2023-10-09T11:20:54.796 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T11:20:54.797 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --owner scheduled_vshankar@teuthology --name vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426 --verbose -- /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/orig.config.yaml 2023-10-09T11:20:54.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:20:54.918 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: vshankar@redhat.com first_in_suite: false job_id: '7418426' kernel: client: branch: testing flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231009.111138 sha1: c68c3f491122d7c1646aa58425d37dc1a8b276ba owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-vshankar-testing-20231009.111138 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: c68c3f491122d7c1646aa58425d37dc1a8b276ba targets: smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD34nbgYcUZvZJZ8f8skn4RhTM6NnE0qu8eFT+hbrug4a313XXlpfaJ8kcTE3m/zuZoHcr/nfate0hq76Hm8RdE= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHxfDg/flbxzoCjGrPvdOZI+jnTNUsQmqFyt+51j2EbHwt1F45TcH7E17DzWehwRL0z3XoUBzGLI2yaQGcjDqkY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-09_11:13:22 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-09T11:20:54.918 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa; will attempt to use it 2023-10-09T11:20:54.919 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks 2023-10-09T11:20:54.919 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-09T11:20:54.920 INFO:teuthology.task.internal:Checking packages... 2023-10-09T11:20:54.940 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-09T11:20:54.940 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-09T11:20:54.940 INFO:teuthology.packaging:ref: None 2023-10-09T11:20:54.940 INFO:teuthology.packaging:tag: None 2023-10-09T11:20:54.940 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T11:20:54.941 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:20:54.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T11:20:55.087 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-09T11:20:55.087 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-09T11:20:55.094 INFO:teuthology.task.internal:no buildpackages task found 2023-10-09T11:20:55.094 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-09T11:20:55.134 INFO:teuthology.task.internal:Saving configuration 2023-10-09T11:20:55.149 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-09T11:20:55.156 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:20:55.181 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:38.345237', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD34nbgYcUZvZJZ8f8skn4RhTM6NnE0qu8eFT+hbrug4a313XXlpfaJ8kcTE3m/zuZoHcr/nfate0hq76Hm8RdE='} 2023-10-09T11:20:55.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:38.346388', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHxfDg/flbxzoCjGrPvdOZI+jnTNUsQmqFyt+51j2EbHwt1F45TcH7E17DzWehwRL0z3XoUBzGLI2yaQGcjDqkY='} 2023-10-09T11:20:55.203 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-09T11:20:55.209 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-09T11:20:55.209 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-09T11:20:55.209 INFO:teuthology.run_tasks:Running task console_log... 2023-10-09T11:20:55.298 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fecada7eb80>, signals=[15]) 2023-10-09T11:20:55.298 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-09T11:20:55.305 INFO:teuthology.task.internal:Opening connections... 2023-10-09T11:20:55.305 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:20:55.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:20:55.375 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:20:55.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:20:55.443 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-09T11:20:55.450 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-10-09T11:20:55.467 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-10-09T11:20:55.467 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-10-09T11:20:55.524 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T11:20:55.524 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T11:20:55.524 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-10-09T11:20:55.524 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-10-09T11:20:55.525 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.4" 2023-10-09T11:20:55.525 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-10-09T11:20:55.525 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T11:20:55.525 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-10-09T11:20:55.525 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T11:20:55.525 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T11:20:55.526 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T11:20:55.526 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T11:20:55.526 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:20:55.526 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T11:20:55.526 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T11:20:55.527 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T11:20:55.527 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T11:20:55.527 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-10-09T11:20:55.552 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-10-09T11:20:55.568 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-10-09T11:20:55.569 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-09T11:20:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T11:20:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T11:20:55.625 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-10-09T11:20:55.626 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-10-09T11:20:55.626 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.4" 2023-10-09T11:20:55.626 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-10-09T11:20:55.626 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T11:20:55.626 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-10-09T11:20:55.627 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T11:20:55.627 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T11:20:55.627 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T11:20:55.627 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T11:20:55.627 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:20:55.627 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T11:20:55.628 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T11:20:55.628 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T11:20:55.628 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T11:20:55.628 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-09T11:20:55.652 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-09T11:20:55.662 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-09T11:20:55.700 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-09T11:20:55.701 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2023-10-09T11:20:55.703 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-10-09T11:20:55.719 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-09T11:20:55.727 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-09T11:20:55.727 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2023-10-09T11:20:55.760 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-10-09T11:20:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T11:20:55.776 INFO:teuthology.orchestra.run.smithi135.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T11:20:55.777 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-09T11:20:55.834 INFO:teuthology.run_tasks:Running task kernel... 2023-10-09T11:20:55.848 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-09T11:20:55.849 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-09T11:20:55.849 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-09T11:20:55.849 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T11:20:55.850 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T11:20:55.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:20:55.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:20:55.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-09T11:20:55.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-09T11:20:56.035 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T11:20:56.035 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-09T11:20:56.036 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-10-09T11:20:56.052 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:20:56.052 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T11:20:56.053 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-09T11:20:56.053 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum upgrade -y linux-firmware 2023-10-09T11:20:56.150 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T11:20:56.150 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-09T11:20:56.150 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2023-10-09T11:20:56.166 INFO:teuthology.orchestra.run.smithi086.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:20:56.166 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T11:20:56.167 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-09T11:20:56.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum upgrade -y linux-firmware 2023-10-09T11:20:57.469 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-09T11:20:57.470 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2023-10-09T11:20:57.629 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-09T11:20:57.630 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-10-09T11:20:58.858 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-09T11:20:59.003 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-09T11:20:59.378 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 33 MB/s | 16 MB 00:00 2023-10-09T11:20:59.730 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-09T11:21:02.655 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 3.7 MB/s | 24 kB 00:00 2023-10-09T11:21:03.107 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-09T11:21:03.521 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-10-09T11:21:03.522 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2023-10-09T11:21:03.522 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-10-09T11:21:03.629 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-09T11:21:03.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T11:21:03.846 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-09T11:21:03.846 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-09T11:21:03.849 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi135.front.sepia.ceph.com to complete... 2023-10-09T11:21:03.990 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-10-09T11:21:03.991 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2023-10-09T11:21:03.991 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-10-09T11:21:04.103 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-09T11:21:04.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-09T11:21:04.321 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-09T11:21:04.321 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-09T11:21:04.323 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi086.front.sepia.ceph.com to complete... 2023-10-09T11:22:08.658 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09 11:22:08 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-09T11:22:08.659 INFO:teuthology.orchestra.run.smithi135.stderr:FINISHED --2023-10-09 11:22:08-- 2023-10-09T11:22:08.659 INFO:teuthology.orchestra.run.smithi135.stderr:Total wall clock time: 1m 5s 2023-10-09T11:22:08.659 INFO:teuthology.orchestra.run.smithi135.stderr:Downloaded: 1 files, 363M in 1m 4s (5.64 MB/s) 2023-10-09T11:22:08.660 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-09T11:22:08.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-09T11:22:10.697 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying... ######################################## 2023-10-09T11:22:11.144 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing... ######################################## 2023-10-09T11:22:11.272 INFO:teuthology.orchestra.run.smithi135.stdout:Updating / installing... 2023-10-09T11:22:47.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09 11:22:47 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-09T11:22:47.673 INFO:teuthology.orchestra.run.smithi086.stderr:FINISHED --2023-10-09 11:22:47-- 2023-10-09T11:22:47.673 INFO:teuthology.orchestra.run.smithi086.stderr:Total wall clock time: 1m 43s 2023-10-09T11:22:47.673 INFO:teuthology.orchestra.run.smithi086.stderr:Downloaded: 1 files, 363M in 1m 43s (3.53 MB/s) 2023-10-09T11:22:47.674 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-09T11:22:47.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-09T11:22:49.128 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-09T11:22:49.408 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying... ######################################## 2023-10-09T11:22:49.832 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing... ######################################## 2023-10-09T11:22:49.967 INFO:teuthology.orchestra.run.smithi086.stdout:Updating / installing... 2023-10-09T11:23:14.907 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-09T11:23:14.908 DEBUG:teuthology.orchestra.run.smithi135:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-09T11:23:14.960 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:14.960 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:14.960 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:14.960 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:14.960 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-09T11:23:14.960 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-09T11:23:14.961 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-09T11:23:14.962 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-09T11:23:14.963 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-09T11:23:14.964 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-09T11:23:14.965 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-09T11:23:14.966 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-09T11:23:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-09T11:23:14.968 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-09T11:23:14.969 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-09T11:23:14.970 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-09T11:23:14.971 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-09T11:23:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-09T11:23:14.973 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-09T11:23:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-09T11:23:14.975 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-09T11:23:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-09T11:23:14.979 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-09T11:23:14.980 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-09T11:23:14.981 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-09T11:23:14.982 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-09T11:23:14.983 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-09T11:23:14.984 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-09T11:23:14.985 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-09T11:23:14.986 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-09T11:23:14.987 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-09T11:23:14.988 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-09T11:23:14.989 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-09T11:23:14.990 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-09T11:23:14.991 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-09T11:23:14.992 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-09T11:23:14.993 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-09T11:23:14.994 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-09T11:23:14.995 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-09T11:23:14.996 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-09T11:23:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-09T11:23:14.998 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-09T11:23:14.999 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-09T11:23:15.000 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-09T11:23:15.001 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-09T11:23:15.002 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-09T11:23:15.003 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-09T11:23:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-09T11:23:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-09T11:23:15.006 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-09T11:23:15.007 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-09T11:23:15.008 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-09T11:23:15.009 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-09T11:23:15.010 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-09T11:23:15.011 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-09T11:23:15.012 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-09T11:23:15.013 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-09T11:23:15.014 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-09T11:23:15.015 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-09T11:23:15.016 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-09T11:23:15.017 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-09T11:23:15.018 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-09T11:23:15.019 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-09T11:23:15.020 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-09T11:23:15.021 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-09T11:23:15.022 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-09T11:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-09T11:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-09T11:23:15.025 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-09T11:23:15.026 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-09T11:23:15.027 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-09T11:23:15.028 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-09T11:23:15.029 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-09T11:23:15.030 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-09T11:23:15.031 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-09T11:23:15.032 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-09T11:23:15.033 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-09T11:23:15.034 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-09T11:23:15.035 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-09T11:23:15.036 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-09T11:23:15.037 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-09T11:23:15.038 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-09T11:23:15.039 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-09T11:23:15.040 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-09T11:23:15.041 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-09T11:23:15.042 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-09T11:23:15.043 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-09T11:23:15.044 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-09T11:23:15.045 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-09T11:23:15.046 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-09T11:23:15.047 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-09T11:23:15.048 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-09T11:23:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-09T11:23:15.050 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-09T11:23:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-09T11:23:15.052 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-09T11:23:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-09T11:23:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-09T11:23:15.055 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-09T11:23:15.056 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-09T11:23:15.057 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-09T11:23:15.058 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-09T11:23:15.059 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-09T11:23:15.060 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-09T11:23:15.061 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-09T11:23:15.062 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-09T11:23:15.063 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-09T11:23:15.064 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-09T11:23:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-09T11:23:15.066 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-09T11:23:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-09T11:23:15.068 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-09T11:23:15.069 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-09T11:23:15.070 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-09T11:23:15.071 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-09T11:23:15.072 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-09T11:23:15.073 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-09T11:23:15.074 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-09T11:23:15.075 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-09T11:23:15.076 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-09T11:23:15.077 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-09T11:23:15.078 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-09T11:23:15.079 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-09T11:23:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-09T11:23:15.081 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-09T11:23:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-09T11:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-09T11:23:15.084 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-09T11:23:15.085 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-09T11:23:15.086 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-09T11:23:15.087 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-09T11:23:15.088 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-09T11:23:15.089 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-09T11:23:15.090 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-09T11:23:15.091 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-09T11:23:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-09T11:23:15.093 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-09T11:23:15.094 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-09T11:23:15.095 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-09T11:23:15.096 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-09T11:23:15.097 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-09T11:23:15.098 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-09T11:23:15.099 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-09T11:23:15.100 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-09T11:23:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-09T11:23:15.102 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-09T11:23:15.103 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-09T11:23:15.104 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-09T11:23:15.105 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-09T11:23:15.106 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-09T11:23:15.107 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-09T11:23:15.108 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-09T11:23:15.109 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-09T11:23:15.110 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-09T11:23:15.111 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-09T11:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-09T11:23:15.113 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-09T11:23:15.114 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-09T11:23:15.115 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-09T11:23:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-09T11:23:15.117 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-09T11:23:15.118 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-09T11:23:15.119 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-09T11:23:15.120 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-09T11:23:15.121 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-09T11:23:15.122 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-09T11:23:15.123 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-09T11:23:15.124 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-09T11:23:15.125 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-09T11:23:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-09T11:23:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-09T11:23:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-09T11:23:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-09T11:23:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-09T11:23:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-09T11:23:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-09T11:23:15.127 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:15.127 DEBUG:teuthology.orchestra.run.smithi135:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:postinstall scriptlet (using /bin/sh): 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-10-09T11:23:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:15.152 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-10-09T11:23:15.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2023-10-09T11:23:15.227 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.02 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 99.el8_4.1 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Group : System Environment/Base 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 9264631 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T11:23:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:Relocations : (not relocatable) 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : Red Hat, Inc. 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : Red Hat, Inc. 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2023-10-09T11:23:15.229 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:23:15.230 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T11:23:15.231 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T11:23:15.231 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:15.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T11:23:19.363 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2023-10-09T11:23:21.573 INFO:teuthology.orchestra.run.smithi135.stderr:done 2023-10-09T11:23:21.575 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-10-09T11:23:21.595 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.v7J0g5ilfQ 2023-10-09T11:23:21.595 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.v7J0g5ilfQ 2023-10-09T11:23:21.669 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.v7J0g5ilfQ 2023-10-09T11:23:21.843 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.v7J0g5ilfQ is 6KB 2023-10-09T11:23:21.868 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.v7J0g5ilfQ 2023-10-09T11:23:21.883 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T11:23:21.955 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T11:23:21.955 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T11:23:21.956 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T11:23:21.956 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T11:23:21.956 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-09T11:23:21.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:22.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2023-10-09T11:23:27.771 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-09T11:23:52.130 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-09T11:23:52.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-09T11:23:52.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:52.683 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-09T11:23:52.683 DEBUG:teuthology.orchestra.run.smithi086:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-09T11:23:52.744 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.744 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.744 INFO:teuthology.orchestra.run.smithi086.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-09T11:23:52.745 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-09T11:23:52.746 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-09T11:23:52.747 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-09T11:23:52.748 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-09T11:23:52.749 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-09T11:23:52.750 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-09T11:23:52.751 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-09T11:23:52.752 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-09T11:23:52.753 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-09T11:23:52.754 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-09T11:23:52.755 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-09T11:23:52.756 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-09T11:23:52.757 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-09T11:23:52.758 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-09T11:23:52.759 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-09T11:23:52.760 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-09T11:23:52.761 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-09T11:23:52.762 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-09T11:23:52.763 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-09T11:23:52.764 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-09T11:23:52.765 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-09T11:23:52.766 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-09T11:23:52.767 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-09T11:23:52.768 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-09T11:23:52.769 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-09T11:23:52.770 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-09T11:23:52.771 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-09T11:23:52.772 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-09T11:23:52.773 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-09T11:23:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-09T11:23:52.775 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-09T11:23:52.776 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-09T11:23:52.777 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-09T11:23:52.778 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-09T11:23:52.779 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-09T11:23:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-09T11:23:52.781 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-09T11:23:52.782 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-09T11:23:52.783 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-09T11:23:52.784 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-09T11:23:52.785 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-09T11:23:52.786 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-09T11:23:52.787 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-09T11:23:52.788 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-09T11:23:52.789 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-09T11:23:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-09T11:23:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-09T11:23:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-09T11:23:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-09T11:23:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-09T11:23:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-09T11:23:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-09T11:23:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-09T11:23:52.792 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-09T11:23:52.793 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-09T11:23:52.794 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-09T11:23:52.795 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-09T11:23:52.796 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-09T11:23:52.797 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-09T11:23:52.798 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-09T11:23:52.799 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-09T11:23:52.800 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-09T11:23:52.801 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-09T11:23:52.802 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-09T11:23:52.803 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-09T11:23:52.804 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-09T11:23:52.805 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-09T11:23:52.806 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-09T11:23:52.807 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-09T11:23:52.808 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-09T11:23:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-09T11:23:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-09T11:23:52.811 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-09T11:23:52.812 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-09T11:23:52.813 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-09T11:23:52.814 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-09T11:23:52.815 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-09T11:23:52.816 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-09T11:23:52.817 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-09T11:23:52.818 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-09T11:23:52.819 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-09T11:23:52.820 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-09T11:23:52.821 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-09T11:23:52.822 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-09T11:23:52.823 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-09T11:23:52.824 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-09T11:23:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-09T11:23:52.826 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-09T11:23:52.829 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-09T11:23:52.829 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-09T11:23:52.829 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-09T11:23:52.830 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-09T11:23:52.831 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-09T11:23:52.832 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-09T11:23:52.832 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-09T11:23:52.832 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-09T11:23:52.832 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-09T11:23:52.832 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-09T11:23:52.832 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-09T11:23:52.832 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-09T11:23:52.833 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-09T11:23:52.834 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-09T11:23:52.835 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-09T11:23:52.836 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-09T11:23:52.837 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-09T11:23:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-09T11:23:52.839 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-09T11:23:52.840 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-09T11:23:52.841 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-09T11:23:52.842 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-09T11:23:52.843 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-09T11:23:52.844 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-09T11:23:52.845 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-09T11:23:52.846 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-09T11:23:52.847 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-09T11:23:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-09T11:23:52.849 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-09T11:23:52.850 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-09T11:23:52.851 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-09T11:23:52.852 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-09T11:23:52.853 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-09T11:23:52.854 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-09T11:23:52.855 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-09T11:23:52.856 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-09T11:23:52.857 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-09T11:23:52.858 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-09T11:23:52.859 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-09T11:23:52.860 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-09T11:23:52.861 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-09T11:23:52.862 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-09T11:23:52.862 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-09T11:23:52.862 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-09T11:23:52.862 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-09T11:23:52.862 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-09T11:23:52.862 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-09T11:23:52.862 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-09T11:23:52.863 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-09T11:23:52.864 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-09T11:23:52.865 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-09T11:23:52.866 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-09T11:23:52.867 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-09T11:23:52.868 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-09T11:23:52.869 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-09T11:23:52.870 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-09T11:23:52.871 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-09T11:23:52.872 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-09T11:23:52.873 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-09T11:23:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-09T11:23:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-09T11:23:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-09T11:23:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-09T11:23:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-09T11:23:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-09T11:23:52.874 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-09T11:23:52.875 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-09T11:23:52.876 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-09T11:23:52.877 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-09T11:23:52.878 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-09T11:23:52.879 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-09T11:23:52.880 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-09T11:23:52.881 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-09T11:23:52.882 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-09T11:23:52.883 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-09T11:23:52.884 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-09T11:23:52.885 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-09T11:23:52.886 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-09T11:23:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-09T11:23:52.888 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-09T11:23:52.889 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-09T11:23:52.890 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-09T11:23:52.891 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-09T11:23:52.892 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-09T11:23:52.893 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-09T11:23:52.894 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-09T11:23:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-09T11:23:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-09T11:23:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-09T11:23:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-09T11:23:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-09T11:23:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-09T11:23:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-09T11:23:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-09T11:23:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-09T11:23:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-09T11:23:52.899 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-09T11:23:52.900 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-09T11:23:52.901 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-09T11:23:52.902 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-09T11:23:52.903 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-09T11:23:52.904 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-09T11:23:52.904 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-09T11:23:52.904 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-09T11:23:52.904 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-09T11:23:52.904 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-09T11:23:52.904 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-09T11:23:52.904 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-09T11:23:52.905 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-09T11:23:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-09T11:23:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-09T11:23:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-09T11:23:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-09T11:23:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-09T11:23:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-09T11:23:52.906 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-09T11:23:52.907 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-09T11:23:52.907 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-09T11:23:52.907 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-09T11:23:52.907 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-09T11:23:52.907 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-09T11:23:52.907 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-09T11:23:52.908 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-09T11:23:52.909 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-09T11:23:52.910 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-09T11:23:52.911 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-09T11:23:52.912 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-09T11:23:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-09T11:23:52.914 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-09T11:23:52.915 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-09T11:23:52.916 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-09T11:23:52.917 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-09T11:23:52.918 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-09T11:23:52.919 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-09T11:23:52.920 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-09T11:23:52.921 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-09T11:23:52.922 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-09T11:23:52.923 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-09T11:23:52.924 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-09T11:23:52.925 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-09T11:23:52.926 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-09T11:23:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-09T11:23:52.928 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-09T11:23:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-09T11:23:52.930 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-09T11:23:52.930 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-09T11:23:52.930 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-09T11:23:52.930 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-09T11:23:52.930 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-09T11:23:52.930 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-09T11:23:52.931 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-09T11:23:52.932 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-09T11:23:52.933 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-09T11:23:52.934 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-09T11:23:52.934 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-09T11:23:52.934 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-09T11:23:52.935 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.935 DEBUG:teuthology.orchestra.run.smithi086:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-09T11:23:52.959 INFO:teuthology.orchestra.run.smithi086.stdout:postinstall scriptlet (using /bin/sh): 2023-10-09T11:23:52.959 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-09T11:23:52.960 INFO:teuthology.orchestra.run.smithi086.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-09T11:23:52.961 INFO:teuthology.orchestra.run.smithi086.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-09T11:23:52.961 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.961 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2023-10-09T11:23:52.961 INFO:teuthology.orchestra.run.smithi086.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-09T11:23:52.961 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-09T11:23:52.961 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:52.961 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2023-10-09T11:23:52.962 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2023-10-09T11:23:53.036 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2023-10-09T11:23:53.036 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2023-10-09T11:23:53.036 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.02 2023-10-09T11:23:53.036 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 99.el8_4.1 2023-10-09T11:23:53.036 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2023-10-09T11:23:53.036 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T11:23:53.036 INFO:teuthology.orchestra.run.smithi086.stdout:Group : System Environment/Base 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 9264631 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:Relocations : (not relocatable) 2023-10-09T11:23:53.037 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : Red Hat, Inc. 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : Red Hat, Inc. 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:23:53.038 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T11:23:53.039 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T11:23:53.040 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:53.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T11:23:56.048 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2023-10-09T11:23:57.908 INFO:teuthology.orchestra.run.smithi086.stderr:done 2023-10-09T11:23:57.909 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2023-10-09T11:23:57.947 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.OH9QdFHCz4 2023-10-09T11:23:57.947 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OH9QdFHCz4 2023-10-09T11:23:58.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.OH9QdFHCz4 2023-10-09T11:23:58.195 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.OH9QdFHCz4 is 6KB 2023-10-09T11:23:58.244 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.OH9QdFHCz4 2023-10-09T11:23:58.257 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T11:23:58.323 INFO:teuthology.orchestra.run.smithi086.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T11:23:58.323 INFO:teuthology.orchestra.run.smithi086.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T11:23:58.323 INFO:teuthology.orchestra.run.smithi086.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T11:23:58.324 INFO:teuthology.orchestra.run.smithi086.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T11:23:58.324 INFO:teuthology.orchestra.run.smithi086.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-09T11:23:58.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-09T11:23:58.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2023-10-09T11:24:10.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-09T11:24:19.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-09T11:24:19.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:24:22.554 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-09T11:24:28.533 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-09T11:24:28.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-09T11:24:28.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:24:34.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-09T11:24:34.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:24:47.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-09T11:24:56.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-09T11:24:56.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:24:59.162 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-09T11:25:06.349 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-09T11:25:06.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-09T11:25:06.741 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-09T11:25:06.742 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-10-09T11:25:06.777 INFO:teuthology.orchestra.run.smithi135.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-09T11:25:06.777 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:25:06.777 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T11:25:06.777 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T11:25:07.778 DEBUG:teuthology.parallel:result is None 2023-10-09T11:25:11.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-09T11:25:11.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:25:29.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-09T11:25:44.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-09T11:25:44.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:25:45.028 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-10-09T11:25:45.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-09T11:25:45.493 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-09T11:25:45.493 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2023-10-09T11:25:45.528 INFO:teuthology.orchestra.run.smithi086.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-09T11:25:45.528 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-09T11:25:45.528 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T11:25:45.528 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T11:25:46.529 DEBUG:teuthology.parallel:result is None 2023-10-09T11:25:46.529 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-09T11:25:46.539 INFO:teuthology.task.internal:Creating test directory... 2023-10-09T11:25:46.539 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T11:25:46.543 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T11:25:46.585 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-09T11:25:46.591 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-09T11:25:46.615 INFO:teuthology.task.internal:Creating archive directory... 2023-10-09T11:25:46.616 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T11:25:46.620 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T11:25:46.682 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-09T11:25:46.689 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-09T11:25:46.689 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T11:25:46.693 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T11:25:46.846 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:25:46.863 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:25:46.879 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:25:46.899 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:25:46.902 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-09T11:25:46.910 INFO:teuthology.task.internal:Configuring sudo... 2023-10-09T11:25:46.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T11:25:46.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T11:25:46.975 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-09T11:25:46.984 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-09T11:25:46.984 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T11:25:46.988 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T11:25:47.024 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:25:47.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:25:47.225 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:25:47.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:25:47.369 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:25:47.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T11:25:47.463 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:25:47.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:25:47.605 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:25:47.670 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:25:47.744 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:25:47.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T11:25:47.813 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2023-10-09T11:25:47.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-10-09T11:25:47.912 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:25:47.966 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:25:48.399 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-09T11:25:48.408 INFO:teuthology.task.internal:Starting timer... 2023-10-09T11:25:48.408 INFO:teuthology.run_tasks:Running task pcp... 2023-10-09T11:25:48.436 INFO:teuthology.run_tasks:Running task selinux... 2023-10-09T11:25:48.468 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-09T11:25:48.468 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2023-10-09T11:25:48.599 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: [ OK ] 2023-10-09T11:25:48.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-10-09T11:25:48.716 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: [ OK ] 2023-10-09T11:25:48.720 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-09T11:25:48.720 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2023-10-09T11:25:48.759 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2023-10-09T11:25:48.759 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-10-09T11:25:48.803 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-10-09T11:25:48.804 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2023-10-09T11:25:48.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:25:48.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:25:48.866 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:25:48.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:25:48.930 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-09T11:25:48.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2023-10-09T11:25:48.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-10-09T11:25:49.060 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-09T11:25:49.070 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-09T11:25:49.070 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-09T11:25:49.085 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-09T11:25:49.086 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi086.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-09T11:37:09.229 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2023-10-09T11:37:09.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-09T11:37:09.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:37:09.313 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-10-09T11:37:09.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-09T11:37:09.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-09T11:37:09.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:37:09.507 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-09T11:37:09.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-09T11:37:09.614 INFO:teuthology.run_tasks:Running task clock... 2023-10-09T11:37:09.626 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-09T11:37:09.626 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T11:37:09.626 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:37:09.631 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T11:37:09.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:37:09.693 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T11:37:09.722 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T11:37:09.726 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T11:37:09.756 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T11:37:09.785 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2023-10-09T11:37:09.812 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2023-10-09T11:37:09.816 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-10-09T11:37:09.843 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-10-09T11:37:09.844 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T11:37:09.876 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T11:37:09.878 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T11:37:09.910 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T11:37:09.970 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2023-10-09T11:37:09.974 INFO:teuthology.orchestra.run.smithi086.stdout:210 Number of sources = 4 2023-10-09T11:37:09.974 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:37:09.975 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2023-10-09T11:37:09.975 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.975 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.975 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.975 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.993 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-10-09T11:37:09.998 INFO:teuthology.orchestra.run.smithi135.stdout:210 Number of sources = 4 2023-10-09T11:37:09.998 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:37:09.998 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-10-09T11:37:09.998 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.998 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.998 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.998 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:37:09.999 INFO:teuthology.run_tasks:Running task install... 2023-10-09T11:37:10.007 DEBUG:teuthology.task.install:project ceph 2023-10-09T11:37:10.008 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-09T11:37:10.008 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-09T11:37:10.008 INFO:teuthology.task.install:Using flavor: default 2023-10-09T11:37:10.014 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-09T11:37:10.014 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-09T11:37:10.014 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T11:37:10.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:37:10.016 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T11:37:10.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:37:10.236 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T11:37:10.237 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T11:37:10.247 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T11:37:10.247 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T11:37:10.636 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T11:37:10.636 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:37:10.636 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T11:37:10.639 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T11:37:10.640 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:37:10.640 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T11:37:10.702 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T11:37:10.703 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T11:37:10.704 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T11:37:10.704 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T11:37:10.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T11:37:10.807 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T11:37:10.894 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T11:37:10.895 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T11:37:10.954 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2023-10-09T11:37:10.955 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-10-09T11:37:10.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2023-10-09T11:37:10.958 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-10-09T11:37:11.416 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-09T11:37:11.419 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-09T11:37:11.778 INFO:teuthology.orchestra.run.smithi135.stdout:44 files removed 2023-10-09T11:37:11.786 INFO:teuthology.orchestra.run.smithi086.stdout:44 files removed 2023-10-09T11:37:11.836 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T11:37:11.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T11:37:12.294 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-09T11:37:12.302 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-09T11:37:13.554 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 104 kB/s | 78 kB 00:00 2023-10-09T11:37:13.697 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 88 kB/s | 78 kB 00:00 2023-10-09T11:37:14.287 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-10-09T11:37:14.424 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-10-09T11:37:14.907 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-10-09T11:37:15.020 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-09T11:37:15.172 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-10-09T11:37:15.284 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-09T11:37:15.713 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-09T11:37:15.877 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 28 MB/s | 16 MB 00:00 2023-10-09T11:37:19.256 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2023-10-09T11:37:19.423 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-09T11:37:19.772 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 MB/s | 38 MB 00:00 2023-10-09T11:37:19.897 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 84 MB/s | 33 MB 00:00 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 MB/s | 38 MB 00:00 2023-10-09T11:37:25.552 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 86 MB/s | 33 MB 00:00 2023-10-09T11:37:33.825 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:37:33.826 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:37:33.836 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T11:37:33.837 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T11:37:33.838 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T11:37:33.839 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T11:37:33.841 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T11:37:33.843 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T11:37:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T11:37:34.038 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:37:34.039 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:37:34.051 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T11:37:34.052 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T11:37:34.053 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T11:37:34.053 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T11:37:34.055 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T11:37:34.058 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T11:37:34.059 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T11:37:34.345 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-10-09T11:37:34.355 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================================================== 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================================================== 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T11:37:34.356 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T11:37:34.357 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T11:37:34.358 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T11:37:34.359 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T11:37:34.360 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T11:37:34.361 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T11:37:34.362 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T11:37:34.363 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T11:37:34.364 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T11:37:34.365 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T11:37:34.366 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T11:37:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T11:37:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:37:34.367 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2023-10-09T11:37:34.367 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================================================== 2023-10-09T11:37:34.367 INFO:teuthology.orchestra.run.smithi086.stdout:Install 118 Packages 2023-10-09T11:37:34.367 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 2 Packages 2023-10-09T11:37:34.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:37:34.368 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 202 M 2023-10-09T11:37:34.368 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2023-10-09T11:37:34.573 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-10-09T11:37:34.584 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================================== 2023-10-09T11:37:34.584 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-10-09T11:37:34.584 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================================== 2023-10-09T11:37:34.584 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:37:34.585 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T11:37:34.586 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:37:34.587 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T11:37:34.588 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T11:37:34.589 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T11:37:34.590 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T11:37:34.591 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T11:37:34.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T11:37:34.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T11:37:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================================== 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout:Install 118 Packages 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:37:34.595 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 202 M 2023-10-09T11:37:34.596 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-10-09T11:37:35.027 INFO:teuthology.orchestra.run.smithi135.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-10-09T11:37:35.090 INFO:teuthology.orchestra.run.smithi086.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-10-09T11:37:35.856 INFO:teuthology.orchestra.run.smithi086.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.1 MB/s | 876 kB 00:00 2023-10-09T11:37:35.937 INFO:teuthology.orchestra.run.smithi086.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 2.0 MB/s | 162 kB 00:00 2023-10-09T11:37:36.701 INFO:teuthology.orchestra.run.smithi135.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 523 kB/s | 876 kB 00:01 2023-10-09T11:37:36.943 INFO:teuthology.orchestra.run.smithi086.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 2.3 MB/s | 2.3 MB 00:01 2023-10-09T11:37:37.042 INFO:teuthology.orchestra.run.smithi135.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 475 kB/s | 162 kB 00:00 2023-10-09T11:37:37.374 INFO:teuthology.orchestra.run.smithi086.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 3.6 MB/s | 1.6 MB 00:00 2023-10-09T11:37:38.210 INFO:teuthology.orchestra.run.smithi086.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 4.7 MB/s | 3.9 MB 00:00 2023-10-09T11:37:38.476 INFO:teuthology.orchestra.run.smithi086.stdout:(7/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.4 MB/s | 5.2 MB 00:03 2023-10-09T11:37:39.233 INFO:teuthology.orchestra.run.smithi135.stdout:(4/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.1 MB/s | 5.2 MB 00:04 2023-10-09T11:37:40.408 INFO:teuthology.orchestra.run.smithi135.stdout:(5/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 701 kB/s | 2.3 MB 00:03 2023-10-09T11:37:40.459 INFO:teuthology.orchestra.run.smithi135.stdout:(6/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 1.3 MB/s | 1.6 MB 00:01 2023-10-09T11:37:41.348 INFO:teuthology.orchestra.run.smithi086.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 5.3 MB/s | 17 MB 00:03 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi086.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 302 kB/s | 24 kB 00:00 2023-10-09T11:37:46.357 INFO:teuthology.orchestra.run.smithi135.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 677 kB/s | 3.9 MB 00:05 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi086.stdout:(10/120): ceph-common-17.2.6-1320.g08cac018.el8 1.9 MB/s | 23 MB 00:12 2023-10-09T11:37:47.049 INFO:teuthology.orchestra.run.smithi086.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 1.4 MB/s | 255 kB 00:00 2023-10-09T11:37:47.135 INFO:teuthology.orchestra.run.smithi086.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 289 kB/s | 25 kB 00:00 2023-10-09T11:37:47.597 INFO:teuthology.orchestra.run.smithi086.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 1.7 MB/s | 797 kB 00:00 2023-10-09T11:37:47.778 INFO:teuthology.orchestra.run.smithi086.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 963 kB/s | 174 kB 00:00 2023-10-09T11:37:47.870 INFO:teuthology.orchestra.run.smithi086.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 1.4 MB/s | 130 kB 00:00 2023-10-09T11:37:48.195 INFO:teuthology.orchestra.run.smithi086.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 1.5 MB/s | 507 kB 00:00 2023-10-09T11:37:50.347 INFO:teuthology.orchestra.run.smithi086.stdout:(17/120): ceph-radosgw-17.2.6-1320.g08cac018.el 1.4 MB/s | 17 MB 00:11 2023-10-09T11:37:50.414 INFO:teuthology.orchestra.run.smithi086.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 674 kB/s | 45 kB 00:00 2023-10-09T11:37:50.486 INFO:teuthology.orchestra.run.smithi086.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 1.6 MB/s | 115 kB 00:00 2023-10-09T11:37:50.632 INFO:teuthology.orchestra.run.smithi086.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 1.3 MB/s | 190 kB 00:00 2023-10-09T11:37:50.859 INFO:teuthology.orchestra.run.smithi086.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 1.6 MB/s | 371 kB 00:00 2023-10-09T11:37:51.095 INFO:teuthology.orchestra.run.smithi086.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 1.5 MB/s | 358 kB 00:00 2023-10-09T11:37:51.142 INFO:teuthology.orchestra.run.smithi086.stdout:(23/120): librgw2-17.2.6-1320.g08cac018.el8.x86 1.9 MB/s | 5.6 MB 00:02 2023-10-09T11:37:51.160 INFO:teuthology.orchestra.run.smithi086.stdout:(24/120): python3-rgw-17.2.6-1320.g08cac018.el8 1.6 MB/s | 107 kB 00:00 2023-10-09T11:37:51.307 INFO:teuthology.orchestra.run.smithi086.stdout:(25/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 549 kB/s | 90 kB 00:00 2023-10-09T11:37:51.475 INFO:teuthology.orchestra.run.smithi086.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 1.0 MB/s | 173 kB 00:00 2023-10-09T11:37:51.559 INFO:teuthology.orchestra.run.smithi086.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 276 kB/s | 23 kB 00:00 2023-10-09T11:37:51.737 INFO:teuthology.orchestra.run.smithi086.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 679 kB/s | 121 kB 00:00 2023-10-09T11:37:53.051 INFO:teuthology.orchestra.run.smithi086.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 1.3 MB/s | 1.7 MB 00:01 2023-10-09T11:37:53.066 INFO:teuthology.orchestra.run.smithi086.stdout:(30/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 1.8 MB/s | 3.5 MB 00:01 2023-10-09T11:37:53.206 INFO:teuthology.orchestra.run.smithi086.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 1.7 MB/s | 238 kB 00:00 2023-10-09T11:37:53.272 INFO:teuthology.orchestra.run.smithi086.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 714 kB/s | 47 kB 00:00 2023-10-09T11:37:53.338 INFO:teuthology.orchestra.run.smithi086.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 223 kB/s | 14 kB 00:00 2023-10-09T11:37:53.479 INFO:teuthology.orchestra.run.smithi086.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 1.9 MB/s | 267 kB 00:00 2023-10-09T11:37:53.542 INFO:teuthology.orchestra.run.smithi086.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-09T11:37:53.646 INFO:teuthology.orchestra.run.smithi086.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 173 kB/s | 18 kB 00:00 2023-10-09T11:37:53.790 INFO:teuthology.orchestra.run.smithi086.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.1 MB/s | 306 kB 00:00 2023-10-09T11:37:53.812 INFO:teuthology.orchestra.run.smithi086.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 2.7 MB/s | 59 kB 00:00 2023-10-09T11:37:53.834 INFO:teuthology.orchestra.run.smithi086.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 3.3 MB/s | 75 kB 00:00 2023-10-09T11:37:53.880 INFO:teuthology.orchestra.run.smithi135.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 1.2 MB/s | 17 MB 00:13 2023-10-09T11:37:53.887 INFO:teuthology.orchestra.run.smithi086.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 8.9 MB/s | 476 kB 00:00 2023-10-09T11:37:53.907 INFO:teuthology.orchestra.run.smithi086.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.2 MB/s | 44 kB 00:00 2023-10-09T11:37:53.931 INFO:teuthology.orchestra.run.smithi086.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 7.7 MB/s | 185 kB 00:00 2023-10-09T11:37:53.951 INFO:teuthology.orchestra.run.smithi135.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 344 kB/s | 24 kB 00:00 2023-10-09T11:37:53.959 INFO:teuthology.orchestra.run.smithi086.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.2 MB/s | 33 kB 00:00 2023-10-09T11:37:53.986 INFO:teuthology.orchestra.run.smithi086.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 614 kB/s | 16 kB 00:00 2023-10-09T11:37:54.009 INFO:teuthology.orchestra.run.smithi086.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 7.4 MB/s | 173 kB 00:00 2023-10-09T11:37:54.036 INFO:teuthology.orchestra.run.smithi086.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 14 MB/s | 384 kB 00:00 2023-10-09T11:37:54.065 INFO:teuthology.orchestra.run.smithi086.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 2.8 MB/s | 81 kB 00:00 2023-10-09T11:37:54.084 INFO:teuthology.orchestra.run.smithi086.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 577 kB/s | 11 kB 00:00 2023-10-09T11:37:54.109 INFO:teuthology.orchestra.run.smithi086.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 720 kB/s | 18 kB 00:00 2023-10-09T11:37:54.160 INFO:teuthology.orchestra.run.smithi086.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 23 MB/s | 1.2 MB 00:00 2023-10-09T11:37:54.180 INFO:teuthology.orchestra.run.smithi086.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2023-10-09T11:37:54.200 INFO:teuthology.orchestra.run.smithi086.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2023-10-09T11:37:54.224 INFO:teuthology.orchestra.run.smithi086.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 2.5 MB/s | 60 kB 00:00 2023-10-09T11:37:54.250 INFO:teuthology.orchestra.run.smithi086.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 11 MB/s | 283 kB 00:00 2023-10-09T11:37:54.270 INFO:teuthology.orchestra.run.smithi086.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 807 kB/s | 16 kB 00:00 2023-10-09T11:37:54.290 INFO:teuthology.orchestra.run.smithi086.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2023-10-09T11:37:54.311 INFO:teuthology.orchestra.run.smithi086.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 9.1 MB/s | 196 kB 00:00 2023-10-09T11:37:54.341 INFO:teuthology.orchestra.run.smithi086.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 2.1 MB/s | 64 kB 00:00 2023-10-09T11:37:54.361 INFO:teuthology.orchestra.run.smithi086.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 952 kB/s | 19 kB 00:00 2023-10-09T11:37:54.381 INFO:teuthology.orchestra.run.smithi086.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2023-10-09T11:37:54.401 INFO:teuthology.orchestra.run.smithi086.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2023-10-09T11:37:54.421 INFO:teuthology.orchestra.run.smithi086.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2023-10-09T11:37:54.446 INFO:teuthology.orchestra.run.smithi086.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 10 MB/s | 255 kB 00:00 2023-10-09T11:37:54.467 INFO:teuthology.orchestra.run.smithi086.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2023-10-09T11:37:54.493 INFO:teuthology.orchestra.run.smithi086.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 2.4 MB/s | 61 kB 00:00 2023-10-09T11:37:54.513 INFO:teuthology.orchestra.run.smithi086.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 4.2 MB/s | 85 kB 00:00 2023-10-09T11:37:54.534 INFO:teuthology.orchestra.run.smithi086.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2023-10-09T11:37:54.590 INFO:teuthology.orchestra.run.smithi086.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 31 MB/s | 1.7 MB 00:00 2023-10-09T11:37:54.594 INFO:teuthology.orchestra.run.smithi086.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-09T11:37:54.625 INFO:teuthology.orchestra.run.smithi086.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 616 kB/s | 19 kB 00:00 2023-10-09T11:37:54.640 INFO:teuthology.orchestra.run.smithi086.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.8 MB/s | 43 kB 00:00 2023-10-09T11:37:54.656 INFO:teuthology.orchestra.run.smithi086.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.4 MB/s | 155 kB 00:00 2023-10-09T11:37:54.673 INFO:teuthology.orchestra.run.smithi086.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-09T11:37:54.688 INFO:teuthology.orchestra.run.smithi086.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.3 MB/s | 48 kB 00:00 2023-10-09T11:37:54.704 INFO:teuthology.orchestra.run.smithi086.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-10-09T11:37:54.717 INFO:teuthology.orchestra.run.smithi086.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.4 MB/s | 43 kB 00:00 2023-10-09T11:37:54.767 INFO:teuthology.orchestra.run.smithi086.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 47 MB/s | 2.3 MB 00:00 2023-10-09T11:37:54.780 INFO:teuthology.orchestra.run.smithi086.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-10-09T11:37:54.801 INFO:teuthology.orchestra.run.smithi086.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 28 MB/s | 605 kB 00:00 2023-10-09T11:37:54.815 INFO:teuthology.orchestra.run.smithi086.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 6.4 MB/s | 83 kB 00:00 2023-10-09T11:37:54.827 INFO:teuthology.orchestra.run.smithi086.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 4.7 MB/s | 59 kB 00:00 2023-10-09T11:37:54.842 INFO:teuthology.orchestra.run.smithi086.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-09T11:37:54.854 INFO:teuthology.orchestra.run.smithi086.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.2 MB/s | 38 kB 00:00 2023-10-09T11:37:54.867 INFO:teuthology.orchestra.run.smithi086.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.4 MB/s | 86 kB 00:00 2023-10-09T11:37:54.880 INFO:teuthology.orchestra.run.smithi086.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.7 MB/s | 58 kB 00:00 2023-10-09T11:37:54.892 INFO:teuthology.orchestra.run.smithi086.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.9 MB/s | 47 kB 00:00 2023-10-09T11:37:54.911 INFO:teuthology.orchestra.run.smithi086.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 29 MB/s | 559 kB 00:00 2023-10-09T11:37:54.932 INFO:teuthology.orchestra.run.smithi086.stdout:(88/120): libgfortran-8.4.1-1.el8.x86_64.rpm 30 MB/s | 639 kB 00:00 2023-10-09T11:37:54.945 INFO:teuthology.orchestra.run.smithi086.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.3 MB/s | 70 kB 00:00 2023-10-09T11:37:54.961 INFO:teuthology.orchestra.run.smithi086.stdout:(90/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-09T11:37:54.974 INFO:teuthology.orchestra.run.smithi086.stdout:(91/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.3 MB/s | 97 kB 00:00 2023-10-09T11:37:55.215 INFO:teuthology.orchestra.run.smithi086.stdout:(92/120): python3-scipy-1.0.0-20.module+el8.1.0 61 MB/s | 15 MB 00:00 2023-10-09T11:37:55.228 INFO:teuthology.orchestra.run.smithi086.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.4 MB/s | 44 kB 00:00 2023-10-09T11:37:55.240 INFO:teuthology.orchestra.run.smithi086.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-10-09T11:37:55.253 INFO:teuthology.orchestra.run.smithi086.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-10-09T11:37:55.269 INFO:teuthology.orchestra.run.smithi086.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 20 MB/s | 320 kB 00:00 2023-10-09T11:37:55.288 INFO:teuthology.orchestra.run.smithi086.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-09T11:37:55.376 INFO:teuthology.orchestra.run.smithi086.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 55 MB/s | 4.8 MB 00:00 2023-10-09T11:37:55.389 INFO:teuthology.orchestra.run.smithi086.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-10-09T11:37:55.411 INFO:teuthology.orchestra.run.smithi086.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 32 MB/s | 688 kB 00:00 2023-10-09T11:37:55.426 INFO:teuthology.orchestra.run.smithi086.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 17 MB/s | 259 kB 00:00 2023-10-09T11:37:55.441 INFO:teuthology.orchestra.run.smithi086.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 15 MB/s | 225 kB 00:00 2023-10-09T11:37:55.454 INFO:teuthology.orchestra.run.smithi086.stdout:(103/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 9.6 MB/s | 126 kB 00:00 2023-10-09T11:37:55.523 INFO:teuthology.orchestra.run.smithi086.stdout:(104/120): python3-numpy-1.14.3-9.el8.x86_64.rp 54 MB/s | 3.7 MB 00:00 2023-10-09T11:37:55.539 INFO:teuthology.orchestra.run.smithi086.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-09T11:37:55.559 INFO:teuthology.orchestra.run.smithi086.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 27 MB/s | 538 kB 00:00 2023-10-09T11:37:55.576 INFO:teuthology.orchestra.run.smithi086.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 18 MB/s | 302 kB 00:00 2023-10-09T11:37:55.590 INFO:teuthology.orchestra.run.smithi086.stdout:(108/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-09T11:37:55.603 INFO:teuthology.orchestra.run.smithi086.stdout:(109/120): python3-pyasn1-modules-0.3.7-6.el8.n 8.3 MB/s | 110 kB 00:00 2023-10-09T11:37:55.620 INFO:teuthology.orchestra.run.smithi086.stdout:(110/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-10-09T11:37:55.632 INFO:teuthology.orchestra.run.smithi086.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.7 MB/s | 20 kB 00:00 2023-10-09T11:37:55.654 INFO:teuthology.orchestra.run.smithi086.stdout:(112/120): libtool-2.4.6-25.el8.x86_64.rpm 32 MB/s | 709 kB 00:00 2023-10-09T11:37:55.667 INFO:teuthology.orchestra.run.smithi086.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.2 MB/s | 54 kB 00:00 2023-10-09T11:37:55.753 INFO:teuthology.orchestra.run.smithi086.stdout:(114/120): openblas-threads-0.3.12-1.el8.x86_64 55 MB/s | 4.7 MB 00:00 2023-10-09T11:37:55.839 INFO:teuthology.orchestra.run.smithi086.stdout:(115/120): openblas-0.3.12-1.el8.x86_64.rpm 54 MB/s | 4.6 MB 00:00 2023-10-09T11:37:55.862 INFO:teuthology.orchestra.run.smithi086.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 31 MB/s | 713 kB 00:00 2023-10-09T11:37:57.176 INFO:teuthology.orchestra.run.smithi086.stdout:(117/120): ceph-mgr-diskprediction-local-17.2.6 1.8 MB/s | 7.4 MB 00:04 2023-10-09T11:37:58.242 INFO:teuthology.orchestra.run.smithi086.stdout:(118/120): librados2-17.2.6-1320.g08cac018.el8. 1.5 MB/s | 3.5 MB 00:02 2023-10-09T11:37:59.875 INFO:teuthology.orchestra.run.smithi086.stdout:(119/120): librbd1-17.2.6-1320.g08cac018.el8.x8 1.3 MB/s | 3.6 MB 00:02 2023-10-09T11:38:01.295 INFO:teuthology.orchestra.run.smithi135.stdout:(10/120): ceph-common-17.2.6-1320.g08cac018.el8 901 kB/s | 23 MB 00:26 2023-10-09T11:38:01.577 INFO:teuthology.orchestra.run.smithi135.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 907 kB/s | 255 kB 00:00 2023-10-09T11:38:01.656 INFO:teuthology.orchestra.run.smithi135.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 318 kB/s | 25 kB 00:00 2023-10-09T11:38:02.349 INFO:teuthology.orchestra.run.smithi086.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 2.5 MB/s | 52 MB 00:20 2023-10-09T11:38:02.353 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2023-10-09T11:38:02.353 INFO:teuthology.orchestra.run.smithi086.stdout:Total 7.2 MB/s | 202 MB 00:27 2023-10-09T11:38:02.421 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2023-10-09T11:38:02.535 INFO:teuthology.orchestra.run.smithi135.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 907 kB/s | 797 kB 00:00 2023-10-09T11:38:02.547 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2023-10-09T11:38:02.547 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2023-10-09T11:38:02.762 INFO:teuthology.orchestra.run.smithi135.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 769 kB/s | 174 kB 00:00 2023-10-09T11:38:02.954 INFO:teuthology.orchestra.run.smithi135.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 676 kB/s | 130 kB 00:00 2023-10-09T11:38:03.211 INFO:teuthology.orchestra.run.smithi135.stdout:(16/120): ceph-radosgw-17.2.6-1320.g08cac018.el 1.0 MB/s | 17 MB 00:16 2023-10-09T11:38:03.625 INFO:teuthology.orchestra.run.smithi135.stdout:(17/120): libradosstriper1-17.2.6-1320.g08cac01 756 kB/s | 507 kB 00:00 2023-10-09T11:38:03.790 INFO:teuthology.orchestra.run.smithi135.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 270 kB/s | 45 kB 00:00 2023-10-09T11:38:04.029 INFO:teuthology.orchestra.run.smithi135.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 484 kB/s | 115 kB 00:00 2023-10-09T11:38:04.365 INFO:teuthology.orchestra.run.smithi135.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 566 kB/s | 190 kB 00:00 2023-10-09T11:38:04.394 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2023-10-09T11:38:04.399 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2023-10-09T11:38:05.001 INFO:teuthology.orchestra.run.smithi135.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 583 kB/s | 371 kB 00:00 2023-10-09T11:38:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 672 kB/s | 358 kB 00:00 2023-10-09T11:38:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 650 kB/s | 107 kB 00:00 2023-10-09T11:38:05.858 INFO:teuthology.orchestra.run.smithi135.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 572 kB/s | 90 kB 00:00 2023-10-09T11:38:09.005 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2023-10-09T11:38:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T11:38:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:38:09.628 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:38:09.685 INFO:teuthology.orchestra.run.smithi135.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 924 kB/s | 3.5 MB 00:03 2023-10-09T11:38:09.864 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:38:09.953 INFO:teuthology.orchestra.run.smithi135.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 649 kB/s | 173 kB 00:00 2023-10-09T11:38:10.031 INFO:teuthology.orchestra.run.smithi135.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 295 kB/s | 23 kB 00:00 2023-10-09T11:38:10.193 INFO:teuthology.orchestra.run.smithi135.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 750 kB/s | 121 kB 00:00 2023-10-09T11:38:10.294 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:38:10.481 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:38:10.777 INFO:teuthology.orchestra.run.smithi135.stdout:(29/120): librgw2-17.2.6-1320.g08cac018.el8.x86 752 kB/s | 5.6 MB 00:07 2023-10-09T11:38:10.938 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:38:11.164 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:38:11.323 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:38:11.505 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:38:11.628 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:38:11.845 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:38:11.849 INFO:teuthology.orchestra.run.smithi135.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 1.0 MB/s | 1.7 MB 00:01 2023-10-09T11:38:12.120 INFO:teuthology.orchestra.run.smithi135.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 881 kB/s | 238 kB 00:00 2023-10-09T11:38:12.173 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T11:38:12.211 INFO:teuthology.orchestra.run.smithi135.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 524 kB/s | 47 kB 00:00 2023-10-09T11:38:12.300 INFO:teuthology.orchestra.run.smithi135.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 163 kB/s | 14 kB 00:00 2023-10-09T11:38:12.572 INFO:teuthology.orchestra.run.smithi135.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 981 kB/s | 267 kB 00:00 2023-10-09T11:38:12.660 INFO:teuthology.orchestra.run.smithi135.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 923 kB/s | 80 kB 00:00 2023-10-09T11:38:12.746 INFO:teuthology.orchestra.run.smithi135.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 209 kB/s | 18 kB 00:00 2023-10-09T11:38:12.884 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T11:38:12.982 INFO:teuthology.orchestra.run.smithi135.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-10-09T11:38:13.020 INFO:teuthology.orchestra.run.smithi135.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.5 MB/s | 59 kB 00:00 2023-10-09T11:38:13.060 INFO:teuthology.orchestra.run.smithi135.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-10-09T11:38:13.097 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:38:13.145 INFO:teuthology.orchestra.run.smithi135.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 5.5 MB/s | 476 kB 00:00 2023-10-09T11:38:13.180 INFO:teuthology.orchestra.run.smithi135.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.2 MB/s | 44 kB 00:00 2023-10-09T11:38:13.219 INFO:teuthology.orchestra.run.smithi135.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 4.7 MB/s | 185 kB 00:00 2023-10-09T11:38:13.239 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:38:13.254 INFO:teuthology.orchestra.run.smithi135.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 955 kB/s | 33 kB 00:00 2023-10-09T11:38:13.289 INFO:teuthology.orchestra.run.smithi135.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 474 kB/s | 16 kB 00:00 2023-10-09T11:38:13.328 INFO:teuthology.orchestra.run.smithi135.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.4 MB/s | 173 kB 00:00 2023-10-09T11:38:13.377 INFO:teuthology.orchestra.run.smithi135.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 7.7 MB/s | 384 kB 00:00 2023-10-09T11:38:13.420 INFO:teuthology.orchestra.run.smithi135.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-10-09T11:38:13.455 INFO:teuthology.orchestra.run.smithi135.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 322 kB/s | 11 kB 00:00 2023-10-09T11:38:13.490 INFO:teuthology.orchestra.run.smithi135.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 509 kB/s | 18 kB 00:00 2023-10-09T11:38:13.554 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T11:38:13.561 INFO:teuthology.orchestra.run.smithi135.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 16 MB/s | 1.2 MB 00:00 2023-10-09T11:38:13.596 INFO:teuthology.orchestra.run.smithi135.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2023-10-09T11:38:13.631 INFO:teuthology.orchestra.run.smithi135.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2023-10-09T11:38:13.675 INFO:teuthology.orchestra.run.smithi135.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-09T11:38:13.714 INFO:teuthology.orchestra.run.smithi135.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 7.0 MB/s | 283 kB 00:00 2023-10-09T11:38:13.749 INFO:teuthology.orchestra.run.smithi135.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 455 kB/s | 16 kB 00:00 2023-10-09T11:38:13.757 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T11:38:13.784 INFO:teuthology.orchestra.run.smithi135.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 976 kB/s | 34 kB 00:00 2023-10-09T11:38:13.822 INFO:teuthology.orchestra.run.smithi135.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 5.0 MB/s | 196 kB 00:00 2023-10-09T11:38:13.858 INFO:teuthology.orchestra.run.smithi135.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 1.8 MB/s | 64 kB 00:00 2023-10-09T11:38:13.893 INFO:teuthology.orchestra.run.smithi135.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 543 kB/s | 19 kB 00:00 2023-10-09T11:38:13.928 INFO:teuthology.orchestra.run.smithi135.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 690 kB/s | 24 kB 00:00 2023-10-09T11:38:13.963 INFO:teuthology.orchestra.run.smithi135.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 842 kB/s | 29 kB 00:00 2023-10-09T11:38:13.972 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:38:13.998 INFO:teuthology.orchestra.run.smithi135.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 799 kB/s | 27 kB 00:00 2023-10-09T11:38:14.037 INFO:teuthology.orchestra.run.smithi135.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 6.4 MB/s | 255 kB 00:00 2023-10-09T11:38:14.077 INFO:teuthology.orchestra.run.smithi135.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 6.3 MB/s | 251 kB 00:00 2023-10-09T11:38:14.089 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:38:14.112 INFO:teuthology.orchestra.run.smithi135.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 1.7 MB/s | 61 kB 00:00 2023-10-09T11:38:14.147 INFO:teuthology.orchestra.run.smithi135.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 2.4 MB/s | 85 kB 00:00 2023-10-09T11:38:14.182 INFO:teuthology.orchestra.run.smithi135.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 669 kB/s | 23 kB 00:00 2023-10-09T11:38:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:38:14.277 INFO:teuthology.orchestra.run.smithi135.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 18 MB/s | 1.7 MB 00:00 2023-10-09T11:38:14.282 INFO:teuthology.orchestra.run.smithi135.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-10-09T11:38:14.377 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:38:14.571 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T11:38:14.688 INFO:teuthology.orchestra.run.smithi135.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 36 MB/s | 15 MB 00:00 2023-10-09T11:38:14.796 INFO:teuthology.orchestra.run.smithi135.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 411 kB/s | 44 kB 00:00 2023-10-09T11:38:14.855 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T11:38:14.929 INFO:teuthology.orchestra.run.smithi135.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 200 kB/s | 27 kB 00:00 2023-10-09T11:38:15.082 INFO:teuthology.orchestra.run.smithi135.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 1.0 MB/s | 161 kB 00:00 2023-10-09T11:38:15.100 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T11:38:15.153 INFO:teuthology.orchestra.run.smithi135.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 4.4 MB/s | 320 kB 00:00 2023-10-09T11:38:15.281 INFO:teuthology.orchestra.run.smithi135.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 3.5 MB/s | 457 kB 00:00 2023-10-09T11:38:15.294 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T11:38:15.464 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:38:15.481 INFO:teuthology.orchestra.run.smithi135.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-10-09T11:38:15.605 INFO:teuthology.orchestra.run.smithi135.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 314 kB/s | 39 kB 00:00 2023-10-09T11:38:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:38:15.654 INFO:teuthology.orchestra.run.smithi135.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-10-09T11:38:15.786 INFO:teuthology.orchestra.run.smithi135.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-10-09T11:38:15.830 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:38:15.886 INFO:teuthology.orchestra.run.smithi135.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 2.2 MB/s | 225 kB 00:00 2023-10-09T11:38:16.009 INFO:teuthology.orchestra.run.smithi135.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-09T11:38:16.134 INFO:teuthology.orchestra.run.smithi135.stdout:(82/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 30 MB/s | 3.7 MB 00:00 2023-10-09T11:38:16.231 INFO:teuthology.orchestra.run.smithi135.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 1.9 MB/s | 187 kB 00:00 2023-10-09T11:38:16.341 INFO:teuthology.orchestra.run.smithi135.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 4.8 MB/s | 538 kB 00:00 2023-10-09T11:38:16.396 INFO:teuthology.orchestra.run.smithi135.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 5.4 MB/s | 302 kB 00:00 2023-10-09T11:38:16.438 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:38:16.540 INFO:teuthology.orchestra.run.smithi135.stdout:(86/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-10-09T11:38:16.614 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:38:16.671 INFO:teuthology.orchestra.run.smithi135.stdout:(87/120): python3-pyasn1-modules-0.3.7-6.el8.no 841 kB/s | 110 kB 00:00 2023-10-09T11:38:16.748 INFO:teuthology.orchestra.run.smithi135.stdout:(88/120): librdkafka-0.11.4-1.el8.x86_64.rpm 4.5 MB/s | 353 kB 00:00 2023-10-09T11:38:16.839 INFO:teuthology.orchestra.run.smithi135.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 221 kB/s | 20 kB 00:00 2023-10-09T11:38:17.014 INFO:teuthology.orchestra.run.smithi135.stdout:(90/120): libtool-2.4.6-25.el8.x86_64.rpm 4.0 MB/s | 709 kB 00:00 2023-10-09T11:38:17.133 INFO:teuthology.orchestra.run.smithi135.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 458 kB/s | 54 kB 00:00 2023-10-09T11:38:17.201 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:38:17.256 INFO:teuthology.orchestra.run.smithi135.stdout:(92/120): openblas-threads-0.3.12-1.el8.x86_64. 38 MB/s | 4.7 MB 00:00 2023-10-09T11:38:17.355 INFO:teuthology.orchestra.run.smithi135.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 47 MB/s | 4.6 MB 00:00 2023-10-09T11:38:17.380 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:38:17.391 INFO:teuthology.orchestra.run.smithi135.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2023-10-09T11:38:17.418 INFO:teuthology.orchestra.run.smithi135.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 719 kB/s | 19 kB 00:00 2023-10-09T11:38:17.436 INFO:teuthology.orchestra.run.smithi135.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.3 MB/s | 43 kB 00:00 2023-10-09T11:38:17.458 INFO:teuthology.orchestra.run.smithi135.stdout:(97/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.0 MB/s | 155 kB 00:00 2023-10-09T11:38:17.499 INFO:teuthology.orchestra.run.smithi135.stdout:(98/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.3 MB/s | 220 kB 00:00 2023-10-09T11:38:17.520 INFO:teuthology.orchestra.run.smithi135.stdout:(99/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.2 MB/s | 48 kB 00:00 2023-10-09T11:38:17.543 INFO:teuthology.orchestra.run.smithi135.stdout:(100/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 9.8 MB/s | 229 kB 00:00 2023-10-09T11:38:17.566 INFO:teuthology.orchestra.run.smithi135.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 1.8 MB/s | 43 kB 00:00 2023-10-09T11:38:17.622 INFO:teuthology.orchestra.run.smithi135.stdout:(102/120): openssl-devel-1.1.1g-15.el8_3.x86_64 41 MB/s | 2.3 MB 00:00 2023-10-09T11:38:17.655 INFO:teuthology.orchestra.run.smithi135.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 546 kB/s | 18 kB 00:00 2023-10-09T11:38:17.689 INFO:teuthology.orchestra.run.smithi135.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 17 MB/s | 605 kB 00:00 2023-10-09T11:38:17.719 INFO:teuthology.orchestra.run.smithi135.stdout:(105/120): fuse-2.9.7-12.el8.x86_64.rpm 2.8 MB/s | 83 kB 00:00 2023-10-09T11:38:17.739 INFO:teuthology.orchestra.run.smithi135.stdout:(106/120): elfutils-libelf-devel-0.182-3.el8.x8 2.9 MB/s | 59 kB 00:00 2023-10-09T11:38:17.836 INFO:teuthology.orchestra.run.smithi135.stdout:(107/120): libquadmath-8.4.1-1.el8.x86_64.rpm 1.7 MB/s | 169 kB 00:00 2023-10-09T11:38:17.982 INFO:teuthology.orchestra.run.smithi135.stdout:(108/120): libcom_err-devel-1.45.6-1.el8.x86_64 263 kB/s | 38 kB 00:00 2023-10-09T11:38:18.018 INFO:teuthology.orchestra.run.smithi135.stdout:(109/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.3 MB/s | 86 kB 00:00 2023-10-09T11:38:18.144 INFO:teuthology.orchestra.run.smithi135.stdout:(110/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 459 kB/s | 58 kB 00:00 2023-10-09T11:38:18.228 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:38:18.241 INFO:teuthology.orchestra.run.smithi135.stdout:(111/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 483 kB/s | 47 kB 00:00 2023-10-09T11:38:18.322 INFO:teuthology.orchestra.run.smithi135.stdout:(112/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 6.8 MB/s | 559 kB 00:00 2023-10-09T11:38:18.471 INFO:teuthology.orchestra.run.smithi135.stdout:(113/120): libgfortran-8.4.1-1.el8.x86_64.rpm 4.2 MB/s | 639 kB 00:00 2023-10-09T11:38:18.522 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T11:38:18.642 INFO:teuthology.orchestra.run.smithi135.stdout:(114/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 410 kB/s | 70 kB 00:00 2023-10-09T11:38:18.745 INFO:teuthology.orchestra.run.smithi135.stdout:(115/120): libselinux-devel-2.9-5.el8.x86_64.rp 1.9 MB/s | 200 kB 00:00 2023-10-09T11:38:18.785 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T11:38:18.794 INFO:teuthology.orchestra.run.smithi135.stdout:(116/120): libuuid-devel-2.32.1-27.el8.x86_64.r 1.9 MB/s | 97 kB 00:00 2023-10-09T11:38:19.095 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T11:38:19.337 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T11:38:19.492 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T11:38:19.783 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T11:38:20.017 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T11:38:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T11:38:20.364 INFO:teuthology.orchestra.run.smithi135.stdout:(117/120): ceph-mgr-diskprediction-local-17.2.6 791 kB/s | 7.4 MB 00:09 2023-10-09T11:38:20.546 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:38:21.338 INFO:teuthology.orchestra.run.smithi135.stdout:(118/120): librados2-17.2.6-1320.g08cac018.el8. 1.4 MB/s | 3.5 MB 00:02 2023-10-09T11:38:23.001 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:38:23.376 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T11:38:24.213 INFO:teuthology.orchestra.run.smithi135.stdout:(119/120): librbd1-17.2.6-1320.g08cac018.el8.x8 954 kB/s | 3.6 MB 00:03 2023-10-09T11:38:24.495 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T11:38:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T11:38:25.073 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T11:38:25.370 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T11:38:25.584 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T11:38:25.851 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T11:38:26.062 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T11:38:26.359 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T11:38:26.630 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T11:38:26.855 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T11:38:27.191 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T11:38:27.440 INFO:teuthology.orchestra.run.smithi135.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 1.5 MB/s | 52 MB 00:33 2023-10-09T11:38:27.445 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-10-09T11:38:27.445 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.8 MB/s | 202 MB 00:52 2023-10-09T11:38:27.513 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-10-09T11:38:27.619 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T11:38:27.639 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-10-09T11:38:27.639 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-10-09T11:38:27.779 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:38:27.879 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:38:28.065 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T11:38:28.250 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T11:38:28.439 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T11:38:28.601 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T11:38:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T11:38:29.049 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T11:38:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T11:38:29.452 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T11:38:29.573 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-10-09T11:38:29.577 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-10-09T11:38:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T11:38:30.031 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T11:38:30.313 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T11:38:30.589 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T11:38:30.971 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T11:38:31.199 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T11:38:31.401 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T11:38:31.669 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T11:38:31.906 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T11:38:32.113 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T11:38:32.277 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T11:38:32.445 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T11:38:32.685 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T11:38:32.917 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T11:38:33.150 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T11:38:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T11:38:33.579 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T11:38:33.831 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T11:38:34.104 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T11:38:34.312 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T11:38:34.346 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-10-09T11:38:34.529 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T11:38:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T11:38:34.757 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-09T11:38:34.939 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T11:38:34.956 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T11:38:35.146 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T11:38:35.151 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T11:38:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T11:38:35.441 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T11:38:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T11:38:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:38:36.508 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:38:36.773 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:38:36.854 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T11:38:36.934 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:38:37.156 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:38:37.186 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T11:38:37.264 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:38:37.520 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T11:38:37.653 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:38:37.865 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T11:38:38.147 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T11:38:38.367 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T11:38:38.515 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T11:38:38.581 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:38:38.723 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:38:38.744 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T11:38:38.966 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T11:38:39.004 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T11:38:39.186 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T11:38:39.208 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T11:38:39.389 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:38:39.557 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:38:39.714 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:38:39.807 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:38:40.019 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-09T11:38:40.181 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T11:38:40.354 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T11:38:40.564 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T11:38:41.179 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T11:38:41.356 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T11:38:41.962 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T11:38:42.147 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T11:38:43.023 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T11:38:43.340 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-09T11:38:43.532 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-09T11:38:43.721 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-09T11:38:44.031 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-09T11:38:44.388 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-09T11:38:44.637 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T11:38:44.854 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T11:38:44.984 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T11:38:45.272 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T11:38:46.088 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:38:46.302 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:38:46.415 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-09T11:38:46.789 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-09T11:38:46.983 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:38:47.106 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-09T11:38:47.258 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:38:47.418 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-09T11:38:47.435 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:38:47.585 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:38:47.705 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-09T11:38:47.921 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T11:38:50.407 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T11:38:50.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-09T11:38:51.071 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T11:38:51.268 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T11:38:51.493 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T11:38:51.728 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T11:38:51.928 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T11:38:52.162 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-09T11:38:52.327 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-09T11:38:52.533 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-09T11:38:52.741 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-09T11:38:52.886 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-09T11:38:53.103 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-09T11:38:53.277 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-09T11:38:53.664 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-09T11:38:53.956 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-09T11:38:54.241 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-09T11:38:54.641 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-09T11:38:54.881 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-09T11:38:55.097 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-09T11:38:55.311 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-09T11:38:55.536 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-09T11:38:55.703 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T11:38:55.804 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T11:38:56.022 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-09T11:38:56.217 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-09T11:38:56.416 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T11:38:56.607 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T11:38:56.880 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T11:38:57.122 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T11:38:57.345 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T11:38:57.509 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T11:38:57.659 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T11:38:57.895 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T11:38:58.096 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T11:38:58.396 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T11:38:58.591 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T11:38:58.812 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T11:38:59.055 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T11:38:59.346 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T11:38:59.579 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T11:38:59.932 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T11:39:00.180 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T11:39:00.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T11:39:00.696 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T11:39:02.117 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T11:39:02.452 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T11:39:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T11:39:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T11:39:03.380 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T11:39:03.807 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T11:39:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T11:39:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T11:39:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T11:39:06.670 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:39:06.670 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2023-10-09T11:39:06.670 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2023-10-09T11:39:06.670 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-10-09T11:39:06.670 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /run 2023-10-09T11:39:06.670 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2023-10-09T11:39:06.670 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2023-10-09T11:39:06.671 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2023-10-09T11:39:06.671 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2023-10-09T11:39:06.671 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-10-09T11:39:06.671 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:39:07.107 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:39:08.732 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:39:08.930 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:39:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:39:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:39:09.851 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:39:10.015 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:39:10.055 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:39:12.384 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:39:12.635 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:39:13.302 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:39:13.617 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:39:13.758 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:39:13.901 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:39:14.481 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:39:14.705 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:39:14.906 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T11:39:15.118 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T11:39:15.348 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:39:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:39:15.829 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:39:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:39:17.140 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:39:17.277 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:39:17.698 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T11:39:17.938 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:39:18.005 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:39:18.155 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:39:18.182 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:39:19.920 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T11:39:20.179 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:39:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:39:20.456 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:39:20.528 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:39:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:39:21.106 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:39:21.306 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:39:26.663 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:39:27.977 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T11:39:28.345 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T11:39:28.537 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T11:39:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T11:39:29.004 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:39:29.031 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:39:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T11:39:29.402 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T11:39:29.605 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T11:39:29.805 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T11:39:30.068 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T11:39:30.246 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:39:30.325 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:39:30.529 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:39:30.557 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:39:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T11:39:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:39:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:39:30.935 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:39:31.324 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:39:31.324 INFO:teuthology.orchestra.run.smithi086.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-09T11:39:31.324 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:39:32.293 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T11:39:32.293 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T11:39:32.293 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T11:39:32.293 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:39:32.293 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T11:39:32.293 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:39:32.294 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T11:39:32.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T11:39:32.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T11:39:32.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T11:39:32.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T11:39:32.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T11:39:32.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T11:39:32.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T11:39:32.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T11:39:32.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T11:39:32.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T11:39:32.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T11:39:32.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T11:39:33.611 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:39:33.611 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-10-09T11:39:33.611 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-10-09T11:39:33.611 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-10-09T11:39:33.611 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2023-10-09T11:39:33.612 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-10-09T11:39:33.612 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-10-09T11:39:33.612 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-10-09T11:39:33.612 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-10-09T11:39:33.612 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-10-09T11:39:33.612 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:39:34.056 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:39:34.580 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:39:34.581 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:02:09 ago on Mon 09 Oct 2023 11:37:25 AM UTC. 2023-10-09T11:39:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:39:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:39:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:39:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:39:36.637 INFO:teuthology.orchestra.run.smithi086.stdout:Installed products updated. 2023-10-09T11:39:36.787 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:39:36.787 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2023-10-09T11:39:36.787 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.787 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.787 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2023-10-09T11:39:36.787 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T11:39:36.787 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.788 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.789 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: jq-1.5-12.el8.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T11:39:36.790 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.791 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T11:39:36.792 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T11:39:36.793 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T11:39:36.794 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T11:39:36.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T11:39:36.796 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T11:39:36.797 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T11:39:36.798 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T11:39:36.799 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T11:39:36.799 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T11:39:36.799 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:39:36.799 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-10-09T11:39:36.823 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:39:36.981 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:39:37.021 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:39:37.108 DEBUG:teuthology.parallel:result is None 2023-10-09T11:39:41.369 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:39:41.600 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:39:41.772 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T11:39:41.993 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T11:39:42.205 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:39:42.493 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:39:42.695 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:39:43.811 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:39:44.013 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:39:44.155 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:39:44.598 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T11:39:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:39:44.848 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:39:45.029 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:39:45.057 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:39:46.792 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T11:39:47.070 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:39:47.195 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:39:47.388 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:39:47.462 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:39:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:39:48.038 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:39:48.230 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:39:53.590 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:39:53.973 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T11:39:54.161 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T11:39:55.235 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T11:39:55.631 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-09T11:39:55.856 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 111/122 2023-10-09T11:39:56.065 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-09T11:39:56.225 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T11:39:56.375 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T11:39:56.579 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T11:39:56.787 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T11:39:56.971 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T11:39:57.215 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-09T11:39:57.444 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T11:39:57.532 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T11:39:57.711 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T11:39:57.735 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T11:39:57.735 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:39:57.992 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:39:57.992 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:39:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:39:58.359 INFO:teuthology.orchestra.run.smithi135.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-09T11:39:58.359 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:39:59.289 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T11:39:59.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T11:39:59.291 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T11:39:59.292 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T11:39:59.300 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T11:39:59.301 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T11:39:59.302 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-09T11:39:59.303 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-09T11:39:59.304 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-09T11:39:59.305 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-09T11:39:59.306 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T11:39:59.307 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T11:40:01.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:40:01.739 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:36 ago on Mon 09 Oct 2023 11:37:25 AM UTC. 2023-10-09T11:40:03.873 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-10-09T11:40:04.006 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:04.006 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-10-09T11:40:04.006 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.5-12.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T11:40:04.009 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.010 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T11:40:04.011 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T11:40:04.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T11:40:04.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T11:40:04.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T11:40:04.016 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T11:40:04.017 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T11:40:04.017 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T11:40:04.017 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:04.017 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-10-09T11:40:04.349 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:04.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:40:04.501 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T11:40:04.554 INFO:teuthology.orchestra.run.smithi086.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T11:40:04.555 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T11:40:04.555 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T11:40:04.555 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:40:04.707 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T11:40:04.761 INFO:teuthology.orchestra.run.smithi135.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T11:40:04.761 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T11:40:04.761 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T11:40:04.761 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-09T11:40:04.762 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:04.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T11:40:04.850 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:04.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T11:40:04.933 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-09T11:40:04.933 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:04.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T11:40:04.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T11:40:05.096 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:05.096 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T11:40:05.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T11:40:05.267 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-09T11:40:05.267 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:05.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T11:40:05.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T11:40:05.428 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:05.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T11:40:05.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T11:40:05.598 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-09T11:40:05.599 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:05.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T11:40:05.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T11:40:05.760 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:05.760 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T11:40:05.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T11:40:05.928 INFO:teuthology.run_tasks:Running task ceph... 2023-10-09T11:40:05.985 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-09T11:40:05.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2023-10-09T11:40:05.990 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2023-10-09T11:40:06.051 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-09T11:40:06.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T11:40:06.055 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T11:40:06.118 INFO:tasks.ceph:Creating extra log directories... 2023-10-09T11:40:06.118 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T11:40:06.123 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T11:40:06.198 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-09T11:40:06.198 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-09T11:40:06.198 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-09T11:40:06.198 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:06.198 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T11:40:06.233 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:06.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:06.508 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:06.509 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T11:40:06.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:06.786 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:06.853 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-09T11:40:06.854 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-09T11:40:06.854 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7418426', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231009.111138', 'sha1': 'c68c3f491122d7c1646aa58425d37dc1a8b276ba'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231009.111138', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'c68c3f491122d7c1646aa58425d37dc1a8b276ba', 'targets': {'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD34nbgYcUZvZJZ8f8skn4RhTM6NnE0qu8eFT+hbrug4a313XXlpfaJ8kcTE3m/zuZoHcr/nfate0hq76Hm8RdE=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHxfDg/flbxzoCjGrPvdOZI+jnTNUsQmqFyt+51j2EbHwt1F45TcH7E17DzWehwRL0z3XoUBzGLI2yaQGcjDqkY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-09_11:13:22', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-09T11:40:06.855 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T11:40:06.859 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T11:40:06.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T11:40:06.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T11:40:06.998 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:06.998 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T11:40:07.033 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T11:40:07.034 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2023-10-09T11:40:07.109 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-09 11:39:31.652457482 +0000 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-09 11:36:29.282062024 +0000 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-09 11:36:29.282062024 +0000 2023-10-09T11:40:07.110 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-09T11:40:07.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T11:40:07.206 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-09T11:40:07.206 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-09T11:40:07.206 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000329029 s, 1.6 MB/s 2023-10-09T11:40:07.209 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T11:40:07.246 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2023-10-09T11:40:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T11:40:07.322 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:07.322 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-09T11:40:07.323 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:07.323 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:07.323 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-09 11:39:31.652457482 +0000 2023-10-09T11:40:07.323 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-09 11:36:30.045045869 +0000 2023-10-09T11:40:07.323 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-09 11:36:30.045045869 +0000 2023-10-09T11:40:07.323 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-09T11:40:07.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T11:40:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-09T11:40:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-09T11:40:07.419 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000302331 s, 1.7 MB/s 2023-10-09T11:40:07.421 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T11:40:07.458 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2023-10-09T11:40:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T11:40:07.534 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-09T11:40:07.534 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-09 11:39:31.652457482 +0000 2023-10-09T11:40:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-09 11:36:30.794030010 +0000 2023-10-09T11:40:07.535 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-09 11:36:30.794030010 +0000 2023-10-09T11:40:07.535 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-09T11:40:07.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T11:40:07.631 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-09T11:40:07.631 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-09T11:40:07.631 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000306261 s, 1.7 MB/s 2023-10-09T11:40:07.633 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T11:40:07.670 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2023-10-09T11:40:07.746 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T11:40:07.746 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:07.747 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-09T11:40:07.747 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:07.747 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:07.747 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-09 11:39:31.652457482 +0000 2023-10-09T11:40:07.747 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-09 11:36:31.556013876 +0000 2023-10-09T11:40:07.747 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-09 11:36:31.556013876 +0000 2023-10-09T11:40:07.747 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-09T11:40:07.747 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T11:40:07.843 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-09T11:40:07.843 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-09T11:40:07.843 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000319297 s, 1.6 MB/s 2023-10-09T11:40:07.845 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T11:40:07.883 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:07.883 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:07.883 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T11:40:07.921 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T11:40:07.921 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-09 11:39:58.692451696 +0000 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-09 11:36:29.508011978 +0000 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-09 11:36:29.508011978 +0000 2023-10-09T11:40:08.002 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-09T11:40:08.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T11:40:08.103 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-09T11:40:08.103 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-09T11:40:08.103 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000367873 s, 1.4 MB/s 2023-10-09T11:40:08.106 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T11:40:08.144 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-10-09T11:40:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T11:40:08.223 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:08.223 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-09T11:40:08.224 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:08.224 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:08.224 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-09 11:39:58.692451696 +0000 2023-10-09T11:40:08.224 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-09 11:36:30.305995561 +0000 2023-10-09T11:40:08.225 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-09 11:36:30.305995561 +0000 2023-10-09T11:40:08.225 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-09T11:40:08.225 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T11:40:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-09T11:40:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-09T11:40:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000309145 s, 1.7 MB/s 2023-10-09T11:40:08.325 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T11:40:08.363 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-09 11:39:58.693451676 +0000 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-09 11:36:31.074979740 +0000 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-09 11:36:31.074979740 +0000 2023-10-09T11:40:08.443 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-09T11:40:08.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T11:40:08.543 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-09T11:40:08.543 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-09T11:40:08.543 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000300635 s, 1.7 MB/s 2023-10-09T11:40:08.545 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T11:40:08.585 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-10-09T11:40:08.665 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T11:40:08.665 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:40:08.665 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-09T11:40:08.666 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:40:08.666 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:40:08.666 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-09 11:39:58.693451676 +0000 2023-10-09T11:40:08.666 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-09 11:36:31.840963981 +0000 2023-10-09T11:40:08.666 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-09 11:36:31.840963981 +0000 2023-10-09T11:40:08.666 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-09T11:40:08.666 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T11:40:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-09T11:40:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-09T11:40:08.773 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000322542 s, 1.6 MB/s 2023-10-09T11:40:08.777 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T11:40:08.816 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:08.816 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T11:40:08.816 INFO:tasks.ceph:Generating config... 2023-10-09T11:40:08.817 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-09T11:40:08.817 INFO:tasks.ceph:[client] debug client = 20 2023-10-09T11:40:08.817 INFO:tasks.ceph:[client] debug ms = 1 2023-10-09T11:40:08.818 INFO:tasks.ceph:[client] pid file = 2023-10-09T11:40:08.818 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-09T11:40:08.818 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-09T11:40:08.818 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-09T11:40:08.818 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-09T11:40:08.818 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-09T11:40:08.818 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-09T11:40:08.818 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-09T11:40:08.818 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-09T11:40:08.818 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-09T11:40:08.818 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-09T11:40:08.819 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-09T11:40:08.819 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-09T11:40:08.819 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-09T11:40:08.819 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-09T11:40:08.820 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-09T11:40:08.821 INFO:tasks.ceph:Setting up mon.a... 2023-10-09T11:40:08.821 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-09T11:40:08.928 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.keyring 2023-10-09T11:40:08.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-09T11:40:09.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:40:09.078 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.86'), ('mon.b', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]')] 2023-10-09T11:40:09.079 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.86,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-09T11:40:09.080 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:09.080 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T11:40:09.116 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.86 --add b 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:09.228 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:09.228 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: generated fsid 2b95c581-b8e1-4fc5-9efb-bba4b9f96168 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:setting min_mon_release = octopus 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:epoch 0 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:fsid 2b95c581-b8e1-4fc5-9efb-bba4b9f96168 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:last_changed 2023-10-09T11:40:09.228626+0000 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:created 2023-10-09T11:40:09.228626+0000 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:min_mon_release 15 (octopus) 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:election_strategy: 1 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:0: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.a 2023-10-09T11:40:09.229 INFO:teuthology.orchestra.run.smithi086.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2023-10-09T11:40:09.230 INFO:teuthology.orchestra.run.smithi086.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2023-10-09T11:40:09.230 INFO:teuthology.orchestra.run.smithi086.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-09T11:40:09.231 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T11:40:09.266 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2b95c581-b8e1-4fc5-9efb-bba4b9f96168... 2023-10-09T11:40:09.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T11:40:09.311 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2023-10-09T11:40:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T11:40:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T11:40:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2023-10-09T11:40:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.86,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 2b95c581-b8e1-4fc5-9efb-bba4b9f96168 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2023-10-09T11:40:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = bitmap 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2023-10-09T11:40:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2023-10-09T11:40:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2023-10-09T11:40:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2023-10-09T11:40:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: debug finisher = 20 2023-10-09T11:40:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.426 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2023-10-09T11:40:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-09T11:40:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-10-09T11:40:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2023-10-09T11:40:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-10-09T11:40:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2023-10-09T11:40:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2023-10-09T11:40:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:40:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2023-10-09T11:40:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2023-10-09T11:40:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:40:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T11:40:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T11:40:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T11:40:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T11:40:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T11:40:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T11:40:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2023-10-09T11:40:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2023-10-09T11:40:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2023-10-09T11:40:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2023-10-09T11:40:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = "" 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2023-10-09T11:40:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2023-10-09T11:40:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2023-10-09T11:40:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2023-10-09T11:40:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2023-10-09T11:40:09.433 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2023-10-09T11:40:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2023-10-09T11:40:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T11:40:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2023-10-09T11:40:09.433 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T11:40:09.434 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2023-10-09T11:40:09.435 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T11:40:09.436 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.86,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on skipped message = False 2023-10-09T11:40:09.437 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 2b95c581-b8e1-4fc5-9efb-bba4b9f96168 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.438 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.439 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2023-10-09T11:40:09.440 INFO:teuthology.orchestra.run.smithi135.stdout: bdev async discard = True 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: bdev enable discard = True 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore allocator = bitmap 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 1/20 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 1/20 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2023-10-09T11:40:09.441 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 4/10 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-10-09T11:40:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: debug finisher = 20 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2023-10-09T11:40:09.443 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T11:40:09.444 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T11:40:09.445 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = "" 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-10-09T11:40:09.446 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-10-09T11:40:09.447 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-10-09T11:40:09.462 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-09T11:40:09.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-09T11:40:09.560 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-09T11:40:09.560 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:09.560 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-09T11:40:09.595 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:09.595 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-09T11:40:09.670 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:40:09.670 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:09.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T11:40:09.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:40:09.796 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:09.796 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:09.872 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:40:09.872 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:09.872 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T11:40:09.872 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:40:09.961 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:09.961 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:10.038 INFO:tasks.ceph:Setting up mon nodes... 2023-10-09T11:40:10.038 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-09T11:40:10.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T11:40:10.147 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T11:40:10.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T11:40:10.274 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T11:40:10.281 INFO:tasks.ceph:Setting up mds nodes... 2023-10-09T11:40:10.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T11:40:10.390 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T11:40:10.395 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-09T11:40:10.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T11:40:10.563 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T11:40:10.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-09T11:40:10.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T11:40:10.743 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T11:40:10.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-09T11:40:10.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T11:40:10.930 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T11:40:10.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-09T11:40:10.997 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-09T11:40:10.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-09T11:40:11.080 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-09T11:40:11.111 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-09T11:40:11.193 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-09T11:40:11.224 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-09T11:40:11.309 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-09T11:40:11.340 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-09T11:40:11.424 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-09T11:40:11.456 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-09T11:40:11.456 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T11:40:11.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-09T11:40:11.516 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:11.516 INFO:tasks.ceph:role: osd.0 2023-10-09T11:40:11.516 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:40:11.517 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T11:40:11.583 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:11.583 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:11.583 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:11.583 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2023-10-09T11:40:11.584 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:11.584 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:11.584 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:11.584 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:11.584 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:11.584 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:12.014 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-10-09T11:40:12.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-10-09T11:40:12.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-09T11:40:12.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-09T11:40:12.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-09T11:40:12.333 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:12.333 INFO:tasks.ceph:role: osd.1 2023-10-09T11:40:12.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:40:12.333 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T11:40:12.399 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:12.400 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:12.809 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-10-09T11:40:12.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-10-09T11:40:12.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-09T11:40:12.937 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-09T11:40:13.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-09T11:40:13.064 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:13.064 INFO:tasks.ceph:role: osd.2 2023-10-09T11:40:13.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:40:13.065 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T11:40:13.132 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:13.132 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2023-10-09T11:40:13.133 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:13.133 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:13.133 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:13.133 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:13.133 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:13.589 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-10-09T11:40:13.594 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-10-09T11:40:13.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-09T11:40:13.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-09T11:40:13.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-09T11:40:13.912 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:13.912 INFO:tasks.ceph:role: osd.3 2023-10-09T11:40:13.912 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:40:13.912 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T11:40:13.979 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:13.979 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:13.980 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:14.411 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-10-09T11:40:14.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-10-09T11:40:14.415 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-09T11:40:14.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-09T11:40:14.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:14.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:14.754+0000 7f706e238540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-09T11:40:14.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:14.754+0000 7f706e238540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-09T11:40:14.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:14.754+0000 7f706e238540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T11:40:14.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:14.754+0000 7f706e238540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T11:40:14.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:14.754+0000 7f706e238540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T11:40:14.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:14.756+0000 7f706e238540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-09T11:40:15.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:15.298+0000 7f706e238540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:16.060+0000 7f706e238540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:16.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:16.826+0000 7f706e238540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:17.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-09T11:40:17.710 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:17.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:17.801+0000 7f924dbef540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-09T11:40:17.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:17.801+0000 7f924dbef540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-09T11:40:17.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:17.801+0000 7f924dbef540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T11:40:17.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:17.801+0000 7f924dbef540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T11:40:17.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:17.801+0000 7f924dbef540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T11:40:17.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:17.803+0000 7f924dbef540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-09T11:40:18.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:18.338+0000 7f924dbef540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:19.100+0000 7f924dbef540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:19.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:19.863+0000 7f924dbef540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:20.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-09T11:40:20.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:20.829+0000 7fae32f88540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-09T11:40:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:20.830+0000 7fae32f88540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-09T11:40:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:20.830+0000 7fae32f88540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T11:40:20.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:20.830+0000 7fae32f88540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T11:40:20.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:20.830+0000 7fae32f88540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T11:40:20.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:20.831+0000 7fae32f88540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-09T11:40:21.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:21.369+0000 7fae32f88540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:22.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:22.139+0000 7fae32f88540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:22.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:22.902+0000 7fae32f88540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:23.715 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-09T11:40:23.780 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:23.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:23.925+0000 7fe675445540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-09T11:40:23.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:23.926+0000 7fe675445540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-09T11:40:23.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:23.926+0000 7fe675445540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T11:40:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:23.926+0000 7fe675445540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T11:40:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:23.926+0000 7fe675445540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T11:40:23.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:23.927+0000 7fe675445540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-09T11:40:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:24.463+0000 7fe675445540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:25.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:25.224+0000 7fe675445540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:25.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:25.987+0000 7fe675445540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:26.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-09T11:40:26.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-09T11:40:26.930 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:26.930 INFO:tasks.ceph:role: osd.4 2023-10-09T11:40:26.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:40:26.930 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T11:40:26.997 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:26.998 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:27.427 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-09T11:40:27.432 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-09T11:40:27.432 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-09T11:40:27.606 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-09T11:40:27.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-09T11:40:27.743 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:27.743 INFO:tasks.ceph:role: osd.5 2023-10-09T11:40:27.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:40:27.743 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:27.816 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:27.817 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:28.230 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-09T11:40:28.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-09T11:40:28.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-09T11:40:28.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-09T11:40:28.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-09T11:40:28.480 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:28.480 INFO:tasks.ceph:role: osd.6 2023-10-09T11:40:28.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:40:28.481 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T11:40:28.551 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:28.551 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:28.552 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:28.997 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-09T11:40:29.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-09T11:40:29.000 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-09T11:40:29.190 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-09T11:40:29.259 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-09T11:40:29.320 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:40:29.320 INFO:tasks.ceph:role: osd.7 2023-10-09T11:40:29.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:40:29.320 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T11:40:29.387 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:40:29.387 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:40:29.387 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:40:29.388 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-09T11:40:29.388 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:40:29.388 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:40:29.388 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:40:29.388 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:40:29.388 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:40:29.388 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:40:29.807 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-09T11:40:29.810 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-09T11:40:29.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-09T11:40:29.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-09T11:40:30.047 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:30.161 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:30.159+0000 7fae20735540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-09T11:40:30.162 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:30.160+0000 7fae20735540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-09T11:40:30.162 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:30.160+0000 7fae20735540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T11:40:30.162 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:30.160+0000 7fae20735540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T11:40:30.162 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:30.160+0000 7fae20735540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T11:40:30.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:30.162+0000 7fae20735540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-09T11:40:30.711 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:30.709+0000 7fae20735540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:31.490 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:31.488+0000 7fae20735540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:32.273 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:32.271+0000 7fae20735540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:33.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-09T11:40:33.173 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:33.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:33.264+0000 7fa920fb4540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-09T11:40:33.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:33.264+0000 7fa920fb4540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-09T11:40:33.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:33.264+0000 7fa920fb4540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T11:40:33.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:33.264+0000 7fa920fb4540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T11:40:33.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:33.264+0000 7fa920fb4540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T11:40:33.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:33.266+0000 7fa920fb4540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-09T11:40:33.818 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:33.817+0000 7fa920fb4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:34.592 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:34.591+0000 7fa920fb4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:35.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:35.365+0000 7fa920fb4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:36.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-09T11:40:36.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:36.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:36.360+0000 7f23067e6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-09T11:40:36.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:36.360+0000 7f23067e6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-09T11:40:36.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:36.361+0000 7f23067e6540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T11:40:36.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:36.361+0000 7f23067e6540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T11:40:36.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:36.361+0000 7f23067e6540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T11:40:36.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:36.362+0000 7f23067e6540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-09T11:40:36.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:36.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:36.913 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:36.913+0000 7f23067e6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:37.685 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:37.684+0000 7f23067e6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:38.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:38.463+0000 7f23067e6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:39.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-09T11:40:39.366 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:39.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:39.459+0000 7f3d4cadd540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-09T11:40:39.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:39.459+0000 7f3d4cadd540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-09T11:40:39.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:39.459+0000 7f3d4cadd540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T11:40:39.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:39.459+0000 7f3d4cadd540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T11:40:39.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:39.459+0000 7f3d4cadd540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T11:40:39.461 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:39.461+0000 7f3d4cadd540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-09T11:40:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:40.003+0000 7f3d4cadd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:40.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:40.778+0000 7f3d4cadd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:41.548 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:41.547+0000 7f3d4cadd540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T11:40:42.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-09T11:40:42.447 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-09T11:40:42.447 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:42.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-09T11:40:42.513 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:42.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-09T11:40:42.616 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:42.616 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-09T11:40:42.715 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:42.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-09T11:40:42.815 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:42.816 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-09T11:40:42.915 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:42.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-09T11:40:43.013 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:43.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-09T11:40:43.113 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.113 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-09T11:40:43.179 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.179 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-09T11:40:43.281 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.281 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-09T11:40:43.384 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.384 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-09T11:40:43.491 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-09T11:40:43.595 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.595 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-09T11:40:43.700 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.700 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-09T11:40:43.809 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:43.809 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-09T11:40:43.848 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:43.849 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-09T11:40:43.931 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.931 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-09T11:40:43.970 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:43.970 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-09T11:40:44.051 INFO:tasks.ceph:Adding keys to all mons... 2023-10-09T11:40:44.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T11:40:44.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ== 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw== 2023-10-09T11:40:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w== 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA== 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg== 2023-10-09T11:40:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ== 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q== 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg== 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ== 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2023-10-09T11:40:44.115 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg== 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA== 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ== 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ== 2023-10-09T11:40:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q== 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw== 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:[client.2] 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q== 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw== 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:[client.3] 2023-10-09T11:40:44.117 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA== 2023-10-09T11:40:44.155 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2023-10-09T11:40:44.155 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ== 2023-10-09T11:40:44.155 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-10-09T11:40:44.155 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw== 2023-10-09T11:40:44.156 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-10-09T11:40:44.156 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w== 2023-10-09T11:40:44.156 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2023-10-09T11:40:44.156 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA== 2023-10-09T11:40:44.156 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2023-10-09T11:40:44.156 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg== 2023-10-09T11:40:44.156 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ== 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q== 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg== 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ== 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-10-09T11:40:44.157 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg== 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA== 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ== 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ== 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q== 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2023-10-09T11:40:44.158 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw== 2023-10-09T11:40:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:[client.2] 2023-10-09T11:40:44.159 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q== 2023-10-09T11:40:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2023-10-09T11:40:44.159 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw== 2023-10-09T11:40:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:[client.3] 2023-10-09T11:40:44.159 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA== 2023-10-09T11:40:44.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:40:44.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:40:44.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:44.305 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:44.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:44.410 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:44.517 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.625 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.724 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:44.930 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:40:44.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:40:45.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:45.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:45.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:45.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:40:45.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.348 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.551 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.555 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:40:45.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:45.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:45.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:45.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:45.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:45.866 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:45.968 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:45.973 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:40:46.078 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-09T11:40:46.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-09T11:40:46.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:40:46.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-09T11:40:46.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-09T11:40:46.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:40:46.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-09T11:40:46.539 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-09T11:40:46.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:40:46.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-09T11:40:46.782 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:46.787 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:40:46.822 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-09T11:40:46.823 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-09T11:40:46.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-09T11:40:46.861 INFO:tasks.ceph.mon.a:Started 2023-10-09T11:40:46.862 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-09T11:40:46.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-09T11:40:46.867 INFO:tasks.ceph.mon.b:Started 2023-10-09T11:40:46.867 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-09T11:40:46.867 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-09T11:40:46.871 INFO:tasks.ceph.mon.c:Started 2023-10-09T11:40:46.871 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-09T11:40:46.872 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-09T11:40:46.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-09T11:40:46.876 INFO:tasks.ceph.mgr.y:Started 2023-10-09T11:40:46.876 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-09T11:40:46.876 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-09T11:40:46.880 INFO:tasks.ceph.mgr.x:Started 2023-10-09T11:40:46.880 INFO:tasks.ceph:Setting crush tunables to default 2023-10-09T11:40:46.880 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd crush tunables default 2023-10-09T11:40:47.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.061+0000 7f6ff959d700 1 Processor -- start 2023-10-09T11:40:47.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.061+0000 7f6ff959d700 1 -- start start 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.062+0000 7f6ff959d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.062+0000 7f6ff959d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b1b40 0x7f6ff415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.062+0000 7f6ff959d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40cfb00 con 0x7f6ff40b16d0 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.062+0000 7f6ff959d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff40b5c40 con 0x7f6ff40b1b40 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.062+0000 7f6ff959d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff40b5f20 con 0x7f6ff40b4e70 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:52482/0 (socket says 172.21.15.86:52482) 2023-10-09T11:40:47.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff3fff700 1 -- 172.21.15.86:0/723983708 learned_addr learned my addr 172.21.15.86:0/723983708 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff37fe700 1 --1- 172.21.15.86:0/723983708 >> v1:172.21.15.135:6789/0 conn(0x7f6ff40b16d0 0x7f6ff415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:44408/0 (socket says 172.21.15.86:44408) 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff3fff700 1 -- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 msgr2=0x7f6ff40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff3fff700 1 -- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 msgr2=0x7f6ff40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff3fff700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff3fff700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff8d9c700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b1b40 0x7f6ff415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff8d9c700 1 -- 172.21.15.86:0/723983708 >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b1b40 msgr2=0x7f6ff415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff8d9c700 1 -- 172.21.15.86:0/723983708 >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b1b40 msgr2=0x7f6ff415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff8d9c700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b1b40 0x7f6ff415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T11:40:47.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.063+0000 7f6ff8d9c700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b1b40 0x7f6ff415d950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:40:47.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.263+0000 7f6ff2ffd700 1 -- 172.21.15.86:0/723983708 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985915037 0 0) 0x7f6ff40cfb00 con 0x7f6ff40b16d0 2023-10-09T11:40:47.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.263+0000 7f6ff2ffd700 1 -- 172.21.15.86:0/723983708 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fdc003570 con 0x7f6ff40b16d0 2023-10-09T11:40:47.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.264+0000 7f6ff8d9c700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b1b40 0x7f6ff415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.264+0000 7f6ff3fff700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.264+0000 7f6ff8d9c700 1 -- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 msgr2=0x7f6ff40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:47.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.264+0000 7f6ff8d9c700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.264+0000 7f6ff8d9c700 1 -- 172.21.15.86:0/723983708 >> v1:172.21.15.135:6789/0 conn(0x7f6ff40b16d0 legacy=0x7f6ff415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.264+0000 7f6ff8d9c700 1 -- 172.21.15.86:0/723983708 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40b6200 con 0x7f6ff40b1b40 2023-10-09T11:40:47.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.264+0000 7f6ff8d9c700 1 --2- 172.21.15.86:0/723983708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b1b40 0x7f6ff415d950 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4064910 tx=0x7f6fec0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c92556424225bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.265+0000 7f6ff2ffd700 1 -- 172.21.15.86:0/723983708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec007cf0 con 0x7f6ff40b1b40 2023-10-09T11:40:47.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.265+0000 7f6ff2ffd700 1 -- 172.21.15.86:0/723983708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec007e70 con 0x7f6ff40b1b40 2023-10-09T11:40:47.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.265+0000 7f6ff2ffd700 1 -- 172.21.15.86:0/723983708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec014610 con 0x7f6ff40b1b40 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.265+0000 7f6ff959d700 1 -- 172.21.15.86:0/723983708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b1b40 msgr2=0x7f6ff415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.265+0000 7f6ff959d700 1 --2- 172.21.15.86:0/723983708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b1b40 0x7f6ff415d950 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4064910 tx=0x7f6fec0097c0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.266+0000 7f6ff959d700 1 -- 172.21.15.86:0/723983708 shutdown_connections 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.266+0000 7f6ff959d700 1 --2- 172.21.15.86:0/723983708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b1b40 0x7f6ff415d950 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.266+0000 7f6ff959d700 1 --2- 172.21.15.86:0/723983708 >> v2:172.21.15.135:3300/0 conn(0x7f6ff40b4e70 0x7f6ff40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.266+0000 7f6ff959d700 1 -- 172.21.15.86:0/723983708 >> 172.21.15.86:0/723983708 conn(0x7f6ff40d10c0 msgr2=0x7f6ff40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.266+0000 7f6ff959d700 1 -- 172.21.15.86:0/723983708 shutdown_connections 2023-10-09T11:40:47.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.266+0000 7f6ff959d700 1 -- 172.21.15.86:0/723983708 wait complete. 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.268+0000 7f6ff959d700 1 Processor -- start 2023-10-09T11:40:47.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.268+0000 7f6ff959d700 1 -- start start 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff959d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b16d0 0x7f6ff414c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff959d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ff40b1b40 0x7f6ff4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff959d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ff40b4e70 0x7f6ff41592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff959d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40c8270 con 0x7f6ff40b16d0 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff959d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40c7660 con 0x7f6ff40b1b40 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff959d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40c7940 con 0x7f6ff40b4e70 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b16d0 0x7f6ff414c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b16d0 0x7f6ff414c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56752/0 (socket says 172.21.15.86:56752) 2023-10-09T11:40:47.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff3fff700 1 -- 172.21.15.86:0/3083967361 learned_addr learned my addr 172.21.15.86:0/3083967361 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff37fe700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ff40b1b40 0x7f6ff4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.269+0000 7f6ff8d9c700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ff40b4e70 0x7f6ff41592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff3fff700 1 -- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ff40b4e70 msgr2=0x7f6ff41592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff3fff700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ff40b4e70 0x7f6ff41592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff3fff700 1 -- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ff40b1b40 msgr2=0x7f6ff4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff3fff700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ff40b1b40 0x7f6ff4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff3fff700 1 -- 172.21.15.86:0/3083967361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec009a80 con 0x7f6ff40b16d0 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff3fff700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b16d0 0x7f6ff414c050 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4011990 tx=0x7f6fe4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6fdbfff700 1 -- 172.21.15.86:0/3083967361 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400c070 con 0x7f6ff40b16d0 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff40c7c20 con 0x7f6ff40b16d0 2023-10-09T11:40:47.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.270+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff414c590 con 0x7f6ff40b16d0 2023-10-09T11:40:47.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.271+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff40c8550 con 0x7f6ff40b16d0 2023-10-09T11:40:47.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.273+0000 7f6fdbfff700 1 -- 172.21.15.86:0/3083967361 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4015880 con 0x7f6ff40b16d0 2023-10-09T11:40:47.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.273+0000 7f6fdbfff700 1 -- 172.21.15.86:0/3083967361 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40159f0 con 0x7f6ff40b16d0 2023-10-09T11:40:47.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.273+0000 7f6fdbfff700 1 -- 172.21.15.86:0/3083967361 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6fe4028480 con 0x7f6ff40b16d0 2023-10-09T11:40:47.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.273+0000 7f6fdbfff700 1 -- 172.21.15.86:0/3083967361 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6fe401e7e0 con 0x7f6ff40b16d0 2023-10-09T11:40:47.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.276+0000 7f6fdbfff700 1 -- 172.21.15.86:0/3083967361 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6fe4023060 con 0x7f6ff40b16d0 2023-10-09T11:40:47.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.354+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6ff404bb80 con 0x7f6ff40b16d0 2023-10-09T11:40:47.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.362+0000 7f6fdbfff700 1 -- 172.21.15.86:0/3083967361 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6fe4019070 con 0x7f6ff40b16d0 2023-10-09T11:40:47.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b16d0 msgr2=0x7f6ff414c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b16d0 0x7f6ff414c050 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4011990 tx=0x7f6fe4008040 comp rx=0 tx=0).stop 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 shutdown_connections 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b16d0 0x7f6ff414c050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ff40b4e70 0x7f6ff41592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 --2- 172.21.15.86:0/3083967361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ff40b1b40 0x7f6ff4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 >> 172.21.15.86:0/3083967361 conn(0x7f6ff40d10c0 msgr2=0x7f6ff40af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 shutdown_connections 2023-10-09T11:40:47.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:47.363+0000 7f6ff959d700 1 -- 172.21.15.86:0/3083967361 wait complete. 2023-10-09T11:40:47.366 INFO:teuthology.orchestra.run.smithi086.stderr:adjusted tunables profile to default 2023-10-09T11:40:47.381 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-09T11:40:47.381 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:47.381 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-09T11:40:47.441 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:47.441 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-09T11:40:47.542 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:47.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-09T11:40:47.643 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-09T11:40:47.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-09T11:40:47.744 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:47.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-09T11:40:47.805 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:47.805 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-09T11:40:47.908 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:47.909 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-09T11:40:48.010 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-09T11:40:48.010 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-09T11:40:48.114 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 23697720-b70b-4a46-9e6b-f08bf831ee47 0 2023-10-09T11:40:48.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.344+0000 7fd68579d700 1 Processor -- start 2023-10-09T11:40:48.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.345+0000 7fd68579d700 1 -- start start 2023-10-09T11:40:48.348 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd68579d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6800b4e70 0x7fd6800ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.348 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd68579d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd6800b16d0 0x7fd6800b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.348 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd68579d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68015d240 0x7fd68015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.348 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd68579d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800b2080 con 0x7fd6800b4e70 2023-10-09T11:40:48.348 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd68579d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800cfb00 con 0x7fd6800b16d0 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd68579d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800b5c40 con 0x7fd68015d240 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd684f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68015d240 0x7fd68015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd67f7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd6800b16d0 0x7fd6800b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd67f7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd6800b16d0 0x7fd6800b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49664/0 (socket says 172.21.15.135:49664) 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd67ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6800b4e70 0x7fd6800ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd684f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68015d240 0x7fd68015d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54894/0 (socket says 172.21.15.135:54894) 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.346+0000 7fd67f7fe700 1 -- 172.21.15.135:0/1877003609 learned_addr learned my addr 172.21.15.135:0/1877003609 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67f7fe700 1 -- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68015d240 msgr2=0x7fd68015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67f7fe700 1 --2- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68015d240 0x7fd68015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67f7fe700 1 -- 172.21.15.135:0/1877003609 >> v2:172.21.15.86:3300/0 conn(0x7fd6800b4e70 msgr2=0x7fd6800ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67f7fe700 1 --2- 172.21.15.135:0/1877003609 >> v2:172.21.15.86:3300/0 conn(0x7fd6800b4e70 0x7fd6800ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67f7fe700 1 -- 172.21.15.135:0/1877003609 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800b5f20 con 0x7fd6800b16d0 2023-10-09T11:40:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67ffff700 1 --2- 172.21.15.135:0/1877003609 >> v2:172.21.15.86:3300/0 conn(0x7fd6800b4e70 0x7fd6800ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd684f9c700 1 --2- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68015d240 0x7fd68015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67f7fe700 1 --2- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6800b16d0 0x7fd6800b1b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd680089830 tx=0x7fd674009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af6ca164cc001754 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67effd700 1 -- 172.21.15.135:0/1877003609 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400b640 con 0x7fd6800b16d0 2023-10-09T11:40:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67effd700 1 -- 172.21.15.135:0/1877003609 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400b7a0 con 0x7fd6800b16d0 2023-10-09T11:40:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.347+0000 7fd67effd700 1 -- 172.21.15.135:0/1877003609 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400bb60 con 0x7fd6800b16d0 2023-10-09T11:40:48.353 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 -- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6800b16d0 msgr2=0x7fd6800b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.353 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 --2- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6800b16d0 0x7fd6800b1b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd680089830 tx=0x7fd674009250 comp rx=0 tx=0).stop 2023-10-09T11:40:48.353 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 -- 172.21.15.135:0/1877003609 shutdown_connections 2023-10-09T11:40:48.353 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 --2- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68015d240 0x7fd68015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.353 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 --2- 172.21.15.135:0/1877003609 >> v2:172.21.15.86:3300/0 conn(0x7fd6800b4e70 0x7fd6800ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.353 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 --2- 172.21.15.135:0/1877003609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6800b16d0 0x7fd6800b1b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.353 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 -- 172.21.15.135:0/1877003609 >> 172.21.15.135:0/1877003609 conn(0x7fd6800d10c0 msgr2=0x7fd6800affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 -- 172.21.15.135:0/1877003609 shutdown_connections 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.348+0000 7fd68579d700 1 -- 172.21.15.135:0/1877003609 wait complete. 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.350+0000 7fd68579d700 1 Processor -- start 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.350+0000 7fd68579d700 1 -- start start 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd68579d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6800b16d0 0x7fd6800c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd68579d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6800b4e70 0x7fd68014bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd68579d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68015d240 0x7fd680158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd68579d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c9150 con 0x7fd6800b4e70 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd68579d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c95e0 con 0x7fd68015d240 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd68579d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c8540 con 0x7fd6800b16d0 2023-10-09T11:40:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6800b16d0 0x7fd6800c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6800b16d0 0x7fd6800c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54896/0 (socket says 172.21.15.135:54896) 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd684f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68015d240 0x7fd680158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 -- 172.21.15.135:0/2493680911 learned_addr learned my addr 172.21.15.135:0/2493680911 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67f7fe700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6800b4e70 0x7fd68014bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 -- 172.21.15.135:0/2493680911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68015d240 msgr2=0x7fd680158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68015d240 0x7fd680158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 -- 172.21.15.135:0/2493680911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6800b4e70 msgr2=0x7fd68014bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6800b4e70 0x7fd68014bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.351+0000 7fd67ffff700 1 -- 172.21.15.135:0/2493680911 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670009420 con 0x7fd6800b16d0 2023-10-09T11:40:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd67ffff700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6800b16d0 0x7fd6800c77d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ec80 tx=0x7fd6700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd667fff700 1 -- 172.21.15.135:0/2493680911 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000c8f0 con 0x7fd6800b16d0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd667fff700 1 -- 172.21.15.135:0/2493680911 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67000ca50 con 0x7fd6800b16d0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd678009a20 con 0x7fd6800b16d0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd667fff700 1 -- 172.21.15.135:0/2493680911 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000cdd0 con 0x7fd6800b16d0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6740094f0 con 0x7fd6800b16d0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd667fff700 1 -- 172.21.15.135:0/2493680911 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd670005c80 con 0x7fd6800b16d0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.352+0000 7fd667fff700 1 -- 172.21.15.135:0/2493680911 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd670006370 con 0x7fd6800b16d0 2023-10-09T11:40:48.356 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.353+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd680088990 con 0x7fd6800b16d0 2023-10-09T11:40:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.356+0000 7fd667fff700 1 -- 172.21.15.135:0/2493680911 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd670021060 con 0x7fd6800b16d0 2023-10-09T11:40:48.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.447+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23697720-b70b-4a46-9e6b-f08bf831ee47", "id": 0} v 0) v1 -- 0x7fd68015ce20 con 0x7fd6800b16d0 2023-10-09T11:40:48.452 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.451+0000 7fd667fff700 1 -- 172.21.15.135:0/2493680911 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23697720-b70b-4a46-9e6b-f08bf831ee47", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd670017070 con 0x7fd6800b16d0 2023-10-09T11:40:48.452 INFO:teuthology.orchestra.run.smithi135.stdout:0 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.452+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6800b16d0 msgr2=0x7fd6800c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.452+0000 7fd68579d700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6800b16d0 0x7fd6800c77d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ec80 tx=0x7fd6700091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.453+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 shutdown_connections 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.453+0000 7fd68579d700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68015d240 0x7fd680158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.453+0000 7fd68579d700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6800b16d0 0x7fd6800c77d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.453+0000 7fd68579d700 1 --2- 172.21.15.135:0/2493680911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6800b4e70 0x7fd68014bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.453+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 >> 172.21.15.135:0/2493680911 conn(0x7fd6800d10c0 msgr2=0x7fd680069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.453+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 shutdown_connections 2023-10-09T11:40:48.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.453+0000 7fd68579d700 1 -- 172.21.15.135:0/2493680911 wait complete. 2023-10-09T11:40:48.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 56782c33-979b-40d2-8bbc-4369d1d5c34d 1 2023-10-09T11:40:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.652+0000 7f83adb9d700 1 Processor -- start 2023-10-09T11:40:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.652+0000 7f83adb9d700 1 -- start start 2023-10-09T11:40:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.653+0000 7f83adb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b16d0 0x7f83a80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.653+0000 7f83adb9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a80b2080 con 0x7f83a80b4e70 2023-10-09T11:40:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.653+0000 7f83adb9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a80cfb00 con 0x7f83a80b33b0 2023-10-09T11:40:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.653+0000 7f83adb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80b5c40 con 0x7f83a80b16d0 2023-10-09T11:40:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83ad39c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f83a80b33b0 0x7f83a80b3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:49058/0 (socket says 172.21.15.135:49058) 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83ad39c700 1 -- 172.21.15.135:0/408708364 learned_addr learned my addr 172.21.15.135:0/408708364 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83acb9b700 1 --1- 172.21.15.135:0/408708364 >> v1:172.21.15.86:6789/0 conn(0x7f83a80b4e70 0x7f83a80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.135:37222/0 (socket says 172.21.15.135:37222) 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83a7fff700 1 --2- 172.21.15.135:0/408708364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b16d0 0x7f83a80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83a7fff700 1 -- 172.21.15.135:0/408708364 >> v1:172.21.15.135:6789/0 conn(0x7f83a80b33b0 legacy=0x7f83a80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83a7fff700 1 -- 172.21.15.135:0/408708364 >> v1:172.21.15.86:6789/0 conn(0x7f83a80b4e70 legacy=0x7f83a80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83a7fff700 1 -- 172.21.15.135:0/408708364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a80b5f20 con 0x7f83a80b16d0 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83a77fe700 1 -- 172.21.15.135:0/408708364 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474280304 0 0) 0x7f83a80cfb00 con 0x7f83a80b33b0 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.654+0000 7f83a7fff700 1 --2- 172.21.15.135:0/408708364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b16d0 0x7f83a80b1b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8394009910 tx=0x7f83940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93672ac066b74d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.655+0000 7f83a77fe700 1 -- 172.21.15.135:0/408708364 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400b860 con 0x7f83a80b16d0 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.655+0000 7f83a77fe700 1 -- 172.21.15.135:0/408708364 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839400b9c0 con 0x7f83a80b16d0 2023-10-09T11:40:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.655+0000 7f83a77fe700 1 -- 172.21.15.135:0/408708364 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400bd60 con 0x7f83a80b16d0 2023-10-09T11:40:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.655+0000 7f83adb9d700 1 -- 172.21.15.135:0/408708364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b16d0 msgr2=0x7f83a80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.655+0000 7f83adb9d700 1 --2- 172.21.15.135:0/408708364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b16d0 0x7f83a80b1b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8394009910 tx=0x7f83940091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.656+0000 7f83adb9d700 1 -- 172.21.15.135:0/408708364 shutdown_connections 2023-10-09T11:40:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.656+0000 7f83adb9d700 1 --2- 172.21.15.135:0/408708364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b16d0 0x7f83a80b1b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.656+0000 7f83adb9d700 1 -- 172.21.15.135:0/408708364 >> 172.21.15.135:0/408708364 conn(0x7f83a80d10c0 msgr2=0x7f83a80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.656+0000 7f83adb9d700 1 -- 172.21.15.135:0/408708364 shutdown_connections 2023-10-09T11:40:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.656+0000 7f83adb9d700 1 -- 172.21.15.135:0/408708364 wait complete. 2023-10-09T11:40:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.658+0000 7f83adb9d700 1 Processor -- start 2023-10-09T11:40:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.658+0000 7f83adb9d700 1 -- start start 2023-10-09T11:40:48.661 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83adb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a80b16d0 0x7f83a8158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.661 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83adb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b33b0 0x7f83a80a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.661 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83adb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a80b4e70 0x7f83a80a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.661 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83adb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80a7ea0 con 0x7f83a80b16d0 2023-10-09T11:40:48.661 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83adb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80a8f10 con 0x7f83a80b4e70 2023-10-09T11:40:48.662 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83adb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80a78e0 con 0x7f83a80b33b0 2023-10-09T11:40:48.662 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83a7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b33b0 0x7f83a80a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.662 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83ad39c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a80b4e70 0x7f83a80a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.662 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83a7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b33b0 0x7f83a80a6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54904/0 (socket says 172.21.15.135:54904) 2023-10-09T11:40:48.662 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83a7fff700 1 -- 172.21.15.135:0/1090860924 learned_addr learned my addr 172.21.15.135:0/1090860924 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:48.662 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.660+0000 7f83acb9b700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a80b16d0 0x7f83a8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.663 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83ad39c700 1 -- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b33b0 msgr2=0x7f83a80a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83ad39c700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b33b0 0x7f83a80a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83ad39c700 1 -- 172.21.15.135:0/1090860924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a80b16d0 msgr2=0x7f83a8158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83ad39c700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a80b16d0 0x7f83a8158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83ad39c700 1 -- 172.21.15.135:0/1090860924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009420 con 0x7f83a80b4e70 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83a7fff700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b33b0 0x7f83a80a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83ad39c700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a80b4e70 0x7f83a80a93a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f83a000cbe0 tx=0x7f83a00019a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83a4ff9700 1 -- 172.21.15.135:0/1090860924 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a000a8b0 con 0x7f83a80b4e70 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83a4ff9700 1 -- 172.21.15.135:0/1090860924 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a000aa30 con 0x7f83a80b4e70 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a80a7bc0 con 0x7f83a80b4e70 2023-10-09T11:40:48.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.661+0000 7f83a4ff9700 1 -- 172.21.15.135:0/1090860924 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a000adf0 con 0x7f83a80b4e70 2023-10-09T11:40:48.665 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.662+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a80a8230 con 0x7f83a80b4e70 2023-10-09T11:40:48.665 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.662+0000 7f83a4ff9700 1 -- 172.21.15.135:0/1090860924 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f83a0007580 con 0x7f83a80b4e70 2023-10-09T11:40:48.665 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.662+0000 7f83a4ff9700 1 -- 172.21.15.135:0/1090860924 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f83a001bae0 con 0x7f83a80b4e70 2023-10-09T11:40:48.665 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.663+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a80a9080 con 0x7f83a80b4e70 2023-10-09T11:40:48.666 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.665+0000 7f83a4ff9700 1 -- 172.21.15.135:0/1090860924 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f83a00079c0 con 0x7f83a80b4e70 2023-10-09T11:40:48.666 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:48.665+0000 7f87ad64a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:40:48.753 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.753+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56782c33-979b-40d2-8bbc-4369d1d5c34d", "id": 1} v 0) v1 -- 0x7f83a80b14b0 con 0x7f83a80b4e70 2023-10-09T11:40:48.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.757+0000 7f83a4ff9700 1 -- 172.21.15.135:0/1090860924 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56782c33-979b-40d2-8bbc-4369d1d5c34d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83a001bca0 con 0x7f83a80b4e70 2023-10-09T11:40:48.758 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-10-09T11:40:48.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a80b4e70 msgr2=0x7f83a80a93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a80b4e70 0x7f83a80a93a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f83a000cbe0 tx=0x7f83a00019a0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 shutdown_connections 2023-10-09T11:40:48.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a80b16d0 0x7f83a8158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83a80b4e70 0x7f83a80a93a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 --2- 172.21.15.135:0/1090860924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83a80b33b0 0x7f83a80a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 >> 172.21.15.135:0/1090860924 conn(0x7f83a80d10c0 msgr2=0x7f83a80c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 shutdown_connections 2023-10-09T11:40:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.758+0000 7f83adb9d700 1 -- 172.21.15.135:0/1090860924 wait complete. 2023-10-09T11:40:48.766 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:48.765+0000 7f3c45760180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:40:48.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 8f880a5f-971b-4352-86ec-366bd3e44eae 2 2023-10-09T11:40:48.830 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:48.829+0000 7f87ad64a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:40:48.924 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:48.923+0000 7f87ad64a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:40:48.943 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:48.943+0000 7f3c45760180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:40:48.955 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.954+0000 7f454d39d700 1 Processor -- start 2023-10-09T11:40:48.955 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.954+0000 7f454d39d700 1 -- start start 2023-10-09T11:40:48.956 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.955+0000 7f454d39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45480b4e70 0x7f45480ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f454d39d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45480cfb00 con 0x7f45480b1b40 2023-10-09T11:40:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f454d39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454815e060 con 0x7f45480b16d0 2023-10-09T11:40:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f454d39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45480b5c40 con 0x7f45480b4e70 2023-10-09T11:40:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f4547fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45480b4e70 0x7f45480ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f4547fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45480b4e70 0x7f45480ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49692/0 (socket says 172.21.15.135:49692) 2023-10-09T11:40:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f4547fff700 1 -- 172.21.15.135:0/2715670691 learned_addr learned my addr 172.21.15.135:0/2715670691 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f4547fff700 1 -- 172.21.15.135:0/2715670691 >> v1:172.21.15.135:6789/0 conn(0x7f45480b16d0 legacy=0x7f454815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f4547fff700 1 -- 172.21.15.135:0/2715670691 >> v1:172.21.15.86:6789/0 conn(0x7f45480b1b40 legacy=0x7f454815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f4547fff700 1 -- 172.21.15.135:0/2715670691 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480b5f20 con 0x7f45480b4e70 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.956+0000 7f4546ffd700 1 -- 172.21.15.135:0/2715670691 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373919550 0 0) 0x7f45480cfb00 con 0x7f45480b1b40 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.957+0000 7f4547fff700 1 --2- 172.21.15.135:0/2715670691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b4e70 0x7f45480ccff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45380099b0 tx=0x7f4538009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=495a48fe6774a6e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.957+0000 7f4546ffd700 1 -- 172.21.15.135:0/2715670691 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800b860 con 0x7f45480b4e70 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.957+0000 7f4546ffd700 1 -- 172.21.15.135:0/2715670691 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800b9c0 con 0x7f45480b4e70 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.957+0000 7f4546ffd700 1 -- 172.21.15.135:0/2715670691 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800bd60 con 0x7f45480b4e70 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.957+0000 7f454d39d700 1 -- 172.21.15.135:0/2715670691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b4e70 msgr2=0x7f45480ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.957+0000 7f454d39d700 1 --2- 172.21.15.135:0/2715670691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b4e70 0x7f45480ccff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45380099b0 tx=0x7f4538009250 comp rx=0 tx=0).stop 2023-10-09T11:40:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.958+0000 7f454d39d700 1 -- 172.21.15.135:0/2715670691 shutdown_connections 2023-10-09T11:40:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.958+0000 7f454d39d700 1 --2- 172.21.15.135:0/2715670691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b4e70 0x7f45480ccff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.958+0000 7f454d39d700 1 -- 172.21.15.135:0/2715670691 >> 172.21.15.135:0/2715670691 conn(0x7f45480d10c0 msgr2=0x7f45480affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.958+0000 7f454d39d700 1 -- 172.21.15.135:0/2715670691 shutdown_connections 2023-10-09T11:40:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.958+0000 7f454d39d700 1 -- 172.21.15.135:0/2715670691 wait complete. 2023-10-09T11:40:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.959+0000 7f454d39d700 1 Processor -- start 2023-10-09T11:40:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.959+0000 7f454d39d700 1 -- start start 2023-10-09T11:40:48.962 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f454d39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b16d0 0x7f4548145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f454d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45480b1b40 0x7f45480ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f454d39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45480b4e70 0x7f45480caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f454d39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454816b590 con 0x7f45480b4e70 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f454d39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4548145e90 con 0x7f45480b16d0 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f454d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45480c6330 con 0x7f45480b1b40 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f4547fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b16d0 0x7f4548145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f45477fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45480b1b40 0x7f45480ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f4547fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b16d0 0x7f4548145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49708/0 (socket says 172.21.15.135:49708) 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f4547fff700 1 -- 172.21.15.135:0/3809116478 learned_addr learned my addr 172.21.15.135:0/3809116478 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.960+0000 7f454cb9c700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45480b4e70 0x7f45480caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f4547fff700 1 -- 172.21.15.135:0/3809116478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45480b1b40 msgr2=0x7f45480ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f4547fff700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45480b1b40 0x7f45480ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f4547fff700 1 -- 172.21.15.135:0/3809116478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45480b4e70 msgr2=0x7f45480caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f4547fff700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45480b4e70 0x7f45480caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f4547fff700 1 -- 172.21.15.135:0/3809116478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45380094f0 con 0x7f45480b16d0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f4547fff700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b16d0 0x7f4548145950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4538006f50 tx=0x7f4538017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f452ffff700 1 -- 172.21.15.135:0/3809116478 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453801f070 con 0x7f45480b16d0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f452ffff700 1 -- 172.21.15.135:0/3809116478 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538011bb0 con 0x7f45480b16d0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f452ffff700 1 -- 172.21.15.135:0/3809116478 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538025420 con 0x7f45480b16d0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.961+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45480c6610 con 0x7f45480b16d0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.962+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45480c6bd0 con 0x7f45480b16d0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.962+0000 7f452ffff700 1 -- 172.21.15.135:0/3809116478 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4538023070 con 0x7f45480b16d0 2023-10-09T11:40:48.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.962+0000 7f452ffff700 1 -- 172.21.15.135:0/3809116478 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f453801a850 con 0x7f45480b16d0 2023-10-09T11:40:48.965 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.962+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45480896a0 con 0x7f45480b16d0 2023-10-09T11:40:48.965 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:48.965+0000 7f452ffff700 1 -- 172.21.15.135:0/3809116478 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4538033060 con 0x7f45480b16d0 2023-10-09T11:40:49.052 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.051+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f880a5f-971b-4352-86ec-366bd3e44eae", "id": 2} v 0) v1 -- 0x7f45480b14b0 con 0x7f45480b16d0 2023-10-09T11:40:49.055 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:49.054+0000 7f3c45760180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:40:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.055+0000 7f452ffff700 1 -- 172.21.15.135:0/3809116478 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f880a5f-971b-4352-86ec-366bd3e44eae", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f453802a070 con 0x7f45480b16d0 2023-10-09T11:40:49.056 INFO:teuthology.orchestra.run.smithi135.stdout:2 2023-10-09T11:40:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b16d0 msgr2=0x7f4548145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b16d0 0x7f4548145950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4538006f50 tx=0x7f4538017000 comp rx=0 tx=0).stop 2023-10-09T11:40:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 shutdown_connections 2023-10-09T11:40:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45480b4e70 0x7f45480caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45480b16d0 0x7f4548145950 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 --2- 172.21.15.135:0/3809116478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45480b1b40 0x7f45480ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 >> 172.21.15.135:0/3809116478 conn(0x7f45480d10c0 msgr2=0x7f45480b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 shutdown_connections 2023-10-09T11:40:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.056+0000 7f454d39d700 1 -- 172.21.15.135:0/3809116478 wait complete. 2023-10-09T11:40:49.075 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 5cdc5a9b-da9a-412d-afa1-71f67fd314db 3 2023-10-09T11:40:49.144 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:49.143+0000 7f87ad64a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:40:49.260 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.259+0000 7f32df5ff700 1 Processor -- start 2023-10-09T11:40:49.260 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.259+0000 7f32df5ff700 1 -- start start 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32df5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f32d8159890 0x7f32d815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32df5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32d8159c60 0x7f32d815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32df5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d815a160 con 0x7f32d815db10 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32df5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d815df50 con 0x7f32d8159c60 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32df5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d80d13a0 con 0x7f32d8159890 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32dd39b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f32d8159890 0x7f32d815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32dd39b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f32d8159890 0x7f32d815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49712/0 (socket says 172.21.15.135:49712) 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32dd39b700 1 -- 172.21.15.135:0/2089727105 learned_addr learned my addr 172.21.15.135:0/2089727105 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32dcb9a700 1 --2- 172.21.15.135:0/2089727105 >> v2:172.21.15.86:3300/0 conn(0x7f32d8159c60 0x7f32d815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32dd39b700 1 -- 172.21.15.135:0/2089727105 >> v2:172.21.15.86:3300/0 conn(0x7f32d8159c60 msgr2=0x7f32d815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32dd39b700 1 --2- 172.21.15.135:0/2089727105 >> v2:172.21.15.86:3300/0 conn(0x7f32d8159c60 0x7f32d815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.261+0000 7f32dd39b700 1 -- 172.21.15.135:0/2089727105 >> v1:172.21.15.86:6789/0 conn(0x7f32d815db10 legacy=0x7f32d8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.262+0000 7f32dd39b700 1 -- 172.21.15.135:0/2089727105 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d815e140 con 0x7f32d8159890 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.262+0000 7f32dd39b700 1 --2- 172.21.15.135:0/2089727105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159890 0x7f32d815abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f32d80d1090 tx=0x7f32d4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88f5171d01dfd85 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.262+0000 7f32cffff700 1 -- 172.21.15.135:0/2089727105 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4009e70 con 0x7f32d8159890 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.262+0000 7f32cffff700 1 -- 172.21.15.135:0/2089727105 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d400b860 con 0x7f32d8159890 2023-10-09T11:40:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.262+0000 7f32cffff700 1 -- 172.21.15.135:0/2089727105 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400bc00 con 0x7f32d8159890 2023-10-09T11:40:49.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 -- 172.21.15.135:0/2089727105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159890 msgr2=0x7f32d815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 --2- 172.21.15.135:0/2089727105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159890 0x7f32d815abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f32d80d1090 tx=0x7f32d4009250 comp rx=0 tx=0).stop 2023-10-09T11:40:49.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 -- 172.21.15.135:0/2089727105 shutdown_connections 2023-10-09T11:40:49.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 --2- 172.21.15.135:0/2089727105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159890 0x7f32d815abd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 --2- 172.21.15.135:0/2089727105 >> v2:172.21.15.86:3300/0 conn(0x7f32d8159c60 0x7f32d815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 -- 172.21.15.135:0/2089727105 >> 172.21.15.135:0/2089727105 conn(0x7f32d8068e20 msgr2=0x7f32d80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 -- 172.21.15.135:0/2089727105 shutdown_connections 2023-10-09T11:40:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.263+0000 7f32df5ff700 1 -- 172.21.15.135:0/2089727105 wait complete. 2023-10-09T11:40:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.264+0000 7f32df5ff700 1 Processor -- start 2023-10-09T11:40:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.264+0000 7f32df5ff700 1 -- start start 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.265+0000 7f32df5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32d8159890 0x7f32d80cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.265+0000 7f32df5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159c60 0x7f32d80cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.265+0000 7f32df5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d815db10 0x7f32d814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.265+0000 7f32df5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80b57c0 con 0x7f32d815db10 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.265+0000 7f32df5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80cda50 con 0x7f32d8159c60 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.265+0000 7f32df5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80cd160 con 0x7f32d8159890 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dcb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159c60 0x7f32d80cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32d8159890 0x7f32d80cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32d8159890 0x7f32d80cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54910/0 (socket says 172.21.15.135:54910) 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dcb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159c60 0x7f32d80cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49718/0 (socket says 172.21.15.135:49718) 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 -- 172.21.15.135:0/4213380938 learned_addr learned my addr 172.21.15.135:0/4213380938 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32ddb9c700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d815db10 0x7f32d814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 -- 172.21.15.135:0/4213380938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159c60 msgr2=0x7f32d80cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159c60 0x7f32d80cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 -- 172.21.15.135:0/4213380938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d815db10 msgr2=0x7f32d814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d815db10 0x7f32d814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 -- 172.21.15.135:0/4213380938 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40094f0 con 0x7f32d8159890 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32ddb9c700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d815db10 0x7f32d814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.266+0000 7f32dd39b700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32d8159890 0x7f32d80cf0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32d4006fd0 tx=0x7f32d4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.267+0000 7f32cd7fa700 1 -- 172.21.15.135:0/4213380938 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400b9d0 con 0x7f32d8159890 2023-10-09T11:40:49.271 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.267+0000 7f32cd7fa700 1 -- 172.21.15.135:0/4213380938 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d400bb30 con 0x7f32d8159890 2023-10-09T11:40:49.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.267+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d80cfbb0 con 0x7f32d8159890 2023-10-09T11:40:49.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.267+0000 7f32cd7fa700 1 -- 172.21.15.135:0/4213380938 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4025670 con 0x7f32d8159890 2023-10-09T11:40:49.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.267+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d80cd6e0 con 0x7f32d8159890 2023-10-09T11:40:49.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.267+0000 7f32cd7fa700 1 -- 172.21.15.135:0/4213380938 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f32d4023070 con 0x7f32d8159890 2023-10-09T11:40:49.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.267+0000 7f32cd7fa700 1 -- 172.21.15.135:0/4213380938 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f32d4025d20 con 0x7f32d8159890 2023-10-09T11:40:49.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.268+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d80cff40 con 0x7f32d8159890 2023-10-09T11:40:49.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.270+0000 7f32cd7fa700 1 -- 172.21.15.135:0/4213380938 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f32d4015020 con 0x7f32d8159890 2023-10-09T11:40:49.308 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:49.307+0000 7f3c45760180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:40:49.357 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:49.355+0000 7f87ad64a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:40:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.385+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5cdc5a9b-da9a-412d-afa1-71f67fd314db", "id": 3} v 0) v1 -- 0x7f32d804c3c0 con 0x7f32d8159890 2023-10-09T11:40:49.392 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.392+0000 7f32cd7fa700 1 -- 172.21.15.135:0/4213380938 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5cdc5a9b-da9a-412d-afa1-71f67fd314db", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f32d4037450 con 0x7f32d8159890 2023-10-09T11:40:49.392 INFO:teuthology.orchestra.run.smithi135.stdout:3 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32d8159890 msgr2=0x7f32d80cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32d8159890 0x7f32d80cf0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32d4006fd0 tx=0x7f32d4017000 comp rx=0 tx=0).stop 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 shutdown_connections 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32d815db10 0x7f32d814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32d8159890 0x7f32d80cf0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 --2- 172.21.15.135:0/4213380938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32d8159c60 0x7f32d80cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 >> 172.21.15.135:0/4213380938 conn(0x7f32d8068e20 msgr2=0x7f32d80b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 shutdown_connections 2023-10-09T11:40:49.394 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.393+0000 7f32df5ff700 1 -- 172.21.15.135:0/4213380938 wait complete. 2023-10-09T11:40:49.416 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new a7ccad54-7e58-44a5-a52f-80bf5dc2a888 4 2023-10-09T11:40:49.452 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:49.450+0000 7f87ad64a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:40:49.541 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:49.540+0000 7f3c45760180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:40:49.601 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.600+0000 7fe2aa59d700 1 Processor -- start 2023-10-09T11:40:49.601 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.600+0000 7fe2aa59d700 1 -- start start 2023-10-09T11:40:49.602 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.601+0000 7fe2aa59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2a4159a70 0x7fe2a40c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.601+0000 7fe2aa59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4068aa0 0x7fe2a40c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.601+0000 7fe2aa59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a40ca920 con 0x7fe2a406bfa0 2023-10-09T11:40:49.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.601+0000 7fe2aa59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a406af00 con 0x7fe2a4159a70 2023-10-09T11:40:49.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.601+0000 7fe2aa59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a406b1e0 con 0x7fe2a4068aa0 2023-10-09T11:40:49.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4068aa0 0x7fe2a40c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4068aa0 0x7fe2a40c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54916/0 (socket says 172.21.15.135:54916) 2023-10-09T11:40:49.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3537744344 learned_addr learned my addr 172.21.15.135:0/3537744344 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3537744344 >> v2:172.21.15.86:3300/0 conn(0x7fe2a4159a70 msgr2=0x7fe2a40c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 --2- 172.21.15.135:0/3537744344 >> v2:172.21.15.86:3300/0 conn(0x7fe2a4159a70 0x7fe2a40c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3537744344 >> v1:172.21.15.86:6789/0 conn(0x7fe2a406bfa0 legacy=0x7fe2a4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3537744344 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a406b4c0 con 0x7fe2a4068aa0 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.602+0000 7fe2a9d9c700 1 --2- 172.21.15.135:0/3537744344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4068aa0 0x7fe2a40c8830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0099b0 tx=0x7fe29c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3649f9058bfd679 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe29bfff700 1 -- 172.21.15.135:0/3537744344 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00b820 con 0x7fe2a4068aa0 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe29bfff700 1 -- 172.21.15.135:0/3537744344 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c00b980 con 0x7fe2a4068aa0 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe29bfff700 1 -- 172.21.15.135:0/3537744344 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00bd20 con 0x7fe2a4068aa0 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3537744344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4068aa0 msgr2=0x7fe2a40c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe2aa59d700 1 --2- 172.21.15.135:0/3537744344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4068aa0 0x7fe2a40c8830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0099b0 tx=0x7fe29c009250 comp rx=0 tx=0).stop 2023-10-09T11:40:49.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3537744344 shutdown_connections 2023-10-09T11:40:49.606 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe2aa59d700 1 --2- 172.21.15.135:0/3537744344 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4068aa0 0x7fe2a40c8830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.606 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe2aa59d700 1 --2- 172.21.15.135:0/3537744344 >> v2:172.21.15.86:3300/0 conn(0x7fe2a4159a70 0x7fe2a40c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.606 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3537744344 >> 172.21.15.135:0/3537744344 conn(0x7fe2a40cddc0 msgr2=0x7fe2a40c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.606 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.603+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3537744344 shutdown_connections 2023-10-09T11:40:49.606 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.604+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3537744344 wait complete. 2023-10-09T11:40:49.608 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.605+0000 7fe2aa59d700 1 Processor -- start 2023-10-09T11:40:49.608 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.605+0000 7fe2aa59d700 1 -- start start 2023-10-09T11:40:49.608 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2aa59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a4068aa0 0x7fe2a416d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.608 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2aa59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a406bfa0 0x7fe2a416a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.608 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2aa59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4159a70 0x7fe2a40b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2aa59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a40c7280 con 0x7fe2a406bfa0 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2aa59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4151bf0 con 0x7fe2a4068aa0 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2aa59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a40c6a90 con 0x7fe2a4159a70 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2a9d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4159a70 0x7fe2a40b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2a9d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4159a70 0x7fe2a40b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54930/0 (socket says 172.21.15.135:54930) 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3345128050 learned_addr learned my addr 172.21.15.135:0/3345128050 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2a959b700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a4068aa0 0x7fe2a416d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.606+0000 7fe2a8d9a700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a406bfa0 0x7fe2a416a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a4068aa0 msgr2=0x7fe2a416d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2a9d9c700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a4068aa0 0x7fe2a416d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3345128050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a406bfa0 msgr2=0x7fe2a416a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.609 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2a9d9c700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a406bfa0 0x7fe2a416a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.610 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2a9d9c700 1 -- 172.21.15.135:0/3345128050 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0094f0 con 0x7fe2a4159a70 2023-10-09T11:40:49.610 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2a9d9c700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4159a70 0x7fe2a40b2900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0099b0 tx=0x7fe29c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.610 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2997fa700 1 -- 172.21.15.135:0/3345128050 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c026480 con 0x7fe2a4159a70 2023-10-09T11:40:49.610 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2997fa700 1 -- 172.21.15.135:0/3345128050 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c01f070 con 0x7fe2a4159a70 2023-10-09T11:40:49.610 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2997fa700 1 -- 172.21.15.135:0/3345128050 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c026850 con 0x7fe2a4159a70 2023-10-09T11:40:49.610 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a416a760 con 0x7fe2a4159a70 2023-10-09T11:40:49.610 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.607+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a40b15b0 con 0x7fe2a4159a70 2023-10-09T11:40:49.611 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.608+0000 7fe2997fa700 1 -- 172.21.15.135:0/3345128050 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe29c01a440 con 0x7fe2a4159a70 2023-10-09T11:40:49.611 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.608+0000 7fe2997fa700 1 -- 172.21.15.135:0/3345128050 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fe29c021070 con 0x7fe2a4159a70 2023-10-09T11:40:49.611 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.608+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a40b1740 con 0x7fe2a4159a70 2023-10-09T11:40:49.611 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:49.609+0000 7f87ad64a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:40:49.612 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.611+0000 7fe2997fa700 1 -- 172.21.15.135:0/3345128050 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe29c02b020 con 0x7fe2a4159a70 2023-10-09T11:40:49.642 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:49.641+0000 7f3c45760180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:40:49.699 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.698+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7ccad54-7e58-44a5-a52f-80bf5dc2a888", "id": 4} v 0) v1 -- 0x7fe2a40c7060 con 0x7fe2a4159a70 2023-10-09T11:40:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.706+0000 7fe2997fa700 1 -- 172.21.15.135:0/3345128050 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7ccad54-7e58-44a5-a52f-80bf5dc2a888", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe29c01a7e0 con 0x7fe2a4159a70 2023-10-09T11:40:49.708 INFO:teuthology.orchestra.run.smithi135.stdout:4 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4159a70 msgr2=0x7fe2a40b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4159a70 0x7fe2a40b2900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0099b0 tx=0x7fe29c016000 comp rx=0 tx=0).stop 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 shutdown_connections 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a4159a70 0x7fe2a40b2900 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a4068aa0 0x7fe2a416d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 --2- 172.21.15.135:0/3345128050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a406bfa0 0x7fe2a416a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 >> 172.21.15.135:0/3345128050 conn(0x7fe2a40cddc0 msgr2=0x7fe2a40c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 shutdown_connections 2023-10-09T11:40:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.708+0000 7fe2aa59d700 1 -- 172.21.15.135:0/3345128050 wait complete. 2023-10-09T11:40:49.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new ad45688c-6a40-4e89-aff3-c4c55420fa6a 5 2023-10-09T11:40:49.729 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:49.728+0000 7f87ad64a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:40:49.822 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:49.821+0000 7f3c45760180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:40:49.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.936+0000 7f0d603ff700 1 Processor -- start 2023-10-09T11:40:49.937 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.936+0000 7f0d603ff700 1 -- start start 2023-10-09T11:40:49.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d603ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58159890 0x7f0d5815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d603ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0d58159c60 0x7f0d5815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d603ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d5815db10 0x7f0d58069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d603ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5815a160 con 0x7f0d5815db10 2023-10-09T11:40:49.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d603ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d580d13a0 con 0x7f0d58159c60 2023-10-09T11:40:49.939 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d603ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5815e140 con 0x7f0d58159890 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d5e19b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58159890 0x7f0d5815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d5d99a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0d58159c60 0x7f0d5815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d5e19b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58159890 0x7f0d5815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54938/0 (socket says 172.21.15.135:54938) 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d5e19b700 1 -- 172.21.15.135:0/3615369132 learned_addr learned my addr 172.21.15.135:0/3615369132 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.938+0000 7f0d5e99c700 1 --2- 172.21.15.135:0/3615369132 >> v2:172.21.15.86:3300/0 conn(0x7f0d5815db10 0x7f0d58069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d99a700 1 -- 172.21.15.135:0/3615369132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58159890 msgr2=0x7f0d5815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d99a700 1 --2- 172.21.15.135:0/3615369132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58159890 0x7f0d5815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.941 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d99a700 1 -- 172.21.15.135:0/3615369132 >> v2:172.21.15.86:3300/0 conn(0x7f0d5815db10 msgr2=0x7f0d58069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d99a700 1 --2- 172.21.15.135:0/3615369132 >> v2:172.21.15.86:3300/0 conn(0x7f0d5815db10 0x7f0d58069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d99a700 1 -- 172.21.15.135:0/3615369132 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5815a3d0 con 0x7f0d58159c60 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5e99c700 1 --2- 172.21.15.135:0/3615369132 >> v2:172.21.15.86:3300/0 conn(0x7f0d5815db10 0x7f0d58069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d99a700 1 --2- 172.21.15.135:0/3615369132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d5815d5d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0d580650f0 tx=0x7f0d480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dacfbcf78de5559 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d199700 1 -- 172.21.15.135:0/3615369132 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011630 con 0x7f0d58159c60 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d199700 1 -- 172.21.15.135:0/3615369132 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d480117b0 con 0x7f0d58159c60 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.939+0000 7f0d5d199700 1 -- 172.21.15.135:0/3615369132 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011b70 con 0x7f0d58159c60 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 -- 172.21.15.135:0/3615369132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 msgr2=0x7f0d5815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3615369132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d5815d5d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0d580650f0 tx=0x7f0d480091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 -- 172.21.15.135:0/3615369132 shutdown_connections 2023-10-09T11:40:49.942 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3615369132 >> v2:172.21.15.86:3300/0 conn(0x7f0d5815db10 0x7f0d58069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3615369132 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58159890 0x7f0d5815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3615369132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d5815d5d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 -- 172.21.15.135:0/3615369132 >> 172.21.15.135:0/3615369132 conn(0x7f0d58068e20 msgr2=0x7f0d580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 -- 172.21.15.135:0/3615369132 shutdown_connections 2023-10-09T11:40:49.943 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.940+0000 7f0d603ff700 1 -- 172.21.15.135:0/3615369132 wait complete. 2023-10-09T11:40:49.945 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.941+0000 7f0d603ff700 1 Processor -- start 2023-10-09T11:40:49.945 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.942+0000 7f0d603ff700 1 -- start start 2023-10-09T11:40:49.945 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.942+0000 7f0d603ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58159890 0x7f0d580c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.945 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.942+0000 7f0d603ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d580c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d603ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d5815db10 0x7f0d580c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d603ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580ca580 con 0x7f0d58159890 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d603ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580cda00 con 0x7f0d58159c60 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d603ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580c9970 con 0x7f0d5815db10 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d580c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d580c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49748/0 (socket says 172.21.15.135:49748) 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 -- 172.21.15.135:0/3852575014 learned_addr learned my addr 172.21.15.135:0/3852575014 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5e19b700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58159890 0x7f0d580c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5e99c700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d5815db10 0x7f0d580c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 -- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d5815db10 msgr2=0x7f0d580c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.946 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d5815db10 0x7f0d580c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 -- 172.21.15.135:0/3852575014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58159890 msgr2=0x7f0d580c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58159890 0x7f0d580c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5d99a700 1 -- 172.21.15.135:0/3852575014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009a20 con 0x7f0d58159c60 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5e19b700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58159890 0x7f0d580c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.943+0000 7f0d5e99c700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d5815db10 0x7f0d580c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d5d99a700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d580c8e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d48013000 tx=0x7f0d48017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d4e7fc700 1 -- 172.21.15.135:0/3852575014 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4801f070 con 0x7f0d58159c60 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d4e7fc700 1 -- 172.21.15.135:0/3852575014 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48000bc0 con 0x7f0d58159c60 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d4e7fc700 1 -- 172.21.15.135:0/3852575014 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48025420 con 0x7f0d58159c60 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48009420 con 0x7f0d58159c60 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d580c9f30 con 0x7f0d58159c60 2023-10-09T11:40:49.947 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d4e7fc700 1 -- 172.21.15.135:0/3852575014 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0d48023070 con 0x7f0d58159c60 2023-10-09T11:40:49.948 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.944+0000 7f0d4e7fc700 1 -- 172.21.15.135:0/3852575014 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f0d4802e930 con 0x7f0d58159c60 2023-10-09T11:40:49.948 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.945+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d580ca6f0 con 0x7f0d58159c60 2023-10-09T11:40:49.948 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:49.948+0000 7f3c45760180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:40:49.949 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:49.948+0000 7f0d4e7fc700 1 -- 172.21.15.135:0/3852575014 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0d4802a070 con 0x7f0d58159c60 2023-10-09T11:40:50.035 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.035+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad45688c-6a40-4e89-aff3-c4c55420fa6a", "id": 5} v 0) v1 -- 0x7f0d5804c3c0 con 0x7f0d58159c60 2023-10-09T11:40:50.042 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.041+0000 7f0d4e7fc700 1 -- 172.21.15.135:0/3852575014 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad45688c-6a40-4e89-aff3-c4c55420fa6a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d48015020 con 0x7f0d58159c60 2023-10-09T11:40:50.042 INFO:teuthology.orchestra.run.smithi135.stdout:5 2023-10-09T11:40:50.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 msgr2=0x7f0d580c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d580c8e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d48013000 tx=0x7f0d48017000 comp rx=0 tx=0).stop 2023-10-09T11:40:50.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 shutdown_connections 2023-10-09T11:40:50.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58159890 0x7f0d580c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d5815db10 0x7f0d580c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.044 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 --2- 172.21.15.135:0/3852575014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d58159c60 0x7f0d580c8e00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.044 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 >> 172.21.15.135:0/3852575014 conn(0x7f0d58068e20 msgr2=0x7f0d580b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.044 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 shutdown_connections 2023-10-09T11:40:50.044 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.042+0000 7f0d603ff700 1 -- 172.21.15.135:0/3852575014 wait complete. 2023-10-09T11:40:50.061 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new dd24db72-6eb2-48dc-a23c-ba81858526ac 6 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.241+0000 7fd51559d700 1 Processor -- start 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.241+0000 7fd51559d700 1 -- start start 2023-10-09T11:40:50.244 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd51559d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5100b16d0 0x7fd5100b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.244 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd51559d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5100b33b0 0x7fd5100b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.244 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd51559d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5100b2080 con 0x7fd5100b4e70 2023-10-09T11:40:50.244 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd51559d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5100cfb00 con 0x7fd5100b16d0 2023-10-09T11:40:50.244 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd51559d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5100b5c40 con 0x7fd5100b33b0 2023-10-09T11:40:50.244 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd514d9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5100b33b0 0x7fd5100b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.245 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd514d9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5100b33b0 0x7fd5100b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49754/0 (socket says 172.21.15.135:49754) 2023-10-09T11:40:50.245 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd514d9c700 1 -- 172.21.15.135:0/3722655353 learned_addr learned my addr 172.21.15.135:0/3722655353 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:50.245 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd50f7fe700 1 --2- 172.21.15.135:0/3722655353 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b16d0 0x7fd5100b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.245 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd514d9c700 1 -- 172.21.15.135:0/3722655353 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b16d0 msgr2=0x7fd5100b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:50.245 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd514d9c700 1 --2- 172.21.15.135:0/3722655353 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b16d0 0x7fd5100b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.245 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd514d9c700 1 -- 172.21.15.135:0/3722655353 >> v1:172.21.15.135:6789/0 conn(0x7fd5100b4e70 legacy=0x7fd5100ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.245 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.243+0000 7fd514d9c700 1 -- 172.21.15.135:0/3722655353 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100b5f20 con 0x7fd5100b33b0 2023-10-09T11:40:50.246 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.244+0000 7fd514d9c700 1 --2- 172.21.15.135:0/3722655353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b33b0 0x7fd5100b37d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd510071380 tx=0x7fd508009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39dfe53a4d05f113 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.246 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.244+0000 7fd50effd700 1 -- 172.21.15.135:0/3722655353 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800e070 con 0x7fd5100b33b0 2023-10-09T11:40:50.246 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.244+0000 7fd50effd700 1 -- 172.21.15.135:0/3722655353 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800ba20 con 0x7fd5100b33b0 2023-10-09T11:40:50.246 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.244+0000 7fd50effd700 1 -- 172.21.15.135:0/3722655353 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080092e0 con 0x7fd5100b33b0 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 -- 172.21.15.135:0/3722655353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b33b0 msgr2=0x7fd5100b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 --2- 172.21.15.135:0/3722655353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b33b0 0x7fd5100b37d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd510071380 tx=0x7fd508009840 comp rx=0 tx=0).stop 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 -- 172.21.15.135:0/3722655353 shutdown_connections 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 --2- 172.21.15.135:0/3722655353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b33b0 0x7fd5100b37d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 --2- 172.21.15.135:0/3722655353 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b16d0 0x7fd5100b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 -- 172.21.15.135:0/3722655353 >> 172.21.15.135:0/3722655353 conn(0x7fd5100d10c0 msgr2=0x7fd5100affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 -- 172.21.15.135:0/3722655353 shutdown_connections 2023-10-09T11:40:50.247 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.245+0000 7fd51559d700 1 -- 172.21.15.135:0/3722655353 wait complete. 2023-10-09T11:40:50.248 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.246+0000 7fd51559d700 1 Processor -- start 2023-10-09T11:40:50.248 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.246+0000 7fd51559d700 1 -- start start 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.247+0000 7fd51559d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b16d0 0x7fd51016a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.247+0000 7fd51559d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5100b33b0 0x7fd5100ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.247+0000 7fd51559d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5100b4e70 0x7fd510157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.247+0000 7fd51559d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100c99e0 con 0x7fd5100b4e70 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.247+0000 7fd51559d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51016a9a0 con 0x7fd5100b16d0 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.247+0000 7fd51559d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100cab10 con 0x7fd5100b33b0 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b16d0 0x7fd51016a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b16d0 0x7fd51016a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49760/0 (socket says 172.21.15.135:49760) 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 -- 172.21.15.135:0/863736969 learned_addr learned my addr 172.21.15.135:0/863736969 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd514d9c700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5100b4e70 0x7fd510157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.249 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50f7fe700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5100b33b0 0x7fd5100ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 -- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5100b33b0 msgr2=0x7fd5100ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5100b33b0 0x7fd5100ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 -- 172.21.15.135:0/863736969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5100b4e70 msgr2=0x7fd510157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5100b4e70 0x7fd510157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 -- 172.21.15.135:0/863736969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508009ae0 con 0x7fd5100b16d0 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd514d9c700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5100b4e70 0x7fd510157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.248+0000 7fd50ffff700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b16d0 0x7fd51016a460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c590 tx=0x7fd50000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.249+0000 7fd4f7fff700 1 -- 172.21.15.135:0/863736969 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500011590 con 0x7fd5100b16d0 2023-10-09T11:40:50.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.249+0000 7fd4f7fff700 1 -- 172.21.15.135:0/863736969 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd500011710 con 0x7fd5100b16d0 2023-10-09T11:40:50.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.249+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5100c9420 con 0x7fd5100b16d0 2023-10-09T11:40:50.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.249+0000 7fd4f7fff700 1 -- 172.21.15.135:0/863736969 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500011ad0 con 0x7fd5100b16d0 2023-10-09T11:40:50.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.249+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5100c9dd0 con 0x7fd5100b16d0 2023-10-09T11:40:50.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.249+0000 7fd4f7fff700 1 -- 172.21.15.135:0/863736969 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd50001c6c0 con 0x7fd5100b16d0 2023-10-09T11:40:50.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.249+0000 7fd4f7fff700 1 -- 172.21.15.135:0/863736969 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fd50001c970 con 0x7fd5100b16d0 2023-10-09T11:40:50.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.250+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510071920 con 0x7fd5100b16d0 2023-10-09T11:40:50.253 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.252+0000 7fd4f7fff700 1 -- 172.21.15.135:0/863736969 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd500017070 con 0x7fd5100b16d0 2023-10-09T11:40:50.331 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:50.330+0000 7f87ad64a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:40:50.340 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.339+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd24db72-6eb2-48dc-a23c-ba81858526ac", "id": 6} v 0) v1 -- 0x7fd5100d1490 con 0x7fd5100b16d0 2023-10-09T11:40:50.348 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.347+0000 7fd4f7fff700 1 -- 172.21.15.135:0/863736969 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd24db72-6eb2-48dc-a23c-ba81858526ac", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd50001cc00 con 0x7fd5100b16d0 2023-10-09T11:40:50.348 INFO:teuthology.orchestra.run.smithi135.stdout:6 2023-10-09T11:40:50.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.348+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b16d0 msgr2=0x7fd51016a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.348+0000 7fd51559d700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b16d0 0x7fd51016a460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c590 tx=0x7fd50000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.349+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 shutdown_connections 2023-10-09T11:40:50.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.349+0000 7fd51559d700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5100b4e70 0x7fd510157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.349+0000 7fd51559d700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5100b16d0 0x7fd51016a460 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.349+0000 7fd51559d700 1 --2- 172.21.15.135:0/863736969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5100b33b0 0x7fd5100ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.349+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 >> 172.21.15.135:0/863736969 conn(0x7fd5100d10c0 msgr2=0x7fd5100cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.349+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 shutdown_connections 2023-10-09T11:40:50.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.349+0000 7fd51559d700 1 -- 172.21.15.135:0/863736969 wait complete. 2023-10-09T11:40:50.367 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 0d290858-b41d-4cc6-b758-62c0ab3b1447 7 2023-10-09T11:40:50.427 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:50.426+0000 7f87ad64a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:40:50.524 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:50.522+0000 7f87ad64a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:40:50.552 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.551+0000 7fe3b05ff700 1 Processor -- start 2023-10-09T11:40:50.552 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.551+0000 7fe3b05ff700 1 -- start start 2023-10-09T11:40:50.553 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3b05ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3b05ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe3a806a2b0 0x7fe3a806a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.554 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3b05ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a80ac450 con 0x7fe3a80637d0 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3b05ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a80693d0 con 0x7fe3a806a2b0 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3b05ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8069d00 con 0x7fe3a806b160 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3ae39b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3ae39b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a806b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:54964/0 (socket says 172.21.15.135:54964) 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3ae39b700 1 -- 172.21.15.135:0/3875623737 learned_addr learned my addr 172.21.15.135:0/3875623737 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3aeb9c700 1 --2- 172.21.15.135:0/3875623737 >> v2:172.21.15.86:3300/0 conn(0x7fe3a806a2b0 0x7fe3a806a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3ae39b700 1 -- 172.21.15.135:0/3875623737 >> v2:172.21.15.86:3300/0 conn(0x7fe3a806a2b0 msgr2=0x7fe3a806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3ae39b700 1 --2- 172.21.15.135:0/3875623737 >> v2:172.21.15.86:3300/0 conn(0x7fe3a806a2b0 0x7fe3a806a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3ae39b700 1 -- 172.21.15.135:0/3875623737 >> v1:172.21.15.86:6789/0 conn(0x7fe3a80637d0 legacy=0x7fe3a8068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.553+0000 7fe3ae39b700 1 -- 172.21.15.135:0/3875623737 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8068830 con 0x7fe3a806b160 2023-10-09T11:40:50.555 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.554+0000 7fe3ae39b700 1 --2- 172.21.15.135:0/3875623737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a806b530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40099b0 tx=0x7fe3a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89db8816b01b32f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.556 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.554+0000 7fe3ad399700 1 -- 172.21.15.135:0/3875623737 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4009ea0 con 0x7fe3a806b160 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.554+0000 7fe3ad399700 1 -- 172.21.15.135:0/3875623737 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a400b860 con 0x7fe3a806b160 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.554+0000 7fe3ad399700 1 -- 172.21.15.135:0/3875623737 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400bc20 con 0x7fe3a806b160 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3875623737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 msgr2=0x7fe3a806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 --2- 172.21.15.135:0/3875623737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a806b530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40099b0 tx=0x7fe3a4009250 comp rx=0 tx=0).stop 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3875623737 shutdown_connections 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 --2- 172.21.15.135:0/3875623737 >> v2:172.21.15.86:3300/0 conn(0x7fe3a806a2b0 0x7fe3a806a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 --2- 172.21.15.135:0/3875623737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a806b530 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3875623737 >> 172.21.15.135:0/3875623737 conn(0x7fe3a806ded0 msgr2=0x7fe3a806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3875623737 shutdown_connections 2023-10-09T11:40:50.557 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.555+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3875623737 wait complete. 2023-10-09T11:40:50.559 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.556+0000 7fe3b05ff700 1 Processor -- start 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.556+0000 7fe3b05ff700 1 -- start start 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3b05ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3a80637d0 0x7fe3a8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3b05ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3a806a2b0 0x7fe3a8142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3b05ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a8142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3b05ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8158320 con 0x7fe3a806a2b0 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3b05ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80c1dd0 con 0x7fe3a80637d0 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3b05ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a815a620 con 0x7fe3a806b160 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3ae39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3a80637d0 0x7fe3a8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.557+0000 7fe3aeb9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a8142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3ae39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3a80637d0 0x7fe3a8152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49766/0 (socket says 172.21.15.135:49766) 2023-10-09T11:40:50.560 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3ae39b700 1 -- 172.21.15.135:0/3082368867 learned_addr learned my addr 172.21.15.135:0/3082368867 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3adb9a700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3a806a2b0 0x7fe3a8142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3aeb9c700 1 -- 172.21.15.135:0/3082368867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3a80637d0 msgr2=0x7fe3a8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3aeb9c700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3a80637d0 0x7fe3a8152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3aeb9c700 1 -- 172.21.15.135:0/3082368867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3a806a2b0 msgr2=0x7fe3a8142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3aeb9c700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3a806a2b0 0x7fe3a8142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3aeb9c700 1 -- 172.21.15.135:0/3082368867 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40094f0 con 0x7fe3a806b160 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3aeb9c700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a8142a10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009e80 tx=0x7fe3a000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe39e7fc700 1 -- 172.21.15.135:0/3082368867 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a000caa0 con 0x7fe3a806b160 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe39e7fc700 1 -- 172.21.15.135:0/3082368867 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a000f040 con 0x7fe3a806b160 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.558+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a8142770 con 0x7fe3a806b160 2023-10-09T11:40:50.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.559+0000 7fe39e7fc700 1 -- 172.21.15.135:0/3082368867 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a000ce70 con 0x7fe3a806b160 2023-10-09T11:40:50.562 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.559+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a81587b0 con 0x7fe3a806b160 2023-10-09T11:40:50.562 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.559+0000 7fe39e7fc700 1 -- 172.21.15.135:0/3082368867 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe3a0014690 con 0x7fe3a806b160 2023-10-09T11:40:50.562 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.559+0000 7fe39e7fc700 1 -- 172.21.15.135:0/3082368867 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fe3a001db10 con 0x7fe3a806b160 2023-10-09T11:40:50.562 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.560+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a804c3c0 con 0x7fe3a806b160 2023-10-09T11:40:50.563 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.562+0000 7fe39e7fc700 1 -- 172.21.15.135:0/3082368867 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe3a003b6d0 con 0x7fe3a806b160 2023-10-09T11:40:50.650 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:50.649+0000 7f3c45760180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:40:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.667+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d290858-b41d-4cc6-b758-62c0ab3b1447", "id": 7} v 0) v1 -- 0x7fe3a80aeec0 con 0x7fe3a806b160 2023-10-09T11:40:50.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.676+0000 7fe39e7fc700 1 -- 172.21.15.135:0/3082368867 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d290858-b41d-4cc6-b758-62c0ab3b1447", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe3a002a030 con 0x7fe3a806b160 2023-10-09T11:40:50.677 INFO:teuthology.orchestra.run.smithi135.stdout:7 2023-10-09T11:40:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 msgr2=0x7fe3a8142a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a8142a10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009e80 tx=0x7fe3a000b040 comp rx=0 tx=0).stop 2023-10-09T11:40:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 shutdown_connections 2023-10-09T11:40:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3a806b160 0x7fe3a8142a10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3a80637d0 0x7fe3a8152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 --2- 172.21.15.135:0/3082368867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3a806a2b0 0x7fe3a8142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 >> 172.21.15.135:0/3082368867 conn(0x7fe3a806ded0 msgr2=0x7fe3a815cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 shutdown_connections 2023-10-09T11:40:50.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-09T11:40:50.677+0000 7fe3b05ff700 1 -- 172.21.15.135:0/3082368867 wait complete. 2023-10-09T11:40:50.695 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-09T11:40:50.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-09T11:40:50.699 INFO:tasks.ceph.osd.0:Started 2023-10-09T11:40:50.699 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-09T11:40:50.700 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-09T11:40:50.704 INFO:tasks.ceph.osd.1:Started 2023-10-09T11:40:50.704 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-09T11:40:50.704 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-09T11:40:50.708 INFO:tasks.ceph.osd.2:Started 2023-10-09T11:40:50.708 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-09T11:40:50.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-09T11:40:50.714 INFO:tasks.ceph.osd.3:Started 2023-10-09T11:40:50.714 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-09T11:40:50.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-09T11:40:50.719 INFO:tasks.ceph.osd.4:Started 2023-10-09T11:40:50.719 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-09T11:40:50.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-09T11:40:50.724 INFO:tasks.ceph.osd.5:Started 2023-10-09T11:40:50.724 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-09T11:40:50.724 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-09T11:40:50.729 INFO:tasks.ceph.osd.6:Started 2023-10-09T11:40:50.729 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-09T11:40:50.729 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-09T11:40:50.735 INFO:tasks.ceph.osd.7:Started 2023-10-09T11:40:50.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:50.763 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:50.762+0000 7f3c45760180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:40:50.890 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:50.889+0000 7f3c45760180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:40:50.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.971+0000 7f50c9f9d700 1 Processor -- start 2023-10-09T11:40:50.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.972+0000 7f50c9f9d700 1 -- start start 2023-10-09T11:40:50.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.974+0000 7f50c9f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.974+0000 7f50c9f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40b2980 con 0x7f50c415d230 2023-10-09T11:40:50.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.974+0000 7f50c9f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40b11d0 con 0x7f50c41597f0 2023-10-09T11:40:50.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.974+0000 7f50c9f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40b14b0 con 0x7f50c4159420 2023-10-09T11:40:50.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.974+0000 7f50c979c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f50c415d230 0x7f50c40b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43898/0 (socket says 172.21.15.86:43898) 2023-10-09T11:40:50.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.974+0000 7f50c979c700 1 -- 172.21.15.86:0/748357693 learned_addr learned my addr 172.21.15.86:0/748357693 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:40:50.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.974+0000 7f50c8f9b700 1 --2- 172.21.15.86:0/748357693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c37fe700 1 -- 172.21.15.86:0/748357693 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277806999 0 0) 0x7f50c40b2980 con 0x7f50c415d230 2023-10-09T11:40:50.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c37fe700 1 -- 172.21.15.86:0/748357693 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b4003570 con 0x7f50c415d230 2023-10-09T11:40:50.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c37fe700 1 -- 172.21.15.86:0/748357693 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656139753 0 0) 0x7f50c40b11d0 con 0x7f50c41597f0 2023-10-09T11:40:50.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c37fe700 1 -- 172.21.15.86:0/748357693 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c40b2980 con 0x7f50c41597f0 2023-10-09T11:40:50.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c8f9b700 1 -- 172.21.15.86:0/748357693 >> v1:172.21.15.135:6789/0 conn(0x7f50c41597f0 legacy=0x7f50c40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c8f9b700 1 -- 172.21.15.86:0/748357693 >> v1:172.21.15.86:6789/0 conn(0x7f50c415d230 legacy=0x7f50c40b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c8f9b700 1 -- 172.21.15.86:0/748357693 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40b1790 con 0x7f50c4159420 2023-10-09T11:40:50.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c8f9b700 1 --2- 172.21.15.86:0/748357693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e90 tx=0x7f50b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de1e3ab7acd54d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c37fe700 1 -- 172.21.15.86:0/748357693 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800e070 con 0x7f50c4159420 2023-10-09T11:40:50.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c37fe700 1 -- 172.21.15.86:0/748357693 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b800bb80 con 0x7f50c4159420 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.975+0000 7f50c37fe700 1 -- 172.21.15.86:0/748357693 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8012430 con 0x7f50c4159420 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.976+0000 7f50c9f9d700 1 -- 172.21.15.86:0/748357693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 msgr2=0x7f50c40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.976+0000 7f50c9f9d700 1 --2- 172.21.15.86:0/748357693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e90 tx=0x7f50b8009780 comp rx=0 tx=0).stop 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.976+0000 7f50c9f9d700 1 -- 172.21.15.86:0/748357693 shutdown_connections 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.976+0000 7f50c9f9d700 1 --2- 172.21.15.86:0/748357693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.976+0000 7f50c9f9d700 1 -- 172.21.15.86:0/748357693 >> 172.21.15.86:0/748357693 conn(0x7f50c40d0660 msgr2=0x7f50c40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.976+0000 7f50c9f9d700 1 -- 172.21.15.86:0/748357693 shutdown_connections 2023-10-09T11:40:50.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.976+0000 7f50c9f9d700 1 -- 172.21.15.86:0/748357693 wait complete. 2023-10-09T11:40:50.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.979+0000 7f50c9f9d700 1 Processor -- start 2023-10-09T11:40:50.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.979+0000 7f50c9f9d700 1 -- start start 2023-10-09T11:40:50.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.980+0000 7f50c9f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.980+0000 7f50c9f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.980+0000 7f50c9f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.980+0000 7f50c9f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40c5ad0 con 0x7f50c415d230 2023-10-09T11:40:50.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.980+0000 7f50c9f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c415aa70 con 0x7f50c41597f0 2023-10-09T11:40:50.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.980+0000 7f50c9f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c415ad50 con 0x7f50c4159420 2023-10-09T11:40:50.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c8f9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c8f9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:33182/0 (socket says 172.21.15.86:33182) 2023-10-09T11:40:50.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c8f9b700 1 -- 172.21.15.86:0/2582917803 learned_addr learned my addr 172.21.15.86:0/2582917803 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:40:50.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56810/0 (socket says 172.21.15.86:56810) 2023-10-09T11:40:50.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c3fff700 1 -- 172.21.15.86:0/2582917803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 msgr2=0x7f50c415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c3fff700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c3fff700 1 -- 172.21.15.86:0/2582917803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 msgr2=0x7f50c415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c3fff700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c3fff700 1 -- 172.21.15.86:0/2582917803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009a20 con 0x7f50c41597f0 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c979c700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.981+0000 7f50c3fff700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40c5590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c560 tx=0x7f50b0007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.982+0000 7f50c0ff9700 1 -- 172.21.15.86:0/2582917803 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0011590 con 0x7f50c41597f0 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.982+0000 7f50c0ff9700 1 -- 172.21.15.86:0/2582917803 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00116f0 con 0x7f50c41597f0 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.982+0000 7f50c0ff9700 1 -- 172.21.15.86:0/2582917803 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0011ab0 con 0x7f50c41597f0 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.982+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c415b030 con 0x7f50c41597f0 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.982+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c415b5f0 con 0x7f50c41597f0 2023-10-09T11:40:50.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.982+0000 7f50c0ff9700 1 -- 172.21.15.86:0/2582917803 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f50b001c460 con 0x7f50c41597f0 2023-10-09T11:40:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.982+0000 7f50c0ff9700 1 -- 172.21.15.86:0/2582917803 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f50b0012b00 con 0x7f50c41597f0 2023-10-09T11:40:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.983+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c404c3c0 con 0x7f50c41597f0 2023-10-09T11:40:50.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:50.985+0000 7f50c0ff9700 1 -- 172.21.15.86:0/2582917803 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f50b0012de0 con 0x7f50c41597f0 2023-10-09T11:40:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.055+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c40b1a70 con 0x7f50c41597f0 2023-10-09T11:40:51.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.056+0000 7f50c0ff9700 1 -- 172.21.15.86:0/2582917803 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f50b001c710 con 0x7f50c41597f0 2023-10-09T11:40:51.058 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:40:51.058 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":10,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:40:50.669698+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:51.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 msgr2=0x7f50c40c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40c5590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c560 tx=0x7f50b0007d50 comp rx=0 tx=0).stop 2023-10-09T11:40:51.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 shutdown_connections 2023-10-09T11:40:51.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 --2- 172.21.15.86:0/2582917803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40c5590 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 >> 172.21.15.86:0/2582917803 conn(0x7f50c40d0660 msgr2=0x7f50c40b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:51.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 shutdown_connections 2023-10-09T11:40:51.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:40:51.057+0000 7f50c9f9d700 1 -- 172.21.15.86:0/2582917803 wait complete. 2023-10-09T11:40:51.077 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-09T11:40:51.077 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-09T11:40:51.296 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:51.295+0000 7f87ad64a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:40:51.398 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-09T11:40:51.397+0000 7fdae1581540 -1 Falling back to public interface 2023-10-09T11:40:51.399 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-10-09T11:40:51.398+0000 7fe7f45c6540 -1 Falling back to public interface 2023-10-09T11:40:51.403 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-10-09T11:40:51.402+0000 7f60f0fe8540 -1 Falling back to public interface 2023-10-09T11:40:51.427 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-09T11:40:51.426+0000 7fc47ecf7540 -1 Falling back to public interface 2023-10-09T11:40:51.428 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-10-09T11:40:51.426+0000 7f9341169540 -1 Falling back to public interface 2023-10-09T11:40:51.428 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-09T11:40:51.428+0000 7ff13da00540 -1 Falling back to public interface 2023-10-09T11:40:51.428 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-09T11:40:51.428+0000 7f857783d540 -1 Falling back to public interface 2023-10-09T11:40:51.439 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-09T11:40:51.437+0000 7f7cfdee8540 -1 Falling back to public interface 2023-10-09T11:40:51.476 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:51.475+0000 7f87ad64a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:40:51.587 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:51.585+0000 7f87ad64a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:40:51.629 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:51.628+0000 7f3c45760180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:40:51.811 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:51.810+0000 7f3c45760180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:40:51.884 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:51.890 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:51.884+0000 7f87ad64a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:40:51.931 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:51.930+0000 7f3c45760180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:40:51.989 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:51.987+0000 7f87ad64a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:40:52.048 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.046+0000 7f3ba339d700 1 Processor -- start 2023-10-09T11:40:52.048 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.046+0000 7f3ba339d700 1 -- start start 2023-10-09T11:40:52.050 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.047+0000 7f3ba339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.050 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.047+0000 7f3ba339d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b9c15daf0 0x7f3b9c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.050 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.047+0000 7f3ba339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c159ef0 con 0x7f3b9c15a670 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.047+0000 7f3ba339d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0b6090 con 0x7f3b9c15daf0 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.047+0000 7f3ba339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c15df40 con 0x7f3b9c15ce50 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b9c15daf0 0x7f3b9c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b9c15daf0 0x7f3b9c15a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56820/0 (socket says 172.21.15.86:56820) 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 -- 172.21.15.86:0/1489496117 learned_addr learned my addr 172.21.15.86:0/1489496117 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba239b700 1 --2- 172.21.15.86:0/1489496117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 -- 172.21.15.86:0/1489496117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 msgr2=0x7f3b9c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 --2- 172.21.15.86:0/1489496117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 -- 172.21.15.86:0/1489496117 >> v1:172.21.15.135:6789/0 conn(0x7f3b9c15a670 legacy=0x7f3b9c15aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.051 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 -- 172.21.15.86:0/1489496117 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0b5480 con 0x7f3b9c15daf0 2023-10-09T11:40:52.052 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.048+0000 7f3ba1b9a700 1 --2- 172.21.15.86:0/1489496117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15daf0 0x7f3b9c15a130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0099b0 tx=0x7f3b8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b0d339cd3736cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.052 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba1399700 1 -- 172.21.15.86:0/1489496117 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c009ea0 con 0x7f3b9c15daf0 2023-10-09T11:40:52.052 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba1399700 1 -- 172.21.15.86:0/1489496117 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c00b8f0 con 0x7f3b9c15daf0 2023-10-09T11:40:52.052 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba1399700 1 -- 172.21.15.86:0/1489496117 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00bc90 con 0x7f3b9c15daf0 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba339d700 1 -- 172.21.15.86:0/1489496117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15daf0 msgr2=0x7f3b9c15a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba339d700 1 --2- 172.21.15.86:0/1489496117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15daf0 0x7f3b9c15a130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0099b0 tx=0x7f3b8c009250 comp rx=0 tx=0).stop 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba339d700 1 -- 172.21.15.86:0/1489496117 shutdown_connections 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba339d700 1 --2- 172.21.15.86:0/1489496117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba339d700 1 --2- 172.21.15.86:0/1489496117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15daf0 0x7f3b9c15a130 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba339d700 1 -- 172.21.15.86:0/1489496117 >> 172.21.15.86:0/1489496117 conn(0x7f3b9c087ff0 msgr2=0x7f3b9c06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.049+0000 7f3ba339d700 1 -- 172.21.15.86:0/1489496117 shutdown_connections 2023-10-09T11:40:52.053 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.050+0000 7f3ba339d700 1 -- 172.21.15.86:0/1489496117 wait complete. 2023-10-09T11:40:52.054 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.051+0000 7f3ba339d700 1 Processor -- start 2023-10-09T11:40:52.054 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.051+0000 7f3ba339d700 1 -- start start 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba339d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15a670 0x7f3b9c153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b9c15daf0 0x7f3b9c0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba339d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0d00f0 con 0x7f3b9c15a670 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c150f20 con 0x7f3b9c15daf0 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1505f0 con 0x7f3b9c15ce50 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba239b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15a670 0x7f3b9c153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.056 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba239b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15a670 0x7f3b9c153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56826/0 (socket says 172.21.15.86:56826) 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba239b700 1 -- 172.21.15.86:0/176904044 learned_addr learned my addr 172.21.15.86:0/176904044 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba1b9a700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.052+0000 7f3ba2b9c700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b9c15daf0 0x7f3b9c0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba239b700 1 -- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 msgr2=0x7f3b9c144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba239b700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba239b700 1 -- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b9c15daf0 msgr2=0x7f3b9c0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba239b700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b9c15daf0 0x7f3b9c0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba239b700 1 -- 172.21.15.86:0/176904044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c0094f0 con 0x7f3b9c15a670 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba239b700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15a670 0x7f3b9c153220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800ecb0 tx=0x7f3b98009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3b927fc700 1 -- 172.21.15.86:0/176904044 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800c9d0 con 0x7f3b9c15a670 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3b927fc700 1 -- 172.21.15.86:0/176904044 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800cb30 con 0x7f3b9c15a670 2023-10-09T11:40:52.057 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c1508d0 con 0x7f3b9c15a670 2023-10-09T11:40:52.058 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3b927fc700 1 -- 172.21.15.86:0/176904044 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800ceb0 con 0x7f3b9c15a670 2023-10-09T11:40:52.058 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c153760 con 0x7f3b9c15a670 2023-10-09T11:40:52.058 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3b927fc700 1 -- 172.21.15.86:0/176904044 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3b98013900 con 0x7f3b9c15a670 2023-10-09T11:40:52.058 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.053+0000 7f3b927fc700 1 -- 172.21.15.86:0/176904044 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3b9801cd10 con 0x7f3b9c15a670 2023-10-09T11:40:52.058 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.054+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c15a1c0 con 0x7f3b9c15a670 2023-10-09T11:40:52.058 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.057+0000 7f3b927fc700 1 -- 172.21.15.86:0/176904044 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3b9803b6d0 con 0x7f3b9c15a670 2023-10-09T11:40:52.131 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.129+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b9c064b50 con 0x7f3b9c15a670 2023-10-09T11:40:52.131 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.130+0000 7f3b927fc700 1 -- 172.21.15.86:0/176904044 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f3b9802a030 con 0x7f3b9c15a670 2023-10-09T11:40:52.132 INFO:teuthology.misc.health.smithi086.stdout: 2023-10-09T11:40:52.132 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":10,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:40:50.669698+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15a670 msgr2=0x7f3b9c153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15a670 0x7f3b9c153220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800ecb0 tx=0x7f3b98009120 comp rx=0 tx=0).stop 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 shutdown_connections 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b9c15a670 0x7f3b9c153220 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b9c15daf0 0x7f3b9c0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 --2- 172.21.15.86:0/176904044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b9c15ce50 0x7f3b9c144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 >> 172.21.15.86:0/176904044 conn(0x7f3b9c087ff0 msgr2=0x7f3b9c1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.133 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 shutdown_connections 2023-10-09T11:40:52.134 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:52.131+0000 7f3ba339d700 1 -- 172.21.15.86:0/176904044 wait complete. 2023-10-09T11:40:52.147 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-09T11:40:52.261 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:52.260+0000 7f3c45760180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:40:52.362 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:52.361+0000 7f3c45760180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:40:52.993 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:52.991+0000 7f87ad64a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:40:53.086 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.085+0000 7f87ad64a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:40:53.180 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.179+0000 7f87ad64a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:40:53.349 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.345+0000 7f87ad64a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:40:53.402 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:53.401+0000 7f3c45760180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:40:53.453 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.451+0000 7f87ad64a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:40:53.500 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:53.499+0000 7f3c45760180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:40:53.598 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:53.598+0000 7f3c45760180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:40:53.644 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.642+0000 7f87ad64a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:40:53.738 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.737+0000 7f87ad64a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:40:53.769 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:53.767+0000 7f3c45760180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:40:53.831 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.829+0000 7f87ad64a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:40:53.884 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:53.883+0000 7f3c45760180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:40:53.938 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:53.936+0000 7f87ad64a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:40:54.095 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:54.093+0000 7f3c45760180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:40:54.196 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:54.195+0000 7f3c45760180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:40:54.343 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:54.343+0000 7f3c45760180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:40:54.499 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:40:54.497+0000 7f3c45760180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:40:54.912 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-10-09T11:40:54.910+0000 7fe7f45c6540 -1 osd.0 0 log_to_monitors true 2023-10-09T11:40:54.957 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:54.955+0000 7f87657fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-09T11:40:54.958 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:40:54.956+0000 7f87657fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-09T11:40:54.976 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-10-09T11:40:54.974+0000 7f60f0fe8540 -1 osd.2 0 log_to_monitors true 2023-10-09T11:40:55.008 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-10-09T11:40:55.006+0000 7f9341169540 -1 osd.3 0 log_to_monitors true 2023-10-09T11:40:55.017 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-09T11:40:55.016+0000 7fc47ecf7540 -1 osd.1 0 log_to_monitors true 2023-10-09T11:40:55.021 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-09T11:40:55.021+0000 7f857783d540 -1 osd.7 0 log_to_monitors true 2023-10-09T11:40:55.187 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-09T11:40:55.186+0000 7fdae1581540 -1 osd.4 0 log_to_monitors true 2023-10-09T11:40:55.259 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-09T11:40:55.258+0000 7ff13da00540 -1 osd.5 0 log_to_monitors true 2023-10-09T11:40:55.279 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-09T11:40:55.278+0000 7f7cfdee8540 -1 osd.6 0 log_to_monitors true 2023-10-09T11:40:57.948 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-10-09T11:40:57.946+0000 7f9334bf6700 -1 osd.3 0 waiting for initial osdmap 2023-10-09T11:40:57.955 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-10-09T11:40:57.953+0000 7f932dbe8700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:40:58.055 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-10-09T11:40:58.054+0000 7fe7e7ff6700 -1 osd.0 0 waiting for initial osdmap 2023-10-09T11:40:58.056 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-10-09T11:40:58.055+0000 7f60e49f6700 -1 osd.2 0 waiting for initial osdmap 2023-10-09T11:40:58.063 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-10-09T11:40:58.062+0000 7fe7e0fe8700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:40:58.066 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-10-09T11:40:58.065+0000 7f60dd9e8700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:40:58.419 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-09T11:40:58.417+0000 7fc4727f6700 -1 osd.1 0 waiting for initial osdmap 2023-10-09T11:40:58.426 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-09T11:40:58.425+0000 7fc46b7e8700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:40:58.952 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:59.117 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.115+0000 7ff3a5dff700 1 Processor -- start 2023-10-09T11:40:59.117 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.115+0000 7ff3a5dff700 1 -- start start 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.116+0000 7ff3a5dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 0x7ff3a0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff3a5dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff3a00704a0 0x7ff3a0067f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff3a5dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a01542b0 con 0x7ff3a00caf30 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff3a5dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a00cc4b0 con 0x7ff3a00704a0 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff3a5dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015a700 con 0x7ff3a00cb300 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff3a00caf30 0x7ff3a015dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38964/0 (socket says 172.21.15.86:38964) 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39f7fe700 1 -- 172.21.15.86:0/1225540386 learned_addr learned my addr 172.21.15.86:0/1225540386 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:40:59.121 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39effd700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 0x7ff3a0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39ffff700 1 --2- 172.21.15.86:0/1225540386 >> v2:172.21.15.135:3300/0 conn(0x7ff3a00704a0 0x7ff3a0067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305791775 0 0) 0x7ff390001110 con 0x7ff3a00caf30 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff388003570 con 0x7ff3a00caf30 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3702707696 0 0) 0x7ff388003570 con 0x7ff3a00caf30 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 msgr2=0x7ff3a0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 0x7ff3a0159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 >> v2:172.21.15.135:3300/0 conn(0x7ff3a00704a0 msgr2=0x7ff3a0067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 --2- 172.21.15.86:0/1225540386 >> v2:172.21.15.135:3300/0 conn(0x7ff3a00704a0 0x7ff3a0067f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a015a9e0 con 0x7ff3a00caf30 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.117+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7ff390001600 con 0x7ff3a00caf30 2023-10-09T11:40:59.122 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 >> v1:172.21.15.86:6789/0 conn(0x7ff3a00caf30 legacy=0x7ff3a015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39e7fc700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 0x7ff388003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39e7fc700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388003fe0 0x7ff388004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39e7fc700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff388004d50 0x7ff3880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00cc4b0 con 0x7ff388004d50 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015a700 con 0x7ff388003fe0 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38800ba90 con 0x7ff3a00cb300 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39ffff700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff388004d50 0x7ff3880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39f7fe700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 0x7ff388003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39effd700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388003fe0 0x7ff388004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39ffff700 1 -- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 msgr2=0x7ff388003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:59.123 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39ffff700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 0x7ff388003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39ffff700 1 -- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388003fe0 msgr2=0x7ff388004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39ffff700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388003fe0 0x7ff388004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39ffff700 1 -- 172.21.15.86:0/1225540386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388003570 con 0x7ff388004d50 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39f7fe700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00cb300 0x7ff388003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39effd700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388003fe0 0x7ff388004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.118+0000 7ff39ffff700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff388004d50 0x7ff3880051c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff39800e210 tx=0x7ff39800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ef54745969d69b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800ea60 con 0x7ff388004d50 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800f040 con 0x7ff388004d50 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff39e7fc700 1 -- 172.21.15.86:0/1225540386 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800ee10 con 0x7ff388004d50 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1225540386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff388004d50 msgr2=0x7ff3880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.124 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff3a5dff700 1 --2- 172.21.15.86:0/1225540386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff388004d50 0x7ff3880051c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff39800e210 tx=0x7ff39800b040 comp rx=0 tx=0).stop 2023-10-09T11:40:59.125 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff39ffff700 1 -- 172.21.15.86:0/1225540386 reap_dead start 2023-10-09T11:40:59.125 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1225540386 shutdown_connections 2023-10-09T11:40:59.125 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1225540386 >> 172.21.15.86:0/1225540386 conn(0x7ff3a00ccc20 msgr2=0x7ff3a00cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:59.125 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1225540386 shutdown_connections 2023-10-09T11:40:59.125 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.119+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1225540386 wait complete. 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.121+0000 7ff3a5dff700 1 Processor -- start 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.121+0000 7ff3a5dff700 1 -- start start 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff3a5dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388004d50 0x7ff3a0169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff3a5dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a00c6170 0x7ff3a00c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff3a5dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00c4ab0 0x7ff3a01579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff3a5dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00c40e0 con 0x7ff3a00c6170 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff3a5dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a016a440 con 0x7ff388004d50 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff3a5dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a016a720 con 0x7ff3a00c4ab0 2023-10-09T11:40:59.127 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a00c6170 0x7ff3a00c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a00c6170 0x7ff3a00c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46658/0 (socket says 172.21.15.86:46658) 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 -- 172.21.15.86:0/1488041803 learned_addr learned my addr 172.21.15.86:0/1488041803 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39f7fe700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388004d50 0x7ff3a0169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 -- 172.21.15.86:0/1488041803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00c4ab0 msgr2=0x7ff3a01579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00c4ab0 0x7ff3a01579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 -- 172.21.15.86:0/1488041803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388004d50 msgr2=0x7ff3a0169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388004d50 0x7ff3a0169af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.122+0000 7ff39effd700 1 -- 172.21.15.86:0/1488041803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00c3d70 con 0x7ff3a00c6170 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.123+0000 7ff39effd700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a00c6170 0x7ff3a00c4570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff394011960 tx=0x7ff394008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.123+0000 7ff3877fe700 1 -- 172.21.15.86:0/1488041803 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400f6d0 con 0x7ff3a00c6170 2023-10-09T11:40:59.128 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.123+0000 7ff3877fe700 1 -- 172.21.15.86:0/1488041803 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39400f830 con 0x7ff3a00c6170 2023-10-09T11:40:59.129 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.123+0000 7ff3877fe700 1 -- 172.21.15.86:0/1488041803 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400fbf0 con 0x7ff3a00c6170 2023-10-09T11:40:59.129 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.123+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a016aa00 con 0x7ff3a00c6170 2023-10-09T11:40:59.129 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.123+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a016a030 con 0x7ff3a00c6170 2023-10-09T11:40:59.129 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.124+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a0158c70 con 0x7ff3a00c6170 2023-10-09T11:40:59.129 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.125+0000 7ff3877fe700 1 -- 172.21.15.86:0/1488041803 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff394015460 con 0x7ff3a00c6170 2023-10-09T11:40:59.130 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.126+0000 7ff3877fe700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff38c066ea0 0x7ff38c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.130 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.126+0000 7ff3877fe700 1 -- 172.21.15.86:0/1488041803 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2787+0+0 (secure 0 0 0) 0x7ff394083d70 con 0x7ff3a00c6170 2023-10-09T11:40:59.130 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.126+0000 7ff39f7fe700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff38c066ea0 0x7ff38c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.130 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.126+0000 7ff39f7fe700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff38c066ea0 0x7ff38c069350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff390007e10 tx=0x7ff390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.132 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.131+0000 7ff3877fe700 1 -- 172.21.15.86:0/1488041803 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff394051c30 con 0x7ff3a00c6170 2023-10-09T11:40:59.250 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-09T11:40:59.250+0000 7f7cf31f9700 -1 osd.6 0 waiting for initial osdmap 2023-10-09T11:40:59.269 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-09T11:40:59.268+0000 7f7cea9e8700 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:40:59.286 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-09T11:40:59.285+0000 7ff1313f6700 -1 osd.5 0 waiting for initial osdmap 2023-10-09T11:40:59.295 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-09T11:40:59.294+0000 7ff12a3e8700 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:40:59.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.332+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3a00c3f00 con 0x7ff3a00c6170 2023-10-09T11:40:59.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.333+0000 7ff3877fe700 1 -- 172.21.15.86:0/1488041803 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8738 (secure 0 0 0) 0x7ff394022020 con 0x7ff3a00c6170 2023-10-09T11:40:59.334 INFO:teuthology.misc.health.smithi086.stdout: 2023-10-09T11:40:59.334 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":15,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:40:59.177381+0000","last_up_change":"2023-10-09T11:40:59.177381+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff38c066ea0 msgr2=0x7ff38c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff38c066ea0 0x7ff38c069350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff390007e10 tx=0x7ff390009040 comp rx=0 tx=0).stop 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a00c6170 msgr2=0x7ff3a00c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a00c6170 0x7ff3a00c4570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff394011960 tx=0x7ff394008040 comp rx=0 tx=0).stop 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 shutdown_connections 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff38c066ea0 0x7ff38c069350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3a00c4ab0 0x7ff3a01579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff388004d50 0x7ff3a0169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.337 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 --2- 172.21.15.86:0/1488041803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a00c6170 0x7ff3a00c4570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.338 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 >> 172.21.15.86:0/1488041803 conn(0x7ff3a00ccc20 msgr2=0x7ff3a015c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:59.338 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 shutdown_connections 2023-10-09T11:40:59.338 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:40:59.335+0000 7ff3a5dff700 1 -- 172.21.15.86:0/1488041803 wait complete. 2023-10-09T11:40:59.338 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-09T11:40:59.336+0000 7f856b3f6700 -1 osd.7 0 waiting for initial osdmap 2023-10-09T11:40:59.345 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-09T11:40:59.344+0000 7f85643e8700 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:40:59.351 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-10-09T11:40:59.352 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-09T11:40:59.351+0000 7fdad4ff6700 -1 osd.4 0 waiting for initial osdmap 2023-10-09T11:40:59.359 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-09T11:40:59.358+0000 7fdacdfe8700 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:41:06.157 DEBUG:teuthology.orchestra.run.smithi086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:06.323 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.322+0000 7fa2ab3ff700 1 Processor -- start 2023-10-09T11:41:06.323 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.322+0000 7fa2ab3ff700 1 -- start start 2023-10-09T11:41:06.324 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa2ab3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2a41566c0 0x7fa2a406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.324 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa2ab3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a40c8150 con 0x7fa2a41562f0 2023-10-09T11:41:06.324 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa2ab3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a4156e70 con 0x7fa2a40c85e0 2023-10-09T11:41:06.325 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa2ab3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a40c7540 con 0x7fa2a41566c0 2023-10-09T11:41:06.325 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa2a919b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa2a41562f0 0x7fa2a40c69d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58394/0 (socket says 172.21.15.86:58394) 2023-10-09T11:41:06.325 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa2a919b700 1 -- 172.21.15.86:0/2428208507 learned_addr learned my addr 172.21.15.86:0/2428208507 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929071067 0 0) 0x7fa2a40c8150 con 0x7fa2a41562f0 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa290003570 con 0x7fa2a41562f0 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.324+0000 7fa2a899a700 1 --2- 172.21.15.86:0/2428208507 >> v2:172.21.15.135:3300/0 conn(0x7fa2a41566c0 0x7fa2a406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658352065 0 0) 0x7fa290003570 con 0x7fa2a41562f0 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 >> v2:172.21.15.135:3300/0 conn(0x7fa2a41566c0 msgr2=0x7fa2a406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 --2- 172.21.15.86:0/2428208507 >> v2:172.21.15.135:3300/0 conn(0x7fa2a41566c0 0x7fa2a406aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 >> v1:172.21.15.135:6789/0 conn(0x7fa2a40c85e0 legacy=0x7fa2a40ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a40c7820 con 0x7fa2a41562f0 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa2a00015f0 con 0x7fa2a41562f0 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 >> v1:172.21.15.86:6789/0 conn(0x7fa2a41562f0 legacy=0x7fa2a40c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.328 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa290003a60 0x7fa290003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290004810 0x7fa290004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2900051c0 0x7fa29000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40c7540 con 0x7fa290003a60 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29000e2e0 con 0x7fa2900051c0 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29000e4a0 con 0x7fa290004810 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a919b700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa290003a60 0x7fa290003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a899a700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290004810 0x7fa290004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a999c700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2900051c0 0x7fa29000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a919b700 1 -- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290004810 msgr2=0x7fa290004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a919b700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290004810 0x7fa290004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a919b700 1 -- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2900051c0 msgr2=0x7fa29000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:06.329 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a919b700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2900051c0 0x7fa29000dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a919b700 1 -- 172.21.15.86:0/2428208507 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290003570 con 0x7fa290003a60 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a999c700 1 -- 172.21.15.86:0/2428208507 reap_dead start 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.325+0000 7fa2a919b700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa290003a60 0x7fa290003e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c3c0 tx=0x7fa2a0007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573298d118d47f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000cc90 con 0x7fa290003a60 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000ce10 con 0x7fa290003a60 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa29bfff700 1 -- 172.21.15.86:0/2428208507 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0007320 con 0x7fa290003a60 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/2428208507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa290003a60 msgr2=0x7fa290003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa290003a60 0x7fa290003e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c3c0 tx=0x7fa2a0007920 comp rx=0 tx=0).stop 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/2428208507 shutdown_connections 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/2428208507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa290003a60 0x7fa290003e70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/2428208507 >> 172.21.15.86:0/2428208507 conn(0x7fa2a406d350 msgr2=0x7fa2a40cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:06.330 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/2428208507 shutdown_connections 2023-10-09T11:41:06.331 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.326+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/2428208507 wait complete. 2023-10-09T11:41:06.332 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.328+0000 7fa2ab3ff700 1 Processor -- start 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.328+0000 7fa2ab3ff700 1 -- start start 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2ab3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290003a60 0x7fa2a41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2ab3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a40aae20 0x7fa2a40a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2ab3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a40cab20 0x7fa2a40caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2ab3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4158a10 con 0x7fa2a40cab20 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2ab3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40cb4d0 con 0x7fa2a40aae20 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2ab3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4157e00 con 0x7fa290003a60 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a40cab20 0x7fa2a40caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a40cab20 0x7fa2a40caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55228/0 (socket says 172.21.15.86:55228) 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 -- 172.21.15.86:0/1572822123 learned_addr learned my addr 172.21.15.86:0/1572822123 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 -- 172.21.15.86:0/1572822123 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290003a60 msgr2=0x7fa2a41530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.333 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290003a60 0x7fa2a41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 -- 172.21.15.86:0/1572822123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a40aae20 msgr2=0x7fa2a40a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a40aae20 0x7fa2a40a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 -- 172.21.15.86:0/1572822123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a41580e0 con 0x7fa2a40cab20 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.329+0000 7fa2a999c700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a40cab20 0x7fa2a40caf90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40714a0 tx=0x7fa29c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.330+0000 7fa2997fa700 1 -- 172.21.15.86:0/1572822123 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c006db0 con 0x7fa2a40cab20 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.330+0000 7fa2997fa700 1 -- 172.21.15.86:0/1572822123 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c003070 con 0x7fa2a40cab20 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.330+0000 7fa2997fa700 1 -- 172.21.15.86:0/1572822123 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c003430 con 0x7fa2a40cab20 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.330+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a41583c0 con 0x7fa2a40cab20 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.330+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a4153600 con 0x7fa2a40cab20 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.331+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a40682b0 con 0x7fa2a40cab20 2023-10-09T11:41:06.334 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.332+0000 7fa2997fa700 1 -- 172.21.15.86:0/1572822123 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa29c001790 con 0x7fa2a40cab20 2023-10-09T11:41:06.335 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.332+0000 7fa2997fa700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.335 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.332+0000 7fa2997fa700 1 -- 172.21.15.86:0/1572822123 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa29c083bb0 con 0x7fa2a40cab20 2023-10-09T11:41:06.335 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.333+0000 7fa2a919b700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.335 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.333+0000 7fa2a919b700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa288066f30 0x7fa2880693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0008fd0 tx=0x7fa2a0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:06.338 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.337+0000 7fa2997fa700 1 -- 172.21.15.86:0/1572822123 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa29c0510d0 con 0x7fa2a40cab20 2023-10-09T11:41:06.532 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.531+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2a4158bc0 con 0x7fa2a40cab20 2023-10-09T11:41:06.533 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.532+0000 7fa2997fa700 1 -- 172.21.15.86:0/1572822123 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fa2a4158bc0 con 0x7fa2a40cab20 2023-10-09T11:41:06.533 INFO:teuthology.misc.health.smithi086.stdout: 2023-10-09T11:41:06.533 INFO:teuthology.misc.health.smithi086.stdout:{"epoch":18,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:02.264387+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:06.535 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa288066f30 msgr2=0x7fa2880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.535 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa288066f30 0x7fa2880693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0008fd0 tx=0x7fa2a0015000 comp rx=0 tx=0).stop 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a40cab20 msgr2=0x7fa2a40caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a40cab20 0x7fa2a40caf90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40714a0 tx=0x7fa29c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 shutdown_connections 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2a40cab20 0x7fa2a40caf90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa290003a60 0x7fa2a41530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 --2- 172.21.15.86:0/1572822123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a40aae20 0x7fa2a40a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 >> 172.21.15.86:0/1572822123 conn(0x7fa2a406d350 msgr2=0x7fa2a406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 shutdown_connections 2023-10-09T11:41:06.536 INFO:teuthology.misc.health.smithi086.stderr:2023-10-09T11:41:06.534+0000 7fa2ab3ff700 1 -- 172.21.15.86:0/1572822123 wait complete. 2023-10-09T11:41:06.550 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-09T11:41:06.550 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-09T11:41:06.550 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:41:06.550 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:41:06.555 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:41:06.555 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:41:06.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:41:06.560 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:41:06.560 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:41:06.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:41:06.565 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:41:06.565 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:41:06.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:41:06.570 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:41:06.570 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-09T11:41:06.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:06.688 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:41:06.689 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:41:06.709 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T11:41:06.709 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:41:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.760+0000 7fbdd9fff700 1 Processor -- start 2023-10-09T11:41:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.760+0000 7fbdd9fff700 1 -- start start 2023-10-09T11:41:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd9fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbdd4159890 0x7fbdd415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd9fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd4159c60 0x7fbdd415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd9fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbdd415db10 0x7fbdd4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd9fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd415a160 con 0x7fbdd415db10 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd9fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd40d13a0 con 0x7fbdd4159890 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd9fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd415e140 con 0x7fbdd4159c60 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbdd415db10 0x7fbdd4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbdd415db10 0x7fbdd4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55268/0 (socket says 172.21.15.86:55268) 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd3fff700 1 -- 172.21.15.86:0/2251770317 learned_addr learned my addr 172.21.15.86:0/2251770317 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd37fe700 1 --2- 172.21.15.86:0/2251770317 >> v2:172.21.15.135:3300/0 conn(0x7fbdd4159890 0x7fbdd415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd2ffd700 1 --2- 172.21.15.86:0/2251770317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd4159c60 0x7fbdd415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd3fff700 1 -- 172.21.15.86:0/2251770317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd4159c60 msgr2=0x7fbdd415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:06.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.762+0000 7fbdd3fff700 1 --2- 172.21.15.86:0/2251770317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd4159c60 0x7fbdd415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd3fff700 1 -- 172.21.15.86:0/2251770317 >> v2:172.21.15.135:3300/0 conn(0x7fbdd4159890 msgr2=0x7fbdd415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd3fff700 1 --2- 172.21.15.86:0/2251770317 >> v2:172.21.15.135:3300/0 conn(0x7fbdd4159890 0x7fbdd415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd3fff700 1 -- 172.21.15.86:0/2251770317 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd415a3d0 con 0x7fbdd415db10 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd37fe700 1 --2- 172.21.15.86:0/2251770317 >> v2:172.21.15.135:3300/0 conn(0x7fbdd4159890 0x7fbdd415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd3fff700 1 --2- 172.21.15.86:0/2251770317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd415db10 0x7fbdd4069560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40d1090 tx=0x7fbdcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b87eb07428f8708 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd27fc700 1 -- 172.21.15.86:0/2251770317 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc00e070 con 0x7fbdd415db10 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd27fc700 1 -- 172.21.15.86:0/2251770317 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc00ba50 con 0x7fbdd415db10 2023-10-09T11:41:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.763+0000 7fbdd27fc700 1 -- 172.21.15.86:0/2251770317 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0092e0 con 0x7fbdd415db10 2023-10-09T11:41:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 -- 172.21.15.86:0/2251770317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd415db10 msgr2=0x7fbdd4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/2251770317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd415db10 0x7fbdd4069560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40d1090 tx=0x7fbdcc009840 comp rx=0 tx=0).stop 2023-10-09T11:41:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 -- 172.21.15.86:0/2251770317 shutdown_connections 2023-10-09T11:41:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/2251770317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd415db10 0x7fbdd4069560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/2251770317 >> v2:172.21.15.135:3300/0 conn(0x7fbdd4159890 0x7fbdd415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/2251770317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd4159c60 0x7fbdd415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 -- 172.21.15.86:0/2251770317 >> 172.21.15.86:0/2251770317 conn(0x7fbdd4068e20 msgr2=0x7fbdd40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 -- 172.21.15.86:0/2251770317 shutdown_connections 2023-10-09T11:41:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.764+0000 7fbdd9fff700 1 -- 172.21.15.86:0/2251770317 wait complete. 2023-10-09T11:41:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.765+0000 7fbdd9fff700 1 Processor -- start 2023-10-09T11:41:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.765+0000 7fbdd9fff700 1 -- start start 2023-10-09T11:41:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd9fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd4159890 0x7fbdd40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd9fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4159c60 0x7fbdd40b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd9fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd415db10 0x7fbdd40b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd9fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40b1c00 con 0x7fbdd4159890 2023-10-09T11:41:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd9fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40b0ff0 con 0x7fbdd4159c60 2023-10-09T11:41:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd9fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40b12d0 con 0x7fbdd415db10 2023-10-09T11:41:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd4159890 0x7fbdd40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd4159890 0x7fbdd40b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55280/0 (socket says 172.21.15.86:55280) 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd37fe700 1 -- 172.21.15.86:0/1329681376 learned_addr learned my addr 172.21.15.86:0/1329681376 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd3fff700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd415db10 0x7fbdd40b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.766+0000 7fbdd2ffd700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4159c60 0x7fbdd40b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd37fe700 1 -- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd415db10 msgr2=0x7fbdd40b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd37fe700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd415db10 0x7fbdd40b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd37fe700 1 -- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4159c60 msgr2=0x7fbdd40b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd37fe700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4159c60 0x7fbdd40b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd37fe700 1 -- 172.21.15.86:0/1329681376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc009ae0 con 0x7fbdd4159890 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd37fe700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd4159890 0x7fbdd40b3590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400e8d0 tx=0x7fbdc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:06.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdbb7fe700 1 -- 172.21.15.86:0/1329681376 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4013410 con 0x7fbdd4159890 2023-10-09T11:41:06.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdbb7fe700 1 -- 172.21.15.86:0/1329681376 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc4013570 con 0x7fbdd4159890 2023-10-09T11:41:06.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdbb7fe700 1 -- 172.21.15.86:0/1329681376 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4013910 con 0x7fbdd4159890 2023-10-09T11:41:06.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd40b15b0 con 0x7fbdd4159890 2023-10-09T11:41:06.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.767+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd41411b0 con 0x7fbdd4159890 2023-10-09T11:41:06.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.768+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd40cbef0 con 0x7fbdd4159890 2023-10-09T11:41:06.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.769+0000 7fbdbb7fe700 1 -- 172.21.15.86:0/1329681376 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdc4013d40 con 0x7fbdd4159890 2023-10-09T11:41:06.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.770+0000 7fbdbb7fe700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbdc0066f30 0x7fbdc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:06.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.770+0000 7fbdbb7fe700 1 -- 172.21.15.86:0/1329681376 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbdc4083ee0 con 0x7fbdd4159890 2023-10-09T11:41:06.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.770+0000 7fbdd2ffd700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbdc0066f30 0x7fbdc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:06.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.771+0000 7fbdd2ffd700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbdc0066f30 0x7fbdc00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b5060 tx=0x7fbdc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:06.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.775+0000 7fbdbb7fe700 1 -- 172.21.15.86:0/1329681376 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdc40514a0 con 0x7fbdd4159890 2023-10-09T11:41:06.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.968+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdd404c3c0 con 0x7fbdd4159890 2023-10-09T11:41:06.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.969+0000 7fbdbb7fe700 1 -- 172.21.15.86:0/1329681376 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fbdc4054ac0 con 0x7fbdd4159890 2023-10-09T11:41:06.969 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:06.970 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:02.264387+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:06.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbdc0066f30 msgr2=0x7fbdc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbdc0066f30 0x7fbdc00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b5060 tx=0x7fbdc8008040 comp rx=0 tx=0).stop 2023-10-09T11:41:06.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd4159890 msgr2=0x7fbdd40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:06.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd4159890 0x7fbdd40b3590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400e8d0 tx=0x7fbdc4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 shutdown_connections 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbdc0066f30 0x7fbdc00693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdd4159890 0x7fbdd40b3590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd415db10 0x7fbdd40b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 --2- 172.21.15.86:0/1329681376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4159c60 0x7fbdd40b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 >> 172.21.15.86:0/1329681376 conn(0x7fbdd4068e20 msgr2=0x7fbdd41553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 shutdown_connections 2023-10-09T11:41:06.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:06.971+0000 7fbdd9fff700 1 -- 172.21.15.86:0/1329681376 wait complete. 2023-10-09T11:41:06.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:41:06.990 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:06.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:07.040 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:07.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.177+0000 7fd2c5dff700 1 Processor -- start 2023-10-09T11:41:07.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.177+0000 7fd2c5dff700 1 -- start start 2023-10-09T11:41:07.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.178+0000 7fd2c5dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2c0155eb0 0x7fd2c006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.178+0000 7fd2c5dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 0x7fd2c0069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.178+0000 7fd2c5dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2c0069cb0 0x7fd2c0159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.178+0000 7fd2c5dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c006a130 con 0x7fd2c0155eb0 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.178+0000 7fd2c5dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c006eb90 con 0x7fd2c0069cb0 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.178+0000 7fd2c5dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c006ee70 con 0x7fd2c00c70b0 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2c0155eb0 0x7fd2c006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2c0155eb0 0x7fd2c006e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55292/0 (socket says 172.21.15.86:55292) 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4071059909 learned_addr learned my addr 172.21.15.86:0/4071059909 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4071059909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 msgr2=0x7fd2c0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 --2- 172.21.15.86:0/4071059909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 0x7fd2c0069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4071059909 >> v2:172.21.15.135:3300/0 conn(0x7fd2c0069cb0 msgr2=0x7fd2c0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 --2- 172.21.15.86:0/4071059909 >> v2:172.21.15.135:3300/0 conn(0x7fd2c0069cb0 0x7fd2c0159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4071059909 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c006f150 con 0x7fd2c0155eb0 2023-10-09T11:41:07.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2bf7fe700 1 --2- 172.21.15.86:0/4071059909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 0x7fd2c006e240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00c7740 tx=0x7fd2b000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c321a47e9ee9a0b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2be7fc700 1 -- 172.21.15.86:0/4071059909 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000be60 con 0x7fd2c0155eb0 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2be7fc700 1 -- 172.21.15.86:0/4071059909 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b000ddc0 con 0x7fd2c0155eb0 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.179+0000 7fd2be7fc700 1 -- 172.21.15.86:0/4071059909 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00196b0 con 0x7fd2c0155eb0 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4071059909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 msgr2=0x7fd2c006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4071059909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 0x7fd2c006e240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00c7740 tx=0x7fd2b000b4f0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4071059909 shutdown_connections 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4071059909 >> v2:172.21.15.135:3300/0 conn(0x7fd2c0069cb0 0x7fd2c0159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4071059909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 0x7fd2c006e240 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4071059909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 0x7fd2c0069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4071059909 >> 172.21.15.86:0/4071059909 conn(0x7fd2c0068e10 msgr2=0x7fd2c00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4071059909 shutdown_connections 2023-10-09T11:41:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.180+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4071059909 wait complete. 2023-10-09T11:41:07.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.182+0000 7fd2c5dff700 1 Processor -- start 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.182+0000 7fd2c5dff700 1 -- start start 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2c5dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2c0069cb0 0x7fd2c0157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2c5dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 0x7fd2c01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2c5dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 0x7fd2c0155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2c5dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00c4020 con 0x7fd2c0155eb0 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2c5dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0159c10 con 0x7fd2c0069cb0 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2c5dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0159ef0 con 0x7fd2c00c70b0 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2c0069cb0 0x7fd2c0157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2c0069cb0 0x7fd2c0157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:39578/0 (socket says 172.21.15.86:39578) 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4039734187 learned_addr learned my addr 172.21.15.86:0/4039734187 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bffff700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 0x7fd2c0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2beffd700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 0x7fd2c01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 msgr2=0x7fd2c01593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 0x7fd2c01593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 msgr2=0x7fd2c0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 0x7fd2c0155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.183+0000 7fd2bf7fe700 1 -- 172.21.15.86:0/4039734187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b000b790 con 0x7fd2c0069cb0 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.184+0000 7fd2bf7fe700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2c0069cb0 0x7fd2c0157f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000b760 tx=0x7fd2b001b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.184+0000 7fd2a77fe700 1 -- 172.21.15.86:0/4039734187 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0010850 con 0x7fd2c0069cb0 2023-10-09T11:41:07.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.184+0000 7fd2a77fe700 1 -- 172.21.15.86:0/4039734187 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b00109b0 con 0x7fd2c0069cb0 2023-10-09T11:41:07.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.184+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c015a1d0 con 0x7fd2c0069cb0 2023-10-09T11:41:07.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.184+0000 7fd2a77fe700 1 -- 172.21.15.86:0/4039734187 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0010d50 con 0x7fd2c0069cb0 2023-10-09T11:41:07.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.184+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c015a4b0 con 0x7fd2c0069cb0 2023-10-09T11:41:07.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.185+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c00c3df0 con 0x7fd2c0069cb0 2023-10-09T11:41:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.186+0000 7fd2a77fe700 1 -- 172.21.15.86:0/4039734187 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2b0023070 con 0x7fd2c0069cb0 2023-10-09T11:41:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.187+0000 7fd2a77fe700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd2ac066f30 0x7fd2ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.187+0000 7fd2a77fe700 1 -- 172.21.15.86:0/4039734187 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd2b0014070 con 0x7fd2c0069cb0 2023-10-09T11:41:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.187+0000 7fd2beffd700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd2ac066f30 0x7fd2ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.188+0000 7fd2beffd700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd2ac066f30 0x7fd2ac0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00c7f60 tx=0x7fd2b4009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:07.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.191+0000 7fd2a77fe700 1 -- 172.21.15.86:0/4039734187 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2b0055dc0 con 0x7fd2c0069cb0 2023-10-09T11:41:07.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.379+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2c004c3c0 con 0x7fd2c0069cb0 2023-10-09T11:41:07.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.379+0000 7fd2a77fe700 1 -- 172.21.15.86:0/4039734187 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2b00593e0 con 0x7fd2c0069cb0 2023-10-09T11:41:07.380 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:07.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd2ac066f30 msgr2=0x7fd2ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd2ac066f30 0x7fd2ac0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00c7f60 tx=0x7fd2b4009120 comp rx=0 tx=0).stop 2023-10-09T11:41:07.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2c0069cb0 msgr2=0x7fd2c0157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2c0069cb0 0x7fd2c0157f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000b760 tx=0x7fd2b001b000 comp rx=0 tx=0).stop 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 shutdown_connections 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd2ac066f30 0x7fd2ac0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c0155eb0 0x7fd2c0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2c0069cb0 0x7fd2c0157f00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 --2- 172.21.15.86:0/4039734187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2c00c70b0 0x7fd2c01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 >> 172.21.15.86:0/4039734187 conn(0x7fd2c0068e10 msgr2=0x7fd2c00cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 shutdown_connections 2023-10-09T11:41:07.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.382+0000 7fd2c5dff700 1 -- 172.21.15.86:0/4039734187 wait complete. 2023-10-09T11:41:07.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.577+0000 7f6303fff700 1 Processor -- start 2023-10-09T11:41:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.577+0000 7f6303fff700 1 -- start start 2023-10-09T11:41:07.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6303fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f62fc0cbf30 0x7f62fc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6303fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc0ccf90 0x7f62fc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6303fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc0cc300 con 0x7f62fc15a270 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6303fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc156bf0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6303fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0ae950 con 0x7f62fc0ccf90 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6301d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f62fc0cbf30 0x7f62fc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6301d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f62fc0cbf30 0x7f62fc0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55300/0 (socket says 172.21.15.86:55300) 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6301d9b700 1 -- 172.21.15.86:0/1423801644 learned_addr learned my addr 172.21.15.86:0/1423801644 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f630159a700 1 --2- 172.21.15.86:0/1423801644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc0ccf90 0x7f62fc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6301d9b700 1 -- 172.21.15.86:0/1423801644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc0ccf90 msgr2=0x7f62fc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6301d9b700 1 --2- 172.21.15.86:0/1423801644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc0ccf90 0x7f62fc0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6301d9b700 1 -- 172.21.15.86:0/1423801644 >> v1:172.21.15.135:6789/0 conn(0x7f62fc15a270 legacy=0x7f62fc0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f6301d9b700 1 -- 172.21.15.86:0/1423801644 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0ad370 con 0x7f62fc0cbf30 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.579+0000 7f630159a700 1 --2- 172.21.15.86:0/1423801644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc0ccf90 0x7f62fc0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6301d9b700 1 --2- 172.21.15.86:0/1423801644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0ae410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f62f800bc80 tx=0x7f62f800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f756cf146b132945 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6300d99700 1 -- 172.21.15.86:0/1423801644 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800be90 con 0x7f62fc0cbf30 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6300d99700 1 -- 172.21.15.86:0/1423801644 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f800ddc0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6300d99700 1 -- 172.21.15.86:0/1423801644 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80196b0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6303fff700 1 -- 172.21.15.86:0/1423801644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 msgr2=0x7f62fc0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6303fff700 1 --2- 172.21.15.86:0/1423801644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0ae410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f62f800bc80 tx=0x7f62f800b4f0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6303fff700 1 -- 172.21.15.86:0/1423801644 shutdown_connections 2023-10-09T11:41:07.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6303fff700 1 --2- 172.21.15.86:0/1423801644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0ae410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6303fff700 1 --2- 172.21.15.86:0/1423801644 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc0ccf90 0x7f62fc0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.580+0000 7f6303fff700 1 -- 172.21.15.86:0/1423801644 >> 172.21.15.86:0/1423801644 conn(0x7f62fc06a320 msgr2=0x7f62fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:07.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.581+0000 7f6303fff700 1 -- 172.21.15.86:0/1423801644 shutdown_connections 2023-10-09T11:41:07.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.581+0000 7f6303fff700 1 -- 172.21.15.86:0/1423801644 wait complete. 2023-10-09T11:41:07.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.582+0000 7f6303fff700 1 Processor -- start 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.582+0000 7f6303fff700 1 -- start start 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6303fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6303fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62fc0ccf90 0x7f62fc165c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6303fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc15a270 0x7f62fc0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6303fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0c8360 con 0x7f62fc0cbf30 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6303fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc1672a0 con 0x7f62fc0ccf90 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6303fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc166c90 con 0x7f62fc15a270 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55316/0 (socket says 172.21.15.86:55316) 2023-10-09T11:41:07.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 -- 172.21.15.86:0/926103125 learned_addr learned my addr 172.21.15.86:0/926103125 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f630159a700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62fc0ccf90 0x7f62fc165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f630259c700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc15a270 0x7f62fc0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 -- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc15a270 msgr2=0x7f62fc0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc15a270 0x7f62fc0c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 -- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62fc0ccf90 msgr2=0x7f62fc165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62fc0ccf90 0x7f62fc165c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.583+0000 7f6301d9b700 1 -- 172.21.15.86:0/926103125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f800b790 con 0x7f62fc0cbf30 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.584+0000 7f6301d9b700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0c7e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62f800b760 tx=0x7f62f801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:07.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.584+0000 7f62f1ffb700 1 -- 172.21.15.86:0/926103125 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8027070 con 0x7f62fc0cbf30 2023-10-09T11:41:07.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.584+0000 7f62f1ffb700 1 -- 172.21.15.86:0/926103125 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f80107d0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.584+0000 7f62f1ffb700 1 -- 172.21.15.86:0/926103125 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8010bb0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.584+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc1666d0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.584+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc166f30 con 0x7f62fc0cbf30 2023-10-09T11:41:07.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.585+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc04c3c0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.586+0000 7f62f1ffb700 1 -- 172.21.15.86:0/926103125 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62f802c410 con 0x7f62fc0cbf30 2023-10-09T11:41:07.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.587+0000 7f62f1ffb700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f62e0066f30 0x7f62e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:07.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.587+0000 7f62f1ffb700 1 -- 172.21.15.86:0/926103125 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f62f8014070 con 0x7f62fc0cbf30 2023-10-09T11:41:07.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.587+0000 7f630159a700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f62e0066f30 0x7f62e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:07.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.588+0000 7f630159a700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f62e0066f30 0x7f62e00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62ec006f00 tx=0x7f62ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:07.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.591+0000 7f62f1ffb700 1 -- 172.21.15.86:0/926103125 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62f8055e90 con 0x7f62fc0cbf30 2023-10-09T11:41:07.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.829+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62fc06f8a0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.829+0000 7f62f1ffb700 1 -- 172.21.15.86:0/926103125 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f62f80594b0 con 0x7f62fc0cbf30 2023-10-09T11:41:07.830 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:07.830 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-09T11:41:07.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f62e0066f30 msgr2=0x7f62e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f62e0066f30 0x7f62e00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62ec006f00 tx=0x7f62ec008040 comp rx=0 tx=0).stop 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 msgr2=0x7f62fc0c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0c7e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62f800b760 tx=0x7f62f801b000 comp rx=0 tx=0).stop 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 shutdown_connections 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f62e0066f30 0x7f62e00693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62fc0cbf30 0x7f62fc0c7e20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62fc15a270 0x7f62fc0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 --2- 172.21.15.86:0/926103125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62fc0ccf90 0x7f62fc165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.831+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 >> 172.21.15.86:0/926103125 conn(0x7f62fc06a320 msgr2=0x7f62fc159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.832+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 shutdown_connections 2023-10-09T11:41:07.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:07.832+0000 7f6303fff700 1 -- 172.21.15.86:0/926103125 wait complete. 2023-10-09T11:41:07.834 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 3 2023-10-09T11:41:07.850 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:08.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.027+0000 7f19d69ff700 1 Processor -- start 2023-10-09T11:41:08.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.027+0000 7f19d69ff700 1 -- start start 2023-10-09T11:41:08.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.028+0000 7f19d69ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19d006bcd0 0x7f19d00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.028+0000 7f19d69ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d006c0a0 0x7f19d015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.028+0000 7f19d69ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19d015df50 0x7f19d015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.028+0000 7f19d69ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d015d7e0 con 0x7f19d006bcd0 2023-10-09T11:41:08.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.028+0000 7f19d69ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d015dac0 con 0x7f19d015df50 2023-10-09T11:41:08.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.028+0000 7f19d69ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d015aa30 con 0x7f19d006c0a0 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19d006bcd0 0x7f19d00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19d006bcd0 0x7f19d00caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55326/0 (socket says 172.21.15.86:55326) 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 -- 172.21.15.86:0/3118528058 learned_addr learned my addr 172.21.15.86:0/3118528058 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19d4f9c700 1 --2- 172.21.15.86:0/3118528058 >> v2:172.21.15.135:3300/0 conn(0x7f19d015df50 0x7f19d015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cf7fe700 1 --2- 172.21.15.86:0/3118528058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d006c0a0 0x7f19d015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 -- 172.21.15.86:0/3118528058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d006c0a0 msgr2=0x7f19d015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 --2- 172.21.15.86:0/3118528058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d006c0a0 0x7f19d015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 -- 172.21.15.86:0/3118528058 >> v2:172.21.15.135:3300/0 conn(0x7f19d015df50 msgr2=0x7f19d015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 --2- 172.21.15.86:0/3118528058 >> v2:172.21.15.135:3300/0 conn(0x7f19d015df50 0x7f19d015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 -- 172.21.15.86:0/3118528058 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d015ad10 con 0x7f19d006bcd0 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cf7fe700 1 --2- 172.21.15.86:0/3118528058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d006c0a0 0x7f19d015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19d4f9c700 1 --2- 172.21.15.86:0/3118528058 >> v2:172.21.15.135:3300/0 conn(0x7f19d015df50 0x7f19d015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.029+0000 7f19cffff700 1 --2- 172.21.15.86:0/3118528058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d00caa90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19d00b4600 tx=0x7f19c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bd583336e1a89e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19ceffd700 1 -- 172.21.15.86:0/3118528058 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000b860 con 0x7f19d006bcd0 2023-10-09T11:41:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19ceffd700 1 -- 172.21.15.86:0/3118528058 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c000b9c0 con 0x7f19d006bcd0 2023-10-09T11:41:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19ceffd700 1 -- 172.21.15.86:0/3118528058 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000bd80 con 0x7f19d006bcd0 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 -- 172.21.15.86:0/3118528058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 msgr2=0x7f19d00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 --2- 172.21.15.86:0/3118528058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d00caa90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19d00b4600 tx=0x7f19c0009250 comp rx=0 tx=0).stop 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 -- 172.21.15.86:0/3118528058 shutdown_connections 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 --2- 172.21.15.86:0/3118528058 >> v2:172.21.15.135:3300/0 conn(0x7f19d015df50 0x7f19d015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 --2- 172.21.15.86:0/3118528058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d00caa90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 --2- 172.21.15.86:0/3118528058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d006c0a0 0x7f19d015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 -- 172.21.15.86:0/3118528058 >> 172.21.15.86:0/3118528058 conn(0x7f19d00ce600 msgr2=0x7f19d00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:08.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 -- 172.21.15.86:0/3118528058 shutdown_connections 2023-10-09T11:41:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.030+0000 7f19d69ff700 1 -- 172.21.15.86:0/3118528058 wait complete. 2023-10-09T11:41:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.032+0000 7f19d69ff700 1 Processor -- start 2023-10-09T11:41:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.032+0000 7f19d69ff700 1 -- start start 2023-10-09T11:41:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19d69ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d0146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19d69ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d006c0a0 0x7f19d01570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19d69ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d015df50 0x7f19d0157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19d69ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d016e540 con 0x7f19d006bcd0 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19d69ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c7ee0 con 0x7f19d006c0a0 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19d69ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c75f0 con 0x7f19d015df50 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d0146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d0146110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55332/0 (socket says 172.21.15.86:55332) 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cffff700 1 -- 172.21.15.86:0/1037853184 learned_addr learned my addr 172.21.15.86:0/1037853184 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d006c0a0 0x7f19d01570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19d4f9c700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d015df50 0x7f19d0157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cffff700 1 -- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d015df50 msgr2=0x7f19d0157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cffff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d015df50 0x7f19d0157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cffff700 1 -- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d006c0a0 msgr2=0x7f19d01570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.033+0000 7f19cffff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d006c0a0 0x7f19d01570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.034+0000 7f19cffff700 1 -- 172.21.15.86:0/1037853184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00094f0 con 0x7f19d006bcd0 2023-10-09T11:41:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.034+0000 7f19d4f9c700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d015df50 0x7f19d0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.034+0000 7f19cffff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d0146110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19d0069220 tx=0x7f19c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.036+0000 7f19b7fff700 1 -- 172.21.15.86:0/1037853184 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0006a90 con 0x7f19d006bcd0 2023-10-09T11:41:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.036+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d016e260 con 0x7f19d006bcd0 2023-10-09T11:41:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.036+0000 7f19b7fff700 1 -- 172.21.15.86:0/1037853184 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c0011e20 con 0x7f19d006bcd0 2023-10-09T11:41:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.036+0000 7f19b7fff700 1 -- 172.21.15.86:0/1037853184 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00266a0 con 0x7f19d006bcd0 2023-10-09T11:41:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.036+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d00c7b70 con 0x7f19d006bcd0 2023-10-09T11:41:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.037+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d004c3c0 con 0x7f19d006bcd0 2023-10-09T11:41:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.037+0000 7f19b7fff700 1 -- 172.21.15.86:0/1037853184 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19c0026a50 con 0x7f19d006bcd0 2023-10-09T11:41:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.038+0000 7f19b7fff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f19bc066f30 0x7f19bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.038+0000 7f19b7fff700 1 -- 172.21.15.86:0/1037853184 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f19c0085c30 con 0x7f19d006bcd0 2023-10-09T11:41:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.039+0000 7f19cf7fe700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f19bc066f30 0x7f19bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.039+0000 7f19cf7fe700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f19bc066f30 0x7f19bc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19d00ca2a0 tx=0x7f19c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.043+0000 7f19b7fff700 1 -- 172.21.15.86:0/1037853184 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c00531d0 con 0x7f19d006bcd0 2023-10-09T11:41:08.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.236+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19d015aff0 con 0x7f19d006bcd0 2023-10-09T11:41:08.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.236+0000 7f19b7fff700 1 -- 172.21.15.86:0/1037853184 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f19c0015090 con 0x7f19d006bcd0 2023-10-09T11:41:08.237 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:08.237 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":18,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:02.264387+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f19bc066f30 msgr2=0x7f19bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f19bc066f30 0x7f19bc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19d00ca2a0 tx=0x7f19c4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 msgr2=0x7f19d0146110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d0146110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19d0069220 tx=0x7f19c0017000 comp rx=0 tx=0).stop 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 shutdown_connections 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f19bc066f30 0x7f19bc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d006bcd0 0x7f19d0146110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19d015df50 0x7f19d0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 --2- 172.21.15.86:0/1037853184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d006c0a0 0x7f19d01570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 >> 172.21.15.86:0/1037853184 conn(0x7f19d00ce600 msgr2=0x7f19d00c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:08.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 shutdown_connections 2023-10-09T11:41:08.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.239+0000 7f19d69ff700 1 -- 172.21.15.86:0/1037853184 wait complete. 2023-10-09T11:41:08.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:41:08.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:08.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.440+0000 7f3d9d9ff700 1 Processor -- start 2023-10-09T11:41:08.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.440+0000 7f3d9d9ff700 1 -- start start 2023-10-09T11:41:08.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d9d9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980c83f0 0x7f3d980c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d9d9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3d980ccee0 0x7f3d981561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d9d9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9815b0d0 con 0x7f3d980c87c0 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d9d9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980c7a60 con 0x7f3d980ccee0 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d9d9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9815a4c0 con 0x7f3d980c83f0 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d96ffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980c83f0 0x7f3d980c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d967fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3d980ccee0 0x7f3d981561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d96ffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980c83f0 0x7f3d980c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:43296/0 (socket says 172.21.15.86:43296) 2023-10-09T11:41:08.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.442+0000 7f3d96ffd700 1 -- 172.21.15.86:0/909218675 learned_addr learned my addr 172.21.15.86:0/909218675 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:08.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d967fc700 1 -- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980c83f0 msgr2=0x7f3d980c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:08.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d967fc700 1 --2- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980c83f0 0x7f3d980c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d967fc700 1 -- 172.21.15.86:0/909218675 >> v1:172.21.15.135:6789/0 conn(0x7f3d980c87c0 legacy=0x7f3d9806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d967fc700 1 -- 172.21.15.86:0/909218675 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9815a7a0 con 0x7f3d980ccee0 2023-10-09T11:41:08.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d96ffd700 1 --2- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980c83f0 0x7f3d980c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:08.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d967fc700 1 --2- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980ccee0 0x7f3d981561d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0098e0 tx=0x7f3d8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aa985dcb4828ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d95ffb700 1 -- 172.21.15.86:0/909218675 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00b640 con 0x7f3d980ccee0 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d95ffb700 1 -- 172.21.15.86:0/909218675 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c00b7a0 con 0x7f3d980ccee0 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.443+0000 7f3d95ffb700 1 -- 172.21.15.86:0/909218675 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00bb40 con 0x7f3d980ccee0 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980ccee0 msgr2=0x7f3d981561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980ccee0 0x7f3d981561d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0098e0 tx=0x7f3d8c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/909218675 shutdown_connections 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980c83f0 0x7f3d980c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/909218675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980ccee0 0x7f3d981561d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/909218675 >> 172.21.15.86:0/909218675 conn(0x7f3d98068e10 msgr2=0x7f3d980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/909218675 shutdown_connections 2023-10-09T11:41:08.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.444+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/909218675 wait complete. 2023-10-09T11:41:08.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.445+0000 7f3d9d9ff700 1 Processor -- start 2023-10-09T11:41:08.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.445+0000 7f3d9d9ff700 1 -- start start 2023-10-09T11:41:08.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.446+0000 7f3d9d9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980c83f0 0x7f3d9814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.446+0000 7f3d9d9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c87c0 0x7f3d980c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.446+0000 7f3d9d9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980ccee0 0x7f3d98153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.446+0000 7f3d9d9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9816a010 con 0x7f3d980c87c0 2023-10-09T11:41:08.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.446+0000 7f3d9d9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9816add0 con 0x7f3d980c83f0 2023-10-09T11:41:08.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.446+0000 7f3d9d9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9814b720 con 0x7f3d980ccee0 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c87c0 0x7f3d980c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c87c0 0x7f3d980c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55336/0 (socket says 172.21.15.86:55336) 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 -- 172.21.15.86:0/2048553947 learned_addr learned my addr 172.21.15.86:0/2048553947 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d96ffd700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980c83f0 0x7f3d9814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d977fe700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980ccee0 0x7f3d98153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 -- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980ccee0 msgr2=0x7f3d98153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980ccee0 0x7f3d98153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 -- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980c83f0 msgr2=0x7f3d9814b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980c83f0 0x7f3d9814b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 -- 172.21.15.86:0/2048553947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880094f0 con 0x7f3d980c87c0 2023-10-09T11:41:08.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d967fc700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c87c0 0x7f3d980c6160 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d98063d40 tx=0x7f3d8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.447+0000 7f3d7effd700 1 -- 172.21.15.86:0/2048553947 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c01bc40 con 0x7f3d980c87c0 2023-10-09T11:41:08.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.448+0000 7f3d7effd700 1 -- 172.21.15.86:0/2048553947 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c01bde0 con 0x7f3d980c87c0 2023-10-09T11:41:08.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.448+0000 7f3d7effd700 1 -- 172.21.15.86:0/2048553947 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c011670 con 0x7f3d980c87c0 2023-10-09T11:41:08.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.448+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c009420 con 0x7f3d980c87c0 2023-10-09T11:41:08.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.448+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9816a4a0 con 0x7f3d980c87c0 2023-10-09T11:41:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.449+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9816af60 con 0x7f3d980c87c0 2023-10-09T11:41:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.449+0000 7f3d7effd700 1 -- 172.21.15.86:0/2048553947 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d8c0119e0 con 0x7f3d980c87c0 2023-10-09T11:41:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.450+0000 7f3d7effd700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d84066f30 0x7f3d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.451+0000 7f3d7effd700 1 -- 172.21.15.86:0/2048553947 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d8c085760 con 0x7f3d980c87c0 2023-10-09T11:41:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.451+0000 7f3d96ffd700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d84066f30 0x7f3d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.451+0000 7f3d96ffd700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d84066f30 0x7f3d840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d88006d20 tx=0x7f3d88009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.455+0000 7f3d7effd700 1 -- 172.21.15.86:0/2048553947 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d8c052c80 con 0x7f3d980c87c0 2023-10-09T11:41:08.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.645+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d9815aa80 con 0x7f3d980c87c0 2023-10-09T11:41:08.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.645+0000 7f3d7effd700 1 -- 172.21.15.86:0/2048553947 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d8c0562a0 con 0x7f3d980c87c0 2023-10-09T11:41:08.646 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d84066f30 msgr2=0x7f3d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d84066f30 0x7f3d840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d88006d20 tx=0x7f3d88009250 comp rx=0 tx=0).stop 2023-10-09T11:41:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c87c0 msgr2=0x7f3d980c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c87c0 0x7f3d980c6160 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d98063d40 tx=0x7f3d8c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 shutdown_connections 2023-10-09T11:41:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d84066f30 0x7f3d840693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d980ccee0 0x7f3d98153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d980c83f0 0x7f3d9814b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 --2- 172.21.15.86:0/2048553947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d980c87c0 0x7f3d980c6160 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 >> 172.21.15.86:0/2048553947 conn(0x7f3d98068e10 msgr2=0x7f3d980b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:08.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 shutdown_connections 2023-10-09T11:41:08.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.647+0000 7f3d9d9ff700 1 -- 172.21.15.86:0/2048553947 wait complete. 2023-10-09T11:41:08.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:41:08.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.846+0000 7facf359d700 1 Processor -- start 2023-10-09T11:41:08.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.846+0000 7facf359d700 1 -- start start 2023-10-09T11:41:08.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.847+0000 7facf359d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7facec156310 0x7facec0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.847+0000 7facf359d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7facec1566e0 0x7facec0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.847+0000 7facf359d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec0ca860 con 0x7facec0ca300 2023-10-09T11:41:08.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.847+0000 7facf359d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0cab40 con 0x7facec156310 2023-10-09T11:41:08.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.847+0000 7facf359d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0cae20 con 0x7facec1566e0 2023-10-09T11:41:08.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.847+0000 7facf259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7facec156310 0x7facec0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7facec156310 0x7facec0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55344/0 (socket says 172.21.15.86:55344) 2023-10-09T11:41:08.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf259b700 1 -- 172.21.15.86:0/3171402092 learned_addr learned my addr 172.21.15.86:0/3171402092 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:08.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf1d9a700 1 --2- 172.21.15.86:0/3171402092 >> v2:172.21.15.135:3300/0 conn(0x7facec1566e0 0x7facec0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf259b700 1 -- 172.21.15.86:0/3171402092 >> v2:172.21.15.135:3300/0 conn(0x7facec1566e0 msgr2=0x7facec0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:08.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf259b700 1 --2- 172.21.15.86:0/3171402092 >> v2:172.21.15.135:3300/0 conn(0x7facec1566e0 0x7facec0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf259b700 1 -- 172.21.15.86:0/3171402092 >> v1:172.21.15.86:6789/0 conn(0x7facec0ca300 legacy=0x7facec0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf259b700 1 -- 172.21.15.86:0/3171402092 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0cb100 con 0x7facec156310 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf1599700 1 -- 172.21.15.86:0/3171402092 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334173404 0 0) 0x7facec0ca860 con 0x7facec0ca300 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf259b700 1 --2- 172.21.15.86:0/3171402092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec156310 0x7facec0c9dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7facec06c000 tx=0x7face8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6547773ed92ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.848+0000 7facf1599700 1 -- 172.21.15.86:0/3171402092 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face800b860 con 0x7facec156310 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf1599700 1 -- 172.21.15.86:0/3171402092 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face800b9c0 con 0x7facec156310 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf1599700 1 -- 172.21.15.86:0/3171402092 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face800bd60 con 0x7facec156310 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 -- 172.21.15.86:0/3171402092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec156310 msgr2=0x7facec0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 --2- 172.21.15.86:0/3171402092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec156310 0x7facec0c9dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7facec06c000 tx=0x7face8009250 comp rx=0 tx=0).stop 2023-10-09T11:41:08.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 -- 172.21.15.86:0/3171402092 shutdown_connections 2023-10-09T11:41:08.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 --2- 172.21.15.86:0/3171402092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec156310 0x7facec0c9dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 --2- 172.21.15.86:0/3171402092 >> v2:172.21.15.135:3300/0 conn(0x7facec1566e0 0x7facec0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 -- 172.21.15.86:0/3171402092 >> 172.21.15.86:0/3171402092 conn(0x7facec0cc1f0 msgr2=0x7facec0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:08.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 -- 172.21.15.86:0/3171402092 shutdown_connections 2023-10-09T11:41:08.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.849+0000 7facf359d700 1 -- 172.21.15.86:0/3171402092 wait complete. 2023-10-09T11:41:08.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.850+0000 7facf359d700 1 Processor -- start 2023-10-09T11:41:08.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.851+0000 7facf359d700 1 -- start start 2023-10-09T11:41:08.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.851+0000 7facf359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facec0ca300 0x7facec1425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf359d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec156310 0x7facec145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf359d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec1566e0 0x7facec1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf359d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec1514b0 con 0x7facec1566e0 2023-10-09T11:41:08.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf359d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec1445e0 con 0x7facec156310 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec1448c0 con 0x7facec0ca300 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec1566e0 0x7facec1464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec1566e0 0x7facec1464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55354/0 (socket says 172.21.15.86:55354) 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 -- 172.21.15.86:0/52509773 learned_addr learned my addr 172.21.15.86:0/52509773 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf1d9a700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec156310 0x7facec145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf259b700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facec0ca300 0x7facec1425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 -- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facec0ca300 msgr2=0x7facec1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facec0ca300 0x7facec1425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 -- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec156310 msgr2=0x7facec145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec156310 0x7facec145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 -- 172.21.15.86:0/52509773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80094f0 con 0x7facec1566e0 2023-10-09T11:41:08.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.852+0000 7facf2d9c700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec1566e0 0x7facec1464a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7face4001560 tx=0x7face4001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.853+0000 7face27fc700 1 -- 172.21.15.86:0/52509773 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4004160 con 0x7facec1566e0 2023-10-09T11:41:08.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.853+0000 7face27fc700 1 -- 172.21.15.86:0/52509773 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400a7e0 con 0x7facec1566e0 2023-10-09T11:41:08.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.853+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec144ba0 con 0x7facec1566e0 2023-10-09T11:41:08.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.853+0000 7face27fc700 1 -- 172.21.15.86:0/52509773 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400aba0 con 0x7facec1566e0 2023-10-09T11:41:08.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.853+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec145160 con 0x7facec1566e0 2023-10-09T11:41:08.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.854+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec04c3c0 con 0x7facec1566e0 2023-10-09T11:41:08.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.855+0000 7face27fc700 1 -- 172.21.15.86:0/52509773 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7face4012420 con 0x7facec1566e0 2023-10-09T11:41:08.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.855+0000 7face27fc700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7facd0066f30 0x7facd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:08.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.856+0000 7face27fc700 1 -- 172.21.15.86:0/52509773 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7face4083ff0 con 0x7facec1566e0 2023-10-09T11:41:08.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.856+0000 7facf259b700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7facd0066f30 0x7facd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:08.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.856+0000 7facf259b700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7facd0066f30 0x7facd00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facec06c000 tx=0x7face8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:08.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:08.859+0000 7face27fc700 1 -- 172.21.15.86:0/52509773 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face4051530 con 0x7facec1566e0 2023-10-09T11:41:09.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.054+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7facec0cd0b0 con 0x7facec1566e0 2023-10-09T11:41:09.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.055+0000 7face27fc700 1 -- 172.21.15.86:0/52509773 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7face4054b50 con 0x7facec1566e0 2023-10-09T11:41:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:09.056 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:41:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:41:09.056 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T11:41:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T11:41:09.057 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:41:09.057 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:41:09.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7facd0066f30 msgr2=0x7facd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7facd0066f30 0x7facd00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facec06c000 tx=0x7face8017000 comp rx=0 tx=0).stop 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec1566e0 msgr2=0x7facec1464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec1566e0 0x7facec1464a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7face4001560 tx=0x7face4001770 comp rx=0 tx=0).stop 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 shutdown_connections 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7facd0066f30 0x7facd00693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facec1566e0 0x7facec1464a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facec0ca300 0x7facec1425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 --2- 172.21.15.86:0/52509773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec156310 0x7facec145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 >> 172.21.15.86:0/52509773 conn(0x7facec0cc1f0 msgr2=0x7facec0addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.057+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 shutdown_connections 2023-10-09T11:41:09.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.058+0000 7facf359d700 1 -- 172.21.15.86:0/52509773 wait complete. 2023-10-09T11:41:09.076 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:41:09.076 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:41:09.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.259+0000 7f392efff700 1 Processor -- start 2023-10-09T11:41:09.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.259+0000 7f392efff700 1 -- start start 2023-10-09T11:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.260+0000 7f392efff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f392806c200 0x7f39280ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.260+0000 7f392efff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280cd030 con 0x7f3928159900 2023-10-09T11:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.260+0000 7f392efff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392806a400 con 0x7f3928159cd0 2023-10-09T11:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.260+0000 7f392efff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39280697f0 con 0x7f392806c200 2023-10-09T11:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.260+0000 7f392cd9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3928159900 0x7f392806baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58434/0 (socket says 172.21.15.86:58434) 2023-10-09T11:41:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f392cd9b700 1 -- 172.21.15.86:0/2690545884 learned_addr learned my addr 172.21.15.86:0/2690545884 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630441312 0 0) 0x7f391c001490 con 0x7f3928159900 2023-10-09T11:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3918003570 con 0x7f3928159900 2023-10-09T11:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f3927fff700 1 --2- 172.21.15.86:0/2690545884 >> v2:172.21.15.135:3300/0 conn(0x7f392806c200 0x7f39280ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3475339783 0 0) 0x7f3918003570 con 0x7f3928159900 2023-10-09T11:41:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 >> v2:172.21.15.135:3300/0 conn(0x7f392806c200 msgr2=0x7f39280ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 --2- 172.21.15.86:0/2690545884 >> v2:172.21.15.135:3300/0 conn(0x7f392806c200 0x7f39280ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 >> v1:172.21.15.135:6789/0 conn(0x7f3928159cd0 legacy=0x7f39280c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928069ad0 con 0x7f3928159900 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f391c001980 con 0x7f3928159900 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 >> v1:172.21.15.86:6789/0 conn(0x7f3928159900 legacy=0x7f392806baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3918003a60 0x7f3918003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3918004810 0x7f3918004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918005210 0x7f391800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280697f0 con 0x7f3918003a60 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391800c130 con 0x7f3918005210 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.261+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391800c2c0 con 0x7f3918004810 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3918003a60 0x7f3918003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f3927fff700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3918004810 0x7f3918004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392d59c700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918005210 0x7f391800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392cd9b700 1 -- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3918004810 msgr2=0x7f3918004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3918004810 0x7f3918004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392cd9b700 1 -- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918005210 msgr2=0x7f391800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918005210 0x7f391800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392cd9b700 1 -- 172.21.15.86:0/2690545884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918003570 con 0x7f3918003a60 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392d59c700 1 -- 172.21.15.86:0/2690545884 reap_dead start 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3918003a60 0x7f3918003e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f391c00aad0 tx=0x7f391c00a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc572c958d0738b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00c590 con 0x7f3918003a60 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.262+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00c6f0 con 0x7f3918003a60 2023-10-09T11:41:09.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f39277fe700 1 -- 172.21.15.86:0/2690545884 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00cab0 con 0x7f3918003a60 2023-10-09T11:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f392efff700 1 -- 172.21.15.86:0/2690545884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3918003a60 msgr2=0x7f3918003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f392efff700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3918003a60 0x7f3918003e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f391c00aad0 tx=0x7f391c00a170 comp rx=0 tx=0).stop 2023-10-09T11:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f392efff700 1 -- 172.21.15.86:0/2690545884 shutdown_connections 2023-10-09T11:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f392efff700 1 --2- 172.21.15.86:0/2690545884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3918003a60 0x7f3918003e70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f392efff700 1 -- 172.21.15.86:0/2690545884 >> 172.21.15.86:0/2690545884 conn(0x7f39280ce510 msgr2=0x7f39280ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f392efff700 1 -- 172.21.15.86:0/2690545884 shutdown_connections 2023-10-09T11:41:09.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.263+0000 7f392efff700 1 -- 172.21.15.86:0/2690545884 wait complete. 2023-10-09T11:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.264+0000 7f392efff700 1 Processor -- start 2023-10-09T11:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.265+0000 7f392efff700 1 -- start start 2023-10-09T11:41:09.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.265+0000 7f392efff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918003a60 0x7f3928153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.265+0000 7f392efff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392815b680 0x7f392815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392efff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39280c8c00 0x7f39280c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392efff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392815b1f0 con 0x7f39280c8c00 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392efff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392815a5e0 con 0x7f3918003a60 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392efff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392815a8c0 con 0x7f392815b680 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39280c8c00 0x7f39280c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39280c8c00 0x7f39280c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55364/0 (socket says 172.21.15.86:55364) 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 -- 172.21.15.86:0/2633374724 learned_addr learned my addr 172.21.15.86:0/2633374724 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918003a60 0x7f3928153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f3927fff700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392815b680 0x7f392815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 -- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392815b680 msgr2=0x7f392815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392815b680 0x7f392815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 -- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918003a60 msgr2=0x7f3928153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918003a60 0x7f3928153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 -- 172.21.15.86:0/2633374724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392815aba0 con 0x7f39280c8c00 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918003a60 0x7f3928153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f392d59c700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39280c8c00 0x7f39280c9070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39280c5570 tx=0x7f3920007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.266+0000 7f3924ff9700 1 -- 172.21.15.86:0/2633374724 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920006b00 con 0x7f39280c8c00 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.267+0000 7f3924ff9700 1 -- 172.21.15.86:0/2633374724 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920006c60 con 0x7f39280c8c00 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.267+0000 7f3924ff9700 1 -- 172.21.15.86:0/2633374724 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007030 con 0x7f39280c8c00 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.267+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392815ae80 con 0x7f39280c8c00 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.267+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39280b33f0 con 0x7f39280c8c00 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.268+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3928071310 con 0x7f39280c8c00 2023-10-09T11:41:09.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.269+0000 7f3924ff9700 1 -- 172.21.15.86:0/2633374724 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39200073e0 con 0x7f39280c8c00 2023-10-09T11:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.269+0000 7f3924ff9700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f390c066f60 0x7f390c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.269+0000 7f3924ff9700 1 -- 172.21.15.86:0/2633374724 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3920083530 con 0x7f39280c8c00 2023-10-09T11:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.270+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f390c066f60 0x7f390c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.270+0000 7f392cd9b700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f390c066f60 0x7f390c069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f391c002250 tx=0x7f391c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.273+0000 7f3924ff9700 1 -- 172.21.15.86:0/2633374724 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39200544e0 con 0x7f39280c8c00 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:09.462+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f392815b010 con 0x7f39280c8c00 2023-10-09T11:41:10.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.044+0000 7f3924ff9700 1 -- 172.21.15.86:0/2633374724 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3920019070 con 0x7f39280c8c00 2023-10-09T11:41:10.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.048+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f390c066f60 msgr2=0x7f390c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.048+0000 7f392efff700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f390c066f60 0x7f390c069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f391c002250 tx=0x7f391c016000 comp rx=0 tx=0).stop 2023-10-09T11:41:10.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.048+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39280c8c00 msgr2=0x7f39280c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.048+0000 7f392efff700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39280c8c00 0x7f39280c9070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39280c5570 tx=0x7f3920007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:10.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 shutdown_connections 2023-10-09T11:41:10.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f390c066f60 0x7f390c069410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39280c8c00 0x7f39280c9070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3918003a60 0x7f3928153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 --2- 172.21.15.86:0/2633374724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392815b680 0x7f392815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 >> 172.21.15.86:0/2633374724 conn(0x7f39280ce510 msgr2=0x7f392806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 shutdown_connections 2023-10-09T11:41:10.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.049+0000 7f392efff700 1 -- 172.21.15.86:0/2633374724 wait complete. 2023-10-09T11:41:10.051 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T11:41:10.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:41:10.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.255+0000 7f5d6ad9d700 1 Processor -- start 2023-10-09T11:41:10.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.255+0000 7f5d6ad9d700 1 -- start start 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.256+0000 7f5d6ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d640ccd00 0x7f5d64155860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.256+0000 7f5d6ad9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6406e510 con 0x7f5d640cc930 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.256+0000 7f5d6ad9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6406df20 con 0x7f5d64155da0 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.256+0000 7f5d6ad9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d640c7220 con 0x7f5d640ccd00 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.256+0000 7f5d69d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5d640cc930 0x7f5d640c7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58448/0 (socket says 172.21.15.86:58448) 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.256+0000 7f5d69d9b700 1 -- 172.21.15.86:0/1736816235 learned_addr learned my addr 172.21.15.86:0/1736816235 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.256+0000 7f5d6959a700 1 --2- 172.21.15.86:0/1736816235 >> v2:172.21.15.86:3300/0 conn(0x7f5d640ccd00 0x7f5d64155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d68d99700 1 -- 172.21.15.86:0/1736816235 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841069868 0 0) 0x7f5d6406e510 con 0x7f5d640cc930 2023-10-09T11:41:10.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d68d99700 1 -- 172.21.15.86:0/1736816235 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d50003570 con 0x7f5d640cc930 2023-10-09T11:41:10.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d6959a700 1 -- 172.21.15.86:0/1736816235 >> v1:172.21.15.135:6789/0 conn(0x7f5d64155da0 legacy=0x7f5d64156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d6959a700 1 -- 172.21.15.86:0/1736816235 >> v1:172.21.15.86:6789/0 conn(0x7f5d640cc930 legacy=0x7f5d640c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d6959a700 1 -- 172.21.15.86:0/1736816235 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640c7f50 con 0x7f5d640ccd00 2023-10-09T11:41:10.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d6959a700 1 --2- 172.21.15.86:0/1736816235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d640ccd00 0x7f5d64155860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d540098e0 tx=0x7f5d540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e78f0a6721b8702 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d68d99700 1 -- 172.21.15.86:0/1736816235 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400b640 con 0x7f5d640ccd00 2023-10-09T11:41:10.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d68d99700 1 -- 172.21.15.86:0/1736816235 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400b7a0 con 0x7f5d640ccd00 2023-10-09T11:41:10.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.257+0000 7f5d68d99700 1 -- 172.21.15.86:0/1736816235 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400bb40 con 0x7f5d640ccd00 2023-10-09T11:41:10.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.258+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/1736816235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d640ccd00 msgr2=0x7f5d64155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.258+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/1736816235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d640ccd00 0x7f5d64155860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d540098e0 tx=0x7f5d540091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.258+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/1736816235 shutdown_connections 2023-10-09T11:41:10.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.258+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/1736816235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d640ccd00 0x7f5d64155860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.258+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/1736816235 >> 172.21.15.86:0/1736816235 conn(0x7f5d64068e20 msgr2=0x7f5d640cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.258+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/1736816235 shutdown_connections 2023-10-09T11:41:10.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.258+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/1736816235 wait complete. 2023-10-09T11:41:10.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.259+0000 7f5d6ad9d700 1 Processor -- start 2023-10-09T11:41:10.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.259+0000 7f5d6ad9d700 1 -- start start 2023-10-09T11:41:10.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.260+0000 7f5d6ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d640cc930 0x7f5d64154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.260+0000 7f5d6ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d640ccd00 0x7f5d640b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.260+0000 7f5d6ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d64155da0 0x7f5d64153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.260+0000 7f5d6ad9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640af0f0 con 0x7f5d64155da0 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.260+0000 7f5d6ad9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640af3d0 con 0x7f5d640ccd00 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.260+0000 7f5d6ad9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6415e180 con 0x7f5d640cc930 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.260+0000 7f5d6a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d64155da0 0x7f5d64153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d64155da0 0x7f5d64153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55372/0 (socket says 172.21.15.86:55372) 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 -- 172.21.15.86:0/3235527106 learned_addr learned my addr 172.21.15.86:0/3235527106 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 -- 172.21.15.86:0/3235527106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d640cc930 msgr2=0x7f5d64154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d640cc930 0x7f5d64154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 -- 172.21.15.86:0/3235527106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d640ccd00 msgr2=0x7f5d640b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d640ccd00 0x7f5d640b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 -- 172.21.15.86:0/3235527106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54009420 con 0x7f5d64155da0 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6a59c700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d64155da0 0x7f5d64153c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c840 tx=0x7f5d5c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d59ffb700 1 -- 172.21.15.86:0/3235527106 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c012630 con 0x7f5d64155da0 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d59ffb700 1 -- 172.21.15.86:0/3235527106 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c0127b0 con 0x7f5d64155da0 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d59ffb700 1 -- 172.21.15.86:0/3235527106 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c012b70 con 0x7f5d64155da0 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.261+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6415e460 con 0x7f5d64155da0 2023-10-09T11:41:10.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.262+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d640c9c10 con 0x7f5d64155da0 2023-10-09T11:41:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.263+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6404c3c0 con 0x7f5d64155da0 2023-10-09T11:41:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.264+0000 7f5d59ffb700 1 -- 172.21.15.86:0/3235527106 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d5c003030 con 0x7f5d64155da0 2023-10-09T11:41:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.265+0000 7f5d59ffb700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d48066f30 0x7f5d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.265+0000 7f5d59ffb700 1 -- 172.21.15.86:0/3235527106 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f5d5c0842c0 con 0x7f5d64155da0 2023-10-09T11:41:10.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.265+0000 7f5d69d9b700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d48066f30 0x7f5d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.265+0000 7f5d69d9b700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d48066f30 0x7f5d480693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d600058d0 tx=0x7f5d600079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.269+0000 7f5d59ffb700 1 -- 172.21.15.86:0/3235527106 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d5c051710 con 0x7f5d64155da0 2023-10-09T11:41:10.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:10.459+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5d640af540 con 0x7f5d64155da0 2023-10-09T11:41:11.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.047+0000 7f5d59ffb700 1 -- 172.21.15.86:0/3235527106 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5d5c054d30 con 0x7f5d64155da0 2023-10-09T11:41:11.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.065+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d48066f30 msgr2=0x7f5d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.065+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d48066f30 0x7f5d480693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d600058d0 tx=0x7f5d600079d0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.065+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d64155da0 msgr2=0x7f5d64153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.065+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d64155da0 0x7f5d64153c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c840 tx=0x7f5d5c001670 comp rx=0 tx=0).stop 2023-10-09T11:41:11.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.067+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 shutdown_connections 2023-10-09T11:41:11.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.067+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d48066f30 0x7f5d480693e0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d600058d0 tx=0x7f5d600079d0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.067+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d64155da0 0x7f5d64153c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.067+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d640cc930 0x7f5d64154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.067+0000 7f5d6ad9d700 1 --2- 172.21.15.86:0/3235527106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d640ccd00 0x7f5d640b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.067+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 >> 172.21.15.86:0/3235527106 conn(0x7f5d64068e20 msgr2=0x7f5d640c2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:11.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.069+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 shutdown_connections 2023-10-09T11:41:11.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.069+0000 7f5d6ad9d700 1 -- 172.21.15.86:0/3235527106 wait complete. 2023-10-09T11:41:11.071 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T11:41:11.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.274+0000 7f5f533ff700 1 Processor -- start 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.274+0000 7f5f533ff700 1 -- start start 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.275+0000 7f5f533ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5f4c069e80 0x7f5f4c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.275+0000 7f5f533ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c06e950 con 0x7f5f4c0c70b0 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.275+0000 7f5f533ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c06eb90 con 0x7f5f4c155eb0 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.275+0000 7f5f533ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c06ee70 con 0x7f5f4c069e80 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.275+0000 7f5f5099a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5f4c0c70b0 0x7f5f4c069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58460/0 (socket says 172.21.15.86:58460) 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.275+0000 7f5f5099a700 1 -- 172.21.15.86:0/196454721 learned_addr learned my addr 172.21.15.86:0/196454721 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f5199c700 1 --2- 172.21.15.86:0/196454721 >> v2:172.21.15.86:3300/0 conn(0x7f5f4c069e80 0x7f5f4c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f43fff700 1 -- 172.21.15.86:0/196454721 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770540786 0 0) 0x7f5f3c001110 con 0x7f5f4c0c70b0 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f43fff700 1 -- 172.21.15.86:0/196454721 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f38004680 con 0x7f5f4c0c70b0 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f5199c700 1 -- 172.21.15.86:0/196454721 >> v1:172.21.15.135:6789/0 conn(0x7f5f4c155eb0 legacy=0x7f5f4c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f5199c700 1 -- 172.21.15.86:0/196454721 >> v1:172.21.15.86:6789/0 conn(0x7f5f4c0c70b0 legacy=0x7f5f4c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f5199c700 1 -- 172.21.15.86:0/196454721 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c06f150 con 0x7f5f4c069e80 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f5199c700 1 --2- 172.21.15.86:0/196454721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c160bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e60 tx=0x7f5f44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd730425de6ad0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f43fff700 1 -- 172.21.15.86:0/196454721 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400e070 con 0x7f5f4c069e80 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f43fff700 1 -- 172.21.15.86:0/196454721 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400bb20 con 0x7f5f4c069e80 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.276+0000 7f5f43fff700 1 -- 172.21.15.86:0/196454721 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44012430 con 0x7f5f4c069e80 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.277+0000 7f5f533ff700 1 -- 172.21.15.86:0/196454721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 msgr2=0x7f5f4c160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.277+0000 7f5f533ff700 1 --2- 172.21.15.86:0/196454721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c160bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e60 tx=0x7f5f44009780 comp rx=0 tx=0).stop 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.277+0000 7f5f533ff700 1 -- 172.21.15.86:0/196454721 shutdown_connections 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.277+0000 7f5f533ff700 1 --2- 172.21.15.86:0/196454721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c160bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.277+0000 7f5f533ff700 1 -- 172.21.15.86:0/196454721 >> 172.21.15.86:0/196454721 conn(0x7f5f4c068e10 msgr2=0x7f5f4c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.277+0000 7f5f533ff700 1 -- 172.21.15.86:0/196454721 shutdown_connections 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.277+0000 7f5f533ff700 1 -- 172.21.15.86:0/196454721 wait complete. 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.278+0000 7f5f533ff700 1 Processor -- start 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.279+0000 7f5f533ff700 1 -- start start 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.279+0000 7f5f533ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.279+0000 7f5f533ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f4c0c70b0 0x7f5f4c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.279+0000 7f5f533ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f4c155eb0 0x7f5f4c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.279+0000 7f5f533ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c1531b0 con 0x7f5f4c069e80 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f533ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0aedb0 con 0x7f5f4c0c70b0 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f533ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0af920 con 0x7f5f4c155eb0 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c0af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55380/0 (socket says 172.21.15.86:55380) 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 -- 172.21.15.86:0/2677331692 learned_addr learned my addr 172.21.15.86:0/2677331692 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5099a700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f4c0c70b0 0x7f5f4c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5199c700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f4c155eb0 0x7f5f4c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 -- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f4c155eb0 msgr2=0x7f5f4c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f4c155eb0 0x7f5f4c0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 -- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f4c0c70b0 msgr2=0x7f5f4c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f4c0c70b0 0x7f5f4c152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 -- 172.21.15.86:0/2677331692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009a20 con 0x7f5f4c069e80 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5099a700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f4c0c70b0 0x7f5f4c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5199c700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f4c155eb0 0x7f5f4c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.280+0000 7f5f5119b700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c0af2d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b5e0 tx=0x7f5f48009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.281+0000 7f5f417fa700 1 -- 172.21.15.86:0/2677331692 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800f510 con 0x7f5f4c069e80 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.281+0000 7f5f417fa700 1 -- 172.21.15.86:0/2677331692 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800f670 con 0x7f5f4c069e80 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.281+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c0afc00 con 0x7f5f4c069e80 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.281+0000 7f5f417fa700 1 -- 172.21.15.86:0/2677331692 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800fa30 con 0x7f5f4c069e80 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.281+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c0b01c0 con 0x7f5f4c069e80 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.282+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c04c3c0 con 0x7f5f4c069e80 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.283+0000 7f5f417fa700 1 -- 172.21.15.86:0/2677331692 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f4801a400 con 0x7f5f4c069e80 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.284+0000 7f5f417fa700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5f30066f30 0x7f5f300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.284+0000 7f5f417fa700 1 -- 172.21.15.86:0/2677331692 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f5f48084040 con 0x7f5f4c069e80 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.284+0000 7f5f5099a700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5f30066f30 0x7f5f300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.285+0000 7f5f5099a700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5f30066f30 0x7f5f300693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0058d0 tx=0x7f5f3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.289+0000 7f5f417fa700 1 -- 172.21.15.86:0/2677331692 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f48051390 con 0x7f5f4c069e80 2023-10-09T11:41:11.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:11.522+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5f4c06f430 con 0x7f5f4c069e80 2023-10-09T11:41:12.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.074+0000 7f5f417fa700 1 -- 172.21.15.86:0/2677331692 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5f480549b0 con 0x7f5f4c069e80 2023-10-09T11:41:12.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5f30066f30 msgr2=0x7f5f300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5f30066f30 0x7f5f300693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0058d0 tx=0x7f5f3c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:12.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 msgr2=0x7f5f4c0af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c0af2d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b5e0 tx=0x7f5f48009120 comp rx=0 tx=0).stop 2023-10-09T11:41:12.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 shutdown_connections 2023-10-09T11:41:12.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5f30066f30 0x7f5f300693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f4c069e80 0x7f5f4c0af2d0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b5e0 tx=0x7f5f48009120 comp rx=0 tx=0).stop 2023-10-09T11:41:12.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f4c155eb0 0x7f5f4c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 --2- 172.21.15.86:0/2677331692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f4c0c70b0 0x7f5f4c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.081+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 >> 172.21.15.86:0/2677331692 conn(0x7f5f4c068e10 msgr2=0x7f5f4c154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:12.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.082+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 shutdown_connections 2023-10-09T11:41:12.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.082+0000 7f5f533ff700 1 -- 172.21.15.86:0/2677331692 wait complete. 2023-10-09T11:41:12.085 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 2 and data pool 3 2023-10-09T11:41:12.104 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:12.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.284+0000 7fae693ff700 1 Processor -- start 2023-10-09T11:41:12.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.284+0000 7fae693ff700 1 -- start start 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.285+0000 7fae693ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae64159840 0x7fae640cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.285+0000 7fae693ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae640cfb30 con 0x7fae640cba70 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.285+0000 7fae693ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae640cbf10 con 0x7fae64069bb0 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.285+0000 7fae693ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640cf4e0 con 0x7fae64159840 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae627fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fae640cba70 0x7fae640694a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58476/0 (socket says 172.21.15.86:58476) 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae627fc700 1 -- 172.21.15.86:0/3027457150 learned_addr learned my addr 172.21.15.86:0/3027457150 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae62ffd700 1 --2- 172.21.15.86:0/3027457150 >> v2:172.21.15.135:3300/0 conn(0x7fae64159840 0x7fae640cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae61ffb700 1 -- 172.21.15.86:0/3027457150 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301424875 0 0) 0x7fae640cfb30 con 0x7fae640cba70 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae61ffb700 1 -- 172.21.15.86:0/3027457150 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae4c003570 con 0x7fae640cba70 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae61ffb700 1 -- 172.21.15.86:0/3027457150 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085330972 0 0) 0x7fae4c003570 con 0x7fae640cba70 2023-10-09T11:41:12.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae62ffd700 1 -- 172.21.15.86:0/3027457150 >> v1:172.21.15.135:6789/0 conn(0x7fae64069bb0 legacy=0x7fae640b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae62ffd700 1 -- 172.21.15.86:0/3027457150 >> v1:172.21.15.86:6789/0 conn(0x7fae640cba70 legacy=0x7fae640694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.286+0000 7fae62ffd700 1 -- 172.21.15.86:0/3027457150 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae640cf7c0 con 0x7fae64159840 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae62ffd700 1 --2- 172.21.15.86:0/3027457150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64159840 0x7fae640cb530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae54009910 tx=0x7fae540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97229afa65a05f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae61ffb700 1 -- 172.21.15.86:0/3027457150 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58001470 con 0x7fae64159840 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae61ffb700 1 -- 172.21.15.86:0/3027457150 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae54011420 con 0x7fae64159840 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae61ffb700 1 -- 172.21.15.86:0/3027457150 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540117a0 con 0x7fae64159840 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae693ff700 1 -- 172.21.15.86:0/3027457150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64159840 msgr2=0x7fae640cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae693ff700 1 --2- 172.21.15.86:0/3027457150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64159840 0x7fae640cb530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae54009910 tx=0x7fae540091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae693ff700 1 -- 172.21.15.86:0/3027457150 shutdown_connections 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae693ff700 1 --2- 172.21.15.86:0/3027457150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64159840 0x7fae640cb530 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae693ff700 1 -- 172.21.15.86:0/3027457150 >> 172.21.15.86:0/3027457150 conn(0x7fae64068e10 msgr2=0x7fae640d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:12.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.287+0000 7fae693ff700 1 -- 172.21.15.86:0/3027457150 shutdown_connections 2023-10-09T11:41:12.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.288+0000 7fae693ff700 1 -- 172.21.15.86:0/3027457150 wait complete. 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.289+0000 7fae693ff700 1 Processor -- start 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.289+0000 7fae693ff700 1 -- start start 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae693ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64069bb0 0x7fae641441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae693ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae640cba70 0x7fae6415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae693ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae64159840 0x7fae6415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae693ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64154b20 con 0x7fae64159840 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae693ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6416dc50 con 0x7fae64069bb0 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae693ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae64144700 con 0x7fae640cba70 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae637fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae64159840 0x7fae6415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae62ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64069bb0 0x7fae641441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae637fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae64159840 0x7fae6415e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55392/0 (socket says 172.21.15.86:55392) 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae637fe700 1 -- 172.21.15.86:0/504628059 learned_addr learned my addr 172.21.15.86:0/504628059 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.290+0000 7fae627fc700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae640cba70 0x7fae6415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae637fe700 1 -- 172.21.15.86:0/504628059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae640cba70 msgr2=0x7fae6415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae637fe700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae640cba70 0x7fae6415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae637fe700 1 -- 172.21.15.86:0/504628059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64069bb0 msgr2=0x7fae641441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae637fe700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64069bb0 0x7fae641441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae637fe700 1 -- 172.21.15.86:0/504628059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54009420 con 0x7fae64159840 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae637fe700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae64159840 0x7fae6415e780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c910 tx=0x7fae5c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae4affd700 1 -- 172.21.15.86:0/504628059 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c012630 con 0x7fae64159840 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae4affd700 1 -- 172.21.15.86:0/504628059 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c012790 con 0x7fae64159840 2023-10-09T11:41:12.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae4affd700 1 -- 172.21.15.86:0/504628059 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c012b50 con 0x7fae64159840 2023-10-09T11:41:12.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6416d360 con 0x7fae64159840 2023-10-09T11:41:12.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.291+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6416d8e0 con 0x7fae64159840 2023-10-09T11:41:12.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.292+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae64064550 con 0x7fae64159840 2023-10-09T11:41:12.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.293+0000 7fae4affd700 1 -- 172.21.15.86:0/504628059 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae5c01b450 con 0x7fae64159840 2023-10-09T11:41:12.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.294+0000 7fae4affd700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fae50066f30 0x7fae500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.294+0000 7fae4affd700 1 -- 172.21.15.86:0/504628059 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae5c084720 con 0x7fae64159840 2023-10-09T11:41:12.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.295+0000 7fae62ffd700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fae50066f30 0x7fae500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.295+0000 7fae62ffd700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fae50066f30 0x7fae500693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae540093f0 tx=0x7fae54016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.298+0000 7fae4affd700 1 -- 172.21.15.86:0/504628059 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae5c0518f0 con 0x7fae64159840 2023-10-09T11:41:12.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.491+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae6416ddc0 con 0x7fae64159840 2023-10-09T11:41:12.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.492+0000 7fae4affd700 1 -- 172.21.15.86:0/504628059 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fae5c054f10 con 0x7fae64159840 2023-10-09T11:41:12.494 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:12.494 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":21,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:11.523115+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fae50066f30 msgr2=0x7fae500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fae50066f30 0x7fae500693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae540093f0 tx=0x7fae54016000 comp rx=0 tx=0).stop 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae64159840 msgr2=0x7fae6415e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae64159840 0x7fae6415e780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c910 tx=0x7fae5c0016f0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 shutdown_connections 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fae50066f30 0x7fae500693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae64159840 0x7fae6415e780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae64069bb0 0x7fae641441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 --2- 172.21.15.86:0/504628059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae640cba70 0x7fae6415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 >> 172.21.15.86:0/504628059 conn(0x7fae64068e10 msgr2=0x7fae641587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:12.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 shutdown_connections 2023-10-09T11:41:12.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.495+0000 7fae693ff700 1 -- 172.21.15.86:0/504628059 wait complete. 2023-10-09T11:41:12.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:12.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.692+0000 7f99b71ff700 1 Processor -- start 2023-10-09T11:41:12.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.692+0000 7f99b71ff700 1 -- start start 2023-10-09T11:41:12.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.693+0000 7f99b71ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f99b00cbf30 0x7f99b00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99b71ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f99b00ccf90 0x7f99b00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99b71ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b00cc300 con 0x7f99b015a270 2023-10-09T11:41:12.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99b71ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b0156bf0 con 0x7f99b00ccf90 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99b71ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b00ae950 con 0x7f99b00cbf30 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99affff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f99b00ccf90 0x7f99b00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99b579c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f99b015a270 0x7f99b00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58482/0 (socket says 172.21.15.86:58482) 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99affff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f99b00ccf90 0x7f99b00b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55406/0 (socket says 172.21.15.86:55406) 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99b579c700 1 -- 172.21.15.86:0/2624916888 learned_addr learned my addr 172.21.15.86:0/2624916888 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99b4f9b700 1 --2- 172.21.15.86:0/2624916888 >> v2:172.21.15.135:3300/0 conn(0x7f99b00cbf30 0x7f99b00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99af7fe700 1 -- 172.21.15.86:0/2624916888 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094907519 0 0) 0x7f99b00cc300 con 0x7f99b015a270 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99af7fe700 1 -- 172.21.15.86:0/2624916888 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a0003570 con 0x7f99b015a270 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99affff700 1 -- 172.21.15.86:0/2624916888 >> v2:172.21.15.135:3300/0 conn(0x7f99b00cbf30 msgr2=0x7f99b00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99affff700 1 --2- 172.21.15.86:0/2624916888 >> v2:172.21.15.135:3300/0 conn(0x7f99b00cbf30 0x7f99b00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99affff700 1 -- 172.21.15.86:0/2624916888 >> v1:172.21.15.86:6789/0 conn(0x7f99b015a270 legacy=0x7f99b00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.694+0000 7f99affff700 1 -- 172.21.15.86:0/2624916888 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00ad370 con 0x7f99b00ccf90 2023-10-09T11:41:12.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99affff700 1 --2- 172.21.15.86:0/2624916888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b00ccf90 0x7f99b00b0d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99b0063d40 tx=0x7f999c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0d292037da97db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99af7fe700 1 -- 172.21.15.86:0/2624916888 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c011630 con 0x7f99b00ccf90 2023-10-09T11:41:12.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99af7fe700 1 -- 172.21.15.86:0/2624916888 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c011790 con 0x7f99b00ccf90 2023-10-09T11:41:12.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99af7fe700 1 -- 172.21.15.86:0/2624916888 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c011b30 con 0x7f99b00ccf90 2023-10-09T11:41:12.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99b71ff700 1 -- 172.21.15.86:0/2624916888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b00ccf90 msgr2=0x7f99b00b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99b71ff700 1 --2- 172.21.15.86:0/2624916888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b00ccf90 0x7f99b00b0d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99b0063d40 tx=0x7f999c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99b71ff700 1 -- 172.21.15.86:0/2624916888 shutdown_connections 2023-10-09T11:41:12.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99b71ff700 1 --2- 172.21.15.86:0/2624916888 >> v2:172.21.15.135:3300/0 conn(0x7f99b00cbf30 0x7f99b00ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99b71ff700 1 --2- 172.21.15.86:0/2624916888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b00ccf90 0x7f99b00b0d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99b71ff700 1 -- 172.21.15.86:0/2624916888 >> 172.21.15.86:0/2624916888 conn(0x7f99b006a320 msgr2=0x7f99b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:12.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.695+0000 7f99b71ff700 1 -- 172.21.15.86:0/2624916888 shutdown_connections 2023-10-09T11:41:12.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.696+0000 7f99b71ff700 1 -- 172.21.15.86:0/2624916888 wait complete. 2023-10-09T11:41:12.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.697+0000 7f99b71ff700 1 Processor -- start 2023-10-09T11:41:12.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.697+0000 7f99b71ff700 1 -- start start 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b71ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99b00cbf30 0x7f99b0154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b71ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00ccf90 0x7f99b016b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b71ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b015a270 0x7f99b016bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b71ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0151d90 con 0x7f99b015a270 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b71ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00caca0 con 0x7f99b00ccf90 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b71ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00caf80 con 0x7f99b00cbf30 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b579c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b015a270 0x7f99b016bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b579c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b015a270 0x7f99b016bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55420/0 (socket says 172.21.15.86:55420) 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.698+0000 7f99b579c700 1 -- 172.21.15.86:0/674201295 learned_addr learned my addr 172.21.15.86:0/674201295 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:12.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99affff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00ccf90 0x7f99b016b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b4f9b700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99b00cbf30 0x7f99b0154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b579c700 1 -- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99b00cbf30 msgr2=0x7f99b0154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b579c700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99b00cbf30 0x7f99b0154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b579c700 1 -- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00ccf90 msgr2=0x7f99b016b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b579c700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00ccf90 0x7f99b016b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b579c700 1 -- 172.21.15.86:0/674201295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009420 con 0x7f99b015a270 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99affff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00ccf90 0x7f99b016b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b4f9b700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99b00cbf30 0x7f99b0154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b579c700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b015a270 0x7f99b016bc20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99a8001460 tx=0x7f99a8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99acff9700 1 -- 172.21.15.86:0/674201295 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800ce80 con 0x7f99b015a270 2023-10-09T11:41:12.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99acff9700 1 -- 172.21.15.86:0/674201295 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800ab70 con 0x7f99b015a270 2023-10-09T11:41:12.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b0151740 con 0x7f99b015a270 2023-10-09T11:41:12.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99acff9700 1 -- 172.21.15.86:0/674201295 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80070f0 con 0x7f99b015a270 2023-10-09T11:41:12.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.699+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b0154f70 con 0x7f99b015a270 2023-10-09T11:41:12.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.700+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b0151f00 con 0x7f99b015a270 2023-10-09T11:41:12.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.701+0000 7f99acff9700 1 -- 172.21.15.86:0/674201295 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99a8007520 con 0x7f99b015a270 2023-10-09T11:41:12.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.702+0000 7f99acff9700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:12.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.702+0000 7f99acff9700 1 -- 172.21.15.86:0/674201295 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99a8084ab0 con 0x7f99b015a270 2023-10-09T11:41:12.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.702+0000 7f99b4f9b700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:12.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.703+0000 7f99b4f9b700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006f00 tx=0x7f99a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:12.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.706+0000 7f99acff9700 1 -- 172.21.15.86:0/674201295 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99a8051d10 con 0x7f99b015a270 2023-10-09T11:41:12.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.896+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b004c3c0 con 0x7f99b015a270 2023-10-09T11:41:12.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.897+0000 7f99acff9700 1 -- 172.21.15.86:0/674201295 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f99a8055330 con 0x7f99b015a270 2023-10-09T11:41:12.898 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:12.898 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":21,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:11.523115+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:12.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.899+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9994066f30 msgr2=0x7f99940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.899+0000 7f99b71ff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006f00 tx=0x7f99a4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.899+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b015a270 msgr2=0x7f99b016bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.899+0000 7f99b71ff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b015a270 0x7f99b016bc20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99a8001460 tx=0x7f99a8001ae0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 shutdown_connections 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b015a270 0x7f99b016bc20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99b00cbf30 0x7f99b0154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 --2- 172.21.15.86:0/674201295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00ccf90 0x7f99b016b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 >> 172.21.15.86:0/674201295 conn(0x7f99b006a320 msgr2=0x7f99b0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 shutdown_connections 2023-10-09T11:41:12.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:12.900+0000 7f99b71ff700 1 -- 172.21.15.86:0/674201295 wait complete. 2023-10-09T11:41:12.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:41:13.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.104+0000 7f9ccf59e700 1 Processor -- start 2023-10-09T11:41:13.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.104+0000 7f9ccf59e700 1 -- start start 2023-10-09T11:41:13.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.105+0000 7f9ccf59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9cd0153900 0x7f9cd00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:13.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccf59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cd00c9db0 0x7f9cd006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:13.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccf59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd006e150 con 0x7f9cd0157130 2023-10-09T11:41:13.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccf59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd00c7800 con 0x7f9cd00c9db0 2023-10-09T11:41:13.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccf59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd00c7ae0 con 0x7f9cd0153900 2023-10-09T11:41:13.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccdd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cd00c9db0 0x7f9cd006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:13.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccdd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cd00c9db0 0x7f9cd006a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55424/0 (socket says 172.21.15.86:55424) 2023-10-09T11:41:13.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/3603878541 learned_addr learned my addr 172.21.15.86:0/3603878541 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:13.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9cce59c700 1 --2- 172.21.15.86:0/3603878541 >> v2:172.21.15.135:3300/0 conn(0x7f9cd0153900 0x7f9cd00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:13.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/3603878541 >> v2:172.21.15.135:3300/0 conn(0x7f9cd0153900 msgr2=0x7f9cd00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:13.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccdd9b700 1 --2- 172.21.15.86:0/3603878541 >> v2:172.21.15.135:3300/0 conn(0x7f9cd0153900 0x7f9cd00c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:13.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/3603878541 >> v1:172.21.15.135:6789/0 conn(0x7f9cd0157130 legacy=0x7f9cd0159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:13.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.106+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/3603878541 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00c7dc0 con 0x7f9cd00c9db0 2023-10-09T11:41:13.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccdd9b700 1 --2- 172.21.15.86:0/3603878541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00c9db0 0x7f9cd006a000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006aed0 tx=0x7f9cc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9cbc3e17a5374e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:13.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccd59a700 1 -- 172.21.15.86:0/3603878541 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4009e70 con 0x7f9cd00c9db0 2023-10-09T11:41:13.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccd59a700 1 -- 172.21.15.86:0/3603878541 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc400b860 con 0x7f9cd00c9db0 2023-10-09T11:41:13.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccd59a700 1 -- 172.21.15.86:0/3603878541 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400bc00 con 0x7f9cd00c9db0 2023-10-09T11:41:13.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccf59e700 1 -- 172.21.15.86:0/3603878541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00c9db0 msgr2=0x7f9cd006a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:13.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/3603878541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00c9db0 0x7f9cd006a000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006aed0 tx=0x7f9cc4009250 comp rx=0 tx=0).stop 2023-10-09T11:41:13.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccf59e700 1 -- 172.21.15.86:0/3603878541 shutdown_connections 2023-10-09T11:41:13.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/3603878541 >> v2:172.21.15.135:3300/0 conn(0x7f9cd0153900 0x7f9cd00c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:13.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/3603878541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00c9db0 0x7f9cd006a000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:13.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.107+0000 7f9ccf59e700 1 -- 172.21.15.86:0/3603878541 >> 172.21.15.86:0/3603878541 conn(0x7f9cd00cc1e0 msgr2=0x7f9cd00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:13.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.108+0000 7f9ccf59e700 1 -- 172.21.15.86:0/3603878541 shutdown_connections 2023-10-09T11:41:13.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.108+0000 7f9ccf59e700 1 -- 172.21.15.86:0/3603878541 wait complete. 2023-10-09T11:41:13.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.109+0000 7f9ccf59e700 1 Processor -- start 2023-10-09T11:41:13.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.109+0000 7f9ccf59e700 1 -- start start 2023-10-09T11:41:13.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccf59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cd00c9db0 0x7f9cd00af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:13.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd0153900 0x7f9cd0151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:13.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccf59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd0157130 0x7f9cd0158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:13.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccf59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0152b70 con 0x7f9cd0153900 2023-10-09T11:41:13.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccf59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd016da40 con 0x7f9cd0157130 2023-10-09T11:41:13.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccf59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd016dd20 con 0x7f9cd00c9db0 2023-10-09T11:41:13.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccdd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd0153900 0x7f9cd0151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:13.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccdd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd0153900 0x7f9cd0151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55426/0 (socket says 172.21.15.86:55426) 2023-10-09T11:41:13.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/1792792389 learned_addr learned my addr 172.21.15.86:0/1792792389 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:13.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9cce59c700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cd00c9db0 0x7f9cd00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:13.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.110+0000 7f9cced9d700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd0157130 0x7f9cd0158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:13.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cd00c9db0 msgr2=0x7f9cd00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:13.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccdd9b700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cd00c9db0 0x7f9cd00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:13.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd0157130 msgr2=0x7f9cd0158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:13.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccdd9b700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd0157130 0x7f9cd0158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:13.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccdd9b700 1 -- 172.21.15.86:0/1792792389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40094f0 con 0x7f9cd0153900 2023-10-09T11:41:13.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9cced9d700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd0157130 0x7f9cd0158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:13.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccdd9b700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd0153900 0x7f9cd0151d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006ce80 tx=0x7f9cc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:13.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9cbe7fc700 1 -- 172.21.15.86:0/1792792389 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400b9d0 con 0x7f9cd0153900 2023-10-09T11:41:13.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9cbe7fc700 1 -- 172.21.15.86:0/1792792389 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc400bb30 con 0x7f9cd0153900 2023-10-09T11:41:13.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9cbe7fc700 1 -- 172.21.15.86:0/1792792389 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4025670 con 0x7f9cd0153900 2023-10-09T11:41:13.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd016e000 con 0x7f9cd0153900 2023-10-09T11:41:13.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.111+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd016e5c0 con 0x7f9cd0153900 2023-10-09T11:41:13.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.112+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd00aba80 con 0x7f9cd0153900 2023-10-09T11:41:13.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.113+0000 7f9cbe7fc700 1 -- 172.21.15.86:0/1792792389 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cc4023070 con 0x7f9cd0153900 2023-10-09T11:41:13.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.114+0000 7f9cbe7fc700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9cb0066f30 0x7f9cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:13.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.114+0000 7f9cbe7fc700 1 -- 172.21.15.86:0/1792792389 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9cc40859d0 con 0x7f9cd0153900 2023-10-09T11:41:13.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.114+0000 7f9cce59c700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9cb0066f30 0x7f9cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:13.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.115+0000 7f9cce59c700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9cb0066f30 0x7f9cb00693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009d10 tx=0x7f9cc00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:13.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.118+0000 7f9cbe7fc700 1 -- 172.21.15.86:0/1792792389 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cc4052ba0 con 0x7f9cd0153900 2023-10-09T11:41:13.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:13.350+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9cd006dd20 con 0x7f9cd0153900 2023-10-09T11:41:14.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.087+0000 7f9cbe7fc700 1 -- 172.21.15.86:0/1792792389 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9cc40561c0 con 0x7f9cd0153900 2023-10-09T11:41:14.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9cb0066f30 msgr2=0x7f9cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9cb0066f30 0x7f9cb00693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009d10 tx=0x7f9cc00091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd0153900 msgr2=0x7f9cd0151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd0153900 0x7f9cd0151d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006ce80 tx=0x7f9cc4017000 comp rx=0 tx=0).stop 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 shutdown_connections 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9cb0066f30 0x7f9cb00693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd0157130 0x7f9cd0158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cd00c9db0 0x7f9cd00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 --2- 172.21.15.86:0/1792792389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd0153900 0x7f9cd0151d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 >> 172.21.15.86:0/1792792389 conn(0x7f9cd00cc1e0 msgr2=0x7f9cd00c1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:14.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 shutdown_connections 2023-10-09T11:41:14.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.090+0000 7f9ccf59e700 1 -- 172.21.15.86:0/1792792389 wait complete. 2023-10-09T11:41:14.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:41:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.294+0000 7ff0d5fff700 1 Processor -- start 2023-10-09T11:41:14.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.294+0000 7ff0d5fff700 1 -- start start 2023-10-09T11:41:14.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.295+0000 7ff0d5fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0d015ac80 0x7ff0d0069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.295+0000 7ff0d5fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d0069cb0 0x7ff0d00c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.295+0000 7ff0d5fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00af2f0 con 0x7ff0d015b050 2023-10-09T11:41:14.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.295+0000 7ff0d5fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d006a130 con 0x7ff0d015ac80 2023-10-09T11:41:14.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.295+0000 7ff0d5fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00af5d0 con 0x7ff0d0069cb0 2023-10-09T11:41:14.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.295+0000 7ff0cf7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0d015ac80 0x7ff0d0069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.296+0000 7ff0cf7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0d015ac80 0x7ff0d0069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:39776/0 (socket says 172.21.15.86:39776) 2023-10-09T11:41:14.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.296+0000 7ff0cf7fe700 1 -- 172.21.15.86:0/466512694 learned_addr learned my addr 172.21.15.86:0/466512694 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:14.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.296+0000 7ff0cffff700 1 --2- 172.21.15.86:0/466512694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d0069cb0 0x7ff0d00c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.297+0000 7ff0cffff700 1 -- 172.21.15.86:0/466512694 >> v2:172.21.15.135:3300/0 conn(0x7ff0d015ac80 msgr2=0x7ff0d0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:14.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.297+0000 7ff0cffff700 1 --2- 172.21.15.86:0/466512694 >> v2:172.21.15.135:3300/0 conn(0x7ff0d015ac80 0x7ff0d0069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.297+0000 7ff0cffff700 1 -- 172.21.15.86:0/466512694 >> v1:172.21.15.135:6789/0 conn(0x7ff0d015b050 legacy=0x7ff0d00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:14.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.297+0000 7ff0cffff700 1 -- 172.21.15.86:0/466512694 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00c8660 con 0x7ff0d0069cb0 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.297+0000 7ff0cffff700 1 --2- 172.21.15.86:0/466512694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d0069cb0 0x7ff0d00c7b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009e60 tx=0x7ff0c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55d5bdd13015bb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.297+0000 7ff0ce7fc700 1 -- 172.21.15.86:0/466512694 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800e070 con 0x7ff0d0069cb0 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0ce7fc700 1 -- 172.21.15.86:0/466512694 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800bb60 con 0x7ff0d0069cb0 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0ce7fc700 1 -- 172.21.15.86:0/466512694 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8012430 con 0x7ff0d0069cb0 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 -- 172.21.15.86:0/466512694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d0069cb0 msgr2=0x7ff0d00c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/466512694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d0069cb0 0x7ff0d00c7b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009e60 tx=0x7ff0c8009780 comp rx=0 tx=0).stop 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 -- 172.21.15.86:0/466512694 shutdown_connections 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/466512694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d0069cb0 0x7ff0d00c7b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/466512694 >> v2:172.21.15.135:3300/0 conn(0x7ff0d015ac80 0x7ff0d0069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 -- 172.21.15.86:0/466512694 >> 172.21.15.86:0/466512694 conn(0x7ff0d0068e10 msgr2=0x7ff0d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:14.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 -- 172.21.15.86:0/466512694 shutdown_connections 2023-10-09T11:41:14.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.298+0000 7ff0d5fff700 1 -- 172.21.15.86:0/466512694 wait complete. 2023-10-09T11:41:14.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.300+0000 7ff0d5fff700 1 Processor -- start 2023-10-09T11:41:14.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.300+0000 7ff0d5fff700 1 -- start start 2023-10-09T11:41:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0d5fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d0069cb0 0x7ff0d00ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0d5fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d015ac80 0x7ff0d00c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0d5fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d015b050 0x7ff0d0156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0d5fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00ae1c0 con 0x7ff0d015ac80 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0d5fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00ad6a0 con 0x7ff0d0069cb0 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0d5fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00ad920 con 0x7ff0d015b050 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d015ac80 0x7ff0d00c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d015ac80 0x7ff0d00c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55432/0 (socket says 172.21.15.86:55432) 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 -- 172.21.15.86:0/4036127738 learned_addr learned my addr 172.21.15.86:0/4036127738 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0cffff700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d015b050 0x7ff0d0156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0cf7fe700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d0069cb0 0x7ff0d00ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 -- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d015b050 msgr2=0x7ff0d0156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d015b050 0x7ff0d0156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 -- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d0069cb0 msgr2=0x7ff0d00ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d0069cb0 0x7ff0d00ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 -- 172.21.15.86:0/4036127738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009a20 con 0x7ff0d015ac80 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.301+0000 7ff0ceffd700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d015ac80 0x7ff0d00c59b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c510 tx=0x7ff0c400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.302+0000 7ff0b77fe700 1 -- 172.21.15.86:0/4036127738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4011590 con 0x7ff0d015ac80 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.302+0000 7ff0b77fe700 1 -- 172.21.15.86:0/4036127738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4011710 con 0x7ff0d015ac80 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.302+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d00adc00 con 0x7ff0d015ac80 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.302+0000 7ff0b77fe700 1 -- 172.21.15.86:0/4036127738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4011ad0 con 0x7ff0d015ac80 2023-10-09T11:41:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.302+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d01659f0 con 0x7ff0d015ac80 2023-10-09T11:41:14.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.303+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d0165850 con 0x7ff0d015ac80 2023-10-09T11:41:14.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.304+0000 7ff0b77fe700 1 -- 172.21.15.86:0/4036127738 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0c401b3b0 con 0x7ff0d015ac80 2023-10-09T11:41:14.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.305+0000 7ff0b77fe700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff0bc066f30 0x7ff0bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:14.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.305+0000 7ff0b77fe700 1 -- 172.21.15.86:0/4036127738 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0c4083960 con 0x7ff0d015ac80 2023-10-09T11:41:14.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.305+0000 7ff0cf7fe700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff0bc066f30 0x7ff0bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:14.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.305+0000 7ff0cf7fe700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff0bc066f30 0x7ff0bc0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0006d40 tx=0x7ff0c0011040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.309+0000 7ff0b77fe700 1 -- 172.21.15.86:0/4036127738 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0d0165850 con 0x7ff0d015ac80 2023-10-09T11:41:14.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:14.546+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff0d0165850 con 0x7ff0d015ac80 2023-10-09T11:41:15.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.088+0000 7ff0b77fe700 1 -- 172.21.15.86:0/4036127738 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0d0165850 con 0x7ff0d015ac80 2023-10-09T11:41:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff0bc066f30 msgr2=0x7ff0bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff0bc066f30 0x7ff0bc0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0006d40 tx=0x7ff0c0011040 comp rx=0 tx=0).stop 2023-10-09T11:41:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d015ac80 msgr2=0x7ff0d00c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d015ac80 0x7ff0d00c59b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c510 tx=0x7ff0c400c820 comp rx=0 tx=0).stop 2023-10-09T11:41:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 shutdown_connections 2023-10-09T11:41:15.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff0bc066f30 0x7ff0bc0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0d015b050 0x7ff0d0156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d0069cb0 0x7ff0d00ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 --2- 172.21.15.86:0/4036127738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d015ac80 0x7ff0d00c59b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 >> 172.21.15.86:0/4036127738 conn(0x7ff0d0068e10 msgr2=0x7ff0d00cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 shutdown_connections 2023-10-09T11:41:15.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.091+0000 7ff0d5fff700 1 -- 172.21.15.86:0/4036127738 wait complete. 2023-10-09T11:41:15.109 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:15.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.287+0000 7f045c99d700 1 Processor -- start 2023-10-09T11:41:15.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.288+0000 7f045c99d700 1 -- start start 2023-10-09T11:41:15.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f045c99d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f045815ca80 0x7f04580acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f045c99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f04580ac4f0 0x7f04580aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f045c99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04580aa610 con 0x7f04580ad4c0 2023-10-09T11:41:15.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f045c99d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04580a9a00 con 0x7f045815ca80 2023-10-09T11:41:15.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f045c99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04580a9ce0 con 0x7f04580ac4f0 2023-10-09T11:41:15.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f04577fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f045815ca80 0x7f04580acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f04577fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f045815ca80 0x7f04580acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39300/0 (socket says 172.21.15.86:39300) 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.289+0000 7f04577fe700 1 -- 172.21.15.86:0/365900915 learned_addr learned my addr 172.21.15.86:0/365900915 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f0457fff700 1 --2- 172.21.15.86:0/365900915 >> v2:172.21.15.135:3300/0 conn(0x7f04580ac4f0 0x7f04580aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04577fe700 1 -- 172.21.15.86:0/365900915 >> v2:172.21.15.135:3300/0 conn(0x7f04580ac4f0 msgr2=0x7f04580aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04577fe700 1 --2- 172.21.15.86:0/365900915 >> v2:172.21.15.135:3300/0 conn(0x7f04580ac4f0 0x7f04580aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04577fe700 1 -- 172.21.15.86:0/365900915 >> v1:172.21.15.135:6789/0 conn(0x7f04580ad4c0 legacy=0x7f04580abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04577fe700 1 -- 172.21.15.86:0/365900915 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580a9fc0 con 0x7f045815ca80 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04577fe700 1 --2- 172.21.15.86:0/365900915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04580acf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f045806d7c0 tx=0x7f0448009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa912cab97dacae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04567fc700 1 -- 172.21.15.86:0/365900915 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044800b820 con 0x7f045815ca80 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04567fc700 1 -- 172.21.15.86:0/365900915 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044800b980 con 0x7f045815ca80 2023-10-09T11:41:15.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.290+0000 7f04567fc700 1 -- 172.21.15.86:0/365900915 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044800bd40 con 0x7f045815ca80 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 -- 172.21.15.86:0/365900915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 msgr2=0x7f04580acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 --2- 172.21.15.86:0/365900915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04580acf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f045806d7c0 tx=0x7f0448009250 comp rx=0 tx=0).stop 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 -- 172.21.15.86:0/365900915 shutdown_connections 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 --2- 172.21.15.86:0/365900915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04580acf80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 --2- 172.21.15.86:0/365900915 >> v2:172.21.15.135:3300/0 conn(0x7f04580ac4f0 0x7f04580aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 -- 172.21.15.86:0/365900915 >> 172.21.15.86:0/365900915 conn(0x7f0458068e20 msgr2=0x7f04580cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 -- 172.21.15.86:0/365900915 shutdown_connections 2023-10-09T11:41:15.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.291+0000 7f045c99d700 1 -- 172.21.15.86:0/365900915 wait complete. 2023-10-09T11:41:15.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.292+0000 7f045c99d700 1 Processor -- start 2023-10-09T11:41:15.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.292+0000 7f045c99d700 1 -- start start 2023-10-09T11:41:15.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.293+0000 7f045c99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04580ac4f0 0x7f045814b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.293+0000 7f045c99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04580ad4c0 0x7f045814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.293+0000 7f045c99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04581513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.293+0000 7f045c99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045814ce00 con 0x7f045815ca80 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.293+0000 7f045c99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045814de90 con 0x7f04580ad4c0 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.293+0000 7f045c99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045814c1f0 con 0x7f04580ac4f0 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.293+0000 7f0457fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04581513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04581513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39312/0 (socket says 172.21.15.86:39312) 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 -- 172.21.15.86:0/4181501313 learned_addr learned my addr 172.21.15.86:0/4181501313 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f04577fe700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04580ac4f0 0x7f045814b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 -- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04580ac4f0 msgr2=0x7f045814b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04580ac4f0 0x7f045814b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0456ffd700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04580ad4c0 0x7f045814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 -- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04580ad4c0 msgr2=0x7f045814f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04580ad4c0 0x7f045814f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 -- 172.21.15.86:0/4181501313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480094f0 con 0x7f045815ca80 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0456ffd700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04580ad4c0 0x7f045814f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f0457fff700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04581513b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0450009fd0 tx=0x7f0450009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f043f7fe700 1 -- 172.21.15.86:0/4181501313 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000ed50 con 0x7f045815ca80 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f043f7fe700 1 -- 172.21.15.86:0/4181501313 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045000eeb0 con 0x7f045815ca80 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f043f7fe700 1 -- 172.21.15.86:0/4181501313 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450014650 con 0x7f045815ca80 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.294+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045814c4d0 con 0x7f045815ca80 2023-10-09T11:41:15.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.295+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045814ca90 con 0x7f045815ca80 2023-10-09T11:41:15.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.295+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045804c3c0 con 0x7f045815ca80 2023-10-09T11:41:15.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.296+0000 7f043f7fe700 1 -- 172.21.15.86:0/4181501313 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04500149c0 con 0x7f045815ca80 2023-10-09T11:41:15.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.297+0000 7f043f7fe700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0444066f30 0x7f04440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.297+0000 7f043f7fe700 1 -- 172.21.15.86:0/4181501313 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0450084cc0 con 0x7f045815ca80 2023-10-09T11:41:15.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.297+0000 7f04577fe700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0444066f30 0x7f04440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.298+0000 7f04577fe700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0444066f30 0x7f04440693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f045806d7c0 tx=0x7f0448016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.301+0000 7f043f7fe700 1 -- 172.21.15.86:0/4181501313 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0450051f30 con 0x7f045815ca80 2023-10-09T11:41:15.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.534+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04580aa2a0 con 0x7f045815ca80 2023-10-09T11:41:15.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.535+0000 7f043f7fe700 1 -- 172.21.15.86:0/4181501313 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f0450055550 con 0x7f045815ca80 2023-10-09T11:41:15.536 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:15.536 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:15.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0444066f30 msgr2=0x7f04440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0444066f30 0x7f04440693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f045806d7c0 tx=0x7f0448016000 comp rx=0 tx=0).stop 2023-10-09T11:41:15.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 msgr2=0x7f04581513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04581513b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0450009fd0 tx=0x7f0450009900 comp rx=0 tx=0).stop 2023-10-09T11:41:15.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 shutdown_connections 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0444066f30 0x7f04440693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f045815ca80 0x7f04581513b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04580ac4f0 0x7f045814b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 --2- 172.21.15.86:0/4181501313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04580ad4c0 0x7f045814f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 >> 172.21.15.86:0/4181501313 conn(0x7f0458068e20 msgr2=0x7f04580afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 shutdown_connections 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.537+0000 7f045c99d700 1 -- 172.21.15.86:0/4181501313 wait complete. 2023-10-09T11:41:15.539 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:15.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.735+0000 7fd756b9d700 1 Processor -- start 2023-10-09T11:41:15.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.735+0000 7fd756b9d700 1 -- start start 2023-10-09T11:41:15.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.736+0000 7fd756b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd750159420 0x7fd7500b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.736+0000 7fd756b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd7501597f0 0x7fd7500b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.736+0000 7fd756b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7500b11d0 con 0x7fd75015d230 2023-10-09T11:41:15.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.736+0000 7fd756b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500b14b0 con 0x7fd750159420 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.736+0000 7fd756b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500b1790 con 0x7fd7501597f0 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.736+0000 7fd755b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd750159420 0x7fd7500b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd755b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd750159420 0x7fd7500b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39314/0 (socket says 172.21.15.86:39314) 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd755b9b700 1 -- 172.21.15.86:0/605137696 learned_addr learned my addr 172.21.15.86:0/605137696 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd75539a700 1 --2- 172.21.15.86:0/605137696 >> v2:172.21.15.135:3300/0 conn(0x7fd7501597f0 0x7fd7500b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd755b9b700 1 -- 172.21.15.86:0/605137696 >> v2:172.21.15.135:3300/0 conn(0x7fd7501597f0 msgr2=0x7fd7500b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd755b9b700 1 --2- 172.21.15.86:0/605137696 >> v2:172.21.15.135:3300/0 conn(0x7fd7501597f0 0x7fd7500b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd755b9b700 1 -- 172.21.15.86:0/605137696 >> v1:172.21.15.135:6789/0 conn(0x7fd75015d230 legacy=0x7fd75015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd755b9b700 1 -- 172.21.15.86:0/605137696 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500b1a70 con 0x7fd750159420 2023-10-09T11:41:15.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd755b9b700 1 --2- 172.21.15.86:0/605137696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd750159420 0x7fd7500b5f40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd750089750 tx=0x7fd74c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443953c48e7110e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd754b99700 1 -- 172.21.15.86:0/605137696 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00b860 con 0x7fd750159420 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd754b99700 1 -- 172.21.15.86:0/605137696 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c00b9c0 con 0x7fd750159420 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.737+0000 7fd754b99700 1 -- 172.21.15.86:0/605137696 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00bd60 con 0x7fd750159420 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 -- 172.21.15.86:0/605137696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd750159420 msgr2=0x7fd7500b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 --2- 172.21.15.86:0/605137696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd750159420 0x7fd7500b5f40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd750089750 tx=0x7fd74c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 -- 172.21.15.86:0/605137696 shutdown_connections 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 --2- 172.21.15.86:0/605137696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd750159420 0x7fd7500b5f40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 --2- 172.21.15.86:0/605137696 >> v2:172.21.15.135:3300/0 conn(0x7fd7501597f0 0x7fd7500b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 -- 172.21.15.86:0/605137696 >> 172.21.15.86:0/605137696 conn(0x7fd7500d0660 msgr2=0x7fd7500d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 -- 172.21.15.86:0/605137696 shutdown_connections 2023-10-09T11:41:15.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.738+0000 7fd756b9d700 1 -- 172.21.15.86:0/605137696 wait complete. 2023-10-09T11:41:15.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.739+0000 7fd756b9d700 1 Processor -- start 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.740+0000 7fd756b9d700 1 -- start start 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.740+0000 7fd756b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd750159420 0x7fd7501548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.740+0000 7fd756b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7501597f0 0x7fd7500c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd756b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd75015d230 0x7fd7500c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd756b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7500ca300 con 0x7fd75015d230 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd756b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7500c5b80 con 0x7fd7501597f0 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd756b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75016d000 con 0x7fd750159420 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd75015d230 0x7fd7500c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd75015d230 0x7fd7500c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39324/0 (socket says 172.21.15.86:39324) 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 -- 172.21.15.86:0/2153571232 learned_addr learned my addr 172.21.15.86:0/2153571232 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd755b9b700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd750159420 0x7fd7501548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75539a700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7501597f0 0x7fd7500c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 -- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd750159420 msgr2=0x7fd7501548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd750159420 0x7fd7501548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 -- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7501597f0 msgr2=0x7fd7500c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7501597f0 0x7fd7500c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 -- 172.21.15.86:0/2153571232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c0094f0 con 0x7fd75015d230 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75539a700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7501597f0 0x7fd7500c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd755b9b700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd750159420 0x7fd7501548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.741+0000 7fd75639c700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd75015d230 0x7fd7500c8830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd74800c810 tx=0x7fd748001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.742+0000 7fd745ffb700 1 -- 172.21.15.86:0/2153571232 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748012630 con 0x7fd75015d230 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.742+0000 7fd745ffb700 1 -- 172.21.15.86:0/2153571232 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7480127b0 con 0x7fd75015d230 2023-10-09T11:41:15.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.742+0000 7fd745ffb700 1 -- 172.21.15.86:0/2153571232 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748012b70 con 0x7fd75015d230 2023-10-09T11:41:15.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.742+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75016d2e0 con 0x7fd75015d230 2023-10-09T11:41:15.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.742+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75016d8a0 con 0x7fd75015d230 2023-10-09T11:41:15.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.743+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75004c3c0 con 0x7fd75015d230 2023-10-09T11:41:15.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.744+0000 7fd745ffb700 1 -- 172.21.15.86:0/2153571232 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd748003030 con 0x7fd75015d230 2023-10-09T11:41:15.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.744+0000 7fd745ffb700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd734066f30 0x7fd7340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:15.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.744+0000 7fd745ffb700 1 -- 172.21.15.86:0/2153571232 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd748084570 con 0x7fd75015d230 2023-10-09T11:41:15.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.745+0000 7fd755b9b700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd734066f30 0x7fd7340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:15.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.745+0000 7fd755b9b700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd734066f30 0x7fd7340693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd750089750 tx=0x7fd74c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:15.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.748+0000 7fd745ffb700 1 -- 172.21.15.86:0/2153571232 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd748051740 con 0x7fd75015d230 2023-10-09T11:41:15.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.941+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7500b1d50 con 0x7fd75015d230 2023-10-09T11:41:15.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.942+0000 7fd745ffb700 1 -- 172.21.15.86:0/2153571232 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd748054d60 con 0x7fd75015d230 2023-10-09T11:41:15.943 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:15.943 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:15.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.944+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd734066f30 msgr2=0x7fd7340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.944+0000 7fd756b9d700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd734066f30 0x7fd7340693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd750089750 tx=0x7fd74c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.944+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd75015d230 msgr2=0x7fd7500c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.944+0000 7fd756b9d700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd75015d230 0x7fd7500c8830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd74800c810 tx=0x7fd748001650 comp rx=0 tx=0).stop 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 shutdown_connections 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd734066f30 0x7fd7340693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd75015d230 0x7fd7500c8830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd750159420 0x7fd7501548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 --2- 172.21.15.86:0/2153571232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7501597f0 0x7fd7500c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 >> 172.21.15.86:0/2153571232 conn(0x7fd7500d0660 msgr2=0x7fd750156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:15.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 shutdown_connections 2023-10-09T11:41:15.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:15.945+0000 7fd756b9d700 1 -- 172.21.15.86:0/2153571232 wait complete. 2023-10-09T11:41:15.963 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:41:15.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:16.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.144+0000 7f50ca59d700 1 Processor -- start 2023-10-09T11:41:16.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.144+0000 7f50ca59d700 1 -- start start 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.145+0000 7f50ca59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.145+0000 7f50ca59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50c415d230 0x7f50c415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.145+0000 7f50ca59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c415dbd0 con 0x7f50c41597f0 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.145+0000 7f50ca59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40b2980 con 0x7f50c415d230 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.145+0000 7f50ca59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40b11d0 con 0x7f50c4159420 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.145+0000 7f50c9d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50c415d230 0x7f50c415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.145+0000 7f50c9d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50c415d230 0x7f50c415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39340/0 (socket says 172.21.15.86:39340) 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50c9d9c700 1 -- 172.21.15.86:0/1316959672 learned_addr learned my addr 172.21.15.86:0/1316959672 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:16.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50c959b700 1 --2- 172.21.15.86:0/1316959672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50c9d9c700 1 -- 172.21.15.86:0/1316959672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 msgr2=0x7f50c40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50c9d9c700 1 --2- 172.21.15.86:0/1316959672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50c9d9c700 1 -- 172.21.15.86:0/1316959672 >> v1:172.21.15.135:6789/0 conn(0x7f50c41597f0 legacy=0x7f50c40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50c9d9c700 1 -- 172.21.15.86:0/1316959672 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40b14b0 con 0x7f50c415d230 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50c9d9c700 1 --2- 172.21.15.86:0/1316959672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415d690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009f20 tx=0x7f50bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cf78af84bc5fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50bbfff700 1 -- 172.21.15.86:0/1316959672 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc00e070 con 0x7f50c415d230 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50bbfff700 1 -- 172.21.15.86:0/1316959672 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc00ba80 con 0x7f50c415d230 2023-10-09T11:41:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.146+0000 7f50bbfff700 1 -- 172.21.15.86:0/1316959672 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0092e0 con 0x7f50c415d230 2023-10-09T11:41:16.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 -- 172.21.15.86:0/1316959672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 msgr2=0x7f50c415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 --2- 172.21.15.86:0/1316959672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415d690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009f20 tx=0x7f50bc009840 comp rx=0 tx=0).stop 2023-10-09T11:41:16.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 -- 172.21.15.86:0/1316959672 shutdown_connections 2023-10-09T11:41:16.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 --2- 172.21.15.86:0/1316959672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c415d690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 --2- 172.21.15.86:0/1316959672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 -- 172.21.15.86:0/1316959672 >> 172.21.15.86:0/1316959672 conn(0x7f50c40d0660 msgr2=0x7f50c40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 -- 172.21.15.86:0/1316959672 shutdown_connections 2023-10-09T11:41:16.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.147+0000 7f50ca59d700 1 -- 172.21.15.86:0/1316959672 wait complete. 2023-10-09T11:41:16.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.148+0000 7f50ca59d700 1 Processor -- start 2023-10-09T11:41:16.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.149+0000 7f50ca59d700 1 -- start start 2023-10-09T11:41:16.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.149+0000 7f50ca59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.149+0000 7f50ca59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.149+0000 7f50ca59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c416a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.149+0000 7f50ca59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40caf70 con 0x7f50c415d230 2023-10-09T11:41:16.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.149+0000 7f50ca59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40cb250 con 0x7f50c41597f0 2023-10-09T11:41:16.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.149+0000 7f50ca59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40cb530 con 0x7f50c4159420 2023-10-09T11:41:16.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c416a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c416a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39346/0 (socket says 172.21.15.86:39346) 2023-10-09T11:41:16.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 -- 172.21.15.86:0/4225746886 learned_addr learned my addr 172.21.15.86:0/4225746886 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:16.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c959b700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c8d9a700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 -- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 msgr2=0x7f50c40ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 -- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 msgr2=0x7f50c40cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 -- 172.21.15.86:0/4225746886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc009ae0 con 0x7f50c415d230 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c8d9a700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50c9d9c700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c416a010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00b6c0 tx=0x7f50bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50b97fa700 1 -- 172.21.15.86:0/4225746886 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0032f0 con 0x7f50c415d230 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50b97fa700 1 -- 172.21.15.86:0/4225746886 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc008e80 con 0x7f50c415d230 2023-10-09T11:41:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50b97fa700 1 -- 172.21.15.86:0/4225746886 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc01c620 con 0x7f50c415d230 2023-10-09T11:41:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.150+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c40cb810 con 0x7f50c415d230 2023-10-09T11:41:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.151+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c4155920 con 0x7f50c415d230 2023-10-09T11:41:16.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.152+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c404c3c0 con 0x7f50c415d230 2023-10-09T11:41:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.152+0000 7f50b97fa700 1 -- 172.21.15.86:0/4225746886 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50bc003040 con 0x7f50c415d230 2023-10-09T11:41:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.153+0000 7f50b97fa700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f50a8066f30 0x7f50a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.153+0000 7f50b97fa700 1 -- 172.21.15.86:0/4225746886 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50bc085f40 con 0x7f50c415d230 2023-10-09T11:41:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.154+0000 7f50c959b700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f50a8066f30 0x7f50a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.154+0000 7f50c959b700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f50a8066f30 0x7f50a80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50c0006fd0 tx=0x7f50c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.158+0000 7f50b97fa700 1 -- 172.21.15.86:0/4225746886 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50bc053110 con 0x7f50c415d230 2023-10-09T11:41:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.346+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50c40cb3c0 con 0x7f50a8066f30 2023-10-09T11:41:16.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.355+0000 7f50b97fa700 1 -- 172.21.15.86:0/4225746886 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263063 (secure 0 0 0) 0x7f50c40cb3c0 con 0x7f50a8066f30 2023-10-09T11:41:16.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:16.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f50a8066f30 msgr2=0x7f50a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f50a8066f30 0x7f50a80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50c0006fd0 tx=0x7f50c0008040 comp rx=0 tx=0).stop 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 msgr2=0x7f50c416a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c416a010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00b6c0 tx=0x7f50bc018000 comp rx=0 tx=0).stop 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 shutdown_connections 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f50a8066f30 0x7f50a80693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50c415d230 0x7f50c416a010 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50c4159420 0x7f50c40ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 --2- 172.21.15.86:0/4225746886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50c41597f0 0x7f50c40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 >> 172.21.15.86:0/4225746886 conn(0x7f50c40d0660 msgr2=0x7f50c41564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 shutdown_connections 2023-10-09T11:41:16.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.360+0000 7f50ca59d700 1 -- 172.21.15.86:0/4225746886 wait complete. 2023-10-09T11:41:16.364 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:41:16.378 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T11:41:15.953484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591116,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381024,"kb_used_data":2720,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593696,"statfs":{"total":773094113280,"available":770655944704,"internally_reserved":0,"allocated":2785280,"data_stored":1695450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.911391"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.067210+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058844+0000","last_change":"2023-10-09T11:41:12.053292+0000","last_active":"2023-10-09T11:41:12.058844+0000","last_peered":"2023-10-09T11:41:12.058844+0000","last_clean":"2023-10-09T11:41:12.058844+0000","last_became_active":"2023-10-09T11:41:12.052978+0000","last_became_peered":"2023-10-09T11:41:12.052978+0000","last_unstale":"2023-10-09T11:41:12.058844+0000","last_undegraded":"2023-10-09T11:41:12.058844+0000","last_fullsized":"2023-10-09T11:41:12.058844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053403+0000","last_change":"2023-10-09T11:41:12.048670+0000","last_active":"2023-10-09T11:41:12.053403+0000","last_peered":"2023-10-09T11:41:12.053403+0000","last_clean":"2023-10-09T11:41:12.053403+0000","last_became_active":"2023-10-09T11:41:12.048364+0000","last_became_peered":"2023-10-09T11:41:12.048364+0000","last_unstale":"2023-10-09T11:41:12.053403+0000","last_undegraded":"2023-10-09T11:41:12.053403+0000","last_fullsized":"2023-10-09T11:41:12.053403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054306+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.060821+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058233+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.066734+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059474+0000","last_change":"2023-10-09T11:41:12.054453+0000","last_active":"2023-10-09T11:41:12.059474+0000","last_peered":"2023-10-09T11:41:12.059474+0000","last_clean":"2023-10-09T11:41:12.059474+0000","last_became_active":"2023-10-09T11:41:12.054117+0000","last_became_peered":"2023-10-09T11:41:12.054117+0000","last_unstale":"2023-10-09T11:41:12.059474+0000","last_undegraded":"2023-10-09T11:41:12.059474+0000","last_fullsized":"2023-10-09T11:41:12.059474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.054577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.064647+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057408+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054239+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053874+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:11.314302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059423+0000","last_change":"2023-10-09T11:41:12.052334+0000","last_active":"2023-10-09T11:41:12.059423+0000","last_peered":"2023-10-09T11:41:12.059423+0000","last_clean":"2023-10-09T11:41:12.059423+0000","last_became_active":"2023-10-09T11:41:12.051731+0000","last_became_peered":"2023-10-09T11:41:12.051731+0000","last_unstale":"2023-10-09T11:41:12.059423+0000","last_undegraded":"2023-10-09T11:41:12.059423+0000","last_fullsized":"2023-10-09T11:41:12.059423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:25.351610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053609+0000","last_change":"2023-10-09T11:41:12.051643+0000","last_active":"2023-10-09T11:41:12.053609+0000","last_peered":"2023-10-09T11:41:12.053609+0000","last_clean":"2023-10-09T11:41:12.053609+0000","last_became_active":"2023-10-09T11:41:12.051337+0000","last_became_peered":"2023-10-09T11:41:12.051337+0000","last_unstale":"2023-10-09T11:41:12.053609+0000","last_undegraded":"2023-10-09T11:41:12.053609+0000","last_fullsized":"2023-10-09T11:41:12.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:10.056568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059700+0000","last_change":"2023-10-09T11:41:12.058090+0000","last_active":"2023-10-09T11:41:12.059700+0000","last_peered":"2023-10-09T11:41:12.059700+0000","last_clean":"2023-10-09T11:41:12.059700+0000","last_became_active":"2023-10-09T11:41:12.057829+0000","last_became_peered":"2023-10-09T11:41:12.057829+0000","last_unstale":"2023-10-09T11:41:12.059700+0000","last_undegraded":"2023-10-09T11:41:12.059700+0000","last_fullsized":"2023-10-09T11:41:12.059700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058504+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058807+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.049265+0000","last_change":"2023-10-09T11:41:12.049265+0000","last_active":"2023-10-09T11:41:12.049265+0000","last_peered":"2023-10-09T11:41:12.049265+0000","last_clean":"2023-10-09T11:41:12.049265+0000","last_became_active":"2023-10-09T11:41:12.049000+0000","last_became_peered":"2023-10-09T11:41:12.049000+0000","last_unstale":"2023-10-09T11:41:12.049265+0000","last_undegraded":"2023-10-09T11:41:12.049265+0000","last_fullsized":"2023-10-09T11:41:12.049265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:17.015986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.065607+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.088830+0000","last_change":"2023-10-09T11:41:11.074267+0000","last_active":"2023-10-09T11:41:12.088830+0000","last_peered":"2023-10-09T11:41:12.088830+0000","last_clean":"2023-10-09T11:41:12.088830+0000","last_became_active":"2023-10-09T11:41:11.073971+0000","last_became_peered":"2023-10-09T11:41:11.073971+0000","last_unstale":"2023-10-09T11:41:12.088830+0000","last_undegraded":"2023-10-09T11:41:12.088830+0000","last_fullsized":"2023-10-09T11:41:12.088830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:17.546372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059770+0000","last_change":"2023-10-09T11:41:12.054265+0000","last_active":"2023-10-09T11:41:12.059770+0000","last_peered":"2023-10-09T11:41:12.059770+0000","last_clean":"2023-10-09T11:41:12.059770+0000","last_became_active":"2023-10-09T11:41:12.053826+0000","last_became_peered":"2023-10-09T11:41:12.053826+0000","last_unstale":"2023-10-09T11:41:12.059770+0000","last_undegraded":"2023-10-09T11:41:12.059770+0000","last_fullsized":"2023-10-09T11:41:12.059770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:00.372669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.085137+0000","last_change":"2023-10-09T11:41:11.063441+0000","last_active":"2023-10-09T11:41:12.085137+0000","last_peered":"2023-10-09T11:41:12.085137+0000","last_clean":"2023-10-09T11:41:12.085137+0000","last_became_active":"2023-10-09T11:41:11.063025+0000","last_became_peered":"2023-10-09T11:41:11.063025+0000","last_unstale":"2023-10-09T11:41:12.085137+0000","last_undegraded":"2023-10-09T11:41:12.085137+0000","last_fullsized":"2023-10-09T11:41:12.085137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:21.843438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063925+0000","last_change":"2023-10-09T11:41:12.058625+0000","last_active":"2023-10-09T11:41:12.063925+0000","last_peered":"2023-10-09T11:41:12.063925+0000","last_clean":"2023-10-09T11:41:12.063925+0000","last_became_active":"2023-10-09T11:41:12.057462+0000","last_became_peered":"2023-10-09T11:41:12.057462+0000","last_unstale":"2023-10-09T11:41:12.063925+0000","last_undegraded":"2023-10-09T11:41:12.063925+0000","last_fullsized":"2023-10-09T11:41:12.063925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079554+0000","last_change":"2023-10-09T11:41:11.079554+0000","last_active":"2023-10-09T11:41:11.079554+0000","last_peered":"2023-10-09T11:41:11.079554+0000","last_clean":"2023-10-09T11:41:11.079554+0000","last_became_active":"2023-10-09T11:41:11.079230+0000","last_became_peered":"2023-10-09T11:41:11.079230+0000","last_unstale":"2023-10-09T11:41:11.079554+0000","last_undegraded":"2023-10-09T11:41:11.079554+0000","last_fullsized":"2023-10-09T11:41:11.079554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059040+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.082099+0000","last_change":"2023-10-09T11:41:11.082099+0000","last_active":"2023-10-09T11:41:11.082099+0000","last_peered":"2023-10-09T11:41:11.082099+0000","last_clean":"2023-10-09T11:41:11.082099+0000","last_became_active":"2023-10-09T11:41:11.081703+0000","last_became_peered":"2023-10-09T11:41:11.081703+0000","last_unstale":"2023-10-09T11:41:11.082099+0000","last_undegraded":"2023-10-09T11:41:11.082099+0000","last_fullsized":"2023-10-09T11:41:11.082099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:59.333597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056823+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086469+0000","last_change":"2023-10-09T11:41:11.074679+0000","last_active":"2023-10-09T11:41:12.086469+0000","last_peered":"2023-10-09T11:41:12.086469+0000","last_clean":"2023-10-09T11:41:12.086469+0000","last_became_active":"2023-10-09T11:41:11.074362+0000","last_became_peered":"2023-10-09T11:41:11.074362+0000","last_unstale":"2023-10-09T11:41:12.086469+0000","last_undegraded":"2023-10-09T11:41:12.086469+0000","last_fullsized":"2023-10-09T11:41:12.086469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054240+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:07.666003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.068876+0000","last_change":"2023-10-09T11:41:11.068876+0000","last_active":"2023-10-09T11:41:11.068876+0000","last_peered":"2023-10-09T11:41:11.068876+0000","last_clean":"2023-10-09T11:41:11.068876+0000","last_became_active":"2023-10-09T11:41:11.068602+0000","last_became_peered":"2023-10-09T11:41:11.068602+0000","last_unstale":"2023-10-09T11:41:11.068876+0000","last_undegraded":"2023-10-09T11:41:11.068876+0000","last_fullsized":"2023-10-09T11:41:11.068876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063758+0000","last_change":"2023-10-09T11:41:12.058551+0000","last_active":"2023-10-09T11:41:12.063758+0000","last_peered":"2023-10-09T11:41:12.063758+0000","last_clean":"2023-10-09T11:41:12.063758+0000","last_became_active":"2023-10-09T11:41:12.056962+0000","last_became_peered":"2023-10-09T11:41:12.056962+0000","last_unstale":"2023-10-09T11:41:12.063758+0000","last_undegraded":"2023-10-09T11:41:12.063758+0000","last_fullsized":"2023-10-09T11:41:12.063758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.038859+0000","last_change":"2023-10-09T11:41:11.072956+0000","last_active":"2023-10-09T11:41:12.038859+0000","last_peered":"2023-10-09T11:41:12.038859+0000","last_clean":"2023-10-09T11:41:12.038859+0000","last_became_active":"2023-10-09T11:41:11.072711+0000","last_became_peered":"2023-10-09T11:41:11.072711+0000","last_unstale":"2023-10-09T11:41:12.038859+0000","last_undegraded":"2023-10-09T11:41:12.038859+0000","last_fullsized":"2023-10-09T11:41:12.038859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060221+0000","last_change":"2023-10-09T11:41:12.056233+0000","last_active":"2023-10-09T11:41:12.060221+0000","last_peered":"2023-10-09T11:41:12.060221+0000","last_clean":"2023-10-09T11:41:12.060221+0000","last_became_active":"2023-10-09T11:41:12.055836+0000","last_became_peered":"2023-10-09T11:41:12.055836+0000","last_unstale":"2023-10-09T11:41:12.060221+0000","last_undegraded":"2023-10-09T11:41:12.060221+0000","last_fullsized":"2023-10-09T11:41:12.060221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.076596+0000","last_change":"2023-10-09T11:41:11.076596+0000","last_active":"2023-10-09T11:41:11.076596+0000","last_peered":"2023-10-09T11:41:11.076596+0000","last_clean":"2023-10-09T11:41:11.076596+0000","last_became_active":"2023-10-09T11:41:11.075211+0000","last_became_peered":"2023-10-09T11:41:11.075211+0000","last_unstale":"2023-10-09T11:41:11.076596+0000","last_undegraded":"2023-10-09T11:41:11.076596+0000","last_fullsized":"2023-10-09T11:41:11.076596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061196+0000","last_change":"2023-10-09T11:41:12.059816+0000","last_active":"2023-10-09T11:41:12.061196+0000","last_peered":"2023-10-09T11:41:12.061196+0000","last_clean":"2023-10-09T11:41:12.061196+0000","last_became_active":"2023-10-09T11:41:12.059529+0000","last_became_peered":"2023-10-09T11:41:12.059529+0000","last_unstale":"2023-10-09T11:41:12.061196+0000","last_undegraded":"2023-10-09T11:41:12.061196+0000","last_fullsized":"2023-10-09T11:41:12.061196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077704+0000","last_change":"2023-10-09T11:41:11.077704+0000","last_active":"2023-10-09T11:41:11.077704+0000","last_peered":"2023-10-09T11:41:11.077704+0000","last_clean":"2023-10-09T11:41:11.077704+0000","last_became_active":"2023-10-09T11:41:11.077405+0000","last_became_peered":"2023-10-09T11:41:11.077405+0000","last_unstale":"2023-10-09T11:41:11.077704+0000","last_undegraded":"2023-10-09T11:41:11.077704+0000","last_fullsized":"2023-10-09T11:41:11.077704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056731+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.071764+0000","last_change":"2023-10-09T11:41:11.071764+0000","last_active":"2023-10-09T11:41:11.071764+0000","last_peered":"2023-10-09T11:41:11.071764+0000","last_clean":"2023-10-09T11:41:11.071764+0000","last_became_active":"2023-10-09T11:41:11.070619+0000","last_became_peered":"2023-10-09T11:41:11.070619+0000","last_unstale":"2023-10-09T11:41:11.071764+0000","last_undegraded":"2023-10-09T11:41:11.071764+0000","last_fullsized":"2023-10-09T11:41:11.071764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063724+0000","last_change":"2023-10-09T11:41:12.057796+0000","last_active":"2023-10-09T11:41:12.063724+0000","last_peered":"2023-10-09T11:41:12.063724+0000","last_clean":"2023-10-09T11:41:12.063724+0000","last_became_active":"2023-10-09T11:41:12.057536+0000","last_became_peered":"2023-10-09T11:41:12.057536+0000","last_unstale":"2023-10-09T11:41:12.063724+0000","last_undegraded":"2023-10-09T11:41:12.063724+0000","last_fullsized":"2023-10-09T11:41:12.063724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086648+0000","last_change":"2023-10-09T11:41:11.077183+0000","last_active":"2023-10-09T11:41:12.086648+0000","last_peered":"2023-10-09T11:41:12.086648+0000","last_clean":"2023-10-09T11:41:12.086648+0000","last_became_active":"2023-10-09T11:41:11.076940+0000","last_became_peered":"2023-10-09T11:41:11.076940+0000","last_unstale":"2023-10-09T11:41:12.086648+0000","last_undegraded":"2023-10-09T11:41:12.086648+0000","last_fullsized":"2023-10-09T11:41:12.086648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.052869+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:29.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.068939+0000","last_change":"2023-10-09T11:41:11.068939+0000","last_active":"2023-10-09T11:41:11.068939+0000","last_peered":"2023-10-09T11:41:11.068939+0000","last_clean":"2023-10-09T11:41:11.068939+0000","last_became_active":"2023-10-09T11:41:11.068555+0000","last_became_peered":"2023-10-09T11:41:11.068555+0000","last_unstale":"2023-10-09T11:41:11.068939+0000","last_undegraded":"2023-10-09T11:41:11.068939+0000","last_fullsized":"2023-10-09T11:41:11.068939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.063229+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086499+0000","last_change":"2023-10-09T11:41:11.065387+0000","last_active":"2023-10-09T11:41:12.086499+0000","last_peered":"2023-10-09T11:41:12.086499+0000","last_clean":"2023-10-09T11:41:12.086499+0000","last_became_active":"2023-10-09T11:41:11.065121+0000","last_became_peered":"2023-10-09T11:41:11.065121+0000","last_unstale":"2023-10-09T11:41:12.086499+0000","last_undegraded":"2023-10-09T11:41:12.086499+0000","last_fullsized":"2023-10-09T11:41:12.086499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:19.832054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053962+0000","last_change":"2023-10-09T11:41:12.052247+0000","last_active":"2023-10-09T11:41:12.053962+0000","last_peered":"2023-10-09T11:41:12.053962+0000","last_clean":"2023-10-09T11:41:12.053962+0000","last_became_active":"2023-10-09T11:41:12.051882+0000","last_became_peered":"2023-10-09T11:41:12.051882+0000","last_unstale":"2023-10-09T11:41:12.053962+0000","last_undegraded":"2023-10-09T11:41:12.053962+0000","last_fullsized":"2023-10-09T11:41:12.053962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077221+0000","last_change":"2023-10-09T11:41:11.077221+0000","last_active":"2023-10-09T11:41:11.077221+0000","last_peered":"2023-10-09T11:41:11.077221+0000","last_clean":"2023-10-09T11:41:11.077221+0000","last_became_active":"2023-10-09T11:41:11.075558+0000","last_became_peered":"2023-10-09T11:41:11.075558+0000","last_unstale":"2023-10-09T11:41:11.077221+0000","last_undegraded":"2023-10-09T11:41:11.077221+0000","last_fullsized":"2023-10-09T11:41:11.077221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.060267+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.069670+0000","last_change":"2023-10-09T11:41:11.069670+0000","last_active":"2023-10-09T11:41:11.069670+0000","last_peered":"2023-10-09T11:41:11.069670+0000","last_clean":"2023-10-09T11:41:11.069670+0000","last_became_active":"2023-10-09T11:41:11.069325+0000","last_became_peered":"2023-10-09T11:41:11.069325+0000","last_unstale":"2023-10-09T11:41:11.069670+0000","last_undegraded":"2023-10-09T11:41:11.069670+0000","last_fullsized":"2023-10-09T11:41:11.069670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059248+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087160+0000","last_change":"2023-10-09T11:41:11.066464+0000","last_active":"2023-10-09T11:41:12.087160+0000","last_peered":"2023-10-09T11:41:12.087160+0000","last_clean":"2023-10-09T11:41:12.087160+0000","last_became_active":"2023-10-09T11:41:11.066166+0000","last_became_peered":"2023-10-09T11:41:11.066166+0000","last_unstale":"2023-10-09T11:41:12.087160+0000","last_undegraded":"2023-10-09T11:41:12.087160+0000","last_fullsized":"2023-10-09T11:41:12.087160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:02.875341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059803+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.065898+0000","last_change":"2023-10-09T11:41:11.065898+0000","last_active":"2023-10-09T11:41:11.065898+0000","last_peered":"2023-10-09T11:41:11.065898+0000","last_clean":"2023-10-09T11:41:11.065898+0000","last_became_active":"2023-10-09T11:41:11.065594+0000","last_became_peered":"2023-10-09T11:41:11.065594+0000","last_unstale":"2023-10-09T11:41:11.065898+0000","last_undegraded":"2023-10-09T11:41:11.065898+0000","last_fullsized":"2023-10-09T11:41:11.065898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:55.877969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.062240+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045586+0000","last_change":"2023-10-09T11:41:11.062024+0000","last_active":"2023-10-09T11:41:12.045586+0000","last_peered":"2023-10-09T11:41:12.045586+0000","last_clean":"2023-10-09T11:41:12.045586+0000","last_became_active":"2023-10-09T11:41:11.061759+0000","last_became_peered":"2023-10-09T11:41:11.061759+0000","last_unstale":"2023-10-09T11:41:12.045586+0000","last_undegraded":"2023-10-09T11:41:12.045586+0000","last_fullsized":"2023-10-09T11:41:12.045586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:28.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053238+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077710+0000","last_change":"2023-10-09T11:41:11.077710+0000","last_active":"2023-10-09T11:41:11.077710+0000","last_peered":"2023-10-09T11:41:11.077710+0000","last_clean":"2023-10-09T11:41:11.077710+0000","last_became_active":"2023-10-09T11:41:11.077435+0000","last_became_peered":"2023-10-09T11:41:11.077435+0000","last_unstale":"2023-10-09T11:41:11.077710+0000","last_undegraded":"2023-10-09T11:41:11.077710+0000","last_fullsized":"2023-10-09T11:41:11.077710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055194+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:27.313199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055235+0000","last_change":"2023-10-09T11:41:12.048312+0000","last_active":"2023-10-09T11:41:12.055235+0000","last_peered":"2023-10-09T11:41:12.055235+0000","last_clean":"2023-10-09T11:41:12.055235+0000","last_became_active":"2023-10-09T11:41:12.048029+0000","last_became_peered":"2023-10-09T11:41:12.048029+0000","last_unstale":"2023-10-09T11:41:12.055235+0000","last_undegraded":"2023-10-09T11:41:12.055235+0000","last_fullsized":"2023-10-09T11:41:12.055235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.069456+0000","last_change":"2023-10-09T11:41:11.065740+0000","last_active":"2023-10-09T11:41:11.069456+0000","last_peered":"2023-10-09T11:41:11.069456+0000","last_clean":"2023-10-09T11:41:11.069456+0000","last_became_active":"2023-10-09T11:41:11.065420+0000","last_became_peered":"2023-10-09T11:41:11.065420+0000","last_unstale":"2023-10-09T11:41:11.069456+0000","last_undegraded":"2023-10-09T11:41:11.069456+0000","last_fullsized":"2023-10-09T11:41:11.069456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.067543+0000","last_change":"2023-10-09T11:41:12.063341+0000","last_active":"2023-10-09T11:41:12.067543+0000","last_peered":"2023-10-09T11:41:12.067543+0000","last_clean":"2023-10-09T11:41:12.067543+0000","last_became_active":"2023-10-09T11:41:12.063063+0000","last_became_peered":"2023-10-09T11:41:12.063063+0000","last_unstale":"2023-10-09T11:41:12.067543+0000","last_undegraded":"2023-10-09T11:41:12.067543+0000","last_fullsized":"2023-10-09T11:41:12.067543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.064371+0000","last_change":"2023-10-09T11:41:11.064371+0000","last_active":"2023-10-09T11:41:11.064371+0000","last_peered":"2023-10-09T11:41:11.064371+0000","last_clean":"2023-10-09T11:41:11.064371+0000","last_became_active":"2023-10-09T11:41:11.064027+0000","last_became_peered":"2023-10-09T11:41:11.064027+0000","last_unstale":"2023-10-09T11:41:11.064371+0000","last_undegraded":"2023-10-09T11:41:11.064371+0000","last_fullsized":"2023-10-09T11:41:11.064371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":161,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:41:10.052394+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:41:10.052394+0000","last_peered":"2023-10-09T11:41:10.052394+0000","last_clean":"2023-10-09T11:41:10.052394+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:41:10.052394+0000","last_undegraded":"2023-10-09T11:41:10.052394+0000","last_fullsized":"2023-10-09T11:41:10.052394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063606+0000","last_change":"2023-10-09T11:41:12.057248+0000","last_active":"2023-10-09T11:41:12.063606+0000","last_peered":"2023-10-09T11:41:12.063606+0000","last_clean":"2023-10-09T11:41:12.063606+0000","last_became_active":"2023-10-09T11:41:12.056873+0000","last_became_peered":"2023-10-09T11:41:12.056873+0000","last_unstale":"2023-10-09T11:41:12.063606+0000","last_undegraded":"2023-10-09T11:41:12.063606+0000","last_fullsized":"2023-10-09T11:41:12.063606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:16.551009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079718+0000","last_change":"2023-10-09T11:41:11.079718+0000","last_active":"2023-10-09T11:41:11.079718+0000","last_peered":"2023-10-09T11:41:11.079718+0000","last_clean":"2023-10-09T11:41:11.079718+0000","last_became_active":"2023-10-09T11:41:11.079488+0000","last_became_peered":"2023-10-09T11:41:11.079488+0000","last_unstale":"2023-10-09T11:41:11.079718+0000","last_undegraded":"2023-10-09T11:41:11.079718+0000","last_fullsized":"2023-10-09T11:41:11.079718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.075456+0000","last_change":"2023-10-09T11:41:11.075456+0000","last_active":"2023-10-09T11:41:11.075456+0000","last_peered":"2023-10-09T11:41:11.075456+0000","last_clean":"2023-10-09T11:41:11.075456+0000","last_became_active":"2023-10-09T11:41:11.074500+0000","last_became_peered":"2023-10-09T11:41:11.074500+0000","last_unstale":"2023-10-09T11:41:11.075456+0000","last_undegraded":"2023-10-09T11:41:11.075456+0000","last_fullsized":"2023-10-09T11:41:11.075456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055214+0000","last_change":"2023-10-09T11:41:12.050593+0000","last_active":"2023-10-09T11:41:12.055214+0000","last_peered":"2023-10-09T11:41:12.055214+0000","last_clean":"2023-10-09T11:41:12.055214+0000","last_became_active":"2023-10-09T11:41:12.050327+0000","last_became_peered":"2023-10-09T11:41:12.050327+0000","last_unstale":"2023-10-09T11:41:12.055214+0000","last_undegraded":"2023-10-09T11:41:12.055214+0000","last_fullsized":"2023-10-09T11:41:12.055214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045891+0000","last_change":"2023-10-09T11:41:11.062590+0000","last_active":"2023-10-09T11:41:12.045891+0000","last_peered":"2023-10-09T11:41:12.045891+0000","last_clean":"2023-10-09T11:41:12.045891+0000","last_became_active":"2023-10-09T11:41:11.062303+0000","last_became_peered":"2023-10-09T11:41:11.062303+0000","last_unstale":"2023-10-09T11:41:12.045891+0000","last_undegraded":"2023-10-09T11:41:12.045891+0000","last_fullsized":"2023-10-09T11:41:12.045891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062836+0000","last_change":"2023-10-09T11:41:12.059380+0000","last_active":"2023-10-09T11:41:12.062836+0000","last_peered":"2023-10-09T11:41:12.062836+0000","last_clean":"2023-10-09T11:41:12.062836+0000","last_became_active":"2023-10-09T11:41:12.059091+0000","last_became_peered":"2023-10-09T11:41:12.059091+0000","last_unstale":"2023-10-09T11:41:12.062836+0000","last_undegraded":"2023-10-09T11:41:12.062836+0000","last_fullsized":"2023-10-09T11:41:12.062836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:41.207515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.074722+0000","last_change":"2023-10-09T11:41:11.074722+0000","last_active":"2023-10-09T11:41:11.074722+0000","last_peered":"2023-10-09T11:41:11.074722+0000","last_clean":"2023-10-09T11:41:11.074722+0000","last_became_active":"2023-10-09T11:41:11.074417+0000","last_became_peered":"2023-10-09T11:41:11.074417+0000","last_unstale":"2023-10-09T11:41:11.074722+0000","last_undegraded":"2023-10-09T11:41:11.074722+0000","last_fullsized":"2023-10-09T11:41:11.074722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053509+0000","last_change":"2023-10-09T11:41:12.051884+0000","last_active":"2023-10-09T11:41:12.053509+0000","last_peered":"2023-10-09T11:41:12.053509+0000","last_clean":"2023-10-09T11:41:12.053509+0000","last_became_active":"2023-10-09T11:41:12.051012+0000","last_became_peered":"2023-10-09T11:41:12.051012+0000","last_unstale":"2023-10-09T11:41:12.053509+0000","last_undegraded":"2023-10-09T11:41:12.053509+0000","last_fullsized":"2023-10-09T11:41:12.053509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:59.214273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079256+0000","last_change":"2023-10-09T11:41:11.079256+0000","last_active":"2023-10-09T11:41:11.079256+0000","last_peered":"2023-10-09T11:41:11.079256+0000","last_clean":"2023-10-09T11:41:11.079256+0000","last_became_active":"2023-10-09T11:41:11.078999+0000","last_became_peered":"2023-10-09T11:41:11.078999+0000","last_unstale":"2023-10-09T11:41:11.079256+0000","last_undegraded":"2023-10-09T11:41:11.079256+0000","last_fullsized":"2023-10-09T11:41:11.079256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055464+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:25.252259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045174+0000","last_change":"2023-10-09T11:41:11.074785+0000","last_active":"2023-10-09T11:41:12.045174+0000","last_peered":"2023-10-09T11:41:12.045174+0000","last_clean":"2023-10-09T11:41:12.045174+0000","last_became_active":"2023-10-09T11:41:11.074460+0000","last_became_peered":"2023-10-09T11:41:11.074460+0000","last_unstale":"2023-10-09T11:41:12.045174+0000","last_undegraded":"2023-10-09T11:41:12.045174+0000","last_fullsized":"2023-10-09T11:41:12.045174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055406+0000","last_change":"2023-10-09T11:41:12.050021+0000","last_active":"2023-10-09T11:41:12.055406+0000","last_peered":"2023-10-09T11:41:12.055406+0000","last_clean":"2023-10-09T11:41:12.055406+0000","last_became_active":"2023-10-09T11:41:12.049763+0000","last_became_peered":"2023-10-09T11:41:12.049763+0000","last_unstale":"2023-10-09T11:41:12.055406+0000","last_undegraded":"2023-10-09T11:41:12.055406+0000","last_fullsized":"2023-10-09T11:41:12.055406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045561+0000","last_change":"2023-10-09T11:41:11.063645+0000","last_active":"2023-10-09T11:41:12.045561+0000","last_peered":"2023-10-09T11:41:12.045561+0000","last_clean":"2023-10-09T11:41:12.045561+0000","last_became_active":"2023-10-09T11:41:11.063324+0000","last_became_peered":"2023-10-09T11:41:11.063324+0000","last_unstale":"2023-10-09T11:41:12.045561+0000","last_undegraded":"2023-10-09T11:41:12.045561+0000","last_fullsized":"2023-10-09T11:41:12.045561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059445+0000","last_change":"2023-10-09T11:41:12.053917+0000","last_active":"2023-10-09T11:41:12.059445+0000","last_peered":"2023-10-09T11:41:12.059445+0000","last_clean":"2023-10-09T11:41:12.059445+0000","last_became_active":"2023-10-09T11:41:12.051978+0000","last_became_peered":"2023-10-09T11:41:12.051978+0000","last_unstale":"2023-10-09T11:41:12.059445+0000","last_undegraded":"2023-10-09T11:41:12.059445+0000","last_fullsized":"2023-10-09T11:41:12.059445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.076948+0000","last_change":"2023-10-09T11:41:11.076948+0000","last_active":"2023-10-09T11:41:11.076948+0000","last_peered":"2023-10-09T11:41:11.076948+0000","last_clean":"2023-10-09T11:41:11.076948+0000","last_became_active":"2023-10-09T11:41:11.076489+0000","last_became_peered":"2023-10-09T11:41:11.076489+0000","last_unstale":"2023-10-09T11:41:11.076948+0000","last_undegraded":"2023-10-09T11:41:11.076948+0000","last_fullsized":"2023-10-09T11:41:11.076948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057619+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.078229+0000","last_change":"2023-10-09T11:41:11.077460+0000","last_active":"2023-10-09T11:41:11.078229+0000","last_peered":"2023-10-09T11:41:11.078229+0000","last_clean":"2023-10-09T11:41:11.078229+0000","last_became_active":"2023-10-09T11:41:11.077192+0000","last_became_peered":"2023-10-09T11:41:11.077192+0000","last_unstale":"2023-10-09T11:41:11.078229+0000","last_undegraded":"2023-10-09T11:41:11.078229+0000","last_fullsized":"2023-10-09T11:41:11.078229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:56.491552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.061884+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086287+0000","last_change":"2023-10-09T11:41:11.060748+0000","last_active":"2023-10-09T11:41:12.086287+0000","last_peered":"2023-10-09T11:41:12.086287+0000","last_clean":"2023-10-09T11:41:12.086287+0000","last_became_active":"2023-10-09T11:41:11.060436+0000","last_became_peered":"2023-10-09T11:41:11.060436+0000","last_unstale":"2023-10-09T11:41:12.086287+0000","last_undegraded":"2023-10-09T11:41:12.086287+0000","last_fullsized":"2023-10-09T11:41:12.086287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056097+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084562+0000","last_change":"2023-10-09T11:41:11.066536+0000","last_active":"2023-10-09T11:41:12.084562+0000","last_peered":"2023-10-09T11:41:12.084562+0000","last_clean":"2023-10-09T11:41:12.084562+0000","last_became_active":"2023-10-09T11:41:11.066194+0000","last_became_peered":"2023-10-09T11:41:11.066194+0000","last_unstale":"2023-10-09T11:41:12.084562+0000","last_undegraded":"2023-10-09T11:41:12.084562+0000","last_fullsized":"2023-10-09T11:41:12.084562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.062688+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059981+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.056111+0000","last_change":"2023-10-09T11:41:12.056111+0000","last_active":"2023-10-09T11:41:12.056111+0000","last_peered":"2023-10-09T11:41:12.056111+0000","last_clean":"2023-10-09T11:41:12.056111+0000","last_became_active":"2023-10-09T11:41:12.055843+0000","last_became_peered":"2023-10-09T11:41:12.055843+0000","last_unstale":"2023-10-09T11:41:12.056111+0000","last_undegraded":"2023-10-09T11:41:12.056111+0000","last_fullsized":"2023-10-09T11:41:12.056111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:43.783508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057160+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053222+0000","last_change":"2023-10-09T11:41:12.051485+0000","last_active":"2023-10-09T11:41:12.053222+0000","last_peered":"2023-10-09T11:41:12.053222+0000","last_clean":"2023-10-09T11:41:12.053222+0000","last_became_active":"2023-10-09T11:41:12.051192+0000","last_became_peered":"2023-10-09T11:41:12.051192+0000","last_unstale":"2023-10-09T11:41:12.053222+0000","last_undegraded":"2023-10-09T11:41:12.053222+0000","last_fullsized":"2023-10-09T11:41:12.053222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062890+0000","last_change":"2023-10-09T11:41:12.059625+0000","last_active":"2023-10-09T11:41:12.062890+0000","last_peered":"2023-10-09T11:41:12.062890+0000","last_clean":"2023-10-09T11:41:12.062890+0000","last_became_active":"2023-10-09T11:41:12.059319+0000","last_became_peered":"2023-10-09T11:41:12.059319+0000","last_unstale":"2023-10-09T11:41:12.062890+0000","last_undegraded":"2023-10-09T11:41:12.062890+0000","last_fullsized":"2023-10-09T11:41:12.062890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061223+0000","last_change":"2023-10-09T11:41:12.059993+0000","last_active":"2023-10-09T11:41:12.061223+0000","last_peered":"2023-10-09T11:41:12.061223+0000","last_clean":"2023-10-09T11:41:12.061223+0000","last_became_active":"2023-10-09T11:41:12.059604+0000","last_became_peered":"2023-10-09T11:41:12.059604+0000","last_unstale":"2023-10-09T11:41:12.061223+0000","last_undegraded":"2023-10-09T11:41:12.061223+0000","last_fullsized":"2023-10-09T11:41:12.061223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058055+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060308+0000","last_change":"2023-10-09T11:41:12.058708+0000","last_active":"2023-10-09T11:41:12.060308+0000","last_peered":"2023-10-09T11:41:12.060308+0000","last_clean":"2023-10-09T11:41:12.060308+0000","last_became_active":"2023-10-09T11:41:12.058356+0000","last_became_peered":"2023-10-09T11:41:12.058356+0000","last_unstale":"2023-10-09T11:41:12.060308+0000","last_undegraded":"2023-10-09T11:41:12.060308+0000","last_fullsized":"2023-10-09T11:41:12.060308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053154+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063421+0000","last_change":"2023-10-09T11:41:12.059080+0000","last_active":"2023-10-09T11:41:12.063421+0000","last_peered":"2023-10-09T11:41:12.063421+0000","last_clean":"2023-10-09T11:41:12.063421+0000","last_became_active":"2023-10-09T11:41:12.056426+0000","last_became_peered":"2023-10-09T11:41:12.056426+0000","last_unstale":"2023-10-09T11:41:12.063421+0000","last_undegraded":"2023-10-09T11:41:12.063421+0000","last_fullsized":"2023-10-09T11:41:12.063421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057664+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053983+0000","last_change":"2023-10-09T11:41:12.052767+0000","last_active":"2023-10-09T11:41:12.053983+0000","last_peered":"2023-10-09T11:41:12.053983+0000","last_clean":"2023-10-09T11:41:12.053983+0000","last_became_active":"2023-10-09T11:41:12.052111+0000","last_became_peered":"2023-10-09T11:41:12.052111+0000","last_unstale":"2023-10-09T11:41:12.053983+0000","last_undegraded":"2023-10-09T11:41:12.053983+0000","last_fullsized":"2023-10-09T11:41:12.053983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055663+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476740,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":646334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":68992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:16.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:16.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.596+0000 7f210359e700 1 Processor -- start 2023-10-09T11:41:16.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.597+0000 7f210359e700 1 -- start start 2023-10-09T11:41:16.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.598+0000 7f210359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2104150180 0x7f2104157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.598+0000 7f210359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210406e2a0 con 0x7f21040c7410 2023-10-09T11:41:16.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.598+0000 7f210359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210406b2e0 con 0x7f2104150550 2023-10-09T11:41:16.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.598+0000 7f210359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21040c78e0 con 0x7f2104150180 2023-10-09T11:41:16.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.598+0000 7f2102d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f21040c7410 0x7f2104069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37240/0 (socket says 172.21.15.86:37240) 2023-10-09T11:41:16.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.598+0000 7f2102d9d700 1 -- 172.21.15.86:0/3399977991 learned_addr learned my addr 172.21.15.86:0/3399977991 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.598+0000 7f210259c700 1 --2- 172.21.15.86:0/3399977991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2104150180 0x7f2104157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210159a700 1 -- 172.21.15.86:0/3399977991 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599853315 0 0) 0x7f210406e2a0 con 0x7f21040c7410 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210159a700 1 -- 172.21.15.86:0/3399977991 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ec004680 con 0x7f21040c7410 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210259c700 1 -- 172.21.15.86:0/3399977991 >> v1:172.21.15.135:6789/0 conn(0x7f2104150550 legacy=0x7f21040c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210259c700 1 -- 172.21.15.86:0/3399977991 >> v1:172.21.15.86:6789/0 conn(0x7f21040c7410 legacy=0x7f2104069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210259c700 1 -- 172.21.15.86:0/3399977991 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21040c7bc0 con 0x7f2104150180 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210259c700 1 --2- 172.21.15.86:0/3399977991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2104150180 0x7f2104157770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009910 tx=0x7f20f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6779b81db2680369 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210159a700 1 -- 172.21.15.86:0/3399977991 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400b680 con 0x7f2104150180 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210159a700 1 -- 172.21.15.86:0/3399977991 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f400b7e0 con 0x7f2104150180 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.599+0000 7f210159a700 1 -- 172.21.15.86:0/3399977991 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400bba0 con 0x7f2104150180 2023-10-09T11:41:16.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.600+0000 7f210359e700 1 -- 172.21.15.86:0/3399977991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2104150180 msgr2=0x7f2104157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.600+0000 7f210359e700 1 --2- 172.21.15.86:0/3399977991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2104150180 0x7f2104157770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009910 tx=0x7f20f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.600+0000 7f210359e700 1 -- 172.21.15.86:0/3399977991 shutdown_connections 2023-10-09T11:41:16.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.600+0000 7f210359e700 1 --2- 172.21.15.86:0/3399977991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2104150180 0x7f2104157770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.600+0000 7f210359e700 1 -- 172.21.15.86:0/3399977991 >> 172.21.15.86:0/3399977991 conn(0x7f21040cc1f0 msgr2=0x7f21040cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.600+0000 7f210359e700 1 -- 172.21.15.86:0/3399977991 shutdown_connections 2023-10-09T11:41:16.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.600+0000 7f210359e700 1 -- 172.21.15.86:0/3399977991 wait complete. 2023-10-09T11:41:16.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.601+0000 7f210359e700 1 Processor -- start 2023-10-09T11:41:16.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.602+0000 7f210359e700 1 -- start start 2023-10-09T11:41:16.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21040c7410 0x7f2104155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2104150180 0x7f21040cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2104150550 0x7f21040cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040c8c60 con 0x7f2104150180 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040afed0 con 0x7f2104150550 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21040b01b0 con 0x7f21040c7410 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2104150180 0x7f21040cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2104150180 0x7f21040cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39356/0 (socket says 172.21.15.86:39356) 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 -- 172.21.15.86:0/428583568 learned_addr learned my addr 172.21.15.86:0/428583568 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210259c700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21040c7410 0x7f2104155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2102d9d700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2104150550 0x7f21040cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 -- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21040c7410 msgr2=0x7f2104155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21040c7410 0x7f2104155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 -- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2104150550 msgr2=0x7f21040cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2104150550 0x7f21040cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 -- 172.21.15.86:0/428583568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4009420 con 0x7f2104150180 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2102d9d700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2104150550 0x7f21040cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f210259c700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21040c7410 0x7f2104155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.603+0000 7f2101d9b700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2104150180 0x7f21040cafa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c590 tx=0x7f20f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.604+0000 7f20f27fc700 1 -- 172.21.15.86:0/428583568 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011590 con 0x7f2104150180 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.604+0000 7f20f27fc700 1 -- 172.21.15.86:0/428583568 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80116f0 con 0x7f2104150180 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.604+0000 7f20f27fc700 1 -- 172.21.15.86:0/428583568 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011ab0 con 0x7f2104150180 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.604+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21040b0490 con 0x7f2104150180 2023-10-09T11:41:16.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.604+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104155f60 con 0x7f2104150180 2023-10-09T11:41:16.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.605+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21040c90f0 con 0x7f2104150180 2023-10-09T11:41:16.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.606+0000 7f20f27fc700 1 -- 172.21.15.86:0/428583568 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20f801b3b0 con 0x7f2104150180 2023-10-09T11:41:16.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.607+0000 7f20f27fc700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f20e4066f30 0x7f20e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.607+0000 7f20f27fc700 1 -- 172.21.15.86:0/428583568 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20f8083b30 con 0x7f2104150180 2023-10-09T11:41:16.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.607+0000 7f210259c700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f20e4066f30 0x7f20e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.607+0000 7f210259c700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f20e4066f30 0x7f20e40693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20f40093f0 tx=0x7f20f4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.610+0000 7f20f27fc700 1 -- 172.21.15.86:0/428583568 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21040c90f0 con 0x7f2104150180 2023-10-09T11:41:16.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.796+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21040c90f0 con 0x7f20e4066f30 2023-10-09T11:41:16.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.804+0000 7f20f27fc700 1 -- 172.21.15.86:0/428583568 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263063 (secure 0 0 0) 0x7f21040c90f0 con 0x7f20e4066f30 2023-10-09T11:41:16.808 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f20e4066f30 msgr2=0x7f20e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f20e4066f30 0x7f20e40693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20f40093f0 tx=0x7f20f4017000 comp rx=0 tx=0).stop 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2104150180 msgr2=0x7f21040cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2104150180 0x7f21040cafa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c590 tx=0x7f20f800c950 comp rx=0 tx=0).stop 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 shutdown_connections 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f20e4066f30 0x7f20e40693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2104150550 0x7f21040cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21040c7410 0x7f2104155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 --2- 172.21.15.86:0/428583568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2104150180 0x7f21040cafa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.807+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 >> 172.21.15.86:0/428583568 conn(0x7f21040cc1f0 msgr2=0x7f21040adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.808+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 shutdown_connections 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:16.808+0000 7f210359e700 1 -- 172.21.15.86:0/428583568 wait complete. 2023-10-09T11:41:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:41:16.825 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T11:41:15.953484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591116,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381024,"kb_used_data":2720,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593696,"statfs":{"total":773094113280,"available":770655944704,"internally_reserved":0,"allocated":2785280,"data_stored":1695450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.911391"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.067210+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058844+0000","last_change":"2023-10-09T11:41:12.053292+0000","last_active":"2023-10-09T11:41:12.058844+0000","last_peered":"2023-10-09T11:41:12.058844+0000","last_clean":"2023-10-09T11:41:12.058844+0000","last_became_active":"2023-10-09T11:41:12.052978+0000","last_became_peered":"2023-10-09T11:41:12.052978+0000","last_unstale":"2023-10-09T11:41:12.058844+0000","last_undegraded":"2023-10-09T11:41:12.058844+0000","last_fullsized":"2023-10-09T11:41:12.058844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053403+0000","last_change":"2023-10-09T11:41:12.048670+0000","last_active":"2023-10-09T11:41:12.053403+0000","last_peered":"2023-10-09T11:41:12.053403+0000","last_clean":"2023-10-09T11:41:12.053403+0000","last_became_active":"2023-10-09T11:41:12.048364+0000","last_became_peered":"2023-10-09T11:41:12.048364+0000","last_unstale":"2023-10-09T11:41:12.053403+0000","last_undegraded":"2023-10-09T11:41:12.053403+0000","last_fullsized":"2023-10-09T11:41:12.053403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054306+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.060821+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058233+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.066734+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059474+0000","last_change":"2023-10-09T11:41:12.054453+0000","last_active":"2023-10-09T11:41:12.059474+0000","last_peered":"2023-10-09T11:41:12.059474+0000","last_clean":"2023-10-09T11:41:12.059474+0000","last_became_active":"2023-10-09T11:41:12.054117+0000","last_became_peered":"2023-10-09T11:41:12.054117+0000","last_unstale":"2023-10-09T11:41:12.059474+0000","last_undegraded":"2023-10-09T11:41:12.059474+0000","last_fullsized":"2023-10-09T11:41:12.059474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.054577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.064647+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057408+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054239+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053874+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:11.314302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059423+0000","last_change":"2023-10-09T11:41:12.052334+0000","last_active":"2023-10-09T11:41:12.059423+0000","last_peered":"2023-10-09T11:41:12.059423+0000","last_clean":"2023-10-09T11:41:12.059423+0000","last_became_active":"2023-10-09T11:41:12.051731+0000","last_became_peered":"2023-10-09T11:41:12.051731+0000","last_unstale":"2023-10-09T11:41:12.059423+0000","last_undegraded":"2023-10-09T11:41:12.059423+0000","last_fullsized":"2023-10-09T11:41:12.059423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:25.351610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053609+0000","last_change":"2023-10-09T11:41:12.051643+0000","last_active":"2023-10-09T11:41:12.053609+0000","last_peered":"2023-10-09T11:41:12.053609+0000","last_clean":"2023-10-09T11:41:12.053609+0000","last_became_active":"2023-10-09T11:41:12.051337+0000","last_became_peered":"2023-10-09T11:41:12.051337+0000","last_unstale":"2023-10-09T11:41:12.053609+0000","last_undegraded":"2023-10-09T11:41:12.053609+0000","last_fullsized":"2023-10-09T11:41:12.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:10.056568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059700+0000","last_change":"2023-10-09T11:41:12.058090+0000","last_active":"2023-10-09T11:41:12.059700+0000","last_peered":"2023-10-09T11:41:12.059700+0000","last_clean":"2023-10-09T11:41:12.059700+0000","last_became_active":"2023-10-09T11:41:12.057829+0000","last_became_peered":"2023-10-09T11:41:12.057829+0000","last_unstale":"2023-10-09T11:41:12.059700+0000","last_undegraded":"2023-10-09T11:41:12.059700+0000","last_fullsized":"2023-10-09T11:41:12.059700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058504+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058807+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.049265+0000","last_change":"2023-10-09T11:41:12.049265+0000","last_active":"2023-10-09T11:41:12.049265+0000","last_peered":"2023-10-09T11:41:12.049265+0000","last_clean":"2023-10-09T11:41:12.049265+0000","last_became_active":"2023-10-09T11:41:12.049000+0000","last_became_peered":"2023-10-09T11:41:12.049000+0000","last_unstale":"2023-10-09T11:41:12.049265+0000","last_undegraded":"2023-10-09T11:41:12.049265+0000","last_fullsized":"2023-10-09T11:41:12.049265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:17.015986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.065607+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.088830+0000","last_change":"2023-10-09T11:41:11.074267+0000","last_active":"2023-10-09T11:41:12.088830+0000","last_peered":"2023-10-09T11:41:12.088830+0000","last_clean":"2023-10-09T11:41:12.088830+0000","last_became_active":"2023-10-09T11:41:11.073971+0000","last_became_peered":"2023-10-09T11:41:11.073971+0000","last_unstale":"2023-10-09T11:41:12.088830+0000","last_undegraded":"2023-10-09T11:41:12.088830+0000","last_fullsized":"2023-10-09T11:41:12.088830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:17.546372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059770+0000","last_change":"2023-10-09T11:41:12.054265+0000","last_active":"2023-10-09T11:41:12.059770+0000","last_peered":"2023-10-09T11:41:12.059770+0000","last_clean":"2023-10-09T11:41:12.059770+0000","last_became_active":"2023-10-09T11:41:12.053826+0000","last_became_peered":"2023-10-09T11:41:12.053826+0000","last_unstale":"2023-10-09T11:41:12.059770+0000","last_undegraded":"2023-10-09T11:41:12.059770+0000","last_fullsized":"2023-10-09T11:41:12.059770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:00.372669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.085137+0000","last_change":"2023-10-09T11:41:11.063441+0000","last_active":"2023-10-09T11:41:12.085137+0000","last_peered":"2023-10-09T11:41:12.085137+0000","last_clean":"2023-10-09T11:41:12.085137+0000","last_became_active":"2023-10-09T11:41:11.063025+0000","last_became_peered":"2023-10-09T11:41:11.063025+0000","last_unstale":"2023-10-09T11:41:12.085137+0000","last_undegraded":"2023-10-09T11:41:12.085137+0000","last_fullsized":"2023-10-09T11:41:12.085137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:21.843438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063925+0000","last_change":"2023-10-09T11:41:12.058625+0000","last_active":"2023-10-09T11:41:12.063925+0000","last_peered":"2023-10-09T11:41:12.063925+0000","last_clean":"2023-10-09T11:41:12.063925+0000","last_became_active":"2023-10-09T11:41:12.057462+0000","last_became_peered":"2023-10-09T11:41:12.057462+0000","last_unstale":"2023-10-09T11:41:12.063925+0000","last_undegraded":"2023-10-09T11:41:12.063925+0000","last_fullsized":"2023-10-09T11:41:12.063925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079554+0000","last_change":"2023-10-09T11:41:11.079554+0000","last_active":"2023-10-09T11:41:11.079554+0000","last_peered":"2023-10-09T11:41:11.079554+0000","last_clean":"2023-10-09T11:41:11.079554+0000","last_became_active":"2023-10-09T11:41:11.079230+0000","last_became_peered":"2023-10-09T11:41:11.079230+0000","last_unstale":"2023-10-09T11:41:11.079554+0000","last_undegraded":"2023-10-09T11:41:11.079554+0000","last_fullsized":"2023-10-09T11:41:11.079554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059040+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.082099+0000","last_change":"2023-10-09T11:41:11.082099+0000","last_active":"2023-10-09T11:41:11.082099+0000","last_peered":"2023-10-09T11:41:11.082099+0000","last_clean":"2023-10-09T11:41:11.082099+0000","last_became_active":"2023-10-09T11:41:11.081703+0000","last_became_peered":"2023-10-09T11:41:11.081703+0000","last_unstale":"2023-10-09T11:41:11.082099+0000","last_undegraded":"2023-10-09T11:41:11.082099+0000","last_fullsized":"2023-10-09T11:41:11.082099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:59.333597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056823+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086469+0000","last_change":"2023-10-09T11:41:11.074679+0000","last_active":"2023-10-09T11:41:12.086469+0000","last_peered":"2023-10-09T11:41:12.086469+0000","last_clean":"2023-10-09T11:41:12.086469+0000","last_became_active":"2023-10-09T11:41:11.074362+0000","last_became_peered":"2023-10-09T11:41:11.074362+0000","last_unstale":"2023-10-09T11:41:12.086469+0000","last_undegraded":"2023-10-09T11:41:12.086469+0000","last_fullsized":"2023-10-09T11:41:12.086469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054240+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:07.666003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.068876+0000","last_change":"2023-10-09T11:41:11.068876+0000","last_active":"2023-10-09T11:41:11.068876+0000","last_peered":"2023-10-09T11:41:11.068876+0000","last_clean":"2023-10-09T11:41:11.068876+0000","last_became_active":"2023-10-09T11:41:11.068602+0000","last_became_peered":"2023-10-09T11:41:11.068602+0000","last_unstale":"2023-10-09T11:41:11.068876+0000","last_undegraded":"2023-10-09T11:41:11.068876+0000","last_fullsized":"2023-10-09T11:41:11.068876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063758+0000","last_change":"2023-10-09T11:41:12.058551+0000","last_active":"2023-10-09T11:41:12.063758+0000","last_peered":"2023-10-09T11:41:12.063758+0000","last_clean":"2023-10-09T11:41:12.063758+0000","last_became_active":"2023-10-09T11:41:12.056962+0000","last_became_peered":"2023-10-09T11:41:12.056962+0000","last_unstale":"2023-10-09T11:41:12.063758+0000","last_undegraded":"2023-10-09T11:41:12.063758+0000","last_fullsized":"2023-10-09T11:41:12.063758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.038859+0000","last_change":"2023-10-09T11:41:11.072956+0000","last_active":"2023-10-09T11:41:12.038859+0000","last_peered":"2023-10-09T11:41:12.038859+0000","last_clean":"2023-10-09T11:41:12.038859+0000","last_became_active":"2023-10-09T11:41:11.072711+0000","last_became_peered":"2023-10-09T11:41:11.072711+0000","last_unstale":"2023-10-09T11:41:12.038859+0000","last_undegraded":"2023-10-09T11:41:12.038859+0000","last_fullsized":"2023-10-09T11:41:12.038859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060221+0000","last_change":"2023-10-09T11:41:12.056233+0000","last_active":"2023-10-09T11:41:12.060221+0000","last_peered":"2023-10-09T11:41:12.060221+0000","last_clean":"2023-10-09T11:41:12.060221+0000","last_became_active":"2023-10-09T11:41:12.055836+0000","last_became_peered":"2023-10-09T11:41:12.055836+0000","last_unstale":"2023-10-09T11:41:12.060221+0000","last_undegraded":"2023-10-09T11:41:12.060221+0000","last_fullsized":"2023-10-09T11:41:12.060221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.076596+0000","last_change":"2023-10-09T11:41:11.076596+0000","last_active":"2023-10-09T11:41:11.076596+0000","last_peered":"2023-10-09T11:41:11.076596+0000","last_clean":"2023-10-09T11:41:11.076596+0000","last_became_active":"2023-10-09T11:41:11.075211+0000","last_became_peered":"2023-10-09T11:41:11.075211+0000","last_unstale":"2023-10-09T11:41:11.076596+0000","last_undegraded":"2023-10-09T11:41:11.076596+0000","last_fullsized":"2023-10-09T11:41:11.076596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061196+0000","last_change":"2023-10-09T11:41:12.059816+0000","last_active":"2023-10-09T11:41:12.061196+0000","last_peered":"2023-10-09T11:41:12.061196+0000","last_clean":"2023-10-09T11:41:12.061196+0000","last_became_active":"2023-10-09T11:41:12.059529+0000","last_became_peered":"2023-10-09T11:41:12.059529+0000","last_unstale":"2023-10-09T11:41:12.061196+0000","last_undegraded":"2023-10-09T11:41:12.061196+0000","last_fullsized":"2023-10-09T11:41:12.061196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077704+0000","last_change":"2023-10-09T11:41:11.077704+0000","last_active":"2023-10-09T11:41:11.077704+0000","last_peered":"2023-10-09T11:41:11.077704+0000","last_clean":"2023-10-09T11:41:11.077704+0000","last_became_active":"2023-10-09T11:41:11.077405+0000","last_became_peered":"2023-10-09T11:41:11.077405+0000","last_unstale":"2023-10-09T11:41:11.077704+0000","last_undegraded":"2023-10-09T11:41:11.077704+0000","last_fullsized":"2023-10-09T11:41:11.077704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056731+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.071764+0000","last_change":"2023-10-09T11:41:11.071764+0000","last_active":"2023-10-09T11:41:11.071764+0000","last_peered":"2023-10-09T11:41:11.071764+0000","last_clean":"2023-10-09T11:41:11.071764+0000","last_became_active":"2023-10-09T11:41:11.070619+0000","last_became_peered":"2023-10-09T11:41:11.070619+0000","last_unstale":"2023-10-09T11:41:11.071764+0000","last_undegraded":"2023-10-09T11:41:11.071764+0000","last_fullsized":"2023-10-09T11:41:11.071764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063724+0000","last_change":"2023-10-09T11:41:12.057796+0000","last_active":"2023-10-09T11:41:12.063724+0000","last_peered":"2023-10-09T11:41:12.063724+0000","last_clean":"2023-10-09T11:41:12.063724+0000","last_became_active":"2023-10-09T11:41:12.057536+0000","last_became_peered":"2023-10-09T11:41:12.057536+0000","last_unstale":"2023-10-09T11:41:12.063724+0000","last_undegraded":"2023-10-09T11:41:12.063724+0000","last_fullsized":"2023-10-09T11:41:12.063724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086648+0000","last_change":"2023-10-09T11:41:11.077183+0000","last_active":"2023-10-09T11:41:12.086648+0000","last_peered":"2023-10-09T11:41:12.086648+0000","last_clean":"2023-10-09T11:41:12.086648+0000","last_became_active":"2023-10-09T11:41:11.076940+0000","last_became_peered":"2023-10-09T11:41:11.076940+0000","last_unstale":"2023-10-09T11:41:12.086648+0000","last_undegraded":"2023-10-09T11:41:12.086648+0000","last_fullsized":"2023-10-09T11:41:12.086648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.052869+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:29.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.068939+0000","last_change":"2023-10-09T11:41:11.068939+0000","last_active":"2023-10-09T11:41:11.068939+0000","last_peered":"2023-10-09T11:41:11.068939+0000","last_clean":"2023-10-09T11:41:11.068939+0000","last_became_active":"2023-10-09T11:41:11.068555+0000","last_became_peered":"2023-10-09T11:41:11.068555+0000","last_unstale":"2023-10-09T11:41:11.068939+0000","last_undegraded":"2023-10-09T11:41:11.068939+0000","last_fullsized":"2023-10-09T11:41:11.068939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.063229+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086499+0000","last_change":"2023-10-09T11:41:11.065387+0000","last_active":"2023-10-09T11:41:12.086499+0000","last_peered":"2023-10-09T11:41:12.086499+0000","last_clean":"2023-10-09T11:41:12.086499+0000","last_became_active":"2023-10-09T11:41:11.065121+0000","last_became_peered":"2023-10-09T11:41:11.065121+0000","last_unstale":"2023-10-09T11:41:12.086499+0000","last_undegraded":"2023-10-09T11:41:12.086499+0000","last_fullsized":"2023-10-09T11:41:12.086499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:19.832054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053962+0000","last_change":"2023-10-09T11:41:12.052247+0000","last_active":"2023-10-09T11:41:12.053962+0000","last_peered":"2023-10-09T11:41:12.053962+0000","last_clean":"2023-10-09T11:41:12.053962+0000","last_became_active":"2023-10-09T11:41:12.051882+0000","last_became_peered":"2023-10-09T11:41:12.051882+0000","last_unstale":"2023-10-09T11:41:12.053962+0000","last_undegraded":"2023-10-09T11:41:12.053962+0000","last_fullsized":"2023-10-09T11:41:12.053962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077221+0000","last_change":"2023-10-09T11:41:11.077221+0000","last_active":"2023-10-09T11:41:11.077221+0000","last_peered":"2023-10-09T11:41:11.077221+0000","last_clean":"2023-10-09T11:41:11.077221+0000","last_became_active":"2023-10-09T11:41:11.075558+0000","last_became_peered":"2023-10-09T11:41:11.075558+0000","last_unstale":"2023-10-09T11:41:11.077221+0000","last_undegraded":"2023-10-09T11:41:11.077221+0000","last_fullsized":"2023-10-09T11:41:11.077221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.060267+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.069670+0000","last_change":"2023-10-09T11:41:11.069670+0000","last_active":"2023-10-09T11:41:11.069670+0000","last_peered":"2023-10-09T11:41:11.069670+0000","last_clean":"2023-10-09T11:41:11.069670+0000","last_became_active":"2023-10-09T11:41:11.069325+0000","last_became_peered":"2023-10-09T11:41:11.069325+0000","last_unstale":"2023-10-09T11:41:11.069670+0000","last_undegraded":"2023-10-09T11:41:11.069670+0000","last_fullsized":"2023-10-09T11:41:11.069670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059248+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087160+0000","last_change":"2023-10-09T11:41:11.066464+0000","last_active":"2023-10-09T11:41:12.087160+0000","last_peered":"2023-10-09T11:41:12.087160+0000","last_clean":"2023-10-09T11:41:12.087160+0000","last_became_active":"2023-10-09T11:41:11.066166+0000","last_became_peered":"2023-10-09T11:41:11.066166+0000","last_unstale":"2023-10-09T11:41:12.087160+0000","last_undegraded":"2023-10-09T11:41:12.087160+0000","last_fullsized":"2023-10-09T11:41:12.087160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:02.875341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059803+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.065898+0000","last_change":"2023-10-09T11:41:11.065898+0000","last_active":"2023-10-09T11:41:11.065898+0000","last_peered":"2023-10-09T11:41:11.065898+0000","last_clean":"2023-10-09T11:41:11.065898+0000","last_became_active":"2023-10-09T11:41:11.065594+0000","last_became_peered":"2023-10-09T11:41:11.065594+0000","last_unstale":"2023-10-09T11:41:11.065898+0000","last_undegraded":"2023-10-09T11:41:11.065898+0000","last_fullsized":"2023-10-09T11:41:11.065898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:55.877969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.062240+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045586+0000","last_change":"2023-10-09T11:41:11.062024+0000","last_active":"2023-10-09T11:41:12.045586+0000","last_peered":"2023-10-09T11:41:12.045586+0000","last_clean":"2023-10-09T11:41:12.045586+0000","last_became_active":"2023-10-09T11:41:11.061759+0000","last_became_peered":"2023-10-09T11:41:11.061759+0000","last_unstale":"2023-10-09T11:41:12.045586+0000","last_undegraded":"2023-10-09T11:41:12.045586+0000","last_fullsized":"2023-10-09T11:41:12.045586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:28.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053238+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077710+0000","last_change":"2023-10-09T11:41:11.077710+0000","last_active":"2023-10-09T11:41:11.077710+0000","last_peered":"2023-10-09T11:41:11.077710+0000","last_clean":"2023-10-09T11:41:11.077710+0000","last_became_active":"2023-10-09T11:41:11.077435+0000","last_became_peered":"2023-10-09T11:41:11.077435+0000","last_unstale":"2023-10-09T11:41:11.077710+0000","last_undegraded":"2023-10-09T11:41:11.077710+0000","last_fullsized":"2023-10-09T11:41:11.077710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055194+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:27.313199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055235+0000","last_change":"2023-10-09T11:41:12.048312+0000","last_active":"2023-10-09T11:41:12.055235+0000","last_peered":"2023-10-09T11:41:12.055235+0000","last_clean":"2023-10-09T11:41:12.055235+0000","last_became_active":"2023-10-09T11:41:12.048029+0000","last_became_peered":"2023-10-09T11:41:12.048029+0000","last_unstale":"2023-10-09T11:41:12.055235+0000","last_undegraded":"2023-10-09T11:41:12.055235+0000","last_fullsized":"2023-10-09T11:41:12.055235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.069456+0000","last_change":"2023-10-09T11:41:11.065740+0000","last_active":"2023-10-09T11:41:11.069456+0000","last_peered":"2023-10-09T11:41:11.069456+0000","last_clean":"2023-10-09T11:41:11.069456+0000","last_became_active":"2023-10-09T11:41:11.065420+0000","last_became_peered":"2023-10-09T11:41:11.065420+0000","last_unstale":"2023-10-09T11:41:11.069456+0000","last_undegraded":"2023-10-09T11:41:11.069456+0000","last_fullsized":"2023-10-09T11:41:11.069456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.067543+0000","last_change":"2023-10-09T11:41:12.063341+0000","last_active":"2023-10-09T11:41:12.067543+0000","last_peered":"2023-10-09T11:41:12.067543+0000","last_clean":"2023-10-09T11:41:12.067543+0000","last_became_active":"2023-10-09T11:41:12.063063+0000","last_became_peered":"2023-10-09T11:41:12.063063+0000","last_unstale":"2023-10-09T11:41:12.067543+0000","last_undegraded":"2023-10-09T11:41:12.067543+0000","last_fullsized":"2023-10-09T11:41:12.067543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.064371+0000","last_change":"2023-10-09T11:41:11.064371+0000","last_active":"2023-10-09T11:41:11.064371+0000","last_peered":"2023-10-09T11:41:11.064371+0000","last_clean":"2023-10-09T11:41:11.064371+0000","last_became_active":"2023-10-09T11:41:11.064027+0000","last_became_peered":"2023-10-09T11:41:11.064027+0000","last_unstale":"2023-10-09T11:41:11.064371+0000","last_undegraded":"2023-10-09T11:41:11.064371+0000","last_fullsized":"2023-10-09T11:41:11.064371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":161,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:41:10.052394+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:41:10.052394+0000","last_peered":"2023-10-09T11:41:10.052394+0000","last_clean":"2023-10-09T11:41:10.052394+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:41:10.052394+0000","last_undegraded":"2023-10-09T11:41:10.052394+0000","last_fullsized":"2023-10-09T11:41:10.052394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063606+0000","last_change":"2023-10-09T11:41:12.057248+0000","last_active":"2023-10-09T11:41:12.063606+0000","last_peered":"2023-10-09T11:41:12.063606+0000","last_clean":"2023-10-09T11:41:12.063606+0000","last_became_active":"2023-10-09T11:41:12.056873+0000","last_became_peered":"2023-10-09T11:41:12.056873+0000","last_unstale":"2023-10-09T11:41:12.063606+0000","last_undegraded":"2023-10-09T11:41:12.063606+0000","last_fullsized":"2023-10-09T11:41:12.063606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:16.551009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079718+0000","last_change":"2023-10-09T11:41:11.079718+0000","last_active":"2023-10-09T11:41:11.079718+0000","last_peered":"2023-10-09T11:41:11.079718+0000","last_clean":"2023-10-09T11:41:11.079718+0000","last_became_active":"2023-10-09T11:41:11.079488+0000","last_became_peered":"2023-10-09T11:41:11.079488+0000","last_unstale":"2023-10-09T11:41:11.079718+0000","last_undegraded":"2023-10-09T11:41:11.079718+0000","last_fullsized":"2023-10-09T11:41:11.079718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.075456+0000","last_change":"2023-10-09T11:41:11.075456+0000","last_active":"2023-10-09T11:41:11.075456+0000","last_peered":"2023-10-09T11:41:11.075456+0000","last_clean":"2023-10-09T11:41:11.075456+0000","last_became_active":"2023-10-09T11:41:11.074500+0000","last_became_peered":"2023-10-09T11:41:11.074500+0000","last_unstale":"2023-10-09T11:41:11.075456+0000","last_undegraded":"2023-10-09T11:41:11.075456+0000","last_fullsized":"2023-10-09T11:41:11.075456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055214+0000","last_change":"2023-10-09T11:41:12.050593+0000","last_active":"2023-10-09T11:41:12.055214+0000","last_peered":"2023-10-09T11:41:12.055214+0000","last_clean":"2023-10-09T11:41:12.055214+0000","last_became_active":"2023-10-09T11:41:12.050327+0000","last_became_peered":"2023-10-09T11:41:12.050327+0000","last_unstale":"2023-10-09T11:41:12.055214+0000","last_undegraded":"2023-10-09T11:41:12.055214+0000","last_fullsized":"2023-10-09T11:41:12.055214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045891+0000","last_change":"2023-10-09T11:41:11.062590+0000","last_active":"2023-10-09T11:41:12.045891+0000","last_peered":"2023-10-09T11:41:12.045891+0000","last_clean":"2023-10-09T11:41:12.045891+0000","last_became_active":"2023-10-09T11:41:11.062303+0000","last_became_peered":"2023-10-09T11:41:11.062303+0000","last_unstale":"2023-10-09T11:41:12.045891+0000","last_undegraded":"2023-10-09T11:41:12.045891+0000","last_fullsized":"2023-10-09T11:41:12.045891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062836+0000","last_change":"2023-10-09T11:41:12.059380+0000","last_active":"2023-10-09T11:41:12.062836+0000","last_peered":"2023-10-09T11:41:12.062836+0000","last_clean":"2023-10-09T11:41:12.062836+0000","last_became_active":"2023-10-09T11:41:12.059091+0000","last_became_peered":"2023-10-09T11:41:12.059091+0000","last_unstale":"2023-10-09T11:41:12.062836+0000","last_undegraded":"2023-10-09T11:41:12.062836+0000","last_fullsized":"2023-10-09T11:41:12.062836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:41.207515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.074722+0000","last_change":"2023-10-09T11:41:11.074722+0000","last_active":"2023-10-09T11:41:11.074722+0000","last_peered":"2023-10-09T11:41:11.074722+0000","last_clean":"2023-10-09T11:41:11.074722+0000","last_became_active":"2023-10-09T11:41:11.074417+0000","last_became_peered":"2023-10-09T11:41:11.074417+0000","last_unstale":"2023-10-09T11:41:11.074722+0000","last_undegraded":"2023-10-09T11:41:11.074722+0000","last_fullsized":"2023-10-09T11:41:11.074722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053509+0000","last_change":"2023-10-09T11:41:12.051884+0000","last_active":"2023-10-09T11:41:12.053509+0000","last_peered":"2023-10-09T11:41:12.053509+0000","last_clean":"2023-10-09T11:41:12.053509+0000","last_became_active":"2023-10-09T11:41:12.051012+0000","last_became_peered":"2023-10-09T11:41:12.051012+0000","last_unstale":"2023-10-09T11:41:12.053509+0000","last_undegraded":"2023-10-09T11:41:12.053509+0000","last_fullsized":"2023-10-09T11:41:12.053509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:59.214273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079256+0000","last_change":"2023-10-09T11:41:11.079256+0000","last_active":"2023-10-09T11:41:11.079256+0000","last_peered":"2023-10-09T11:41:11.079256+0000","last_clean":"2023-10-09T11:41:11.079256+0000","last_became_active":"2023-10-09T11:41:11.078999+0000","last_became_peered":"2023-10-09T11:41:11.078999+0000","last_unstale":"2023-10-09T11:41:11.079256+0000","last_undegraded":"2023-10-09T11:41:11.079256+0000","last_fullsized":"2023-10-09T11:41:11.079256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055464+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:25.252259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045174+0000","last_change":"2023-10-09T11:41:11.074785+0000","last_active":"2023-10-09T11:41:12.045174+0000","last_peered":"2023-10-09T11:41:12.045174+0000","last_clean":"2023-10-09T11:41:12.045174+0000","last_became_active":"2023-10-09T11:41:11.074460+0000","last_became_peered":"2023-10-09T11:41:11.074460+0000","last_unstale":"2023-10-09T11:41:12.045174+0000","last_undegraded":"2023-10-09T11:41:12.045174+0000","last_fullsized":"2023-10-09T11:41:12.045174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055406+0000","last_change":"2023-10-09T11:41:12.050021+0000","last_active":"2023-10-09T11:41:12.055406+0000","last_peered":"2023-10-09T11:41:12.055406+0000","last_clean":"2023-10-09T11:41:12.055406+0000","last_became_active":"2023-10-09T11:41:12.049763+0000","last_became_peered":"2023-10-09T11:41:12.049763+0000","last_unstale":"2023-10-09T11:41:12.055406+0000","last_undegraded":"2023-10-09T11:41:12.055406+0000","last_fullsized":"2023-10-09T11:41:12.055406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045561+0000","last_change":"2023-10-09T11:41:11.063645+0000","last_active":"2023-10-09T11:41:12.045561+0000","last_peered":"2023-10-09T11:41:12.045561+0000","last_clean":"2023-10-09T11:41:12.045561+0000","last_became_active":"2023-10-09T11:41:11.063324+0000","last_became_peered":"2023-10-09T11:41:11.063324+0000","last_unstale":"2023-10-09T11:41:12.045561+0000","last_undegraded":"2023-10-09T11:41:12.045561+0000","last_fullsized":"2023-10-09T11:41:12.045561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059445+0000","last_change":"2023-10-09T11:41:12.053917+0000","last_active":"2023-10-09T11:41:12.059445+0000","last_peered":"2023-10-09T11:41:12.059445+0000","last_clean":"2023-10-09T11:41:12.059445+0000","last_became_active":"2023-10-09T11:41:12.051978+0000","last_became_peered":"2023-10-09T11:41:12.051978+0000","last_unstale":"2023-10-09T11:41:12.059445+0000","last_undegraded":"2023-10-09T11:41:12.059445+0000","last_fullsized":"2023-10-09T11:41:12.059445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.076948+0000","last_change":"2023-10-09T11:41:11.076948+0000","last_active":"2023-10-09T11:41:11.076948+0000","last_peered":"2023-10-09T11:41:11.076948+0000","last_clean":"2023-10-09T11:41:11.076948+0000","last_became_active":"2023-10-09T11:41:11.076489+0000","last_became_peered":"2023-10-09T11:41:11.076489+0000","last_unstale":"2023-10-09T11:41:11.076948+0000","last_undegraded":"2023-10-09T11:41:11.076948+0000","last_fullsized":"2023-10-09T11:41:11.076948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057619+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.078229+0000","last_change":"2023-10-09T11:41:11.077460+0000","last_active":"2023-10-09T11:41:11.078229+0000","last_peered":"2023-10-09T11:41:11.078229+0000","last_clean":"2023-10-09T11:41:11.078229+0000","last_became_active":"2023-10-09T11:41:11.077192+0000","last_became_peered":"2023-10-09T11:41:11.077192+0000","last_unstale":"2023-10-09T11:41:11.078229+0000","last_undegraded":"2023-10-09T11:41:11.078229+0000","last_fullsized":"2023-10-09T11:41:11.078229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:56.491552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.061884+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086287+0000","last_change":"2023-10-09T11:41:11.060748+0000","last_active":"2023-10-09T11:41:12.086287+0000","last_peered":"2023-10-09T11:41:12.086287+0000","last_clean":"2023-10-09T11:41:12.086287+0000","last_became_active":"2023-10-09T11:41:11.060436+0000","last_became_peered":"2023-10-09T11:41:11.060436+0000","last_unstale":"2023-10-09T11:41:12.086287+0000","last_undegraded":"2023-10-09T11:41:12.086287+0000","last_fullsized":"2023-10-09T11:41:12.086287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056097+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084562+0000","last_change":"2023-10-09T11:41:11.066536+0000","last_active":"2023-10-09T11:41:12.084562+0000","last_peered":"2023-10-09T11:41:12.084562+0000","last_clean":"2023-10-09T11:41:12.084562+0000","last_became_active":"2023-10-09T11:41:11.066194+0000","last_became_peered":"2023-10-09T11:41:11.066194+0000","last_unstale":"2023-10-09T11:41:12.084562+0000","last_undegraded":"2023-10-09T11:41:12.084562+0000","last_fullsized":"2023-10-09T11:41:12.084562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.062688+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059981+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.056111+0000","last_change":"2023-10-09T11:41:12.056111+0000","last_active":"2023-10-09T11:41:12.056111+0000","last_peered":"2023-10-09T11:41:12.056111+0000","last_clean":"2023-10-09T11:41:12.056111+0000","last_became_active":"2023-10-09T11:41:12.055843+0000","last_became_peered":"2023-10-09T11:41:12.055843+0000","last_unstale":"2023-10-09T11:41:12.056111+0000","last_undegraded":"2023-10-09T11:41:12.056111+0000","last_fullsized":"2023-10-09T11:41:12.056111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:43.783508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057160+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053222+0000","last_change":"2023-10-09T11:41:12.051485+0000","last_active":"2023-10-09T11:41:12.053222+0000","last_peered":"2023-10-09T11:41:12.053222+0000","last_clean":"2023-10-09T11:41:12.053222+0000","last_became_active":"2023-10-09T11:41:12.051192+0000","last_became_peered":"2023-10-09T11:41:12.051192+0000","last_unstale":"2023-10-09T11:41:12.053222+0000","last_undegraded":"2023-10-09T11:41:12.053222+0000","last_fullsized":"2023-10-09T11:41:12.053222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062890+0000","last_change":"2023-10-09T11:41:12.059625+0000","last_active":"2023-10-09T11:41:12.062890+0000","last_peered":"2023-10-09T11:41:12.062890+0000","last_clean":"2023-10-09T11:41:12.062890+0000","last_became_active":"2023-10-09T11:41:12.059319+0000","last_became_peered":"2023-10-09T11:41:12.059319+0000","last_unstale":"2023-10-09T11:41:12.062890+0000","last_undegraded":"2023-10-09T11:41:12.062890+0000","last_fullsized":"2023-10-09T11:41:12.062890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061223+0000","last_change":"2023-10-09T11:41:12.059993+0000","last_active":"2023-10-09T11:41:12.061223+0000","last_peered":"2023-10-09T11:41:12.061223+0000","last_clean":"2023-10-09T11:41:12.061223+0000","last_became_active":"2023-10-09T11:41:12.059604+0000","last_became_peered":"2023-10-09T11:41:12.059604+0000","last_unstale":"2023-10-09T11:41:12.061223+0000","last_undegraded":"2023-10-09T11:41:12.061223+0000","last_fullsized":"2023-10-09T11:41:12.061223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058055+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060308+0000","last_change":"2023-10-09T11:41:12.058708+0000","last_active":"2023-10-09T11:41:12.060308+0000","last_peered":"2023-10-09T11:41:12.060308+0000","last_clean":"2023-10-09T11:41:12.060308+0000","last_became_active":"2023-10-09T11:41:12.058356+0000","last_became_peered":"2023-10-09T11:41:12.058356+0000","last_unstale":"2023-10-09T11:41:12.060308+0000","last_undegraded":"2023-10-09T11:41:12.060308+0000","last_fullsized":"2023-10-09T11:41:12.060308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053154+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063421+0000","last_change":"2023-10-09T11:41:12.059080+0000","last_active":"2023-10-09T11:41:12.063421+0000","last_peered":"2023-10-09T11:41:12.063421+0000","last_clean":"2023-10-09T11:41:12.063421+0000","last_became_active":"2023-10-09T11:41:12.056426+0000","last_became_peered":"2023-10-09T11:41:12.056426+0000","last_unstale":"2023-10-09T11:41:12.063421+0000","last_undegraded":"2023-10-09T11:41:12.063421+0000","last_fullsized":"2023-10-09T11:41:12.063421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057664+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053983+0000","last_change":"2023-10-09T11:41:12.052767+0000","last_active":"2023-10-09T11:41:12.053983+0000","last_peered":"2023-10-09T11:41:12.053983+0000","last_clean":"2023-10-09T11:41:12.053983+0000","last_became_active":"2023-10-09T11:41:12.052111+0000","last_became_peered":"2023-10-09T11:41:12.052111+0000","last_unstale":"2023-10-09T11:41:12.053983+0000","last_undegraded":"2023-10-09T11:41:12.053983+0000","last_fullsized":"2023-10-09T11:41:12.053983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055663+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476740,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":646334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":68992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:16.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:17.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.046+0000 7f703a39d700 1 Processor -- start 2023-10-09T11:41:17.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.046+0000 7f703a39d700 1 -- start start 2023-10-09T11:41:17.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.047+0000 7f703a39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f70341597f0 0x7f70340b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.047+0000 7f703a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f703415d230 0x7f703415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.047+0000 7f703a39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703415dbb0 con 0x7f7034159420 2023-10-09T11:41:17.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.047+0000 7f703a39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340b11d0 con 0x7f70341597f0 2023-10-09T11:41:17.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.047+0000 7f703a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70340b14b0 con 0x7f703415d230 2023-10-09T11:41:17.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f7038b9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f70341597f0 0x7f70340b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f7039b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f703415d230 0x7f703415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f703939b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7034159420 0x7f70340b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55570/0 (socket says 172.21.15.86:55570) 2023-10-09T11:41:17.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f703939b700 1 -- 172.21.15.86:0/2324526602 learned_addr learned my addr 172.21.15.86:0/2324526602 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:17.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f7039b9c700 1 -- 172.21.15.86:0/2324526602 >> v2:172.21.15.135:3300/0 conn(0x7f70341597f0 msgr2=0x7f70340b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f7039b9c700 1 --2- 172.21.15.86:0/2324526602 >> v2:172.21.15.135:3300/0 conn(0x7f70341597f0 0x7f70340b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f7039b9c700 1 -- 172.21.15.86:0/2324526602 >> v1:172.21.15.135:6789/0 conn(0x7f7034159420 legacy=0x7f70340b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f7039b9c700 1 -- 172.21.15.86:0/2324526602 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340b1790 con 0x7f703415d230 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.048+0000 7f7038b9a700 1 --2- 172.21.15.86:0/2324526602 >> v2:172.21.15.135:3300/0 conn(0x7f70341597f0 0x7f70340b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f7039b9c700 1 --2- 172.21.15.86:0/2324526602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f703415d230 0x7f703415d670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f702c009e60 tx=0x7f702c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f393559fcd6b6c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f702bfff700 1 -- 172.21.15.86:0/2324526602 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00e070 con 0x7f703415d230 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f702bfff700 1 -- 172.21.15.86:0/2324526602 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00bb60 con 0x7f703415d230 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f702bfff700 1 -- 172.21.15.86:0/2324526602 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c012430 con 0x7f703415d230 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f703a39d700 1 -- 172.21.15.86:0/2324526602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f703415d230 msgr2=0x7f703415d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f703a39d700 1 --2- 172.21.15.86:0/2324526602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f703415d230 0x7f703415d670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f702c009e60 tx=0x7f702c009780 comp rx=0 tx=0).stop 2023-10-09T11:41:17.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f703a39d700 1 -- 172.21.15.86:0/2324526602 shutdown_connections 2023-10-09T11:41:17.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f703a39d700 1 --2- 172.21.15.86:0/2324526602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f703415d230 0x7f703415d670 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.049+0000 7f703a39d700 1 --2- 172.21.15.86:0/2324526602 >> v2:172.21.15.135:3300/0 conn(0x7f70341597f0 0x7f70340b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.050+0000 7f703a39d700 1 -- 172.21.15.86:0/2324526602 >> 172.21.15.86:0/2324526602 conn(0x7f70340d0660 msgr2=0x7f70340d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.050+0000 7f703a39d700 1 -- 172.21.15.86:0/2324526602 shutdown_connections 2023-10-09T11:41:17.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.050+0000 7f703a39d700 1 -- 172.21.15.86:0/2324526602 wait complete. 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.051+0000 7f703a39d700 1 Processor -- start 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.051+0000 7f703a39d700 1 -- start start 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f703a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7034159420 0x7f70340c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f703a39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70341597f0 0x7f703415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f703a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f703415d230 0x7f7034157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f703a39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703415a5d0 con 0x7f70341597f0 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f703a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703415c8a0 con 0x7f703415d230 2023-10-09T11:41:17.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f703a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70340c7ed0 con 0x7f7034159420 2023-10-09T11:41:17.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f7038b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70341597f0 0x7f703415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f7038b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70341597f0 0x7f703415c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39372/0 (socket says 172.21.15.86:39372) 2023-10-09T11:41:17.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f7038b9a700 1 -- 172.21.15.86:0/1071771613 learned_addr learned my addr 172.21.15.86:0/1071771613 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:17.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f7039b9c700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f703415d230 0x7f7034157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.052+0000 7f703939b700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7034159420 0x7f70340c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f7038b9a700 1 -- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7034159420 msgr2=0x7f70340c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f7038b9a700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7034159420 0x7f70340c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f7038b9a700 1 -- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f703415d230 msgr2=0x7f7034157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f7038b9a700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f703415d230 0x7f7034157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f7038b9a700 1 -- 172.21.15.86:0/1071771613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024009420 con 0x7f70341597f0 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f7038b9a700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70341597f0 0x7f703415c360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f702400ecb0 tx=0x7f70240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f70297fa700 1 -- 172.21.15.86:0/1071771613 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400c920 con 0x7f70341597f0 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f70297fa700 1 -- 172.21.15.86:0/1071771613 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400ca80 con 0x7f70341597f0 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c009a20 con 0x7f70341597f0 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f70297fa700 1 -- 172.21.15.86:0/1071771613 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400ce20 con 0x7f70341597f0 2023-10-09T11:41:17.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.053+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7034159f80 con 0x7f70341597f0 2023-10-09T11:41:17.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.054+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703404c3c0 con 0x7f70341597f0 2023-10-09T11:41:17.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.055+0000 7f70297fa700 1 -- 172.21.15.86:0/1071771613 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7024013680 con 0x7f70341597f0 2023-10-09T11:41:17.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.056+0000 7f70297fa700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7018066f30 0x7f70180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.056+0000 7f70297fa700 1 -- 172.21.15.86:0/1071771613 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70240846d0 con 0x7f70341597f0 2023-10-09T11:41:17.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.056+0000 7f703939b700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7018066f30 0x7f70180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.057+0000 7f703939b700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7018066f30 0x7f70180693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7030007130 tx=0x7f7030007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.060+0000 7f70297fa700 1 -- 172.21.15.86:0/1071771613 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70240518a0 con 0x7f70341597f0 2023-10-09T11:41:17.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.248+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70340b3e50 con 0x7f7018066f30 2023-10-09T11:41:17.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.255+0000 7f70297fa700 1 -- 172.21.15.86:0/1071771613 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263063 (secure 0 0 0) 0x7f70340b3e50 con 0x7f7018066f30 2023-10-09T11:41:17.260 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:17.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.259+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7018066f30 msgr2=0x7f70180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.259+0000 7f703a39d700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7018066f30 0x7f70180693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7030007130 tx=0x7f7030007eb0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.259+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70341597f0 msgr2=0x7f703415c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.259+0000 7f703a39d700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70341597f0 0x7f703415c360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f702400ecb0 tx=0x7f70240091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 shutdown_connections 2023-10-09T11:41:17.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7018066f30 0x7f70180693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f703415d230 0x7f7034157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7034159420 0x7f70340c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 --2- 172.21.15.86:0/1071771613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70341597f0 0x7f703415c360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 >> 172.21.15.86:0/1071771613 conn(0x7f70340d0660 msgr2=0x7f7034068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 shutdown_connections 2023-10-09T11:41:17.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.260+0000 7f703a39d700 1 -- 172.21.15.86:0/1071771613 wait complete. 2023-10-09T11:41:17.265 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:41:17.277 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T11:41:15.953484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591116,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381024,"kb_used_data":2720,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593696,"statfs":{"total":773094113280,"available":770655944704,"internally_reserved":0,"allocated":2785280,"data_stored":1695450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.911391"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.067210+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058844+0000","last_change":"2023-10-09T11:41:12.053292+0000","last_active":"2023-10-09T11:41:12.058844+0000","last_peered":"2023-10-09T11:41:12.058844+0000","last_clean":"2023-10-09T11:41:12.058844+0000","last_became_active":"2023-10-09T11:41:12.052978+0000","last_became_peered":"2023-10-09T11:41:12.052978+0000","last_unstale":"2023-10-09T11:41:12.058844+0000","last_undegraded":"2023-10-09T11:41:12.058844+0000","last_fullsized":"2023-10-09T11:41:12.058844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053403+0000","last_change":"2023-10-09T11:41:12.048670+0000","last_active":"2023-10-09T11:41:12.053403+0000","last_peered":"2023-10-09T11:41:12.053403+0000","last_clean":"2023-10-09T11:41:12.053403+0000","last_became_active":"2023-10-09T11:41:12.048364+0000","last_became_peered":"2023-10-09T11:41:12.048364+0000","last_unstale":"2023-10-09T11:41:12.053403+0000","last_undegraded":"2023-10-09T11:41:12.053403+0000","last_fullsized":"2023-10-09T11:41:12.053403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054306+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.060821+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058233+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.066734+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059474+0000","last_change":"2023-10-09T11:41:12.054453+0000","last_active":"2023-10-09T11:41:12.059474+0000","last_peered":"2023-10-09T11:41:12.059474+0000","last_clean":"2023-10-09T11:41:12.059474+0000","last_became_active":"2023-10-09T11:41:12.054117+0000","last_became_peered":"2023-10-09T11:41:12.054117+0000","last_unstale":"2023-10-09T11:41:12.059474+0000","last_undegraded":"2023-10-09T11:41:12.059474+0000","last_fullsized":"2023-10-09T11:41:12.059474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.054577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.064647+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057408+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054239+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053874+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:11.314302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059423+0000","last_change":"2023-10-09T11:41:12.052334+0000","last_active":"2023-10-09T11:41:12.059423+0000","last_peered":"2023-10-09T11:41:12.059423+0000","last_clean":"2023-10-09T11:41:12.059423+0000","last_became_active":"2023-10-09T11:41:12.051731+0000","last_became_peered":"2023-10-09T11:41:12.051731+0000","last_unstale":"2023-10-09T11:41:12.059423+0000","last_undegraded":"2023-10-09T11:41:12.059423+0000","last_fullsized":"2023-10-09T11:41:12.059423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:25.351610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053609+0000","last_change":"2023-10-09T11:41:12.051643+0000","last_active":"2023-10-09T11:41:12.053609+0000","last_peered":"2023-10-09T11:41:12.053609+0000","last_clean":"2023-10-09T11:41:12.053609+0000","last_became_active":"2023-10-09T11:41:12.051337+0000","last_became_peered":"2023-10-09T11:41:12.051337+0000","last_unstale":"2023-10-09T11:41:12.053609+0000","last_undegraded":"2023-10-09T11:41:12.053609+0000","last_fullsized":"2023-10-09T11:41:12.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:10.056568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059700+0000","last_change":"2023-10-09T11:41:12.058090+0000","last_active":"2023-10-09T11:41:12.059700+0000","last_peered":"2023-10-09T11:41:12.059700+0000","last_clean":"2023-10-09T11:41:12.059700+0000","last_became_active":"2023-10-09T11:41:12.057829+0000","last_became_peered":"2023-10-09T11:41:12.057829+0000","last_unstale":"2023-10-09T11:41:12.059700+0000","last_undegraded":"2023-10-09T11:41:12.059700+0000","last_fullsized":"2023-10-09T11:41:12.059700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058504+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058807+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.049265+0000","last_change":"2023-10-09T11:41:12.049265+0000","last_active":"2023-10-09T11:41:12.049265+0000","last_peered":"2023-10-09T11:41:12.049265+0000","last_clean":"2023-10-09T11:41:12.049265+0000","last_became_active":"2023-10-09T11:41:12.049000+0000","last_became_peered":"2023-10-09T11:41:12.049000+0000","last_unstale":"2023-10-09T11:41:12.049265+0000","last_undegraded":"2023-10-09T11:41:12.049265+0000","last_fullsized":"2023-10-09T11:41:12.049265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:17.015986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.065607+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.088830+0000","last_change":"2023-10-09T11:41:11.074267+0000","last_active":"2023-10-09T11:41:12.088830+0000","last_peered":"2023-10-09T11:41:12.088830+0000","last_clean":"2023-10-09T11:41:12.088830+0000","last_became_active":"2023-10-09T11:41:11.073971+0000","last_became_peered":"2023-10-09T11:41:11.073971+0000","last_unstale":"2023-10-09T11:41:12.088830+0000","last_undegraded":"2023-10-09T11:41:12.088830+0000","last_fullsized":"2023-10-09T11:41:12.088830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:17.546372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059770+0000","last_change":"2023-10-09T11:41:12.054265+0000","last_active":"2023-10-09T11:41:12.059770+0000","last_peered":"2023-10-09T11:41:12.059770+0000","last_clean":"2023-10-09T11:41:12.059770+0000","last_became_active":"2023-10-09T11:41:12.053826+0000","last_became_peered":"2023-10-09T11:41:12.053826+0000","last_unstale":"2023-10-09T11:41:12.059770+0000","last_undegraded":"2023-10-09T11:41:12.059770+0000","last_fullsized":"2023-10-09T11:41:12.059770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:00.372669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.085137+0000","last_change":"2023-10-09T11:41:11.063441+0000","last_active":"2023-10-09T11:41:12.085137+0000","last_peered":"2023-10-09T11:41:12.085137+0000","last_clean":"2023-10-09T11:41:12.085137+0000","last_became_active":"2023-10-09T11:41:11.063025+0000","last_became_peered":"2023-10-09T11:41:11.063025+0000","last_unstale":"2023-10-09T11:41:12.085137+0000","last_undegraded":"2023-10-09T11:41:12.085137+0000","last_fullsized":"2023-10-09T11:41:12.085137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:21.843438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063925+0000","last_change":"2023-10-09T11:41:12.058625+0000","last_active":"2023-10-09T11:41:12.063925+0000","last_peered":"2023-10-09T11:41:12.063925+0000","last_clean":"2023-10-09T11:41:12.063925+0000","last_became_active":"2023-10-09T11:41:12.057462+0000","last_became_peered":"2023-10-09T11:41:12.057462+0000","last_unstale":"2023-10-09T11:41:12.063925+0000","last_undegraded":"2023-10-09T11:41:12.063925+0000","last_fullsized":"2023-10-09T11:41:12.063925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079554+0000","last_change":"2023-10-09T11:41:11.079554+0000","last_active":"2023-10-09T11:41:11.079554+0000","last_peered":"2023-10-09T11:41:11.079554+0000","last_clean":"2023-10-09T11:41:11.079554+0000","last_became_active":"2023-10-09T11:41:11.079230+0000","last_became_peered":"2023-10-09T11:41:11.079230+0000","last_unstale":"2023-10-09T11:41:11.079554+0000","last_undegraded":"2023-10-09T11:41:11.079554+0000","last_fullsized":"2023-10-09T11:41:11.079554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059040+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.082099+0000","last_change":"2023-10-09T11:41:11.082099+0000","last_active":"2023-10-09T11:41:11.082099+0000","last_peered":"2023-10-09T11:41:11.082099+0000","last_clean":"2023-10-09T11:41:11.082099+0000","last_became_active":"2023-10-09T11:41:11.081703+0000","last_became_peered":"2023-10-09T11:41:11.081703+0000","last_unstale":"2023-10-09T11:41:11.082099+0000","last_undegraded":"2023-10-09T11:41:11.082099+0000","last_fullsized":"2023-10-09T11:41:11.082099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:59.333597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056823+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086469+0000","last_change":"2023-10-09T11:41:11.074679+0000","last_active":"2023-10-09T11:41:12.086469+0000","last_peered":"2023-10-09T11:41:12.086469+0000","last_clean":"2023-10-09T11:41:12.086469+0000","last_became_active":"2023-10-09T11:41:11.074362+0000","last_became_peered":"2023-10-09T11:41:11.074362+0000","last_unstale":"2023-10-09T11:41:12.086469+0000","last_undegraded":"2023-10-09T11:41:12.086469+0000","last_fullsized":"2023-10-09T11:41:12.086469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.054240+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:07.666003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.068876+0000","last_change":"2023-10-09T11:41:11.068876+0000","last_active":"2023-10-09T11:41:11.068876+0000","last_peered":"2023-10-09T11:41:11.068876+0000","last_clean":"2023-10-09T11:41:11.068876+0000","last_became_active":"2023-10-09T11:41:11.068602+0000","last_became_peered":"2023-10-09T11:41:11.068602+0000","last_unstale":"2023-10-09T11:41:11.068876+0000","last_undegraded":"2023-10-09T11:41:11.068876+0000","last_fullsized":"2023-10-09T11:41:11.068876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063758+0000","last_change":"2023-10-09T11:41:12.058551+0000","last_active":"2023-10-09T11:41:12.063758+0000","last_peered":"2023-10-09T11:41:12.063758+0000","last_clean":"2023-10-09T11:41:12.063758+0000","last_became_active":"2023-10-09T11:41:12.056962+0000","last_became_peered":"2023-10-09T11:41:12.056962+0000","last_unstale":"2023-10-09T11:41:12.063758+0000","last_undegraded":"2023-10-09T11:41:12.063758+0000","last_fullsized":"2023-10-09T11:41:12.063758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.038859+0000","last_change":"2023-10-09T11:41:11.072956+0000","last_active":"2023-10-09T11:41:12.038859+0000","last_peered":"2023-10-09T11:41:12.038859+0000","last_clean":"2023-10-09T11:41:12.038859+0000","last_became_active":"2023-10-09T11:41:11.072711+0000","last_became_peered":"2023-10-09T11:41:11.072711+0000","last_unstale":"2023-10-09T11:41:12.038859+0000","last_undegraded":"2023-10-09T11:41:12.038859+0000","last_fullsized":"2023-10-09T11:41:12.038859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060221+0000","last_change":"2023-10-09T11:41:12.056233+0000","last_active":"2023-10-09T11:41:12.060221+0000","last_peered":"2023-10-09T11:41:12.060221+0000","last_clean":"2023-10-09T11:41:12.060221+0000","last_became_active":"2023-10-09T11:41:12.055836+0000","last_became_peered":"2023-10-09T11:41:12.055836+0000","last_unstale":"2023-10-09T11:41:12.060221+0000","last_undegraded":"2023-10-09T11:41:12.060221+0000","last_fullsized":"2023-10-09T11:41:12.060221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.076596+0000","last_change":"2023-10-09T11:41:11.076596+0000","last_active":"2023-10-09T11:41:11.076596+0000","last_peered":"2023-10-09T11:41:11.076596+0000","last_clean":"2023-10-09T11:41:11.076596+0000","last_became_active":"2023-10-09T11:41:11.075211+0000","last_became_peered":"2023-10-09T11:41:11.075211+0000","last_unstale":"2023-10-09T11:41:11.076596+0000","last_undegraded":"2023-10-09T11:41:11.076596+0000","last_fullsized":"2023-10-09T11:41:11.076596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061196+0000","last_change":"2023-10-09T11:41:12.059816+0000","last_active":"2023-10-09T11:41:12.061196+0000","last_peered":"2023-10-09T11:41:12.061196+0000","last_clean":"2023-10-09T11:41:12.061196+0000","last_became_active":"2023-10-09T11:41:12.059529+0000","last_became_peered":"2023-10-09T11:41:12.059529+0000","last_unstale":"2023-10-09T11:41:12.061196+0000","last_undegraded":"2023-10-09T11:41:12.061196+0000","last_fullsized":"2023-10-09T11:41:12.061196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077704+0000","last_change":"2023-10-09T11:41:11.077704+0000","last_active":"2023-10-09T11:41:11.077704+0000","last_peered":"2023-10-09T11:41:11.077704+0000","last_clean":"2023-10-09T11:41:11.077704+0000","last_became_active":"2023-10-09T11:41:11.077405+0000","last_became_peered":"2023-10-09T11:41:11.077405+0000","last_unstale":"2023-10-09T11:41:11.077704+0000","last_undegraded":"2023-10-09T11:41:11.077704+0000","last_fullsized":"2023-10-09T11:41:11.077704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056731+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.071764+0000","last_change":"2023-10-09T11:41:11.071764+0000","last_active":"2023-10-09T11:41:11.071764+0000","last_peered":"2023-10-09T11:41:11.071764+0000","last_clean":"2023-10-09T11:41:11.071764+0000","last_became_active":"2023-10-09T11:41:11.070619+0000","last_became_peered":"2023-10-09T11:41:11.070619+0000","last_unstale":"2023-10-09T11:41:11.071764+0000","last_undegraded":"2023-10-09T11:41:11.071764+0000","last_fullsized":"2023-10-09T11:41:11.071764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063724+0000","last_change":"2023-10-09T11:41:12.057796+0000","last_active":"2023-10-09T11:41:12.063724+0000","last_peered":"2023-10-09T11:41:12.063724+0000","last_clean":"2023-10-09T11:41:12.063724+0000","last_became_active":"2023-10-09T11:41:12.057536+0000","last_became_peered":"2023-10-09T11:41:12.057536+0000","last_unstale":"2023-10-09T11:41:12.063724+0000","last_undegraded":"2023-10-09T11:41:12.063724+0000","last_fullsized":"2023-10-09T11:41:12.063724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086648+0000","last_change":"2023-10-09T11:41:11.077183+0000","last_active":"2023-10-09T11:41:12.086648+0000","last_peered":"2023-10-09T11:41:12.086648+0000","last_clean":"2023-10-09T11:41:12.086648+0000","last_became_active":"2023-10-09T11:41:11.076940+0000","last_became_peered":"2023-10-09T11:41:11.076940+0000","last_unstale":"2023-10-09T11:41:12.086648+0000","last_undegraded":"2023-10-09T11:41:12.086648+0000","last_fullsized":"2023-10-09T11:41:12.086648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.052869+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:29.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.068939+0000","last_change":"2023-10-09T11:41:11.068939+0000","last_active":"2023-10-09T11:41:11.068939+0000","last_peered":"2023-10-09T11:41:11.068939+0000","last_clean":"2023-10-09T11:41:11.068939+0000","last_became_active":"2023-10-09T11:41:11.068555+0000","last_became_peered":"2023-10-09T11:41:11.068555+0000","last_unstale":"2023-10-09T11:41:11.068939+0000","last_undegraded":"2023-10-09T11:41:11.068939+0000","last_fullsized":"2023-10-09T11:41:11.068939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.063229+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086499+0000","last_change":"2023-10-09T11:41:11.065387+0000","last_active":"2023-10-09T11:41:12.086499+0000","last_peered":"2023-10-09T11:41:12.086499+0000","last_clean":"2023-10-09T11:41:12.086499+0000","last_became_active":"2023-10-09T11:41:11.065121+0000","last_became_peered":"2023-10-09T11:41:11.065121+0000","last_unstale":"2023-10-09T11:41:12.086499+0000","last_undegraded":"2023-10-09T11:41:12.086499+0000","last_fullsized":"2023-10-09T11:41:12.086499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:19.832054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053962+0000","last_change":"2023-10-09T11:41:12.052247+0000","last_active":"2023-10-09T11:41:12.053962+0000","last_peered":"2023-10-09T11:41:12.053962+0000","last_clean":"2023-10-09T11:41:12.053962+0000","last_became_active":"2023-10-09T11:41:12.051882+0000","last_became_peered":"2023-10-09T11:41:12.051882+0000","last_unstale":"2023-10-09T11:41:12.053962+0000","last_undegraded":"2023-10-09T11:41:12.053962+0000","last_fullsized":"2023-10-09T11:41:12.053962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077221+0000","last_change":"2023-10-09T11:41:11.077221+0000","last_active":"2023-10-09T11:41:11.077221+0000","last_peered":"2023-10-09T11:41:11.077221+0000","last_clean":"2023-10-09T11:41:11.077221+0000","last_became_active":"2023-10-09T11:41:11.075558+0000","last_became_peered":"2023-10-09T11:41:11.075558+0000","last_unstale":"2023-10-09T11:41:11.077221+0000","last_undegraded":"2023-10-09T11:41:11.077221+0000","last_fullsized":"2023-10-09T11:41:11.077221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.060267+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.069670+0000","last_change":"2023-10-09T11:41:11.069670+0000","last_active":"2023-10-09T11:41:11.069670+0000","last_peered":"2023-10-09T11:41:11.069670+0000","last_clean":"2023-10-09T11:41:11.069670+0000","last_became_active":"2023-10-09T11:41:11.069325+0000","last_became_peered":"2023-10-09T11:41:11.069325+0000","last_unstale":"2023-10-09T11:41:11.069670+0000","last_undegraded":"2023-10-09T11:41:11.069670+0000","last_fullsized":"2023-10-09T11:41:11.069670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059248+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087160+0000","last_change":"2023-10-09T11:41:11.066464+0000","last_active":"2023-10-09T11:41:12.087160+0000","last_peered":"2023-10-09T11:41:12.087160+0000","last_clean":"2023-10-09T11:41:12.087160+0000","last_became_active":"2023-10-09T11:41:11.066166+0000","last_became_peered":"2023-10-09T11:41:11.066166+0000","last_unstale":"2023-10-09T11:41:12.087160+0000","last_undegraded":"2023-10-09T11:41:12.087160+0000","last_fullsized":"2023-10-09T11:41:12.087160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:02.875341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059803+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.065898+0000","last_change":"2023-10-09T11:41:11.065898+0000","last_active":"2023-10-09T11:41:11.065898+0000","last_peered":"2023-10-09T11:41:11.065898+0000","last_clean":"2023-10-09T11:41:11.065898+0000","last_became_active":"2023-10-09T11:41:11.065594+0000","last_became_peered":"2023-10-09T11:41:11.065594+0000","last_unstale":"2023-10-09T11:41:11.065898+0000","last_undegraded":"2023-10-09T11:41:11.065898+0000","last_fullsized":"2023-10-09T11:41:11.065898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:55.877969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.062240+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045586+0000","last_change":"2023-10-09T11:41:11.062024+0000","last_active":"2023-10-09T11:41:12.045586+0000","last_peered":"2023-10-09T11:41:12.045586+0000","last_clean":"2023-10-09T11:41:12.045586+0000","last_became_active":"2023-10-09T11:41:11.061759+0000","last_became_peered":"2023-10-09T11:41:11.061759+0000","last_unstale":"2023-10-09T11:41:12.045586+0000","last_undegraded":"2023-10-09T11:41:12.045586+0000","last_fullsized":"2023-10-09T11:41:12.045586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:28.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053238+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.077710+0000","last_change":"2023-10-09T11:41:11.077710+0000","last_active":"2023-10-09T11:41:11.077710+0000","last_peered":"2023-10-09T11:41:11.077710+0000","last_clean":"2023-10-09T11:41:11.077710+0000","last_became_active":"2023-10-09T11:41:11.077435+0000","last_became_peered":"2023-10-09T11:41:11.077435+0000","last_unstale":"2023-10-09T11:41:11.077710+0000","last_undegraded":"2023-10-09T11:41:11.077710+0000","last_fullsized":"2023-10-09T11:41:11.077710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055194+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:27.313199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055235+0000","last_change":"2023-10-09T11:41:12.048312+0000","last_active":"2023-10-09T11:41:12.055235+0000","last_peered":"2023-10-09T11:41:12.055235+0000","last_clean":"2023-10-09T11:41:12.055235+0000","last_became_active":"2023-10-09T11:41:12.048029+0000","last_became_peered":"2023-10-09T11:41:12.048029+0000","last_unstale":"2023-10-09T11:41:12.055235+0000","last_undegraded":"2023-10-09T11:41:12.055235+0000","last_fullsized":"2023-10-09T11:41:12.055235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.069456+0000","last_change":"2023-10-09T11:41:11.065740+0000","last_active":"2023-10-09T11:41:11.069456+0000","last_peered":"2023-10-09T11:41:11.069456+0000","last_clean":"2023-10-09T11:41:11.069456+0000","last_became_active":"2023-10-09T11:41:11.065420+0000","last_became_peered":"2023-10-09T11:41:11.065420+0000","last_unstale":"2023-10-09T11:41:11.069456+0000","last_undegraded":"2023-10-09T11:41:11.069456+0000","last_fullsized":"2023-10-09T11:41:11.069456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.067543+0000","last_change":"2023-10-09T11:41:12.063341+0000","last_active":"2023-10-09T11:41:12.067543+0000","last_peered":"2023-10-09T11:41:12.067543+0000","last_clean":"2023-10-09T11:41:12.067543+0000","last_became_active":"2023-10-09T11:41:12.063063+0000","last_became_peered":"2023-10-09T11:41:12.063063+0000","last_unstale":"2023-10-09T11:41:12.067543+0000","last_undegraded":"2023-10-09T11:41:12.067543+0000","last_fullsized":"2023-10-09T11:41:12.067543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.064371+0000","last_change":"2023-10-09T11:41:11.064371+0000","last_active":"2023-10-09T11:41:11.064371+0000","last_peered":"2023-10-09T11:41:11.064371+0000","last_clean":"2023-10-09T11:41:11.064371+0000","last_became_active":"2023-10-09T11:41:11.064027+0000","last_became_peered":"2023-10-09T11:41:11.064027+0000","last_unstale":"2023-10-09T11:41:11.064371+0000","last_undegraded":"2023-10-09T11:41:11.064371+0000","last_fullsized":"2023-10-09T11:41:11.064371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":161,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:41:10.052394+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:41:10.052394+0000","last_peered":"2023-10-09T11:41:10.052394+0000","last_clean":"2023-10-09T11:41:10.052394+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:41:10.052394+0000","last_undegraded":"2023-10-09T11:41:10.052394+0000","last_fullsized":"2023-10-09T11:41:10.052394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063606+0000","last_change":"2023-10-09T11:41:12.057248+0000","last_active":"2023-10-09T11:41:12.063606+0000","last_peered":"2023-10-09T11:41:12.063606+0000","last_clean":"2023-10-09T11:41:12.063606+0000","last_became_active":"2023-10-09T11:41:12.056873+0000","last_became_peered":"2023-10-09T11:41:12.056873+0000","last_unstale":"2023-10-09T11:41:12.063606+0000","last_undegraded":"2023-10-09T11:41:12.063606+0000","last_fullsized":"2023-10-09T11:41:12.063606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:16.551009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079718+0000","last_change":"2023-10-09T11:41:11.079718+0000","last_active":"2023-10-09T11:41:11.079718+0000","last_peered":"2023-10-09T11:41:11.079718+0000","last_clean":"2023-10-09T11:41:11.079718+0000","last_became_active":"2023-10-09T11:41:11.079488+0000","last_became_peered":"2023-10-09T11:41:11.079488+0000","last_unstale":"2023-10-09T11:41:11.079718+0000","last_undegraded":"2023-10-09T11:41:11.079718+0000","last_fullsized":"2023-10-09T11:41:11.079718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.075456+0000","last_change":"2023-10-09T11:41:11.075456+0000","last_active":"2023-10-09T11:41:11.075456+0000","last_peered":"2023-10-09T11:41:11.075456+0000","last_clean":"2023-10-09T11:41:11.075456+0000","last_became_active":"2023-10-09T11:41:11.074500+0000","last_became_peered":"2023-10-09T11:41:11.074500+0000","last_unstale":"2023-10-09T11:41:11.075456+0000","last_undegraded":"2023-10-09T11:41:11.075456+0000","last_fullsized":"2023-10-09T11:41:11.075456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055214+0000","last_change":"2023-10-09T11:41:12.050593+0000","last_active":"2023-10-09T11:41:12.055214+0000","last_peered":"2023-10-09T11:41:12.055214+0000","last_clean":"2023-10-09T11:41:12.055214+0000","last_became_active":"2023-10-09T11:41:12.050327+0000","last_became_peered":"2023-10-09T11:41:12.050327+0000","last_unstale":"2023-10-09T11:41:12.055214+0000","last_undegraded":"2023-10-09T11:41:12.055214+0000","last_fullsized":"2023-10-09T11:41:12.055214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045891+0000","last_change":"2023-10-09T11:41:11.062590+0000","last_active":"2023-10-09T11:41:12.045891+0000","last_peered":"2023-10-09T11:41:12.045891+0000","last_clean":"2023-10-09T11:41:12.045891+0000","last_became_active":"2023-10-09T11:41:11.062303+0000","last_became_peered":"2023-10-09T11:41:11.062303+0000","last_unstale":"2023-10-09T11:41:12.045891+0000","last_undegraded":"2023-10-09T11:41:12.045891+0000","last_fullsized":"2023-10-09T11:41:12.045891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062836+0000","last_change":"2023-10-09T11:41:12.059380+0000","last_active":"2023-10-09T11:41:12.062836+0000","last_peered":"2023-10-09T11:41:12.062836+0000","last_clean":"2023-10-09T11:41:12.062836+0000","last_became_active":"2023-10-09T11:41:12.059091+0000","last_became_peered":"2023-10-09T11:41:12.059091+0000","last_unstale":"2023-10-09T11:41:12.062836+0000","last_undegraded":"2023-10-09T11:41:12.062836+0000","last_fullsized":"2023-10-09T11:41:12.062836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:41.207515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.074722+0000","last_change":"2023-10-09T11:41:11.074722+0000","last_active":"2023-10-09T11:41:11.074722+0000","last_peered":"2023-10-09T11:41:11.074722+0000","last_clean":"2023-10-09T11:41:11.074722+0000","last_became_active":"2023-10-09T11:41:11.074417+0000","last_became_peered":"2023-10-09T11:41:11.074417+0000","last_unstale":"2023-10-09T11:41:11.074722+0000","last_undegraded":"2023-10-09T11:41:11.074722+0000","last_fullsized":"2023-10-09T11:41:11.074722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053509+0000","last_change":"2023-10-09T11:41:12.051884+0000","last_active":"2023-10-09T11:41:12.053509+0000","last_peered":"2023-10-09T11:41:12.053509+0000","last_clean":"2023-10-09T11:41:12.053509+0000","last_became_active":"2023-10-09T11:41:12.051012+0000","last_became_peered":"2023-10-09T11:41:12.051012+0000","last_unstale":"2023-10-09T11:41:12.053509+0000","last_undegraded":"2023-10-09T11:41:12.053509+0000","last_fullsized":"2023-10-09T11:41:12.053509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:59.214273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.079256+0000","last_change":"2023-10-09T11:41:11.079256+0000","last_active":"2023-10-09T11:41:11.079256+0000","last_peered":"2023-10-09T11:41:11.079256+0000","last_clean":"2023-10-09T11:41:11.079256+0000","last_became_active":"2023-10-09T11:41:11.078999+0000","last_became_peered":"2023-10-09T11:41:11.078999+0000","last_unstale":"2023-10-09T11:41:11.079256+0000","last_undegraded":"2023-10-09T11:41:11.079256+0000","last_fullsized":"2023-10-09T11:41:11.079256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055464+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:25.252259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045174+0000","last_change":"2023-10-09T11:41:11.074785+0000","last_active":"2023-10-09T11:41:12.045174+0000","last_peered":"2023-10-09T11:41:12.045174+0000","last_clean":"2023-10-09T11:41:12.045174+0000","last_became_active":"2023-10-09T11:41:11.074460+0000","last_became_peered":"2023-10-09T11:41:11.074460+0000","last_unstale":"2023-10-09T11:41:12.045174+0000","last_undegraded":"2023-10-09T11:41:12.045174+0000","last_fullsized":"2023-10-09T11:41:12.045174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055406+0000","last_change":"2023-10-09T11:41:12.050021+0000","last_active":"2023-10-09T11:41:12.055406+0000","last_peered":"2023-10-09T11:41:12.055406+0000","last_clean":"2023-10-09T11:41:12.055406+0000","last_became_active":"2023-10-09T11:41:12.049763+0000","last_became_peered":"2023-10-09T11:41:12.049763+0000","last_unstale":"2023-10-09T11:41:12.055406+0000","last_undegraded":"2023-10-09T11:41:12.055406+0000","last_fullsized":"2023-10-09T11:41:12.055406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045561+0000","last_change":"2023-10-09T11:41:11.063645+0000","last_active":"2023-10-09T11:41:12.045561+0000","last_peered":"2023-10-09T11:41:12.045561+0000","last_clean":"2023-10-09T11:41:12.045561+0000","last_became_active":"2023-10-09T11:41:11.063324+0000","last_became_peered":"2023-10-09T11:41:11.063324+0000","last_unstale":"2023-10-09T11:41:12.045561+0000","last_undegraded":"2023-10-09T11:41:12.045561+0000","last_fullsized":"2023-10-09T11:41:12.045561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059445+0000","last_change":"2023-10-09T11:41:12.053917+0000","last_active":"2023-10-09T11:41:12.059445+0000","last_peered":"2023-10-09T11:41:12.059445+0000","last_clean":"2023-10-09T11:41:12.059445+0000","last_became_active":"2023-10-09T11:41:12.051978+0000","last_became_peered":"2023-10-09T11:41:12.051978+0000","last_unstale":"2023-10-09T11:41:12.059445+0000","last_undegraded":"2023-10-09T11:41:12.059445+0000","last_fullsized":"2023-10-09T11:41:12.059445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.076948+0000","last_change":"2023-10-09T11:41:11.076948+0000","last_active":"2023-10-09T11:41:11.076948+0000","last_peered":"2023-10-09T11:41:11.076948+0000","last_clean":"2023-10-09T11:41:11.076948+0000","last_became_active":"2023-10-09T11:41:11.076489+0000","last_became_peered":"2023-10-09T11:41:11.076489+0000","last_unstale":"2023-10-09T11:41:11.076948+0000","last_undegraded":"2023-10-09T11:41:11.076948+0000","last_fullsized":"2023-10-09T11:41:11.076948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057619+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.078229+0000","last_change":"2023-10-09T11:41:11.077460+0000","last_active":"2023-10-09T11:41:11.078229+0000","last_peered":"2023-10-09T11:41:11.078229+0000","last_clean":"2023-10-09T11:41:11.078229+0000","last_became_active":"2023-10-09T11:41:11.077192+0000","last_became_peered":"2023-10-09T11:41:11.077192+0000","last_unstale":"2023-10-09T11:41:11.078229+0000","last_undegraded":"2023-10-09T11:41:11.078229+0000","last_fullsized":"2023-10-09T11:41:11.078229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:56.491552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.061884+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086287+0000","last_change":"2023-10-09T11:41:11.060748+0000","last_active":"2023-10-09T11:41:12.086287+0000","last_peered":"2023-10-09T11:41:12.086287+0000","last_clean":"2023-10-09T11:41:12.086287+0000","last_became_active":"2023-10-09T11:41:11.060436+0000","last_became_peered":"2023-10-09T11:41:11.060436+0000","last_unstale":"2023-10-09T11:41:12.086287+0000","last_undegraded":"2023-10-09T11:41:12.086287+0000","last_fullsized":"2023-10-09T11:41:12.086287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.056097+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084562+0000","last_change":"2023-10-09T11:41:11.066536+0000","last_active":"2023-10-09T11:41:12.084562+0000","last_peered":"2023-10-09T11:41:12.084562+0000","last_clean":"2023-10-09T11:41:12.084562+0000","last_became_active":"2023-10-09T11:41:11.066194+0000","last_became_peered":"2023-10-09T11:41:11.066194+0000","last_unstale":"2023-10-09T11:41:12.084562+0000","last_undegraded":"2023-10-09T11:41:12.084562+0000","last_fullsized":"2023-10-09T11:41:12.084562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.062688+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.059981+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.056111+0000","last_change":"2023-10-09T11:41:12.056111+0000","last_active":"2023-10-09T11:41:12.056111+0000","last_peered":"2023-10-09T11:41:12.056111+0000","last_clean":"2023-10-09T11:41:12.056111+0000","last_became_active":"2023-10-09T11:41:12.055843+0000","last_became_peered":"2023-10-09T11:41:12.055843+0000","last_unstale":"2023-10-09T11:41:12.056111+0000","last_undegraded":"2023-10-09T11:41:12.056111+0000","last_fullsized":"2023-10-09T11:41:12.056111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:43.783508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057160+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053222+0000","last_change":"2023-10-09T11:41:12.051485+0000","last_active":"2023-10-09T11:41:12.053222+0000","last_peered":"2023-10-09T11:41:12.053222+0000","last_clean":"2023-10-09T11:41:12.053222+0000","last_became_active":"2023-10-09T11:41:12.051192+0000","last_became_peered":"2023-10-09T11:41:12.051192+0000","last_unstale":"2023-10-09T11:41:12.053222+0000","last_undegraded":"2023-10-09T11:41:12.053222+0000","last_fullsized":"2023-10-09T11:41:12.053222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062890+0000","last_change":"2023-10-09T11:41:12.059625+0000","last_active":"2023-10-09T11:41:12.062890+0000","last_peered":"2023-10-09T11:41:12.062890+0000","last_clean":"2023-10-09T11:41:12.062890+0000","last_became_active":"2023-10-09T11:41:12.059319+0000","last_became_peered":"2023-10-09T11:41:12.059319+0000","last_unstale":"2023-10-09T11:41:12.062890+0000","last_undegraded":"2023-10-09T11:41:12.062890+0000","last_fullsized":"2023-10-09T11:41:12.062890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061223+0000","last_change":"2023-10-09T11:41:12.059993+0000","last_active":"2023-10-09T11:41:12.061223+0000","last_peered":"2023-10-09T11:41:12.061223+0000","last_clean":"2023-10-09T11:41:12.061223+0000","last_became_active":"2023-10-09T11:41:12.059604+0000","last_became_peered":"2023-10-09T11:41:12.059604+0000","last_unstale":"2023-10-09T11:41:12.061223+0000","last_undegraded":"2023-10-09T11:41:12.061223+0000","last_fullsized":"2023-10-09T11:41:12.061223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.058055+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060308+0000","last_change":"2023-10-09T11:41:12.058708+0000","last_active":"2023-10-09T11:41:12.060308+0000","last_peered":"2023-10-09T11:41:12.060308+0000","last_clean":"2023-10-09T11:41:12.060308+0000","last_became_active":"2023-10-09T11:41:12.058356+0000","last_became_peered":"2023-10-09T11:41:12.058356+0000","last_unstale":"2023-10-09T11:41:12.060308+0000","last_undegraded":"2023-10-09T11:41:12.060308+0000","last_fullsized":"2023-10-09T11:41:12.060308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.053154+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063421+0000","last_change":"2023-10-09T11:41:12.059080+0000","last_active":"2023-10-09T11:41:12.063421+0000","last_peered":"2023-10-09T11:41:12.063421+0000","last_clean":"2023-10-09T11:41:12.063421+0000","last_became_active":"2023-10-09T11:41:12.056426+0000","last_became_peered":"2023-10-09T11:41:12.056426+0000","last_unstale":"2023-10-09T11:41:12.063421+0000","last_undegraded":"2023-10-09T11:41:12.063421+0000","last_fullsized":"2023-10-09T11:41:12.063421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.057664+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053983+0000","last_change":"2023-10-09T11:41:12.052767+0000","last_active":"2023-10-09T11:41:12.053983+0000","last_peered":"2023-10-09T11:41:12.053983+0000","last_clean":"2023-10-09T11:41:12.053983+0000","last_became_active":"2023-10-09T11:41:12.052111+0000","last_became_peered":"2023-10-09T11:41:12.052111+0000","last_unstale":"2023-10-09T11:41:12.053983+0000","last_undegraded":"2023-10-09T11:41:12.053983+0000","last_fullsized":"2023-10-09T11:41:12.053983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:11.041183+0000","last_change":"2023-10-09T11:41:11.055663+0000","last_active":"2023-10-09T11:41:11.041183+0000","last_peered":"2023-10-09T11:41:11.041183+0000","last_clean":"2023-10-09T11:41:11.041183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:11.041183+0000","last_undegraded":"2023-10-09T11:41:11.041183+0000","last_fullsized":"2023-10-09T11:41:11.041183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476740,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":646334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":68992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":180224,"data_stored":55966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:17.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-09T11:41:17.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.067210+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-09T11:41:17.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.054306+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-09T11:41:17.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.060821+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.058233+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.066734+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.064647+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-09T11:41:17.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.057408+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.054239+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.053874+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:35:11.314302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.058504+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-09T11:41:17.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.058807+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.065607+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.059040+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.056823+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-09T11:41:17.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.054240+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:36:07.666003+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:17.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-09T11:41:17.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.056731+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-09T11:41:17.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.052869+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:05:29.486103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:17.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.063229+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.060267+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.059248+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:06:45.324161+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.059803+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-09T11:41:17.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.062240+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-09T11:41:17.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.053238+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:09:33.578011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-09T11:41:17.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.055194+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:38:27.313199+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:17.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-09T11:41:17.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.055464+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:49:25.252259+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:17.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-09T11:41:17.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.057619+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:56:48.166693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:17.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-09T11:41:17.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.061884+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-09T11:41:17.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.056097+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-09T11:41:17.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.062688+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:17.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-09T11:41:17.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.059981+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:03:21.777376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.057160+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.058055+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:52:24.482339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.053154+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-09T11:41:17.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.057664+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:17.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-09T11:41:17.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:11.041183+0000', 'last_change': '2023-10-09T11:41:11.055663+0000', 'last_active': '2023-10-09T11:41:11.041183+0000', 'last_peered': '2023-10-09T11:41:11.041183+0000', 'last_clean': '2023-10-09T11:41:11.041183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:11.041183+0000', 'last_undegraded': '2023-10-09T11:41:11.041183+0000', 'last_fullsized': '2023-10-09T11:41:11.041183+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:11.041183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:17.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:41:17.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.496+0000 7f158b1ff700 1 Processor -- start 2023-10-09T11:41:17.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.496+0000 7f158b1ff700 1 -- start start 2023-10-09T11:41:17.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.497+0000 7f158b1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15840ced50 0x7f15840b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.497+0000 7f158b1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ada80 0x7f15840adec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.497+0000 7f158b1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840ad5f0 con 0x7f15840b2b80 2023-10-09T11:41:17.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.497+0000 7f158b1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158415a060 con 0x7f15840ced50 2023-10-09T11:41:17.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.497+0000 7f158b1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15840cf310 con 0x7f15840ada80 2023-10-09T11:41:17.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f1583fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15840ced50 0x7f15840b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ada80 0x7f15840adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ada80 0x7f15840adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:42566/0 (socket says 172.21.15.86:42566) 2023-10-09T11:41:17.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 -- 172.21.15.86:0/784132592 learned_addr learned my addr 172.21.15.86:0/784132592 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:17.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f1588f9b700 1 --1- 172.21.15.86:0/784132592 >> v1:172.21.15.135:6789/0 conn(0x7f15840b2b80 0x7f15840b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55586/0 (socket says 172.21.15.86:55586) 2023-10-09T11:41:17.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 -- 172.21.15.86:0/784132592 >> v2:172.21.15.135:3300/0 conn(0x7f15840ced50 msgr2=0x7f15840b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 --2- 172.21.15.86:0/784132592 >> v2:172.21.15.135:3300/0 conn(0x7f15840ced50 0x7f15840b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 -- 172.21.15.86:0/784132592 >> v1:172.21.15.135:6789/0 conn(0x7f15840b2b80 legacy=0x7f15840b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 -- 172.21.15.86:0/784132592 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840cf5f0 con 0x7f15840ada80 2023-10-09T11:41:17.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.498+0000 7f158979c700 1 --2- 172.21.15.86:0/784132592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ada80 0x7f15840adec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f157c0099b0 tx=0x7f157c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7980ec84984df0ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f15837fe700 1 -- 172.21.15.86:0/784132592 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c009ea0 con 0x7f15840ada80 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f15837fe700 1 -- 172.21.15.86:0/784132592 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00b860 con 0x7f15840ada80 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f15837fe700 1 -- 172.21.15.86:0/784132592 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00bc00 con 0x7f15840ada80 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 -- 172.21.15.86:0/784132592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ada80 msgr2=0x7f15840adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 --2- 172.21.15.86:0/784132592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ada80 0x7f15840adec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f157c0099b0 tx=0x7f157c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 -- 172.21.15.86:0/784132592 shutdown_connections 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 --2- 172.21.15.86:0/784132592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ada80 0x7f15840adec0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 --2- 172.21.15.86:0/784132592 >> v2:172.21.15.135:3300/0 conn(0x7f15840ced50 0x7f15840b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 -- 172.21.15.86:0/784132592 >> 172.21.15.86:0/784132592 conn(0x7f15840999f0 msgr2=0x7f15840b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 -- 172.21.15.86:0/784132592 shutdown_connections 2023-10-09T11:41:17.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.499+0000 7f158b1ff700 1 -- 172.21.15.86:0/784132592 wait complete. 2023-10-09T11:41:17.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.501+0000 7f158b1ff700 1 Processor -- start 2023-10-09T11:41:17.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.501+0000 7f158b1ff700 1 -- start start 2023-10-09T11:41:17.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f158b1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15840ada80 0x7f15840699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f158b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15840b2b80 0x7f1584069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f158b1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ced50 0x7f15840c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f158b1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158406b290 con 0x7f15840ada80 2023-10-09T11:41:17.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f158b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158406a420 con 0x7f15840b2b80 2023-10-09T11:41:17.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f158b1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158406a680 con 0x7f15840ced50 2023-10-09T11:41:17.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15840ada80 0x7f15840699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15840ada80 0x7f15840699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39388/0 (socket says 172.21.15.86:39388) 2023-10-09T11:41:17.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 -- 172.21.15.86:0/1047342178 learned_addr learned my addr 172.21.15.86:0/1047342178 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:17.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1583fff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15840b2b80 0x7f1584069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f158979c700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ced50 0x7f15840c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 -- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ced50 msgr2=0x7f15840c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ced50 0x7f15840c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 -- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15840b2b80 msgr2=0x7f1584069ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15840b2b80 0x7f1584069ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1588f9b700 1 -- 172.21.15.86:0/1047342178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0094f0 con 0x7f15840ada80 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.502+0000 7f1583fff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15840b2b80 0x7f1584069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.503+0000 7f1588f9b700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15840ada80 0x7f15840699a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f157800cd30 tx=0x7f1578001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.503+0000 7f1580ff9700 1 -- 172.21.15.86:0/1047342178 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157800ab70 con 0x7f15840ada80 2023-10-09T11:41:17.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.503+0000 7f1580ff9700 1 -- 172.21.15.86:0/1047342178 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157800acd0 con 0x7f15840ada80 2023-10-09T11:41:17.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.503+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158406a960 con 0x7f15840ada80 2023-10-09T11:41:17.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.503+0000 7f1580ff9700 1 -- 172.21.15.86:0/1047342178 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578007340 con 0x7f15840ada80 2023-10-09T11:41:17.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.503+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158406af20 con 0x7f15840ada80 2023-10-09T11:41:17.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.504+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1584063c90 con 0x7f15840ada80 2023-10-09T11:41:17.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.505+0000 7f1580ff9700 1 -- 172.21.15.86:0/1047342178 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1578007770 con 0x7f15840ada80 2023-10-09T11:41:17.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.506+0000 7f1580ff9700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1568066f30 0x7f15680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.506+0000 7f1580ff9700 1 -- 172.21.15.86:0/1047342178 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1578084b40 con 0x7f15840ada80 2023-10-09T11:41:17.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.506+0000 7f1583fff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1568066f30 0x7f15680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.507+0000 7f1583fff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1568066f30 0x7f15680693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1570009ce0 tx=0x7f1570008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.510+0000 7f1580ff9700 1 -- 172.21.15.86:0/1047342178 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1578051d90 con 0x7f15840ada80 2023-10-09T11:41:17.705 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-10-09T11:41:17.704+0000 7fb504ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.778+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f158404c3c0 con 0x7f15840ada80 2023-10-09T11:41:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.779+0000 7f1580ff9700 1 -- 172.21.15.86:0/1047342178 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1099 (secure 0 0 0) 0x7f15780553b0 con 0x7f15840ada80 2023-10-09T11:41:17.779 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:17.780 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":62},{"state_name":"creating+peering","count":35}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591116,"bytes_used":2438168576,"bytes_avail":770655944704,"bytes_total":773094113280,"inactive_pgs_ratio":0.36082473397254944,"write_bytes_sec":1559,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4293}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-09T11:40:47.240691+0000","services":{}},"progress_events":{}} 2023-10-09T11:41:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1568066f30 msgr2=0x7f15680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1568066f30 0x7f15680693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1570009ce0 tx=0x7f1570008040 comp rx=0 tx=0).stop 2023-10-09T11:41:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15840ada80 msgr2=0x7f15840699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15840ada80 0x7f15840699a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f157800cd30 tx=0x7f1578001b80 comp rx=0 tx=0).stop 2023-10-09T11:41:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 shutdown_connections 2023-10-09T11:41:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1568066f30 0x7f15680693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15840ada80 0x7f15840699a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15840ced50 0x7f15840c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 --2- 172.21.15.86:0/1047342178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15840b2b80 0x7f1584069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 >> 172.21.15.86:0/1047342178 conn(0x7f15840999f0 msgr2=0x7f15840aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 shutdown_connections 2023-10-09T11:41:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.781+0000 7f158b1ff700 1 -- 172.21.15.86:0/1047342178 wait complete. 2023-10-09T11:41:17.799 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:41:17.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:17.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.981+0000 7f7d1d59d700 1 Processor -- start 2023-10-09T11:41:17.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.981+0000 7f7d1d59d700 1 -- start start 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1d59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d18159420 0x7f7d180b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1d59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d1815d230 0x7f7d1815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1d59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1815dbd0 con 0x7f7d181597f0 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1d59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180b2980 con 0x7f7d1815d230 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1d59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180b11d0 con 0x7f7d18159420 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1cd9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d1815d230 0x7f7d1815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1cd9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d1815d230 0x7f7d1815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39396/0 (socket says 172.21.15.86:39396) 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.982+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/3721163508 learned_addr learned my addr 172.21.15.86:0/3721163508 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:17.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d17fff700 1 --2- 172.21.15.86:0/3721163508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d18159420 0x7f7d180b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/3721163508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d18159420 msgr2=0x7f7d180b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d1cd9c700 1 --2- 172.21.15.86:0/3721163508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d18159420 0x7f7d180b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/3721163508 >> v1:172.21.15.135:6789/0 conn(0x7f7d181597f0 legacy=0x7f7d180b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/3721163508 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180b14b0 con 0x7f7d1815d230 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d1cd9c700 1 --2- 172.21.15.86:0/3721163508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d1815d690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009f20 tx=0x7f7d10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a474ef5de04cbf68 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d16ffd700 1 -- 172.21.15.86:0/3721163508 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1000e070 con 0x7f7d1815d230 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d16ffd700 1 -- 172.21.15.86:0/3721163508 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1000ba80 con 0x7f7d1815d230 2023-10-09T11:41:17.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.983+0000 7f7d16ffd700 1 -- 172.21.15.86:0/3721163508 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100092e0 con 0x7f7d1815d230 2023-10-09T11:41:17.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 -- 172.21.15.86:0/3721163508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 msgr2=0x7f7d1815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/3721163508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d1815d690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009f20 tx=0x7f7d10009840 comp rx=0 tx=0).stop 2023-10-09T11:41:17.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 -- 172.21.15.86:0/3721163508 shutdown_connections 2023-10-09T11:41:17.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/3721163508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d1815d690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/3721163508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d18159420 0x7f7d180b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 -- 172.21.15.86:0/3721163508 >> 172.21.15.86:0/3721163508 conn(0x7f7d180d0660 msgr2=0x7f7d180d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 -- 172.21.15.86:0/3721163508 shutdown_connections 2023-10-09T11:41:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.984+0000 7f7d1d59d700 1 -- 172.21.15.86:0/3721163508 wait complete. 2023-10-09T11:41:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.985+0000 7f7d1d59d700 1 Processor -- start 2023-10-09T11:41:17.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.986+0000 7f7d1d59d700 1 -- start start 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.986+0000 7f7d1d59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d18159420 0x7f7d180c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.986+0000 7f7d1d59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d181597f0 0x7f7d1815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.986+0000 7f7d1d59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d180c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.986+0000 7f7d1d59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1815c590 con 0x7f7d1815d230 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.986+0000 7f7d1d59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180c66d0 con 0x7f7d18159420 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.986+0000 7f7d1d59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180c5ac0 con 0x7f7d181597f0 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d180c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d180c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39412/0 (socket says 172.21.15.86:39412) 2023-10-09T11:41:17.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/1693213735 learned_addr learned my addr 172.21.15.86:0/1693213735 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d17fff700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d18159420 0x7f7d180c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d177fe700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d181597f0 0x7f7d1815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d181597f0 msgr2=0x7f7d1815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d181597f0 0x7f7d1815c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d18159420 msgr2=0x7f7d180c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d18159420 0x7f7d180c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 -- 172.21.15.86:0/1693213735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009ae0 con 0x7f7d1815d230 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.987+0000 7f7d1cd9c700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d180c6b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000b6c0 tx=0x7f7d10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.988+0000 7f7cfffff700 1 -- 172.21.15.86:0/1693213735 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100032f0 con 0x7f7d1815d230 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.988+0000 7f7cfffff700 1 -- 172.21.15.86:0/1693213735 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10008dd0 con 0x7f7d1815d230 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.988+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d180c5da0 con 0x7f7d1815d230 2023-10-09T11:41:17.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.988+0000 7f7cfffff700 1 -- 172.21.15.86:0/1693213735 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001c620 con 0x7f7d1815d230 2023-10-09T11:41:17.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.988+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d180c6360 con 0x7f7d1815d230 2023-10-09T11:41:17.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.989+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d180c6860 con 0x7f7d1815d230 2023-10-09T11:41:17.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.990+0000 7f7cfffff700 1 -- 172.21.15.86:0/1693213735 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d10003040 con 0x7f7d1815d230 2023-10-09T11:41:17.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.991+0000 7f7cfffff700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7d04066f30 0x7f7d040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:17.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.991+0000 7f7cfffff700 1 -- 172.21.15.86:0/1693213735 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d10085da0 con 0x7f7d1815d230 2023-10-09T11:41:17.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.991+0000 7f7d17fff700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7d04066f30 0x7f7d040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:17.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.992+0000 7f7d17fff700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7d04066f30 0x7f7d040693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d08006fd0 tx=0x7f7d08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:17.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:17.995+0000 7f7cfffff700 1 -- 172.21.15.86:0/1693213735 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d10053010 con 0x7f7d1815d230 2023-10-09T11:41:18.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.183+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d1804c3c0 con 0x7f7d04066f30 2023-10-09T11:41:18.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.192+0000 7f7cfffff700 1 -- 172.21.15.86:0/1693213735 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264585 (secure 0 0 0) 0x7f7d1804c3c0 con 0x7f7d04066f30 2023-10-09T11:41:18.196 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7d04066f30 msgr2=0x7f7d040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7d04066f30 0x7f7d040693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d08006fd0 tx=0x7f7d08008040 comp rx=0 tx=0).stop 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 msgr2=0x7f7d180c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d180c6b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000b6c0 tx=0x7f7d10018000 comp rx=0 tx=0).stop 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 shutdown_connections 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7d04066f30 0x7f7d040693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d1815d230 0x7f7d180c6b60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d18159420 0x7f7d180c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 --2- 172.21.15.86:0/1693213735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d181597f0 0x7f7d1815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:18.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 >> 172.21.15.86:0/1693213735 conn(0x7f7d180d0660 msgr2=0x7f7d18156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:18.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 shutdown_connections 2023-10-09T11:41:18.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:18.196+0000 7f7d1d59d700 1 -- 172.21.15.86:0/1693213735 wait complete. 2023-10-09T11:41:18.199 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:41:18.214 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T11:41:17.953892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381200,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593520,"statfs":{"total":773094113280,"available":770655764480,"internally_reserved":0,"allocated":2965504,"data_stored":1775012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.908849"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071394+0000","last_change":"2023-10-09T11:41:12.064188+0000","last_active":"2023-10-09T11:41:12.071394+0000","last_peered":"2023-10-09T11:41:12.071394+0000","last_clean":"2023-10-09T11:41:12.071394+0000","last_became_active":"2023-10-09T11:41:12.063875+0000","last_became_peered":"2023-10-09T11:41:12.063875+0000","last_unstale":"2023-10-09T11:41:12.071394+0000","last_undegraded":"2023-10-09T11:41:12.071394+0000","last_fullsized":"2023-10-09T11:41:12.071394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058844+0000","last_change":"2023-10-09T11:41:12.053292+0000","last_active":"2023-10-09T11:41:12.058844+0000","last_peered":"2023-10-09T11:41:12.058844+0000","last_clean":"2023-10-09T11:41:12.058844+0000","last_became_active":"2023-10-09T11:41:12.052978+0000","last_became_peered":"2023-10-09T11:41:12.052978+0000","last_unstale":"2023-10-09T11:41:12.058844+0000","last_undegraded":"2023-10-09T11:41:12.058844+0000","last_fullsized":"2023-10-09T11:41:12.058844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053403+0000","last_change":"2023-10-09T11:41:12.048670+0000","last_active":"2023-10-09T11:41:12.053403+0000","last_peered":"2023-10-09T11:41:12.053403+0000","last_clean":"2023-10-09T11:41:12.053403+0000","last_became_active":"2023-10-09T11:41:12.048364+0000","last_became_peered":"2023-10-09T11:41:12.048364+0000","last_unstale":"2023-10-09T11:41:12.053403+0000","last_undegraded":"2023-10-09T11:41:12.053403+0000","last_fullsized":"2023-10-09T11:41:12.053403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065349+0000","last_change":"2023-10-09T11:41:12.062125+0000","last_active":"2023-10-09T11:41:12.065349+0000","last_peered":"2023-10-09T11:41:12.065349+0000","last_clean":"2023-10-09T11:41:12.065349+0000","last_became_active":"2023-10-09T11:41:12.061872+0000","last_became_peered":"2023-10-09T11:41:12.061872+0000","last_unstale":"2023-10-09T11:41:12.065349+0000","last_undegraded":"2023-10-09T11:41:12.065349+0000","last_fullsized":"2023-10-09T11:41:12.065349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052679+0000","last_change":"2023-10-09T11:41:12.049492+0000","last_active":"2023-10-09T11:41:12.052679+0000","last_peered":"2023-10-09T11:41:12.052679+0000","last_clean":"2023-10-09T11:41:12.052679+0000","last_became_active":"2023-10-09T11:41:12.049220+0000","last_became_peered":"2023-10-09T11:41:12.049220+0000","last_unstale":"2023-10-09T11:41:12.052679+0000","last_undegraded":"2023-10-09T11:41:12.052679+0000","last_fullsized":"2023-10-09T11:41:12.052679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070457+0000","last_change":"2023-10-09T11:41:12.065396+0000","last_active":"2023-10-09T11:41:12.070457+0000","last_peered":"2023-10-09T11:41:12.070457+0000","last_clean":"2023-10-09T11:41:12.070457+0000","last_became_active":"2023-10-09T11:41:12.065090+0000","last_became_peered":"2023-10-09T11:41:12.065090+0000","last_unstale":"2023-10-09T11:41:12.070457+0000","last_undegraded":"2023-10-09T11:41:12.070457+0000","last_fullsized":"2023-10-09T11:41:12.070457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071362+0000","last_change":"2023-10-09T11:41:12.063605+0000","last_active":"2023-10-09T11:41:12.071362+0000","last_peered":"2023-10-09T11:41:12.071362+0000","last_clean":"2023-10-09T11:41:12.071362+0000","last_became_active":"2023-10-09T11:41:12.063327+0000","last_became_peered":"2023-10-09T11:41:12.063327+0000","last_unstale":"2023-10-09T11:41:12.071362+0000","last_undegraded":"2023-10-09T11:41:12.071362+0000","last_fullsized":"2023-10-09T11:41:12.071362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059474+0000","last_change":"2023-10-09T11:41:12.054453+0000","last_active":"2023-10-09T11:41:12.059474+0000","last_peered":"2023-10-09T11:41:12.059474+0000","last_clean":"2023-10-09T11:41:12.059474+0000","last_became_active":"2023-10-09T11:41:12.054117+0000","last_became_peered":"2023-10-09T11:41:12.054117+0000","last_unstale":"2023-10-09T11:41:12.059474+0000","last_undegraded":"2023-10-09T11:41:12.059474+0000","last_fullsized":"2023-10-09T11:41:12.059474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.054577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071695+0000","last_change":"2023-10-09T11:41:12.064789+0000","last_active":"2023-10-09T11:41:12.071695+0000","last_peered":"2023-10-09T11:41:12.071695+0000","last_clean":"2023-10-09T11:41:12.071695+0000","last_became_active":"2023-10-09T11:41:12.064496+0000","last_became_peered":"2023-10-09T11:41:12.064496+0000","last_unstale":"2023-10-09T11:41:12.071695+0000","last_undegraded":"2023-10-09T11:41:12.071695+0000","last_fullsized":"2023-10-09T11:41:12.071695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:04.019082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061611+0000","last_change":"2023-10-09T11:41:12.057786+0000","last_active":"2023-10-09T11:41:12.061611+0000","last_peered":"2023-10-09T11:41:12.061611+0000","last_clean":"2023-10-09T11:41:12.061611+0000","last_became_active":"2023-10-09T11:41:12.057470+0000","last_became_peered":"2023-10-09T11:41:12.057470+0000","last_unstale":"2023-10-09T11:41:12.061611+0000","last_undegraded":"2023-10-09T11:41:12.061611+0000","last_fullsized":"2023-10-09T11:41:12.061611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061547+0000","last_change":"2023-10-09T11:41:12.057855+0000","last_active":"2023-10-09T11:41:12.061547+0000","last_peered":"2023-10-09T11:41:12.061547+0000","last_clean":"2023-10-09T11:41:12.061547+0000","last_became_active":"2023-10-09T11:41:12.057494+0000","last_became_peered":"2023-10-09T11:41:12.057494+0000","last_unstale":"2023-10-09T11:41:12.061547+0000","last_undegraded":"2023-10-09T11:41:12.061547+0000","last_fullsized":"2023-10-09T11:41:12.061547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055353+0000","last_change":"2023-10-09T11:41:12.048796+0000","last_active":"2023-10-09T11:41:12.055353+0000","last_peered":"2023-10-09T11:41:12.055353+0000","last_clean":"2023-10-09T11:41:12.055353+0000","last_became_active":"2023-10-09T11:41:12.048484+0000","last_became_peered":"2023-10-09T11:41:12.048484+0000","last_unstale":"2023-10-09T11:41:12.055353+0000","last_undegraded":"2023-10-09T11:41:12.055353+0000","last_fullsized":"2023-10-09T11:41:12.055353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059423+0000","last_change":"2023-10-09T11:41:12.052334+0000","last_active":"2023-10-09T11:41:12.059423+0000","last_peered":"2023-10-09T11:41:12.059423+0000","last_clean":"2023-10-09T11:41:12.059423+0000","last_became_active":"2023-10-09T11:41:12.051731+0000","last_became_peered":"2023-10-09T11:41:12.051731+0000","last_unstale":"2023-10-09T11:41:12.059423+0000","last_undegraded":"2023-10-09T11:41:12.059423+0000","last_fullsized":"2023-10-09T11:41:12.059423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:25.351610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053609+0000","last_change":"2023-10-09T11:41:12.051643+0000","last_active":"2023-10-09T11:41:12.053609+0000","last_peered":"2023-10-09T11:41:12.053609+0000","last_clean":"2023-10-09T11:41:12.053609+0000","last_became_active":"2023-10-09T11:41:12.051337+0000","last_became_peered":"2023-10-09T11:41:12.051337+0000","last_unstale":"2023-10-09T11:41:12.053609+0000","last_undegraded":"2023-10-09T11:41:12.053609+0000","last_fullsized":"2023-10-09T11:41:12.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:10.056568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059700+0000","last_change":"2023-10-09T11:41:12.058090+0000","last_active":"2023-10-09T11:41:12.059700+0000","last_peered":"2023-10-09T11:41:12.059700+0000","last_clean":"2023-10-09T11:41:12.059700+0000","last_became_active":"2023-10-09T11:41:12.057829+0000","last_became_peered":"2023-10-09T11:41:12.057829+0000","last_unstale":"2023-10-09T11:41:12.059700+0000","last_undegraded":"2023-10-09T11:41:12.059700+0000","last_fullsized":"2023-10-09T11:41:12.059700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064496+0000","last_change":"2023-10-09T11:41:12.059376+0000","last_active":"2023-10-09T11:41:12.064496+0000","last_peered":"2023-10-09T11:41:12.064496+0000","last_clean":"2023-10-09T11:41:12.064496+0000","last_became_active":"2023-10-09T11:41:12.059105+0000","last_became_peered":"2023-10-09T11:41:12.059105+0000","last_unstale":"2023-10-09T11:41:12.064496+0000","last_undegraded":"2023-10-09T11:41:12.064496+0000","last_fullsized":"2023-10-09T11:41:12.064496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070447+0000","last_change":"2023-10-09T11:41:12.064945+0000","last_active":"2023-10-09T11:41:12.070447+0000","last_peered":"2023-10-09T11:41:12.070447+0000","last_clean":"2023-10-09T11:41:12.070447+0000","last_became_active":"2023-10-09T11:41:12.064668+0000","last_became_peered":"2023-10-09T11:41:12.064668+0000","last_unstale":"2023-10-09T11:41:12.070447+0000","last_undegraded":"2023-10-09T11:41:12.070447+0000","last_fullsized":"2023-10-09T11:41:12.070447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.049265+0000","last_change":"2023-10-09T11:41:12.049265+0000","last_active":"2023-10-09T11:41:12.049265+0000","last_peered":"2023-10-09T11:41:12.049265+0000","last_clean":"2023-10-09T11:41:12.049265+0000","last_became_active":"2023-10-09T11:41:12.049000+0000","last_became_peered":"2023-10-09T11:41:12.049000+0000","last_unstale":"2023-10-09T11:41:12.049265+0000","last_undegraded":"2023-10-09T11:41:12.049265+0000","last_fullsized":"2023-10-09T11:41:12.049265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:17.015986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064795+0000","last_change":"2023-10-09T11:41:12.052554+0000","last_active":"2023-10-09T11:41:12.064795+0000","last_peered":"2023-10-09T11:41:12.064795+0000","last_clean":"2023-10-09T11:41:12.064795+0000","last_became_active":"2023-10-09T11:41:12.050539+0000","last_became_peered":"2023-10-09T11:41:12.050539+0000","last_unstale":"2023-10-09T11:41:12.064795+0000","last_undegraded":"2023-10-09T11:41:12.064795+0000","last_fullsized":"2023-10-09T11:41:12.064795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.088830+0000","last_change":"2023-10-09T11:41:11.074267+0000","last_active":"2023-10-09T11:41:12.088830+0000","last_peered":"2023-10-09T11:41:12.088830+0000","last_clean":"2023-10-09T11:41:12.088830+0000","last_became_active":"2023-10-09T11:41:11.073971+0000","last_became_peered":"2023-10-09T11:41:11.073971+0000","last_unstale":"2023-10-09T11:41:12.088830+0000","last_undegraded":"2023-10-09T11:41:12.088830+0000","last_fullsized":"2023-10-09T11:41:12.088830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:17.546372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059770+0000","last_change":"2023-10-09T11:41:12.054265+0000","last_active":"2023-10-09T11:41:12.059770+0000","last_peered":"2023-10-09T11:41:12.059770+0000","last_clean":"2023-10-09T11:41:12.059770+0000","last_became_active":"2023-10-09T11:41:12.053826+0000","last_became_peered":"2023-10-09T11:41:12.053826+0000","last_unstale":"2023-10-09T11:41:12.059770+0000","last_undegraded":"2023-10-09T11:41:12.059770+0000","last_fullsized":"2023-10-09T11:41:12.059770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:00.372669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.085137+0000","last_change":"2023-10-09T11:41:11.063441+0000","last_active":"2023-10-09T11:41:12.085137+0000","last_peered":"2023-10-09T11:41:12.085137+0000","last_clean":"2023-10-09T11:41:12.085137+0000","last_became_active":"2023-10-09T11:41:11.063025+0000","last_became_peered":"2023-10-09T11:41:11.063025+0000","last_unstale":"2023-10-09T11:41:12.085137+0000","last_undegraded":"2023-10-09T11:41:12.085137+0000","last_fullsized":"2023-10-09T11:41:12.085137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:21.843438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063925+0000","last_change":"2023-10-09T11:41:12.058625+0000","last_active":"2023-10-09T11:41:12.063925+0000","last_peered":"2023-10-09T11:41:12.063925+0000","last_clean":"2023-10-09T11:41:12.063925+0000","last_became_active":"2023-10-09T11:41:12.057462+0000","last_became_peered":"2023-10-09T11:41:12.057462+0000","last_unstale":"2023-10-09T11:41:12.063925+0000","last_undegraded":"2023-10-09T11:41:12.063925+0000","last_fullsized":"2023-10-09T11:41:12.063925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086798+0000","last_change":"2023-10-09T11:41:11.079554+0000","last_active":"2023-10-09T11:41:12.086798+0000","last_peered":"2023-10-09T11:41:12.086798+0000","last_clean":"2023-10-09T11:41:12.086798+0000","last_became_active":"2023-10-09T11:41:11.079230+0000","last_became_peered":"2023-10-09T11:41:11.079230+0000","last_unstale":"2023-10-09T11:41:12.086798+0000","last_undegraded":"2023-10-09T11:41:12.086798+0000","last_fullsized":"2023-10-09T11:41:12.086798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064686+0000","last_change":"2023-10-09T11:41:12.060600+0000","last_active":"2023-10-09T11:41:12.064686+0000","last_peered":"2023-10-09T11:41:12.064686+0000","last_clean":"2023-10-09T11:41:12.064686+0000","last_became_active":"2023-10-09T11:41:12.060325+0000","last_became_peered":"2023-10-09T11:41:12.060325+0000","last_unstale":"2023-10-09T11:41:12.064686+0000","last_undegraded":"2023-10-09T11:41:12.064686+0000","last_fullsized":"2023-10-09T11:41:12.064686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086427+0000","last_change":"2023-10-09T11:41:11.082099+0000","last_active":"2023-10-09T11:41:12.086427+0000","last_peered":"2023-10-09T11:41:12.086427+0000","last_clean":"2023-10-09T11:41:12.086427+0000","last_became_active":"2023-10-09T11:41:11.081703+0000","last_became_peered":"2023-10-09T11:41:11.081703+0000","last_unstale":"2023-10-09T11:41:12.086427+0000","last_undegraded":"2023-10-09T11:41:12.086427+0000","last_fullsized":"2023-10-09T11:41:12.086427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:59.333597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066051+0000","last_change":"2023-10-09T11:41:12.059389+0000","last_active":"2023-10-09T11:41:12.066051+0000","last_peered":"2023-10-09T11:41:12.066051+0000","last_clean":"2023-10-09T11:41:12.066051+0000","last_became_active":"2023-10-09T11:41:12.059089+0000","last_became_peered":"2023-10-09T11:41:12.059089+0000","last_unstale":"2023-10-09T11:41:12.066051+0000","last_undegraded":"2023-10-09T11:41:12.066051+0000","last_fullsized":"2023-10-09T11:41:12.066051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086469+0000","last_change":"2023-10-09T11:41:11.074679+0000","last_active":"2023-10-09T11:41:12.086469+0000","last_peered":"2023-10-09T11:41:12.086469+0000","last_clean":"2023-10-09T11:41:12.086469+0000","last_became_active":"2023-10-09T11:41:11.074362+0000","last_became_peered":"2023-10-09T11:41:11.074362+0000","last_unstale":"2023-10-09T11:41:12.086469+0000","last_undegraded":"2023-10-09T11:41:12.086469+0000","last_fullsized":"2023-10-09T11:41:12.086469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055401+0000","last_change":"2023-10-09T11:41:12.048767+0000","last_active":"2023-10-09T11:41:12.055401+0000","last_peered":"2023-10-09T11:41:12.055401+0000","last_clean":"2023-10-09T11:41:12.055401+0000","last_became_active":"2023-10-09T11:41:12.048451+0000","last_became_peered":"2023-10-09T11:41:12.048451+0000","last_unstale":"2023-10-09T11:41:12.055401+0000","last_undegraded":"2023-10-09T11:41:12.055401+0000","last_fullsized":"2023-10-09T11:41:12.055401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:29.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087372+0000","last_change":"2023-10-09T11:41:11.068876+0000","last_active":"2023-10-09T11:41:12.087372+0000","last_peered":"2023-10-09T11:41:12.087372+0000","last_clean":"2023-10-09T11:41:12.087372+0000","last_became_active":"2023-10-09T11:41:11.068602+0000","last_became_peered":"2023-10-09T11:41:11.068602+0000","last_unstale":"2023-10-09T11:41:12.087372+0000","last_undegraded":"2023-10-09T11:41:12.087372+0000","last_fullsized":"2023-10-09T11:41:12.087372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063758+0000","last_change":"2023-10-09T11:41:12.058551+0000","last_active":"2023-10-09T11:41:12.063758+0000","last_peered":"2023-10-09T11:41:12.063758+0000","last_clean":"2023-10-09T11:41:12.063758+0000","last_became_active":"2023-10-09T11:41:12.056962+0000","last_became_peered":"2023-10-09T11:41:12.056962+0000","last_unstale":"2023-10-09T11:41:12.063758+0000","last_undegraded":"2023-10-09T11:41:12.063758+0000","last_fullsized":"2023-10-09T11:41:12.063758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.038859+0000","last_change":"2023-10-09T11:41:11.072956+0000","last_active":"2023-10-09T11:41:12.038859+0000","last_peered":"2023-10-09T11:41:12.038859+0000","last_clean":"2023-10-09T11:41:12.038859+0000","last_became_active":"2023-10-09T11:41:11.072711+0000","last_became_peered":"2023-10-09T11:41:11.072711+0000","last_unstale":"2023-10-09T11:41:12.038859+0000","last_undegraded":"2023-10-09T11:41:12.038859+0000","last_fullsized":"2023-10-09T11:41:12.038859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060221+0000","last_change":"2023-10-09T11:41:12.056233+0000","last_active":"2023-10-09T11:41:12.060221+0000","last_peered":"2023-10-09T11:41:12.060221+0000","last_clean":"2023-10-09T11:41:12.060221+0000","last_became_active":"2023-10-09T11:41:12.055836+0000","last_became_peered":"2023-10-09T11:41:12.055836+0000","last_unstale":"2023-10-09T11:41:12.060221+0000","last_undegraded":"2023-10-09T11:41:12.060221+0000","last_fullsized":"2023-10-09T11:41:12.060221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.076596+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.075211+0000","last_became_peered":"2023-10-09T11:41:11.075211+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061196+0000","last_change":"2023-10-09T11:41:12.059816+0000","last_active":"2023-10-09T11:41:12.061196+0000","last_peered":"2023-10-09T11:41:12.061196+0000","last_clean":"2023-10-09T11:41:12.061196+0000","last_became_active":"2023-10-09T11:41:12.059529+0000","last_became_peered":"2023-10-09T11:41:12.059529+0000","last_unstale":"2023-10-09T11:41:12.061196+0000","last_undegraded":"2023-10-09T11:41:12.061196+0000","last_fullsized":"2023-10-09T11:41:12.061196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043525+0000","last_change":"2023-10-09T11:41:11.077704+0000","last_active":"2023-10-09T11:41:12.043525+0000","last_peered":"2023-10-09T11:41:12.043525+0000","last_clean":"2023-10-09T11:41:12.043525+0000","last_became_active":"2023-10-09T11:41:11.077405+0000","last_became_peered":"2023-10-09T11:41:11.077405+0000","last_unstale":"2023-10-09T11:41:12.043525+0000","last_undegraded":"2023-10-09T11:41:12.043525+0000","last_fullsized":"2023-10-09T11:41:12.043525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064572+0000","last_change":"2023-10-09T11:41:12.060375+0000","last_active":"2023-10-09T11:41:12.064572+0000","last_peered":"2023-10-09T11:41:12.064572+0000","last_clean":"2023-10-09T11:41:12.064572+0000","last_became_active":"2023-10-09T11:41:12.060103+0000","last_became_peered":"2023-10-09T11:41:12.060103+0000","last_unstale":"2023-10-09T11:41:12.064572+0000","last_undegraded":"2023-10-09T11:41:12.064572+0000","last_fullsized":"2023-10-09T11:41:12.064572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055192+0000","last_change":"2023-10-09T11:41:11.071764+0000","last_active":"2023-10-09T11:41:12.055192+0000","last_peered":"2023-10-09T11:41:12.055192+0000","last_clean":"2023-10-09T11:41:12.055192+0000","last_became_active":"2023-10-09T11:41:11.070619+0000","last_became_peered":"2023-10-09T11:41:11.070619+0000","last_unstale":"2023-10-09T11:41:12.055192+0000","last_undegraded":"2023-10-09T11:41:12.055192+0000","last_fullsized":"2023-10-09T11:41:12.055192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063724+0000","last_change":"2023-10-09T11:41:12.057796+0000","last_active":"2023-10-09T11:41:12.063724+0000","last_peered":"2023-10-09T11:41:12.063724+0000","last_clean":"2023-10-09T11:41:12.063724+0000","last_became_active":"2023-10-09T11:41:12.057536+0000","last_became_peered":"2023-10-09T11:41:12.057536+0000","last_unstale":"2023-10-09T11:41:12.063724+0000","last_undegraded":"2023-10-09T11:41:12.063724+0000","last_fullsized":"2023-10-09T11:41:12.063724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086648+0000","last_change":"2023-10-09T11:41:11.077183+0000","last_active":"2023-10-09T11:41:12.086648+0000","last_peered":"2023-10-09T11:41:12.086648+0000","last_clean":"2023-10-09T11:41:12.086648+0000","last_became_active":"2023-10-09T11:41:11.076940+0000","last_became_peered":"2023-10-09T11:41:11.076940+0000","last_unstale":"2023-10-09T11:41:12.086648+0000","last_undegraded":"2023-10-09T11:41:12.086648+0000","last_fullsized":"2023-10-09T11:41:12.086648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055266+0000","last_change":"2023-10-09T11:41:12.048070+0000","last_active":"2023-10-09T11:41:12.055266+0000","last_peered":"2023-10-09T11:41:12.055266+0000","last_clean":"2023-10-09T11:41:12.055266+0000","last_became_active":"2023-10-09T11:41:12.047867+0000","last_became_peered":"2023-10-09T11:41:12.047867+0000","last_unstale":"2023-10-09T11:41:12.055266+0000","last_undegraded":"2023-10-09T11:41:12.055266+0000","last_fullsized":"2023-10-09T11:41:12.055266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:01.222208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.089647+0000","last_change":"2023-10-09T11:41:11.068939+0000","last_active":"2023-10-09T11:41:12.089647+0000","last_peered":"2023-10-09T11:41:12.089647+0000","last_clean":"2023-10-09T11:41:12.089647+0000","last_became_active":"2023-10-09T11:41:11.068555+0000","last_became_peered":"2023-10-09T11:41:11.068555+0000","last_unstale":"2023-10-09T11:41:12.089647+0000","last_undegraded":"2023-10-09T11:41:12.089647+0000","last_fullsized":"2023-10-09T11:41:12.089647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064816+0000","last_change":"2023-10-09T11:41:12.058308+0000","last_active":"2023-10-09T11:41:12.064816+0000","last_peered":"2023-10-09T11:41:12.064816+0000","last_clean":"2023-10-09T11:41:12.064816+0000","last_became_active":"2023-10-09T11:41:12.057987+0000","last_became_peered":"2023-10-09T11:41:12.057987+0000","last_unstale":"2023-10-09T11:41:12.064816+0000","last_undegraded":"2023-10-09T11:41:12.064816+0000","last_fullsized":"2023-10-09T11:41:12.064816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086499+0000","last_change":"2023-10-09T11:41:11.065387+0000","last_active":"2023-10-09T11:41:12.086499+0000","last_peered":"2023-10-09T11:41:12.086499+0000","last_clean":"2023-10-09T11:41:12.086499+0000","last_became_active":"2023-10-09T11:41:11.065121+0000","last_became_peered":"2023-10-09T11:41:11.065121+0000","last_unstale":"2023-10-09T11:41:12.086499+0000","last_undegraded":"2023-10-09T11:41:12.086499+0000","last_fullsized":"2023-10-09T11:41:12.086499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:19.832054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053962+0000","last_change":"2023-10-09T11:41:12.052247+0000","last_active":"2023-10-09T11:41:12.053962+0000","last_peered":"2023-10-09T11:41:12.053962+0000","last_clean":"2023-10-09T11:41:12.053962+0000","last_became_active":"2023-10-09T11:41:12.051882+0000","last_became_peered":"2023-10-09T11:41:12.051882+0000","last_unstale":"2023-10-09T11:41:12.053962+0000","last_undegraded":"2023-10-09T11:41:12.053962+0000","last_fullsized":"2023-10-09T11:41:12.053962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052727+0000","last_change":"2023-10-09T11:41:11.077221+0000","last_active":"2023-10-09T11:41:12.052727+0000","last_peered":"2023-10-09T11:41:12.052727+0000","last_clean":"2023-10-09T11:41:12.052727+0000","last_became_active":"2023-10-09T11:41:11.075558+0000","last_became_peered":"2023-10-09T11:41:11.075558+0000","last_unstale":"2023-10-09T11:41:12.052727+0000","last_undegraded":"2023-10-09T11:41:12.052727+0000","last_fullsized":"2023-10-09T11:41:12.052727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071415+0000","last_change":"2023-10-09T11:41:12.064288+0000","last_active":"2023-10-09T11:41:12.071415+0000","last_peered":"2023-10-09T11:41:12.071415+0000","last_clean":"2023-10-09T11:41:12.071415+0000","last_became_active":"2023-10-09T11:41:12.064017+0000","last_became_peered":"2023-10-09T11:41:12.064017+0000","last_unstale":"2023-10-09T11:41:12.071415+0000","last_undegraded":"2023-10-09T11:41:12.071415+0000","last_fullsized":"2023-10-09T11:41:12.071415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043298+0000","last_change":"2023-10-09T11:41:11.069670+0000","last_active":"2023-10-09T11:41:12.043298+0000","last_peered":"2023-10-09T11:41:12.043298+0000","last_clean":"2023-10-09T11:41:12.043298+0000","last_became_active":"2023-10-09T11:41:11.069325+0000","last_became_peered":"2023-10-09T11:41:11.069325+0000","last_unstale":"2023-10-09T11:41:12.043298+0000","last_undegraded":"2023-10-09T11:41:12.043298+0000","last_fullsized":"2023-10-09T11:41:12.043298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058961+0000","last_change":"2023-10-09T11:41:12.054973+0000","last_active":"2023-10-09T11:41:12.058961+0000","last_peered":"2023-10-09T11:41:12.058961+0000","last_clean":"2023-10-09T11:41:12.058961+0000","last_became_active":"2023-10-09T11:41:12.054637+0000","last_became_peered":"2023-10-09T11:41:12.054637+0000","last_unstale":"2023-10-09T11:41:12.058961+0000","last_undegraded":"2023-10-09T11:41:12.058961+0000","last_fullsized":"2023-10-09T11:41:12.058961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087160+0000","last_change":"2023-10-09T11:41:11.066464+0000","last_active":"2023-10-09T11:41:12.087160+0000","last_peered":"2023-10-09T11:41:12.087160+0000","last_clean":"2023-10-09T11:41:12.087160+0000","last_became_active":"2023-10-09T11:41:11.066166+0000","last_became_peered":"2023-10-09T11:41:11.066166+0000","last_unstale":"2023-10-09T11:41:12.087160+0000","last_undegraded":"2023-10-09T11:41:12.087160+0000","last_fullsized":"2023-10-09T11:41:12.087160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:02.875341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071715+0000","last_change":"2023-10-09T11:41:12.065762+0000","last_active":"2023-10-09T11:41:12.071715+0000","last_peered":"2023-10-09T11:41:12.071715+0000","last_clean":"2023-10-09T11:41:12.071715+0000","last_became_active":"2023-10-09T11:41:12.065421+0000","last_became_peered":"2023-10-09T11:41:12.065421+0000","last_unstale":"2023-10-09T11:41:12.071715+0000","last_undegraded":"2023-10-09T11:41:12.071715+0000","last_fullsized":"2023-10-09T11:41:12.071715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084177+0000","last_change":"2023-10-09T11:41:11.065898+0000","last_active":"2023-10-09T11:41:12.084177+0000","last_peered":"2023-10-09T11:41:12.084177+0000","last_clean":"2023-10-09T11:41:12.084177+0000","last_became_active":"2023-10-09T11:41:11.065594+0000","last_became_peered":"2023-10-09T11:41:11.065594+0000","last_unstale":"2023-10-09T11:41:12.084177+0000","last_undegraded":"2023-10-09T11:41:12.084177+0000","last_fullsized":"2023-10-09T11:41:12.084177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:55.877969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071698+0000","last_change":"2023-10-09T11:41:12.064978+0000","last_active":"2023-10-09T11:41:12.071698+0000","last_peered":"2023-10-09T11:41:12.071698+0000","last_clean":"2023-10-09T11:41:12.071698+0000","last_became_active":"2023-10-09T11:41:12.064674+0000","last_became_peered":"2023-10-09T11:41:12.064674+0000","last_unstale":"2023-10-09T11:41:12.071698+0000","last_undegraded":"2023-10-09T11:41:12.071698+0000","last_fullsized":"2023-10-09T11:41:12.071698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045586+0000","last_change":"2023-10-09T11:41:11.062024+0000","last_active":"2023-10-09T11:41:12.045586+0000","last_peered":"2023-10-09T11:41:12.045586+0000","last_clean":"2023-10-09T11:41:12.045586+0000","last_became_active":"2023-10-09T11:41:11.061759+0000","last_became_peered":"2023-10-09T11:41:11.061759+0000","last_unstale":"2023-10-09T11:41:12.045586+0000","last_undegraded":"2023-10-09T11:41:12.045586+0000","last_fullsized":"2023-10-09T11:41:12.045586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:28.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066071+0000","last_change":"2023-10-09T11:41:12.062692+0000","last_active":"2023-10-09T11:41:12.066071+0000","last_peered":"2023-10-09T11:41:12.066071+0000","last_clean":"2023-10-09T11:41:12.066071+0000","last_became_active":"2023-10-09T11:41:12.062415+0000","last_became_peered":"2023-10-09T11:41:12.062415+0000","last_unstale":"2023-10-09T11:41:12.066071+0000","last_undegraded":"2023-10-09T11:41:12.066071+0000","last_fullsized":"2023-10-09T11:41:12.066071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.077710+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.077435+0000","last_became_peered":"2023-10-09T11:41:11.077435+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058902+0000","last_change":"2023-10-09T11:41:12.051806+0000","last_active":"2023-10-09T11:41:12.058902+0000","last_peered":"2023-10-09T11:41:12.058902+0000","last_clean":"2023-10-09T11:41:12.058902+0000","last_became_active":"2023-10-09T11:41:12.051462+0000","last_became_peered":"2023-10-09T11:41:12.051462+0000","last_unstale":"2023-10-09T11:41:12.058902+0000","last_undegraded":"2023-10-09T11:41:12.058902+0000","last_fullsized":"2023-10-09T11:41:12.058902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055235+0000","last_change":"2023-10-09T11:41:12.048312+0000","last_active":"2023-10-09T11:41:12.055235+0000","last_peered":"2023-10-09T11:41:12.055235+0000","last_clean":"2023-10-09T11:41:12.055235+0000","last_became_active":"2023-10-09T11:41:12.048029+0000","last_became_peered":"2023-10-09T11:41:12.048029+0000","last_unstale":"2023-10-09T11:41:12.055235+0000","last_undegraded":"2023-10-09T11:41:12.055235+0000","last_fullsized":"2023-10-09T11:41:12.055235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.069456+0000","last_change":"2023-10-09T11:41:11.065740+0000","last_active":"2023-10-09T11:41:11.069456+0000","last_peered":"2023-10-09T11:41:11.069456+0000","last_clean":"2023-10-09T11:41:11.069456+0000","last_became_active":"2023-10-09T11:41:11.065420+0000","last_became_peered":"2023-10-09T11:41:11.065420+0000","last_unstale":"2023-10-09T11:41:11.069456+0000","last_undegraded":"2023-10-09T11:41:11.069456+0000","last_fullsized":"2023-10-09T11:41:11.069456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.067543+0000","last_change":"2023-10-09T11:41:12.063341+0000","last_active":"2023-10-09T11:41:12.067543+0000","last_peered":"2023-10-09T11:41:12.067543+0000","last_clean":"2023-10-09T11:41:12.067543+0000","last_became_active":"2023-10-09T11:41:12.063063+0000","last_became_peered":"2023-10-09T11:41:12.063063+0000","last_unstale":"2023-10-09T11:41:12.067543+0000","last_undegraded":"2023-10-09T11:41:12.067543+0000","last_fullsized":"2023-10-09T11:41:12.067543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052738+0000","last_change":"2023-10-09T11:41:11.064371+0000","last_active":"2023-10-09T11:41:12.052738+0000","last_peered":"2023-10-09T11:41:12.052738+0000","last_clean":"2023-10-09T11:41:12.052738+0000","last_became_active":"2023-10-09T11:41:11.064027+0000","last_became_peered":"2023-10-09T11:41:11.064027+0000","last_unstale":"2023-10-09T11:41:12.052738+0000","last_undegraded":"2023-10-09T11:41:12.052738+0000","last_fullsized":"2023-10-09T11:41:12.052738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044083+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:41:12.044083+0000","last_peered":"2023-10-09T11:41:12.044083+0000","last_clean":"2023-10-09T11:41:12.044083+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:41:12.044083+0000","last_undegraded":"2023-10-09T11:41:12.044083+0000","last_fullsized":"2023-10-09T11:41:12.044083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063606+0000","last_change":"2023-10-09T11:41:12.057248+0000","last_active":"2023-10-09T11:41:12.063606+0000","last_peered":"2023-10-09T11:41:12.063606+0000","last_clean":"2023-10-09T11:41:12.063606+0000","last_became_active":"2023-10-09T11:41:12.056873+0000","last_became_peered":"2023-10-09T11:41:12.056873+0000","last_unstale":"2023-10-09T11:41:12.063606+0000","last_undegraded":"2023-10-09T11:41:12.063606+0000","last_fullsized":"2023-10-09T11:41:12.063606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:16.551009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044184+0000","last_change":"2023-10-09T11:41:11.079718+0000","last_active":"2023-10-09T11:41:12.044184+0000","last_peered":"2023-10-09T11:41:12.044184+0000","last_clean":"2023-10-09T11:41:12.044184+0000","last_became_active":"2023-10-09T11:41:11.079488+0000","last_became_peered":"2023-10-09T11:41:11.079488+0000","last_unstale":"2023-10-09T11:41:12.044184+0000","last_undegraded":"2023-10-09T11:41:12.044184+0000","last_fullsized":"2023-10-09T11:41:12.044184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043828+0000","last_change":"2023-10-09T11:41:11.075456+0000","last_active":"2023-10-09T11:41:12.043828+0000","last_peered":"2023-10-09T11:41:12.043828+0000","last_clean":"2023-10-09T11:41:12.043828+0000","last_became_active":"2023-10-09T11:41:11.074500+0000","last_became_peered":"2023-10-09T11:41:11.074500+0000","last_unstale":"2023-10-09T11:41:12.043828+0000","last_undegraded":"2023-10-09T11:41:12.043828+0000","last_fullsized":"2023-10-09T11:41:12.043828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055214+0000","last_change":"2023-10-09T11:41:12.050593+0000","last_active":"2023-10-09T11:41:12.055214+0000","last_peered":"2023-10-09T11:41:12.055214+0000","last_clean":"2023-10-09T11:41:12.055214+0000","last_became_active":"2023-10-09T11:41:12.050327+0000","last_became_peered":"2023-10-09T11:41:12.050327+0000","last_unstale":"2023-10-09T11:41:12.055214+0000","last_undegraded":"2023-10-09T11:41:12.055214+0000","last_fullsized":"2023-10-09T11:41:12.055214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045891+0000","last_change":"2023-10-09T11:41:11.062590+0000","last_active":"2023-10-09T11:41:12.045891+0000","last_peered":"2023-10-09T11:41:12.045891+0000","last_clean":"2023-10-09T11:41:12.045891+0000","last_became_active":"2023-10-09T11:41:11.062303+0000","last_became_peered":"2023-10-09T11:41:11.062303+0000","last_unstale":"2023-10-09T11:41:12.045891+0000","last_undegraded":"2023-10-09T11:41:12.045891+0000","last_fullsized":"2023-10-09T11:41:12.045891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062836+0000","last_change":"2023-10-09T11:41:12.059380+0000","last_active":"2023-10-09T11:41:12.062836+0000","last_peered":"2023-10-09T11:41:12.062836+0000","last_clean":"2023-10-09T11:41:12.062836+0000","last_became_active":"2023-10-09T11:41:12.059091+0000","last_became_peered":"2023-10-09T11:41:12.059091+0000","last_unstale":"2023-10-09T11:41:12.062836+0000","last_undegraded":"2023-10-09T11:41:12.062836+0000","last_fullsized":"2023-10-09T11:41:12.062836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:41.207515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086758+0000","last_change":"2023-10-09T11:41:11.074722+0000","last_active":"2023-10-09T11:41:12.086758+0000","last_peered":"2023-10-09T11:41:12.086758+0000","last_clean":"2023-10-09T11:41:12.086758+0000","last_became_active":"2023-10-09T11:41:11.074417+0000","last_became_peered":"2023-10-09T11:41:11.074417+0000","last_unstale":"2023-10-09T11:41:12.086758+0000","last_undegraded":"2023-10-09T11:41:12.086758+0000","last_fullsized":"2023-10-09T11:41:12.086758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053509+0000","last_change":"2023-10-09T11:41:12.051884+0000","last_active":"2023-10-09T11:41:12.053509+0000","last_peered":"2023-10-09T11:41:12.053509+0000","last_clean":"2023-10-09T11:41:12.053509+0000","last_became_active":"2023-10-09T11:41:12.051012+0000","last_became_peered":"2023-10-09T11:41:12.051012+0000","last_unstale":"2023-10-09T11:41:12.053509+0000","last_undegraded":"2023-10-09T11:41:12.053509+0000","last_fullsized":"2023-10-09T11:41:12.053509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:59.214273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043996+0000","last_change":"2023-10-09T11:41:11.079256+0000","last_active":"2023-10-09T11:41:12.043996+0000","last_peered":"2023-10-09T11:41:12.043996+0000","last_clean":"2023-10-09T11:41:12.043996+0000","last_became_active":"2023-10-09T11:41:11.078999+0000","last_became_peered":"2023-10-09T11:41:11.078999+0000","last_unstale":"2023-10-09T11:41:12.043996+0000","last_undegraded":"2023-10-09T11:41:12.043996+0000","last_fullsized":"2023-10-09T11:41:12.043996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.057087+0000","last_change":"2023-10-09T11:41:12.048978+0000","last_active":"2023-10-09T11:41:12.057087+0000","last_peered":"2023-10-09T11:41:12.057087+0000","last_clean":"2023-10-09T11:41:12.057087+0000","last_became_active":"2023-10-09T11:41:12.048636+0000","last_became_peered":"2023-10-09T11:41:12.048636+0000","last_unstale":"2023-10-09T11:41:12.057087+0000","last_undegraded":"2023-10-09T11:41:12.057087+0000","last_fullsized":"2023-10-09T11:41:12.057087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045174+0000","last_change":"2023-10-09T11:41:11.074785+0000","last_active":"2023-10-09T11:41:12.045174+0000","last_peered":"2023-10-09T11:41:12.045174+0000","last_clean":"2023-10-09T11:41:12.045174+0000","last_became_active":"2023-10-09T11:41:11.074460+0000","last_became_peered":"2023-10-09T11:41:11.074460+0000","last_unstale":"2023-10-09T11:41:12.045174+0000","last_undegraded":"2023-10-09T11:41:12.045174+0000","last_fullsized":"2023-10-09T11:41:12.045174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055406+0000","last_change":"2023-10-09T11:41:12.050021+0000","last_active":"2023-10-09T11:41:12.055406+0000","last_peered":"2023-10-09T11:41:12.055406+0000","last_clean":"2023-10-09T11:41:12.055406+0000","last_became_active":"2023-10-09T11:41:12.049763+0000","last_became_peered":"2023-10-09T11:41:12.049763+0000","last_unstale":"2023-10-09T11:41:12.055406+0000","last_undegraded":"2023-10-09T11:41:12.055406+0000","last_fullsized":"2023-10-09T11:41:12.055406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045561+0000","last_change":"2023-10-09T11:41:11.063645+0000","last_active":"2023-10-09T11:41:12.045561+0000","last_peered":"2023-10-09T11:41:12.045561+0000","last_clean":"2023-10-09T11:41:12.045561+0000","last_became_active":"2023-10-09T11:41:11.063324+0000","last_became_peered":"2023-10-09T11:41:11.063324+0000","last_unstale":"2023-10-09T11:41:12.045561+0000","last_undegraded":"2023-10-09T11:41:12.045561+0000","last_fullsized":"2023-10-09T11:41:12.045561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059445+0000","last_change":"2023-10-09T11:41:12.053917+0000","last_active":"2023-10-09T11:41:12.059445+0000","last_peered":"2023-10-09T11:41:12.059445+0000","last_clean":"2023-10-09T11:41:12.059445+0000","last_became_active":"2023-10-09T11:41:12.051978+0000","last_became_peered":"2023-10-09T11:41:12.051978+0000","last_unstale":"2023-10-09T11:41:12.059445+0000","last_undegraded":"2023-10-09T11:41:12.059445+0000","last_fullsized":"2023-10-09T11:41:12.059445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086796+0000","last_change":"2023-10-09T11:41:11.076948+0000","last_active":"2023-10-09T11:41:12.086796+0000","last_peered":"2023-10-09T11:41:12.086796+0000","last_clean":"2023-10-09T11:41:12.086796+0000","last_became_active":"2023-10-09T11:41:11.076489+0000","last_became_peered":"2023-10-09T11:41:11.076489+0000","last_unstale":"2023-10-09T11:41:12.086796+0000","last_undegraded":"2023-10-09T11:41:12.086796+0000","last_fullsized":"2023-10-09T11:41:12.086796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061534+0000","last_change":"2023-10-09T11:41:12.056922+0000","last_active":"2023-10-09T11:41:12.061534+0000","last_peered":"2023-10-09T11:41:12.061534+0000","last_clean":"2023-10-09T11:41:12.061534+0000","last_became_active":"2023-10-09T11:41:12.056611+0000","last_became_peered":"2023-10-09T11:41:12.056611+0000","last_unstale":"2023-10-09T11:41:12.061534+0000","last_undegraded":"2023-10-09T11:41:12.061534+0000","last_fullsized":"2023-10-09T11:41:12.061534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:41:11.078229+0000","last_change":"2023-10-09T11:41:11.077460+0000","last_active":"2023-10-09T11:41:11.078229+0000","last_peered":"2023-10-09T11:41:11.078229+0000","last_clean":"2023-10-09T11:41:11.078229+0000","last_became_active":"2023-10-09T11:41:11.077192+0000","last_became_peered":"2023-10-09T11:41:11.077192+0000","last_unstale":"2023-10-09T11:41:11.078229+0000","last_undegraded":"2023-10-09T11:41:11.078229+0000","last_fullsized":"2023-10-09T11:41:11.078229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:56.491552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071319+0000","last_change":"2023-10-09T11:41:12.061959+0000","last_active":"2023-10-09T11:41:12.071319+0000","last_peered":"2023-10-09T11:41:12.071319+0000","last_clean":"2023-10-09T11:41:12.071319+0000","last_became_active":"2023-10-09T11:41:12.058357+0000","last_became_peered":"2023-10-09T11:41:12.058357+0000","last_unstale":"2023-10-09T11:41:12.071319+0000","last_undegraded":"2023-10-09T11:41:12.071319+0000","last_fullsized":"2023-10-09T11:41:12.071319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086287+0000","last_change":"2023-10-09T11:41:11.060748+0000","last_active":"2023-10-09T11:41:12.086287+0000","last_peered":"2023-10-09T11:41:12.086287+0000","last_clean":"2023-10-09T11:41:12.086287+0000","last_became_active":"2023-10-09T11:41:11.060436+0000","last_became_peered":"2023-10-09T11:41:11.060436+0000","last_unstale":"2023-10-09T11:41:12.086287+0000","last_undegraded":"2023-10-09T11:41:12.086287+0000","last_fullsized":"2023-10-09T11:41:12.086287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065329+0000","last_change":"2023-10-09T11:41:12.060982+0000","last_active":"2023-10-09T11:41:12.065329+0000","last_peered":"2023-10-09T11:41:12.065329+0000","last_clean":"2023-10-09T11:41:12.065329+0000","last_became_active":"2023-10-09T11:41:12.056626+0000","last_became_peered":"2023-10-09T11:41:12.056626+0000","last_unstale":"2023-10-09T11:41:12.065329+0000","last_undegraded":"2023-10-09T11:41:12.065329+0000","last_fullsized":"2023-10-09T11:41:12.065329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084562+0000","last_change":"2023-10-09T11:41:11.066536+0000","last_active":"2023-10-09T11:41:12.084562+0000","last_peered":"2023-10-09T11:41:12.084562+0000","last_clean":"2023-10-09T11:41:12.084562+0000","last_became_active":"2023-10-09T11:41:11.066194+0000","last_became_peered":"2023-10-09T11:41:11.066194+0000","last_unstale":"2023-10-09T11:41:12.084562+0000","last_undegraded":"2023-10-09T11:41:12.084562+0000","last_fullsized":"2023-10-09T11:41:12.084562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071765+0000","last_change":"2023-10-09T11:41:12.067596+0000","last_active":"2023-10-09T11:41:12.071765+0000","last_peered":"2023-10-09T11:41:12.071765+0000","last_clean":"2023-10-09T11:41:12.071765+0000","last_became_active":"2023-10-09T11:41:12.067282+0000","last_became_peered":"2023-10-09T11:41:12.067282+0000","last_unstale":"2023-10-09T11:41:12.071765+0000","last_undegraded":"2023-10-09T11:41:12.071765+0000","last_fullsized":"2023-10-09T11:41:12.071765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061545+0000","last_change":"2023-10-09T11:41:12.056097+0000","last_active":"2023-10-09T11:41:12.061545+0000","last_peered":"2023-10-09T11:41:12.061545+0000","last_clean":"2023-10-09T11:41:12.061545+0000","last_became_active":"2023-10-09T11:41:12.055031+0000","last_became_peered":"2023-10-09T11:41:12.055031+0000","last_unstale":"2023-10-09T11:41:12.061545+0000","last_undegraded":"2023-10-09T11:41:12.061545+0000","last_fullsized":"2023-10-09T11:41:12.061545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.056111+0000","last_change":"2023-10-09T11:41:12.056111+0000","last_active":"2023-10-09T11:41:12.056111+0000","last_peered":"2023-10-09T11:41:12.056111+0000","last_clean":"2023-10-09T11:41:12.056111+0000","last_became_active":"2023-10-09T11:41:12.055843+0000","last_became_peered":"2023-10-09T11:41:12.055843+0000","last_unstale":"2023-10-09T11:41:12.056111+0000","last_undegraded":"2023-10-09T11:41:12.056111+0000","last_fullsized":"2023-10-09T11:41:12.056111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:43.783508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063535+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.063535+0000","last_peered":"2023-10-09T11:41:12.063535+0000","last_clean":"2023-10-09T11:41:12.063535+0000","last_became_active":"2023-10-09T11:41:12.055904+0000","last_became_peered":"2023-10-09T11:41:12.055904+0000","last_unstale":"2023-10-09T11:41:12.063535+0000","last_undegraded":"2023-10-09T11:41:12.063535+0000","last_fullsized":"2023-10-09T11:41:12.063535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053222+0000","last_change":"2023-10-09T11:41:12.051485+0000","last_active":"2023-10-09T11:41:12.053222+0000","last_peered":"2023-10-09T11:41:12.053222+0000","last_clean":"2023-10-09T11:41:12.053222+0000","last_became_active":"2023-10-09T11:41:12.051192+0000","last_became_peered":"2023-10-09T11:41:12.051192+0000","last_unstale":"2023-10-09T11:41:12.053222+0000","last_undegraded":"2023-10-09T11:41:12.053222+0000","last_fullsized":"2023-10-09T11:41:12.053222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062890+0000","last_change":"2023-10-09T11:41:12.059625+0000","last_active":"2023-10-09T11:41:12.062890+0000","last_peered":"2023-10-09T11:41:12.062890+0000","last_clean":"2023-10-09T11:41:12.062890+0000","last_became_active":"2023-10-09T11:41:12.059319+0000","last_became_peered":"2023-10-09T11:41:12.059319+0000","last_unstale":"2023-10-09T11:41:12.062890+0000","last_undegraded":"2023-10-09T11:41:12.062890+0000","last_fullsized":"2023-10-09T11:41:12.062890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061223+0000","last_change":"2023-10-09T11:41:12.059993+0000","last_active":"2023-10-09T11:41:12.061223+0000","last_peered":"2023-10-09T11:41:12.061223+0000","last_clean":"2023-10-09T11:41:12.061223+0000","last_became_active":"2023-10-09T11:41:12.059604+0000","last_became_peered":"2023-10-09T11:41:12.059604+0000","last_unstale":"2023-10-09T11:41:12.061223+0000","last_undegraded":"2023-10-09T11:41:12.061223+0000","last_fullsized":"2023-10-09T11:41:12.061223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063218+0000","last_change":"2023-10-09T11:41:12.059495+0000","last_active":"2023-10-09T11:41:12.063218+0000","last_peered":"2023-10-09T11:41:12.063218+0000","last_clean":"2023-10-09T11:41:12.063218+0000","last_became_active":"2023-10-09T11:41:12.059200+0000","last_became_peered":"2023-10-09T11:41:12.059200+0000","last_unstale":"2023-10-09T11:41:12.063218+0000","last_undegraded":"2023-10-09T11:41:12.063218+0000","last_fullsized":"2023-10-09T11:41:12.063218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060308+0000","last_change":"2023-10-09T11:41:12.058708+0000","last_active":"2023-10-09T11:41:12.060308+0000","last_peered":"2023-10-09T11:41:12.060308+0000","last_clean":"2023-10-09T11:41:12.060308+0000","last_became_active":"2023-10-09T11:41:12.058356+0000","last_became_peered":"2023-10-09T11:41:12.058356+0000","last_unstale":"2023-10-09T11:41:12.060308+0000","last_undegraded":"2023-10-09T11:41:12.060308+0000","last_fullsized":"2023-10-09T11:41:12.060308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063595+0000","last_change":"2023-10-09T11:41:12.056307+0000","last_active":"2023-10-09T11:41:12.063595+0000","last_peered":"2023-10-09T11:41:12.063595+0000","last_clean":"2023-10-09T11:41:12.063595+0000","last_became_active":"2023-10-09T11:41:12.056023+0000","last_became_peered":"2023-10-09T11:41:12.056023+0000","last_unstale":"2023-10-09T11:41:12.063595+0000","last_undegraded":"2023-10-09T11:41:12.063595+0000","last_fullsized":"2023-10-09T11:41:12.063595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063421+0000","last_change":"2023-10-09T11:41:12.059080+0000","last_active":"2023-10-09T11:41:12.063421+0000","last_peered":"2023-10-09T11:41:12.063421+0000","last_clean":"2023-10-09T11:41:12.063421+0000","last_became_active":"2023-10-09T11:41:12.056426+0000","last_became_peered":"2023-10-09T11:41:12.056426+0000","last_unstale":"2023-10-09T11:41:12.063421+0000","last_undegraded":"2023-10-09T11:41:12.063421+0000","last_fullsized":"2023-10-09T11:41:12.063421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.072184+0000","last_change":"2023-10-09T11:41:12.069213+0000","last_active":"2023-10-09T11:41:12.072184+0000","last_peered":"2023-10-09T11:41:12.072184+0000","last_clean":"2023-10-09T11:41:12.072184+0000","last_became_active":"2023-10-09T11:41:12.068965+0000","last_became_peered":"2023-10-09T11:41:12.068965+0000","last_unstale":"2023-10-09T11:41:12.072184+0000","last_undegraded":"2023-10-09T11:41:12.072184+0000","last_fullsized":"2023-10-09T11:41:12.072184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053983+0000","last_change":"2023-10-09T11:41:12.052767+0000","last_active":"2023-10-09T11:41:12.053983+0000","last_peered":"2023-10-09T11:41:12.053983+0000","last_clean":"2023-10-09T11:41:12.053983+0000","last_became_active":"2023-10-09T11:41:12.052111+0000","last_became_peered":"2023-10-09T11:41:12.052111+0000","last_unstale":"2023-10-09T11:41:12.053983+0000","last_undegraded":"2023-10-09T11:41:12.053983+0000","last_fullsized":"2023-10-09T11:41:12.053983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061451+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.061451+0000","last_peered":"2023-10-09T11:41:12.061451+0000","last_clean":"2023-10-09T11:41:12.061451+0000","last_became_active":"2023-10-09T11:41:12.055911+0000","last_became_peered":"2023-10-09T11:41:12.055911+0000","last_unstale":"2023-10-09T11:41:12.061451+0000","last_undegraded":"2023-10-09T11:41:12.061451+0000","last_fullsized":"2023-10-09T11:41:12.061451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":68992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:21.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:21.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.409+0000 7f648b5ff700 1 Processor -- start 2023-10-09T11:41:21.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.409+0000 7f648b5ff700 1 -- start start 2023-10-09T11:41:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.410+0000 7f648b5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6484155c10 0x7f6484155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.410+0000 7f648b5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f64840ac6a0 0x7f64840b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.410+0000 7f648b5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64840acac0 con 0x7f64840ac230 2023-10-09T11:41:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.410+0000 7f648b5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64840ad930 con 0x7f64840ac6a0 2023-10-09T11:41:21.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.410+0000 7f648b5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64840acd20 con 0x7f6484155c10 2023-10-09T11:41:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f6488b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f64840ac230 0x7f64841568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37250/0 (socket says 172.21.15.86:37250) 2023-10-09T11:41:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f6488b9a700 1 -- 172.21.15.86:0/4200368335 learned_addr learned my addr 172.21.15.86:0/4200368335 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f648939b700 1 --2- 172.21.15.86:0/4200368335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6484155c10 0x7f6484155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f6489b9c700 1 --2- 172.21.15.86:0/4200368335 >> v2:172.21.15.135:3300/0 conn(0x7f64840ac6a0 0x7f64840b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f647bfff700 1 -- 172.21.15.86:0/4200368335 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657055150 0 0) 0x7f64840acac0 con 0x7f64840ac230 2023-10-09T11:41:21.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f647bfff700 1 -- 172.21.15.86:0/4200368335 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6470005780 con 0x7f64840ac230 2023-10-09T11:41:21.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f648939b700 1 -- 172.21.15.86:0/4200368335 >> v2:172.21.15.135:3300/0 conn(0x7f64840ac6a0 msgr2=0x7f64840b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f648939b700 1 --2- 172.21.15.86:0/4200368335 >> v2:172.21.15.135:3300/0 conn(0x7f64840ac6a0 0x7f64840b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f648939b700 1 -- 172.21.15.86:0/4200368335 >> v1:172.21.15.86:6789/0 conn(0x7f64840ac230 legacy=0x7f64841568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f648939b700 1 -- 172.21.15.86:0/4200368335 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840ad000 con 0x7f6484155c10 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.411+0000 7f6489b9c700 1 --2- 172.21.15.86:0/4200368335 >> v2:172.21.15.135:3300/0 conn(0x7f64840ac6a0 0x7f64840b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f648939b700 1 --2- 172.21.15.86:0/4200368335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6484155c10 0x7f6484155fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f64800098e0 tx=0x7f64800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b9fb6bbb6e7174 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f647bfff700 1 -- 172.21.15.86:0/4200368335 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011630 con 0x7f6484155c10 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f647bfff700 1 -- 172.21.15.86:0/4200368335 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480011790 con 0x7f6484155c10 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f647bfff700 1 -- 172.21.15.86:0/4200368335 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011b10 con 0x7f6484155c10 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f648b5ff700 1 -- 172.21.15.86:0/4200368335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6484155c10 msgr2=0x7f6484155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f648b5ff700 1 --2- 172.21.15.86:0/4200368335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6484155c10 0x7f6484155fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f64800098e0 tx=0x7f64800091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f648b5ff700 1 -- 172.21.15.86:0/4200368335 shutdown_connections 2023-10-09T11:41:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f648b5ff700 1 --2- 172.21.15.86:0/4200368335 >> v2:172.21.15.135:3300/0 conn(0x7f64840ac6a0 0x7f64840b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f648b5ff700 1 --2- 172.21.15.86:0/4200368335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6484155c10 0x7f6484155fe0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.412+0000 7f648b5ff700 1 -- 172.21.15.86:0/4200368335 >> 172.21.15.86:0/4200368335 conn(0x7f648406a320 msgr2=0x7f64840cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.413+0000 7f648b5ff700 1 -- 172.21.15.86:0/4200368335 shutdown_connections 2023-10-09T11:41:21.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.413+0000 7f648b5ff700 1 -- 172.21.15.86:0/4200368335 wait complete. 2023-10-09T11:41:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.414+0000 7f648b5ff700 1 Processor -- start 2023-10-09T11:41:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.414+0000 7f648b5ff700 1 -- start start 2023-10-09T11:41:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648b5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64840ac230 0x7f64840aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648b5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64840ac6a0 0x7f64840a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648b5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6484155c10 0x7f64840a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648b5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64840a54c0 con 0x7f64840ac230 2023-10-09T11:41:21.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648b5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484151840 con 0x7f6484155c10 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648b5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6484151b20 con 0x7f64840ac6a0 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648939b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64840ac230 0x7f64840aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648939b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64840ac230 0x7f64840aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39422/0 (socket says 172.21.15.86:39422) 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f648939b700 1 -- 172.21.15.86:0/3804074939 learned_addr learned my addr 172.21.15.86:0/3804074939 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f6488b9a700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64840ac6a0 0x7f64840a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.415+0000 7f6489b9c700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6484155c10 0x7f64840a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648939b700 1 -- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64840ac6a0 msgr2=0x7f64840a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648939b700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64840ac6a0 0x7f64840a7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648939b700 1 -- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6484155c10 msgr2=0x7f64840a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648939b700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6484155c10 0x7f64840a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648939b700 1 -- 172.21.15.86:0/3804074939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c009a20 con 0x7f64840ac230 2023-10-09T11:41:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648939b700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64840ac230 0x7f64840aacf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6484064290 tx=0x7f6480017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f64797fa700 1 -- 172.21.15.86:0/3804074939 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011b10 con 0x7f64840ac230 2023-10-09T11:41:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f64797fa700 1 -- 172.21.15.86:0/3804074939 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480000cc0 con 0x7f64840ac230 2023-10-09T11:41:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6480009420 con 0x7f64840ac230 2023-10-09T11:41:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f64797fa700 1 -- 172.21.15.86:0/3804074939 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648001a680 con 0x7f64840ac230 2023-10-09T11:41:21.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.416+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64841520e0 con 0x7f64840ac230 2023-10-09T11:41:21.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.417+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648404c3c0 con 0x7f64840ac230 2023-10-09T11:41:21.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.418+0000 7f64797fa700 1 -- 172.21.15.86:0/3804074939 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f648001aa70 con 0x7f64840ac230 2023-10-09T11:41:21.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.419+0000 7f64797fa700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6468066f30 0x7f64680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.419+0000 7f64797fa700 1 -- 172.21.15.86:0/3804074939 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64800861b0 con 0x7f64840ac230 2023-10-09T11:41:21.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.419+0000 7f6488b9a700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6468066f30 0x7f64680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.420+0000 7f6488b9a700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6468066f30 0x7f64680693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64740058d0 tx=0x7f6474009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.423+0000 7f64797fa700 1 -- 172.21.15.86:0/3804074939 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6480053420 con 0x7f64840ac230 2023-10-09T11:41:21.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.608+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64840a5600 con 0x7f6468066f30 2023-10-09T11:41:21.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.615+0000 7f64797fa700 1 -- 172.21.15.86:0/3804074939 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264561 (secure 0 0 0) 0x7f6474001d20 con 0x7f6468066f30 2023-10-09T11:41:21.619 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:21.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6468066f30 msgr2=0x7f64680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6468066f30 0x7f64680693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64740058d0 tx=0x7f6474009040 comp rx=0 tx=0).stop 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64840ac230 msgr2=0x7f64840aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64840ac230 0x7f64840aacf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6484064290 tx=0x7f6480017000 comp rx=0 tx=0).stop 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 shutdown_connections 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6468066f30 0x7f64680693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64840ac230 0x7f64840aacf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6484155c10 0x7f64840a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 --2- 172.21.15.86:0/3804074939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64840ac6a0 0x7f64840a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 >> 172.21.15.86:0/3804074939 conn(0x7f648406a320 msgr2=0x7f64840ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 shutdown_connections 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.619+0000 7f648b5ff700 1 -- 172.21.15.86:0/3804074939 wait complete. 2023-10-09T11:41:21.622 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:41:21.637 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-09T11:41:19.954397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381212,"kb_used_data":2908,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593508,"statfs":{"total":773094113280,"available":770655752192,"internally_reserved":0,"allocated":2977792,"data_stored":1781300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001771"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071394+0000","last_change":"2023-10-09T11:41:12.064188+0000","last_active":"2023-10-09T11:41:12.071394+0000","last_peered":"2023-10-09T11:41:12.071394+0000","last_clean":"2023-10-09T11:41:12.071394+0000","last_became_active":"2023-10-09T11:41:12.063875+0000","last_became_peered":"2023-10-09T11:41:12.063875+0000","last_unstale":"2023-10-09T11:41:12.071394+0000","last_undegraded":"2023-10-09T11:41:12.071394+0000","last_fullsized":"2023-10-09T11:41:12.071394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058844+0000","last_change":"2023-10-09T11:41:12.053292+0000","last_active":"2023-10-09T11:41:12.058844+0000","last_peered":"2023-10-09T11:41:12.058844+0000","last_clean":"2023-10-09T11:41:12.058844+0000","last_became_active":"2023-10-09T11:41:12.052978+0000","last_became_peered":"2023-10-09T11:41:12.052978+0000","last_unstale":"2023-10-09T11:41:12.058844+0000","last_undegraded":"2023-10-09T11:41:12.058844+0000","last_fullsized":"2023-10-09T11:41:12.058844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053403+0000","last_change":"2023-10-09T11:41:12.048670+0000","last_active":"2023-10-09T11:41:12.053403+0000","last_peered":"2023-10-09T11:41:12.053403+0000","last_clean":"2023-10-09T11:41:12.053403+0000","last_became_active":"2023-10-09T11:41:12.048364+0000","last_became_peered":"2023-10-09T11:41:12.048364+0000","last_unstale":"2023-10-09T11:41:12.053403+0000","last_undegraded":"2023-10-09T11:41:12.053403+0000","last_fullsized":"2023-10-09T11:41:12.053403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065349+0000","last_change":"2023-10-09T11:41:12.062125+0000","last_active":"2023-10-09T11:41:12.065349+0000","last_peered":"2023-10-09T11:41:12.065349+0000","last_clean":"2023-10-09T11:41:12.065349+0000","last_became_active":"2023-10-09T11:41:12.061872+0000","last_became_peered":"2023-10-09T11:41:12.061872+0000","last_unstale":"2023-10-09T11:41:12.065349+0000","last_undegraded":"2023-10-09T11:41:12.065349+0000","last_fullsized":"2023-10-09T11:41:12.065349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052679+0000","last_change":"2023-10-09T11:41:12.049492+0000","last_active":"2023-10-09T11:41:12.052679+0000","last_peered":"2023-10-09T11:41:12.052679+0000","last_clean":"2023-10-09T11:41:12.052679+0000","last_became_active":"2023-10-09T11:41:12.049220+0000","last_became_peered":"2023-10-09T11:41:12.049220+0000","last_unstale":"2023-10-09T11:41:12.052679+0000","last_undegraded":"2023-10-09T11:41:12.052679+0000","last_fullsized":"2023-10-09T11:41:12.052679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070457+0000","last_change":"2023-10-09T11:41:12.065396+0000","last_active":"2023-10-09T11:41:12.070457+0000","last_peered":"2023-10-09T11:41:12.070457+0000","last_clean":"2023-10-09T11:41:12.070457+0000","last_became_active":"2023-10-09T11:41:12.065090+0000","last_became_peered":"2023-10-09T11:41:12.065090+0000","last_unstale":"2023-10-09T11:41:12.070457+0000","last_undegraded":"2023-10-09T11:41:12.070457+0000","last_fullsized":"2023-10-09T11:41:12.070457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071362+0000","last_change":"2023-10-09T11:41:12.063605+0000","last_active":"2023-10-09T11:41:12.071362+0000","last_peered":"2023-10-09T11:41:12.071362+0000","last_clean":"2023-10-09T11:41:12.071362+0000","last_became_active":"2023-10-09T11:41:12.063327+0000","last_became_peered":"2023-10-09T11:41:12.063327+0000","last_unstale":"2023-10-09T11:41:12.071362+0000","last_undegraded":"2023-10-09T11:41:12.071362+0000","last_fullsized":"2023-10-09T11:41:12.071362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059474+0000","last_change":"2023-10-09T11:41:12.054453+0000","last_active":"2023-10-09T11:41:12.059474+0000","last_peered":"2023-10-09T11:41:12.059474+0000","last_clean":"2023-10-09T11:41:12.059474+0000","last_became_active":"2023-10-09T11:41:12.054117+0000","last_became_peered":"2023-10-09T11:41:12.054117+0000","last_unstale":"2023-10-09T11:41:12.059474+0000","last_undegraded":"2023-10-09T11:41:12.059474+0000","last_fullsized":"2023-10-09T11:41:12.059474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.054577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071695+0000","last_change":"2023-10-09T11:41:12.064789+0000","last_active":"2023-10-09T11:41:12.071695+0000","last_peered":"2023-10-09T11:41:12.071695+0000","last_clean":"2023-10-09T11:41:12.071695+0000","last_became_active":"2023-10-09T11:41:12.064496+0000","last_became_peered":"2023-10-09T11:41:12.064496+0000","last_unstale":"2023-10-09T11:41:12.071695+0000","last_undegraded":"2023-10-09T11:41:12.071695+0000","last_fullsized":"2023-10-09T11:41:12.071695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:04.019082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061611+0000","last_change":"2023-10-09T11:41:12.057786+0000","last_active":"2023-10-09T11:41:12.061611+0000","last_peered":"2023-10-09T11:41:12.061611+0000","last_clean":"2023-10-09T11:41:12.061611+0000","last_became_active":"2023-10-09T11:41:12.057470+0000","last_became_peered":"2023-10-09T11:41:12.057470+0000","last_unstale":"2023-10-09T11:41:12.061611+0000","last_undegraded":"2023-10-09T11:41:12.061611+0000","last_fullsized":"2023-10-09T11:41:12.061611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061547+0000","last_change":"2023-10-09T11:41:12.057855+0000","last_active":"2023-10-09T11:41:12.061547+0000","last_peered":"2023-10-09T11:41:12.061547+0000","last_clean":"2023-10-09T11:41:12.061547+0000","last_became_active":"2023-10-09T11:41:12.057494+0000","last_became_peered":"2023-10-09T11:41:12.057494+0000","last_unstale":"2023-10-09T11:41:12.061547+0000","last_undegraded":"2023-10-09T11:41:12.061547+0000","last_fullsized":"2023-10-09T11:41:12.061547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055353+0000","last_change":"2023-10-09T11:41:12.048796+0000","last_active":"2023-10-09T11:41:12.055353+0000","last_peered":"2023-10-09T11:41:12.055353+0000","last_clean":"2023-10-09T11:41:12.055353+0000","last_became_active":"2023-10-09T11:41:12.048484+0000","last_became_peered":"2023-10-09T11:41:12.048484+0000","last_unstale":"2023-10-09T11:41:12.055353+0000","last_undegraded":"2023-10-09T11:41:12.055353+0000","last_fullsized":"2023-10-09T11:41:12.055353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059423+0000","last_change":"2023-10-09T11:41:12.052334+0000","last_active":"2023-10-09T11:41:12.059423+0000","last_peered":"2023-10-09T11:41:12.059423+0000","last_clean":"2023-10-09T11:41:12.059423+0000","last_became_active":"2023-10-09T11:41:12.051731+0000","last_became_peered":"2023-10-09T11:41:12.051731+0000","last_unstale":"2023-10-09T11:41:12.059423+0000","last_undegraded":"2023-10-09T11:41:12.059423+0000","last_fullsized":"2023-10-09T11:41:12.059423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:25.351610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053609+0000","last_change":"2023-10-09T11:41:12.051643+0000","last_active":"2023-10-09T11:41:12.053609+0000","last_peered":"2023-10-09T11:41:12.053609+0000","last_clean":"2023-10-09T11:41:12.053609+0000","last_became_active":"2023-10-09T11:41:12.051337+0000","last_became_peered":"2023-10-09T11:41:12.051337+0000","last_unstale":"2023-10-09T11:41:12.053609+0000","last_undegraded":"2023-10-09T11:41:12.053609+0000","last_fullsized":"2023-10-09T11:41:12.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:10.056568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059700+0000","last_change":"2023-10-09T11:41:12.058090+0000","last_active":"2023-10-09T11:41:12.059700+0000","last_peered":"2023-10-09T11:41:12.059700+0000","last_clean":"2023-10-09T11:41:12.059700+0000","last_became_active":"2023-10-09T11:41:12.057829+0000","last_became_peered":"2023-10-09T11:41:12.057829+0000","last_unstale":"2023-10-09T11:41:12.059700+0000","last_undegraded":"2023-10-09T11:41:12.059700+0000","last_fullsized":"2023-10-09T11:41:12.059700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064496+0000","last_change":"2023-10-09T11:41:12.059376+0000","last_active":"2023-10-09T11:41:12.064496+0000","last_peered":"2023-10-09T11:41:12.064496+0000","last_clean":"2023-10-09T11:41:12.064496+0000","last_became_active":"2023-10-09T11:41:12.059105+0000","last_became_peered":"2023-10-09T11:41:12.059105+0000","last_unstale":"2023-10-09T11:41:12.064496+0000","last_undegraded":"2023-10-09T11:41:12.064496+0000","last_fullsized":"2023-10-09T11:41:12.064496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070447+0000","last_change":"2023-10-09T11:41:12.064945+0000","last_active":"2023-10-09T11:41:12.070447+0000","last_peered":"2023-10-09T11:41:12.070447+0000","last_clean":"2023-10-09T11:41:12.070447+0000","last_became_active":"2023-10-09T11:41:12.064668+0000","last_became_peered":"2023-10-09T11:41:12.064668+0000","last_unstale":"2023-10-09T11:41:12.070447+0000","last_undegraded":"2023-10-09T11:41:12.070447+0000","last_fullsized":"2023-10-09T11:41:12.070447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052841+0000","last_change":"2023-10-09T11:41:12.049265+0000","last_active":"2023-10-09T11:41:12.052841+0000","last_peered":"2023-10-09T11:41:12.052841+0000","last_clean":"2023-10-09T11:41:12.052841+0000","last_became_active":"2023-10-09T11:41:12.049000+0000","last_became_peered":"2023-10-09T11:41:12.049000+0000","last_unstale":"2023-10-09T11:41:12.052841+0000","last_undegraded":"2023-10-09T11:41:12.052841+0000","last_fullsized":"2023-10-09T11:41:12.052841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:17.015986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064795+0000","last_change":"2023-10-09T11:41:12.052554+0000","last_active":"2023-10-09T11:41:12.064795+0000","last_peered":"2023-10-09T11:41:12.064795+0000","last_clean":"2023-10-09T11:41:12.064795+0000","last_became_active":"2023-10-09T11:41:12.050539+0000","last_became_peered":"2023-10-09T11:41:12.050539+0000","last_unstale":"2023-10-09T11:41:12.064795+0000","last_undegraded":"2023-10-09T11:41:12.064795+0000","last_fullsized":"2023-10-09T11:41:12.064795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.088830+0000","last_change":"2023-10-09T11:41:11.074267+0000","last_active":"2023-10-09T11:41:12.088830+0000","last_peered":"2023-10-09T11:41:12.088830+0000","last_clean":"2023-10-09T11:41:12.088830+0000","last_became_active":"2023-10-09T11:41:11.073971+0000","last_became_peered":"2023-10-09T11:41:11.073971+0000","last_unstale":"2023-10-09T11:41:12.088830+0000","last_undegraded":"2023-10-09T11:41:12.088830+0000","last_fullsized":"2023-10-09T11:41:12.088830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:17.546372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059770+0000","last_change":"2023-10-09T11:41:12.054265+0000","last_active":"2023-10-09T11:41:12.059770+0000","last_peered":"2023-10-09T11:41:12.059770+0000","last_clean":"2023-10-09T11:41:12.059770+0000","last_became_active":"2023-10-09T11:41:12.053826+0000","last_became_peered":"2023-10-09T11:41:12.053826+0000","last_unstale":"2023-10-09T11:41:12.059770+0000","last_undegraded":"2023-10-09T11:41:12.059770+0000","last_fullsized":"2023-10-09T11:41:12.059770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:00.372669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.085137+0000","last_change":"2023-10-09T11:41:11.063441+0000","last_active":"2023-10-09T11:41:12.085137+0000","last_peered":"2023-10-09T11:41:12.085137+0000","last_clean":"2023-10-09T11:41:12.085137+0000","last_became_active":"2023-10-09T11:41:11.063025+0000","last_became_peered":"2023-10-09T11:41:11.063025+0000","last_unstale":"2023-10-09T11:41:12.085137+0000","last_undegraded":"2023-10-09T11:41:12.085137+0000","last_fullsized":"2023-10-09T11:41:12.085137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:21.843438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063925+0000","last_change":"2023-10-09T11:41:12.058625+0000","last_active":"2023-10-09T11:41:12.063925+0000","last_peered":"2023-10-09T11:41:12.063925+0000","last_clean":"2023-10-09T11:41:12.063925+0000","last_became_active":"2023-10-09T11:41:12.057462+0000","last_became_peered":"2023-10-09T11:41:12.057462+0000","last_unstale":"2023-10-09T11:41:12.063925+0000","last_undegraded":"2023-10-09T11:41:12.063925+0000","last_fullsized":"2023-10-09T11:41:12.063925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086798+0000","last_change":"2023-10-09T11:41:11.079554+0000","last_active":"2023-10-09T11:41:12.086798+0000","last_peered":"2023-10-09T11:41:12.086798+0000","last_clean":"2023-10-09T11:41:12.086798+0000","last_became_active":"2023-10-09T11:41:11.079230+0000","last_became_peered":"2023-10-09T11:41:11.079230+0000","last_unstale":"2023-10-09T11:41:12.086798+0000","last_undegraded":"2023-10-09T11:41:12.086798+0000","last_fullsized":"2023-10-09T11:41:12.086798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064686+0000","last_change":"2023-10-09T11:41:12.060600+0000","last_active":"2023-10-09T11:41:12.064686+0000","last_peered":"2023-10-09T11:41:12.064686+0000","last_clean":"2023-10-09T11:41:12.064686+0000","last_became_active":"2023-10-09T11:41:12.060325+0000","last_became_peered":"2023-10-09T11:41:12.060325+0000","last_unstale":"2023-10-09T11:41:12.064686+0000","last_undegraded":"2023-10-09T11:41:12.064686+0000","last_fullsized":"2023-10-09T11:41:12.064686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086427+0000","last_change":"2023-10-09T11:41:11.082099+0000","last_active":"2023-10-09T11:41:12.086427+0000","last_peered":"2023-10-09T11:41:12.086427+0000","last_clean":"2023-10-09T11:41:12.086427+0000","last_became_active":"2023-10-09T11:41:11.081703+0000","last_became_peered":"2023-10-09T11:41:11.081703+0000","last_unstale":"2023-10-09T11:41:12.086427+0000","last_undegraded":"2023-10-09T11:41:12.086427+0000","last_fullsized":"2023-10-09T11:41:12.086427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:59.333597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066051+0000","last_change":"2023-10-09T11:41:12.059389+0000","last_active":"2023-10-09T11:41:12.066051+0000","last_peered":"2023-10-09T11:41:12.066051+0000","last_clean":"2023-10-09T11:41:12.066051+0000","last_became_active":"2023-10-09T11:41:12.059089+0000","last_became_peered":"2023-10-09T11:41:12.059089+0000","last_unstale":"2023-10-09T11:41:12.066051+0000","last_undegraded":"2023-10-09T11:41:12.066051+0000","last_fullsized":"2023-10-09T11:41:12.066051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086469+0000","last_change":"2023-10-09T11:41:11.074679+0000","last_active":"2023-10-09T11:41:12.086469+0000","last_peered":"2023-10-09T11:41:12.086469+0000","last_clean":"2023-10-09T11:41:12.086469+0000","last_became_active":"2023-10-09T11:41:11.074362+0000","last_became_peered":"2023-10-09T11:41:11.074362+0000","last_unstale":"2023-10-09T11:41:12.086469+0000","last_undegraded":"2023-10-09T11:41:12.086469+0000","last_fullsized":"2023-10-09T11:41:12.086469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055401+0000","last_change":"2023-10-09T11:41:12.048767+0000","last_active":"2023-10-09T11:41:12.055401+0000","last_peered":"2023-10-09T11:41:12.055401+0000","last_clean":"2023-10-09T11:41:12.055401+0000","last_became_active":"2023-10-09T11:41:12.048451+0000","last_became_peered":"2023-10-09T11:41:12.048451+0000","last_unstale":"2023-10-09T11:41:12.055401+0000","last_undegraded":"2023-10-09T11:41:12.055401+0000","last_fullsized":"2023-10-09T11:41:12.055401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:29.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087372+0000","last_change":"2023-10-09T11:41:11.068876+0000","last_active":"2023-10-09T11:41:12.087372+0000","last_peered":"2023-10-09T11:41:12.087372+0000","last_clean":"2023-10-09T11:41:12.087372+0000","last_became_active":"2023-10-09T11:41:11.068602+0000","last_became_peered":"2023-10-09T11:41:11.068602+0000","last_unstale":"2023-10-09T11:41:12.087372+0000","last_undegraded":"2023-10-09T11:41:12.087372+0000","last_fullsized":"2023-10-09T11:41:12.087372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063758+0000","last_change":"2023-10-09T11:41:12.058551+0000","last_active":"2023-10-09T11:41:12.063758+0000","last_peered":"2023-10-09T11:41:12.063758+0000","last_clean":"2023-10-09T11:41:12.063758+0000","last_became_active":"2023-10-09T11:41:12.056962+0000","last_became_peered":"2023-10-09T11:41:12.056962+0000","last_unstale":"2023-10-09T11:41:12.063758+0000","last_undegraded":"2023-10-09T11:41:12.063758+0000","last_fullsized":"2023-10-09T11:41:12.063758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.038859+0000","last_change":"2023-10-09T11:41:11.072956+0000","last_active":"2023-10-09T11:41:12.038859+0000","last_peered":"2023-10-09T11:41:12.038859+0000","last_clean":"2023-10-09T11:41:12.038859+0000","last_became_active":"2023-10-09T11:41:11.072711+0000","last_became_peered":"2023-10-09T11:41:11.072711+0000","last_unstale":"2023-10-09T11:41:12.038859+0000","last_undegraded":"2023-10-09T11:41:12.038859+0000","last_fullsized":"2023-10-09T11:41:12.038859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060221+0000","last_change":"2023-10-09T11:41:12.056233+0000","last_active":"2023-10-09T11:41:12.060221+0000","last_peered":"2023-10-09T11:41:12.060221+0000","last_clean":"2023-10-09T11:41:12.060221+0000","last_became_active":"2023-10-09T11:41:12.055836+0000","last_became_peered":"2023-10-09T11:41:12.055836+0000","last_unstale":"2023-10-09T11:41:12.060221+0000","last_undegraded":"2023-10-09T11:41:12.060221+0000","last_fullsized":"2023-10-09T11:41:12.060221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.076596+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.075211+0000","last_became_peered":"2023-10-09T11:41:11.075211+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061196+0000","last_change":"2023-10-09T11:41:12.059816+0000","last_active":"2023-10-09T11:41:12.061196+0000","last_peered":"2023-10-09T11:41:12.061196+0000","last_clean":"2023-10-09T11:41:12.061196+0000","last_became_active":"2023-10-09T11:41:12.059529+0000","last_became_peered":"2023-10-09T11:41:12.059529+0000","last_unstale":"2023-10-09T11:41:12.061196+0000","last_undegraded":"2023-10-09T11:41:12.061196+0000","last_fullsized":"2023-10-09T11:41:12.061196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043525+0000","last_change":"2023-10-09T11:41:11.077704+0000","last_active":"2023-10-09T11:41:12.043525+0000","last_peered":"2023-10-09T11:41:12.043525+0000","last_clean":"2023-10-09T11:41:12.043525+0000","last_became_active":"2023-10-09T11:41:11.077405+0000","last_became_peered":"2023-10-09T11:41:11.077405+0000","last_unstale":"2023-10-09T11:41:12.043525+0000","last_undegraded":"2023-10-09T11:41:12.043525+0000","last_fullsized":"2023-10-09T11:41:12.043525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064572+0000","last_change":"2023-10-09T11:41:12.060375+0000","last_active":"2023-10-09T11:41:12.064572+0000","last_peered":"2023-10-09T11:41:12.064572+0000","last_clean":"2023-10-09T11:41:12.064572+0000","last_became_active":"2023-10-09T11:41:12.060103+0000","last_became_peered":"2023-10-09T11:41:12.060103+0000","last_unstale":"2023-10-09T11:41:12.064572+0000","last_undegraded":"2023-10-09T11:41:12.064572+0000","last_fullsized":"2023-10-09T11:41:12.064572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055192+0000","last_change":"2023-10-09T11:41:11.071764+0000","last_active":"2023-10-09T11:41:12.055192+0000","last_peered":"2023-10-09T11:41:12.055192+0000","last_clean":"2023-10-09T11:41:12.055192+0000","last_became_active":"2023-10-09T11:41:11.070619+0000","last_became_peered":"2023-10-09T11:41:11.070619+0000","last_unstale":"2023-10-09T11:41:12.055192+0000","last_undegraded":"2023-10-09T11:41:12.055192+0000","last_fullsized":"2023-10-09T11:41:12.055192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063724+0000","last_change":"2023-10-09T11:41:12.057796+0000","last_active":"2023-10-09T11:41:12.063724+0000","last_peered":"2023-10-09T11:41:12.063724+0000","last_clean":"2023-10-09T11:41:12.063724+0000","last_became_active":"2023-10-09T11:41:12.057536+0000","last_became_peered":"2023-10-09T11:41:12.057536+0000","last_unstale":"2023-10-09T11:41:12.063724+0000","last_undegraded":"2023-10-09T11:41:12.063724+0000","last_fullsized":"2023-10-09T11:41:12.063724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086648+0000","last_change":"2023-10-09T11:41:11.077183+0000","last_active":"2023-10-09T11:41:12.086648+0000","last_peered":"2023-10-09T11:41:12.086648+0000","last_clean":"2023-10-09T11:41:12.086648+0000","last_became_active":"2023-10-09T11:41:11.076940+0000","last_became_peered":"2023-10-09T11:41:11.076940+0000","last_unstale":"2023-10-09T11:41:12.086648+0000","last_undegraded":"2023-10-09T11:41:12.086648+0000","last_fullsized":"2023-10-09T11:41:12.086648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055266+0000","last_change":"2023-10-09T11:41:12.048070+0000","last_active":"2023-10-09T11:41:12.055266+0000","last_peered":"2023-10-09T11:41:12.055266+0000","last_clean":"2023-10-09T11:41:12.055266+0000","last_became_active":"2023-10-09T11:41:12.047867+0000","last_became_peered":"2023-10-09T11:41:12.047867+0000","last_unstale":"2023-10-09T11:41:12.055266+0000","last_undegraded":"2023-10-09T11:41:12.055266+0000","last_fullsized":"2023-10-09T11:41:12.055266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:01.222208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.089647+0000","last_change":"2023-10-09T11:41:11.068939+0000","last_active":"2023-10-09T11:41:12.089647+0000","last_peered":"2023-10-09T11:41:12.089647+0000","last_clean":"2023-10-09T11:41:12.089647+0000","last_became_active":"2023-10-09T11:41:11.068555+0000","last_became_peered":"2023-10-09T11:41:11.068555+0000","last_unstale":"2023-10-09T11:41:12.089647+0000","last_undegraded":"2023-10-09T11:41:12.089647+0000","last_fullsized":"2023-10-09T11:41:12.089647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064816+0000","last_change":"2023-10-09T11:41:12.058308+0000","last_active":"2023-10-09T11:41:12.064816+0000","last_peered":"2023-10-09T11:41:12.064816+0000","last_clean":"2023-10-09T11:41:12.064816+0000","last_became_active":"2023-10-09T11:41:12.057987+0000","last_became_peered":"2023-10-09T11:41:12.057987+0000","last_unstale":"2023-10-09T11:41:12.064816+0000","last_undegraded":"2023-10-09T11:41:12.064816+0000","last_fullsized":"2023-10-09T11:41:12.064816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086499+0000","last_change":"2023-10-09T11:41:11.065387+0000","last_active":"2023-10-09T11:41:12.086499+0000","last_peered":"2023-10-09T11:41:12.086499+0000","last_clean":"2023-10-09T11:41:12.086499+0000","last_became_active":"2023-10-09T11:41:11.065121+0000","last_became_peered":"2023-10-09T11:41:11.065121+0000","last_unstale":"2023-10-09T11:41:12.086499+0000","last_undegraded":"2023-10-09T11:41:12.086499+0000","last_fullsized":"2023-10-09T11:41:12.086499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:19.832054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053962+0000","last_change":"2023-10-09T11:41:12.052247+0000","last_active":"2023-10-09T11:41:12.053962+0000","last_peered":"2023-10-09T11:41:12.053962+0000","last_clean":"2023-10-09T11:41:12.053962+0000","last_became_active":"2023-10-09T11:41:12.051882+0000","last_became_peered":"2023-10-09T11:41:12.051882+0000","last_unstale":"2023-10-09T11:41:12.053962+0000","last_undegraded":"2023-10-09T11:41:12.053962+0000","last_fullsized":"2023-10-09T11:41:12.053962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052727+0000","last_change":"2023-10-09T11:41:11.077221+0000","last_active":"2023-10-09T11:41:12.052727+0000","last_peered":"2023-10-09T11:41:12.052727+0000","last_clean":"2023-10-09T11:41:12.052727+0000","last_became_active":"2023-10-09T11:41:11.075558+0000","last_became_peered":"2023-10-09T11:41:11.075558+0000","last_unstale":"2023-10-09T11:41:12.052727+0000","last_undegraded":"2023-10-09T11:41:12.052727+0000","last_fullsized":"2023-10-09T11:41:12.052727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071415+0000","last_change":"2023-10-09T11:41:12.064288+0000","last_active":"2023-10-09T11:41:12.071415+0000","last_peered":"2023-10-09T11:41:12.071415+0000","last_clean":"2023-10-09T11:41:12.071415+0000","last_became_active":"2023-10-09T11:41:12.064017+0000","last_became_peered":"2023-10-09T11:41:12.064017+0000","last_unstale":"2023-10-09T11:41:12.071415+0000","last_undegraded":"2023-10-09T11:41:12.071415+0000","last_fullsized":"2023-10-09T11:41:12.071415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043298+0000","last_change":"2023-10-09T11:41:11.069670+0000","last_active":"2023-10-09T11:41:12.043298+0000","last_peered":"2023-10-09T11:41:12.043298+0000","last_clean":"2023-10-09T11:41:12.043298+0000","last_became_active":"2023-10-09T11:41:11.069325+0000","last_became_peered":"2023-10-09T11:41:11.069325+0000","last_unstale":"2023-10-09T11:41:12.043298+0000","last_undegraded":"2023-10-09T11:41:12.043298+0000","last_fullsized":"2023-10-09T11:41:12.043298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058961+0000","last_change":"2023-10-09T11:41:12.054973+0000","last_active":"2023-10-09T11:41:12.058961+0000","last_peered":"2023-10-09T11:41:12.058961+0000","last_clean":"2023-10-09T11:41:12.058961+0000","last_became_active":"2023-10-09T11:41:12.054637+0000","last_became_peered":"2023-10-09T11:41:12.054637+0000","last_unstale":"2023-10-09T11:41:12.058961+0000","last_undegraded":"2023-10-09T11:41:12.058961+0000","last_fullsized":"2023-10-09T11:41:12.058961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087283+0000","last_change":"2023-10-09T11:41:11.066464+0000","last_active":"2023-10-09T11:41:12.087283+0000","last_peered":"2023-10-09T11:41:12.087283+0000","last_clean":"2023-10-09T11:41:12.087283+0000","last_became_active":"2023-10-09T11:41:11.066166+0000","last_became_peered":"2023-10-09T11:41:11.066166+0000","last_unstale":"2023-10-09T11:41:12.087283+0000","last_undegraded":"2023-10-09T11:41:12.087283+0000","last_fullsized":"2023-10-09T11:41:12.087283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:02.875341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071715+0000","last_change":"2023-10-09T11:41:12.065762+0000","last_active":"2023-10-09T11:41:12.071715+0000","last_peered":"2023-10-09T11:41:12.071715+0000","last_clean":"2023-10-09T11:41:12.071715+0000","last_became_active":"2023-10-09T11:41:12.065421+0000","last_became_peered":"2023-10-09T11:41:12.065421+0000","last_unstale":"2023-10-09T11:41:12.071715+0000","last_undegraded":"2023-10-09T11:41:12.071715+0000","last_fullsized":"2023-10-09T11:41:12.071715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084177+0000","last_change":"2023-10-09T11:41:11.065898+0000","last_active":"2023-10-09T11:41:12.084177+0000","last_peered":"2023-10-09T11:41:12.084177+0000","last_clean":"2023-10-09T11:41:12.084177+0000","last_became_active":"2023-10-09T11:41:11.065594+0000","last_became_peered":"2023-10-09T11:41:11.065594+0000","last_unstale":"2023-10-09T11:41:12.084177+0000","last_undegraded":"2023-10-09T11:41:12.084177+0000","last_fullsized":"2023-10-09T11:41:12.084177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:55.877969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071698+0000","last_change":"2023-10-09T11:41:12.064978+0000","last_active":"2023-10-09T11:41:12.071698+0000","last_peered":"2023-10-09T11:41:12.071698+0000","last_clean":"2023-10-09T11:41:12.071698+0000","last_became_active":"2023-10-09T11:41:12.064674+0000","last_became_peered":"2023-10-09T11:41:12.064674+0000","last_unstale":"2023-10-09T11:41:12.071698+0000","last_undegraded":"2023-10-09T11:41:12.071698+0000","last_fullsized":"2023-10-09T11:41:12.071698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045586+0000","last_change":"2023-10-09T11:41:11.062024+0000","last_active":"2023-10-09T11:41:12.045586+0000","last_peered":"2023-10-09T11:41:12.045586+0000","last_clean":"2023-10-09T11:41:12.045586+0000","last_became_active":"2023-10-09T11:41:11.061759+0000","last_became_peered":"2023-10-09T11:41:11.061759+0000","last_unstale":"2023-10-09T11:41:12.045586+0000","last_undegraded":"2023-10-09T11:41:12.045586+0000","last_fullsized":"2023-10-09T11:41:12.045586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:28.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066071+0000","last_change":"2023-10-09T11:41:12.062692+0000","last_active":"2023-10-09T11:41:12.066071+0000","last_peered":"2023-10-09T11:41:12.066071+0000","last_clean":"2023-10-09T11:41:12.066071+0000","last_became_active":"2023-10-09T11:41:12.062415+0000","last_became_peered":"2023-10-09T11:41:12.062415+0000","last_unstale":"2023-10-09T11:41:12.066071+0000","last_undegraded":"2023-10-09T11:41:12.066071+0000","last_fullsized":"2023-10-09T11:41:12.066071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.077710+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.077435+0000","last_became_peered":"2023-10-09T11:41:11.077435+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058902+0000","last_change":"2023-10-09T11:41:12.051806+0000","last_active":"2023-10-09T11:41:12.058902+0000","last_peered":"2023-10-09T11:41:12.058902+0000","last_clean":"2023-10-09T11:41:12.058902+0000","last_became_active":"2023-10-09T11:41:12.051462+0000","last_became_peered":"2023-10-09T11:41:12.051462+0000","last_unstale":"2023-10-09T11:41:12.058902+0000","last_undegraded":"2023-10-09T11:41:12.058902+0000","last_fullsized":"2023-10-09T11:41:12.058902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055235+0000","last_change":"2023-10-09T11:41:12.048312+0000","last_active":"2023-10-09T11:41:12.055235+0000","last_peered":"2023-10-09T11:41:12.055235+0000","last_clean":"2023-10-09T11:41:12.055235+0000","last_became_active":"2023-10-09T11:41:12.048029+0000","last_became_peered":"2023-10-09T11:41:12.048029+0000","last_unstale":"2023-10-09T11:41:12.055235+0000","last_undegraded":"2023-10-09T11:41:12.055235+0000","last_fullsized":"2023-10-09T11:41:12.055235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044145+0000","last_change":"2023-10-09T11:41:11.065740+0000","last_active":"2023-10-09T11:41:12.044145+0000","last_peered":"2023-10-09T11:41:12.044145+0000","last_clean":"2023-10-09T11:41:12.044145+0000","last_became_active":"2023-10-09T11:41:11.065420+0000","last_became_peered":"2023-10-09T11:41:11.065420+0000","last_unstale":"2023-10-09T11:41:12.044145+0000","last_undegraded":"2023-10-09T11:41:12.044145+0000","last_fullsized":"2023-10-09T11:41:12.044145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.067543+0000","last_change":"2023-10-09T11:41:12.063341+0000","last_active":"2023-10-09T11:41:12.067543+0000","last_peered":"2023-10-09T11:41:12.067543+0000","last_clean":"2023-10-09T11:41:12.067543+0000","last_became_active":"2023-10-09T11:41:12.063063+0000","last_became_peered":"2023-10-09T11:41:12.063063+0000","last_unstale":"2023-10-09T11:41:12.067543+0000","last_undegraded":"2023-10-09T11:41:12.067543+0000","last_fullsized":"2023-10-09T11:41:12.067543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052738+0000","last_change":"2023-10-09T11:41:11.064371+0000","last_active":"2023-10-09T11:41:12.052738+0000","last_peered":"2023-10-09T11:41:12.052738+0000","last_clean":"2023-10-09T11:41:12.052738+0000","last_became_active":"2023-10-09T11:41:11.064027+0000","last_became_peered":"2023-10-09T11:41:11.064027+0000","last_unstale":"2023-10-09T11:41:12.052738+0000","last_undegraded":"2023-10-09T11:41:12.052738+0000","last_fullsized":"2023-10-09T11:41:12.052738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044083+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:41:12.044083+0000","last_peered":"2023-10-09T11:41:12.044083+0000","last_clean":"2023-10-09T11:41:12.044083+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:41:12.044083+0000","last_undegraded":"2023-10-09T11:41:12.044083+0000","last_fullsized":"2023-10-09T11:41:12.044083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063606+0000","last_change":"2023-10-09T11:41:12.057248+0000","last_active":"2023-10-09T11:41:12.063606+0000","last_peered":"2023-10-09T11:41:12.063606+0000","last_clean":"2023-10-09T11:41:12.063606+0000","last_became_active":"2023-10-09T11:41:12.056873+0000","last_became_peered":"2023-10-09T11:41:12.056873+0000","last_unstale":"2023-10-09T11:41:12.063606+0000","last_undegraded":"2023-10-09T11:41:12.063606+0000","last_fullsized":"2023-10-09T11:41:12.063606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:16.551009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044184+0000","last_change":"2023-10-09T11:41:11.079718+0000","last_active":"2023-10-09T11:41:12.044184+0000","last_peered":"2023-10-09T11:41:12.044184+0000","last_clean":"2023-10-09T11:41:12.044184+0000","last_became_active":"2023-10-09T11:41:11.079488+0000","last_became_peered":"2023-10-09T11:41:11.079488+0000","last_unstale":"2023-10-09T11:41:12.044184+0000","last_undegraded":"2023-10-09T11:41:12.044184+0000","last_fullsized":"2023-10-09T11:41:12.044184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043828+0000","last_change":"2023-10-09T11:41:11.075456+0000","last_active":"2023-10-09T11:41:12.043828+0000","last_peered":"2023-10-09T11:41:12.043828+0000","last_clean":"2023-10-09T11:41:12.043828+0000","last_became_active":"2023-10-09T11:41:11.074500+0000","last_became_peered":"2023-10-09T11:41:11.074500+0000","last_unstale":"2023-10-09T11:41:12.043828+0000","last_undegraded":"2023-10-09T11:41:12.043828+0000","last_fullsized":"2023-10-09T11:41:12.043828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055214+0000","last_change":"2023-10-09T11:41:12.050593+0000","last_active":"2023-10-09T11:41:12.055214+0000","last_peered":"2023-10-09T11:41:12.055214+0000","last_clean":"2023-10-09T11:41:12.055214+0000","last_became_active":"2023-10-09T11:41:12.050327+0000","last_became_peered":"2023-10-09T11:41:12.050327+0000","last_unstale":"2023-10-09T11:41:12.055214+0000","last_undegraded":"2023-10-09T11:41:12.055214+0000","last_fullsized":"2023-10-09T11:41:12.055214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045891+0000","last_change":"2023-10-09T11:41:11.062590+0000","last_active":"2023-10-09T11:41:12.045891+0000","last_peered":"2023-10-09T11:41:12.045891+0000","last_clean":"2023-10-09T11:41:12.045891+0000","last_became_active":"2023-10-09T11:41:11.062303+0000","last_became_peered":"2023-10-09T11:41:11.062303+0000","last_unstale":"2023-10-09T11:41:12.045891+0000","last_undegraded":"2023-10-09T11:41:12.045891+0000","last_fullsized":"2023-10-09T11:41:12.045891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062836+0000","last_change":"2023-10-09T11:41:12.059380+0000","last_active":"2023-10-09T11:41:12.062836+0000","last_peered":"2023-10-09T11:41:12.062836+0000","last_clean":"2023-10-09T11:41:12.062836+0000","last_became_active":"2023-10-09T11:41:12.059091+0000","last_became_peered":"2023-10-09T11:41:12.059091+0000","last_unstale":"2023-10-09T11:41:12.062836+0000","last_undegraded":"2023-10-09T11:41:12.062836+0000","last_fullsized":"2023-10-09T11:41:12.062836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:41.207515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086758+0000","last_change":"2023-10-09T11:41:11.074722+0000","last_active":"2023-10-09T11:41:12.086758+0000","last_peered":"2023-10-09T11:41:12.086758+0000","last_clean":"2023-10-09T11:41:12.086758+0000","last_became_active":"2023-10-09T11:41:11.074417+0000","last_became_peered":"2023-10-09T11:41:11.074417+0000","last_unstale":"2023-10-09T11:41:12.086758+0000","last_undegraded":"2023-10-09T11:41:12.086758+0000","last_fullsized":"2023-10-09T11:41:12.086758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053509+0000","last_change":"2023-10-09T11:41:12.051884+0000","last_active":"2023-10-09T11:41:12.053509+0000","last_peered":"2023-10-09T11:41:12.053509+0000","last_clean":"2023-10-09T11:41:12.053509+0000","last_became_active":"2023-10-09T11:41:12.051012+0000","last_became_peered":"2023-10-09T11:41:12.051012+0000","last_unstale":"2023-10-09T11:41:12.053509+0000","last_undegraded":"2023-10-09T11:41:12.053509+0000","last_fullsized":"2023-10-09T11:41:12.053509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:59.214273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043996+0000","last_change":"2023-10-09T11:41:11.079256+0000","last_active":"2023-10-09T11:41:12.043996+0000","last_peered":"2023-10-09T11:41:12.043996+0000","last_clean":"2023-10-09T11:41:12.043996+0000","last_became_active":"2023-10-09T11:41:11.078999+0000","last_became_peered":"2023-10-09T11:41:11.078999+0000","last_unstale":"2023-10-09T11:41:12.043996+0000","last_undegraded":"2023-10-09T11:41:12.043996+0000","last_fullsized":"2023-10-09T11:41:12.043996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.057087+0000","last_change":"2023-10-09T11:41:12.048978+0000","last_active":"2023-10-09T11:41:12.057087+0000","last_peered":"2023-10-09T11:41:12.057087+0000","last_clean":"2023-10-09T11:41:12.057087+0000","last_became_active":"2023-10-09T11:41:12.048636+0000","last_became_peered":"2023-10-09T11:41:12.048636+0000","last_unstale":"2023-10-09T11:41:12.057087+0000","last_undegraded":"2023-10-09T11:41:12.057087+0000","last_fullsized":"2023-10-09T11:41:12.057087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045174+0000","last_change":"2023-10-09T11:41:11.074785+0000","last_active":"2023-10-09T11:41:12.045174+0000","last_peered":"2023-10-09T11:41:12.045174+0000","last_clean":"2023-10-09T11:41:12.045174+0000","last_became_active":"2023-10-09T11:41:11.074460+0000","last_became_peered":"2023-10-09T11:41:11.074460+0000","last_unstale":"2023-10-09T11:41:12.045174+0000","last_undegraded":"2023-10-09T11:41:12.045174+0000","last_fullsized":"2023-10-09T11:41:12.045174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055406+0000","last_change":"2023-10-09T11:41:12.050021+0000","last_active":"2023-10-09T11:41:12.055406+0000","last_peered":"2023-10-09T11:41:12.055406+0000","last_clean":"2023-10-09T11:41:12.055406+0000","last_became_active":"2023-10-09T11:41:12.049763+0000","last_became_peered":"2023-10-09T11:41:12.049763+0000","last_unstale":"2023-10-09T11:41:12.055406+0000","last_undegraded":"2023-10-09T11:41:12.055406+0000","last_fullsized":"2023-10-09T11:41:12.055406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045561+0000","last_change":"2023-10-09T11:41:11.063645+0000","last_active":"2023-10-09T11:41:12.045561+0000","last_peered":"2023-10-09T11:41:12.045561+0000","last_clean":"2023-10-09T11:41:12.045561+0000","last_became_active":"2023-10-09T11:41:11.063324+0000","last_became_peered":"2023-10-09T11:41:11.063324+0000","last_unstale":"2023-10-09T11:41:12.045561+0000","last_undegraded":"2023-10-09T11:41:12.045561+0000","last_fullsized":"2023-10-09T11:41:12.045561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059445+0000","last_change":"2023-10-09T11:41:12.053917+0000","last_active":"2023-10-09T11:41:12.059445+0000","last_peered":"2023-10-09T11:41:12.059445+0000","last_clean":"2023-10-09T11:41:12.059445+0000","last_became_active":"2023-10-09T11:41:12.051978+0000","last_became_peered":"2023-10-09T11:41:12.051978+0000","last_unstale":"2023-10-09T11:41:12.059445+0000","last_undegraded":"2023-10-09T11:41:12.059445+0000","last_fullsized":"2023-10-09T11:41:12.059445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086796+0000","last_change":"2023-10-09T11:41:11.076948+0000","last_active":"2023-10-09T11:41:12.086796+0000","last_peered":"2023-10-09T11:41:12.086796+0000","last_clean":"2023-10-09T11:41:12.086796+0000","last_became_active":"2023-10-09T11:41:11.076489+0000","last_became_peered":"2023-10-09T11:41:11.076489+0000","last_unstale":"2023-10-09T11:41:12.086796+0000","last_undegraded":"2023-10-09T11:41:12.086796+0000","last_fullsized":"2023-10-09T11:41:12.086796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061534+0000","last_change":"2023-10-09T11:41:12.056922+0000","last_active":"2023-10-09T11:41:12.061534+0000","last_peered":"2023-10-09T11:41:12.061534+0000","last_clean":"2023-10-09T11:41:12.061534+0000","last_became_active":"2023-10-09T11:41:12.056611+0000","last_became_peered":"2023-10-09T11:41:12.056611+0000","last_unstale":"2023-10-09T11:41:12.061534+0000","last_undegraded":"2023-10-09T11:41:12.061534+0000","last_fullsized":"2023-10-09T11:41:12.061534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044251+0000","last_change":"2023-10-09T11:41:11.077460+0000","last_active":"2023-10-09T11:41:12.044251+0000","last_peered":"2023-10-09T11:41:12.044251+0000","last_clean":"2023-10-09T11:41:12.044251+0000","last_became_active":"2023-10-09T11:41:11.077192+0000","last_became_peered":"2023-10-09T11:41:11.077192+0000","last_unstale":"2023-10-09T11:41:12.044251+0000","last_undegraded":"2023-10-09T11:41:12.044251+0000","last_fullsized":"2023-10-09T11:41:12.044251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:56.491552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071319+0000","last_change":"2023-10-09T11:41:12.061959+0000","last_active":"2023-10-09T11:41:12.071319+0000","last_peered":"2023-10-09T11:41:12.071319+0000","last_clean":"2023-10-09T11:41:12.071319+0000","last_became_active":"2023-10-09T11:41:12.058357+0000","last_became_peered":"2023-10-09T11:41:12.058357+0000","last_unstale":"2023-10-09T11:41:12.071319+0000","last_undegraded":"2023-10-09T11:41:12.071319+0000","last_fullsized":"2023-10-09T11:41:12.071319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086287+0000","last_change":"2023-10-09T11:41:11.060748+0000","last_active":"2023-10-09T11:41:12.086287+0000","last_peered":"2023-10-09T11:41:12.086287+0000","last_clean":"2023-10-09T11:41:12.086287+0000","last_became_active":"2023-10-09T11:41:11.060436+0000","last_became_peered":"2023-10-09T11:41:11.060436+0000","last_unstale":"2023-10-09T11:41:12.086287+0000","last_undegraded":"2023-10-09T11:41:12.086287+0000","last_fullsized":"2023-10-09T11:41:12.086287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065329+0000","last_change":"2023-10-09T11:41:12.060982+0000","last_active":"2023-10-09T11:41:12.065329+0000","last_peered":"2023-10-09T11:41:12.065329+0000","last_clean":"2023-10-09T11:41:12.065329+0000","last_became_active":"2023-10-09T11:41:12.056626+0000","last_became_peered":"2023-10-09T11:41:12.056626+0000","last_unstale":"2023-10-09T11:41:12.065329+0000","last_undegraded":"2023-10-09T11:41:12.065329+0000","last_fullsized":"2023-10-09T11:41:12.065329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084778+0000","last_change":"2023-10-09T11:41:11.066536+0000","last_active":"2023-10-09T11:41:12.084778+0000","last_peered":"2023-10-09T11:41:12.084778+0000","last_clean":"2023-10-09T11:41:12.084778+0000","last_became_active":"2023-10-09T11:41:11.066194+0000","last_became_peered":"2023-10-09T11:41:11.066194+0000","last_unstale":"2023-10-09T11:41:12.084778+0000","last_undegraded":"2023-10-09T11:41:12.084778+0000","last_fullsized":"2023-10-09T11:41:12.084778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071765+0000","last_change":"2023-10-09T11:41:12.067596+0000","last_active":"2023-10-09T11:41:12.071765+0000","last_peered":"2023-10-09T11:41:12.071765+0000","last_clean":"2023-10-09T11:41:12.071765+0000","last_became_active":"2023-10-09T11:41:12.067282+0000","last_became_peered":"2023-10-09T11:41:12.067282+0000","last_unstale":"2023-10-09T11:41:12.071765+0000","last_undegraded":"2023-10-09T11:41:12.071765+0000","last_fullsized":"2023-10-09T11:41:12.071765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061545+0000","last_change":"2023-10-09T11:41:12.056097+0000","last_active":"2023-10-09T11:41:12.061545+0000","last_peered":"2023-10-09T11:41:12.061545+0000","last_clean":"2023-10-09T11:41:12.061545+0000","last_became_active":"2023-10-09T11:41:12.055031+0000","last_became_peered":"2023-10-09T11:41:12.055031+0000","last_unstale":"2023-10-09T11:41:12.061545+0000","last_undegraded":"2023-10-09T11:41:12.061545+0000","last_fullsized":"2023-10-09T11:41:12.061545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058104+0000","last_change":"2023-10-09T11:41:12.056111+0000","last_active":"2023-10-09T11:41:12.058104+0000","last_peered":"2023-10-09T11:41:12.058104+0000","last_clean":"2023-10-09T11:41:12.058104+0000","last_became_active":"2023-10-09T11:41:12.055843+0000","last_became_peered":"2023-10-09T11:41:12.055843+0000","last_unstale":"2023-10-09T11:41:12.058104+0000","last_undegraded":"2023-10-09T11:41:12.058104+0000","last_fullsized":"2023-10-09T11:41:12.058104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:43.783508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063535+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.063535+0000","last_peered":"2023-10-09T11:41:12.063535+0000","last_clean":"2023-10-09T11:41:12.063535+0000","last_became_active":"2023-10-09T11:41:12.055904+0000","last_became_peered":"2023-10-09T11:41:12.055904+0000","last_unstale":"2023-10-09T11:41:12.063535+0000","last_undegraded":"2023-10-09T11:41:12.063535+0000","last_fullsized":"2023-10-09T11:41:12.063535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053222+0000","last_change":"2023-10-09T11:41:12.051485+0000","last_active":"2023-10-09T11:41:12.053222+0000","last_peered":"2023-10-09T11:41:12.053222+0000","last_clean":"2023-10-09T11:41:12.053222+0000","last_became_active":"2023-10-09T11:41:12.051192+0000","last_became_peered":"2023-10-09T11:41:12.051192+0000","last_unstale":"2023-10-09T11:41:12.053222+0000","last_undegraded":"2023-10-09T11:41:12.053222+0000","last_fullsized":"2023-10-09T11:41:12.053222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062890+0000","last_change":"2023-10-09T11:41:12.059625+0000","last_active":"2023-10-09T11:41:12.062890+0000","last_peered":"2023-10-09T11:41:12.062890+0000","last_clean":"2023-10-09T11:41:12.062890+0000","last_became_active":"2023-10-09T11:41:12.059319+0000","last_became_peered":"2023-10-09T11:41:12.059319+0000","last_unstale":"2023-10-09T11:41:12.062890+0000","last_undegraded":"2023-10-09T11:41:12.062890+0000","last_fullsized":"2023-10-09T11:41:12.062890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061223+0000","last_change":"2023-10-09T11:41:12.059993+0000","last_active":"2023-10-09T11:41:12.061223+0000","last_peered":"2023-10-09T11:41:12.061223+0000","last_clean":"2023-10-09T11:41:12.061223+0000","last_became_active":"2023-10-09T11:41:12.059604+0000","last_became_peered":"2023-10-09T11:41:12.059604+0000","last_unstale":"2023-10-09T11:41:12.061223+0000","last_undegraded":"2023-10-09T11:41:12.061223+0000","last_fullsized":"2023-10-09T11:41:12.061223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063218+0000","last_change":"2023-10-09T11:41:12.059495+0000","last_active":"2023-10-09T11:41:12.063218+0000","last_peered":"2023-10-09T11:41:12.063218+0000","last_clean":"2023-10-09T11:41:12.063218+0000","last_became_active":"2023-10-09T11:41:12.059200+0000","last_became_peered":"2023-10-09T11:41:12.059200+0000","last_unstale":"2023-10-09T11:41:12.063218+0000","last_undegraded":"2023-10-09T11:41:12.063218+0000","last_fullsized":"2023-10-09T11:41:12.063218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060308+0000","last_change":"2023-10-09T11:41:12.058708+0000","last_active":"2023-10-09T11:41:12.060308+0000","last_peered":"2023-10-09T11:41:12.060308+0000","last_clean":"2023-10-09T11:41:12.060308+0000","last_became_active":"2023-10-09T11:41:12.058356+0000","last_became_peered":"2023-10-09T11:41:12.058356+0000","last_unstale":"2023-10-09T11:41:12.060308+0000","last_undegraded":"2023-10-09T11:41:12.060308+0000","last_fullsized":"2023-10-09T11:41:12.060308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063595+0000","last_change":"2023-10-09T11:41:12.056307+0000","last_active":"2023-10-09T11:41:12.063595+0000","last_peered":"2023-10-09T11:41:12.063595+0000","last_clean":"2023-10-09T11:41:12.063595+0000","last_became_active":"2023-10-09T11:41:12.056023+0000","last_became_peered":"2023-10-09T11:41:12.056023+0000","last_unstale":"2023-10-09T11:41:12.063595+0000","last_undegraded":"2023-10-09T11:41:12.063595+0000","last_fullsized":"2023-10-09T11:41:12.063595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063421+0000","last_change":"2023-10-09T11:41:12.059080+0000","last_active":"2023-10-09T11:41:12.063421+0000","last_peered":"2023-10-09T11:41:12.063421+0000","last_clean":"2023-10-09T11:41:12.063421+0000","last_became_active":"2023-10-09T11:41:12.056426+0000","last_became_peered":"2023-10-09T11:41:12.056426+0000","last_unstale":"2023-10-09T11:41:12.063421+0000","last_undegraded":"2023-10-09T11:41:12.063421+0000","last_fullsized":"2023-10-09T11:41:12.063421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.072184+0000","last_change":"2023-10-09T11:41:12.069213+0000","last_active":"2023-10-09T11:41:12.072184+0000","last_peered":"2023-10-09T11:41:12.072184+0000","last_clean":"2023-10-09T11:41:12.072184+0000","last_became_active":"2023-10-09T11:41:12.068965+0000","last_became_peered":"2023-10-09T11:41:12.068965+0000","last_unstale":"2023-10-09T11:41:12.072184+0000","last_undegraded":"2023-10-09T11:41:12.072184+0000","last_fullsized":"2023-10-09T11:41:12.072184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053983+0000","last_change":"2023-10-09T11:41:12.052767+0000","last_active":"2023-10-09T11:41:12.053983+0000","last_peered":"2023-10-09T11:41:12.053983+0000","last_clean":"2023-10-09T11:41:12.053983+0000","last_became_active":"2023-10-09T11:41:12.052111+0000","last_became_peered":"2023-10-09T11:41:12.052111+0000","last_unstale":"2023-10-09T11:41:12.053983+0000","last_undegraded":"2023-10-09T11:41:12.053983+0000","last_fullsized":"2023-10-09T11:41:12.053983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061451+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.061451+0000","last_peered":"2023-10-09T11:41:12.061451+0000","last_clean":"2023-10-09T11:41:12.061451+0000","last_became_active":"2023-10-09T11:41:12.055911+0000","last_became_peered":"2023-10-09T11:41:12.055911+0000","last_unstale":"2023-10-09T11:41:12.061451+0000","last_undegraded":"2023-10-09T11:41:12.061451+0000","last_fullsized":"2023-10-09T11:41:12.061451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:21.643 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:41:21.643 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-09T11:41:21.643 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-09T11:41:21.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T11:41:21.644 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-09T11:41:21.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.856+0000 7f594b3ff700 1 Processor -- start 2023-10-09T11:41:21.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.856+0000 7f594b3ff700 1 -- start start 2023-10-09T11:41:21.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.857+0000 7f594b3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59441578b0 0x7f5944155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.857+0000 7f594b3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440ad930 con 0x7f59440af2f0 2023-10-09T11:41:21.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.857+0000 7f594b3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440acd20 con 0x7f5944155c10 2023-10-09T11:41:21.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.857+0000 7f594b3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440ad000 con 0x7f59441578b0 2023-10-09T11:41:21.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f594999c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f59440af2f0 0x7f59440af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37264/0 (socket says 172.21.15.86:37264) 2023-10-09T11:41:21.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f594999c700 1 -- 172.21.15.86:0/1664035789 learned_addr learned my addr 172.21.15.86:0/1664035789 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:21.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f594899a700 1 --2- 172.21.15.86:0/1664035789 >> v2:172.21.15.86:3300/0 conn(0x7f59441578b0 0x7f5944155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f593bfff700 1 -- 172.21.15.86:0/1664035789 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181592461 0 0) 0x7f59440ad930 con 0x7f59440af2f0 2023-10-09T11:41:21.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f593bfff700 1 -- 172.21.15.86:0/1664035789 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5930003570 con 0x7f59440af2f0 2023-10-09T11:41:21.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f594899a700 1 -- 172.21.15.86:0/1664035789 >> v1:172.21.15.135:6789/0 conn(0x7f5944155c10 legacy=0x7f59440ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f594899a700 1 -- 172.21.15.86:0/1664035789 >> v1:172.21.15.86:6789/0 conn(0x7f59440af2f0 legacy=0x7f59440af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f594899a700 1 -- 172.21.15.86:0/1664035789 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440ad2e0 con 0x7f59441578b0 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.858+0000 7f594899a700 1 --2- 172.21.15.86:0/1664035789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f5944155fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59340098e0 tx=0x7f59340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d2c7662cf92738 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f593bfff700 1 -- 172.21.15.86:0/1664035789 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400b640 con 0x7f59441578b0 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f593bfff700 1 -- 172.21.15.86:0/1664035789 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400b7a0 con 0x7f59441578b0 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f593bfff700 1 -- 172.21.15.86:0/1664035789 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400bb20 con 0x7f59441578b0 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f594b3ff700 1 -- 172.21.15.86:0/1664035789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 msgr2=0x7f5944155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1664035789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f5944155fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59340098e0 tx=0x7f59340091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f594b3ff700 1 -- 172.21.15.86:0/1664035789 shutdown_connections 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1664035789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f5944155fe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f594b3ff700 1 -- 172.21.15.86:0/1664035789 >> 172.21.15.86:0/1664035789 conn(0x7f594406a320 msgr2=0x7f59440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:21.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f594b3ff700 1 -- 172.21.15.86:0/1664035789 shutdown_connections 2023-10-09T11:41:21.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.859+0000 7f594b3ff700 1 -- 172.21.15.86:0/1664035789 wait complete. 2023-10-09T11:41:21.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.861+0000 7f594b3ff700 1 Processor -- start 2023-10-09T11:41:21.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.861+0000 7f594b3ff700 1 -- start start 2023-10-09T11:41:21.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59440af2f0 0x7f59441420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5944155c10 0x7f5944169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594b3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f594415cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594b3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594415c750 con 0x7f59441578b0 2023-10-09T11:41:21.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594416a470 con 0x7f5944155c10 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594416a750 con 0x7f59440af2f0 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f594415cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f594415cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39444/0 (socket says 172.21.15.86:39444) 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594999c700 1 -- 172.21.15.86:0/1721783679 learned_addr learned my addr 172.21.15.86:0/1721783679 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594899a700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5944155c10 0x7f5944169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594919b700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59440af2f0 0x7f59441420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594999c700 1 -- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59440af2f0 msgr2=0x7f59441420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594999c700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59440af2f0 0x7f59441420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594999c700 1 -- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5944155c10 msgr2=0x7f5944169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.862+0000 7f594999c700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5944155c10 0x7f5944169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f594999c700 1 -- 172.21.15.86:0/1721783679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5934009420 con 0x7f59441578b0 2023-10-09T11:41:21.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f594899a700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5944155c10 0x7f5944169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:21.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f594999c700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f594415cbe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f593c001460 tx=0x7f593c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f59397fa700 1 -- 172.21.15.86:0/1721783679 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00ce80 con 0x7f59441578b0 2023-10-09T11:41:21.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f59397fa700 1 -- 172.21.15.86:0/1721783679 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c00ab70 con 0x7f59441578b0 2023-10-09T11:41:21.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f59397fa700 1 -- 172.21.15.86:0/1721783679 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c0070f0 con 0x7f59441578b0 2023-10-09T11:41:21.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594416aa30 con 0x7f59441578b0 2023-10-09T11:41:21.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.863+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594416a0f0 con 0x7f59441578b0 2023-10-09T11:41:21.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.864+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594404c3c0 con 0x7f59441578b0 2023-10-09T11:41:21.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.865+0000 7f59397fa700 1 -- 172.21.15.86:0/1721783679 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f593c007520 con 0x7f59441578b0 2023-10-09T11:41:21.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.866+0000 7f59397fa700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.866+0000 7f59397fa700 1 -- 172.21.15.86:0/1721783679 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f593c084af0 con 0x7f59441578b0 2023-10-09T11:41:21.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.866+0000 7f594919b700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.867+0000 7f594919b700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5928066f30 0x7f59280693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5944069500 tx=0x7f5940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:21.870+0000 7f59397fa700 1 -- 172.21.15.86:0/1721783679 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f593c051cb0 con 0x7f59441578b0 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.116+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f59440ad5c0 con 0x7f59441578b0 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.119+0000 7f59397fa700 1 -- 172.21.15.86:0/1721783679 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163699 (secure 0 0 0) 0x7f593c0552d0 con 0x7f59441578b0 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5928066f30 msgr2=0x7f59280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5928066f30 0x7f59280693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5944069500 tx=0x7f5940009040 comp rx=0 tx=0).stop 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 msgr2=0x7f594415cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f594415cbe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f593c001460 tx=0x7f593c001ae0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 shutdown_connections 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5928066f30 0x7f59280693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59441578b0 0x7f594415cbe0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59440af2f0 0x7f59441420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 --2- 172.21.15.86:0/1721783679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5944155c10 0x7f5944169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 >> 172.21.15.86:0/1721783679 conn(0x7f594406a320 msgr2=0x7f59440ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 shutdown_connections 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.122+0000 7f594b3ff700 1 -- 172.21.15.86:0/1721783679 wait complete. 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":85490},{"type":"v1","addr":"172.21.15.86:6833","nonce":85490}]},"active_addr":"172.21.15.86:6833/85490","active_change":"2023-10-09T11:40:53.939829+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2164323904}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1379635191}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2564271480}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2422899393}]}]} 2023-10-09T11:41:22.144 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-09T11:41:22.144 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-09T11:41:22.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:22.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.324+0000 7f3ea17ff700 1 Processor -- start 2023-10-09T11:41:22.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.324+0000 7f3ea17ff700 1 -- start start 2023-10-09T11:41:22.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3ea17ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c155c10 0x7f3e9c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3ea17ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e9c0ac230 0x7f3e9c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3ea17ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e9c1568a0 0x7f3e9c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3ea17ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c0ad930 con 0x7f3e9c0ac230 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3ea17ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c0acd20 con 0x7f3e9c1568a0 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3ea17ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0ad000 con 0x7f3e9c155c10 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e9c0ac230 0x7f3e9c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e9c0ac230 0x7f3e9c0ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39460/0 (socket says 172.21.15.86:39460) 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/3615477363 learned_addr learned my addr 172.21.15.86:0/3615477363 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9b7fe700 1 --2- 172.21.15.86:0/3615477363 >> v2:172.21.15.135:3300/0 conn(0x7f3e9c1568a0 0x7f3e9c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9affd700 1 --2- 172.21.15.86:0/3615477363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c155c10 0x7f3e9c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/3615477363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c155c10 msgr2=0x7f3e9c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 --2- 172.21.15.86:0/3615477363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c155c10 0x7f3e9c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/3615477363 >> v2:172.21.15.135:3300/0 conn(0x7f3e9c1568a0 msgr2=0x7f3e9c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 --2- 172.21.15.86:0/3615477363 >> v2:172.21.15.135:3300/0 conn(0x7f3e9c1568a0 0x7f3e9c156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.326+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/3615477363 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0ad2e0 con 0x7f3e9c0ac230 2023-10-09T11:41:22.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3e9a7fc700 1 --2- 172.21.15.86:0/3615477363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c0ac230 0x7f3e9c0ac6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0c8c60 tx=0x7f3e90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393e12ed4fa1bf2b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3e99ffb700 1 -- 172.21.15.86:0/3615477363 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000b860 con 0x7f3e9c0ac230 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3e99ffb700 1 -- 172.21.15.86:0/3615477363 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9000b9c0 con 0x7f3e9c0ac230 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3e99ffb700 1 -- 172.21.15.86:0/3615477363 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000bd60 con 0x7f3e9c0ac230 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 -- 172.21.15.86:0/3615477363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c0ac230 msgr2=0x7f3e9c0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/3615477363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c0ac230 0x7f3e9c0ac6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0c8c60 tx=0x7f3e90009250 comp rx=0 tx=0).stop 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 -- 172.21.15.86:0/3615477363 shutdown_connections 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/3615477363 >> v2:172.21.15.135:3300/0 conn(0x7f3e9c1568a0 0x7f3e9c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/3615477363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c155c10 0x7f3e9c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/3615477363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c0ac230 0x7f3e9c0ac6a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 -- 172.21.15.86:0/3615477363 >> 172.21.15.86:0/3615477363 conn(0x7f3e9c06a320 msgr2=0x7f3e9c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.327+0000 7f3ea17ff700 1 -- 172.21.15.86:0/3615477363 shutdown_connections 2023-10-09T11:41:22.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.328+0000 7f3ea17ff700 1 -- 172.21.15.86:0/3615477363 wait complete. 2023-10-09T11:41:22.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.329+0000 7f3ea17ff700 1 Processor -- start 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.329+0000 7f3ea17ff700 1 -- start start 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3ea17ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c0ac230 0x7f3e9c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3ea17ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c155c10 0x7f3e9c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3ea17ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1568a0 0x7f3e9c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3ea17ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c150690 con 0x7f3e9c155c10 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3ea17ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c14f9f0 con 0x7f3e9c1568a0 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3ea17ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c159190 con 0x7f3e9c0ac230 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c155c10 0x7f3e9c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c155c10 0x7f3e9c14f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39464/0 (socket says 172.21.15.86:39464) 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/1007656989 learned_addr learned my addr 172.21.15.86:0/1007656989 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:22.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/1007656989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c0ac230 msgr2=0x7f3e9c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c0ac230 0x7f3e9c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/1007656989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1568a0 msgr2=0x7f3e9c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1568a0 0x7f3e9c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.330+0000 7f3e9a7fc700 1 -- 172.21.15.86:0/1007656989 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900094f0 con 0x7f3e9c155c10 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.331+0000 7f3e9a7fc700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c155c10 0x7f3e9c14f4b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c064290 tx=0x7f3e90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.331+0000 7f3e82ffd700 1 -- 172.21.15.86:0/1007656989 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90024440 con 0x7f3e9c155c10 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.331+0000 7f3e82ffd700 1 -- 172.21.15.86:0/1007656989 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e900245a0 con 0x7f3e9c155c10 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.331+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c159470 con 0x7f3e9c155c10 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.331+0000 7f3e82ffd700 1 -- 172.21.15.86:0/1007656989 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90024960 con 0x7f3e9c155c10 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.331+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c159a30 con 0x7f3e9c155c10 2023-10-09T11:41:22.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.332+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c04c3c0 con 0x7f3e9c155c10 2023-10-09T11:41:22.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.333+0000 7f3e82ffd700 1 -- 172.21.15.86:0/1007656989 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e9001a420 con 0x7f3e9c155c10 2023-10-09T11:41:22.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.334+0000 7f3e82ffd700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3e88066fb0 0x7f3e88069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.334+0000 7f3e82ffd700 1 -- 172.21.15.86:0/1007656989 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e900863f0 con 0x7f3e9c155c10 2023-10-09T11:41:22.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.334+0000 7f3e9affd700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3e88066fb0 0x7f3e88069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.334+0000 7f3e9affd700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3e88066fb0 0x7f3e88069460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009a60 tx=0x7f3e8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.338+0000 7f3e82ffd700 1 -- 172.21.15.86:0/1007656989 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e900535c0 con 0x7f3e9c155c10 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.529+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e9c1507d0 con 0x7f3e9c155c10 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.530+0000 7f3e82ffd700 1 -- 172.21.15.86:0/1007656989 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3e90056be0 con 0x7f3e9c155c10 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3e88066fb0 msgr2=0x7f3e88069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3e88066fb0 0x7f3e88069460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009a60 tx=0x7f3e8c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c155c10 msgr2=0x7f3e9c14f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c155c10 0x7f3e9c14f4b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c064290 tx=0x7f3e90017000 comp rx=0 tx=0).stop 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 shutdown_connections 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3e88066fb0 0x7f3e88069460 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c1568a0 0x7f3e9c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c0ac230 0x7f3e9c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 --2- 172.21.15.86:0/1007656989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e9c155c10 0x7f3e9c14f4b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 >> 172.21.15.86:0/1007656989 conn(0x7f3e9c06a320 msgr2=0x7f3e9c06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 shutdown_connections 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.533+0000 7f3ea17ff700 1 -- 172.21.15.86:0/1007656989 wait complete. 2023-10-09T11:41:22.551 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-09T11:41:22.551 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:22.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.730+0000 7f6235dff700 1 Processor -- start 2023-10-09T11:41:22.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.730+0000 7f6235dff700 1 -- start start 2023-10-09T11:41:22.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.731+0000 7f6235dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6230159890 0x7f623015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.731+0000 7f6235dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230069560 0x7f62300699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.731+0000 7f6235dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6230069ee0 con 0x7f6230159c60 2023-10-09T11:41:22.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.731+0000 7f6235dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623015a160 con 0x7f6230159890 2023-10-09T11:41:22.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.731+0000 7f6235dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62300d13a0 con 0x7f6230069560 2023-10-09T11:41:22.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6230159890 0x7f623015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6230159890 0x7f623015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39470/0 (socket says 172.21.15.86:39470) 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 -- 172.21.15.86:0/4015706645 learned_addr learned my addr 172.21.15.86:0/4015706645 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622ffff700 1 --2- 172.21.15.86:0/4015706645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230069560 0x7f62300699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 -- 172.21.15.86:0/4015706645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230069560 msgr2=0x7f62300699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 --2- 172.21.15.86:0/4015706645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230069560 0x7f62300699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 -- 172.21.15.86:0/4015706645 >> v1:172.21.15.135:6789/0 conn(0x7f6230159c60 legacy=0x7f623015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 -- 172.21.15.86:0/4015706645 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623015e140 con 0x7f6230159890 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622f7fe700 1 --2- 172.21.15.86:0/4015706645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230159890 0x7f623015abd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62200099b0 tx=0x7f6220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dea049ea62f915 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.732+0000 7f622e7fc700 1 -- 172.21.15.86:0/4015706645 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622000b820 con 0x7f6230159890 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f622e7fc700 1 -- 172.21.15.86:0/4015706645 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622000b980 con 0x7f6230159890 2023-10-09T11:41:22.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f622e7fc700 1 -- 172.21.15.86:0/4015706645 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622000bd20 con 0x7f6230159890 2023-10-09T11:41:22.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 -- 172.21.15.86:0/4015706645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230159890 msgr2=0x7f623015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 --2- 172.21.15.86:0/4015706645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230159890 0x7f623015abd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62200099b0 tx=0x7f6220009250 comp rx=0 tx=0).stop 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 -- 172.21.15.86:0/4015706645 shutdown_connections 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 --2- 172.21.15.86:0/4015706645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230069560 0x7f62300699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 --2- 172.21.15.86:0/4015706645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230159890 0x7f623015abd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 -- 172.21.15.86:0/4015706645 >> 172.21.15.86:0/4015706645 conn(0x7f6230068e20 msgr2=0x7f62300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 -- 172.21.15.86:0/4015706645 shutdown_connections 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.733+0000 7f6235dff700 1 -- 172.21.15.86:0/4015706645 wait complete. 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.734+0000 7f6235dff700 1 Processor -- start 2023-10-09T11:41:22.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.735+0000 7f6235dff700 1 -- start start 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.735+0000 7f6235dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230069560 0x7f6230169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.735+0000 7f6235dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6230159890 0x7f6230147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.735+0000 7f6235dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230159c60 0x7f623016cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f6235dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300b3630 con 0x7f6230069560 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f6235dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623016d6f0 con 0x7f6230159890 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f6235dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623016d9d0 con 0x7f6230159c60 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230069560 0x7f6230169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230069560 0x7f6230169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39474/0 (socket says 172.21.15.86:39474) 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 -- 172.21.15.86:0/3822322673 learned_addr learned my addr 172.21.15.86:0/3822322673 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:22.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 -- 172.21.15.86:0/3822322673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230159c60 msgr2=0x7f623016cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230159c60 0x7f623016cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 -- 172.21.15.86:0/3822322673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6230159890 msgr2=0x7f6230147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6230159890 0x7f6230147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 -- 172.21.15.86:0/3822322673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62200094f0 con 0x7f6230069560 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f622f7fe700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230069560 0x7f6230169830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6220009290 tx=0x7f6220016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.736+0000 7f62177fe700 1 -- 172.21.15.86:0/3822322673 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220011ca0 con 0x7f6230069560 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.737+0000 7f62177fe700 1 -- 172.21.15.86:0/3822322673 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220020070 con 0x7f6230069560 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.737+0000 7f62177fe700 1 -- 172.21.15.86:0/3822322673 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622001b6a0 con 0x7f6230069560 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.737+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62300b38d0 con 0x7f6230069560 2023-10-09T11:41:22.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.737+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623016dcb0 con 0x7f6230069560 2023-10-09T11:41:22.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.738+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623004c3c0 con 0x7f6230069560 2023-10-09T11:41:22.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.738+0000 7f62177fe700 1 -- 172.21.15.86:0/3822322673 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6220022030 con 0x7f6230069560 2023-10-09T11:41:22.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.739+0000 7f62177fe700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f621c066f30 0x7f621c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.739+0000 7f62177fe700 1 -- 172.21.15.86:0/3822322673 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6220086380 con 0x7f6230069560 2023-10-09T11:41:22.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.739+0000 7f622effd700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f621c066f30 0x7f621c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.740+0000 7f622effd700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f621c066f30 0x7f621c0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6224007fd0 tx=0x7f6224007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.743+0000 7f62177fe700 1 -- 172.21.15.86:0/3822322673 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62200535f0 con 0x7f6230069560 2023-10-09T11:41:22.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.933+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f623004c3c0 con 0x7f6230069560 2023-10-09T11:41:22.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.934+0000 7f62177fe700 1 -- 172.21.15.86:0/3822322673 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6220056c10 con 0x7f6230069560 2023-10-09T11:41:22.934 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:22.935 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:22.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f621c066f30 msgr2=0x7f621c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f621c066f30 0x7f621c0693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6224007fd0 tx=0x7f6224007b20 comp rx=0 tx=0).stop 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230069560 msgr2=0x7f6230169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230069560 0x7f6230169830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6220009290 tx=0x7f6220016000 comp rx=0 tx=0).stop 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 shutdown_connections 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f621c066f30 0x7f621c0693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6230069560 0x7f6230169830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6230159c60 0x7f623016cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 --2- 172.21.15.86:0/3822322673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6230159890 0x7f6230147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.936+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 >> 172.21.15.86:0/3822322673 conn(0x7f6230068e20 msgr2=0x7f62301534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.937+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 shutdown_connections 2023-10-09T11:41:22.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:22.937+0000 7f6235dff700 1 -- 172.21.15.86:0/3822322673 wait complete. 2023-10-09T11:41:22.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-09T11:41:22.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-09T11:41:22.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-09T11:41:22.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-09T11:41:22.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-09T11:41:22.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-09T11:41:22.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-09T11:41:22.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-09T11:41:23.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.276+0000 7f815ffff700 1 Processor -- start 2023-10-09T11:41:23.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.277+0000 7f815ffff700 1 -- start start 2023-10-09T11:41:23.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.279+0000 7f815ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8158104240 0x7f81580069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.279+0000 7f815ffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81581049f0 con 0x7f8158101700 2023-10-09T11:41:23.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.279+0000 7f815ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8158007650 con 0x7f815804fdf0 2023-10-09T11:41:23.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.279+0000 7f815ffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8158053930 con 0x7f8158104240 2023-10-09T11:41:23.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.279+0000 7f815e7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8158101700 0x7f8158103b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37276/0 (socket says 172.21.15.86:37276) 2023-10-09T11:41:23.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.279+0000 7f815e7fc700 1 -- 172.21.15.86:0/36292997 learned_addr learned my addr 172.21.15.86:0/36292997 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.280+0000 7f815f7fe700 1 --2- 172.21.15.86:0/36292997 >> v2:172.21.15.86:3300/0 conn(0x7f8158104240 0x7f81580069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.280+0000 7f815f7fe700 1 -- 172.21.15.86:0/36292997 >> v1:172.21.15.135:6789/0 conn(0x7f815804fdf0 legacy=0x7f81580fa390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:41:23.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.280+0000 7f815f7fe700 1 -- 172.21.15.86:0/36292997 >> v1:172.21.15.86:6789/0 conn(0x7f8158101700 legacy=0x7f8158103b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.280+0000 7f815f7fe700 1 -- 172.21.15.86:0/36292997 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158053270 con 0x7f8158104240 2023-10-09T11:41:23.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.281+0000 7f815f7fe700 1 --2- 172.21.15.86:0/36292997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8158104240 0x7f81580069f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8160071b60 tx=0x7f8160066260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4482123e5cf04cca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.282+0000 7f815dffb700 1 -- 172.21.15.86:0/36292997 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160067610 con 0x7f8158104240 2023-10-09T11:41:23.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.282+0000 7f815dffb700 1 -- 172.21.15.86:0/36292997 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160067770 con 0x7f8158104240 2023-10-09T11:41:23.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.282+0000 7f815dffb700 1 -- 172.21.15.86:0/36292997 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160064550 con 0x7f8158104240 2023-10-09T11:41:23.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.283+0000 7f815ffff700 1 -- 172.21.15.86:0/36292997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8158104240 msgr2=0x7f81580069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.283+0000 7f815ffff700 1 --2- 172.21.15.86:0/36292997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8158104240 0x7f81580069f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8160071b60 tx=0x7f8160066260 comp rx=0 tx=0).stop 2023-10-09T11:41:23.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.284+0000 7f815ffff700 1 -- 172.21.15.86:0/36292997 shutdown_connections 2023-10-09T11:41:23.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.284+0000 7f815ffff700 1 --2- 172.21.15.86:0/36292997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8158104240 0x7f81580069f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.284+0000 7f815ffff700 1 -- 172.21.15.86:0/36292997 >> 172.21.15.86:0/36292997 conn(0x7f8158051810 msgr2=0x7f8158051c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.284+0000 7f815ffff700 1 -- 172.21.15.86:0/36292997 shutdown_connections 2023-10-09T11:41:23.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.284+0000 7f815ffff700 1 -- 172.21.15.86:0/36292997 wait complete. 2023-10-09T11:41:23.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.283+0000 7f71115ff700 1 Processor -- start 2023-10-09T11:41:23.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.283+0000 7f71115ff700 1 -- start start 2023-10-09T11:41:23.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.285+0000 7f71115ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f71040ddfd0 0x7f71040de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.285+0000 7f71115ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710400c2e0 0x7f71040060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.285+0000 7f71115ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f710404ff30 0x7f7104050370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.285+0000 7f71115ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7104053cf0 con 0x7f710404ff30 2023-10-09T11:41:23.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.285+0000 7f71115ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7104050980 con 0x7f71040ddfd0 2023-10-09T11:41:23.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.285+0000 7f71115ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71040533c0 con 0x7f710400c2e0 2023-10-09T11:41:23.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.284+0000 7fdf825ff700 1 Processor -- start 2023-10-09T11:41:23.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.284+0000 7fdf825ff700 1 -- start start 2023-10-09T11:41:23.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.286+0000 7f710a7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710400c2e0 0x7f71040060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.286+0000 7f710a7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710400c2e0 0x7f71040060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:42668/0 (socket says 172.21.15.86:42668) 2023-10-09T11:41:23.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.286+0000 7f710a7fc700 1 -- 172.21.15.86:0/3702733162 learned_addr learned my addr 172.21.15.86:0/3702733162 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710b7fe700 1 --2- 172.21.15.86:0/3702733162 >> v2:172.21.15.86:3300/0 conn(0x7f710404ff30 0x7f7104050370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f815ffff700 1 Processor -- start 2023-10-09T11:41:23.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7fdf825ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf7c1618c0 0x7fdf7c0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7fdf825ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0b2600 con 0x7fdf7c0b1500 2023-10-09T11:41:23.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7fdf825ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0b19f0 con 0x7fdf7c1473b0 2023-10-09T11:41:23.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7fdf825ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b1cd0 con 0x7fdf7c1618c0 2023-10-09T11:41:23.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f815ffff700 1 -- start start 2023-10-09T11:41:23.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710affd700 1 --2- 172.21.15.86:0/3702733162 >> v2:172.21.15.135:3300/0 conn(0x7f71040ddfd0 0x7f71040de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710a7fc700 1 -- 172.21.15.86:0/3702733162 >> v2:172.21.15.135:3300/0 conn(0x7f71040ddfd0 msgr2=0x7f71040de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710a7fc700 1 --2- 172.21.15.86:0/3702733162 >> v2:172.21.15.135:3300/0 conn(0x7f71040ddfd0 0x7f71040de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710a7fc700 1 -- 172.21.15.86:0/3702733162 >> v2:172.21.15.86:3300/0 conn(0x7f710404ff30 msgr2=0x7f7104050370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710a7fc700 1 --2- 172.21.15.86:0/3702733162 >> v2:172.21.15.86:3300/0 conn(0x7f710404ff30 0x7f7104050370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710a7fc700 1 -- 172.21.15.86:0/3702733162 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040536a0 con 0x7f710400c2e0 2023-10-09T11:41:23.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf7bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf7c1618c0 0x7fdf7c0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf7bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf7c1618c0 0x7fdf7c0b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:56902/0 (socket says 172.21.15.86:56902) 2023-10-09T11:41:23.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf80b9c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fdf7c1473b0 0x7fdf7c0b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55614/0 (socket says 172.21.15.86:55614) 2023-10-09T11:41:23.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf80b9c700 1 -- 172.21.15.86:0/1578209554 learned_addr learned my addr 172.21.15.86:0/1578209554 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710b7fe700 1 --2- 172.21.15.86:0/3702733162 >> v2:172.21.15.86:3300/0 conn(0x7f710404ff30 0x7f7104050370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:23.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.287+0000 7f710a7fc700 1 --2- 172.21.15.86:0/3702733162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710400c2e0 0x7f71040060c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f710c05f200 tx=0x7f710c066260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec3e6408373e0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf7affd700 1 -- 172.21.15.86:0/1578209554 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964665116 0 0) 0x7fdf7c0b19f0 con 0x7fdf7c1473b0 2023-10-09T11:41:23.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf7affd700 1 -- 172.21.15.86:0/1578209554 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf64003570 con 0x7fdf7c1473b0 2023-10-09T11:41:23.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7f7109ffb700 1 -- 172.21.15.86:0/3702733162 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c067610 con 0x7f710400c2e0 2023-10-09T11:41:23.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7f7109ffb700 1 -- 172.21.15.86:0/3702733162 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c067770 con 0x7f710400c2e0 2023-10-09T11:41:23.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf7bfff700 1 -- 172.21.15.86:0/1578209554 >> v1:172.21.15.135:6789/0 conn(0x7fdf7c1473b0 legacy=0x7fdf7c0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.288+0000 7fdf7bfff700 1 -- 172.21.15.86:0/1578209554 >> v1:172.21.15.86:6789/0 conn(0x7fdf7c0b1500 legacy=0x7fdf7c146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7fdf7bfff700 1 -- 172.21.15.86:0/1578209554 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0b1fb0 con 0x7fdf7c1618c0 2023-10-09T11:41:23.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f815ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f815804fdf0 0x7f815804e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7fdf7bfff700 1 --2- 172.21.15.86:0/1578209554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf7c1618c0 0x7fdf7c0b0fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098e0 tx=0x7fdf6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=559f62c9cfa14ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f71115ff700 1 -- 172.21.15.86:0/3702733162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710400c2e0 msgr2=0x7f71040060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f71115ff700 1 --2- 172.21.15.86:0/3702733162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710400c2e0 0x7f71040060c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f710c05f200 tx=0x7f710c066260 comp rx=0 tx=0).stop 2023-10-09T11:41:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f71115ff700 1 -- 172.21.15.86:0/3702733162 shutdown_connections 2023-10-09T11:41:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f71115ff700 1 --2- 172.21.15.86:0/3702733162 >> v2:172.21.15.86:3300/0 conn(0x7f710404ff30 0x7f7104050370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f71115ff700 1 --2- 172.21.15.86:0/3702733162 >> v2:172.21.15.135:3300/0 conn(0x7f71040ddfd0 0x7f71040de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f71115ff700 1 --2- 172.21.15.86:0/3702733162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710400c2e0 0x7f71040060c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.289+0000 7f71115ff700 1 -- 172.21.15.86:0/3702733162 >> 172.21.15.86:0/3702733162 conn(0x7f7104054e30 msgr2=0x7f7104055230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7fdf7affd700 1 -- 172.21.15.86:0/1578209554 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00b640 con 0x7fdf7c1618c0 2023-10-09T11:41:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7fdf7affd700 1 -- 172.21.15.86:0/1578209554 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c00b7a0 con 0x7fdf7c1618c0 2023-10-09T11:41:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7fdf7affd700 1 -- 172.21.15.86:0/1578209554 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00bb40 con 0x7fdf7c1618c0 2023-10-09T11:41:23.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7f815effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f815804fdf0 0x7f815804e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7f815effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f815804fdf0 0x7f815804e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39510/0 (socket says 172.21.15.86:39510) 2023-10-09T11:41:23.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7f815effd700 1 -- 172.21.15.86:0/3915129118 learned_addr learned my addr 172.21.15.86:0/3915129118 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7f815ffff700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8158101700 0x7f81580f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7fdf825ff700 1 -- 172.21.15.86:0/1578209554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf7c1618c0 msgr2=0x7fdf7c0b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7fdf825ff700 1 --2- 172.21.15.86:0/1578209554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf7c1618c0 0x7fdf7c0b0fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098e0 tx=0x7fdf6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7f71115ff700 1 -- 172.21.15.86:0/3702733162 shutdown_connections 2023-10-09T11:41:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7f815e7fc700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8158101700 0x7f81580f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7f815ffff700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8158104240 0x7f8158102b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.290+0000 7f71115ff700 1 -- 172.21.15.86:0/3702733162 wait complete. 2023-10-09T11:41:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7fdf825ff700 1 -- 172.21.15.86:0/1578209554 shutdown_connections 2023-10-09T11:41:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7fdf825ff700 1 --2- 172.21.15.86:0/1578209554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf7c1618c0 0x7fdf7c0b0fc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.291+0000 7fdf825ff700 1 -- 172.21.15.86:0/1578209554 >> 172.21.15.86:0/1578209554 conn(0x7fdf7c0d05f0 msgr2=0x7fdf7c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81580faaa0 con 0x7f815804fdf0 2023-10-09T11:41:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7fdf825ff700 1 -- 172.21.15.86:0/1578209554 shutdown_connections 2023-10-09T11:41:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f815f7fe700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8158104240 0x7f8158102b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815804f120 con 0x7f8158101700 2023-10-09T11:41:23.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815804e880 con 0x7f8158104240 2023-10-09T11:41:23.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f771ef9d700 1 Processor -- start 2023-10-09T11:41:23.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f8dd55ff700 1 Processor -- start 2023-10-09T11:41:23.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f815effd700 1 -- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8158104240 msgr2=0x7f8158102b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f815effd700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8158104240 0x7f8158102b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f815effd700 1 -- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8158101700 msgr2=0x7f81580f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f815effd700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8158101700 0x7f81580f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f815effd700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816004c9a0 con 0x7f815804fdf0 2023-10-09T11:41:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7fdf825ff700 1 -- 172.21.15.86:0/1578209554 wait complete. 2023-10-09T11:41:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f815effd700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f815804fdf0 0x7f815804e2a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f815400b880 tx=0x7f81540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540059d0 con 0x7f815804fdf0 2023-10-09T11:41:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f71115ff700 1 Processor -- start 2023-10-09T11:41:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.294+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8154005b30 con 0x7f815804fdf0 2023-10-09T11:41:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.294+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815804eb60 con 0x7f815804fdf0 2023-10-09T11:41:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.294+0000 7fdf825ff700 1 Processor -- start 2023-10-09T11:41:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.294+0000 7fdf825ff700 1 -- start start 2023-10-09T11:41:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.293+0000 7f771ef9d700 1 -- start start 2023-10-09T11:41:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f771ef9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77180ce900 0x7f77180cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f771ef9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f771815cd70 0x7f771815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f771ef9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77180cfa60 con 0x7f771815c9a0 2023-10-09T11:41:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f771ef9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180cee50 con 0x7f771815cd70 2023-10-09T11:41:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f771ef9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180cf130 con 0x7f77180ce900 2023-10-09T11:41:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f71115ff700 1 -- start start 2023-10-09T11:41:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.292+0000 7f8dd55ff700 1 -- start start 2023-10-09T11:41:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.294+0000 7f8dd55ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dd00afc40 0x7f8dd00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f8dd55ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8dd00b2140 0x7f8dd015d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f8dd55ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00b0750 con 0x7f8dd00b0010 2023-10-09T11:41:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f8dd55ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd00aca70 con 0x7f8dd00b2140 2023-10-09T11:41:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f8dd55ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00acd50 con 0x7f8dd00afc40 2023-10-09T11:41:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f8dcf7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8dd00b0010 0x7f8dd015dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55622/0 (socket says 172.21.15.86:55622) 2023-10-09T11:41:23.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f8dcf7fe700 1 -- 172.21.15.86:0/1084751740 learned_addr learned my addr 172.21.15.86:0/1084751740 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f8dce7fc700 1 --2- 172.21.15.86:0/1084751740 >> v2:172.21.15.86:3300/0 conn(0x7f8dd00b2140 0x7f8dd015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929765376 0 0) 0x7f8dd00b0750 con 0x7f8dd00b0010 2023-10-09T11:41:23.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dbc003570 con 0x7f8dd00b0010 2023-10-09T11:41:23.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dceffd700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dd00afc40 0x7f8dd00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916157865 0 0) 0x7f8dbc003570 con 0x7f8dd00b0010 2023-10-09T11:41:23.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f771df9b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f771815c9a0 0x7f77180cb750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55638/0 (socket says 172.21.15.86:55638) 2023-10-09T11:41:23.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f71115ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710404ff30 0x7f71040dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f71115ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71040ddfd0 0x7f710403a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f71115ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71040f5a30 0x7f71040f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f771df9b700 1 -- 172.21.15.86:0/3863886221 learned_addr learned my addr 172.21.15.86:0/3863886221 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f71115ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040e01c0 con 0x7f710404ff30 2023-10-09T11:41:23.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f71115ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104039480 con 0x7f71040ddfd0 2023-10-09T11:41:23.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f71115ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7104038b50 con 0x7f71040f5a30 2023-10-09T11:41:23.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7fdf825ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf7c0b1500 0x7fdf7c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dd00afc40 msgr2=0x7f8dd00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7fdf825ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c1473b0 0x7fdf7c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7fdf825ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7c1618c0 0x7fdf7c143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f771d79a700 1 --2- 172.21.15.86:0/3863886221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77180ce900 0x7f77180cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f771e79c700 1 --2- 172.21.15.86:0/3863886221 >> v2:172.21.15.86:3300/0 conn(0x7f771815cd70 0x7f771815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f710affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710404ff30 0x7f71040dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f710affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710404ff30 0x7f71040dfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39530/0 (socket says 172.21.15.86:39530) 2023-10-09T11:41:23.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f710affd700 1 -- 172.21.15.86:0/3978906836 learned_addr learned my addr 172.21.15.86:0/3978906836 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dd00afc40 0x7f8dd00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f710b7fe700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71040f5a30 0x7f71040f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 >> v2:172.21.15.86:3300/0 conn(0x7f8dd00b2140 msgr2=0x7f8dd015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 --2- 172.21.15.86:0/1084751740 >> v2:172.21.15.86:3300/0 conn(0x7f8dd00b2140 0x7f8dd015d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00ad030 con 0x7f8dd00b0010 2023-10-09T11:41:23.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f8dc80017f0 con 0x7f8dd00b0010 2023-10-09T11:41:23.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7fdf825ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b49d0 con 0x7fdf7c1473b0 2023-10-09T11:41:23.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 >> v1:172.21.15.135:6789/0 conn(0x7f8dd00b0010 legacy=0x7f8dd015dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dbc003ae0 0x7f8dbc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc004810 0x7f8dbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7fdf825ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b5830 con 0x7fdf7c0b1500 2023-10-09T11:41:23.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dbc0051c0 0x7f8dbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00aca70 con 0x7f8dbc0051c0 2023-10-09T11:41:23.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00acd50 con 0x7f8dbc004810 2023-10-09T11:41:23.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.297+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc00c020 con 0x7f8dbc003ae0 2023-10-09T11:41:23.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7fdf80b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7c1618c0 0x7fdf7c143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7f710a7fc700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71040ddfd0 0x7f710403a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7fdf80b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7c1618c0 0x7fdf7c143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:42718/0 (socket says 172.21.15.86:42718) 2023-10-09T11:41:23.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7fdf80b9c700 1 -- 172.21.15.86:0/2294148364 learned_addr learned my addr 172.21.15.86:0/2294148364 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7f771d79a700 1 -- 172.21.15.86:0/3863886221 >> v2:172.21.15.86:3300/0 conn(0x7f771815cd70 msgr2=0x7f771815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7f771d79a700 1 --2- 172.21.15.86:0/3863886221 >> v2:172.21.15.86:3300/0 conn(0x7f771815cd70 0x7f771815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7fdf825ff700 1 -- 172.21.15.86:0/2294148364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b4530 con 0x7fdf7c1618c0 2023-10-09T11:41:23.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7f771d79a700 1 -- 172.21.15.86:0/3863886221 >> v1:172.21.15.135:6789/0 conn(0x7f771815c9a0 legacy=0x7f77180cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7f771d79a700 1 -- 172.21.15.86:0/3863886221 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180cf410 con 0x7f77180ce900 2023-10-09T11:41:23.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.298+0000 7fdf7b7fe700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c1473b0 0x7fdf7c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.295+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158037c50 con 0x7f815804fdf0 2023-10-09T11:41:23.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8154006030 con 0x7f815804fdf0 2023-10-09T11:41:23.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.296+0000 7f8144ff9700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8140000fd0 con 0x7f815804fdf0 2023-10-09T11:41:23.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f771d79a700 1 --2- 172.21.15.86:0/3863886221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77180ce900 0x7f77180cfef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f77080098e0 tx=0x7f77080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5c626dc514d59e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f710affd700 1 -- 172.21.15.86:0/3978906836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71040f5a30 msgr2=0x7f71040f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f710affd700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71040f5a30 0x7f71040f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f710affd700 1 -- 172.21.15.86:0/3978906836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71040ddfd0 msgr2=0x7f710403a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f710affd700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71040ddfd0 0x7f710403a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f710affd700 1 -- 172.21.15.86:0/3978906836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c04c0e0 con 0x7f710404ff30 2023-10-09T11:41:23.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f8dcf7fe700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dbc0051c0 0x7f8dbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8154006460 con 0x7f815804fdf0 2023-10-09T11:41:23.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f771cf99700 1 -- 172.21.15.86:0/3863886221 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708009e80 con 0x7f77180ce900 2023-10-09T11:41:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7fdf80b9c700 1 -- 172.21.15.86:0/2294148364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf7c0b1500 msgr2=0x7fdf7c0b3ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:41:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7fdf80b9c700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf7c0b1500 0x7fdf7c0b3ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7fdf80b9c700 1 -- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c1473b0 msgr2=0x7fdf7c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7fdf80b9c700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c1473b0 0x7fdf7c15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7fdf80b9c700 1 -- 172.21.15.86:0/2294148364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009420 con 0x7fdf7c1618c0 2023-10-09T11:41:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f771cf99700 1 -- 172.21.15.86:0/3863886221 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770800b860 con 0x7f77180ce900 2023-10-09T11:41:23.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7fdf80b9c700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7c1618c0 0x7fdf7c143870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c7c0 tx=0x7fdf70007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f710affd700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710404ff30 0x7f71040dfac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00d860 tx=0x7f70fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f771ef9d700 1 -- 172.21.15.86:0/3863886221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77180ce900 msgr2=0x7f77180cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f771ef9d700 1 --2- 172.21.15.86:0/3863886221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77180ce900 0x7f77180cfef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f77080098e0 tx=0x7f77080091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0125f0 con 0x7f710404ff30 2023-10-09T11:41:23.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f771ef9d700 1 -- 172.21.15.86:0/3863886221 shutdown_connections 2023-10-09T11:41:23.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f8146ffd700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f814c067080 0x7f814c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.299+0000 7f8dce7fc700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc004810 0x7f8dbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f8dcf7fe700 1 -- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dbc003ae0 msgr2=0x7f8dbc003ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:41:23.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8154084610 con 0x7f815804fdf0 2023-10-09T11:41:23.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f8dcf7fe700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dbc003ae0 0x7f8dbc003ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f8dcf7fe700 1 -- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc004810 msgr2=0x7f8dbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f8dcf7fe700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc004810 0x7f8dbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f8146ffd700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7f814c06f290 0x7f814c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70005c00 con 0x7fdf7c1618c0 2023-10-09T11:41:23.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf70005d60 con 0x7fdf7c1618c0 2023-10-09T11:41:23.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf700072e0 con 0x7fdf7c1618c0 2023-10-09T11:41:23.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7fdf825ff700 1 -- 172.21.15.86:0/2294148364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c0b4c20 con 0x7fdf7c1618c0 2023-10-09T11:41:23.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7fdf825ff700 1 -- 172.21.15.86:0/2294148364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c0b51e0 con 0x7fdf7c1618c0 2023-10-09T11:41:23.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f814c071d50 con 0x7f814c06f290 2023-10-09T11:41:23.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8154084940 con 0x7f815804fdf0 2023-10-09T11:41:23.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.300+0000 7f8dcf7fe700 1 -- 172.21.15.86:0/1084751740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00ad030 con 0x7f8dbc0051c0 2023-10-09T11:41:23.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f771ef9d700 1 --2- 172.21.15.86:0/3863886221 >> v2:172.21.15.86:3300/0 conn(0x7f771815cd70 0x7f771815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f771ef9d700 1 --2- 172.21.15.86:0/3863886221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77180ce900 0x7f77180cfef0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f771ef9d700 1 -- 172.21.15.86:0/3863886221 >> 172.21.15.86:0/3863886221 conn(0x7f77180d05c0 msgr2=0x7f77180d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.302+0000 7fdf825ff700 1 -- 172.21.15.86:0/2294148364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf5c000fd0 con 0x7fdf7c1618c0 2023-10-09T11:41:23.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.302+0000 7f771ef9d700 1 -- 172.21.15.86:0/3863886221 shutdown_connections 2023-10-09T11:41:23.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.302+0000 7f771ef9d700 1 -- 172.21.15.86:0/3863886221 wait complete. 2023-10-09T11:41:23.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f71115ff700 1 -- 172.21.15.86:0/3978906836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7104038e30 con 0x7f710404ff30 2023-10-09T11:41:23.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.301+0000 7f71115ff700 1 -- 172.21.15.86:0/3978906836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710403a6c0 con 0x7f710404ff30 2023-10-09T11:41:23.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.303+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc012750 con 0x7f710404ff30 2023-10-09T11:41:23.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.303+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc012b10 con 0x7f710404ff30 2023-10-09T11:41:23.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.303+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70e4000fd0 con 0x7f710404ff30 2023-10-09T11:41:23.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.302+0000 7f815f7fe700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7f814c06f290 0x7f814c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.302+0000 7f815e7fc700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f814c067080 0x7f814c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.303+0000 7f815e7fc700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f814c067080 0x7f814c069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f815804e090 tx=0x7f8150001570 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.303+0000 7f8dcf7fe700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dbc0051c0 0x7f8dbc00ba60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800aa30 tx=0x7f8dc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c383bf4feefe5484 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.304+0000 7f815f7fe700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7f814c06f290 0x7f814c0716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7f2f60bff700 1 Processor -- start 2023-10-09T11:41:23.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7f771ef9d700 1 Processor -- start 2023-10-09T11:41:23.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.304+0000 7f5a92fff700 1 Processor -- start 2023-10-09T11:41:23.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7f2f60bff700 1 -- start start 2023-10-09T11:41:23.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.304+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800ae70 con 0x7f8dbc0051c0 2023-10-09T11:41:23.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.304+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc800c550 con 0x7f8dbc0051c0 2023-10-09T11:41:23.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.304+0000 7f8dcdffb700 1 -- 172.21.15.86:0/1084751740 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800c910 con 0x7f8dbc0051c0 2023-10-09T11:41:23.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7f771ef9d700 1 -- start start 2023-10-09T11:41:23.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7f8dd55ff700 1 -- 172.21.15.86:0/1084751740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dbc0051c0 msgr2=0x7f8dbc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7f8dd55ff700 1 --2- 172.21.15.86:0/1084751740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dbc0051c0 0x7f8dbc00ba60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800aa30 tx=0x7f8dc800a060 comp rx=0 tx=0).stop 2023-10-09T11:41:23.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.306+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== osd.0 v2:172.21.15.86:6800/85765 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f814c071d50 con 0x7f814c06f290 2023-10-09T11:41:23.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf7001b3b0 con 0x7fdf7c1618c0 2023-10-09T11:41:23.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.306+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70fc01e460 con 0x7f710404ff30 2023-10-09T11:41:23.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.305+0000 7f5a92fff700 1 -- start start 2023-10-09T11:41:23.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.306+0000 7fb5dbfff700 1 Processor -- start 2023-10-09T11:41:23.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7fb5dbfff700 1 -- start start 2023-10-09T11:41:23.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7fdf63fff700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdf68067080 0x7fdf68069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f771ef9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f771815c9a0 0x7f771815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f2f60bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2f54037330 0x7f2f540e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf70084210 con 0x7fdf7c1618c0 2023-10-09T11:41:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f771ef9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f771815cd70 0x7f77180b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f2f5a59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2f54036f60 0x7f2f5404fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37290/0 (socket says 172.21.15.86:37290) 2023-10-09T11:41:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f2f5a59c700 1 -- 172.21.15.86:0/2971969675 learned_addr learned my addr 172.21.15.86:0/2971969675 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7fdf63fff700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fdf6806f290 0x7fdf680716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 --> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf68071d50 con 0x7fdf6806f290 2023-10-09T11:41:23.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf70084540 con 0x7fdf7c1618c0 2023-10-09T11:41:23.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f5a92fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a8c159890 0x7f5a8c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f771ef9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77180b0ef0 0x7f77180b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f771ef9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c85c0 con 0x7f77180b0ef0 2023-10-09T11:41:23.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f771ef9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c88c0 con 0x7f771815c9a0 2023-10-09T11:41:23.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f2f59d9b700 1 --2- 172.21.15.86:0/2971969675 >> v2:172.21.15.135:3300/0 conn(0x7f2f54037330 0x7f2f540e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f2f60bff700 1 --2- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f540e62e0 0x7f2f540531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.307+0000 7f771ef9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77181551a0 con 0x7f771815cd70 2023-10-09T11:41:23.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f771815cd70 0x7f77180b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f771815cd70 0x7f77180b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:42730/0 (socket says 172.21.15.86:42730) 2023-10-09T11:41:23.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 -- 172.21.15.86:0/4077667270 learned_addr learned my addr 172.21.15.86:0/4077667270 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771df9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f771815c9a0 0x7f771815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7fdf7b7fe700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fdf6806f290 0x7fdf680716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f54006900 con 0x7f2f54036f60 2023-10-09T11:41:23.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f2f5ad9d700 1 --2- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f540e62e0 0x7f2f540531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f540e6c10 con 0x7f2f54037330 2023-10-09T11:41:23.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f540e6760 con 0x7f2f540e62e0 2023-10-09T11:41:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 -- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f771815c9a0 msgr2=0x7f771815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f771815c9a0 0x7f771815bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 -- 172.21.15.86:0/4077667270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77180b0ef0 msgr2=0x7f77180b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77180b0ef0 0x7f77180b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f771d79a700 1 -- 172.21.15.86:0/4077667270 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708009420 con 0x7f771815cd70 2023-10-09T11:41:23.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f771d79a700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f771815cd70 0x7f77180b5970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f770801ad70 tx=0x7f7708017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f70f2ffd700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f70f8067080 0x7f70f8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc06e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f2f59d9b700 1 -- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f540e62e0 msgr2=0x7f2f540531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f2f59d9b700 1 --2- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f540e62e0 0x7f2f540531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f2f59d9b700 1 -- 172.21.15.86:0/2971969675 >> v1:172.21.15.86:6789/0 conn(0x7f2f54036f60 legacy=0x7f2f5404fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f2f59d9b700 1 -- 172.21.15.86:0/2971969675 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54006b80 con 0x7f2f54037330 2023-10-09T11:41:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f2f59d9b700 1 --2- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f54037330 0x7f2f540e5da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098e0 tx=0x7f2f500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ae5ab472d14f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7fb5dbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5dc15de50 0x7fb5dc0c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7fb5dbfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0ca410 con 0x7fb5dc0696c0 2023-10-09T11:41:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7fb5dbfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c6f80 con 0x7fb5dc15de50 2023-10-09T11:41:23.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7fb5dbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c7220 con 0x7fb5dc15da80 2023-10-09T11:41:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770801f070 con 0x7f771815cd70 2023-10-09T11:41:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708009e80 con 0x7f771815cd70 2023-10-09T11:41:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70fc084b00 con 0x7f710404ff30 2023-10-09T11:41:23.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7fb5db7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb5dc0696c0 0x7fb5dc06ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55650/0 (socket says 172.21.15.86:55650) 2023-10-09T11:41:23.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7fb5db7fe700 1 -- 172.21.15.86:0/3369311061 learned_addr learned my addr 172.21.15.86:0/3369311061 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7fdf7b7fe700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fdf6806f290 0x7fdf680716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7f70f2ffd700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f70f806f290 0x7f70f80716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 --> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70f8071d50 con 0x7f70f806f290 2023-10-09T11:41:23.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70fc086ea0 con 0x7f710404ff30 2023-10-09T11:41:23.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7fb5daffd700 1 --2- 172.21.15.86:0/3369311061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7f710b7fe700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f70f806f290 0x7f70f80716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== osd.1 v2:172.21.15.86:6817/85768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdf68071d50 con 0x7fdf6806f290 2023-10-09T11:41:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7f710b7fe700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f70f806f290 0x7f70f80716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7fdf7bfff700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdf68067080 0x7fdf68069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f8dcf7fe700 1 -- 172.21.15.86:0/1084751740 reap_dead start 2023-10-09T11:41:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f8dd55ff700 1 -- 172.21.15.86:0/1084751740 shutdown_connections 2023-10-09T11:41:23.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f8dd55ff700 1 -- 172.21.15.86:0/1084751740 >> 172.21.15.86:0/1084751740 conn(0x7f8dd006a320 msgr2=0x7f8dd00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f2f5959a700 1 -- 172.21.15.86:0/2971969675 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000b640 con 0x7f2f54037330 2023-10-09T11:41:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f2f5959a700 1 -- 172.21.15.86:0/2971969675 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000b7a0 con 0x7f2f54037330 2023-10-09T11:41:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f2f5959a700 1 -- 172.21.15.86:0/2971969675 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000bb60 con 0x7f2f54037330 2023-10-09T11:41:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f5a92fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c15a160 con 0x7f5a8c069560 2023-10-09T11:41:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f5a92fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0d13a0 con 0x7f5a8c159c60 2023-10-09T11:41:23.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.308+0000 7f5a92fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c15e140 con 0x7f5a8c159890 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f5a8bfff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f5a8c159c60 0x7f5a8c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55642/0 (socket says 172.21.15.86:55642) 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.309+0000 7f5a8bfff700 1 -- 172.21.15.86:0/3721772459 learned_addr learned my addr 172.21.15.86:0/3721772459 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696192938 0 0) 0x7f5a8c0d13a0 con 0x7f5a8c159c60 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a74003570 con 0x7f5a8c159c60 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7fb5daffd700 1 -- 172.21.15.86:0/3369311061 >> v2:172.21.15.86:3300/0 conn(0x7fb5dc15de50 msgr2=0x7fb5dc0c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7fb5daffd700 1 --2- 172.21.15.86:0/3369311061 >> v2:172.21.15.86:3300/0 conn(0x7fb5dc15de50 0x7fb5dc0c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7fb5daffd700 1 -- 172.21.15.86:0/3369311061 >> v1:172.21.15.135:6789/0 conn(0x7fb5dc0696c0 legacy=0x7fb5dc06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7fb5daffd700 1 -- 172.21.15.86:0/3369311061 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0c7500 con 0x7fb5dc15da80 2023-10-09T11:41:23.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== osd.2 v2:172.21.15.86:6808/85766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f70f8071d50 con 0x7f70f806f290 2023-10-09T11:41:23.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708006e50 con 0x7f771815cd70 2023-10-09T11:41:23.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7fb5daffd700 1 --2- 172.21.15.86:0/3369311061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc06e470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0098e0 tx=0x7fb5cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3cc3417d7b1ca7f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.310+0000 7f771ef9d700 1 -- 172.21.15.86:0/4077667270 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77180b6050 con 0x7f771815cd70 2023-10-09T11:41:23.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f771ef9d700 1 -- 172.21.15.86:0/4077667270 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77180b3ff0 con 0x7f771815cd70 2023-10-09T11:41:23.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f8dd55ff700 1 -- 172.21.15.86:0/1084751740 shutdown_connections 2023-10-09T11:41:23.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f54037330 msgr2=0x7f2f540e5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7fb5d9ffb700 1 -- 172.21.15.86:0/3369311061 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc009e80 con 0x7fb5dc15da80 2023-10-09T11:41:23.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7fb5d9ffb700 1 -- 172.21.15.86:0/3369311061 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc00b860 con 0x7fb5dc15da80 2023-10-09T11:41:23.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f2f60bff700 1 --2- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f54037330 0x7f2f540e5da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098e0 tx=0x7f2f500091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7fb5d9ffb700 1 -- 172.21.15.86:0/3369311061 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00bc00 con 0x7fb5dc15da80 2023-10-09T11:41:23.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76f4000fd0 con 0x7f771815cd70 2023-10-09T11:41:23.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 shutdown_connections 2023-10-09T11:41:23.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f2f60bff700 1 --2- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f540e62e0 0x7f2f540531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f2f60bff700 1 --2- 172.21.15.86:0/2971969675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f54037330 0x7f2f540e5da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 >> 172.21.15.86:0/2971969675 conn(0x7f2f54054c90 msgr2=0x7f2f54055090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 shutdown_connections 2023-10-09T11:41:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982414880 0 0) 0x7f5a74003570 con 0x7f5a8c159c60 2023-10-09T11:41:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 >> v2:172.21.15.86:3300/0 conn(0x7f5a8c159890 msgr2=0x7f5a8c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 --2- 172.21.15.86:0/3721772459 >> v2:172.21.15.86:3300/0 conn(0x7f5a8c159890 0x7f5a8c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 >> v1:172.21.15.86:6789/0 conn(0x7f5a8c069560 legacy=0x7f5a8c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c15a3d0 con 0x7f5a8c159c60 2023-10-09T11:41:23.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f5a80001470 con 0x7f5a8c159c60 2023-10-09T11:41:23.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f2f60bff700 1 -- 172.21.15.86:0/2971969675 wait complete. 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 >> v1:172.21.15.135:6789/0 conn(0x7f5a8c159c60 legacy=0x7f5a8c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74003b30 0x7f5a74003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a74004810 0x7f5a74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a74005410 0x7f5a740142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c15e140 con 0x7f5a74005410 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a74014b10 con 0x7f5a74003b30 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.311+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a74014cd0 con 0x7f5a74004810 2023-10-09T11:41:23.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a74004810 0x7f5a74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f5a90d9b700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74003b30 0x7f5a74003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.312+0000 7f5a9159c700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a74005410 0x7f5a740142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8bfff700 1 -- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74003b30 msgr2=0x7f5a74003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74003b30 0x7f5a74003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8bfff700 1 -- 172.21.15.86:0/3721772459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a74005410 msgr2=0x7f5a740142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a74005410 0x7f5a740142d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8bfff700 1 -- 172.21.15.86:0/3721772459 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74003570 con 0x7f5a74004810 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a9159c700 1 -- 172.21.15.86:0/3721772459 reap_dead start 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a74004810 0x7f5a74004c80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a8001d2e0 tx=0x7f5a80001e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f888d03dda32756 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7fb5dbfff700 1 -- 172.21.15.86:0/3369311061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 msgr2=0x7fb5dc06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7fb5dbfff700 1 --2- 172.21.15.86:0/3369311061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc06e470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0098e0 tx=0x7fb5cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7fdf7bfff700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdf68067080 0x7fdf68069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00a010 tx=0x7fdf6c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f710a7fc700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f70f8067080 0x7f70f8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7fb5dbfff700 1 -- 172.21.15.86:0/3369311061 shutdown_connections 2023-10-09T11:41:23.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7fb5dbfff700 1 --2- 172.21.15.86:0/3369311061 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc06e470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7fb5dbfff700 1 --2- 172.21.15.86:0/3369311061 >> v2:172.21.15.86:3300/0 conn(0x7fb5dc15de50 0x7fb5dc0c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.314+0000 7fb5dbfff700 1 -- 172.21.15.86:0/3369311061 >> 172.21.15.86:0/3369311061 conn(0x7fb5dc0cc1f0 msgr2=0x7fb5dc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.315+0000 7f710a7fc700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f70f8067080 0x7f70f8069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7104053e30 tx=0x7f710c08c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8001dc10 con 0x7f5a74004810 2023-10-09T11:41:23.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8001dd70 con 0x7f5a74004810 2023-10-09T11:41:23.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/3721772459 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80005b70 con 0x7f5a74004810 2023-10-09T11:41:23.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.315+0000 7f5a92fff700 1 -- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a74004810 msgr2=0x7f5a74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.315+0000 7f5a92fff700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a74004810 0x7f5a74004c80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a8001d2e0 tx=0x7f5a80001e30 comp rx=0 tx=0).stop 2023-10-09T11:41:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.315+0000 7fb5dbfff700 1 -- 172.21.15.86:0/3369311061 shutdown_connections 2023-10-09T11:41:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.316+0000 7f2f60bff700 1 Processor -- start 2023-10-09T11:41:23.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.316+0000 7f2f60bff700 1 -- start start 2023-10-09T11:41:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.316+0000 7fb5dbfff700 1 -- 172.21.15.86:0/3369311061 wait complete. 2023-10-09T11:41:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.317+0000 7fb5dbfff700 1 Processor -- start 2023-10-09T11:41:23.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.317+0000 7fb5dbfff700 1 -- start start 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.313+0000 7f8dd55ff700 1 -- 172.21.15.86:0/1084751740 wait complete. 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.315+0000 7f8dd55ff700 1 Processor -- start 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.316+0000 7f8dd55ff700 1 -- start start 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.317+0000 7f8dd55ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dd0087790 0x7f8dd01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.317+0000 7f8dd55ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dd0087b60 0x7f8dd01550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.317+0000 7f8dd55ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ae2b0 0x7f8dd00ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f8dd55ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0156960 con 0x7f8dd00ae2b0 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f8dd55ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00aec50 con 0x7f8dd0087790 2023-10-09T11:41:23.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f8dd55ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd012e550 con 0x7f8dd0087b60 2023-10-09T11:41:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f8dcf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ae2b0 0x7f8dd00ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f8dcf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ae2b0 0x7f8dd00ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39596/0 (socket says 172.21.15.86:39596) 2023-10-09T11:41:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f8dcf7fe700 1 -- 172.21.15.86:0/3206434187 learned_addr learned my addr 172.21.15.86:0/3206434187 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f8dceffd700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dd0087790 0x7f8dd01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f2f60bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f54036f60 0x7f2f54034dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f2f60bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f54037330 0x7f2f540358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0696c0 0x7fb5dc1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.317+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7708023070 con 0x7f771815cd70 2023-10-09T11:41:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f770dffb700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f76fc067080 0x7f76fc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.318+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7708085910 con 0x7f771815cd70 2023-10-09T11:41:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f54036f60 0x7f2f54034dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f54036f60 0x7f2f54034dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:42774/0 (socket says 172.21.15.86:42774) 2023-10-09T11:41:23.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f770dffb700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f76fc06f290 0x7f76fc0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 --> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76fc071d50 con 0x7f76fc06f290 2023-10-09T11:41:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770808a220 con 0x7f771815cd70 2023-10-09T11:41:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5dc15de50 0x7fb5dc156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f5a59c700 1 -- 172.21.15.86:0/1214245723 learned_addr learned my addr 172.21.15.86:0/1214245723 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f60bff700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f540e62e0 0x7f2f540d6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f59d9b700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f54037330 0x7f2f540358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5dbfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c32a0 con 0x7fb5dc0696c0 2023-10-09T11:41:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5dbfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c3860 con 0x7fb5dc15de50 2023-10-09T11:41:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f771df9b700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f76fc067080 0x7f76fc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5dc15de50 0x7fb5dc156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5dc15de50 0x7fb5dc156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57010/0 (socket says 172.21.15.86:57010) 2023-10-09T11:41:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5db7fe700 1 -- 172.21.15.86:0/1048217734 learned_addr learned my addr 172.21.15.86:0/1048217734 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5404a940 con 0x7f2f54037330 2023-10-09T11:41:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc151b30 con 0x7fb5dc15da80 2023-10-09T11:41:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5404ac20 con 0x7f2f540e62e0 2023-10-09T11:41:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f771e79c700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f76fc06f290 0x7f76fc0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.319+0000 7f2f5ad9d700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f540e62e0 0x7f2f540d6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5404af00 con 0x7f2f54036f60 2023-10-09T11:41:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7fb5da7fc700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7fb5daffd700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0696c0 0x7fb5dc1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f2f5a59c700 1 -- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f540e62e0 msgr2=0x7f2f540d6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f2f5a59c700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f540e62e0 0x7f2f540d6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7fb5db7fe700 1 -- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 msgr2=0x7fb5dc155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7fb5db7fe700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5dc15da80 0x7fb5dc155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7fb5db7fe700 1 -- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0696c0 msgr2=0x7fb5dc1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7fb5db7fe700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0696c0 0x7fb5dc1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7fb5db7fe700 1 -- 172.21.15.86:0/1048217734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc009420 con 0x7fb5dc15de50 2023-10-09T11:41:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f2f5a59c700 1 -- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f54037330 msgr2=0x7f2f540358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f5a92fff700 1 -- 172.21.15.86:0/3721772459 shutdown_connections 2023-10-09T11:41:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f5a92fff700 1 --2- 172.21.15.86:0/3721772459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a74004810 0x7f5a74004c80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f5a92fff700 1 -- 172.21.15.86:0/3721772459 >> 172.21.15.86:0/3721772459 conn(0x7f5a8c068e20 msgr2=0x7f5a8c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f2f5a59c700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f54037330 0x7f2f540358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f2f5a59c700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50009420 con 0x7f2f54036f60 2023-10-09T11:41:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f771df9b700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f76fc067080 0x7f76fc069530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7714007180 tx=0x7f7714007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f2f5a59c700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f54036f60 0x7f2f54034dd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c7c0 tx=0x7f2f4c007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c005b30 con 0x7f2f54036f60 2023-10-09T11:41:23.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c005c90 con 0x7f2f54036f60 2023-10-09T11:41:23.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c004a40 con 0x7f2f54036f60 2023-10-09T11:41:23.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f8dceffd700 1 -- 172.21.15.86:0/3206434187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dd0087b60 msgr2=0x7f8dd01550e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:41:23.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f8dceffd700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dd0087b60 0x7f8dd01550e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f8dceffd700 1 -- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ae2b0 msgr2=0x7f8dd00ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f8dceffd700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ae2b0 0x7f8dd00ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f8dceffd700 1 -- 172.21.15.86:0/3206434187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd012dc20 con 0x7f8dd0087790 2023-10-09T11:41:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.320+0000 7f8dceffd700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dd0087790 0x7f8dd01562a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0063d40 tx=0x7f8db8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db80125f0 con 0x7f8dd0087790 2023-10-09T11:41:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db8012750 con 0x7f8dd0087790 2023-10-09T11:41:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5404b1e0 con 0x7f2f54036f60 2023-10-09T11:41:23.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8012b10 con 0x7f8dd0087790 2023-10-09T11:41:23.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7f771e79c700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f76fc06f290 0x7f76fc0716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7fb5db7fe700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5dc15de50 0x7fb5dc156450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c7c0 tx=0x7fb5d4007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4005b30 con 0x7fb5dc15de50 2023-10-09T11:41:23.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.321+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4005c90 con 0x7fb5dc15de50 2023-10-09T11:41:23.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7f5a92fff700 1 -- 172.21.15.86:0/3721772459 shutdown_connections 2023-10-09T11:41:23.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4007300 con 0x7fb5dc15de50 2023-10-09T11:41:23.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc160340 con 0x7fb5dc15de50 2023-10-09T11:41:23.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f54035310 con 0x7f2f54036f60 2023-10-09T11:41:23.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc0c34f0 con 0x7fb5dc15de50 2023-10-09T11:41:23.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd012df00 con 0x7f8dd0087790 2023-10-09T11:41:23.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd0131080 con 0x7f8dd0087790 2023-10-09T11:41:23.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.323+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5dc04c3c0 con 0x7fb5dc15de50 2023-10-09T11:41:23.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.323+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8dd004c3c0 con 0x7f8dd0087790 2023-10-09T11:41:23.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.322+0000 7f5a92fff700 1 -- 172.21.15.86:0/3721772459 wait complete. 2023-10-09T11:41:23.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.325+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5d4007670 con 0x7fb5dc15de50 2023-10-09T11:41:23.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.324+0000 7f5a92fff700 1 Processor -- start 2023-10-09T11:41:23.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7fb5d2ffd700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb5bc066f80 0x7fb5bc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== osd.4 v2:172.21.15.135:6800/114751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f76fc071d50 con 0x7f76fc06f290 2023-10-09T11:41:23.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5d4083970 con 0x7fb5dc15de50 2023-10-09T11:41:23.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8db8013480 con 0x7f8dd0087790 2023-10-09T11:41:23.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.325+0000 7f5a92fff700 1 -- start start 2023-10-09T11:41:23.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7f5a92fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74004810 0x7f5a8c14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7f5a92fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0cf4d0 0x7f5a8c153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7f5a92fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0c6b60 0x7f5a8c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7fb5d2ffd700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fb5bc06f020 0x7fb5bc071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 --> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5bc071ae0 con 0x7fb5bc06f020 2023-10-09T11:41:23.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5d4088220 con 0x7fb5dc15de50 2023-10-09T11:41:23.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.326+0000 7fb5daffd700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb5bc066f80 0x7fb5bc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7fb5da7fc700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fb5bc06f020 0x7fb5bc071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.325+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f4c0070d0 con 0x7f2f54036f60 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.325+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f54005390 con 0x7f2f54036f60 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7f2f4a7fc700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2f3c066fb0 0x7f2f3c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f4c0838d0 con 0x7f2f54036f60 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7f2f4a7fc700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f2f3c06f140 0x7f2f3c071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.327+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f3c071c00 con 0x7f2f3c06f140 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f2f59d9b700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2f3c066fb0 0x7f2f3c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f2f5ad9d700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f2f3c06f140 0x7f2f3c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0cf4d0 0x7f5a8c153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0cf4d0 0x7f5a8c153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:42782/0 (socket says 172.21.15.86:42782) 2023-10-09T11:41:23.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a9159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0c6b60 0x7f5a8c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a9159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0c6b60 0x7f5a8c0c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39620/0 (socket says 172.21.15.86:39620) 2023-10-09T11:41:23.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a8bfff700 1 -- 172.21.15.86:0/2092622996 learned_addr learned my addr 172.21.15.86:0/2092622996 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f4c050aa0 con 0x7f2f54036f60 2023-10-09T11:41:23.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c14e930 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c7510 con 0x7f5a74004810 2023-10-09T11:41:23.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c154660 con 0x7f5a8c0cf4d0 2023-10-09T11:41:23.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f5a90d9b700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74004810 0x7f5a8c14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7fb5da7fc700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fb5bc06f020 0x7fb5bc071430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f2f5ad9d700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f2f3c06f140 0x7f2f3c071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f2f59d9b700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2f3c066fb0 0x7f2f3c069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f500093f0 tx=0x7f2f50017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7fb5daffd700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb5bc066f80 0x7fb5bc069430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0098e0 tx=0x7fb5cc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.328+0000 7f8dc6ffd700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8db0067000 0x7f8db00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8db8085160 con 0x7f8dd0087790 2023-10-09T11:41:23.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f8dc6ffd700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f8db006f0a0 0x7f8db00714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 --> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8db0071b60 con 0x7f8db006f0a0 2023-10-09T11:41:23.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8db8085490 con 0x7f8dd0087790 2023-10-09T11:41:23.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f8dce7fc700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8db0067000 0x7f8db00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.330+0000 7f8dce7fc700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8db0067000 0x7f8db00694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00aefa0 tx=0x7f8dc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.330+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== osd.5 v2:172.21.15.135:6808/114759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2f3c071c00 con 0x7f2f3c06f140 2023-10-09T11:41:23.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.330+0000 7f8dcf7fe700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f8db006f0a0 0x7f8db00714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.330+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== osd.7 v2:172.21.15.135:6809/114757 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb5bc071ae0 con 0x7fb5bc06f020 2023-10-09T11:41:23.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f5a9159c700 1 -- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0cf4d0 msgr2=0x7f5a8c153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f5a9159c700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0cf4d0 0x7f5a8c153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f5a9159c700 1 -- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74004810 msgr2=0x7f5a8c14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f5a9159c700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a74004810 0x7f5a8c14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.329+0000 7f5a9159c700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c1540a0 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.332+0000 7f5a9159c700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0c6b60 0x7f5a8c0c6fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c15a030 tx=0x7f5a7c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.332+0000 7f8dcf7fe700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f8db006f0a0 0x7f8db00714b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.334+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== osd.3 v2:172.21.15.86:6816/85767 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8db0071b60 con 0x7f8db006f0a0 2023-10-09T11:41:23.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.334+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00eea0 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.334+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c013420 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.334+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c0137c0 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.335+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c154380 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.335+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c0b4520 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.339+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a7c013b30 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.340+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a8c0b40a0 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.340+0000 7f5a88ff9700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5a78067080 0x7f5a78069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.341+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a7c084070 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.341+0000 7f5a88ff9700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7f5a7806f290 0x7f5a780716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.341+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a78071d50 con 0x7f5a7806f290 2023-10-09T11:41:23.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.341+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a7c0864f0 con 0x7f5a8c0c6b60 2023-10-09T11:41:23.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.342+0000 7f5a90d9b700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5a78067080 0x7f5a78069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.342+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7f5a7806f290 0x7f5a780716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.343+0000 7f5a90d9b700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5a78067080 0x7f5a78069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0b6600 tx=0x7f5a84010040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.343+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7f5a7806f290 0x7f5a780716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.344+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== osd.6 v2:172.21.15.135:6824/114774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5a78071d50 con 0x7f5a7806f290 2023-10-09T11:41:23.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.345+0000 7f8144ff9700 1 -- 172.21.15.86:0/3915129118 --> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8140002d30 con 0x7f814c06f290 2023-10-09T11:41:23.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.346+0000 7f8146ffd700 1 -- 172.21.15.86:0/3915129118 <== osd.0 v2:172.21.15.86:6800/85765 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8140002d30 con 0x7f814c06f290 2023-10-09T11:41:23.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.346+0000 7fdf825ff700 1 -- 172.21.15.86:0/2294148364 --> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf5c002c90 con 0x7fdf6806f290 2023-10-09T11:41:23.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.346+0000 7fdf63fff700 1 -- 172.21.15.86:0/2294148364 <== osd.1 v2:172.21.15.86:6817/85768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf5c002c90 con 0x7fdf6806f290 2023-10-09T11:41:23.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.347+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7f814c06f290 msgr2=0x7f814c0716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.347+0000 7f815ffff700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7f814c06f290 0x7f814c0716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.347+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f814c067080 msgr2=0x7f814c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7f815ffff700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f814c067080 0x7f814c069530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f815804e090 tx=0x7f8150001570 comp rx=0 tx=0).stop 2023-10-09T11:41:23.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f815804fdf0 msgr2=0x7f815804e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7f815ffff700 1 --2- 172.21.15.86:0/3915129118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f815804fdf0 0x7f815804e2a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f815400b880 tx=0x7f81540091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7f815f7fe700 1 -- 172.21.15.86:0/3915129118 reap_dead start 2023-10-09T11:41:23.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7fdf61ffb700 1 -- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fdf6806f290 msgr2=0x7fdf680716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7fdf61ffb700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fdf6806f290 0x7fdf680716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7fdf61ffb700 1 -- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdf68067080 msgr2=0x7fdf68069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7fdf61ffb700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdf68067080 0x7fdf68069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00a010 tx=0x7fdf6c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:23.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7fdf61ffb700 1 -- 172.21.15.86:0/2294148364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7c1618c0 msgr2=0x7fdf7c143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.348+0000 7fdf61ffb700 1 --2- 172.21.15.86:0/2294148364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7c1618c0 0x7fdf7c143870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c7c0 tx=0x7fdf70007d90 comp rx=0 tx=0).stop 2023-10-09T11:41:23.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7fdf80b9c700 1 -- 172.21.15.86:0/2294148364 reap_dead start 2023-10-09T11:41:23.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 shutdown_connections 2023-10-09T11:41:23.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 >> 172.21.15.86:0/3915129118 conn(0x7f8158051810 msgr2=0x7f8158006d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7fdf61ffb700 1 -- 172.21.15.86:0/2294148364 shutdown_connections 2023-10-09T11:41:23.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7fdf61ffb700 1 -- 172.21.15.86:0/2294148364 >> 172.21.15.86:0/2294148364 conn(0x7fdf7c0d05f0 msgr2=0x7fdf7c069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 shutdown_connections 2023-10-09T11:41:23.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7f815ffff700 1 -- 172.21.15.86:0/3915129118 wait complete. 2023-10-09T11:41:23.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.349+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 --> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70e4002d30 con 0x7f70f806f290 2023-10-09T11:41:23.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.350+0000 7f70f2ffd700 1 -- 172.21.15.86:0/3978906836 <== osd.2 v2:172.21.15.86:6808/85766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f70e4002d30 con 0x7f70f806f290 2023-10-09T11:41:23.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.350+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f70f806f290 msgr2=0x7f70f80716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.350+0000 7f70f0ff9700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f70f806f290 0x7f70f80716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.350+0000 7fdf61ffb700 1 -- 172.21.15.86:0/2294148364 shutdown_connections 2023-10-09T11:41:23.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.351+0000 7fdf61ffb700 1 -- 172.21.15.86:0/2294148364 wait complete. 2023-10-09T11:41:23.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.351+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f70f8067080 msgr2=0x7f70f8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.351+0000 7f70f0ff9700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f70f8067080 0x7f70f8069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7104053e30 tx=0x7f710c08c000 comp rx=0 tx=0).stop 2023-10-09T11:41:23.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.351+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710404ff30 msgr2=0x7f71040dfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.351+0000 7f70f0ff9700 1 --2- 172.21.15.86:0/3978906836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710404ff30 0x7f71040dfac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00d860 tx=0x7f70fc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:23.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.351+0000 7f710b7fe700 1 -- 172.21.15.86:0/3978906836 reap_dead start 2023-10-09T11:41:23.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.352+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 shutdown_connections 2023-10-09T11:41:23.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.352+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 >> 172.21.15.86:0/3978906836 conn(0x7f7104054e30 msgr2=0x7f71040cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.352+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 shutdown_connections 2023-10-09T11:41:23.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.353+0000 7f70f0ff9700 1 -- 172.21.15.86:0/3978906836 wait complete. 2023-10-09T11:41:23.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.357+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 --> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76f4002d30 con 0x7f76fc06f290 2023-10-09T11:41:23.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.360+0000 7f770dffb700 1 -- 172.21.15.86:0/4077667270 <== osd.4 v2:172.21.15.135:6800/114751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76f4002d30 con 0x7f76fc06f290 2023-10-09T11:41:23.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.360+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 --> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5dc0c9dc0 con 0x7fb5bc06f020 2023-10-09T11:41:23.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.361+0000 7fb5d2ffd700 1 -- 172.21.15.86:0/1048217734 <== osd.7 v2:172.21.15.135:6809/114757 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5dc0c9dc0 con 0x7fb5bc06f020 2023-10-09T11:41:23.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.362+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f76fc06f290 msgr2=0x7f76fc0716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.362+0000 7f76fb7fe700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f76fc06f290 0x7f76fc0716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.362+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fb5bc06f020 msgr2=0x7fb5bc071430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.362+0000 7fb5dbfff700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fb5bc06f020 0x7fb5bc071430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb5bc066f80 msgr2=0x7fb5bc069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7fb5dbfff700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb5bc066f80 0x7fb5bc069430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0098e0 tx=0x7fb5cc017000 comp rx=0 tx=0).stop 2023-10-09T11:41:23.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5dc15de50 msgr2=0x7fb5dc156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7fb5dbfff700 1 --2- 172.21.15.86:0/1048217734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5dc15de50 0x7fb5dc156450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c7c0 tx=0x7fb5d4007eb0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7fb5db7fe700 1 -- 172.21.15.86:0/1048217734 reap_dead start 2023-10-09T11:41:23.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 --> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8dd00ad310 con 0x7f8db006f0a0 2023-10-09T11:41:23.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f76fc067080 msgr2=0x7f76fc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7f76fb7fe700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f76fc067080 0x7f76fc069530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7714007180 tx=0x7f7714007eb0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 shutdown_connections 2023-10-09T11:41:23.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 >> 172.21.15.86:0/1048217734 conn(0x7fb5dc0cc1f0 msgr2=0x7fb5dc06de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f771815cd70 msgr2=0x7f77180b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.363+0000 7f76fb7fe700 1 --2- 172.21.15.86:0/4077667270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f771815cd70 0x7f77180b5970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f770801ad70 tx=0x7f7708017000 comp rx=0 tx=0).stop 2023-10-09T11:41:23.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.364+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 shutdown_connections 2023-10-09T11:41:23.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.364+0000 7f771e79c700 1 -- 172.21.15.86:0/4077667270 reap_dead start 2023-10-09T11:41:23.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.364+0000 7fb5dbfff700 1 -- 172.21.15.86:0/1048217734 wait complete. 2023-10-09T11:41:23.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.364+0000 7f8dc6ffd700 1 -- 172.21.15.86:0/3206434187 <== osd.3 v2:172.21.15.86:6816/85767 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8dd00ad310 con 0x7f8db006f0a0 2023-10-09T11:41:23.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.364+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 shutdown_connections 2023-10-09T11:41:23.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.364+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 >> 172.21.15.86:0/4077667270 conn(0x7f77180d05c0 msgr2=0x7f7718069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.365+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 shutdown_connections 2023-10-09T11:41:23.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.365+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f8db006f0a0 msgr2=0x7f8db00714b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.365+0000 7f8dd55ff700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f8db006f0a0 0x7f8db00714b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.365+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8db0067000 msgr2=0x7f8db00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.365+0000 7f8dd55ff700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8db0067000 0x7f8db00694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00aefa0 tx=0x7f8dc0008040 comp rx=0 tx=0).stop 2023-10-09T11:41:23.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.365+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dd0087790 msgr2=0x7f8dd01562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.365+0000 7f8dd55ff700 1 --2- 172.21.15.86:0/3206434187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dd0087790 0x7f8dd01562a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0063d40 tx=0x7f8db8008040 comp rx=0 tx=0).stop 2023-10-09T11:41:23.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.366+0000 7f8dcf7fe700 1 -- 172.21.15.86:0/3206434187 reap_dead start 2023-10-09T11:41:23.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.366+0000 7f76fb7fe700 1 -- 172.21.15.86:0/4077667270 wait complete. 2023-10-09T11:41:23.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.366+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 shutdown_connections 2023-10-09T11:41:23.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.366+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 >> 172.21.15.86:0/3206434187 conn(0x7f8dd006a320 msgr2=0x7f8dd00af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.367+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 shutdown_connections 2023-10-09T11:41:23.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.367+0000 7f8dd55ff700 1 -- 172.21.15.86:0/3206434187 wait complete. 2023-10-09T11:41:23.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.368+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 --> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f5404b370 con 0x7f2f3c06f140 2023-10-09T11:41:23.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.369+0000 7f2f4a7fc700 1 -- 172.21.15.86:0/1214245723 <== osd.5 v2:172.21.15.135:6808/114759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f5404b370 con 0x7f2f3c06f140 2023-10-09T11:41:23.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.371+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f2f3c06f140 msgr2=0x7f2f3c071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.371+0000 7f2f60bff700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f2f3c06f140 0x7f2f3c071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.372+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2f3c066fb0 msgr2=0x7f2f3c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.372+0000 7f2f60bff700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2f3c066fb0 0x7f2f3c069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f500093f0 tx=0x7f2f50017000 comp rx=0 tx=0).stop 2023-10-09T11:41:23.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.372+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f54036f60 msgr2=0x7f2f54034dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.372+0000 7f2f60bff700 1 --2- 172.21.15.86:0/1214245723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f54036f60 0x7f2f54034dd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c7c0 tx=0x7f2f4c007f70 comp rx=0 tx=0).stop 2023-10-09T11:41:23.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.372+0000 7f2f5ad9d700 1 -- 172.21.15.86:0/1214245723 reap_dead start 2023-10-09T11:41:23.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.375+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 --> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a8c0b40a0 con 0x7f5a7806f290 2023-10-09T11:41:23.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.376+0000 7f5a88ff9700 1 -- 172.21.15.86:0/2092622996 <== osd.6 v2:172.21.15.135:6824/114774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a8c0b40a0 con 0x7f5a7806f290 2023-10-09T11:41:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.377+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7f5a7806f290 msgr2=0x7f5a780716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.377+0000 7f5a92fff700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7f5a7806f290 0x7f5a780716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.377+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5a78067080 msgr2=0x7f5a78069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.377+0000 7f5a92fff700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5a78067080 0x7f5a78069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0b6600 tx=0x7f5a84010040 comp rx=0 tx=0).stop 2023-10-09T11:41:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.378+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0c6b60 msgr2=0x7f5a8c0c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.378+0000 7f5a92fff700 1 --2- 172.21.15.86:0/2092622996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0c6b60 0x7f5a8c0c6fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c15a030 tx=0x7f5a7c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.378+0000 7f5a9159c700 1 -- 172.21.15.86:0/2092622996 reap_dead start 2023-10-09T11:41:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.378+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 shutdown_connections 2023-10-09T11:41:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.378+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 >> 172.21.15.86:0/2092622996 conn(0x7f5a8c068e20 msgr2=0x7f5a8c157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.379+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 shutdown_connections 2023-10-09T11:41:23.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.379+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 >> 172.21.15.86:0/1214245723 conn(0x7f2f54054c90 msgr2=0x7f2f540dd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.380+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 shutdown_connections 2023-10-09T11:41:23.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.380+0000 7f2f60bff700 1 -- 172.21.15.86:0/1214245723 wait complete. 2023-10-09T11:41:23.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.382+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 shutdown_connections 2023-10-09T11:41:23.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.382+0000 7f5a92fff700 1 -- 172.21.15.86:0/2092622996 wait complete. 2023-10-09T11:41:23.418 INFO:teuthology.orchestra.run.smithi086.stdout:64424509448 2023-10-09T11:41:23.418 INFO:teuthology.orchestra.run.smithi086.stdout:60129542151 2023-10-09T11:41:23.419 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T11:41:23.419 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T11:41:23.420 INFO:teuthology.orchestra.run.smithi086.stdout:60129542151 2023-10-09T11:41:23.421 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T11:41:23.421 INFO:teuthology.orchestra.run.smithi086.stdout:68719476743 2023-10-09T11:41:23.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T11:41:23.422 INFO:teuthology.orchestra.run.smithi086.stdout:64424509448 2023-10-09T11:41:23.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T11:41:23.423 INFO:teuthology.orchestra.run.smithi086.stdout:68719476743 2023-10-09T11:41:23.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T11:41:23.424 INFO:teuthology.orchestra.run.smithi086.stdout:68719476743 2023-10-09T11:41:23.425 INFO:teuthology.orchestra.run.smithi086.stdout:68719476744 2023-10-09T11:41:23.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T11:41:23.426 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T11:41:23.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.779+0000 7f42bffff700 1 Processor -- start 2023-10-09T11:41:23.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.779+0000 7f42bffff700 1 -- start start 2023-10-09T11:41:23.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.782+0000 7f42bffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b80de030 0x7f42b80de400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.782+0000 7f42bffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42b8053330 0x7f42b8053780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.782+0000 7f42bffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42b804ffb0 0x7f42b8050430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.782+0000 7f42be7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42b8053330 0x7f42b8053780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.783+0000 7f42be7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42b8053330 0x7f42b8053780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39634/0 (socket says 172.21.15.86:39634) 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.783+0000 7f42be7fc700 1 -- 172.21.15.86:0/534948245 learned_addr learned my addr 172.21.15.86:0/534948245 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.783+0000 7f42bf7fe700 1 --2- 172.21.15.86:0/534948245 >> v2:172.21.15.135:3300/0 conn(0x7f42b804ffb0 0x7f42b8050430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.783+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b8050970 con 0x7f42b8053330 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.783+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b8054690 con 0x7f42b804ffb0 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.783+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80061f0 con 0x7f42b80de030 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.783+0000 7f42beffd700 1 --2- 172.21.15.86:0/534948245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b80de030 0x7f42b80de400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.784+0000 7f42be7fc700 1 -- 172.21.15.86:0/534948245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b80de030 msgr2=0x7f42b80de400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.784+0000 7f42be7fc700 1 --2- 172.21.15.86:0/534948245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b80de030 0x7f42b80de400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.784+0000 7f42be7fc700 1 -- 172.21.15.86:0/534948245 >> v2:172.21.15.135:3300/0 conn(0x7f42b804ffb0 msgr2=0x7f42b8050430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.784+0000 7f42be7fc700 1 --2- 172.21.15.86:0/534948245 >> v2:172.21.15.135:3300/0 conn(0x7f42b804ffb0 0x7f42b8050430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.784+0000 7f42be7fc700 1 -- 172.21.15.86:0/534948245 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8053df0 con 0x7f42b8053330 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.784+0000 7f42beffd700 1 --2- 172.21.15.86:0/534948245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b80de030 0x7f42b80de400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:23.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.785+0000 7f42be7fc700 1 --2- 172.21.15.86:0/534948245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b8053330 0x7f42b8053780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099b0 tx=0x7f42b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8102e74fc7616d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.785+0000 7f42bdffb700 1 -- 172.21.15.86:0/534948245 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4009ea0 con 0x7f42b8053330 2023-10-09T11:41:23.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.786+0000 7f42bdffb700 1 -- 172.21.15.86:0/534948245 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400b820 con 0x7f42b8053330 2023-10-09T11:41:23.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.786+0000 7f42bdffb700 1 -- 172.21.15.86:0/534948245 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400bbe0 con 0x7f42b8053330 2023-10-09T11:41:23.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.787+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b8053330 msgr2=0x7f42b8053780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.787+0000 7f42bffff700 1 --2- 172.21.15.86:0/534948245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b8053330 0x7f42b8053780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099b0 tx=0x7f42b4009250 comp rx=0 tx=0).stop 2023-10-09T11:41:23.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.786+0000 7efd0759e700 1 Processor -- start 2023-10-09T11:41:23.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.786+0000 7efd0759e700 1 -- start start 2023-10-09T11:41:23.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 shutdown_connections 2023-10-09T11:41:23.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7f42bffff700 1 --2- 172.21.15.86:0/534948245 >> v2:172.21.15.135:3300/0 conn(0x7f42b804ffb0 0x7f42b8050430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7f42bffff700 1 --2- 172.21.15.86:0/534948245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b80de030 0x7f42b80de400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7f42bffff700 1 --2- 172.21.15.86:0/534948245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b8053330 0x7f42b8053780 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 >> 172.21.15.86:0/534948245 conn(0x7f42b8054da0 msgr2=0x7f42b80551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 shutdown_connections 2023-10-09T11:41:23.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7f42bffff700 1 -- 172.21.15.86:0/534948245 wait complete. 2023-10-09T11:41:23.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7efd0759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efd0815de70 0x7efd0806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7efd0759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd0806ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7efd0759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0806e8c0 con 0x7efd0815daa0 2023-10-09T11:41:23.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7efd0759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd080ca740 con 0x7efd0815de70 2023-10-09T11:41:23.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.788+0000 7efd0759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0806e5e0 con 0x7efd080696c0 2023-10-09T11:41:23.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.789+0000 7efd0659c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7efd0815daa0 0x7efd080c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37306/0 (socket says 172.21.15.86:37306) 2023-10-09T11:41:23.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.789+0000 7efd0659c700 1 -- 172.21.15.86:0/549547786 learned_addr learned my addr 172.21.15.86:0/549547786 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.790+0000 7efd05d9b700 1 --2- 172.21.15.86:0/549547786 >> v2:172.21.15.135:3300/0 conn(0x7efd0815de70 0x7efd0806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.791+0000 7f42bffff700 1 Processor -- start 2023-10-09T11:41:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.791+0000 7efd0559a700 1 -- 172.21.15.86:0/549547786 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201788525 0 0) 0x7efd0806e8c0 con 0x7efd0815daa0 2023-10-09T11:41:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.791+0000 7f42bffff700 1 -- start start 2023-10-09T11:41:23.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.791+0000 7efd0559a700 1 -- 172.21.15.86:0/549547786 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf4003570 con 0x7efd0815daa0 2023-10-09T11:41:23.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7f42bffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b804ffb0 0x7f42b80e3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7f42bffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b8053330 0x7f42b80d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7f42bffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42b80de030 0x7f42b80d92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42bffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b8037be0 con 0x7f42b804ffb0 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42bffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b8037ec0 con 0x7f42b80de030 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42bffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80381a0 con 0x7f42b8053330 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7efd0559a700 1 -- 172.21.15.86:0/549547786 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4226802870 0 0) 0x7efcf4003570 con 0x7efd0815daa0 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7efd05d9b700 1 -- 172.21.15.86:0/549547786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 msgr2=0x7efd0806ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:41:23.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7efd05d9b700 1 --2- 172.21.15.86:0/549547786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd0806ecd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7efd05d9b700 1 -- 172.21.15.86:0/549547786 >> v1:172.21.15.86:6789/0 conn(0x7efd0815daa0 legacy=0x7efd080c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7efd05d9b700 1 -- 172.21.15.86:0/549547786 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd080ca0f0 con 0x7efd0815de70 2023-10-09T11:41:23.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7efd05d9b700 1 --2- 172.21.15.86:0/549547786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 0x7efd0806e000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efcf80098e0 tx=0x7efcf80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36367ad40c9ab830 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7ff3427ff700 1 Processor -- start 2023-10-09T11:41:23.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42beffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b804ffb0 0x7f42b80e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42be7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b8053330 0x7f42b80d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42beffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b804ffb0 0x7f42b80e3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39650/0 (socket says 172.21.15.86:39650) 2023-10-09T11:41:23.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42beffd700 1 -- 172.21.15.86:0/950085562 learned_addr learned my addr 172.21.15.86:0/950085562 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7f42bf7fe700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42b80de030 0x7f42b80d92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7efd0559a700 1 -- 172.21.15.86:0/549547786 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0001470 con 0x7efd0815de70 2023-10-09T11:41:23.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.793+0000 7efd0559a700 1 -- 172.21.15.86:0/549547786 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf8011420 con 0x7efd0815de70 2023-10-09T11:41:23.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7f42beffd700 1 -- 172.21.15.86:0/950085562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b8053330 msgr2=0x7f42b80d8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7f42beffd700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b8053330 0x7f42b80d8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7f42beffd700 1 -- 172.21.15.86:0/950085562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42b80de030 msgr2=0x7f42b80d92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7f42beffd700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42b80de030 0x7f42b80d92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7f42beffd700 1 -- 172.21.15.86:0/950085562 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40094f0 con 0x7f42b804ffb0 2023-10-09T11:41:23.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7f42beffd700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b804ffb0 0x7f42b80e3410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42b000cc50 tx=0x7f42b00080e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7efd0759e700 1 -- 172.21.15.86:0/549547786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 msgr2=0x7efd0806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7efd0759e700 1 --2- 172.21.15.86:0/549547786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 0x7efd0806e000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efcf80098e0 tx=0x7efcf80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7f9f617ff700 1 Processor -- start 2023-10-09T11:41:23.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7f42a6ffd700 1 -- 172.21.15.86:0/950085562 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000abb0 con 0x7f42b804ffb0 2023-10-09T11:41:23.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7f42a6ffd700 1 -- 172.21.15.86:0/950085562 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b0011070 con 0x7f42b804ffb0 2023-10-09T11:41:23.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7f42a6ffd700 1 -- 172.21.15.86:0/950085562 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000d440 con 0x7f42b804ffb0 2023-10-09T11:41:23.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7efd0759e700 1 -- 172.21.15.86:0/549547786 shutdown_connections 2023-10-09T11:41:23.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7efd0759e700 1 --2- 172.21.15.86:0/549547786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd0806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.792+0000 7ff3427ff700 1 -- start start 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7ff3427ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff33c0cba20 0x7ff33c0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7ff3427ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c068aa0 0x7ff33c068ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7ff3427ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff33c156050 0x7ff33c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7ff3427ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0aceb0 con 0x7ff33c156050 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7ff3427ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0b2490 con 0x7ff33c0cba20 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.794+0000 7ff3427ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0ac4e0 con 0x7ff33c068aa0 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff33c0cba20 0x7ff33c0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff33c0cba20 0x7ff33c0ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57046/0 (socket says 172.21.15.86:57046) 2023-10-09T11:41:23.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 -- 172.21.15.86:0/3905401299 learned_addr learned my addr 172.21.15.86:0/3905401299 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7efd0759e700 1 --2- 172.21.15.86:0/549547786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 0x7efd0806e000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7f42bffff700 1 -- 172.21.15.86:0/950085562 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b8038480 con 0x7f42b804ffb0 2023-10-09T11:41:23.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7efd0759e700 1 -- 172.21.15.86:0/549547786 >> 172.21.15.86:0/549547786 conn(0x7efd080cc1f0 msgr2=0x7efd080cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33b7fe700 1 --2- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c068aa0 0x7ff33c068ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 -- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c068aa0 msgr2=0x7ff33c068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 --2- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c068aa0 0x7ff33c068ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 -- 172.21.15.86:0/3905401299 >> v2:172.21.15.86:3300/0 conn(0x7ff33c156050 msgr2=0x7ff33c1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff340d9c700 1 --2- 172.21.15.86:0/3905401299 >> v2:172.21.15.86:3300/0 conn(0x7ff33c156050 0x7ff33c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff49df9d700 1 Processor -- start 2023-10-09T11:41:23.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.796+0000 7ff49df9d700 1 -- start start 2023-10-09T11:41:23.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 --2- 172.21.15.86:0/3905401299 >> v2:172.21.15.86:3300/0 conn(0x7ff33c156050 0x7ff33c1564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7f42bffff700 1 -- 172.21.15.86:0/950085562 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b804eca0 con 0x7f42b804ffb0 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.795+0000 7ff33bfff700 1 -- 172.21.15.86:0/3905401299 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c069430 con 0x7ff33c0cba20 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.796+0000 7ff33bfff700 1 --2- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c0cba20 0x7ff33c0ac970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06d420 tx=0x7ff32c0082d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a40b41fd3173bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.796+0000 7ff33b7fe700 1 --2- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c068aa0 0x7ff33c068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.796+0000 7ff33affd700 1 -- 172.21.15.86:0/3905401299 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c010070 con 0x7ff33c0cba20 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.796+0000 7ff33affd700 1 -- 172.21.15.86:0/3905401299 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00db00 con 0x7ff33c0cba20 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.796+0000 7ff33affd700 1 -- 172.21.15.86:0/3905401299 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00dea0 con 0x7ff33c0cba20 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.797+0000 7ff3427ff700 1 -- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c0cba20 msgr2=0x7ff33c0ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.797+0000 7ff3427ff700 1 --2- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c0cba20 0x7ff33c0ac970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06d420 tx=0x7ff32c0082d0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7ff3427ff700 1 -- 172.21.15.86:0/3905401299 shutdown_connections 2023-10-09T11:41:23.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7efd0759e700 1 -- 172.21.15.86:0/549547786 shutdown_connections 2023-10-09T11:41:23.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7ff3427ff700 1 --2- 172.21.15.86:0/3905401299 >> v2:172.21.15.86:3300/0 conn(0x7ff33c156050 0x7ff33c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7ff3427ff700 1 --2- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c0cba20 0x7ff33c0ac970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7ff49df9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff4980c77e0 0x7ff4981607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7ff3427ff700 1 --2- 172.21.15.86:0/3905401299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c068aa0 0x7ff33c068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7ff3427ff700 1 -- 172.21.15.86:0/3905401299 >> 172.21.15.86:0/3905401299 conn(0x7ff33c0cd000 msgr2=0x7ff33c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7ff49cf9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff498155720 0x7ff49806f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37320/0 (socket says 172.21.15.86:37320) 2023-10-09T11:41:23.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7ff49cf9b700 1 -- 172.21.15.86:0/1145390441 learned_addr learned my addr 172.21.15.86:0/1145390441 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7ff3427ff700 1 -- 172.21.15.86:0/3905401299 shutdown_connections 2023-10-09T11:41:23.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7efd0759e700 1 -- 172.21.15.86:0/549547786 wait complete. 2023-10-09T11:41:23.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7ff3427ff700 1 -- 172.21.15.86:0/3905401299 wait complete. 2023-10-09T11:41:23.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49806dd20 con 0x7ff498155720 2023-10-09T11:41:23.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7f42bffff700 1 -- 172.21.15.86:0/950085562 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b8038920 con 0x7f42b804ffb0 2023-10-09T11:41:23.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7ff49d79c700 1 --2- 172.21.15.86:0/1145390441 >> v2:172.21.15.135:3300/0 conn(0x7ff4980c77e0 0x7ff4981607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.799+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49806e000 con 0x7ff498156af0 2023-10-09T11:41:23.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.800+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49806e2e0 con 0x7ff4980c77e0 2023-10-09T11:41:23.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.800+0000 7f42a6ffd700 1 -- 172.21.15.86:0/950085562 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42b000d830 con 0x7f42b804ffb0 2023-10-09T11:41:23.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.796+0000 7f9f617ff700 1 -- start start 2023-10-09T11:41:23.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7f9f617ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f5c159890 0x7f9f5c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7f9f617ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c159c60 0x7f9f5c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7f9f617ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c15a160 con 0x7f9f5c15db10 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7f9f617ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0d13a0 con 0x7f9f5c159890 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.798+0000 7f9f617ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c15e140 con 0x7f9f5c159c60 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.800+0000 7f9f5b7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9f5c15db10 0x7f9f5c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55662/0 (socket says 172.21.15.86:55662) 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.800+0000 7f9f5b7fe700 1 -- 172.21.15.86:0/5841944 learned_addr learned my addr 172.21.15.86:0/5841944 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.800+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221185180 0 0) 0x7f9f5c15a160 con 0x7f9f5c15db10 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.800+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f44003570 con 0x7f9f5c15db10 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148153981 0 0) 0x7f9f44003570 con 0x7f9f5c15db10 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c159c60 msgr2=0x7f9f5c15d5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c159c60 0x7f9f5c15d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 >> v2:172.21.15.86:3300/0 conn(0x7f9f5c159890 msgr2=0x7f9f5c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 --2- 172.21.15.86:0/5841944 >> v2:172.21.15.86:3300/0 conn(0x7f9f5c159890 0x7f9f5c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c15a3d0 con 0x7f9f5c15db10 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f9f4c0017f0 con 0x7f9f5c15db10 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 >> v1:172.21.15.135:6789/0 conn(0x7f9f5c15db10 legacy=0x7f9f5c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f44003ae0 0x7f9f44003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f44004810 0x7f9f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f440053c0 0x7f9f4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0d13a0 con 0x7f9f44004810 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c15e140 con 0x7f9f44003ae0 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.801+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4402e2a0 con 0x7f9f440053c0 2023-10-09T11:41:23.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7f9f5b7fe700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f440053c0 0x7f9f4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7f9f5affd700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f44003ae0 0x7f9f44003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7f9f5b7fe700 1 -- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f44003ae0 msgr2=0x7f9f44003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7f9f5b7fe700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f44003ae0 0x7f9f44003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7f9f5b7fe700 1 -- 172.21.15.86:0/5841944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f44004810 msgr2=0x7f9f44004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:41:23.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7f42a6ffd700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f42ac067080 0x7f42ac069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7f42a6ffd700 1 -- 172.21.15.86:0/950085562 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42b00844c0 con 0x7f42b804ffb0 2023-10-09T11:41:23.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7efd0759e700 1 Processor -- start 2023-10-09T11:41:23.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7ff3427ff700 1 Processor -- start 2023-10-09T11:41:23.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.802+0000 7ff3427ff700 1 -- start start 2023-10-09T11:41:23.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7f9f5b7fe700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f44004810 0x7f9f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7f9f5b7fe700 1 -- 172.21.15.86:0/5841944 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c15a3d0 con 0x7f9f440053c0 2023-10-09T11:41:23.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7efd0759e700 1 -- start start 2023-10-09T11:41:23.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7f9f5b7fe700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f440053c0 0x7f9f4400ba60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00aa30 tx=0x7f9f4c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70eec82ed577a6ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7f42be7fc700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f42ac067080 0x7f42ac069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7ff49d79c700 1 -- 172.21.15.86:0/1145390441 >> v1:172.21.15.135:6789/0 conn(0x7ff498156af0 legacy=0x7ff4980c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7ff49d79c700 1 -- 172.21.15.86:0/1145390441 >> v1:172.21.15.86:6789/0 conn(0x7ff498155720 legacy=0x7ff49806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.803+0000 7ff49d79c700 1 -- 172.21.15.86:0/1145390441 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49806e5c0 con 0x7ff4980c77e0 2023-10-09T11:41:23.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff49d79c700 1 --2- 172.21.15.86:0/1145390441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff4981607e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff488009860 tx=0x7ff4880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a275cb2b3d2ce69 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00ae70 con 0x7f9f440053c0 2023-10-09T11:41:23.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00c550 con 0x7f9f440053c0 2023-10-09T11:41:23.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7f9f59ffb700 1 -- 172.21.15.86:0/5841944 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00c8f0 con 0x7f9f440053c0 2023-10-09T11:41:23.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7f42be7fc700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f42ac067080 0x7f42ac069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099b0 tx=0x7f42b4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff3427ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff33c068aa0 0x7ff33c152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff3427ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c0cba20 0x7ff33c169fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff3427ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c156050 0x7ff33c16d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff3427ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c16e3e0 con 0x7ff33c068aa0 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff3427ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c15e940 con 0x7ff33c156050 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff3427ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c15dd30 con 0x7ff33c0cba20 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff33bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff33c068aa0 0x7ff33c152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff33bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff33c068aa0 0x7ff33c152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39704/0 (socket says 172.21.15.86:39704) 2023-10-09T11:41:23.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff4977fe700 1 -- 172.21.15.86:0/1145390441 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488011630 con 0x7ff4980c77e0 2023-10-09T11:41:23.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.804+0000 7ff33bfff700 1 -- 172.21.15.86:0/1116987332 learned_addr learned my addr 172.21.15.86:0/1116987332 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff4977fe700 1 -- 172.21.15.86:0/1145390441 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488011790 con 0x7ff4980c77e0 2023-10-09T11:41:23.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff4977fe700 1 -- 172.21.15.86:0/1145390441 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488011b50 con 0x7ff4980c77e0 2023-10-09T11:41:23.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff340d9c700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c156050 0x7ff33c16d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7f9f617ff700 1 -- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f440053c0 msgr2=0x7f9f4400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7f9f617ff700 1 --2- 172.21.15.86:0/5841944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f440053c0 0x7f9f4400ba60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00aa30 tx=0x7f9f4c00a060 comp rx=0 tx=0).stop 2023-10-09T11:41:23.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7f9f5b7fe700 1 -- 172.21.15.86:0/5841944 reap_dead start 2023-10-09T11:41:23.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff33bfff700 1 -- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c0cba20 msgr2=0x7ff33c169fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7f9f617ff700 1 -- 172.21.15.86:0/5841944 shutdown_connections 2023-10-09T11:41:23.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7f9f617ff700 1 -- 172.21.15.86:0/5841944 >> 172.21.15.86:0/5841944 conn(0x7f9f5c068e20 msgr2=0x7f9f5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff33bfff700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c0cba20 0x7ff33c169fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff33bfff700 1 -- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c156050 msgr2=0x7ff33c16d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff33bfff700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c156050 0x7ff33c16d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7f1ada99d700 1 Processor -- start 2023-10-09T11:41:23.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.805+0000 7ff33bfff700 1 -- 172.21.15.86:0/1116987332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c008570 con 0x7ff33c068aa0 2023-10-09T11:41:23.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 msgr2=0x7ff4981607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7ff340d9c700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c156050 0x7ff33c16d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:23.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7f1ada99d700 1 -- start start 2023-10-09T11:41:23.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7ff49df9d700 1 --2- 172.21.15.86:0/1145390441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff4981607e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff488009860 tx=0x7ff4880091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7f9f617ff700 1 -- 172.21.15.86:0/5841944 shutdown_connections 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd0759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd08158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd0759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd0815daa0 0x7efd0815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd0759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 0x7efd0815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd0759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080b0160 con 0x7efd0815daa0 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd0759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080af550 con 0x7efd0815de70 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd0759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd080af830 con 0x7efd080696c0 2023-10-09T11:41:23.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd05d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd0815daa0 0x7efd0815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7ff33bfff700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff33c068aa0 0x7ff33c152d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff32c008310 tx=0x7ff32c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 shutdown_connections 2023-10-09T11:41:23.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7ff49df9d700 1 --2- 172.21.15.86:0/1145390441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff4981607e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 >> 172.21.15.86:0/1145390441 conn(0x7ff4980cc1f0 msgr2=0x7ff4980cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7efd05d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd0815daa0 0x7efd0815aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39710/0 (socket says 172.21.15.86:39710) 2023-10-09T11:41:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.807+0000 7efd05d9b700 1 -- 172.21.15.86:0/839422428 learned_addr learned my addr 172.21.15.86:0/839422428 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.806+0000 7f9f617ff700 1 -- 172.21.15.86:0/5841944 wait complete. 2023-10-09T11:41:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.807+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 shutdown_connections 2023-10-09T11:41:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.807+0000 7ff49df9d700 1 -- 172.21.15.86:0/1145390441 wait complete. 2023-10-09T11:41:23.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.807+0000 7efd0659c700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd08158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.807+0000 7efd06d9d700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 0x7efd0815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7f9f617ff700 1 Processor -- start 2023-10-09T11:41:23.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7f42a6ffd700 1 -- 172.21.15.86:0/950085562 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42b004f5a0 con 0x7f42b804ffb0 2023-10-09T11:41:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7efd0659c700 1 -- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 msgr2=0x7efd0815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7efd0659c700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 0x7efd0815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7efd0659c700 1 -- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd0815daa0 msgr2=0x7efd0815aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7efd0659c700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd0815daa0 0x7efd0815aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7efd0659c700 1 -- 172.21.15.86:0/839422428 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8009420 con 0x7efd080696c0 2023-10-09T11:41:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7efd05d9b700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd0815daa0 0x7efd0815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7efd0659c700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd08158100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcf000c7f0 tx=0x7efcf00019d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7ff323fff700 1 -- 172.21.15.86:0/1116987332 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00b2c0 con 0x7ff33c068aa0 2023-10-09T11:41:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7ff323fff700 1 -- 172.21.15.86:0/1116987332 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00b420 con 0x7ff33c068aa0 2023-10-09T11:41:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7ff3427ff700 1 -- 172.21.15.86:0/1116987332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c15e010 con 0x7ff33c068aa0 2023-10-09T11:41:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7f1ada99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415de50 0x7f1ad406e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7f1ada99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40ca410 con 0x7f1ad40696c0 2023-10-09T11:41:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7f1ada99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40c7220 con 0x7f1ad415da80 2023-10-09T11:41:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.808+0000 7f1ada99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c7500 con 0x7f1ad415de50 2023-10-09T11:41:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7efcfe7fc700 1 -- 172.21.15.86:0/839422428 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0007360 con 0x7efd080696c0 2023-10-09T11:41:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f9f617ff700 1 -- start start 2023-10-09T11:41:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7efcfe7fc700 1 -- 172.21.15.86:0/839422428 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00074c0 con 0x7efd080696c0 2023-10-09T11:41:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7efcfe7fc700 1 -- 172.21.15.86:0/839422428 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0004830 con 0x7efd080696c0 2023-10-09T11:41:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f1ad999b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1ad415da80 0x7f1ad40c6a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55686/0 (socket says 172.21.15.86:55686) 2023-10-09T11:41:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f1ad999b700 1 -- 172.21.15.86:0/1889375401 learned_addr learned my addr 172.21.15.86:0/1889375401 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f1ad919a700 1 --2- 172.21.15.86:0/1889375401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415de50 0x7f1ad406e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f1ad919a700 1 -- 172.21.15.86:0/1889375401 >> v1:172.21.15.135:6789/0 conn(0x7f1ad415da80 legacy=0x7f1ad40c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f1ad919a700 1 -- 172.21.15.86:0/1889375401 >> v1:172.21.15.86:6789/0 conn(0x7f1ad40696c0 legacy=0x7f1ad406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f1ad919a700 1 -- 172.21.15.86:0/1889375401 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40c9dc0 con 0x7f1ad415de50 2023-10-09T11:41:23.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7ff323fff700 1 -- 172.21.15.86:0/1116987332 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00b7e0 con 0x7ff33c068aa0 2023-10-09T11:41:23.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.809+0000 7f3c8359e700 1 Processor -- start 2023-10-09T11:41:23.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.810+0000 7ff3427ff700 1 -- 172.21.15.86:0/1116987332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c15e5d0 con 0x7ff33c068aa0 2023-10-09T11:41:23.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.810+0000 7ff49df9d700 1 Processor -- start 2023-10-09T11:41:23.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.810+0000 7f1ad919a700 1 --2- 172.21.15.86:0/1889375401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415de50 0x7f1ad406e470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009910 tx=0x7f1ac40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c310ee820cf4d028 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.810+0000 7ff49df9d700 1 -- start start 2023-10-09T11:41:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.810+0000 7f1ad8999700 1 -- 172.21.15.86:0/1889375401 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400b820 con 0x7f1ad415de50 2023-10-09T11:41:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.811+0000 7f1ad8999700 1 -- 172.21.15.86:0/1889375401 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac400b980 con 0x7f1ad415de50 2023-10-09T11:41:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.811+0000 7f1ad8999700 1 -- 172.21.15.86:0/1889375401 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400bd20 con 0x7f1ad415de50 2023-10-09T11:41:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.811+0000 7efd0759e700 1 -- 172.21.15.86:0/839422428 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd080afb10 con 0x7efd080696c0 2023-10-09T11:41:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.811+0000 7f1ada99d700 1 -- 172.21.15.86:0/1889375401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415de50 msgr2=0x7f1ad406e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.811+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1889375401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415de50 0x7f1ad406e470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009910 tx=0x7f1ac40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7efd0759e700 1 -- 172.21.15.86:0/839422428 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd080c6480 con 0x7efd080696c0 2023-10-09T11:41:23.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f9f617ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f440053c0 0x7f9f5c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7ff49df9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff498145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f9f617ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c0c9c80 0x7f9f5c158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7ff49df9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff498155720 0x7ff4980a8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f9f617ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f5c14fa40 0x7f9f5c14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f9f617ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0cb960 con 0x7f9f5c14fa40 2023-10-09T11:41:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f9f617ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0ca0f0 con 0x7f9f440053c0 2023-10-09T11:41:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff49df9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff498156af0 0x7ff4980a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f9f617ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0ca330 con 0x7f9f5c0c9c80 2023-10-09T11:41:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f9f5affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f440053c0 0x7f9f5c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f9f5affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f440053c0 0x7f9f5c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57088/0 (socket says 172.21.15.86:57088) 2023-10-09T11:41:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f9f5affd700 1 -- 172.21.15.86:0/3102541374 learned_addr learned my addr 172.21.15.86:0/3102541374 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff49df9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498167440 con 0x7ff498155720 2023-10-09T11:41:23.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff49df9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980c54a0 con 0x7ff4980c77e0 2023-10-09T11:41:23.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.810+0000 7f3c8359e700 1 -- start start 2023-10-09T11:41:23.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f3c8359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c7c039160 0x7f3c7c03b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f3c8359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7c006d30 con 0x7f3c7c039530 2023-10-09T11:41:23.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f3c8359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7c007b90 con 0x7f3c7c0e27a0 2023-10-09T11:41:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f3c8359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7c006f80 con 0x7f3c7c039160 2023-10-09T11:41:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.812+0000 7f3c81d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3c7c039530 0x7f3c7c0e2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37344/0 (socket says 172.21.15.86:37344) 2023-10-09T11:41:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f3c81d9b700 1 -- 172.21.15.86:0/598757062 learned_addr learned my addr 172.21.15.86:0/598757062 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff49df9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980c5780 con 0x7ff498156af0 2023-10-09T11:41:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff49cf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff498145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f1ada99d700 1 -- 172.21.15.86:0/1889375401 shutdown_connections 2023-10-09T11:41:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1889375401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415de50 0x7f1ad406e470 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f1ada99d700 1 -- 172.21.15.86:0/1889375401 >> 172.21.15.86:0/1889375401 conn(0x7f1ad40cc1f0 msgr2=0x7f1ad40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff49cf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff498145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57098/0 (socket says 172.21.15.86:57098) 2023-10-09T11:41:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f3c8259c700 1 --2- 172.21.15.86:0/598757062 >> v2:172.21.15.86:3300/0 conn(0x7f3c7c039160 0x7f3c7c03b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff49cf9b700 1 -- 172.21.15.86:0/929623307 learned_addr learned my addr 172.21.15.86:0/929623307 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff497fff700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff498155720 0x7ff4980a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7f9f5a7fc700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c0c9c80 0x7f9f5c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7f9f5affd700 1 -- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c0c9c80 msgr2=0x7f9f5c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7f9f5affd700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c0c9c80 0x7f9f5c158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7f9f5affd700 1 -- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f5c14fa40 msgr2=0x7f9f5c14feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7f9f5affd700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f5c14fa40 0x7f9f5c14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7f9f5affd700 1 -- 172.21.15.86:0/3102541374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0ca610 con 0x7f9f440053c0 2023-10-09T11:41:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7ff49cf9b700 1 -- 172.21.15.86:0/929623307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff498156af0 msgr2=0x7ff4980a8da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:41:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7ff49cf9b700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff498156af0 0x7ff4980a8da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7ff49cf9b700 1 -- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff498155720 msgr2=0x7ff4980a8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7ff49cf9b700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff498155720 0x7ff4980a8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7ff49cf9b700 1 -- 172.21.15.86:0/929623307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009420 con 0x7ff4980c77e0 2023-10-09T11:41:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.814+0000 7ff49cf9b700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff498145b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00eaa0 tx=0x7ff48c007f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7ff494ff9700 1 -- 172.21.15.86:0/929623307 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c005b30 con 0x7ff4980c77e0 2023-10-09T11:41:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7efd0759e700 1 -- 172.21.15.86:0/839422428 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0804c3c0 con 0x7efd080696c0 2023-10-09T11:41:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7f3c8259c700 1 -- 172.21.15.86:0/598757062 >> v1:172.21.15.135:6789/0 conn(0x7f3c7c0e27a0 legacy=0x7f3c7c03c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7f3c8259c700 1 -- 172.21.15.86:0/598757062 >> v1:172.21.15.86:6789/0 conn(0x7f3c7c039530 legacy=0x7f3c7c0e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff323fff700 1 -- 172.21.15.86:0/1116987332 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff32c021480 con 0x7ff33c068aa0 2023-10-09T11:41:23.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.813+0000 7ff3427ff700 1 -- 172.21.15.86:0/1116987332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c04c3c0 con 0x7ff33c068aa0 2023-10-09T11:41:23.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7efcfe7fc700 1 -- 172.21.15.86:0/839422428 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcf0004c60 con 0x7efd080696c0 2023-10-09T11:41:23.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7ff323fff700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff328067000 0x7ff3280694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7ff323fff700 1 -- 172.21.15.86:0/1116987332 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff32c0868b0 con 0x7ff33c068aa0 2023-10-09T11:41:23.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7f3c8259c700 1 -- 172.21.15.86:0/598757062 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c007260 con 0x7f3c7c039160 2023-10-09T11:41:23.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7fc92e59d700 1 Processor -- start 2023-10-09T11:41:23.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7f9f5affd700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f440053c0 0x7f9f5c0c8260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400d800 tx=0x7f9f54008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7f3c8259c700 1 --2- 172.21.15.86:0/598757062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039160 0x7f3c7c03b350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098e0 tx=0x7f3c740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e7e08728edbb28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.816+0000 7ff494ff9700 1 -- 172.21.15.86:0/929623307 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c005c90 con 0x7ff4980c77e0 2023-10-09T11:41:23.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.816+0000 7f1ada99d700 1 -- 172.21.15.86:0/1889375401 shutdown_connections 2023-10-09T11:41:23.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.815+0000 7fc92e59d700 1 -- start start 2023-10-09T11:41:23.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.816+0000 7ff33b7fe700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff328067000 0x7ff3280694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.816+0000 7efcfe7fc700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efce8067050 0x7efce8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7ff494ff9700 1 -- 172.21.15.86:0/929623307 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c004a40 con 0x7ff4980c77e0 2023-10-09T11:41:23.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7efcfe7fc700 1 -- 172.21.15.86:0/839422428 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efcf0083ab0 con 0x7efd080696c0 2023-10-09T11:41:23.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7f9f42ffd700 1 -- 172.21.15.86:0/3102541374 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54011500 con 0x7f9f440053c0 2023-10-09T11:41:23.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7f9f42ffd700 1 -- 172.21.15.86:0/3102541374 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5400f040 con 0x7f9f440053c0 2023-10-09T11:41:23.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7ff33b7fe700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff328067000 0x7ff3280694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3340094d0 tx=0x7ff3340096b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7efd05d9b700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efce8067050 0x7efce8069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c0ca8f0 con 0x7f9f440053c0 2023-10-09T11:41:23.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0caeb0 con 0x7f9f440053c0 2023-10-09T11:41:23.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.818+0000 7f9f42ffd700 1 -- 172.21.15.86:0/3102541374 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540118d0 con 0x7f9f440053c0 2023-10-09T11:41:23.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.818+0000 7fc92e59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc9200574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7ff49df9d700 1 -- 172.21.15.86:0/929623307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4980c5a60 con 0x7ff4980c77e0 2023-10-09T11:41:23.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.817+0000 7ff49df9d700 1 -- 172.21.15.86:0/929623307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4981460c0 con 0x7ff4980c77e0 2023-10-09T11:41:23.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.818+0000 7fc92d59b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc920039560 0x7fc920056de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37352/0 (socket says 172.21.15.86:37352) 2023-10-09T11:41:23.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.818+0000 7efd05d9b700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efce8067050 0x7efce8069500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000e10 tx=0x7efcf8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.818+0000 7fc92d59b700 1 -- 172.21.15.86:0/2554652140 learned_addr learned my addr 172.21.15.86:0/2554652140 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:23.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.818+0000 7ff49df9d700 1 -- 172.21.15.86:0/929623307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49804c3c0 con 0x7ff4980c77e0 2023-10-09T11:41:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.819+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200e0580 con 0x7fc920039560 2023-10-09T11:41:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.819+0000 7fc92cd9a700 1 --2- 172.21.15.86:0/2554652140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc9200574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.819+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200548c0 con 0x7fc920057a30 2023-10-09T11:41:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.819+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92003ac70 con 0x7fc92004d880 2023-10-09T11:41:23.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.818+0000 7f1ada99d700 1 -- 172.21.15.86:0/1889375401 wait complete. 2023-10-09T11:41:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.819+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c0cb0d0 con 0x7f9f440053c0 2023-10-09T11:41:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.820+0000 7f1ada99d700 1 Processor -- start 2023-10-09T11:41:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.820+0000 7fc92cd9a700 1 -- 172.21.15.86:0/2554652140 >> v1:172.21.15.135:6789/0 conn(0x7fc920057a30 legacy=0x7fc9200e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.820+0000 7fc92cd9a700 1 -- 172.21.15.86:0/2554652140 >> v1:172.21.15.86:6789/0 conn(0x7fc920039560 legacy=0x7fc920056de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.820+0000 7fc92cd9a700 1 -- 172.21.15.86:0/2554652140 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920006fb0 con 0x7fc92004d880 2023-10-09T11:41:23.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.820+0000 7f1ada99d700 1 -- start start 2023-10-09T11:41:23.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.820+0000 7fc92cd9a700 1 --2- 172.21.15.86:0/2554652140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc9200574f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc918009910 tx=0x7fc9180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9a3fe5bf4a9e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ada99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ad40696c0 0x7f1ad40c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ada99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415da80 0x7f1ad41773f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ada99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad415de50 0x7f1ad415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ada99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c4c90 con 0x7f1ad415de50 2023-10-09T11:41:23.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ada99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c43a0 con 0x7f1ad40696c0 2023-10-09T11:41:23.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ada99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c4640 con 0x7f1ad415da80 2023-10-09T11:41:23.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f9f42ffd700 1 -- 172.21.15.86:0/3102541374 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f54011c40 con 0x7f9f440053c0 2023-10-09T11:41:23.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ad919a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415da80 0x7f1ad41773f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7fc91ffff700 1 -- 172.21.15.86:0/2554652140 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800b860 con 0x7fc92004d880 2023-10-09T11:41:23.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.821+0000 7f1ada19c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad415de50 0x7f1ad415fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ada19c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad415de50 0x7f1ad415fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39732/0 (socket says 172.21.15.86:39732) 2023-10-09T11:41:23.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7fc91ffff700 1 -- 172.21.15.86:0/2554652140 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800b9c0 con 0x7fc92004d880 2023-10-09T11:41:23.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ada19c700 1 -- 172.21.15.86:0/1790509294 learned_addr learned my addr 172.21.15.86:0/1790509294 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7fc91ffff700 1 -- 172.21.15.86:0/2554652140 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800bd60 con 0x7fc92004d880 2023-10-09T11:41:23.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ad999b700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ad40696c0 0x7f1ad40c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ad999b700 1 -- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415da80 msgr2=0x7f1ad41773f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ad999b700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415da80 0x7f1ad41773f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ad999b700 1 -- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad415de50 msgr2=0x7f1ad415fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ad999b700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad415de50 0x7f1ad415fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ad999b700 1 -- 172.21.15.86:0/1790509294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009420 con 0x7f1ad40696c0 2023-10-09T11:41:23.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7f9f42ffd700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9f48067030 0x7f9f480694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.822+0000 7f1ada19c700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad415de50 0x7f1ad415fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:23.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7f9f42ffd700 1 -- 172.21.15.86:0/3102541374 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f54084150 con 0x7f9f440053c0 2023-10-09T11:41:23.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 msgr2=0x7fc9200574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7f1ad999b700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ad40696c0 0x7f1ad40c5120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c560 tx=0x7f1ad0007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7efcfe7fc700 1 -- 172.21.15.86:0/839422428 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcf004c5a0 con 0x7efd080696c0 2023-10-09T11:41:23.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7fc92e59d700 1 --2- 172.21.15.86:0/2554652140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc9200574f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc918009910 tx=0x7fc9180091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7f3c8159a700 1 -- 172.21.15.86:0/598757062 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74009e80 con 0x7f3c7c039160 2023-10-09T11:41:23.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7f3c8159a700 1 -- 172.21.15.86:0/598757062 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400b760 con 0x7f3c7c039160 2023-10-09T11:41:23.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 shutdown_connections 2023-10-09T11:41:23.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7fc92e59d700 1 --2- 172.21.15.86:0/2554652140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc9200574f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 >> 172.21.15.86:0/2554652140 conn(0x7fc920039da0 msgr2=0x7fc92003a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 shutdown_connections 2023-10-09T11:41:23.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7f9f5a7fc700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9f48067030 0x7f9f480694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.823+0000 7fc92e59d700 1 -- 172.21.15.86:0/2554652140 wait complete. 2023-10-09T11:41:23.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7ff323fff700 1 -- 172.21.15.86:0/1116987332 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff32c053bb0 con 0x7ff33c068aa0 2023-10-09T11:41:23.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8159a700 1 -- 172.21.15.86:0/598757062 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400bb00 con 0x7f3c7c039160 2023-10-09T11:41:23.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8359e700 1 -- 172.21.15.86:0/598757062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039160 msgr2=0x7f3c7c03b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8359e700 1 --2- 172.21.15.86:0/598757062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039160 0x7f3c7c03b350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098e0 tx=0x7f3c740091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8359e700 1 -- 172.21.15.86:0/598757062 shutdown_connections 2023-10-09T11:41:23.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8359e700 1 --2- 172.21.15.86:0/598757062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039160 0x7f3c7c03b350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8359e700 1 -- 172.21.15.86:0/598757062 >> 172.21.15.86:0/598757062 conn(0x7f3c7c059c40 msgr2=0x7f3c7c055be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f9f5a7fc700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9f48067030 0x7f9f480694e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cf180 tx=0x7f9f50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8359e700 1 -- 172.21.15.86:0/598757062 shutdown_connections 2023-10-09T11:41:23.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.824+0000 7f3c8359e700 1 -- 172.21.15.86:0/598757062 wait complete. 2023-10-09T11:41:23.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.825+0000 7ff494ff9700 1 -- 172.21.15.86:0/929623307 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff48c001690 con 0x7ff4980c77e0 2023-10-09T11:41:23.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.825+0000 7fc92e59d700 1 Processor -- start 2023-10-09T11:41:23.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.826+0000 7f3c8359e700 1 Processor -- start 2023-10-09T11:41:23.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.826+0000 7f3c8359e700 1 -- start start 2023-10-09T11:41:23.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.827+0000 7ff494ff9700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff484067000 0x7ff4840694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.827+0000 7fc92e59d700 1 -- start start 2023-10-09T11:41:23.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.827+0000 7ff497fff700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff484067000 0x7ff4840694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.827+0000 7ff494ff9700 1 -- 172.21.15.86:0/929623307 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff48c086620 con 0x7ff4980c77e0 2023-10-09T11:41:23.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92e59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc920039560 0x7fc920023110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92e59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc920021560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7ff497fff700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff484067000 0x7ff4840694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4980a5d70 tx=0x7ff490009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92e59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc920057a30 0x7fc9200241a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92e59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920022c80 con 0x7fc920039560 2023-10-09T11:41:23.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92e59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920022070 con 0x7fc920057a30 2023-10-09T11:41:23.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92e59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc920022350 con 0x7fc92004d880 2023-10-09T11:41:23.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92cd9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc920021560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92cd9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc920021560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:42890/0 (socket says 172.21.15.86:42890) 2023-10-09T11:41:23.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92cd9a700 1 -- 172.21.15.86:0/3784846786 learned_addr learned my addr 172.21.15.86:0/3784846786 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7fc92dd9c700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc920057a30 0x7fc9200241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7ff494ff9700 1 -- 172.21.15.86:0/929623307 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff48c086a10 con 0x7ff4980c77e0 2023-10-09T11:41:23.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc92cd9a700 1 -- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc920057a30 msgr2=0x7fc9200241a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc92cd9a700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc920057a30 0x7fc9200241a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc92cd9a700 1 -- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc920039560 msgr2=0x7fc920023110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc92cd9a700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc920039560 0x7fc920023110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc92cd9a700 1 -- 172.21.15.86:0/3784846786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918009420 con 0x7fc92004d880 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc92cd9a700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc920021560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9180093f0 tx=0x7fc918017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc91d7fa700 1 -- 172.21.15.86:0/3784846786 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918024440 con 0x7fc92004d880 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc91d7fa700 1 -- 172.21.15.86:0/3784846786 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9180245c0 con 0x7fc92004d880 2023-10-09T11:41:23.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc920022630 con 0x7fc92004d880 2023-10-09T11:41:23.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c7c039160 0x7f3c7c0df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.830+0000 7fc91d7fa700 1 -- 172.21.15.86:0/3784846786 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918024980 con 0x7fc92004d880 2023-10-09T11:41:23.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.830+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92000cb30 con 0x7fc92004d880 2023-10-09T11:41:23.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039530 0x7f3c7c0f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c7c0e27a0 0x7f3c7c0e4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c050dc0 con 0x7f3c7c039530 2023-10-09T11:41:23.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c050220 con 0x7f3c7c039160 2023-10-09T11:41:23.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.831+0000 7f1ac9ffb700 1 -- 172.21.15.86:0/1790509294 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0005b30 con 0x7f1ad40696c0 2023-10-09T11:41:23.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.831+0000 7f1ac9ffb700 1 -- 172.21.15.86:0/1790509294 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad0005cb0 con 0x7f1ad40696c0 2023-10-09T11:41:23.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.831+0000 7f1ac9ffb700 1 -- 172.21.15.86:0/1790509294 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0007320 con 0x7f1ad40696c0 2023-10-09T11:41:23.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c050490 con 0x7f3c7c0e27a0 2023-10-09T11:41:23.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.831+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad40c4920 con 0x7f1ad40696c0 2023-10-09T11:41:23.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c7c039160 0x7f3c7c0df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c7c039160 0x7f3c7c0df3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57112/0 (socket says 172.21.15.86:57112) 2023-10-09T11:41:23.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.831+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad4177930 con 0x7f1ad40696c0 2023-10-09T11:41:23.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.828+0000 7f3c8259c700 1 -- 172.21.15.86:0/2658264450 learned_addr learned my addr 172.21.15.86:0/2658264450 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:23.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7f3c82d9d700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c7c0e27a0 0x7f3c7c0e4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7f3c8259c700 1 -- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c7c0e27a0 msgr2=0x7f3c7c0e4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7f3c8259c700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c7c0e27a0 0x7f3c7c0e4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7f3c8259c700 1 -- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039530 msgr2=0x7f3c7c0f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.829+0000 7f3c81d9b700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039530 0x7f3c7c0f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.830+0000 7f3c8259c700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039530 0x7f3c7c0f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.830+0000 7f3c8259c700 1 -- 172.21.15.86:0/2658264450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c74009420 con 0x7f3c7c039160 2023-10-09T11:41:23.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.830+0000 7f3c81d9b700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039530 0x7f3c7c0f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:23.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.830+0000 7f3c8259c700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c7c039160 0x7f3c7c0df3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400b3c0 tx=0x7f3c74016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.830+0000 7f9f42ffd700 1 -- 172.21.15.86:0/3102541374 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f540513a0 con 0x7f9f440053c0 2023-10-09T11:41:23.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.832+0000 7fc91d7fa700 1 -- 172.21.15.86:0/3784846786 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc91801a420 con 0x7fc92004d880 2023-10-09T11:41:23.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.832+0000 7f3c7a7fc700 1 -- 172.21.15.86:0/2658264450 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7402dbe0 con 0x7f3c7c039160 2023-10-09T11:41:23.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.832+0000 7f3c7a7fc700 1 -- 172.21.15.86:0/2658264450 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7402dd40 con 0x7f3c7c039160 2023-10-09T11:41:23.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.833+0000 7f3c7a7fc700 1 -- 172.21.15.86:0/2658264450 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7401a670 con 0x7f3c7c039160 2023-10-09T11:41:23.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.833+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7c050770 con 0x7f3c7c039160 2023-10-09T11:41:23.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.833+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7c0df900 con 0x7f3c7c039160 2023-10-09T11:41:23.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.833+0000 7fc91d7fa700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc90c067000 0x7fc90c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.833+0000 7fc91d7fa700 1 -- 172.21.15.86:0/3784846786 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9180863e0 con 0x7fc92004d880 2023-10-09T11:41:23.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.834+0000 7fc92d59b700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc90c067000 0x7fc90c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.835+0000 7f1ac9ffb700 1 -- 172.21.15.86:0/1790509294 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ad0012400 con 0x7f1ad40696c0 2023-10-09T11:41:23.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.836+0000 7f1ac9ffb700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1ab8067000 0x7f1ab80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.836+0000 7f1ac9ffb700 1 -- 172.21.15.86:0/1790509294 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ad0083750 con 0x7f1ad40696c0 2023-10-09T11:41:23.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.836+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920022f60 con 0x7fc92004d880 2023-10-09T11:41:23.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.836+0000 7f3c7a7fc700 1 -- 172.21.15.86:0/2658264450 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c7401a9e0 con 0x7f3c7c039160 2023-10-09T11:41:23.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.836+0000 7fc92d59b700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc90c067000 0x7fc90c0694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9240058d0 tx=0x7fc924007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.837+0000 7f1ad919a700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1ab8067000 0x7f1ab80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.837+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab40052b0 con 0x7f1ad40696c0 2023-10-09T11:41:23.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.837+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c680052b0 con 0x7f3c7c039160 2023-10-09T11:41:23.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.837+0000 7f3c7a7fc700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3c64067080 0x7f3c64069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.838+0000 7f3c7a7fc700 1 -- 172.21.15.86:0/2658264450 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c74097450 con 0x7f3c7c039160 2023-10-09T11:41:23.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.838+0000 7f3c81d9b700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3c64067080 0x7f3c64069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.839+0000 7f3c81d9b700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3c64067080 0x7f3c64069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0058d0 tx=0x7f3c6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.841+0000 7fc91d7fa700 1 -- 172.21.15.86:0/3784846786 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9180536b0 con 0x7fc92004d880 2023-10-09T11:41:23.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.841+0000 7f1ad919a700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1ab8067000 0x7f1ab80694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ad415e2a0 tx=0x7f1ac4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.844+0000 7f1ac9ffb700 1 -- 172.21.15.86:0/1790509294 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad004b5a0 con 0x7f1ad40696c0 2023-10-09T11:41:23.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:23.847+0000 7f3c7a7fc700 1 -- 172.21.15.86:0/2658264450 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c74064a70 con 0x7f3c7c039160 2023-10-09T11:41:24.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.243+0000 7f42bffff700 1 -- 172.21.15.86:0/950085562 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42b8038ad0 con 0x7f42b804ffb0 2023-10-09T11:41:24.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.244+0000 7f42a6ffd700 1 -- 172.21.15.86:0/950085562 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42b0051710 con 0x7f42b804ffb0 2023-10-09T11:41:24.245 INFO:teuthology.orchestra.run.smithi086.stdout:60129542151 2023-10-09T11:41:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.248+0000 7f42a4ff9700 1 -- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f42ac067080 msgr2=0x7f42ac069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.248+0000 7f42a4ff9700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f42ac067080 0x7f42ac069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099b0 tx=0x7f42b4018000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.249+0000 7f42a4ff9700 1 -- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b804ffb0 msgr2=0x7f42b80e3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.249+0000 7f42a4ff9700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b804ffb0 0x7f42b80e3410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42b000cc50 tx=0x7f42b00080e0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.249+0000 7f42a4ff9700 1 -- 172.21.15.86:0/950085562 shutdown_connections 2023-10-09T11:41:24.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.250+0000 7f42a4ff9700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f42ac067080 0x7f42ac069530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.250+0000 7f42a4ff9700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b804ffb0 0x7f42b80e3410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.250+0000 7f42a4ff9700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42b80de030 0x7f42b80d92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.250+0000 7f42a4ff9700 1 --2- 172.21.15.86:0/950085562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42b8053330 0x7f42b80d8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.250+0000 7f42a4ff9700 1 -- 172.21.15.86:0/950085562 >> 172.21.15.86:0/950085562 conn(0x7f42b8054da0 msgr2=0x7f42b8035140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.250+0000 7f42a4ff9700 1 -- 172.21.15.86:0/950085562 shutdown_connections 2023-10-09T11:41:24.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.251+0000 7f42a4ff9700 1 -- 172.21.15.86:0/950085562 wait complete. 2023-10-09T11:41:24.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.263+0000 7ff3427ff700 1 -- 172.21.15.86:0/1116987332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff33c068880 con 0x7ff33c068aa0 2023-10-09T11:41:24.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.263+0000 7ff49df9d700 1 -- 172.21.15.86:0/929623307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff49806d940 con 0x7ff4980c77e0 2023-10-09T11:41:24.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.264+0000 7ff323fff700 1 -- 172.21.15.86:0/1116987332 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff32c0571d0 con 0x7ff33c068aa0 2023-10-09T11:41:24.265 INFO:teuthology.orchestra.run.smithi086.stdout:68719476743 2023-10-09T11:41:24.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.264+0000 7ff494ff9700 1 -- 172.21.15.86:0/929623307 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff48c024090 con 0x7ff4980c77e0 2023-10-09T11:41:24.265 INFO:teuthology.orchestra.run.smithi086.stdout:64424509448 2023-10-09T11:41:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.267+0000 7efd0759e700 1 -- 172.21.15.86:0/839422428 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd080af970 con 0x7efd080696c0 2023-10-09T11:41:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 -- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff328067000 msgr2=0x7ff3280694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff328067000 0x7ff3280694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3340094d0 tx=0x7ff3340096b0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 -- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff33c068aa0 msgr2=0x7ff33c152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff33c068aa0 0x7ff33c152d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff32c008310 tx=0x7ff32c01c000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 -- 172.21.15.86:0/1116987332 shutdown_connections 2023-10-09T11:41:24.271 INFO:teuthology.orchestra.run.smithi086.stdout:64424509448 2023-10-09T11:41:24.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7efcfe7fc700 1 -- 172.21.15.86:0/839422428 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd080af970 con 0x7efd080696c0 2023-10-09T11:41:24.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff328067000 0x7ff3280694b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff33c068aa0 0x7ff33c152d00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c156050 0x7ff33c16d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 --2- 172.21.15.86:0/1116987332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c0cba20 0x7ff33c169fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.268+0000 7ff321ffb700 1 -- 172.21.15.86:0/1116987332 >> 172.21.15.86:0/1116987332 conn(0x7ff33c0cd000 msgr2=0x7ff33c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff321ffb700 1 -- 172.21.15.86:0/1116987332 shutdown_connections 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff321ffb700 1 -- 172.21.15.86:0/1116987332 wait complete. 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 -- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff484067000 msgr2=0x7ff4840694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff484067000 0x7ff4840694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4980a5d70 tx=0x7ff490009040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 -- 172.21.15.86:0/929623307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 msgr2=0x7ff498145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff498145b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00eaa0 tx=0x7ff48c007f10 comp rx=0 tx=0).stop 2023-10-09T11:41:24.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 -- 172.21.15.86:0/929623307 shutdown_connections 2023-10-09T11:41:24.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff484067000 0x7ff4840694b0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4980a5d70 tx=0x7ff490009040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff498156af0 0x7ff4980a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4980c77e0 0x7ff498145b80 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00eaa0 tx=0x7ff48c007f10 comp rx=0 tx=0).stop 2023-10-09T11:41:24.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 --2- 172.21.15.86:0/929623307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff498155720 0x7ff4980a8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.269+0000 7ff47e7fc700 1 -- 172.21.15.86:0/929623307 >> 172.21.15.86:0/929623307 conn(0x7ff4980cc1f0 msgr2=0x7ff4980cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.273 INFO:teuthology.orchestra.run.smithi086.stdout:60129542151 2023-10-09T11:41:24.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.270+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f5c04c3c0 con 0x7f9f440053c0 2023-10-09T11:41:24.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.270+0000 7f9f42ffd700 1 -- 172.21.15.86:0/3102541374 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f540549c0 con 0x7f9f440053c0 2023-10-09T11:41:24.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 -- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efce8067050 msgr2=0x7efce8069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efce8067050 0x7efce8069500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000e10 tx=0x7efcf8016000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 -- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 msgr2=0x7efd08158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9f48067030 msgr2=0x7f9f480694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7f9f617ff700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9f48067030 0x7f9f480694e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cf180 tx=0x7f9f50008040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f440053c0 msgr2=0x7f9f5c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7f9f617ff700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f440053c0 0x7f9f5c0c8260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400d800 tx=0x7f9f54008040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 shutdown_connections 2023-10-09T11:41:24.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd08158100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcf000c7f0 tx=0x7efcf00019d0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9f48067030 0x7f9f480694e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f5c14fa40 0x7f9f5c14feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f440053c0 0x7f9f5c0c8260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 -- 172.21.15.86:0/839422428 shutdown_connections 2023-10-09T11:41:24.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 --2- 172.21.15.86:0/3102541374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f5c0c9c80 0x7f9f5c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 >> 172.21.15.86:0/3102541374 conn(0x7f9f5c068e20 msgr2=0x7f9f5c15cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7ff47e7fc700 1 -- 172.21.15.86:0/929623307 shutdown_connections 2023-10-09T11:41:24.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efce8067050 0x7efce8069500 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000e10 tx=0x7efcf8016000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd0815de70 0x7efd0815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd080696c0 0x7efd08158100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 --2- 172.21.15.86:0/839422428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd0815daa0 0x7efd0815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.273+0000 7efce7fff700 1 -- 172.21.15.86:0/839422428 >> 172.21.15.86:0/839422428 conn(0x7efd080cc1f0 msgr2=0x7efd080c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 shutdown_connections 2023-10-09T11:41:24.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7efce7fff700 1 -- 172.21.15.86:0/839422428 shutdown_connections 2023-10-09T11:41:24.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7efce7fff700 1 -- 172.21.15.86:0/839422428 wait complete. 2023-10-09T11:41:24.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7f9f617ff700 1 -- 172.21.15.86:0/3102541374 wait complete. 2023-10-09T11:41:24.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.274+0000 7ff47e7fc700 1 -- 172.21.15.86:0/929623307 wait complete. 2023-10-09T11:41:24.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-10-09T11:41:24.283 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.284+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc920054c40 con 0x7fc92004d880 2023-10-09T11:41:24.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.285+0000 7fc91d7fa700 1 -- 172.21.15.86:0/3784846786 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc918015020 con 0x7fc92004d880 2023-10-09T11:41:24.286 INFO:teuthology.orchestra.run.smithi086.stdout:68719476744 2023-10-09T11:41:24.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc90c067000 msgr2=0x7fc90c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc90c067000 0x7fc90c0694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9240058d0 tx=0x7fc924007a60 comp rx=0 tx=0).stop 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 msgr2=0x7fc920021560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc920021560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9180093f0 tx=0x7fc918017000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 shutdown_connections 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc90c067000 0x7fc90c0694b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc920039560 0x7fc920023110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc920057a30 0x7fc9200241a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 --2- 172.21.15.86:0/3784846786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc92004d880 0x7fc920021560 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 >> 172.21.15.86:0/3784846786 conn(0x7fc920039da0 msgr2=0x7fc9200df730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 shutdown_connections 2023-10-09T11:41:24.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.288+0000 7fc92e59d700 1 -- 172.21.15.86:0/3784846786 wait complete. 2023-10-09T11:41:24.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.289+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1ab4005830 con 0x7f1ad40696c0 2023-10-09T11:41:24.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.289+0000 7f1ac9ffb700 1 -- 172.21.15.86:0/1790509294 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ad0017080 con 0x7f1ad40696c0 2023-10-09T11:41:24.291 INFO:teuthology.orchestra.run.smithi086.stdout:68719476743 2023-10-09T11:41:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1ab8067000 msgr2=0x7f1ab80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1ab8067000 0x7f1ab80694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ad415e2a0 tx=0x7f1ac4016000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ad40696c0 msgr2=0x7f1ad40c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ad40696c0 0x7f1ad40c5120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c560 tx=0x7f1ad0007e80 comp rx=0 tx=0).stop 2023-10-09T11:41:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 shutdown_connections 2023-10-09T11:41:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1ab8067000 0x7f1ab80694b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad415de50 0x7f1ad415fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ad40696c0 0x7f1ad40c5120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 --2- 172.21.15.86:0/1790509294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ad415da80 0x7f1ad41773f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 >> 172.21.15.86:0/1790509294 conn(0x7f1ad40cc1f0 msgr2=0x7f1ad4069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 shutdown_connections 2023-10-09T11:41:24.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.294+0000 7f1ada99d700 1 -- 172.21.15.86:0/1790509294 wait complete. 2023-10-09T11:41:24.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.296+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3c68005560 con 0x7f3c7c039160 2023-10-09T11:41:24.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.297+0000 7f3c7a7fc700 1 -- 172.21.15.86:0/2658264450 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c74009250 con 0x7f3c7c039160 2023-10-09T11:41:24.298 INFO:teuthology.orchestra.run.smithi086.stdout:68719476743 2023-10-09T11:41:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.300+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3c64067080 msgr2=0x7f3c64069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.300+0000 7f3c8359e700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3c64067080 0x7f3c64069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0058d0 tx=0x7f3c6c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c7c039160 msgr2=0x7f3c7c0df3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c7c039160 0x7f3c7c0df3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400b3c0 tx=0x7f3c74016000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 shutdown_connections 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3c64067080 0x7f3c64069530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c7c0e27a0 0x7f3c7c0e4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c7c039160 0x7f3c7c0df3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 --2- 172.21.15.86:0/2658264450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c7c039530 0x7f3c7c0f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 >> 172.21.15.86:0/2658264450 conn(0x7f3c7c059c40 msgr2=0x7f3c7c03c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 shutdown_connections 2023-10-09T11:41:24.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.301+0000 7f3c8359e700 1 -- 172.21.15.86:0/2658264450 wait complete. 2023-10-09T11:41:24.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.7 2023-10-09T11:41:24.307 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2023-10-09T11:41:24.311 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2023-10-09T11:41:24.312 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2023-10-09T11:41:24.313 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.6 2023-10-09T11:41:24.315 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.4 2023-10-09T11:41:24.320 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.5 2023-10-09T11:41:24.325 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:24.325 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T11:41:24.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:24.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.544+0000 7fe8d89ff700 1 Processor -- start 2023-10-09T11:41:24.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.544+0000 7fe8d89ff700 1 -- start start 2023-10-09T11:41:24.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.545+0000 7fe8d89ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.545+0000 7fe8d89ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8d4157820 0x7fe8d40abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.545+0000 7fe8d89ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d4157c80 con 0x7fe8d40b1850 2023-10-09T11:41:24.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.545+0000 7fe8d89ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d406fc30 con 0x7fe8d4157820 2023-10-09T11:41:24.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.545+0000 7fe8d89ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40cc260 con 0x7fe8d40b1c20 2023-10-09T11:41:24.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8d4157820 0x7fe8d40abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d1d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8d4157820 0x7fe8d40abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57130/0 (socket says 172.21.15.86:57130) 2023-10-09T11:41:24.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 -- 172.21.15.86:0/2725830451 learned_addr learned my addr 172.21.15.86:0/2725830451 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:24.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d259c700 1 --1- 172.21.15.86:0/2725830451 >> v1:172.21.15.135:6789/0 conn(0x7fe8d40b1850 0x7fe8d40ae680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55694/0 (socket says 172.21.15.86:55694) 2023-10-09T11:41:24.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 -- 172.21.15.86:0/2725830451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 msgr2=0x7fe8d41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:24.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 --2- 172.21.15.86:0/2725830451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d41572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 -- 172.21.15.86:0/2725830451 >> v1:172.21.15.135:6789/0 conn(0x7fe8d40b1850 legacy=0x7fe8d40ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 -- 172.21.15.86:0/2725830451 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40cb300 con 0x7fe8d4157820 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.546+0000 7fe8d2d9d700 1 --2- 172.21.15.86:0/2725830451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d40abf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009f20 tx=0x7fe8cc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77a66c4b3f87b34d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d159a700 1 -- 172.21.15.86:0/2725830451 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00e070 con 0x7fe8d4157820 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d159a700 1 -- 172.21.15.86:0/2725830451 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00b9d0 con 0x7fe8d4157820 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d159a700 1 -- 172.21.15.86:0/2725830451 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0092e0 con 0x7fe8d4157820 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 -- 172.21.15.86:0/2725830451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 msgr2=0x7fe8d40abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/2725830451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d40abf60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009f20 tx=0x7fe8cc009840 comp rx=0 tx=0).stop 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 -- 172.21.15.86:0/2725830451 shutdown_connections 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/2725830451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d40abf60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/2725830451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d41572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 -- 172.21.15.86:0/2725830451 >> 172.21.15.86:0/2725830451 conn(0x7fe8d406a320 msgr2=0x7fe8d40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 -- 172.21.15.86:0/2725830451 shutdown_connections 2023-10-09T11:41:24.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.547+0000 7fe8d89ff700 1 -- 172.21.15.86:0/2725830451 wait complete. 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.549+0000 7fe8d89ff700 1 Processor -- start 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.549+0000 7fe8d89ff700 1 -- start start 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d89ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8d40b1850 0x7fe8d40ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d89ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d4169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d89ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d89ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d416a9d0 con 0x7fe8d40b1850 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d89ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d416d560 con 0x7fe8d4157820 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d89ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40aba10 con 0x7fe8d40b1c20 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8d40b1850 0x7fe8d40ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8d40b1850 0x7fe8d40ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39760/0 (socket says 172.21.15.86:39760) 2023-10-09T11:41:24.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 -- 172.21.15.86:0/1809916195 learned_addr learned my addr 172.21.15.86:0/1809916195 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d2d9d700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d1d9b700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d4169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 -- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 msgr2=0x7fe8d4169ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d4169ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 -- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 msgr2=0x7fe8d415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 -- 172.21.15.86:0/1809916195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc009ae0 con 0x7fe8d40b1850 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d2d9d700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d1d9b700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d4169ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.550+0000 7fe8d259c700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8d40b1850 0x7fe8d40ab4d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c7f0 tx=0x7fe8c4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.551+0000 7fe8c27fc700 1 -- 172.21.15.86:0/1809916195 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4005a70 con 0x7fe8d40b1850 2023-10-09T11:41:24.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.551+0000 7fe8c27fc700 1 -- 172.21.15.86:0/1809916195 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4005bf0 con 0x7fe8d40b1850 2023-10-09T11:41:24.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.551+0000 7fe8c27fc700 1 -- 172.21.15.86:0/1809916195 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40070f0 con 0x7fe8d40b1850 2023-10-09T11:41:24.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.551+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d416a410 con 0x7fe8d40b1850 2023-10-09T11:41:24.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.551+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d416d1f0 con 0x7fe8d40b1850 2023-10-09T11:41:24.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.552+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d416d840 con 0x7fe8d40b1850 2023-10-09T11:41:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.553+0000 7fe8c27fc700 1 -- 172.21.15.86:0/1809916195 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8c40074a0 con 0x7fe8d40b1850 2023-10-09T11:41:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.553+0000 7fe8c27fc700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe8b4066f30 0x7fe8b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.554+0000 7fe8c27fc700 1 -- 172.21.15.86:0/1809916195 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8c4083fb0 con 0x7fe8d40b1850 2023-10-09T11:41:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.554+0000 7fe8d1d9b700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe8b4066f30 0x7fe8b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.554+0000 7fe8d1d9b700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe8b4066f30 0x7fe8b40693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8006f00 tx=0x7fe8c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.557+0000 7fe8c27fc700 1 -- 172.21.15.86:0/1809916195 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8c4051200 con 0x7fe8d40b1850 2023-10-09T11:41:24.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.743+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8d404c430 con 0x7fe8b4066f30 2023-10-09T11:41:24.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.750+0000 7fe8c27fc700 1 -- 172.21.15.86:0/1809916195 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264554 (secure 0 0 0) 0x7fe8d404c430 con 0x7fe8b4066f30 2023-10-09T11:41:24.754 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:24.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe8b4066f30 msgr2=0x7fe8b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe8b4066f30 0x7fe8b40693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8006f00 tx=0x7fe8c8008040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8d40b1850 msgr2=0x7fe8d40ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8d40b1850 0x7fe8d40ab4d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c7f0 tx=0x7fe8c4007f70 comp rx=0 tx=0).stop 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 shutdown_connections 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe8b4066f30 0x7fe8b40693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8d40b1850 0x7fe8d40ab4d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8d4157820 0x7fe8d415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 --2- 172.21.15.86:0/1809916195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8d40b1c20 0x7fe8d4169ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 >> 172.21.15.86:0/1809916195 conn(0x7fe8d406a320 msgr2=0x7fe8d4152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 shutdown_connections 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.754+0000 7fe8d89ff700 1 -- 172.21.15.86:0/1809916195 wait complete. 2023-10-09T11:41:24.757 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:41:24.772 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-09T11:41:23.955376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.919517"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071394+0000","last_change":"2023-10-09T11:41:12.064188+0000","last_active":"2023-10-09T11:41:12.071394+0000","last_peered":"2023-10-09T11:41:12.071394+0000","last_clean":"2023-10-09T11:41:12.071394+0000","last_became_active":"2023-10-09T11:41:12.063875+0000","last_became_peered":"2023-10-09T11:41:12.063875+0000","last_unstale":"2023-10-09T11:41:12.071394+0000","last_undegraded":"2023-10-09T11:41:12.071394+0000","last_fullsized":"2023-10-09T11:41:12.071394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058844+0000","last_change":"2023-10-09T11:41:12.053292+0000","last_active":"2023-10-09T11:41:12.058844+0000","last_peered":"2023-10-09T11:41:12.058844+0000","last_clean":"2023-10-09T11:41:12.058844+0000","last_became_active":"2023-10-09T11:41:12.052978+0000","last_became_peered":"2023-10-09T11:41:12.052978+0000","last_unstale":"2023-10-09T11:41:12.058844+0000","last_undegraded":"2023-10-09T11:41:12.058844+0000","last_fullsized":"2023-10-09T11:41:12.058844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053403+0000","last_change":"2023-10-09T11:41:12.048670+0000","last_active":"2023-10-09T11:41:12.053403+0000","last_peered":"2023-10-09T11:41:12.053403+0000","last_clean":"2023-10-09T11:41:12.053403+0000","last_became_active":"2023-10-09T11:41:12.048364+0000","last_became_peered":"2023-10-09T11:41:12.048364+0000","last_unstale":"2023-10-09T11:41:12.053403+0000","last_undegraded":"2023-10-09T11:41:12.053403+0000","last_fullsized":"2023-10-09T11:41:12.053403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065349+0000","last_change":"2023-10-09T11:41:12.062125+0000","last_active":"2023-10-09T11:41:12.065349+0000","last_peered":"2023-10-09T11:41:12.065349+0000","last_clean":"2023-10-09T11:41:12.065349+0000","last_became_active":"2023-10-09T11:41:12.061872+0000","last_became_peered":"2023-10-09T11:41:12.061872+0000","last_unstale":"2023-10-09T11:41:12.065349+0000","last_undegraded":"2023-10-09T11:41:12.065349+0000","last_fullsized":"2023-10-09T11:41:12.065349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052679+0000","last_change":"2023-10-09T11:41:12.049492+0000","last_active":"2023-10-09T11:41:12.052679+0000","last_peered":"2023-10-09T11:41:12.052679+0000","last_clean":"2023-10-09T11:41:12.052679+0000","last_became_active":"2023-10-09T11:41:12.049220+0000","last_became_peered":"2023-10-09T11:41:12.049220+0000","last_unstale":"2023-10-09T11:41:12.052679+0000","last_undegraded":"2023-10-09T11:41:12.052679+0000","last_fullsized":"2023-10-09T11:41:12.052679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070457+0000","last_change":"2023-10-09T11:41:12.065396+0000","last_active":"2023-10-09T11:41:12.070457+0000","last_peered":"2023-10-09T11:41:12.070457+0000","last_clean":"2023-10-09T11:41:12.070457+0000","last_became_active":"2023-10-09T11:41:12.065090+0000","last_became_peered":"2023-10-09T11:41:12.065090+0000","last_unstale":"2023-10-09T11:41:12.070457+0000","last_undegraded":"2023-10-09T11:41:12.070457+0000","last_fullsized":"2023-10-09T11:41:12.070457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071362+0000","last_change":"2023-10-09T11:41:12.063605+0000","last_active":"2023-10-09T11:41:12.071362+0000","last_peered":"2023-10-09T11:41:12.071362+0000","last_clean":"2023-10-09T11:41:12.071362+0000","last_became_active":"2023-10-09T11:41:12.063327+0000","last_became_peered":"2023-10-09T11:41:12.063327+0000","last_unstale":"2023-10-09T11:41:12.071362+0000","last_undegraded":"2023-10-09T11:41:12.071362+0000","last_fullsized":"2023-10-09T11:41:12.071362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059474+0000","last_change":"2023-10-09T11:41:12.054453+0000","last_active":"2023-10-09T11:41:12.059474+0000","last_peered":"2023-10-09T11:41:12.059474+0000","last_clean":"2023-10-09T11:41:12.059474+0000","last_became_active":"2023-10-09T11:41:12.054117+0000","last_became_peered":"2023-10-09T11:41:12.054117+0000","last_unstale":"2023-10-09T11:41:12.059474+0000","last_undegraded":"2023-10-09T11:41:12.059474+0000","last_fullsized":"2023-10-09T11:41:12.059474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.054577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071695+0000","last_change":"2023-10-09T11:41:12.064789+0000","last_active":"2023-10-09T11:41:12.071695+0000","last_peered":"2023-10-09T11:41:12.071695+0000","last_clean":"2023-10-09T11:41:12.071695+0000","last_became_active":"2023-10-09T11:41:12.064496+0000","last_became_peered":"2023-10-09T11:41:12.064496+0000","last_unstale":"2023-10-09T11:41:12.071695+0000","last_undegraded":"2023-10-09T11:41:12.071695+0000","last_fullsized":"2023-10-09T11:41:12.071695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:04.019082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061611+0000","last_change":"2023-10-09T11:41:12.057786+0000","last_active":"2023-10-09T11:41:12.061611+0000","last_peered":"2023-10-09T11:41:12.061611+0000","last_clean":"2023-10-09T11:41:12.061611+0000","last_became_active":"2023-10-09T11:41:12.057470+0000","last_became_peered":"2023-10-09T11:41:12.057470+0000","last_unstale":"2023-10-09T11:41:12.061611+0000","last_undegraded":"2023-10-09T11:41:12.061611+0000","last_fullsized":"2023-10-09T11:41:12.061611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061547+0000","last_change":"2023-10-09T11:41:12.057855+0000","last_active":"2023-10-09T11:41:12.061547+0000","last_peered":"2023-10-09T11:41:12.061547+0000","last_clean":"2023-10-09T11:41:12.061547+0000","last_became_active":"2023-10-09T11:41:12.057494+0000","last_became_peered":"2023-10-09T11:41:12.057494+0000","last_unstale":"2023-10-09T11:41:12.061547+0000","last_undegraded":"2023-10-09T11:41:12.061547+0000","last_fullsized":"2023-10-09T11:41:12.061547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055353+0000","last_change":"2023-10-09T11:41:12.048796+0000","last_active":"2023-10-09T11:41:12.055353+0000","last_peered":"2023-10-09T11:41:12.055353+0000","last_clean":"2023-10-09T11:41:12.055353+0000","last_became_active":"2023-10-09T11:41:12.048484+0000","last_became_peered":"2023-10-09T11:41:12.048484+0000","last_unstale":"2023-10-09T11:41:12.055353+0000","last_undegraded":"2023-10-09T11:41:12.055353+0000","last_fullsized":"2023-10-09T11:41:12.055353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059423+0000","last_change":"2023-10-09T11:41:12.052334+0000","last_active":"2023-10-09T11:41:12.059423+0000","last_peered":"2023-10-09T11:41:12.059423+0000","last_clean":"2023-10-09T11:41:12.059423+0000","last_became_active":"2023-10-09T11:41:12.051731+0000","last_became_peered":"2023-10-09T11:41:12.051731+0000","last_unstale":"2023-10-09T11:41:12.059423+0000","last_undegraded":"2023-10-09T11:41:12.059423+0000","last_fullsized":"2023-10-09T11:41:12.059423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:25.351610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053609+0000","last_change":"2023-10-09T11:41:12.051643+0000","last_active":"2023-10-09T11:41:12.053609+0000","last_peered":"2023-10-09T11:41:12.053609+0000","last_clean":"2023-10-09T11:41:12.053609+0000","last_became_active":"2023-10-09T11:41:12.051337+0000","last_became_peered":"2023-10-09T11:41:12.051337+0000","last_unstale":"2023-10-09T11:41:12.053609+0000","last_undegraded":"2023-10-09T11:41:12.053609+0000","last_fullsized":"2023-10-09T11:41:12.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:10.056568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059700+0000","last_change":"2023-10-09T11:41:12.058090+0000","last_active":"2023-10-09T11:41:12.059700+0000","last_peered":"2023-10-09T11:41:12.059700+0000","last_clean":"2023-10-09T11:41:12.059700+0000","last_became_active":"2023-10-09T11:41:12.057829+0000","last_became_peered":"2023-10-09T11:41:12.057829+0000","last_unstale":"2023-10-09T11:41:12.059700+0000","last_undegraded":"2023-10-09T11:41:12.059700+0000","last_fullsized":"2023-10-09T11:41:12.059700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064496+0000","last_change":"2023-10-09T11:41:12.059376+0000","last_active":"2023-10-09T11:41:12.064496+0000","last_peered":"2023-10-09T11:41:12.064496+0000","last_clean":"2023-10-09T11:41:12.064496+0000","last_became_active":"2023-10-09T11:41:12.059105+0000","last_became_peered":"2023-10-09T11:41:12.059105+0000","last_unstale":"2023-10-09T11:41:12.064496+0000","last_undegraded":"2023-10-09T11:41:12.064496+0000","last_fullsized":"2023-10-09T11:41:12.064496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070447+0000","last_change":"2023-10-09T11:41:12.064945+0000","last_active":"2023-10-09T11:41:12.070447+0000","last_peered":"2023-10-09T11:41:12.070447+0000","last_clean":"2023-10-09T11:41:12.070447+0000","last_became_active":"2023-10-09T11:41:12.064668+0000","last_became_peered":"2023-10-09T11:41:12.064668+0000","last_unstale":"2023-10-09T11:41:12.070447+0000","last_undegraded":"2023-10-09T11:41:12.070447+0000","last_fullsized":"2023-10-09T11:41:12.070447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052841+0000","last_change":"2023-10-09T11:41:12.049265+0000","last_active":"2023-10-09T11:41:12.052841+0000","last_peered":"2023-10-09T11:41:12.052841+0000","last_clean":"2023-10-09T11:41:12.052841+0000","last_became_active":"2023-10-09T11:41:12.049000+0000","last_became_peered":"2023-10-09T11:41:12.049000+0000","last_unstale":"2023-10-09T11:41:12.052841+0000","last_undegraded":"2023-10-09T11:41:12.052841+0000","last_fullsized":"2023-10-09T11:41:12.052841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:17.015986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064795+0000","last_change":"2023-10-09T11:41:12.052554+0000","last_active":"2023-10-09T11:41:12.064795+0000","last_peered":"2023-10-09T11:41:12.064795+0000","last_clean":"2023-10-09T11:41:12.064795+0000","last_became_active":"2023-10-09T11:41:12.050539+0000","last_became_peered":"2023-10-09T11:41:12.050539+0000","last_unstale":"2023-10-09T11:41:12.064795+0000","last_undegraded":"2023-10-09T11:41:12.064795+0000","last_fullsized":"2023-10-09T11:41:12.064795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.088830+0000","last_change":"2023-10-09T11:41:11.074267+0000","last_active":"2023-10-09T11:41:12.088830+0000","last_peered":"2023-10-09T11:41:12.088830+0000","last_clean":"2023-10-09T11:41:12.088830+0000","last_became_active":"2023-10-09T11:41:11.073971+0000","last_became_peered":"2023-10-09T11:41:11.073971+0000","last_unstale":"2023-10-09T11:41:12.088830+0000","last_undegraded":"2023-10-09T11:41:12.088830+0000","last_fullsized":"2023-10-09T11:41:12.088830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:17.546372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059770+0000","last_change":"2023-10-09T11:41:12.054265+0000","last_active":"2023-10-09T11:41:12.059770+0000","last_peered":"2023-10-09T11:41:12.059770+0000","last_clean":"2023-10-09T11:41:12.059770+0000","last_became_active":"2023-10-09T11:41:12.053826+0000","last_became_peered":"2023-10-09T11:41:12.053826+0000","last_unstale":"2023-10-09T11:41:12.059770+0000","last_undegraded":"2023-10-09T11:41:12.059770+0000","last_fullsized":"2023-10-09T11:41:12.059770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:00.372669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.085137+0000","last_change":"2023-10-09T11:41:11.063441+0000","last_active":"2023-10-09T11:41:12.085137+0000","last_peered":"2023-10-09T11:41:12.085137+0000","last_clean":"2023-10-09T11:41:12.085137+0000","last_became_active":"2023-10-09T11:41:11.063025+0000","last_became_peered":"2023-10-09T11:41:11.063025+0000","last_unstale":"2023-10-09T11:41:12.085137+0000","last_undegraded":"2023-10-09T11:41:12.085137+0000","last_fullsized":"2023-10-09T11:41:12.085137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:21.843438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063925+0000","last_change":"2023-10-09T11:41:12.058625+0000","last_active":"2023-10-09T11:41:12.063925+0000","last_peered":"2023-10-09T11:41:12.063925+0000","last_clean":"2023-10-09T11:41:12.063925+0000","last_became_active":"2023-10-09T11:41:12.057462+0000","last_became_peered":"2023-10-09T11:41:12.057462+0000","last_unstale":"2023-10-09T11:41:12.063925+0000","last_undegraded":"2023-10-09T11:41:12.063925+0000","last_fullsized":"2023-10-09T11:41:12.063925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086798+0000","last_change":"2023-10-09T11:41:11.079554+0000","last_active":"2023-10-09T11:41:12.086798+0000","last_peered":"2023-10-09T11:41:12.086798+0000","last_clean":"2023-10-09T11:41:12.086798+0000","last_became_active":"2023-10-09T11:41:11.079230+0000","last_became_peered":"2023-10-09T11:41:11.079230+0000","last_unstale":"2023-10-09T11:41:12.086798+0000","last_undegraded":"2023-10-09T11:41:12.086798+0000","last_fullsized":"2023-10-09T11:41:12.086798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064686+0000","last_change":"2023-10-09T11:41:12.060600+0000","last_active":"2023-10-09T11:41:12.064686+0000","last_peered":"2023-10-09T11:41:12.064686+0000","last_clean":"2023-10-09T11:41:12.064686+0000","last_became_active":"2023-10-09T11:41:12.060325+0000","last_became_peered":"2023-10-09T11:41:12.060325+0000","last_unstale":"2023-10-09T11:41:12.064686+0000","last_undegraded":"2023-10-09T11:41:12.064686+0000","last_fullsized":"2023-10-09T11:41:12.064686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086427+0000","last_change":"2023-10-09T11:41:11.082099+0000","last_active":"2023-10-09T11:41:12.086427+0000","last_peered":"2023-10-09T11:41:12.086427+0000","last_clean":"2023-10-09T11:41:12.086427+0000","last_became_active":"2023-10-09T11:41:11.081703+0000","last_became_peered":"2023-10-09T11:41:11.081703+0000","last_unstale":"2023-10-09T11:41:12.086427+0000","last_undegraded":"2023-10-09T11:41:12.086427+0000","last_fullsized":"2023-10-09T11:41:12.086427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:59.333597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066051+0000","last_change":"2023-10-09T11:41:12.059389+0000","last_active":"2023-10-09T11:41:12.066051+0000","last_peered":"2023-10-09T11:41:12.066051+0000","last_clean":"2023-10-09T11:41:12.066051+0000","last_became_active":"2023-10-09T11:41:12.059089+0000","last_became_peered":"2023-10-09T11:41:12.059089+0000","last_unstale":"2023-10-09T11:41:12.066051+0000","last_undegraded":"2023-10-09T11:41:12.066051+0000","last_fullsized":"2023-10-09T11:41:12.066051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086469+0000","last_change":"2023-10-09T11:41:11.074679+0000","last_active":"2023-10-09T11:41:12.086469+0000","last_peered":"2023-10-09T11:41:12.086469+0000","last_clean":"2023-10-09T11:41:12.086469+0000","last_became_active":"2023-10-09T11:41:11.074362+0000","last_became_peered":"2023-10-09T11:41:11.074362+0000","last_unstale":"2023-10-09T11:41:12.086469+0000","last_undegraded":"2023-10-09T11:41:12.086469+0000","last_fullsized":"2023-10-09T11:41:12.086469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055401+0000","last_change":"2023-10-09T11:41:12.048767+0000","last_active":"2023-10-09T11:41:12.055401+0000","last_peered":"2023-10-09T11:41:12.055401+0000","last_clean":"2023-10-09T11:41:12.055401+0000","last_became_active":"2023-10-09T11:41:12.048451+0000","last_became_peered":"2023-10-09T11:41:12.048451+0000","last_unstale":"2023-10-09T11:41:12.055401+0000","last_undegraded":"2023-10-09T11:41:12.055401+0000","last_fullsized":"2023-10-09T11:41:12.055401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:29.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087372+0000","last_change":"2023-10-09T11:41:11.068876+0000","last_active":"2023-10-09T11:41:12.087372+0000","last_peered":"2023-10-09T11:41:12.087372+0000","last_clean":"2023-10-09T11:41:12.087372+0000","last_became_active":"2023-10-09T11:41:11.068602+0000","last_became_peered":"2023-10-09T11:41:11.068602+0000","last_unstale":"2023-10-09T11:41:12.087372+0000","last_undegraded":"2023-10-09T11:41:12.087372+0000","last_fullsized":"2023-10-09T11:41:12.087372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063758+0000","last_change":"2023-10-09T11:41:12.058551+0000","last_active":"2023-10-09T11:41:12.063758+0000","last_peered":"2023-10-09T11:41:12.063758+0000","last_clean":"2023-10-09T11:41:12.063758+0000","last_became_active":"2023-10-09T11:41:12.056962+0000","last_became_peered":"2023-10-09T11:41:12.056962+0000","last_unstale":"2023-10-09T11:41:12.063758+0000","last_undegraded":"2023-10-09T11:41:12.063758+0000","last_fullsized":"2023-10-09T11:41:12.063758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.038859+0000","last_change":"2023-10-09T11:41:11.072956+0000","last_active":"2023-10-09T11:41:12.038859+0000","last_peered":"2023-10-09T11:41:12.038859+0000","last_clean":"2023-10-09T11:41:12.038859+0000","last_became_active":"2023-10-09T11:41:11.072711+0000","last_became_peered":"2023-10-09T11:41:11.072711+0000","last_unstale":"2023-10-09T11:41:12.038859+0000","last_undegraded":"2023-10-09T11:41:12.038859+0000","last_fullsized":"2023-10-09T11:41:12.038859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060221+0000","last_change":"2023-10-09T11:41:12.056233+0000","last_active":"2023-10-09T11:41:12.060221+0000","last_peered":"2023-10-09T11:41:12.060221+0000","last_clean":"2023-10-09T11:41:12.060221+0000","last_became_active":"2023-10-09T11:41:12.055836+0000","last_became_peered":"2023-10-09T11:41:12.055836+0000","last_unstale":"2023-10-09T11:41:12.060221+0000","last_undegraded":"2023-10-09T11:41:12.060221+0000","last_fullsized":"2023-10-09T11:41:12.060221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.076596+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.075211+0000","last_became_peered":"2023-10-09T11:41:11.075211+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061196+0000","last_change":"2023-10-09T11:41:12.059816+0000","last_active":"2023-10-09T11:41:12.061196+0000","last_peered":"2023-10-09T11:41:12.061196+0000","last_clean":"2023-10-09T11:41:12.061196+0000","last_became_active":"2023-10-09T11:41:12.059529+0000","last_became_peered":"2023-10-09T11:41:12.059529+0000","last_unstale":"2023-10-09T11:41:12.061196+0000","last_undegraded":"2023-10-09T11:41:12.061196+0000","last_fullsized":"2023-10-09T11:41:12.061196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043525+0000","last_change":"2023-10-09T11:41:11.077704+0000","last_active":"2023-10-09T11:41:12.043525+0000","last_peered":"2023-10-09T11:41:12.043525+0000","last_clean":"2023-10-09T11:41:12.043525+0000","last_became_active":"2023-10-09T11:41:11.077405+0000","last_became_peered":"2023-10-09T11:41:11.077405+0000","last_unstale":"2023-10-09T11:41:12.043525+0000","last_undegraded":"2023-10-09T11:41:12.043525+0000","last_fullsized":"2023-10-09T11:41:12.043525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064572+0000","last_change":"2023-10-09T11:41:12.060375+0000","last_active":"2023-10-09T11:41:12.064572+0000","last_peered":"2023-10-09T11:41:12.064572+0000","last_clean":"2023-10-09T11:41:12.064572+0000","last_became_active":"2023-10-09T11:41:12.060103+0000","last_became_peered":"2023-10-09T11:41:12.060103+0000","last_unstale":"2023-10-09T11:41:12.064572+0000","last_undegraded":"2023-10-09T11:41:12.064572+0000","last_fullsized":"2023-10-09T11:41:12.064572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055192+0000","last_change":"2023-10-09T11:41:11.071764+0000","last_active":"2023-10-09T11:41:12.055192+0000","last_peered":"2023-10-09T11:41:12.055192+0000","last_clean":"2023-10-09T11:41:12.055192+0000","last_became_active":"2023-10-09T11:41:11.070619+0000","last_became_peered":"2023-10-09T11:41:11.070619+0000","last_unstale":"2023-10-09T11:41:12.055192+0000","last_undegraded":"2023-10-09T11:41:12.055192+0000","last_fullsized":"2023-10-09T11:41:12.055192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063724+0000","last_change":"2023-10-09T11:41:12.057796+0000","last_active":"2023-10-09T11:41:12.063724+0000","last_peered":"2023-10-09T11:41:12.063724+0000","last_clean":"2023-10-09T11:41:12.063724+0000","last_became_active":"2023-10-09T11:41:12.057536+0000","last_became_peered":"2023-10-09T11:41:12.057536+0000","last_unstale":"2023-10-09T11:41:12.063724+0000","last_undegraded":"2023-10-09T11:41:12.063724+0000","last_fullsized":"2023-10-09T11:41:12.063724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086648+0000","last_change":"2023-10-09T11:41:11.077183+0000","last_active":"2023-10-09T11:41:12.086648+0000","last_peered":"2023-10-09T11:41:12.086648+0000","last_clean":"2023-10-09T11:41:12.086648+0000","last_became_active":"2023-10-09T11:41:11.076940+0000","last_became_peered":"2023-10-09T11:41:11.076940+0000","last_unstale":"2023-10-09T11:41:12.086648+0000","last_undegraded":"2023-10-09T11:41:12.086648+0000","last_fullsized":"2023-10-09T11:41:12.086648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055266+0000","last_change":"2023-10-09T11:41:12.048070+0000","last_active":"2023-10-09T11:41:12.055266+0000","last_peered":"2023-10-09T11:41:12.055266+0000","last_clean":"2023-10-09T11:41:12.055266+0000","last_became_active":"2023-10-09T11:41:12.047867+0000","last_became_peered":"2023-10-09T11:41:12.047867+0000","last_unstale":"2023-10-09T11:41:12.055266+0000","last_undegraded":"2023-10-09T11:41:12.055266+0000","last_fullsized":"2023-10-09T11:41:12.055266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:01.222208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.089647+0000","last_change":"2023-10-09T11:41:11.068939+0000","last_active":"2023-10-09T11:41:12.089647+0000","last_peered":"2023-10-09T11:41:12.089647+0000","last_clean":"2023-10-09T11:41:12.089647+0000","last_became_active":"2023-10-09T11:41:11.068555+0000","last_became_peered":"2023-10-09T11:41:11.068555+0000","last_unstale":"2023-10-09T11:41:12.089647+0000","last_undegraded":"2023-10-09T11:41:12.089647+0000","last_fullsized":"2023-10-09T11:41:12.089647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064816+0000","last_change":"2023-10-09T11:41:12.058308+0000","last_active":"2023-10-09T11:41:12.064816+0000","last_peered":"2023-10-09T11:41:12.064816+0000","last_clean":"2023-10-09T11:41:12.064816+0000","last_became_active":"2023-10-09T11:41:12.057987+0000","last_became_peered":"2023-10-09T11:41:12.057987+0000","last_unstale":"2023-10-09T11:41:12.064816+0000","last_undegraded":"2023-10-09T11:41:12.064816+0000","last_fullsized":"2023-10-09T11:41:12.064816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086499+0000","last_change":"2023-10-09T11:41:11.065387+0000","last_active":"2023-10-09T11:41:12.086499+0000","last_peered":"2023-10-09T11:41:12.086499+0000","last_clean":"2023-10-09T11:41:12.086499+0000","last_became_active":"2023-10-09T11:41:11.065121+0000","last_became_peered":"2023-10-09T11:41:11.065121+0000","last_unstale":"2023-10-09T11:41:12.086499+0000","last_undegraded":"2023-10-09T11:41:12.086499+0000","last_fullsized":"2023-10-09T11:41:12.086499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:19.832054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053962+0000","last_change":"2023-10-09T11:41:12.052247+0000","last_active":"2023-10-09T11:41:12.053962+0000","last_peered":"2023-10-09T11:41:12.053962+0000","last_clean":"2023-10-09T11:41:12.053962+0000","last_became_active":"2023-10-09T11:41:12.051882+0000","last_became_peered":"2023-10-09T11:41:12.051882+0000","last_unstale":"2023-10-09T11:41:12.053962+0000","last_undegraded":"2023-10-09T11:41:12.053962+0000","last_fullsized":"2023-10-09T11:41:12.053962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052727+0000","last_change":"2023-10-09T11:41:11.077221+0000","last_active":"2023-10-09T11:41:12.052727+0000","last_peered":"2023-10-09T11:41:12.052727+0000","last_clean":"2023-10-09T11:41:12.052727+0000","last_became_active":"2023-10-09T11:41:11.075558+0000","last_became_peered":"2023-10-09T11:41:11.075558+0000","last_unstale":"2023-10-09T11:41:12.052727+0000","last_undegraded":"2023-10-09T11:41:12.052727+0000","last_fullsized":"2023-10-09T11:41:12.052727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071415+0000","last_change":"2023-10-09T11:41:12.064288+0000","last_active":"2023-10-09T11:41:12.071415+0000","last_peered":"2023-10-09T11:41:12.071415+0000","last_clean":"2023-10-09T11:41:12.071415+0000","last_became_active":"2023-10-09T11:41:12.064017+0000","last_became_peered":"2023-10-09T11:41:12.064017+0000","last_unstale":"2023-10-09T11:41:12.071415+0000","last_undegraded":"2023-10-09T11:41:12.071415+0000","last_fullsized":"2023-10-09T11:41:12.071415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043298+0000","last_change":"2023-10-09T11:41:11.069670+0000","last_active":"2023-10-09T11:41:12.043298+0000","last_peered":"2023-10-09T11:41:12.043298+0000","last_clean":"2023-10-09T11:41:12.043298+0000","last_became_active":"2023-10-09T11:41:11.069325+0000","last_became_peered":"2023-10-09T11:41:11.069325+0000","last_unstale":"2023-10-09T11:41:12.043298+0000","last_undegraded":"2023-10-09T11:41:12.043298+0000","last_fullsized":"2023-10-09T11:41:12.043298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058961+0000","last_change":"2023-10-09T11:41:12.054973+0000","last_active":"2023-10-09T11:41:12.058961+0000","last_peered":"2023-10-09T11:41:12.058961+0000","last_clean":"2023-10-09T11:41:12.058961+0000","last_became_active":"2023-10-09T11:41:12.054637+0000","last_became_peered":"2023-10-09T11:41:12.054637+0000","last_unstale":"2023-10-09T11:41:12.058961+0000","last_undegraded":"2023-10-09T11:41:12.058961+0000","last_fullsized":"2023-10-09T11:41:12.058961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087283+0000","last_change":"2023-10-09T11:41:11.066464+0000","last_active":"2023-10-09T11:41:12.087283+0000","last_peered":"2023-10-09T11:41:12.087283+0000","last_clean":"2023-10-09T11:41:12.087283+0000","last_became_active":"2023-10-09T11:41:11.066166+0000","last_became_peered":"2023-10-09T11:41:11.066166+0000","last_unstale":"2023-10-09T11:41:12.087283+0000","last_undegraded":"2023-10-09T11:41:12.087283+0000","last_fullsized":"2023-10-09T11:41:12.087283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:02.875341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071715+0000","last_change":"2023-10-09T11:41:12.065762+0000","last_active":"2023-10-09T11:41:12.071715+0000","last_peered":"2023-10-09T11:41:12.071715+0000","last_clean":"2023-10-09T11:41:12.071715+0000","last_became_active":"2023-10-09T11:41:12.065421+0000","last_became_peered":"2023-10-09T11:41:12.065421+0000","last_unstale":"2023-10-09T11:41:12.071715+0000","last_undegraded":"2023-10-09T11:41:12.071715+0000","last_fullsized":"2023-10-09T11:41:12.071715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084177+0000","last_change":"2023-10-09T11:41:11.065898+0000","last_active":"2023-10-09T11:41:12.084177+0000","last_peered":"2023-10-09T11:41:12.084177+0000","last_clean":"2023-10-09T11:41:12.084177+0000","last_became_active":"2023-10-09T11:41:11.065594+0000","last_became_peered":"2023-10-09T11:41:11.065594+0000","last_unstale":"2023-10-09T11:41:12.084177+0000","last_undegraded":"2023-10-09T11:41:12.084177+0000","last_fullsized":"2023-10-09T11:41:12.084177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:55.877969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071698+0000","last_change":"2023-10-09T11:41:12.064978+0000","last_active":"2023-10-09T11:41:12.071698+0000","last_peered":"2023-10-09T11:41:12.071698+0000","last_clean":"2023-10-09T11:41:12.071698+0000","last_became_active":"2023-10-09T11:41:12.064674+0000","last_became_peered":"2023-10-09T11:41:12.064674+0000","last_unstale":"2023-10-09T11:41:12.071698+0000","last_undegraded":"2023-10-09T11:41:12.071698+0000","last_fullsized":"2023-10-09T11:41:12.071698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045586+0000","last_change":"2023-10-09T11:41:11.062024+0000","last_active":"2023-10-09T11:41:12.045586+0000","last_peered":"2023-10-09T11:41:12.045586+0000","last_clean":"2023-10-09T11:41:12.045586+0000","last_became_active":"2023-10-09T11:41:11.061759+0000","last_became_peered":"2023-10-09T11:41:11.061759+0000","last_unstale":"2023-10-09T11:41:12.045586+0000","last_undegraded":"2023-10-09T11:41:12.045586+0000","last_fullsized":"2023-10-09T11:41:12.045586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:28.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066071+0000","last_change":"2023-10-09T11:41:12.062692+0000","last_active":"2023-10-09T11:41:12.066071+0000","last_peered":"2023-10-09T11:41:12.066071+0000","last_clean":"2023-10-09T11:41:12.066071+0000","last_became_active":"2023-10-09T11:41:12.062415+0000","last_became_peered":"2023-10-09T11:41:12.062415+0000","last_unstale":"2023-10-09T11:41:12.066071+0000","last_undegraded":"2023-10-09T11:41:12.066071+0000","last_fullsized":"2023-10-09T11:41:12.066071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.077710+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.077435+0000","last_became_peered":"2023-10-09T11:41:11.077435+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058902+0000","last_change":"2023-10-09T11:41:12.051806+0000","last_active":"2023-10-09T11:41:12.058902+0000","last_peered":"2023-10-09T11:41:12.058902+0000","last_clean":"2023-10-09T11:41:12.058902+0000","last_became_active":"2023-10-09T11:41:12.051462+0000","last_became_peered":"2023-10-09T11:41:12.051462+0000","last_unstale":"2023-10-09T11:41:12.058902+0000","last_undegraded":"2023-10-09T11:41:12.058902+0000","last_fullsized":"2023-10-09T11:41:12.058902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055235+0000","last_change":"2023-10-09T11:41:12.048312+0000","last_active":"2023-10-09T11:41:12.055235+0000","last_peered":"2023-10-09T11:41:12.055235+0000","last_clean":"2023-10-09T11:41:12.055235+0000","last_became_active":"2023-10-09T11:41:12.048029+0000","last_became_peered":"2023-10-09T11:41:12.048029+0000","last_unstale":"2023-10-09T11:41:12.055235+0000","last_undegraded":"2023-10-09T11:41:12.055235+0000","last_fullsized":"2023-10-09T11:41:12.055235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044145+0000","last_change":"2023-10-09T11:41:11.065740+0000","last_active":"2023-10-09T11:41:12.044145+0000","last_peered":"2023-10-09T11:41:12.044145+0000","last_clean":"2023-10-09T11:41:12.044145+0000","last_became_active":"2023-10-09T11:41:11.065420+0000","last_became_peered":"2023-10-09T11:41:11.065420+0000","last_unstale":"2023-10-09T11:41:12.044145+0000","last_undegraded":"2023-10-09T11:41:12.044145+0000","last_fullsized":"2023-10-09T11:41:12.044145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.067543+0000","last_change":"2023-10-09T11:41:12.063341+0000","last_active":"2023-10-09T11:41:12.067543+0000","last_peered":"2023-10-09T11:41:12.067543+0000","last_clean":"2023-10-09T11:41:12.067543+0000","last_became_active":"2023-10-09T11:41:12.063063+0000","last_became_peered":"2023-10-09T11:41:12.063063+0000","last_unstale":"2023-10-09T11:41:12.067543+0000","last_undegraded":"2023-10-09T11:41:12.067543+0000","last_fullsized":"2023-10-09T11:41:12.067543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052738+0000","last_change":"2023-10-09T11:41:11.064371+0000","last_active":"2023-10-09T11:41:12.052738+0000","last_peered":"2023-10-09T11:41:12.052738+0000","last_clean":"2023-10-09T11:41:12.052738+0000","last_became_active":"2023-10-09T11:41:11.064027+0000","last_became_peered":"2023-10-09T11:41:11.064027+0000","last_unstale":"2023-10-09T11:41:12.052738+0000","last_undegraded":"2023-10-09T11:41:12.052738+0000","last_fullsized":"2023-10-09T11:41:12.052738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044083+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:41:12.044083+0000","last_peered":"2023-10-09T11:41:12.044083+0000","last_clean":"2023-10-09T11:41:12.044083+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:41:12.044083+0000","last_undegraded":"2023-10-09T11:41:12.044083+0000","last_fullsized":"2023-10-09T11:41:12.044083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063606+0000","last_change":"2023-10-09T11:41:12.057248+0000","last_active":"2023-10-09T11:41:12.063606+0000","last_peered":"2023-10-09T11:41:12.063606+0000","last_clean":"2023-10-09T11:41:12.063606+0000","last_became_active":"2023-10-09T11:41:12.056873+0000","last_became_peered":"2023-10-09T11:41:12.056873+0000","last_unstale":"2023-10-09T11:41:12.063606+0000","last_undegraded":"2023-10-09T11:41:12.063606+0000","last_fullsized":"2023-10-09T11:41:12.063606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:16.551009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044184+0000","last_change":"2023-10-09T11:41:11.079718+0000","last_active":"2023-10-09T11:41:12.044184+0000","last_peered":"2023-10-09T11:41:12.044184+0000","last_clean":"2023-10-09T11:41:12.044184+0000","last_became_active":"2023-10-09T11:41:11.079488+0000","last_became_peered":"2023-10-09T11:41:11.079488+0000","last_unstale":"2023-10-09T11:41:12.044184+0000","last_undegraded":"2023-10-09T11:41:12.044184+0000","last_fullsized":"2023-10-09T11:41:12.044184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043828+0000","last_change":"2023-10-09T11:41:11.075456+0000","last_active":"2023-10-09T11:41:12.043828+0000","last_peered":"2023-10-09T11:41:12.043828+0000","last_clean":"2023-10-09T11:41:12.043828+0000","last_became_active":"2023-10-09T11:41:11.074500+0000","last_became_peered":"2023-10-09T11:41:11.074500+0000","last_unstale":"2023-10-09T11:41:12.043828+0000","last_undegraded":"2023-10-09T11:41:12.043828+0000","last_fullsized":"2023-10-09T11:41:12.043828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055214+0000","last_change":"2023-10-09T11:41:12.050593+0000","last_active":"2023-10-09T11:41:12.055214+0000","last_peered":"2023-10-09T11:41:12.055214+0000","last_clean":"2023-10-09T11:41:12.055214+0000","last_became_active":"2023-10-09T11:41:12.050327+0000","last_became_peered":"2023-10-09T11:41:12.050327+0000","last_unstale":"2023-10-09T11:41:12.055214+0000","last_undegraded":"2023-10-09T11:41:12.055214+0000","last_fullsized":"2023-10-09T11:41:12.055214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-09T11:41:13.038153+0000","last_change":"2023-10-09T11:41:11.062590+0000","last_active":"2023-10-09T11:41:13.038153+0000","last_peered":"2023-10-09T11:41:13.038153+0000","last_clean":"2023-10-09T11:41:13.038153+0000","last_became_active":"2023-10-09T11:41:11.062303+0000","last_became_peered":"2023-10-09T11:41:11.062303+0000","last_unstale":"2023-10-09T11:41:13.038153+0000","last_undegraded":"2023-10-09T11:41:13.038153+0000","last_fullsized":"2023-10-09T11:41:13.038153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062836+0000","last_change":"2023-10-09T11:41:12.059380+0000","last_active":"2023-10-09T11:41:12.062836+0000","last_peered":"2023-10-09T11:41:12.062836+0000","last_clean":"2023-10-09T11:41:12.062836+0000","last_became_active":"2023-10-09T11:41:12.059091+0000","last_became_peered":"2023-10-09T11:41:12.059091+0000","last_unstale":"2023-10-09T11:41:12.062836+0000","last_undegraded":"2023-10-09T11:41:12.062836+0000","last_fullsized":"2023-10-09T11:41:12.062836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:41.207515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086758+0000","last_change":"2023-10-09T11:41:11.074722+0000","last_active":"2023-10-09T11:41:12.086758+0000","last_peered":"2023-10-09T11:41:12.086758+0000","last_clean":"2023-10-09T11:41:12.086758+0000","last_became_active":"2023-10-09T11:41:11.074417+0000","last_became_peered":"2023-10-09T11:41:11.074417+0000","last_unstale":"2023-10-09T11:41:12.086758+0000","last_undegraded":"2023-10-09T11:41:12.086758+0000","last_fullsized":"2023-10-09T11:41:12.086758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053509+0000","last_change":"2023-10-09T11:41:12.051884+0000","last_active":"2023-10-09T11:41:12.053509+0000","last_peered":"2023-10-09T11:41:12.053509+0000","last_clean":"2023-10-09T11:41:12.053509+0000","last_became_active":"2023-10-09T11:41:12.051012+0000","last_became_peered":"2023-10-09T11:41:12.051012+0000","last_unstale":"2023-10-09T11:41:12.053509+0000","last_undegraded":"2023-10-09T11:41:12.053509+0000","last_fullsized":"2023-10-09T11:41:12.053509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:59.214273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043996+0000","last_change":"2023-10-09T11:41:11.079256+0000","last_active":"2023-10-09T11:41:12.043996+0000","last_peered":"2023-10-09T11:41:12.043996+0000","last_clean":"2023-10-09T11:41:12.043996+0000","last_became_active":"2023-10-09T11:41:11.078999+0000","last_became_peered":"2023-10-09T11:41:11.078999+0000","last_unstale":"2023-10-09T11:41:12.043996+0000","last_undegraded":"2023-10-09T11:41:12.043996+0000","last_fullsized":"2023-10-09T11:41:12.043996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.057087+0000","last_change":"2023-10-09T11:41:12.048978+0000","last_active":"2023-10-09T11:41:12.057087+0000","last_peered":"2023-10-09T11:41:12.057087+0000","last_clean":"2023-10-09T11:41:12.057087+0000","last_became_active":"2023-10-09T11:41:12.048636+0000","last_became_peered":"2023-10-09T11:41:12.048636+0000","last_unstale":"2023-10-09T11:41:12.057087+0000","last_undegraded":"2023-10-09T11:41:12.057087+0000","last_fullsized":"2023-10-09T11:41:12.057087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045174+0000","last_change":"2023-10-09T11:41:11.074785+0000","last_active":"2023-10-09T11:41:12.045174+0000","last_peered":"2023-10-09T11:41:12.045174+0000","last_clean":"2023-10-09T11:41:12.045174+0000","last_became_active":"2023-10-09T11:41:11.074460+0000","last_became_peered":"2023-10-09T11:41:11.074460+0000","last_unstale":"2023-10-09T11:41:12.045174+0000","last_undegraded":"2023-10-09T11:41:12.045174+0000","last_fullsized":"2023-10-09T11:41:12.045174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055406+0000","last_change":"2023-10-09T11:41:12.050021+0000","last_active":"2023-10-09T11:41:12.055406+0000","last_peered":"2023-10-09T11:41:12.055406+0000","last_clean":"2023-10-09T11:41:12.055406+0000","last_became_active":"2023-10-09T11:41:12.049763+0000","last_became_peered":"2023-10-09T11:41:12.049763+0000","last_unstale":"2023-10-09T11:41:12.055406+0000","last_undegraded":"2023-10-09T11:41:12.055406+0000","last_fullsized":"2023-10-09T11:41:12.055406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045561+0000","last_change":"2023-10-09T11:41:11.063645+0000","last_active":"2023-10-09T11:41:12.045561+0000","last_peered":"2023-10-09T11:41:12.045561+0000","last_clean":"2023-10-09T11:41:12.045561+0000","last_became_active":"2023-10-09T11:41:11.063324+0000","last_became_peered":"2023-10-09T11:41:11.063324+0000","last_unstale":"2023-10-09T11:41:12.045561+0000","last_undegraded":"2023-10-09T11:41:12.045561+0000","last_fullsized":"2023-10-09T11:41:12.045561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059445+0000","last_change":"2023-10-09T11:41:12.053917+0000","last_active":"2023-10-09T11:41:12.059445+0000","last_peered":"2023-10-09T11:41:12.059445+0000","last_clean":"2023-10-09T11:41:12.059445+0000","last_became_active":"2023-10-09T11:41:12.051978+0000","last_became_peered":"2023-10-09T11:41:12.051978+0000","last_unstale":"2023-10-09T11:41:12.059445+0000","last_undegraded":"2023-10-09T11:41:12.059445+0000","last_fullsized":"2023-10-09T11:41:12.059445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086796+0000","last_change":"2023-10-09T11:41:11.076948+0000","last_active":"2023-10-09T11:41:12.086796+0000","last_peered":"2023-10-09T11:41:12.086796+0000","last_clean":"2023-10-09T11:41:12.086796+0000","last_became_active":"2023-10-09T11:41:11.076489+0000","last_became_peered":"2023-10-09T11:41:11.076489+0000","last_unstale":"2023-10-09T11:41:12.086796+0000","last_undegraded":"2023-10-09T11:41:12.086796+0000","last_fullsized":"2023-10-09T11:41:12.086796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061534+0000","last_change":"2023-10-09T11:41:12.056922+0000","last_active":"2023-10-09T11:41:12.061534+0000","last_peered":"2023-10-09T11:41:12.061534+0000","last_clean":"2023-10-09T11:41:12.061534+0000","last_became_active":"2023-10-09T11:41:12.056611+0000","last_became_peered":"2023-10-09T11:41:12.056611+0000","last_unstale":"2023-10-09T11:41:12.061534+0000","last_undegraded":"2023-10-09T11:41:12.061534+0000","last_fullsized":"2023-10-09T11:41:12.061534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044251+0000","last_change":"2023-10-09T11:41:11.077460+0000","last_active":"2023-10-09T11:41:12.044251+0000","last_peered":"2023-10-09T11:41:12.044251+0000","last_clean":"2023-10-09T11:41:12.044251+0000","last_became_active":"2023-10-09T11:41:11.077192+0000","last_became_peered":"2023-10-09T11:41:11.077192+0000","last_unstale":"2023-10-09T11:41:12.044251+0000","last_undegraded":"2023-10-09T11:41:12.044251+0000","last_fullsized":"2023-10-09T11:41:12.044251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:56.491552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071319+0000","last_change":"2023-10-09T11:41:12.061959+0000","last_active":"2023-10-09T11:41:12.071319+0000","last_peered":"2023-10-09T11:41:12.071319+0000","last_clean":"2023-10-09T11:41:12.071319+0000","last_became_active":"2023-10-09T11:41:12.058357+0000","last_became_peered":"2023-10-09T11:41:12.058357+0000","last_unstale":"2023-10-09T11:41:12.071319+0000","last_undegraded":"2023-10-09T11:41:12.071319+0000","last_fullsized":"2023-10-09T11:41:12.071319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086287+0000","last_change":"2023-10-09T11:41:11.060748+0000","last_active":"2023-10-09T11:41:12.086287+0000","last_peered":"2023-10-09T11:41:12.086287+0000","last_clean":"2023-10-09T11:41:12.086287+0000","last_became_active":"2023-10-09T11:41:11.060436+0000","last_became_peered":"2023-10-09T11:41:11.060436+0000","last_unstale":"2023-10-09T11:41:12.086287+0000","last_undegraded":"2023-10-09T11:41:12.086287+0000","last_fullsized":"2023-10-09T11:41:12.086287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065329+0000","last_change":"2023-10-09T11:41:12.060982+0000","last_active":"2023-10-09T11:41:12.065329+0000","last_peered":"2023-10-09T11:41:12.065329+0000","last_clean":"2023-10-09T11:41:12.065329+0000","last_became_active":"2023-10-09T11:41:12.056626+0000","last_became_peered":"2023-10-09T11:41:12.056626+0000","last_unstale":"2023-10-09T11:41:12.065329+0000","last_undegraded":"2023-10-09T11:41:12.065329+0000","last_fullsized":"2023-10-09T11:41:12.065329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084778+0000","last_change":"2023-10-09T11:41:11.066536+0000","last_active":"2023-10-09T11:41:12.084778+0000","last_peered":"2023-10-09T11:41:12.084778+0000","last_clean":"2023-10-09T11:41:12.084778+0000","last_became_active":"2023-10-09T11:41:11.066194+0000","last_became_peered":"2023-10-09T11:41:11.066194+0000","last_unstale":"2023-10-09T11:41:12.084778+0000","last_undegraded":"2023-10-09T11:41:12.084778+0000","last_fullsized":"2023-10-09T11:41:12.084778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071765+0000","last_change":"2023-10-09T11:41:12.067596+0000","last_active":"2023-10-09T11:41:12.071765+0000","last_peered":"2023-10-09T11:41:12.071765+0000","last_clean":"2023-10-09T11:41:12.071765+0000","last_became_active":"2023-10-09T11:41:12.067282+0000","last_became_peered":"2023-10-09T11:41:12.067282+0000","last_unstale":"2023-10-09T11:41:12.071765+0000","last_undegraded":"2023-10-09T11:41:12.071765+0000","last_fullsized":"2023-10-09T11:41:12.071765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061545+0000","last_change":"2023-10-09T11:41:12.056097+0000","last_active":"2023-10-09T11:41:12.061545+0000","last_peered":"2023-10-09T11:41:12.061545+0000","last_clean":"2023-10-09T11:41:12.061545+0000","last_became_active":"2023-10-09T11:41:12.055031+0000","last_became_peered":"2023-10-09T11:41:12.055031+0000","last_unstale":"2023-10-09T11:41:12.061545+0000","last_undegraded":"2023-10-09T11:41:12.061545+0000","last_fullsized":"2023-10-09T11:41:12.061545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058104+0000","last_change":"2023-10-09T11:41:12.056111+0000","last_active":"2023-10-09T11:41:12.058104+0000","last_peered":"2023-10-09T11:41:12.058104+0000","last_clean":"2023-10-09T11:41:12.058104+0000","last_became_active":"2023-10-09T11:41:12.055843+0000","last_became_peered":"2023-10-09T11:41:12.055843+0000","last_unstale":"2023-10-09T11:41:12.058104+0000","last_undegraded":"2023-10-09T11:41:12.058104+0000","last_fullsized":"2023-10-09T11:41:12.058104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:43.783508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063535+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.063535+0000","last_peered":"2023-10-09T11:41:12.063535+0000","last_clean":"2023-10-09T11:41:12.063535+0000","last_became_active":"2023-10-09T11:41:12.055904+0000","last_became_peered":"2023-10-09T11:41:12.055904+0000","last_unstale":"2023-10-09T11:41:12.063535+0000","last_undegraded":"2023-10-09T11:41:12.063535+0000","last_fullsized":"2023-10-09T11:41:12.063535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053222+0000","last_change":"2023-10-09T11:41:12.051485+0000","last_active":"2023-10-09T11:41:12.053222+0000","last_peered":"2023-10-09T11:41:12.053222+0000","last_clean":"2023-10-09T11:41:12.053222+0000","last_became_active":"2023-10-09T11:41:12.051192+0000","last_became_peered":"2023-10-09T11:41:12.051192+0000","last_unstale":"2023-10-09T11:41:12.053222+0000","last_undegraded":"2023-10-09T11:41:12.053222+0000","last_fullsized":"2023-10-09T11:41:12.053222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062890+0000","last_change":"2023-10-09T11:41:12.059625+0000","last_active":"2023-10-09T11:41:12.062890+0000","last_peered":"2023-10-09T11:41:12.062890+0000","last_clean":"2023-10-09T11:41:12.062890+0000","last_became_active":"2023-10-09T11:41:12.059319+0000","last_became_peered":"2023-10-09T11:41:12.059319+0000","last_unstale":"2023-10-09T11:41:12.062890+0000","last_undegraded":"2023-10-09T11:41:12.062890+0000","last_fullsized":"2023-10-09T11:41:12.062890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061223+0000","last_change":"2023-10-09T11:41:12.059993+0000","last_active":"2023-10-09T11:41:12.061223+0000","last_peered":"2023-10-09T11:41:12.061223+0000","last_clean":"2023-10-09T11:41:12.061223+0000","last_became_active":"2023-10-09T11:41:12.059604+0000","last_became_peered":"2023-10-09T11:41:12.059604+0000","last_unstale":"2023-10-09T11:41:12.061223+0000","last_undegraded":"2023-10-09T11:41:12.061223+0000","last_fullsized":"2023-10-09T11:41:12.061223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063218+0000","last_change":"2023-10-09T11:41:12.059495+0000","last_active":"2023-10-09T11:41:12.063218+0000","last_peered":"2023-10-09T11:41:12.063218+0000","last_clean":"2023-10-09T11:41:12.063218+0000","last_became_active":"2023-10-09T11:41:12.059200+0000","last_became_peered":"2023-10-09T11:41:12.059200+0000","last_unstale":"2023-10-09T11:41:12.063218+0000","last_undegraded":"2023-10-09T11:41:12.063218+0000","last_fullsized":"2023-10-09T11:41:12.063218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060308+0000","last_change":"2023-10-09T11:41:12.058708+0000","last_active":"2023-10-09T11:41:12.060308+0000","last_peered":"2023-10-09T11:41:12.060308+0000","last_clean":"2023-10-09T11:41:12.060308+0000","last_became_active":"2023-10-09T11:41:12.058356+0000","last_became_peered":"2023-10-09T11:41:12.058356+0000","last_unstale":"2023-10-09T11:41:12.060308+0000","last_undegraded":"2023-10-09T11:41:12.060308+0000","last_fullsized":"2023-10-09T11:41:12.060308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063595+0000","last_change":"2023-10-09T11:41:12.056307+0000","last_active":"2023-10-09T11:41:12.063595+0000","last_peered":"2023-10-09T11:41:12.063595+0000","last_clean":"2023-10-09T11:41:12.063595+0000","last_became_active":"2023-10-09T11:41:12.056023+0000","last_became_peered":"2023-10-09T11:41:12.056023+0000","last_unstale":"2023-10-09T11:41:12.063595+0000","last_undegraded":"2023-10-09T11:41:12.063595+0000","last_fullsized":"2023-10-09T11:41:12.063595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063421+0000","last_change":"2023-10-09T11:41:12.059080+0000","last_active":"2023-10-09T11:41:12.063421+0000","last_peered":"2023-10-09T11:41:12.063421+0000","last_clean":"2023-10-09T11:41:12.063421+0000","last_became_active":"2023-10-09T11:41:12.056426+0000","last_became_peered":"2023-10-09T11:41:12.056426+0000","last_unstale":"2023-10-09T11:41:12.063421+0000","last_undegraded":"2023-10-09T11:41:12.063421+0000","last_fullsized":"2023-10-09T11:41:12.063421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.072184+0000","last_change":"2023-10-09T11:41:12.069213+0000","last_active":"2023-10-09T11:41:12.072184+0000","last_peered":"2023-10-09T11:41:12.072184+0000","last_clean":"2023-10-09T11:41:12.072184+0000","last_became_active":"2023-10-09T11:41:12.068965+0000","last_became_peered":"2023-10-09T11:41:12.068965+0000","last_unstale":"2023-10-09T11:41:12.072184+0000","last_undegraded":"2023-10-09T11:41:12.072184+0000","last_fullsized":"2023-10-09T11:41:12.072184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053983+0000","last_change":"2023-10-09T11:41:12.052767+0000","last_active":"2023-10-09T11:41:12.053983+0000","last_peered":"2023-10-09T11:41:12.053983+0000","last_clean":"2023-10-09T11:41:12.053983+0000","last_became_active":"2023-10-09T11:41:12.052111+0000","last_became_peered":"2023-10-09T11:41:12.052111+0000","last_unstale":"2023-10-09T11:41:12.053983+0000","last_undegraded":"2023-10-09T11:41:12.053983+0000","last_fullsized":"2023-10-09T11:41:12.053983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061451+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.061451+0000","last_peered":"2023-10-09T11:41:12.061451+0000","last_clean":"2023-10-09T11:41:12.061451+0000","last_became_active":"2023-10-09T11:41:12.055911+0000","last_became_peered":"2023-10-09T11:41:12.055911+0000","last_unstale":"2023-10-09T11:41:12.061451+0000","last_undegraded":"2023-10-09T11:41:12.061451+0000","last_fullsized":"2023-10-09T11:41:12.061451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476743,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:24.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:24.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.991+0000 7fee53fff700 1 Processor -- start 2023-10-09T11:41:24.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.991+0000 7fee53fff700 1 -- start start 2023-10-09T11:41:24.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.992+0000 7fee53fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee54159420 0x7fee540b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.992+0000 7fee53fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee5415d230 0x7fee5415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.992+0000 7fee53fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5415dbd0 con 0x7fee541597f0 2023-10-09T11:41:24.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.992+0000 7fee53fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540b2980 con 0x7fee5415d230 2023-10-09T11:41:24.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.992+0000 7fee53fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540b11d0 con 0x7fee54159420 2023-10-09T11:41:24.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee5415d230 0x7fee5415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee5415d230 0x7fee5415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54580/0 (socket says 172.21.15.86:54580) 2023-10-09T11:41:24.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 -- 172.21.15.86:0/911510655 learned_addr learned my addr 172.21.15.86:0/911510655 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:24.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee52ffd700 1 --2- 172.21.15.86:0/911510655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee54159420 0x7fee540b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 -- 172.21.15.86:0/911510655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee54159420 msgr2=0x7fee540b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:24.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 --2- 172.21.15.86:0/911510655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee54159420 0x7fee540b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 -- 172.21.15.86:0/911510655 >> v1:172.21.15.135:6789/0 conn(0x7fee541597f0 legacy=0x7fee540b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 -- 172.21.15.86:0/911510655 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540b14b0 con 0x7fee5415d230 2023-10-09T11:41:24.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee52ffd700 1 --2- 172.21.15.86:0/911510655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee54159420 0x7fee540b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee537fe700 1 --2- 172.21.15.86:0/911510655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee5415d230 0x7fee5415d690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0099b0 tx=0x7fee4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57c5b35d8a26b15 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.993+0000 7fee51ffb700 1 -- 172.21.15.86:0/911510655 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00b860 con 0x7fee5415d230 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee51ffb700 1 -- 172.21.15.86:0/911510655 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c00b9c0 con 0x7fee5415d230 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee51ffb700 1 -- 172.21.15.86:0/911510655 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00bd60 con 0x7fee5415d230 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 -- 172.21.15.86:0/911510655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee5415d230 msgr2=0x7fee5415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 --2- 172.21.15.86:0/911510655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee5415d230 0x7fee5415d690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0099b0 tx=0x7fee4c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 -- 172.21.15.86:0/911510655 shutdown_connections 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 --2- 172.21.15.86:0/911510655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee5415d230 0x7fee5415d690 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 --2- 172.21.15.86:0/911510655 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee54159420 0x7fee540b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 -- 172.21.15.86:0/911510655 >> 172.21.15.86:0/911510655 conn(0x7fee540d0660 msgr2=0x7fee540d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 -- 172.21.15.86:0/911510655 shutdown_connections 2023-10-09T11:41:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.994+0000 7fee53fff700 1 -- 172.21.15.86:0/911510655 wait complete. 2023-10-09T11:41:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.996+0000 7fee53fff700 1 Processor -- start 2023-10-09T11:41:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.996+0000 7fee53fff700 1 -- start start 2023-10-09T11:41:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.996+0000 7fee53fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee54159420 0x7fee54169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.996+0000 7fee53fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee541597f0 0x7fee540c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee53fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5415d230 0x7fee54155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee53fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee54155690 con 0x7fee54159420 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee53fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c6280 con 0x7fee541597f0 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee53fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415b210 con 0x7fee5415d230 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee54159420 0x7fee54169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee54159420 0x7fee54169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54586/0 (socket says 172.21.15.86:54586) 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 -- 172.21.15.86:0/1450984401 learned_addr learned my addr 172.21.15.86:0/1450984401 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 -- 172.21.15.86:0/1450984401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5415d230 msgr2=0x7fee54155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5415d230 0x7fee54155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 -- 172.21.15.86:0/1450984401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee541597f0 msgr2=0x7fee540c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee541597f0 0x7fee540c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 -- 172.21.15.86:0/1450984401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0094f0 con 0x7fee54159420 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee52ffd700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee54159420 0x7fee54169490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee4400d1d0 tx=0x7fee44009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee3affd700 1 -- 172.21.15.86:0/1450984401 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400de70 con 0x7fee54159420 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee3affd700 1 -- 172.21.15.86:0/1450984401 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400f040 con 0x7fee54159420 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee3affd700 1 -- 172.21.15.86:0/1450984401 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44015670 con 0x7fee54159420 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.997+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540c7520 con 0x7fee54159420 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.998+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540c7ae0 con 0x7fee54159420 2023-10-09T11:41:25.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.999+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5404c3c0 con 0x7fee54159420 2023-10-09T11:41:25.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:24.999+0000 7fee3affd700 1 -- 172.21.15.86:0/1450984401 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee44015a60 con 0x7fee54159420 2023-10-09T11:41:25.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.000+0000 7fee3affd700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fee40066f30 0x7fee400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.001+0000 7fee3affd700 1 -- 172.21.15.86:0/1450984401 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee44084a00 con 0x7fee54159420 2023-10-09T11:41:25.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.001+0000 7fee527fc700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fee40066f30 0x7fee400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.001+0000 7fee527fc700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fee40066f30 0x7fee400693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee540c65c0 tx=0x7fee48007b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.004+0000 7fee3affd700 1 -- 172.21.15.86:0/1450984401 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee4404e5a0 con 0x7fee54159420 2023-10-09T11:41:25.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.191+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee540b1790 con 0x7fee40066f30 2023-10-09T11:41:25.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.199+0000 7fee3affd700 1 -- 172.21.15.86:0/1450984401 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264554 (secure 0 0 0) 0x7fee540b1790 con 0x7fee40066f30 2023-10-09T11:41:25.203 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fee40066f30 msgr2=0x7fee400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fee40066f30 0x7fee400693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fee540c65c0 tx=0x7fee48007b40 comp rx=0 tx=0).stop 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee54159420 msgr2=0x7fee54169490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee54159420 0x7fee54169490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee4400d1d0 tx=0x7fee44009a90 comp rx=0 tx=0).stop 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 shutdown_connections 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fee40066f30 0x7fee400693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee54159420 0x7fee54169490 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee5415d230 0x7fee54155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 --2- 172.21.15.86:0/1450984401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee541597f0 0x7fee540c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 >> 172.21.15.86:0/1450984401 conn(0x7fee540d0660 msgr2=0x7fee540689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 shutdown_connections 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.203+0000 7fee53fff700 1 -- 172.21.15.86:0/1450984401 wait complete. 2023-10-09T11:41:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:41:25.221 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-09T11:41:23.955376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.919517"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071394+0000","last_change":"2023-10-09T11:41:12.064188+0000","last_active":"2023-10-09T11:41:12.071394+0000","last_peered":"2023-10-09T11:41:12.071394+0000","last_clean":"2023-10-09T11:41:12.071394+0000","last_became_active":"2023-10-09T11:41:12.063875+0000","last_became_peered":"2023-10-09T11:41:12.063875+0000","last_unstale":"2023-10-09T11:41:12.071394+0000","last_undegraded":"2023-10-09T11:41:12.071394+0000","last_fullsized":"2023-10-09T11:41:12.071394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058844+0000","last_change":"2023-10-09T11:41:12.053292+0000","last_active":"2023-10-09T11:41:12.058844+0000","last_peered":"2023-10-09T11:41:12.058844+0000","last_clean":"2023-10-09T11:41:12.058844+0000","last_became_active":"2023-10-09T11:41:12.052978+0000","last_became_peered":"2023-10-09T11:41:12.052978+0000","last_unstale":"2023-10-09T11:41:12.058844+0000","last_undegraded":"2023-10-09T11:41:12.058844+0000","last_fullsized":"2023-10-09T11:41:12.058844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053403+0000","last_change":"2023-10-09T11:41:12.048670+0000","last_active":"2023-10-09T11:41:12.053403+0000","last_peered":"2023-10-09T11:41:12.053403+0000","last_clean":"2023-10-09T11:41:12.053403+0000","last_became_active":"2023-10-09T11:41:12.048364+0000","last_became_peered":"2023-10-09T11:41:12.048364+0000","last_unstale":"2023-10-09T11:41:12.053403+0000","last_undegraded":"2023-10-09T11:41:12.053403+0000","last_fullsized":"2023-10-09T11:41:12.053403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065349+0000","last_change":"2023-10-09T11:41:12.062125+0000","last_active":"2023-10-09T11:41:12.065349+0000","last_peered":"2023-10-09T11:41:12.065349+0000","last_clean":"2023-10-09T11:41:12.065349+0000","last_became_active":"2023-10-09T11:41:12.061872+0000","last_became_peered":"2023-10-09T11:41:12.061872+0000","last_unstale":"2023-10-09T11:41:12.065349+0000","last_undegraded":"2023-10-09T11:41:12.065349+0000","last_fullsized":"2023-10-09T11:41:12.065349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052679+0000","last_change":"2023-10-09T11:41:12.049492+0000","last_active":"2023-10-09T11:41:12.052679+0000","last_peered":"2023-10-09T11:41:12.052679+0000","last_clean":"2023-10-09T11:41:12.052679+0000","last_became_active":"2023-10-09T11:41:12.049220+0000","last_became_peered":"2023-10-09T11:41:12.049220+0000","last_unstale":"2023-10-09T11:41:12.052679+0000","last_undegraded":"2023-10-09T11:41:12.052679+0000","last_fullsized":"2023-10-09T11:41:12.052679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070457+0000","last_change":"2023-10-09T11:41:12.065396+0000","last_active":"2023-10-09T11:41:12.070457+0000","last_peered":"2023-10-09T11:41:12.070457+0000","last_clean":"2023-10-09T11:41:12.070457+0000","last_became_active":"2023-10-09T11:41:12.065090+0000","last_became_peered":"2023-10-09T11:41:12.065090+0000","last_unstale":"2023-10-09T11:41:12.070457+0000","last_undegraded":"2023-10-09T11:41:12.070457+0000","last_fullsized":"2023-10-09T11:41:12.070457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:58.461496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071362+0000","last_change":"2023-10-09T11:41:12.063605+0000","last_active":"2023-10-09T11:41:12.071362+0000","last_peered":"2023-10-09T11:41:12.071362+0000","last_clean":"2023-10-09T11:41:12.071362+0000","last_became_active":"2023-10-09T11:41:12.063327+0000","last_became_peered":"2023-10-09T11:41:12.063327+0000","last_unstale":"2023-10-09T11:41:12.071362+0000","last_undegraded":"2023-10-09T11:41:12.071362+0000","last_fullsized":"2023-10-09T11:41:12.071362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059474+0000","last_change":"2023-10-09T11:41:12.054453+0000","last_active":"2023-10-09T11:41:12.059474+0000","last_peered":"2023-10-09T11:41:12.059474+0000","last_clean":"2023-10-09T11:41:12.059474+0000","last_became_active":"2023-10-09T11:41:12.054117+0000","last_became_peered":"2023-10-09T11:41:12.054117+0000","last_unstale":"2023-10-09T11:41:12.059474+0000","last_undegraded":"2023-10-09T11:41:12.059474+0000","last_fullsized":"2023-10-09T11:41:12.059474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.054577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071695+0000","last_change":"2023-10-09T11:41:12.064789+0000","last_active":"2023-10-09T11:41:12.071695+0000","last_peered":"2023-10-09T11:41:12.071695+0000","last_clean":"2023-10-09T11:41:12.071695+0000","last_became_active":"2023-10-09T11:41:12.064496+0000","last_became_peered":"2023-10-09T11:41:12.064496+0000","last_unstale":"2023-10-09T11:41:12.071695+0000","last_undegraded":"2023-10-09T11:41:12.071695+0000","last_fullsized":"2023-10-09T11:41:12.071695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:04.019082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061611+0000","last_change":"2023-10-09T11:41:12.057786+0000","last_active":"2023-10-09T11:41:12.061611+0000","last_peered":"2023-10-09T11:41:12.061611+0000","last_clean":"2023-10-09T11:41:12.061611+0000","last_became_active":"2023-10-09T11:41:12.057470+0000","last_became_peered":"2023-10-09T11:41:12.057470+0000","last_unstale":"2023-10-09T11:41:12.061611+0000","last_undegraded":"2023-10-09T11:41:12.061611+0000","last_fullsized":"2023-10-09T11:41:12.061611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061547+0000","last_change":"2023-10-09T11:41:12.057855+0000","last_active":"2023-10-09T11:41:12.061547+0000","last_peered":"2023-10-09T11:41:12.061547+0000","last_clean":"2023-10-09T11:41:12.061547+0000","last_became_active":"2023-10-09T11:41:12.057494+0000","last_became_peered":"2023-10-09T11:41:12.057494+0000","last_unstale":"2023-10-09T11:41:12.061547+0000","last_undegraded":"2023-10-09T11:41:12.061547+0000","last_fullsized":"2023-10-09T11:41:12.061547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055353+0000","last_change":"2023-10-09T11:41:12.048796+0000","last_active":"2023-10-09T11:41:12.055353+0000","last_peered":"2023-10-09T11:41:12.055353+0000","last_clean":"2023-10-09T11:41:12.055353+0000","last_became_active":"2023-10-09T11:41:12.048484+0000","last_became_peered":"2023-10-09T11:41:12.048484+0000","last_unstale":"2023-10-09T11:41:12.055353+0000","last_undegraded":"2023-10-09T11:41:12.055353+0000","last_fullsized":"2023-10-09T11:41:12.055353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:11.286540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059423+0000","last_change":"2023-10-09T11:41:12.052334+0000","last_active":"2023-10-09T11:41:12.059423+0000","last_peered":"2023-10-09T11:41:12.059423+0000","last_clean":"2023-10-09T11:41:12.059423+0000","last_became_active":"2023-10-09T11:41:12.051731+0000","last_became_peered":"2023-10-09T11:41:12.051731+0000","last_unstale":"2023-10-09T11:41:12.059423+0000","last_undegraded":"2023-10-09T11:41:12.059423+0000","last_fullsized":"2023-10-09T11:41:12.059423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:25.351610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053609+0000","last_change":"2023-10-09T11:41:12.051643+0000","last_active":"2023-10-09T11:41:12.053609+0000","last_peered":"2023-10-09T11:41:12.053609+0000","last_clean":"2023-10-09T11:41:12.053609+0000","last_became_active":"2023-10-09T11:41:12.051337+0000","last_became_peered":"2023-10-09T11:41:12.051337+0000","last_unstale":"2023-10-09T11:41:12.053609+0000","last_undegraded":"2023-10-09T11:41:12.053609+0000","last_fullsized":"2023-10-09T11:41:12.053609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:10.056568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059700+0000","last_change":"2023-10-09T11:41:12.058090+0000","last_active":"2023-10-09T11:41:12.059700+0000","last_peered":"2023-10-09T11:41:12.059700+0000","last_clean":"2023-10-09T11:41:12.059700+0000","last_became_active":"2023-10-09T11:41:12.057829+0000","last_became_peered":"2023-10-09T11:41:12.057829+0000","last_unstale":"2023-10-09T11:41:12.059700+0000","last_undegraded":"2023-10-09T11:41:12.059700+0000","last_fullsized":"2023-10-09T11:41:12.059700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064496+0000","last_change":"2023-10-09T11:41:12.059376+0000","last_active":"2023-10-09T11:41:12.064496+0000","last_peered":"2023-10-09T11:41:12.064496+0000","last_clean":"2023-10-09T11:41:12.064496+0000","last_became_active":"2023-10-09T11:41:12.059105+0000","last_became_peered":"2023-10-09T11:41:12.059105+0000","last_unstale":"2023-10-09T11:41:12.064496+0000","last_undegraded":"2023-10-09T11:41:12.064496+0000","last_fullsized":"2023-10-09T11:41:12.064496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.070447+0000","last_change":"2023-10-09T11:41:12.064945+0000","last_active":"2023-10-09T11:41:12.070447+0000","last_peered":"2023-10-09T11:41:12.070447+0000","last_clean":"2023-10-09T11:41:12.070447+0000","last_became_active":"2023-10-09T11:41:12.064668+0000","last_became_peered":"2023-10-09T11:41:12.064668+0000","last_unstale":"2023-10-09T11:41:12.070447+0000","last_undegraded":"2023-10-09T11:41:12.070447+0000","last_fullsized":"2023-10-09T11:41:12.070447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052841+0000","last_change":"2023-10-09T11:41:12.049265+0000","last_active":"2023-10-09T11:41:12.052841+0000","last_peered":"2023-10-09T11:41:12.052841+0000","last_clean":"2023-10-09T11:41:12.052841+0000","last_became_active":"2023-10-09T11:41:12.049000+0000","last_became_peered":"2023-10-09T11:41:12.049000+0000","last_unstale":"2023-10-09T11:41:12.052841+0000","last_undegraded":"2023-10-09T11:41:12.052841+0000","last_fullsized":"2023-10-09T11:41:12.052841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:17.015986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064795+0000","last_change":"2023-10-09T11:41:12.052554+0000","last_active":"2023-10-09T11:41:12.064795+0000","last_peered":"2023-10-09T11:41:12.064795+0000","last_clean":"2023-10-09T11:41:12.064795+0000","last_became_active":"2023-10-09T11:41:12.050539+0000","last_became_peered":"2023-10-09T11:41:12.050539+0000","last_unstale":"2023-10-09T11:41:12.064795+0000","last_undegraded":"2023-10-09T11:41:12.064795+0000","last_fullsized":"2023-10-09T11:41:12.064795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:23.983289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.088830+0000","last_change":"2023-10-09T11:41:11.074267+0000","last_active":"2023-10-09T11:41:12.088830+0000","last_peered":"2023-10-09T11:41:12.088830+0000","last_clean":"2023-10-09T11:41:12.088830+0000","last_became_active":"2023-10-09T11:41:11.073971+0000","last_became_peered":"2023-10-09T11:41:11.073971+0000","last_unstale":"2023-10-09T11:41:12.088830+0000","last_undegraded":"2023-10-09T11:41:12.088830+0000","last_fullsized":"2023-10-09T11:41:12.088830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:17.546372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059770+0000","last_change":"2023-10-09T11:41:12.054265+0000","last_active":"2023-10-09T11:41:12.059770+0000","last_peered":"2023-10-09T11:41:12.059770+0000","last_clean":"2023-10-09T11:41:12.059770+0000","last_became_active":"2023-10-09T11:41:12.053826+0000","last_became_peered":"2023-10-09T11:41:12.053826+0000","last_unstale":"2023-10-09T11:41:12.059770+0000","last_undegraded":"2023-10-09T11:41:12.059770+0000","last_fullsized":"2023-10-09T11:41:12.059770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:00.372669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.085137+0000","last_change":"2023-10-09T11:41:11.063441+0000","last_active":"2023-10-09T11:41:12.085137+0000","last_peered":"2023-10-09T11:41:12.085137+0000","last_clean":"2023-10-09T11:41:12.085137+0000","last_became_active":"2023-10-09T11:41:11.063025+0000","last_became_peered":"2023-10-09T11:41:11.063025+0000","last_unstale":"2023-10-09T11:41:12.085137+0000","last_undegraded":"2023-10-09T11:41:12.085137+0000","last_fullsized":"2023-10-09T11:41:12.085137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:21:21.843438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063925+0000","last_change":"2023-10-09T11:41:12.058625+0000","last_active":"2023-10-09T11:41:12.063925+0000","last_peered":"2023-10-09T11:41:12.063925+0000","last_clean":"2023-10-09T11:41:12.063925+0000","last_became_active":"2023-10-09T11:41:12.057462+0000","last_became_peered":"2023-10-09T11:41:12.057462+0000","last_unstale":"2023-10-09T11:41:12.063925+0000","last_undegraded":"2023-10-09T11:41:12.063925+0000","last_fullsized":"2023-10-09T11:41:12.063925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086798+0000","last_change":"2023-10-09T11:41:11.079554+0000","last_active":"2023-10-09T11:41:12.086798+0000","last_peered":"2023-10-09T11:41:12.086798+0000","last_clean":"2023-10-09T11:41:12.086798+0000","last_became_active":"2023-10-09T11:41:11.079230+0000","last_became_peered":"2023-10-09T11:41:11.079230+0000","last_unstale":"2023-10-09T11:41:12.086798+0000","last_undegraded":"2023-10-09T11:41:12.086798+0000","last_fullsized":"2023-10-09T11:41:12.086798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064686+0000","last_change":"2023-10-09T11:41:12.060600+0000","last_active":"2023-10-09T11:41:12.064686+0000","last_peered":"2023-10-09T11:41:12.064686+0000","last_clean":"2023-10-09T11:41:12.064686+0000","last_became_active":"2023-10-09T11:41:12.060325+0000","last_became_peered":"2023-10-09T11:41:12.060325+0000","last_unstale":"2023-10-09T11:41:12.064686+0000","last_undegraded":"2023-10-09T11:41:12.064686+0000","last_fullsized":"2023-10-09T11:41:12.064686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:12.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086427+0000","last_change":"2023-10-09T11:41:11.082099+0000","last_active":"2023-10-09T11:41:12.086427+0000","last_peered":"2023-10-09T11:41:12.086427+0000","last_clean":"2023-10-09T11:41:12.086427+0000","last_became_active":"2023-10-09T11:41:11.081703+0000","last_became_peered":"2023-10-09T11:41:11.081703+0000","last_unstale":"2023-10-09T11:41:12.086427+0000","last_undegraded":"2023-10-09T11:41:12.086427+0000","last_fullsized":"2023-10-09T11:41:12.086427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:59.333597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066051+0000","last_change":"2023-10-09T11:41:12.059389+0000","last_active":"2023-10-09T11:41:12.066051+0000","last_peered":"2023-10-09T11:41:12.066051+0000","last_clean":"2023-10-09T11:41:12.066051+0000","last_became_active":"2023-10-09T11:41:12.059089+0000","last_became_peered":"2023-10-09T11:41:12.059089+0000","last_unstale":"2023-10-09T11:41:12.066051+0000","last_undegraded":"2023-10-09T11:41:12.066051+0000","last_fullsized":"2023-10-09T11:41:12.066051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:22.218524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086469+0000","last_change":"2023-10-09T11:41:11.074679+0000","last_active":"2023-10-09T11:41:12.086469+0000","last_peered":"2023-10-09T11:41:12.086469+0000","last_clean":"2023-10-09T11:41:12.086469+0000","last_became_active":"2023-10-09T11:41:11.074362+0000","last_became_peered":"2023-10-09T11:41:11.074362+0000","last_unstale":"2023-10-09T11:41:12.086469+0000","last_undegraded":"2023-10-09T11:41:12.086469+0000","last_fullsized":"2023-10-09T11:41:12.086469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055401+0000","last_change":"2023-10-09T11:41:12.048767+0000","last_active":"2023-10-09T11:41:12.055401+0000","last_peered":"2023-10-09T11:41:12.055401+0000","last_clean":"2023-10-09T11:41:12.055401+0000","last_became_active":"2023-10-09T11:41:12.048451+0000","last_became_peered":"2023-10-09T11:41:12.048451+0000","last_unstale":"2023-10-09T11:41:12.055401+0000","last_undegraded":"2023-10-09T11:41:12.055401+0000","last_fullsized":"2023-10-09T11:41:12.055401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:29.034914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087372+0000","last_change":"2023-10-09T11:41:11.068876+0000","last_active":"2023-10-09T11:41:12.087372+0000","last_peered":"2023-10-09T11:41:12.087372+0000","last_clean":"2023-10-09T11:41:12.087372+0000","last_became_active":"2023-10-09T11:41:11.068602+0000","last_became_peered":"2023-10-09T11:41:11.068602+0000","last_unstale":"2023-10-09T11:41:12.087372+0000","last_undegraded":"2023-10-09T11:41:12.087372+0000","last_fullsized":"2023-10-09T11:41:12.087372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063758+0000","last_change":"2023-10-09T11:41:12.058551+0000","last_active":"2023-10-09T11:41:12.063758+0000","last_peered":"2023-10-09T11:41:12.063758+0000","last_clean":"2023-10-09T11:41:12.063758+0000","last_became_active":"2023-10-09T11:41:12.056962+0000","last_became_peered":"2023-10-09T11:41:12.056962+0000","last_unstale":"2023-10-09T11:41:12.063758+0000","last_undegraded":"2023-10-09T11:41:12.063758+0000","last_fullsized":"2023-10-09T11:41:12.063758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.038859+0000","last_change":"2023-10-09T11:41:11.072956+0000","last_active":"2023-10-09T11:41:12.038859+0000","last_peered":"2023-10-09T11:41:12.038859+0000","last_clean":"2023-10-09T11:41:12.038859+0000","last_became_active":"2023-10-09T11:41:11.072711+0000","last_became_peered":"2023-10-09T11:41:11.072711+0000","last_unstale":"2023-10-09T11:41:12.038859+0000","last_undegraded":"2023-10-09T11:41:12.038859+0000","last_fullsized":"2023-10-09T11:41:12.038859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060221+0000","last_change":"2023-10-09T11:41:12.056233+0000","last_active":"2023-10-09T11:41:12.060221+0000","last_peered":"2023-10-09T11:41:12.060221+0000","last_clean":"2023-10-09T11:41:12.060221+0000","last_became_active":"2023-10-09T11:41:12.055836+0000","last_became_peered":"2023-10-09T11:41:12.055836+0000","last_unstale":"2023-10-09T11:41:12.060221+0000","last_undegraded":"2023-10-09T11:41:12.060221+0000","last_fullsized":"2023-10-09T11:41:12.060221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.076596+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.075211+0000","last_became_peered":"2023-10-09T11:41:11.075211+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:26.308196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061196+0000","last_change":"2023-10-09T11:41:12.059816+0000","last_active":"2023-10-09T11:41:12.061196+0000","last_peered":"2023-10-09T11:41:12.061196+0000","last_clean":"2023-10-09T11:41:12.061196+0000","last_became_active":"2023-10-09T11:41:12.059529+0000","last_became_peered":"2023-10-09T11:41:12.059529+0000","last_unstale":"2023-10-09T11:41:12.061196+0000","last_undegraded":"2023-10-09T11:41:12.061196+0000","last_fullsized":"2023-10-09T11:41:12.061196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043525+0000","last_change":"2023-10-09T11:41:11.077704+0000","last_active":"2023-10-09T11:41:12.043525+0000","last_peered":"2023-10-09T11:41:12.043525+0000","last_clean":"2023-10-09T11:41:12.043525+0000","last_became_active":"2023-10-09T11:41:11.077405+0000","last_became_peered":"2023-10-09T11:41:11.077405+0000","last_unstale":"2023-10-09T11:41:12.043525+0000","last_undegraded":"2023-10-09T11:41:12.043525+0000","last_fullsized":"2023-10-09T11:41:12.043525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064572+0000","last_change":"2023-10-09T11:41:12.060375+0000","last_active":"2023-10-09T11:41:12.064572+0000","last_peered":"2023-10-09T11:41:12.064572+0000","last_clean":"2023-10-09T11:41:12.064572+0000","last_became_active":"2023-10-09T11:41:12.060103+0000","last_became_peered":"2023-10-09T11:41:12.060103+0000","last_unstale":"2023-10-09T11:41:12.064572+0000","last_undegraded":"2023-10-09T11:41:12.064572+0000","last_fullsized":"2023-10-09T11:41:12.064572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055192+0000","last_change":"2023-10-09T11:41:11.071764+0000","last_active":"2023-10-09T11:41:12.055192+0000","last_peered":"2023-10-09T11:41:12.055192+0000","last_clean":"2023-10-09T11:41:12.055192+0000","last_became_active":"2023-10-09T11:41:11.070619+0000","last_became_peered":"2023-10-09T11:41:11.070619+0000","last_unstale":"2023-10-09T11:41:12.055192+0000","last_undegraded":"2023-10-09T11:41:12.055192+0000","last_fullsized":"2023-10-09T11:41:12.055192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063724+0000","last_change":"2023-10-09T11:41:12.057796+0000","last_active":"2023-10-09T11:41:12.063724+0000","last_peered":"2023-10-09T11:41:12.063724+0000","last_clean":"2023-10-09T11:41:12.063724+0000","last_became_active":"2023-10-09T11:41:12.057536+0000","last_became_peered":"2023-10-09T11:41:12.057536+0000","last_unstale":"2023-10-09T11:41:12.063724+0000","last_undegraded":"2023-10-09T11:41:12.063724+0000","last_fullsized":"2023-10-09T11:41:12.063724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086648+0000","last_change":"2023-10-09T11:41:11.077183+0000","last_active":"2023-10-09T11:41:12.086648+0000","last_peered":"2023-10-09T11:41:12.086648+0000","last_clean":"2023-10-09T11:41:12.086648+0000","last_became_active":"2023-10-09T11:41:11.076940+0000","last_became_peered":"2023-10-09T11:41:11.076940+0000","last_unstale":"2023-10-09T11:41:12.086648+0000","last_undegraded":"2023-10-09T11:41:12.086648+0000","last_fullsized":"2023-10-09T11:41:12.086648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055266+0000","last_change":"2023-10-09T11:41:12.048070+0000","last_active":"2023-10-09T11:41:12.055266+0000","last_peered":"2023-10-09T11:41:12.055266+0000","last_clean":"2023-10-09T11:41:12.055266+0000","last_became_active":"2023-10-09T11:41:12.047867+0000","last_became_peered":"2023-10-09T11:41:12.047867+0000","last_unstale":"2023-10-09T11:41:12.055266+0000","last_undegraded":"2023-10-09T11:41:12.055266+0000","last_fullsized":"2023-10-09T11:41:12.055266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:01.222208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.089647+0000","last_change":"2023-10-09T11:41:11.068939+0000","last_active":"2023-10-09T11:41:12.089647+0000","last_peered":"2023-10-09T11:41:12.089647+0000","last_clean":"2023-10-09T11:41:12.089647+0000","last_became_active":"2023-10-09T11:41:11.068555+0000","last_became_peered":"2023-10-09T11:41:11.068555+0000","last_unstale":"2023-10-09T11:41:12.089647+0000","last_undegraded":"2023-10-09T11:41:12.089647+0000","last_fullsized":"2023-10-09T11:41:12.089647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.064816+0000","last_change":"2023-10-09T11:41:12.058308+0000","last_active":"2023-10-09T11:41:12.064816+0000","last_peered":"2023-10-09T11:41:12.064816+0000","last_clean":"2023-10-09T11:41:12.064816+0000","last_became_active":"2023-10-09T11:41:12.057987+0000","last_became_peered":"2023-10-09T11:41:12.057987+0000","last_unstale":"2023-10-09T11:41:12.064816+0000","last_undegraded":"2023-10-09T11:41:12.064816+0000","last_fullsized":"2023-10-09T11:41:12.064816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:47.920614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086499+0000","last_change":"2023-10-09T11:41:11.065387+0000","last_active":"2023-10-09T11:41:12.086499+0000","last_peered":"2023-10-09T11:41:12.086499+0000","last_clean":"2023-10-09T11:41:12.086499+0000","last_became_active":"2023-10-09T11:41:11.065121+0000","last_became_peered":"2023-10-09T11:41:11.065121+0000","last_unstale":"2023-10-09T11:41:12.086499+0000","last_undegraded":"2023-10-09T11:41:12.086499+0000","last_fullsized":"2023-10-09T11:41:12.086499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:19.832054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053962+0000","last_change":"2023-10-09T11:41:12.052247+0000","last_active":"2023-10-09T11:41:12.053962+0000","last_peered":"2023-10-09T11:41:12.053962+0000","last_clean":"2023-10-09T11:41:12.053962+0000","last_became_active":"2023-10-09T11:41:12.051882+0000","last_became_peered":"2023-10-09T11:41:12.051882+0000","last_unstale":"2023-10-09T11:41:12.053962+0000","last_undegraded":"2023-10-09T11:41:12.053962+0000","last_fullsized":"2023-10-09T11:41:12.053962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:52.851244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052727+0000","last_change":"2023-10-09T11:41:11.077221+0000","last_active":"2023-10-09T11:41:12.052727+0000","last_peered":"2023-10-09T11:41:12.052727+0000","last_clean":"2023-10-09T11:41:12.052727+0000","last_became_active":"2023-10-09T11:41:11.075558+0000","last_became_peered":"2023-10-09T11:41:11.075558+0000","last_unstale":"2023-10-09T11:41:12.052727+0000","last_undegraded":"2023-10-09T11:41:12.052727+0000","last_fullsized":"2023-10-09T11:41:12.052727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071415+0000","last_change":"2023-10-09T11:41:12.064288+0000","last_active":"2023-10-09T11:41:12.071415+0000","last_peered":"2023-10-09T11:41:12.071415+0000","last_clean":"2023-10-09T11:41:12.071415+0000","last_became_active":"2023-10-09T11:41:12.064017+0000","last_became_peered":"2023-10-09T11:41:12.064017+0000","last_unstale":"2023-10-09T11:41:12.071415+0000","last_undegraded":"2023-10-09T11:41:12.071415+0000","last_fullsized":"2023-10-09T11:41:12.071415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043298+0000","last_change":"2023-10-09T11:41:11.069670+0000","last_active":"2023-10-09T11:41:12.043298+0000","last_peered":"2023-10-09T11:41:12.043298+0000","last_clean":"2023-10-09T11:41:12.043298+0000","last_became_active":"2023-10-09T11:41:11.069325+0000","last_became_peered":"2023-10-09T11:41:11.069325+0000","last_unstale":"2023-10-09T11:41:12.043298+0000","last_undegraded":"2023-10-09T11:41:12.043298+0000","last_fullsized":"2023-10-09T11:41:12.043298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058961+0000","last_change":"2023-10-09T11:41:12.054973+0000","last_active":"2023-10-09T11:41:12.058961+0000","last_peered":"2023-10-09T11:41:12.058961+0000","last_clean":"2023-10-09T11:41:12.058961+0000","last_became_active":"2023-10-09T11:41:12.054637+0000","last_became_peered":"2023-10-09T11:41:12.054637+0000","last_unstale":"2023-10-09T11:41:12.058961+0000","last_undegraded":"2023-10-09T11:41:12.058961+0000","last_fullsized":"2023-10-09T11:41:12.058961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:31.358034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.087283+0000","last_change":"2023-10-09T11:41:11.066464+0000","last_active":"2023-10-09T11:41:12.087283+0000","last_peered":"2023-10-09T11:41:12.087283+0000","last_clean":"2023-10-09T11:41:12.087283+0000","last_became_active":"2023-10-09T11:41:11.066166+0000","last_became_peered":"2023-10-09T11:41:11.066166+0000","last_unstale":"2023-10-09T11:41:12.087283+0000","last_undegraded":"2023-10-09T11:41:12.087283+0000","last_fullsized":"2023-10-09T11:41:12.087283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:02.875341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071715+0000","last_change":"2023-10-09T11:41:12.065762+0000","last_active":"2023-10-09T11:41:12.071715+0000","last_peered":"2023-10-09T11:41:12.071715+0000","last_clean":"2023-10-09T11:41:12.071715+0000","last_became_active":"2023-10-09T11:41:12.065421+0000","last_became_peered":"2023-10-09T11:41:12.065421+0000","last_unstale":"2023-10-09T11:41:12.071715+0000","last_undegraded":"2023-10-09T11:41:12.071715+0000","last_fullsized":"2023-10-09T11:41:12.071715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084177+0000","last_change":"2023-10-09T11:41:11.065898+0000","last_active":"2023-10-09T11:41:12.084177+0000","last_peered":"2023-10-09T11:41:12.084177+0000","last_clean":"2023-10-09T11:41:12.084177+0000","last_became_active":"2023-10-09T11:41:11.065594+0000","last_became_peered":"2023-10-09T11:41:11.065594+0000","last_unstale":"2023-10-09T11:41:12.084177+0000","last_undegraded":"2023-10-09T11:41:12.084177+0000","last_fullsized":"2023-10-09T11:41:12.084177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:25:55.877969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071698+0000","last_change":"2023-10-09T11:41:12.064978+0000","last_active":"2023-10-09T11:41:12.071698+0000","last_peered":"2023-10-09T11:41:12.071698+0000","last_clean":"2023-10-09T11:41:12.071698+0000","last_became_active":"2023-10-09T11:41:12.064674+0000","last_became_peered":"2023-10-09T11:41:12.064674+0000","last_unstale":"2023-10-09T11:41:12.071698+0000","last_undegraded":"2023-10-09T11:41:12.071698+0000","last_fullsized":"2023-10-09T11:41:12.071698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:06.365514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045586+0000","last_change":"2023-10-09T11:41:11.062024+0000","last_active":"2023-10-09T11:41:12.045586+0000","last_peered":"2023-10-09T11:41:12.045586+0000","last_clean":"2023-10-09T11:41:12.045586+0000","last_became_active":"2023-10-09T11:41:11.061759+0000","last_became_peered":"2023-10-09T11:41:11.061759+0000","last_unstale":"2023-10-09T11:41:12.045586+0000","last_undegraded":"2023-10-09T11:41:12.045586+0000","last_fullsized":"2023-10-09T11:41:12.045586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:28.481101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.066071+0000","last_change":"2023-10-09T11:41:12.062692+0000","last_active":"2023-10-09T11:41:12.066071+0000","last_peered":"2023-10-09T11:41:12.066071+0000","last_clean":"2023-10-09T11:41:12.066071+0000","last_became_active":"2023-10-09T11:41:12.062415+0000","last_became_peered":"2023-10-09T11:41:12.062415+0000","last_unstale":"2023-10-09T11:41:12.066071+0000","last_undegraded":"2023-10-09T11:41:12.066071+0000","last_fullsized":"2023-10-09T11:41:12.066071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:52.277407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052588+0000","last_change":"2023-10-09T11:41:11.077710+0000","last_active":"2023-10-09T11:41:12.052588+0000","last_peered":"2023-10-09T11:41:12.052588+0000","last_clean":"2023-10-09T11:41:12.052588+0000","last_became_active":"2023-10-09T11:41:11.077435+0000","last_became_peered":"2023-10-09T11:41:11.077435+0000","last_unstale":"2023-10-09T11:41:12.052588+0000","last_undegraded":"2023-10-09T11:41:12.052588+0000","last_fullsized":"2023-10-09T11:41:12.052588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058902+0000","last_change":"2023-10-09T11:41:12.051806+0000","last_active":"2023-10-09T11:41:12.058902+0000","last_peered":"2023-10-09T11:41:12.058902+0000","last_clean":"2023-10-09T11:41:12.058902+0000","last_became_active":"2023-10-09T11:41:12.051462+0000","last_became_peered":"2023-10-09T11:41:12.051462+0000","last_unstale":"2023-10-09T11:41:12.058902+0000","last_undegraded":"2023-10-09T11:41:12.058902+0000","last_fullsized":"2023-10-09T11:41:12.058902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.792528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055235+0000","last_change":"2023-10-09T11:41:12.048312+0000","last_active":"2023-10-09T11:41:12.055235+0000","last_peered":"2023-10-09T11:41:12.055235+0000","last_clean":"2023-10-09T11:41:12.055235+0000","last_became_active":"2023-10-09T11:41:12.048029+0000","last_became_peered":"2023-10-09T11:41:12.048029+0000","last_unstale":"2023-10-09T11:41:12.055235+0000","last_undegraded":"2023-10-09T11:41:12.055235+0000","last_fullsized":"2023-10-09T11:41:12.055235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044145+0000","last_change":"2023-10-09T11:41:11.065740+0000","last_active":"2023-10-09T11:41:12.044145+0000","last_peered":"2023-10-09T11:41:12.044145+0000","last_clean":"2023-10-09T11:41:12.044145+0000","last_became_active":"2023-10-09T11:41:11.065420+0000","last_became_peered":"2023-10-09T11:41:11.065420+0000","last_unstale":"2023-10-09T11:41:12.044145+0000","last_undegraded":"2023-10-09T11:41:12.044145+0000","last_fullsized":"2023-10-09T11:41:12.044145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:45.061674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.067543+0000","last_change":"2023-10-09T11:41:12.063341+0000","last_active":"2023-10-09T11:41:12.067543+0000","last_peered":"2023-10-09T11:41:12.067543+0000","last_clean":"2023-10-09T11:41:12.067543+0000","last_became_active":"2023-10-09T11:41:12.063063+0000","last_became_peered":"2023-10-09T11:41:12.063063+0000","last_unstale":"2023-10-09T11:41:12.067543+0000","last_undegraded":"2023-10-09T11:41:12.067543+0000","last_fullsized":"2023-10-09T11:41:12.067543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.167644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.052738+0000","last_change":"2023-10-09T11:41:11.064371+0000","last_active":"2023-10-09T11:41:12.052738+0000","last_peered":"2023-10-09T11:41:12.052738+0000","last_clean":"2023-10-09T11:41:12.052738+0000","last_became_active":"2023-10-09T11:41:11.064027+0000","last_became_peered":"2023-10-09T11:41:11.064027+0000","last_unstale":"2023-10-09T11:41:12.052738+0000","last_undegraded":"2023-10-09T11:41:12.052738+0000","last_fullsized":"2023-10-09T11:41:12.052738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044083+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:41:12.044083+0000","last_peered":"2023-10-09T11:41:12.044083+0000","last_clean":"2023-10-09T11:41:12.044083+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:41:12.044083+0000","last_undegraded":"2023-10-09T11:41:12.044083+0000","last_fullsized":"2023-10-09T11:41:12.044083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063606+0000","last_change":"2023-10-09T11:41:12.057248+0000","last_active":"2023-10-09T11:41:12.063606+0000","last_peered":"2023-10-09T11:41:12.063606+0000","last_clean":"2023-10-09T11:41:12.063606+0000","last_became_active":"2023-10-09T11:41:12.056873+0000","last_became_peered":"2023-10-09T11:41:12.056873+0000","last_unstale":"2023-10-09T11:41:12.063606+0000","last_undegraded":"2023-10-09T11:41:12.063606+0000","last_fullsized":"2023-10-09T11:41:12.063606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:16.551009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044184+0000","last_change":"2023-10-09T11:41:11.079718+0000","last_active":"2023-10-09T11:41:12.044184+0000","last_peered":"2023-10-09T11:41:12.044184+0000","last_clean":"2023-10-09T11:41:12.044184+0000","last_became_active":"2023-10-09T11:41:11.079488+0000","last_became_peered":"2023-10-09T11:41:11.079488+0000","last_unstale":"2023-10-09T11:41:12.044184+0000","last_undegraded":"2023-10-09T11:41:12.044184+0000","last_fullsized":"2023-10-09T11:41:12.044184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:10.281538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043828+0000","last_change":"2023-10-09T11:41:11.075456+0000","last_active":"2023-10-09T11:41:12.043828+0000","last_peered":"2023-10-09T11:41:12.043828+0000","last_clean":"2023-10-09T11:41:12.043828+0000","last_became_active":"2023-10-09T11:41:11.074500+0000","last_became_peered":"2023-10-09T11:41:11.074500+0000","last_unstale":"2023-10-09T11:41:12.043828+0000","last_undegraded":"2023-10-09T11:41:12.043828+0000","last_fullsized":"2023-10-09T11:41:12.043828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:06.661001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055214+0000","last_change":"2023-10-09T11:41:12.050593+0000","last_active":"2023-10-09T11:41:12.055214+0000","last_peered":"2023-10-09T11:41:12.055214+0000","last_clean":"2023-10-09T11:41:12.055214+0000","last_became_active":"2023-10-09T11:41:12.050327+0000","last_became_peered":"2023-10-09T11:41:12.050327+0000","last_unstale":"2023-10-09T11:41:12.055214+0000","last_undegraded":"2023-10-09T11:41:12.055214+0000","last_fullsized":"2023-10-09T11:41:12.055214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:11.446435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-09T11:41:13.038153+0000","last_change":"2023-10-09T11:41:11.062590+0000","last_active":"2023-10-09T11:41:13.038153+0000","last_peered":"2023-10-09T11:41:13.038153+0000","last_clean":"2023-10-09T11:41:13.038153+0000","last_became_active":"2023-10-09T11:41:11.062303+0000","last_became_peered":"2023-10-09T11:41:11.062303+0000","last_unstale":"2023-10-09T11:41:13.038153+0000","last_undegraded":"2023-10-09T11:41:13.038153+0000","last_fullsized":"2023-10-09T11:41:13.038153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:10.309300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062836+0000","last_change":"2023-10-09T11:41:12.059380+0000","last_active":"2023-10-09T11:41:12.062836+0000","last_peered":"2023-10-09T11:41:12.062836+0000","last_clean":"2023-10-09T11:41:12.062836+0000","last_became_active":"2023-10-09T11:41:12.059091+0000","last_became_peered":"2023-10-09T11:41:12.059091+0000","last_unstale":"2023-10-09T11:41:12.062836+0000","last_undegraded":"2023-10-09T11:41:12.062836+0000","last_fullsized":"2023-10-09T11:41:12.062836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:41.207515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086758+0000","last_change":"2023-10-09T11:41:11.074722+0000","last_active":"2023-10-09T11:41:12.086758+0000","last_peered":"2023-10-09T11:41:12.086758+0000","last_clean":"2023-10-09T11:41:12.086758+0000","last_became_active":"2023-10-09T11:41:11.074417+0000","last_became_peered":"2023-10-09T11:41:11.074417+0000","last_unstale":"2023-10-09T11:41:12.086758+0000","last_undegraded":"2023-10-09T11:41:12.086758+0000","last_fullsized":"2023-10-09T11:41:12.086758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053509+0000","last_change":"2023-10-09T11:41:12.051884+0000","last_active":"2023-10-09T11:41:12.053509+0000","last_peered":"2023-10-09T11:41:12.053509+0000","last_clean":"2023-10-09T11:41:12.053509+0000","last_became_active":"2023-10-09T11:41:12.051012+0000","last_became_peered":"2023-10-09T11:41:12.051012+0000","last_unstale":"2023-10-09T11:41:12.053509+0000","last_undegraded":"2023-10-09T11:41:12.053509+0000","last_fullsized":"2023-10-09T11:41:12.053509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:59.214273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.043996+0000","last_change":"2023-10-09T11:41:11.079256+0000","last_active":"2023-10-09T11:41:12.043996+0000","last_peered":"2023-10-09T11:41:12.043996+0000","last_clean":"2023-10-09T11:41:12.043996+0000","last_became_active":"2023-10-09T11:41:11.078999+0000","last_became_peered":"2023-10-09T11:41:11.078999+0000","last_unstale":"2023-10-09T11:41:12.043996+0000","last_undegraded":"2023-10-09T11:41:12.043996+0000","last_fullsized":"2023-10-09T11:41:12.043996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.057087+0000","last_change":"2023-10-09T11:41:12.048978+0000","last_active":"2023-10-09T11:41:12.057087+0000","last_peered":"2023-10-09T11:41:12.057087+0000","last_clean":"2023-10-09T11:41:12.057087+0000","last_became_active":"2023-10-09T11:41:12.048636+0000","last_became_peered":"2023-10-09T11:41:12.048636+0000","last_unstale":"2023-10-09T11:41:12.057087+0000","last_undegraded":"2023-10-09T11:41:12.057087+0000","last_fullsized":"2023-10-09T11:41:12.057087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:00.338599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045174+0000","last_change":"2023-10-09T11:41:11.074785+0000","last_active":"2023-10-09T11:41:12.045174+0000","last_peered":"2023-10-09T11:41:12.045174+0000","last_clean":"2023-10-09T11:41:12.045174+0000","last_became_active":"2023-10-09T11:41:11.074460+0000","last_became_peered":"2023-10-09T11:41:11.074460+0000","last_unstale":"2023-10-09T11:41:12.045174+0000","last_undegraded":"2023-10-09T11:41:12.045174+0000","last_fullsized":"2023-10-09T11:41:12.045174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.055406+0000","last_change":"2023-10-09T11:41:12.050021+0000","last_active":"2023-10-09T11:41:12.055406+0000","last_peered":"2023-10-09T11:41:12.055406+0000","last_clean":"2023-10-09T11:41:12.055406+0000","last_became_active":"2023-10-09T11:41:12.049763+0000","last_became_peered":"2023-10-09T11:41:12.049763+0000","last_unstale":"2023-10-09T11:41:12.055406+0000","last_undegraded":"2023-10-09T11:41:12.055406+0000","last_fullsized":"2023-10-09T11:41:12.055406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:15.679133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.045561+0000","last_change":"2023-10-09T11:41:11.063645+0000","last_active":"2023-10-09T11:41:12.045561+0000","last_peered":"2023-10-09T11:41:12.045561+0000","last_clean":"2023-10-09T11:41:12.045561+0000","last_became_active":"2023-10-09T11:41:11.063324+0000","last_became_peered":"2023-10-09T11:41:11.063324+0000","last_unstale":"2023-10-09T11:41:12.045561+0000","last_undegraded":"2023-10-09T11:41:12.045561+0000","last_fullsized":"2023-10-09T11:41:12.045561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:28.029911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.059445+0000","last_change":"2023-10-09T11:41:12.053917+0000","last_active":"2023-10-09T11:41:12.059445+0000","last_peered":"2023-10-09T11:41:12.059445+0000","last_clean":"2023-10-09T11:41:12.059445+0000","last_became_active":"2023-10-09T11:41:12.051978+0000","last_became_peered":"2023-10-09T11:41:12.051978+0000","last_unstale":"2023-10-09T11:41:12.059445+0000","last_undegraded":"2023-10-09T11:41:12.059445+0000","last_fullsized":"2023-10-09T11:41:12.059445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:50.844908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086796+0000","last_change":"2023-10-09T11:41:11.076948+0000","last_active":"2023-10-09T11:41:12.086796+0000","last_peered":"2023-10-09T11:41:12.086796+0000","last_clean":"2023-10-09T11:41:12.086796+0000","last_became_active":"2023-10-09T11:41:11.076489+0000","last_became_peered":"2023-10-09T11:41:11.076489+0000","last_unstale":"2023-10-09T11:41:12.086796+0000","last_undegraded":"2023-10-09T11:41:12.086796+0000","last_fullsized":"2023-10-09T11:41:12.086796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:18.787525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061534+0000","last_change":"2023-10-09T11:41:12.056922+0000","last_active":"2023-10-09T11:41:12.061534+0000","last_peered":"2023-10-09T11:41:12.061534+0000","last_clean":"2023-10-09T11:41:12.061534+0000","last_became_active":"2023-10-09T11:41:12.056611+0000","last_became_peered":"2023-10-09T11:41:12.056611+0000","last_unstale":"2023-10-09T11:41:12.061534+0000","last_undegraded":"2023-10-09T11:41:12.061534+0000","last_fullsized":"2023-10-09T11:41:12.061534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:45.192149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.044251+0000","last_change":"2023-10-09T11:41:11.077460+0000","last_active":"2023-10-09T11:41:12.044251+0000","last_peered":"2023-10-09T11:41:12.044251+0000","last_clean":"2023-10-09T11:41:12.044251+0000","last_became_active":"2023-10-09T11:41:11.077192+0000","last_became_peered":"2023-10-09T11:41:11.077192+0000","last_unstale":"2023-10-09T11:41:12.044251+0000","last_undegraded":"2023-10-09T11:41:12.044251+0000","last_fullsized":"2023-10-09T11:41:12.044251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:56.491552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071319+0000","last_change":"2023-10-09T11:41:12.061959+0000","last_active":"2023-10-09T11:41:12.071319+0000","last_peered":"2023-10-09T11:41:12.071319+0000","last_clean":"2023-10-09T11:41:12.071319+0000","last_became_active":"2023-10-09T11:41:12.058357+0000","last_became_peered":"2023-10-09T11:41:12.058357+0000","last_unstale":"2023-10-09T11:41:12.071319+0000","last_undegraded":"2023-10-09T11:41:12.071319+0000","last_fullsized":"2023-10-09T11:41:12.071319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.086287+0000","last_change":"2023-10-09T11:41:11.060748+0000","last_active":"2023-10-09T11:41:12.086287+0000","last_peered":"2023-10-09T11:41:12.086287+0000","last_clean":"2023-10-09T11:41:12.086287+0000","last_became_active":"2023-10-09T11:41:11.060436+0000","last_became_peered":"2023-10-09T11:41:11.060436+0000","last_unstale":"2023-10-09T11:41:12.086287+0000","last_undegraded":"2023-10-09T11:41:12.086287+0000","last_fullsized":"2023-10-09T11:41:12.086287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:00.217206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.065329+0000","last_change":"2023-10-09T11:41:12.060982+0000","last_active":"2023-10-09T11:41:12.065329+0000","last_peered":"2023-10-09T11:41:12.065329+0000","last_clean":"2023-10-09T11:41:12.065329+0000","last_became_active":"2023-10-09T11:41:12.056626+0000","last_became_peered":"2023-10-09T11:41:12.056626+0000","last_unstale":"2023-10-09T11:41:12.065329+0000","last_undegraded":"2023-10-09T11:41:12.065329+0000","last_fullsized":"2023-10-09T11:41:12.065329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:07.394282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.084778+0000","last_change":"2023-10-09T11:41:11.066536+0000","last_active":"2023-10-09T11:41:12.084778+0000","last_peered":"2023-10-09T11:41:12.084778+0000","last_clean":"2023-10-09T11:41:12.084778+0000","last_became_active":"2023-10-09T11:41:11.066194+0000","last_became_peered":"2023-10-09T11:41:11.066194+0000","last_unstale":"2023-10-09T11:41:12.084778+0000","last_undegraded":"2023-10-09T11:41:12.084778+0000","last_fullsized":"2023-10-09T11:41:12.084778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:10.036181+0000","last_clean_scrub_stamp":"2023-10-09T11:41:10.036181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:05.087539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.071765+0000","last_change":"2023-10-09T11:41:12.067596+0000","last_active":"2023-10-09T11:41:12.071765+0000","last_peered":"2023-10-09T11:41:12.071765+0000","last_clean":"2023-10-09T11:41:12.071765+0000","last_became_active":"2023-10-09T11:41:12.067282+0000","last_became_peered":"2023-10-09T11:41:12.067282+0000","last_unstale":"2023-10-09T11:41:12.071765+0000","last_undegraded":"2023-10-09T11:41:12.071765+0000","last_fullsized":"2023-10-09T11:41:12.071765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061545+0000","last_change":"2023-10-09T11:41:12.056097+0000","last_active":"2023-10-09T11:41:12.061545+0000","last_peered":"2023-10-09T11:41:12.061545+0000","last_clean":"2023-10-09T11:41:12.061545+0000","last_became_active":"2023-10-09T11:41:12.055031+0000","last_became_peered":"2023-10-09T11:41:12.055031+0000","last_unstale":"2023-10-09T11:41:12.061545+0000","last_undegraded":"2023-10-09T11:41:12.061545+0000","last_fullsized":"2023-10-09T11:41:12.061545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:22.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.058104+0000","last_change":"2023-10-09T11:41:12.056111+0000","last_active":"2023-10-09T11:41:12.058104+0000","last_peered":"2023-10-09T11:41:12.058104+0000","last_clean":"2023-10-09T11:41:12.058104+0000","last_became_active":"2023-10-09T11:41:12.055843+0000","last_became_peered":"2023-10-09T11:41:12.055843+0000","last_unstale":"2023-10-09T11:41:12.058104+0000","last_undegraded":"2023-10-09T11:41:12.058104+0000","last_fullsized":"2023-10-09T11:41:12.058104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:43.783508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063535+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.063535+0000","last_peered":"2023-10-09T11:41:12.063535+0000","last_clean":"2023-10-09T11:41:12.063535+0000","last_became_active":"2023-10-09T11:41:12.055904+0000","last_became_peered":"2023-10-09T11:41:12.055904+0000","last_unstale":"2023-10-09T11:41:12.063535+0000","last_undegraded":"2023-10-09T11:41:12.063535+0000","last_fullsized":"2023-10-09T11:41:12.063535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:52.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053222+0000","last_change":"2023-10-09T11:41:12.051485+0000","last_active":"2023-10-09T11:41:12.053222+0000","last_peered":"2023-10-09T11:41:12.053222+0000","last_clean":"2023-10-09T11:41:12.053222+0000","last_became_active":"2023-10-09T11:41:12.051192+0000","last_became_peered":"2023-10-09T11:41:12.051192+0000","last_unstale":"2023-10-09T11:41:12.053222+0000","last_undegraded":"2023-10-09T11:41:12.053222+0000","last_fullsized":"2023-10-09T11:41:12.053222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.062890+0000","last_change":"2023-10-09T11:41:12.059625+0000","last_active":"2023-10-09T11:41:12.062890+0000","last_peered":"2023-10-09T11:41:12.062890+0000","last_clean":"2023-10-09T11:41:12.062890+0000","last_became_active":"2023-10-09T11:41:12.059319+0000","last_became_peered":"2023-10-09T11:41:12.059319+0000","last_unstale":"2023-10-09T11:41:12.062890+0000","last_undegraded":"2023-10-09T11:41:12.062890+0000","last_fullsized":"2023-10-09T11:41:12.062890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:28.040359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061223+0000","last_change":"2023-10-09T11:41:12.059993+0000","last_active":"2023-10-09T11:41:12.061223+0000","last_peered":"2023-10-09T11:41:12.061223+0000","last_clean":"2023-10-09T11:41:12.061223+0000","last_became_active":"2023-10-09T11:41:12.059604+0000","last_became_peered":"2023-10-09T11:41:12.059604+0000","last_unstale":"2023-10-09T11:41:12.061223+0000","last_undegraded":"2023-10-09T11:41:12.061223+0000","last_fullsized":"2023-10-09T11:41:12.061223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063218+0000","last_change":"2023-10-09T11:41:12.059495+0000","last_active":"2023-10-09T11:41:12.063218+0000","last_peered":"2023-10-09T11:41:12.063218+0000","last_clean":"2023-10-09T11:41:12.063218+0000","last_became_active":"2023-10-09T11:41:12.059200+0000","last_became_peered":"2023-10-09T11:41:12.059200+0000","last_unstale":"2023-10-09T11:41:12.063218+0000","last_undegraded":"2023-10-09T11:41:12.063218+0000","last_fullsized":"2023-10-09T11:41:12.063218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:34.971594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.060308+0000","last_change":"2023-10-09T11:41:12.058708+0000","last_active":"2023-10-09T11:41:12.060308+0000","last_peered":"2023-10-09T11:41:12.060308+0000","last_clean":"2023-10-09T11:41:12.060308+0000","last_became_active":"2023-10-09T11:41:12.058356+0000","last_became_peered":"2023-10-09T11:41:12.058356+0000","last_unstale":"2023-10-09T11:41:12.060308+0000","last_undegraded":"2023-10-09T11:41:12.060308+0000","last_fullsized":"2023-10-09T11:41:12.060308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063595+0000","last_change":"2023-10-09T11:41:12.056307+0000","last_active":"2023-10-09T11:41:12.063595+0000","last_peered":"2023-10-09T11:41:12.063595+0000","last_clean":"2023-10-09T11:41:12.063595+0000","last_became_active":"2023-10-09T11:41:12.056023+0000","last_became_peered":"2023-10-09T11:41:12.056023+0000","last_unstale":"2023-10-09T11:41:12.063595+0000","last_undegraded":"2023-10-09T11:41:12.063595+0000","last_fullsized":"2023-10-09T11:41:12.063595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:34.742270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.063421+0000","last_change":"2023-10-09T11:41:12.059080+0000","last_active":"2023-10-09T11:41:12.063421+0000","last_peered":"2023-10-09T11:41:12.063421+0000","last_clean":"2023-10-09T11:41:12.063421+0000","last_became_active":"2023-10-09T11:41:12.056426+0000","last_became_peered":"2023-10-09T11:41:12.056426+0000","last_unstale":"2023-10-09T11:41:12.063421+0000","last_undegraded":"2023-10-09T11:41:12.063421+0000","last_fullsized":"2023-10-09T11:41:12.063421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:44.527064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.072184+0000","last_change":"2023-10-09T11:41:12.069213+0000","last_active":"2023-10-09T11:41:12.072184+0000","last_peered":"2023-10-09T11:41:12.072184+0000","last_clean":"2023-10-09T11:41:12.072184+0000","last_became_active":"2023-10-09T11:41:12.068965+0000","last_became_peered":"2023-10-09T11:41:12.068965+0000","last_unstale":"2023-10-09T11:41:12.072184+0000","last_undegraded":"2023-10-09T11:41:12.072184+0000","last_fullsized":"2023-10-09T11:41:12.072184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:38.119195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.053983+0000","last_change":"2023-10-09T11:41:12.052767+0000","last_active":"2023-10-09T11:41:12.053983+0000","last_peered":"2023-10-09T11:41:12.053983+0000","last_clean":"2023-10-09T11:41:12.053983+0000","last_became_active":"2023-10-09T11:41:12.052111+0000","last_became_peered":"2023-10-09T11:41:12.052111+0000","last_unstale":"2023-10-09T11:41:12.053983+0000","last_undegraded":"2023-10-09T11:41:12.053983+0000","last_fullsized":"2023-10-09T11:41:12.053983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:47.938043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-09T11:41:12.061451+0000","last_change":"2023-10-09T11:41:12.056204+0000","last_active":"2023-10-09T11:41:12.061451+0000","last_peered":"2023-10-09T11:41:12.061451+0000","last_clean":"2023-10-09T11:41:12.061451+0000","last_became_active":"2023-10-09T11:41:12.055911+0000","last_became_peered":"2023-10-09T11:41:12.055911+0000","last_unstale":"2023-10-09T11:41:12.061451+0000","last_undegraded":"2023-10-09T11:41:12.061451+0000","last_fullsized":"2023-10-09T11:41:12.061451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:11.041183+0000","last_clean_scrub_stamp":"2023-10-09T11:41:11.041183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:43.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476743,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:41:25.227 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T11:41:25.227 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-09T11:41:25.227 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-09T11:41:25.228 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-09T11:41:25.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.439+0000 7f35e67ff700 1 Processor -- start 2023-10-09T11:41:25.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.439+0000 7f35e67ff700 1 -- start start 2023-10-09T11:41:25.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35e67ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35e00acf10 0x7f35e0160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35e67ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e0153f10 con 0x7f35e0156510 2023-10-09T11:41:25.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35e67ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e00af800 con 0x7f35e00b0ca0 2023-10-09T11:41:25.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35e67ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e00ad9d0 con 0x7f35e00acf10 2023-10-09T11:41:25.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35dffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f35e0156510 0x7f35e00ac800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:57962/0 (socket says 172.21.15.86:57962) 2023-10-09T11:41:25.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35dffff700 1 -- 172.21.15.86:0/2571835295 learned_addr learned my addr 172.21.15.86:0/2571835295 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:25.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35e4d9c700 1 --2- 172.21.15.86:0/2571835295 >> v2:172.21.15.135:3300/0 conn(0x7f35e00acf10 0x7f35e0160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.441+0000 7f35df7fe700 1 -- 172.21.15.86:0/2571835295 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040902326 0 0) 0x7f35e0153f10 con 0x7f35e0156510 2023-10-09T11:41:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35df7fe700 1 -- 172.21.15.86:0/2571835295 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35cc003570 con 0x7f35e0156510 2023-10-09T11:41:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35df7fe700 1 -- 172.21.15.86:0/2571835295 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884182499 0 0) 0x7f35e00af800 con 0x7f35e00b0ca0 2023-10-09T11:41:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35df7fe700 1 -- 172.21.15.86:0/2571835295 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e0153f10 con 0x7f35e00b0ca0 2023-10-09T11:41:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35e4d9c700 1 -- 172.21.15.86:0/2571835295 >> v1:172.21.15.135:6789/0 conn(0x7f35e00b0ca0 legacy=0x7f35e01568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35e4d9c700 1 -- 172.21.15.86:0/2571835295 >> v1:172.21.15.86:6789/0 conn(0x7f35e0156510 legacy=0x7f35e00ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35e4d9c700 1 -- 172.21.15.86:0/2571835295 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00ad410 con 0x7f35e00acf10 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35e4d9c700 1 --2- 172.21.15.86:0/2571835295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e00acf10 0x7f35e0160ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009e60 tx=0x7f35d8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9fb8ffb5d691358 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35df7fe700 1 -- 172.21.15.86:0/2571835295 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d800e070 con 0x7f35e00acf10 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35df7fe700 1 -- 172.21.15.86:0/2571835295 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d800bab0 con 0x7f35e00acf10 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.442+0000 7f35df7fe700 1 -- 172.21.15.86:0/2571835295 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d800be70 con 0x7f35e00acf10 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.443+0000 7f35e67ff700 1 -- 172.21.15.86:0/2571835295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e00acf10 msgr2=0x7f35e0160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.443+0000 7f35e67ff700 1 --2- 172.21.15.86:0/2571835295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e00acf10 0x7f35e0160ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009e60 tx=0x7f35d8009780 comp rx=0 tx=0).stop 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.443+0000 7f35e67ff700 1 -- 172.21.15.86:0/2571835295 shutdown_connections 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.443+0000 7f35e67ff700 1 --2- 172.21.15.86:0/2571835295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e00acf10 0x7f35e0160ae0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.443+0000 7f35e67ff700 1 -- 172.21.15.86:0/2571835295 >> 172.21.15.86:0/2571835295 conn(0x7f35e006a310 msgr2=0x7f35e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.443+0000 7f35e67ff700 1 -- 172.21.15.86:0/2571835295 shutdown_connections 2023-10-09T11:41:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.443+0000 7f35e67ff700 1 -- 172.21.15.86:0/2571835295 wait complete. 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.444+0000 7f35e67ff700 1 Processor -- start 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.444+0000 7f35e67ff700 1 -- start start 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.445+0000 7f35e67ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e00acf10 0x7f35e015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.445+0000 7f35e67ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35e00b0ca0 0x7f35e014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.445+0000 7f35e67ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e0156510 0x7f35e014b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.445+0000 7f35e67ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e0150ed0 con 0x7f35e00b0ca0 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.445+0000 7f35e67ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e01502c0 con 0x7f35e0156510 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.445+0000 7f35e67ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e01505a0 con 0x7f35e00acf10 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35e00b0ca0 0x7f35e014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35e00b0ca0 0x7f35e014adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54602/0 (socket says 172.21.15.86:54602) 2023-10-09T11:41:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 -- 172.21.15.86:0/905800174 learned_addr learned my addr 172.21.15.86:0/905800174 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35dffff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e00acf10 0x7f35e015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35e4d9c700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e0156510 0x7f35e014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 -- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e00acf10 msgr2=0x7f35e015deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e00acf10 0x7f35e015deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 -- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e0156510 msgr2=0x7f35e014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e0156510 0x7f35e014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 -- 172.21.15.86:0/905800174 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8009a20 con 0x7f35e00b0ca0 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35dffff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e00acf10 0x7f35e015deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35e4d9c700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e0156510 0x7f35e014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35d7fff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35e00b0ca0 0x7f35e014adf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c7c0 tx=0x7f35c8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35dcff9700 1 -- 172.21.15.86:0/905800174 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8010510 con 0x7f35e00b0ca0 2023-10-09T11:41:25.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35dcff9700 1 -- 172.21.15.86:0/905800174 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c8010690 con 0x7f35e00b0ca0 2023-10-09T11:41:25.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e0150880 con 0x7f35e00b0ca0 2023-10-09T11:41:25.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.446+0000 7f35dcff9700 1 -- 172.21.15.86:0/905800174 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8010a50 con 0x7f35e00b0ca0 2023-10-09T11:41:25.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.447+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e015e3f0 con 0x7f35e00b0ca0 2023-10-09T11:41:25.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.448+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e00af770 con 0x7f35e00b0ca0 2023-10-09T11:41:25.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.448+0000 7f35dcff9700 1 -- 172.21.15.86:0/905800174 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35c801b400 con 0x7f35e00b0ca0 2023-10-09T11:41:25.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.449+0000 7f35dcff9700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35c0066f30 0x7f35c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.450+0000 7f35dcff9700 1 -- 172.21.15.86:0/905800174 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35c8083ce0 con 0x7f35e00b0ca0 2023-10-09T11:41:25.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.450+0000 7f35dffff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35c0066f30 0x7f35c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.450+0000 7f35dffff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35c0066f30 0x7f35c00693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35d0007fd0 tx=0x7f35d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.453+0000 7f35dcff9700 1 -- 172.21.15.86:0/905800174 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35c8050f50 con 0x7f35e00b0ca0 2023-10-09T11:41:25.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.683+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f35e004c3c0 con 0x7f35e00b0ca0 2023-10-09T11:41:25.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.684+0000 7f35dcff9700 1 -- 172.21.15.86:0/905800174 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f35c8016040 con 0x7f35e00b0ca0 2023-10-09T11:41:25.685 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:25.685 INFO:teuthology.orchestra.run.smithi086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-09T11:41:25.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35c0066f30 msgr2=0x7f35c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35c0066f30 0x7f35c00693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35d0007fd0 tx=0x7f35d0009040 comp rx=0 tx=0).stop 2023-10-09T11:41:25.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35e00b0ca0 msgr2=0x7f35e014adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35e00b0ca0 0x7f35e014adf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c7c0 tx=0x7f35c8007db0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 shutdown_connections 2023-10-09T11:41:25.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35c0066f30 0x7f35c00693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e0156510 0x7f35e014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e00acf10 0x7f35e015deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 --2- 172.21.15.86:0/905800174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35e00b0ca0 0x7f35e014adf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 >> 172.21.15.86:0/905800174 conn(0x7f35e006a310 msgr2=0x7f35e01568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 shutdown_connections 2023-10-09T11:41:25.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.686+0000 7f35e67ff700 1 -- 172.21.15.86:0/905800174 wait complete. 2023-10-09T11:41:25.704 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-09T11:41:25.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:25.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.884+0000 7f0950d9d700 1 Processor -- start 2023-10-09T11:41:25.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.884+0000 7f0950d9d700 1 -- start start 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f0950d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f094c1566e0 0x7f094c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f0950d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f094c0cb900 0x7f094c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f0950d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0ca860 con 0x7f094c156310 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f0950d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0cab40 con 0x7f094c1566e0 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f0950d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0cae20 con 0x7f094c0cb900 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f094b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f094c156310 0x7f094c0c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:57964/0 (socket says 172.21.15.86:57964) 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f094b7fe700 1 -- 172.21.15.86:0/1727885946 learned_addr learned my addr 172.21.15.86:0/1727885946 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:25.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.885+0000 7f0943fff700 1 --2- 172.21.15.86:0/1727885946 >> v2:172.21.15.86:3300/0 conn(0x7f094c1566e0 0x7f094c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f094bfff700 1 --2- 172.21.15.86:0/1727885946 >> v2:172.21.15.135:3300/0 conn(0x7f094c0cb900 0x7f094c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f094affd700 1 -- 172.21.15.86:0/1727885946 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715219072 0 0) 0x7f094c0ca860 con 0x7f094c156310 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f094affd700 1 -- 172.21.15.86:0/1727885946 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0938003570 con 0x7f094c156310 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f0943fff700 1 -- 172.21.15.86:0/1727885946 >> v2:172.21.15.135:3300/0 conn(0x7f094c0cb900 msgr2=0x7f094c0ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f0943fff700 1 --2- 172.21.15.86:0/1727885946 >> v2:172.21.15.135:3300/0 conn(0x7f094c0cb900 0x7f094c0ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f0943fff700 1 -- 172.21.15.86:0/1727885946 >> v1:172.21.15.86:6789/0 conn(0x7f094c156310 legacy=0x7f094c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f0943fff700 1 -- 172.21.15.86:0/1727885946 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0cb100 con 0x7f094c1566e0 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f0943fff700 1 --2- 172.21.15.86:0/1727885946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c0ae000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f094c0addc0 tx=0x7f09340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde9f3863d415a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f094affd700 1 -- 172.21.15.86:0/1727885946 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934011630 con 0x7f094c1566e0 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f094affd700 1 -- 172.21.15.86:0/1727885946 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934011790 con 0x7f094c1566e0 2023-10-09T11:41:25.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.886+0000 7f094affd700 1 -- 172.21.15.86:0/1727885946 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934011b10 con 0x7f094c1566e0 2023-10-09T11:41:25.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 -- 172.21.15.86:0/1727885946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 msgr2=0x7f094c0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 --2- 172.21.15.86:0/1727885946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c0ae000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f094c0addc0 tx=0x7f09340091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 -- 172.21.15.86:0/1727885946 shutdown_connections 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 --2- 172.21.15.86:0/1727885946 >> v2:172.21.15.135:3300/0 conn(0x7f094c0cb900 0x7f094c0ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 --2- 172.21.15.86:0/1727885946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c0ae000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 -- 172.21.15.86:0/1727885946 >> 172.21.15.86:0/1727885946 conn(0x7f094c0cc1f0 msgr2=0x7f094c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 -- 172.21.15.86:0/1727885946 shutdown_connections 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.887+0000 7f0950d9d700 1 -- 172.21.15.86:0/1727885946 wait complete. 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.888+0000 7f0950d9d700 1 Processor -- start 2023-10-09T11:41:25.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.889+0000 7f0950d9d700 1 -- start start 2023-10-09T11:41:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.889+0000 7f0950d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f094c0cb900 0x7f094c14c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.889+0000 7f0950d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c156310 0x7f094c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.889+0000 7f0950d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.889+0000 7f0950d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c2a40 con 0x7f094c1566e0 2023-10-09T11:41:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.889+0000 7f0950d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c14c6a0 con 0x7f094c156310 2023-10-09T11:41:25.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f0950d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0c1e30 con 0x7f094c0cb900 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54606/0 (socket says 172.21.15.86:54606) 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 -- 172.21.15.86:0/880399261 learned_addr learned my addr 172.21.15.86:0/880399261 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f0943fff700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c156310 0x7f094c14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094b7fe700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f094c0cb900 0x7f094c14c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 -- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f094c0cb900 msgr2=0x7f094c14c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f094c0cb900 0x7f094c14c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 -- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c156310 msgr2=0x7f094c14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c156310 0x7f094c14d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 -- 172.21.15.86:0/880399261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934009420 con 0x7f094c1566e0 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f094bfff700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c15e920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0944007f20 tx=0x7f0944009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f09437fe700 1 -- 172.21.15.86:0/880399261 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400eca0 con 0x7f094c1566e0 2023-10-09T11:41:25.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f09437fe700 1 -- 172.21.15.86:0/880399261 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400ee20 con 0x7f094c1566e0 2023-10-09T11:41:25.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.890+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c0c2110 con 0x7f094c1566e0 2023-10-09T11:41:25.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.891+0000 7f09437fe700 1 -- 172.21.15.86:0/880399261 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944014670 con 0x7f094c1566e0 2023-10-09T11:41:25.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.891+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c0c26d0 con 0x7f094c1566e0 2023-10-09T11:41:25.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.892+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c0c2bf0 con 0x7f094c1566e0 2023-10-09T11:41:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.892+0000 7f09437fe700 1 -- 172.21.15.86:0/880399261 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09440149e0 con 0x7f094c1566e0 2023-10-09T11:41:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.893+0000 7f09437fe700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f092c066f30 0x7f092c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.893+0000 7f09437fe700 1 -- 172.21.15.86:0/880399261 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0944084ce0 con 0x7f094c1566e0 2023-10-09T11:41:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.893+0000 7f094b7fe700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f092c066f30 0x7f092c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.894+0000 7f094b7fe700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f092c066f30 0x7f092c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f094c151ce0 tx=0x7f093c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:25.897+0000 7f09437fe700 1 -- 172.21.15.86:0/880399261 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0944051eb0 con 0x7f094c1566e0 2023-10-09T11:41:26.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.089+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f094c04c3c0 con 0x7f094c1566e0 2023-10-09T11:41:26.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.089+0000 7f09437fe700 1 -- 172.21.15.86:0/880399261 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f09440554d0 con 0x7f094c1566e0 2023-10-09T11:41:26.090 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:26.090 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f092c066f30 msgr2=0x7f092c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f092c066f30 0x7f092c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f094c151ce0 tx=0x7f093c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 msgr2=0x7f094c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c15e920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0944007f20 tx=0x7f0944009860 comp rx=0 tx=0).stop 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 shutdown_connections 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f092c066f30 0x7f092c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f094c1566e0 0x7f094c15e920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f094c0cb900 0x7f094c14c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 --2- 172.21.15.86:0/880399261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c156310 0x7f094c14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 >> 172.21.15.86:0/880399261 conn(0x7f094c0cc1f0 msgr2=0x7f094c153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 shutdown_connections 2023-10-09T11:41:26.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.092+0000 7f0950d9d700 1 -- 172.21.15.86:0/880399261 wait complete. 2023-10-09T11:41:26.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:09.500279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:10.496954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:26.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.293+0000 7fb2239ff700 1 Processor -- start 2023-10-09T11:41:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.293+0000 7fb2239ff700 1 -- start start 2023-10-09T11:41:26.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.294+0000 7fb2239ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb21c0ca120 0x7fb21c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.294+0000 7fb2239ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb21c154530 0x7fb21c0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.294+0000 7fb2239ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c15b2e0 con 0x7fb21c154160 2023-10-09T11:41:26.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.294+0000 7fb2239ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21c15a6d0 con 0x7fb21c0ca120 2023-10-09T11:41:26.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.294+0000 7fb2239ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21c15a9b0 con 0x7fb21c154530 2023-10-09T11:41:26.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.294+0000 7fb22179b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb21c154160 0x7fb21c1577b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:57970/0 (socket says 172.21.15.86:57970) 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb22179b700 1 -- 172.21.15.86:0/807587123 learned_addr learned my addr 172.21.15.86:0/807587123 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb220f9a700 1 --2- 172.21.15.86:0/807587123 >> v2:172.21.15.86:3300/0 conn(0x7fb21c0ca120 0x7fb21c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb213fff700 1 -- 172.21.15.86:0/807587123 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764752868 0 0) 0x7fb21c15b2e0 con 0x7fb21c154160 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb221f9c700 1 --2- 172.21.15.86:0/807587123 >> v2:172.21.15.135:3300/0 conn(0x7fb21c154530 0x7fb21c0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb213fff700 1 -- 172.21.15.86:0/807587123 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb208003570 con 0x7fb21c154160 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb220f9a700 1 -- 172.21.15.86:0/807587123 >> v2:172.21.15.135:3300/0 conn(0x7fb21c154530 msgr2=0x7fb21c0c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb220f9a700 1 --2- 172.21.15.86:0/807587123 >> v2:172.21.15.135:3300/0 conn(0x7fb21c154530 0x7fb21c0c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb220f9a700 1 -- 172.21.15.86:0/807587123 >> v1:172.21.15.86:6789/0 conn(0x7fb21c154160 legacy=0x7fb21c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb220f9a700 1 -- 172.21.15.86:0/807587123 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c15ac90 con 0x7fb21c0ca120 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb221f9c700 1 --2- 172.21.15.86:0/807587123 >> v2:172.21.15.135:3300/0 conn(0x7fb21c154530 0x7fb21c0c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb220f9a700 1 --2- 172.21.15.86:0/807587123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c0ca120 0x7fb21c0c81d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0c6b20 tx=0x7fb20c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba2869187dabbed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb213fff700 1 -- 172.21.15.86:0/807587123 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c011630 con 0x7fb21c0ca120 2023-10-09T11:41:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb213fff700 1 -- 172.21.15.86:0/807587123 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c011790 con 0x7fb21c0ca120 2023-10-09T11:41:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.295+0000 7fb213fff700 1 -- 172.21.15.86:0/807587123 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c011b10 con 0x7fb21c0ca120 2023-10-09T11:41:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 -- 172.21.15.86:0/807587123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c0ca120 msgr2=0x7fb21c0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 --2- 172.21.15.86:0/807587123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c0ca120 0x7fb21c0c81d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0c6b20 tx=0x7fb20c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 -- 172.21.15.86:0/807587123 shutdown_connections 2023-10-09T11:41:26.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 --2- 172.21.15.86:0/807587123 >> v2:172.21.15.135:3300/0 conn(0x7fb21c154530 0x7fb21c0c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 --2- 172.21.15.86:0/807587123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c0ca120 0x7fb21c0c81d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 -- 172.21.15.86:0/807587123 >> 172.21.15.86:0/807587123 conn(0x7fb21c06a360 msgr2=0x7fb21c0cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 -- 172.21.15.86:0/807587123 shutdown_connections 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.296+0000 7fb2239ff700 1 -- 172.21.15.86:0/807587123 wait complete. 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.297+0000 7fb2239ff700 1 Processor -- start 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.298+0000 7fb2239ff700 1 -- start start 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.298+0000 7fb2239ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb21c0ca120 0x7fb21c146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.298+0000 7fb2239ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c154160 0x7fb21c0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.298+0000 7fb2239ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c154530 0x7fb21c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.298+0000 7fb2239ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0c48b0 con 0x7fb21c154530 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.298+0000 7fb2239ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c141240 con 0x7fb21c154160 2023-10-09T11:41:26.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.298+0000 7fb2239ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0c5530 con 0x7fb21c0ca120 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c154530 0x7fb21c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c154530 0x7fb21c149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54628/0 (socket says 172.21.15.86:54628) 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 -- 172.21.15.86:0/3787654965 learned_addr learned my addr 172.21.15.86:0/3787654965 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb22179b700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb21c0ca120 0x7fb21c146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb220f9a700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c154160 0x7fb21c0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 -- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb21c0ca120 msgr2=0x7fb21c146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb21c0ca120 0x7fb21c146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 -- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c154160 msgr2=0x7fb21c0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c154160 0x7fb21c0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 -- 172.21.15.86:0/3787654965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009420 con 0x7fb21c154530 2023-10-09T11:41:26.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.299+0000 7fb221f9c700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c154530 0x7fb21c149720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb21400cef0 tx=0x7fb214007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.300+0000 7fb2117fa700 1 -- 172.21.15.86:0/3787654965 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400ae00 con 0x7fb21c154530 2023-10-09T11:41:26.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.300+0000 7fb2117fa700 1 -- 172.21.15.86:0/3787654965 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb214016420 con 0x7fb21c154530 2023-10-09T11:41:26.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.300+0000 7fb2117fa700 1 -- 172.21.15.86:0/3787654965 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2140167e0 con 0x7fb21c154530 2023-10-09T11:41:26.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.300+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c0c4010 con 0x7fb21c154530 2023-10-09T11:41:26.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.300+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c0c45d0 con 0x7fb21c154530 2023-10-09T11:41:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.301+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c04c3c0 con 0x7fb21c154530 2023-10-09T11:41:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.302+0000 7fb2117fa700 1 -- 172.21.15.86:0/3787654965 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb214016c10 con 0x7fb21c154530 2023-10-09T11:41:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.302+0000 7fb2117fa700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb200066f30 0x7fb2000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.302+0000 7fb2117fa700 1 -- 172.21.15.86:0/3787654965 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb214012070 con 0x7fb21c154530 2023-10-09T11:41:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.303+0000 7fb22179b700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb200066f30 0x7fb2000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.303+0000 7fb22179b700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb200066f30 0x7fb2000693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb218000c00 tx=0x7fb218009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.306+0000 7fb2117fa700 1 -- 172.21.15.86:0/3787654965 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb21404e5a0 con 0x7fb21c154530 2023-10-09T11:41:26.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.495+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb21c15af70 con 0x7fb21c154530 2023-10-09T11:41:26.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.495+0000 7fb2117fa700 1 -- 172.21.15.86:0/3787654965 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb21408a020 con 0x7fb21c154530 2023-10-09T11:41:26.496 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb200066f30 msgr2=0x7fb2000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb200066f30 0x7fb2000693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb218000c00 tx=0x7fb218009040 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c154530 msgr2=0x7fb21c149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c154530 0x7fb21c149720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb21400cef0 tx=0x7fb214007860 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 shutdown_connections 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb200066f30 0x7fb2000693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb21c154530 0x7fb21c149720 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb21c0ca120 0x7fb21c146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 --2- 172.21.15.86:0/3787654965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c154160 0x7fb21c0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 >> 172.21.15.86:0/3787654965 conn(0x7fb21c06a360 msgr2=0x7fb21c0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 shutdown_connections 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.498+0000 7fb2239ff700 1 -- 172.21.15.86:0/3787654965 wait complete. 2023-10-09T11:41:26.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.699+0000 7f5e2b5ff700 1 Processor -- start 2023-10-09T11:41:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.699+0000 7f5e2b5ff700 1 -- start start 2023-10-09T11:41:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.700+0000 7f5e2b5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e24155eb0 0x7f5e2406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2b5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 0x7f5e24069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2b5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2406eb90 con 0x7f5e24069cb0 2023-10-09T11:41:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2b5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2406a130 con 0x7f5e24155eb0 2023-10-09T11:41:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2b5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2406ee70 con 0x7f5e240c70b0 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e24155eb0 0x7f5e2406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e24155eb0 0x7f5e2406e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54640/0 (socket says 172.21.15.86:54640) 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 -- 172.21.15.86:0/27225598 learned_addr learned my addr 172.21.15.86:0/27225598 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 -- 172.21.15.86:0/27225598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 msgr2=0x7f5e24069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 --2- 172.21.15.86:0/27225598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 0x7f5e24069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 -- 172.21.15.86:0/27225598 >> v1:172.21.15.135:6789/0 conn(0x7f5e24069cb0 legacy=0x7f5e24159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 -- 172.21.15.86:0/27225598 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2406f150 con 0x7f5e24155eb0 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.701+0000 7f5e2939b700 1 --2- 172.21.15.86:0/27225598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e2406e240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e200099b0 tx=0x7f5e20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf36233419ad2e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e1bfff700 1 -- 172.21.15.86:0/27225598 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000b820 con 0x7f5e24155eb0 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e1bfff700 1 -- 172.21.15.86:0/27225598 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000b980 con 0x7f5e24155eb0 2023-10-09T11:41:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e1bfff700 1 -- 172.21.15.86:0/27225598 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000bd20 con 0x7f5e24155eb0 2023-10-09T11:41:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/27225598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 msgr2=0x7f5e2406e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/27225598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e2406e240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e200099b0 tx=0x7f5e20009250 comp rx=0 tx=0).stop 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/27225598 shutdown_connections 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/27225598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e2406e240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/27225598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 0x7f5e24069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/27225598 >> 172.21.15.86:0/27225598 conn(0x7f5e24068e10 msgr2=0x7f5e240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/27225598 shutdown_connections 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.702+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/27225598 wait complete. 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.704+0000 7f5e2b5ff700 1 Processor -- start 2023-10-09T11:41:26.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.704+0000 7f5e2b5ff700 1 -- start start 2023-10-09T11:41:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e2b5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e24069cb0 0x7f5e240c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e2b5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 0x7f5e24143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e2b5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e240b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e2b5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e24144560 con 0x7f5e24155eb0 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e2b5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240ad950 con 0x7f5e24069cb0 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e2b5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240c5110 con 0x7f5e240c70b0 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e240b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e240b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54646/0 (socket says 172.21.15.86:54646) 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 -- 172.21.15.86:0/937915326 learned_addr learned my addr 172.21.15.86:0/937915326 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e2939b700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e24069cb0 0x7f5e240c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e28b9a700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 0x7f5e24143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 -- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 msgr2=0x7f5e24143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 0x7f5e24143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 -- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e24069cb0 msgr2=0x7f5e240c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e24069cb0 0x7f5e240c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.705+0000 7f5e29b9c700 1 -- 172.21.15.86:0/937915326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200094f0 con 0x7f5e24155eb0 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.706+0000 7f5e29b9c700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e240b12e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00bbb0 tx=0x7f5e1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.706+0000 7f5e197fa700 1 -- 172.21.15.86:0/937915326 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c00c630 con 0x7f5e24155eb0 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.706+0000 7f5e197fa700 1 -- 172.21.15.86:0/937915326 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c00c7b0 con 0x7f5e24155eb0 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.706+0000 7f5e197fa700 1 -- 172.21.15.86:0/937915326 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c00cb70 con 0x7f5e24155eb0 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.706+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e240acb90 con 0x7f5e24155eb0 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.706+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e240ad150 con 0x7f5e24155eb0 2023-10-09T11:41:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.707+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2404c3c0 con 0x7f5e24155eb0 2023-10-09T11:41:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.708+0000 7f5e197fa700 1 -- 172.21.15.86:0/937915326 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e1c012070 con 0x7f5e24155eb0 2023-10-09T11:41:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.708+0000 7f5e197fa700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5e08066f30 0x7f5e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.709+0000 7f5e197fa700 1 -- 172.21.15.86:0/937915326 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e1c084130 con 0x7f5e24155eb0 2023-10-09T11:41:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.709+0000 7f5e2939b700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5e08066f30 0x7f5e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.709+0000 7f5e2939b700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5e08066f30 0x7f5e080693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e200099b0 tx=0x7f5e20016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.713+0000 7f5e197fa700 1 -- 172.21.15.86:0/937915326 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e1c051300 con 0x7f5e24155eb0 2023-10-09T11:41:26.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.900+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e2406f430 con 0x7f5e24155eb0 2023-10-09T11:41:26.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.901+0000 7f5e197fa700 1 -- 172.21.15.86:0/937915326 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e1c054920 con 0x7f5e24155eb0 2023-10-09T11:41:26.902 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:41:26.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5e08066f30 msgr2=0x7f5e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5e08066f30 0x7f5e080693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5e200099b0 tx=0x7f5e20016000 comp rx=0 tx=0).stop 2023-10-09T11:41:26.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 msgr2=0x7f5e240b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e240b12e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00bbb0 tx=0x7f5e1c009840 comp rx=0 tx=0).stop 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 shutdown_connections 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5e08066f30 0x7f5e080693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e24155eb0 0x7f5e240b12e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e24069cb0 0x7f5e240c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 --2- 172.21.15.86:0/937915326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e240c70b0 0x7f5e24143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 >> 172.21.15.86:0/937915326 conn(0x7f5e24068e10 msgr2=0x7f5e240cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 shutdown_connections 2023-10-09T11:41:26.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:26.903+0000 7f5e2b5ff700 1 -- 172.21.15.86:0/937915326 wait complete. 2023-10-09T11:41:26.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:27.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.105+0000 7f251fbff700 1 Processor -- start 2023-10-09T11:41:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.105+0000 7f251fbff700 1 -- start start 2023-10-09T11:41:27.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.106+0000 7f251fbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f251815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.106+0000 7f251fbff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f251815db10 0x7f2518069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.106+0000 7f251fbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251815a160 con 0x7f2518159890 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.106+0000 7f251fbff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180d13a0 con 0x7f251815db10 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.106+0000 7f251fbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251815e140 con 0x7f2518159c60 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251e19c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f251815db10 0x7f2518069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d19a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f251815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d99b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f2518159890 0x7f251815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:57716/0 (socket says 172.21.15.86:57716) 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d99b700 1 -- 172.21.15.86:0/2662365947 learned_addr learned my addr 172.21.15.86:0/2662365947 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251c999700 1 -- 172.21.15.86:0/2662365947 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718081402 0 0) 0x7f251815a160 con 0x7f2518159890 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251c999700 1 -- 172.21.15.86:0/2662365947 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2504003570 con 0x7f2518159890 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d19a700 1 -- 172.21.15.86:0/2662365947 >> v2:172.21.15.135:3300/0 conn(0x7f251815db10 msgr2=0x7f2518069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d19a700 1 --2- 172.21.15.86:0/2662365947 >> v2:172.21.15.135:3300/0 conn(0x7f251815db10 0x7f2518069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d19a700 1 -- 172.21.15.86:0/2662365947 >> v1:172.21.15.135:6789/0 conn(0x7f2518159890 legacy=0x7f251815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d19a700 1 -- 172.21.15.86:0/2662365947 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251815a3d0 con 0x7f2518159c60 2023-10-09T11:41:27.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251e19c700 1 --2- 172.21.15.86:0/2662365947 >> v2:172.21.15.135:3300/0 conn(0x7f251815db10 0x7f2518069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:27.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.107+0000 7f251d19a700 1 --2- 172.21.15.86:0/2662365947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f251815d5d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f25080098e0 tx=0x7f25080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1642d86f2413b592 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251c999700 1 -- 172.21.15.86:0/2662365947 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011630 con 0x7f2518159c60 2023-10-09T11:41:27.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251c999700 1 -- 172.21.15.86:0/2662365947 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508011790 con 0x7f2518159c60 2023-10-09T11:41:27.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251c999700 1 -- 172.21.15.86:0/2662365947 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508011b30 con 0x7f2518159c60 2023-10-09T11:41:27.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 -- 172.21.15.86:0/2662365947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 msgr2=0x7f251815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 --2- 172.21.15.86:0/2662365947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f251815d5d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f25080098e0 tx=0x7f25080091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 -- 172.21.15.86:0/2662365947 shutdown_connections 2023-10-09T11:41:27.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 --2- 172.21.15.86:0/2662365947 >> v2:172.21.15.135:3300/0 conn(0x7f251815db10 0x7f2518069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 --2- 172.21.15.86:0/2662365947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f251815d5d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 -- 172.21.15.86:0/2662365947 >> 172.21.15.86:0/2662365947 conn(0x7f2518068e20 msgr2=0x7f25180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 -- 172.21.15.86:0/2662365947 shutdown_connections 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.108+0000 7f251fbff700 1 -- 172.21.15.86:0/2662365947 wait complete. 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.110+0000 7f251fbff700 1 Processor -- start 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.110+0000 7f251fbff700 1 -- start start 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251fbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518159890 0x7f25180cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251fbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f2518158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251fbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251815db10 0x7f25180c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251fbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b6500 con 0x7f251815db10 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251fbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b4780 con 0x7f2518159890 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251fbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180ce2e0 con 0x7f2518159c60 2023-10-09T11:41:27.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251e19c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251815db10 0x7f25180c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251d99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518159890 0x7f25180cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251d19a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f2518158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251d19a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f2518158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38078/0 (socket says 172.21.15.86:38078) 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.111+0000 7f251d19a700 1 -- 172.21.15.86:0/4020865089 learned_addr learned my addr 172.21.15.86:0/4020865089 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251e19c700 1 -- 172.21.15.86:0/4020865089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 msgr2=0x7f2518158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251e19c700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f2518158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251e19c700 1 -- 172.21.15.86:0/4020865089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518159890 msgr2=0x7f25180cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251e19c700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518159890 0x7f25180cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251e19c700 1 -- 172.21.15.86:0/4020865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009a20 con 0x7f251815db10 2023-10-09T11:41:27.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251e19c700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251815db10 0x7f25180c95b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2510009ed0 tx=0x7f251000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f250dffb700 1 -- 172.21.15.86:0/4020865089 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000cb70 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f250dffb700 1 -- 172.21.15.86:0/4020865089 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251000f040 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f250dffb700 1 -- 172.21.15.86:0/4020865089 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510014480 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2508009420 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.112+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25180b5eb0 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.113+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251804c3c0 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.114+0000 7f250dffb700 1 -- 172.21.15.86:0/4020865089 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2510003020 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.115+0000 7f250dffb700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f24fc066f30 0x7f24fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.115+0000 7f250dffb700 1 -- 172.21.15.86:0/4020865089 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2510084d30 con 0x7f251815db10 2023-10-09T11:41:27.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.115+0000 7f251d99b700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f24fc066f30 0x7f24fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.116+0000 7f251d99b700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f24fc066f30 0x7f24fc0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2514007fd0 tx=0x7f2514009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.119+0000 7f250dffb700 1 -- 172.21.15.86:0/4020865089 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2510051f00 con 0x7f251815db10 2023-10-09T11:41:27.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.309+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f251806a5b0 con 0x7f251815db10 2023-10-09T11:41:27.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.309+0000 7f250dffb700 1 -- 172.21.15.86:0/4020865089 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2510055520 con 0x7f251815db10 2023-10-09T11:41:27.311 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:41:27.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f24fc066f30 msgr2=0x7f24fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f24fc066f30 0x7f24fc0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2514007fd0 tx=0x7f2514009040 comp rx=0 tx=0).stop 2023-10-09T11:41:27.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251815db10 msgr2=0x7f25180c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251815db10 0x7f25180c95b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2510009ed0 tx=0x7f251000b040 comp rx=0 tx=0).stop 2023-10-09T11:41:27.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 shutdown_connections 2023-10-09T11:41:27.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f24fc066f30 0x7f24fc0693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251815db10 0x7f25180c95b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518159890 0x7f25180cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 --2- 172.21.15.86:0/4020865089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2518159c60 0x7f2518158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 >> 172.21.15.86:0/4020865089 conn(0x7f2518068e20 msgr2=0x7f25181530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 shutdown_connections 2023-10-09T11:41:27.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.312+0000 7f251fbff700 1 -- 172.21.15.86:0/4020865089 wait complete. 2023-10-09T11:41:27.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:27.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.508+0000 7fb90bfff700 1 Processor -- start 2023-10-09T11:41:27.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.508+0000 7fb90bfff700 1 -- start start 2023-10-09T11:41:27.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb90c150180 0x7fb90c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb90c150550 0x7fb90c0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c06e2a0 con 0x7fb90c0c7240 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90bfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c06b2e0 con 0x7fb90c150550 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c0c7680 con 0x7fb90c150180 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb903fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb90c150550 0x7fb90c0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb90c0c7240 0x7fb90c069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:57984/0 (socket says 172.21.15.86:57984) 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90b7fe700 1 -- 172.21.15.86:0/564962095 learned_addr learned my addr 172.21.15.86:0/564962095 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb903fff700 1 --2- 172.21.15.86:0/564962095 >> v2:172.21.15.86:3300/0 conn(0x7fb90c150550 0x7fb90c0c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54666/0 (socket says 172.21.15.86:54666) 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90affd700 1 --2- 172.21.15.86:0/564962095 >> v2:172.21.15.135:3300/0 conn(0x7fb90c150180 0x7fb90c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb903fff700 1 -- 172.21.15.86:0/564962095 >> v2:172.21.15.135:3300/0 conn(0x7fb90c150180 msgr2=0x7fb90c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb903fff700 1 --2- 172.21.15.86:0/564962095 >> v2:172.21.15.135:3300/0 conn(0x7fb90c150180 0x7fb90c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb903fff700 1 -- 172.21.15.86:0/564962095 >> v1:172.21.15.86:6789/0 conn(0x7fb90c0c7240 legacy=0x7fb90c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb903fff700 1 -- 172.21.15.86:0/564962095 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0c78e0 con 0x7fb90c150550 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.510+0000 7fb90a7fc700 1 -- 172.21.15.86:0/564962095 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417131561 0 0) 0x7fb90c06e2a0 con 0x7fb90c0c7240 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.511+0000 7fb903fff700 1 --2- 172.21.15.86:0/564962095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c150550 0x7fb90c0c6d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb90c06fd20 tx=0x7fb8f400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5defa2b0cadd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.511+0000 7fb90a7fc700 1 -- 172.21.15.86:0/564962095 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400db70 con 0x7fb90c150550 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.511+0000 7fb90a7fc700 1 -- 172.21.15.86:0/564962095 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f400dcd0 con 0x7fb90c150550 2023-10-09T11:41:27.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.511+0000 7fb90a7fc700 1 -- 172.21.15.86:0/564962095 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f40196b0 con 0x7fb90c150550 2023-10-09T11:41:27.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.511+0000 7fb90bfff700 1 -- 172.21.15.86:0/564962095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c150550 msgr2=0x7fb90c0c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.511+0000 7fb90bfff700 1 --2- 172.21.15.86:0/564962095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c150550 0x7fb90c0c6d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb90c06fd20 tx=0x7fb8f400b430 comp rx=0 tx=0).stop 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.512+0000 7fb90bfff700 1 -- 172.21.15.86:0/564962095 shutdown_connections 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.512+0000 7fb90bfff700 1 --2- 172.21.15.86:0/564962095 >> v2:172.21.15.135:3300/0 conn(0x7fb90c150180 0x7fb90c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.512+0000 7fb90bfff700 1 --2- 172.21.15.86:0/564962095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c150550 0x7fb90c0c6d00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.512+0000 7fb90bfff700 1 -- 172.21.15.86:0/564962095 >> 172.21.15.86:0/564962095 conn(0x7fb90c0cc1f0 msgr2=0x7fb90c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.512+0000 7fb90bfff700 1 -- 172.21.15.86:0/564962095 shutdown_connections 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.512+0000 7fb90bfff700 1 -- 172.21.15.86:0/564962095 wait complete. 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.513+0000 7fb90bfff700 1 Processor -- start 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.513+0000 7fb90bfff700 1 -- start start 2023-10-09T11:41:27.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c0c7240 0x7fb90c0c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb90c150180 0x7fb90c0c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb90c150550 0x7fb90c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0aca50 con 0x7fb90c0c7240 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0c5fd0 con 0x7fb90c150180 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0ac120 con 0x7fb90c150550 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c0c7240 0x7fb90c0c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c0c7240 0x7fb90c0c3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54680/0 (socket says 172.21.15.86:54680) 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.514+0000 7fb90affd700 1 -- 172.21.15.86:0/567800592 learned_addr learned my addr 172.21.15.86:0/567800592 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90affd700 1 -- 172.21.15.86:0/567800592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb90c150550 msgr2=0x7fb90c0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90affd700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb90c150550 0x7fb90c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90affd700 1 -- 172.21.15.86:0/567800592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb90c150180 msgr2=0x7fb90c0c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90affd700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb90c150180 0x7fb90c0c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90affd700 1 -- 172.21.15.86:0/567800592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f400b6d0 con 0x7fb90c0c7240 2023-10-09T11:41:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90affd700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c0c7240 0x7fb90c0c3460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00d890 tx=0x7fb8fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb902ffd700 1 -- 172.21.15.86:0/567800592 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00b600 con 0x7fb90c0c7240 2023-10-09T11:41:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb902ffd700 1 -- 172.21.15.86:0/567800592 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00b760 con 0x7fb90c0c7240 2023-10-09T11:41:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c0ac400 con 0x7fb90c0c7240 2023-10-09T11:41:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb902ffd700 1 -- 172.21.15.86:0/567800592 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00bae0 con 0x7fb90c0c7240 2023-10-09T11:41:27.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.515+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c0c5cd0 con 0x7fb90c0c7240 2023-10-09T11:41:27.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.516+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c04c3c0 con 0x7fb90c0c7240 2023-10-09T11:41:27.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.517+0000 7fb902ffd700 1 -- 172.21.15.86:0/567800592 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8fc01e460 con 0x7fb90c0c7240 2023-10-09T11:41:27.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.518+0000 7fb902ffd700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.518+0000 7fb902ffd700 1 -- 172.21.15.86:0/567800592 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8fc084c80 con 0x7fb90c0c7240 2023-10-09T11:41:27.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.518+0000 7fb903fff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.519+0000 7fb903fff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0c62a0 tx=0x7fb8f401b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.522+0000 7fb902ffd700 1 -- 172.21.15.86:0/567800592 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8fc051e50 con 0x7fb90c0c7240 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.753+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb90c069cc0 con 0x7fb90c0c7240 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.754+0000 7fb902ffd700 1 -- 172.21.15.86:0/567800592 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fb8fc055470 con 0x7fb90c0c7240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb8ec066f30 msgr2=0x7fb8ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0c62a0 tx=0x7fb8f401b000 comp rx=0 tx=0).stop 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c0c7240 msgr2=0x7fb90c0c3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c0c7240 0x7fb90c0c3460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00d890 tx=0x7fb8fc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 shutdown_connections 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb90c0c7240 0x7fb90c0c3460 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb90c150550 0x7fb90c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 --2- 172.21.15.86:0/567800592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb90c150180 0x7fb90c0c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 >> 172.21.15.86:0/567800592 conn(0x7fb90c0cc1f0 msgr2=0x7fb90c159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 shutdown_connections 2023-10-09T11:41:27.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.756+0000 7fb90bfff700 1 -- 172.21.15.86:0/567800592 wait complete. 2023-10-09T11:41:27.759 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:27.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:27.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.953+0000 7feadaf9d700 1 Processor -- start 2023-10-09T11:41:27.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.953+0000 7feadaf9d700 1 -- start start 2023-10-09T11:41:27.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.954+0000 7feadaf9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fead4159420 0x7fead40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.954+0000 7feadaf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.954+0000 7feadaf9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fead415d230 0x7fead415d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.954+0000 7feadaf9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead415dbd0 con 0x7fead4159420 2023-10-09T11:41:27.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.954+0000 7feadaf9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead40b11d0 con 0x7fead415d230 2023-10-09T11:41:27.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.954+0000 7feadaf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead40b14b0 con 0x7fead41597f0 2023-10-09T11:41:27.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.954+0000 7fead9f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fead4159420 0x7fead40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fead4159420 0x7fead40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54696/0 (socket says 172.21.15.86:54696) 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 -- 172.21.15.86:0/3309395568 learned_addr learned my addr 172.21.15.86:0/3309395568 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 -- 172.21.15.86:0/3309395568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 msgr2=0x7fead40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7feada79c700 1 --2- 172.21.15.86:0/3309395568 >> v2:172.21.15.135:3300/0 conn(0x7fead415d230 0x7fead415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead979a700 1 --2- 172.21.15.86:0/3309395568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 --2- 172.21.15.86:0/3309395568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 -- 172.21.15.86:0/3309395568 >> v2:172.21.15.135:3300/0 conn(0x7fead415d230 msgr2=0x7fead415d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 --2- 172.21.15.86:0/3309395568 >> v2:172.21.15.135:3300/0 conn(0x7fead415d230 0x7fead415d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 -- 172.21.15.86:0/3309395568 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40b1790 con 0x7fead4159420 2023-10-09T11:41:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead979a700 1 --2- 172.21.15.86:0/3309395568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:27.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7feada79c700 1 --2- 172.21.15.86:0/3309395568 >> v2:172.21.15.135:3300/0 conn(0x7fead415d230 0x7fead415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:27.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead9f9b700 1 --2- 172.21.15.86:0/3309395568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead40b5f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fead40d1720 tx=0x7fead0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9432e89763bf25da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.955+0000 7fead8f99700 1 -- 172.21.15.86:0/3309395568 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000b860 con 0x7fead4159420 2023-10-09T11:41:27.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7fead8f99700 1 -- 172.21.15.86:0/3309395568 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000b9c0 con 0x7fead4159420 2023-10-09T11:41:27.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7fead8f99700 1 -- 172.21.15.86:0/3309395568 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000bd60 con 0x7fead4159420 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 -- 172.21.15.86:0/3309395568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 msgr2=0x7fead40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 --2- 172.21.15.86:0/3309395568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead40b5f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fead40d1720 tx=0x7fead0009250 comp rx=0 tx=0).stop 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 -- 172.21.15.86:0/3309395568 shutdown_connections 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 --2- 172.21.15.86:0/3309395568 >> v2:172.21.15.135:3300/0 conn(0x7fead415d230 0x7fead415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 --2- 172.21.15.86:0/3309395568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead40b5f40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 --2- 172.21.15.86:0/3309395568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 -- 172.21.15.86:0/3309395568 >> 172.21.15.86:0/3309395568 conn(0x7fead40d0660 msgr2=0x7fead40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 -- 172.21.15.86:0/3309395568 shutdown_connections 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.956+0000 7feadaf9d700 1 -- 172.21.15.86:0/3309395568 wait complete. 2023-10-09T11:41:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.958+0000 7feadaf9d700 1 Processor -- start 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.958+0000 7feadaf9d700 1 -- start start 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feadaf9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead4141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feadaf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead4169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feadaf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fead415d230 0x7fead41521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feadaf9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead41415d0 con 0x7fead4159420 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feadaf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead415aa80 con 0x7fead415d230 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feadaf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead415ad60 con 0x7fead41597f0 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead4141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead4141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54708/0 (socket says 172.21.15.86:54708) 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 -- 172.21.15.86:0/1923765375 learned_addr learned my addr 172.21.15.86:0/1923765375 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:27.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead979a700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead4169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feada79c700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fead415d230 0x7fead41521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 -- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 msgr2=0x7fead4169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead4169af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 -- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fead415d230 msgr2=0x7fead41521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fead415d230 0x7fead41521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 -- 172.21.15.86:0/1923765375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00094f0 con 0x7fead4159420 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7feada79c700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fead415d230 0x7fead41521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.959+0000 7fead9f9b700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead4141090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fead4089340 tx=0x7fead0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.960+0000 7feac9ffb700 1 -- 172.21.15.86:0/1923765375 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0024440 con 0x7fead4159420 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.960+0000 7feac9ffb700 1 -- 172.21.15.86:0/1923765375 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead00245a0 con 0x7fead4159420 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.960+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead415b040 con 0x7fead4159420 2023-10-09T11:41:27.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.960+0000 7feac9ffb700 1 -- 172.21.15.86:0/1923765375 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0024960 con 0x7fead4159420 2023-10-09T11:41:27.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.960+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead415b600 con 0x7fead4159420 2023-10-09T11:41:27.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.961+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead415b7f0 con 0x7fead4159420 2023-10-09T11:41:27.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.962+0000 7feac9ffb700 1 -- 172.21.15.86:0/1923765375 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fead001a420 con 0x7fead4159420 2023-10-09T11:41:27.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.962+0000 7feac9ffb700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7feab8066f30 0x7feab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.962+0000 7feac9ffb700 1 -- 172.21.15.86:0/1923765375 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fead0086440 con 0x7fead4159420 2023-10-09T11:41:27.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.963+0000 7fead979a700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7feab8066f30 0x7feab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.963+0000 7fead979a700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7feab8066f30 0x7feab80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fead415a630 tx=0x7feac4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:27.967+0000 7feac9ffb700 1 -- 172.21.15.86:0/1923765375 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fead00536b0 con 0x7fead4159420 2023-10-09T11:41:28.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.164+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fead404c3c0 con 0x7fead4159420 2023-10-09T11:41:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.165+0000 7feac9ffb700 1 -- 172.21.15.86:0/1923765375 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fead0056cd0 con 0x7fead4159420 2023-10-09T11:41:28.167 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:28.167 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.167+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7feab8066f30 msgr2=0x7feab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.167+0000 7feadaf9d700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7feab8066f30 0x7feab80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fead415a630 tx=0x7feac4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.167+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 msgr2=0x7fead4141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.167+0000 7feadaf9d700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead4141090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fead4089340 tx=0x7fead0017000 comp rx=0 tx=0).stop 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.167+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 shutdown_connections 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.167+0000 7feadaf9d700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7feab8066f30 0x7feab80693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.168+0000 7feadaf9d700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead4159420 0x7fead4141090 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.168+0000 7feadaf9d700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fead415d230 0x7fead41521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.168+0000 7feadaf9d700 1 --2- 172.21.15.86:0/1923765375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead41597f0 0x7fead4169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.168+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 >> 172.21.15.86:0/1923765375 conn(0x7fead40d0660 msgr2=0x7fead40698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.168+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 shutdown_connections 2023-10-09T11:41:28.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.168+0000 7feadaf9d700 1 -- 172.21.15.86:0/1923765375 wait complete. 2023-10-09T11:41:28.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:09.500279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:10.496954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:28.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:28.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.370+0000 7fa8e37ff700 1 Processor -- start 2023-10-09T11:41:28.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.370+0000 7fa8e37ff700 1 -- start start 2023-10-09T11:41:28.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.371+0000 7fa8e37ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 0x7fa8dc06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.371+0000 7fa8e37ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa8dc069e80 0x7fa8dc0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.371+0000 7fa8e37ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc06eb90 con 0x7fa8dc0c70b0 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8e37ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc06ee70 con 0x7fa8dc069e80 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8e37ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc06f150 con 0x7fa8dc155eb0 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8e0d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa8dc0c70b0 0x7fa8dc069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:57990/0 (socket says 172.21.15.86:57990) 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8e0d9a700 1 -- 172.21.15.86:0/3335677286 learned_addr learned my addr 172.21.15.86:0/3335677286 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098956732 0 0) 0x7fa8dc06eb90 con 0x7fa8dc0c70b0 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8e1d9c700 1 --2- 172.21.15.86:0/3335677286 >> v2:172.21.15.135:3300/0 conn(0x7fa8dc069e80 0x7fa8dc0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8e159b700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 0x7fa8dc06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c8004680 con 0x7fa8dc0c70b0 2023-10-09T11:41:28.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049092842 0 0) 0x7fa8c8004680 con 0x7fa8dc0c70b0 2023-10-09T11:41:28.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 msgr2=0x7fa8dc06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 0x7fa8dc06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 >> v2:172.21.15.135:3300/0 conn(0x7fa8dc069e80 msgr2=0x7fa8dc0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 --2- 172.21.15.86:0/3335677286 >> v2:172.21.15.135:3300/0 conn(0x7fa8dc069e80 0x7fa8dc0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc06f430 con 0x7fa8dc0c70b0 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.372+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa8cc001470 con 0x7fa8dc0c70b0 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 >> v1:172.21.15.86:6789/0 conn(0x7fa8dc0c70b0 legacy=0x7fa8dc069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8d3fff700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8c8004b70 0x7fa8c8004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8d3fff700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8005920 0x7fa8c8005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8d3fff700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 0x7fa8c80062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc06ee70 con 0x7fa8c8005920 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc06f150 con 0x7fa8c8004b70 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8003490 con 0x7fa8dc155eb0 2023-10-09T11:41:28.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e0d9a700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8005920 0x7fa8c8005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e159b700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8c8004b70 0x7fa8c8004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e1d9c700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 0x7fa8c80062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e0d9a700 1 -- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 msgr2=0x7fa8c80062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e0d9a700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8dc155eb0 0x7fa8c80062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e0d9a700 1 -- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8c8004b70 msgr2=0x7fa8c8004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e0d9a700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8c8004b70 0x7fa8c8004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.373+0000 7fa8e0d9a700 1 -- 172.21.15.86:0/3335677286 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8004680 con 0x7fa8c8005920 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e0d9a700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8005920 0x7fa8c8005d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c3c0 tx=0x7fa8cc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7b63474978b979 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00cc90 con 0x7fa8c8005920 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc00ce10 con 0x7fa8c8005920 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8d3fff700 1 -- 172.21.15.86:0/3335677286 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc005b70 con 0x7fa8c8005920 2023-10-09T11:41:28.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e37ff700 1 -- 172.21.15.86:0/3335677286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8005920 msgr2=0x7fa8c8005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e37ff700 1 --2- 172.21.15.86:0/3335677286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8005920 0x7fa8c8005d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c3c0 tx=0x7fa8cc001e90 comp rx=0 tx=0).stop 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e1d9c700 1 -- 172.21.15.86:0/3335677286 reap_dead start 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e37ff700 1 -- 172.21.15.86:0/3335677286 shutdown_connections 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e37ff700 1 -- 172.21.15.86:0/3335677286 >> 172.21.15.86:0/3335677286 conn(0x7fa8dc068e10 msgr2=0x7fa8dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e37ff700 1 -- 172.21.15.86:0/3335677286 shutdown_connections 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.374+0000 7fa8e37ff700 1 -- 172.21.15.86:0/3335677286 wait complete. 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.376+0000 7fa8e37ff700 1 Processor -- start 2023-10-09T11:41:28.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.376+0000 7fa8e37ff700 1 -- start start 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e37ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8c8005920 0x7fa8dc144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e37ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc151f50 0x7fa8dc0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e37ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8dc0b0fd0 0x7fa8dc0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e37ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0b0630 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e37ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0b1980 con 0x7fa8dc151f50 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e37ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc145520 con 0x7fa8c8005920 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8dc0b0fd0 0x7fa8dc0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8dc0b0fd0 0x7fa8dc0b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54724/0 (socket says 172.21.15.86:54724) 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 -- 172.21.15.86:0/4214309062 learned_addr learned my addr 172.21.15.86:0/4214309062 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:28.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e0d9a700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc151f50 0x7fa8dc0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e159b700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8c8005920 0x7fa8dc144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 -- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8c8005920 msgr2=0x7fa8dc144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8c8005920 0x7fa8dc144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 -- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc151f50 msgr2=0x7fa8dc0af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc151f50 0x7fa8dc0af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e1d9c700 1 -- 172.21.15.86:0/4214309062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0af810 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.377+0000 7fa8e0d9a700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc151f50 0x7fa8dc0af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.378+0000 7fa8e1d9c700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8dc0b0fd0 0x7fa8dc0b1440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40094d0 tx=0x7fa8d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.378+0000 7fa8d17fa700 1 -- 172.21.15.86:0/4214309062 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400e040 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.378+0000 7fa8d17fa700 1 -- 172.21.15.86:0/4214309062 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d400f040 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.378+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc0afab0 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.378+0000 7fa8d17fa700 1 -- 172.21.15.86:0/4214309062 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400fe20 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.378+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc0b0070 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.379+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc0abbb0 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.380+0000 7fa8d17fa700 1 -- 172.21.15.86:0/4214309062 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8d4015640 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.381+0000 7fa8d17fa700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8c0066f30 0x7fa8c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.381+0000 7fa8d17fa700 1 -- 172.21.15.86:0/4214309062 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8d4084e90 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.381+0000 7fa8e159b700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8c0066f30 0x7fa8c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.381+0000 7fa8e159b700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8c0066f30 0x7fa8c00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8006f00 tx=0x7fa8d80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.385+0000 7fa8d17fa700 1 -- 172.21.15.86:0/4214309062 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8dc0abbb0 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.574+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8dc0abbb0 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.575+0000 7fa8d17fa700 1 -- 172.21.15.86:0/4214309062 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8dc0abbb0 con 0x7fa8dc0b0fd0 2023-10-09T11:41:28.576 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8c0066f30 msgr2=0x7fa8c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8c0066f30 0x7fa8c00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8006f00 tx=0x7fa8d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8dc0b0fd0 msgr2=0x7fa8dc0b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8dc0b0fd0 0x7fa8dc0b1440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40094d0 tx=0x7fa8d400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 shutdown_connections 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8c0066f30 0x7fa8c00693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8dc0b0fd0 0x7fa8dc0b1440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8c8005920 0x7fa8dc144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 --2- 172.21.15.86:0/4214309062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8dc151f50 0x7fa8dc0af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 >> 172.21.15.86:0/4214309062 conn(0x7fa8dc068e10 msgr2=0x7fa8dc155150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 shutdown_connections 2023-10-09T11:41:28.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.577+0000 7fa8e37ff700 1 -- 172.21.15.86:0/4214309062 wait complete. 2023-10-09T11:41:28.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:28.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.778+0000 7fb6f31ff700 1 Processor -- start 2023-10-09T11:41:28.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.778+0000 7fb6f31ff700 1 -- start start 2023-10-09T11:41:28.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f31ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb6ec069e80 0x7fb6ec160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f31ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec06e950 con 0x7fb6ec155eb0 2023-10-09T11:41:28.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f31ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec06eb90 con 0x7fb6ec0c70b0 2023-10-09T11:41:28.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f31ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec06ee70 con 0x7fb6ec069e80 2023-10-09T11:41:28.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f0f9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb6ec155eb0 0x7fb6ec06e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:57996/0 (socket says 172.21.15.86:57996) 2023-10-09T11:41:28.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f0f9b700 1 -- 172.21.15.86:0/2403567049 learned_addr learned my addr 172.21.15.86:0/2403567049 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:28.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f179c700 1 --2- 172.21.15.86:0/2403567049 >> v2:172.21.15.86:3300/0 conn(0x7fb6ec069e80 0x7fb6ec160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6eb7fe700 1 -- 172.21.15.86:0/2403567049 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141041227 0 0) 0x7fb6e0001110 con 0x7fb6ec155eb0 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6eb7fe700 1 -- 172.21.15.86:0/2403567049 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6dc004680 con 0x7fb6ec155eb0 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f179c700 1 -- 172.21.15.86:0/2403567049 >> v1:172.21.15.135:6789/0 conn(0x7fb6ec0c70b0 legacy=0x7fb6ec069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f179c700 1 -- 172.21.15.86:0/2403567049 >> v1:172.21.15.86:6789/0 conn(0x7fb6ec155eb0 legacy=0x7fb6ec06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.780+0000 7fb6f179c700 1 -- 172.21.15.86:0/2403567049 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec06f150 con 0x7fb6ec069e80 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.781+0000 7fb6f179c700 1 --2- 172.21.15.86:0/2403567049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec069e80 0x7fb6ec160bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009e60 tx=0x7fb6e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588a1507c0ae8dbb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.781+0000 7fb6eb7fe700 1 -- 172.21.15.86:0/2403567049 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e400e070 con 0x7fb6ec069e80 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.781+0000 7fb6eb7fe700 1 -- 172.21.15.86:0/2403567049 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e400bb60 con 0x7fb6ec069e80 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.781+0000 7fb6eb7fe700 1 -- 172.21.15.86:0/2403567049 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4012430 con 0x7fb6ec069e80 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.781+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2403567049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec069e80 msgr2=0x7fb6ec160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.781+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2403567049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec069e80 0x7fb6ec160bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009e60 tx=0x7fb6e4009780 comp rx=0 tx=0).stop 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.782+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2403567049 shutdown_connections 2023-10-09T11:41:28.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.782+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2403567049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec069e80 0x7fb6ec160bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.782+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2403567049 >> 172.21.15.86:0/2403567049 conn(0x7fb6ec068e10 msgr2=0x7fb6ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.782+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2403567049 shutdown_connections 2023-10-09T11:41:28.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.782+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2403567049 wait complete. 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.783+0000 7fb6f31ff700 1 Processor -- start 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.783+0000 7fb6f31ff700 1 -- start start 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f31ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6ec069e80 0x7fb6ec152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f31ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6ec0c70b0 0x7fb6ec0ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f31ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec155eb0 0x7fb6ec140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f31ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec140ab0 con 0x7fb6ec155eb0 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f31ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0c5580 con 0x7fb6ec0c70b0 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f31ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec153250 con 0x7fb6ec069e80 2023-10-09T11:41:28.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f179c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec155eb0 0x7fb6ec140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f179c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec155eb0 0x7fb6ec140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54742/0 (socket says 172.21.15.86:54742) 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f179c700 1 -- 172.21.15.86:0/2598872371 learned_addr learned my addr 172.21.15.86:0/2598872371 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6f0f9b700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6ec069e80 0x7fb6ec152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.784+0000 7fb6ebfff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6ec0c70b0 0x7fb6ec0ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f179c700 1 -- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6ec069e80 msgr2=0x7fb6ec152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f179c700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6ec069e80 0x7fb6ec152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f179c700 1 -- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6ec0c70b0 msgr2=0x7fb6ec0ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f179c700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6ec0c70b0 0x7fb6ec0ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f179c700 1 -- 172.21.15.86:0/2598872371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4009a20 con 0x7fb6ec155eb0 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f0f9b700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6ec069e80 0x7fb6ec152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6ebfff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6ec0c70b0 0x7fb6ec0ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:28.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f179c700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec155eb0 0x7fb6ec140d50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec06fe40 tx=0x7fb6e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6e8ff9700 1 -- 172.21.15.86:0/2598872371 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4012e50 con 0x7fb6ec155eb0 2023-10-09T11:41:28.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6e8ff9700 1 -- 172.21.15.86:0/2598872371 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e401d630 con 0x7fb6ec155eb0 2023-10-09T11:41:28.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec0c4970 con 0x7fb6ec155eb0 2023-10-09T11:41:28.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6e8ff9700 1 -- 172.21.15.86:0/2598872371 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e401d9f0 con 0x7fb6ec155eb0 2023-10-09T11:41:28.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.785+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec0c4f30 con 0x7fb6ec155eb0 2023-10-09T11:41:28.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.786+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec04c3c0 con 0x7fb6ec155eb0 2023-10-09T11:41:28.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.787+0000 7fb6e8ff9700 1 -- 172.21.15.86:0/2598872371 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6e4024070 con 0x7fb6ec155eb0 2023-10-09T11:41:28.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.788+0000 7fb6e8ff9700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb6d0066f30 0x7fb6d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.788+0000 7fb6e8ff9700 1 -- 172.21.15.86:0/2598872371 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6e4086d70 con 0x7fb6ec155eb0 2023-10-09T11:41:28.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.788+0000 7fb6f0f9b700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb6d0066f30 0x7fb6d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.789+0000 7fb6f0f9b700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb6d0066f30 0x7fb6d00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0c39a0 tx=0x7fb6e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.792+0000 7fb6e8ff9700 1 -- 172.21.15.86:0/2598872371 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6e4053fe0 con 0x7fb6ec155eb0 2023-10-09T11:41:28.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.980+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6ec0678d0 con 0x7fb6ec155eb0 2023-10-09T11:41:28.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.981+0000 7fb6e8ff9700 1 -- 172.21.15.86:0/2598872371 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6e4057600 con 0x7fb6ec155eb0 2023-10-09T11:41:28.982 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:41:28.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb6d0066f30 msgr2=0x7fb6d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb6d0066f30 0x7fb6d00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0c39a0 tx=0x7fb6e0009040 comp rx=0 tx=0).stop 2023-10-09T11:41:28.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec155eb0 msgr2=0x7fb6ec140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec155eb0 0x7fb6ec140d50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec06fe40 tx=0x7fb6e4019000 comp rx=0 tx=0).stop 2023-10-09T11:41:28.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 shutdown_connections 2023-10-09T11:41:28.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb6d0066f30 0x7fb6d00693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6ec155eb0 0x7fb6ec140d50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6ec069e80 0x7fb6ec152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 --2- 172.21.15.86:0/2598872371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6ec0c70b0 0x7fb6ec0ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 >> 172.21.15.86:0/2598872371 conn(0x7fb6ec068e10 msgr2=0x7fb6ec06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 shutdown_connections 2023-10-09T11:41:28.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:28.983+0000 7fb6f31ff700 1 -- 172.21.15.86:0/2598872371 wait complete. 2023-10-09T11:41:29.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:29.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.185+0000 7fa2c47ff700 1 Processor -- start 2023-10-09T11:41:29.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.185+0000 7fa2c47ff700 1 -- start start 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.186+0000 7fa2c47ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa2bc155eb0 0x7fa2bc06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.186+0000 7fa2c47ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc0c70b0 0x7fa2bc069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.186+0000 7fa2c47ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc06eb90 con 0x7fa2bc069cb0 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c47ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc06a130 con 0x7fa2bc155eb0 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c47ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc06ee70 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa2bc155eb0 0x7fa2bc06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa2bc155eb0 0x7fa2bc06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54756/0 (socket says 172.21.15.86:54756) 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 -- 172.21.15.86:0/4286359590 learned_addr learned my addr 172.21.15.86:0/4286359590 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:29.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 -- 172.21.15.86:0/4286359590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc0c70b0 msgr2=0x7fa2bc069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 --2- 172.21.15.86:0/4286359590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc0c70b0 0x7fa2bc069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 -- 172.21.15.86:0/4286359590 >> v1:172.21.15.135:6789/0 conn(0x7fa2bc069cb0 legacy=0x7fa2bc159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 -- 172.21.15.86:0/4286359590 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc06f150 con 0x7fa2bc155eb0 2023-10-09T11:41:29.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c259b700 1 --2- 172.21.15.86:0/4286359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc06e240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80099b0 tx=0x7fa2b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9497bac29c6140 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.187+0000 7fa2c1599700 1 -- 172.21.15.86:0/4286359590 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800b820 con 0x7fa2bc155eb0 2023-10-09T11:41:29.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c1599700 1 -- 172.21.15.86:0/4286359590 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b800b980 con 0x7fa2bc155eb0 2023-10-09T11:41:29.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c1599700 1 -- 172.21.15.86:0/4286359590 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800bd20 con 0x7fa2bc155eb0 2023-10-09T11:41:29.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4286359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc155eb0 msgr2=0x7fa2bc06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4286359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc06e240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80099b0 tx=0x7fa2b8009250 comp rx=0 tx=0).stop 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4286359590 shutdown_connections 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4286359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc06e240 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4286359590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc0c70b0 0x7fa2bc069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4286359590 >> 172.21.15.86:0/4286359590 conn(0x7fa2bc068e10 msgr2=0x7fa2bc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4286359590 shutdown_connections 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.188+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4286359590 wait complete. 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.190+0000 7fa2c47ff700 1 Processor -- start 2023-10-09T11:41:29.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.190+0000 7fa2c47ff700 1 -- start start 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c47ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc069cb0 0x7fa2bc16b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c47ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc0c70b0 0x7fa2bc16a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c47ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc0ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c47ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0adbc0 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c47ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc16afb0 con 0x7fa2bc155eb0 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c47ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc16a710 con 0x7fa2bc069cb0 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc0c70b0 0x7fa2bc16a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc0c70b0 0x7fa2bc16a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54770/0 (socket says 172.21.15.86:54770) 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 -- 172.21.15.86:0/4200553979 learned_addr learned my addr 172.21.15.86:0/4200553979 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c259b700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc069cb0 0x7fa2bc16b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c2d9c700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc0ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 -- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc069cb0 msgr2=0x7fa2bc16b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc069cb0 0x7fa2bc16b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 -- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc155eb0 msgr2=0x7fa2bc0ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc0ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 -- 172.21.15.86:0/4200553979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b80094f0 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c259b700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc069cb0 0x7fa2bc16b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c2d9c700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc0ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.191+0000 7fa2c1d9a700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc0c70b0 0x7fa2bc16a050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00b810 tx=0x7fa2ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.192+0000 7fa2b27fc700 1 -- 172.21.15.86:0/4200553979 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00f5f0 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.192+0000 7fa2b27fc700 1 -- 172.21.15.86:0/4200553979 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac00f770 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.192+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc16a9f0 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.192+0000 7fa2b27fc700 1 -- 172.21.15.86:0/4200553979 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00fb30 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.192+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc14c320 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.193+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc04c3c0 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.194+0000 7fa2b27fc700 1 -- 172.21.15.86:0/4200553979 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2ac010480 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.194+0000 7fa2b27fc700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.194+0000 7fa2b27fc700 1 -- 172.21.15.86:0/4200553979 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2ac0845b0 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.195+0000 7fa2c259b700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.195+0000 7fa2c259b700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa2a0066f30 0x7fa2a00693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80099b0 tx=0x7fa2b8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.198+0000 7fa2b27fc700 1 -- 172.21.15.86:0/4200553979 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2ac051800 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.390+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2bc06f430 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.390+0000 7fa2b27fc700 1 -- 172.21.15.86:0/4200553979 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2ac054e20 con 0x7fa2bc0c70b0 2023-10-09T11:41:29.392 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:41:29.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa2a0066f30 msgr2=0x7fa2a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa2a0066f30 0x7fa2a00693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80099b0 tx=0x7fa2b8016000 comp rx=0 tx=0).stop 2023-10-09T11:41:29.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc0c70b0 msgr2=0x7fa2bc16a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc0c70b0 0x7fa2bc16a050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00b810 tx=0x7fa2ac009250 comp rx=0 tx=0).stop 2023-10-09T11:41:29.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 shutdown_connections 2023-10-09T11:41:29.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc155eb0 0x7fa2bc0ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2bc069cb0 0x7fa2bc16b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 --2- 172.21.15.86:0/4200553979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2bc0c70b0 0x7fa2bc16a050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 >> 172.21.15.86:0/4200553979 conn(0x7fa2bc068e10 msgr2=0x7fa2bc0c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 shutdown_connections 2023-10-09T11:41:29.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.393+0000 7fa2c47ff700 1 -- 172.21.15.86:0/4200553979 wait complete. 2023-10-09T11:41:29.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:29.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.590+0000 7f768ebff700 1 Processor -- start 2023-10-09T11:41:29.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.590+0000 7f768ebff700 1 -- start start 2023-10-09T11:41:29.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.591+0000 7f768ebff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76880b1420 0x7f76880ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.591+0000 7f768ebff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880cc300 con 0x7f76880cbf30 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.591+0000 7f768ebff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880ad370 con 0x7f76880ccf90 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.591+0000 7f768ebff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7688156bf0 con 0x7f76880b1420 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.591+0000 7f7687fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76880b1420 0x7f76880ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f7687fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76880b1420 0x7f76880ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54782/0 (socket says 172.21.15.86:54782) 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f7687fff700 1 -- 172.21.15.86:0/3077095865 learned_addr learned my addr 172.21.15.86:0/3077095865 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f768c99b700 1 --1- 172.21.15.86:0/3077095865 >> v1:172.21.15.86:6789/0 conn(0x7f76880cbf30 0x7f76880b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58006/0 (socket says 172.21.15.86:58006) 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f7687fff700 1 -- 172.21.15.86:0/3077095865 >> v1:172.21.15.135:6789/0 conn(0x7f76880ccf90 legacy=0x7f76880c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f7687fff700 1 -- 172.21.15.86:0/3077095865 >> v1:172.21.15.86:6789/0 conn(0x7f76880cbf30 legacy=0x7f76880b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f76877fe700 1 -- 172.21.15.86:0/3077095865 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442435796 0 0) 0x7f76880cc300 con 0x7f76880cbf30 2023-10-09T11:41:29.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f7687fff700 1 -- 172.21.15.86:0/3077095865 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880ad650 con 0x7f76880b1420 2023-10-09T11:41:29.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f7687fff700 1 --2- 172.21.15.86:0/3077095865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880ae410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76740099b0 tx=0x7f7674009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa0afdcde714efa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.592+0000 7f76877fe700 1 -- 172.21.15.86:0/3077095865 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400b820 con 0x7f76880b1420 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f76877fe700 1 -- 172.21.15.86:0/3077095865 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767400b980 con 0x7f76880b1420 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f76877fe700 1 -- 172.21.15.86:0/3077095865 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400bd20 con 0x7f76880b1420 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f768ebff700 1 -- 172.21.15.86:0/3077095865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 msgr2=0x7f76880ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f768ebff700 1 --2- 172.21.15.86:0/3077095865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880ae410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76740099b0 tx=0x7f7674009250 comp rx=0 tx=0).stop 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f768ebff700 1 -- 172.21.15.86:0/3077095865 shutdown_connections 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f768ebff700 1 --2- 172.21.15.86:0/3077095865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880ae410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f768ebff700 1 -- 172.21.15.86:0/3077095865 >> 172.21.15.86:0/3077095865 conn(0x7f768806a320 msgr2=0x7f76880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f768ebff700 1 -- 172.21.15.86:0/3077095865 shutdown_connections 2023-10-09T11:41:29.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.593+0000 7f768ebff700 1 -- 172.21.15.86:0/3077095865 wait complete. 2023-10-09T11:41:29.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.595+0000 7f768ebff700 1 Processor -- start 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.595+0000 7f768ebff700 1 -- start start 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768ebff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768ebff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76880cbf30 0x7f7688154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768ebff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76880ccf90 0x7f76880c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768ebff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7688169ed0 con 0x7f76880b1420 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768ebff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768816a190 con 0x7f76880cbf30 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768ebff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768816a470 con 0x7f76880ccf90 2023-10-09T11:41:29.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54784/0 (socket says 172.21.15.86:54784) 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 -- 172.21.15.86:0/2119821540 learned_addr learned my addr 172.21.15.86:0/2119821540 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 -- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76880ccf90 msgr2=0x7f76880c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f7687fff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76880cbf30 0x7f7688154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768d19c700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76880ccf90 0x7f76880c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76880ccf90 0x7f76880c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 -- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76880cbf30 msgr2=0x7f7688154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76880cbf30 0x7f7688154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768c99b700 1 -- 172.21.15.86:0/2119821540 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76740094f0 con 0x7f76880b1420 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f7687fff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76880cbf30 0x7f7688154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.596+0000 7f768d19c700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76880ccf90 0x7f76880c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:29.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.597+0000 7f768c99b700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880c17e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c810 tx=0x7f767c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.597+0000 7f7684ff9700 1 -- 172.21.15.86:0/2119821540 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0063d0 con 0x7f76880b1420 2023-10-09T11:41:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.597+0000 7f7684ff9700 1 -- 172.21.15.86:0/2119821540 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c006530 con 0x7f76880b1420 2023-10-09T11:41:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.597+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768816a750 con 0x7f76880b1420 2023-10-09T11:41:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.597+0000 7f7684ff9700 1 -- 172.21.15.86:0/2119821540 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c004a60 con 0x7f76880b1420 2023-10-09T11:41:29.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.597+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768816ad10 con 0x7f76880b1420 2023-10-09T11:41:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.598+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76880aa8a0 con 0x7f76880b1420 2023-10-09T11:41:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.599+0000 7f7684ff9700 1 -- 172.21.15.86:0/2119821540 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f767c01b400 con 0x7f76880b1420 2023-10-09T11:41:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.599+0000 7f7684ff9700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f766c066f30 0x7f766c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.599+0000 7f7684ff9700 1 -- 172.21.15.86:0/2119821540 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f767c0840b0 con 0x7f76880b1420 2023-10-09T11:41:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.600+0000 7f7687fff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f766c066f30 0x7f766c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.600+0000 7f7687fff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f766c066f30 0x7f766c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f76740099b0 tx=0x7f7674016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.603+0000 7f7684ff9700 1 -- 172.21.15.86:0/2119821540 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76880aa8a0 con 0x7f76880b1420 2023-10-09T11:41:29.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.837+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76880aa8a0 con 0x7f76880b1420 2023-10-09T11:41:29.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.838+0000 7f7684ff9700 1 -- 172.21.15.86:0/2119821540 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f76880aa8a0 con 0x7f76880b1420 2023-10-09T11:41:29.839 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:29.839 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:29.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f766c066f30 msgr2=0x7f766c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f766c066f30 0x7f766c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f76740099b0 tx=0x7f7674016000 comp rx=0 tx=0).stop 2023-10-09T11:41:29.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 msgr2=0x7f76880c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880c17e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c810 tx=0x7f767c007de0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 shutdown_connections 2023-10-09T11:41:29.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f766c066f30 0x7f766c0693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76880b1420 0x7f76880c17e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76880ccf90 0x7f76880c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 --2- 172.21.15.86:0/2119821540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76880cbf30 0x7f7688154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 >> 172.21.15.86:0/2119821540 conn(0x7f768806a320 msgr2=0x7f76880ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 shutdown_connections 2023-10-09T11:41:29.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:29.840+0000 7f768ebff700 1 -- 172.21.15.86:0/2119821540 wait complete. 2023-10-09T11:41:29.843 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:29.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:30.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.037+0000 7fb3535ff700 1 Processor -- start 2023-10-09T11:41:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.037+0000 7fb3535ff700 1 -- start start 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.038+0000 7fb3535ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb34c155c10 0x7fb34c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.038+0000 7fb3535ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0acac0 con 0x7fb34c0ac230 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.038+0000 7fb3535ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0ad930 con 0x7fb34c0ac6d0 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.038+0000 7fb3535ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0acd20 con 0x7fb34c155c10 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb35139b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb34c155c10 0x7fb34c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb35139b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb34c155c10 0x7fb34c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54792/0 (socket says 172.21.15.86:54792) 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb350b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb34c0ac230 0x7fb34c1568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58010/0 (socket says 172.21.15.86:58010) 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb35139b700 1 -- 172.21.15.86:0/1650014204 learned_addr learned my addr 172.21.15.86:0/1650014204 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb35139b700 1 -- 172.21.15.86:0/1650014204 >> v1:172.21.15.135:6789/0 conn(0x7fb34c0ac6d0 legacy=0x7fb34c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb35139b700 1 -- 172.21.15.86:0/1650014204 >> v1:172.21.15.86:6789/0 conn(0x7fb34c0ac230 legacy=0x7fb34c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb35139b700 1 -- 172.21.15.86:0/1650014204 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0ad000 con 0x7fb34c155c10 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb343fff700 1 -- 172.21.15.86:0/1650014204 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576913780 0 0) 0x7fb34c0acac0 con 0x7fb34c0ac230 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.039+0000 7fb35139b700 1 --2- 172.21.15.86:0/1650014204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c155c10 0x7fb34c155fe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb34800ab50 tx=0x7fb34800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986f4fe78612f752 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb343fff700 1 -- 172.21.15.86:0/1650014204 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800c9c0 con 0x7fb34c155c10 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb343fff700 1 -- 172.21.15.86:0/1650014204 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800cb20 con 0x7fb34c155c10 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb343fff700 1 -- 172.21.15.86:0/1650014204 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800f470 con 0x7fb34c155c10 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb3535ff700 1 -- 172.21.15.86:0/1650014204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c155c10 msgr2=0x7fb34c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb3535ff700 1 --2- 172.21.15.86:0/1650014204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c155c10 0x7fb34c155fe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb34800ab50 tx=0x7fb34800a3f0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb3535ff700 1 -- 172.21.15.86:0/1650014204 shutdown_connections 2023-10-09T11:41:30.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb3535ff700 1 --2- 172.21.15.86:0/1650014204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c155c10 0x7fb34c155fe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb3535ff700 1 -- 172.21.15.86:0/1650014204 >> 172.21.15.86:0/1650014204 conn(0x7fb34c06a320 msgr2=0x7fb34c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb3535ff700 1 -- 172.21.15.86:0/1650014204 shutdown_connections 2023-10-09T11:41:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.040+0000 7fb3535ff700 1 -- 172.21.15.86:0/1650014204 wait complete. 2023-10-09T11:41:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.042+0000 7fb3535ff700 1 Processor -- start 2023-10-09T11:41:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.042+0000 7fb3535ff700 1 -- start start 2023-10-09T11:41:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb3535ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c0ac230 0x7fb34c0aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb3535ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c0ac6d0 0x7fb34c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb3535ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb34c155c10 0x7fb34c0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb3535ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c2270 con 0x7fb34c0ac230 2023-10-09T11:41:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb3535ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c2930 con 0x7fb34c0ac6d0 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb3535ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0c1cb0 con 0x7fb34c155c10 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c0ac230 0x7fb34c0aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c0ac230 0x7fb34c0aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54796/0 (socket says 172.21.15.86:54796) 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 -- 172.21.15.86:0/3615821439 learned_addr learned my addr 172.21.15.86:0/3615821439 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb350b9a700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c0ac6d0 0x7fb34c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb351b9c700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb34c155c10 0x7fb34c0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 -- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb34c155c10 msgr2=0x7fb34c0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb34c155c10 0x7fb34c0c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 -- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c0ac6d0 msgr2=0x7fb34c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c0ac6d0 0x7fb34c0c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.043+0000 7fb35139b700 1 -- 172.21.15.86:0/3615821439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34800a690 con 0x7fb34c0ac230 2023-10-09T11:41:30.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.044+0000 7fb35139b700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c0ac230 0x7fb34c0aaaf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb348008010 tx=0x7fb348018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.044+0000 7fb3417fa700 1 -- 172.21.15.86:0/3615821439 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348006bc0 con 0x7fb34c0ac230 2023-10-09T11:41:30.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.044+0000 7fb3417fa700 1 -- 172.21.15.86:0/3615821439 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348017630 con 0x7fb34c0ac230 2023-10-09T11:41:30.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.044+0000 7fb3417fa700 1 -- 172.21.15.86:0/3615821439 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480179d0 con 0x7fb34c0ac230 2023-10-09T11:41:30.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.044+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0c1f90 con 0x7fb34c0ac230 2023-10-09T11:41:30.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.044+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0ab030 con 0x7fb34c0ac230 2023-10-09T11:41:30.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.045+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c04c3c0 con 0x7fb34c0ac230 2023-10-09T11:41:30.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.046+0000 7fb3417fa700 1 -- 172.21.15.86:0/3615821439 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb34802b460 con 0x7fb34c0ac230 2023-10-09T11:41:30.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.047+0000 7fb3417fa700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.047+0000 7fb3417fa700 1 -- 172.21.15.86:0/3615821439 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb348013070 con 0x7fb34c0ac230 2023-10-09T11:41:30.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.047+0000 7fb350b9a700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.047+0000 7fb350b9a700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0011e0 tx=0x7fb33c007bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.051+0000 7fb3417fa700 1 -- 172.21.15.86:0/3615821439 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3480539a0 con 0x7fb34c0ac230 2023-10-09T11:41:30.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.243+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb34c04c3c0 con 0x7fb34c0ac230 2023-10-09T11:41:30.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.244+0000 7fb3417fa700 1 -- 172.21.15.86:0/3615821439 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fb348056fc0 con 0x7fb34c0ac230 2023-10-09T11:41:30.245 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:30.245 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 msgr2=0x7fb3300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0011e0 tx=0x7fb33c007bf0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c0ac230 msgr2=0x7fb34c0aaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c0ac230 0x7fb34c0aaaf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb348008010 tx=0x7fb348018000 comp rx=0 tx=0).stop 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 shutdown_connections 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb34c0ac230 0x7fb34c0aaaf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb34c155c10 0x7fb34c0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 --2- 172.21.15.86:0/3615821439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c0ac6d0 0x7fb34c0c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 >> 172.21.15.86:0/3615821439 conn(0x7fb34c06a320 msgr2=0x7fb34c0cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 shutdown_connections 2023-10-09T11:41:30.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.246+0000 7fb3535ff700 1 -- 172.21.15.86:0/3615821439 wait complete. 2023-10-09T11:41:30.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:30.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.442+0000 7fcb50dff700 1 Processor -- start 2023-10-09T11:41:30.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.442+0000 7fcb50dff700 1 -- start start 2023-10-09T11:41:30.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.443+0000 7fcb50dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb4c06bcd0 0x7fcb4c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.443+0000 7fcb50dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 0x7fcb4c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.443+0000 7fcb50dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcb4c15df50 0x7fcb4c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.443+0000 7fcb50dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c15d7e0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.443+0000 7fcb50dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c15dac0 con 0x7fcb4c15df50 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.443+0000 7fcb50dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c15aa30 con 0x7fcb4c06c0a0 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb4c06bcd0 0x7fcb4c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb4c06bcd0 0x7fcb4c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54810/0 (socket says 172.21.15.86:54810) 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 -- 172.21.15.86:0/4281153739 learned_addr learned my addr 172.21.15.86:0/4281153739 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb49d9b700 1 --2- 172.21.15.86:0/4281153739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 0x7fcb4c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4ad9d700 1 --2- 172.21.15.86:0/4281153739 >> v2:172.21.15.135:3300/0 conn(0x7fcb4c15df50 0x7fcb4c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 -- 172.21.15.86:0/4281153739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 msgr2=0x7fcb4c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 --2- 172.21.15.86:0/4281153739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 0x7fcb4c15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 -- 172.21.15.86:0/4281153739 >> v2:172.21.15.135:3300/0 conn(0x7fcb4c15df50 msgr2=0x7fcb4c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:30.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 --2- 172.21.15.86:0/4281153739 >> v2:172.21.15.135:3300/0 conn(0x7fcb4c15df50 0x7fcb4c15e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 -- 172.21.15.86:0/4281153739 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c15ad10 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.444+0000 7fcb4a59c700 1 --2- 172.21.15.86:0/4281153739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c0caa90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0b4600 tx=0x7fcb3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e3f11590426730 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb4959a700 1 -- 172.21.15.86:0/4281153739 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00b640 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb4959a700 1 -- 172.21.15.86:0/4281153739 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00b7a0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb4959a700 1 -- 172.21.15.86:0/4281153739 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00bb40 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 -- 172.21.15.86:0/4281153739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 msgr2=0x7fcb4c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 --2- 172.21.15.86:0/4281153739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c0caa90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0b4600 tx=0x7fcb3c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 -- 172.21.15.86:0/4281153739 shutdown_connections 2023-10-09T11:41:30.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 --2- 172.21.15.86:0/4281153739 >> v2:172.21.15.135:3300/0 conn(0x7fcb4c15df50 0x7fcb4c15e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 --2- 172.21.15.86:0/4281153739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c0caa90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 --2- 172.21.15.86:0/4281153739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 0x7fcb4c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 -- 172.21.15.86:0/4281153739 >> 172.21.15.86:0/4281153739 conn(0x7fcb4c0ce600 msgr2=0x7fcb4c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 -- 172.21.15.86:0/4281153739 shutdown_connections 2023-10-09T11:41:30.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.445+0000 7fcb50dff700 1 -- 172.21.15.86:0/4281153739 wait complete. 2023-10-09T11:41:30.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.447+0000 7fcb50dff700 1 Processor -- start 2023-10-09T11:41:30.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.447+0000 7fcb50dff700 1 -- start start 2023-10-09T11:41:30.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb50dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb50dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 0x7fcb4c0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb50dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c15df50 0x7fcb4c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb50dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0b3cf0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb50dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c158d60 con 0x7fcb4c15df50 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb50dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c1584c0 con 0x7fcb4c06c0a0 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54814/0 (socket says 172.21.15.86:54814) 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 -- 172.21.15.86:0/2794187408 learned_addr learned my addr 172.21.15.86:0/2794187408 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 -- 172.21.15.86:0/2794187408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 msgr2=0x7fcb4c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 0x7fcb4c0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 -- 172.21.15.86:0/2794187408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c15df50 msgr2=0x7fcb4c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c15df50 0x7fcb4c154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 -- 172.21.15.86:0/2794187408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0094f0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.448+0000 7fcb4a59c700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c157de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c006fd0 tx=0x7fcb3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.449+0000 7fcb3a7fc700 1 -- 172.21.15.86:0/2794187408 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00b910 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.449+0000 7fcb3a7fc700 1 -- 172.21.15.86:0/2794187408 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00ba90 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.449+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c1587a0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.449+0000 7fcb3a7fc700 1 -- 172.21.15.86:0/2794187408 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c011670 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.449+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c0b14d0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.450+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c0b16f0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.451+0000 7fcb3a7fc700 1 -- 172.21.15.86:0/2794187408 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb3c011a60 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.452+0000 7fcb3a7fc700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb2c066f30 0x7fcb2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:30.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.452+0000 7fcb3a7fc700 1 -- 172.21.15.86:0/2794187408 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb3c085c40 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.452+0000 7fcb49d9b700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb2c066f30 0x7fcb2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:30.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.453+0000 7fcb49d9b700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb2c066f30 0x7fcb2c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009b10 tx=0x7fcb400091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.456+0000 7fcb3a7fc700 1 -- 172.21.15.86:0/2794187408 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb3c052e10 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.687+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb4c04c3f0 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.688+0000 7fcb3a7fc700 1 -- 172.21.15.86:0/2794187408 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fcb3c056430 con 0x7fcb4c06bcd0 2023-10-09T11:41:30.689 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:30.690 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:30.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb2c066f30 msgr2=0x7fcb2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb2c066f30 0x7fcb2c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009b10 tx=0x7fcb400091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 msgr2=0x7fcb4c157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c157de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c006fd0 tx=0x7fcb3c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:30.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 shutdown_connections 2023-10-09T11:41:30.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb2c066f30 0x7fcb2c0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb4c06bcd0 0x7fcb4c157de0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c15df50 0x7fcb4c154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 --2- 172.21.15.86:0/2794187408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb4c06c0a0 0x7fcb4c0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 >> 172.21.15.86:0/2794187408 conn(0x7fcb4c0ce600 msgr2=0x7fcb4c0c3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 shutdown_connections 2023-10-09T11:41:30.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:30.690+0000 7fcb50dff700 1 -- 172.21.15.86:0/2794187408 wait complete. 2023-10-09T11:41:30.693 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:31.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:41:11.523424+0000', 'modified': '2023-10-09T11:41:15.086399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6835/3007704433', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6833', 'nonce': 3007704433}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3007704433}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:41:31.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:41:31.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:41:31.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.293+0000 7fe03abff700 1 Processor -- start 2023-10-09T11:41:31.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.293+0000 7fe03abff700 1 -- start start 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.294+0000 7fe03abff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe0340cbf30 0x7fe0340ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.294+0000 7fe03abff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 0x7fe0340c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.294+0000 7fe03abff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0340cc300 con 0x7fe0340ccf90 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.294+0000 7fe03abff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe034156bf0 con 0x7fe0340cbf30 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.294+0000 7fe03abff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340ae950 con 0x7fe0340b1420 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe033fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe0340ccf90 0x7fe0340b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58022/0 (socket says 172.21.15.86:58022) 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe033fff700 1 -- 172.21.15.86:0/791297911 learned_addr learned my addr 172.21.15.86:0/791297911 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe03919c700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 0x7fe0340c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe03899b700 1 --2- 172.21.15.86:0/791297911 >> v2:172.21.15.135:3300/0 conn(0x7fe0340cbf30 0x7fe0340ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106750831 0 0) 0x7fe0340cc300 con 0x7fe0340ccf90 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe024003570 con 0x7fe0340ccf90 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471546138 0 0) 0x7fe024003570 con 0x7fe0340ccf90 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 msgr2=0x7fe0340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 0x7fe0340c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 >> v2:172.21.15.135:3300/0 conn(0x7fe0340cbf30 msgr2=0x7fe0340ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 --2- 172.21.15.86:0/791297911 >> v2:172.21.15.135:3300/0 conn(0x7fe0340cbf30 0x7fe0340ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0340ad370 con 0x7fe0340ccf90 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fe020001470 con 0x7fe0340ccf90 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 >> v1:172.21.15.86:6789/0 conn(0x7fe0340ccf90 legacy=0x7fe0340b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.295+0000 7fe0337fe700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 0x7fe024003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe024004010 0x7fe024004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004d50 0x7fe0240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe034156bf0 con 0x7fe024004010 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340ae950 con 0x7fe024004d50 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02400bab0 con 0x7fe0340b1420 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe033fff700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe024004010 0x7fe024004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe03899b700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 0x7fe024003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe03919c700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004d50 0x7fe0240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe033fff700 1 -- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 msgr2=0x7fe024003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe033fff700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0340b1420 0x7fe024003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe033fff700 1 -- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004d50 msgr2=0x7fe0240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe033fff700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004d50 0x7fe0240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe033fff700 1 -- 172.21.15.86:0/791297911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024003570 con 0x7fe024004010 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe033fff700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe024004010 0x7fe024004810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c390 tx=0x7fe0340c8fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f2c45e70aa80a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02000cc60 con 0x7fe024004010 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02000cdc0 con 0x7fe024004010 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.296+0000 7fe0337fe700 1 -- 172.21.15.86:0/791297911 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020005b70 con 0x7fe024004010 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.297+0000 7fe03abff700 1 -- 172.21.15.86:0/791297911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe024004010 msgr2=0x7fe024004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.297+0000 7fe03abff700 1 --2- 172.21.15.86:0/791297911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe024004010 0x7fe024004810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c390 tx=0x7fe0340c8fd0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.297+0000 7fe03919c700 1 -- 172.21.15.86:0/791297911 reap_dead start 2023-10-09T11:41:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.297+0000 7fe03abff700 1 -- 172.21.15.86:0/791297911 shutdown_connections 2023-10-09T11:41:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.297+0000 7fe03abff700 1 -- 172.21.15.86:0/791297911 >> 172.21.15.86:0/791297911 conn(0x7fe03406a320 msgr2=0x7fe0340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.297+0000 7fe03abff700 1 -- 172.21.15.86:0/791297911 shutdown_connections 2023-10-09T11:41:31.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.297+0000 7fe03abff700 1 -- 172.21.15.86:0/791297911 wait complete. 2023-10-09T11:41:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.298+0000 7fe03abff700 1 Processor -- start 2023-10-09T11:41:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.299+0000 7fe03abff700 1 -- start start 2023-10-09T11:41:31.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.299+0000 7fe03abff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004010 0x7fe034142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03abff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe034169e70 0x7fe034143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03abff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe034150af0 0x7fe034150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03abff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe034151d90 con 0x7fe034169e70 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03abff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341514b0 con 0x7fe024004010 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03abff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe034143a20 con 0x7fe034150af0 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe034169e70 0x7fe034143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe034169e70 0x7fe034143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54836/0 (socket says 172.21.15.86:54836) 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 -- 172.21.15.86:0/2513720963 learned_addr learned my addr 172.21.15.86:0/2513720963 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03899b700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004010 0x7fe034142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03919c700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe034150af0 0x7fe034150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 -- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe034150af0 msgr2=0x7fe034150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe034150af0 0x7fe034150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 -- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004010 msgr2=0x7fe034142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004010 0x7fe034142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 -- 172.21.15.86:0/2513720963 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034143d00 con 0x7fe034169e70 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe03899b700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004010 0x7fe034142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.300+0000 7fe033fff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe034169e70 0x7fe034143120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c980 tx=0x7fe020015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.301+0000 7fe030ff9700 1 -- 172.21.15.86:0/2513720963 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02000cc60 con 0x7fe034169e70 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.301+0000 7fe030ff9700 1 -- 172.21.15.86:0/2513720963 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02000c9b0 con 0x7fe034169e70 2023-10-09T11:41:31.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.301+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe034143fe0 con 0x7fe034169e70 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.301+0000 7fe030ff9700 1 -- 172.21.15.86:0/2513720963 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020007530 con 0x7fe034169e70 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.301+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe034143660 con 0x7fe034169e70 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.303+0000 7fe030ff9700 1 -- 172.21.15.86:0/2513720963 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe020019030 con 0x7fe034169e70 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.303+0000 7fe030ff9700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe018066f30 0x7fe0180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.304+0000 7fe030ff9700 1 -- 172.21.15.86:0/2513720963 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe020085b60 con 0x7fe034169e70 2023-10-09T11:41:31.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.304+0000 7fe03899b700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe018066f30 0x7fe0180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.304+0000 7fe03899b700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe018066f30 0x7fe0180693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe034161ef0 tx=0x7fe028008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.306+0000 7fe049420b80 1 Processor -- start 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.306+0000 7fe049420b80 1 -- start start 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 0x55f561d5fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561da9d00 0x55f561d88a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe049420b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d5bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe049420b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561cb6a70 con 0x55f561d88f60 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561cb4270 con 0x55f561da9d00 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f561cb0060 con 0x55f561d5fa50 2023-10-09T11:41:31.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d5bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d5bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54846/0 (socket says 172.21.15.86:54846) 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 -- 172.21.15.86:0/2012318869 learned_addr learned my addr 172.21.15.86:0/2012318869 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03899b700 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 0x55f561d5fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe033fff700 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561da9d00 0x55f561d88a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 -- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 msgr2=0x55f561d5fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 0x55f561d5fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 -- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561da9d00 msgr2=0x55f561d88a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561da9d00 0x55f561d88a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 -- 172.21.15.86:0/2012318869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f561b4a270 con 0x55f561d88f60 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.307+0000 7fe03919c700 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d5bcf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009f60 tx=0x7fe02c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905b22015cc0f88d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe01dffb700 1 -- 172.21.15.86:0/2012318869 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00e040 con 0x55f561d88f60 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe01dffb700 1 -- 172.21.15.86:0/2012318869 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c007df0 con 0x55f561d88f60 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe01dffb700 1 -- 172.21.15.86:0/2012318869 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c017680 con 0x55f561d88f60 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 -- 172.21.15.86:0/2012318869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 msgr2=0x55f561d5bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d5bcf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009f60 tx=0x7fe02c00b040 comp rx=0 tx=0).stop 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 -- 172.21.15.86:0/2012318869 shutdown_connections 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d5bcf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 0x55f561d5fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 --2- 172.21.15.86:0/2012318869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561da9d00 0x55f561d88a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 -- 172.21.15.86:0/2012318869 >> 172.21.15.86:0/2012318869 conn(0x55f561d61370 msgr2=0x55f561d61740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 -- 172.21.15.86:0/2012318869 shutdown_connections 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.308+0000 7fe049420b80 1 -- 172.21.15.86:0/2012318869 wait complete. 2023-10-09T11:41:31.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.309+0000 7fe049420b80 1 -- start start 2023-10-09T11:41:31.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.309+0000 7fe049420b80 1 Processor -- start 2023-10-09T11:41:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe049420b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d5fa50 0x55f561da88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561da01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561da9d00 0x55f561da3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe049420b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561c5b890 con 0x55f561d5fa50 2023-10-09T11:41:31.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561c76ea0 con 0x55f561d88f60 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f561b32e30 con 0x55f561da9d00 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe049420b80 10 client.0 _ll_register_callbacks cb 0x55f561d23110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe03899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d5fa50 0x55f561da88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe03899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d5fa50 0x55f561da88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54848/0 (socket says 172.21.15.86:54848) 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.310+0000 7fe03899b700 1 -- 172.21.15.86:0/67021133 learned_addr learned my addr 172.21.15.86:0/67021133 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe03919c700 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561da9d00 0x55f561da3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe033fff700 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561da01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe03899b700 1 -- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561da9d00 msgr2=0x55f561da3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe03899b700 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561da9d00 0x55f561da3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe03899b700 1 -- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 msgr2=0x55f561da01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe03899b700 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561da01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe03899b700 1 -- 172.21.15.86:0/67021133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c009d10 con 0x55f561d5fa50 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe03899b700 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d5fa50 0x55f561da88d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0280167e0 tx=0x7fe02801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197359ab623b09d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe012ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe012ffd700 1 -- 172.21.15.86:0/67021133 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028013eb0 con 0x55f561d5fa50 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe012ffd700 1 -- 172.21.15.86:0/67021133 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe028024630 con 0x55f561d5fa50 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.311+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f561d54b70 con 0x55f561d5fa50 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe012ffd700 1 -- 172.21.15.86:0/67021133 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe028024a00 con 0x55f561d5fa50 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 10 client.4620 fetch_fsmap learned FSMap version 8 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f561aecfe0 con 0x55f561d5fa50 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe012ffd700 1 -- 172.21.15.86:0/67021133 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f561d54b70 con 0x55f561d5fa50 2023-10-09T11:41:31.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe012ffd700 1 -- 172.21.15.86:0/67021133 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe028024b60 con 0x55f561d5fa50 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 10 client.4620 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 10 client.4620 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 20 client.4620 populate_metadata read hostname 'smithi086' 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561db66d0 0x55f561da60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 4 client.4620 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 --> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f561d31aa0 con 0x55f561db66d0 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.312+0000 7fe033fff700 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561db66d0 0x55f561da60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.313+0000 7fe033fff700 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561db66d0 0x55f561da60f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fa5883b7a9087df server_cookie=5ea7aea32ad8d5c in_seq=0 out_seq=0 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.313+0000 7fe012ffd700 10 client.4620 ms_handle_connect on v2:172.21.15.135:6833/3007704433 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe012ffd700 1 -- 172.21.15.86:0/67021133 <== mds.0 v2:172.21.15.135:6833/3007704433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f561d31aa0 con 0x55f561db66d0 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe012ffd700 10 client.4620 handle_command_reply: tid=0 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 client.4620 shutdown 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d5fa50 msgr2=0x55f561da88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d5fa50 0x55f561da88d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0280167e0 tx=0x7fe02801a000 comp rx=0 tx=0).stop 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 shutdown_connections 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561db66d0 0x55f561da60f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d5fa50 0x55f561da88d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561da9d00 0x55f561da3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 --2- 172.21.15.86:0/67021133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561da01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe012ffd700 0 client.4620 ms_handle_reset on v2:172.21.15.135:6833/3007704433 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 >> 172.21.15.86:0/67021133 conn(0x55f561d61370 msgr2=0x55f561d60350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 shutdown_connections 2023-10-09T11:41:31.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 1 -- 172.21.15.86:0/67021133 wait complete. 2023-10-09T11:41:31.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.314+0000 7fe049420b80 20 client.4620 trim_cache size 0 max 16384 2023-10-09T11:41:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.331+0000 7fe049420b80 1 Processor -- start 2023-10-09T11:41:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.331+0000 7fe049420b80 1 -- start start 2023-10-09T11:41:31.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe049420b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d61370 0x55f561d8f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 0x55f561e06f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561e074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe049420b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561d5f370 con 0x55f561d61370 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561d61ee0 con 0x55f561d88f60 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f561d5b0f0 con 0x55f561d5fa50 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe03899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d61370 0x55f561d8f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe03899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d61370 0x55f561d8f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54862/0 (socket says 172.21.15.86:54862) 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.332+0000 7fe03899b700 1 -- 172.21.15.86:0/463570134 learned_addr learned my addr 172.21.15.86:0/463570134 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03899b700 1 -- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 msgr2=0x55f561e06f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03899b700 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 0x55f561e06f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03919c700 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561e074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03899b700 1 -- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 msgr2=0x55f561e074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03899b700 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561e074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03899b700 1 -- 172.21.15.86:0/463570134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f561c7e780 con 0x55f561d61370 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03919c700 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561e074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe03899b700 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d61370 0x55f561d8f530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe02800b010 tx=0x7fe028025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c151ee5cceaace2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe01e7fc700 1 -- 172.21.15.86:0/463570134 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028024630 con 0x55f561d61370 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe01e7fc700 1 -- 172.21.15.86:0/463570134 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe028016dd0 con 0x55f561d61370 2023-10-09T11:41:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe01e7fc700 1 -- 172.21.15.86:0/463570134 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028024a00 con 0x55f561d61370 2023-10-09T11:41:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe049420b80 1 -- 172.21.15.86:0/463570134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d61370 msgr2=0x55f561d8f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.333+0000 7fe049420b80 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d61370 0x55f561d8f530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe02800b010 tx=0x7fe028025000 comp rx=0 tx=0).stop 2023-10-09T11:41:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 -- 172.21.15.86:0/463570134 shutdown_connections 2023-10-09T11:41:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d61370 0x55f561d8f530 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d88f60 0x55f561e074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 --2- 172.21.15.86:0/463570134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d5fa50 0x55f561e06f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 -- 172.21.15.86:0/463570134 >> 172.21.15.86:0/463570134 conn(0x55f561d5efa0 msgr2=0x55f561d60070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 -- 172.21.15.86:0/463570134 shutdown_connections 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 -- 172.21.15.86:0/463570134 wait complete. 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 -- start start 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.334+0000 7fe049420b80 1 Processor -- start 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.335+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d5fa50 0x55f561dfc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.335+0000 7fe049420b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d61370 0x55f561dc7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.335+0000 7fe049420b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d8f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.335+0000 7fe049420b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561dc3bf0 con 0x55f561d88f60 2023-10-09T11:41:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.335+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f561d84fb0 con 0x55f561d5fa50 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.335+0000 7fe049420b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f561e0d490 con 0x55f561d61370 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.335+0000 7fe049420b80 10 client.0 _ll_register_callbacks cb 0x55f561d23110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d8f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d8f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54876/0 (socket says 172.21.15.86:54876) 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 -- 172.21.15.86:0/1466813200 learned_addr learned my addr 172.21.15.86:0/1466813200 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03899b700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d5fa50 0x55f561dfc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe033fff700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d61370 0x55f561dc7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 -- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d61370 msgr2=0x55f561dc7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d61370 0x55f561dc7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 -- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d5fa50 msgr2=0x55f561dfc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d5fa50 0x55f561dfc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 -- 172.21.15.86:0/1466813200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f561aecfe0 con 0x55f561d88f60 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03899b700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d5fa50 0x55f561dfc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe03919c700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d8f530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02c007ff0 tx=0x7fe02c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde74f740288c7a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.336+0000 7fe012ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe012ffd700 1 -- 172.21.15.86:0/1466813200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c027070 con 0x55f561d88f60 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe02c007df0 con 0x55f561d88f60 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe012ffd700 1 -- 172.21.15.86:0/1466813200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe02c021600 con 0x55f561d88f60 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe012ffd700 1 -- 172.21.15.86:0/1466813200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe02c00e040 con 0x55f561d88f60 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 10 client.4626 fetch_fsmap learned FSMap version 8 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f561c65470 con 0x55f561d88f60 2023-10-09T11:41:31.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe012ffd700 1 -- 172.21.15.86:0/1466813200 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c007df0 con 0x55f561d88f60 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe012ffd700 1 -- 172.21.15.86:0/1466813200 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe02c021a10 con 0x55f561d88f60 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 10 client.4626 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 20 client.4626 populate_metadata read hostname 'smithi086' 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561da9d00 0x55f561da8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 4 client.4626 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 --> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f561c52e00 con 0x55f561da9d00 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.337+0000 7fe03899b700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561da9d00 0x55f561da8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe012ffd700 10 client.4626 ms_handle_connect on v2:172.21.15.135:6833/3007704433 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe03899b700 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561da9d00 0x55f561da8c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e34e6a12d516af3 server_cookie=a071982a01b62be8 in_seq=0 out_seq=0 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe012ffd700 1 -- 172.21.15.86:0/1466813200 <== mds.0 v2:172.21.15.135:6833/3007704433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55f561c52e00 con 0x55f561da9d00 2023-10-09T11:41:31.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe012ffd700 10 client.4626 handle_command_reply: tid=0 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 client.4626 shutdown 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 msgr2=0x55f561d8f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d8f530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02c007ff0 tx=0x7fe02c01a000 comp rx=0 tx=0).stop 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 shutdown_connections 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:6833/3007704433,v1:172.21.15.135:6835/3007704433] conn(0x55f561da9d00 0x55f561da8c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f561d88f60 0x55f561d8f530 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f561d5fa50 0x55f561dfc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe012ffd700 0 client.4626 ms_handle_reset on v2:172.21.15.135:6833/3007704433 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 --2- 172.21.15.86:0/1466813200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f561d61370 0x55f561dc7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.338+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 >> 172.21.15.86:0/1466813200 conn(0x55f561d5efa0 msgr2=0x55f561d5baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 shutdown_connections 2023-10-09T11:41:31.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe049420b80 1 -- 172.21.15.86:0/1466813200 wait complete. 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe049420b80 20 client.4626 trim_cache size 0 max 16384 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4293, 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T11:41:31.347 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 19.266634903, 2023-10-09T11:41:31.348 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 8, 2023-10-09T11:41:31.348 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 22, 2023-10-09T11:41:31.348 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 22, 2023-10-09T11:41:31.348 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 24.626725076 2023-10-09T11:41:31.348 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe018066f30 msgr2=0x7fe0180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe018066f30 0x7fe0180693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe034161ef0 tx=0x7fe028008040 comp rx=0 tx=0).stop 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe034169e70 msgr2=0x7fe034143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe034169e70 0x7fe034143120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c980 tx=0x7fe020015000 comp rx=0 tx=0).stop 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 shutdown_connections 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe018066f30 0x7fe0180693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe034150af0 0x7fe034150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe024004010 0x7fe034142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 --2- 172.21.15.86:0/2513720963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe034169e70 0x7fe034143120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 >> 172.21.15.86:0/2513720963 conn(0x7fe03406a320 msgr2=0x7fe0340ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.339+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 shutdown_connections 2023-10-09T11:41:31.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:31.340+0000 7fe03abff700 1 -- 172.21.15.86:0/2513720963 wait complete. 2023-10-09T11:41:31.358 INFO:teuthology.run_tasks:Running task kclient... 2023-10-09T11:41:31.379 INFO:tasks.kclient:Mounting kernel clients... 2023-10-09T11:41:31.379 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-09T11:41:31.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.380 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:41:31.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2023-10-09T11:41:31.520 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2023-10-09T11:41:31.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:41:31.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.523 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:41:31.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2023-10-09T11:41:31.661 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2023-10-09T11:41:31.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:41:31.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.664 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-09T11:41:31.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.705 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-09T11:41:31.814 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-10-09T11:41:31.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:41:31.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.817 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-09T11:41:31.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:31.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-09T11:41:31.958 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-10-09T11:41:31.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:41:31.961 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-09T11:41:31.961 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:32.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.140+0000 7f310ffff700 1 Processor -- start 2023-10-09T11:41:32.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.141+0000 7f310ffff700 1 -- start start 2023-10-09T11:41:32.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 0x7f31100b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310ffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100b40f0 con 0x7f311006c0f0 2023-10-09T11:41:32.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3110069640 con 0x7f31100ad870 2023-10-09T11:41:32.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110069920 con 0x7f3110142ea0 2023-10-09T11:41:32.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f311006c0f0 0x7f311006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58032/0 (socket says 172.21.15.86:58032) 2023-10-09T11:41:32.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310f7fe700 1 -- 172.21.15.86:0/1006583483 learned_addr learned my addr 172.21.15.86:0/1006583483 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290168847 0 0) 0x7f31100b40f0 con 0x7f311006c0f0 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30f8003570 con 0x7f311006c0f0 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.142+0000 7f310effd700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 0x7f31100b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420076079 0 0) 0x7f30f8003570 con 0x7f311006c0f0 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 msgr2=0x7f31100b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 0x7f31100b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 >> v1:172.21.15.135:6789/0 conn(0x7f31100ad870 legacy=0x7f311006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110069c00 con 0x7f311006c0f0 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f31080017f0 con 0x7f311006c0f0 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 >> v1:172.21.15.86:6789/0 conn(0x7f311006c0f0 legacy=0x7f311006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f8003a90 0x7f30f8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 0x7f30f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f8004d50 0x7f30f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110069920 con 0x7f30f8003a90 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f800bb10 con 0x7f30f8004d50 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f800bcd0 con 0x7f3110142ea0 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310effd700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f8003a90 0x7f30f8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310e7fc700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 0x7f30f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310f7fe700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f8004d50 0x7f30f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310effd700 1 -- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 msgr2=0x7f30f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310effd700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3110142ea0 0x7f30f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310effd700 1 -- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f8004d50 msgr2=0x7f30f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310effd700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f8004d50 0x7f30f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.143+0000 7f310effd700 1 -- 172.21.15.86:0/1006583483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f8003570 con 0x7f30f8003a90 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310f7fe700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f8004d50 0x7f30f80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310effd700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f8003a90 0x7f30f8003e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3100009c00 tx=0x7f31000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e881431b5bf29f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000e710 con 0x7f30f8003a90 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000e870 con 0x7f30f8003a90 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310dffb700 1 -- 172.21.15.86:0/1006583483 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000ec30 con 0x7f30f8003a90 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310ffff700 1 -- 172.21.15.86:0/1006583483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f8003a90 msgr2=0x7f30f8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310ffff700 1 --2- 172.21.15.86:0/1006583483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30f8003a90 0x7f30f8003e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3100009c00 tx=0x7f31000091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.144+0000 7f310f7fe700 1 -- 172.21.15.86:0/1006583483 reap_dead start 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.145+0000 7f310ffff700 1 -- 172.21.15.86:0/1006583483 shutdown_connections 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.145+0000 7f310ffff700 1 -- 172.21.15.86:0/1006583483 >> 172.21.15.86:0/1006583483 conn(0x7f31100ce430 msgr2=0x7f31100ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.145+0000 7f310ffff700 1 -- 172.21.15.86:0/1006583483 shutdown_connections 2023-10-09T11:41:32.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.145+0000 7f310ffff700 1 -- 172.21.15.86:0/1006583483 wait complete. 2023-10-09T11:41:32.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.146+0000 7f310ffff700 1 Processor -- start 2023-10-09T11:41:32.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.146+0000 7f310ffff700 1 -- start start 2023-10-09T11:41:32.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30f8003a90 0x7f311015c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311015e930 0x7f31101698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3110169df0 0x7f31100cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311015cea0 con 0x7f311015e930 2023-10-09T11:41:32.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311016a850 con 0x7f3110169df0 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311016a290 con 0x7f30f8003a90 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311015e930 0x7f31101698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311015e930 0x7f31101698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54890/0 (socket says 172.21.15.86:54890) 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310e7fc700 1 -- 172.21.15.86:0/976636528 learned_addr learned my addr 172.21.15.86:0/976636528 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310effd700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30f8003a90 0x7f311015c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.147+0000 7f310f7fe700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3110169df0 0x7f31100cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310e7fc700 1 -- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30f8003a90 msgr2=0x7f311015c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310e7fc700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30f8003a90 0x7f311015c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310e7fc700 1 -- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3110169df0 msgr2=0x7f31100cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310e7fc700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3110169df0 0x7f31100cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310e7fc700 1 -- 172.21.15.86:0/976636528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311016a570 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310effd700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30f8003a90 0x7f311015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310f7fe700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3110169df0 0x7f31100cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310e7fc700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311015e930 0x7f31101698b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f310400f900 tx=0x7f3104007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f30f6ffd700 1 -- 172.21.15.86:0/976636528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400fea0 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f30f6ffd700 1 -- 172.21.15.86:0/976636528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104002510 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311016abb0 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f30f6ffd700 1 -- 172.21.15.86:0/976636528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104002250 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.148+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31100cc7e0 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.149+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311004c3c0 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.150+0000 7f30f6ffd700 1 -- 172.21.15.86:0/976636528 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f310400da60 con 0x7f311015e930 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.151+0000 7f30f6ffd700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f30fc066f30 0x7f30fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.151+0000 7f30f6ffd700 1 -- 172.21.15.86:0/976636528 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31040843d0 con 0x7f311015e930 2023-10-09T11:41:32.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.151+0000 7f310effd700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f30fc066f30 0x7f30fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.152+0000 7f310effd700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f30fc066f30 0x7f30fc0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31000091e0 tx=0x7f310001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.155+0000 7f30f6ffd700 1 -- 172.21.15.86:0/976636528 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31040515a0 con 0x7f311015e930 2023-10-09T11:41:32.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.388+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3110143270 con 0x7f311015e930 2023-10-09T11:41:32.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.388+0000 7f30f6ffd700 1 -- 172.21.15.86:0/976636528 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3104054bc0 con 0x7f311015e930 2023-10-09T11:41:32.390 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:32.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f30fc066f30 msgr2=0x7f30fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f30fc066f30 0x7f30fc0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31000091e0 tx=0x7f310001a000 comp rx=0 tx=0).stop 2023-10-09T11:41:32.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311015e930 msgr2=0x7f31101698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311015e930 0x7f31101698b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f310400f900 tx=0x7f3104007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 shutdown_connections 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f30fc066f30 0x7f30fc0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3110169df0 0x7f31100cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30f8003a90 0x7f311015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 --2- 172.21.15.86:0/976636528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311015e930 0x7f31101698b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 >> 172.21.15.86:0/976636528 conn(0x7f31100ce430 msgr2=0x7f3110141dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.390+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 shutdown_connections 2023-10-09T11:41:32.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:32.391+0000 7f310ffff700 1 -- 172.21.15.86:0/976636528 wait complete. 2023-10-09T11:41:32.410 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:41:32.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:32.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:41:32.410 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:41:32.410 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:32.410 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:41:32.410 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:41:32.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:32.411 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:32.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:32.411 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:41:32.447 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:32.447 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:32.447 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:32.447 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:32.447 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:32.448 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:41:32.449 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42251sec preferred_lft 42251sec 2023-10-09T11:41:32.449 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:41:32.449 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:32.449 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T11:41:32.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:32.449 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:32.449 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:32.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2023-10-09T11:41:32.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2023-10-09T11:41:32.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2023-10-09T11:41:32.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T11:41:32.450 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:32.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:32.881 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:32.947 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:41:32.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:32.951 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:41:33.005 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:41:33.005 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:33.005 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:41:33.005 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:41:33.005 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:33.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:33.006 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:33.006 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:33.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:41:33.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:41:33.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:41:33.007 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:33.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:33.718 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:41:33.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:33.755 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2023-10-09T11:41:33.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:33.831 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:33.831 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:33.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:41:33.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-09T11:41:33.831 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:33.997 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-09T11:41:33.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:33.997 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:33.997 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:33.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-09T11:41:33.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T11:41:33.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-09T11:41:33.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-09T11:41:33.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-09T11:41:33.998 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:34.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:34.246 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:34.246 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:34.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T11:41:34.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T11:41:34.246 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:34.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:34.402 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:34.437 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:34.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:34.438 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:34.512 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:41:34.512 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:34.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:34.656 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:34.656 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:35.085 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:35.085 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:35.085 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:41:35.085 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:41:35.085 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:41:35.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:35.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:35.091 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:35.154 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-09T11:41:35.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:35.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.338+0000 7f7b0bdff700 1 Processor -- start 2023-10-09T11:41:35.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.338+0000 7f7b0bdff700 1 -- start start 2023-10-09T11:41:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.339+0000 7f7b0bdff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b04069560 0x7f7b040699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.339+0000 7f7b0bdff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04069ee0 con 0x7f7b04159890 2023-10-09T11:41:35.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.339+0000 7f7b0bdff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0415a160 con 0x7f7b04159c60 2023-10-09T11:41:35.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.339+0000 7f7b0bdff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040d13a0 con 0x7f7b04069560 2023-10-09T11:41:35.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b0a39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b04069560 0x7f7b040699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b09b9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7b04159890 0x7f7b0415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44554/0 (socket says 172.21.15.86:44554) 2023-10-09T11:41:35.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b09b9b700 1 -- 172.21.15.86:0/477634070 learned_addr learned my addr 172.21.15.86:0/477634070 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:35.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b0a39c700 1 -- 172.21.15.86:0/477634070 >> v1:172.21.15.135:6789/0 conn(0x7f7b04159c60 legacy=0x7f7b0415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b0a39c700 1 -- 172.21.15.86:0/477634070 >> v1:172.21.15.86:6789/0 conn(0x7f7b04159890 legacy=0x7f7b0415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b0a39c700 1 -- 172.21.15.86:0/477634070 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0415e140 con 0x7f7b04069560 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b08b99700 1 -- 172.21.15.86:0/477634070 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922326236 0 0) 0x7f7b04069ee0 con 0x7f7b04159890 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.340+0000 7f7b0a39c700 1 --2- 172.21.15.86:0/477634070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04069560 0x7f7b040699a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009e60 tx=0x7f7afc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b113b856c70a90fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b08b99700 1 -- 172.21.15.86:0/477634070 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc00e070 con 0x7f7b04069560 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b08b99700 1 -- 172.21.15.86:0/477634070 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00bc30 con 0x7f7b04069560 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b08b99700 1 -- 172.21.15.86:0/477634070 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc012430 con 0x7f7b04069560 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b0bdff700 1 -- 172.21.15.86:0/477634070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04069560 msgr2=0x7f7b040699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/477634070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04069560 0x7f7b040699a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009e60 tx=0x7f7afc009780 comp rx=0 tx=0).stop 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b0bdff700 1 -- 172.21.15.86:0/477634070 shutdown_connections 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/477634070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04069560 0x7f7b040699a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b0bdff700 1 -- 172.21.15.86:0/477634070 >> 172.21.15.86:0/477634070 conn(0x7f7b04068e20 msgr2=0x7f7b040d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b0bdff700 1 -- 172.21.15.86:0/477634070 shutdown_connections 2023-10-09T11:41:35.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.341+0000 7f7b0bdff700 1 -- 172.21.15.86:0/477634070 wait complete. 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.343+0000 7f7b0bdff700 1 Processor -- start 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.343+0000 7f7b0bdff700 1 -- start start 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0bdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04069560 0x7f7b040b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0bdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b04159890 0x7f7b040b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0bdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04159c60 0x7f7b04157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0bdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b5480 con 0x7f7b04159c60 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0bdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b3ec0 con 0x7f7b04069560 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0bdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b41a0 con 0x7f7b04159890 2023-10-09T11:41:35.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04159c60 0x7f7b04157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04159c60 0x7f7b04157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41402/0 (socket says 172.21.15.86:41402) 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 -- 172.21.15.86:0/3564030012 learned_addr learned my addr 172.21.15.86:0/3564030012 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b09b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04069560 0x7f7b040b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0939a700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b04159890 0x7f7b040b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 -- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b04159890 msgr2=0x7f7b040b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b04159890 0x7f7b040b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 -- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04069560 msgr2=0x7f7b040b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04069560 0x7f7b040b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0a39c700 1 -- 172.21.15.86:0/3564030012 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc009a20 con 0x7f7b04159c60 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.344+0000 7f7b0939a700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b04159890 0x7f7b040b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.345+0000 7f7b0a39c700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04159c60 0x7f7b04157bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7afc013000 tx=0x7f7afc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.345+0000 7f7af9ffb700 1 -- 172.21.15.86:0/3564030012 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc012e60 con 0x7f7b04159c60 2023-10-09T11:41:35.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.345+0000 7f7af9ffb700 1 -- 172.21.15.86:0/3564030012 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc01b630 con 0x7f7b04159c60 2023-10-09T11:41:35.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.345+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b040b4480 con 0x7f7b04159c60 2023-10-09T11:41:35.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.345+0000 7f7af9ffb700 1 -- 172.21.15.86:0/3564030012 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc01b9b0 con 0x7f7b04159c60 2023-10-09T11:41:35.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.345+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b040b4a40 con 0x7f7b04159c60 2023-10-09T11:41:35.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.346+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b040b4db0 con 0x7f7b04159c60 2023-10-09T11:41:35.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.347+0000 7f7af9ffb700 1 -- 172.21.15.86:0/3564030012 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7afc01bd20 con 0x7f7b04159c60 2023-10-09T11:41:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.348+0000 7f7af9ffb700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7ae8066f30 0x7f7ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.348+0000 7f7af9ffb700 1 -- 172.21.15.86:0/3564030012 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7afc086440 con 0x7f7b04159c60 2023-10-09T11:41:35.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.349+0000 7f7b09b9b700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7ae8066f30 0x7f7ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.349+0000 7f7b09b9b700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7ae8066f30 0x7f7ae80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b00007fd0 tx=0x7f7b00007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.352+0000 7f7af9ffb700 1 -- 172.21.15.86:0/3564030012 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7afc0536c0 con 0x7f7b04159c60 2023-10-09T11:41:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.584+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b0404c3c0 con 0x7f7b04159c60 2023-10-09T11:41:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.585+0000 7f7af9ffb700 1 -- 172.21.15.86:0/3564030012 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7afc056ce0 con 0x7f7b04159c60 2023-10-09T11:41:35.587 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7ae8066f30 msgr2=0x7f7ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7ae8066f30 0x7f7ae80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b00007fd0 tx=0x7f7b00007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04159c60 msgr2=0x7f7b04157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04159c60 0x7f7b04157bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7afc013000 tx=0x7f7afc019000 comp rx=0 tx=0).stop 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 shutdown_connections 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7ae8066f30 0x7f7ae80693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b04159c60 0x7f7b04157bc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04069560 0x7f7b040b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 --2- 172.21.15.86:0/3564030012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b04159890 0x7f7b040b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 >> 172.21.15.86:0/3564030012 conn(0x7f7b04068e20 msgr2=0x7f7b0415aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 shutdown_connections 2023-10-09T11:41:35.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:35.587+0000 7f7b0bdff700 1 -- 172.21.15.86:0/3564030012 wait complete. 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:35.606 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-09T11:41:35.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:35.607 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:35.643 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:35.644 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:41:35.644 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:35.645 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:35.645 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:41:35.645 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42248sec preferred_lft 42248sec 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:35.646 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T11:41:35.647 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:35.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:35.648 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:35.746 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:41:35.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:35.749 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:41:35.787 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:41:35.787 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:35.788 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:41:35.788 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:41:35.788 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:35.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:35.789 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:35.789 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:35.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:41:35.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:41:35.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:41:35.789 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:35.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:35.984 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:41:36.019 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:41:36.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:36.020 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2023-10-09T11:41:36.097 INFO:teuthology.orchestra.run.smithi086.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-09T11:41:36.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:36.099 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:36.099 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:36.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:41:36.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-09T11:41:36.099 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:36.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:36.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T11:41:36.327 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:36.327 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:36.327 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:36.327 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.327 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:36.327 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.328 INFO:teuthology.orchestra.run.smithi086.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:36.328 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 62:85:33:75:a6:96 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:41:36.328 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:41:36.328 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.328 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::6085:33ff:fe75:a696/64 scope link 2023-10-09T11:41:36.328 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:36.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T11:41:36.390 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:36.390 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 62:85:33:75:a6:96 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::6085:33ff:fe75:a696/64 scope link 2023-10-09T11:41:36.391 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:36.393 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-09T11:41:36.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-09T11:41:36.394 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:36.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:36.620 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:41:36.620 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:41:36.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.1 up 2023-10-09T11:41:36.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T11:41:36.620 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:41:36.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:36.775 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-09T11:41:36.811 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-09T11:41:36.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:36.812 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-09T11:41:36.886 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-09T11:41:36.886 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:36.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:37.016 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:37.016 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:37.045 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:37.045 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:37.045 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:41:37.045 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 2@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:41:37.045 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:41:37.050 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:37.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:37.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-09T11:41:37.111 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-09T11:41:37.111 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:37.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:37.161 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:37.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.296+0000 7fcc2d39d700 1 Processor -- start 2023-10-09T11:41:37.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.296+0000 7fcc2d39d700 1 -- start start 2023-10-09T11:41:37.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.297+0000 7fcc2d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc28156310 0x7fcc280c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.297+0000 7fcc2d39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc280ae710 0x7fcc280c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.297+0000 7fcc2d39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280ca860 con 0x7fcc281566e0 2023-10-09T11:41:37.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.297+0000 7fcc2d39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280cab40 con 0x7fcc280ae710 2023-10-09T11:41:37.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.297+0000 7fcc2d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280cae20 con 0x7fcc28156310 2023-10-09T11:41:37.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc27fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc28156310 0x7fcc280c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc280ae710 0x7fcc280c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc280ae710 0x7fcc280c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:53618/0 (socket says 172.21.15.86:53618) 2023-10-09T11:41:37.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc27fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc28156310 0x7fcc280c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:41266/0 (socket says 172.21.15.86:41266) 2023-10-09T11:41:37.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 -- 172.21.15.86:0/2781655531 learned_addr learned my addr 172.21.15.86:0/2781655531 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:37.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc277fe700 1 -- 172.21.15.86:0/2781655531 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515808857 0 0) 0x7fcc280ca860 con 0x7fcc281566e0 2023-10-09T11:41:37.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 -- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc28156310 msgr2=0x7fcc280c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:37.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 --2- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc28156310 0x7fcc280c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 -- 172.21.15.86:0/2781655531 >> v1:172.21.15.135:6789/0 conn(0x7fcc281566e0 legacy=0x7fcc280ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 -- 172.21.15.86:0/2781655531 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280cb100 con 0x7fcc280ae710 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc27fff700 1 --2- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc28156310 0x7fcc280c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.298+0000 7fcc2cb9c700 1 --2- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc280ae710 0x7fcc280c6830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009f20 tx=0x7fcc20009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e56d4bcb3f79d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc277fe700 1 -- 172.21.15.86:0/2781655531 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000e070 con 0x7fcc280ae710 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc277fe700 1 -- 172.21.15.86:0/2781655531 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2000b9d0 con 0x7fcc280ae710 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc277fe700 1 -- 172.21.15.86:0/2781655531 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200092e0 con 0x7fcc280ae710 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 -- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc280ae710 msgr2=0x7fcc280c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc280ae710 0x7fcc280c6830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009f20 tx=0x7fcc20009840 comp rx=0 tx=0).stop 2023-10-09T11:41:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 -- 172.21.15.86:0/2781655531 shutdown_connections 2023-10-09T11:41:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc28156310 0x7fcc280c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/2781655531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc280ae710 0x7fcc280c6830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 -- 172.21.15.86:0/2781655531 >> 172.21.15.86:0/2781655531 conn(0x7fcc280cc1f0 msgr2=0x7fcc280cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 -- 172.21.15.86:0/2781655531 shutdown_connections 2023-10-09T11:41:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.299+0000 7fcc2d39d700 1 -- 172.21.15.86:0/2781655531 wait complete. 2023-10-09T11:41:37.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.301+0000 7fcc2d39d700 1 Processor -- start 2023-10-09T11:41:37.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.301+0000 7fcc2d39d700 1 -- start start 2023-10-09T11:41:37.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc2d39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc280ae710 0x7fcc28148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc2d39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc28156310 0x7fcc2815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc2d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc281566e0 0x7fcc28167a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc2d39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814d930 con 0x7fcc280ae710 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc2d39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814ca40 con 0x7fcc28156310 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc2d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814cd20 con 0x7fcc281566e0 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc27fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc280ae710 0x7fcc28148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc27fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc280ae710 0x7fcc28148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41414/0 (socket says 172.21.15.86:41414) 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc27fff700 1 -- 172.21.15.86:0/913094357 learned_addr learned my addr 172.21.15.86:0/913094357 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.302+0000 7fcc1ffff700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc28156310 0x7fcc2815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc2cb9c700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc281566e0 0x7fcc28167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc27fff700 1 -- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc281566e0 msgr2=0x7fcc28167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc27fff700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc281566e0 0x7fcc28167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc27fff700 1 -- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc28156310 msgr2=0x7fcc2815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc27fff700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc28156310 0x7fcc2815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc27fff700 1 -- 172.21.15.86:0/913094357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009420 con 0x7fcc280ae710 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc27fff700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc280ae710 0x7fcc28148cc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800ec80 tx=0x7fcc180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc24ff9700 1 -- 172.21.15.86:0/913094357 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800c9d0 con 0x7fcc280ae710 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc24ff9700 1 -- 172.21.15.86:0/913094357 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800cb30 con 0x7fcc280ae710 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc20009ae0 con 0x7fcc280ae710 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc24ff9700 1 -- 172.21.15.86:0/913094357 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800ceb0 con 0x7fcc280ae710 2023-10-09T11:41:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.303+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2814d2e0 con 0x7fcc280ae710 2023-10-09T11:41:37.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.304+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2806e5c0 con 0x7fcc280ae710 2023-10-09T11:41:37.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.305+0000 7fcc24ff9700 1 -- 172.21.15.86:0/913094357 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc18013680 con 0x7fcc280ae710 2023-10-09T11:41:37.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.306+0000 7fcc24ff9700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcc08066f60 0x7fcc08069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.306+0000 7fcc24ff9700 1 -- 172.21.15.86:0/913094357 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc180849f0 con 0x7fcc280ae710 2023-10-09T11:41:37.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.306+0000 7fcc1ffff700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcc08066f60 0x7fcc08069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.307+0000 7fcc1ffff700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcc08066f60 0x7fcc08069410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc280b1870 tx=0x7fcc10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:37.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.311+0000 7fcc24ff9700 1 -- 172.21.15.86:0/913094357 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc18051bc0 con 0x7fcc280ae710 2023-10-09T11:41:37.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.544+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcc2804c3c0 con 0x7fcc280ae710 2023-10-09T11:41:37.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.544+0000 7fcc24ff9700 1 -- 172.21.15.86:0/913094357 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcc180551e0 con 0x7fcc280ae710 2023-10-09T11:41:37.546 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:37.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcc08066f60 msgr2=0x7fcc08069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcc08066f60 0x7fcc08069410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc280b1870 tx=0x7fcc10009040 comp rx=0 tx=0).stop 2023-10-09T11:41:37.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc280ae710 msgr2=0x7fcc28148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc280ae710 0x7fcc28148cc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800ec80 tx=0x7fcc180091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 shutdown_connections 2023-10-09T11:41:37.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcc08066f60 0x7fcc08069410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc280ae710 0x7fcc28148cc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc281566e0 0x7fcc28167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 --2- 172.21.15.86:0/913094357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc28156310 0x7fcc2815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 >> 172.21.15.86:0/913094357 conn(0x7fcc280cc1f0 msgr2=0x7fcc281539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:37.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 shutdown_connections 2023-10-09T11:41:37.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:37.547+0000 7fcc2d39d700 1 -- 172.21.15.86:0/913094357 wait complete. 2023-10-09T11:41:37.566 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:41:37.566 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:37.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-10-09T11:41:37.566 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:41:37.566 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:37.566 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:41:37.567 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:41:37.567 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:37.567 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:37.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:37.567 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42205sec preferred_lft 42205sec 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2023-10-09T11:41:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:37.609 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T11:41:37.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:37.610 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:37.610 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:37.610 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2023-10-09T11:41:37.610 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2023-10-09T11:41:37.610 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2023-10-09T11:41:37.610 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T11:41:37.610 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:38.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:38.082 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:38.226 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-10-09T11:41:38.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:38.230 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-10-09T11:41:38.282 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-10-09T11:41:38.282 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:38.283 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:41:38.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:41:38.283 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:38.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:38.284 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:38.284 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:38.284 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:41:38.284 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:41:38.284 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:41:38.284 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:39.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:39.026 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-09T11:41:39.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:39.062 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-10-09T11:41:39.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:39.138 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:39.138 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:39.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:41:39.139 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-09T11:41:39.139 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:39.305 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-09T11:41:39.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-09T11:41:39.306 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:39.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:39.556 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:39.556 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:39.556 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2023-10-09T11:41:39.556 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T11:41:39.556 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:39.710 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:39.710 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:39.746 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:39.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:39.746 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:39.821 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:41:39.821 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:39.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:39.993 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:39.994 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:40.497 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:40.497 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:40.497 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:41:40.497 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 1@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:41:40.497 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:41:40.502 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:40.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:40.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:40.564 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-09T11:41:40.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:40.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.751+0000 7faf3b7ff700 1 Processor -- start 2023-10-09T11:41:40.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.752+0000 7faf3b7ff700 1 -- start start 2023-10-09T11:41:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf3b7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faf340cbf30 0x7faf340ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf3b7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf340ccf90 0x7faf340b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf3b7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf3b7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf34156bf0 con 0x7faf340ccf90 2023-10-09T11:41:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf3b7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf340ae950 con 0x7faf340cbf30 2023-10-09T11:41:40.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf3b7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340cc300 con 0x7faf3415a270 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf340ccf90 0x7faf340b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf340ccf90 0x7faf340b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41428/0 (socket says 172.21.15.86:41428) 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 -- 172.21.15.86:0/2688375490 learned_addr learned my addr 172.21.15.86:0/2688375490 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf39d9c700 1 --2- 172.21.15.86:0/2688375490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf3959b700 1 --2- 172.21.15.86:0/2688375490 >> v2:172.21.15.135:3300/0 conn(0x7faf340cbf30 0x7faf340ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 -- 172.21.15.86:0/2688375490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 msgr2=0x7faf340b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 --2- 172.21.15.86:0/2688375490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 -- 172.21.15.86:0/2688375490 >> v2:172.21.15.135:3300/0 conn(0x7faf340cbf30 msgr2=0x7faf340ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 --2- 172.21.15.86:0/2688375490 >> v2:172.21.15.135:3300/0 conn(0x7faf340cbf30 0x7faf340ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.753+0000 7faf38d9a700 1 -- 172.21.15.86:0/2688375490 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340ad370 con 0x7faf340ccf90 2023-10-09T11:41:40.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.754+0000 7faf38d9a700 1 --2- 172.21.15.86:0/2688375490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340ccf90 0x7faf340b0d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf34063d40 tx=0x7faf24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34316c9460da1943 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.754+0000 7faf2bfff700 1 -- 172.21.15.86:0/2688375490 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400b640 con 0x7faf340ccf90 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.754+0000 7faf2bfff700 1 -- 172.21.15.86:0/2688375490 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2400b7a0 con 0x7faf340ccf90 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.754+0000 7faf2bfff700 1 -- 172.21.15.86:0/2688375490 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400bb40 con 0x7faf340ccf90 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.754+0000 7faf3b7ff700 1 -- 172.21.15.86:0/2688375490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340ccf90 msgr2=0x7faf340b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.754+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/2688375490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340ccf90 0x7faf340b0d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf34063d40 tx=0x7faf24009250 comp rx=0 tx=0).stop 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.755+0000 7faf3b7ff700 1 -- 172.21.15.86:0/2688375490 shutdown_connections 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.755+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/2688375490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.755+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/2688375490 >> v2:172.21.15.135:3300/0 conn(0x7faf340cbf30 0x7faf340ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.755+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/2688375490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340ccf90 0x7faf340b0d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.755+0000 7faf3b7ff700 1 -- 172.21.15.86:0/2688375490 >> 172.21.15.86:0/2688375490 conn(0x7faf3406a320 msgr2=0x7faf340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:40.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.755+0000 7faf3b7ff700 1 -- 172.21.15.86:0/2688375490 shutdown_connections 2023-10-09T11:41:40.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.755+0000 7faf3b7ff700 1 -- 172.21.15.86:0/2688375490 wait complete. 2023-10-09T11:41:40.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.756+0000 7faf3b7ff700 1 Processor -- start 2023-10-09T11:41:40.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.756+0000 7faf3b7ff700 1 -- start start 2023-10-09T11:41:40.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3b7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340cbf30 0x7faf341524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3b7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf340ccf90 0x7faf34068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3b7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3b7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340a65e0 con 0x7faf340cbf30 2023-10-09T11:41:40.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3b7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34152a20 con 0x7faf340ccf90 2023-10-09T11:41:40.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3b7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340a5a10 con 0x7faf3415a270 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340cbf30 0x7faf341524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340cbf30 0x7faf341524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41432/0 (socket says 172.21.15.86:41432) 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf3959b700 1 -- 172.21.15.86:0/4012255988 learned_addr learned my addr 172.21.15.86:0/4012255988 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.757+0000 7faf38d9a700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf340ccf90 0x7faf34068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf39d9c700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3959b700 1 -- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 msgr2=0x7faf340688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3959b700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3959b700 1 -- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf340ccf90 msgr2=0x7faf34068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3959b700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf340ccf90 0x7faf34068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:40.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3959b700 1 -- 172.21.15.86:0/4012255988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240094f0 con 0x7faf340cbf30 2023-10-09T11:41:40.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3959b700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340cbf30 0x7faf341524e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf3000e930 tx=0x7faf300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:40.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf297fa700 1 -- 172.21.15.86:0/4012255988 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30013680 con 0x7faf340cbf30 2023-10-09T11:41:40.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf297fa700 1 -- 172.21.15.86:0/4012255988 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf300137e0 con 0x7faf340cbf30 2023-10-09T11:41:40.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf297fa700 1 -- 172.21.15.86:0/4012255988 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30013b80 con 0x7faf340cbf30 2023-10-09T11:41:40.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340a5cb0 con 0x7faf340cbf30 2023-10-09T11:41:40.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.758+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340a6270 con 0x7faf340cbf30 2023-10-09T11:41:40.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.759+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf340a68c0 con 0x7faf340cbf30 2023-10-09T11:41:40.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.760+0000 7faf297fa700 1 -- 172.21.15.86:0/4012255988 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf3000c3e0 con 0x7faf340cbf30 2023-10-09T11:41:40.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.761+0000 7faf297fa700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7faf18066f30 0x7faf180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:40.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.761+0000 7faf297fa700 1 -- 172.21.15.86:0/4012255988 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf30084680 con 0x7faf340cbf30 2023-10-09T11:41:40.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.761+0000 7faf38d9a700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7faf18066f30 0x7faf180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:40.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.762+0000 7faf38d9a700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7faf18066f30 0x7faf180693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf34063d40 tx=0x7faf24017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:40.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.765+0000 7faf297fa700 1 -- 172.21.15.86:0/4012255988 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf30051850 con 0x7faf340cbf30 2023-10-09T11:41:40.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.998+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf3404c3c0 con 0x7faf340cbf30 2023-10-09T11:41:41.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:40.998+0000 7faf297fa700 1 -- 172.21.15.86:0/4012255988 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7faf30054e70 con 0x7faf340cbf30 2023-10-09T11:41:41.000 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:41.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7faf18066f30 msgr2=0x7faf180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7faf18066f30 0x7faf180693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf34063d40 tx=0x7faf24017000 comp rx=0 tx=0).stop 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340cbf30 msgr2=0x7faf341524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340cbf30 0x7faf341524e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf3000e930 tx=0x7faf300091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 shutdown_connections 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7faf18066f30 0x7faf180693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf340cbf30 0x7faf341524e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3415a270 0x7faf340688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 --2- 172.21.15.86:0/4012255988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf340ccf90 0x7faf34068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.000+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 >> 172.21.15.86:0/4012255988 conn(0x7faf3406a320 msgr2=0x7faf340cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.001+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 shutdown_connections 2023-10-09T11:41:41.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:41.001+0000 7faf3b7ff700 1 -- 172.21.15.86:0/4012255988 wait complete. 2023-10-09T11:41:41.019 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:41.020 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-09T11:41:41.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.020 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-10-09T11:41:41.057 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:41.057 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:41.057 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:41.057 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.057 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:41.058 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42202sec preferred_lft 42202sec 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 86:30:cc:5f:91:dc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::4893:93ff:fe18:5557/64 scope link 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.059 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:41.060 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 86:30:cc:5f:91:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:41:41.060 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::8430:ccff:fe5f:91dc/64 scope link tentative 2023-10-09T11:41:41.060 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.061 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:41.159 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-10-09T11:41:41.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.163 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-10-09T11:41:41.200 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-10-09T11:41:41.200 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:41.200 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:41:41.201 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:41:41.201 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:41.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.202 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:41.202 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:41.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:41:41.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:41:41.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:41:41.202 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:41.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.395 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-09T11:41:41.431 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:41:41.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.431 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-10-09T11:41:41.506 INFO:teuthology.orchestra.run.smithi135.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-09T11:41:41.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.507 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:41.507 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:41.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:41:41.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-09T11:41:41.507 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:41.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T11:41:41.733 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0e:11:b2:31:e0:b8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.734 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::c11:b2ff:fe31:e0b8/64 scope link 2023-10-09T11:41:41.735 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T11:41:41.796 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0e:11:b2:31:e0:b8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::c11:b2ff:fe31:e0b8/64 scope link 2023-10-09T11:41:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:41.799 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-09T11:41:41.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-09T11:41:41.800 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:42.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.033 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-09T11:41:42.033 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-09T11:41:42.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.1 up 2023-10-09T11:41:42.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T11:41:42.034 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:42.190 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-09T11:41:42.226 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-09T11:41:42.226 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:42.226 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-09T11:41:42.302 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-09T11:41:42.302 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:42.302 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:42.432 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:42.433 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:42.461 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:42.461 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:42.461 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:41:42.461 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 3@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:41:42.461 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:41:42.466 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:42.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:42.466 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-09T11:41:42.527 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-09T11:41:42.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:42.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.733+0000 7f664759e700 1 Processor -- start 2023-10-09T11:41:42.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.734+0000 7f664759e700 1 -- start start 2023-10-09T11:41:42.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f664759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6648150550 0x7f6648157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f664759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f66480c7410 0x7f6648069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f664759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664806e2a0 con 0x7f6648150180 2023-10-09T11:41:42.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f664759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664806b2e0 con 0x7f66480c7410 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f664759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66480c78e0 con 0x7f6648150550 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f6646d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f66480c7410 0x7f6648069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f6646d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f66480c7410 0x7f6648069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41448/0 (socket says 172.21.15.86:41448) 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f6646d9d700 1 -- 172.21.15.86:0/1181667342 learned_addr learned my addr 172.21.15.86:0/1181667342 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.735+0000 7f663ffff700 1 --2- 172.21.15.86:0/1181667342 >> v2:172.21.15.135:3300/0 conn(0x7f6648150550 0x7f6648157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6646d9d700 1 -- 172.21.15.86:0/1181667342 >> v2:172.21.15.135:3300/0 conn(0x7f6648150550 msgr2=0x7f6648157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6646d9d700 1 --2- 172.21.15.86:0/1181667342 >> v2:172.21.15.135:3300/0 conn(0x7f6648150550 0x7f6648157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6646d9d700 1 -- 172.21.15.86:0/1181667342 >> v1:172.21.15.135:6789/0 conn(0x7f6648150180 legacy=0x7f66480c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6646d9d700 1 -- 172.21.15.86:0/1181667342 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480c7bc0 con 0x7f66480c7410 2023-10-09T11:41:42.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6646d9d700 1 --2- 172.21.15.86:0/1181667342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648069f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f664806d1e0 tx=0x7f6640009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e164e481c821af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6645d9b700 1 -- 172.21.15.86:0/1181667342 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000e070 con 0x7f66480c7410 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6645d9b700 1 -- 172.21.15.86:0/1181667342 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664000ba20 con 0x7f66480c7410 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.736+0000 7f6645d9b700 1 -- 172.21.15.86:0/1181667342 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66400092e0 con 0x7f66480c7410 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 -- 172.21.15.86:0/1181667342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 msgr2=0x7f6648069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 --2- 172.21.15.86:0/1181667342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648069f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f664806d1e0 tx=0x7f6640009840 comp rx=0 tx=0).stop 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 -- 172.21.15.86:0/1181667342 shutdown_connections 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 --2- 172.21.15.86:0/1181667342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648069f50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 --2- 172.21.15.86:0/1181667342 >> v2:172.21.15.135:3300/0 conn(0x7f6648150550 0x7f6648157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 -- 172.21.15.86:0/1181667342 >> 172.21.15.86:0/1181667342 conn(0x7f66480cc1f0 msgr2=0x7f66480cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 -- 172.21.15.86:0/1181667342 shutdown_connections 2023-10-09T11:41:42.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.737+0000 7f664759e700 1 -- 172.21.15.86:0/1181667342 wait complete. 2023-10-09T11:41:42.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.738+0000 7f664759e700 1 Processor -- start 2023-10-09T11:41:42.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.738+0000 7f664759e700 1 -- start start 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.739+0000 7f664759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.739+0000 7f664759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6648150180 0x7f66480c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.739+0000 7f664759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648150550 0x7f664814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.739+0000 7f664759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480c5480 con 0x7f66480c7410 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.739+0000 7f664759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480c3c30 con 0x7f6648150550 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.739+0000 7f664759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66480c3340 con 0x7f6648150180 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648167fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41462/0 (socket says 172.21.15.86:41462) 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 -- 172.21.15.86:0/360880072 learned_addr learned my addr 172.21.15.86:0/360880072 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f6646d9d700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648150550 0x7f664814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f663ffff700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6648150180 0x7f66480c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 -- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6648150180 msgr2=0x7f66480c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6648150180 0x7f66480c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 -- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648150550 msgr2=0x7f664814d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648150550 0x7f664814d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 -- 172.21.15.86:0/360880072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6640009ae0 con 0x7f66480c7410 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664659c700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648167fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f663800c4e0 tx=0x7f663800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f663e7fc700 1 -- 172.21.15.86:0/360880072 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638011590 con 0x7f66480c7410 2023-10-09T11:41:42.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f663e7fc700 1 -- 172.21.15.86:0/360880072 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638011710 con 0x7f66480c7410 2023-10-09T11:41:42.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66480c35e0 con 0x7f66480c7410 2023-10-09T11:41:42.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.740+0000 7f663e7fc700 1 -- 172.21.15.86:0/360880072 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638011ad0 con 0x7f66480c7410 2023-10-09T11:41:42.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.741+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66480c56b0 con 0x7f66480c7410 2023-10-09T11:41:42.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.741+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664804c3c0 con 0x7f66480c7410 2023-10-09T11:41:42.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.742+0000 7f663e7fc700 1 -- 172.21.15.86:0/360880072 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f663801b3b0 con 0x7f66480c7410 2023-10-09T11:41:42.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.744+0000 7f663e7fc700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.744+0000 7f663e7fc700 1 -- 172.21.15.86:0/360880072 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6638083960 con 0x7f66480c7410 2023-10-09T11:41:42.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.744+0000 7f663ffff700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.745+0000 7f663ffff700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6628066f30 0x7f66280693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66480c4720 tx=0x7f663000a330 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.748+0000 7f663e7fc700 1 -- 172.21.15.86:0/360880072 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6638050b30 con 0x7f66480c7410 2023-10-09T11:41:42.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.940+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f664806ada0 con 0x7f66480c7410 2023-10-09T11:41:42.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.941+0000 7f663e7fc700 1 -- 172.21.15.86:0/360880072 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6638017070 con 0x7f66480c7410 2023-10-09T11:41:42.942 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:42.943 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:42.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6628066f30 msgr2=0x7f66280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6628066f30 0x7f66280693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66480c4720 tx=0x7f663000a330 comp rx=0 tx=0).stop 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 msgr2=0x7f6648167fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648167fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f663800c4e0 tx=0x7f663800c7f0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 shutdown_connections 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66480c7410 0x7f6648167fe0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6648150550 0x7f664814d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 --2- 172.21.15.86:0/360880072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6648150180 0x7f66480c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.943+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 >> 172.21.15.86:0/360880072 conn(0x7f66480cc1f0 msgr2=0x7f6648069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.944+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 shutdown_connections 2023-10-09T11:41:42.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:42.944+0000 7f664759e700 1 -- 172.21.15.86:0/360880072 wait complete. 2023-10-09T11:41:42.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:09.500279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:10.496954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:42.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:43.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.150+0000 7f5ab899d700 1 Processor -- start 2023-10-09T11:41:43.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.150+0000 7f5ab899d700 1 -- start start 2023-10-09T11:41:43.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.151+0000 7f5ab899d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b4e70 0x7f5ab40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.151+0000 7f5ab899d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5ab40b16d0 0x7f5ab40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.151+0000 7f5ab899d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab40b2080 con 0x7f5ab415d240 2023-10-09T11:41:43.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.151+0000 7f5ab899d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab40cfb00 con 0x7f5ab40b16d0 2023-10-09T11:41:43.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.151+0000 7f5ab899d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40b5c40 con 0x7f5ab40b4e70 2023-10-09T11:41:43.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab37fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b4e70 0x7f5ab40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab2ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5ab40b16d0 0x7f5ab40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab3fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f5ab415d240 0x7f5ab415d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:43714/0 (socket says 172.21.15.86:43714) 2023-10-09T11:41:43.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab3fff700 1 -- 172.21.15.86:0/2370850904 learned_addr learned my addr 172.21.15.86:0/2370850904 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:43.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab2ffd700 1 -- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b4e70 msgr2=0x7f5ab40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b4e70 0x7f5ab40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab2ffd700 1 -- 172.21.15.86:0/2370850904 >> v1:172.21.15.135:6789/0 conn(0x7f5ab415d240 legacy=0x7f5ab415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab2ffd700 1 -- 172.21.15.86:0/2370850904 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40b5f20 con 0x7f5ab40b16d0 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab37fe700 1 --2- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b4e70 0x7f5ab40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.152+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b16d0 0x7f5ab40b1b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098e0 tx=0x7f5aa80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2481d621fe1bf493 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab27fc700 1 -- 172.21.15.86:0/2370850904 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800b640 con 0x7f5ab40b16d0 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab27fc700 1 -- 172.21.15.86:0/2370850904 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa800b7a0 con 0x7f5ab40b16d0 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab27fc700 1 -- 172.21.15.86:0/2370850904 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800bb40 con 0x7f5ab40b16d0 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 -- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b16d0 msgr2=0x7f5ab40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 --2- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b16d0 0x7f5ab40b1b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098e0 tx=0x7f5aa80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 -- 172.21.15.86:0/2370850904 shutdown_connections 2023-10-09T11:41:43.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 --2- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b4e70 0x7f5ab40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 --2- 172.21.15.86:0/2370850904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b16d0 0x7f5ab40b1b40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 -- 172.21.15.86:0/2370850904 >> 172.21.15.86:0/2370850904 conn(0x7f5ab40d10c0 msgr2=0x7f5ab40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 -- 172.21.15.86:0/2370850904 shutdown_connections 2023-10-09T11:41:43.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.153+0000 7f5ab899d700 1 -- 172.21.15.86:0/2370850904 wait complete. 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.155+0000 7f5ab899d700 1 Processor -- start 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.155+0000 7f5ab899d700 1 -- start start 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab899d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b16d0 0x7f5ab40c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab899d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b4e70 0x7f5ab41459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab899d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab415d240 0x7f5ab4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab899d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40cb520 con 0x7f5ab415d240 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab899d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40c6360 con 0x7f5ab40b4e70 2023-10-09T11:41:43.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab899d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40cac50 con 0x7f5ab40b16d0 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab415d240 0x7f5ab4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab415d240 0x7f5ab4158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41478/0 (socket says 172.21.15.86:41478) 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 -- 172.21.15.86:0/4088956055 learned_addr learned my addr 172.21.15.86:0/4088956055 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab2ffd700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b4e70 0x7f5ab41459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab37fe700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b16d0 0x7f5ab40c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 -- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b16d0 msgr2=0x7f5ab40c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b16d0 0x7f5ab40c7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 -- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b4e70 msgr2=0x7f5ab41459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b4e70 0x7f5ab41459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.156+0000 7f5ab3fff700 1 -- 172.21.15.86:0/4088956055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4009420 con 0x7f5ab415d240 2023-10-09T11:41:43.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.157+0000 7f5ab3fff700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab415d240 0x7f5ab4158db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00cbc0 tx=0x7f5aac0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.157+0000 7f5a9b7fe700 1 -- 172.21.15.86:0/4088956055 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00a7e0 con 0x7f5ab415d240 2023-10-09T11:41:43.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.157+0000 7f5a9b7fe700 1 -- 172.21.15.86:0/4088956055 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac00a940 con 0x7f5ab415d240 2023-10-09T11:41:43.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.157+0000 7f5a9b7fe700 1 -- 172.21.15.86:0/4088956055 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00acc0 con 0x7f5ab415d240 2023-10-09T11:41:43.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.157+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa8009420 con 0x7f5ab415d240 2023-10-09T11:41:43.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.157+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab40c6570 con 0x7f5ab415d240 2023-10-09T11:41:43.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.158+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab40c6d70 con 0x7f5ab415d240 2023-10-09T11:41:43.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.159+0000 7f5a9b7fe700 1 -- 172.21.15.86:0/4088956055 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aac007300 con 0x7f5ab415d240 2023-10-09T11:41:43.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.160+0000 7f5a9b7fe700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5aa0066f30 0x7f5aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.160+0000 7f5a9b7fe700 1 -- 172.21.15.86:0/4088956055 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5aac084880 con 0x7f5ab415d240 2023-10-09T11:41:43.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.160+0000 7f5ab37fe700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5aa0066f30 0x7f5aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.160+0000 7f5ab37fe700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5aa0066f30 0x7f5aa00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4158c30 tx=0x7f5aa40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.164+0000 7f5a9b7fe700 1 -- 172.21.15.86:0/4088956055 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ab40c6d70 con 0x7f5ab415d240 2023-10-09T11:41:43.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.352+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ab40c6d70 con 0x7f5ab415d240 2023-10-09T11:41:43.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.353+0000 7f5a9b7fe700 1 -- 172.21.15.86:0/4088956055 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ab40c6d70 con 0x7f5ab415d240 2023-10-09T11:41:43.354 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:43.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5aa0066f30 msgr2=0x7f5aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5aa0066f30 0x7f5aa00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4158c30 tx=0x7f5aa40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab415d240 msgr2=0x7f5ab4158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab415d240 0x7f5ab4158db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00cbc0 tx=0x7f5aac0019c0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 shutdown_connections 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5aa0066f30 0x7f5aa00693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab415d240 0x7f5ab4158db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ab40b16d0 0x7f5ab40c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 --2- 172.21.15.86:0/4088956055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ab40b4e70 0x7f5ab41459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.355+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 >> 172.21.15.86:0/4088956055 conn(0x7f5ab40d10c0 msgr2=0x7f5ab4069910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.356+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 shutdown_connections 2023-10-09T11:41:43.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.356+0000 7f5ab899d700 1 -- 172.21.15.86:0/4088956055 wait complete. 2023-10-09T11:41:43.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:43.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.554+0000 7fc58759d700 1 Processor -- start 2023-10-09T11:41:43.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.555+0000 7fc58759d700 1 -- start start 2023-10-09T11:41:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc58759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5800cb1a0 0x7fc58015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc58759d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc58015a8a0 0x7fc58006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc58759d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc58006f5a0 0x7fc5800ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc58759d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58015b2e0 con 0x7fc58006f5a0 2023-10-09T11:41:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc58759d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58006ebd0 con 0x7fc58015a8a0 2023-10-09T11:41:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc58759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58015ad20 con 0x7fc5800cb1a0 2023-10-09T11:41:43.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc586d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc58006f5a0 0x7fc5800ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc586d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc58006f5a0 0x7fc5800ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41480/0 (socket says 172.21.15.86:41480) 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc585d9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc58015a8a0 0x7fc58006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc586d9c700 1 -- 172.21.15.86:0/2758325392 learned_addr learned my addr 172.21.15.86:0/2758325392 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.556+0000 7fc58659b700 1 --2- 172.21.15.86:0/2758325392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5800cb1a0 0x7fc58015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc586d9c700 1 -- 172.21.15.86:0/2758325392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5800cb1a0 msgr2=0x7fc58015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc586d9c700 1 --2- 172.21.15.86:0/2758325392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5800cb1a0 0x7fc58015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc586d9c700 1 -- 172.21.15.86:0/2758325392 >> v2:172.21.15.135:3300/0 conn(0x7fc58015a8a0 msgr2=0x7fc58006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc586d9c700 1 --2- 172.21.15.86:0/2758325392 >> v2:172.21.15.135:3300/0 conn(0x7fc58015a8a0 0x7fc58006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc586d9c700 1 -- 172.21.15.86:0/2758325392 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58015b000 con 0x7fc58006f5a0 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc586d9c700 1 --2- 172.21.15.86:0/2758325392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc58006f5a0 0x7fc5800ae0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc58006d1e0 tx=0x7fc57800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38feb45bcfebf45b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc585599700 1 -- 172.21.15.86:0/2758325392 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578010070 con 0x7fc58006f5a0 2023-10-09T11:41:43.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc585599700 1 -- 172.21.15.86:0/2758325392 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57800ddc0 con 0x7fc58006f5a0 2023-10-09T11:41:43.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.557+0000 7fc585599700 1 -- 172.21.15.86:0/2758325392 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800b320 con 0x7fc58006f5a0 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 -- 172.21.15.86:0/2758325392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc58006f5a0 msgr2=0x7fc5800ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 --2- 172.21.15.86:0/2758325392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc58006f5a0 0x7fc5800ae0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc58006d1e0 tx=0x7fc57800ba50 comp rx=0 tx=0).stop 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 -- 172.21.15.86:0/2758325392 shutdown_connections 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 --2- 172.21.15.86:0/2758325392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc58006f5a0 0x7fc5800ae0d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 --2- 172.21.15.86:0/2758325392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5800cb1a0 0x7fc58015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 --2- 172.21.15.86:0/2758325392 >> v2:172.21.15.135:3300/0 conn(0x7fc58015a8a0 0x7fc58006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 -- 172.21.15.86:0/2758325392 >> 172.21.15.86:0/2758325392 conn(0x7fc5800cc1e0 msgr2=0x7fc5800cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 -- 172.21.15.86:0/2758325392 shutdown_connections 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.558+0000 7fc58759d700 1 -- 172.21.15.86:0/2758325392 wait complete. 2023-10-09T11:41:43.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.560+0000 7fc58759d700 1 Processor -- start 2023-10-09T11:41:43.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.560+0000 7fc58759d700 1 -- start start 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc58006f5a0 0x7fc580149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5800cb1a0 0x7fc5800af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58759d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5800af900 0x7fc5800afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58759d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580151c70 con 0x7fc5800af900 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580151f50 con 0x7fc5800cb1a0 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc580152230 con 0x7fc58006f5a0 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5800af900 0x7fc5800afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5800af900 0x7fc5800afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41496/0 (socket says 172.21.15.86:41496) 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 -- 172.21.15.86:0/444145782 learned_addr learned my addr 172.21.15.86:0/444145782 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:43.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58659b700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc58006f5a0 0x7fc580149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc585d9a700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5800cb1a0 0x7fc5800af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 -- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc58006f5a0 msgr2=0x7fc580149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc58006f5a0 0x7fc580149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 -- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5800cb1a0 msgr2=0x7fc5800af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5800cb1a0 0x7fc5800af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc586d9c700 1 -- 172.21.15.86:0/444145782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57800bcf0 con 0x7fc5800af900 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc58659b700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc58006f5a0 0x7fc580149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.561+0000 7fc585d9a700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5800cb1a0 0x7fc5800af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.562+0000 7fc586d9c700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5800af900 0x7fc5800afda0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc57800ba90 tx=0x7fc57801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.562+0000 7fc5767fc700 1 -- 172.21.15.86:0/444145782 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800ac10 con 0x7fc5800af900 2023-10-09T11:41:43.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.562+0000 7fc5767fc700 1 -- 172.21.15.86:0/444145782 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57800ad70 con 0x7fc5800af900 2023-10-09T11:41:43.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.562+0000 7fc5767fc700 1 -- 172.21.15.86:0/444145782 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57801e690 con 0x7fc5800af900 2023-10-09T11:41:43.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.562+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc580152510 con 0x7fc5800af900 2023-10-09T11:41:43.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.562+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5801518d0 con 0x7fc5800af900 2023-10-09T11:41:43.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.563+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc580152a30 con 0x7fc5800af900 2023-10-09T11:41:43.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.564+0000 7fc5767fc700 1 -- 172.21.15.86:0/444145782 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc578003040 con 0x7fc5800af900 2023-10-09T11:41:43.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.565+0000 7fc5767fc700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc564066f30 0x7fc5640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.565+0000 7fc5767fc700 1 -- 172.21.15.86:0/444145782 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc578086190 con 0x7fc5800af900 2023-10-09T11:41:43.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.565+0000 7fc58659b700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc564066f30 0x7fc5640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.565+0000 7fc58659b700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc564066f30 0x7fc5640693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc57c006f00 tx=0x7fc57c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.569+0000 7fc5767fc700 1 -- 172.21.15.86:0/444145782 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc580152a30 con 0x7fc5800af900 2023-10-09T11:41:43.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.758+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc580152a30 con 0x7fc5800af900 2023-10-09T11:41:43.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.759+0000 7fc5767fc700 1 -- 172.21.15.86:0/444145782 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc580152a30 con 0x7fc5800af900 2023-10-09T11:41:43.761 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:41:43.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc564066f30 msgr2=0x7fc5640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc564066f30 0x7fc5640693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc57c006f00 tx=0x7fc57c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:43.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5800af900 msgr2=0x7fc5800afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5800af900 0x7fc5800afda0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc57800ba90 tx=0x7fc57801a000 comp rx=0 tx=0).stop 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 shutdown_connections 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc564066f30 0x7fc5640693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5800af900 0x7fc5800afda0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc58006f5a0 0x7fc580149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 --2- 172.21.15.86:0/444145782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5800cb1a0 0x7fc5800af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 >> 172.21.15.86:0/444145782 conn(0x7fc5800cc1e0 msgr2=0x7fc580155260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 shutdown_connections 2023-10-09T11:41:43.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.761+0000 7fc58759d700 1 -- 172.21.15.86:0/444145782 wait complete. 2023-10-09T11:41:43.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:43.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.961+0000 7f739abff700 1 Processor -- start 2023-10-09T11:41:43.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.961+0000 7f739abff700 1 -- start start 2023-10-09T11:41:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.962+0000 7f739abff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f73940c83f0 0x7f73940c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.962+0000 7f739abff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f73941568e0 0x7f73940ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739abff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739415b0d0 con 0x7f73940ccee0 2023-10-09T11:41:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739abff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73940c7a60 con 0x7f73940c83f0 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739abff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739415a4c0 con 0x7f73941568e0 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739899b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f73940c83f0 0x7f73940c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739899b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f73940c83f0 0x7f73940c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41502/0 (socket says 172.21.15.86:41502) 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739899b700 1 -- 172.21.15.86:0/1159929157 learned_addr learned my addr 172.21.15.86:0/1159929157 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f7393fff700 1 --1- 172.21.15.86:0/1159929157 >> v1:172.21.15.86:6789/0 conn(0x7f73940ccee0 0x7f73941561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44562/0 (socket says 172.21.15.86:44562) 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739919c700 1 --2- 172.21.15.86:0/1159929157 >> v2:172.21.15.135:3300/0 conn(0x7f73941568e0 0x7f73940ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739899b700 1 -- 172.21.15.86:0/1159929157 >> v2:172.21.15.135:3300/0 conn(0x7f73941568e0 msgr2=0x7f73940ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739899b700 1 --2- 172.21.15.86:0/1159929157 >> v2:172.21.15.135:3300/0 conn(0x7f73941568e0 0x7f73940ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739899b700 1 -- 172.21.15.86:0/1159929157 >> v1:172.21.15.86:6789/0 conn(0x7f73940ccee0 legacy=0x7f73941561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f739899b700 1 -- 172.21.15.86:0/1159929157 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739415a7a0 con 0x7f73940c83f0 2023-10-09T11:41:43.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.963+0000 7f73937fe700 1 -- 172.21.15.86:0/1159929157 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843822200 0 0) 0x7f739415b0d0 con 0x7f73940ccee0 2023-10-09T11:41:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739899b700 1 --2- 172.21.15.86:0/1159929157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f73940c7520 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f739406d240 tx=0x7f7388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4892d91c1fc9ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f73937fe700 1 -- 172.21.15.86:0/1159929157 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800b860 con 0x7f73940c83f0 2023-10-09T11:41:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f73937fe700 1 -- 172.21.15.86:0/1159929157 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800b9c0 con 0x7f73940c83f0 2023-10-09T11:41:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f73937fe700 1 -- 172.21.15.86:0/1159929157 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800bd60 con 0x7f73940c83f0 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 -- 172.21.15.86:0/1159929157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 msgr2=0x7f73940c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 --2- 172.21.15.86:0/1159929157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f73940c7520 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f739406d240 tx=0x7f7388009250 comp rx=0 tx=0).stop 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 -- 172.21.15.86:0/1159929157 shutdown_connections 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 --2- 172.21.15.86:0/1159929157 >> v2:172.21.15.135:3300/0 conn(0x7f73941568e0 0x7f73940ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 --2- 172.21.15.86:0/1159929157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f73940c7520 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 -- 172.21.15.86:0/1159929157 >> 172.21.15.86:0/1159929157 conn(0x7f7394068e10 msgr2=0x7f73940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 -- 172.21.15.86:0/1159929157 shutdown_connections 2023-10-09T11:41:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.964+0000 7f739abff700 1 -- 172.21.15.86:0/1159929157 wait complete. 2023-10-09T11:41:43.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.966+0000 7f739abff700 1 Processor -- start 2023-10-09T11:41:43.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.966+0000 7f739abff700 1 -- start start 2023-10-09T11:41:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739abff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f739414a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739abff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73940ccee0 0x7f73940c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739abff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73941568e0 0x7f73940c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739abff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940af2d0 con 0x7f73940c83f0 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739abff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940afe50 con 0x7f73940ccee0 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739abff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739414a690 con 0x7f73941568e0 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f739414a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f739414a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41516/0 (socket says 172.21.15.86:41516) 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 -- 172.21.15.86:0/1760772902 learned_addr learned my addr 172.21.15.86:0/1760772902 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 -- 172.21.15.86:0/1760772902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73941568e0 msgr2=0x7f73940c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73941568e0 0x7f73940c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 -- 172.21.15.86:0/1760772902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73940ccee0 msgr2=0x7f73940c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73940ccee0 0x7f73940c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.967+0000 7f739899b700 1 -- 172.21.15.86:0/1760772902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73880094f0 con 0x7f73940c83f0 2023-10-09T11:41:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.968+0000 7f739899b700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f739414a150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7394063d40 tx=0x7f7388017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.968+0000 7f7390ff9700 1 -- 172.21.15.86:0/1760772902 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388024440 con 0x7f73940c83f0 2023-10-09T11:41:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.968+0000 7f7390ff9700 1 -- 172.21.15.86:0/1760772902 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73880245c0 con 0x7f73940c83f0 2023-10-09T11:41:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.968+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73940af520 con 0x7f73940c83f0 2023-10-09T11:41:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.968+0000 7f7390ff9700 1 -- 172.21.15.86:0/1760772902 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388024980 con 0x7f73940c83f0 2023-10-09T11:41:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.968+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73940afae0 con 0x7f73940c83f0 2023-10-09T11:41:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.969+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73940b01e0 con 0x7f73940c83f0 2023-10-09T11:41:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.970+0000 7f7390ff9700 1 -- 172.21.15.86:0/1760772902 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f738801a420 con 0x7f73940c83f0 2023-10-09T11:41:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.971+0000 7f7390ff9700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7378066f30 0x7f73780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.971+0000 7f7390ff9700 1 -- 172.21.15.86:0/1760772902 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7388086450 con 0x7f73940c83f0 2023-10-09T11:41:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.971+0000 7f7393fff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7378066f30 0x7f73780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.972+0000 7f7393fff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7378066f30 0x7f73780693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f73800011e0 tx=0x7f73800079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:43.975+0000 7f7390ff9700 1 -- 172.21.15.86:0/1760772902 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73940b01e0 con 0x7f73940c83f0 2023-10-09T11:41:44.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.170+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73940b01e0 con 0x7f73940c83f0 2023-10-09T11:41:44.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.173+0000 7f7390ff9700 1 -- 172.21.15.86:0/1760772902 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73940b01e0 con 0x7f73940c83f0 2023-10-09T11:41:44.174 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:41:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7378066f30 msgr2=0x7f73780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7378066f30 0x7f73780693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f73800011e0 tx=0x7f73800079b0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 msgr2=0x7f739414a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f739414a150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7394063d40 tx=0x7f7388017000 comp rx=0 tx=0).stop 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 shutdown_connections 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7378066f30 0x7f73780693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73940c83f0 0x7f739414a150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73941568e0 0x7f73940c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 --2- 172.21.15.86:0/1760772902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73940ccee0 0x7f73940c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.175+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 >> 172.21.15.86:0/1760772902 conn(0x7f7394068e10 msgr2=0x7f73940cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.176+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 shutdown_connections 2023-10-09T11:41:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.176+0000 7f739abff700 1 -- 172.21.15.86:0/1760772902 wait complete. 2023-10-09T11:41:44.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:44.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.374+0000 7f64ccb9d700 1 Processor -- start 2023-10-09T11:41:44.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.374+0000 7f64ccb9d700 1 -- start start 2023-10-09T11:41:44.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.375+0000 7f64ccb9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64c8159420 0x7f64c80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.375+0000 7f64ccb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.375+0000 7f64ccb9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80b11d0 con 0x7f64c815d230 2023-10-09T11:41:44.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.375+0000 7f64ccb9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c80b14b0 con 0x7f64c8159420 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.375+0000 7f64ccb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80b1790 con 0x7f64c81597f0 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64c8159420 0x7f64c80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64c8159420 0x7f64c80b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41524/0 (socket says 172.21.15.86:41524) 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 -- 172.21.15.86:0/3545065223 learned_addr learned my addr 172.21.15.86:0/3545065223 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c6ffd700 1 --2- 172.21.15.86:0/3545065223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 -- 172.21.15.86:0/3545065223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 msgr2=0x7f64c80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 --2- 172.21.15.86:0/3545065223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 -- 172.21.15.86:0/3545065223 >> v1:172.21.15.135:6789/0 conn(0x7f64c815d230 legacy=0x7f64c80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 -- 172.21.15.86:0/3545065223 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80b1a70 con 0x7f64c8159420 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.376+0000 7f64c77fe700 1 --2- 172.21.15.86:0/3545065223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c8159420 0x7f64c80b5f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f64b80099b0 tx=0x7f64b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6a03ab6289010 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64c67fc700 1 -- 172.21.15.86:0/3545065223 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800b860 con 0x7f64c8159420 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64c67fc700 1 -- 172.21.15.86:0/3545065223 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800b9c0 con 0x7f64c8159420 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64c67fc700 1 -- 172.21.15.86:0/3545065223 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800bd60 con 0x7f64c8159420 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 -- 172.21.15.86:0/3545065223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c8159420 msgr2=0x7f64c80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/3545065223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c8159420 0x7f64c80b5f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f64b80099b0 tx=0x7f64b8009250 comp rx=0 tx=0).stop 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 -- 172.21.15.86:0/3545065223 shutdown_connections 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/3545065223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c8159420 0x7f64c80b5f40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/3545065223 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 -- 172.21.15.86:0/3545065223 >> 172.21.15.86:0/3545065223 conn(0x7f64c80d0660 msgr2=0x7f64c80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 -- 172.21.15.86:0/3545065223 shutdown_connections 2023-10-09T11:41:44.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.377+0000 7f64ccb9d700 1 -- 172.21.15.86:0/3545065223 wait complete. 2023-10-09T11:41:44.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.379+0000 7f64ccb9d700 1 Processor -- start 2023-10-09T11:41:44.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.379+0000 7f64ccb9d700 1 -- start start 2023-10-09T11:41:44.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64ccb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64c8159420 0x7f64c80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64ccb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64ccb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c815d230 0x7f64c80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64ccb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8153fa0 con 0x7f64c815d230 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64ccb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80cff00 con 0x7f64c8159420 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64ccb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80d01e0 con 0x7f64c81597f0 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c815d230 0x7f64c80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c815d230 0x7f64c80cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41536/0 (socket says 172.21.15.86:41536) 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 -- 172.21.15.86:0/2377397969 learned_addr learned my addr 172.21.15.86:0/2377397969 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c77fe700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64c8159420 0x7f64c80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c6ffd700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 -- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 msgr2=0x7f64c80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 -- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64c8159420 msgr2=0x7f64c80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64c8159420 0x7f64c80cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c7fff700 1 -- 172.21.15.86:0/2377397969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80094f0 con 0x7f64c815d230 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.380+0000 7f64c6ffd700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.381+0000 7f64c7fff700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c815d230 0x7f64c80cf8d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c840 tx=0x7f64c0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.381+0000 7f64af7fe700 1 -- 172.21.15.86:0/2377397969 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0012630 con 0x7f64c815d230 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.381+0000 7f64af7fe700 1 -- 172.21.15.86:0/2377397969 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c00127b0 con 0x7f64c815d230 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.381+0000 7f64af7fe700 1 -- 172.21.15.86:0/2377397969 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0012b70 con 0x7f64c815d230 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.381+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c815a620 con 0x7f64c815d230 2023-10-09T11:41:44.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.381+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c815abe0 con 0x7f64c815d230 2023-10-09T11:41:44.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.382+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c804c3c0 con 0x7f64c815d230 2023-10-09T11:41:44.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.383+0000 7f64af7fe700 1 -- 172.21.15.86:0/2377397969 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64c0003030 con 0x7f64c815d230 2023-10-09T11:41:44.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.384+0000 7f64af7fe700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f64b4066f30 0x7f64b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.384+0000 7f64af7fe700 1 -- 172.21.15.86:0/2377397969 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64c00844d0 con 0x7f64c815d230 2023-10-09T11:41:44.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.384+0000 7f64c77fe700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f64b4066f30 0x7f64b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.385+0000 7f64c77fe700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f64b4066f30 0x7f64b40693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64b80099b0 tx=0x7f64b8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.388+0000 7f64af7fe700 1 -- 172.21.15.86:0/2377397969 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64c0055130 con 0x7f64c815d230 2023-10-09T11:41:44.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.579+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64c80d03a0 con 0x7f64c815d230 2023-10-09T11:41:44.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.580+0000 7f64af7fe700 1 -- 172.21.15.86:0/2377397969 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f64c0054cc0 con 0x7f64c815d230 2023-10-09T11:41:44.582 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:44.582 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:44.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.582+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f64b4066f30 msgr2=0x7f64b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f64b4066f30 0x7f64b40693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64b80099b0 tx=0x7f64b8017000 comp rx=0 tx=0).stop 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c815d230 msgr2=0x7f64c80cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c815d230 0x7f64c80cf8d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c840 tx=0x7f64c0001670 comp rx=0 tx=0).stop 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 shutdown_connections 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f64b4066f30 0x7f64b40693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64c815d230 0x7f64c80cf8d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64c8159420 0x7f64c80cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 --2- 172.21.15.86:0/2377397969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64c81597f0 0x7f64c80cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 >> 172.21.15.86:0/2377397969 conn(0x7f64c80d0660 msgr2=0x7f64c80b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 shutdown_connections 2023-10-09T11:41:44.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.583+0000 7f64ccb9d700 1 -- 172.21.15.86:0/2377397969 wait complete. 2023-10-09T11:41:44.602 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:09.500279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:10.496954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:44.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.782+0000 7f589c5ff700 1 Processor -- start 2023-10-09T11:41:44.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.782+0000 7f589c5ff700 1 -- start start 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.783+0000 7f589c5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5894159890 0x7f589415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.783+0000 7f589c5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5894159c60 0x7f589415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.783+0000 7f589c5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589415a160 con 0x7f589415db10 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.783+0000 7f589c5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589415df50 con 0x7f5894159c60 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.783+0000 7f589c5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58940d13a0 con 0x7f5894159890 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.783+0000 7f5899b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5894159c60 0x7f589415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.783+0000 7f5899b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5894159c60 0x7f589415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41542/0 (socket says 172.21.15.86:41542) 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899b9a700 1 -- 172.21.15.86:0/2171160168 learned_addr learned my addr 172.21.15.86:0/2171160168 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:44.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f589a39b700 1 --2- 172.21.15.86:0/2171160168 >> v2:172.21.15.135:3300/0 conn(0x7f5894159890 0x7f589415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899b9a700 1 -- 172.21.15.86:0/2171160168 >> v2:172.21.15.135:3300/0 conn(0x7f5894159890 msgr2=0x7f589415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899b9a700 1 --2- 172.21.15.86:0/2171160168 >> v2:172.21.15.135:3300/0 conn(0x7f5894159890 0x7f589415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899b9a700 1 -- 172.21.15.86:0/2171160168 >> v1:172.21.15.86:6789/0 conn(0x7f589415db10 legacy=0x7f5894069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899b9a700 1 -- 172.21.15.86:0/2171160168 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589415e140 con 0x7f5894159c60 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899399700 1 -- 172.21.15.86:0/2171160168 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54547418 0 0) 0x7f589415a160 con 0x7f589415db10 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899b9a700 1 --2- 172.21.15.86:0/2171160168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159c60 0x7f589415d5d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f58940d1090 tx=0x7f5884009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfea12af814fe71 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899399700 1 -- 172.21.15.86:0/2171160168 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588400b860 con 0x7f5894159c60 2023-10-09T11:41:44.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899399700 1 -- 172.21.15.86:0/2171160168 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588400b9c0 con 0x7f5894159c60 2023-10-09T11:41:44.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.784+0000 7f5899399700 1 -- 172.21.15.86:0/2171160168 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588400bd60 con 0x7f5894159c60 2023-10-09T11:41:44.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 -- 172.21.15.86:0/2171160168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159c60 msgr2=0x7f589415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 --2- 172.21.15.86:0/2171160168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159c60 0x7f589415d5d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f58940d1090 tx=0x7f5884009250 comp rx=0 tx=0).stop 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 -- 172.21.15.86:0/2171160168 shutdown_connections 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 --2- 172.21.15.86:0/2171160168 >> v2:172.21.15.135:3300/0 conn(0x7f5894159890 0x7f589415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 --2- 172.21.15.86:0/2171160168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159c60 0x7f589415d5d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 -- 172.21.15.86:0/2171160168 >> 172.21.15.86:0/2171160168 conn(0x7f5894068e20 msgr2=0x7f58940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 -- 172.21.15.86:0/2171160168 shutdown_connections 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.785+0000 7f589c5ff700 1 -- 172.21.15.86:0/2171160168 wait complete. 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.786+0000 7f589c5ff700 1 Processor -- start 2023-10-09T11:41:44.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.787+0000 7f589c5ff700 1 -- start start 2023-10-09T11:41:44.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.787+0000 7f589c5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159890 0x7f589413f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.787+0000 7f589c5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5894159c60 0x7f5894157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.787+0000 7f589c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589415db10 0x7f58941580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.787+0000 7f589c5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940cd7b0 con 0x7f5894159890 2023-10-09T11:41:44.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b2d50 con 0x7f589415db10 2023-10-09T11:41:44.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589c5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b2a70 con 0x7f5894159c60 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159890 0x7f589413f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159890 0x7f589413f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41550/0 (socket says 172.21.15.86:41550) 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 -- 172.21.15.86:0/3651125851 learned_addr learned my addr 172.21.15.86:0/3651125851 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 -- 172.21.15.86:0/3651125851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5894159c60 msgr2=0x7f5894157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5894159c60 0x7f5894157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 -- 172.21.15.86:0/3651125851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589415db10 msgr2=0x7f58941580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589415db10 0x7f58941580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 -- 172.21.15.86:0/3651125851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840094f0 con 0x7f5894159890 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589a39b700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159890 0x7f589413f310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f589000d890 tx=0x7f5890008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f588a7fc700 1 -- 172.21.15.86:0/3651125851 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000b600 con 0x7f5894159890 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f588a7fc700 1 -- 172.21.15.86:0/3651125851 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589000b760 con 0x7f5894159890 2023-10-09T11:41:44.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58940cd160 con 0x7f5894159890 2023-10-09T11:41:44.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.788+0000 7f588a7fc700 1 -- 172.21.15.86:0/3651125851 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000bae0 con 0x7f5894159890 2023-10-09T11:41:44.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.789+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58940b1d00 con 0x7f5894159890 2023-10-09T11:41:44.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.790+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589404c3c0 con 0x7f5894159890 2023-10-09T11:41:44.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.790+0000 7f588a7fc700 1 -- 172.21.15.86:0/3651125851 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f589001e460 con 0x7f5894159890 2023-10-09T11:41:44.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.791+0000 7f588a7fc700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5878066f30 0x7f58780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.791+0000 7f588a7fc700 1 -- 172.21.15.86:0/3651125851 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5890084c80 con 0x7f5894159890 2023-10-09T11:41:44.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.791+0000 7f5899b9a700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5878066f30 0x7f58780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.792+0000 7f5899b9a700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5878066f30 0x7f58780693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58940d1090 tx=0x7f5884017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.795+0000 7f588a7fc700 1 -- 172.21.15.86:0/3651125851 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5890051e50 con 0x7f5894159890 2023-10-09T11:41:44.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.987+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f589406a5b0 con 0x7f5894159890 2023-10-09T11:41:44.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.987+0000 7f588a7fc700 1 -- 172.21.15.86:0/3651125851 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5890055470 con 0x7f5894159890 2023-10-09T11:41:44.989 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:44.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5878066f30 msgr2=0x7f58780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5878066f30 0x7f58780693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58940d1090 tx=0x7f5884017000 comp rx=0 tx=0).stop 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159890 msgr2=0x7f589413f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159890 0x7f589413f310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f589000d890 tx=0x7f5890008040 comp rx=0 tx=0).stop 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 shutdown_connections 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5878066f30 0x7f58780693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5894159890 0x7f589413f310 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f589415db10 0x7f58941580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 --2- 172.21.15.86:0/3651125851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5894159c60 0x7f5894157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.989+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 >> 172.21.15.86:0/3651125851 conn(0x7f5894068e20 msgr2=0x7f58941536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.990+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 shutdown_connections 2023-10-09T11:41:44.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:44.990+0000 7f589c5ff700 1 -- 172.21.15.86:0/3651125851 wait complete. 2023-10-09T11:41:45.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:45.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.192+0000 7fe8a99ff700 1 Processor -- start 2023-10-09T11:41:45.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.192+0000 7fe8a99ff700 1 -- start start 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.193+0000 7fe8a99ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40ccee0 0x7fe8a41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.193+0000 7fe8a99ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8a40c87c0 0x7fe8a4156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.193+0000 7fe8a99ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a415b0d0 con 0x7fe8a40c83f0 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.193+0000 7fe8a99ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a4156c50 con 0x7fe8a40c87c0 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.193+0000 7fe8a99ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415a4c0 con 0x7fe8a40ccee0 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a2ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe8a40c83f0 0x7fe8a40c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53230/0 (socket says 172.21.15.86:53230) 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a2ffd700 1 -- 172.21.15.86:0/3651636318 learned_addr learned my addr 172.21.15.86:0/3651636318 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:45.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a37fe700 1 --2- 172.21.15.86:0/3651636318 >> v2:172.21.15.86:3300/0 conn(0x7fe8a40c87c0 0x7fe8a4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a27fc700 1 --2- 172.21.15.86:0/3651636318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40ccee0 0x7fe8a41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a1ffb700 1 -- 172.21.15.86:0/3651636318 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450396808 0 0) 0x7fe8a415b0d0 con 0x7fe8a40c83f0 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a1ffb700 1 -- 172.21.15.86:0/3651636318 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe88c003570 con 0x7fe8a40c83f0 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a37fe700 1 -- 172.21.15.86:0/3651636318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40ccee0 msgr2=0x7fe8a41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a37fe700 1 --2- 172.21.15.86:0/3651636318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40ccee0 0x7fe8a41561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a37fe700 1 -- 172.21.15.86:0/3651636318 >> v1:172.21.15.86:6789/0 conn(0x7fe8a40c83f0 legacy=0x7fe8a40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a37fe700 1 -- 172.21.15.86:0/3651636318 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a415a7a0 con 0x7fe8a40c87c0 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.194+0000 7fe8a27fc700 1 --2- 172.21.15.86:0/3651636318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40ccee0 0x7fe8a41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:45.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.195+0000 7fe8a37fe700 1 --2- 172.21.15.86:0/3651636318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40c87c0 0x7fe8a4156710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009e60 tx=0x7fe89c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebc8c2f7e409b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.195+0000 7fe8a1ffb700 1 -- 172.21.15.86:0/3651636318 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00bb60 con 0x7fe8a40c87c0 2023-10-09T11:41:45.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.195+0000 7fe8a1ffb700 1 -- 172.21.15.86:0/3651636318 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c00bcc0 con 0x7fe8a40c87c0 2023-10-09T11:41:45.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.195+0000 7fe8a1ffb700 1 -- 172.21.15.86:0/3651636318 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0116b0 con 0x7fe8a40c87c0 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 -- 172.21.15.86:0/3651636318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40c87c0 msgr2=0x7fe8a4156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/3651636318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40c87c0 0x7fe8a4156710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009e60 tx=0x7fe89c009780 comp rx=0 tx=0).stop 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 -- 172.21.15.86:0/3651636318 shutdown_connections 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/3651636318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40c87c0 0x7fe8a4156710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/3651636318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40ccee0 0x7fe8a41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 -- 172.21.15.86:0/3651636318 >> 172.21.15.86:0/3651636318 conn(0x7fe8a4068e10 msgr2=0x7fe8a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 -- 172.21.15.86:0/3651636318 shutdown_connections 2023-10-09T11:41:45.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.196+0000 7fe8a99ff700 1 -- 172.21.15.86:0/3651636318 wait complete. 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.197+0000 7fe8a99ff700 1 Processor -- start 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.198+0000 7fe8a99ff700 1 -- start start 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.198+0000 7fe8a99ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40c83f0 0x7fe8a40b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.198+0000 7fe8a99ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8a40c87c0 0x7fe8a4157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.198+0000 7fe8a99ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40ccee0 0x7fe8a4150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.198+0000 7fe8a99ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40b0800 con 0x7fe8a40ccee0 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.198+0000 7fe8a99ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4157050 con 0x7fe8a40c87c0 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.198+0000 7fe8a99ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40b0a50 con 0x7fe8a40c83f0 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40ccee0 0x7fe8a4150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40ccee0 0x7fe8a4150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55592/0 (socket says 172.21.15.86:55592) 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 -- 172.21.15.86:0/2866158051 learned_addr learned my addr 172.21.15.86:0/2866158051 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a27fc700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8a40c87c0 0x7fe8a4157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a2ffd700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40c83f0 0x7fe8a40b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 -- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40c83f0 msgr2=0x7fe8a40b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40c83f0 0x7fe8a40b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 -- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8a40c87c0 msgr2=0x7fe8a4157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8a40c87c0 0x7fe8a4157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 -- 172.21.15.86:0/2866158051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c009a20 con 0x7fe8a40ccee0 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a2ffd700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40c83f0 0x7fe8a40b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:45.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.199+0000 7fe8a37fe700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40ccee0 0x7fe8a4150ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b6c0 tx=0x7fe89c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.200+0000 7fe88affd700 1 -- 172.21.15.86:0/2866158051 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c01a770 con 0x7fe8a40ccee0 2023-10-09T11:41:45.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.200+0000 7fe88affd700 1 -- 172.21.15.86:0/2866158051 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c01e050 con 0x7fe8a40ccee0 2023-10-09T11:41:45.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.200+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a40b0d30 con 0x7fe8a40ccee0 2023-10-09T11:41:45.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.200+0000 7fe88affd700 1 -- 172.21.15.86:0/2866158051 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c01ab40 con 0x7fe8a40ccee0 2023-10-09T11:41:45.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.200+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a40b12f0 con 0x7fe8a40ccee0 2023-10-09T11:41:45.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.201+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a404c3c0 con 0x7fe8a40ccee0 2023-10-09T11:41:45.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.202+0000 7fe88affd700 1 -- 172.21.15.86:0/2866158051 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe89c003040 con 0x7fe8a40ccee0 2023-10-09T11:41:45.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.203+0000 7fe88affd700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe890066f30 0x7fe8900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.203+0000 7fe88affd700 1 -- 172.21.15.86:0/2866158051 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe89c0891b0 con 0x7fe8a40ccee0 2023-10-09T11:41:45.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.203+0000 7fe8a2ffd700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe890066f30 0x7fe8900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.203+0000 7fe8a2ffd700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe890066f30 0x7fe8900693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8940058d0 tx=0x7fe894009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.207+0000 7fe88affd700 1 -- 172.21.15.86:0/2866158051 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe89c056420 con 0x7fe8a40ccee0 2023-10-09T11:41:45.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.395+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8a415aa80 con 0x7fe8a40ccee0 2023-10-09T11:41:45.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.396+0000 7fe88affd700 1 -- 172.21.15.86:0/2866158051 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe89c059a40 con 0x7fe8a40ccee0 2023-10-09T11:41:45.397 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe890066f30 msgr2=0x7fe8900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe890066f30 0x7fe8900693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8940058d0 tx=0x7fe894009040 comp rx=0 tx=0).stop 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40ccee0 msgr2=0x7fe8a4150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40ccee0 0x7fe8a4150ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b6c0 tx=0x7fe89c01b000 comp rx=0 tx=0).stop 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 shutdown_connections 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe890066f30 0x7fe8900693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a40ccee0 0x7fe8a4150ef0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a40c83f0 0x7fe8a40b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 --2- 172.21.15.86:0/2866158051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8a40c87c0 0x7fe8a4157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 >> 172.21.15.86:0/2866158051 conn(0x7fe8a4068e10 msgr2=0x7fe8a40cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 shutdown_connections 2023-10-09T11:41:45.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.398+0000 7fe8a99ff700 1 -- 172.21.15.86:0/2866158051 wait complete. 2023-10-09T11:41:45.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:45.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.599+0000 7f4a043ff700 1 Processor -- start 2023-10-09T11:41:45.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.599+0000 7f4a043ff700 1 -- start start 2023-10-09T11:41:45.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.600+0000 7f4a043ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.600+0000 7f4a043ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49fc0b0a70 0x7f49fc0c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.600+0000 7f4a043ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc0af2f0 con 0x7f49fc15ac80 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.600+0000 7f4a043ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49fc0af5d0 con 0x7f49fc0b0a70 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.600+0000 7f4a043ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0c8660 con 0x7f49fc069e80 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.600+0000 7f4a0299c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49fc0b0a70 0x7f49fc0c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0299c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49fc0b0a70 0x7f49fc0c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55606/0 (socket says 172.21.15.86:55606) 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0299c700 1 -- 172.21.15.86:0/2210333342 learned_addr learned my addr 172.21.15.86:0/2210333342 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0199a700 1 --2- 172.21.15.86:0/2210333342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0299c700 1 -- 172.21.15.86:0/2210333342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 msgr2=0x7f49fc0c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0299c700 1 --2- 172.21.15.86:0/2210333342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0299c700 1 -- 172.21.15.86:0/2210333342 >> v1:172.21.15.135:6789/0 conn(0x7f49fc15ac80 legacy=0x7f49fc069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:45.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0299c700 1 -- 172.21.15.86:0/2210333342 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc0c8940 con 0x7f49fc0b0a70 2023-10-09T11:41:45.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0199a700 1 --2- 172.21.15.86:0/2210333342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:45.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a0299c700 1 --2- 172.21.15.86:0/2210333342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc0c70b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009f20 tx=0x7f49f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5159c5a67418afac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a01199700 1 -- 172.21.15.86:0/2210333342 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400e070 con 0x7f49fc0b0a70 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a01199700 1 -- 172.21.15.86:0/2210333342 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f400ba40 con 0x7f49fc0b0a70 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.601+0000 7f4a01199700 1 -- 172.21.15.86:0/2210333342 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40092e0 con 0x7f49fc0b0a70 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 -- 172.21.15.86:0/2210333342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 msgr2=0x7f49fc0c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 --2- 172.21.15.86:0/2210333342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc0c70b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009f20 tx=0x7f49f4009840 comp rx=0 tx=0).stop 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 -- 172.21.15.86:0/2210333342 shutdown_connections 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 --2- 172.21.15.86:0/2210333342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc0c70b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 --2- 172.21.15.86:0/2210333342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 -- 172.21.15.86:0/2210333342 >> 172.21.15.86:0/2210333342 conn(0x7f49fc068e10 msgr2=0x7f49fc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 -- 172.21.15.86:0/2210333342 shutdown_connections 2023-10-09T11:41:45.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.602+0000 7f4a043ff700 1 -- 172.21.15.86:0/2210333342 wait complete. 2023-10-09T11:41:45.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.604+0000 7f4a043ff700 1 Processor -- start 2023-10-09T11:41:45.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.604+0000 7f4a043ff700 1 -- start start 2023-10-09T11:41:45.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a043ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a043ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc16a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a043ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49fc15ac80 0x7f49fc154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a043ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0ad0a0 con 0x7f49fc0b0a70 2023-10-09T11:41:45.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a043ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc16ada0 con 0x7f49fc15ac80 2023-10-09T11:41:45.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a043ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0ad2d0 con 0x7f49fc069e80 2023-10-09T11:41:45.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0199a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc16a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0199a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc16a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55614/0 (socket says 172.21.15.86:55614) 2023-10-09T11:41:45.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0199a700 1 -- 172.21.15.86:0/1516670502 learned_addr learned my addr 172.21.15.86:0/1516670502 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:45.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0219b700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0299c700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49fc15ac80 0x7f49fc154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0199a700 1 -- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 msgr2=0x7f49fc0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0199a700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.605+0000 7f4a0199a700 1 -- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49fc15ac80 msgr2=0x7f49fc154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f4a0199a700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49fc15ac80 0x7f49fc154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f4a0199a700 1 -- 172.21.15.86:0/1516670502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4009ae0 con 0x7f49fc0b0a70 2023-10-09T11:41:45.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f4a0199a700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc16a860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00c880 tx=0x7f49ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f49f27fc700 1 -- 172.21.15.86:0/1516670502 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec011600 con 0x7f49fc0b0a70 2023-10-09T11:41:45.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f49f27fc700 1 -- 172.21.15.86:0/1516670502 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec011760 con 0x7f49fc0b0a70 2023-10-09T11:41:45.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc0ad5b0 con 0x7f49fc0b0a70 2023-10-09T11:41:45.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f49f27fc700 1 -- 172.21.15.86:0/1516670502 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec011b00 con 0x7f49fc0b0a70 2023-10-09T11:41:45.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.606+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc0adbf0 con 0x7f49fc0b0a70 2023-10-09T11:41:45.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.607+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc04c3c0 con 0x7f49fc0b0a70 2023-10-09T11:41:45.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.608+0000 7f49f27fc700 1 -- 172.21.15.86:0/1516670502 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49ec018360 con 0x7f49fc0b0a70 2023-10-09T11:41:45.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.609+0000 7f49f27fc700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:45.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.609+0000 7f49f27fc700 1 -- 172.21.15.86:0/1516670502 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49ec084260 con 0x7f49fc0b0a70 2023-10-09T11:41:45.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.610+0000 7f4a0219b700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:45.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.610+0000 7f4a0219b700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f49e0066f30 0x7f49e00693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009af0 tx=0x7f49f8009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:45.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.613+0000 7f49f27fc700 1 -- 172.21.15.86:0/1516670502 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49ec051430 con 0x7f49fc0b0a70 2023-10-09T11:41:45.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.803+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49fc0adf10 con 0x7f49fc0b0a70 2023-10-09T11:41:45.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.804+0000 7f49f27fc700 1 -- 172.21.15.86:0/1516670502 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49ec054a50 con 0x7f49fc0b0a70 2023-10-09T11:41:45.806 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:41:45.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f49e0066f30 msgr2=0x7f49e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f49e0066f30 0x7f49e00693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009af0 tx=0x7f49f8009060 comp rx=0 tx=0).stop 2023-10-09T11:41:45.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 msgr2=0x7f49fc16a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:45.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc16a860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00c880 tx=0x7f49ec008040 comp rx=0 tx=0).stop 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 shutdown_connections 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49fc15ac80 0x7f49fc154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49fc069e80 0x7f49fc0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 --2- 172.21.15.86:0/1516670502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49fc0b0a70 0x7f49fc16a860 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 >> 172.21.15.86:0/1516670502 conn(0x7f49fc068e10 msgr2=0x7f49fc156260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 shutdown_connections 2023-10-09T11:41:45.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:45.806+0000 7f4a043ff700 1 -- 172.21.15.86:0/1516670502 wait complete. 2023-10-09T11:41:45.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:46.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.008+0000 7f7f527ff700 1 Processor -- start 2023-10-09T11:41:46.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.008+0000 7f7f527ff700 1 -- start start 2023-10-09T11:41:46.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f527ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7f4c155c10 0x7f7f4c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f527ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f4c0ac230 0x7f7f4c0ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f527ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c0ccc40 0x7f7f4c0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f527ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f4c0ad930 con 0x7f7f4c155c10 2023-10-09T11:41:46.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f527ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f4c0acd20 con 0x7f7f4c0ac230 2023-10-09T11:41:46.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f527ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c0ad000 con 0x7f7f4c0ccc40 2023-10-09T11:41:46.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7f4c155c10 0x7f7f4c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7f4c155c10 0x7f7f4c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55622/0 (socket says 172.21.15.86:55622) 2023-10-09T11:41:46.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 -- 172.21.15.86:0/995321906 learned_addr learned my addr 172.21.15.86:0/995321906 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:46.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4b7fe700 1 --2- 172.21.15.86:0/995321906 >> v2:172.21.15.135:3300/0 conn(0x7f7f4c0ac230 0x7f7f4c0ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f50d9c700 1 --2- 172.21.15.86:0/995321906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c0ccc40 0x7f7f4c0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 -- 172.21.15.86:0/995321906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c0ccc40 msgr2=0x7f7f4c0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:46.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 --2- 172.21.15.86:0/995321906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c0ccc40 0x7f7f4c0af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 -- 172.21.15.86:0/995321906 >> v2:172.21.15.135:3300/0 conn(0x7f7f4c0ac230 msgr2=0x7f7f4c0ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:46.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 --2- 172.21.15.86:0/995321906 >> v2:172.21.15.135:3300/0 conn(0x7f7f4c0ac230 0x7f7f4c0ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f4bfff700 1 -- 172.21.15.86:0/995321906 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c0ad2e0 con 0x7f7f4c155c10 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.010+0000 7f7f50d9c700 1 --2- 172.21.15.86:0/995321906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c0ccc40 0x7f7f4c0af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f4bfff700 1 --2- 172.21.15.86:0/995321906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c155c10 0x7f7f4c155fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c065bb0 tx=0x7f7f3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b60ca4251afe15 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f4affd700 1 -- 172.21.15.86:0/995321906 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c009e70 con 0x7f7f4c155c10 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f4affd700 1 -- 172.21.15.86:0/995321906 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00b860 con 0x7f7f4c155c10 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f4affd700 1 -- 172.21.15.86:0/995321906 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00bc00 con 0x7f7f4c155c10 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 -- 172.21.15.86:0/995321906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c155c10 msgr2=0x7f7f4c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 --2- 172.21.15.86:0/995321906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c155c10 0x7f7f4c155fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c065bb0 tx=0x7f7f3c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 -- 172.21.15.86:0/995321906 shutdown_connections 2023-10-09T11:41:46.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 --2- 172.21.15.86:0/995321906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c0ccc40 0x7f7f4c0af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 --2- 172.21.15.86:0/995321906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c155c10 0x7f7f4c155fe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 --2- 172.21.15.86:0/995321906 >> v2:172.21.15.135:3300/0 conn(0x7f7f4c0ac230 0x7f7f4c0ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 -- 172.21.15.86:0/995321906 >> 172.21.15.86:0/995321906 conn(0x7f7f4c06a320 msgr2=0x7f7f4c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.011+0000 7f7f527ff700 1 -- 172.21.15.86:0/995321906 shutdown_connections 2023-10-09T11:41:46.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.012+0000 7f7f527ff700 1 -- 172.21.15.86:0/995321906 wait complete. 2023-10-09T11:41:46.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.013+0000 7f7f527ff700 1 Processor -- start 2023-10-09T11:41:46.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.013+0000 7f7f527ff700 1 -- start start 2023-10-09T11:41:46.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f527ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c0ac230 0x7f7f4c142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f527ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c0ccc40 0x7f7f4c0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f527ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c155c10 0x7f7f4c13e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f527ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c143880 con 0x7f7f4c0ac230 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f527ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c142c70 con 0x7f7f4c0ccc40 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f527ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c142f50 con 0x7f7f4c155c10 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f4bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c0ac230 0x7f7f4c142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f4bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c0ac230 0x7f7f4c142560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55632/0 (socket says 172.21.15.86:55632) 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f4bfff700 1 -- 172.21.15.86:0/1391645406 learned_addr learned my addr 172.21.15.86:0/1391645406 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f4b7fe700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c0ccc40 0x7f7f4c0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f50d9c700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c155c10 0x7f7f4c13e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f4bfff700 1 -- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c155c10 msgr2=0x7f7f4c13e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.014+0000 7f7f4bfff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c155c10 0x7f7f4c13e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f4bfff700 1 -- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c0ccc40 msgr2=0x7f7f4c0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f4bfff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c0ccc40 0x7f7f4c0c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f4bfff700 1 -- 172.21.15.86:0/1391645406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0094f0 con 0x7f7f4c0ac230 2023-10-09T11:41:46.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f4b7fe700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c0ccc40 0x7f7f4c0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:46.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f4bfff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c0ac230 0x7f7f4c142560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009290 tx=0x7f7f3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f33fff700 1 -- 172.21.15.86:0/1391645406 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00bbe0 con 0x7f7f4c0ac230 2023-10-09T11:41:46.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f33fff700 1 -- 172.21.15.86:0/1391645406 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c01f070 con 0x7f7f4c0ac230 2023-10-09T11:41:46.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4c143230 con 0x7f7f4c0ac230 2023-10-09T11:41:46.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f33fff700 1 -- 172.21.15.86:0/1391645406 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0266b0 con 0x7f7f4c0ac230 2023-10-09T11:41:46.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.015+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4c13ecb0 con 0x7f7f4c0ac230 2023-10-09T11:41:46.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.016+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4c04c3c0 con 0x7f7f4c0ac230 2023-10-09T11:41:46.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.017+0000 7f7f33fff700 1 -- 172.21.15.86:0/1391645406 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f3c026a60 con 0x7f7f4c0ac230 2023-10-09T11:41:46.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.018+0000 7f7f33fff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f38066f60 0x7f7f38069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.018+0000 7f7f33fff700 1 -- 172.21.15.86:0/1391645406 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f3c021070 con 0x7f7f4c0ac230 2023-10-09T11:41:46.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.018+0000 7f7f4b7fe700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f38066f60 0x7f7f38069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.019+0000 7f7f4b7fe700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f38066f60 0x7f7f38069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0cbc80 tx=0x7f7f40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.022+0000 7f7f33fff700 1 -- 172.21.15.86:0/1391645406 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f3c0533a0 con 0x7f7f4c0ac230 2023-10-09T11:41:46.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.213+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f4c0ad5c0 con 0x7f7f4c0ac230 2023-10-09T11:41:46.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.214+0000 7f7f33fff700 1 -- 172.21.15.86:0/1391645406 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f7f3c015090 con 0x7f7f4c0ac230 2023-10-09T11:41:46.215 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:46.216 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:46.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f38066f60 msgr2=0x7f7f38069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f38066f60 0x7f7f38069410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0cbc80 tx=0x7f7f40008040 comp rx=0 tx=0).stop 2023-10-09T11:41:46.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c0ac230 msgr2=0x7f7f4c142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c0ac230 0x7f7f4c142560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009290 tx=0x7f7f3c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 shutdown_connections 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f38066f60 0x7f7f38069410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f4c0ac230 0x7f7f4c142560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f4c155c10 0x7f7f4c13e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 --2- 172.21.15.86:0/1391645406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c0ccc40 0x7f7f4c0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 >> 172.21.15.86:0/1391645406 conn(0x7f7f4c06a320 msgr2=0x7f7f4c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 shutdown_connections 2023-10-09T11:41:46.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.216+0000 7f7f527ff700 1 -- 172.21.15.86:0/1391645406 wait complete. 2023-10-09T11:41:46.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:09.500279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:10.496954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:46.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:46.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.417+0000 7fb2b3bff700 1 Processor -- start 2023-10-09T11:41:46.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.417+0000 7fb2b3bff700 1 -- start start 2023-10-09T11:41:46.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b3bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2ac155eb0 0x7fb2ac06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b3bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb2ac0c70b0 0x7fb2ac069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b3bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac06eb90 con 0x7fb2ac069cb0 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b3bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ac06a130 con 0x7fb2ac155eb0 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b3bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ac06ee70 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b199b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2ac155eb0 0x7fb2ac06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b199b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2ac155eb0 0x7fb2ac06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55644/0 (socket says 172.21.15.86:55644) 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b199b700 1 -- 172.21.15.86:0/317103947 learned_addr learned my addr 172.21.15.86:0/317103947 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b219c700 1 --1- 172.21.15.86:0/317103947 >> v1:172.21.15.86:6789/0 conn(0x7fb2ac069cb0 0x7fb2ac159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53244/0 (socket says 172.21.15.86:53244) 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b199b700 1 -- 172.21.15.86:0/317103947 >> v2:172.21.15.135:3300/0 conn(0x7fb2ac0c70b0 msgr2=0x7fb2ac069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b119a700 1 --2- 172.21.15.86:0/317103947 >> v2:172.21.15.135:3300/0 conn(0x7fb2ac0c70b0 0x7fb2ac069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b199b700 1 --2- 172.21.15.86:0/317103947 >> v2:172.21.15.135:3300/0 conn(0x7fb2ac0c70b0 0x7fb2ac069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b199b700 1 -- 172.21.15.86:0/317103947 >> v1:172.21.15.86:6789/0 conn(0x7fb2ac069cb0 legacy=0x7fb2ac159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b199b700 1 -- 172.21.15.86:0/317103947 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac06f150 con 0x7fb2ac155eb0 2023-10-09T11:41:46.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b119a700 1 --2- 172.21.15.86:0/317103947 >> v2:172.21.15.135:3300/0 conn(0x7fb2ac0c70b0 0x7fb2ac069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:46.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.419+0000 7fb2b0999700 1 -- 172.21.15.86:0/317103947 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667804483 0 0) 0x7fb2ac06eb90 con 0x7fb2ac069cb0 2023-10-09T11:41:46.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b199b700 1 --2- 172.21.15.86:0/317103947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac06e240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac065130 tx=0x7fb2a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4effe37cc76210c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b0999700 1 -- 172.21.15.86:0/317103947 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800b860 con 0x7fb2ac155eb0 2023-10-09T11:41:46.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b0999700 1 -- 172.21.15.86:0/317103947 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800b9c0 con 0x7fb2ac155eb0 2023-10-09T11:41:46.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b0999700 1 -- 172.21.15.86:0/317103947 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800bd60 con 0x7fb2ac155eb0 2023-10-09T11:41:46.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b3bff700 1 -- 172.21.15.86:0/317103947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac155eb0 msgr2=0x7fb2ac06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.420+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/317103947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac06e240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac065130 tx=0x7fb2a8009250 comp rx=0 tx=0).stop 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.421+0000 7fb2b3bff700 1 -- 172.21.15.86:0/317103947 shutdown_connections 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.421+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/317103947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac06e240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.421+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/317103947 >> v2:172.21.15.135:3300/0 conn(0x7fb2ac0c70b0 0x7fb2ac069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.421+0000 7fb2b3bff700 1 -- 172.21.15.86:0/317103947 >> 172.21.15.86:0/317103947 conn(0x7fb2ac068e10 msgr2=0x7fb2ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.421+0000 7fb2b3bff700 1 -- 172.21.15.86:0/317103947 shutdown_connections 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.421+0000 7fb2b3bff700 1 -- 172.21.15.86:0/317103947 wait complete. 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.422+0000 7fb2b3bff700 1 Processor -- start 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.422+0000 7fb2b3bff700 1 -- start start 2023-10-09T11:41:46.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b3bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2ac069cb0 0x7fb2ac149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b3bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac0c70b0 0x7fb2ac0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b3bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b3bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0c3c30 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b3bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0aa510 con 0x7fb2ac155eb0 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b3bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0b19d0 con 0x7fb2ac069cb0 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b119a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac0c70b0 0x7fb2ac0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b119a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac0c70b0 0x7fb2ac0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55648/0 (socket says 172.21.15.86:55648) 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b119a700 1 -- 172.21.15.86:0/4198857346 learned_addr learned my addr 172.21.15.86:0/4198857346 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b199b700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2ac069cb0 0x7fb2ac149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.423+0000 7fb2b219c700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b119a700 1 -- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2ac069cb0 msgr2=0x7fb2ac149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b119a700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2ac069cb0 0x7fb2ac149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b119a700 1 -- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2ac155eb0 msgr2=0x7fb2ac0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b119a700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b119a700 1 -- 172.21.15.86:0/4198857346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80094f0 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b219c700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b119a700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac0c70b0 0x7fb2ac0b0e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c830 tx=0x7fb29c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2a1ffb700 1 -- 172.21.15.86:0/4198857346 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c011600 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2a1ffb700 1 -- 172.21.15.86:0/4198857346 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c011760 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac0b1cb0 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2a1ffb700 1 -- 172.21.15.86:0/4198857346 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c011b20 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.424+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac0abd00 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.425+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac0c3da0 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.426+0000 7fb2a1ffb700 1 -- 172.21.15.86:0/4198857346 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb29c0193b0 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.427+0000 7fb2a1ffb700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb290066f30 0x7fb2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.427+0000 7fb2a1ffb700 1 -- 172.21.15.86:0/4198857346 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb29c084570 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.427+0000 7fb2b199b700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb290066f30 0x7fb2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.428+0000 7fb2b199b700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb290066f30 0x7fb2900693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac065130 tx=0x7fb2a8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.431+0000 7fb2a1ffb700 1 -- 172.21.15.86:0/4198857346 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb29c051740 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.621+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2ac04c3c0 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.622+0000 7fb2a1ffb700 1 -- 172.21.15.86:0/4198857346 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb29c054d60 con 0x7fb2ac0c70b0 2023-10-09T11:41:46.624 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:46.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb290066f30 msgr2=0x7fb2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb290066f30 0x7fb2900693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac065130 tx=0x7fb2a8017000 comp rx=0 tx=0).stop 2023-10-09T11:41:46.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac0c70b0 msgr2=0x7fb2ac0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac0c70b0 0x7fb2ac0b0e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c830 tx=0x7fb29c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 shutdown_connections 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb290066f30 0x7fb2900693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2ac155eb0 0x7fb2ac0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2ac069cb0 0x7fb2ac149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 --2- 172.21.15.86:0/4198857346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2ac0c70b0 0x7fb2ac0b0e60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 >> 172.21.15.86:0/4198857346 conn(0x7fb2ac068e10 msgr2=0x7fb2ac0c2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 shutdown_connections 2023-10-09T11:41:46.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.624+0000 7fb2b3bff700 1 -- 172.21.15.86:0/4198857346 wait complete. 2023-10-09T11:41:46.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:46.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.826+0000 7f43bd79d700 1 Processor -- start 2023-10-09T11:41:46.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.827+0000 7f43bd79d700 1 -- start start 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43bd79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43b8157130 0x7f43b80c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43bd79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b806e5e0 0x7f43b806ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43bd79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b806e150 con 0x7f43b80c9db0 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43bd79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80c7800 con 0x7f43b8157130 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43bd79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80c7ae0 con 0x7f43b806e5e0 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43b7fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f43b80c9db0 0x7f43b8153900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53250/0 (socket says 172.21.15.86:53250) 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43b7fff700 1 -- 172.21.15.86:0/2359086431 learned_addr learned my addr 172.21.15.86:0/2359086431 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.828+0000 7f43b77fe700 1 --2- 172.21.15.86:0/2359086431 >> v2:172.21.15.86:3300/0 conn(0x7f43b8157130 0x7f43b80c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43bcf9c700 1 --2- 172.21.15.86:0/2359086431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b806e5e0 0x7f43b806ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b6ffd700 1 -- 172.21.15.86:0/2359086431 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293559552 0 0) 0x7f43b806e150 con 0x7f43b80c9db0 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b6ffd700 1 -- 172.21.15.86:0/2359086431 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a0003570 con 0x7f43b80c9db0 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b77fe700 1 -- 172.21.15.86:0/2359086431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b806e5e0 msgr2=0x7f43b806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b77fe700 1 --2- 172.21.15.86:0/2359086431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b806e5e0 0x7f43b806ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b77fe700 1 -- 172.21.15.86:0/2359086431 >> v1:172.21.15.86:6789/0 conn(0x7f43b80c9db0 legacy=0x7f43b8153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b77fe700 1 -- 172.21.15.86:0/2359086431 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80c7dc0 con 0x7f43b8157130 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43bcf9c700 1 --2- 172.21.15.86:0/2359086431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b806e5e0 0x7f43b806ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b77fe700 1 --2- 172.21.15.86:0/2359086431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b8157130 0x7f43b80c6f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0098e0 tx=0x7f43ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1445ffb5ae48649 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b6ffd700 1 -- 172.21.15.86:0/2359086431 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00b640 con 0x7f43b8157130 2023-10-09T11:41:46.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b6ffd700 1 -- 172.21.15.86:0/2359086431 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00b7a0 con 0x7f43b8157130 2023-10-09T11:41:46.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.829+0000 7f43b6ffd700 1 -- 172.21.15.86:0/2359086431 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00bb40 con 0x7f43b8157130 2023-10-09T11:41:46.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 -- 172.21.15.86:0/2359086431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b8157130 msgr2=0x7f43b80c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2359086431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b8157130 0x7f43b80c6f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0098e0 tx=0x7f43ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 -- 172.21.15.86:0/2359086431 shutdown_connections 2023-10-09T11:41:46.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2359086431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b806e5e0 0x7f43b806ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2359086431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b8157130 0x7f43b80c6f00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 -- 172.21.15.86:0/2359086431 >> 172.21.15.86:0/2359086431 conn(0x7f43b80cc1e0 msgr2=0x7f43b80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 -- 172.21.15.86:0/2359086431 shutdown_connections 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.830+0000 7f43bd79d700 1 -- 172.21.15.86:0/2359086431 wait complete. 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.831+0000 7f43bd79d700 1 Processor -- start 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.831+0000 7f43bd79d700 1 -- start start 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.832+0000 7f43bd79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b806e5e0 0x7f43b81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.832+0000 7f43bd79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80c9db0 0x7f43b80ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.832+0000 7f43bd79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b8157130 0x7f43b80b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.832+0000 7f43bd79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80af2b0 con 0x7f43b806e5e0 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.832+0000 7f43bd79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80accf0 con 0x7f43b80c9db0 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.832+0000 7f43bd79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80ac0e0 con 0x7f43b8157130 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b806e5e0 0x7f43b81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b806e5e0 0x7f43b81524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55656/0 (socket says 172.21.15.86:55656) 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 -- 172.21.15.86:0/2632026402 learned_addr learned my addr 172.21.15.86:0/2632026402 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b77fe700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80c9db0 0x7f43b80ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43bcf9c700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b8157130 0x7f43b80b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 -- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b8157130 msgr2=0x7f43b80b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b8157130 0x7f43b80b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 -- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80c9db0 msgr2=0x7f43b80ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:46.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80c9db0 0x7f43b80ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:46.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 -- 172.21.15.86:0/2632026402 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac009420 con 0x7f43b806e5e0 2023-10-09T11:41:46.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43b7fff700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b806e5e0 0x7f43b81524e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c590 tx=0x7f43a8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f439ffff700 1 -- 172.21.15.86:0/2632026402 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8005b30 con 0x7f43b806e5e0 2023-10-09T11:41:46.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f439ffff700 1 -- 172.21.15.86:0/2632026402 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8005cb0 con 0x7f43b806e5e0 2023-10-09T11:41:46.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f439ffff700 1 -- 172.21.15.86:0/2632026402 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8007320 con 0x7f43b806e5e0 2023-10-09T11:41:46.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.833+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b80ac3c0 con 0x7f43b806e5e0 2023-10-09T11:41:46.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.834+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b80ac980 con 0x7f43b806e5e0 2023-10-09T11:41:46.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.835+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b80acfd0 con 0x7f43b806e5e0 2023-10-09T11:41:46.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.835+0000 7f439ffff700 1 -- 172.21.15.86:0/2632026402 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43a801b3b0 con 0x7f43b806e5e0 2023-10-09T11:41:46.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.836+0000 7f439ffff700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f43a4066f60 0x7f43a4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:46.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.836+0000 7f439ffff700 1 -- 172.21.15.86:0/2632026402 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43a8083b10 con 0x7f43b806e5e0 2023-10-09T11:41:46.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.837+0000 7f43b77fe700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f43a4066f60 0x7f43a4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:46.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.837+0000 7f43b77fe700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f43a4066f60 0x7f43a4069410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0093f0 tx=0x7f43ac017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:46.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:46.840+0000 7f439ffff700 1 -- 172.21.15.86:0/2632026402 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43a8050ce0 con 0x7f43b806e5e0 2023-10-09T11:41:47.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.032+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43b806dd20 con 0x7f43b806e5e0 2023-10-09T11:41:47.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.032+0000 7f439ffff700 1 -- 172.21.15.86:0/2632026402 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43a8017020 con 0x7f43b806e5e0 2023-10-09T11:41:47.034 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:41:47.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f43a4066f60 msgr2=0x7f43a4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f43a4066f60 0x7f43a4069410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0093f0 tx=0x7f43ac017000 comp rx=0 tx=0).stop 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b806e5e0 msgr2=0x7f43b81524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b806e5e0 0x7f43b81524e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c590 tx=0x7f43a8007e00 comp rx=0 tx=0).stop 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 shutdown_connections 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f43a4066f60 0x7f43a4069410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43b806e5e0 0x7f43b81524e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43b8157130 0x7f43b80b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 --2- 172.21.15.86:0/2632026402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80c9db0 0x7f43b80ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 >> 172.21.15.86:0/2632026402 conn(0x7f43b80cc1e0 msgr2=0x7f43b8155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 shutdown_connections 2023-10-09T11:41:47.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.035+0000 7f43bd79d700 1 -- 172.21.15.86:0/2632026402 wait complete. 2023-10-09T11:41:47.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:47.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.237+0000 7fb348b9d700 1 Processor -- start 2023-10-09T11:41:47.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.238+0000 7fb348b9d700 1 -- start start 2023-10-09T11:41:47.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb348b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3440ccc00 0x7fb344069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb348b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3440c9f30 con 0x7fb34406a020 2023-10-09T11:41:47.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb348b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3440ca470 con 0x7fb344159a60 2023-10-09T11:41:47.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb348b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34406dfc0 con 0x7fb3440ccc00 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb342ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3440ccc00 0x7fb344069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb342ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3440ccc00 0x7fb344069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55662/0 (socket says 172.21.15.86:55662) 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb343fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb34406a020 0x7fb3440cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53256/0 (socket says 172.21.15.86:53256) 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.239+0000 7fb342ffd700 1 -- 172.21.15.86:0/4089045414 learned_addr learned my addr 172.21.15.86:0/4089045414 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb342ffd700 1 -- 172.21.15.86:0/4089045414 >> v1:172.21.15.135:6789/0 conn(0x7fb344159a60 legacy=0x7fb3440c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb342ffd700 1 -- 172.21.15.86:0/4089045414 >> v1:172.21.15.86:6789/0 conn(0x7fb34406a020 legacy=0x7fb3440cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb342ffd700 1 -- 172.21.15.86:0/4089045414 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440ca750 con 0x7fb3440ccc00 2023-10-09T11:41:47.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb3427fc700 1 -- 172.21.15.86:0/4089045414 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372142303 0 0) 0x7fb3440c9f30 con 0x7fb34406a020 2023-10-09T11:41:47.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb342ffd700 1 --2- 172.21.15.86:0/4089045414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3440ccc00 0x7fb344069ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3380099b0 tx=0x7fb338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984d20e4fe2318f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb3427fc700 1 -- 172.21.15.86:0/4089045414 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800b8f0 con 0x7fb3440ccc00 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb3427fc700 1 -- 172.21.15.86:0/4089045414 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33800ba50 con 0x7fb3440ccc00 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.240+0000 7fb3427fc700 1 -- 172.21.15.86:0/4089045414 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800bdf0 con 0x7fb3440ccc00 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.241+0000 7fb348b9d700 1 -- 172.21.15.86:0/4089045414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3440ccc00 msgr2=0x7fb344069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.241+0000 7fb348b9d700 1 --2- 172.21.15.86:0/4089045414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3440ccc00 0x7fb344069ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3380099b0 tx=0x7fb338009250 comp rx=0 tx=0).stop 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.241+0000 7fb348b9d700 1 -- 172.21.15.86:0/4089045414 shutdown_connections 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.241+0000 7fb348b9d700 1 --2- 172.21.15.86:0/4089045414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3440ccc00 0x7fb344069ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.241+0000 7fb348b9d700 1 -- 172.21.15.86:0/4089045414 >> 172.21.15.86:0/4089045414 conn(0x7fb34406baa0 msgr2=0x7fb34406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.241+0000 7fb348b9d700 1 -- 172.21.15.86:0/4089045414 shutdown_connections 2023-10-09T11:41:47.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.241+0000 7fb348b9d700 1 -- 172.21.15.86:0/4089045414 wait complete. 2023-10-09T11:41:47.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.242+0000 7fb348b9d700 1 Processor -- start 2023-10-09T11:41:47.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.243+0000 7fb348b9d700 1 -- start start 2023-10-09T11:41:47.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.243+0000 7fb348b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34406a020 0x7fb344153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.243+0000 7fb348b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3440ccc00 0x7fb34416b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.243+0000 7fb348b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb344159a60 0x7fb3440ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb348b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34416b6f0 con 0x7fb344159a60 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb348b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440b1430 con 0x7fb34406a020 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb348b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34416a220 con 0x7fb3440ccc00 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb344159a60 0x7fb3440ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb344159a60 0x7fb3440ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55672/0 (socket says 172.21.15.86:55672) 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 -- 172.21.15.86:0/2681728337 learned_addr learned my addr 172.21.15.86:0/2681728337 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb342ffd700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3440ccc00 0x7fb34416b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb3437fe700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34406a020 0x7fb344153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 -- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3440ccc00 msgr2=0x7fb34416b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3440ccc00 0x7fb34416b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 -- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34406a020 msgr2=0x7fb344153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34406a020 0x7fb344153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 -- 172.21.15.86:0/2681728337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380094f0 con 0x7fb344159a60 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.244+0000 7fb343fff700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb344159a60 0x7fb3440ce670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00cd50 tx=0x7fb33c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.245+0000 7fb32b7fe700 1 -- 172.21.15.86:0/2681728337 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c005df0 con 0x7fb344159a60 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.245+0000 7fb32b7fe700 1 -- 172.21.15.86:0/2681728337 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c00a960 con 0x7fb344159a60 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.245+0000 7fb32b7fe700 1 -- 172.21.15.86:0/2681728337 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00ad20 con 0x7fb344159a60 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.245+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34416a500 con 0x7fb344159a60 2023-10-09T11:41:47.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.245+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34416aac0 con 0x7fb344159a60 2023-10-09T11:41:47.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.246+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3440b1650 con 0x7fb344159a60 2023-10-09T11:41:47.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.247+0000 7fb32b7fe700 1 -- 172.21.15.86:0/2681728337 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb33c007300 con 0x7fb344159a60 2023-10-09T11:41:47.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.247+0000 7fb32b7fe700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.248+0000 7fb32b7fe700 1 -- 172.21.15.86:0/2681728337 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb33c0847e0 con 0x7fb344159a60 2023-10-09T11:41:47.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.248+0000 7fb3437fe700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.248+0000 7fb3437fe700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3340037c0 tx=0x7fb334009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.252+0000 7fb32b7fe700 1 -- 172.21.15.86:0/2681728337 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3440b1650 con 0x7fb344159a60 2023-10-09T11:41:47.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.441+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3440b15f0 con 0x7fb344159a60 2023-10-09T11:41:47.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.442+0000 7fb32b7fe700 1 -- 172.21.15.86:0/2681728337 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb33c051a30 con 0x7fb344159a60 2023-10-09T11:41:47.443 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:41:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 msgr2=0x7fb3300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3340037c0 tx=0x7fb334009040 comp rx=0 tx=0).stop 2023-10-09T11:41:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb344159a60 msgr2=0x7fb3440ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb344159a60 0x7fb3440ce670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00cd50 tx=0x7fb33c001b10 comp rx=0 tx=0).stop 2023-10-09T11:41:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 shutdown_connections 2023-10-09T11:41:47.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb330066f30 0x7fb3300693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb344159a60 0x7fb3440ce670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34406a020 0x7fb344153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 --2- 172.21.15.86:0/2681728337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3440ccc00 0x7fb34416b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 >> 172.21.15.86:0/2681728337 conn(0x7fb34406baa0 msgr2=0x7fb34406be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 shutdown_connections 2023-10-09T11:41:47.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.444+0000 7fb348b9d700 1 -- 172.21.15.86:0/2681728337 wait complete. 2023-10-09T11:41:47.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.642+0000 7f850df9d700 1 Processor -- start 2023-10-09T11:41:47.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.642+0000 7f850df9d700 1 -- start start 2023-10-09T11:41:47.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850df9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150180 0x7f8508157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850df9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f85080c7410 0x7f8508069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850df9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850806e2a0 con 0x7f8508150550 2023-10-09T11:41:47.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850df9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850806b2e0 con 0x7f85080c7410 2023-10-09T11:41:47.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850df9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c78e0 con 0x7f8508150180 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850cf9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150180 0x7f8508157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850cf9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150180 0x7f8508157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:51226/0 (socket says 172.21.15.86:51226) 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850cf9b700 1 -- 172.21.15.86:0/3088195918 learned_addr learned my addr 172.21.15.86:0/3088195918 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.644+0000 7f850d79c700 1 --2- 172.21.15.86:0/3088195918 >> v2:172.21.15.135:3300/0 conn(0x7f85080c7410 0x7f8508069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f85077fe700 1 -- 172.21.15.86:0/3088195918 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172639083 0 0) 0x7f850806e2a0 con 0x7f8508150550 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f85077fe700 1 -- 172.21.15.86:0/3088195918 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f8003570 con 0x7f8508150550 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f850d79c700 1 -- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150180 msgr2=0x7f8508157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f850d79c700 1 --2- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150180 0x7f8508157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f850d79c700 1 -- 172.21.15.86:0/3088195918 >> v1:172.21.15.135:6789/0 conn(0x7f8508150550 legacy=0x7f85080c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f850d79c700 1 -- 172.21.15.86:0/3088195918 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080c7bc0 con 0x7f85080c7410 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f850cf9b700 1 --2- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150180 0x7f8508157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f850d79c700 1 --2- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85080c7410 0x7f8508069f50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8500009cf0 tx=0x7f8500009590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f028ca5f4b5d2696 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.645+0000 7f85077fe700 1 -- 172.21.15.86:0/3088195918 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000b880 con 0x7f85080c7410 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f85077fe700 1 -- 172.21.15.86:0/3088195918 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850000b9e0 con 0x7f85080c7410 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f85077fe700 1 -- 172.21.15.86:0/3088195918 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000bda0 con 0x7f85080c7410 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 -- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85080c7410 msgr2=0x7f8508069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 --2- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85080c7410 0x7f8508069f50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8500009cf0 tx=0x7f8500009590 comp rx=0 tx=0).stop 2023-10-09T11:41:47.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 -- 172.21.15.86:0/3088195918 shutdown_connections 2023-10-09T11:41:47.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 --2- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150180 0x7f8508157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 --2- 172.21.15.86:0/3088195918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85080c7410 0x7f8508069f50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 -- 172.21.15.86:0/3088195918 >> 172.21.15.86:0/3088195918 conn(0x7f85080cc1f0 msgr2=0x7f85080cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 -- 172.21.15.86:0/3088195918 shutdown_connections 2023-10-09T11:41:47.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.646+0000 7f850df9d700 1 -- 172.21.15.86:0/3088195918 wait complete. 2023-10-09T11:41:47.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.648+0000 7f850df9d700 1 Processor -- start 2023-10-09T11:41:47.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.648+0000 7f850df9d700 1 -- start start 2023-10-09T11:41:47.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850df9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85080c7410 0x7f85080abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850df9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8508150180 0x7f850814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850df9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150550 0x7f85080c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850df9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080ac300 con 0x7f85080c7410 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850df9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080ac5e0 con 0x7f8508150180 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850df9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080ac8c0 con 0x7f8508150550 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85080c7410 0x7f85080abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85080c7410 0x7f85080abab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55680/0 (socket says 172.21.15.86:55680) 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 -- 172.21.15.86:0/2861606063 learned_addr learned my addr 172.21.15.86:0/2861606063 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f8507fff700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8508150180 0x7f850814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850d79c700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150550 0x7f85080c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 -- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150550 msgr2=0x7f85080c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150550 0x7f85080c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 -- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8508150180 msgr2=0x7f850814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8508150180 0x7f850814ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.649+0000 7f850cf9b700 1 -- 172.21.15.86:0/2861606063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc00b790 con 0x7f85080c7410 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.650+0000 7f850cf9b700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85080c7410 0x7f85080abab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00ed60 tx=0x7f84fc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.650+0000 7f8504ff9700 1 -- 172.21.15.86:0/2861606063 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00eec0 con 0x7f85080c7410 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.650+0000 7f8504ff9700 1 -- 172.21.15.86:0/2861606063 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc00dcd0 con 0x7f85080c7410 2023-10-09T11:41:47.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.650+0000 7f8504ff9700 1 -- 172.21.15.86:0/2861606063 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc010650 con 0x7f85080c7410 2023-10-09T11:41:47.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.650+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8500009830 con 0x7f85080c7410 2023-10-09T11:41:47.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.650+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85080ace80 con 0x7f85080c7410 2023-10-09T11:41:47.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.651+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850804c3c0 con 0x7f85080c7410 2023-10-09T11:41:47.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.652+0000 7f8504ff9700 1 -- 172.21.15.86:0/2861606063 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84fc010a40 con 0x7f85080c7410 2023-10-09T11:41:47.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.653+0000 7f8504ff9700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.653+0000 7f8504ff9700 1 -- 172.21.15.86:0/2861606063 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84fc084ca0 con 0x7f85080c7410 2023-10-09T11:41:47.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.653+0000 7f8507fff700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.654+0000 7f8507fff700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f850814f640 tx=0x7f84f4007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.657+0000 7f8504ff9700 1 -- 172.21.15.86:0/2861606063 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84fc051e70 con 0x7f85080c7410 2023-10-09T11:41:47.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.851+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85081570d0 con 0x7f85080c7410 2023-10-09T11:41:47.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.852+0000 7f8504ff9700 1 -- 172.21.15.86:0/2861606063 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f84fc01d090 con 0x7f85080c7410 2023-10-09T11:41:47.854 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:47.854 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f84ec066f30 msgr2=0x7f84ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f84ec066f30 0x7f84ec0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f850814f640 tx=0x7f84f4007d50 comp rx=0 tx=0).stop 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85080c7410 msgr2=0x7f85080abab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85080c7410 0x7f85080abab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00ed60 tx=0x7f84fc00b4f0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 shutdown_connections 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f84ec066f30 0x7f84ec0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85080c7410 0x7f85080abab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8508150550 0x7f85080c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 --2- 172.21.15.86:0/2861606063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8508150180 0x7f850814ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 >> 172.21.15.86:0/2861606063 conn(0x7f85080cc1f0 msgr2=0x7f85081562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 shutdown_connections 2023-10-09T11:41:47.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:47.855+0000 7f850df9d700 1 -- 172.21.15.86:0/2861606063 wait complete. 2023-10-09T11:41:47.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:09.500279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:10.496954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:47.875 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:48.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.057+0000 7f80f0fff700 1 Processor -- start 2023-10-09T11:41:48.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.057+0000 7f80f0fff700 1 -- start start 2023-10-09T11:41:48.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80f0fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 0x7f80ec0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80f0fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec15b0d0 con 0x7f80ec1568e0 2023-10-09T11:41:48.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80f0fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0c7a60 con 0x7f80ec0ccee0 2023-10-09T11:41:48.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80f0fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15a4c0 con 0x7f80ec0c83f0 2023-10-09T11:41:48.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80ead9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f80ec1568e0 0x7f80ec0ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53266/0 (socket says 172.21.15.86:53266) 2023-10-09T11:41:48.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80ead9d700 1 -- 172.21.15.86:0/3657922537 learned_addr learned my addr 172.21.15.86:0/3657922537 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:48.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80ea59c700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 0x7f80ec0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983639809 0 0) 0x7f80ec15b0d0 con 0x7f80ec1568e0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.059+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d8003570 con 0x7f80ec1568e0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339976724 0 0) 0x7f80ec0c7a60 con 0x7f80ec0ccee0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ec15b0d0 con 0x7f80ec0ccee0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3502144346 0 0) 0x7f80d8003570 con 0x7f80ec1568e0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 msgr2=0x7f80ec0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 0x7f80ec0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 >> v1:172.21.15.135:6789/0 conn(0x7f80ec0ccee0 legacy=0x7f80ec1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec15a7a0 con 0x7f80ec1568e0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f80e40017f0 con 0x7f80ec1568e0 2023-10-09T11:41:48.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 >> v1:172.21.15.86:6789/0 conn(0x7f80ec1568e0 legacy=0x7f80ec0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80d8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8004810 0x7f80d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 0x7f80d8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15a4c0 con 0x7f80d8003c20 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d800de00 con 0x7f80d8004810 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d800dfc0 con 0x7f80ec0c83f0 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80ea59c700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80d8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80ead9d700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 0x7f80d8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80e3fff700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8004810 0x7f80d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80ea59c700 1 -- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 msgr2=0x7f80d8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80ea59c700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0c83f0 0x7f80d8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80ea59c700 1 -- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8004810 msgr2=0x7f80d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.060+0000 7f80ea59c700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80d8004810 0x7f80d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80ea59c700 1 -- 172.21.15.86:0/3657922537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8003570 con 0x7f80d8003c20 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80ea59c700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80d8004010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009c00 tx=0x7f80dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3997530f157bf2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00e710 con 0x7f80d8003c20 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00e870 con 0x7f80d8003c20 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80e9d9b700 1 -- 172.21.15.86:0/3657922537 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00ec30 con 0x7f80d8003c20 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80f0fff700 1 -- 172.21.15.86:0/3657922537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 msgr2=0x7f80d8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80f0fff700 1 --2- 172.21.15.86:0/3657922537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80d8004010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009c00 tx=0x7f80dc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.061+0000 7f80ead9d700 1 -- 172.21.15.86:0/3657922537 reap_dead start 2023-10-09T11:41:48.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.062+0000 7f80f0fff700 1 -- 172.21.15.86:0/3657922537 shutdown_connections 2023-10-09T11:41:48.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.062+0000 7f80f0fff700 1 -- 172.21.15.86:0/3657922537 >> 172.21.15.86:0/3657922537 conn(0x7f80ec068e10 msgr2=0x7f80ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.062+0000 7f80f0fff700 1 -- 172.21.15.86:0/3657922537 shutdown_connections 2023-10-09T11:41:48.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.062+0000 7f80f0fff700 1 -- 172.21.15.86:0/3657922537 wait complete. 2023-10-09T11:41:48.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.063+0000 7f80f0fff700 1 Processor -- start 2023-10-09T11:41:48.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.063+0000 7f80f0fff700 1 -- start start 2023-10-09T11:41:48.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80f0fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80ec14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80f0fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0afe50 0x7f80ec0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80f0fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80ec0b0e10 0x7f80ec151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80f0fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0b1290 con 0x7f80d8003c20 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80f0fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec151e00 con 0x7f80ec0b0e10 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80f0fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec1520e0 con 0x7f80ec0afe50 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80ea59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80ec14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80ea59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80ec14ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55698/0 (socket says 172.21.15.86:55698) 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.064+0000 7f80ea59c700 1 -- 172.21.15.86:0/2243418616 learned_addr learned my addr 172.21.15.86:0/2243418616 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ead9d700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80ec0b0e10 0x7f80ec151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80e3fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0afe50 0x7f80ec0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ea59c700 1 -- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0afe50 msgr2=0x7f80ec0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ea59c700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0afe50 0x7f80ec0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ea59c700 1 -- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80ec0b0e10 msgr2=0x7f80ec151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ea59c700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80ec0b0e10 0x7f80ec151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ea59c700 1 -- 172.21.15.86:0/2243418616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0af370 con 0x7f80d8003c20 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ead9d700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80ec0b0e10 0x7f80ec151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80e3fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0afe50 0x7f80ec0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80ea59c700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80ec14ae80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e4b0 tx=0x7f80dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80e27fc700 1 -- 172.21.15.86:0/2243418616 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc022070 con 0x7f80d8003c20 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80e27fc700 1 -- 172.21.15.86:0/2243418616 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00e9e0 con 0x7f80d8003c20 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec0af650 con 0x7f80d8003c20 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80e27fc700 1 -- 172.21.15.86:0/2243418616 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc027470 con 0x7f80d8003c20 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.065+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec0b02a0 con 0x7f80d8003c20 2023-10-09T11:41:48.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.066+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec0afb70 con 0x7f80d8003c20 2023-10-09T11:41:48.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.067+0000 7f80e27fc700 1 -- 172.21.15.86:0/2243418616 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80dc01c450 con 0x7f80d8003c20 2023-10-09T11:41:48.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.068+0000 7f80e27fc700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f80cc066f30 0x7f80cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.068+0000 7f80e27fc700 1 -- 172.21.15.86:0/2243418616 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80dc086270 con 0x7f80d8003c20 2023-10-09T11:41:48.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.068+0000 7f80e3fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f80cc066f30 0x7f80cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.069+0000 7f80e3fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f80cc066f30 0x7f80cc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f80d4000c00 tx=0x7f80d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.072+0000 7f80e27fc700 1 -- 172.21.15.86:0/2243418616 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80ec0afb70 con 0x7f80d8003c20 2023-10-09T11:41:48.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.265+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80ec0afb70 con 0x7f80d8003c20 2023-10-09T11:41:48.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.266+0000 7f80e27fc700 1 -- 172.21.15.86:0/2243418616 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80ec0afb70 con 0x7f80d8003c20 2023-10-09T11:41:48.267 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:48.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f80cc066f30 msgr2=0x7f80cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f80cc066f30 0x7f80cc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f80d4000c00 tx=0x7f80d4009040 comp rx=0 tx=0).stop 2023-10-09T11:41:48.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 msgr2=0x7f80ec14ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80ec14ae80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e4b0 tx=0x7f80dc01a000 comp rx=0 tx=0).stop 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 shutdown_connections 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f80cc066f30 0x7f80cc0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8003c20 0x7f80ec14ae80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80ec0b0e10 0x7f80ec151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 --2- 172.21.15.86:0/2243418616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80ec0afe50 0x7f80ec0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 >> 172.21.15.86:0/2243418616 conn(0x7f80ec068e10 msgr2=0x7f80ec14bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 shutdown_connections 2023-10-09T11:41:48.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.268+0000 7f80f0fff700 1 -- 172.21.15.86:0/2243418616 wait complete. 2023-10-09T11:41:48.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:48.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.468+0000 7f360dfff700 1 Processor -- start 2023-10-09T11:41:48.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.468+0000 7f360dfff700 1 -- start start 2023-10-09T11:41:48.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.469+0000 7f360dfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f360815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.469+0000 7f360dfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f360815db10 0x7f3608069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.469+0000 7f360dfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360815a160 con 0x7f3608159890 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.469+0000 7f360dfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080d13a0 con 0x7f360815db10 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.469+0000 7f360dfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360815e140 con 0x7f3608159c60 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f3606ffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f360815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f3607fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f360815db10 0x7f3608069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f36077fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f3608159890 0x7f360815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:44172/0 (socket says 172.21.15.86:44172) 2023-10-09T11:41:48.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f36077fe700 1 -- 172.21.15.86:0/2709140827 learned_addr learned my addr 172.21.15.86:0/2709140827 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:48.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f36067fc700 1 -- 172.21.15.86:0/2709140827 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164578455 0 0) 0x7f360815a160 con 0x7f3608159890 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f36067fc700 1 -- 172.21.15.86:0/2709140827 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f0003570 con 0x7f3608159890 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f3607fff700 1 -- 172.21.15.86:0/2709140827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 msgr2=0x7f360815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f3607fff700 1 --2- 172.21.15.86:0/2709140827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f360815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f3607fff700 1 -- 172.21.15.86:0/2709140827 >> v1:172.21.15.135:6789/0 conn(0x7f3608159890 legacy=0x7f360815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.470+0000 7f3607fff700 1 -- 172.21.15.86:0/2709140827 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360815a3d0 con 0x7f360815db10 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.471+0000 7f3607fff700 1 --2- 172.21.15.86:0/2709140827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 0x7f3608069560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3600009e60 tx=0x7f3600009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5065b629499f3d90 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.471+0000 7f36067fc700 1 -- 172.21.15.86:0/2709140827 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000e070 con 0x7f360815db10 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.471+0000 7f36067fc700 1 -- 172.21.15.86:0/2709140827 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360000bab0 con 0x7f360815db10 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.471+0000 7f36067fc700 1 -- 172.21.15.86:0/2709140827 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000be70 con 0x7f360815db10 2023-10-09T11:41:48.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 -- 172.21.15.86:0/2709140827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 msgr2=0x7f3608069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 --2- 172.21.15.86:0/2709140827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 0x7f3608069560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3600009e60 tx=0x7f3600009780 comp rx=0 tx=0).stop 2023-10-09T11:41:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 -- 172.21.15.86:0/2709140827 shutdown_connections 2023-10-09T11:41:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 --2- 172.21.15.86:0/2709140827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 0x7f3608069560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 --2- 172.21.15.86:0/2709140827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f360815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 -- 172.21.15.86:0/2709140827 >> 172.21.15.86:0/2709140827 conn(0x7f3608068e20 msgr2=0x7f36080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 -- 172.21.15.86:0/2709140827 shutdown_connections 2023-10-09T11:41:48.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.472+0000 7f360dfff700 1 -- 172.21.15.86:0/2709140827 wait complete. 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.473+0000 7f360dfff700 1 Processor -- start 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.473+0000 7f360dfff700 1 -- start start 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f360dfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608159890 0x7f36080cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f360dfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f36080c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f360dfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 0x7f36080c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f360dfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360815bfb0 con 0x7f3608159890 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f360dfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360815caf0 con 0x7f360815db10 2023-10-09T11:41:48.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f360dfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3608151ec0 con 0x7f3608159c60 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f36077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608159890 0x7f36080cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f36077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608159890 0x7f36080cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55712/0 (socket says 172.21.15.86:55712) 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.474+0000 7f36077fe700 1 -- 172.21.15.86:0/2507866876 learned_addr learned my addr 172.21.15.86:0/2507866876 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f3607fff700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 0x7f36080c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f3606ffd700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f36080c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f36077fe700 1 -- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 msgr2=0x7f36080c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f36077fe700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f36080c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f36077fe700 1 -- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 msgr2=0x7f36080c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f36077fe700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 0x7f36080c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f36077fe700 1 -- 172.21.15.86:0/2507866876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600009a20 con 0x7f3608159890 2023-10-09T11:41:48.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f36077fe700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608159890 0x7f36080cfac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c7c0 tx=0x7f35f8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f35ef7fe700 1 -- 172.21.15.86:0/2507866876 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8005b30 con 0x7f3608159890 2023-10-09T11:41:48.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f35ef7fe700 1 -- 172.21.15.86:0/2507866876 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f8005c90 con 0x7f3608159890 2023-10-09T11:41:48.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f35ef7fe700 1 -- 172.21.15.86:0/2507866876 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8007340 con 0x7f3608159890 2023-10-09T11:41:48.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360815c1c0 con 0x7f3608159890 2023-10-09T11:41:48.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.475+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360815c780 con 0x7f3608159890 2023-10-09T11:41:48.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.476+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360804c3c0 con 0x7f3608159890 2023-10-09T11:41:48.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.477+0000 7f35ef7fe700 1 -- 172.21.15.86:0/2507866876 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35f801b400 con 0x7f3608159890 2023-10-09T11:41:48.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.478+0000 7f35ef7fe700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35f4066f60 0x7f35f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.478+0000 7f35ef7fe700 1 -- 172.21.15.86:0/2507866876 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35f8084070 con 0x7f3608159890 2023-10-09T11:41:48.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.478+0000 7f3606ffd700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35f4066f60 0x7f35f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.479+0000 7f3606ffd700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35f4066f60 0x7f35f4069410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f360815d320 tx=0x7f35fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.482+0000 7f35ef7fe700 1 -- 172.21.15.86:0/2507866876 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35f80512c0 con 0x7f3608159890 2023-10-09T11:41:48.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.670+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f360806a5b0 con 0x7f3608159890 2023-10-09T11:41:48.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.670+0000 7f35ef7fe700 1 -- 172.21.15.86:0/2507866876 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35f80548e0 con 0x7f3608159890 2023-10-09T11:41:48.672 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35f4066f60 msgr2=0x7f35f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35f4066f60 0x7f35f4069410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f360815d320 tx=0x7f35fc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608159890 msgr2=0x7f36080cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608159890 0x7f36080cfac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c7c0 tx=0x7f35f8007e00 comp rx=0 tx=0).stop 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 shutdown_connections 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f35f4066f60 0x7f35f4069410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608159890 0x7f36080cfac0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f360815db10 0x7f36080c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 --2- 172.21.15.86:0/2507866876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3608159c60 0x7f36080c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 >> 172.21.15.86:0/2507866876 conn(0x7f3608068e20 msgr2=0x7f36080b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 shutdown_connections 2023-10-09T11:41:48.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.673+0000 7f360dfff700 1 -- 172.21.15.86:0/2507866876 wait complete. 2023-10-09T11:41:48.691 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:48.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.873+0000 7f45c65ff700 1 Processor -- start 2023-10-09T11:41:48.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.873+0000 7f45c65ff700 1 -- start start 2023-10-09T11:41:48.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45c65ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45c0159890 0x7f45c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45c65ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45c0159c60 0x7f45c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45c65ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c015a160 con 0x7f45c015db10 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45c65ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c015df50 con 0x7f45c0159c60 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45c65ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00d13a0 con 0x7f45c0159890 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45bf7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45c0159c60 0x7f45c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45bf7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45c0159c60 0x7f45c015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55724/0 (socket says 172.21.15.86:55724) 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.874+0000 7f45bf7fe700 1 -- 172.21.15.86:0/2443913629 learned_addr learned my addr 172.21.15.86:0/2443913629 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45bffff700 1 --2- 172.21.15.86:0/2443913629 >> v2:172.21.15.135:3300/0 conn(0x7f45c0159890 0x7f45c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45bf7fe700 1 -- 172.21.15.86:0/2443913629 >> v2:172.21.15.135:3300/0 conn(0x7f45c0159890 msgr2=0x7f45c015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45bf7fe700 1 --2- 172.21.15.86:0/2443913629 >> v2:172.21.15.135:3300/0 conn(0x7f45c0159890 0x7f45c015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45bf7fe700 1 -- 172.21.15.86:0/2443913629 >> v1:172.21.15.135:6789/0 conn(0x7f45c015db10 legacy=0x7f45c0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45bf7fe700 1 -- 172.21.15.86:0/2443913629 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c015e140 con 0x7f45c0159c60 2023-10-09T11:41:48.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45bf7fe700 1 --2- 172.21.15.86:0/2443913629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c015d5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45c00d1090 tx=0x7f45b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace85729dfc66eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45beffd700 1 -- 172.21.15.86:0/2443913629 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400b820 con 0x7f45c0159c60 2023-10-09T11:41:48.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45beffd700 1 -- 172.21.15.86:0/2443913629 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400b980 con 0x7f45c0159c60 2023-10-09T11:41:48.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.875+0000 7f45beffd700 1 -- 172.21.15.86:0/2443913629 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400bd20 con 0x7f45c0159c60 2023-10-09T11:41:48.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 -- 172.21.15.86:0/2443913629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 msgr2=0x7f45c015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 --2- 172.21.15.86:0/2443913629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c015d5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45c00d1090 tx=0x7f45b4009250 comp rx=0 tx=0).stop 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 -- 172.21.15.86:0/2443913629 shutdown_connections 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 --2- 172.21.15.86:0/2443913629 >> v2:172.21.15.135:3300/0 conn(0x7f45c0159890 0x7f45c015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 --2- 172.21.15.86:0/2443913629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c015d5d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 -- 172.21.15.86:0/2443913629 >> 172.21.15.86:0/2443913629 conn(0x7f45c0068e20 msgr2=0x7f45c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 -- 172.21.15.86:0/2443913629 shutdown_connections 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.876+0000 7f45c65ff700 1 -- 172.21.15.86:0/2443913629 wait complete. 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.877+0000 7f45c65ff700 1 Processor -- start 2023-10-09T11:41:48.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.878+0000 7f45c65ff700 1 -- start start 2023-10-09T11:41:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.878+0000 7f45c65ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45c0159890 0x7f45c016a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.878+0000 7f45c65ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c00b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.878+0000 7f45c65ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45c015db10 0x7f45c00b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.878+0000 7f45c65ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c016b320 con 0x7f45c0159c60 2023-10-09T11:41:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.878+0000 7f45c65ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00b3830 con 0x7f45c0159890 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.878+0000 7f45c65ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c016a670 con 0x7f45c015db10 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c00b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c00b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55738/0 (socket says 172.21.15.86:55738) 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 -- 172.21.15.86:0/1298734742 learned_addr learned my addr 172.21.15.86:0/1298734742 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bffff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45c0159890 0x7f45c016a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45c4b9c700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45c015db10 0x7f45c00b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 -- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45c015db10 msgr2=0x7f45c00b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45c015db10 0x7f45c00b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 -- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45c0159890 msgr2=0x7f45c016a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45c0159890 0x7f45c016a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 -- 172.21.15.86:0/1298734742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40094f0 con 0x7f45c0159c60 2023-10-09T11:41:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.879+0000 7f45bf7fe700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c00b5ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009290 tx=0x7f45b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.880+0000 7f45a7fff700 1 -- 172.21.15.86:0/1298734742 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4011e20 con 0x7f45c0159c60 2023-10-09T11:41:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.880+0000 7f45a7fff700 1 -- 172.21.15.86:0/1298734742 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4020070 con 0x7f45c0159c60 2023-10-09T11:41:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.880+0000 7f45a7fff700 1 -- 172.21.15.86:0/1298734742 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b401b6a0 con 0x7f45c0159c60 2023-10-09T11:41:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.880+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c016a950 con 0x7f45c0159c60 2023-10-09T11:41:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.880+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c016af10 con 0x7f45c0159c60 2023-10-09T11:41:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.881+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c016b490 con 0x7f45c0159c60 2023-10-09T11:41:48.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.881+0000 7f45a7fff700 1 -- 172.21.15.86:0/1298734742 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45b4022030 con 0x7f45c0159c60 2023-10-09T11:41:48.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.882+0000 7f45a7fff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.882+0000 7f45a7fff700 1 -- 172.21.15.86:0/1298734742 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45b4086570 con 0x7f45c0159c60 2023-10-09T11:41:48.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.883+0000 7f45bffff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.883+0000 7f45bffff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f45ac066f30 0x7f45ac0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45b0006fd0 tx=0x7f45b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:48.886+0000 7f45a7fff700 1 -- 172.21.15.86:0/1298734742 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45b4053740 con 0x7f45c0159c60 2023-10-09T11:41:49.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.075+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45c016b460 con 0x7f45c0159c60 2023-10-09T11:41:49.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.076+0000 7f45a7fff700 1 -- 172.21.15.86:0/1298734742 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45b4056d60 con 0x7f45c0159c60 2023-10-09T11:41:49.077 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:41:49.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f45ac066f30 msgr2=0x7f45ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f45ac066f30 0x7f45ac0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45b0006fd0 tx=0x7f45b0008040 comp rx=0 tx=0).stop 2023-10-09T11:41:49.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 msgr2=0x7f45c00b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c00b5ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009290 tx=0x7f45b4016000 comp rx=0 tx=0).stop 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 shutdown_connections 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f45ac066f30 0x7f45ac0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45c015db10 0x7f45c00b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45c0159890 0x7f45c016a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 --2- 172.21.15.86:0/1298734742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45c0159c60 0x7f45c00b5ab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 >> 172.21.15.86:0/1298734742 conn(0x7f45c0068e20 msgr2=0x7f45c0153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 shutdown_connections 2023-10-09T11:41:49.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.078+0000 7f45c65ff700 1 -- 172.21.15.86:0/1298734742 wait complete. 2023-10-09T11:41:49.121 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-10-09T11:41:49.121 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T11:41:49.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-09T11:41:49.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.301+0000 7f5a0bfff700 1 Processor -- start 2023-10-09T11:41:49.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.301+0000 7f5a0bfff700 1 -- start start 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a0c159420 0x7f5a0c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a0c1597f0 0x7f5a0c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c15d230 0x7f5a0c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0bfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c15dbb0 con 0x7f5a0c1597f0 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c0b11d0 con 0x7f5a0c159420 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0b14b0 con 0x7f5a0c15d230 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0a7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a0c1597f0 0x7f5a0c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0a7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a0c1597f0 0x7f5a0c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55754/0 (socket says 172.21.15.86:55754) 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.302+0000 7f5a0a7fc700 1 -- 172.21.15.86:0/1147876333 learned_addr learned my addr 172.21.15.86:0/1147876333 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0b7fe700 1 --2- 172.21.15.86:0/1147876333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c15d230 0x7f5a0c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0affd700 1 --2- 172.21.15.86:0/1147876333 >> v2:172.21.15.135:3300/0 conn(0x7f5a0c159420 0x7f5a0c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0a7fc700 1 -- 172.21.15.86:0/1147876333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c15d230 msgr2=0x7f5a0c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0a7fc700 1 --2- 172.21.15.86:0/1147876333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c15d230 0x7f5a0c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0a7fc700 1 -- 172.21.15.86:0/1147876333 >> v2:172.21.15.135:3300/0 conn(0x7f5a0c159420 msgr2=0x7f5a0c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0a7fc700 1 --2- 172.21.15.86:0/1147876333 >> v2:172.21.15.135:3300/0 conn(0x7f5a0c159420 0x7f5a0c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0a7fc700 1 -- 172.21.15.86:0/1147876333 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c0b1790 con 0x7f5a0c1597f0 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a0a7fc700 1 --2- 172.21.15.86:0/1147876333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c1597f0 0x7f5a0c0b2270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0b2f20 tx=0x7f5a00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55e02cf68a07a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a09ffb700 1 -- 172.21.15.86:0/1147876333 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000b860 con 0x7f5a0c1597f0 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a09ffb700 1 -- 172.21.15.86:0/1147876333 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0000b9c0 con 0x7f5a0c1597f0 2023-10-09T11:41:49.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.303+0000 7f5a09ffb700 1 -- 172.21.15.86:0/1147876333 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000bd60 con 0x7f5a0c1597f0 2023-10-09T11:41:49.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 -- 172.21.15.86:0/1147876333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c1597f0 msgr2=0x7f5a0c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/1147876333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c1597f0 0x7f5a0c0b2270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0b2f20 tx=0x7f5a00009250 comp rx=0 tx=0).stop 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 -- 172.21.15.86:0/1147876333 shutdown_connections 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/1147876333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c15d230 0x7f5a0c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/1147876333 >> v2:172.21.15.135:3300/0 conn(0x7f5a0c159420 0x7f5a0c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/1147876333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c1597f0 0x7f5a0c0b2270 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 -- 172.21.15.86:0/1147876333 >> 172.21.15.86:0/1147876333 conn(0x7f5a0c0d0660 msgr2=0x7f5a0c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 -- 172.21.15.86:0/1147876333 shutdown_connections 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.304+0000 7f5a0bfff700 1 -- 172.21.15.86:0/1147876333 wait complete. 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.305+0000 7f5a0bfff700 1 Processor -- start 2023-10-09T11:41:49.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.306+0000 7f5a0bfff700 1 -- start start 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.306+0000 7f5a0bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c159420 0x7f5a0c13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.306+0000 7f5a0bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0c1597f0 0x7f5a0c16a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.306+0000 7f5a0bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c15d230 0x7f5a0c16cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.306+0000 7f5a0bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c16de10 con 0x7f5a0c15d230 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.306+0000 7f5a0bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c151e80 con 0x7f5a0c1597f0 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.306+0000 7f5a0bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c151b70 con 0x7f5a0c159420 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c15d230 0x7f5a0c16cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c15d230 0x7f5a0c16cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55756/0 (socket says 172.21.15.86:55756) 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 -- 172.21.15.86:0/3561583680 learned_addr learned my addr 172.21.15.86:0/3561583680 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0a7fc700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0c1597f0 0x7f5a0c16a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0affd700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c159420 0x7f5a0c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 -- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c159420 msgr2=0x7f5a0c13dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c159420 0x7f5a0c13dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 -- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0c1597f0 msgr2=0x7f5a0c16a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0c1597f0 0x7f5a0c16a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 -- 172.21.15.86:0/3561583680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000094f0 con 0x7f5a0c15d230 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0affd700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c159420 0x7f5a0c13dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f5a0b7fe700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c15d230 0x7f5a0c16cee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007f20 tx=0x7f5a04009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.307+0000 7f59f2ffd700 1 -- 172.21.15.86:0/3561583680 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400eca0 con 0x7f5a0c15d230 2023-10-09T11:41:49.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.308+0000 7f59f2ffd700 1 -- 172.21.15.86:0/3561583680 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0400ee20 con 0x7f5a0c15d230 2023-10-09T11:41:49.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.308+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0c16d570 con 0x7f5a0c15d230 2023-10-09T11:41:49.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.308+0000 7f59f2ffd700 1 -- 172.21.15.86:0/3561583680 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04014670 con 0x7f5a0c15d230 2023-10-09T11:41:49.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.308+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0c16db30 con 0x7f5a0c15d230 2023-10-09T11:41:49.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.309+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0c152030 con 0x7f5a0c15d230 2023-10-09T11:41:49.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.309+0000 7f59f2ffd700 1 -- 172.21.15.86:0/3561583680 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a040149e0 con 0x7f5a0c15d230 2023-10-09T11:41:49.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.310+0000 7f59f2ffd700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f59f8066f30 0x7f59f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.310+0000 7f59f2ffd700 1 -- 172.21.15.86:0/3561583680 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a04084d00 con 0x7f5a0c15d230 2023-10-09T11:41:49.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.311+0000 7f5a0affd700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f59f8066f30 0x7f59f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.311+0000 7f5a0affd700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f59f8066f30 0x7f59f80693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59fc006fd0 tx=0x7f59fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.314+0000 7f59f2ffd700 1 -- 172.21.15.86:0/3561583680 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a0c152030 con 0x7f5a0c15d230 2023-10-09T11:41:49.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:49.578+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f5a0c152030 con 0x7f5a0c15d230 2023-10-09T11:41:50.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.204+0000 7f59f2ffd700 1 -- 172.21.15.86:0/3561583680 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5a0c152030 con 0x7f5a0c15d230 2023-10-09T11:41:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f59f8066f30 msgr2=0x7f59f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f59f8066f30 0x7f59f80693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59fc006fd0 tx=0x7f59fc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c15d230 msgr2=0x7f5a0c16cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c15d230 0x7f5a0c16cee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007f20 tx=0x7f5a04009860 comp rx=0 tx=0).stop 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 shutdown_connections 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f59f8066f30 0x7f59f80693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a0c15d230 0x7f5a0c16cee0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a0c159420 0x7f5a0c13dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 --2- 172.21.15.86:0/3561583680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a0c1597f0 0x7f5a0c16a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 >> 172.21.15.86:0/3561583680 conn(0x7f5a0c0d0660 msgr2=0x7f5a0c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 shutdown_connections 2023-10-09T11:41:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.207+0000 7f5a0bfff700 1 -- 172.21.15.86:0/3561583680 wait complete. 2023-10-09T11:41:50.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:41:50.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.411+0000 7fd10bfff700 1 Processor -- start 2023-10-09T11:41:50.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.411+0000 7fd10bfff700 1 -- start start 2023-10-09T11:41:50.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.411+0000 7fd10bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd10c0b4e70 0x7fd10c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.411+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b1b40 0x7fd10c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.411+0000 7fd10bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c0cfb00 con 0x7fd10c0b16d0 2023-10-09T11:41:50.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.411+0000 7fd10bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c0b5c40 con 0x7fd10c0b4e70 2023-10-09T11:41:50.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.411+0000 7fd10bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0b5f20 con 0x7fd10c0b1b40 2023-10-09T11:41:50.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b1b40 0x7fd10c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b1b40 0x7fd10c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:51330/0 (socket says 172.21.15.86:51330) 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 -- 172.21.15.86:0/363850943 learned_addr learned my addr 172.21.15.86:0/363850943 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10a7fc700 1 --1- 172.21.15.86:0/363850943 >> v1:172.21.15.135:6789/0 conn(0x7fd10c0b16d0 0x7fd10c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:44186/0 (socket says 172.21.15.86:44186) 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10affd700 1 --2- 172.21.15.86:0/363850943 >> v2:172.21.15.135:3300/0 conn(0x7fd10c0b4e70 0x7fd10c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 -- 172.21.15.86:0/363850943 >> v2:172.21.15.135:3300/0 conn(0x7fd10c0b4e70 msgr2=0x7fd10c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 --2- 172.21.15.86:0/363850943 >> v2:172.21.15.135:3300/0 conn(0x7fd10c0b4e70 0x7fd10c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 -- 172.21.15.86:0/363850943 >> v1:172.21.15.135:6789/0 conn(0x7fd10c0b16d0 legacy=0x7fd10c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd109ffb700 1 -- 172.21.15.86:0/363850943 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731456248 0 0) 0x7fd10c0cfb00 con 0x7fd10c0b16d0 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 -- 172.21.15.86:0/363850943 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c0b6200 con 0x7fd10c0b1b40 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.412+0000 7fd10b7fe700 1 --2- 172.21.15.86:0/363850943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b1b40 0x7fd10c15d950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd104009f20 tx=0x7fd104009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc08cadf7a72a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.413+0000 7fd109ffb700 1 -- 172.21.15.86:0/363850943 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10400e070 con 0x7fd10c0b1b40 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.413+0000 7fd109ffb700 1 -- 172.21.15.86:0/363850943 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10400b9d0 con 0x7fd10c0b1b40 2023-10-09T11:41:50.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.413+0000 7fd109ffb700 1 -- 172.21.15.86:0/363850943 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040092e0 con 0x7fd10c0b1b40 2023-10-09T11:41:50.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 -- 172.21.15.86:0/363850943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b1b40 msgr2=0x7fd10c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 --2- 172.21.15.86:0/363850943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b1b40 0x7fd10c15d950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd104009f20 tx=0x7fd104009840 comp rx=0 tx=0).stop 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 -- 172.21.15.86:0/363850943 shutdown_connections 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 --2- 172.21.15.86:0/363850943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b1b40 0x7fd10c15d950 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 --2- 172.21.15.86:0/363850943 >> v2:172.21.15.135:3300/0 conn(0x7fd10c0b4e70 0x7fd10c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 -- 172.21.15.86:0/363850943 >> 172.21.15.86:0/363850943 conn(0x7fd10c0d10c0 msgr2=0x7fd10c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 -- 172.21.15.86:0/363850943 shutdown_connections 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.414+0000 7fd10bfff700 1 -- 172.21.15.86:0/363850943 wait complete. 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.415+0000 7fd10bfff700 1 Processor -- start 2023-10-09T11:41:50.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.415+0000 7fd10bfff700 1 -- start start 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c0b16d0 0x7fd10c169850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0b1b40 0x7fd10c14af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b4e70 0x7fd10c15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0cc760 con 0x7fd10c0b1b40 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c169d90 con 0x7fd10c0b16d0 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0cc1a0 con 0x7fd10c0b4e70 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0b1b40 0x7fd10c14af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0b1b40 0x7fd10c14af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55772/0 (socket says 172.21.15.86:55772) 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.416+0000 7fd10a7fc700 1 -- 172.21.15.86:0/3232544918 learned_addr learned my addr 172.21.15.86:0/3232544918 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:50.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10b7fe700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b4e70 0x7fd10c15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10affd700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c0b16d0 0x7fd10c169850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10a7fc700 1 -- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b4e70 msgr2=0x7fd10c15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10a7fc700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b4e70 0x7fd10c15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10a7fc700 1 -- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c0b16d0 msgr2=0x7fd10c169850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10a7fc700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c0b16d0 0x7fd10c169850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10a7fc700 1 -- 172.21.15.86:0/3232544918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104009ae0 con 0x7fd10c0b1b40 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10a7fc700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0b1b40 0x7fd10c14af90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c5b0 tx=0x7fd100001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd0f2ffd700 1 -- 172.21.15.86:0/3232544918 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100005a70 con 0x7fd10c0b1b40 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd0f2ffd700 1 -- 172.21.15.86:0/3232544918 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100005bd0 con 0x7fd10c0b1b40 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd0f2ffd700 1 -- 172.21.15.86:0/3232544918 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000070d0 con 0x7fd10c0b1b40 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.417+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c0cc480 con 0x7fd10c0b1b40 2023-10-09T11:41:50.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.418+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c0c7790 con 0x7fd10c0b1b40 2023-10-09T11:41:50.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.419+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0c7310 con 0x7fd10c0b1b40 2023-10-09T11:41:50.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.419+0000 7fd0f2ffd700 1 -- 172.21.15.86:0/3232544918 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd100007480 con 0x7fd10c0b1b40 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.420+0000 7fd0f2ffd700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.421+0000 7fd0f2ffd700 1 -- 172.21.15.86:0/3232544918 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd100083980 con 0x7fd10c0b1b40 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.421+0000 7fd10affd700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.421+0000 7fd10affd700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd0f8066f30 0x7fd0f80693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009db0 tx=0x7fd0fc0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.424+0000 7fd0f2ffd700 1 -- 172.21.15.86:0/3232544918 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd10c0c7310 con 0x7fd10c0b1b40 2023-10-09T11:41:50.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.616+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd10c0c7310 con 0x7fd10c0b1b40 2023-10-09T11:41:50.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.622+0000 7fd0f2ffd700 1 -- 172.21.15.86:0/3232544918 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd10c0c7310 con 0x7fd10c0b1b40 2023-10-09T11:41:50.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd0f8066f30 msgr2=0x7fd0f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd0f8066f30 0x7fd0f80693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009db0 tx=0x7fd0fc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0b1b40 msgr2=0x7fd10c14af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0b1b40 0x7fd10c14af90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c5b0 tx=0x7fd100001040 comp rx=0 tx=0).stop 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 shutdown_connections 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd0f8066f30 0x7fd0f80693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd10c0b4e70 0x7fd10c15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c0b16d0 0x7fd10c169850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 --2- 172.21.15.86:0/3232544918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0b1b40 0x7fd10c14af90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 >> 172.21.15.86:0/3232544918 conn(0x7fd10c0d10c0 msgr2=0x7fd10c0ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 shutdown_connections 2023-10-09T11:41:50.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:50.624+0000 7fd10bfff700 1 -- 172.21.15.86:0/3232544918 wait complete. 2023-10-09T11:41:50.644 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:50.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:50.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:50.813 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:50.813 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:41:50.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:50.814 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-09T11:41:50.904 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:41:50.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:50.904 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:41:50.950 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:41:50.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:50.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-09T11:41:51.054 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:41:51.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.054 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:41:51.102 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-09T11:41:51.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:51.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-09T11:41:51.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:41:51.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.178 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T11:41:51.216 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-09T11:41:51.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:51.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-09T11:41:51.291 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T11:41:51.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.291 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T11:41:51.328 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:41:51.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:51.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.508+0000 7f7a5759e700 1 Processor -- start 2023-10-09T11:41:51.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.508+0000 7f7a5759e700 1 -- start start 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a58150180 0x7f7a58157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150550 0x7f7a580c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5806e2a0 con 0x7f7a580c7240 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a580c76c0 con 0x7f7a58150180 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5806b2e0 con 0x7f7a58150550 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a58150180 0x7f7a58157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a58150180 0x7f7a58157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55782/0 (socket says 172.21.15.86:55782) 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.509+0000 7f7a5659c700 1 -- 172.21.15.86:0/1838710391 learned_addr learned my addr 172.21.15.86:0/1838710391 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:51.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a55d9b700 1 --2- 172.21.15.86:0/1838710391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150550 0x7f7a580c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5659c700 1 -- 172.21.15.86:0/1838710391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150550 msgr2=0x7f7a580c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5659c700 1 --2- 172.21.15.86:0/1838710391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150550 0x7f7a580c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5659c700 1 -- 172.21.15.86:0/1838710391 >> v1:172.21.15.135:6789/0 conn(0x7f7a580c7240 legacy=0x7f7a58069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5659c700 1 -- 172.21.15.86:0/1838710391 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580c78e0 con 0x7f7a58150180 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5659c700 1 --2- 172.21.15.86:0/1838710391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58150180 0x7f7a58157770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800bc70 tx=0x7f7a4800b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8cec3b319f7f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5559a700 1 -- 172.21.15.86:0/1838710391 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800be80 con 0x7f7a58150180 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5559a700 1 -- 172.21.15.86:0/1838710391 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4800dcb0 con 0x7f7a58150180 2023-10-09T11:41:51.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.510+0000 7f7a5559a700 1 -- 172.21.15.86:0/1838710391 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48017620 con 0x7f7a58150180 2023-10-09T11:41:51.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 -- 172.21.15.86:0/1838710391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58150180 msgr2=0x7f7a58157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 --2- 172.21.15.86:0/1838710391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58150180 0x7f7a58157770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800bc70 tx=0x7f7a4800b4e0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 -- 172.21.15.86:0/1838710391 shutdown_connections 2023-10-09T11:41:51.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 --2- 172.21.15.86:0/1838710391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58150180 0x7f7a58157770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 --2- 172.21.15.86:0/1838710391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150550 0x7f7a580c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 -- 172.21.15.86:0/1838710391 >> 172.21.15.86:0/1838710391 conn(0x7f7a580cc1f0 msgr2=0x7f7a580cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:51.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 -- 172.21.15.86:0/1838710391 shutdown_connections 2023-10-09T11:41:51.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.511+0000 7f7a5759e700 1 -- 172.21.15.86:0/1838710391 wait complete. 2023-10-09T11:41:51.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.512+0000 7f7a5759e700 1 Processor -- start 2023-10-09T11:41:51.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.513+0000 7f7a5759e700 1 -- start start 2023-10-09T11:41:51.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.513+0000 7f7a5759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c7240 0x7f7a580c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150180 0x7f7a58148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a58150550 0x7f7a580c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580ade10 con 0x7f7a580c7240 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580ae0f0 con 0x7f7a58150550 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580ae3d0 con 0x7f7a58150180 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c7240 0x7f7a580c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c7240 0x7f7a580c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55784/0 (socket says 172.21.15.86:55784) 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 -- 172.21.15.86:0/4088164363 learned_addr learned my addr 172.21.15.86:0/4088164363 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a55d9b700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150180 0x7f7a58148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a56d9d700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a58150550 0x7f7a580c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 -- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150180 msgr2=0x7f7a58148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150180 0x7f7a58148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 -- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a58150550 msgr2=0x7f7a580c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a58150550 0x7f7a580c1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 -- 172.21.15.86:0/4088164363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4800b780 con 0x7f7a580c7240 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a56d9d700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a58150550 0x7f7a580c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.514+0000 7f7a5659c700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c7240 0x7f7a580c4a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a5806fe40 tx=0x7f7a48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.515+0000 7f7a467fc700 1 -- 172.21.15.86:0/4088164363 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48021660 con 0x7f7a580c7240 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.515+0000 7f7a467fc700 1 -- 172.21.15.86:0/4088164363 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480217c0 con 0x7f7a580c7240 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.515+0000 7f7a467fc700 1 -- 172.21.15.86:0/4088164363 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48021b80 con 0x7f7a580c7240 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.515+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a580ae6b0 con 0x7f7a580c7240 2023-10-09T11:41:51.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.515+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a580c33a0 con 0x7f7a580c7240 2023-10-09T11:41:51.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.516+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5804c3c0 con 0x7f7a580c7240 2023-10-09T11:41:51.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.517+0000 7f7a467fc700 1 -- 172.21.15.86:0/4088164363 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a48015070 con 0x7f7a580c7240 2023-10-09T11:41:51.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.518+0000 7f7a467fc700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7a38066f30 0x7f7a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.518+0000 7f7a467fc700 1 -- 172.21.15.86:0/4088164363 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a480882b0 con 0x7f7a580c7240 2023-10-09T11:41:51.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.518+0000 7f7a55d9b700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7a38066f30 0x7f7a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.518+0000 7f7a55d9b700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7a38066f30 0x7f7a380693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a58155dc0 tx=0x7f7a4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.522+0000 7f7a467fc700 1 -- 172.21.15.86:0/4088164363 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a48055520 con 0x7f7a580c7240 2023-10-09T11:41:51.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.754+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a580abe80 con 0x7f7a580c7240 2023-10-09T11:41:51.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.755+0000 7f7a467fc700 1 -- 172.21.15.86:0/4088164363 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f7a4805e030 con 0x7f7a580c7240 2023-10-09T11:41:51.755 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:51.755 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7a38066f30 msgr2=0x7f7a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7a38066f30 0x7f7a380693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a58155dc0 tx=0x7f7a4c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c7240 msgr2=0x7f7a580c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c7240 0x7f7a580c4a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a5806fe40 tx=0x7f7a48019000 comp rx=0 tx=0).stop 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 shutdown_connections 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7a38066f30 0x7f7a380693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c7240 0x7f7a580c4a40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a58150550 0x7f7a580c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 --2- 172.21.15.86:0/4088164363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a58150180 0x7f7a58148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 >> 172.21.15.86:0/4088164363 conn(0x7f7a580cc1f0 msgr2=0x7f7a580c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:51.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 shutdown_connections 2023-10-09T11:41:51.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.757+0000 7f7a5759e700 1 -- 172.21.15.86:0/4088164363 wait complete. 2023-10-09T11:41:51.759 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:51.775 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:51.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.955+0000 7fd9eeb9d700 1 Processor -- start 2023-10-09T11:41:51.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.955+0000 7fd9eeb9d700 1 -- start start 2023-10-09T11:41:51.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.956+0000 7fd9eeb9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9e8159420 0x7fd9e80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.956+0000 7fd9eeb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e815d230 0x7fd9e815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.956+0000 7fd9eeb9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80b2980 con 0x7fd9e81597f0 2023-10-09T11:41:51.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.956+0000 7fd9eeb9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e815dbb0 con 0x7fd9e8159420 2023-10-09T11:41:51.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.956+0000 7fd9eeb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80b11d0 con 0x7fd9e815d230 2023-10-09T11:41:51.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.956+0000 7fd9edb9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9e8159420 0x7fd9e80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9ed39a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd9e81597f0 0x7fd9e80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53280/0 (socket says 172.21.15.86:53280) 2023-10-09T11:41:51.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9edb9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9e8159420 0x7fd9e80b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55792/0 (socket says 172.21.15.86:55792) 2023-10-09T11:41:51.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9ed39a700 1 -- 172.21.15.86:0/2174729049 learned_addr learned my addr 172.21.15.86:0/2174729049 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:51.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9ee39c700 1 --2- 172.21.15.86:0/2174729049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e815d230 0x7fd9e815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9edb9b700 1 -- 172.21.15.86:0/2174729049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e815d230 msgr2=0x7fd9e815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:51.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9edb9b700 1 --2- 172.21.15.86:0/2174729049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e815d230 0x7fd9e815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9edb9b700 1 -- 172.21.15.86:0/2174729049 >> v1:172.21.15.86:6789/0 conn(0x7fd9e81597f0 legacy=0x7fd9e80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9edb9b700 1 -- 172.21.15.86:0/2174729049 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80b14b0 con 0x7fd9e8159420 2023-10-09T11:41:51.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.957+0000 7fd9ee39c700 1 --2- 172.21.15.86:0/2174729049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e815d230 0x7fd9e815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9edb9b700 1 --2- 172.21.15.86:0/2174729049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8159420 0x7fd9e80b5f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40098e0 tx=0x7fd9e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84474b9138495e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9ecb99700 1 -- 172.21.15.86:0/2174729049 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4009e80 con 0x7fd9e8159420 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9ecb99700 1 -- 172.21.15.86:0/2174729049 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e400b860 con 0x7fd9e8159420 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9ecb99700 1 -- 172.21.15.86:0/2174729049 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400bbe0 con 0x7fd9e8159420 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/2174729049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8159420 msgr2=0x7fd9e80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/2174729049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8159420 0x7fd9e80b5f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40098e0 tx=0x7fd9e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/2174729049 shutdown_connections 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/2174729049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e815d230 0x7fd9e815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/2174729049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8159420 0x7fd9e80b5f40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.958+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/2174729049 >> 172.21.15.86:0/2174729049 conn(0x7fd9e80d0660 msgr2=0x7fd9e80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.959+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/2174729049 shutdown_connections 2023-10-09T11:41:51.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.959+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/2174729049 wait complete. 2023-10-09T11:41:51.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.960+0000 7fd9eeb9d700 1 Processor -- start 2023-10-09T11:41:51.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.960+0000 7fd9eeb9d700 1 -- start start 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9eeb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e8159420 0x7fd9e81543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9eeb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e81597f0 0x7fd9e80695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9eeb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e815d230 0x7fd9e81535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9eeb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8069af0 con 0x7fd9e815d230 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9eeb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8154b20 con 0x7fd9e81597f0 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9eeb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8154dc0 con 0x7fd9e8159420 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9ee39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e815d230 0x7fd9e81535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9ee39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e815d230 0x7fd9e81535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55798/0 (socket says 172.21.15.86:55798) 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9ee39c700 1 -- 172.21.15.86:0/478698317 learned_addr learned my addr 172.21.15.86:0/478698317 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:51.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.961+0000 7fd9edb9b700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e8159420 0x7fd9e81543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ed39a700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e81597f0 0x7fd9e80695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ee39c700 1 -- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e8159420 msgr2=0x7fd9e81543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ee39c700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e8159420 0x7fd9e81543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ee39c700 1 -- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e81597f0 msgr2=0x7fd9e80695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ee39c700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e81597f0 0x7fd9e80695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ee39c700 1 -- 172.21.15.86:0/478698317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4009420 con 0x7fd9e815d230 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9edb9b700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e8159420 0x7fd9e81543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ee39c700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e815d230 0x7fd9e81535e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009fc0 tx=0x7fd9e00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ddffb700 1 -- 172.21.15.86:0/478698317 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000dd40 con 0x7fd9e815d230 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ddffb700 1 -- 172.21.15.86:0/478698317 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000f040 con 0x7fd9e815d230 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e81550a0 con 0x7fd9e815d230 2023-10-09T11:41:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9ddffb700 1 -- 172.21.15.86:0/478698317 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0015690 con 0x7fd9e815d230 2023-10-09T11:41:51.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.962+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e8155660 con 0x7fd9e815d230 2023-10-09T11:41:51.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.963+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e804c3c0 con 0x7fd9e815d230 2023-10-09T11:41:51.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.964+0000 7fd9ddffb700 1 -- 172.21.15.86:0/478698317 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9e001e3b0 con 0x7fd9e815d230 2023-10-09T11:41:51.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.965+0000 7fd9ddffb700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.965+0000 7fd9ddffb700 1 -- 172.21.15.86:0/478698317 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9e0084a80 con 0x7fd9e815d230 2023-10-09T11:41:51.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.965+0000 7fd9edb9b700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.966+0000 7fd9edb9b700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9cc066f30 0x7fd9cc0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40091e0 tx=0x7fd9e4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:51.969+0000 7fd9ddffb700 1 -- 172.21.15.86:0/478698317 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9e0051cf0 con 0x7fd9e815d230 2023-10-09T11:41:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.169+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9e80b1790 con 0x7fd9e815d230 2023-10-09T11:41:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.170+0000 7fd9ddffb700 1 -- 172.21.15.86:0/478698317 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd9e001a090 con 0x7fd9e815d230 2023-10-09T11:41:52.171 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:52.171 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":22,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:13.033731+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9cc066f30 msgr2=0x7fd9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9cc066f30 0x7fd9cc0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40091e0 tx=0x7fd9e4017000 comp rx=0 tx=0).stop 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e815d230 msgr2=0x7fd9e81535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e815d230 0x7fd9e81535e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009fc0 tx=0x7fd9e00099b0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 shutdown_connections 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e815d230 0x7fd9e81535e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e8159420 0x7fd9e81543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 --2- 172.21.15.86:0/478698317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e81597f0 0x7fd9e80695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.172+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 >> 172.21.15.86:0/478698317 conn(0x7fd9e80d0660 msgr2=0x7fd9e8156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.173+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 shutdown_connections 2023-10-09T11:41:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.173+0000 7fd9eeb9d700 1 -- 172.21.15.86:0/478698317 wait complete. 2023-10-09T11:41:52.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:09.500279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:10.496954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:52.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:52.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.375+0000 7f7c7f1ff700 1 Processor -- start 2023-10-09T11:41:52.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.375+0000 7f7c7f1ff700 1 -- start start 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.376+0000 7f7c7f1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c78155eb0 0x7f7c7806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.376+0000 7f7c7f1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c78069e80 0x7f7c780ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.376+0000 7f7c7f1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7806eb90 con 0x7f7c780c70b0 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.376+0000 7f7c7f1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7806ee70 con 0x7f7c78155eb0 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.376+0000 7f7c7f1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7806f150 con 0x7f7c78069e80 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c7cf9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c78155eb0 0x7f7c7806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c77fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7c780c70b0 0x7f7c78069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53282/0 (socket says 172.21.15.86:53282) 2023-10-09T11:41:52.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c77fff700 1 -- 172.21.15.86:0/576647358 learned_addr learned my addr 172.21.15.86:0/576647358 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:52.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c7d79c700 1 --2- 172.21.15.86:0/576647358 >> v2:172.21.15.135:3300/0 conn(0x7f7c78069e80 0x7f7c780ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c7cf9b700 1 -- 172.21.15.86:0/576647358 >> v2:172.21.15.135:3300/0 conn(0x7f7c78069e80 msgr2=0x7f7c780ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:52.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c7cf9b700 1 --2- 172.21.15.86:0/576647358 >> v2:172.21.15.135:3300/0 conn(0x7f7c78069e80 0x7f7c780ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c7cf9b700 1 -- 172.21.15.86:0/576647358 >> v1:172.21.15.86:6789/0 conn(0x7f7c780c70b0 legacy=0x7f7c78069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c777fe700 1 -- 172.21.15.86:0/576647358 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327486676 0 0) 0x7f7c7806eb90 con 0x7f7c780c70b0 2023-10-09T11:41:52.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c7cf9b700 1 -- 172.21.15.86:0/576647358 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7806f430 con 0x7f7c78155eb0 2023-10-09T11:41:52.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.377+0000 7f7c7cf9b700 1 --2- 172.21.15.86:0/576647358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c7806e240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806d270 tx=0x7f7c6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ca30ad375be93e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c777fe700 1 -- 172.21.15.86:0/576647358 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00b6b0 con 0x7f7c78155eb0 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c777fe700 1 -- 172.21.15.86:0/576647358 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00b810 con 0x7f7c78155eb0 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c777fe700 1 -- 172.21.15.86:0/576647358 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00bbb0 con 0x7f7c78155eb0 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/576647358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 msgr2=0x7f7c7806e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/576647358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c7806e240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806d270 tx=0x7f7c6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/576647358 shutdown_connections 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/576647358 >> v2:172.21.15.135:3300/0 conn(0x7f7c78069e80 0x7f7c780ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/576647358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c7806e240 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/576647358 >> 172.21.15.86:0/576647358 conn(0x7f7c78068e10 msgr2=0x7f7c780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/576647358 shutdown_connections 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.378+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/576647358 wait complete. 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.380+0000 7f7c7f1ff700 1 Processor -- start 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.380+0000 7f7c7f1ff700 1 -- start start 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c78069e80 0x7f7c780abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c780c70b0 0x7f7c780c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7f1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c78153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7f1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780acb60 con 0x7f7c78155eb0 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780ac060 con 0x7f7c78069e80 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780ac2c0 con 0x7f7c780c70b0 2023-10-09T11:41:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c78153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c78153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55826/0 (socket says 172.21.15.86:55826) 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 -- 172.21.15.86:0/479520281 learned_addr learned my addr 172.21.15.86:0/479520281 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7cf9b700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c78069e80 0x7f7c780abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c77fff700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c780c70b0 0x7f7c780c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 -- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c780c70b0 msgr2=0x7f7c780c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c780c70b0 0x7f7c780c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 -- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c78069e80 msgr2=0x7f7c780abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c78069e80 0x7f7c780abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.381+0000 7f7c7d79c700 1 -- 172.21.15.86:0/479520281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c009420 con 0x7f7c78155eb0 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.382+0000 7f7c7d79c700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c78153790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7c70007e40 tx=0x7f7c700097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.382+0000 7f7c74ff9700 1 -- 172.21.15.86:0/479520281 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000eac0 con 0x7f7c78155eb0 2023-10-09T11:41:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.382+0000 7f7c74ff9700 1 -- 172.21.15.86:0/479520281 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000ec40 con 0x7f7c78155eb0 2023-10-09T11:41:52.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.382+0000 7f7c74ff9700 1 -- 172.21.15.86:0/479520281 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014420 con 0x7f7c78155eb0 2023-10-09T11:41:52.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.382+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c780ac5a0 con 0x7f7c78155eb0 2023-10-09T11:41:52.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.382+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c780ad140 con 0x7f7c78155eb0 2023-10-09T11:41:52.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.383+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c780acf80 con 0x7f7c78155eb0 2023-10-09T11:41:52.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.384+0000 7f7c74ff9700 1 -- 172.21.15.86:0/479520281 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c70014850 con 0x7f7c78155eb0 2023-10-09T11:41:52.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.385+0000 7f7c74ff9700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c5c066f30 0x7f7c5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.385+0000 7f7c74ff9700 1 -- 172.21.15.86:0/479520281 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c70084ac0 con 0x7f7c78155eb0 2023-10-09T11:41:52.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.385+0000 7f7c7cf9b700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c5c066f30 0x7f7c5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.386+0000 7f7c7cf9b700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c5c066f30 0x7f7c5c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0093f0 tx=0x7f7c6c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.389+0000 7f7c74ff9700 1 -- 172.21.15.86:0/479520281 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c70051d30 con 0x7f7c78155eb0 2023-10-09T11:41:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.578+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c7804c410 con 0x7f7c78155eb0 2023-10-09T11:41:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.579+0000 7f7c74ff9700 1 -- 172.21.15.86:0/479520281 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c70084e60 con 0x7f7c78155eb0 2023-10-09T11:41:52.579 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:41:52.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c5c066f30 msgr2=0x7f7c5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c5c066f30 0x7f7c5c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0093f0 tx=0x7f7c6c018000 comp rx=0 tx=0).stop 2023-10-09T11:41:52.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 msgr2=0x7f7c78153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c78153790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7c70007e40 tx=0x7f7c700097e0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 shutdown_connections 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c5c066f30 0x7f7c5c0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c78155eb0 0x7f7c78153790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c78069e80 0x7f7c780abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 --2- 172.21.15.86:0/479520281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c780c70b0 0x7f7c780c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 >> 172.21.15.86:0/479520281 conn(0x7f7c78068e10 msgr2=0x7f7c78154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 shutdown_connections 2023-10-09T11:41:52.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.581+0000 7f7c7f1ff700 1 -- 172.21.15.86:0/479520281 wait complete. 2023-10-09T11:41:52.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:52.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.781+0000 7f5350fff700 1 Processor -- start 2023-10-09T11:41:52.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.781+0000 7f5350fff700 1 -- start start 2023-10-09T11:41:52.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.782+0000 7f5350fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f534c06b160 0x7f534c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.782+0000 7f5350fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0637d0 0x7f534c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.782+0000 7f5350fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c0ac450 con 0x7f534c06a2b0 2023-10-09T11:41:52.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.782+0000 7f5350fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c069d00 con 0x7f534c06b160 2023-10-09T11:41:52.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.782+0000 7f5350fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c068830 con 0x7f534c0637d0 2023-10-09T11:41:52.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f534ad9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f534c06a2b0 0x7f534c06a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53296/0 (socket says 172.21.15.86:53296) 2023-10-09T11:41:52.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f534ad9d700 1 -- 172.21.15.86:0/1742406022 learned_addr learned my addr 172.21.15.86:0/1742406022 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:52.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f5349d9b700 1 --2- 172.21.15.86:0/1742406022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0637d0 0x7f534c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f534a59c700 1 --2- 172.21.15.86:0/1742406022 >> v2:172.21.15.135:3300/0 conn(0x7f534c06b160 0x7f534c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f534959a700 1 -- 172.21.15.86:0/1742406022 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295086619 0 0) 0x7f534c0ac450 con 0x7f534c06a2b0 2023-10-09T11:41:52.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f534959a700 1 -- 172.21.15.86:0/1742406022 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5334003570 con 0x7f534c06a2b0 2023-10-09T11:41:52.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f5349d9b700 1 -- 172.21.15.86:0/1742406022 >> v2:172.21.15.135:3300/0 conn(0x7f534c06b160 msgr2=0x7f534c06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:52.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f5349d9b700 1 --2- 172.21.15.86:0/1742406022 >> v2:172.21.15.135:3300/0 conn(0x7f534c06b160 0x7f534c06b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f5349d9b700 1 -- 172.21.15.86:0/1742406022 >> v1:172.21.15.86:6789/0 conn(0x7f534c06a2b0 legacy=0x7f534c06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.783+0000 7f5349d9b700 1 -- 172.21.15.86:0/1742406022 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c069740 con 0x7f534c0637d0 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f5349d9b700 1 --2- 172.21.15.86:0/1742406022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0637d0 0x7f534c068cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53400098e0 tx=0x7f53400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c036b7b28fd4c6c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f534959a700 1 -- 172.21.15.86:0/1742406022 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011630 con 0x7f534c0637d0 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f534959a700 1 -- 172.21.15.86:0/1742406022 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340011790 con 0x7f534c0637d0 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f534959a700 1 -- 172.21.15.86:0/1742406022 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011b30 con 0x7f534c0637d0 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f5350fff700 1 -- 172.21.15.86:0/1742406022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0637d0 msgr2=0x7f534c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f5350fff700 1 --2- 172.21.15.86:0/1742406022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0637d0 0x7f534c068cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53400098e0 tx=0x7f53400091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f5350fff700 1 -- 172.21.15.86:0/1742406022 shutdown_connections 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f5350fff700 1 --2- 172.21.15.86:0/1742406022 >> v2:172.21.15.135:3300/0 conn(0x7f534c06b160 0x7f534c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f5350fff700 1 --2- 172.21.15.86:0/1742406022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c0637d0 0x7f534c068cc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.784+0000 7f5350fff700 1 -- 172.21.15.86:0/1742406022 >> 172.21.15.86:0/1742406022 conn(0x7f534c06ded0 msgr2=0x7f534c06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.785+0000 7f5350fff700 1 -- 172.21.15.86:0/1742406022 shutdown_connections 2023-10-09T11:41:52.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.785+0000 7f5350fff700 1 -- 172.21.15.86:0/1742406022 wait complete. 2023-10-09T11:41:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.786+0000 7f5350fff700 1 Processor -- start 2023-10-09T11:41:52.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.786+0000 7f5350fff700 1 -- start start 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f5350fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c0637d0 0x7f534c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f5350fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c06a2b0 0x7f534c157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f5350fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f534c06b160 0x7f534c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f5350fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0b0680 con 0x7f534c06b160 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f5350fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c15a3b0 con 0x7f534c0637d0 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f5350fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c15a0d0 con 0x7f534c06a2b0 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f534ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f534c06b160 0x7f534c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f534ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f534c06b160 0x7f534c1593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55828/0 (socket says 172.21.15.86:55828) 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.787+0000 7f534ad9d700 1 -- 172.21.15.86:0/1916137033 learned_addr learned my addr 172.21.15.86:0/1916137033 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534a59c700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c0637d0 0x7f534c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f5349d9b700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c06a2b0 0x7f534c157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534ad9d700 1 -- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c06a2b0 msgr2=0x7f534c157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534ad9d700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c06a2b0 0x7f534c157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534ad9d700 1 -- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c0637d0 msgr2=0x7f534c157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534ad9d700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c0637d0 0x7f534c157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534ad9d700 1 -- 172.21.15.86:0/1916137033 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340009420 con 0x7f534c06b160 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534a59c700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c0637d0 0x7f534c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f534ad9d700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f534c06b160 0x7f534c1593a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5344001460 tx=0x7f5344001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f533a7fc700 1 -- 172.21.15.86:0/1916137033 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400a950 con 0x7f534c06b160 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f533a7fc700 1 -- 172.21.15.86:0/1916137033 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534400aab0 con 0x7f534c06b160 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f533a7fc700 1 -- 172.21.15.86:0/1916137033 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400ae30 con 0x7f534c06b160 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c0b0030 con 0x7f534c06b160 2023-10-09T11:41:52.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.788+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c16afb0 con 0x7f534c06b160 2023-10-09T11:41:52.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.789+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c0b07f0 con 0x7f534c06b160 2023-10-09T11:41:52.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.790+0000 7f533a7fc700 1 -- 172.21.15.86:0/1916137033 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5344007300 con 0x7f534c06b160 2023-10-09T11:41:52.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.791+0000 7f533a7fc700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f532c066f30 0x7f532c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.791+0000 7f533a7fc700 1 -- 172.21.15.86:0/1916137033 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5344084a40 con 0x7f534c06b160 2023-10-09T11:41:52.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.791+0000 7f534a59c700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f532c066f30 0x7f532c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.792+0000 7f534a59c700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f532c066f30 0x7f532c0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f534c068620 tx=0x7f533c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.795+0000 7f533a7fc700 1 -- 172.21.15.86:0/1916137033 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5344051c90 con 0x7f534c06b160 2023-10-09T11:41:52.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.985+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f534c04c3c0 con 0x7f534c06b160 2023-10-09T11:41:52.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.986+0000 7f533a7fc700 1 -- 172.21.15.86:0/1916137033 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53440552b0 con 0x7f534c06b160 2023-10-09T11:41:52.986 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:41:52.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f532c066f30 msgr2=0x7f532c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f532c066f30 0x7f532c0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f534c068620 tx=0x7f533c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:52.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f534c06b160 msgr2=0x7f534c1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f534c06b160 0x7f534c1593a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5344001460 tx=0x7f5344001a40 comp rx=0 tx=0).stop 2023-10-09T11:41:52.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 shutdown_connections 2023-10-09T11:41:52.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f532c066f30 0x7f532c0693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f534c06b160 0x7f534c1593a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c0637d0 0x7f534c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 --2- 172.21.15.86:0/1916137033 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f534c06a2b0 0x7f534c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.988+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 >> 172.21.15.86:0/1916137033 conn(0x7f534c06ded0 msgr2=0x7f534c1539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.989+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 shutdown_connections 2023-10-09T11:41:52.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:52.989+0000 7f5350fff700 1 -- 172.21.15.86:0/1916137033 wait complete. 2023-10-09T11:41:53.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:53.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.189+0000 7f77ed3ff700 1 Processor -- start 2023-10-09T11:41:53.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.189+0000 7f77ed3ff700 1 -- start start 2023-10-09T11:41:53.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.190+0000 7f77ed3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77e8069560 0x7f77e80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.190+0000 7f77ed3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e8069ee0 con 0x7f77e8159890 2023-10-09T11:41:53.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.190+0000 7f77ed3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e815a160 con 0x7f77e8159c60 2023-10-09T11:41:53.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.190+0000 7f77ed3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e80d13a0 con 0x7f77e8069560 2023-10-09T11:41:53.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.190+0000 7f77e6ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f77e8159890 0x7f77e815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53312/0 (socket says 172.21.15.86:53312) 2023-10-09T11:41:53.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e6ffd700 1 -- 172.21.15.86:0/1984048999 learned_addr learned my addr 172.21.15.86:0/1984048999 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:53.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e77fe700 1 --2- 172.21.15.86:0/1984048999 >> v2:172.21.15.135:3300/0 conn(0x7f77e8069560 0x7f77e80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753748848 0 0) 0x7f77e8069ee0 con 0x7f77e8159890 2023-10-09T11:41:53.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d0003570 con 0x7f77e8159890 2023-10-09T11:41:53.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 236033277 0 0) 0x7f77d0003570 con 0x7f77e8159890 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 >> v2:172.21.15.135:3300/0 conn(0x7f77e8069560 msgr2=0x7f77e80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 --2- 172.21.15.86:0/1984048999 >> v2:172.21.15.135:3300/0 conn(0x7f77e8069560 0x7f77e80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 >> v1:172.21.15.135:6789/0 conn(0x7f77e8159c60 legacy=0x7f77e815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e815e140 con 0x7f77e8159890 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f77d8001470 con 0x7f77e8159890 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e77fe700 1 --2- 172.21.15.86:0/1984048999 >> v2:172.21.15.135:3300/0 conn(0x7f77e8069560 0x7f77e80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 >> v1:172.21.15.86:6789/0 conn(0x7f77e8159890 legacy=0x7f77e815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0003a60 0x7f77d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77d0004810 0x7f77d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.191+0000 7f77e5ffb700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d00051c0 0x7f77d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80d13a0 con 0x7f77d0004810 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d000c0d0 con 0x7f77d00051c0 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d000c290 con 0x7f77d0003a60 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e67fc700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77d0004810 0x7f77d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e77fe700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d00051c0 0x7f77d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e6ffd700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0003a60 0x7f77d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e67fc700 1 -- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0003a60 msgr2=0x7f77d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e67fc700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0003a60 0x7f77d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e67fc700 1 -- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d00051c0 msgr2=0x7f77d000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e67fc700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d00051c0 0x7f77d000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e67fc700 1 -- 172.21.15.86:0/1984048999 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0003570 con 0x7f77d0004810 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e77fe700 1 -- 172.21.15.86:0/1984048999 reap_dead start 2023-10-09T11:41:53.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e67fc700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77d0004810 0x7f77d0004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0018b0 tx=0x7f77dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c589995a8342fec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc012420 con 0x7f77d0004810 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc0125a0 con 0x7f77d0004810 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.192+0000 7f77e5ffb700 1 -- 172.21.15.86:0/1984048999 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc012960 con 0x7f77d0004810 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.193+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1984048999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77d0004810 msgr2=0x7f77d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.193+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77d0004810 0x7f77d0004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0018b0 tx=0x7f77dc007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.193+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1984048999 shutdown_connections 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.193+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1984048999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77d0004810 0x7f77d0004c80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.193+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1984048999 >> 172.21.15.86:0/1984048999 conn(0x7f77e8068e20 msgr2=0x7f77e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.193+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1984048999 shutdown_connections 2023-10-09T11:41:53.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.193+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1984048999 wait complete. 2023-10-09T11:41:53.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.195+0000 7f77ed3ff700 1 Processor -- start 2023-10-09T11:41:53.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.195+0000 7f77ed3ff700 1 -- start start 2023-10-09T11:41:53.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77ed3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0004810 0x7f77e80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77ed3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e814d3c0 0x7f77e814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77ed3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77e80cf400 0x7f77e80cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77ed3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80cfdb0 con 0x7f77e80cf400 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77ed3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8152070 con 0x7f77e814d3c0 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77ed3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8151a90 con 0x7f77d0004810 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77e80cf400 0x7f77e80cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77e80cf400 0x7f77e80cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55854/0 (socket says 172.21.15.86:55854) 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 -- 172.21.15.86:0/1730975602 learned_addr learned my addr 172.21.15.86:0/1730975602 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 -- 172.21.15.86:0/1730975602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0004810 msgr2=0x7f77e80c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0004810 0x7f77e80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 -- 172.21.15.86:0/1730975602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e814d3c0 msgr2=0x7f77e814caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e814d3c0 0x7f77e814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.196+0000 7f77e77fe700 1 -- 172.21.15.86:0/1730975602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80c8890 con 0x7f77e80cf400 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.197+0000 7f77e77fe700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77e80cf400 0x7f77e80cf870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77e80d03b0 tx=0x7f77e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.197+0000 7f77ceffd700 1 -- 172.21.15.86:0/1730975602 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000e070 con 0x7f77e80cf400 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.197+0000 7f77ceffd700 1 -- 172.21.15.86:0/1730975602 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0011d60 con 0x7f77e80cf400 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.197+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e80c8b10 con 0x7f77e80cf400 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.197+0000 7f77ceffd700 1 -- 172.21.15.86:0/1730975602 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00166e0 con 0x7f77e80cf400 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.197+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e80c8df0 con 0x7f77e80cf400 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.198+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e804c3c0 con 0x7f77e80cf400 2023-10-09T11:41:53.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.199+0000 7f77ceffd700 1 -- 172.21.15.86:0/1730975602 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77e0016ad0 con 0x7f77e80cf400 2023-10-09T11:41:53.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.199+0000 7f77ceffd700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f77d4066f30 0x7f77d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.200+0000 7f77ceffd700 1 -- 172.21.15.86:0/1730975602 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77e0085350 con 0x7f77e80cf400 2023-10-09T11:41:53.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.200+0000 7f77e6ffd700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f77d4066f30 0x7f77d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.200+0000 7f77e6ffd700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f77d4066f30 0x7f77d40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f77d8001200 tx=0x7f77d8000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.204+0000 7f77ceffd700 1 -- 172.21.15.86:0/1730975602 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77e0052520 con 0x7f77e80cf400 2023-10-09T11:41:53.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.393+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77e8152220 con 0x7f77e80cf400 2023-10-09T11:41:53.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.393+0000 7f77ceffd700 1 -- 172.21.15.86:0/1730975602 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77e8152220 con 0x7f77e80cf400 2023-10-09T11:41:53.394 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:41:53.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f77d4066f30 msgr2=0x7f77d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f77d4066f30 0x7f77d40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f77d8001200 tx=0x7f77d8000ed0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77e80cf400 msgr2=0x7f77e80cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77e80cf400 0x7f77e80cf870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77e80d03b0 tx=0x7f77e000b040 comp rx=0 tx=0).stop 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 shutdown_connections 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f77d4066f30 0x7f77d40693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77e80cf400 0x7f77e80cf870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d0004810 0x7f77e80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 --2- 172.21.15.86:0/1730975602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77e814d3c0 0x7f77e814caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 >> 172.21.15.86:0/1730975602 conn(0x7f77e8068e20 msgr2=0x7f77e80d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 shutdown_connections 2023-10-09T11:41:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.396+0000 7f77ed3ff700 1 -- 172.21.15.86:0/1730975602 wait complete. 2023-10-09T11:41:53.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:53.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.594+0000 7f7020f9d700 1 Processor -- start 2023-10-09T11:41:53.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.594+0000 7f7020f9d700 1 -- start start 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.595+0000 7f7020f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c150180 0x7f701c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.595+0000 7f7020f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f701c0c7410 0x7f701c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.595+0000 7f7020f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701c06e2a0 con 0x7f701c150550 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.595+0000 7f7020f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c06b2e0 con 0x7f701c0c7410 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.595+0000 7f7020f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0c78e0 con 0x7f701c150180 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.595+0000 7f7013fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f701c150550 0x7f701c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53328/0 (socket says 172.21.15.86:53328) 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.595+0000 7f7013fff700 1 -- 172.21.15.86:0/211643490 learned_addr learned my addr 172.21.15.86:0/211643490 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701b7fe700 1 --2- 172.21.15.86:0/211643490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c150180 0x7f701c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701bfff700 1 --2- 172.21.15.86:0/211643490 >> v2:172.21.15.135:3300/0 conn(0x7f701c0c7410 0x7f701c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701affd700 1 -- 172.21.15.86:0/211643490 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730379597 0 0) 0x7f701c06e2a0 con 0x7f701c150550 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701affd700 1 -- 172.21.15.86:0/211643490 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7008004680 con 0x7f701c150550 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701b7fe700 1 -- 172.21.15.86:0/211643490 >> v2:172.21.15.135:3300/0 conn(0x7f701c0c7410 msgr2=0x7f701c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701b7fe700 1 --2- 172.21.15.86:0/211643490 >> v2:172.21.15.135:3300/0 conn(0x7f701c0c7410 0x7f701c069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701b7fe700 1 -- 172.21.15.86:0/211643490 >> v1:172.21.15.86:6789/0 conn(0x7f701c150550 legacy=0x7f701c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701b7fe700 1 -- 172.21.15.86:0/211643490 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c0c7bc0 con 0x7f701c150180 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.596+0000 7f701b7fe700 1 --2- 172.21.15.86:0/211643490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c150180 0x7f701c157770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f700c0098e0 tx=0x7f700c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7fa86a6416f849 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f701affd700 1 -- 172.21.15.86:0/211643490 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c011630 con 0x7f701c150180 2023-10-09T11:41:53.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f701affd700 1 -- 172.21.15.86:0/211643490 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c011790 con 0x7f701c150180 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f701affd700 1 -- 172.21.15.86:0/211643490 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c011b30 con 0x7f701c150180 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 -- 172.21.15.86:0/211643490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c150180 msgr2=0x7f701c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 --2- 172.21.15.86:0/211643490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c150180 0x7f701c157770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f700c0098e0 tx=0x7f700c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 -- 172.21.15.86:0/211643490 shutdown_connections 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 --2- 172.21.15.86:0/211643490 >> v2:172.21.15.135:3300/0 conn(0x7f701c0c7410 0x7f701c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 --2- 172.21.15.86:0/211643490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c150180 0x7f701c157770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 -- 172.21.15.86:0/211643490 >> 172.21.15.86:0/211643490 conn(0x7f701c0cc1f0 msgr2=0x7f701c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 -- 172.21.15.86:0/211643490 shutdown_connections 2023-10-09T11:41:53.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.597+0000 7f7020f9d700 1 -- 172.21.15.86:0/211643490 wait complete. 2023-10-09T11:41:53.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.599+0000 7f7020f9d700 1 Processor -- start 2023-10-09T11:41:53.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.599+0000 7f7020f9d700 1 -- start start 2023-10-09T11:41:53.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7020f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c0c7410 0x7f701c14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7020f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f701c150180 0x7f701c0c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7020f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f701c150550 0x7f701c0c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7020f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c14ac80 con 0x7f701c150180 2023-10-09T11:41:53.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7020f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0b1020 con 0x7f701c150550 2023-10-09T11:41:53.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7020f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0b0410 con 0x7f701c0c7410 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7013fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f701c150180 0x7f701c0c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7013fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f701c150180 0x7f701c0c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55864/0 (socket says 172.21.15.86:55864) 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f7013fff700 1 -- 172.21.15.86:0/4071367157 learned_addr learned my addr 172.21.15.86:0/4071367157 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f701b7fe700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c0c7410 0x7f701c14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.600+0000 7f701bfff700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f701c150550 0x7f701c0c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7013fff700 1 -- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c0c7410 msgr2=0x7f701c14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7013fff700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c0c7410 0x7f701c14a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7013fff700 1 -- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f701c150550 msgr2=0x7f701c0c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7013fff700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f701c150550 0x7f701c0c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7013fff700 1 -- 172.21.15.86:0/4071367157 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c009420 con 0x7f701c150180 2023-10-09T11:41:53.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7013fff700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f701c150180 0x7f701c0c32a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f700400c590 tx=0x7f7004007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f70137fe700 1 -- 172.21.15.86:0/4071367157 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004005b30 con 0x7f701c150180 2023-10-09T11:41:53.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f70137fe700 1 -- 172.21.15.86:0/4071367157 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004005c90 con 0x7f701c150180 2023-10-09T11:41:53.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c0b06f0 con 0x7f701c150180 2023-10-09T11:41:53.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f70137fe700 1 -- 172.21.15.86:0/4071367157 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004007320 con 0x7f701c150180 2023-10-09T11:41:53.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.601+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c0b0cb0 con 0x7f701c150180 2023-10-09T11:41:53.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.602+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c0b11d0 con 0x7f701c150180 2023-10-09T11:41:53.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.603+0000 7f70137fe700 1 -- 172.21.15.86:0/4071367157 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f700401b3b0 con 0x7f701c150180 2023-10-09T11:41:53.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.604+0000 7f70137fe700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6ffc067000 0x7f6ffc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.604+0000 7f70137fe700 1 -- 172.21.15.86:0/4071367157 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7004083af0 con 0x7f701c150180 2023-10-09T11:41:53.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.604+0000 7f701b7fe700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6ffc067000 0x7f6ffc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.605+0000 7f701b7fe700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6ffc067000 0x7f6ffc0694b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f700c0091e0 tx=0x7f700c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.608+0000 7f70137fe700 1 -- 172.21.15.86:0/4071367157 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f701c0b11d0 con 0x7f701c150180 2023-10-09T11:41:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.838+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f701c0b0e40 con 0x7f701c150180 2023-10-09T11:41:53.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.839+0000 7f70137fe700 1 -- 172.21.15.86:0/4071367157 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f7004017070 con 0x7f701c150180 2023-10-09T11:41:53.840 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:53.840 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:53.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.841+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6ffc067000 msgr2=0x7f6ffc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.841+0000 7f7020f9d700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6ffc067000 0x7f6ffc0694b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f700c0091e0 tx=0x7f700c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.841+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f701c150180 msgr2=0x7f701c0c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.841+0000 7f7020f9d700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f701c150180 0x7f701c0c32a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f700400c590 tx=0x7f7004007e00 comp rx=0 tx=0).stop 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 shutdown_connections 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6ffc067000 0x7f6ffc0694b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f701c150550 0x7f701c0c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f701c0c7410 0x7f701c14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 --2- 172.21.15.86:0/4071367157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f701c150180 0x7f701c0c32a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 >> 172.21.15.86:0/4071367157 conn(0x7f701c0cc1f0 msgr2=0x7f701c1585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 shutdown_connections 2023-10-09T11:41:53.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:53.842+0000 7f7020f9d700 1 -- 172.21.15.86:0/4071367157 wait complete. 2023-10-09T11:41:53.844 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:53.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:54.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.041+0000 7f604c1ff700 1 Processor -- start 2023-10-09T11:41:54.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.042+0000 7f604c1ff700 1 -- start start 2023-10-09T11:41:54.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f604c1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f60440cbf30 0x7f60440ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f604c1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60440cc300 con 0x7f60440ccf90 2023-10-09T11:41:54.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f604c1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60440ad370 con 0x7f60440b1420 2023-10-09T11:41:54.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f604c1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6044156bf0 con 0x7f60440cbf30 2023-10-09T11:41:54.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f6049f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f60440cbf30 0x7f60440ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f604979a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f60440ccf90 0x7f60440b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53334/0 (socket says 172.21.15.86:53334) 2023-10-09T11:41:54.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f604979a700 1 -- 172.21.15.86:0/433173659 learned_addr learned my addr 172.21.15.86:0/433173659 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:54.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f6049f9b700 1 -- 172.21.15.86:0/433173659 >> v1:172.21.15.135:6789/0 conn(0x7f60440b1420 legacy=0x7f60440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.043+0000 7f6049f9b700 1 -- 172.21.15.86:0/433173659 >> v1:172.21.15.86:6789/0 conn(0x7f60440ccf90 legacy=0x7f60440b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f6049f9b700 1 -- 172.21.15.86:0/433173659 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440ad650 con 0x7f60440cbf30 2023-10-09T11:41:54.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f6048f99700 1 -- 172.21.15.86:0/433173659 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151632772 0 0) 0x7f60440cc300 con 0x7f60440ccf90 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f6049f9b700 1 --2- 172.21.15.86:0/433173659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440cbf30 0x7f60440ae410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f60400098e0 tx=0x7f60400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a3fa5b2285a24c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f6048f99700 1 -- 172.21.15.86:0/433173659 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040009e80 con 0x7f60440cbf30 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f6048f99700 1 -- 172.21.15.86:0/433173659 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000b860 con 0x7f60440cbf30 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f6048f99700 1 -- 172.21.15.86:0/433173659 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000bbe0 con 0x7f60440cbf30 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f604c1ff700 1 -- 172.21.15.86:0/433173659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440cbf30 msgr2=0x7f60440ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.044+0000 7f604c1ff700 1 --2- 172.21.15.86:0/433173659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440cbf30 0x7f60440ae410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f60400098e0 tx=0x7f60400091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.045+0000 7f604c1ff700 1 -- 172.21.15.86:0/433173659 shutdown_connections 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.045+0000 7f604c1ff700 1 --2- 172.21.15.86:0/433173659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440cbf30 0x7f60440ae410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.045+0000 7f604c1ff700 1 -- 172.21.15.86:0/433173659 >> 172.21.15.86:0/433173659 conn(0x7f604406a320 msgr2=0x7f60440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.045+0000 7f604c1ff700 1 -- 172.21.15.86:0/433173659 shutdown_connections 2023-10-09T11:41:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.045+0000 7f604c1ff700 1 -- 172.21.15.86:0/433173659 wait complete. 2023-10-09T11:41:54.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.046+0000 7f604c1ff700 1 Processor -- start 2023-10-09T11:41:54.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.046+0000 7f604c1ff700 1 -- start start 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604c1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440b1420 0x7f6044159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604c1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60440cbf30 0x7f6044156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604c1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60440ccf90 0x7f604414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604c1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6044158320 con 0x7f60440b1420 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604c1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6044157710 con 0x7f60440ccf90 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604c1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60441579f0 con 0x7f60440cbf30 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440b1420 0x7f6044159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440b1420 0x7f6044159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55876/0 (socket says 172.21.15.86:55876) 2023-10-09T11:41:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 -- 172.21.15.86:0/852700998 learned_addr learned my addr 172.21.15.86:0/852700998 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604979a700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60440cbf30 0x7f6044156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f604a79c700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60440ccf90 0x7f604414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 -- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60440cbf30 msgr2=0x7f6044156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60440cbf30 0x7f6044156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 -- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60440ccf90 msgr2=0x7f604414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60440ccf90 0x7f604414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.047+0000 7f6049f9b700 1 -- 172.21.15.86:0/852700998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009420 con 0x7f60440b1420 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.048+0000 7f6049f9b700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440b1420 0x7f6044159760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6044064290 tx=0x7f6040017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.048+0000 7f6039ffb700 1 -- 172.21.15.86:0/852700998 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604001f070 con 0x7f60440b1420 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.048+0000 7f6039ffb700 1 -- 172.21.15.86:0/852700998 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000b9d0 con 0x7f60440b1420 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.048+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6044157cd0 con 0x7f60440b1420 2023-10-09T11:41:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.048+0000 7f6039ffb700 1 -- 172.21.15.86:0/852700998 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040025670 con 0x7f60440b1420 2023-10-09T11:41:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.048+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6044151a20 con 0x7f60440b1420 2023-10-09T11:41:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.049+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604404c3c0 con 0x7f60440b1420 2023-10-09T11:41:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.050+0000 7f6039ffb700 1 -- 172.21.15.86:0/852700998 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6040023070 con 0x7f60440b1420 2023-10-09T11:41:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.051+0000 7f6039ffb700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6028066f30 0x7f60280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.051+0000 7f6039ffb700 1 -- 172.21.15.86:0/852700998 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6040085c80 con 0x7f60440b1420 2023-10-09T11:41:54.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.051+0000 7f604979a700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6028066f30 0x7f60280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.051+0000 7f604979a700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6028066f30 0x7f60280693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f604414bbe0 tx=0x7f6034009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.055+0000 7f6039ffb700 1 -- 172.21.15.86:0/852700998 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6040052e50 con 0x7f60440b1420 2023-10-09T11:41:54.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.254+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60440b0af0 con 0x7f60440b1420 2023-10-09T11:41:54.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.254+0000 7f6039ffb700 1 -- 172.21.15.86:0/852700998 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15587 (secure 0 0 0) 0x7f604002a090 con 0x7f60440b1420 2023-10-09T11:41:54.255 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:54.255 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":23,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:54.210833+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:54.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6028066f30 msgr2=0x7f60280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6028066f30 0x7f60280693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f604414bbe0 tx=0x7f6034009040 comp rx=0 tx=0).stop 2023-10-09T11:41:54.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440b1420 msgr2=0x7f6044159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440b1420 0x7f6044159760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6044064290 tx=0x7f6040017000 comp rx=0 tx=0).stop 2023-10-09T11:41:54.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 shutdown_connections 2023-10-09T11:41:54.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6028066f30 0x7f60280693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60440b1420 0x7f6044159760 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60440ccf90 0x7f604414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 --2- 172.21.15.86:0/852700998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60440cbf30 0x7f6044156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 >> 172.21.15.86:0/852700998 conn(0x7f604406a320 msgr2=0x7f604406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 shutdown_connections 2023-10-09T11:41:54.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.257+0000 7f604c1ff700 1 -- 172.21.15.86:0/852700998 wait complete. 2023-10-09T11:41:54.275 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:41:54.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.454+0000 7f28d6dff700 1 Processor -- start 2023-10-09T11:41:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.454+0000 7f28d6dff700 1 -- start start 2023-10-09T11:41:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28d6dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 0x7f28d0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28d6dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d00acac0 con 0x7f28d00ac6a0 2023-10-09T11:41:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28d6dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d00ad930 con 0x7f28d00ac230 2023-10-09T11:41:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28d6dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00acd20 con 0x7f28d0155c10 2023-10-09T11:41:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28d539c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f28d00ac6a0 0x7f28d00b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:53350/0 (socket says 172.21.15.86:53350) 2023-10-09T11:41:54.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28d539c700 1 -- 172.21.15.86:0/1855364519 learned_addr learned my addr 172.21.15.86:0/1855364519 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 0x7f28d0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973672768 0 0) 0x7f28d00acac0 con 0x7f28d00ac6a0 2023-10-09T11:41:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.456+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c0003570 con 0x7f28d00ac6a0 2023-10-09T11:41:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574220375 0 0) 0x7f28c0003570 con 0x7f28d00ac6a0 2023-10-09T11:41:54.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 msgr2=0x7f28d0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 0x7f28d0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 >> v1:172.21.15.135:6789/0 conn(0x7f28d00ac230 legacy=0x7f28d01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00ad000 con 0x7f28d00ac6a0 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f28c80017f0 con 0x7f28d00ac6a0 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 >> v1:172.21.15.86:6789/0 conn(0x7f28d00ac6a0 legacy=0x7f28d00b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c0003a90 0x7f28c0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28c0004810 0x7f28c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 0x7f28c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00acd20 con 0x7f28c0003a90 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c000cc50 con 0x7f28c0004810 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0005ab0 con 0x7f28d0155c10 2023-10-09T11:41:54.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c0003a90 0x7f28c0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d539c700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 0x7f28c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cffff700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28c0004810 0x7f28c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d4b9b700 1 -- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 msgr2=0x7f28c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 0x7f28c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d4b9b700 1 -- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28c0004810 msgr2=0x7f28c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28c0004810 0x7f28c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d4b9b700 1 -- 172.21.15.86:0/1855364519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0003570 con 0x7f28c0003a90 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28d539c700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d0155c10 0x7f28c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.457+0000 7f28cffff700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28c0004810 0x7f28c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c0003a90 0x7f28c0003e60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009c00 tx=0x7f28c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4747ff027278141 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400e710 con 0x7f28c0003a90 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400e870 con 0x7f28c0003a90 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28cf7fe700 1 -- 172.21.15.86:0/1855364519 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400ec30 con 0x7f28c0003a90 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28d6dff700 1 -- 172.21.15.86:0/1855364519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c0003a90 msgr2=0x7f28c0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28d6dff700 1 --2- 172.21.15.86:0/1855364519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c0003a90 0x7f28c0003e60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009c00 tx=0x7f28c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28d539c700 1 -- 172.21.15.86:0/1855364519 reap_dead start 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28d6dff700 1 -- 172.21.15.86:0/1855364519 shutdown_connections 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.458+0000 7f28d6dff700 1 -- 172.21.15.86:0/1855364519 >> 172.21.15.86:0/1855364519 conn(0x7f28d006a320 msgr2=0x7f28d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.459+0000 7f28d6dff700 1 -- 172.21.15.86:0/1855364519 shutdown_connections 2023-10-09T11:41:54.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.459+0000 7f28d6dff700 1 -- 172.21.15.86:0/1855364519 wait complete. 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.460+0000 7f28d6dff700 1 Processor -- start 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.460+0000 7f28d6dff700 1 -- start start 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d6dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28c0003a90 0x7f28d01467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d6dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28d0144290 0x7f28d0146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d6dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0144800 0x7f28d0144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d6dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d01477f0 con 0x7f28d0144290 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d6dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d01484f0 con 0x7f28d0144800 2023-10-09T11:41:54.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d6dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0147510 con 0x7f28c0003a90 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28cffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28d0144290 0x7f28d0146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28cffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28d0144290 0x7f28d0146ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55896/0 (socket says 172.21.15.86:55896) 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28cffff700 1 -- 172.21.15.86:0/1887617925 learned_addr learned my addr 172.21.15.86:0/1887617925 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28c0003a90 0x7f28d01467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.461+0000 7f28d539c700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0144800 0x7f28d0144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28cffff700 1 -- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28c0003a90 msgr2=0x7f28d01467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28cffff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28c0003a90 0x7f28d01467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28cffff700 1 -- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0144800 msgr2=0x7f28d0144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28cffff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0144800 0x7f28d0144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28cffff700 1 -- 172.21.15.86:0/1887617925 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0147ea0 con 0x7f28d0144290 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28cffff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28d0144290 0x7f28d0146ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00d880 tx=0x7f28bc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28ccff9700 1 -- 172.21.15.86:0/1887617925 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc006820 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28ccff9700 1 -- 172.21.15.86:0/1887617925 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc006980 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d0148180 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28ccff9700 1 -- 172.21.15.86:0/1887617925 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc006d40 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.462+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d01451c0 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.463+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d0147d00 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.464+0000 7f28ccff9700 1 -- 172.21.15.86:0/1887617925 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28bc007240 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.465+0000 7f28ccff9700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f28b4066f30 0x7f28b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.465+0000 7f28ccff9700 1 -- 172.21.15.86:0/1887617925 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f28bc084400 con 0x7f28d0144290 2023-10-09T11:41:54.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.465+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f28b4066f30 0x7f28b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.466+0000 7f28d4b9b700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f28b4066f30 0x7f28b40693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28c40091e0 tx=0x7f28c401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.469+0000 7f28ccff9700 1 -- 172.21.15.86:0/1887617925 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d0147d00 con 0x7f28d0144290 2023-10-09T11:41:54.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.700+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d0147d00 con 0x7f28d0144290 2023-10-09T11:41:54.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.700+0000 7f28ccff9700 1 -- 172.21.15.86:0/1887617925 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f28d0147d00 con 0x7f28d0144290 2023-10-09T11:41:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:54.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.702+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f28b4066f30 msgr2=0x7f28b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.702+0000 7f28d6dff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f28b4066f30 0x7f28b40693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28c40091e0 tx=0x7f28c401a000 comp rx=0 tx=0).stop 2023-10-09T11:41:54.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.702+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28d0144290 msgr2=0x7f28d0146ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.702+0000 7f28d6dff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28d0144290 0x7f28d0146ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00d880 tx=0x7f28bc009040 comp rx=0 tx=0).stop 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 shutdown_connections 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f28b4066f30 0x7f28b40693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d0144800 0x7f28d0144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28c0003a90 0x7f28d01467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 --2- 172.21.15.86:0/1887617925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28d0144290 0x7f28d0146ce0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 >> 172.21.15.86:0/1887617925 conn(0x7f28d006a320 msgr2=0x7f28d01538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 shutdown_connections 2023-10-09T11:41:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.703+0000 7f28d6dff700 1 -- 172.21.15.86:0/1887617925 wait complete. 2023-10-09T11:41:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:54.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:54.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.900+0000 7fc7df9ff700 1 Processor -- start 2023-10-09T11:41:54.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.900+0000 7fc7df9ff700 1 -- start start 2023-10-09T11:41:54.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7df9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7d8155c10 0x7fc7d8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7df9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac6d0 0x7fc7d80b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7df9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d80acac0 con 0x7fc7d80ac230 2023-10-09T11:41:54.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7df9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d80ad930 con 0x7fc7d8155c10 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7df9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80acd20 con 0x7fc7d80ac6d0 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7dd79b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7d8155c10 0x7fc7d8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7dcf9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc7d80ac230 0x7fc7d81568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33026/0 (socket says 172.21.15.86:33026) 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.901+0000 7fc7dcf9a700 1 -- 172.21.15.86:0/3129348220 learned_addr learned my addr 172.21.15.86:0/3129348220 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7ddf9c700 1 --2- 172.21.15.86:0/3129348220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac6d0 0x7fc7d80b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7cffff700 1 -- 172.21.15.86:0/3129348220 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530803692 0 0) 0x7fc7d80acac0 con 0x7fc7d80ac230 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7cffff700 1 -- 172.21.15.86:0/3129348220 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c4004680 con 0x7fc7d80ac230 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7dd79b700 1 -- 172.21.15.86:0/3129348220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac6d0 msgr2=0x7fc7d80b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7dd79b700 1 --2- 172.21.15.86:0/3129348220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac6d0 0x7fc7d80b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7dd79b700 1 -- 172.21.15.86:0/3129348220 >> v1:172.21.15.86:6789/0 conn(0x7fc7d80ac230 legacy=0x7fc7d81568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7dd79b700 1 -- 172.21.15.86:0/3129348220 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d80ad000 con 0x7fc7d8155c10 2023-10-09T11:41:54.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7ddf9c700 1 --2- 172.21.15.86:0/3129348220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac6d0 0x7fc7d80b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:54.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7dd79b700 1 --2- 172.21.15.86:0/3129348220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d8155fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80acc50 tx=0x7fc7d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8a006b3e1e00a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.902+0000 7fc7cffff700 1 -- 172.21.15.86:0/3129348220 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4011630 con 0x7fc7d8155c10 2023-10-09T11:41:54.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7cffff700 1 -- 172.21.15.86:0/3129348220 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4011790 con 0x7fc7d8155c10 2023-10-09T11:41:54.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7cffff700 1 -- 172.21.15.86:0/3129348220 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4011b50 con 0x7fc7d8155c10 2023-10-09T11:41:54.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 -- 172.21.15.86:0/3129348220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 msgr2=0x7fc7d8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/3129348220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d8155fe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80acc50 tx=0x7fc7d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 -- 172.21.15.86:0/3129348220 shutdown_connections 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/3129348220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac6d0 0x7fc7d80b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/3129348220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d8155fe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 -- 172.21.15.86:0/3129348220 >> 172.21.15.86:0/3129348220 conn(0x7fc7d806a320 msgr2=0x7fc7d80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 -- 172.21.15.86:0/3129348220 shutdown_connections 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.903+0000 7fc7df9ff700 1 -- 172.21.15.86:0/3129348220 wait complete. 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.905+0000 7fc7df9ff700 1 Processor -- start 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.905+0000 7fc7df9ff700 1 -- start start 2023-10-09T11:41:54.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7df9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac230 0x7fc7d80cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7df9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d80ac6d0 0x7fc7d8169b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7df9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d816a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7df9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80a9e30 con 0x7fc7d8155c10 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7df9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d814d550 con 0x7fc7d80ac6d0 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7df9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80cccc0 con 0x7fc7d80ac230 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d816a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d816a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51894/0 (socket says 172.21.15.86:51894) 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 -- 172.21.15.86:0/23906721 learned_addr learned my addr 172.21.15.86:0/23906721 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7dd79b700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac230 0x7fc7d80cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7dcf9a700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d80ac6d0 0x7fc7d8169b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 -- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac230 msgr2=0x7fc7d80cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac230 0x7fc7d80cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 -- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d80ac6d0 msgr2=0x7fc7d8169b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d80ac6d0 0x7fc7d8169b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7ddf9c700 1 -- 172.21.15.86:0/23906721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4009420 con 0x7fc7d8155c10 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.906+0000 7fc7dcf9a700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d80ac6d0 0x7fc7d8169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.907+0000 7fc7ddf9c700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d816a0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d180 tx=0x7fc7d0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.907+0000 7fc7cd7fa700 1 -- 172.21.15.86:0/23906721 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000dd70 con 0x7fc7d8155c10 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.907+0000 7fc7cd7fa700 1 -- 172.21.15.86:0/23906721 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000f040 con 0x7fc7d8155c10 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.907+0000 7fc7cd7fa700 1 -- 172.21.15.86:0/23906721 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0015690 con 0x7fc7d8155c10 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.907+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d80ccfa0 con 0x7fc7d8155c10 2023-10-09T11:41:54.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.907+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d80ca110 con 0x7fc7d8155c10 2023-10-09T11:41:54.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.908+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d80a9f70 con 0x7fc7d8155c10 2023-10-09T11:41:54.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.909+0000 7fc7cd7fa700 1 -- 172.21.15.86:0/23906721 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7d001e3b0 con 0x7fc7d8155c10 2023-10-09T11:41:54.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.910+0000 7fc7cd7fa700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc7bc066f30 0x7fc7bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.910+0000 7fc7cd7fa700 1 -- 172.21.15.86:0/23906721 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7fc7d0084ad0 con 0x7fc7d8155c10 2023-10-09T11:41:54.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.910+0000 7fc7dd79b700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc7bc066f30 0x7fc7bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.911+0000 7fc7dd79b700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc7bc066f30 0x7fc7bc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40091e0 tx=0x7fc7d4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:54.914+0000 7fc7cd7fa700 1 -- 172.21.15.86:0/23906721 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7d80a9f70 con 0x7fc7d8155c10 2023-10-09T11:41:55.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.147+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7d80a9f70 con 0x7fc7d8155c10 2023-10-09T11:41:55.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.148+0000 7fc7cd7fa700 1 -- 172.21.15.86:0/23906721 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fc7d80a9f70 con 0x7fc7d8155c10 2023-10-09T11:41:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:55.149 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3902683519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3902683519},{"type":"v1","addr":"172.21.15.135:6834","nonce":3902683519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/1578274626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1578274626},{"type":"v1","addr":"172.21.15.86:6837","nonce":1578274626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/963400117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":963400117},{"type":"v1","addr":"172.21.15.86:6836","nonce":963400117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:11.523424+0000","modified":"2023-10-09T11:41:15.086399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3007704433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3007704433},{"type":"v1","addr":"172.21.15.135:6835","nonce":3007704433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:41:55.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc7bc066f30 msgr2=0x7fc7bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc7bc066f30 0x7fc7bc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40091e0 tx=0x7fc7d4016000 comp rx=0 tx=0).stop 2023-10-09T11:41:55.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 msgr2=0x7fc7d816a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d816a0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d180 tx=0x7fc7d0009a50 comp rx=0 tx=0).stop 2023-10-09T11:41:55.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 shutdown_connections 2023-10-09T11:41:55.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc7bc066f30 0x7fc7bc0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7d8155c10 0x7fc7d816a0c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d80ac230 0x7fc7d80cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 --2- 172.21.15.86:0/23906721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d80ac6d0 0x7fc7d8169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 >> 172.21.15.86:0/23906721 conn(0x7fc7d806a320 msgr2=0x7fc7d80b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 shutdown_connections 2023-10-09T11:41:55.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.150+0000 7fc7df9ff700 1 -- 172.21.15.86:0/23906721 wait complete. 2023-10-09T11:41:55.153 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 8 2023-10-09T11:41:55.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:55.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.353+0000 7f785a5ff700 1 Processor -- start 2023-10-09T11:41:55.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.353+0000 7f785a5ff700 1 -- start start 2023-10-09T11:41:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.354+0000 7f785a5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78541599e0 0x7f7854069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.354+0000 7f785a5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78540c96a0 con 0x7f7854159db0 2023-10-09T11:41:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.354+0000 7f785a5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78540cb9e0 con 0x7f785406a2b0 2023-10-09T11:41:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.354+0000 7f785a5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78540cab60 con 0x7f78541599e0 2023-10-09T11:41:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.354+0000 7f7853fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78541599e0 0x7f7854069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7853fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78541599e0 0x7f7854069ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51908/0 (socket says 172.21.15.86:51908) 2023-10-09T11:41:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7853fff700 1 -- 172.21.15.86:0/629256039 learned_addr learned my addr 172.21.15.86:0/629256039 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7853fff700 1 -- 172.21.15.86:0/629256039 >> v1:172.21.15.135:6789/0 conn(0x7f785406a2b0 legacy=0x7f785406a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7853fff700 1 -- 172.21.15.86:0/629256039 >> v1:172.21.15.86:6789/0 conn(0x7f7854159db0 legacy=0x7f7854069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7853fff700 1 -- 172.21.15.86:0/629256039 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78540cb420 con 0x7f78541599e0 2023-10-09T11:41:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7852ffd700 1 -- 172.21.15.86:0/629256039 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221985068 0 0) 0x7f78540c96a0 con 0x7f7854159db0 2023-10-09T11:41:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7853fff700 1 --2- 172.21.15.86:0/629256039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78541599e0 0x7f7854069ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f78440099b0 tx=0x7f7844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3962b6321bb1df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.355+0000 7f7852ffd700 1 -- 172.21.15.86:0/629256039 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784400b860 con 0x7f78541599e0 2023-10-09T11:41:55.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f7852ffd700 1 -- 172.21.15.86:0/629256039 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784400b9c0 con 0x7f78541599e0 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f7852ffd700 1 -- 172.21.15.86:0/629256039 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784400bd60 con 0x7f78541599e0 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f785a5ff700 1 -- 172.21.15.86:0/629256039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78541599e0 msgr2=0x7f7854069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f785a5ff700 1 --2- 172.21.15.86:0/629256039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78541599e0 0x7f7854069ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f78440099b0 tx=0x7f7844009250 comp rx=0 tx=0).stop 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f785a5ff700 1 -- 172.21.15.86:0/629256039 shutdown_connections 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f785a5ff700 1 --2- 172.21.15.86:0/629256039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78541599e0 0x7f7854069ac0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f785a5ff700 1 -- 172.21.15.86:0/629256039 >> 172.21.15.86:0/629256039 conn(0x7f78540c9860 msgr2=0x7f78540c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f785a5ff700 1 -- 172.21.15.86:0/629256039 shutdown_connections 2023-10-09T11:41:55.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.356+0000 7f785a5ff700 1 -- 172.21.15.86:0/629256039 wait complete. 2023-10-09T11:41:55.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.358+0000 7f785a5ff700 1 Processor -- start 2023-10-09T11:41:55.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.358+0000 7f785a5ff700 1 -- start start 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f785a5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f785406a2b0 0x7f7854157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f785a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78541599e0 0x7f7854158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f785a5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7854159db0 0x7f785414de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f785a5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7854157ec0 con 0x7f785406a2b0 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f785a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7854156f30 con 0x7f78541599e0 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f785a5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7854158d80 con 0x7f7854159db0 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f785406a2b0 0x7f7854157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f785406a2b0 0x7f7854157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51910/0 (socket says 172.21.15.86:51910) 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 -- 172.21.15.86:0/3870899708 learned_addr learned my addr 172.21.15.86:0/3870899708 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:55.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 -- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7854159db0 msgr2=0x7f785414de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7854159db0 0x7f785414de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 -- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78541599e0 msgr2=0x7f7854158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f78537fe700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78541599e0 0x7f7854158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78541599e0 0x7f7854158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f7853fff700 1 -- 172.21.15.86:0/3870899708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78440094f0 con 0x7f785406a2b0 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.359+0000 7f78537fe700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78541599e0 0x7f7854158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.360+0000 7f7853fff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f785406a2b0 0x7f7854157980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7844006f50 tx=0x7f7844017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.360+0000 7f783bfff700 1 -- 172.21.15.86:0/3870899708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784401f070 con 0x7f785406a2b0 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.360+0000 7f783bfff700 1 -- 172.21.15.86:0/3870899708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844011c40 con 0x7f785406a2b0 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.360+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7854159060 con 0x7f785406a2b0 2023-10-09T11:41:55.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.360+0000 7f783bfff700 1 -- 172.21.15.86:0/3870899708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844025420 con 0x7f785406a2b0 2023-10-09T11:41:55.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.360+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7854157460 con 0x7f785406a2b0 2023-10-09T11:41:55.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.361+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7854157650 con 0x7f785406a2b0 2023-10-09T11:41:55.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.362+0000 7f783bfff700 1 -- 172.21.15.86:0/3870899708 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7844023070 con 0x7f785406a2b0 2023-10-09T11:41:55.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.363+0000 7f783bfff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7840066f30 0x7f78400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.363+0000 7f783bfff700 1 -- 172.21.15.86:0/3870899708 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f7844085ac0 con 0x7f785406a2b0 2023-10-09T11:41:55.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.363+0000 7f78537fe700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7840066f30 0x7f78400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.363+0000 7f78537fe700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7840066f30 0x7f78400693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f78540c38c0 tx=0x7f7848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.367+0000 7f783bfff700 1 -- 172.21.15.86:0/3870899708 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7844052cc0 con 0x7f785406a2b0 2023-10-09T11:41:55.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.558+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f785404c3c0 con 0x7f785406a2b0 2023-10-09T11:41:55.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.559+0000 7f783bfff700 1 -- 172.21.15.86:0/3870899708 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+15587 (secure 0 0 0) 0x7f7844015090 con 0x7f785406a2b0 2023-10-09T11:41:55.560 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:41:55.560 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":24,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:41:55.215830+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:09.500279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:10.496954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:55.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7840066f30 msgr2=0x7f78400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7840066f30 0x7f78400693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f78540c38c0 tx=0x7f7848009040 comp rx=0 tx=0).stop 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f785406a2b0 msgr2=0x7f7854157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f785406a2b0 0x7f7854157980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7844006f50 tx=0x7f7844017000 comp rx=0 tx=0).stop 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 shutdown_connections 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7840066f30 0x7f78400693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f785406a2b0 0x7f7854157980 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7854159db0 0x7f785414de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.561+0000 7f785a5ff700 1 --2- 172.21.15.86:0/3870899708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78541599e0 0x7f7854158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.562+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 >> 172.21.15.86:0/3870899708 conn(0x7f78540c9860 msgr2=0x7f785406b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.562+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 shutdown_connections 2023-10-09T11:41:55.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.562+0000 7f785a5ff700 1 -- 172.21.15.86:0/3870899708 wait complete. 2023-10-09T11:41:55.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:41:55.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.760+0000 7f192fbff700 1 Processor -- start 2023-10-09T11:41:55.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.760+0000 7f192fbff700 1 -- start start 2023-10-09T11:41:55.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192fbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 0x7f1928162530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192fbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280cb300 con 0x7f19280b1850 2023-10-09T11:41:55.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192fbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280cb5e0 con 0x7f19280b1c20 2023-10-09T11:41:55.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192fbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192806fc30 con 0x7f19281579f0 2023-10-09T11:41:55.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192d99b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f19280b1850 0x7f19280ae680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33046/0 (socket says 172.21.15.86:33046) 2023-10-09T11:41:55.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192d99b700 1 -- 172.21.15.86:0/2769167491 learned_addr learned my addr 172.21.15.86:0/2769167491 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430023365 0 0) 0x7f19280cb300 con 0x7f19280b1850 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.762+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1914003570 con 0x7f19280b1850 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192e19c700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 0x7f1928162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 616468298 0 0) 0x7f1914003570 con 0x7f19280b1850 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 msgr2=0x7f1928162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 0x7f1928162530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 >> v1:172.21.15.135:6789/0 conn(0x7f19280b1c20 legacy=0x7f19281572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280cb8c0 con 0x7f19280b1850 2023-10-09T11:41:55.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f1924001470 con 0x7f19280b1850 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 >> v1:172.21.15.86:6789/0 conn(0x7f19280b1850 legacy=0x7f19280ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914003a90 0x7f1914003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1914004810 0x7f1914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 0x7f191400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192806fc30 con 0x7f1914004810 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914005520 con 0x7f1914003a90 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140056e0 con 0x7f19281579f0 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192d19a700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1914004810 0x7f1914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192d99b700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914003a90 0x7f1914003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.763+0000 7f192e19c700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 0x7f191400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192d19a700 1 -- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 msgr2=0x7f191400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192d19a700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19281579f0 0x7f191400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192d19a700 1 -- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914003a90 msgr2=0x7f1914003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192d19a700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914003a90 0x7f1914003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192d19a700 1 -- 172.21.15.86:0/2769167491 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914003570 con 0x7f1914004810 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192d19a700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1914004810 0x7f1914004c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f19180018e0 tx=0x7f1918007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83eebaa4cc8673ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918012420 con 0x7f1914004810 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918012580 con 0x7f1914004810 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192c999700 1 -- 172.21.15.86:0/2769167491 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918012920 con 0x7f1914004810 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192fbff700 1 -- 172.21.15.86:0/2769167491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1914004810 msgr2=0x7f1914004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192fbff700 1 --2- 172.21.15.86:0/2769167491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1914004810 0x7f1914004c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f19180018e0 tx=0x7f1918007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.764+0000 7f192e19c700 1 -- 172.21.15.86:0/2769167491 reap_dead start 2023-10-09T11:41:55.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.765+0000 7f192fbff700 1 -- 172.21.15.86:0/2769167491 shutdown_connections 2023-10-09T11:41:55.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.765+0000 7f192fbff700 1 -- 172.21.15.86:0/2769167491 >> 172.21.15.86:0/2769167491 conn(0x7f192806a320 msgr2=0x7f19280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.765+0000 7f192fbff700 1 -- 172.21.15.86:0/2769167491 shutdown_connections 2023-10-09T11:41:55.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.765+0000 7f192fbff700 1 -- 172.21.15.86:0/2769167491 wait complete. 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.766+0000 7f192fbff700 1 Processor -- start 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.766+0000 7f192fbff700 1 -- start start 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192fbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914004810 0x7f192814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192fbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f192814add0 0x7f192814b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192fbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19280af900 0x7f19280afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192fbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280cc260 con 0x7f19280af900 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192fbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280b02e0 con 0x7f1914004810 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192fbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1928137a00 con 0x7f192814add0 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192e19c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19280af900 0x7f19280afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192e19c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19280af900 0x7f19280afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51922/0 (socket says 172.21.15.86:51922) 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.767+0000 7f192e19c700 1 -- 172.21.15.86:0/3249907829 learned_addr learned my addr 172.21.15.86:0/3249907829 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192d19a700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f192814add0 0x7f192814b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192e19c700 1 -- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f192814add0 msgr2=0x7f192814b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192d99b700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914004810 0x7f192814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192e19c700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f192814add0 0x7f192814b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192e19c700 1 -- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914004810 msgr2=0x7f192814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192e19c700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914004810 0x7f192814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192e19c700 1 -- 172.21.15.86:0/3249907829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192816d150 con 0x7f19280af900 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192d19a700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f192814add0 0x7f192814b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192d99b700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914004810 0x7f192814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192e19c700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19280af900 0x7f19280afda0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19280cd3a0 tx=0x7f1920009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f191dffb700 1 -- 172.21.15.86:0/3249907829 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920007040 con 0x7f19280af900 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f191dffb700 1 -- 172.21.15.86:0/3249907829 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920002d50 con 0x7f19280af900 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f191dffb700 1 -- 172.21.15.86:0/3249907829 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920015670 con 0x7f19280af900 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192816d430 con 0x7f19280af900 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.768+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192816d9f0 con 0x7f19280af900 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.769+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192804c3c0 con 0x7f19280af900 2023-10-09T11:41:55.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.770+0000 7f191dffb700 1 -- 172.21.15.86:0/3249907829 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1920003040 con 0x7f19280af900 2023-10-09T11:41:55.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.771+0000 7f191dffb700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f190c066f30 0x7f190c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.772+0000 7f191dffb700 1 -- 172.21.15.86:0/3249907829 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f1920084c60 con 0x7f19280af900 2023-10-09T11:41:55.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.772+0000 7f192d99b700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f190c066f30 0x7f190c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.772+0000 7f192d99b700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f190c066f30 0x7f190c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1924001c10 tx=0x7f1924009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:55.776+0000 7f191dffb700 1 -- 172.21.15.86:0/3249907829 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1920051e60 con 0x7f19280af900 2023-10-09T11:41:56.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.012+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f19280cbba0 con 0x7f19280af900 2023-10-09T11:41:56.013 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T11:41:56.013+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:41:56.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.017+0000 7f191dffb700 1 -- 172.21.15.86:0/3249907829 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1920055480 con 0x7f19280af900 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f190c066f30 msgr2=0x7f190c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f190c066f30 0x7f190c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1924001c10 tx=0x7f1924009040 comp rx=0 tx=0).stop 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19280af900 msgr2=0x7f19280afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19280af900 0x7f19280afda0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19280cd3a0 tx=0x7f1920009710 comp rx=0 tx=0).stop 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 shutdown_connections 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f190c066f30 0x7f190c0693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19280af900 0x7f19280afda0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1914004810 0x7f192814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 --2- 172.21.15.86:0/3249907829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f192814add0 0x7f192814b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 >> 172.21.15.86:0/3249907829 conn(0x7f192806a320 msgr2=0x7f192814e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:56.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 shutdown_connections 2023-10-09T11:41:56.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.020+0000 7f192fbff700 1 -- 172.21.15.86:0/3249907829 wait complete. 2023-10-09T11:41:56.022 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:41:56.023 INFO:tasks.ceph.mds.d.smithi135.stderr: -2000> 2023-10-09T11:41:17.704+0000 7fb504ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:56.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:41:56.062 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:41:56.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.222+0000 7ff57adff700 1 Processor -- start 2023-10-09T11:41:56.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.222+0000 7ff57adff700 1 -- start start 2023-10-09T11:41:56.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff57adff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff5740c83f0 0x7ff5740c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff57adff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5741568e0 0x7ff5740ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff57adff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57415b0d0 con 0x7ff5740ccee0 2023-10-09T11:41:56.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff57adff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5740c7a60 con 0x7ff5741568e0 2023-10-09T11:41:56.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff57adff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57415a4c0 con 0x7ff5740c83f0 2023-10-09T11:41:56.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff57939c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5741568e0 0x7ff5740ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff573fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff5740ccee0 0x7ff5741561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:58972/0 (socket says 172.21.15.86:58972) 2023-10-09T11:41:56.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff573fff700 1 -- 172.21.15.86:0/3524518324 learned_addr learned my addr 172.21.15.86:0/3524518324 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:56.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.224+0000 7ff578b9b700 1 --2- 172.21.15.86:0/3524518324 >> v2:172.21.15.135:3300/0 conn(0x7ff5740c83f0 0x7ff5740c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.225+0000 7ff57939c700 1 -- 172.21.15.86:0/3524518324 >> v2:172.21.15.135:3300/0 conn(0x7ff5740c83f0 msgr2=0x7ff5740c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:56.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.225+0000 7ff57939c700 1 --2- 172.21.15.86:0/3524518324 >> v2:172.21.15.135:3300/0 conn(0x7ff5740c83f0 0x7ff5740c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.225+0000 7ff57939c700 1 -- 172.21.15.86:0/3524518324 >> v1:172.21.15.135:6789/0 conn(0x7ff5740ccee0 legacy=0x7ff5741561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.225+0000 7ff57939c700 1 -- 172.21.15.86:0/3524518324 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57415a7a0 con 0x7ff5741568e0 2023-10-09T11:41:56.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.225+0000 7ff57939c700 1 --2- 172.21.15.86:0/3524518324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5741568e0 0x7ff5740ca1e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c9fd0 tx=0x7ff56c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633248206772e73e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.227+0000 7ff5737fe700 1 -- 172.21.15.86:0/3524518324 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00e070 con 0x7ff5741568e0 2023-10-09T11:41:56.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.227+0000 7ff5737fe700 1 -- 172.21.15.86:0/3524518324 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c00bb60 con 0x7ff5741568e0 2023-10-09T11:41:56.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.227+0000 7ff5737fe700 1 -- 172.21.15.86:0/3524518324 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c012430 con 0x7ff5741568e0 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 -- 172.21.15.86:0/3524518324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5741568e0 msgr2=0x7ff5740ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 --2- 172.21.15.86:0/3524518324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5741568e0 0x7ff5740ca1e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c9fd0 tx=0x7ff56c009780 comp rx=0 tx=0).stop 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 -- 172.21.15.86:0/3524518324 shutdown_connections 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 --2- 172.21.15.86:0/3524518324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5741568e0 0x7ff5740ca1e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 --2- 172.21.15.86:0/3524518324 >> v2:172.21.15.135:3300/0 conn(0x7ff5740c83f0 0x7ff5740c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 -- 172.21.15.86:0/3524518324 >> 172.21.15.86:0/3524518324 conn(0x7ff574068e10 msgr2=0x7ff5740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 -- 172.21.15.86:0/3524518324 shutdown_connections 2023-10-09T11:41:56.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.228+0000 7ff57adff700 1 -- 172.21.15.86:0/3524518324 wait complete. 2023-10-09T11:41:56.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.229+0000 7ff57adff700 1 Processor -- start 2023-10-09T11:41:56.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.230+0000 7ff57adff700 1 -- start start 2023-10-09T11:41:56.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.230+0000 7ff57adff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5740c83f0 0x7ff57414fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.230+0000 7ff57adff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5740ccee0 0x7ff5740c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.230+0000 7ff57adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5741568e0 0x7ff5740b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.230+0000 7ff57adff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff574150310 con 0x7ff5740c83f0 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.230+0000 7ff57adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740b1600 con 0x7ff5741568e0 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.230+0000 7ff57adff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740c1370 con 0x7ff5740ccee0 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5740c83f0 0x7ff57414fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5740c83f0 0x7ff57414fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51936/0 (socket says 172.21.15.86:51936) 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 -- 172.21.15.86:0/1119918193 learned_addr learned my addr 172.21.15.86:0/1119918193 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff573fff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5740ccee0 0x7ff5740c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff57939c700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5741568e0 0x7ff5740b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 -- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5740ccee0 msgr2=0x7ff5740c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5740ccee0 0x7ff5740c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 -- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5741568e0 msgr2=0x7ff5740b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5741568e0 0x7ff5740b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 -- 172.21.15.86:0/1119918193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c009a20 con 0x7ff5740c83f0 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff573fff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5740ccee0 0x7ff5740c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff57939c700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5741568e0 0x7ff5740b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff578b9b700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5740c83f0 0x7ff57414fdd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ec80 tx=0x7ff5680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff570ff9700 1 -- 172.21.15.86:0/1119918193 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56800c9d0 con 0x7ff5740c83f0 2023-10-09T11:41:56.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff570ff9700 1 -- 172.21.15.86:0/1119918193 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56800cb30 con 0x7ff5740c83f0 2023-10-09T11:41:56.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5740c1650 con 0x7ff5740c83f0 2023-10-09T11:41:56.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.231+0000 7ff570ff9700 1 -- 172.21.15.86:0/1119918193 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568013470 con 0x7ff5740c83f0 2023-10-09T11:41:56.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.232+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5740c1c10 con 0x7ff5740c83f0 2023-10-09T11:41:56.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.233+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5740c1f80 con 0x7ff5740c83f0 2023-10-09T11:41:56.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.233+0000 7ff570ff9700 1 -- 172.21.15.86:0/1119918193 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff568013820 con 0x7ff5740c83f0 2023-10-09T11:41:56.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.234+0000 7ff570ff9700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff558066f30 0x7ff5580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.234+0000 7ff570ff9700 1 -- 172.21.15.86:0/1119918193 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5907+0+0 (secure 0 0 0) 0x7ff568084970 con 0x7ff5740c83f0 2023-10-09T11:41:56.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.235+0000 7ff573fff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff558066f30 0x7ff5580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.235+0000 7ff573fff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff558066f30 0x7ff5580693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff5600058d0 tx=0x7ff560009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.238+0000 7ff570ff9700 1 -- 172.21.15.86:0/1119918193 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff568051b10 con 0x7ff5740c83f0 2023-10-09T11:41:56.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:56.470+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff57404c3c0 con 0x7ff5740c83f0 2023-10-09T11:41:57.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.018+0000 7ff570ff9700 1 -- 172.21.15.86:0/1119918193 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff568055130 con 0x7ff5740c83f0 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff558066f30 msgr2=0x7ff5580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff558066f30 0x7ff5580693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff5600058d0 tx=0x7ff560009040 comp rx=0 tx=0).stop 2023-10-09T11:41:57.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5740c83f0 msgr2=0x7ff57414fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5740c83f0 0x7ff57414fdd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ec80 tx=0x7ff5680091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 shutdown_connections 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff558066f30 0x7ff5580693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5740c83f0 0x7ff57414fdd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5741568e0 0x7ff5740b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 --2- 172.21.15.86:0/1119918193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5740ccee0 0x7ff5740c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 >> 172.21.15.86:0/1119918193 conn(0x7ff574068e10 msgr2=0x7ff574151ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.021+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 shutdown_connections 2023-10-09T11:41:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.022+0000 7ff57adff700 1 -- 172.21.15.86:0/1119918193 wait complete. 2023-10-09T11:41:57.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:41:57.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.226+0000 7f44b41ff700 1 Processor -- start 2023-10-09T11:41:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.226+0000 7f44b41ff700 1 -- start start 2023-10-09T11:41:57.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.227+0000 7f44b41ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.227+0000 7f44b41ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac15a9b0 con 0x7f44ac068890 2023-10-09T11:41:57.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.227+0000 7f44b41ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac15ac90 con 0x7f44ac1563b0 2023-10-09T11:41:57.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.227+0000 7f44b41ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac15af70 con 0x7f44ac15a440 2023-10-09T11:41:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.228+0000 7f44b279c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f44ac068890 0x7f44ac0c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33060/0 (socket says 172.21.15.86:33060) 2023-10-09T11:41:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.228+0000 7f44b279c700 1 -- 172.21.15.86:0/1243737515 learned_addr learned my addr 172.21.15.86:0/1243737515 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.228+0000 7f44b179a700 1 --2- 172.21.15.86:0/1243737515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.228+0000 7f44b179a700 1 -- 172.21.15.86:0/1243737515 >> v1:172.21.15.135:6789/0 conn(0x7f44ac1563b0 legacy=0x7f44ac156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.228+0000 7f44b179a700 1 -- 172.21.15.86:0/1243737515 >> v1:172.21.15.86:6789/0 conn(0x7f44ac068890 legacy=0x7f44ac0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.228+0000 7f44b179a700 1 -- 172.21.15.86:0/1243737515 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac15b250 con 0x7f44ac15a440 2023-10-09T11:41:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.229+0000 7f44b179a700 1 --2- 172.21.15.86:0/1243737515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0acf30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f449c009910 tx=0x7f449c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bbd61a50db75f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.230+0000 7f44b0f99700 1 -- 172.21.15.86:0/1243737515 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00b860 con 0x7f44ac15a440 2023-10-09T11:41:57.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.230+0000 7f44b0f99700 1 -- 172.21.15.86:0/1243737515 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00b9c0 con 0x7f44ac15a440 2023-10-09T11:41:57.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.230+0000 7f44b0f99700 1 -- 172.21.15.86:0/1243737515 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00bd60 con 0x7f44ac15a440 2023-10-09T11:41:57.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.231+0000 7f44b41ff700 1 -- 172.21.15.86:0/1243737515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 msgr2=0x7f44ac0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.231+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1243737515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0acf30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f449c009910 tx=0x7f449c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.231+0000 7f44b41ff700 1 -- 172.21.15.86:0/1243737515 shutdown_connections 2023-10-09T11:41:57.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.231+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1243737515 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0acf30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.231+0000 7f44b41ff700 1 -- 172.21.15.86:0/1243737515 >> 172.21.15.86:0/1243737515 conn(0x7f44ac0c8f90 msgr2=0x7f44ac0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.231+0000 7f44b41ff700 1 -- 172.21.15.86:0/1243737515 shutdown_connections 2023-10-09T11:41:57.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.231+0000 7f44b41ff700 1 -- 172.21.15.86:0/1243737515 wait complete. 2023-10-09T11:41:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.232+0000 7f44b41ff700 1 Processor -- start 2023-10-09T11:41:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.233+0000 7f44b41ff700 1 -- start start 2023-10-09T11:41:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.233+0000 7f44b41ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44ac068890 0x7f44ac1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.233+0000 7f44b41ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ac1563b0 0x7f44ac0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.233+0000 7f44b41ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.233+0000 7f44b41ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0caca0 con 0x7f44ac068890 2023-10-09T11:41:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.233+0000 7f44b41ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac15cdd0 con 0x7f44ac1563b0 2023-10-09T11:41:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.233+0000 7f44b41ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0ca370 con 0x7f44ac15a440 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44ac068890 0x7f44ac1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44ac068890 0x7f44ac1487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51946/0 (socket says 172.21.15.86:51946) 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 -- 172.21.15.86:0/1175195191 learned_addr learned my addr 172.21.15.86:0/1175195191 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b279c700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b179a700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ac1563b0 0x7f44ac0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 -- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 msgr2=0x7f44ac0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 -- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ac1563b0 msgr2=0x7f44ac0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ac1563b0 0x7f44ac0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 -- 172.21.15.86:0/1175195191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009420 con 0x7f44ac068890 2023-10-09T11:41:57.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b1f9b700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44ac068890 0x7f44ac1487c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f44a800c590 tx=0x7f44a800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44a1ffb700 1 -- 172.21.15.86:0/1175195191 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8011590 con 0x7f44ac068890 2023-10-09T11:41:57.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44a1ffb700 1 -- 172.21.15.86:0/1175195191 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a80116f0 con 0x7f44ac068890 2023-10-09T11:41:57.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.234+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac0ca650 con 0x7f44ac068890 2023-10-09T11:41:57.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.235+0000 7f44a1ffb700 1 -- 172.21.15.86:0/1175195191 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8011ab0 con 0x7f44ac068890 2023-10-09T11:41:57.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.235+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac169df0 con 0x7f44ac068890 2023-10-09T11:41:57.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.236+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac0718b0 con 0x7f44ac068890 2023-10-09T11:41:57.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.236+0000 7f44a1ffb700 1 -- 172.21.15.86:0/1175195191 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44a801b3b0 con 0x7f44ac068890 2023-10-09T11:41:57.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.237+0000 7f44a1ffb700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4490066f30 0x7f44900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.237+0000 7f44a1ffb700 1 -- 172.21.15.86:0/1175195191 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f44a8083c50 con 0x7f44ac068890 2023-10-09T11:41:57.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.237+0000 7f44b179a700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4490066f30 0x7f44900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.238+0000 7f44b179a700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4490066f30 0x7f44900693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f449c0093f0 tx=0x7f449c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.241+0000 7f44a1ffb700 1 -- 172.21.15.86:0/1175195191 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44a8050d50 con 0x7f44ac068890 2023-10-09T11:41:57.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:57.431+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44ac06d6a0 con 0x7f44ac068890 2023-10-09T11:41:58.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.236+0000 7f44a1ffb700 1 -- 172.21.15.86:0/1175195191 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f44a8017020 con 0x7f44ac068890 2023-10-09T11:41:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4490066f30 msgr2=0x7f44900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4490066f30 0x7f44900693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f449c0093f0 tx=0x7f449c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44ac068890 msgr2=0x7f44ac1487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44ac068890 0x7f44ac1487c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f44a800c590 tx=0x7f44a800c950 comp rx=0 tx=0).stop 2023-10-09T11:41:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 shutdown_connections 2023-10-09T11:41:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4490066f30 0x7f44900693e0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f449c0093f0 tx=0x7f449c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:58.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44ac068890 0x7f44ac1487c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44ac15a440 0x7f44ac0b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 --2- 172.21.15.86:0/1175195191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ac1563b0 0x7f44ac0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.241+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 >> 172.21.15.86:0/1175195191 conn(0x7f44ac0c8f90 msgr2=0x7f44ac1548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.242+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 shutdown_connections 2023-10-09T11:41:58.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.242+0000 7f44b41ff700 1 -- 172.21.15.86:0/1175195191 wait complete. 2023-10-09T11:41:58.245 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:41:58.265 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:41:58.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.452+0000 7fe05219d700 1 Processor -- start 2023-10-09T11:41:58.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.452+0000 7fe05219d700 1 -- start start 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05219d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe04c0b03c0 0x7fe04c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05219d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe04c0b0790 0x7fe04c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05219d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0cfa00 con 0x7fe04c1591e0 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05219d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0cb580 con 0x7fe04c0b03c0 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05219d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0b2de0 con 0x7fe04c0b0790 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05119b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe04c0b03c0 0x7fe04c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05119b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe04c0b03c0 0x7fe04c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51958/0 (socket says 172.21.15.86:51958) 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.453+0000 7fe05119b700 1 -- 172.21.15.86:0/2036488195 learned_addr learned my addr 172.21.15.86:0/2036488195 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe05099a700 1 --2- 172.21.15.86:0/2036488195 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0b0790 0x7fe04c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe05119b700 1 -- 172.21.15.86:0/2036488195 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0b0790 msgr2=0x7fe04c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe05119b700 1 --2- 172.21.15.86:0/2036488195 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0b0790 0x7fe04c0b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe05119b700 1 -- 172.21.15.86:0/2036488195 >> v1:172.21.15.135:6789/0 conn(0x7fe04c1591e0 legacy=0x7fe04c159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe05119b700 1 -- 172.21.15.86:0/2036488195 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0cf160 con 0x7fe04c0b03c0 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe05099a700 1 --2- 172.21.15.86:0/2036488195 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0b0790 0x7fe04c0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe05119b700 1 --2- 172.21.15.86:0/2036488195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0cea70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0480099b0 tx=0x7fe048009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3e75559e1a6591 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe043fff700 1 -- 172.21.15.86:0/2036488195 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800b7e0 con 0x7fe04c0b03c0 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe043fff700 1 -- 172.21.15.86:0/2036488195 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800b940 con 0x7fe04c0b03c0 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.454+0000 7fe043fff700 1 -- 172.21.15.86:0/2036488195 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800bd00 con 0x7fe04c0b03c0 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 -- 172.21.15.86:0/2036488195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 msgr2=0x7fe04c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 --2- 172.21.15.86:0/2036488195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0cea70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0480099b0 tx=0x7fe048009250 comp rx=0 tx=0).stop 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 -- 172.21.15.86:0/2036488195 shutdown_connections 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 --2- 172.21.15.86:0/2036488195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0cea70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 --2- 172.21.15.86:0/2036488195 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0b0790 0x7fe04c0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 -- 172.21.15.86:0/2036488195 >> 172.21.15.86:0/2036488195 conn(0x7fe04c063230 msgr2=0x7fe04c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 -- 172.21.15.86:0/2036488195 shutdown_connections 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.455+0000 7fe05219d700 1 -- 172.21.15.86:0/2036488195 wait complete. 2023-10-09T11:41:58.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.456+0000 7fe05219d700 1 Processor -- start 2023-10-09T11:41:58.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.457+0000 7fe05219d700 1 -- start start 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.457+0000 7fe05219d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.457+0000 7fe05219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0b0790 0x7fe04c1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.457+0000 7fe05219d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c1591e0 0x7fe04c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.457+0000 7fe05219d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c153370 con 0x7fe04c0b03c0 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.457+0000 7fe05219d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0c6b20 con 0x7fe04c1591e0 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.457+0000 7fe05219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c157b10 con 0x7fe04c0b0790 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51974/0 (socket says 172.21.15.86:51974) 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 -- 172.21.15.86:0/2615948643 learned_addr learned my addr 172.21.15.86:0/2615948643 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05199c700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c1591e0 0x7fe04c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05099a700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0b0790 0x7fe04c1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 -- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0b0790 msgr2=0x7fe04c1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0b0790 0x7fe04c1575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 -- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c1591e0 msgr2=0x7fe04c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c1591e0 0x7fe04c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 -- 172.21.15.86:0/2615948643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480094f0 con 0x7fe04c0b03c0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05199c700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c1591e0 0x7fe04c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05099a700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0b0790 0x7fe04c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05119b700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0c65e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0cfe40 tx=0x7fe048016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe0417fa700 1 -- 172.21.15.86:0/2615948643 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048006a90 con 0x7fe04c0b03c0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe0417fa700 1 -- 172.21.15.86:0/2615948643 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048020070 con 0x7fe04c0b03c0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe0417fa700 1 -- 172.21.15.86:0/2615948643 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04801b450 con 0x7fe04c0b03c0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.458+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c0c6150 con 0x7fe04c0b03c0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.459+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c0c5820 con 0x7fe04c0b03c0 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.459+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c04c3c0 con 0x7fe04c0b03c0 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.460+0000 7fe0417fa700 1 -- 172.21.15.86:0/2615948643 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe048022030 con 0x7fe04c0b03c0 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.461+0000 7fe0417fa700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe030066f30 0x7fe0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.461+0000 7fe0417fa700 1 -- 172.21.15.86:0/2615948643 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5469+0+0 (secure 0 0 0) 0x7fe048086340 con 0x7fe04c0b03c0 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.461+0000 7fe05099a700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe030066f30 0x7fe0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.462+0000 7fe05099a700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe030066f30 0x7fe0300693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe03c008b20 tx=0x7fe03c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.465+0000 7fe0417fa700 1 -- 172.21.15.86:0/2615948643 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe048053600 con 0x7fe04c0b03c0 2023-10-09T11:41:58.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:58.662+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe04c04c3c0 con 0x7fe04c0b03c0 2023-10-09T11:41:59.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.241+0000 7fe0417fa700 1 -- 172.21.15.86:0/2615948643 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe048056c20 con 0x7fe04c0b03c0 2023-10-09T11:41:59.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.246+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe030066f30 msgr2=0x7fe0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.246+0000 7fe05219d700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe030066f30 0x7fe0300693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe03c008b20 tx=0x7fe03c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:59.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.246+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 msgr2=0x7fe04c0c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.246+0000 7fe05219d700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0c65e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0cfe40 tx=0x7fe048016000 comp rx=0 tx=0).stop 2023-10-09T11:41:59.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.248+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 shutdown_connections 2023-10-09T11:41:59.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.248+0000 7fe05219d700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe030066f30 0x7fe0300693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.248+0000 7fe05219d700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe04c0b03c0 0x7fe04c0c65e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.248+0000 7fe05219d700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c1591e0 0x7fe04c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.248+0000 7fe05219d700 1 --2- 172.21.15.86:0/2615948643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0b0790 0x7fe04c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.248+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 >> 172.21.15.86:0/2615948643 conn(0x7fe04c063230 msgr2=0x7fe04c068860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.249+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 shutdown_connections 2023-10-09T11:41:59.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.249+0000 7fe05219d700 1 -- 172.21.15.86:0/2615948643 wait complete. 2023-10-09T11:41:59.251 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T11:41:59.270 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:41:59.270 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:41:59.270 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:41:59.270 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:59.270 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:41:59.271 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:41:59.271 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:41:59.271 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:59.271 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:41:59.271 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:41:59.271 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:41:59.271 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:59.272 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:41:59.272 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:41:59.272 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:41:59.272 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:59.285 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:41:59.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:41:59.286 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:41:59.286 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:41:59.290 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:41:59.290 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:41:59.291 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:41:59.291 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:41:59.330 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:41:59.330 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:59.332 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:41:59.332 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:59.336 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:41:59.336 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:59.338 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:41:59.339 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:59.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:41:59.467 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:41:59.468 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:41:59.481 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T11:41:59.481 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:41:59.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.534+0000 7f73fe1ff700 1 Processor -- start 2023-10-09T11:41:59.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.534+0000 7f73fe1ff700 1 -- start start 2023-10-09T11:41:59.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.535+0000 7f73fe1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f73f8069560 0x7f73f80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.535+0000 7f73fe1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f8069ee0 con 0x7f73f8159890 2023-10-09T11:41:59.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.535+0000 7f73fe1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f815a160 con 0x7f73f8159c60 2023-10-09T11:41:59.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.535+0000 7f73fe1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80d13a0 con 0x7f73f8069560 2023-10-09T11:41:59.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.535+0000 7f73f77fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f73f8159890 0x7f73f815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33088/0 (socket says 172.21.15.86:33088) 2023-10-09T11:41:59.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.535+0000 7f73f77fe700 1 -- 172.21.15.86:0/1152642358 learned_addr learned my addr 172.21.15.86:0/1152642358 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:41:59.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.535+0000 7f73f7fff700 1 --2- 172.21.15.86:0/1152642358 >> v2:172.21.15.86:3300/0 conn(0x7f73f8069560 0x7f73f80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f67fc700 1 -- 172.21.15.86:0/1152642358 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123045545 0 0) 0x7f73f8069ee0 con 0x7f73f8159890 2023-10-09T11:41:59.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f7fff700 1 -- 172.21.15.86:0/1152642358 >> v1:172.21.15.135:6789/0 conn(0x7f73f8159c60 legacy=0x7f73f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f7fff700 1 -- 172.21.15.86:0/1152642358 >> v1:172.21.15.86:6789/0 conn(0x7f73f8159890 legacy=0x7f73f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f7fff700 1 -- 172.21.15.86:0/1152642358 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f815e140 con 0x7f73f8069560 2023-10-09T11:41:59.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f7fff700 1 --2- 172.21.15.86:0/1152642358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f80699a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009e60 tx=0x7f73f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a84fc22f7778a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f67fc700 1 -- 172.21.15.86:0/1152642358 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000e070 con 0x7f73f8069560 2023-10-09T11:41:59.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f67fc700 1 -- 172.21.15.86:0/1152642358 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000bc30 con 0x7f73f8069560 2023-10-09T11:41:59.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.536+0000 7f73f67fc700 1 -- 172.21.15.86:0/1152642358 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0012430 con 0x7f73f8069560 2023-10-09T11:41:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.537+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1152642358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 msgr2=0x7f73f80699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.537+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1152642358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f80699a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009e60 tx=0x7f73f0009780 comp rx=0 tx=0).stop 2023-10-09T11:41:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.537+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1152642358 shutdown_connections 2023-10-09T11:41:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.537+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1152642358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f80699a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.537+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1152642358 >> 172.21.15.86:0/1152642358 conn(0x7f73f8068e20 msgr2=0x7f73f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.537+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1152642358 shutdown_connections 2023-10-09T11:41:59.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.537+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1152642358 wait complete. 2023-10-09T11:41:59.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.538+0000 7f73fe1ff700 1 Processor -- start 2023-10-09T11:41:59.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.538+0000 7f73fe1ff700 1 -- start start 2023-10-09T11:41:59.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73fe1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73fe1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73f8159890 0x7f73f80c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73fe1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73f8159c60 0x7f73f80cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73fe1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80cde50 con 0x7f73f8069560 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73fe1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8149850 con 0x7f73f8159890 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73fe1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80cd240 con 0x7f73f8159c60 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f8149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52030/0 (socket says 172.21.15.86:52030) 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.539+0000 7f73f77fe700 1 -- 172.21.15.86:0/1532784331 learned_addr learned my addr 172.21.15.86:0/1532784331 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f7fff700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73f8159c60 0x7f73f80cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f6ffd700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73f8159890 0x7f73f80c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f77fe700 1 -- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73f8159c60 msgr2=0x7f73f80cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f77fe700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73f8159c60 0x7f73f80cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f77fe700 1 -- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73f8159890 msgr2=0x7f73f80c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f77fe700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73f8159890 0x7f73f80c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f77fe700 1 -- 172.21.15.86:0/1532784331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0009a20 con 0x7f73f8069560 2023-10-09T11:41:59.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73f77fe700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f8149310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f73e800c7e0 tx=0x7f73e8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73df7fe700 1 -- 172.21.15.86:0/1532784331 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8005b30 con 0x7f73f8069560 2023-10-09T11:41:59.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73df7fe700 1 -- 172.21.15.86:0/1532784331 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8005c90 con 0x7f73f8069560 2023-10-09T11:41:59.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.540+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f80cd520 con 0x7f73f8069560 2023-10-09T11:41:59.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.541+0000 7f73df7fe700 1 -- 172.21.15.86:0/1532784331 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8007300 con 0x7f73f8069560 2023-10-09T11:41:59.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.541+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f80cdae0 con 0x7f73f8069560 2023-10-09T11:41:59.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.542+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f80b2e40 con 0x7f73f8069560 2023-10-09T11:41:59.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.542+0000 7f73df7fe700 1 -- 172.21.15.86:0/1532784331 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73e801b3b0 con 0x7f73f8069560 2023-10-09T11:41:59.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.543+0000 7f73df7fe700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f73e4066f30 0x7f73e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.543+0000 7f73df7fe700 1 -- 172.21.15.86:0/1532784331 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f73e8083750 con 0x7f73f8069560 2023-10-09T11:41:59.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.544+0000 7f73f6ffd700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f73e4066f30 0x7f73e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.544+0000 7f73f6ffd700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f73e4066f30 0x7f73e40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f73f80ca3b0 tx=0x7f73ec007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.547+0000 7f73df7fe700 1 -- 172.21.15.86:0/1532784331 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73e8050cc0 con 0x7f73f8069560 2023-10-09T11:41:59.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:41:59.750+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f73f804c3c0 con 0x7f73f8069560 2023-10-09T11:42:00.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.255+0000 7f73df7fe700 1 -- 172.21.15.86:0/1532784331 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f73e8017080 con 0x7f73f8069560 2023-10-09T11:42:00.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f73e4066f30 msgr2=0x7f73e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f73e4066f30 0x7f73e40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f73f80ca3b0 tx=0x7f73ec007ea0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 msgr2=0x7f73f8149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f8149310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f73e800c7e0 tx=0x7f73e8007df0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 shutdown_connections 2023-10-09T11:42:00.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f73e4066f30 0x7f73e40693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73f8069560 0x7f73f8149310 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73f8159c60 0x7f73f80cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 --2- 172.21.15.86:0/1532784331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73f8159890 0x7f73f80c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 >> 172.21.15.86:0/1532784331 conn(0x7f73f8068e20 msgr2=0x7f73f8155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 shutdown_connections 2023-10-09T11:42:00.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.258+0000 7f73fe1ff700 1 -- 172.21.15.86:0/1532784331 wait complete. 2023-10-09T11:42:00.260 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T11:42:00.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:42:00.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.457+0000 7f4b1cfff700 1 Processor -- start 2023-10-09T11:42:00.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.457+0000 7f4b1cfff700 1 -- start start 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b1cfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b18155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b1cfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b180ac230 0x7f4b180ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b1cfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180ad930 con 0x7f4b181568a0 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b1cfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b180acd20 con 0x7f4b180ac230 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b1cfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180ad000 con 0x7f4b18155c10 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b0ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b180ac230 0x7f4b180ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b0ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b180ac230 0x7f4b180ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52042/0 (socket says 172.21.15.86:52042) 2023-10-09T11:42:00.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b0ffff700 1 -- 172.21.15.86:0/648442005 learned_addr learned my addr 172.21.15.86:0/648442005 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:00.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b1659c700 1 --2- 172.21.15.86:0/648442005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b18155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b0ffff700 1 -- 172.21.15.86:0/648442005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 msgr2=0x7f4b18155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b0ffff700 1 --2- 172.21.15.86:0/648442005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b18155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b0ffff700 1 -- 172.21.15.86:0/648442005 >> v1:172.21.15.135:6789/0 conn(0x7f4b181568a0 legacy=0x7f4b18156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.459+0000 7f4b0ffff700 1 -- 172.21.15.86:0/648442005 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180ad2e0 con 0x7f4b180ac230 2023-10-09T11:42:00.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.460+0000 7f4b0ffff700 1 --2- 172.21.15.86:0/648442005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b180ac6a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a94503e93f09113 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.460+0000 7f4b15d9b700 1 -- 172.21.15.86:0/648442005 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000b860 con 0x7f4b180ac230 2023-10-09T11:42:00.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.460+0000 7f4b15d9b700 1 -- 172.21.15.86:0/648442005 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0000b9c0 con 0x7f4b180ac230 2023-10-09T11:42:00.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.460+0000 7f4b15d9b700 1 -- 172.21.15.86:0/648442005 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000bd60 con 0x7f4b180ac230 2023-10-09T11:42:00.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.460+0000 7f4b1cfff700 1 -- 172.21.15.86:0/648442005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 msgr2=0x7f4b180ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.460+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/648442005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b180ac6a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00009250 comp rx=0 tx=0).stop 2023-10-09T11:42:00.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.461+0000 7f4b1cfff700 1 -- 172.21.15.86:0/648442005 shutdown_connections 2023-10-09T11:42:00.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.461+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/648442005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b18155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.461+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/648442005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b180ac6a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.461+0000 7f4b1cfff700 1 -- 172.21.15.86:0/648442005 >> 172.21.15.86:0/648442005 conn(0x7f4b1806a320 msgr2=0x7f4b180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.461+0000 7f4b1cfff700 1 -- 172.21.15.86:0/648442005 shutdown_connections 2023-10-09T11:42:00.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.461+0000 7f4b1cfff700 1 -- 172.21.15.86:0/648442005 wait complete. 2023-10-09T11:42:00.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.462+0000 7f4b1cfff700 1 Processor -- start 2023-10-09T11:42:00.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.462+0000 7f4b1cfff700 1 -- start start 2023-10-09T11:42:00.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1cfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b181336c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1cfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b1815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1cfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b181568a0 0x7f4b1814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1cfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1814e090 con 0x7f4b180ac230 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1cfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1814d200 con 0x7f4b181568a0 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1cfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1814d480 con 0x7f4b18155c10 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b181336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b181336c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52048/0 (socket says 172.21.15.86:52048) 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.463+0000 7f4b1659c700 1 -- 172.21.15.86:0/1784457741 learned_addr learned my addr 172.21.15.86:0/1784457741 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:00.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b16d9d700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b181568a0 0x7f4b1814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b0ffff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b1815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1659c700 1 -- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 msgr2=0x7f4b1815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1659c700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b1815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1659c700 1 -- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b181568a0 msgr2=0x7f4b1814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1659c700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b181568a0 0x7f4b1814b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1659c700 1 -- 172.21.15.86:0/1784457741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b000094f0 con 0x7f4b180ac230 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1659c700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b181336c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800d890 tx=0x7f4b08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b0e7fc700 1 -- 172.21.15.86:0/1784457741 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080125f0 con 0x7f4b180ac230 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b0e7fc700 1 -- 172.21.15.86:0/1784457741 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b08012770 con 0x7f4b180ac230 2023-10-09T11:42:00.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1814d760 con 0x7f4b180ac230 2023-10-09T11:42:00.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b0e7fc700 1 -- 172.21.15.86:0/1784457741 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08012b30 con 0x7f4b180ac230 2023-10-09T11:42:00.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.464+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1814dd20 con 0x7f4b180ac230 2023-10-09T11:42:00.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.465+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1804c3c0 con 0x7f4b180ac230 2023-10-09T11:42:00.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.466+0000 7f4b0e7fc700 1 -- 172.21.15.86:0/1784457741 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b0801e460 con 0x7f4b180ac230 2023-10-09T11:42:00.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.468+0000 7f4b0e7fc700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4af8066fb0 0x7f4af8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.468+0000 7f4b0e7fc700 1 -- 172.21.15.86:0/1784457741 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4b080849a0 con 0x7f4b180ac230 2023-10-09T11:42:00.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.468+0000 7f4b0ffff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4af8066fb0 0x7f4af8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.468+0000 7f4b0ffff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4af8066fb0 0x7f4af8069460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.472+0000 7f4b0e7fc700 1 -- 172.21.15.86:0/1784457741 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b08051ec0 con 0x7f4b180ac230 2023-10-09T11:42:00.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.734+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4b180ad5c0 con 0x7f4b180ac230 2023-10-09T11:42:00.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.734+0000 7f4b0e7fc700 1 -- 172.21.15.86:0/1784457741 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4b080554e0 con 0x7f4b180ac230 2023-10-09T11:42:00.735 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:00.735 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:42:00.736 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T11:42:00.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.736 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T11:42:00.736 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T11:42:00.736 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.736 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.736 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.737 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.738 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:42:00.739 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T11:42:00.741 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T11:42:00.742 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T11:42:00.743 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.743 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.743 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.743 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.744 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T11:42:00.744 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T11:42:00.744 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.744 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.744 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.744 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.745 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T11:42:00.745 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T11:42:00.745 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.745 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.745 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.746 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.746 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.746 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T11:42:00.746 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T11:42:00.746 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.750 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T11:42:00.751 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.752 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.bootstrap-mds", 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC/5iNl5YRODhAAO3s4t67GmmtYOhOfbm7s+w==", 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile bootstrap-mds" 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.bootstrap-mgr", 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC/5iNl049ODhAArrVlup0Cd6BwdnH0q7NbjQ==", 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.bootstrap-osd", 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC/5iNl/5dODhAAP9RlAT+/3PKEeErbDYjbew==", 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile bootstrap-osd" 2023-10-09T11:42:00.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.bootstrap-rbd", 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC/5iNl26BODhAA7dPHOWcuG+N5M60O6BTOlA==", 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-09T11:42:00.755 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC/5iNlTalODhAAYZGcntEn3v+326ZibsUIRw==", 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.bootstrap-rgw", 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC/5iNlqbFODhAADNuy7JqtvsbYYIW4EYuJAw==", 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.756 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:42:00.757 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:42:00.758 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:00.758 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:42:00.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.758 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:00.758 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T11:42:00.758 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:42:00.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.736+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4af8066fb0 msgr2=0x7f4af8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.736+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4af8066fb0 0x7f4af8069460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00017000 comp rx=0 tx=0).stop 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.736+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 msgr2=0x7f4b181336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.736+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b181336c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800d890 tx=0x7f4b08008040 comp rx=0 tx=0).stop 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 shutdown_connections 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4af8066fb0 0x7f4af8069460 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b180ac230 0x7f4b181336c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b181568a0 0x7f4b1814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 --2- 172.21.15.86:0/1784457741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b18155c10 0x7f4b1815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 >> 172.21.15.86:0/1784457741 conn(0x7f4b1806a320 msgr2=0x7f4b18153350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 shutdown_connections 2023-10-09T11:42:00.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.737+0000 7f4b1cfff700 1 -- 172.21.15.86:0/1784457741 wait complete. 2023-10-09T11:42:00.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-09T11:42:00.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.942+0000 7fdeef59e700 1 Processor -- start 2023-10-09T11:42:00.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.942+0000 7fdeef59e700 1 -- start start 2023-10-09T11:42:00.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.943+0000 7fdeef59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdef00c6c60 0x7fdef00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.943+0000 7fdeef59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef00b1410 con 0x7fdef01595a0 2023-10-09T11:42:00.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.943+0000 7fdeef59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef0063230 con 0x7fdef006e8c0 2023-10-09T11:42:00.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.943+0000 7fdeef59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef00b2b90 con 0x7fdef00c6c60 2023-10-09T11:42:00.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.943+0000 7fdeee59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdef01595a0 0x7fdef00b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33098/0 (socket says 172.21.15.86:33098) 2023-10-09T11:42:00.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.943+0000 7fdeee59c700 1 -- 172.21.15.86:0/1027468071 learned_addr learned my addr 172.21.15.86:0/1027468071 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:00.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.943+0000 7fdeedd9b700 1 --2- 172.21.15.86:0/1027468071 >> v2:172.21.15.86:3300/0 conn(0x7fdef00c6c60 0x7fdef00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeedd9b700 1 -- 172.21.15.86:0/1027468071 >> v1:172.21.15.135:6789/0 conn(0x7fdef006e8c0 legacy=0x7fdef0159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeedd9b700 1 -- 172.21.15.86:0/1027468071 >> v1:172.21.15.86:6789/0 conn(0x7fdef01595a0 legacy=0x7fdef00b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeed59a700 1 -- 172.21.15.86:0/1027468071 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505476080 0 0) 0x7fdef00b1410 con 0x7fdef01595a0 2023-10-09T11:42:00.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeedd9b700 1 -- 172.21.15.86:0/1027468071 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef00634f0 con 0x7fdef00c6c60 2023-10-09T11:42:00.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeedd9b700 1 --2- 172.21.15.86:0/1027468071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef00c8120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdee40098e0 tx=0x7fdee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c8607b374d993 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeed59a700 1 -- 172.21.15.86:0/1027468071 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4009e80 con 0x7fdef00c6c60 2023-10-09T11:42:00.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeed59a700 1 -- 172.21.15.86:0/1027468071 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee400b820 con 0x7fdef00c6c60 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.944+0000 7fdeed59a700 1 -- 172.21.15.86:0/1027468071 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400bba0 con 0x7fdef00c6c60 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.945+0000 7fdeef59e700 1 -- 172.21.15.86:0/1027468071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 msgr2=0x7fdef00c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.945+0000 7fdeef59e700 1 --2- 172.21.15.86:0/1027468071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef00c8120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdee40098e0 tx=0x7fdee40091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.945+0000 7fdeef59e700 1 -- 172.21.15.86:0/1027468071 shutdown_connections 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.945+0000 7fdeef59e700 1 --2- 172.21.15.86:0/1027468071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef00c8120 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.945+0000 7fdeef59e700 1 -- 172.21.15.86:0/1027468071 >> 172.21.15.86:0/1027468071 conn(0x7fdef006ddb0 msgr2=0x7fdef006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.945+0000 7fdeef59e700 1 -- 172.21.15.86:0/1027468071 shutdown_connections 2023-10-09T11:42:00.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.945+0000 7fdeef59e700 1 -- 172.21.15.86:0/1027468071 wait complete. 2023-10-09T11:42:00.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.946+0000 7fdeef59e700 1 Processor -- start 2023-10-09T11:42:00.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.947+0000 7fdeef59e700 1 -- start start 2023-10-09T11:42:00.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.947+0000 7fdeef59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef006e8c0 0x7fdef0169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.947+0000 7fdeef59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.947+0000 7fdeef59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdef01595a0 0x7fdef00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.947+0000 7fdeef59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef015b390 con 0x7fdef00c6c60 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.947+0000 7fdeef59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef015add0 con 0x7fdef01595a0 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.947+0000 7fdeef59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef015b0b0 con 0x7fdef006e8c0 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52070/0 (socket says 172.21.15.86:52070) 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 -- 172.21.15.86:0/2313825486 learned_addr learned my addr 172.21.15.86:0/2313825486 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeeed9d700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdef01595a0 0x7fdef00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeee59c700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef006e8c0 0x7fdef0169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 -- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef006e8c0 msgr2=0x7fdef0169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef006e8c0 0x7fdef0169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 -- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdef01595a0 msgr2=0x7fdef00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdef01595a0 0x7fdef00ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 -- 172.21.15.86:0/2313825486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4009420 con 0x7fdef00c6c60 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.948+0000 7fdeedd9b700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef015a350 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdee40030c0 tx=0x7fdee4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.949+0000 7fdede7fc700 1 -- 172.21.15.86:0/2313825486 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee401b470 con 0x7fdef00c6c60 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.949+0000 7fdede7fc700 1 -- 172.21.15.86:0/2313825486 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee401b5d0 con 0x7fdef00c6c60 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.949+0000 7fdede7fc700 1 -- 172.21.15.86:0/2313825486 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee401b990 con 0x7fdef00c6c60 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.949+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef016ab60 con 0x7fdef00c6c60 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.949+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef016a6b0 con 0x7fdef00c6c60 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.950+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef004c3c0 con 0x7fdef00c6c60 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.951+0000 7fdede7fc700 1 -- 172.21.15.86:0/2313825486 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdee401c450 con 0x7fdef00c6c60 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.951+0000 7fdede7fc700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fded0066f30 0x7fded00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.952+0000 7fdede7fc700 1 -- 172.21.15.86:0/2313825486 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdee40861f0 con 0x7fdef00c6c60 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.952+0000 7fdeee59c700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fded0066f30 0x7fded00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.952+0000 7fdeee59c700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fded0066f30 0x7fded00693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c8f0 tx=0x7fdee0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:00.956+0000 7fdede7fc700 1 -- 172.21.15.86:0/2313825486 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdee4053710 con 0x7fdef00c6c60 2023-10-09T11:42:01.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.221+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fdef00637d0 con 0x7fdef00c6c60 2023-10-09T11:42:01.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.225+0000 7fdede7fc700 1 -- 172.21.15.86:0/2313825486 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdee4056d30 con 0x7fdef00c6c60 2023-10-09T11:42:01.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fded0066f30 msgr2=0x7fded00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fded0066f30 0x7fded00693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c8f0 tx=0x7fdee0009040 comp rx=0 tx=0).stop 2023-10-09T11:42:01.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 msgr2=0x7fdef015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef015a350 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdee40030c0 tx=0x7fdee4016000 comp rx=0 tx=0).stop 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 shutdown_connections 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fded0066f30 0x7fded00693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdef01595a0 0x7fdef00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef006e8c0 0x7fdef0169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 --2- 172.21.15.86:0/2313825486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef00c6c60 0x7fdef015a350 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 >> 172.21.15.86:0/2313825486 conn(0x7fdef006ddb0 msgr2=0x7fdef006e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 shutdown_connections 2023-10-09T11:42:01.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.227+0000 7fdeef59e700 1 -- 172.21.15.86:0/2313825486 wait complete. 2023-10-09T11:42:01.245 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-09T11:42:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.429+0000 7f1dd519d700 1 Processor -- start 2023-10-09T11:42:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.429+0000 7f1dd519d700 1 -- start start 2023-10-09T11:42:01.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dd519d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1dd0157770 0x7f1dd0150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dd519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd00c7150 0x7f1dd006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dd519d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd006e2a0 con 0x7f1dd00c6d00 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dd519d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd0157b40 con 0x7f1dd0157770 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dd519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd006b2e0 con 0x7f1dd00c7150 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dcffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1dd0157770 0x7f1dd0150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dcffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1dd0157770 0x7f1dd0150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52076/0 (socket says 172.21.15.86:52076) 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dcffff700 1 -- 172.21.15.86:0/1095437792 learned_addr learned my addr 172.21.15.86:0/1095437792 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.430+0000 7f1dd499c700 1 --2- 172.21.15.86:0/1095437792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd00c7150 0x7f1dd006ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dcffff700 1 -- 172.21.15.86:0/1095437792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd00c7150 msgr2=0x7f1dd006ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:01.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dcffff700 1 --2- 172.21.15.86:0/1095437792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd00c7150 0x7f1dd006ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dcffff700 1 -- 172.21.15.86:0/1095437792 >> v1:172.21.15.135:6789/0 conn(0x7f1dd00c6d00 legacy=0x7f1dd006e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dcffff700 1 -- 172.21.15.86:0/1095437792 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00c78e0 con 0x7f1dd0157770 2023-10-09T11:42:01.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dcffff700 1 --2- 172.21.15.86:0/1095437792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd0157770 0x7f1dd0150180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000bc50 tx=0x7f1dc000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f47b3cebbd41b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dceffd700 1 -- 172.21.15.86:0/1095437792 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000be60 con 0x7f1dd0157770 2023-10-09T11:42:01.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dceffd700 1 -- 172.21.15.86:0/1095437792 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc000de00 con 0x7f1dd0157770 2023-10-09T11:42:01.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.431+0000 7f1dceffd700 1 -- 172.21.15.86:0/1095437792 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00196b0 con 0x7f1dd0157770 2023-10-09T11:42:01.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 -- 172.21.15.86:0/1095437792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd0157770 msgr2=0x7f1dd0150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1095437792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd0157770 0x7f1dd0150180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000bc50 tx=0x7f1dc000b4f0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 -- 172.21.15.86:0/1095437792 shutdown_connections 2023-10-09T11:42:01.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1095437792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd00c7150 0x7f1dd006ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1095437792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd0157770 0x7f1dd0150180 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 -- 172.21.15.86:0/1095437792 >> 172.21.15.86:0/1095437792 conn(0x7f1dd00cc1f0 msgr2=0x7f1dd00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 -- 172.21.15.86:0/1095437792 shutdown_connections 2023-10-09T11:42:01.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.432+0000 7f1dd519d700 1 -- 172.21.15.86:0/1095437792 wait complete. 2023-10-09T11:42:01.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.433+0000 7f1dd519d700 1 Processor -- start 2023-10-09T11:42:01.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.434+0000 7f1dd519d700 1 -- start start 2023-10-09T11:42:01.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.434+0000 7f1dd519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd00c6d00 0x7f1dd00ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.434+0000 7f1dd519d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd00c7150 0x7f1dd014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dd519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd0157770 0x7f1dd00af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dd519d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00adbc0 con 0x7f1dd00c7150 2023-10-09T11:42:01.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dd519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00ae6d0 con 0x7f1dd00c6d00 2023-10-09T11:42:01.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dd519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd014bd00 con 0x7f1dd0157770 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd00c7150 0x7f1dd014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd00c7150 0x7f1dd014b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52092/0 (socket says 172.21.15.86:52092) 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 -- 172.21.15.86:0/1593400924 learned_addr learned my addr 172.21.15.86:0/1593400924 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcffff700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd00c6d00 0x7f1dd00ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dd499c700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd0157770 0x7f1dd00af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 -- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd0157770 msgr2=0x7f1dd00af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd0157770 0x7f1dd00af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 -- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd00c6d00 msgr2=0x7f1dd00ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd00c6d00 0x7f1dd00ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 -- 172.21.15.86:0/1593400924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc000b790 con 0x7f1dd00c7150 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dd499c700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd0157770 0x7f1dd00af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.435+0000 7f1dcf7fe700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd00c7150 0x7f1dd014b7c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c590 tx=0x7f1dc400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.436+0000 7f1db7fff700 1 -- 172.21.15.86:0/1593400924 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011590 con 0x7f1dd00c7150 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.436+0000 7f1db7fff700 1 -- 172.21.15.86:0/1593400924 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4011710 con 0x7f1dd00c7150 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.436+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd016d6e0 con 0x7f1dd00c7150 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.436+0000 7f1db7fff700 1 -- 172.21.15.86:0/1593400924 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011ad0 con 0x7f1dd00c7150 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.436+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd016dca0 con 0x7f1dd00c7150 2023-10-09T11:42:01.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.437+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd004c3c0 con 0x7f1dd00c7150 2023-10-09T11:42:01.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.438+0000 7f1db7fff700 1 -- 172.21.15.86:0/1593400924 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dc401b3b0 con 0x7f1dd00c7150 2023-10-09T11:42:01.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.438+0000 7f1db7fff700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.439+0000 7f1db7fff700 1 -- 172.21.15.86:0/1593400924 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1dc40837b0 con 0x7f1dd00c7150 2023-10-09T11:42:01.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.439+0000 7f1dcffff700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.439+0000 7f1dcffff700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dbc066f30 0x7f1dbc0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000bc50 tx=0x7f1dc001b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.442+0000 7f1db7fff700 1 -- 172.21.15.86:0/1593400924 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dc4050cd0 con 0x7f1dd00c7150 2023-10-09T11:42:01.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.708+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f1dd00ccf10 con 0x7f1dd00c7150 2023-10-09T11:42:01.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.713+0000 7f1db7fff700 1 -- 172.21.15.86:0/1593400924 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1dc4017020 con 0x7f1dd00c7150 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.715+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dbc066f30 msgr2=0x7f1dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.715+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dbc066f30 0x7f1dbc0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000bc50 tx=0x7f1dc001b000 comp rx=0 tx=0).stop 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd00c7150 msgr2=0x7f1dd014b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd00c7150 0x7f1dd014b7c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c590 tx=0x7f1dc400c8a0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 shutdown_connections 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dd0157770 0x7f1dd00af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dd00c6d00 0x7f1dd00ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 --2- 172.21.15.86:0/1593400924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd00c7150 0x7f1dd014b7c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 >> 172.21.15.86:0/1593400924 conn(0x7f1dd00cc1f0 msgr2=0x7f1dd0157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 shutdown_connections 2023-10-09T11:42:01.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.716+0000 7f1dd519d700 1 -- 172.21.15.86:0/1593400924 wait complete. 2023-10-09T11:42:01.733 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-09T11:42:01.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.913+0000 7f32299ff700 1 Processor -- start 2023-10-09T11:42:01.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.913+0000 7f32299ff700 1 -- start start 2023-10-09T11:42:01.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.914+0000 7f32299ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3224069560 0x7f32240699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.914+0000 7f32299ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3224069ee0 con 0x7f3224159890 2023-10-09T11:42:01.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.914+0000 7f32299ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322415a160 con 0x7f3224159c60 2023-10-09T11:42:01.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.914+0000 7f32299ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240d13a0 con 0x7f3224069560 2023-10-09T11:42:01.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f3222ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3224159890 0x7f322415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33100/0 (socket says 172.21.15.86:33100) 2023-10-09T11:42:01.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f3222ffd700 1 -- 172.21.15.86:0/2725338814 learned_addr learned my addr 172.21.15.86:0/2725338814 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:01.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f32237fe700 1 --2- 172.21.15.86:0/2725338814 >> v2:172.21.15.86:3300/0 conn(0x7f3224069560 0x7f32240699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f3221ffb700 1 -- 172.21.15.86:0/2725338814 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334324777 0 0) 0x7f3224069ee0 con 0x7f3224159890 2023-10-09T11:42:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f32237fe700 1 -- 172.21.15.86:0/2725338814 >> v1:172.21.15.135:6789/0 conn(0x7f3224159c60 legacy=0x7f322415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:01.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f32237fe700 1 -- 172.21.15.86:0/2725338814 >> v1:172.21.15.86:6789/0 conn(0x7f3224159890 legacy=0x7f322415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f32237fe700 1 -- 172.21.15.86:0/2725338814 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322415e140 con 0x7f3224069560 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.915+0000 7f32237fe700 1 --2- 172.21.15.86:0/2725338814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224069560 0x7f32240699a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f321c009e60 tx=0x7f321c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbd01505c504987 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f3221ffb700 1 -- 172.21.15.86:0/2725338814 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00e070 con 0x7f3224069560 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f3221ffb700 1 -- 172.21.15.86:0/2725338814 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c00bc30 con 0x7f3224069560 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f3221ffb700 1 -- 172.21.15.86:0/2725338814 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c012430 con 0x7f3224069560 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f32299ff700 1 -- 172.21.15.86:0/2725338814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224069560 msgr2=0x7f32240699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f32299ff700 1 --2- 172.21.15.86:0/2725338814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224069560 0x7f32240699a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f321c009e60 tx=0x7f321c009780 comp rx=0 tx=0).stop 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f32299ff700 1 -- 172.21.15.86:0/2725338814 shutdown_connections 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f32299ff700 1 --2- 172.21.15.86:0/2725338814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224069560 0x7f32240699a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f32299ff700 1 -- 172.21.15.86:0/2725338814 >> 172.21.15.86:0/2725338814 conn(0x7f3224068e20 msgr2=0x7f32240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f32299ff700 1 -- 172.21.15.86:0/2725338814 shutdown_connections 2023-10-09T11:42:01.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.916+0000 7f32299ff700 1 -- 172.21.15.86:0/2725338814 wait complete. 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.918+0000 7f32299ff700 1 Processor -- start 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.918+0000 7f32299ff700 1 -- start start 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32299ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3224069560 0x7f3224149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32299ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3224159890 0x7f32240c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32299ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224159c60 0x7f32240cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32299ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240cde50 con 0x7f3224159c60 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32299ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3224149850 con 0x7f3224069560 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32299ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32240cd240 con 0x7f3224159890 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224159c60 0x7f32240cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224159c60 0x7f32240cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52110/0 (socket says 172.21.15.86:52110) 2023-10-09T11:42:01.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 -- 172.21.15.86:0/3899548438 learned_addr learned my addr 172.21.15.86:0/3899548438 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f3222ffd700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3224069560 0x7f3224149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32227fc700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3224159890 0x7f32240c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 -- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3224159890 msgr2=0x7f32240c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3224159890 0x7f32240c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 -- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3224069560 msgr2=0x7f3224149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3224069560 0x7f3224149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32237fe700 1 -- 172.21.15.86:0/3899548438 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c009a20 con 0x7f3224159c60 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f3222ffd700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3224069560 0x7f3224149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.919+0000 7f32227fc700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3224159890 0x7f32240c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.920+0000 7f32237fe700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224159c60 0x7f32240cadf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f321c013000 tx=0x7f321c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.920+0000 7f320affd700 1 -- 172.21.15.86:0/3899548438 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c01b630 con 0x7f3224159c60 2023-10-09T11:42:01.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.920+0000 7f320affd700 1 -- 172.21.15.86:0/3899548438 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c01b790 con 0x7f3224159c60 2023-10-09T11:42:01.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.920+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32240cd520 con 0x7f3224159c60 2023-10-09T11:42:01.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.920+0000 7f320affd700 1 -- 172.21.15.86:0/3899548438 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c01bb10 con 0x7f3224159c60 2023-10-09T11:42:01.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.920+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32240cdae0 con 0x7f3224159c60 2023-10-09T11:42:01.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.921+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32240b2e40 con 0x7f3224159c60 2023-10-09T11:42:01.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.922+0000 7f320affd700 1 -- 172.21.15.86:0/3899548438 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f321c01c400 con 0x7f3224159c60 2023-10-09T11:42:01.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.923+0000 7f320affd700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3210066f30 0x7f32100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.923+0000 7f320affd700 1 -- 172.21.15.86:0/3899548438 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f321c0861d0 con 0x7f3224159c60 2023-10-09T11:42:01.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.924+0000 7f3222ffd700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3210066f30 0x7f32100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.924+0000 7f3222ffd700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3210066f30 0x7f32100693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32140018d0 tx=0x7f3214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:01.928+0000 7f320affd700 1 -- 172.21.15.86:0/3899548438 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f321c0537a0 con 0x7f3224159c60 2023-10-09T11:42:02.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.195+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f322404c3c0 con 0x7f3224159c60 2023-10-09T11:42:02.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.199+0000 7f320affd700 1 -- 172.21.15.86:0/3899548438 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f321c056dc0 con 0x7f3224159c60 2023-10-09T11:42:02.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3210066f30 msgr2=0x7f32100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3210066f30 0x7f32100693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32140018d0 tx=0x7f3214009040 comp rx=0 tx=0).stop 2023-10-09T11:42:02.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224159c60 msgr2=0x7f32240cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224159c60 0x7f32240cadf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f321c013000 tx=0x7f321c019000 comp rx=0 tx=0).stop 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 shutdown_connections 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3210066f30 0x7f32100693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3224159c60 0x7f32240cadf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3224069560 0x7f3224149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 --2- 172.21.15.86:0/3899548438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3224159890 0x7f32240c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 >> 172.21.15.86:0/3899548438 conn(0x7f3224068e20 msgr2=0x7f3224155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 shutdown_connections 2023-10-09T11:42:02.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.201+0000 7f32299ff700 1 -- 172.21.15.86:0/3899548438 wait complete. 2023-10-09T11:42:02.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-09T11:42:02.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.401+0000 7f3cfc5ff700 1 Processor -- start 2023-10-09T11:42:02.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.401+0000 7f3cfc5ff700 1 -- start start 2023-10-09T11:42:02.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfc5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 0x7f3cf40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfc5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3cf40ccf90 0x7f3cf40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfc5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40cc300 con 0x7f3cf415a270 2023-10-09T11:42:02.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfc5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf4156bf0 con 0x7f3cf40ccf90 2023-10-09T11:42:02.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfc5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40ae950 con 0x7f3cf40cbf30 2023-10-09T11:42:02.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfab9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3cf415a270 0x7f3cf40c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33104/0 (socket says 172.21.15.86:33104) 2023-10-09T11:42:02.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfab9c700 1 -- 172.21.15.86:0/112451666 learned_addr learned my addr 172.21.15.86:0/112451666 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:02.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cfa39b700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 0x7f3cf40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cf9b9a700 1 --2- 172.21.15.86:0/112451666 >> v2:172.21.15.135:3300/0 conn(0x7f3cf40ccf90 0x7f3cf40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431482469 0 0) 0x7f3cf40cc300 con 0x7f3cf415a270 2023-10-09T11:42:02.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.403+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce0003570 con 0x7f3cf415a270 2023-10-09T11:42:02.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894697614 0 0) 0x7f3ce0003570 con 0x7f3cf415a270 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 msgr2=0x7f3cf40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 0x7f3cf40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 >> v2:172.21.15.135:3300/0 conn(0x7f3cf40ccf90 msgr2=0x7f3cf40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 --2- 172.21.15.86:0/112451666 >> v2:172.21.15.135:3300/0 conn(0x7f3cf40ccf90 0x7f3cf40b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40ad370 con 0x7f3cf415a270 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f3cec0017f0 con 0x7f3cf415a270 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfa39b700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 0x7f3cf40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9b9a700 1 --2- 172.21.15.86:0/112451666 >> v2:172.21.15.135:3300/0 conn(0x7f3cf40ccf90 0x7f3cf40b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:02.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 >> v1:172.21.15.86:6789/0 conn(0x7f3cf415a270 legacy=0x7f3cf40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 0x7f3ce0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce0003fd0 0x7f3ce0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3ce00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf4156bf0 con 0x7f3ce0004d50 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40ae950 con 0x7f3ce0003fd0 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce000ba90 con 0x7f3cf40cbf30 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfab9c700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3ce00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfa39b700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 0x7f3ce0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9b9a700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce0003fd0 0x7f3ce0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfab9c700 1 -- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 msgr2=0x7f3ce0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfab9c700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf40cbf30 0x7f3ce0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfab9c700 1 -- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce0003fd0 msgr2=0x7f3ce0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfab9c700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce0003fd0 0x7f3ce0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cfab9c700 1 -- 172.21.15.86:0/112451666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0009420 con 0x7f3ce0004d50 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.404+0000 7f3cf9b9a700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce0003fd0 0x7f3ce0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cfab9c700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3ce00051c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00a930 tx=0x7f3cec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9501d54103decc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0070d0 con 0x7f3ce0004d50 2023-10-09T11:42:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec007230 con 0x7f3ce0004d50 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cf9399700 1 -- 172.21.15.86:0/112451666 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0075d0 con 0x7f3ce0004d50 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/112451666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 msgr2=0x7f3ce00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cfc5ff700 1 --2- 172.21.15.86:0/112451666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3ce00051c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00a930 tx=0x7f3cec0021d0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cfab9c700 1 -- 172.21.15.86:0/112451666 reap_dead start 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/112451666 shutdown_connections 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.405+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/112451666 >> 172.21.15.86:0/112451666 conn(0x7f3cf406a320 msgr2=0x7f3cf40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.406+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/112451666 shutdown_connections 2023-10-09T11:42:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.406+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/112451666 wait complete. 2023-10-09T11:42:02.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.407+0000 7f3cfc5ff700 1 Processor -- start 2023-10-09T11:42:02.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.407+0000 7f3cfc5ff700 1 -- start start 2023-10-09T11:42:02.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfc5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3cf415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfc5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf41539c0 0x7f3cf415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfc5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cf40c7c30 0x7f3cf415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfc5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf415f0c0 con 0x7f3ce0004d50 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfc5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c81a0 con 0x7f3cf40c7c30 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfc5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf415ea70 con 0x7f3cf41539c0 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfa39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3cf415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfa39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3cf415be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52116/0 (socket says 172.21.15.86:52116) 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfa39b700 1 -- 172.21.15.86:0/3786539907 learned_addr learned my addr 172.21.15.86:0/3786539907 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cf9b9a700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf41539c0 0x7f3cf415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.408+0000 7f3cfab9c700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cf40c7c30 0x7f3cf415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfa39b700 1 -- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf41539c0 msgr2=0x7f3cf415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfa39b700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf41539c0 0x7f3cf415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfa39b700 1 -- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cf40c7c30 msgr2=0x7f3cf415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfa39b700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cf40c7c30 0x7f3cf415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfa39b700 1 -- 172.21.15.86:0/3786539907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf415ed50 con 0x7f3ce0004d50 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfa39b700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3cf415be10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0011d70 tx=0x7f3cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cea7fc700 1 -- 172.21.15.86:0/3786539907 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000fc70 con 0x7f3ce0004d50 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cea7fc700 1 -- 172.21.15.86:0/3786539907 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf000fdd0 con 0x7f3ce0004d50 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cea7fc700 1 -- 172.21.15.86:0/3786539907 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf001d6b0 con 0x7f3ce0004d50 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf415f550 con 0x7f3ce0004d50 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.409+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf4153e60 con 0x7f3ce0004d50 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.410+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf415f3a0 con 0x7f3ce0004d50 2023-10-09T11:42:02.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.411+0000 7f3cea7fc700 1 -- 172.21.15.86:0/3786539907 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cf001daa0 con 0x7f3ce0004d50 2023-10-09T11:42:02.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.412+0000 7f3cea7fc700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3cd8066f30 0x7f3cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.412+0000 7f3cea7fc700 1 -- 172.21.15.86:0/3786539907 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3cf0018070 con 0x7f3ce0004d50 2023-10-09T11:42:02.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.412+0000 7f3cf9b9a700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3cd8066f30 0x7f3cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.413+0000 7f3cf9b9a700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3cd8066f30 0x7f3cd80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40093f0 tx=0x7f3ce4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.416+0000 7f3cea7fc700 1 -- 172.21.15.86:0/3786539907 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cf00526e0 con 0x7f3ce0004d50 2023-10-09T11:42:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.681+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3cf415e8a0 con 0x7f3ce0004d50 2023-10-09T11:42:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.684+0000 7f3cea7fc700 1 -- 172.21.15.86:0/3786539907 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3cf0055d00 con 0x7f3ce0004d50 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3cd8066f30 msgr2=0x7f3cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3cd8066f30 0x7f3cd80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40093f0 tx=0x7f3ce4008040 comp rx=0 tx=0).stop 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 msgr2=0x7f3cf415be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3cf415be10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0011d70 tx=0x7f3cf00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 shutdown_connections 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3cd8066f30 0x7f3cd80693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ce0004d50 0x7f3cf415be10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cf40c7c30 0x7f3cf415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 --2- 172.21.15.86:0/3786539907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cf41539c0 0x7f3cf415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 >> 172.21.15.86:0/3786539907 conn(0x7f3cf406a320 msgr2=0x7f3cf40caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 shutdown_connections 2023-10-09T11:42:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.687+0000 7f3cfc5ff700 1 -- 172.21.15.86:0/3786539907 wait complete. 2023-10-09T11:42:02.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-09T11:42:02.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.885+0000 7f36d759e700 1 Processor -- start 2023-10-09T11:42:02.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.885+0000 7f36d759e700 1 -- start start 2023-10-09T11:42:02.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.886+0000 7f36d759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f36d8156310 0x7f36d80c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d80ca860 con 0x7f36d80ae710 2023-10-09T11:42:02.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d80cab40 con 0x7f36d81566e0 2023-10-09T11:42:02.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80cae20 con 0x7f36d8156310 2023-10-09T11:42:02.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d6d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f36d80ae710 0x7f36d80c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33120/0 (socket says 172.21.15.86:33120) 2023-10-09T11:42:02.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d6d9d700 1 -- 172.21.15.86:0/797146057 learned_addr learned my addr 172.21.15.86:0/797146057 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:02.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d659c700 1 --2- 172.21.15.86:0/797146057 >> v2:172.21.15.135:3300/0 conn(0x7f36d8156310 0x7f36d80c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247201396 0 0) 0x7f36d80ca860 con 0x7f36d80ae710 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.887+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c4003570 con 0x7f36d80ae710 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242496572 0 0) 0x7f36c4003570 con 0x7f36d80ae710 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 >> v2:172.21.15.135:3300/0 conn(0x7f36d8156310 msgr2=0x7f36d80c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 --2- 172.21.15.86:0/797146057 >> v2:172.21.15.135:3300/0 conn(0x7f36d8156310 0x7f36d80c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 >> v1:172.21.15.135:6789/0 conn(0x7f36d81566e0 legacy=0x7f36d80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d80cb100 con 0x7f36d80ae710 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f36d00017f0 con 0x7f36d80ae710 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 >> v1:172.21.15.86:6789/0 conn(0x7f36d80ae710 legacy=0x7f36d80c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36c4003a60 0x7f36c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4004810 0x7f36c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36c40051c0 0x7f36c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80cae20 con 0x7f36c4003a60 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c400c0d0 con 0x7f36c4004810 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c400c290 con 0x7f36c40051c0 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d659c700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36c4003a60 0x7f36c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36cffff700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4004810 0x7f36c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d6d9d700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36c40051c0 0x7f36c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d659c700 1 -- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36c40051c0 msgr2=0x7f36c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d659c700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36c40051c0 0x7f36c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d659c700 1 -- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4004810 msgr2=0x7f36c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d659c700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4004810 0x7f36c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d659c700 1 -- 172.21.15.86:0/797146057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4003570 con 0x7f36c4003a60 2023-10-09T11:42:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d6d9d700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36c40051c0 0x7f36c400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.888+0000 7f36d6d9d700 1 -- 172.21.15.86:0/797146057 reap_dead start 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d659c700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36c4003a60 0x7f36c4003e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009c00 tx=0x7f36c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab92164b59d22eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c800e710 con 0x7f36c4003a60 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c800e870 con 0x7f36c4003a60 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d5d9b700 1 -- 172.21.15.86:0/797146057 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c800ec30 con 0x7f36c4003a60 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d759e700 1 -- 172.21.15.86:0/797146057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36c4003a60 msgr2=0x7f36c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d759e700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36c4003a60 0x7f36c4003e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009c00 tx=0x7f36c80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d759e700 1 -- 172.21.15.86:0/797146057 shutdown_connections 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d759e700 1 --2- 172.21.15.86:0/797146057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36c4003a60 0x7f36c4003e70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.889+0000 7f36d759e700 1 -- 172.21.15.86:0/797146057 >> 172.21.15.86:0/797146057 conn(0x7f36d80cc1f0 msgr2=0x7f36d80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.890+0000 7f36d759e700 1 -- 172.21.15.86:0/797146057 shutdown_connections 2023-10-09T11:42:02.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.890+0000 7f36d759e700 1 -- 172.21.15.86:0/797146057 wait complete. 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.891+0000 7f36d759e700 1 Processor -- start 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.891+0000 7f36d759e700 1 -- start start 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36d759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4003a60 0x7f36d814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36d759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d80b05d0 0x7f36d81469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36d759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d80b0a40 0x7f36d8146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36d759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d816e1b0 con 0x7f36d80b05d0 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36d759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d816d630 con 0x7f36c4003a60 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36d759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d816d910 con 0x7f36d80b0a40 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36cffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d80b05d0 0x7f36d81469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.892+0000 7f36cffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d80b05d0 0x7f36d81469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52134/0 (socket says 172.21.15.86:52134) 2023-10-09T11:42:02.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36cffff700 1 -- 172.21.15.86:0/2124169652 learned_addr learned my addr 172.21.15.86:0/2124169652 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36d659c700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4003a60 0x7f36d814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36d6d9d700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d80b0a40 0x7f36d8146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36cffff700 1 -- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d80b0a40 msgr2=0x7f36d8146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36cffff700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d80b0a40 0x7f36d8146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36cffff700 1 -- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4003a60 msgr2=0x7f36d814a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36cffff700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4003a60 0x7f36d814a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36cffff700 1 -- 172.21.15.86:0/2124169652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d816dbf0 con 0x7f36d80b05d0 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36cffff700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d80b05d0 0x7f36d81469c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36c0002950 tx=0x7f36c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36ce7fc700 1 -- 172.21.15.86:0/2124169652 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c000f670 con 0x7f36d80b05d0 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36ce7fc700 1 -- 172.21.15.86:0/2124169652 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c000f7d0 con 0x7f36d80b05d0 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d816ded0 con 0x7f36d80b05d0 2023-10-09T11:42:02.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.893+0000 7f36ce7fc700 1 -- 172.21.15.86:0/2124169652 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c000fb70 con 0x7f36d80b05d0 2023-10-09T11:42:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.894+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d816d3d0 con 0x7f36d80b05d0 2023-10-09T11:42:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.894+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d804c3c0 con 0x7f36d80b05d0 2023-10-09T11:42:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.895+0000 7f36ce7fc700 1 -- 172.21.15.86:0/2124169652 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36c001c400 con 0x7f36d80b05d0 2023-10-09T11:42:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.896+0000 7f36ce7fc700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f36b8066f30 0x7f36b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.896+0000 7f36ce7fc700 1 -- 172.21.15.86:0/2124169652 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f36c0084580 con 0x7f36d80b05d0 2023-10-09T11:42:02.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.896+0000 7f36d659c700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f36b8066f30 0x7f36b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.897+0000 7f36d659c700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f36b8066f30 0x7f36b80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36c80091e0 tx=0x7f36c801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:02.900+0000 7f36ce7fc700 1 -- 172.21.15.86:0/2124169652 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36c0051c10 con 0x7f36d80b05d0 2023-10-09T11:42:03.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.163+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f36d814bc00 con 0x7f36d80b05d0 2023-10-09T11:42:03.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.167+0000 7f36ce7fc700 1 -- 172.21.15.86:0/2124169652 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f36c0084070 con 0x7f36d80b05d0 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f36b8066f30 msgr2=0x7f36b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f36b8066f30 0x7f36b80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f36c80091e0 tx=0x7f36c801a000 comp rx=0 tx=0).stop 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d80b05d0 msgr2=0x7f36d81469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d80b05d0 0x7f36d81469c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36c0002950 tx=0x7f36c0007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 shutdown_connections 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f36b8066f30 0x7f36b80693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d80b0a40 0x7f36d8146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c4003a60 0x7f36d814a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 --2- 172.21.15.86:0/2124169652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d80b05d0 0x7f36d81469c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 >> 172.21.15.86:0/2124169652 conn(0x7f36d80cc1f0 msgr2=0x7f36d8151b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 shutdown_connections 2023-10-09T11:42:03.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.170+0000 7f36d759e700 1 -- 172.21.15.86:0/2124169652 wait complete. 2023-10-09T11:42:03.188 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-09T11:42:03.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.367+0000 7f825f7ff700 1 Processor -- start 2023-10-09T11:42:03.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.367+0000 7f825f7ff700 1 -- start start 2023-10-09T11:42:03.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.368+0000 7f825f7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f82580cbf30 0x7f82580ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.368+0000 7f825f7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82580ccf90 0x7f82580b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.368+0000 7f825f7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82580cc300 con 0x7f825815a270 2023-10-09T11:42:03.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.368+0000 7f825f7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8258156bf0 con 0x7f82580ccf90 2023-10-09T11:42:03.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.368+0000 7f825f7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580ae950 con 0x7f82580cbf30 2023-10-09T11:42:03.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82580ccf90 0x7f82580b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82580ccf90 0x7f82580b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52138/0 (socket says 172.21.15.86:52138) 2023-10-09T11:42:03.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825d59b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f82580cbf30 0x7f82580ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 -- 172.21.15.86:0/576808585 learned_addr learned my addr 172.21.15.86:0/576808585 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:03.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 -- 172.21.15.86:0/576808585 >> v2:172.21.15.135:3300/0 conn(0x7f82580cbf30 msgr2=0x7f82580ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:03.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 --2- 172.21.15.86:0/576808585 >> v2:172.21.15.135:3300/0 conn(0x7f82580cbf30 0x7f82580ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 -- 172.21.15.86:0/576808585 >> v1:172.21.15.135:6789/0 conn(0x7f825815a270 legacy=0x7f82580c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 -- 172.21.15.86:0/576808585 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580ad370 con 0x7f82580ccf90 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.369+0000 7f825cd9a700 1 --2- 172.21.15.86:0/576808585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580ccf90 0x7f82580b0d10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8258063d40 tx=0x7f8248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cf037f7ca1fbd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f824ffff700 1 -- 172.21.15.86:0/576808585 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248009ea0 con 0x7f82580ccf90 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f824ffff700 1 -- 172.21.15.86:0/576808585 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824800b820 con 0x7f82580ccf90 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f824ffff700 1 -- 172.21.15.86:0/576808585 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800bbc0 con 0x7f82580ccf90 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 -- 172.21.15.86:0/576808585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580ccf90 msgr2=0x7f82580b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 --2- 172.21.15.86:0/576808585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580ccf90 0x7f82580b0d10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8258063d40 tx=0x7f8248009250 comp rx=0 tx=0).stop 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 -- 172.21.15.86:0/576808585 shutdown_connections 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 --2- 172.21.15.86:0/576808585 >> v2:172.21.15.135:3300/0 conn(0x7f82580cbf30 0x7f82580ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 --2- 172.21.15.86:0/576808585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580ccf90 0x7f82580b0d10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 -- 172.21.15.86:0/576808585 >> 172.21.15.86:0/576808585 conn(0x7f825806a320 msgr2=0x7f82580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 -- 172.21.15.86:0/576808585 shutdown_connections 2023-10-09T11:42:03.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.370+0000 7f825f7ff700 1 -- 172.21.15.86:0/576808585 wait complete. 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.372+0000 7f825f7ff700 1 Processor -- start 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.372+0000 7f825f7ff700 1 -- start start 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825f7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580cbf30 0x7f825816a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825f7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82580ccf90 0x7f825816d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825f7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f825815a270 0x7f82580c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825f7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825816a570 con 0x7f82580cbf30 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825f7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580a54c0 con 0x7f82580ccf90 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825f7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580a57a0 con 0x7f825815a270 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825d59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580cbf30 0x7f825816a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825d59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580cbf30 0x7f825816a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52144/0 (socket says 172.21.15.86:52144) 2023-10-09T11:42:03.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825d59b700 1 -- 172.21.15.86:0/1913229740 learned_addr learned my addr 172.21.15.86:0/1913229740 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.373+0000 7f825cd9a700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82580ccf90 0x7f825816d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825dd9c700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f825815a270 0x7f82580c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825d59b700 1 -- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f825815a270 msgr2=0x7f82580c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825d59b700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f825815a270 0x7f82580c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825d59b700 1 -- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82580ccf90 msgr2=0x7f825816d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825d59b700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82580ccf90 0x7f825816d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825d59b700 1 -- 172.21.15.86:0/1913229740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82480094f0 con 0x7f82580cbf30 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825dd9c700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f825815a270 0x7f82580c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825cd9a700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82580ccf90 0x7f825816d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825d59b700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580cbf30 0x7f825816a030 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f825400e930 tx=0x7f82540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f824d7fa700 1 -- 172.21.15.86:0/1913229740 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400eed0 con 0x7f82580cbf30 2023-10-09T11:42:03.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f824d7fa700 1 -- 172.21.15.86:0/1913229740 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825400c850 con 0x7f82580cbf30 2023-10-09T11:42:03.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825816de60 con 0x7f82580cbf30 2023-10-09T11:42:03.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f824d7fa700 1 -- 172.21.15.86:0/1913229740 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400cbf0 con 0x7f82580cbf30 2023-10-09T11:42:03.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.374+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825816e420 con 0x7f82580cbf30 2023-10-09T11:42:03.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.375+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82580b0590 con 0x7f82580cbf30 2023-10-09T11:42:03.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.376+0000 7f824d7fa700 1 -- 172.21.15.86:0/1913229740 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8254013470 con 0x7f82580cbf30 2023-10-09T11:42:03.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.377+0000 7f824d7fa700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f823c066f30 0x7f823c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.377+0000 7f824d7fa700 1 -- 172.21.15.86:0/1913229740 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f82540844b0 con 0x7f82580cbf30 2023-10-09T11:42:03.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.377+0000 7f825cd9a700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f823c066f30 0x7f823c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.378+0000 7f825cd9a700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f823c066f30 0x7f823c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8258063d40 tx=0x7f8248017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.381+0000 7f824d7fa700 1 -- 172.21.15.86:0/1913229740 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82540519d0 con 0x7f82580cbf30 2023-10-09T11:42:03.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.646+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f82581569a0 con 0x7f82580cbf30 2023-10-09T11:42:03.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.650+0000 7f824d7fa700 1 -- 172.21.15.86:0/1913229740 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8254054ff0 con 0x7f82580cbf30 2023-10-09T11:42:03.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f823c066f30 msgr2=0x7f823c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f823c066f30 0x7f823c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8258063d40 tx=0x7f8248017000 comp rx=0 tx=0).stop 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580cbf30 msgr2=0x7f825816a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580cbf30 0x7f825816a030 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f825400e930 tx=0x7f82540091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 shutdown_connections 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f823c066f30 0x7f823c0693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82580cbf30 0x7f825816a030 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f825815a270 0x7f82580c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 --2- 172.21.15.86:0/1913229740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82580ccf90 0x7f825816d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 >> 172.21.15.86:0/1913229740 conn(0x7f825806a320 msgr2=0x7f82580c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 shutdown_connections 2023-10-09T11:42:03.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.653+0000 7f825f7ff700 1 -- 172.21.15.86:0/1913229740 wait complete. 2023-10-09T11:42:03.671 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:03.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.850+0000 7f5adcbff700 1 Processor -- start 2023-10-09T11:42:03.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.850+0000 7f5adcbff700 1 -- start start 2023-10-09T11:42:03.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.851+0000 7f5adcbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 0x7f5ad80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.851+0000 7f5adcbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80cc300 con 0x7f5ad80b1420 2023-10-09T11:42:03.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.851+0000 7f5adcbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80ad370 con 0x7f5ad80cbf30 2023-10-09T11:42:03.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.851+0000 7f5adcbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8156bf0 con 0x7f5ad80ccf90 2023-10-09T11:42:03.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad5d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5ad80b1420 0x7f5ad80c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33134/0 (socket says 172.21.15.86:33134) 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad5d9b700 1 -- 172.21.15.86:0/604015803 learned_addr learned my addr 172.21.15.86:0/604015803 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad6d9d700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 0x7f5ad80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948035101 0 0) 0x7f5ad80cc300 con 0x7f5ad80b1420 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac0003570 con 0x7f5ad80b1420 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303124622 0 0) 0x7f5ad80ad370 con 0x7f5ad80cbf30 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad80cc300 con 0x7f5ad80cbf30 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 115026280 0 0) 0x7f5ac0003570 con 0x7f5ad80b1420 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 msgr2=0x7f5ad80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:03.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 0x7f5ad80ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 >> v1:172.21.15.135:6789/0 conn(0x7f5ad80cbf30 legacy=0x7f5ad80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80ad650 con 0x7f5ad80b1420 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f5acc0013f0 con 0x7f5ad80b1420 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 >> v1:172.21.15.86:6789/0 conn(0x7f5ad80b1420 legacy=0x7f5ad80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.852+0000 7f5ad559a700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac0003c20 0x7f5ac0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad559a700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 0x7f5ac0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad559a700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ac00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8156bf0 con 0x7f5ac0004d50 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac000de00 con 0x7f5ac0003c20 2023-10-09T11:42:03.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac000df70 con 0x7f5ad80ccf90 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad6d9d700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ac00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad659c700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac0003c20 0x7f5ac0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad5d9b700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 0x7f5ac0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad6d9d700 1 -- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 msgr2=0x7f5ac0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad6d9d700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad80ccf90 0x7f5ac0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad6d9d700 1 -- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac0003c20 msgr2=0x7f5ac0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad6d9d700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac0003c20 0x7f5ac0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad6d9d700 1 -- 172.21.15.86:0/604015803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0003570 con 0x7f5ac0004d50 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.853+0000 7f5ad6d9d700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ac00051c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00094d0 tx=0x7f5ad000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a229b01a3784fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000ea90 con 0x7f5ac0004d50 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000f040 con 0x7f5ac0004d50 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5ad559a700 1 -- 172.21.15.86:0/604015803 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000ee20 con 0x7f5ac0004d50 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5adcbff700 1 -- 172.21.15.86:0/604015803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 msgr2=0x7f5ac00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5adcbff700 1 --2- 172.21.15.86:0/604015803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ac00051c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00094d0 tx=0x7f5ad000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5ad6d9d700 1 -- 172.21.15.86:0/604015803 reap_dead start 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5adcbff700 1 -- 172.21.15.86:0/604015803 shutdown_connections 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5adcbff700 1 -- 172.21.15.86:0/604015803 >> 172.21.15.86:0/604015803 conn(0x7f5ad806a320 msgr2=0x7f5ad80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5adcbff700 1 -- 172.21.15.86:0/604015803 shutdown_connections 2023-10-09T11:42:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.854+0000 7f5adcbff700 1 -- 172.21.15.86:0/604015803 wait complete. 2023-10-09T11:42:03.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.856+0000 7f5adcbff700 1 Processor -- start 2023-10-09T11:42:03.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.856+0000 7f5adcbff700 1 -- start start 2023-10-09T11:42:03.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5adcbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ad80c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5adcbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad815b400 0x7f5ad815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5adcbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad815c010 0x7f5ad80c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5adcbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad815c460 con 0x7f5ac0004d50 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5adcbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c6940 con 0x7f5ad815b400 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5adcbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c6c20 con 0x7f5ad815c010 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ad80c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ad80c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52170/0 (socket says 172.21.15.86:52170) 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 -- 172.21.15.86:0/4038672631 learned_addr learned my addr 172.21.15.86:0/4038672631 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 -- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad815c010 msgr2=0x7f5ad80c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad6d9d700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad815c010 0x7f5ad80c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad5d9b700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad815b400 0x7f5ad815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad815c010 0x7f5ad80c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 -- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad815b400 msgr2=0x7f5ad815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad815b400 0x7f5ad815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad659c700 1 -- 172.21.15.86:0/4038672631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80c6f00 con 0x7f5ac0004d50 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad5d9b700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad815b400 0x7f5ad815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.857+0000 7f5ad6d9d700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad815c010 0x7f5ad80c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.858+0000 7f5ad659c700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ad80c60f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80010e0 tx=0x7f5ac8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.858+0000 7f5ac67fc700 1 -- 172.21.15.86:0/4038672631 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800f9a0 con 0x7f5ac0004d50 2023-10-09T11:42:03.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.858+0000 7f5ac67fc700 1 -- 172.21.15.86:0/4038672631 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac800fb00 con 0x7f5ac0004d50 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.858+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad80c71e0 con 0x7f5ac0004d50 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.858+0000 7f5ac67fc700 1 -- 172.21.15.86:0/4038672631 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800fec0 con 0x7f5ac0004d50 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.858+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad80c6630 con 0x7f5ac0004d50 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.859+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad80c7700 con 0x7f5ac0004d50 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.860+0000 7f5ac67fc700 1 -- 172.21.15.86:0/4038672631 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ac8013600 con 0x7f5ac0004d50 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.861+0000 7f5ac67fc700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5ab8066f30 0x7f5ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.861+0000 7f5ac67fc700 1 -- 172.21.15.86:0/4038672631 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5ac8084940 con 0x7f5ac0004d50 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.861+0000 7f5ad5d9b700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5ab8066f30 0x7f5ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.862+0000 7f5ad5d9b700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5ab8066f30 0x7f5ab80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5acc001520 tx=0x7f5acc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:03.865+0000 7f5ac67fc700 1 -- 172.21.15.86:0/4038672631 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ad80c7700 con 0x7f5ac0004d50 2023-10-09T11:42:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.059+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ad80c7700 con 0x7f5ac0004d50 2023-10-09T11:42:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.060+0000 7f5ac67fc700 1 -- 172.21.15.86:0/4038672631 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f5ad80c7700 con 0x7f5ac0004d50 2023-10-09T11:42:04.061 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:04.061 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":31,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:42:00.263008+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5ab8066f30 msgr2=0x7f5ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5ab8066f30 0x7f5ab80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5acc001520 tx=0x7f5acc009040 comp rx=0 tx=0).stop 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 msgr2=0x7f5ad80c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ad80c60f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80010e0 tx=0x7f5ac8007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 shutdown_connections 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5ab8066f30 0x7f5ab80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac0004d50 0x7f5ad80c60f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad815c010 0x7f5ad80c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 --2- 172.21.15.86:0/4038672631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad815b400 0x7f5ad815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.062+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 >> 172.21.15.86:0/4038672631 conn(0x7f5ad806a320 msgr2=0x7f5ad80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.063+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 shutdown_connections 2023-10-09T11:42:04.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.063+0000 7f5adcbff700 1 -- 172.21.15.86:0/4038672631 wait complete. 2023-10-09T11:42:04.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:42:04.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:42:04.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.265+0000 7f0560d9d700 1 Processor -- start 2023-10-09T11:42:04.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.265+0000 7f0560d9d700 1 -- start start 2023-10-09T11:42:04.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.266+0000 7f0560d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 0x7f055c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.266+0000 7f0560d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0cfb00 con 0x7f055c0b1b40 2023-10-09T11:42:04.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.266+0000 7f0560d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c15e060 con 0x7f055c0b16d0 2023-10-09T11:42:04.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.266+0000 7f0560d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0b5c40 con 0x7f055c0b4e70 2023-10-09T11:42:04.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f055c0b1b40 0x7f055c15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33144/0 (socket says 172.21.15.86:33144) 2023-10-09T11:42:04.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055bfff700 1 -- 172.21.15.86:0/2583671841 learned_addr learned my addr 172.21.15.86:0/2583671841 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:04.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055b7fe700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 0x7f055c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952905814 0 0) 0x7f055c0cfb00 con 0x7f055c0b1b40 2023-10-09T11:42:04.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0544003570 con 0x7f055c0b1b40 2023-10-09T11:42:04.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281392235 0 0) 0x7f055c15e060 con 0x7f055c0b16d0 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f055c0cfb00 con 0x7f055c0b16d0 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2013058837 0 0) 0x7f0544003570 con 0x7f055c0b1b40 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 msgr2=0x7f055c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 0x7f055c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 >> v1:172.21.15.135:6789/0 conn(0x7f055c0b16d0 legacy=0x7f055c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0b5f20 con 0x7f055c0b1b40 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f05540017f0 con 0x7f055c0b1b40 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 >> v1:172.21.15.86:6789/0 conn(0x7f055c0b1b40 legacy=0x7f055c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.267+0000 7f055a7fc700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 0x7f0544003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055a7fc700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544004180 0x7f0544004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055a7fc700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0544004d50 0x7f05440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0b5c40 con 0x7f0544004d50 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054400bba0 con 0x7f0544004180 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054400bd60 con 0x7f055c0b4e70 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055bfff700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0544004d50 0x7f05440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055b7fe700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 0x7f0544003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055affd700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544004180 0x7f0544004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055bfff700 1 -- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 msgr2=0x7f0544003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055bfff700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0b4e70 0x7f0544003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055bfff700 1 -- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544004180 msgr2=0x7f0544004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055bfff700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544004180 0x7f0544004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055bfff700 1 -- 172.21.15.86:0/2583671841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544003570 con 0x7f0544004d50 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.268+0000 7f055bfff700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0544004d50 0x7f05440051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f055400a8d0 tx=0x7f0554002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbda958d27d45e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540070d0 con 0x7f0544004d50 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554007230 con 0x7f0544004d50 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f055a7fc700 1 -- 172.21.15.86:0/2583671841 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540075f0 con 0x7f0544004d50 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f0560d9d700 1 -- 172.21.15.86:0/2583671841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0544004d50 msgr2=0x7f05440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f0560d9d700 1 --2- 172.21.15.86:0/2583671841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0544004d50 0x7f05440051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f055400a8d0 tx=0x7f0554002190 comp rx=0 tx=0).stop 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f055bfff700 1 -- 172.21.15.86:0/2583671841 reap_dead start 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f0560d9d700 1 -- 172.21.15.86:0/2583671841 shutdown_connections 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f0560d9d700 1 -- 172.21.15.86:0/2583671841 >> 172.21.15.86:0/2583671841 conn(0x7f055c0d10c0 msgr2=0x7f055c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f0560d9d700 1 -- 172.21.15.86:0/2583671841 shutdown_connections 2023-10-09T11:42:04.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.269+0000 7f0560d9d700 1 -- 172.21.15.86:0/2583671841 wait complete. 2023-10-09T11:42:04.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.271+0000 7f0560d9d700 1 Processor -- start 2023-10-09T11:42:04.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.271+0000 7f0560d9d700 1 -- start start 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f0560d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c0c7940 0x7f055c16abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f0560d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0c7d10 0x7f055c16b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f0560d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c167be0 0x7f055c157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f0560d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c16c540 con 0x7f055c0c7d10 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f0560d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c16b6b0 con 0x7f055c0c7940 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f0560d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c16b930 con 0x7f055c167be0 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0c7d10 0x7f055c16b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0c7d10 0x7f055c16b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52188/0 (socket says 172.21.15.86:52188) 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 -- 172.21.15.86:0/3432159258 learned_addr learned my addr 172.21.15.86:0/3432159258 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055b7fe700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c0c7940 0x7f055c16abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055bfff700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c167be0 0x7f055c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 -- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c167be0 msgr2=0x7f055c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c167be0 0x7f055c157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 -- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c0c7940 msgr2=0x7f055c16abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c0c7940 0x7f055c16abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055affd700 1 -- 172.21.15.86:0/3432159258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c16bc10 con 0x7f055c0c7d10 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.272+0000 7f055b7fe700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c0c7940 0x7f055c16abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.273+0000 7f055affd700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0c7d10 0x7f055c16b170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0550002b50 tx=0x7f0550007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.273+0000 7f05437fe700 1 -- 172.21.15.86:0/3432159258 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000fa00 con 0x7f055c0c7d10 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.273+0000 7f05437fe700 1 -- 172.21.15.86:0/3432159258 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000fb80 con 0x7f055c0c7d10 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.273+0000 7f05437fe700 1 -- 172.21.15.86:0/3432159258 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500133f0 con 0x7f055c0c7d10 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.273+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c16bef0 con 0x7f055c0c7d10 2023-10-09T11:42:04.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.273+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c168080 con 0x7f055c0c7d10 2023-10-09T11:42:04.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.274+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c16c6b0 con 0x7f055c0c7d10 2023-10-09T11:42:04.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.275+0000 7f05437fe700 1 -- 172.21.15.86:0/3432159258 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05500137a0 con 0x7f055c0c7d10 2023-10-09T11:42:04.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.275+0000 7f05437fe700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0548066f30 0x7f05480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.276+0000 7f05437fe700 1 -- 172.21.15.86:0/3432159258 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0550084960 con 0x7f055c0c7d10 2023-10-09T11:42:04.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.276+0000 7f055b7fe700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0548066f30 0x7f05480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.276+0000 7f055b7fe700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0548066f30 0x7f05480693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f054c006f00 tx=0x7f054c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.279+0000 7f05437fe700 1 -- 172.21.15.86:0/3432159258 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0550051f00 con 0x7f055c0c7d10 2023-10-09T11:42:04.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.469+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f055c0b52d0 con 0x7f055c0c7d10 2023-10-09T11:42:04.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.469+0000 7f05437fe700 1 -- 172.21.15.86:0/3432159258 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0550017020 con 0x7f055c0c7d10 2023-10-09T11:42:04.470 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:42:04.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0548066f30 msgr2=0x7f05480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0548066f30 0x7f05480693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f054c006f00 tx=0x7f054c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0c7d10 msgr2=0x7f055c16b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0c7d10 0x7f055c16b170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0550002b50 tx=0x7f0550007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 shutdown_connections 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0548066f30 0x7f05480693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c167be0 0x7f055c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c0c7940 0x7f055c16abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.471+0000 7f0560d9d700 1 --2- 172.21.15.86:0/3432159258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0c7d10 0x7f055c16b170 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.472+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 >> 172.21.15.86:0/3432159258 conn(0x7f055c0d10c0 msgr2=0x7f055c069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.472+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 shutdown_connections 2023-10-09T11:42:04.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.472+0000 7f0560d9d700 1 -- 172.21.15.86:0/3432159258 wait complete. 2023-10-09T11:42:04.489 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:42:04.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.669+0000 7f03a19ff700 1 Processor -- start 2023-10-09T11:42:04.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.670+0000 7f03a19ff700 1 -- start start 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f03a19ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c155c10 0x7f039c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f03a19ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f039c0ac230 0x7f039c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f03a19ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c0ad930 con 0x7f039c1568a0 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f03a19ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c0acd20 con 0x7f039c0ac230 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f03a19ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0ad000 con 0x7f039c155c10 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f0393fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f039c0ac230 0x7f039c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f0393fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f039c0ac230 0x7f039c0ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52200/0 (socket says 172.21.15.86:52200) 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f0393fff700 1 -- 172.21.15.86:0/4283841159 learned_addr learned my addr 172.21.15.86:0/4283841159 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:04.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.671+0000 7f039affd700 1 --2- 172.21.15.86:0/4283841159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c155c10 0x7f039c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f0393fff700 1 -- 172.21.15.86:0/4283841159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c155c10 msgr2=0x7f039c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f0393fff700 1 --2- 172.21.15.86:0/4283841159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c155c10 0x7f039c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f0393fff700 1 -- 172.21.15.86:0/4283841159 >> v1:172.21.15.135:6789/0 conn(0x7f039c1568a0 legacy=0x7f039c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f0393fff700 1 -- 172.21.15.86:0/4283841159 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0ad2e0 con 0x7f039c0ac230 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f039a7fc700 1 -- 172.21.15.86:0/4283841159 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845871134 0 0) 0x7f039c0ad930 con 0x7f039c1568a0 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f0393fff700 1 --2- 172.21.15.86:0/4283841159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c0ac230 0x7f039c0ac6a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f03840099b0 tx=0x7f0384009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa989ce7686de31 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f039a7fc700 1 -- 172.21.15.86:0/4283841159 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384009ea0 con 0x7f039c0ac230 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f039a7fc700 1 -- 172.21.15.86:0/4283841159 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038400b860 con 0x7f039c0ac230 2023-10-09T11:42:04.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.672+0000 7f039a7fc700 1 -- 172.21.15.86:0/4283841159 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400bc00 con 0x7f039c0ac230 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 -- 172.21.15.86:0/4283841159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c0ac230 msgr2=0x7f039c0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 --2- 172.21.15.86:0/4283841159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c0ac230 0x7f039c0ac6a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f03840099b0 tx=0x7f0384009250 comp rx=0 tx=0).stop 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 -- 172.21.15.86:0/4283841159 shutdown_connections 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 --2- 172.21.15.86:0/4283841159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c155c10 0x7f039c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 --2- 172.21.15.86:0/4283841159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c0ac230 0x7f039c0ac6a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 -- 172.21.15.86:0/4283841159 >> 172.21.15.86:0/4283841159 conn(0x7f039c06a320 msgr2=0x7f039c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 -- 172.21.15.86:0/4283841159 shutdown_connections 2023-10-09T11:42:04.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.673+0000 7f03a19ff700 1 -- 172.21.15.86:0/4283841159 wait complete. 2023-10-09T11:42:04.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.674+0000 7f03a19ff700 1 Processor -- start 2023-10-09T11:42:04.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.674+0000 7f03a19ff700 1 -- start start 2023-10-09T11:42:04.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f03a19ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039c0ac230 0x7f039c0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f03a19ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c155c10 0x7f039c0af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f03a19ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c1568a0 0x7f039c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f03a19ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c14c830 con 0x7f039c155c10 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f03a19ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c14db20 con 0x7f039c0ac230 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f03a19ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c14ca80 con 0x7f039c1568a0 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f0393fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c155c10 0x7f039c0af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f0393fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c155c10 0x7f039c0af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52208/0 (socket says 172.21.15.86:52208) 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.675+0000 7f0393fff700 1 -- 172.21.15.86:0/2482745097 learned_addr learned my addr 172.21.15.86:0/2482745097 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f039b7fe700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c1568a0 0x7f039c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f039affd700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039c0ac230 0x7f039c0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0393fff700 1 -- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c1568a0 msgr2=0x7f039c14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0393fff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c1568a0 0x7f039c14b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0393fff700 1 -- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039c0ac230 msgr2=0x7f039c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0393fff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039c0ac230 0x7f039c0cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0393fff700 1 -- 172.21.15.86:0/2482745097 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840094f0 con 0x7f039c155c10 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f039b7fe700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c1568a0 0x7f039c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0393fff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c155c10 0x7f039c0af7e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f039c064290 tx=0x7f0384017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0392ffd700 1 -- 172.21.15.86:0/2482745097 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400bbe0 con 0x7f039c155c10 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0392ffd700 1 -- 172.21.15.86:0/2482745097 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384011420 con 0x7f039c155c10 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c14cd60 con 0x7f039c155c10 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.676+0000 7f0392ffd700 1 -- 172.21.15.86:0/2482745097 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840117e0 con 0x7f039c155c10 2023-10-09T11:42:04.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.677+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c14d600 con 0x7f039c155c10 2023-10-09T11:42:04.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.678+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c14d150 con 0x7f039c155c10 2023-10-09T11:42:04.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.678+0000 7f0392ffd700 1 -- 172.21.15.86:0/2482745097 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0384011bd0 con 0x7f039c155c10 2023-10-09T11:42:04.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.679+0000 7f0392ffd700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f037c066f30 0x7f037c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.679+0000 7f0392ffd700 1 -- 172.21.15.86:0/2482745097 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0384085b60 con 0x7f039c155c10 2023-10-09T11:42:04.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.679+0000 7f039affd700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f037c066f30 0x7f037c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.680+0000 7f039affd700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f037c066f30 0x7f037c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f038c009db0 tx=0x7f038c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.683+0000 7f0392ffd700 1 -- 172.21.15.86:0/2482745097 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0384053080 con 0x7f039c155c10 2023-10-09T11:42:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.875+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f039c14d7f0 con 0x7f039c155c10 2023-10-09T11:42:04.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.876+0000 7f0392ffd700 1 -- 172.21.15.86:0/2482745097 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0384015090 con 0x7f039c155c10 2023-10-09T11:42:04.877 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:04.877 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:42:04.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:04.877 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T11:42:04.877 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T11:42:04.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:04.877 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:42:04.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f037c066f30 msgr2=0x7f037c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f037c066f30 0x7f037c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f038c009db0 tx=0x7f038c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c155c10 msgr2=0x7f039c0af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c155c10 0x7f039c0af7e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f039c064290 tx=0x7f0384017000 comp rx=0 tx=0).stop 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 shutdown_connections 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f037c066f30 0x7f037c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f039c1568a0 0x7f039c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039c0ac230 0x7f039c0cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 --2- 172.21.15.86:0/2482745097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f039c155c10 0x7f039c0af7e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 >> 172.21.15.86:0/2482745097 conn(0x7f039c06a320 msgr2=0x7f039c0ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.878+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 shutdown_connections 2023-10-09T11:42:04.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:04.879+0000 7f03a19ff700 1 -- 172.21.15.86:0/2482745097 wait complete. 2023-10-09T11:42:04.896 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:42:04.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:42:05.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.081+0000 7fd2aadff700 1 Processor -- start 2023-10-09T11:42:05.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.082+0000 7fd2aadff700 1 -- start start 2023-10-09T11:42:05.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2aadff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 0x7fd2a4164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2aadff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a40cfa60 con 0x7fd2a40cd910 2023-10-09T11:42:05.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2aadff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a40b5b00 con 0x7fd2a4159ec0 2023-10-09T11:42:05.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2aadff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b5da0 con 0x7fd2a40b55a0 2023-10-09T11:42:05.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2a3fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd2a40cd910 0x7fd2a40ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38786/0 (socket says 172.21.15.86:38786) 2023-10-09T11:42:05.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2a3fff700 1 -- 172.21.15.86:0/3916982580 learned_addr learned my addr 172.21.15.86:0/3916982580 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2a939c700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 0x7fd2a4164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.083+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515037986 0 0) 0x7fd2a40cfa60 con 0x7fd2a40cd910 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd294003570 con 0x7fd2a40cd910 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285294104 0 0) 0x7fd2a40b5b00 con 0x7fd2a4159ec0 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a40cfa60 con 0x7fd2a4159ec0 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4241363390 0 0) 0x7fd294003570 con 0x7fd2a40cd910 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 msgr2=0x7fd2a4164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 0x7fd2a4164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 >> v1:172.21.15.135:6789/0 conn(0x7fd2a4159ec0 legacy=0x7fd2a40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40b6080 con 0x7fd2a40cd910 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fd290001470 con 0x7fd2a40cd910 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 >> v1:172.21.15.86:6789/0 conn(0x7fd2a40cd910 legacy=0x7fd2a40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd294003c20 0x7fd294004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd294004810 0x7fd294004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 0x7fd2940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40b5da0 con 0x7fd294003c20 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29400bb70 con 0x7fd294004810 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29400bd30 con 0x7fd2a40b55a0 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd294003c20 0x7fd294004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a3fff700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd294004810 0x7fd294004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.084+0000 7fd2a939c700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 0x7fd2940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a8b9b700 1 -- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 msgr2=0x7fd2940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a40b55a0 0x7fd2940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a8b9b700 1 -- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd294004810 msgr2=0x7fd294004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd294004810 0x7fd294004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a8b9b700 1 -- 172.21.15.86:0/3916982580 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40b6080 con 0x7fd294003c20 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd294003c20 0x7fd294004010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd298001a30 tx=0x7fd298007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7807f6dfc5a3c01e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980013f0 con 0x7fd294003c20 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29800c5d0 con 0x7fd294003c20 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.085+0000 7fd2a37fe700 1 -- 172.21.15.86:0/3916982580 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800c990 con 0x7fd294003c20 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.086+0000 7fd2aadff700 1 -- 172.21.15.86:0/3916982580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd294003c20 msgr2=0x7fd294004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.086+0000 7fd2aadff700 1 --2- 172.21.15.86:0/3916982580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd294003c20 0x7fd294004010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd298001a30 tx=0x7fd298007d80 comp rx=0 tx=0).stop 2023-10-09T11:42:05.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.086+0000 7fd2a939c700 1 -- 172.21.15.86:0/3916982580 reap_dead start 2023-10-09T11:42:05.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.086+0000 7fd2aadff700 1 -- 172.21.15.86:0/3916982580 shutdown_connections 2023-10-09T11:42:05.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.086+0000 7fd2aadff700 1 -- 172.21.15.86:0/3916982580 >> 172.21.15.86:0/3916982580 conn(0x7fd2a40999f0 msgr2=0x7fd2a40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.086+0000 7fd2aadff700 1 -- 172.21.15.86:0/3916982580 shutdown_connections 2023-10-09T11:42:05.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.086+0000 7fd2aadff700 1 -- 172.21.15.86:0/3916982580 wait complete. 2023-10-09T11:42:05.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.087+0000 7fd2aadff700 1 Processor -- start 2023-10-09T11:42:05.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.087+0000 7fd2aadff700 1 -- start start 2023-10-09T11:42:05.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.088+0000 7fd2aadff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd294003c20 0x7fd2a41568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.088+0000 7fd2aadff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a4156120 0x7fd2a416ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.088+0000 7fd2aadff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a416d200 0x7fd2a416d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.088+0000 7fd2aadff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a409b9f0 con 0x7fd2a4156120 2023-10-09T11:42:05.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.088+0000 7fd2aadff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a409b150 con 0x7fd2a416d200 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.088+0000 7fd2aadff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a409b430 con 0x7fd294003c20 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.088+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a4156120 0x7fd2a416ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a4156120 0x7fd2a416ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39030/0 (socket says 172.21.15.86:39030) 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 -- 172.21.15.86:0/175178767 learned_addr learned my addr 172.21.15.86:0/175178767 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd294003c20 0x7fd2a41568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 -- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd294003c20 msgr2=0x7fd2a41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a939c700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a416d200 0x7fd2a416d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd294003c20 0x7fd2a41568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 -- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a416d200 msgr2=0x7fd2a416d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a416d200 0x7fd2a416d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 -- 172.21.15.86:0/175178767 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a409b710 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a939c700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a416d200 0x7fd2a416d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd294003c20 0x7fd2a41568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a3fff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a4156120 0x7fd2a416ccc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd290001ac0 tx=0x7fd2900079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a0ff9700 1 -- 172.21.15.86:0/175178767 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290018030 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a0ff9700 1 -- 172.21.15.86:0/175178767 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000fa70 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a409ae40 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.089+0000 7fd2a0ff9700 1 -- 172.21.15.86:0/175178767 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000fe10 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.090+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a4156f90 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.091+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a4063c90 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.091+0000 7fd2a0ff9700 1 -- 172.21.15.86:0/175178767 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd29001b070 con 0x7fd2a4156120 2023-10-09T11:42:05.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.092+0000 7fd2a0ff9700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd288066f30 0x7fd2880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.092+0000 7fd2a0ff9700 1 -- 172.21.15.86:0/175178767 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd290019070 con 0x7fd2a4156120 2023-10-09T11:42:05.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.092+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd288066f30 0x7fd2880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.093+0000 7fd2a8b9b700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd288066f30 0x7fd2880693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd298001a30 tx=0x7fd298015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.096+0000 7fd2a0ff9700 1 -- 172.21.15.86:0/175178767 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2900517b0 con 0x7fd2a4156120 2023-10-09T11:42:05.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:05.288+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd2a416dbb0 con 0x7fd2a4156120 2023-10-09T11:42:06.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.274+0000 7fd2a0ff9700 1 -- 172.21.15.86:0/175178767 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd290054dd0 con 0x7fd2a4156120 2023-10-09T11:42:06.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.278+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd288066f30 msgr2=0x7fd2880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.278+0000 7fd2aadff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd288066f30 0x7fd2880693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd298001a30 tx=0x7fd298015000 comp rx=0 tx=0).stop 2023-10-09T11:42:06.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.278+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a4156120 msgr2=0x7fd2a416ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.278+0000 7fd2aadff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a4156120 0x7fd2a416ccc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd290001ac0 tx=0x7fd2900079d0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 shutdown_connections 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd288066f30 0x7fd2880693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a416d200 0x7fd2a416d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd294003c20 0x7fd2a41568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 --2- 172.21.15.86:0/175178767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a4156120 0x7fd2a416ccc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 >> 172.21.15.86:0/175178767 conn(0x7fd2a40999f0 msgr2=0x7fd2a4158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 shutdown_connections 2023-10-09T11:42:06.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.280+0000 7fd2aadff700 1 -- 172.21.15.86:0/175178767 wait complete. 2023-10-09T11:42:06.282 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T11:42:06.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:42:06.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.490+0000 7f7ca6fff700 1 Processor -- start 2023-10-09T11:42:06.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.490+0000 7f7ca6fff700 1 -- start start 2023-10-09T11:42:06.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.491+0000 7f7ca6fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 0x7f7ca006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.491+0000 7f7ca6fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7ca0156ee0 0x7f7ca0069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.491+0000 7f7ca6fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca006a210 con 0x7f7ca0069dd0 2023-10-09T11:42:06.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.491+0000 7f7ca6fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca0156340 con 0x7f7ca0156ee0 2023-10-09T11:42:06.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.491+0000 7f7ca6fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00c8990 con 0x7f7ca00c85c0 2023-10-09T11:42:06.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7ca559c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7ca0069dd0 0x7f7ca0159ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38798/0 (socket says 172.21.15.86:38798) 2023-10-09T11:42:06.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7ca559c700 1 -- 172.21.15.86:0/2506850805 learned_addr learned my addr 172.21.15.86:0/2506850805 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:06.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9ffff700 1 --2- 172.21.15.86:0/2506850805 >> v2:172.21.15.135:3300/0 conn(0x7f7ca0156ee0 0x7f7ca0069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7ca4d9b700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 0x7f7ca006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236802216 0 0) 0x7f7ca006a210 con 0x7f7ca0069dd0 2023-10-09T11:42:06.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c90003570 con 0x7f7ca0069dd0 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893065239 0 0) 0x7f7c90003570 con 0x7f7ca0069dd0 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 msgr2=0x7f7ca006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 0x7f7ca006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 >> v2:172.21.15.135:3300/0 conn(0x7f7ca0156ee0 msgr2=0x7f7ca0069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 --2- 172.21.15.86:0/2506850805 >> v2:172.21.15.135:3300/0 conn(0x7f7ca0156ee0 0x7f7ca0069890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca006ee20 con 0x7f7ca0069dd0 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f7c980017f0 con 0x7f7ca0069dd0 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.492+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 >> v1:172.21.15.86:6789/0 conn(0x7f7ca0069dd0 legacy=0x7f7ca0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9f7fe700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c90003a60 0x7f7c90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9f7fe700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 0x7f7c90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9f7fe700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c90004d50 0x7f7c900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0156340 con 0x7f7c90004d50 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00c8990 con 0x7f7c90003a60 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9000dc70 con 0x7f7ca00c85c0 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9ffff700 1 --2- 172.21.15.86:0/2506850805 >> v2:172.21.15.135:3300/0 conn(0x7f7ca0156ee0 0x7f7ca0069890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7ca559c700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c90004d50 0x7f7c900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7ca4d9b700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c90003a60 0x7f7c90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7c9ffff700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 0x7f7c90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7ca559c700 1 -- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 msgr2=0x7f7c90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7ca559c700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ca00c85c0 0x7f7c90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7ca559c700 1 -- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c90003a60 msgr2=0x7f7c90003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7ca559c700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c90003a60 0x7f7c90003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.493+0000 7f7ca559c700 1 -- 172.21.15.86:0/2506850805 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90003570 con 0x7f7c90004d50 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca559c700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c90004d50 0x7f7c900051c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800a970 tx=0x7f7c98002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f046bc9ba70ee74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c980070d0 con 0x7f7c90004d50 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98007270 con 0x7f7c90004d50 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7c9f7fe700 1 -- 172.21.15.86:0/2506850805 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98007630 con 0x7f7c90004d50 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca6fff700 1 -- 172.21.15.86:0/2506850805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c90004d50 msgr2=0x7f7c900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca6fff700 1 --2- 172.21.15.86:0/2506850805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c90004d50 0x7f7c900051c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800a970 tx=0x7f7c98002210 comp rx=0 tx=0).stop 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca559c700 1 -- 172.21.15.86:0/2506850805 reap_dead start 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca6fff700 1 -- 172.21.15.86:0/2506850805 shutdown_connections 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca6fff700 1 -- 172.21.15.86:0/2506850805 >> 172.21.15.86:0/2506850805 conn(0x7f7ca00cc540 msgr2=0x7f7ca00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca6fff700 1 -- 172.21.15.86:0/2506850805 shutdown_connections 2023-10-09T11:42:06.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.494+0000 7f7ca6fff700 1 -- 172.21.15.86:0/2506850805 wait complete. 2023-10-09T11:42:06.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.496+0000 7f7ca6fff700 1 Processor -- start 2023-10-09T11:42:06.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.496+0000 7f7ca6fff700 1 -- start start 2023-10-09T11:42:06.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca6fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c90004d50 0x7f7ca015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca6fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca00b0c50 0x7f7ca01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca6fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ca00cb450 0x7f7ca00cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca6fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca015b5d0 con 0x7f7ca00cb450 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca6fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00cbde0 con 0x7f7ca00b0c50 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca6fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00b14a0 con 0x7f7c90004d50 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca559c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ca00cb450 0x7f7ca00cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca559c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ca00cb450 0x7f7ca00cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39048/0 (socket says 172.21.15.86:39048) 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca559c700 1 -- 172.21.15.86:0/1874374366 learned_addr learned my addr 172.21.15.86:0/1874374366 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7c9ffff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca00b0c50 0x7f7ca01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca559c700 1 -- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c90004d50 msgr2=0x7f7ca015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.497+0000 7f7ca559c700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c90004d50 0x7f7ca015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7ca559c700 1 -- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca00b0c50 msgr2=0x7f7ca01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7ca559c700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca00b0c50 0x7f7ca01555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7ca559c700 1 -- 172.21.15.86:0/1874374366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00b1780 con 0x7f7ca00cb450 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7c9ffff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca00b0c50 0x7f7ca01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7ca559c700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ca00cb450 0x7f7ca00cb8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000f80 tx=0x7f7c98015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7c9cff9700 1 -- 172.21.15.86:0/1874374366 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98023070 con 0x7f7ca00cb450 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7c9cff9700 1 -- 172.21.15.86:0/1874374366 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c980017b0 con 0x7f7ca00cb450 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca00b1a60 con 0x7f7ca00cb450 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7c9cff9700 1 -- 172.21.15.86:0/1874374366 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c980070d0 con 0x7f7ca00cb450 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.498+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00b2020 con 0x7f7ca00cb450 2023-10-09T11:42:06.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.499+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca00718b0 con 0x7f7ca00cb450 2023-10-09T11:42:06.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.500+0000 7f7c9cff9700 1 -- 172.21.15.86:0/1874374366 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c9801e450 con 0x7f7ca00cb450 2023-10-09T11:42:06.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.501+0000 7f7c9cff9700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.501+0000 7f7c9cff9700 1 -- 172.21.15.86:0/1874374366 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7c98086460 con 0x7f7ca00cb450 2023-10-09T11:42:06.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.501+0000 7f7ca4d9b700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.502+0000 7f7ca4d9b700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c84066f30 0x7f7c840693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7c94006eb0 tx=0x7f7c940091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.506+0000 7f7c9cff9700 1 -- 172.21.15.86:0/1874374366 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c980538b0 con 0x7f7ca00cb450 2023-10-09T11:42:06.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:06.697+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ca00718b0 con 0x7f7ca00cb450 2023-10-09T11:42:07.253 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:07.258 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:07.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.287+0000 7f7c9cff9700 1 -- 172.21.15.86:0/1874374366 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7c980075f0 con 0x7f7ca00cb450 2023-10-09T11:42:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.292+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c84066f30 msgr2=0x7f7c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.292+0000 7f7ca6fff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c84066f30 0x7f7c840693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7c94006eb0 tx=0x7f7c940091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.292+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ca00cb450 msgr2=0x7f7ca00cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.292+0000 7f7ca6fff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ca00cb450 0x7f7ca00cb8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000f80 tx=0x7f7c98015000 comp rx=0 tx=0).stop 2023-10-09T11:42:07.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.294+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 shutdown_connections 2023-10-09T11:42:07.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.294+0000 7f7ca6fff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.294+0000 7f7ca6fff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ca00cb450 0x7f7ca00cb8a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.294+0000 7f7ca6fff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c90004d50 0x7f7ca015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.294+0000 7f7ca6fff700 1 --2- 172.21.15.86:0/1874374366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca00b0c50 0x7f7ca01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.294+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 >> 172.21.15.86:0/1874374366 conn(0x7f7ca00cc540 msgr2=0x7f7ca0158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:07.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.295+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 shutdown_connections 2023-10-09T11:42:07.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.296+0000 7f7ca6fff700 1 -- 172.21.15.86:0/1874374366 wait complete. 2023-10-09T11:42:07.302 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T11:42:07.322 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:42:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.545+0000 7fc02679d700 1 Processor -- start 2023-10-09T11:42:07.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.545+0000 7fc02679d700 1 -- start start 2023-10-09T11:42:07.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc02679d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0200c9db0 0x7fc02006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc02679d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02006e150 con 0x7fc020157130 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc02679d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0200c7800 con 0x7fc020153900 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc02679d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200c7610 con 0x7fc0200c9db0 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc024f9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0200c9db0 0x7fc02006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc024f9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0200c9db0 0x7fc02006a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39060/0 (socket says 172.21.15.86:39060) 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc024f9a700 1 -- 172.21.15.86:0/4282757749 learned_addr learned my addr 172.21.15.86:0/4282757749 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.546+0000 7fc025f9c700 1 --1- 172.21.15.86:0/4282757749 >> v1:172.21.15.86:6789/0 conn(0x7fc020157130 0x7fc02006e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38800/0 (socket says 172.21.15.86:38800) 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc024f9a700 1 -- 172.21.15.86:0/4282757749 >> v1:172.21.15.135:6789/0 conn(0x7fc020153900 legacy=0x7fc0200c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc024f9a700 1 -- 172.21.15.86:0/4282757749 >> v1:172.21.15.86:6789/0 conn(0x7fc020157130 legacy=0x7fc02006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc017fff700 1 -- 172.21.15.86:0/4282757749 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900700853 0 0) 0x7fc02006e150 con 0x7fc020157130 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc024f9a700 1 -- 172.21.15.86:0/4282757749 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200c7ae0 con 0x7fc0200c9db0 2023-10-09T11:42:07.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc024f9a700 1 --2- 172.21.15.86:0/4282757749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0200c9db0 0x7fc02006a000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc0100099b0 tx=0x7fc010009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e7f2ec3c5b94f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:07.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc017fff700 1 -- 172.21.15.86:0/4282757749 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000b860 con 0x7fc0200c9db0 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc017fff700 1 -- 172.21.15.86:0/4282757749 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01000b9c0 con 0x7fc0200c9db0 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.547+0000 7fc017fff700 1 -- 172.21.15.86:0/4282757749 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000bd60 con 0x7fc0200c9db0 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.548+0000 7fc02679d700 1 -- 172.21.15.86:0/4282757749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0200c9db0 msgr2=0x7fc02006a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.548+0000 7fc02679d700 1 --2- 172.21.15.86:0/4282757749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0200c9db0 0x7fc02006a000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc0100099b0 tx=0x7fc010009250 comp rx=0 tx=0).stop 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.548+0000 7fc02679d700 1 -- 172.21.15.86:0/4282757749 shutdown_connections 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.548+0000 7fc02679d700 1 --2- 172.21.15.86:0/4282757749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0200c9db0 0x7fc02006a000 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.548+0000 7fc02679d700 1 -- 172.21.15.86:0/4282757749 >> 172.21.15.86:0/4282757749 conn(0x7fc0200cc1e0 msgr2=0x7fc0200cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.548+0000 7fc02679d700 1 -- 172.21.15.86:0/4282757749 shutdown_connections 2023-10-09T11:42:07.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.548+0000 7fc02679d700 1 -- 172.21.15.86:0/4282757749 wait complete. 2023-10-09T11:42:07.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.549+0000 7fc02679d700 1 Processor -- start 2023-10-09T11:42:07.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.550+0000 7fc02679d700 1 -- start start 2023-10-09T11:42:07.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.550+0000 7fc02679d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0200c9db0 0x7fc02014b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.550+0000 7fc02679d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc020153900 0x7fc02016aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.550+0000 7fc02679d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc020157130 0x7fc0200a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.550+0000 7fc02679d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200aa7c0 con 0x7fc020157130 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.550+0000 7fc02679d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02014bdc0 con 0x7fc0200c9db0 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.550+0000 7fc02679d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200acbd0 con 0x7fc020153900 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc020157130 0x7fc0200a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc020157130 0x7fc0200a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39074/0 (socket says 172.21.15.86:39074) 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 -- 172.21.15.86:0/3852583432 learned_addr learned my addr 172.21.15.86:0/3852583432 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc02579b700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0200c9db0 0x7fc02014b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc024f9a700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc020153900 0x7fc02016aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 -- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc020153900 msgr2=0x7fc02016aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc020153900 0x7fc02016aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 -- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0200c9db0 msgr2=0x7fc02014b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0200c9db0 0x7fc02014b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 -- 172.21.15.86:0/3852583432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100094f0 con 0x7fc020157130 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc02579b700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0200c9db0 0x7fc02014b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc025f9c700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc020157130 0x7fc0200a98d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc01800ccc0 tx=0x7fc018001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc0157fa700 1 -- 172.21.15.86:0/3852583432 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018005df0 con 0x7fc020157130 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc0157fa700 1 -- 172.21.15.86:0/3852583432 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800a6b0 con 0x7fc020157130 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.551+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0200abfc0 con 0x7fc020157130 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.552+0000 7fc0157fa700 1 -- 172.21.15.86:0/3852583432 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800aa70 con 0x7fc020157130 2023-10-09T11:42:07.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.552+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200ac580 con 0x7fc020157130 2023-10-09T11:42:07.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.553+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02006c450 con 0x7fc020157130 2023-10-09T11:42:07.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.554+0000 7fc0157fa700 1 -- 172.21.15.86:0/3852583432 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0180070f0 con 0x7fc020157130 2023-10-09T11:42:07.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.554+0000 7fc0157fa700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc004066f30 0x7fc0040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.554+0000 7fc0157fa700 1 -- 172.21.15.86:0/3852583432 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fc018084600 con 0x7fc020157130 2023-10-09T11:42:07.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.555+0000 7fc02579b700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc004066f30 0x7fc0040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.555+0000 7fc02579b700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc004066f30 0x7fc0040693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc01c007fd0 tx=0x7fc01c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:07.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.559+0000 7fc0157fa700 1 -- 172.21.15.86:0/3852583432 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc018051960 con 0x7fc020157130 2023-10-09T11:42:07.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:07.791+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc02004bb80 con 0x7fc020157130 2023-10-09T11:42:08.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.312+0000 7fc0157fa700 1 -- 172.21.15.86:0/3852583432 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc018054f80 con 0x7fc020157130 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.319+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc004066f30 msgr2=0x7fc0040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.319+0000 7fc02679d700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc004066f30 0x7fc0040693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc01c007fd0 tx=0x7fc01c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc020157130 msgr2=0x7fc0200a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc020157130 0x7fc0200a98d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc01800ccc0 tx=0x7fc018001a70 comp rx=0 tx=0).stop 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 shutdown_connections 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc004066f30 0x7fc0040693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc020157130 0x7fc0200a98d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0200c9db0 0x7fc02014b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 --2- 172.21.15.86:0/3852583432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc020153900 0x7fc02016aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.320+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 >> 172.21.15.86:0/3852583432 conn(0x7fc0200cc1e0 msgr2=0x7fc0200c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.325+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 shutdown_connections 2023-10-09T11:42:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.328+0000 7fc02679d700 1 -- 172.21.15.86:0/3852583432 wait complete. 2023-10-09T11:42:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 4 and data pool 5 2023-10-09T11:42:08.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:08.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.533+0000 7fad1e1ff700 1 Processor -- start 2023-10-09T11:42:08.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.533+0000 7fad1e1ff700 1 -- start start 2023-10-09T11:42:08.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.534+0000 7fad1e1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fad181578b0 0x7fad18155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.534+0000 7fad1e1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad180af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.534+0000 7fad1e1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad180ad930 con 0x7fad18155c10 2023-10-09T11:42:08.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.534+0000 7fad1e1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad180acd20 con 0x7fad181578b0 2023-10-09T11:42:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.534+0000 7fad1e1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad180ad000 con 0x7fad180af2f0 2023-10-09T11:42:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad16ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fad181578b0 0x7fad18155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad177fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fad18155c10 0x7fad180ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38808/0 (socket says 172.21.15.86:38808) 2023-10-09T11:42:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad177fe700 1 -- 172.21.15.86:0/3283046730 learned_addr learned my addr 172.21.15.86:0/3283046730 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad17fff700 1 --2- 172.21.15.86:0/3283046730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad180af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad16ffd700 1 -- 172.21.15.86:0/3283046730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 msgr2=0x7fad180af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad16ffd700 1 --2- 172.21.15.86:0/3283046730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad180af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad16ffd700 1 -- 172.21.15.86:0/3283046730 >> v1:172.21.15.86:6789/0 conn(0x7fad18155c10 legacy=0x7fad180ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad16ffd700 1 -- 172.21.15.86:0/3283046730 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad180ad2e0 con 0x7fad181578b0 2023-10-09T11:42:08.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad17fff700 1 --2- 172.21.15.86:0/3283046730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad180af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:08.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad167fc700 1 -- 172.21.15.86:0/3283046730 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764123607 0 0) 0x7fad180ad930 con 0x7fad18155c10 2023-10-09T11:42:08.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.535+0000 7fad16ffd700 1 --2- 172.21.15.86:0/3283046730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad181578b0 0x7fad18155fe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098e0 tx=0x7fad0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c3c18ddea468c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad167fc700 1 -- 172.21.15.86:0/3283046730 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c009e80 con 0x7fad181578b0 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad167fc700 1 -- 172.21.15.86:0/3283046730 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c00b860 con 0x7fad181578b0 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad167fc700 1 -- 172.21.15.86:0/3283046730 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00bbe0 con 0x7fad181578b0 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 -- 172.21.15.86:0/3283046730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad181578b0 msgr2=0x7fad18155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/3283046730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad181578b0 0x7fad18155fe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098e0 tx=0x7fad0c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 -- 172.21.15.86:0/3283046730 shutdown_connections 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/3283046730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad180af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/3283046730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad181578b0 0x7fad18155fe0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 -- 172.21.15.86:0/3283046730 >> 172.21.15.86:0/3283046730 conn(0x7fad1806a320 msgr2=0x7fad180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 -- 172.21.15.86:0/3283046730 shutdown_connections 2023-10-09T11:42:08.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.536+0000 7fad1e1ff700 1 -- 172.21.15.86:0/3283046730 wait complete. 2023-10-09T11:42:08.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.538+0000 7fad1e1ff700 1 Processor -- start 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.538+0000 7fad1e1ff700 1 -- start start 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad1e1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad1816acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad1e1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad18155c10 0x7fad18152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad1e1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad181578b0 0x7fad180cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad1e1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180c9720 con 0x7fad18155c10 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad1e1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180c8120 con 0x7fad181578b0 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad1e1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad18152790 con 0x7fad180af2f0 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad18155c10 0x7fad18152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad18155c10 0x7fad18152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39102/0 (socket says 172.21.15.86:39102) 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 -- 172.21.15.86:0/4013476063 learned_addr learned my addr 172.21.15.86:0/4013476063 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad17fff700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad181578b0 0x7fad180cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad177fe700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad1816acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 -- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 msgr2=0x7fad1816acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad1816acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 -- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad181578b0 msgr2=0x7fad180cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad181578b0 0x7fad180cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.539+0000 7fad16ffd700 1 -- 172.21.15.86:0/4013476063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c009420 con 0x7fad18155c10 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.540+0000 7fad16ffd700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad18155c10 0x7fad18152250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad180ae0f0 tx=0x7fad0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.540+0000 7facff7fe700 1 -- 172.21.15.86:0/4013476063 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00bbe0 con 0x7fad18155c10 2023-10-09T11:42:08.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.540+0000 7facff7fe700 1 -- 172.21.15.86:0/4013476063 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c011420 con 0x7fad18155c10 2023-10-09T11:42:08.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.540+0000 7facff7fe700 1 -- 172.21.15.86:0/4013476063 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0117e0 con 0x7fad18155c10 2023-10-09T11:42:08.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.540+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1816a720 con 0x7fad18155c10 2023-10-09T11:42:08.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.540+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad180c93b0 con 0x7fad18155c10 2023-10-09T11:42:08.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.541+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad180c9890 con 0x7fad18155c10 2023-10-09T11:42:08.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.542+0000 7facff7fe700 1 -- 172.21.15.86:0/4013476063 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad0c011bd0 con 0x7fad18155c10 2023-10-09T11:42:08.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.542+0000 7facff7fe700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad04066f30 0x7fad040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.543+0000 7facff7fe700 1 -- 172.21.15.86:0/4013476063 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad0c0860a0 con 0x7fad18155c10 2023-10-09T11:42:08.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.543+0000 7fad177fe700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad04066f30 0x7fad040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.543+0000 7fad177fe700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad04066f30 0x7fad040693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fad080011e0 tx=0x7fad08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.547+0000 7facff7fe700 1 -- 172.21.15.86:0/4013476063 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad0c053270 con 0x7fad18155c10 2023-10-09T11:42:08.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.738+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad1804c3c0 con 0x7fad18155c10 2023-10-09T11:42:08.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.739+0000 7facff7fe700 1 -- 172.21.15.86:0/4013476063 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fad0c056890 con 0x7fad18155c10 2023-10-09T11:42:08.740 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:08.740 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:42:07.792782+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:05.325678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:06.736222+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.741+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad04066f30 msgr2=0x7fad040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.741+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad04066f30 0x7fad040693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fad080011e0 tx=0x7fad08009040 comp rx=0 tx=0).stop 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.741+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad18155c10 msgr2=0x7fad18152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.741+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad18155c10 0x7fad18152250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad180ae0f0 tx=0x7fad0c017000 comp rx=0 tx=0).stop 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 shutdown_connections 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad04066f30 0x7fad040693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad181578b0 0x7fad180cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad180af2f0 0x7fad1816acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 --2- 172.21.15.86:0/4013476063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad18155c10 0x7fad18152250 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 >> 172.21.15.86:0/4013476063 conn(0x7fad1806a320 msgr2=0x7fad180ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 shutdown_connections 2023-10-09T11:42:08.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.742+0000 7fad1e1ff700 1 -- 172.21.15.86:0/4013476063 wait complete. 2023-10-09T11:42:08.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:08.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.940+0000 7f8399bff700 1 Processor -- start 2023-10-09T11:42:08.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.940+0000 7f8399bff700 1 -- start start 2023-10-09T11:42:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.941+0000 7f8399bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8394159890 0x7f839415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.941+0000 7f8399bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f839415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.941+0000 7f8399bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839415a160 con 0x7f839415db10 2023-10-09T11:42:08.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.941+0000 7f8399bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940d13a0 con 0x7f8394159890 2023-10-09T11:42:08.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.941+0000 7f8399bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839415e140 con 0x7f8394159c60 2023-10-09T11:42:08.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83937fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8394159890 0x7f839415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83937fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8394159890 0x7f839415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:40188/0 (socket says 172.21.15.86:40188) 2023-10-09T11:42:08.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83937fe700 1 -- 172.21.15.86:0/2381905956 learned_addr learned my addr 172.21.15.86:0/2381905956 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:08.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f8392ffd700 1 --2- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f839415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83937fe700 1 -- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 msgr2=0x7f839415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83937fe700 1 --2- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f839415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83937fe700 1 -- 172.21.15.86:0/2381905956 >> v1:172.21.15.135:6789/0 conn(0x7f839415db10 legacy=0x7f8394069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83937fe700 1 -- 172.21.15.86:0/2381905956 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839415a3d0 con 0x7f8394159890 2023-10-09T11:42:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f83927fc700 1 -- 172.21.15.86:0/2381905956 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723950658 0 0) 0x7f839415a160 con 0x7f839415db10 2023-10-09T11:42:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.942+0000 7f8392ffd700 1 --2- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f839415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.943+0000 7f83937fe700 1 --2- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8394159890 0x7f839415abd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f83840099b0 tx=0x7f8384009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fa19882d5c2878f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.943+0000 7f83927fc700 1 -- 172.21.15.86:0/2381905956 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384009ea0 con 0x7f8394159890 2023-10-09T11:42:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.943+0000 7f83927fc700 1 -- 172.21.15.86:0/2381905956 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400b860 con 0x7f8394159890 2023-10-09T11:42:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.943+0000 7f83927fc700 1 -- 172.21.15.86:0/2381905956 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400bc00 con 0x7f8394159890 2023-10-09T11:42:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.943+0000 7f8399bff700 1 -- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8394159890 msgr2=0x7f839415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.943+0000 7f8399bff700 1 --2- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8394159890 0x7f839415abd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f83840099b0 tx=0x7f8384009250 comp rx=0 tx=0).stop 2023-10-09T11:42:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.944+0000 7f8399bff700 1 -- 172.21.15.86:0/2381905956 shutdown_connections 2023-10-09T11:42:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.944+0000 7f8399bff700 1 --2- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8394159890 0x7f839415abd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.944+0000 7f8399bff700 1 --2- 172.21.15.86:0/2381905956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f839415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.944+0000 7f8399bff700 1 -- 172.21.15.86:0/2381905956 >> 172.21.15.86:0/2381905956 conn(0x7f8394068e20 msgr2=0x7f83940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.944+0000 7f8399bff700 1 -- 172.21.15.86:0/2381905956 shutdown_connections 2023-10-09T11:42:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.944+0000 7f8399bff700 1 -- 172.21.15.86:0/2381905956 wait complete. 2023-10-09T11:42:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.945+0000 7f8399bff700 1 Processor -- start 2023-10-09T11:42:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.945+0000 7f8399bff700 1 -- start start 2023-10-09T11:42:08.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f8399bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8394159890 0x7f839414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f8399bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f83940c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f8399bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f839415db10 0x7f83940ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f8399bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c6bf0 con 0x7f8394159890 2023-10-09T11:42:08.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f8399bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c5fe0 con 0x7f839415db10 2023-10-09T11:42:08.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f8399bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c62c0 con 0x7f8394159c60 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f83937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8394159890 0x7f839414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f83937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8394159890 0x7f839414b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39106/0 (socket says 172.21.15.86:39106) 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f83937fe700 1 -- 172.21.15.86:0/4268271520 learned_addr learned my addr 172.21.15.86:0/4268271520 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.946+0000 7f8392ffd700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f83940c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f8393fff700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f839415db10 0x7f83940ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f83937fe700 1 -- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 msgr2=0x7f83940c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f83937fe700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f83940c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f83937fe700 1 -- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f839415db10 msgr2=0x7f83940ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f83937fe700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f839415db10 0x7f83940ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f83937fe700 1 -- 172.21.15.86:0/4268271520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388009420 con 0x7f8394159890 2023-10-09T11:42:08.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f8392ffd700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f83940c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:08.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f83937fe700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8394159890 0x7f839414b6f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f83940899c0 tx=0x7f8384017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f837b7fe700 1 -- 172.21.15.86:0/4268271520 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400bbe0 con 0x7f8394159890 2023-10-09T11:42:08.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f837b7fe700 1 -- 172.21.15.86:0/4268271520 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8384011420 con 0x7f8394159890 2023-10-09T11:42:08.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f837b7fe700 1 -- 172.21.15.86:0/4268271520 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840117e0 con 0x7f8394159890 2023-10-09T11:42:08.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83840094f0 con 0x7f8394159890 2023-10-09T11:42:08.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.947+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83940c6880 con 0x7f8394159890 2023-10-09T11:42:08.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.948+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839404c3c0 con 0x7f8394159890 2023-10-09T11:42:08.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.949+0000 7f837b7fe700 1 -- 172.21.15.86:0/4268271520 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8384011c10 con 0x7f8394159890 2023-10-09T11:42:08.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.950+0000 7f837b7fe700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.950+0000 7f837b7fe700 1 -- 172.21.15.86:0/4268271520 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8384085f20 con 0x7f8394159890 2023-10-09T11:42:08.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.950+0000 7f8392ffd700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.951+0000 7f8392ffd700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8380066f30 0x7f83800693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83880093f0 tx=0x7f8388008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:08.954+0000 7f837b7fe700 1 -- 172.21.15.86:0/4268271520 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83840530f0 con 0x7f8394159890 2023-10-09T11:42:09.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.147+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f839406a5b0 con 0x7f8394159890 2023-10-09T11:42:09.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.148+0000 7f837b7fe700 1 -- 172.21.15.86:0/4268271520 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f8384056710 con 0x7f8394159890 2023-10-09T11:42:09.149 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:09.149 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:42:07.792782+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:05.325678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:06.736222+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:09.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.150+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8380066f30 msgr2=0x7f83800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.150+0000 7f8399bff700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8380066f30 0x7f83800693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83880093f0 tx=0x7f8388008040 comp rx=0 tx=0).stop 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.150+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8394159890 msgr2=0x7f839414b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.150+0000 7f8399bff700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8394159890 0x7f839414b6f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f83940899c0 tx=0x7f8384017000 comp rx=0 tx=0).stop 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 shutdown_connections 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8394159890 0x7f839414b6f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f839415db10 0x7f83940ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 --2- 172.21.15.86:0/4268271520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8394159c60 0x7f83940c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 >> 172.21.15.86:0/4268271520 conn(0x7f8394068e20 msgr2=0x7f839414d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 shutdown_connections 2023-10-09T11:42:09.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.151+0000 7f8399bff700 1 -- 172.21.15.86:0/4268271520 wait complete. 2023-10-09T11:42:09.169 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:42:09.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.355+0000 7f015239d700 1 Processor -- start 2023-10-09T11:42:09.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.355+0000 7f015239d700 1 -- start start 2023-10-09T11:42:09.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.356+0000 7f015239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c0cb230 0x7f014c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.356+0000 7f015239d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0c9f30 con 0x7f014c159a60 2023-10-09T11:42:09.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.356+0000 7f015239d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0ca470 con 0x7f014c0ccc00 2023-10-09T11:42:09.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.356+0000 7f015239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0cbbd0 con 0x7f014c0cb230 2023-10-09T11:42:09.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.356+0000 7f015139b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f014c159a60 0x7f014c0c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38822/0 (socket says 172.21.15.86:38822) 2023-10-09T11:42:09.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.356+0000 7f015139b700 1 -- 172.21.15.86:0/2426438614 learned_addr learned my addr 172.21.15.86:0/2426438614 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:09.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0151b9c700 1 --2- 172.21.15.86:0/2426438614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c0cb230 0x7f014c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089699231 0 0) 0x7f014c0c9f30 con 0x7f014c159a60 2023-10-09T11:42:09.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138003570 con 0x7f014c159a60 2023-10-09T11:42:09.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9456318 0 0) 0x7f014c0ca470 con 0x7f014c0ccc00 2023-10-09T11:42:09.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f014c0c9f30 con 0x7f014c0ccc00 2023-10-09T11:42:09.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4055065833 0 0) 0x7f0138003570 con 0x7f014c159a60 2023-10-09T11:42:09.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0151b9c700 1 -- 172.21.15.86:0/2426438614 >> v1:172.21.15.135:6789/0 conn(0x7f014c0ccc00 legacy=0x7f014c069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0151b9c700 1 -- 172.21.15.86:0/2426438614 >> v1:172.21.15.86:6789/0 conn(0x7f014c159a60 legacy=0x7f014c0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.357+0000 7f0151b9c700 1 -- 172.21.15.86:0/2426438614 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0ca750 con 0x7f014c0cb230 2023-10-09T11:42:09.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f0151b9c700 1 --2- 172.21.15.86:0/2426438614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c0cb230 0x7f014c0cb690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0144009e90 tx=0x7f0144009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd432d48b59a937e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400e070 con 0x7f014c0cb230 2023-10-09T11:42:09.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014400b900 con 0x7f014c0cb230 2023-10-09T11:42:09.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f0143fff700 1 -- 172.21.15.86:0/2426438614 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148001470 con 0x7f014c0cb230 2023-10-09T11:42:09.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f015239d700 1 -- 172.21.15.86:0/2426438614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c0cb230 msgr2=0x7f014c0cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f015239d700 1 --2- 172.21.15.86:0/2426438614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c0cb230 0x7f014c0cb690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0144009e90 tx=0x7f0144009780 comp rx=0 tx=0).stop 2023-10-09T11:42:09.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f015239d700 1 -- 172.21.15.86:0/2426438614 shutdown_connections 2023-10-09T11:42:09.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f015239d700 1 --2- 172.21.15.86:0/2426438614 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c0cb230 0x7f014c0cb690 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f015239d700 1 -- 172.21.15.86:0/2426438614 >> 172.21.15.86:0/2426438614 conn(0x7f014c06baa0 msgr2=0x7f014c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.358+0000 7f015239d700 1 -- 172.21.15.86:0/2426438614 shutdown_connections 2023-10-09T11:42:09.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.359+0000 7f015239d700 1 -- 172.21.15.86:0/2426438614 wait complete. 2023-10-09T11:42:09.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.360+0000 7f015239d700 1 Processor -- start 2023-10-09T11:42:09.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.360+0000 7f015239d700 1 -- start start 2023-10-09T11:42:09.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015239d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f014c0cb230 0x7f014c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c0ccc00 0x7f014c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c159a60 0x7f014c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015239d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c16a0f0 con 0x7f014c0cb230 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0b1910 con 0x7f014c0ccc00 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0b1bf0 con 0x7f014c159a60 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f014c0cb230 0x7f014c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f014c0cb230 0x7f014c152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39112/0 (socket says 172.21.15.86:39112) 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f015139b700 1 -- 172.21.15.86:0/862477053 learned_addr learned my addr 172.21.15.86:0/862477053 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f0151b9c700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c159a60 0x7f014c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.361+0000 7f0150b9a700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c0ccc00 0x7f014c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015139b700 1 -- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c159a60 msgr2=0x7f014c155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015139b700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c159a60 0x7f014c155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015139b700 1 -- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c0ccc00 msgr2=0x7f014c155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015139b700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c0ccc00 0x7f014c155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015139b700 1 -- 172.21.15.86:0/862477053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144009a20 con 0x7f014c0cb230 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f0150b9a700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c0ccc00 0x7f014c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015139b700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f014c0cb230 0x7f014c152750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f014800cb60 tx=0x7f0148001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f01417fa700 1 -- 172.21.15.86:0/862477053 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148007e90 con 0x7f014c0cb230 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f01417fa700 1 -- 172.21.15.86:0/862477053 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148007360 con 0x7f014c0cb230 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c0b1ed0 con 0x7f014c0cb230 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f01417fa700 1 -- 172.21.15.86:0/862477053 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148004830 con 0x7f014c0cb230 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.362+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c156930 con 0x7f014c0cb230 2023-10-09T11:42:09.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.363+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c06eba0 con 0x7f014c0cb230 2023-10-09T11:42:09.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.364+0000 7f01417fa700 1 -- 172.21.15.86:0/862477053 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0148004ba0 con 0x7f014c0cb230 2023-10-09T11:42:09.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.365+0000 7f01417fa700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0130066f30 0x7f01300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.365+0000 7f01417fa700 1 -- 172.21.15.86:0/862477053 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0148083a70 con 0x7f014c0cb230 2023-10-09T11:42:09.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.365+0000 7f0150b9a700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0130066f30 0x7f01300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.365+0000 7f0150b9a700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0130066f30 0x7f01300693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f014c0b0ce0 tx=0x7f013c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.369+0000 7f01417fa700 1 -- 172.21.15.86:0/862477053 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0148050cc0 con 0x7f014c0cb230 2023-10-09T11:42:09.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:09.606+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f014c04bb80 con 0x7f014c0cb230 2023-10-09T11:42:10.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.324+0000 7f01417fa700 1 -- 172.21.15.86:0/862477053 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0148018070 con 0x7f014c0cb230 2023-10-09T11:42:10.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0130066f30 msgr2=0x7f01300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0130066f30 0x7f01300693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f014c0b0ce0 tx=0x7f013c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:10.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f014c0cb230 msgr2=0x7f014c152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f014c0cb230 0x7f014c152750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f014800cb60 tx=0x7f0148001ad0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 shutdown_connections 2023-10-09T11:42:10.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0130066f30 0x7f01300693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f014c0cb230 0x7f014c152750 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f014c159a60 0x7f014c155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 --2- 172.21.15.86:0/862477053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c0ccc00 0x7f014c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 >> 172.21.15.86:0/862477053 conn(0x7f014c06baa0 msgr2=0x7f014c06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:10.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 shutdown_connections 2023-10-09T11:42:10.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.327+0000 7f015239d700 1 -- 172.21.15.86:0/862477053 wait complete. 2023-10-09T11:42:10.347 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:42:10.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.532+0000 7f07b759d700 1 Processor -- start 2023-10-09T11:42:10.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.532+0000 7f07b759d700 1 -- start start 2023-10-09T11:42:10.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.533+0000 7f07b759d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07b006f060 0x7f07b00ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.533+0000 7f07b759d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b006ebd0 con 0x7f07b006f4b0 2023-10-09T11:42:10.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b759d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b015aa70 con 0x7f07b00cb1a0 2023-10-09T11:42:10.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b759d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b015b2e0 con 0x7f07b006f060 2023-10-09T11:42:10.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b5d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07b006f060 0x7f07b00ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b6d9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f07b006f4b0 0x7f07b00c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38828/0 (socket says 172.21.15.86:38828) 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b6d9c700 1 -- 172.21.15.86:0/1879852261 learned_addr learned my addr 172.21.15.86:0/1879852261 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b5d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07b006f060 0x7f07b00ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39124/0 (socket says 172.21.15.86:39124) 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b5d9a700 1 -- 172.21.15.86:0/1879852261 >> v1:172.21.15.135:6789/0 conn(0x7f07b00cb1a0 legacy=0x7f07b015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b5d9a700 1 -- 172.21.15.86:0/1879852261 >> v1:172.21.15.86:6789/0 conn(0x7f07b006f4b0 legacy=0x7f07b00c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b5d9a700 1 -- 172.21.15.86:0/1879852261 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b015ad20 con 0x7f07b006f060 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.534+0000 7f07b5599700 1 -- 172.21.15.86:0/1879852261 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347942746 0 0) 0x7f07b006ebd0 con 0x7f07b006f4b0 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b5d9a700 1 --2- 172.21.15.86:0/1879852261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b006f060 0x7f07b00ae0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f07a00098e0 tx=0x7f07a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741ec57acff4c5e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b5599700 1 -- 172.21.15.86:0/1879852261 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0009e80 con 0x7f07b006f060 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b5599700 1 -- 172.21.15.86:0/1879852261 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a000b8f0 con 0x7f07b006f060 2023-10-09T11:42:10.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b5599700 1 -- 172.21.15.86:0/1879852261 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000bc70 con 0x7f07b006f060 2023-10-09T11:42:10.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b759d700 1 -- 172.21.15.86:0/1879852261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b006f060 msgr2=0x7f07b00ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b759d700 1 --2- 172.21.15.86:0/1879852261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b006f060 0x7f07b00ae0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f07a00098e0 tx=0x7f07a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b759d700 1 -- 172.21.15.86:0/1879852261 shutdown_connections 2023-10-09T11:42:10.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b759d700 1 --2- 172.21.15.86:0/1879852261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b006f060 0x7f07b00ae0d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b759d700 1 -- 172.21.15.86:0/1879852261 >> 172.21.15.86:0/1879852261 conn(0x7f07b00cc1e0 msgr2=0x7f07b00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:10.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.535+0000 7f07b759d700 1 -- 172.21.15.86:0/1879852261 shutdown_connections 2023-10-09T11:42:10.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.536+0000 7f07b759d700 1 -- 172.21.15.86:0/1879852261 wait complete. 2023-10-09T11:42:10.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.537+0000 7f07b759d700 1 Processor -- start 2023-10-09T11:42:10.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.537+0000 7f07b759d700 1 -- start start 2023-10-09T11:42:10.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b006f060 0x7f07b00c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b006f4b0 0x7f07b016ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b759d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b00cb1a0 0x7f07b0159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b759d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b016b2e0 con 0x7f07b00cb1a0 2023-10-09T11:42:10.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c6530 con 0x7f07b006f4b0 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c5490 con 0x7f07b006f060 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b6d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b00cb1a0 0x7f07b0159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b6d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b00cb1a0 0x7f07b0159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39140/0 (socket says 172.21.15.86:39140) 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b6d9c700 1 -- 172.21.15.86:0/1805509884 learned_addr learned my addr 172.21.15.86:0/1805509884 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b5d9a700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b006f4b0 0x7f07b016ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b6d9c700 1 -- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b006f060 msgr2=0x7f07b00c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.538+0000 7f07b659b700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b006f060 0x7f07b00c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b6d9c700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b006f060 0x7f07b00c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b6d9c700 1 -- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b006f4b0 msgr2=0x7f07b016ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b6d9c700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b006f4b0 0x7f07b016ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b6d9c700 1 -- 172.21.15.86:0/1805509884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0009420 con 0x7f07b00cb1a0 2023-10-09T11:42:10.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b5d9a700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b006f4b0 0x7f07b016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:10.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b659b700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b006f060 0x7f07b00c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:10.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b6d9c700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b00cb1a0 0x7f07b0159130 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f07a800cc90 tx=0x7f07a8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07a67fc700 1 -- 172.21.15.86:0/1805509884 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a800cea0 con 0x7f07b00cb1a0 2023-10-09T11:42:10.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07a67fc700 1 -- 172.21.15.86:0/1805509884 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a800ab70 con 0x7f07b00cb1a0 2023-10-09T11:42:10.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07a67fc700 1 -- 172.21.15.86:0/1805509884 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80070f0 con 0x7f07b00cb1a0 2023-10-09T11:42:10.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b00c5770 con 0x7f07b00cb1a0 2023-10-09T11:42:10.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.539+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b00c5d30 con 0x7f07b00cb1a0 2023-10-09T11:42:10.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.540+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b006c450 con 0x7f07b00cb1a0 2023-10-09T11:42:10.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.541+0000 7f07a67fc700 1 -- 172.21.15.86:0/1805509884 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07a80074a0 con 0x7f07b00cb1a0 2023-10-09T11:42:10.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.542+0000 7f07a67fc700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0794066f60 0x7f0794069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.542+0000 7f07a67fc700 1 -- 172.21.15.86:0/1805509884 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07a80849e0 con 0x7f07b00cb1a0 2023-10-09T11:42:10.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.542+0000 7f07b659b700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0794066f60 0x7f0794069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.542+0000 7f07b659b700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0794066f60 0x7f0794069410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07b00c2f40 tx=0x7f07ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.546+0000 7f07a67fc700 1 -- 172.21.15.86:0/1805509884 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07a8051c30 con 0x7f07b00cb1a0 2023-10-09T11:42:10.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:10.777+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f07b015b000 con 0x7f07b00cb1a0 2023-10-09T11:42:11.260 INFO:tasks.ceph.mds.c.smithi086.stderr:2023-10-09T11:42:11.259+0000 7f491b1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:11.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.327+0000 7f07a67fc700 1 -- 172.21.15.86:0/1805509884 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f07a8055250 con 0x7f07b00cb1a0 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0794066f60 msgr2=0x7f0794069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0794066f60 0x7f0794069410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07b00c2f40 tx=0x7f07ac009040 comp rx=0 tx=0).stop 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b00cb1a0 msgr2=0x7f07b0159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b00cb1a0 0x7f07b0159130 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f07a800cc90 tx=0x7f07a8001a80 comp rx=0 tx=0).stop 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 shutdown_connections 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0794066f60 0x7f0794069410 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07b00cb1a0 0x7f07b0159130 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b006f060 0x7f07b00c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 --2- 172.21.15.86:0/1805509884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b006f4b0 0x7f07b016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 >> 172.21.15.86:0/1805509884 conn(0x7f07b00cc1e0 msgr2=0x7f07b00c11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 shutdown_connections 2023-10-09T11:42:11.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.330+0000 7f07b759d700 1 -- 172.21.15.86:0/1805509884 wait complete. 2023-10-09T11:42:11.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:11.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.528+0000 7f5d687ff700 1 Processor -- start 2023-10-09T11:42:11.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.528+0000 7f5d687ff700 1 -- start start 2023-10-09T11:42:11.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d687ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5d601578b0 0x7f5d60155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d687ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d600af2f0 0x7f5d600af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d687ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d600ad930 con 0x7f5d60155c10 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d687ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600b0c80 con 0x7f5d600af2f0 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d687ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600acd20 con 0x7f5d601578b0 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d66d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d600af2f0 0x7f5d600af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d66d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d600af2f0 0x7f5d600af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39156/0 (socket says 172.21.15.86:39156) 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3557869717 learned_addr learned my addr 172.21.15.86:0/3557869717 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d65d9a700 1 --2- 172.21.15.86:0/3557869717 >> v2:172.21.15.135:3300/0 conn(0x7f5d601578b0 0x7f5d60155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3557869717 >> v2:172.21.15.135:3300/0 conn(0x7f5d601578b0 msgr2=0x7f5d60155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d66d9c700 1 --2- 172.21.15.86:0/3557869717 >> v2:172.21.15.135:3300/0 conn(0x7f5d601578b0 0x7f5d60155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3557869717 >> v1:172.21.15.135:6789/0 conn(0x7f5d60155c10 legacy=0x7f5d600ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3557869717 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600ad000 con 0x7f5d600af2f0 2023-10-09T11:42:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.530+0000 7f5d65d9a700 1 --2- 172.21.15.86:0/3557869717 >> v2:172.21.15.135:3300/0 conn(0x7f5d601578b0 0x7f5d60155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:11.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.531+0000 7f5d66d9c700 1 --2- 172.21.15.86:0/3557869717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d600af2f0 0x7f5d600af730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c8c60 tx=0x7f5d58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b227b17fcf7479c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.531+0000 7f5d65599700 1 -- 172.21.15.86:0/3557869717 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800e070 con 0x7f5d600af2f0 2023-10-09T11:42:11.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.531+0000 7f5d65599700 1 -- 172.21.15.86:0/3557869717 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5800ba50 con 0x7f5d600af2f0 2023-10-09T11:42:11.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.531+0000 7f5d65599700 1 -- 172.21.15.86:0/3557869717 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580092e0 con 0x7f5d600af2f0 2023-10-09T11:42:11.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.531+0000 7f5d687ff700 1 -- 172.21.15.86:0/3557869717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d600af2f0 msgr2=0x7f5d600af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.531+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3557869717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d600af2f0 0x7f5d600af730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c8c60 tx=0x7f5d58009840 comp rx=0 tx=0).stop 2023-10-09T11:42:11.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.532+0000 7f5d687ff700 1 -- 172.21.15.86:0/3557869717 shutdown_connections 2023-10-09T11:42:11.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.532+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3557869717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d600af2f0 0x7f5d600af730 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.532+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3557869717 >> v2:172.21.15.135:3300/0 conn(0x7f5d601578b0 0x7f5d60155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.532+0000 7f5d687ff700 1 -- 172.21.15.86:0/3557869717 >> 172.21.15.86:0/3557869717 conn(0x7f5d6006a320 msgr2=0x7f5d600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.532+0000 7f5d687ff700 1 -- 172.21.15.86:0/3557869717 shutdown_connections 2023-10-09T11:42:11.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.532+0000 7f5d687ff700 1 -- 172.21.15.86:0/3557869717 wait complete. 2023-10-09T11:42:11.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.533+0000 7f5d687ff700 1 Processor -- start 2023-10-09T11:42:11.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.533+0000 7f5d687ff700 1 -- start start 2023-10-09T11:42:11.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d687ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d600af2f0 0x7f5d600aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d687ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d60155c10 0x7f5d600ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d687ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d601578b0 0x7f5d6014e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d687ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600ca710 con 0x7f5d601578b0 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d687ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600ca9f0 con 0x7f5d60155c10 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d687ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600aaaa0 con 0x7f5d600af2f0 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d66d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d601578b0 0x7f5d6014e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d66d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d601578b0 0x7f5d6014e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39166/0 (socket says 172.21.15.86:39166) 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3285817806 learned_addr learned my addr 172.21.15.86:0/3285817806 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.534+0000 7f5d65d9a700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d60155c10 0x7f5d600ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d6659b700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d600af2f0 0x7f5d600aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d600af2f0 msgr2=0x7f5d600aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d66d9c700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d600af2f0 0x7f5d600aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d60155c10 msgr2=0x7f5d600ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d66d9c700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d60155c10 0x7f5d600ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d66d9c700 1 -- 172.21.15.86:0/3285817806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d58009ae0 con 0x7f5d601578b0 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d6659b700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d600af2f0 0x7f5d600aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d66d9c700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d601578b0 0x7f5d6014e420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d60064290 tx=0x7f5d58018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d567fc700 1 -- 172.21.15.86:0/3285817806 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58008e40 con 0x7f5d601578b0 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d567fc700 1 -- 172.21.15.86:0/3285817806 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5800be60 con 0x7f5d601578b0 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d567fc700 1 -- 172.21.15.86:0/3285817806 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580266b0 con 0x7f5d601578b0 2023-10-09T11:42:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d600aad80 con 0x7f5d601578b0 2023-10-09T11:42:11.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.535+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d600aa7c0 con 0x7f5d601578b0 2023-10-09T11:42:11.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.536+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d600cab60 con 0x7f5d601578b0 2023-10-09T11:42:11.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.537+0000 7f5d567fc700 1 -- 172.21.15.86:0/3285817806 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d58003040 con 0x7f5d601578b0 2023-10-09T11:42:11.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.538+0000 7f5d567fc700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d44066f30 0x7f5d440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.538+0000 7f5d567fc700 1 -- 172.21.15.86:0/3285817806 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d580864c0 con 0x7f5d601578b0 2023-10-09T11:42:11.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.538+0000 7f5d6659b700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d44066f30 0x7f5d440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.539+0000 7f5d6659b700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d44066f30 0x7f5d440693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c001840 tx=0x7f5d5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.542+0000 7f5d567fc700 1 -- 172.21.15.86:0/3285817806 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d58053690 con 0x7f5d601578b0 2023-10-09T11:42:11.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.771+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d6004c3c0 con 0x7f5d601578b0 2023-10-09T11:42:11.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.772+0000 7f5d567fc700 1 -- 172.21.15.86:0/3285817806 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f5d58056cb0 con 0x7f5d601578b0 2023-10-09T11:42:11.773 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:11.773 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1552998028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1552998028},{"type":"v1","addr":"172.21.15.135:6834","nonce":1552998028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3861152933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3861152933},{"type":"v1","addr":"172.21.15.135:6835","nonce":3861152933}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4887,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/647611791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":647611791},{"type":"v1","addr":"172.21.15.86:6836","nonce":647611791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:07.793130+0000","modified":"2023-10-09T11:42:11.321775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6837/1725825433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1725825433},{"type":"v1","addr":"172.21.15.86:6837","nonce":1725825433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:42:11.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d44066f30 msgr2=0x7f5d440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d44066f30 0x7f5d440693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c001840 tx=0x7f5d5c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:11.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d601578b0 msgr2=0x7f5d6014e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d601578b0 0x7f5d6014e420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d60064290 tx=0x7f5d58018000 comp rx=0 tx=0).stop 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 shutdown_connections 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5d44066f30 0x7f5d440693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d601578b0 0x7f5d6014e420 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d600af2f0 0x7f5d600aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 --2- 172.21.15.86:0/3285817806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d60155c10 0x7f5d600ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 >> 172.21.15.86:0/3285817806 conn(0x7f5d6006a320 msgr2=0x7f5d6014bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.774+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 shutdown_connections 2023-10-09T11:42:11.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.775+0000 7f5d687ff700 1 -- 172.21.15.86:0/3285817806 wait complete. 2023-10-09T11:42:11.777 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2023-10-09T11:42:11.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:11.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.973+0000 7f89ff59e700 1 Processor -- start 2023-10-09T11:42:11.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.973+0000 7f89ff59e700 1 -- start start 2023-10-09T11:42:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.974+0000 7f89ff59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a0006a0a0 0x7f8a0015b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.974+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006dd20 0x7f8a0015b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.974+0000 7f89ff59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0006ae70 con 0x7f8a0006d950 2023-10-09T11:42:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.974+0000 7f89ff59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a000c8a60 con 0x7f8a0006a0a0 2023-10-09T11:42:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.974+0000 7f89ff59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0006a540 con 0x7f8a0006dd20 2023-10-09T11:42:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fed9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006dd20 0x7f8a0015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a0006a0a0 0x7f8a0015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a0006a0a0 0x7f8a0015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:40248/0 (socket says 172.21.15.86:40248) 2023-10-09T11:42:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 -- 172.21.15.86:0/822216366 learned_addr learned my addr 172.21.15.86:0/822216366 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fe59c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8a0006d950 0x7f8a000c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:43812/0 (socket says 172.21.15.86:43812) 2023-10-09T11:42:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fed9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006dd20 0x7f8a0015b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:39492/0 (socket says 172.21.15.86:39492) 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fd59a700 1 -- 172.21.15.86:0/822216366 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299484222 0 0) 0x7f8a0006ae70 con 0x7f8a0006d950 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 -- 172.21.15.86:0/822216366 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006dd20 msgr2=0x7f8a0015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 --2- 172.21.15.86:0/822216366 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006dd20 0x7f8a0015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 -- 172.21.15.86:0/822216366 >> v1:172.21.15.135:6789/0 conn(0x7f8a0006d950 legacy=0x7f8a000c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 -- 172.21.15.86:0/822216366 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0006a820 con 0x7f8a0006a0a0 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.975+0000 7f89fdd9b700 1 --2- 172.21.15.86:0/822216366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006a0a0 0x7f8a0015b410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89f40099b0 tx=0x7f89f4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=536a9e6eabe5b39a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89fd59a700 1 -- 172.21.15.86:0/822216366 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4009ea0 con 0x7f8a0006a0a0 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89fd59a700 1 -- 172.21.15.86:0/822216366 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f400b860 con 0x7f8a0006a0a0 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89fd59a700 1 -- 172.21.15.86:0/822216366 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f400bc00 con 0x7f8a0006a0a0 2023-10-09T11:42:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 -- 172.21.15.86:0/822216366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006a0a0 msgr2=0x7f8a0015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 --2- 172.21.15.86:0/822216366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006a0a0 0x7f8a0015b410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89f40099b0 tx=0x7f89f4009250 comp rx=0 tx=0).stop 2023-10-09T11:42:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 -- 172.21.15.86:0/822216366 shutdown_connections 2023-10-09T11:42:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 --2- 172.21.15.86:0/822216366 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006dd20 0x7f8a0015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 --2- 172.21.15.86:0/822216366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006a0a0 0x7f8a0015b410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 -- 172.21.15.86:0/822216366 >> 172.21.15.86:0/822216366 conn(0x7f8a000cc1f0 msgr2=0x7f8a000cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 -- 172.21.15.86:0/822216366 shutdown_connections 2023-10-09T11:42:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.976+0000 7f89ff59e700 1 -- 172.21.15.86:0/822216366 wait complete. 2023-10-09T11:42:11.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.978+0000 7f89ff59e700 1 Processor -- start 2023-10-09T11:42:11.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.978+0000 7f89ff59e700 1 -- start start 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006a0a0 0x7f8a001519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006d950 0x7f8a000c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89ff59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0006dd20 0x7f8a0015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89ff59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00152300 con 0x7f8a0006dd20 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89ff59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00159280 con 0x7f8a0006d950 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89ff59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a001594e0 con 0x7f8a0006a0a0 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89fed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0006dd20 0x7f8a0015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89fed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0006dd20 0x7f8a0015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39178/0 (socket says 172.21.15.86:39178) 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89fed9d700 1 -- 172.21.15.86:0/692757138 learned_addr learned my addr 172.21.15.86:0/692757138 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89fdd9b700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006d950 0x7f8a000c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.979+0000 7f89fe59c700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006a0a0 0x7f8a001519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89fed9d700 1 -- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006a0a0 msgr2=0x7f8a001519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89fed9d700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006a0a0 0x7f8a001519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89fed9d700 1 -- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006d950 msgr2=0x7f8a000c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89fed9d700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006d950 0x7f8a000c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89fed9d700 1 -- 172.21.15.86:0/692757138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40094f0 con 0x7f8a0006dd20 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89fed9d700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0006dd20 0x7f8a0015a580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f89f80124f0 tx=0x7f89f800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89ee7fc700 1 -- 172.21.15.86:0/692757138 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800d0d0 con 0x7f8a0006dd20 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89ee7fc700 1 -- 172.21.15.86:0/692757138 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8013040 con 0x7f8a0006dd20 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89ee7fc700 1 -- 172.21.15.86:0/692757138 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800d4a0 con 0x7f8a0006dd20 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a001597c0 con 0x7f8a0006dd20 2023-10-09T11:42:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.980+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0015a060 con 0x7f8a0006dd20 2023-10-09T11:42:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.981+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a00159bc0 con 0x7f8a0006dd20 2023-10-09T11:42:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.982+0000 7f89ee7fc700 1 -- 172.21.15.86:0/692757138 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89f800b960 con 0x7f8a0006dd20 2023-10-09T11:42:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.983+0000 7f89ee7fc700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f89e0066f30 0x7f89e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.983+0000 7f89ee7fc700 1 -- 172.21.15.86:0/692757138 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89f8088e90 con 0x7f8a0006dd20 2023-10-09T11:42:11.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.983+0000 7f89fe59c700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f89e0066f30 0x7f89e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.984+0000 7f89fe59c700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f89e0066f30 0x7f89e00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f89f0007fd0 tx=0x7f89f0007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:11.987+0000 7f89ee7fc700 1 -- 172.21.15.86:0/692757138 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89f8056060 con 0x7f8a0006dd20 2023-10-09T11:42:12.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.179+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a0015a250 con 0x7f8a0006dd20 2023-10-09T11:42:12.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.180+0000 7f89ee7fc700 1 -- 172.21.15.86:0/692757138 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f89f808a090 con 0x7f8a0006dd20 2023-10-09T11:42:12.181 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:12.181 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":35,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:42:09.307523+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:05.325678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:06.736222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f89e0066f30 msgr2=0x7f89e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f89e0066f30 0x7f89e00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f89f0007fd0 tx=0x7f89f0007d50 comp rx=0 tx=0).stop 2023-10-09T11:42:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0006dd20 msgr2=0x7f8a0015a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0006dd20 0x7f8a0015a580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f89f80124f0 tx=0x7f89f800f040 comp rx=0 tx=0).stop 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 shutdown_connections 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f89e0066f30 0x7f89e00693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0006dd20 0x7f8a0015a580 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a0006a0a0 0x7f8a001519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 --2- 172.21.15.86:0/692757138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0006d950 0x7f8a000c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 >> 172.21.15.86:0/692757138 conn(0x7f8a000cc1f0 msgr2=0x7f8a00153bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.182+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 shutdown_connections 2023-10-09T11:42:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.183+0000 7f89ff59e700 1 -- 172.21.15.86:0/692757138 wait complete. 2023-10-09T11:42:12.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:42:12.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:12.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.383+0000 7f9fe9dff700 1 Processor -- start 2023-10-09T11:42:12.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.383+0000 7f9fe9dff700 1 -- start start 2023-10-09T11:42:12.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe9dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fe4155c10 0x7f9fe4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe9dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9fe40ac230 0x7f9fe40ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe9dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 0x7f9fe4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe9dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe40ad930 con 0x7f9fe4155c10 2023-10-09T11:42:12.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe9dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe40acd20 con 0x7f9fe40ac230 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe9dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe40ad000 con 0x7f9fe41568a0 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fe4155c10 0x7f9fe4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fe4155c10 0x7f9fe4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39184/0 (socket says 172.21.15.86:39184) 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 -- 172.21.15.86:0/2311714475 learned_addr learned my addr 172.21.15.86:0/2311714475 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe3fff700 1 --2- 172.21.15.86:0/2311714475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 0x7f9fe4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fdbfff700 1 --2- 172.21.15.86:0/2311714475 >> v2:172.21.15.135:3300/0 conn(0x7f9fe40ac230 0x7f9fe40ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 -- 172.21.15.86:0/2311714475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 msgr2=0x7f9fe4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 --2- 172.21.15.86:0/2311714475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 0x7f9fe4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 -- 172.21.15.86:0/2311714475 >> v2:172.21.15.135:3300/0 conn(0x7f9fe40ac230 msgr2=0x7f9fe40ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 --2- 172.21.15.86:0/2311714475 >> v2:172.21.15.135:3300/0 conn(0x7f9fe40ac230 0x7f9fe40ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fe37fe700 1 -- 172.21.15.86:0/2311714475 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40ad2e0 con 0x7f9fe4155c10 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.385+0000 7f9fdbfff700 1 --2- 172.21.15.86:0/2311714475 >> v2:172.21.15.135:3300/0 conn(0x7f9fe40ac230 0x7f9fe40ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe37fe700 1 --2- 172.21.15.86:0/2311714475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe4155c10 0x7f9fe4155fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4065bb0 tx=0x7f9fd400b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fac074b2f782da7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe2ffd700 1 -- 172.21.15.86:0/2311714475 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400db10 con 0x7f9fe4155c10 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe2ffd700 1 -- 172.21.15.86:0/2311714475 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd400dc70 con 0x7f9fe4155c10 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe2ffd700 1 -- 172.21.15.86:0/2311714475 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4017410 con 0x7f9fe4155c10 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe9dff700 1 -- 172.21.15.86:0/2311714475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe4155c10 msgr2=0x7f9fe4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/2311714475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe4155c10 0x7f9fe4155fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4065bb0 tx=0x7f9fd400b4e0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe9dff700 1 -- 172.21.15.86:0/2311714475 shutdown_connections 2023-10-09T11:42:12.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/2311714475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 0x7f9fe4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/2311714475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe4155c10 0x7f9fe4155fe0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/2311714475 >> v2:172.21.15.135:3300/0 conn(0x7f9fe40ac230 0x7f9fe40ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.386+0000 7f9fe9dff700 1 -- 172.21.15.86:0/2311714475 >> 172.21.15.86:0/2311714475 conn(0x7f9fe406a320 msgr2=0x7f9fe40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.387+0000 7f9fe9dff700 1 -- 172.21.15.86:0/2311714475 shutdown_connections 2023-10-09T11:42:12.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.387+0000 7f9fe9dff700 1 -- 172.21.15.86:0/2311714475 wait complete. 2023-10-09T11:42:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.388+0000 7f9fe9dff700 1 Processor -- start 2023-10-09T11:42:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.388+0000 7f9fe9dff700 1 -- start start 2023-10-09T11:42:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe9dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe40ac230 0x7f9fe416acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe9dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe4155c10 0x7f9fe414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe9dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 0x7f9fe415d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe9dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe414ddd0 con 0x7f9fe40ac230 2023-10-09T11:42:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe9dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe414cef0 con 0x7f9fe4155c10 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe9dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe414d1c0 con 0x7f9fe41568a0 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe40ac230 0x7f9fe416acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe40ac230 0x7f9fe416acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39200/0 (socket says 172.21.15.86:39200) 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.389+0000 7f9fe37fe700 1 -- 172.21.15.86:0/1159565087 learned_addr learned my addr 172.21.15.86:0/1159565087 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe37fe700 1 -- 172.21.15.86:0/1159565087 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 msgr2=0x7f9fe415d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe37fe700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 0x7f9fe415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe37fe700 1 -- 172.21.15.86:0/1159565087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe4155c10 msgr2=0x7f9fe414c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe37fe700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe4155c10 0x7f9fe414c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe37fe700 1 -- 172.21.15.86:0/1159565087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd400b780 con 0x7f9fe40ac230 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe37fe700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe40ac230 0x7f9fe416acf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4064290 tx=0x7f9fd4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fdb7fe700 1 -- 172.21.15.86:0/1159565087 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4000c90 con 0x7f9fe40ac230 2023-10-09T11:42:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fdb7fe700 1 -- 172.21.15.86:0/1159565087 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd40165d0 con 0x7f9fe40ac230 2023-10-09T11:42:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fdb7fe700 1 -- 172.21.15.86:0/1159565087 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4016990 con 0x7f9fe40ac230 2023-10-09T11:42:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe414d4a0 con 0x7f9fe40ac230 2023-10-09T11:42:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.390+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe414da60 con 0x7f9fe40ac230 2023-10-09T11:42:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.391+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe404c3c0 con 0x7f9fe40ac230 2023-10-09T11:42:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.392+0000 7f9fdb7fe700 1 -- 172.21.15.86:0/1159565087 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fd4015070 con 0x7f9fe40ac230 2023-10-09T11:42:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.393+0000 7f9fdb7fe700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9fc4066f30 0x7f9fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.393+0000 7f9fdb7fe700 1 -- 172.21.15.86:0/1159565087 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9fd40863f0 con 0x7f9fe40ac230 2023-10-09T11:42:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.393+0000 7f9fdbfff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9fc4066f30 0x7f9fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.394+0000 7f9fdbfff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9fc4066f30 0x7f9fc40693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4152340 tx=0x7f9fcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.397+0000 7f9fdb7fe700 1 -- 172.21.15.86:0/1159565087 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fd40535c0 con 0x7f9fe40ac230 2023-10-09T11:42:12.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.581+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fe414df10 con 0x7f9fc4066f30 2023-10-09T11:42:12.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.591+0000 7f9fdb7fe700 1 -- 172.21.15.86:0/1159565087 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288975 (secure 0 0 0) 0x7f9fcc007680 con 0x7f9fc4066f30 2023-10-09T11:42:12.596 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:12.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9fc4066f30 msgr2=0x7f9fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9fc4066f30 0x7f9fc40693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4152340 tx=0x7f9fcc008040 comp rx=0 tx=0).stop 2023-10-09T11:42:12.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe40ac230 msgr2=0x7f9fe416acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe40ac230 0x7f9fe416acf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4064290 tx=0x7f9fd4019000 comp rx=0 tx=0).stop 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 shutdown_connections 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9fc4066f30 0x7f9fc40693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe40ac230 0x7f9fe416acf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fe41568a0 0x7f9fe415d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 --2- 172.21.15.86:0/1159565087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe4155c10 0x7f9fe414c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.595+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 >> 172.21.15.86:0/1159565087 conn(0x7f9fe406a320 msgr2=0x7f9fe40b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.596+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 shutdown_connections 2023-10-09T11:42:12.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.596+0000 7f9fe9dff700 1 -- 172.21.15.86:0/1159565087 wait complete. 2023-10-09T11:42:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:42:12.614 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-10-09T11:42:11.964813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386608,"kb_used_data":4208,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752588112,"statfs":{"total":773094113280,"available":770650226688,"internally_reserved":0,"allocated":4308992,"data_stored":2379220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.691855"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.325079+0000","last_change":"2023-10-09T11:42:08.319852+0000","last_active":"2023-10-09T11:42:08.325079+0000","last_peered":"2023-10-09T11:42:08.325079+0000","last_clean":"2023-10-09T11:42:08.325079+0000","last_became_active":"2023-10-09T11:42:08.319465+0000","last_became_peered":"2023-10-09T11:42:08.319465+0000","last_unstale":"2023-10-09T11:42:08.325079+0000","last_undegraded":"2023-10-09T11:42:08.325079+0000","last_fullsized":"2023-10-09T11:42:08.325079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326139+0000","last_change":"2023-10-09T11:42:08.319251+0000","last_active":"2023-10-09T11:42:08.326139+0000","last_peered":"2023-10-09T11:42:08.326139+0000","last_clean":"2023-10-09T11:42:08.326139+0000","last_became_active":"2023-10-09T11:42:08.319012+0000","last_became_peered":"2023-10-09T11:42:08.319012+0000","last_unstale":"2023-10-09T11:42:08.326139+0000","last_undegraded":"2023-10-09T11:42:08.326139+0000","last_fullsized":"2023-10-09T11:42:08.326139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:33.409030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334669+0000","last_change":"2023-10-09T11:42:08.331844+0000","last_active":"2023-10-09T11:42:08.334669+0000","last_peered":"2023-10-09T11:42:08.334669+0000","last_clean":"2023-10-09T11:42:08.334669+0000","last_became_active":"2023-10-09T11:42:08.331463+0000","last_became_peered":"2023-10-09T11:42:08.331463+0000","last_unstale":"2023-10-09T11:42:08.334669+0000","last_undegraded":"2023-10-09T11:42:08.334669+0000","last_fullsized":"2023-10-09T11:42:08.334669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:24.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336965+0000","last_change":"2023-10-09T11:42:08.331097+0000","last_active":"2023-10-09T11:42:08.336965+0000","last_peered":"2023-10-09T11:42:08.336965+0000","last_clean":"2023-10-09T11:42:08.336965+0000","last_became_active":"2023-10-09T11:42:08.330853+0000","last_became_peered":"2023-10-09T11:42:08.330853+0000","last_unstale":"2023-10-09T11:42:08.336965+0000","last_undegraded":"2023-10-09T11:42:08.336965+0000","last_fullsized":"2023-10-09T11:42:08.336965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:05.341265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.325425+0000","last_change":"2023-10-09T11:42:08.325425+0000","last_active":"2023-10-09T11:42:08.325425+0000","last_peered":"2023-10-09T11:42:08.325425+0000","last_clean":"2023-10-09T11:42:08.325425+0000","last_became_active":"2023-10-09T11:42:08.325199+0000","last_became_peered":"2023-10-09T11:42:08.325199+0000","last_unstale":"2023-10-09T11:42:08.325425+0000","last_undegraded":"2023-10-09T11:42:08.325425+0000","last_fullsized":"2023-10-09T11:42:08.325425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:02.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336326+0000","last_change":"2023-10-09T11:42:08.327925+0000","last_active":"2023-10-09T11:42:08.336326+0000","last_peered":"2023-10-09T11:42:08.336326+0000","last_clean":"2023-10-09T11:42:08.336326+0000","last_became_active":"2023-10-09T11:42:08.327616+0000","last_became_peered":"2023-10-09T11:42:08.327616+0000","last_unstale":"2023-10-09T11:42:08.336326+0000","last_undegraded":"2023-10-09T11:42:08.336326+0000","last_fullsized":"2023-10-09T11:42:08.336326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:29.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330154+0000","last_change":"2023-10-09T11:42:08.322338+0000","last_active":"2023-10-09T11:42:08.330154+0000","last_peered":"2023-10-09T11:42:08.330154+0000","last_clean":"2023-10-09T11:42:08.330154+0000","last_became_active":"2023-10-09T11:42:08.321659+0000","last_became_peered":"2023-10-09T11:42:08.321659+0000","last_unstale":"2023-10-09T11:42:08.330154+0000","last_undegraded":"2023-10-09T11:42:08.330154+0000","last_fullsized":"2023-10-09T11:42:08.330154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:24.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328799+0000","last_change":"2023-10-09T11:42:08.323463+0000","last_active":"2023-10-09T11:42:08.328799+0000","last_peered":"2023-10-09T11:42:08.328799+0000","last_clean":"2023-10-09T11:42:08.328799+0000","last_became_active":"2023-10-09T11:42:08.323074+0000","last_became_peered":"2023-10-09T11:42:08.323074+0000","last_unstale":"2023-10-09T11:42:08.328799+0000","last_undegraded":"2023-10-09T11:42:08.328799+0000","last_fullsized":"2023-10-09T11:42:08.328799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328738+0000","last_change":"2023-10-09T11:42:08.323073+0000","last_active":"2023-10-09T11:42:08.328738+0000","last_peered":"2023-10-09T11:42:08.328738+0000","last_clean":"2023-10-09T11:42:08.328738+0000","last_became_active":"2023-10-09T11:42:08.322717+0000","last_became_peered":"2023-10-09T11:42:08.322717+0000","last_unstale":"2023-10-09T11:42:08.328738+0000","last_undegraded":"2023-10-09T11:42:08.328738+0000","last_fullsized":"2023-10-09T11:42:08.328738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:21.630092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336822+0000","last_change":"2023-10-09T11:42:08.332031+0000","last_active":"2023-10-09T11:42:08.336822+0000","last_peered":"2023-10-09T11:42:08.336822+0000","last_clean":"2023-10-09T11:42:08.336822+0000","last_became_active":"2023-10-09T11:42:08.331776+0000","last_became_peered":"2023-10-09T11:42:08.331776+0000","last_unstale":"2023-10-09T11:42:08.336822+0000","last_undegraded":"2023-10-09T11:42:08.336822+0000","last_fullsized":"2023-10-09T11:42:08.336822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330068+0000","last_change":"2023-10-09T11:42:08.321721+0000","last_active":"2023-10-09T11:42:08.330068+0000","last_peered":"2023-10-09T11:42:08.330068+0000","last_clean":"2023-10-09T11:42:08.330068+0000","last_became_active":"2023-10-09T11:42:08.321338+0000","last_became_peered":"2023-10-09T11:42:08.321338+0000","last_unstale":"2023-10-09T11:42:08.330068+0000","last_undegraded":"2023-10-09T11:42:08.330068+0000","last_fullsized":"2023-10-09T11:42:08.330068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:27.640818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330764+0000","last_change":"2023-10-09T11:42:08.324899+0000","last_active":"2023-10-09T11:42:08.330764+0000","last_peered":"2023-10-09T11:42:08.330764+0000","last_clean":"2023-10-09T11:42:08.330764+0000","last_became_active":"2023-10-09T11:42:08.324616+0000","last_became_peered":"2023-10-09T11:42:08.324616+0000","last_unstale":"2023-10-09T11:42:08.330764+0000","last_undegraded":"2023-10-09T11:42:08.330764+0000","last_fullsized":"2023-10-09T11:42:08.330764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.317963+0000","last_change":"2023-10-09T11:42:08.317963+0000","last_active":"2023-10-09T11:42:08.317963+0000","last_peered":"2023-10-09T11:42:08.317963+0000","last_clean":"2023-10-09T11:42:08.317963+0000","last_became_active":"2023-10-09T11:42:08.317656+0000","last_became_peered":"2023-10-09T11:42:08.317656+0000","last_unstale":"2023-10-09T11:42:08.317963+0000","last_undegraded":"2023-10-09T11:42:08.317963+0000","last_fullsized":"2023-10-09T11:42:08.317963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:41.474478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320473+0000","last_change":"2023-10-09T11:42:08.309452+0000","last_active":"2023-10-09T11:42:08.320473+0000","last_peered":"2023-10-09T11:42:08.320473+0000","last_clean":"2023-10-09T11:42:08.320473+0000","last_became_active":"2023-10-09T11:42:08.309204+0000","last_became_peered":"2023-10-09T11:42:08.309204+0000","last_unstale":"2023-10-09T11:42:08.320473+0000","last_undegraded":"2023-10-09T11:42:08.320473+0000","last_fullsized":"2023-10-09T11:42:08.320473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:36.137744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.333447+0000","last_change":"2023-10-09T11:42:08.326336+0000","last_active":"2023-10-09T11:42:08.333447+0000","last_peered":"2023-10-09T11:42:08.333447+0000","last_clean":"2023-10-09T11:42:08.333447+0000","last_became_active":"2023-10-09T11:42:08.325922+0000","last_became_peered":"2023-10-09T11:42:08.325922+0000","last_unstale":"2023-10-09T11:42:08.333447+0000","last_undegraded":"2023-10-09T11:42:08.333447+0000","last_fullsized":"2023-10-09T11:42:08.333447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:01.919729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328818+0000","last_change":"2023-10-09T11:42:08.324001+0000","last_active":"2023-10-09T11:42:08.328818+0000","last_peered":"2023-10-09T11:42:08.328818+0000","last_clean":"2023-10-09T11:42:08.328818+0000","last_became_active":"2023-10-09T11:42:08.323718+0000","last_became_peered":"2023-10-09T11:42:08.323718+0000","last_unstale":"2023-10-09T11:42:08.328818+0000","last_undegraded":"2023-10-09T11:42:08.328818+0000","last_fullsized":"2023-10-09T11:42:08.328818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:42.494821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.327627+0000","last_change":"2023-10-09T11:42:08.321961+0000","last_active":"2023-10-09T11:42:08.327627+0000","last_peered":"2023-10-09T11:42:08.327627+0000","last_clean":"2023-10-09T11:42:08.327627+0000","last_became_active":"2023-10-09T11:42:08.321194+0000","last_became_peered":"2023-10-09T11:42:08.321194+0000","last_unstale":"2023-10-09T11:42:08.327627+0000","last_undegraded":"2023-10-09T11:42:08.327627+0000","last_fullsized":"2023-10-09T11:42:08.327627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:16.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.329108+0000","last_change":"2023-10-09T11:42:08.325088+0000","last_active":"2023-10-09T11:42:08.329108+0000","last_peered":"2023-10-09T11:42:08.329108+0000","last_clean":"2023-10-09T11:42:08.329108+0000","last_became_active":"2023-10-09T11:42:08.323627+0000","last_became_peered":"2023-10-09T11:42:08.323627+0000","last_unstale":"2023-10-09T11:42:08.329108+0000","last_undegraded":"2023-10-09T11:42:08.329108+0000","last_fullsized":"2023-10-09T11:42:08.329108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:54.508477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.337884+0000","last_change":"2023-10-09T11:42:08.334824+0000","last_active":"2023-10-09T11:42:08.337884+0000","last_peered":"2023-10-09T11:42:08.337884+0000","last_clean":"2023-10-09T11:42:08.337884+0000","last_became_active":"2023-10-09T11:42:08.334487+0000","last_became_peered":"2023-10-09T11:42:08.334487+0000","last_unstale":"2023-10-09T11:42:08.337884+0000","last_undegraded":"2023-10-09T11:42:08.337884+0000","last_fullsized":"2023-10-09T11:42:08.337884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:34.523880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328414+0000","last_change":"2023-10-09T11:42:08.328414+0000","last_active":"2023-10-09T11:42:08.328414+0000","last_peered":"2023-10-09T11:42:08.328414+0000","last_clean":"2023-10-09T11:42:08.328414+0000","last_became_active":"2023-10-09T11:42:08.328101+0000","last_became_peered":"2023-10-09T11:42:08.328101+0000","last_unstale":"2023-10-09T11:42:08.328414+0000","last_undegraded":"2023-10-09T11:42:08.328414+0000","last_fullsized":"2023-10-09T11:42:08.328414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:11.090620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326256+0000","last_change":"2023-10-09T11:42:08.315862+0000","last_active":"2023-10-09T11:42:08.326256+0000","last_peered":"2023-10-09T11:42:08.326256+0000","last_clean":"2023-10-09T11:42:08.326256+0000","last_became_active":"2023-10-09T11:42:08.315350+0000","last_became_peered":"2023-10-09T11:42:08.315350+0000","last_unstale":"2023-10-09T11:42:08.326256+0000","last_undegraded":"2023-10-09T11:42:08.326256+0000","last_fullsized":"2023-10-09T11:42:08.326256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:11.823191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.319826+0000","last_change":"2023-10-09T11:42:08.313442+0000","last_active":"2023-10-09T11:42:08.319826+0000","last_peered":"2023-10-09T11:42:08.319826+0000","last_clean":"2023-10-09T11:42:08.319826+0000","last_became_active":"2023-10-09T11:42:08.311330+0000","last_became_peered":"2023-10-09T11:42:08.311330+0000","last_unstale":"2023-10-09T11:42:08.319826+0000","last_undegraded":"2023-10-09T11:42:08.319826+0000","last_fullsized":"2023-10-09T11:42:08.319826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:29.100201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.318024+0000","last_change":"2023-10-09T11:42:08.318024+0000","last_active":"2023-10-09T11:42:08.318024+0000","last_peered":"2023-10-09T11:42:08.318024+0000","last_clean":"2023-10-09T11:42:08.318024+0000","last_became_active":"2023-10-09T11:42:08.317761+0000","last_became_peered":"2023-10-09T11:42:08.317761+0000","last_unstale":"2023-10-09T11:42:08.318024+0000","last_undegraded":"2023-10-09T11:42:08.318024+0000","last_fullsized":"2023-10-09T11:42:08.318024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:02.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334585+0000","last_change":"2023-10-09T11:42:08.332378+0000","last_active":"2023-10-09T11:42:08.334585+0000","last_peered":"2023-10-09T11:42:08.334585+0000","last_clean":"2023-10-09T11:42:08.334585+0000","last_became_active":"2023-10-09T11:42:08.332113+0000","last_became_peered":"2023-10-09T11:42:08.332113+0000","last_unstale":"2023-10-09T11:42:08.334585+0000","last_undegraded":"2023-10-09T11:42:08.334585+0000","last_fullsized":"2023-10-09T11:42:08.334585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.333656+0000","last_change":"2023-10-09T11:42:08.322830+0000","last_active":"2023-10-09T11:42:08.333656+0000","last_peered":"2023-10-09T11:42:08.333656+0000","last_clean":"2023-10-09T11:42:08.333656+0000","last_became_active":"2023-10-09T11:42:08.322575+0000","last_became_peered":"2023-10-09T11:42:08.322575+0000","last_unstale":"2023-10-09T11:42:08.333656+0000","last_undegraded":"2023-10-09T11:42:08.333656+0000","last_fullsized":"2023-10-09T11:42:08.333656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:05.088664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.329084+0000","last_change":"2023-10-09T11:42:08.322842+0000","last_active":"2023-10-09T11:42:08.329084+0000","last_peered":"2023-10-09T11:42:08.329084+0000","last_clean":"2023-10-09T11:42:08.329084+0000","last_became_active":"2023-10-09T11:42:08.322567+0000","last_became_peered":"2023-10-09T11:42:08.322567+0000","last_unstale":"2023-10-09T11:42:08.329084+0000","last_undegraded":"2023-10-09T11:42:08.329084+0000","last_fullsized":"2023-10-09T11:42:08.329084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:35.779359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335709+0000","last_change":"2023-10-09T11:42:08.327096+0000","last_active":"2023-10-09T11:42:08.335709+0000","last_peered":"2023-10-09T11:42:08.335709+0000","last_clean":"2023-10-09T11:42:08.335709+0000","last_became_active":"2023-10-09T11:42:08.326858+0000","last_became_peered":"2023-10-09T11:42:08.326858+0000","last_unstale":"2023-10-09T11:42:08.335709+0000","last_undegraded":"2023-10-09T11:42:08.335709+0000","last_fullsized":"2023-10-09T11:42:08.335709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:19.175276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330621+0000","last_change":"2023-10-09T11:42:08.322211+0000","last_active":"2023-10-09T11:42:08.330621+0000","last_peered":"2023-10-09T11:42:08.330621+0000","last_clean":"2023-10-09T11:42:08.330621+0000","last_became_active":"2023-10-09T11:42:08.321945+0000","last_became_peered":"2023-10-09T11:42:08.321945+0000","last_unstale":"2023-10-09T11:42:08.330621+0000","last_undegraded":"2023-10-09T11:42:08.330621+0000","last_fullsized":"2023-10-09T11:42:08.330621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:05.341265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320120+0000","last_change":"2023-10-09T11:42:08.313953+0000","last_active":"2023-10-09T11:42:08.320120+0000","last_peered":"2023-10-09T11:42:08.320120+0000","last_clean":"2023-10-09T11:42:08.320120+0000","last_became_active":"2023-10-09T11:42:08.311647+0000","last_became_peered":"2023-10-09T11:42:08.311647+0000","last_unstale":"2023-10-09T11:42:08.320120+0000","last_undegraded":"2023-10-09T11:42:08.320120+0000","last_fullsized":"2023-10-09T11:42:08.320120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:04.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.327768+0000","last_change":"2023-10-09T11:42:08.321575+0000","last_active":"2023-10-09T11:42:08.327768+0000","last_peered":"2023-10-09T11:42:08.327768+0000","last_clean":"2023-10-09T11:42:08.327768+0000","last_became_active":"2023-10-09T11:42:08.321265+0000","last_became_peered":"2023-10-09T11:42:08.321265+0000","last_unstale":"2023-10-09T11:42:08.327768+0000","last_undegraded":"2023-10-09T11:42:08.327768+0000","last_fullsized":"2023-10-09T11:42:08.327768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:19.175276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320670+0000","last_change":"2023-10-09T11:42:08.318238+0000","last_active":"2023-10-09T11:42:08.320670+0000","last_peered":"2023-10-09T11:42:08.320670+0000","last_clean":"2023-10-09T11:42:08.320670+0000","last_became_active":"2023-10-09T11:42:08.317973+0000","last_became_peered":"2023-10-09T11:42:08.317973+0000","last_unstale":"2023-10-09T11:42:08.320670+0000","last_undegraded":"2023-10-09T11:42:08.320670+0000","last_fullsized":"2023-10-09T11:42:08.320670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:39.586371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.331035+0000","last_change":"2023-10-09T11:42:08.328700+0000","last_active":"2023-10-09T11:42:08.331035+0000","last_peered":"2023-10-09T11:42:08.331035+0000","last_clean":"2023-10-09T11:42:08.331035+0000","last_became_active":"2023-10-09T11:42:08.327858+0000","last_became_peered":"2023-10-09T11:42:08.327858+0000","last_unstale":"2023-10-09T11:42:08.331035+0000","last_undegraded":"2023-10-09T11:42:08.331035+0000","last_fullsized":"2023-10-09T11:42:08.331035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:05.341265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.324922+0000","last_change":"2023-10-09T11:42:08.324922+0000","last_active":"2023-10-09T11:42:08.324922+0000","last_peered":"2023-10-09T11:42:08.324922+0000","last_clean":"2023-10-09T11:42:08.324922+0000","last_became_active":"2023-10-09T11:42:08.324672+0000","last_became_peered":"2023-10-09T11:42:08.324672+0000","last_unstale":"2023-10-09T11:42:08.324922+0000","last_undegraded":"2023-10-09T11:42:08.324922+0000","last_fullsized":"2023-10-09T11:42:08.324922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:11.090620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339319+0000","last_change":"2023-10-09T11:42:07.301729+0000","last_active":"2023-10-09T11:42:08.339319+0000","last_peered":"2023-10-09T11:42:08.339319+0000","last_clean":"2023-10-09T11:42:08.339319+0000","last_became_active":"2023-10-09T11:42:07.301477+0000","last_became_peered":"2023-10-09T11:42:07.301477+0000","last_unstale":"2023-10-09T11:42:08.339319+0000","last_undegraded":"2023-10-09T11:42:08.339319+0000","last_fullsized":"2023-10-09T11:42:08.339319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:28.092257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328454+0000","last_change":"2023-10-09T11:42:08.325197+0000","last_active":"2023-10-09T11:42:08.328454+0000","last_peered":"2023-10-09T11:42:08.328454+0000","last_clean":"2023-10-09T11:42:08.328454+0000","last_became_active":"2023-10-09T11:42:08.324888+0000","last_became_peered":"2023-10-09T11:42:08.324888+0000","last_unstale":"2023-10-09T11:42:08.328454+0000","last_undegraded":"2023-10-09T11:42:08.328454+0000","last_fullsized":"2023-10-09T11:42:08.328454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.305828+0000","last_change":"2023-10-09T11:42:07.297211+0000","last_active":"2023-10-09T11:42:08.305828+0000","last_peered":"2023-10-09T11:42:08.305828+0000","last_clean":"2023-10-09T11:42:08.305828+0000","last_became_active":"2023-10-09T11:42:07.296971+0000","last_became_peered":"2023-10-09T11:42:07.296971+0000","last_unstale":"2023-10-09T11:42:08.305828+0000","last_undegraded":"2023-10-09T11:42:08.305828+0000","last_fullsized":"2023-10-09T11:42:08.305828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:22.287266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.319614+0000","last_change":"2023-10-09T11:42:08.313766+0000","last_active":"2023-10-09T11:42:08.319614+0000","last_peered":"2023-10-09T11:42:08.319614+0000","last_clean":"2023-10-09T11:42:08.319614+0000","last_became_active":"2023-10-09T11:42:08.311677+0000","last_became_peered":"2023-10-09T11:42:08.311677+0000","last_unstale":"2023-10-09T11:42:08.319614+0000","last_undegraded":"2023-10-09T11:42:08.319614+0000","last_fullsized":"2023-10-09T11:42:08.319614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:52.910603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.338632+0000","last_change":"2023-10-09T11:42:07.301828+0000","last_active":"2023-10-09T11:42:08.338632+0000","last_peered":"2023-10-09T11:42:08.338632+0000","last_clean":"2023-10-09T11:42:08.338632+0000","last_became_active":"2023-10-09T11:42:07.301583+0000","last_became_peered":"2023-10-09T11:42:07.301583+0000","last_unstale":"2023-10-09T11:42:08.338632+0000","last_undegraded":"2023-10-09T11:42:08.338632+0000","last_fullsized":"2023-10-09T11:42:08.338632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:52.832024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335597+0000","last_change":"2023-10-09T11:42:08.322990+0000","last_active":"2023-10-09T11:42:08.335597+0000","last_peered":"2023-10-09T11:42:08.335597+0000","last_clean":"2023-10-09T11:42:08.335597+0000","last_became_active":"2023-10-09T11:42:08.322732+0000","last_became_peered":"2023-10-09T11:42:08.322732+0000","last_unstale":"2023-10-09T11:42:08.335597+0000","last_undegraded":"2023-10-09T11:42:08.335597+0000","last_fullsized":"2023-10-09T11:42:08.335597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:01.919729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336549+0000","last_change":"2023-10-09T11:42:07.303163+0000","last_active":"2023-10-09T11:42:08.336549+0000","last_peered":"2023-10-09T11:42:08.336549+0000","last_clean":"2023-10-09T11:42:08.336549+0000","last_became_active":"2023-10-09T11:42:07.300730+0000","last_became_peered":"2023-10-09T11:42:07.300730+0000","last_unstale":"2023-10-09T11:42:08.336549+0000","last_undegraded":"2023-10-09T11:42:08.336549+0000","last_fullsized":"2023-10-09T11:42:08.336549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:57.604026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330858+0000","last_change":"2023-10-09T11:42:08.327652+0000","last_active":"2023-10-09T11:42:08.330858+0000","last_peered":"2023-10-09T11:42:08.330858+0000","last_clean":"2023-10-09T11:42:08.330858+0000","last_became_active":"2023-10-09T11:42:08.327300+0000","last_became_peered":"2023-10-09T11:42:08.327300+0000","last_unstale":"2023-10-09T11:42:08.330858+0000","last_undegraded":"2023-10-09T11:42:08.330858+0000","last_fullsized":"2023-10-09T11:42:08.330858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339539+0000","last_change":"2023-10-09T11:42:07.292086+0000","last_active":"2023-10-09T11:42:08.339539+0000","last_peered":"2023-10-09T11:42:08.339539+0000","last_clean":"2023-10-09T11:42:08.339539+0000","last_became_active":"2023-10-09T11:42:07.291825+0000","last_became_peered":"2023-10-09T11:42:07.291825+0000","last_unstale":"2023-10-09T11:42:08.339539+0000","last_undegraded":"2023-10-09T11:42:08.339539+0000","last_fullsized":"2023-10-09T11:42:08.339539+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:09.252634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330519+0000","last_change":"2023-10-09T11:42:08.318957+0000","last_active":"2023-10-09T11:42:08.330519+0000","last_peered":"2023-10-09T11:42:08.330519+0000","last_clean":"2023-10-09T11:42:08.330519+0000","last_became_active":"2023-10-09T11:42:08.317271+0000","last_became_peered":"2023-10-09T11:42:08.317271+0000","last_unstale":"2023-10-09T11:42:08.330519+0000","last_undegraded":"2023-10-09T11:42:08.330519+0000","last_fullsized":"2023-10-09T11:42:08.330519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:19.175276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339505+0000","last_change":"2023-10-09T11:42:07.291424+0000","last_active":"2023-10-09T11:42:08.339505+0000","last_peered":"2023-10-09T11:42:08.339505+0000","last_clean":"2023-10-09T11:42:08.339505+0000","last_became_active":"2023-10-09T11:42:07.291194+0000","last_became_peered":"2023-10-09T11:42:07.291194+0000","last_unstale":"2023-10-09T11:42:08.339505+0000","last_undegraded":"2023-10-09T11:42:08.339505+0000","last_fullsized":"2023-10-09T11:42:08.339505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:31.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328810+0000","last_change":"2023-10-09T11:42:08.321880+0000","last_active":"2023-10-09T11:42:08.328810+0000","last_peered":"2023-10-09T11:42:08.328810+0000","last_clean":"2023-10-09T11:42:08.328810+0000","last_became_active":"2023-10-09T11:42:08.320892+0000","last_became_peered":"2023-10-09T11:42:08.320892+0000","last_unstale":"2023-10-09T11:42:08.328810+0000","last_undegraded":"2023-10-09T11:42:08.328810+0000","last_fullsized":"2023-10-09T11:42:08.328810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:43.811496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306541+0000","last_change":"2023-10-09T11:42:07.288047+0000","last_active":"2023-10-09T11:42:08.306541+0000","last_peered":"2023-10-09T11:42:08.306541+0000","last_clean":"2023-10-09T11:42:08.306541+0000","last_became_active":"2023-10-09T11:42:07.287784+0000","last_became_peered":"2023-10-09T11:42:07.287784+0000","last_unstale":"2023-10-09T11:42:08.306541+0000","last_undegraded":"2023-10-09T11:42:08.306541+0000","last_fullsized":"2023-10-09T11:42:08.306541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:42.372440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335364+0000","last_change":"2023-10-09T11:42:08.328204+0000","last_active":"2023-10-09T11:42:08.335364+0000","last_peered":"2023-10-09T11:42:08.335364+0000","last_clean":"2023-10-09T11:42:08.335364+0000","last_became_active":"2023-10-09T11:42:08.327920+0000","last_became_peered":"2023-10-09T11:42:08.327920+0000","last_unstale":"2023-10-09T11:42:08.335364+0000","last_undegraded":"2023-10-09T11:42:08.335364+0000","last_fullsized":"2023-10-09T11:42:08.335364+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304187+0000","last_change":"2023-10-09T11:42:07.299052+0000","last_active":"2023-10-09T11:42:08.304187+0000","last_peered":"2023-10-09T11:42:08.304187+0000","last_clean":"2023-10-09T11:42:08.304187+0000","last_became_active":"2023-10-09T11:42:07.298785+0000","last_became_peered":"2023-10-09T11:42:07.298785+0000","last_unstale":"2023-10-09T11:42:08.304187+0000","last_undegraded":"2023-10-09T11:42:08.304187+0000","last_fullsized":"2023-10-09T11:42:08.304187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:25.688985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330587+0000","last_change":"2023-10-09T11:42:08.322143+0000","last_active":"2023-10-09T11:42:08.330587+0000","last_peered":"2023-10-09T11:42:08.330587+0000","last_clean":"2023-10-09T11:42:08.330587+0000","last_became_active":"2023-10-09T11:42:08.321705+0000","last_became_peered":"2023-10-09T11:42:08.321705+0000","last_unstale":"2023-10-09T11:42:08.330587+0000","last_undegraded":"2023-10-09T11:42:08.330587+0000","last_fullsized":"2023-10-09T11:42:08.330587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.307123+0000","last_change":"2023-10-09T11:42:07.294311+0000","last_active":"2023-10-09T11:42:08.307123+0000","last_peered":"2023-10-09T11:42:08.307123+0000","last_clean":"2023-10-09T11:42:08.307123+0000","last_became_active":"2023-10-09T11:42:07.294004+0000","last_became_peered":"2023-10-09T11:42:07.294004+0000","last_unstale":"2023-10-09T11:42:08.307123+0000","last_undegraded":"2023-10-09T11:42:08.307123+0000","last_fullsized":"2023-10-09T11:42:08.307123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:31.020407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330363+0000","last_change":"2023-10-09T11:42:08.323988+0000","last_active":"2023-10-09T11:42:08.330363+0000","last_peered":"2023-10-09T11:42:08.330363+0000","last_clean":"2023-10-09T11:42:08.330363+0000","last_became_active":"2023-10-09T11:42:08.323694+0000","last_became_peered":"2023-10-09T11:42:08.323694+0000","last_unstale":"2023-10-09T11:42:08.330363+0000","last_undegraded":"2023-10-09T11:42:08.330363+0000","last_fullsized":"2023-10-09T11:42:08.330363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:45.467688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-09T11:42:07.303758+0000","last_change":"2023-10-09T11:42:07.299268+0000","last_active":"2023-10-09T11:42:07.303758+0000","last_peered":"2023-10-09T11:42:07.303758+0000","last_clean":"2023-10-09T11:42:07.303758+0000","last_became_active":"2023-10-09T11:42:07.298999+0000","last_became_peered":"2023-10-09T11:42:07.298999+0000","last_unstale":"2023-10-09T11:42:07.303758+0000","last_undegraded":"2023-10-09T11:42:07.303758+0000","last_fullsized":"2023-10-09T11:42:07.303758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:22.387287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326226+0000","last_change":"2023-10-09T11:42:08.321083+0000","last_active":"2023-10-09T11:42:08.326226+0000","last_peered":"2023-10-09T11:42:08.326226+0000","last_clean":"2023-10-09T11:42:08.326226+0000","last_became_active":"2023-10-09T11:42:08.320806+0000","last_became_peered":"2023-10-09T11:42:08.320806+0000","last_unstale":"2023-10-09T11:42:08.326226+0000","last_undegraded":"2023-10-09T11:42:08.326226+0000","last_fullsized":"2023-10-09T11:42:08.326226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:17.285841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335808+0000","last_change":"2023-10-09T11:42:07.299572+0000","last_active":"2023-10-09T11:42:08.335808+0000","last_peered":"2023-10-09T11:42:08.335808+0000","last_clean":"2023-10-09T11:42:08.335808+0000","last_became_active":"2023-10-09T11:42:07.299307+0000","last_became_peered":"2023-10-09T11:42:07.299307+0000","last_unstale":"2023-10-09T11:42:08.335808+0000","last_undegraded":"2023-10-09T11:42:08.335808+0000","last_fullsized":"2023-10-09T11:42:08.335808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:34.245439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334653+0000","last_change":"2023-10-09T11:42:08.331675+0000","last_active":"2023-10-09T11:42:08.334653+0000","last_peered":"2023-10-09T11:42:08.334653+0000","last_clean":"2023-10-09T11:42:08.334653+0000","last_became_active":"2023-10-09T11:42:08.331130+0000","last_became_peered":"2023-10-09T11:42:08.331130+0000","last_unstale":"2023-10-09T11:42:08.334653+0000","last_undegraded":"2023-10-09T11:42:08.334653+0000","last_fullsized":"2023-10-09T11:42:08.334653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:16.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.343362+0000","last_change":"2023-10-09T11:42:07.302661+0000","last_active":"2023-10-09T11:42:08.343362+0000","last_peered":"2023-10-09T11:42:08.343362+0000","last_clean":"2023-10-09T11:42:08.343362+0000","last_became_active":"2023-10-09T11:42:07.302413+0000","last_became_peered":"2023-10-09T11:42:07.302413+0000","last_unstale":"2023-10-09T11:42:08.343362+0000","last_undegraded":"2023-10-09T11:42:08.343362+0000","last_fullsized":"2023-10-09T11:42:08.343362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:08.198909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335711+0000","last_change":"2023-10-09T11:42:08.329233+0000","last_active":"2023-10-09T11:42:08.335711+0000","last_peered":"2023-10-09T11:42:08.335711+0000","last_clean":"2023-10-09T11:42:08.335711+0000","last_became_active":"2023-10-09T11:42:08.328971+0000","last_became_peered":"2023-10-09T11:42:08.328971+0000","last_unstale":"2023-10-09T11:42:08.335711+0000","last_undegraded":"2023-10-09T11:42:08.335711+0000","last_fullsized":"2023-10-09T11:42:08.335711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339234+0000","last_change":"2023-10-09T11:42:07.300330+0000","last_active":"2023-10-09T11:42:08.339234+0000","last_peered":"2023-10-09T11:42:08.339234+0000","last_clean":"2023-10-09T11:42:08.339234+0000","last_became_active":"2023-10-09T11:42:07.300051+0000","last_became_peered":"2023-10-09T11:42:07.300051+0000","last_unstale":"2023-10-09T11:42:08.339234+0000","last_undegraded":"2023-10-09T11:42:08.339234+0000","last_fullsized":"2023-10-09T11:42:08.339234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:03.190161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326199+0000","last_change":"2023-10-09T11:42:08.320969+0000","last_active":"2023-10-09T11:42:08.326199+0000","last_peered":"2023-10-09T11:42:08.326199+0000","last_clean":"2023-10-09T11:42:08.326199+0000","last_became_active":"2023-10-09T11:42:08.320678+0000","last_became_peered":"2023-10-09T11:42:08.320678+0000","last_unstale":"2023-10-09T11:42:08.326199+0000","last_undegraded":"2023-10-09T11:42:08.326199+0000","last_fullsized":"2023-10-09T11:42:08.326199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:30.629034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.311746+0000","last_change":"2023-10-09T11:42:07.300077+0000","last_active":"2023-10-09T11:42:08.311746+0000","last_peered":"2023-10-09T11:42:08.311746+0000","last_clean":"2023-10-09T11:42:08.311746+0000","last_became_active":"2023-10-09T11:42:07.299796+0000","last_became_peered":"2023-10-09T11:42:07.299796+0000","last_unstale":"2023-10-09T11:42:08.311746+0000","last_undegraded":"2023-10-09T11:42:08.311746+0000","last_fullsized":"2023-10-09T11:42:08.311746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:26.290826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.331017+0000","last_change":"2023-10-09T11:42:08.328390+0000","last_active":"2023-10-09T11:42:08.331017+0000","last_peered":"2023-10-09T11:42:08.331017+0000","last_clean":"2023-10-09T11:42:08.331017+0000","last_became_active":"2023-10-09T11:42:08.328142+0000","last_became_peered":"2023-10-09T11:42:08.328142+0000","last_unstale":"2023-10-09T11:42:08.331017+0000","last_undegraded":"2023-10-09T11:42:08.331017+0000","last_fullsized":"2023-10-09T11:42:08.331017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:18.663763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306638+0000","last_change":"2023-10-09T11:42:07.294316+0000","last_active":"2023-10-09T11:42:08.306638+0000","last_peered":"2023-10-09T11:42:08.306638+0000","last_clean":"2023-10-09T11:42:08.306638+0000","last_became_active":"2023-10-09T11:42:07.294024+0000","last_became_peered":"2023-10-09T11:42:07.294024+0000","last_unstale":"2023-10-09T11:42:08.306638+0000","last_undegraded":"2023-10-09T11:42:08.306638+0000","last_fullsized":"2023-10-09T11:42:08.306638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:10.082677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328512+0000","last_change":"2023-10-09T11:42:08.325654+0000","last_active":"2023-10-09T11:42:08.328512+0000","last_peered":"2023-10-09T11:42:08.328512+0000","last_clean":"2023-10-09T11:42:08.328512+0000","last_became_active":"2023-10-09T11:42:08.325354+0000","last_became_peered":"2023-10-09T11:42:08.325354+0000","last_unstale":"2023-10-09T11:42:08.328512+0000","last_undegraded":"2023-10-09T11:42:08.328512+0000","last_fullsized":"2023-10-09T11:42:08.328512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339350+0000","last_change":"2023-10-09T11:42:07.298627+0000","last_active":"2023-10-09T11:42:08.339350+0000","last_peered":"2023-10-09T11:42:08.339350+0000","last_clean":"2023-10-09T11:42:08.339350+0000","last_became_active":"2023-10-09T11:42:07.298346+0000","last_became_peered":"2023-10-09T11:42:07.298346+0000","last_unstale":"2023-10-09T11:42:08.339350+0000","last_undegraded":"2023-10-09T11:42:08.339350+0000","last_fullsized":"2023-10-09T11:42:08.339350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:01.329280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328773+0000","last_change":"2023-10-09T11:42:08.324273+0000","last_active":"2023-10-09T11:42:08.328773+0000","last_peered":"2023-10-09T11:42:08.328773+0000","last_clean":"2023-10-09T11:42:08.328773+0000","last_became_active":"2023-10-09T11:42:08.323970+0000","last_became_peered":"2023-10-09T11:42:08.323970+0000","last_unstale":"2023-10-09T11:42:08.328773+0000","last_undegraded":"2023-10-09T11:42:08.328773+0000","last_fullsized":"2023-10-09T11:42:08.328773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:57.006395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335132+0000","last_change":"2023-10-09T11:42:07.306126+0000","last_active":"2023-10-09T11:42:08.335132+0000","last_peered":"2023-10-09T11:42:08.335132+0000","last_clean":"2023-10-09T11:42:08.335132+0000","last_became_active":"2023-10-09T11:42:07.305876+0000","last_became_peered":"2023-10-09T11:42:07.305876+0000","last_unstale":"2023-10-09T11:42:08.335132+0000","last_undegraded":"2023-10-09T11:42:08.335132+0000","last_fullsized":"2023-10-09T11:42:08.335132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:43.311506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.333461+0000","last_change":"2023-10-09T11:42:08.327977+0000","last_active":"2023-10-09T11:42:08.333461+0000","last_peered":"2023-10-09T11:42:08.333461+0000","last_clean":"2023-10-09T11:42:08.333461+0000","last_became_active":"2023-10-09T11:42:08.327036+0000","last_became_peered":"2023-10-09T11:42:08.327036+0000","last_unstale":"2023-10-09T11:42:08.333461+0000","last_undegraded":"2023-10-09T11:42:08.333461+0000","last_fullsized":"2023-10-09T11:42:08.333461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:18.663763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339037+0000","last_change":"2023-10-09T11:42:07.301503+0000","last_active":"2023-10-09T11:42:08.339037+0000","last_peered":"2023-10-09T11:42:08.339037+0000","last_clean":"2023-10-09T11:42:08.339037+0000","last_became_active":"2023-10-09T11:42:07.301251+0000","last_became_peered":"2023-10-09T11:42:07.301251+0000","last_unstale":"2023-10-09T11:42:08.339037+0000","last_undegraded":"2023-10-09T11:42:08.339037+0000","last_fullsized":"2023-10-09T11:42:08.339037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:25.575073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336955+0000","last_change":"2023-10-09T11:42:08.327733+0000","last_active":"2023-10-09T11:42:08.336955+0000","last_peered":"2023-10-09T11:42:08.336955+0000","last_clean":"2023-10-09T11:42:08.336955+0000","last_became_active":"2023-10-09T11:42:08.327455+0000","last_became_peered":"2023-10-09T11:42:08.327455+0000","last_unstale":"2023-10-09T11:42:08.336955+0000","last_undegraded":"2023-10-09T11:42:08.336955+0000","last_fullsized":"2023-10-09T11:42:08.336955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:42.494821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.338278+0000","last_change":"2023-10-09T11:42:07.294908+0000","last_active":"2023-10-09T11:42:08.338278+0000","last_peered":"2023-10-09T11:42:08.338278+0000","last_clean":"2023-10-09T11:42:08.338278+0000","last_became_active":"2023-10-09T11:42:07.294634+0000","last_became_peered":"2023-10-09T11:42:07.294634+0000","last_unstale":"2023-10-09T11:42:08.338278+0000","last_undegraded":"2023-10-09T11:42:08.338278+0000","last_fullsized":"2023-10-09T11:42:08.338278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:54.656314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.321276+0000","last_change":"2023-10-09T11:42:08.321276+0000","last_active":"2023-10-09T11:42:08.321276+0000","last_peered":"2023-10-09T11:42:08.321276+0000","last_clean":"2023-10-09T11:42:08.321276+0000","last_became_active":"2023-10-09T11:42:08.321042+0000","last_became_peered":"2023-10-09T11:42:08.321042+0000","last_unstale":"2023-10-09T11:42:08.321276+0000","last_undegraded":"2023-10-09T11:42:08.321276+0000","last_fullsized":"2023-10-09T11:42:08.321276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:53.839968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304609+0000","last_change":"2023-10-09T11:42:07.301149+0000","last_active":"2023-10-09T11:42:08.304609+0000","last_peered":"2023-10-09T11:42:08.304609+0000","last_clean":"2023-10-09T11:42:08.304609+0000","last_became_active":"2023-10-09T11:42:07.300881+0000","last_became_peered":"2023-10-09T11:42:07.300881+0000","last_unstale":"2023-10-09T11:42:08.304609+0000","last_undegraded":"2023-10-09T11:42:08.304609+0000","last_fullsized":"2023-10-09T11:42:08.304609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:43.626754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.317112+0000","last_change":"2023-10-09T11:42:08.317112+0000","last_active":"2023-10-09T11:42:08.317112+0000","last_peered":"2023-10-09T11:42:08.317112+0000","last_clean":"2023-10-09T11:42:08.317112+0000","last_became_active":"2023-10-09T11:42:08.316866+0000","last_became_peered":"2023-10-09T11:42:08.316866+0000","last_unstale":"2023-10-09T11:42:08.317112+0000","last_undegraded":"2023-10-09T11:42:08.317112+0000","last_fullsized":"2023-10-09T11:42:08.317112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:43.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336305+0000","last_change":"2023-10-09T11:42:07.301350+0000","last_active":"2023-10-09T11:42:08.336305+0000","last_peered":"2023-10-09T11:42:08.336305+0000","last_clean":"2023-10-09T11:42:08.336305+0000","last_became_active":"2023-10-09T11:42:07.301081+0000","last_became_peered":"2023-10-09T11:42:07.301081+0000","last_unstale":"2023-10-09T11:42:08.336305+0000","last_undegraded":"2023-10-09T11:42:08.336305+0000","last_fullsized":"2023-10-09T11:42:08.336305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:04.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.314192+0000","last_change":"2023-10-09T11:42:08.314192+0000","last_active":"2023-10-09T11:42:08.314192+0000","last_peered":"2023-10-09T11:42:08.314192+0000","last_clean":"2023-10-09T11:42:08.314192+0000","last_became_active":"2023-10-09T11:42:08.313916+0000","last_became_peered":"2023-10-09T11:42:08.313916+0000","last_unstale":"2023-10-09T11:42:08.314192+0000","last_undegraded":"2023-10-09T11:42:08.314192+0000","last_fullsized":"2023-10-09T11:42:08.314192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:01.515186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.309120+0000","last_change":"2023-10-09T11:42:07.304102+0000","last_active":"2023-10-09T11:42:08.309120+0000","last_peered":"2023-10-09T11:42:08.309120+0000","last_clean":"2023-10-09T11:42:08.309120+0000","last_became_active":"2023-10-09T11:42:07.303505+0000","last_became_peered":"2023-10-09T11:42:07.303505+0000","last_unstale":"2023-10-09T11:42:08.309120+0000","last_undegraded":"2023-10-09T11:42:08.309120+0000","last_fullsized":"2023-10-09T11:42:08.309120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:26.290826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.313565+0000","last_change":"2023-10-09T11:42:08.313565+0000","last_active":"2023-10-09T11:42:08.313565+0000","last_peered":"2023-10-09T11:42:08.313565+0000","last_clean":"2023-10-09T11:42:08.313565+0000","last_became_active":"2023-10-09T11:42:08.313273+0000","last_became_peered":"2023-10-09T11:42:08.313273+0000","last_unstale":"2023-10-09T11:42:08.313565+0000","last_undegraded":"2023-10-09T11:42:08.313565+0000","last_fullsized":"2023-10-09T11:42:08.313565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:32.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304468+0000","last_change":"2023-10-09T11:42:07.298032+0000","last_active":"2023-10-09T11:42:08.304468+0000","last_peered":"2023-10-09T11:42:08.304468+0000","last_clean":"2023-10-09T11:42:08.304468+0000","last_became_active":"2023-10-09T11:42:07.297773+0000","last_became_peered":"2023-10-09T11:42:07.297773+0000","last_unstale":"2023-10-09T11:42:08.304468+0000","last_undegraded":"2023-10-09T11:42:08.304468+0000","last_fullsized":"2023-10-09T11:42:08.304468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:48.568989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330172+0000","last_change":"2023-10-09T11:42:08.322545+0000","last_active":"2023-10-09T11:42:08.330172+0000","last_peered":"2023-10-09T11:42:08.330172+0000","last_clean":"2023-10-09T11:42:08.330172+0000","last_became_active":"2023-10-09T11:42:08.322004+0000","last_became_peered":"2023-10-09T11:42:08.322004+0000","last_unstale":"2023-10-09T11:42:08.330172+0000","last_undegraded":"2023-10-09T11:42:08.330172+0000","last_fullsized":"2023-10-09T11:42:08.330172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:01.919729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.312529+0000","last_change":"2023-10-09T11:42:07.299591+0000","last_active":"2023-10-09T11:42:08.312529+0000","last_peered":"2023-10-09T11:42:08.312529+0000","last_clean":"2023-10-09T11:42:08.312529+0000","last_became_active":"2023-10-09T11:42:07.299336+0000","last_became_peered":"2023-10-09T11:42:07.299336+0000","last_unstale":"2023-10-09T11:42:08.312529+0000","last_undegraded":"2023-10-09T11:42:08.312529+0000","last_fullsized":"2023-10-09T11:42:08.312529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:26.290826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.322947+0000","last_change":"2023-10-09T11:42:08.322947+0000","last_active":"2023-10-09T11:42:08.322947+0000","last_peered":"2023-10-09T11:42:08.322947+0000","last_clean":"2023-10-09T11:42:08.322947+0000","last_became_active":"2023-10-09T11:42:08.322671+0000","last_became_peered":"2023-10-09T11:42:08.322671+0000","last_unstale":"2023-10-09T11:42:08.322947+0000","last_undegraded":"2023-10-09T11:42:08.322947+0000","last_fullsized":"2023-10-09T11:42:08.322947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:09.206853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334069+0000","last_change":"2023-10-09T11:42:07.303278+0000","last_active":"2023-10-09T11:42:08.334069+0000","last_peered":"2023-10-09T11:42:08.334069+0000","last_clean":"2023-10-09T11:42:08.334069+0000","last_became_active":"2023-10-09T11:42:07.302967+0000","last_became_peered":"2023-10-09T11:42:07.302967+0000","last_unstale":"2023-10-09T11:42:08.334069+0000","last_undegraded":"2023-10-09T11:42:08.334069+0000","last_fullsized":"2023-10-09T11:42:08.334069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:41.433548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330742+0000","last_change":"2023-10-09T11:42:08.322951+0000","last_active":"2023-10-09T11:42:08.330742+0000","last_peered":"2023-10-09T11:42:08.330742+0000","last_clean":"2023-10-09T11:42:08.330742+0000","last_became_active":"2023-10-09T11:42:08.322636+0000","last_became_peered":"2023-10-09T11:42:08.322636+0000","last_unstale":"2023-10-09T11:42:08.330742+0000","last_undegraded":"2023-10-09T11:42:08.330742+0000","last_fullsized":"2023-10-09T11:42:08.330742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:27.640818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-09T11:42:07.305945+0000","last_change":"2023-10-09T11:42:07.302612+0000","last_active":"2023-10-09T11:42:07.305945+0000","last_peered":"2023-10-09T11:42:07.305945+0000","last_clean":"2023-10-09T11:42:07.305945+0000","last_became_active":"2023-10-09T11:42:07.302279+0000","last_became_peered":"2023-10-09T11:42:07.302279+0000","last_unstale":"2023-10-09T11:42:07.305945+0000","last_undegraded":"2023-10-09T11:42:07.305945+0000","last_fullsized":"2023-10-09T11:42:07.305945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:59.929218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.319700+0000","last_change":"2023-10-09T11:42:08.319700+0000","last_active":"2023-10-09T11:42:08.319700+0000","last_peered":"2023-10-09T11:42:08.319700+0000","last_clean":"2023-10-09T11:42:08.319700+0000","last_became_active":"2023-10-09T11:42:08.318546+0000","last_became_peered":"2023-10-09T11:42:08.318546+0000","last_unstale":"2023-10-09T11:42:08.319700+0000","last_undegraded":"2023-10-09T11:42:08.319700+0000","last_fullsized":"2023-10-09T11:42:08.319700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:09.206853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.312036+0000","last_change":"2023-10-09T11:42:07.300333+0000","last_active":"2023-10-09T11:42:08.312036+0000","last_peered":"2023-10-09T11:42:08.312036+0000","last_clean":"2023-10-09T11:42:08.312036+0000","last_became_active":"2023-10-09T11:42:07.300028+0000","last_became_peered":"2023-10-09T11:42:07.300028+0000","last_unstale":"2023-10-09T11:42:08.312036+0000","last_undegraded":"2023-10-09T11:42:08.312036+0000","last_fullsized":"2023-10-09T11:42:08.312036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:19.656986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320701+0000","last_change":"2023-10-09T11:42:08.318128+0000","last_active":"2023-10-09T11:42:08.320701+0000","last_peered":"2023-10-09T11:42:08.320701+0000","last_clean":"2023-10-09T11:42:08.320701+0000","last_became_active":"2023-10-09T11:42:08.317365+0000","last_became_peered":"2023-10-09T11:42:08.317365+0000","last_unstale":"2023-10-09T11:42:08.320701+0000","last_undegraded":"2023-10-09T11:42:08.320701+0000","last_fullsized":"2023-10-09T11:42:08.320701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:05.088664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-09T11:42:07.305985+0000","last_change":"2023-10-09T11:42:07.301683+0000","last_active":"2023-10-09T11:42:07.305985+0000","last_peered":"2023-10-09T11:42:07.305985+0000","last_clean":"2023-10-09T11:42:07.305985+0000","last_became_active":"2023-10-09T11:42:07.301402+0000","last_became_peered":"2023-10-09T11:42:07.301402+0000","last_unstale":"2023-10-09T11:42:07.305985+0000","last_undegraded":"2023-10-09T11:42:07.305985+0000","last_fullsized":"2023-10-09T11:42:07.305985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:57.604026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320279+0000","last_change":"2023-10-09T11:42:08.320279+0000","last_active":"2023-10-09T11:42:08.320279+0000","last_peered":"2023-10-09T11:42:08.320279+0000","last_clean":"2023-10-09T11:42:08.320279+0000","last_became_active":"2023-10-09T11:42:08.319992+0000","last_became_peered":"2023-10-09T11:42:08.319992+0000","last_unstale":"2023-10-09T11:42:08.320279+0000","last_undegraded":"2023-10-09T11:42:08.320279+0000","last_fullsized":"2023-10-09T11:42:08.320279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:43.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.311832+0000","last_change":"2023-10-09T11:42:07.302331+0000","last_active":"2023-10-09T11:42:08.311832+0000","last_peered":"2023-10-09T11:42:08.311832+0000","last_clean":"2023-10-09T11:42:08.311832+0000","last_became_active":"2023-10-09T11:42:07.302092+0000","last_became_peered":"2023-10-09T11:42:07.302092+0000","last_unstale":"2023-10-09T11:42:08.311832+0000","last_undegraded":"2023-10-09T11:42:08.311832+0000","last_fullsized":"2023-10-09T11:42:08.311832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:34.245439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.332619+0000","last_change":"2023-10-09T11:42:08.325497+0000","last_active":"2023-10-09T11:42:08.332619+0000","last_peered":"2023-10-09T11:42:08.332619+0000","last_clean":"2023-10-09T11:42:08.332619+0000","last_became_active":"2023-10-09T11:42:08.324950+0000","last_became_peered":"2023-10-09T11:42:08.324950+0000","last_unstale":"2023-10-09T11:42:08.332619+0000","last_undegraded":"2023-10-09T11:42:08.332619+0000","last_fullsized":"2023-10-09T11:42:08.332619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:29.444499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304486+0000","last_change":"2023-10-09T11:42:07.300512+0000","last_active":"2023-10-09T11:42:08.304486+0000","last_peered":"2023-10-09T11:42:08.304486+0000","last_clean":"2023-10-09T11:42:08.304486+0000","last_became_active":"2023-10-09T11:42:07.300164+0000","last_became_peered":"2023-10-09T11:42:07.300164+0000","last_unstale":"2023-10-09T11:42:08.304486+0000","last_undegraded":"2023-10-09T11:42:08.304486+0000","last_fullsized":"2023-10-09T11:42:08.304486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:23.008112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326389+0000","last_change":"2023-10-09T11:42:08.319452+0000","last_active":"2023-10-09T11:42:08.326389+0000","last_peered":"2023-10-09T11:42:08.326389+0000","last_clean":"2023-10-09T11:42:08.326389+0000","last_became_active":"2023-10-09T11:42:08.319190+0000","last_became_peered":"2023-10-09T11:42:08.319190+0000","last_unstale":"2023-10-09T11:42:08.326389+0000","last_undegraded":"2023-10-09T11:42:08.326389+0000","last_fullsized":"2023-10-09T11:42:08.326389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:12.171072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306082+0000","last_change":"2023-10-09T11:42:07.296735+0000","last_active":"2023-10-09T11:42:08.306082+0000","last_peered":"2023-10-09T11:42:08.306082+0000","last_clean":"2023-10-09T11:42:08.306082+0000","last_became_active":"2023-10-09T11:42:07.296474+0000","last_became_peered":"2023-10-09T11:42:07.296474+0000","last_unstale":"2023-10-09T11:42:08.306082+0000","last_undegraded":"2023-10-09T11:42:08.306082+0000","last_fullsized":"2023-10-09T11:42:08.306082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:40.466534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.327662+0000","last_change":"2023-10-09T11:42:08.322810+0000","last_active":"2023-10-09T11:42:08.327662+0000","last_peered":"2023-10-09T11:42:08.327662+0000","last_clean":"2023-10-09T11:42:08.327662+0000","last_became_active":"2023-10-09T11:42:08.321237+0000","last_became_peered":"2023-10-09T11:42:08.321237+0000","last_unstale":"2023-10-09T11:42:08.327662+0000","last_undegraded":"2023-10-09T11:42:08.327662+0000","last_fullsized":"2023-10-09T11:42:08.327662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306884+0000","last_change":"2023-10-09T11:42:07.302858+0000","last_active":"2023-10-09T11:42:08.306884+0000","last_peered":"2023-10-09T11:42:08.306884+0000","last_clean":"2023-10-09T11:42:08.306884+0000","last_became_active":"2023-10-09T11:42:07.302581+0000","last_became_peered":"2023-10-09T11:42:07.302581+0000","last_unstale":"2023-10-09T11:42:08.306884+0000","last_undegraded":"2023-10-09T11:42:08.306884+0000","last_fullsized":"2023-10-09T11:42:08.306884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:11.163129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.311096+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:42:08.311096+0000","last_peered":"2023-10-09T11:42:08.311096+0000","last_clean":"2023-10-09T11:42:08.311096+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:42:08.311096+0000","last_undegraded":"2023-10-09T11:42:08.311096+0000","last_fullsized":"2023-10-09T11:42:08.311096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476753,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":983040,"data_stored":741264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.754},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.872},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79600000000000004}]}]},{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":151394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.754},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.80800000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":144588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.97299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54500000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.86499999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.436}]},{"osd":3,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66000000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.73399999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":152364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.877}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.76800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69499999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":152364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.372},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.495},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.73899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.80000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67600000000000005}]}]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":150910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.75}]},{"osd":1,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81799999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.86699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.879},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.629},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.64900000000000002}]}]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":151450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.90900000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.81799999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.86199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:12.621 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:12.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.831+0000 7fa08bfff700 1 Processor -- start 2023-10-09T11:42:12.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.832+0000 7fa08bfff700 1 -- start start 2023-10-09T11:42:12.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa08c150550 0x7fa08c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa08c0c7410 0x7fa08c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c06e2a0 con 0x7fa08c150180 2023-10-09T11:42:12.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08bfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c06b2e0 con 0x7fa08c0c7410 2023-10-09T11:42:12.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c0c78e0 con 0x7fa08c150550 2023-10-09T11:42:12.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa08c0c7410 0x7fa08c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08affd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa08c150180 0x7fa08c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38832/0 (socket says 172.21.15.86:38832) 2023-10-09T11:42:12.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08affd700 1 -- 172.21.15.86:0/1922698508 learned_addr learned my addr 172.21.15.86:0/1922698508 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.833+0000 7fa08a7fc700 1 --2- 172.21.15.86:0/1922698508 >> v2:172.21.15.135:3300/0 conn(0x7fa08c150550 0x7fa08c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa08b7fe700 1 -- 172.21.15.86:0/1922698508 >> v2:172.21.15.135:3300/0 conn(0x7fa08c150550 msgr2=0x7fa08c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa08b7fe700 1 --2- 172.21.15.86:0/1922698508 >> v2:172.21.15.135:3300/0 conn(0x7fa08c150550 0x7fa08c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa08b7fe700 1 -- 172.21.15.86:0/1922698508 >> v1:172.21.15.86:6789/0 conn(0x7fa08c150180 legacy=0x7fa08c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa08b7fe700 1 -- 172.21.15.86:0/1922698508 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0c7bc0 con 0x7fa08c0c7410 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa089ffb700 1 -- 172.21.15.86:0/1922698508 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195899929 0 0) 0x7fa08c06e2a0 con 0x7fa08c150180 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa08b7fe700 1 --2- 172.21.15.86:0/1922698508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c069f50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa08c06d1e0 tx=0x7fa084009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae30ff616ce2e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa089ffb700 1 -- 172.21.15.86:0/1922698508 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400e070 con 0x7fa08c0c7410 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa089ffb700 1 -- 172.21.15.86:0/1922698508 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400bc30 con 0x7fa08c0c7410 2023-10-09T11:42:12.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.834+0000 7fa089ffb700 1 -- 172.21.15.86:0/1922698508 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084012430 con 0x7fa08c0c7410 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 -- 172.21.15.86:0/1922698508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 msgr2=0x7fa08c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 --2- 172.21.15.86:0/1922698508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c069f50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa08c06d1e0 tx=0x7fa084009780 comp rx=0 tx=0).stop 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 -- 172.21.15.86:0/1922698508 shutdown_connections 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 --2- 172.21.15.86:0/1922698508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c069f50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 --2- 172.21.15.86:0/1922698508 >> v2:172.21.15.135:3300/0 conn(0x7fa08c150550 0x7fa08c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 -- 172.21.15.86:0/1922698508 >> 172.21.15.86:0/1922698508 conn(0x7fa08c0cc1f0 msgr2=0x7fa08c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 -- 172.21.15.86:0/1922698508 shutdown_connections 2023-10-09T11:42:12.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.835+0000 7fa08bfff700 1 -- 172.21.15.86:0/1922698508 wait complete. 2023-10-09T11:42:12.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.836+0000 7fa08bfff700 1 Processor -- start 2023-10-09T11:42:12.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.836+0000 7fa08bfff700 1 -- start start 2023-10-09T11:42:12.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.837+0000 7fa08bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.837+0000 7fa08bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa08c150180 0x7fa08c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.837+0000 7fa08bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa08c150550 0x7fa08c0c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.837+0000 7fa08bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0af130 con 0x7fa08c0c7410 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.837+0000 7fa08bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0af410 con 0x7fa08c150180 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.837+0000 7fa08bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0af6f0 con 0x7fa08c150550 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.837+0000 7fa08affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c14ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39210/0 (socket says 172.21.15.86:39210) 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 -- 172.21.15.86:0/712991234 learned_addr learned my addr 172.21.15.86:0/712991234 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08a7fc700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa08c150180 0x7fa08c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08b7fe700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa08c150550 0x7fa08c0c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 -- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa08c150550 msgr2=0x7fa08c0c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa08c150550 0x7fa08c0c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 -- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa08c150180 msgr2=0x7fa08c14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa08c150180 0x7fa08c14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 -- 172.21.15.86:0/712991234 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084009a20 con 0x7fa08c0c7410 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08a7fc700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa08c150180 0x7fa08c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08b7fe700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa08c150550 0x7fa08c0c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08affd700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c14ca70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c5b0 tx=0x7fa07c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa072ffd700 1 -- 172.21.15.86:0/712991234 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c005b30 con 0x7fa08c0c7410 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa072ffd700 1 -- 172.21.15.86:0/712991234 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c005c90 con 0x7fa08c0c7410 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.838+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c0af9d0 con 0x7fa08c0c7410 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.839+0000 7fa072ffd700 1 -- 172.21.15.86:0/712991234 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c007300 con 0x7fa08c0c7410 2023-10-09T11:42:12.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.839+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c14b350 con 0x7fa08c0c7410 2023-10-09T11:42:12.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.840+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c0afef0 con 0x7fa08c0c7410 2023-10-09T11:42:12.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.840+0000 7fa072ffd700 1 -- 172.21.15.86:0/712991234 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa07c01b3b0 con 0x7fa08c0c7410 2023-10-09T11:42:12.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.841+0000 7fa072ffd700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa078066f30 0x7fa0780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.841+0000 7fa072ffd700 1 -- 172.21.15.86:0/712991234 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa07c083b00 con 0x7fa08c0c7410 2023-10-09T11:42:12.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.842+0000 7fa08a7fc700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa078066f30 0x7fa0780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.842+0000 7fa08a7fc700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa078066f30 0x7fa0780693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa08c14f640 tx=0x7fa080008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:12.845+0000 7fa072ffd700 1 -- 172.21.15.86:0/712991234 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa08c0afef0 con 0x7fa08c0c7410 2023-10-09T11:42:13.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.029+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa08c04c3c0 con 0x7fa078066f30 2023-10-09T11:42:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.038+0000 7fa072ffd700 1 -- 172.21.15.86:0/712991234 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288975 (secure 0 0 0) 0x7fa08c04c3c0 con 0x7fa078066f30 2023-10-09T11:42:13.043 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa078066f30 msgr2=0x7fa0780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa078066f30 0x7fa0780693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa08c14f640 tx=0x7fa080008040 comp rx=0 tx=0).stop 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 msgr2=0x7fa08c14ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c14ca70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c5b0 tx=0x7fa07c001070 comp rx=0 tx=0).stop 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 shutdown_connections 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa078066f30 0x7fa0780693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa08c0c7410 0x7fa08c14ca70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa08c150550 0x7fa08c0c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 --2- 172.21.15.86:0/712991234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa08c150180 0x7fa08c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.042+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 >> 172.21.15.86:0/712991234 conn(0x7fa08c0cc1f0 msgr2=0x7fa08c157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.043+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 shutdown_connections 2023-10-09T11:42:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.043+0000 7fa08bfff700 1 -- 172.21.15.86:0/712991234 wait complete. 2023-10-09T11:42:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:42:13.061 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-10-09T11:42:11.964813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386608,"kb_used_data":4208,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752588112,"statfs":{"total":773094113280,"available":770650226688,"internally_reserved":0,"allocated":4308992,"data_stored":2379220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.691855"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.325079+0000","last_change":"2023-10-09T11:42:08.319852+0000","last_active":"2023-10-09T11:42:08.325079+0000","last_peered":"2023-10-09T11:42:08.325079+0000","last_clean":"2023-10-09T11:42:08.325079+0000","last_became_active":"2023-10-09T11:42:08.319465+0000","last_became_peered":"2023-10-09T11:42:08.319465+0000","last_unstale":"2023-10-09T11:42:08.325079+0000","last_undegraded":"2023-10-09T11:42:08.325079+0000","last_fullsized":"2023-10-09T11:42:08.325079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326139+0000","last_change":"2023-10-09T11:42:08.319251+0000","last_active":"2023-10-09T11:42:08.326139+0000","last_peered":"2023-10-09T11:42:08.326139+0000","last_clean":"2023-10-09T11:42:08.326139+0000","last_became_active":"2023-10-09T11:42:08.319012+0000","last_became_peered":"2023-10-09T11:42:08.319012+0000","last_unstale":"2023-10-09T11:42:08.326139+0000","last_undegraded":"2023-10-09T11:42:08.326139+0000","last_fullsized":"2023-10-09T11:42:08.326139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:33.409030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334669+0000","last_change":"2023-10-09T11:42:08.331844+0000","last_active":"2023-10-09T11:42:08.334669+0000","last_peered":"2023-10-09T11:42:08.334669+0000","last_clean":"2023-10-09T11:42:08.334669+0000","last_became_active":"2023-10-09T11:42:08.331463+0000","last_became_peered":"2023-10-09T11:42:08.331463+0000","last_unstale":"2023-10-09T11:42:08.334669+0000","last_undegraded":"2023-10-09T11:42:08.334669+0000","last_fullsized":"2023-10-09T11:42:08.334669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:24.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336965+0000","last_change":"2023-10-09T11:42:08.331097+0000","last_active":"2023-10-09T11:42:08.336965+0000","last_peered":"2023-10-09T11:42:08.336965+0000","last_clean":"2023-10-09T11:42:08.336965+0000","last_became_active":"2023-10-09T11:42:08.330853+0000","last_became_peered":"2023-10-09T11:42:08.330853+0000","last_unstale":"2023-10-09T11:42:08.336965+0000","last_undegraded":"2023-10-09T11:42:08.336965+0000","last_fullsized":"2023-10-09T11:42:08.336965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:05.341265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.325425+0000","last_change":"2023-10-09T11:42:08.325425+0000","last_active":"2023-10-09T11:42:08.325425+0000","last_peered":"2023-10-09T11:42:08.325425+0000","last_clean":"2023-10-09T11:42:08.325425+0000","last_became_active":"2023-10-09T11:42:08.325199+0000","last_became_peered":"2023-10-09T11:42:08.325199+0000","last_unstale":"2023-10-09T11:42:08.325425+0000","last_undegraded":"2023-10-09T11:42:08.325425+0000","last_fullsized":"2023-10-09T11:42:08.325425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:02.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336326+0000","last_change":"2023-10-09T11:42:08.327925+0000","last_active":"2023-10-09T11:42:08.336326+0000","last_peered":"2023-10-09T11:42:08.336326+0000","last_clean":"2023-10-09T11:42:08.336326+0000","last_became_active":"2023-10-09T11:42:08.327616+0000","last_became_peered":"2023-10-09T11:42:08.327616+0000","last_unstale":"2023-10-09T11:42:08.336326+0000","last_undegraded":"2023-10-09T11:42:08.336326+0000","last_fullsized":"2023-10-09T11:42:08.336326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:29.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330154+0000","last_change":"2023-10-09T11:42:08.322338+0000","last_active":"2023-10-09T11:42:08.330154+0000","last_peered":"2023-10-09T11:42:08.330154+0000","last_clean":"2023-10-09T11:42:08.330154+0000","last_became_active":"2023-10-09T11:42:08.321659+0000","last_became_peered":"2023-10-09T11:42:08.321659+0000","last_unstale":"2023-10-09T11:42:08.330154+0000","last_undegraded":"2023-10-09T11:42:08.330154+0000","last_fullsized":"2023-10-09T11:42:08.330154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:24.652260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328799+0000","last_change":"2023-10-09T11:42:08.323463+0000","last_active":"2023-10-09T11:42:08.328799+0000","last_peered":"2023-10-09T11:42:08.328799+0000","last_clean":"2023-10-09T11:42:08.328799+0000","last_became_active":"2023-10-09T11:42:08.323074+0000","last_became_peered":"2023-10-09T11:42:08.323074+0000","last_unstale":"2023-10-09T11:42:08.328799+0000","last_undegraded":"2023-10-09T11:42:08.328799+0000","last_fullsized":"2023-10-09T11:42:08.328799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328738+0000","last_change":"2023-10-09T11:42:08.323073+0000","last_active":"2023-10-09T11:42:08.328738+0000","last_peered":"2023-10-09T11:42:08.328738+0000","last_clean":"2023-10-09T11:42:08.328738+0000","last_became_active":"2023-10-09T11:42:08.322717+0000","last_became_peered":"2023-10-09T11:42:08.322717+0000","last_unstale":"2023-10-09T11:42:08.328738+0000","last_undegraded":"2023-10-09T11:42:08.328738+0000","last_fullsized":"2023-10-09T11:42:08.328738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:21.630092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336822+0000","last_change":"2023-10-09T11:42:08.332031+0000","last_active":"2023-10-09T11:42:08.336822+0000","last_peered":"2023-10-09T11:42:08.336822+0000","last_clean":"2023-10-09T11:42:08.336822+0000","last_became_active":"2023-10-09T11:42:08.331776+0000","last_became_peered":"2023-10-09T11:42:08.331776+0000","last_unstale":"2023-10-09T11:42:08.336822+0000","last_undegraded":"2023-10-09T11:42:08.336822+0000","last_fullsized":"2023-10-09T11:42:08.336822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330068+0000","last_change":"2023-10-09T11:42:08.321721+0000","last_active":"2023-10-09T11:42:08.330068+0000","last_peered":"2023-10-09T11:42:08.330068+0000","last_clean":"2023-10-09T11:42:08.330068+0000","last_became_active":"2023-10-09T11:42:08.321338+0000","last_became_peered":"2023-10-09T11:42:08.321338+0000","last_unstale":"2023-10-09T11:42:08.330068+0000","last_undegraded":"2023-10-09T11:42:08.330068+0000","last_fullsized":"2023-10-09T11:42:08.330068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:27.640818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330764+0000","last_change":"2023-10-09T11:42:08.324899+0000","last_active":"2023-10-09T11:42:08.330764+0000","last_peered":"2023-10-09T11:42:08.330764+0000","last_clean":"2023-10-09T11:42:08.330764+0000","last_became_active":"2023-10-09T11:42:08.324616+0000","last_became_peered":"2023-10-09T11:42:08.324616+0000","last_unstale":"2023-10-09T11:42:08.330764+0000","last_undegraded":"2023-10-09T11:42:08.330764+0000","last_fullsized":"2023-10-09T11:42:08.330764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.317963+0000","last_change":"2023-10-09T11:42:08.317963+0000","last_active":"2023-10-09T11:42:08.317963+0000","last_peered":"2023-10-09T11:42:08.317963+0000","last_clean":"2023-10-09T11:42:08.317963+0000","last_became_active":"2023-10-09T11:42:08.317656+0000","last_became_peered":"2023-10-09T11:42:08.317656+0000","last_unstale":"2023-10-09T11:42:08.317963+0000","last_undegraded":"2023-10-09T11:42:08.317963+0000","last_fullsized":"2023-10-09T11:42:08.317963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:41.474478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320473+0000","last_change":"2023-10-09T11:42:08.309452+0000","last_active":"2023-10-09T11:42:08.320473+0000","last_peered":"2023-10-09T11:42:08.320473+0000","last_clean":"2023-10-09T11:42:08.320473+0000","last_became_active":"2023-10-09T11:42:08.309204+0000","last_became_peered":"2023-10-09T11:42:08.309204+0000","last_unstale":"2023-10-09T11:42:08.320473+0000","last_undegraded":"2023-10-09T11:42:08.320473+0000","last_fullsized":"2023-10-09T11:42:08.320473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:18:36.137744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.333447+0000","last_change":"2023-10-09T11:42:08.326336+0000","last_active":"2023-10-09T11:42:08.333447+0000","last_peered":"2023-10-09T11:42:08.333447+0000","last_clean":"2023-10-09T11:42:08.333447+0000","last_became_active":"2023-10-09T11:42:08.325922+0000","last_became_peered":"2023-10-09T11:42:08.325922+0000","last_unstale":"2023-10-09T11:42:08.333447+0000","last_undegraded":"2023-10-09T11:42:08.333447+0000","last_fullsized":"2023-10-09T11:42:08.333447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:01.919729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328818+0000","last_change":"2023-10-09T11:42:08.324001+0000","last_active":"2023-10-09T11:42:08.328818+0000","last_peered":"2023-10-09T11:42:08.328818+0000","last_clean":"2023-10-09T11:42:08.328818+0000","last_became_active":"2023-10-09T11:42:08.323718+0000","last_became_peered":"2023-10-09T11:42:08.323718+0000","last_unstale":"2023-10-09T11:42:08.328818+0000","last_undegraded":"2023-10-09T11:42:08.328818+0000","last_fullsized":"2023-10-09T11:42:08.328818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:42.494821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.327627+0000","last_change":"2023-10-09T11:42:08.321961+0000","last_active":"2023-10-09T11:42:08.327627+0000","last_peered":"2023-10-09T11:42:08.327627+0000","last_clean":"2023-10-09T11:42:08.327627+0000","last_became_active":"2023-10-09T11:42:08.321194+0000","last_became_peered":"2023-10-09T11:42:08.321194+0000","last_unstale":"2023-10-09T11:42:08.327627+0000","last_undegraded":"2023-10-09T11:42:08.327627+0000","last_fullsized":"2023-10-09T11:42:08.327627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:16.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.329108+0000","last_change":"2023-10-09T11:42:08.325088+0000","last_active":"2023-10-09T11:42:08.329108+0000","last_peered":"2023-10-09T11:42:08.329108+0000","last_clean":"2023-10-09T11:42:08.329108+0000","last_became_active":"2023-10-09T11:42:08.323627+0000","last_became_peered":"2023-10-09T11:42:08.323627+0000","last_unstale":"2023-10-09T11:42:08.329108+0000","last_undegraded":"2023-10-09T11:42:08.329108+0000","last_fullsized":"2023-10-09T11:42:08.329108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:54.508477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.337884+0000","last_change":"2023-10-09T11:42:08.334824+0000","last_active":"2023-10-09T11:42:08.337884+0000","last_peered":"2023-10-09T11:42:08.337884+0000","last_clean":"2023-10-09T11:42:08.337884+0000","last_became_active":"2023-10-09T11:42:08.334487+0000","last_became_peered":"2023-10-09T11:42:08.334487+0000","last_unstale":"2023-10-09T11:42:08.337884+0000","last_undegraded":"2023-10-09T11:42:08.337884+0000","last_fullsized":"2023-10-09T11:42:08.337884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:34.523880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328414+0000","last_change":"2023-10-09T11:42:08.328414+0000","last_active":"2023-10-09T11:42:08.328414+0000","last_peered":"2023-10-09T11:42:08.328414+0000","last_clean":"2023-10-09T11:42:08.328414+0000","last_became_active":"2023-10-09T11:42:08.328101+0000","last_became_peered":"2023-10-09T11:42:08.328101+0000","last_unstale":"2023-10-09T11:42:08.328414+0000","last_undegraded":"2023-10-09T11:42:08.328414+0000","last_fullsized":"2023-10-09T11:42:08.328414+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:11.090620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326256+0000","last_change":"2023-10-09T11:42:08.315862+0000","last_active":"2023-10-09T11:42:08.326256+0000","last_peered":"2023-10-09T11:42:08.326256+0000","last_clean":"2023-10-09T11:42:08.326256+0000","last_became_active":"2023-10-09T11:42:08.315350+0000","last_became_peered":"2023-10-09T11:42:08.315350+0000","last_unstale":"2023-10-09T11:42:08.326256+0000","last_undegraded":"2023-10-09T11:42:08.326256+0000","last_fullsized":"2023-10-09T11:42:08.326256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:11.823191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.319826+0000","last_change":"2023-10-09T11:42:08.313442+0000","last_active":"2023-10-09T11:42:08.319826+0000","last_peered":"2023-10-09T11:42:08.319826+0000","last_clean":"2023-10-09T11:42:08.319826+0000","last_became_active":"2023-10-09T11:42:08.311330+0000","last_became_peered":"2023-10-09T11:42:08.311330+0000","last_unstale":"2023-10-09T11:42:08.319826+0000","last_undegraded":"2023-10-09T11:42:08.319826+0000","last_fullsized":"2023-10-09T11:42:08.319826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:29.100201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.318024+0000","last_change":"2023-10-09T11:42:08.318024+0000","last_active":"2023-10-09T11:42:08.318024+0000","last_peered":"2023-10-09T11:42:08.318024+0000","last_clean":"2023-10-09T11:42:08.318024+0000","last_became_active":"2023-10-09T11:42:08.317761+0000","last_became_peered":"2023-10-09T11:42:08.317761+0000","last_unstale":"2023-10-09T11:42:08.318024+0000","last_undegraded":"2023-10-09T11:42:08.318024+0000","last_fullsized":"2023-10-09T11:42:08.318024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:02.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334585+0000","last_change":"2023-10-09T11:42:08.332378+0000","last_active":"2023-10-09T11:42:08.334585+0000","last_peered":"2023-10-09T11:42:08.334585+0000","last_clean":"2023-10-09T11:42:08.334585+0000","last_became_active":"2023-10-09T11:42:08.332113+0000","last_became_peered":"2023-10-09T11:42:08.332113+0000","last_unstale":"2023-10-09T11:42:08.334585+0000","last_undegraded":"2023-10-09T11:42:08.334585+0000","last_fullsized":"2023-10-09T11:42:08.334585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.333656+0000","last_change":"2023-10-09T11:42:08.322830+0000","last_active":"2023-10-09T11:42:08.333656+0000","last_peered":"2023-10-09T11:42:08.333656+0000","last_clean":"2023-10-09T11:42:08.333656+0000","last_became_active":"2023-10-09T11:42:08.322575+0000","last_became_peered":"2023-10-09T11:42:08.322575+0000","last_unstale":"2023-10-09T11:42:08.333656+0000","last_undegraded":"2023-10-09T11:42:08.333656+0000","last_fullsized":"2023-10-09T11:42:08.333656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:05.088664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.329084+0000","last_change":"2023-10-09T11:42:08.322842+0000","last_active":"2023-10-09T11:42:08.329084+0000","last_peered":"2023-10-09T11:42:08.329084+0000","last_clean":"2023-10-09T11:42:08.329084+0000","last_became_active":"2023-10-09T11:42:08.322567+0000","last_became_peered":"2023-10-09T11:42:08.322567+0000","last_unstale":"2023-10-09T11:42:08.329084+0000","last_undegraded":"2023-10-09T11:42:08.329084+0000","last_fullsized":"2023-10-09T11:42:08.329084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:35.779359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335709+0000","last_change":"2023-10-09T11:42:08.327096+0000","last_active":"2023-10-09T11:42:08.335709+0000","last_peered":"2023-10-09T11:42:08.335709+0000","last_clean":"2023-10-09T11:42:08.335709+0000","last_became_active":"2023-10-09T11:42:08.326858+0000","last_became_peered":"2023-10-09T11:42:08.326858+0000","last_unstale":"2023-10-09T11:42:08.335709+0000","last_undegraded":"2023-10-09T11:42:08.335709+0000","last_fullsized":"2023-10-09T11:42:08.335709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:19.175276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330621+0000","last_change":"2023-10-09T11:42:08.322211+0000","last_active":"2023-10-09T11:42:08.330621+0000","last_peered":"2023-10-09T11:42:08.330621+0000","last_clean":"2023-10-09T11:42:08.330621+0000","last_became_active":"2023-10-09T11:42:08.321945+0000","last_became_peered":"2023-10-09T11:42:08.321945+0000","last_unstale":"2023-10-09T11:42:08.330621+0000","last_undegraded":"2023-10-09T11:42:08.330621+0000","last_fullsized":"2023-10-09T11:42:08.330621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:05.341265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320120+0000","last_change":"2023-10-09T11:42:08.313953+0000","last_active":"2023-10-09T11:42:08.320120+0000","last_peered":"2023-10-09T11:42:08.320120+0000","last_clean":"2023-10-09T11:42:08.320120+0000","last_became_active":"2023-10-09T11:42:08.311647+0000","last_became_peered":"2023-10-09T11:42:08.311647+0000","last_unstale":"2023-10-09T11:42:08.320120+0000","last_undegraded":"2023-10-09T11:42:08.320120+0000","last_fullsized":"2023-10-09T11:42:08.320120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:04.029664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.327768+0000","last_change":"2023-10-09T11:42:08.321575+0000","last_active":"2023-10-09T11:42:08.327768+0000","last_peered":"2023-10-09T11:42:08.327768+0000","last_clean":"2023-10-09T11:42:08.327768+0000","last_became_active":"2023-10-09T11:42:08.321265+0000","last_became_peered":"2023-10-09T11:42:08.321265+0000","last_unstale":"2023-10-09T11:42:08.327768+0000","last_undegraded":"2023-10-09T11:42:08.327768+0000","last_fullsized":"2023-10-09T11:42:08.327768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:19.175276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320670+0000","last_change":"2023-10-09T11:42:08.318238+0000","last_active":"2023-10-09T11:42:08.320670+0000","last_peered":"2023-10-09T11:42:08.320670+0000","last_clean":"2023-10-09T11:42:08.320670+0000","last_became_active":"2023-10-09T11:42:08.317973+0000","last_became_peered":"2023-10-09T11:42:08.317973+0000","last_unstale":"2023-10-09T11:42:08.320670+0000","last_undegraded":"2023-10-09T11:42:08.320670+0000","last_fullsized":"2023-10-09T11:42:08.320670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:27:39.586371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.331035+0000","last_change":"2023-10-09T11:42:08.328700+0000","last_active":"2023-10-09T11:42:08.331035+0000","last_peered":"2023-10-09T11:42:08.331035+0000","last_clean":"2023-10-09T11:42:08.331035+0000","last_became_active":"2023-10-09T11:42:08.327858+0000","last_became_peered":"2023-10-09T11:42:08.327858+0000","last_unstale":"2023-10-09T11:42:08.331035+0000","last_undegraded":"2023-10-09T11:42:08.331035+0000","last_fullsized":"2023-10-09T11:42:08.331035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:05.341265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.324922+0000","last_change":"2023-10-09T11:42:08.324922+0000","last_active":"2023-10-09T11:42:08.324922+0000","last_peered":"2023-10-09T11:42:08.324922+0000","last_clean":"2023-10-09T11:42:08.324922+0000","last_became_active":"2023-10-09T11:42:08.324672+0000","last_became_peered":"2023-10-09T11:42:08.324672+0000","last_unstale":"2023-10-09T11:42:08.324922+0000","last_undegraded":"2023-10-09T11:42:08.324922+0000","last_fullsized":"2023-10-09T11:42:08.324922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:11.090620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339319+0000","last_change":"2023-10-09T11:42:07.301729+0000","last_active":"2023-10-09T11:42:08.339319+0000","last_peered":"2023-10-09T11:42:08.339319+0000","last_clean":"2023-10-09T11:42:08.339319+0000","last_became_active":"2023-10-09T11:42:07.301477+0000","last_became_peered":"2023-10-09T11:42:07.301477+0000","last_unstale":"2023-10-09T11:42:08.339319+0000","last_undegraded":"2023-10-09T11:42:08.339319+0000","last_fullsized":"2023-10-09T11:42:08.339319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:28.092257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328454+0000","last_change":"2023-10-09T11:42:08.325197+0000","last_active":"2023-10-09T11:42:08.328454+0000","last_peered":"2023-10-09T11:42:08.328454+0000","last_clean":"2023-10-09T11:42:08.328454+0000","last_became_active":"2023-10-09T11:42:08.324888+0000","last_became_peered":"2023-10-09T11:42:08.324888+0000","last_unstale":"2023-10-09T11:42:08.328454+0000","last_undegraded":"2023-10-09T11:42:08.328454+0000","last_fullsized":"2023-10-09T11:42:08.328454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.305828+0000","last_change":"2023-10-09T11:42:07.297211+0000","last_active":"2023-10-09T11:42:08.305828+0000","last_peered":"2023-10-09T11:42:08.305828+0000","last_clean":"2023-10-09T11:42:08.305828+0000","last_became_active":"2023-10-09T11:42:07.296971+0000","last_became_peered":"2023-10-09T11:42:07.296971+0000","last_unstale":"2023-10-09T11:42:08.305828+0000","last_undegraded":"2023-10-09T11:42:08.305828+0000","last_fullsized":"2023-10-09T11:42:08.305828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:22.287266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.319614+0000","last_change":"2023-10-09T11:42:08.313766+0000","last_active":"2023-10-09T11:42:08.319614+0000","last_peered":"2023-10-09T11:42:08.319614+0000","last_clean":"2023-10-09T11:42:08.319614+0000","last_became_active":"2023-10-09T11:42:08.311677+0000","last_became_peered":"2023-10-09T11:42:08.311677+0000","last_unstale":"2023-10-09T11:42:08.319614+0000","last_undegraded":"2023-10-09T11:42:08.319614+0000","last_fullsized":"2023-10-09T11:42:08.319614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:52.910603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.338632+0000","last_change":"2023-10-09T11:42:07.301828+0000","last_active":"2023-10-09T11:42:08.338632+0000","last_peered":"2023-10-09T11:42:08.338632+0000","last_clean":"2023-10-09T11:42:08.338632+0000","last_became_active":"2023-10-09T11:42:07.301583+0000","last_became_peered":"2023-10-09T11:42:07.301583+0000","last_unstale":"2023-10-09T11:42:08.338632+0000","last_undegraded":"2023-10-09T11:42:08.338632+0000","last_fullsized":"2023-10-09T11:42:08.338632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:52.832024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335597+0000","last_change":"2023-10-09T11:42:08.322990+0000","last_active":"2023-10-09T11:42:08.335597+0000","last_peered":"2023-10-09T11:42:08.335597+0000","last_clean":"2023-10-09T11:42:08.335597+0000","last_became_active":"2023-10-09T11:42:08.322732+0000","last_became_peered":"2023-10-09T11:42:08.322732+0000","last_unstale":"2023-10-09T11:42:08.335597+0000","last_undegraded":"2023-10-09T11:42:08.335597+0000","last_fullsized":"2023-10-09T11:42:08.335597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:01.919729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336549+0000","last_change":"2023-10-09T11:42:07.303163+0000","last_active":"2023-10-09T11:42:08.336549+0000","last_peered":"2023-10-09T11:42:08.336549+0000","last_clean":"2023-10-09T11:42:08.336549+0000","last_became_active":"2023-10-09T11:42:07.300730+0000","last_became_peered":"2023-10-09T11:42:07.300730+0000","last_unstale":"2023-10-09T11:42:08.336549+0000","last_undegraded":"2023-10-09T11:42:08.336549+0000","last_fullsized":"2023-10-09T11:42:08.336549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:57.604026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330858+0000","last_change":"2023-10-09T11:42:08.327652+0000","last_active":"2023-10-09T11:42:08.330858+0000","last_peered":"2023-10-09T11:42:08.330858+0000","last_clean":"2023-10-09T11:42:08.330858+0000","last_became_active":"2023-10-09T11:42:08.327300+0000","last_became_peered":"2023-10-09T11:42:08.327300+0000","last_unstale":"2023-10-09T11:42:08.330858+0000","last_undegraded":"2023-10-09T11:42:08.330858+0000","last_fullsized":"2023-10-09T11:42:08.330858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339539+0000","last_change":"2023-10-09T11:42:07.292086+0000","last_active":"2023-10-09T11:42:08.339539+0000","last_peered":"2023-10-09T11:42:08.339539+0000","last_clean":"2023-10-09T11:42:08.339539+0000","last_became_active":"2023-10-09T11:42:07.291825+0000","last_became_peered":"2023-10-09T11:42:07.291825+0000","last_unstale":"2023-10-09T11:42:08.339539+0000","last_undegraded":"2023-10-09T11:42:08.339539+0000","last_fullsized":"2023-10-09T11:42:08.339539+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:09.252634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330519+0000","last_change":"2023-10-09T11:42:08.318957+0000","last_active":"2023-10-09T11:42:08.330519+0000","last_peered":"2023-10-09T11:42:08.330519+0000","last_clean":"2023-10-09T11:42:08.330519+0000","last_became_active":"2023-10-09T11:42:08.317271+0000","last_became_peered":"2023-10-09T11:42:08.317271+0000","last_unstale":"2023-10-09T11:42:08.330519+0000","last_undegraded":"2023-10-09T11:42:08.330519+0000","last_fullsized":"2023-10-09T11:42:08.330519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:19.175276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339505+0000","last_change":"2023-10-09T11:42:07.291424+0000","last_active":"2023-10-09T11:42:08.339505+0000","last_peered":"2023-10-09T11:42:08.339505+0000","last_clean":"2023-10-09T11:42:08.339505+0000","last_became_active":"2023-10-09T11:42:07.291194+0000","last_became_peered":"2023-10-09T11:42:07.291194+0000","last_unstale":"2023-10-09T11:42:08.339505+0000","last_undegraded":"2023-10-09T11:42:08.339505+0000","last_fullsized":"2023-10-09T11:42:08.339505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:33:31.402493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328810+0000","last_change":"2023-10-09T11:42:08.321880+0000","last_active":"2023-10-09T11:42:08.328810+0000","last_peered":"2023-10-09T11:42:08.328810+0000","last_clean":"2023-10-09T11:42:08.328810+0000","last_became_active":"2023-10-09T11:42:08.320892+0000","last_became_peered":"2023-10-09T11:42:08.320892+0000","last_unstale":"2023-10-09T11:42:08.328810+0000","last_undegraded":"2023-10-09T11:42:08.328810+0000","last_fullsized":"2023-10-09T11:42:08.328810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:43.811496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306541+0000","last_change":"2023-10-09T11:42:07.288047+0000","last_active":"2023-10-09T11:42:08.306541+0000","last_peered":"2023-10-09T11:42:08.306541+0000","last_clean":"2023-10-09T11:42:08.306541+0000","last_became_active":"2023-10-09T11:42:07.287784+0000","last_became_peered":"2023-10-09T11:42:07.287784+0000","last_unstale":"2023-10-09T11:42:08.306541+0000","last_undegraded":"2023-10-09T11:42:08.306541+0000","last_fullsized":"2023-10-09T11:42:08.306541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:42.372440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335364+0000","last_change":"2023-10-09T11:42:08.328204+0000","last_active":"2023-10-09T11:42:08.335364+0000","last_peered":"2023-10-09T11:42:08.335364+0000","last_clean":"2023-10-09T11:42:08.335364+0000","last_became_active":"2023-10-09T11:42:08.327920+0000","last_became_peered":"2023-10-09T11:42:08.327920+0000","last_unstale":"2023-10-09T11:42:08.335364+0000","last_undegraded":"2023-10-09T11:42:08.335364+0000","last_fullsized":"2023-10-09T11:42:08.335364+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304187+0000","last_change":"2023-10-09T11:42:07.299052+0000","last_active":"2023-10-09T11:42:08.304187+0000","last_peered":"2023-10-09T11:42:08.304187+0000","last_clean":"2023-10-09T11:42:08.304187+0000","last_became_active":"2023-10-09T11:42:07.298785+0000","last_became_peered":"2023-10-09T11:42:07.298785+0000","last_unstale":"2023-10-09T11:42:08.304187+0000","last_undegraded":"2023-10-09T11:42:08.304187+0000","last_fullsized":"2023-10-09T11:42:08.304187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:25.688985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330587+0000","last_change":"2023-10-09T11:42:08.322143+0000","last_active":"2023-10-09T11:42:08.330587+0000","last_peered":"2023-10-09T11:42:08.330587+0000","last_clean":"2023-10-09T11:42:08.330587+0000","last_became_active":"2023-10-09T11:42:08.321705+0000","last_became_peered":"2023-10-09T11:42:08.321705+0000","last_unstale":"2023-10-09T11:42:08.330587+0000","last_undegraded":"2023-10-09T11:42:08.330587+0000","last_fullsized":"2023-10-09T11:42:08.330587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.307123+0000","last_change":"2023-10-09T11:42:07.294311+0000","last_active":"2023-10-09T11:42:08.307123+0000","last_peered":"2023-10-09T11:42:08.307123+0000","last_clean":"2023-10-09T11:42:08.307123+0000","last_became_active":"2023-10-09T11:42:07.294004+0000","last_became_peered":"2023-10-09T11:42:07.294004+0000","last_unstale":"2023-10-09T11:42:08.307123+0000","last_undegraded":"2023-10-09T11:42:08.307123+0000","last_fullsized":"2023-10-09T11:42:08.307123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:31.020407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330363+0000","last_change":"2023-10-09T11:42:08.323988+0000","last_active":"2023-10-09T11:42:08.330363+0000","last_peered":"2023-10-09T11:42:08.330363+0000","last_clean":"2023-10-09T11:42:08.330363+0000","last_became_active":"2023-10-09T11:42:08.323694+0000","last_became_peered":"2023-10-09T11:42:08.323694+0000","last_unstale":"2023-10-09T11:42:08.330363+0000","last_undegraded":"2023-10-09T11:42:08.330363+0000","last_fullsized":"2023-10-09T11:42:08.330363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:45.467688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-09T11:42:07.303758+0000","last_change":"2023-10-09T11:42:07.299268+0000","last_active":"2023-10-09T11:42:07.303758+0000","last_peered":"2023-10-09T11:42:07.303758+0000","last_clean":"2023-10-09T11:42:07.303758+0000","last_became_active":"2023-10-09T11:42:07.298999+0000","last_became_peered":"2023-10-09T11:42:07.298999+0000","last_unstale":"2023-10-09T11:42:07.303758+0000","last_undegraded":"2023-10-09T11:42:07.303758+0000","last_fullsized":"2023-10-09T11:42:07.303758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:22.387287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326226+0000","last_change":"2023-10-09T11:42:08.321083+0000","last_active":"2023-10-09T11:42:08.326226+0000","last_peered":"2023-10-09T11:42:08.326226+0000","last_clean":"2023-10-09T11:42:08.326226+0000","last_became_active":"2023-10-09T11:42:08.320806+0000","last_became_peered":"2023-10-09T11:42:08.320806+0000","last_unstale":"2023-10-09T11:42:08.326226+0000","last_undegraded":"2023-10-09T11:42:08.326226+0000","last_fullsized":"2023-10-09T11:42:08.326226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:17.285841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335808+0000","last_change":"2023-10-09T11:42:07.299572+0000","last_active":"2023-10-09T11:42:08.335808+0000","last_peered":"2023-10-09T11:42:08.335808+0000","last_clean":"2023-10-09T11:42:08.335808+0000","last_became_active":"2023-10-09T11:42:07.299307+0000","last_became_peered":"2023-10-09T11:42:07.299307+0000","last_unstale":"2023-10-09T11:42:08.335808+0000","last_undegraded":"2023-10-09T11:42:08.335808+0000","last_fullsized":"2023-10-09T11:42:08.335808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:34.245439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334653+0000","last_change":"2023-10-09T11:42:08.331675+0000","last_active":"2023-10-09T11:42:08.334653+0000","last_peered":"2023-10-09T11:42:08.334653+0000","last_clean":"2023-10-09T11:42:08.334653+0000","last_became_active":"2023-10-09T11:42:08.331130+0000","last_became_peered":"2023-10-09T11:42:08.331130+0000","last_unstale":"2023-10-09T11:42:08.334653+0000","last_undegraded":"2023-10-09T11:42:08.334653+0000","last_fullsized":"2023-10-09T11:42:08.334653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:16.101340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.343362+0000","last_change":"2023-10-09T11:42:07.302661+0000","last_active":"2023-10-09T11:42:08.343362+0000","last_peered":"2023-10-09T11:42:08.343362+0000","last_clean":"2023-10-09T11:42:08.343362+0000","last_became_active":"2023-10-09T11:42:07.302413+0000","last_became_peered":"2023-10-09T11:42:07.302413+0000","last_unstale":"2023-10-09T11:42:08.343362+0000","last_undegraded":"2023-10-09T11:42:08.343362+0000","last_fullsized":"2023-10-09T11:42:08.343362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:08.198909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335711+0000","last_change":"2023-10-09T11:42:08.329233+0000","last_active":"2023-10-09T11:42:08.335711+0000","last_peered":"2023-10-09T11:42:08.335711+0000","last_clean":"2023-10-09T11:42:08.335711+0000","last_became_active":"2023-10-09T11:42:08.328971+0000","last_became_peered":"2023-10-09T11:42:08.328971+0000","last_unstale":"2023-10-09T11:42:08.335711+0000","last_undegraded":"2023-10-09T11:42:08.335711+0000","last_fullsized":"2023-10-09T11:42:08.335711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:27.978608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339234+0000","last_change":"2023-10-09T11:42:07.300330+0000","last_active":"2023-10-09T11:42:08.339234+0000","last_peered":"2023-10-09T11:42:08.339234+0000","last_clean":"2023-10-09T11:42:08.339234+0000","last_became_active":"2023-10-09T11:42:07.300051+0000","last_became_peered":"2023-10-09T11:42:07.300051+0000","last_unstale":"2023-10-09T11:42:08.339234+0000","last_undegraded":"2023-10-09T11:42:08.339234+0000","last_fullsized":"2023-10-09T11:42:08.339234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:03.190161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326199+0000","last_change":"2023-10-09T11:42:08.320969+0000","last_active":"2023-10-09T11:42:08.326199+0000","last_peered":"2023-10-09T11:42:08.326199+0000","last_clean":"2023-10-09T11:42:08.326199+0000","last_became_active":"2023-10-09T11:42:08.320678+0000","last_became_peered":"2023-10-09T11:42:08.320678+0000","last_unstale":"2023-10-09T11:42:08.326199+0000","last_undegraded":"2023-10-09T11:42:08.326199+0000","last_fullsized":"2023-10-09T11:42:08.326199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:30.629034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.311746+0000","last_change":"2023-10-09T11:42:07.300077+0000","last_active":"2023-10-09T11:42:08.311746+0000","last_peered":"2023-10-09T11:42:08.311746+0000","last_clean":"2023-10-09T11:42:08.311746+0000","last_became_active":"2023-10-09T11:42:07.299796+0000","last_became_peered":"2023-10-09T11:42:07.299796+0000","last_unstale":"2023-10-09T11:42:08.311746+0000","last_undegraded":"2023-10-09T11:42:08.311746+0000","last_fullsized":"2023-10-09T11:42:08.311746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:26.290826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.331017+0000","last_change":"2023-10-09T11:42:08.328390+0000","last_active":"2023-10-09T11:42:08.331017+0000","last_peered":"2023-10-09T11:42:08.331017+0000","last_clean":"2023-10-09T11:42:08.331017+0000","last_became_active":"2023-10-09T11:42:08.328142+0000","last_became_peered":"2023-10-09T11:42:08.328142+0000","last_unstale":"2023-10-09T11:42:08.331017+0000","last_undegraded":"2023-10-09T11:42:08.331017+0000","last_fullsized":"2023-10-09T11:42:08.331017+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:18.663763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306638+0000","last_change":"2023-10-09T11:42:07.294316+0000","last_active":"2023-10-09T11:42:08.306638+0000","last_peered":"2023-10-09T11:42:08.306638+0000","last_clean":"2023-10-09T11:42:08.306638+0000","last_became_active":"2023-10-09T11:42:07.294024+0000","last_became_peered":"2023-10-09T11:42:07.294024+0000","last_unstale":"2023-10-09T11:42:08.306638+0000","last_undegraded":"2023-10-09T11:42:08.306638+0000","last_fullsized":"2023-10-09T11:42:08.306638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:10.082677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328512+0000","last_change":"2023-10-09T11:42:08.325654+0000","last_active":"2023-10-09T11:42:08.328512+0000","last_peered":"2023-10-09T11:42:08.328512+0000","last_clean":"2023-10-09T11:42:08.328512+0000","last_became_active":"2023-10-09T11:42:08.325354+0000","last_became_peered":"2023-10-09T11:42:08.325354+0000","last_unstale":"2023-10-09T11:42:08.328512+0000","last_undegraded":"2023-10-09T11:42:08.328512+0000","last_fullsized":"2023-10-09T11:42:08.328512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:54.036861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339350+0000","last_change":"2023-10-09T11:42:07.298627+0000","last_active":"2023-10-09T11:42:08.339350+0000","last_peered":"2023-10-09T11:42:08.339350+0000","last_clean":"2023-10-09T11:42:08.339350+0000","last_became_active":"2023-10-09T11:42:07.298346+0000","last_became_peered":"2023-10-09T11:42:07.298346+0000","last_unstale":"2023-10-09T11:42:08.339350+0000","last_undegraded":"2023-10-09T11:42:08.339350+0000","last_fullsized":"2023-10-09T11:42:08.339350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:01.329280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.328773+0000","last_change":"2023-10-09T11:42:08.324273+0000","last_active":"2023-10-09T11:42:08.328773+0000","last_peered":"2023-10-09T11:42:08.328773+0000","last_clean":"2023-10-09T11:42:08.328773+0000","last_became_active":"2023-10-09T11:42:08.323970+0000","last_became_peered":"2023-10-09T11:42:08.323970+0000","last_unstale":"2023-10-09T11:42:08.328773+0000","last_undegraded":"2023-10-09T11:42:08.328773+0000","last_fullsized":"2023-10-09T11:42:08.328773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:57.006395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.335132+0000","last_change":"2023-10-09T11:42:07.306126+0000","last_active":"2023-10-09T11:42:08.335132+0000","last_peered":"2023-10-09T11:42:08.335132+0000","last_clean":"2023-10-09T11:42:08.335132+0000","last_became_active":"2023-10-09T11:42:07.305876+0000","last_became_peered":"2023-10-09T11:42:07.305876+0000","last_unstale":"2023-10-09T11:42:08.335132+0000","last_undegraded":"2023-10-09T11:42:08.335132+0000","last_fullsized":"2023-10-09T11:42:08.335132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:43.311506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.333461+0000","last_change":"2023-10-09T11:42:08.327977+0000","last_active":"2023-10-09T11:42:08.333461+0000","last_peered":"2023-10-09T11:42:08.333461+0000","last_clean":"2023-10-09T11:42:08.333461+0000","last_became_active":"2023-10-09T11:42:08.327036+0000","last_became_peered":"2023-10-09T11:42:08.327036+0000","last_unstale":"2023-10-09T11:42:08.333461+0000","last_undegraded":"2023-10-09T11:42:08.333461+0000","last_fullsized":"2023-10-09T11:42:08.333461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:50:18.663763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.339037+0000","last_change":"2023-10-09T11:42:07.301503+0000","last_active":"2023-10-09T11:42:08.339037+0000","last_peered":"2023-10-09T11:42:08.339037+0000","last_clean":"2023-10-09T11:42:08.339037+0000","last_became_active":"2023-10-09T11:42:07.301251+0000","last_became_peered":"2023-10-09T11:42:07.301251+0000","last_unstale":"2023-10-09T11:42:08.339037+0000","last_undegraded":"2023-10-09T11:42:08.339037+0000","last_fullsized":"2023-10-09T11:42:08.339037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:25.575073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336955+0000","last_change":"2023-10-09T11:42:08.327733+0000","last_active":"2023-10-09T11:42:08.336955+0000","last_peered":"2023-10-09T11:42:08.336955+0000","last_clean":"2023-10-09T11:42:08.336955+0000","last_became_active":"2023-10-09T11:42:08.327455+0000","last_became_peered":"2023-10-09T11:42:08.327455+0000","last_unstale":"2023-10-09T11:42:08.336955+0000","last_undegraded":"2023-10-09T11:42:08.336955+0000","last_fullsized":"2023-10-09T11:42:08.336955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:42.494821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.338278+0000","last_change":"2023-10-09T11:42:07.294908+0000","last_active":"2023-10-09T11:42:08.338278+0000","last_peered":"2023-10-09T11:42:08.338278+0000","last_clean":"2023-10-09T11:42:08.338278+0000","last_became_active":"2023-10-09T11:42:07.294634+0000","last_became_peered":"2023-10-09T11:42:07.294634+0000","last_unstale":"2023-10-09T11:42:08.338278+0000","last_undegraded":"2023-10-09T11:42:08.338278+0000","last_fullsized":"2023-10-09T11:42:08.338278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:54.656314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.321276+0000","last_change":"2023-10-09T11:42:08.321276+0000","last_active":"2023-10-09T11:42:08.321276+0000","last_peered":"2023-10-09T11:42:08.321276+0000","last_clean":"2023-10-09T11:42:08.321276+0000","last_became_active":"2023-10-09T11:42:08.321042+0000","last_became_peered":"2023-10-09T11:42:08.321042+0000","last_unstale":"2023-10-09T11:42:08.321276+0000","last_undegraded":"2023-10-09T11:42:08.321276+0000","last_fullsized":"2023-10-09T11:42:08.321276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:53.839968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304609+0000","last_change":"2023-10-09T11:42:07.301149+0000","last_active":"2023-10-09T11:42:08.304609+0000","last_peered":"2023-10-09T11:42:08.304609+0000","last_clean":"2023-10-09T11:42:08.304609+0000","last_became_active":"2023-10-09T11:42:07.300881+0000","last_became_peered":"2023-10-09T11:42:07.300881+0000","last_unstale":"2023-10-09T11:42:08.304609+0000","last_undegraded":"2023-10-09T11:42:08.304609+0000","last_fullsized":"2023-10-09T11:42:08.304609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:43.626754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.317112+0000","last_change":"2023-10-09T11:42:08.317112+0000","last_active":"2023-10-09T11:42:08.317112+0000","last_peered":"2023-10-09T11:42:08.317112+0000","last_clean":"2023-10-09T11:42:08.317112+0000","last_became_active":"2023-10-09T11:42:08.316866+0000","last_became_peered":"2023-10-09T11:42:08.316866+0000","last_unstale":"2023-10-09T11:42:08.317112+0000","last_undegraded":"2023-10-09T11:42:08.317112+0000","last_fullsized":"2023-10-09T11:42:08.317112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:43.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.336305+0000","last_change":"2023-10-09T11:42:07.301350+0000","last_active":"2023-10-09T11:42:08.336305+0000","last_peered":"2023-10-09T11:42:08.336305+0000","last_clean":"2023-10-09T11:42:08.336305+0000","last_became_active":"2023-10-09T11:42:07.301081+0000","last_became_peered":"2023-10-09T11:42:07.301081+0000","last_unstale":"2023-10-09T11:42:08.336305+0000","last_undegraded":"2023-10-09T11:42:08.336305+0000","last_fullsized":"2023-10-09T11:42:08.336305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:04.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.314192+0000","last_change":"2023-10-09T11:42:08.314192+0000","last_active":"2023-10-09T11:42:08.314192+0000","last_peered":"2023-10-09T11:42:08.314192+0000","last_clean":"2023-10-09T11:42:08.314192+0000","last_became_active":"2023-10-09T11:42:08.313916+0000","last_became_peered":"2023-10-09T11:42:08.313916+0000","last_unstale":"2023-10-09T11:42:08.314192+0000","last_undegraded":"2023-10-09T11:42:08.314192+0000","last_fullsized":"2023-10-09T11:42:08.314192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:01.515186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.309120+0000","last_change":"2023-10-09T11:42:07.304102+0000","last_active":"2023-10-09T11:42:08.309120+0000","last_peered":"2023-10-09T11:42:08.309120+0000","last_clean":"2023-10-09T11:42:08.309120+0000","last_became_active":"2023-10-09T11:42:07.303505+0000","last_became_peered":"2023-10-09T11:42:07.303505+0000","last_unstale":"2023-10-09T11:42:08.309120+0000","last_undegraded":"2023-10-09T11:42:08.309120+0000","last_fullsized":"2023-10-09T11:42:08.309120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:26.290826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.313565+0000","last_change":"2023-10-09T11:42:08.313565+0000","last_active":"2023-10-09T11:42:08.313565+0000","last_peered":"2023-10-09T11:42:08.313565+0000","last_clean":"2023-10-09T11:42:08.313565+0000","last_became_active":"2023-10-09T11:42:08.313273+0000","last_became_peered":"2023-10-09T11:42:08.313273+0000","last_unstale":"2023-10-09T11:42:08.313565+0000","last_undegraded":"2023-10-09T11:42:08.313565+0000","last_fullsized":"2023-10-09T11:42:08.313565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:32.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304468+0000","last_change":"2023-10-09T11:42:07.298032+0000","last_active":"2023-10-09T11:42:08.304468+0000","last_peered":"2023-10-09T11:42:08.304468+0000","last_clean":"2023-10-09T11:42:08.304468+0000","last_became_active":"2023-10-09T11:42:07.297773+0000","last_became_peered":"2023-10-09T11:42:07.297773+0000","last_unstale":"2023-10-09T11:42:08.304468+0000","last_undegraded":"2023-10-09T11:42:08.304468+0000","last_fullsized":"2023-10-09T11:42:08.304468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:48.568989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330172+0000","last_change":"2023-10-09T11:42:08.322545+0000","last_active":"2023-10-09T11:42:08.330172+0000","last_peered":"2023-10-09T11:42:08.330172+0000","last_clean":"2023-10-09T11:42:08.330172+0000","last_became_active":"2023-10-09T11:42:08.322004+0000","last_became_peered":"2023-10-09T11:42:08.322004+0000","last_unstale":"2023-10-09T11:42:08.330172+0000","last_undegraded":"2023-10-09T11:42:08.330172+0000","last_fullsized":"2023-10-09T11:42:08.330172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:01.919729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.312529+0000","last_change":"2023-10-09T11:42:07.299591+0000","last_active":"2023-10-09T11:42:08.312529+0000","last_peered":"2023-10-09T11:42:08.312529+0000","last_clean":"2023-10-09T11:42:08.312529+0000","last_became_active":"2023-10-09T11:42:07.299336+0000","last_became_peered":"2023-10-09T11:42:07.299336+0000","last_unstale":"2023-10-09T11:42:08.312529+0000","last_undegraded":"2023-10-09T11:42:08.312529+0000","last_fullsized":"2023-10-09T11:42:08.312529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:26.290826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.322947+0000","last_change":"2023-10-09T11:42:08.322947+0000","last_active":"2023-10-09T11:42:08.322947+0000","last_peered":"2023-10-09T11:42:08.322947+0000","last_clean":"2023-10-09T11:42:08.322947+0000","last_became_active":"2023-10-09T11:42:08.322671+0000","last_became_peered":"2023-10-09T11:42:08.322671+0000","last_unstale":"2023-10-09T11:42:08.322947+0000","last_undegraded":"2023-10-09T11:42:08.322947+0000","last_fullsized":"2023-10-09T11:42:08.322947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:09.206853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.334069+0000","last_change":"2023-10-09T11:42:07.303278+0000","last_active":"2023-10-09T11:42:08.334069+0000","last_peered":"2023-10-09T11:42:08.334069+0000","last_clean":"2023-10-09T11:42:08.334069+0000","last_became_active":"2023-10-09T11:42:07.302967+0000","last_became_peered":"2023-10-09T11:42:07.302967+0000","last_unstale":"2023-10-09T11:42:08.334069+0000","last_undegraded":"2023-10-09T11:42:08.334069+0000","last_fullsized":"2023-10-09T11:42:08.334069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:41.433548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.330742+0000","last_change":"2023-10-09T11:42:08.322951+0000","last_active":"2023-10-09T11:42:08.330742+0000","last_peered":"2023-10-09T11:42:08.330742+0000","last_clean":"2023-10-09T11:42:08.330742+0000","last_became_active":"2023-10-09T11:42:08.322636+0000","last_became_peered":"2023-10-09T11:42:08.322636+0000","last_unstale":"2023-10-09T11:42:08.330742+0000","last_undegraded":"2023-10-09T11:42:08.330742+0000","last_fullsized":"2023-10-09T11:42:08.330742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:27.640818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-09T11:42:07.305945+0000","last_change":"2023-10-09T11:42:07.302612+0000","last_active":"2023-10-09T11:42:07.305945+0000","last_peered":"2023-10-09T11:42:07.305945+0000","last_clean":"2023-10-09T11:42:07.305945+0000","last_became_active":"2023-10-09T11:42:07.302279+0000","last_became_peered":"2023-10-09T11:42:07.302279+0000","last_unstale":"2023-10-09T11:42:07.305945+0000","last_undegraded":"2023-10-09T11:42:07.305945+0000","last_fullsized":"2023-10-09T11:42:07.305945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:59.929218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.319700+0000","last_change":"2023-10-09T11:42:08.319700+0000","last_active":"2023-10-09T11:42:08.319700+0000","last_peered":"2023-10-09T11:42:08.319700+0000","last_clean":"2023-10-09T11:42:08.319700+0000","last_became_active":"2023-10-09T11:42:08.318546+0000","last_became_peered":"2023-10-09T11:42:08.318546+0000","last_unstale":"2023-10-09T11:42:08.319700+0000","last_undegraded":"2023-10-09T11:42:08.319700+0000","last_fullsized":"2023-10-09T11:42:08.319700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:09.206853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.312036+0000","last_change":"2023-10-09T11:42:07.300333+0000","last_active":"2023-10-09T11:42:08.312036+0000","last_peered":"2023-10-09T11:42:08.312036+0000","last_clean":"2023-10-09T11:42:08.312036+0000","last_became_active":"2023-10-09T11:42:07.300028+0000","last_became_peered":"2023-10-09T11:42:07.300028+0000","last_unstale":"2023-10-09T11:42:08.312036+0000","last_undegraded":"2023-10-09T11:42:08.312036+0000","last_fullsized":"2023-10-09T11:42:08.312036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:19.656986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320701+0000","last_change":"2023-10-09T11:42:08.318128+0000","last_active":"2023-10-09T11:42:08.320701+0000","last_peered":"2023-10-09T11:42:08.320701+0000","last_clean":"2023-10-09T11:42:08.320701+0000","last_became_active":"2023-10-09T11:42:08.317365+0000","last_became_peered":"2023-10-09T11:42:08.317365+0000","last_unstale":"2023-10-09T11:42:08.320701+0000","last_undegraded":"2023-10-09T11:42:08.320701+0000","last_fullsized":"2023-10-09T11:42:08.320701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:05.088664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-09T11:42:07.305985+0000","last_change":"2023-10-09T11:42:07.301683+0000","last_active":"2023-10-09T11:42:07.305985+0000","last_peered":"2023-10-09T11:42:07.305985+0000","last_clean":"2023-10-09T11:42:07.305985+0000","last_became_active":"2023-10-09T11:42:07.301402+0000","last_became_peered":"2023-10-09T11:42:07.301402+0000","last_unstale":"2023-10-09T11:42:07.305985+0000","last_undegraded":"2023-10-09T11:42:07.305985+0000","last_fullsized":"2023-10-09T11:42:07.305985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:57.604026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.320279+0000","last_change":"2023-10-09T11:42:08.320279+0000","last_active":"2023-10-09T11:42:08.320279+0000","last_peered":"2023-10-09T11:42:08.320279+0000","last_clean":"2023-10-09T11:42:08.320279+0000","last_became_active":"2023-10-09T11:42:08.319992+0000","last_became_peered":"2023-10-09T11:42:08.319992+0000","last_unstale":"2023-10-09T11:42:08.320279+0000","last_undegraded":"2023-10-09T11:42:08.320279+0000","last_fullsized":"2023-10-09T11:42:08.320279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:43.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.311832+0000","last_change":"2023-10-09T11:42:07.302331+0000","last_active":"2023-10-09T11:42:08.311832+0000","last_peered":"2023-10-09T11:42:08.311832+0000","last_clean":"2023-10-09T11:42:08.311832+0000","last_became_active":"2023-10-09T11:42:07.302092+0000","last_became_peered":"2023-10-09T11:42:07.302092+0000","last_unstale":"2023-10-09T11:42:08.311832+0000","last_undegraded":"2023-10-09T11:42:08.311832+0000","last_fullsized":"2023-10-09T11:42:08.311832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:34.245439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.332619+0000","last_change":"2023-10-09T11:42:08.325497+0000","last_active":"2023-10-09T11:42:08.332619+0000","last_peered":"2023-10-09T11:42:08.332619+0000","last_clean":"2023-10-09T11:42:08.332619+0000","last_became_active":"2023-10-09T11:42:08.324950+0000","last_became_peered":"2023-10-09T11:42:08.324950+0000","last_unstale":"2023-10-09T11:42:08.332619+0000","last_undegraded":"2023-10-09T11:42:08.332619+0000","last_fullsized":"2023-10-09T11:42:08.332619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:29.444499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.304486+0000","last_change":"2023-10-09T11:42:07.300512+0000","last_active":"2023-10-09T11:42:08.304486+0000","last_peered":"2023-10-09T11:42:08.304486+0000","last_clean":"2023-10-09T11:42:08.304486+0000","last_became_active":"2023-10-09T11:42:07.300164+0000","last_became_peered":"2023-10-09T11:42:07.300164+0000","last_unstale":"2023-10-09T11:42:08.304486+0000","last_undegraded":"2023-10-09T11:42:08.304486+0000","last_fullsized":"2023-10-09T11:42:08.304486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:23.008112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.326389+0000","last_change":"2023-10-09T11:42:08.319452+0000","last_active":"2023-10-09T11:42:08.326389+0000","last_peered":"2023-10-09T11:42:08.326389+0000","last_clean":"2023-10-09T11:42:08.326389+0000","last_became_active":"2023-10-09T11:42:08.319190+0000","last_became_peered":"2023-10-09T11:42:08.319190+0000","last_unstale":"2023-10-09T11:42:08.326389+0000","last_undegraded":"2023-10-09T11:42:08.326389+0000","last_fullsized":"2023-10-09T11:42:08.326389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:12.171072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306082+0000","last_change":"2023-10-09T11:42:07.296735+0000","last_active":"2023-10-09T11:42:08.306082+0000","last_peered":"2023-10-09T11:42:08.306082+0000","last_clean":"2023-10-09T11:42:08.306082+0000","last_became_active":"2023-10-09T11:42:07.296474+0000","last_became_peered":"2023-10-09T11:42:07.296474+0000","last_unstale":"2023-10-09T11:42:08.306082+0000","last_undegraded":"2023-10-09T11:42:08.306082+0000","last_fullsized":"2023-10-09T11:42:08.306082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:40.466534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.327662+0000","last_change":"2023-10-09T11:42:08.322810+0000","last_active":"2023-10-09T11:42:08.327662+0000","last_peered":"2023-10-09T11:42:08.327662+0000","last_clean":"2023-10-09T11:42:08.327662+0000","last_became_active":"2023-10-09T11:42:08.321237+0000","last_became_peered":"2023-10-09T11:42:08.321237+0000","last_unstale":"2023-10-09T11:42:08.327662+0000","last_undegraded":"2023-10-09T11:42:08.327662+0000","last_fullsized":"2023-10-09T11:42:08.327662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:07.272021+0000","last_clean_scrub_stamp":"2023-10-09T11:42:07.272021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:22.827958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.306884+0000","last_change":"2023-10-09T11:42:07.302858+0000","last_active":"2023-10-09T11:42:08.306884+0000","last_peered":"2023-10-09T11:42:08.306884+0000","last_clean":"2023-10-09T11:42:08.306884+0000","last_became_active":"2023-10-09T11:42:07.302581+0000","last_became_peered":"2023-10-09T11:42:07.302581+0000","last_unstale":"2023-10-09T11:42:08.306884+0000","last_undegraded":"2023-10-09T11:42:08.306884+0000","last_fullsized":"2023-10-09T11:42:08.306884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:06.264077+0000","last_clean_scrub_stamp":"2023-10-09T11:42:06.264077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:11.163129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-09T11:42:08.311096+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:42:08.311096+0000","last_peered":"2023-10-09T11:42:08.311096+0000","last_clean":"2023-10-09T11:42:08.311096+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:42:08.311096+0000","last_undegraded":"2023-10-09T11:42:08.311096+0000","last_fullsized":"2023-10-09T11:42:08.311096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476753,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":983040,"data_stored":741264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.754},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.872},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79600000000000004}]}]},{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":151394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.754},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.80800000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":144588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.97299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54500000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.81799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.86499999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":734886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.436}]},{"osd":3,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66000000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.73399999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":152364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.877}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.76800000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69499999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":152364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.372},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.495},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.73899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.80000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67600000000000005}]}]},{"osd":4,"up_from":16,"seq":68719476753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":150910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.75}]},{"osd":1,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81799999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.86699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.879},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.629},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.64900000000000002}]}]},{"osd":5,"up_from":16,"seq":68719476753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":151450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.90900000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.81799999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.86199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:42:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:42:13.067 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:42:13.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.287+0000 7f80ab3ff700 1 Processor -- start 2023-10-09T11:42:13.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.287+0000 7f80ab3ff700 1 -- start start 2023-10-09T11:42:13.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.288+0000 7f80ab3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.288+0000 7f80ab3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80a4069fa0 0x7f80a40c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.288+0000 7f80ab3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a4156340 con 0x7f80a4156ee0 2023-10-09T11:42:13.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.288+0000 7f80ab3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a40c8990 con 0x7f80a4069fa0 2023-10-09T11:42:13.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.288+0000 7f80ab3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a406ee20 con 0x7f80a40c85c0 2023-10-09T11:42:13.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80a4069fa0 0x7f80a40c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80a4069fa0 0x7f80a40c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39218/0 (socket says 172.21.15.86:39218) 2023-10-09T11:42:13.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 -- 172.21.15.86:0/2179537490 learned_addr learned my addr 172.21.15.86:0/2179537490 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:13.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a919b700 1 --2- 172.21.15.86:0/2179537490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 -- 172.21.15.86:0/2179537490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 msgr2=0x7f80a406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 --2- 172.21.15.86:0/2179537490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a406d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 -- 172.21.15.86:0/2179537490 >> v1:172.21.15.86:6789/0 conn(0x7f80a4156ee0 legacy=0x7f80a4069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 -- 172.21.15.86:0/2179537490 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a406dd80 con 0x7f80a4069fa0 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f809bfff700 1 -- 172.21.15.86:0/2179537490 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914891524 0 0) 0x7f80a4156340 con 0x7f80a4156ee0 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.289+0000 7f80a999c700 1 --2- 172.21.15.86:0/2179537490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40c6ae0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f809c009f20 tx=0x7f809c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce2dbc9700c0407 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f809bfff700 1 -- 172.21.15.86:0/2179537490 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0092e0 con 0x7f80a4069fa0 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f809bfff700 1 -- 172.21.15.86:0/2179537490 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00ba80 con 0x7f80a4069fa0 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f809bfff700 1 -- 172.21.15.86:0/2179537490 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00be40 con 0x7f80a4069fa0 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 -- 172.21.15.86:0/2179537490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 msgr2=0x7f80a40c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/2179537490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40c6ae0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f809c009f20 tx=0x7f809c009840 comp rx=0 tx=0).stop 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 -- 172.21.15.86:0/2179537490 shutdown_connections 2023-10-09T11:42:13.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/2179537490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40c6ae0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/2179537490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a406d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 -- 172.21.15.86:0/2179537490 >> 172.21.15.86:0/2179537490 conn(0x7f80a40cc540 msgr2=0x7f80a40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:13.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 -- 172.21.15.86:0/2179537490 shutdown_connections 2023-10-09T11:42:13.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.290+0000 7f80ab3ff700 1 -- 172.21.15.86:0/2179537490 wait complete. 2023-10-09T11:42:13.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.292+0000 7f80ab3ff700 1 Processor -- start 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.292+0000 7f80ab3ff700 1 -- start start 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80ab3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80ab3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a416d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80ab3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a4156ee0 0x7f80a416dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80ab3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4158690 con 0x7f80a4069fa0 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80ab3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40b21f0 con 0x7f80a4156ee0 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80ab3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4158040 con 0x7f80a40c85c0 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40ab050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39222/0 (socket says 172.21.15.86:39222) 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 -- 172.21.15.86:0/3842126350 learned_addr learned my addr 172.21.15.86:0/3842126350 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:13.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a999c700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a4156ee0 0x7f80a416dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a899a700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a416d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 -- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 msgr2=0x7f80a416d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a416d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 -- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a4156ee0 msgr2=0x7f80a416dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a4156ee0 0x7f80a416dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.293+0000 7f80a919b700 1 -- 172.21.15.86:0/3842126350 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c009ae0 con 0x7f80a4069fa0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.294+0000 7f80a919b700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40ab050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f80a000d890 tx=0x7f80a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.294+0000 7f80997fa700 1 -- 172.21.15.86:0/3842126350 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000b600 con 0x7f80a4069fa0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.294+0000 7f80997fa700 1 -- 172.21.15.86:0/3842126350 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000b760 con 0x7f80a4069fa0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.294+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a4158320 con 0x7f80a4069fa0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.294+0000 7f80997fa700 1 -- 172.21.15.86:0/3842126350 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000bae0 con 0x7f80a4069fa0 2023-10-09T11:42:13.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.294+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a40ab590 con 0x7f80a4069fa0 2023-10-09T11:42:13.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.295+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a40718b0 con 0x7f80a4069fa0 2023-10-09T11:42:13.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.296+0000 7f80997fa700 1 -- 172.21.15.86:0/3842126350 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80a001e460 con 0x7f80a4069fa0 2023-10-09T11:42:13.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.297+0000 7f80997fa700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.297+0000 7f80997fa700 1 -- 172.21.15.86:0/3842126350 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80a0084be0 con 0x7f80a4069fa0 2023-10-09T11:42:13.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.297+0000 7f80a899a700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.298+0000 7f80a899a700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f80a40ad7d0 tx=0x7f8094009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.301+0000 7f80997fa700 1 -- 172.21.15.86:0/3842126350 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80a0051e50 con 0x7f80a4069fa0 2023-10-09T11:42:13.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.569+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f80a406e060 con 0x7f80a4069fa0 2023-10-09T11:42:13.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.573+0000 7f80997fa700 1 -- 172.21.15.86:0/3842126350 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f80a0055470 con 0x7f80a4069fa0 2023-10-09T11:42:13.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.575+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8088066f30 msgr2=0x7f80880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.575+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f80a40ad7d0 tx=0x7f8094009040 comp rx=0 tx=0).stop 2023-10-09T11:42:13.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.575+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 msgr2=0x7f80a40ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.575+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40ab050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f80a000d890 tx=0x7f80a0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 shutdown_connections 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a4069fa0 0x7f80a40ab050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80a4156ee0 0x7f80a416dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 --2- 172.21.15.86:0/3842126350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80a40c85c0 0x7f80a416d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 >> 172.21.15.86:0/3842126350 conn(0x7f80a40cc540 msgr2=0x7f80a40ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 shutdown_connections 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.576+0000 7f80ab3ff700 1 -- 172.21.15.86:0/3842126350 wait complete. 2023-10-09T11:42:13.577 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T11:42:13.593 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:13.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.773+0000 7fd45e9ff700 1 Processor -- start 2023-10-09T11:42:13.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.774+0000 7fd45e9ff700 1 -- start start 2023-10-09T11:42:13.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd45e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd4580ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd45e9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4580b1420 0x7fd4580c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd45e9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4580cc300 con 0x7fd4580ccf90 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd45e9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd458156bf0 con 0x7fd4580b1420 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd45e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580ae950 con 0x7fd4580cbf30 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd44ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd4580ccf90 0x7fd4580b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38838/0 (socket says 172.21.15.86:38838) 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd44ffff700 1 -- 172.21.15.86:0/510836169 learned_addr learned my addr 172.21.15.86:0/510836169 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd457fff700 1 --2- 172.21.15.86:0/510836169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd4580ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.775+0000 7fd45cf9c700 1 --2- 172.21.15.86:0/510836169 >> v2:172.21.15.135:3300/0 conn(0x7fd4580b1420 0x7fd4580c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd4577fe700 1 -- 172.21.15.86:0/510836169 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143975100 0 0) 0x7fd4580cc300 con 0x7fd4580ccf90 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd4577fe700 1 -- 172.21.15.86:0/510836169 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd444003570 con 0x7fd4580ccf90 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd457fff700 1 -- 172.21.15.86:0/510836169 >> v2:172.21.15.135:3300/0 conn(0x7fd4580b1420 msgr2=0x7fd4580c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd457fff700 1 --2- 172.21.15.86:0/510836169 >> v2:172.21.15.135:3300/0 conn(0x7fd4580b1420 0x7fd4580c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd457fff700 1 -- 172.21.15.86:0/510836169 >> v1:172.21.15.86:6789/0 conn(0x7fd4580ccf90 legacy=0x7fd4580b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd457fff700 1 -- 172.21.15.86:0/510836169 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580ad370 con 0x7fd4580cbf30 2023-10-09T11:42:13.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd45cf9c700 1 --2- 172.21.15.86:0/510836169 >> v2:172.21.15.135:3300/0 conn(0x7fd4580b1420 0x7fd4580c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.776+0000 7fd457fff700 1 --2- 172.21.15.86:0/510836169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd4580ae410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4480098e0 tx=0x7fd4480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c91f765d3cb0408 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd4577fe700 1 -- 172.21.15.86:0/510836169 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800f6b0 con 0x7fd4580cbf30 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd4577fe700 1 -- 172.21.15.86:0/510836169 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800f810 con 0x7fd4580cbf30 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd4577fe700 1 -- 172.21.15.86:0/510836169 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800fbb0 con 0x7fd4580cbf30 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 -- 172.21.15.86:0/510836169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 msgr2=0x7fd4580ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/510836169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd4580ae410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4480098e0 tx=0x7fd4480091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 -- 172.21.15.86:0/510836169 shutdown_connections 2023-10-09T11:42:13.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/510836169 >> v2:172.21.15.135:3300/0 conn(0x7fd4580b1420 0x7fd4580c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/510836169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd4580ae410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 -- 172.21.15.86:0/510836169 >> 172.21.15.86:0/510836169 conn(0x7fd45806a320 msgr2=0x7fd4580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:13.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 -- 172.21.15.86:0/510836169 shutdown_connections 2023-10-09T11:42:13.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.777+0000 7fd45e9ff700 1 -- 172.21.15.86:0/510836169 wait complete. 2023-10-09T11:42:13.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.779+0000 7fd45e9ff700 1 Processor -- start 2023-10-09T11:42:13.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.779+0000 7fd45e9ff700 1 -- start start 2023-10-09T11:42:13.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45e9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b1420 0x7fd45815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd458155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45e9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4580ccf90 0x7fd458156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45e9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c6820 con 0x7fd4580ccf90 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45e9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c6b00 con 0x7fd4580b1420 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c6de0 con 0x7fd4580cbf30 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4580ccf90 0x7fd458156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4580ccf90 0x7fd458156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39232/0 (socket says 172.21.15.86:39232) 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 -- 172.21.15.86:0/3767680392 learned_addr learned my addr 172.21.15.86:0/3767680392 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd44ffff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd458155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd457fff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b1420 0x7fd45815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 -- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 msgr2=0x7fd458155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd458155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 -- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b1420 msgr2=0x7fd45815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b1420 0x7fd45815ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd45cf9c700 1 -- 172.21.15.86:0/3767680392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450009a20 con 0x7fd4580ccf90 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.780+0000 7fd457fff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b1420 0x7fd45815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.781+0000 7fd44ffff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd458155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.781+0000 7fd45cf9c700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4580ccf90 0x7fd458156240 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd45000ef90 tx=0x7fd45000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.781+0000 7fd454ff9700 1 -- 172.21.15.86:0/3767680392 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45000cd30 con 0x7fd4580ccf90 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.781+0000 7fd454ff9700 1 -- 172.21.15.86:0/3767680392 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45000f040 con 0x7fd4580ccf90 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.781+0000 7fd454ff9700 1 -- 172.21.15.86:0/3767680392 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500146b0 con 0x7fd4580ccf90 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.781+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd448009420 con 0x7fd4580ccf90 2023-10-09T11:42:13.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.781+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580c73a0 con 0x7fd4580ccf90 2023-10-09T11:42:13.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.783+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45804c3c0 con 0x7fd4580ccf90 2023-10-09T11:42:13.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.783+0000 7fd454ff9700 1 -- 172.21.15.86:0/3767680392 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd450014ae0 con 0x7fd4580ccf90 2023-10-09T11:42:13.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.784+0000 7fd454ff9700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd438066f30 0x7fd4380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.785+0000 7fd454ff9700 1 -- 172.21.15.86:0/3767680392 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd450085430 con 0x7fd4580ccf90 2023-10-09T11:42:13.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.785+0000 7fd457fff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd438066f30 0x7fd4380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.785+0000 7fd457fff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd438066f30 0x7fd4380693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4480091e0 tx=0x7fd448019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:13.789+0000 7fd454ff9700 1 -- 172.21.15.86:0/3767680392 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd450052600 con 0x7fd4580ccf90 2023-10-09T11:42:14.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.022+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4580ad650 con 0x7fd4580ccf90 2023-10-09T11:42:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.022+0000 7fd454ff9700 1 -- 172.21.15.86:0/3767680392 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fd450055c20 con 0x7fd4580ccf90 2023-10-09T11:42:14.023 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:42:14.023 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1552998028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1552998028},{"type":"v1","addr":"172.21.15.135:6834","nonce":1552998028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3861152933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3861152933},{"type":"v1","addr":"172.21.15.135:6835","nonce":3861152933}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4887,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/647611791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":647611791},{"type":"v1","addr":"172.21.15.86:6836","nonce":647611791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:07.793130+0000","modified":"2023-10-09T11:42:11.321775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6837/1725825433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1725825433},{"type":"v1","addr":"172.21.15.86:6837","nonce":1725825433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd438066f30 msgr2=0x7fd4380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd438066f30 0x7fd4380693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4480091e0 tx=0x7fd448019000 comp rx=0 tx=0).stop 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4580ccf90 msgr2=0x7fd458156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4580ccf90 0x7fd458156240 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd45000ef90 tx=0x7fd45000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 shutdown_connections 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd438066f30 0x7fd4380693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4580ccf90 0x7fd458156240 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b1420 0x7fd45815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 --2- 172.21.15.86:0/3767680392 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4580cbf30 0x7fd458155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 >> 172.21.15.86:0/3767680392 conn(0x7fd45806a320 msgr2=0x7fd4580c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 shutdown_connections 2023-10-09T11:42:14.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.025+0000 7fd45e9ff700 1 -- 172.21.15.86:0/3767680392 wait complete. 2023-10-09T11:42:14.027 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2023-10-09T11:42:14.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:42:07.793130+0000', 'modified': '2023-10-09T11:42:11.321775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4890}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4890': {'gid': 4890, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.86:6837/1725825433', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6835', 'nonce': 1725825433}, {'type': 'v1', 'addr': '172.21.15.86:6837', 'nonce': 1725825433}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:42:14.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:42:14.445 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:42:14.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.626+0000 7fc5d73ff700 1 Processor -- start 2023-10-09T11:42:14.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.626+0000 7fc5d73ff700 1 -- start start 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d73ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5d00b1850 0x7fc5d00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d73ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d00ae680 0x7fc5d01572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d73ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d00cb300 con 0x7fc5d00aeb00 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d73ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d006fc30 con 0x7fc5d00ae680 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d73ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00cc260 con 0x7fc5d00b1850 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d00ae680 0x7fc5d01572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d00ae680 0x7fc5d01572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39246/0 (socket says 172.21.15.86:39246) 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d499a700 1 -- 172.21.15.86:0/3640026287 learned_addr learned my addr 172.21.15.86:0/3640026287 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d519b700 1 --2- 172.21.15.86:0/3640026287 >> v2:172.21.15.135:3300/0 conn(0x7fc5d00b1850 0x7fc5d00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d499a700 1 -- 172.21.15.86:0/3640026287 >> v2:172.21.15.135:3300/0 conn(0x7fc5d00b1850 msgr2=0x7fc5d00b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d499a700 1 --2- 172.21.15.86:0/3640026287 >> v2:172.21.15.135:3300/0 conn(0x7fc5d00b1850 0x7fc5d00b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d499a700 1 -- 172.21.15.86:0/3640026287 >> v1:172.21.15.135:6789/0 conn(0x7fc5d00aeb00 legacy=0x7fc5d015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.628+0000 7fc5d499a700 1 -- 172.21.15.86:0/3640026287 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00cb5e0 con 0x7fc5d00ae680 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.629+0000 7fc5d499a700 1 --2- 172.21.15.86:0/3640026287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d01572e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00641e0 tx=0x7fc5c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286bf4016d11f9b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.629+0000 7fc5c7fff700 1 -- 172.21.15.86:0/3640026287 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000b860 con 0x7fc5d00ae680 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.629+0000 7fc5c7fff700 1 -- 172.21.15.86:0/3640026287 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000b9c0 con 0x7fc5d00ae680 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.629+0000 7fc5c7fff700 1 -- 172.21.15.86:0/3640026287 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000bd60 con 0x7fc5d00ae680 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.629+0000 7fc5d73ff700 1 -- 172.21.15.86:0/3640026287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 msgr2=0x7fc5d01572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.629+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/3640026287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d01572e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00641e0 tx=0x7fc5c0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.630+0000 7fc5d73ff700 1 -- 172.21.15.86:0/3640026287 shutdown_connections 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.630+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/3640026287 >> v2:172.21.15.135:3300/0 conn(0x7fc5d00b1850 0x7fc5d00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.630+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/3640026287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d01572e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.630+0000 7fc5d73ff700 1 -- 172.21.15.86:0/3640026287 >> 172.21.15.86:0/3640026287 conn(0x7fc5d006a320 msgr2=0x7fc5d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.630+0000 7fc5d73ff700 1 -- 172.21.15.86:0/3640026287 shutdown_connections 2023-10-09T11:42:14.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.630+0000 7fc5d73ff700 1 -- 172.21.15.86:0/3640026287 wait complete. 2023-10-09T11:42:14.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.631+0000 7fc5d73ff700 1 Processor -- start 2023-10-09T11:42:14.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.631+0000 7fc5d73ff700 1 -- start start 2023-10-09T11:42:14.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d73ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d00a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d73ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5d00aeb00 0x7fc5d0167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d73ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d00b1850 0x7fc5d0167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d73ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00a7920 con 0x7fc5d00ae680 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d73ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00a7c00 con 0x7fc5d00b1850 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d73ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0168dc0 con 0x7fc5d00aeb00 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d519b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d00a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d519b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d00a6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39256/0 (socket says 172.21.15.86:39256) 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.632+0000 7fc5d519b700 1 -- 172.21.15.86:0/1784499354 learned_addr learned my addr 172.21.15.86:0/1784499354 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d519b700 1 -- 172.21.15.86:0/1784499354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5d00aeb00 msgr2=0x7fc5d0167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d519b700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5d00aeb00 0x7fc5d0167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d519b700 1 -- 172.21.15.86:0/1784499354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d00b1850 msgr2=0x7fc5d0167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d519b700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d00b1850 0x7fc5d0167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d519b700 1 -- 172.21.15.86:0/1784499354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00094f0 con 0x7fc5d00ae680 2023-10-09T11:42:14.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d519b700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d00a6e50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00d860 tx=0x7fc5cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5c57fa700 1 -- 172.21.15.86:0/1784499354 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0125f0 con 0x7fc5d00ae680 2023-10-09T11:42:14.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5c57fa700 1 -- 172.21.15.86:0/1784499354 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc012750 con 0x7fc5d00ae680 2023-10-09T11:42:14.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5c57fa700 1 -- 172.21.15.86:0/1784499354 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc012b10 con 0x7fc5d00ae680 2023-10-09T11:42:14.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d01690a0 con 0x7fc5d00ae680 2023-10-09T11:42:14.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.633+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d0150e50 con 0x7fc5d00ae680 2023-10-09T11:42:14.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.635+0000 7fc5c57fa700 1 -- 172.21.15.86:0/1784499354 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5cc01e460 con 0x7fc5d00ae680 2023-10-09T11:42:14.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.636+0000 7fc5c57fa700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc5b4066f30 0x7fc5b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.636+0000 7fc5c57fa700 1 -- 172.21.15.86:0/1784499354 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5cc084c90 con 0x7fc5d00ae680 2023-10-09T11:42:14.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.637+0000 7fc5d499a700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc5b4066f30 0x7fc5b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.637+0000 7fc5d499a700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc5b4066f30 0x7fc5b40693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00641e0 tx=0x7fc5c0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.638+0000 7fc5e5b31b80 1 Processor -- start 2023-10-09T11:42:14.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.638+0000 7fc5e5b31b80 1 -- start start 2023-10-09T11:42:14.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 0x5643ddc8be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddcb4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcb4f60 0x5643ddc87cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddbe2a70 con 0x5643ddcd5d00 2023-10-09T11:42:14.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddbe0270 con 0x5643ddc8ba50 2023-10-09T11:42:14.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643ddbdc060 con 0x5643ddcb4f60 2023-10-09T11:42:14.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5d499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddcb4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5d499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddcb4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39264/0 (socket says 172.21.15.86:39264) 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.639+0000 7fc5d499a700 1 -- 172.21.15.86:0/2727830226 learned_addr learned my addr 172.21.15.86:0/2727830226 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d519b700 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 0x5643ddc8be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d599c700 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcb4f60 0x5643ddc87cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d499a700 1 -- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcb4f60 msgr2=0x5643ddc87cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d499a700 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcb4f60 0x5643ddc87cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d499a700 1 -- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 msgr2=0x5643ddc8be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d499a700 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 0x5643ddc8be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d499a700 1 -- 172.21.15.86:0/2727830226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643dda76270 con 0x5643ddcd5d00 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d599c700 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcb4f60 0x5643ddc87cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5d499a700 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddcb4a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000bc80 tx=0x7fc5c001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89098a767e9f01dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5ba7fc700 1 -- 172.21.15.86:0/2727830226 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0011ac0 con 0x5643ddcd5d00 2023-10-09T11:42:14.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5ba7fc700 1 -- 172.21.15.86:0/2727830226 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0011c20 con 0x5643ddcd5d00 2023-10-09T11:42:14.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.640+0000 7fc5ba7fc700 1 -- 172.21.15.86:0/2727830226 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0011dd0 con 0x5643ddcd5d00 2023-10-09T11:42:14.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/2727830226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 msgr2=0x5643ddcb4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddcb4a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000bc80 tx=0x7fc5c001d040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/2727830226 shutdown_connections 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcb4f60 0x5643ddc87cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 0x5643ddc8be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/2727830226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddcb4a20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/2727830226 >> 172.21.15.86:0/2727830226 conn(0x5643ddc8d370 msgr2=0x5643ddc8d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/2727830226 shutdown_connections 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.641+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/2727830226 wait complete. 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.642+0000 7fc5e5b31b80 1 -- start start 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.642+0000 7fc5e5b31b80 1 Processor -- start 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddce2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddccbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddccc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddb87890 con 0x5643ddcd5d00 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddba2ea0 con 0x5643ddcb4f60 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643dda5ee30 con 0x5643ddc8ba50 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5e5b31b80 10 client.0 _ll_register_callbacks cb 0x5643ddc4f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5d599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddccc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5d599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddccc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39272/0 (socket says 172.21.15.86:39272) 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5d599c700 1 -- 172.21.15.86:0/545519019 learned_addr learned my addr 172.21.15.86:0/545519019 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5d499a700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddccbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.643+0000 7fc5d519b700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddce2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5d599c700 1 -- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 msgr2=0x5643ddce2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5d599c700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddce2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5d599c700 1 -- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 msgr2=0x5643ddccbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5d599c700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddccbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5d599c700 1 -- 172.21.15.86:0/545519019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c0021050 con 0x5643ddcd5d00 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5d499a700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddccbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5d599c700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddccc3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e640 tx=0x7fc5c8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe15ead8a99d13f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5af7fe700 1 -- 172.21.15.86:0/545519019 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80135f0 con 0x5643ddcd5d00 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5af7fe700 1 -- 172.21.15.86:0/545519019 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5c8013750 con 0x5643ddcd5d00 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643ddc80b70 con 0x5643ddcd5d00 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5af7fe700 1 -- 172.21.15.86:0/545519019 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c8001950 con 0x5643ddcd5d00 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5e5b31b80 10 client.5076 fetch_fsmap learned FSMap version 17 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.644+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5643dda18fe0 con 0x5643ddcd5d00 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5af7fe700 1 -- 172.21.15.86:0/545519019 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643ddc80b70 con 0x5643ddcd5d00 2023-10-09T11:42:14.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5af7fe700 1 -- 172.21.15.86:0/545519019 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc5c8013b20 con 0x5643ddcd5d00 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5e5b31b80 10 client.5076 fetch_fsmap finished waiting for FSMap version 17 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5e5b31b80 10 client.5076 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5e5b31b80 20 client.5076 populate_metadata read hostname 'smithi086' 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddce3020 0x5643ddcd5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5e5b31b80 4 client.5076 mds_command: new command op to 4890 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 --> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643ddc5daa0 con 0x5643ddce3020 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.645+0000 7fc5d519b700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddce3020 0x5643ddcd5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.646+0000 7fc5d519b700 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddce3020 0x5643ddcd5310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fa2a4c6df55d8a0 server_cookie=8df4b66ec219a498 in_seq=0 out_seq=0 2023-10-09T11:42:14.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.646+0000 7fc5af7fe700 10 client.5076 ms_handle_connect on v2:172.21.15.86:6835/1725825433 2023-10-09T11:42:14.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.646+0000 7fc5af7fe700 1 -- 172.21.15.86:0/545519019 <== mds.0 v2:172.21.15.86:6835/1725825433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x7fc5cc071250 con 0x5643ddce3020 2023-10-09T11:42:14.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.646+0000 7fc5af7fe700 10 client.5076 handle_command_reply: tid=0 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.646+0000 7fc5e5b31b80 1 client.5076 shutdown 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.646+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 msgr2=0x5643ddccc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.646+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddccc3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e640 tx=0x7fc5c8009040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 shutdown_connections 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddce3020 0x5643ddcd5310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddccc3b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddce2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5af7fe700 0 client.5076 ms_handle_reset on v2:172.21.15.86:6835/1725825433 2023-10-09T11:42:14.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/545519019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddccbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 >> 172.21.15.86:0/545519019 conn(0x5643ddc8d370 msgr2=0x5643ddc888f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 shutdown_connections 2023-10-09T11:42:14.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/545519019 wait complete. 2023-10-09T11:42:14.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.647+0000 7fc5e5b31b80 20 client.5076 trim_cache size 0 max 16384 2023-10-09T11:42:14.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.664+0000 7fc5e5b31b80 1 Processor -- start 2023-10-09T11:42:14.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.664+0000 7fc5e5b31b80 1 -- start start 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 0x5643ddc8d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcb4f60 0x5643ddcf32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcd5d00 0x5643ddcb4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddc8e000 con 0x5643ddcb4f60 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddc865a0 con 0x5643ddc8ba50 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643ddc8dc80 con 0x5643ddcd5d00 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcb4f60 0x5643ddcf32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcb4f60 0x5643ddcf32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39288/0 (socket says 172.21.15.86:39288) 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 -- 172.21.15.86:0/536195169 learned_addr learned my addr 172.21.15.86:0/536195169 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 -- 172.21.15.86:0/536195169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcd5d00 msgr2=0x5643ddcb4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 --2- 172.21.15.86:0/536195169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcd5d00 0x5643ddcb4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 -- 172.21.15.86:0/536195169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 msgr2=0x5643ddc8d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 --2- 172.21.15.86:0/536195169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 0x5643ddc8d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 -- 172.21.15.86:0/536195169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643ddbaa780 con 0x5643ddcb4f60 2023-10-09T11:42:14.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.665+0000 7fc5d499a700 1 --2- 172.21.15.86:0/536195169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcb4f60 0x5643ddcf32f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00094c0 tx=0x7fc5c0029070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43d8042726bd062 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5baffd700 1 -- 172.21.15.86:0/536195169 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000b860 con 0x5643ddcb4f60 2023-10-09T11:42:14.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5baffd700 1 -- 172.21.15.86:0/536195169 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0011d90 con 0x5643ddcb4f60 2023-10-09T11:42:14.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5baffd700 1 -- 172.21.15.86:0/536195169 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0030470 con 0x5643ddcb4f60 2023-10-09T11:42:14.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/536195169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcb4f60 msgr2=0x5643ddcf32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/536195169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcb4f60 0x5643ddcf32f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00094c0 tx=0x7fc5c0029070 comp rx=0 tx=0).stop 2023-10-09T11:42:14.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/536195169 shutdown_connections 2023-10-09T11:42:14.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/536195169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddcd5d00 0x5643ddcb4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/536195169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddc8ba50 0x5643ddc8d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/536195169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcb4f60 0x5643ddcf32f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/536195169 >> 172.21.15.86:0/536195169 conn(0x5643ddc8d370 msgr2=0x5643ddc844b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/536195169 shutdown_connections 2023-10-09T11:42:14.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.666+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/536195169 wait complete. 2023-10-09T11:42:14.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.667+0000 7fc5e5b31b80 1 -- start start 2023-10-09T11:42:14.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.667+0000 7fc5e5b31b80 1 Processor -- start 2023-10-09T11:42:14.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddcd1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddcc9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5e5b31b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddd2fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddccef90 con 0x5643ddcd5d00 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ddd3d790 con 0x5643ddcb4f60 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5e5b31b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643ddcc86f0 con 0x5643ddc8ba50 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5e5b31b80 10 client.0 _ll_register_callbacks cb 0x5643ddc4f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5d599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddd2fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5d599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddd2fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39292/0 (socket says 172.21.15.86:39292) 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5d599c700 1 -- 172.21.15.86:0/1880362604 learned_addr learned my addr 172.21.15.86:0/1880362604 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5d519b700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddcd1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.668+0000 7fc5d499a700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddcc9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5d599c700 1 -- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 msgr2=0x5643ddcd1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5d599c700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddcd1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5d599c700 1 -- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 msgr2=0x5643ddcc9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5d599c700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddcc9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5d599c700 1 -- 172.21.15.86:0/1880362604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643dda76270 con 0x5643ddcd5d00 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5d499a700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddcc9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5d599c700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddd2fcc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5643ddcd52e0 tx=0x7fc5c801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd248a3cdf75ae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5af7fe700 1 -- 172.21.15.86:0/1880362604 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8000f60 con 0x5643ddcd5d00 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5af7fe700 1 -- 172.21.15.86:0/1880362604 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5c80135f0 con 0x5643ddcd5d00 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5c0011c20 con 0x5643ddcd5d00 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5af7fe700 1 -- 172.21.15.86:0/1880362604 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c800e4c0 con 0x5643ddcd5d00 2023-10-09T11:42:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5e5b31b80 10 client.5082 fetch_fsmap learned FSMap version 17 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.669+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5643ddb91470 con 0x5643ddcd5d00 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5af7fe700 1 -- 172.21.15.86:0/1880362604 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0011c20 con 0x5643ddcd5d00 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5af7fe700 1 -- 172.21.15.86:0/1880362604 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc5c80145f0 con 0x5643ddcd5d00 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5e5b31b80 10 client.5082 fetch_fsmap finished waiting for FSMap version 17 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5e5b31b80 10 client.5082 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5e5b31b80 20 client.5082 populate_metadata read hostname 'smithi086' 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddcf1fe0 0x5643ddcf23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5e5b31b80 4 client.5082 mds_command: new command op to 4890 tid=0[{"prefix": "status"}] 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 --> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5643ddb7ee00 con 0x5643ddcf1fe0 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5d519b700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddcf1fe0 0x5643ddcf23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5af7fe700 10 client.5082 ms_handle_connect on v2:172.21.15.86:6835/1725825433 2023-10-09T11:42:14.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.670+0000 7fc5d519b700 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddcf1fe0 0x5643ddcf23b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecfce4926a14cf13 server_cookie=15c47b05d5bff9b7 in_seq=0 out_seq=0 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5af7fe700 1 -- 172.21.15.86:0/1880362604 <== mds.0 v2:172.21.15.86:6835/1725825433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5643ddb7ee00 con 0x5643ddcf1fe0 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5af7fe700 10 client.5082 handle_command_reply: tid=0 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 client.5082 shutdown 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 msgr2=0x5643ddd2fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddd2fcc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5643ddcd52e0 tx=0x7fc5c801f000 comp rx=0 tx=0).stop 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 shutdown_connections 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:6835/1725825433,v1:172.21.15.86:6837/1725825433] conn(0x5643ddcf1fe0 0x5643ddcf23b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5643ddcd5d00 0x5643ddd2fcc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5643ddc8ba50 0x5643ddcd1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5af7fe700 0 client.5082 ms_handle_reset on v2:172.21.15.86:6835/1725825433 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 --2- 172.21.15.86:0/1880362604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643ddcb4f60 0x5643ddcc9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 >> 172.21.15.86:0/1880362604 conn(0x5643ddc8d370 msgr2=0x5643ddd32880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 shutdown_connections 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 1 -- 172.21.15.86:0/1880362604 wait complete. 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.671+0000 7fc5e5b31b80 20 client.5082 trim_cache size 0 max 16384 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4890, 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T11:42:14.678 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T11:42:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T11:42:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 6.3637699899999998, 2023-10-09T11:42:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 17, 2023-10-09T11:42:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 35, 2023-10-09T11:42:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 35, 2023-10-09T11:42:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 15.199717211999999 2023-10-09T11:42:14.679 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc5b4066f30 msgr2=0x7fc5b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc5b4066f30 0x7fc5b40693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00641e0 tx=0x7fc5c0017000 comp rx=0 tx=0).stop 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 msgr2=0x7fc5d00a6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d00a6e50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00d860 tx=0x7fc5cc008040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 shutdown_connections 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc5b4066f30 0x7fc5b40693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d00ae680 0x7fc5d00a6e50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5d00b1850 0x7fc5d0167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 --2- 172.21.15.86:0/1784499354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5d00aeb00 0x7fc5d0167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 >> 172.21.15.86:0/1784499354 conn(0x7fc5d006a320 msgr2=0x7fc5d0153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 shutdown_connections 2023-10-09T11:42:14.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.672+0000 7fc5d73ff700 1 -- 172.21.15.86:0/1784499354 wait complete. 2023-10-09T11:42:14.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:42:14.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.869+0000 7fe990bff700 1 Processor -- start 2023-10-09T11:42:14.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.869+0000 7fe990bff700 1 -- start start 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe990bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe98c06bcd0 0x7fe98c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe990bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe98c15df50 0x7fe98c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe990bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c15d7e0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe990bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c15dac0 con 0x7fe98c15df50 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe990bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c15aa30 con 0x7fe98c06bcd0 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe98ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe98c15df50 0x7fe98c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe98ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe98c15df50 0x7fe98c15e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39306/0 (socket says 172.21.15.86:39306) 2023-10-09T11:42:14.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.870+0000 7fe98ad9d700 1 -- 172.21.15.86:0/764408395 learned_addr learned my addr 172.21.15.86:0/764408395 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98a59c700 1 --2- 172.21.15.86:0/764408395 >> v2:172.21.15.135:3300/0 conn(0x7fe98c06bcd0 0x7fe98c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98ad9d700 1 -- 172.21.15.86:0/764408395 >> v2:172.21.15.135:3300/0 conn(0x7fe98c06bcd0 msgr2=0x7fe98c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98ad9d700 1 --2- 172.21.15.86:0/764408395 >> v2:172.21.15.135:3300/0 conn(0x7fe98c06bcd0 0x7fe98c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98ad9d700 1 -- 172.21.15.86:0/764408395 >> v1:172.21.15.86:6789/0 conn(0x7fe98c06c0a0 legacy=0x7fe98c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98ad9d700 1 -- 172.21.15.86:0/764408395 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c15ad10 con 0x7fe98c15df50 2023-10-09T11:42:14.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98959a700 1 -- 172.21.15.86:0/764408395 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367167273 0 0) 0x7fe98c15d7e0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98ad9d700 1 --2- 172.21.15.86:0/764408395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c15df50 0x7fe98c15e3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0691a0 tx=0x7fe984009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dcc17ffcd72860 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98959a700 1 -- 172.21.15.86:0/764408395 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98400e070 con 0x7fe98c15df50 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98959a700 1 -- 172.21.15.86:0/764408395 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98400ba50 con 0x7fe98c15df50 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.871+0000 7fe98959a700 1 -- 172.21.15.86:0/764408395 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840092e0 con 0x7fe98c15df50 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 -- 172.21.15.86:0/764408395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c15df50 msgr2=0x7fe98c15e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 --2- 172.21.15.86:0/764408395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c15df50 0x7fe98c15e3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0691a0 tx=0x7fe984009840 comp rx=0 tx=0).stop 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 -- 172.21.15.86:0/764408395 shutdown_connections 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 --2- 172.21.15.86:0/764408395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c15df50 0x7fe98c15e3b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 --2- 172.21.15.86:0/764408395 >> v2:172.21.15.135:3300/0 conn(0x7fe98c06bcd0 0x7fe98c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 -- 172.21.15.86:0/764408395 >> 172.21.15.86:0/764408395 conn(0x7fe98c0ce600 msgr2=0x7fe98c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 -- 172.21.15.86:0/764408395 shutdown_connections 2023-10-09T11:42:14.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.872+0000 7fe990bff700 1 -- 172.21.15.86:0/764408395 wait complete. 2023-10-09T11:42:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.873+0000 7fe990bff700 1 Processor -- start 2023-10-09T11:42:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.874+0000 7fe990bff700 1 -- start start 2023-10-09T11:42:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.874+0000 7fe990bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98c06bcd0 0x7fe98c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.874+0000 7fe990bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c06c0a0 0x7fe98c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.874+0000 7fe990bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe98c15df50 0x7fe98c143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe990bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c16b310 con 0x7fe98c06c0a0 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe990bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0c83f0 con 0x7fe98c06bcd0 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe990bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0c86d0 con 0x7fe98c15df50 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c06c0a0 0x7fe98c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c06c0a0 0x7fe98c0c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39316/0 (socket says 172.21.15.86:39316) 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 -- 172.21.15.86:0/2566208696 learned_addr learned my addr 172.21.15.86:0/2566208696 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 -- 172.21.15.86:0/2566208696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe98c15df50 msgr2=0x7fe98c143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe98c15df50 0x7fe98c143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 -- 172.21.15.86:0/2566208696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98c06bcd0 msgr2=0x7fe98c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98c06bcd0 0x7fe98c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 -- 172.21.15.86:0/2566208696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984009ae0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe989d9b700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c06c0a0 0x7fe98c0c5800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe98000c5b0 tx=0x7fe980007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.875+0000 7fe97a7fc700 1 -- 172.21.15.86:0/2566208696 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980011590 con 0x7fe98c06c0a0 2023-10-09T11:42:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.876+0000 7fe97a7fc700 1 -- 172.21.15.86:0/2566208696 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe980011710 con 0x7fe98c06c0a0 2023-10-09T11:42:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.876+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c0c89b0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.876+0000 7fe97a7fc700 1 -- 172.21.15.86:0/2566208696 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980011ad0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.876+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c0c5d40 con 0x7fe98c06c0a0 2023-10-09T11:42:14.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.877+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c04c3c0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.878+0000 7fe97a7fc700 1 -- 172.21.15.86:0/2566208696 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe98001b3b0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.878+0000 7fe97a7fc700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe96c066f30 0x7fe96c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.878+0000 7fe97a7fc700 1 -- 172.21.15.86:0/2566208696 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9800839e0 con 0x7fe98c06c0a0 2023-10-09T11:42:14.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.879+0000 7fe98a59c700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe96c066f30 0x7fe96c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.879+0000 7fe98a59c700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe96c066f30 0x7fe96c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009a40 tx=0x7fe97c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:14.882+0000 7fe97a7fc700 1 -- 172.21.15.86:0/2566208696 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe980050c50 con 0x7fe98c06c0a0 2023-10-09T11:42:15.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.119+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe98c15aff0 con 0x7fe98c06c0a0 2023-10-09T11:42:15.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.119+0000 7fe97a7fc700 1 -- 172.21.15.86:0/2566208696 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe980017020 con 0x7fe98c06c0a0 2023-10-09T11:42:15.121 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:42:15.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe96c066f30 msgr2=0x7fe96c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe96c066f30 0x7fe96c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009a40 tx=0x7fe97c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c06c0a0 msgr2=0x7fe98c0c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c06c0a0 0x7fe98c0c5800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe98000c5b0 tx=0x7fe980007f60 comp rx=0 tx=0).stop 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 shutdown_connections 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe96c066f30 0x7fe96c0693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe98c15df50 0x7fe98c143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98c06bcd0 0x7fe98c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 --2- 172.21.15.86:0/2566208696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c06c0a0 0x7fe98c0c5800 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 >> 172.21.15.86:0/2566208696 conn(0x7fe98c0ce600 msgr2=0x7fe98c069480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 shutdown_connections 2023-10-09T11:42:15.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:15.122+0000 7fe990bff700 1 -- 172.21.15.86:0/2566208696 wait complete. 2023-10-09T11:42:15.140 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:42:15.141 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:15.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:15.142 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:42:15.178 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:42:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:42:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:42:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:15.178 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:15.179 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42208sec preferred_lft 42208sec 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:15.180 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:42:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T11:42:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:15.181 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:42:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T11:42:15.181 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:15.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:15.181 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:42:15.276 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:42:15.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:15.279 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:42:15.318 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:42:15.318 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:42:15.318 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:42:15.318 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:42:15.318 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:42:15.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:15.319 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:42:15.319 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:42:15.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:42:15.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:42:15.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:42:15.320 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:42:15.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:15.514 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:42:15.549 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:42:15.549 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:42:15.550 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:15.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:15.550 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T11:42:15.651 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:15.651 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:15.687 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:15.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:15.687 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:15.762 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:42:15.763 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:42:15.763 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:15.892 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:15.892 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:15.919 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:15.920 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:15.920 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:42:15.920 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:42:15.920 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:42:15.924 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:42:15.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:15.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:15.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:42:16.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.164+0000 7f8c419ff700 1 Processor -- start 2023-10-09T11:42:16.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.164+0000 7f8c419ff700 1 -- start start 2023-10-09T11:42:16.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.165+0000 7f8c419ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c3c0cbf30 0x7f8c3c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.165+0000 7f8c419ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0ccf90 0x7f8c3c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.165+0000 7f8c419ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c3c15a270 0x7f8c3c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.165+0000 7f8c419ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c156bf0 con 0x7f8c3c15a270 2023-10-09T11:42:16.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.165+0000 7f8c419ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0ae950 con 0x7f8c3c0cbf30 2023-10-09T11:42:16.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.165+0000 7f8c419ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0cc300 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c3c15a270 0x7f8c3c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c3c15a270 0x7f8c3c0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39056/0 (socket says 172.21.15.86:39056) 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 -- 172.21.15.86:0/3983230807 learned_addr learned my addr 172.21.15.86:0/3983230807 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3a7fc700 1 --2- 172.21.15.86:0/3983230807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0ccf90 0x7f8c3c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3affd700 1 --2- 172.21.15.86:0/3983230807 >> v2:172.21.15.135:3300/0 conn(0x7f8c3c0cbf30 0x7f8c3c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 -- 172.21.15.86:0/3983230807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0ccf90 msgr2=0x7f8c3c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 --2- 172.21.15.86:0/3983230807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0ccf90 0x7f8c3c0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 -- 172.21.15.86:0/3983230807 >> v2:172.21.15.135:3300/0 conn(0x7f8c3c0cbf30 msgr2=0x7f8c3c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 --2- 172.21.15.86:0/3983230807 >> v2:172.21.15.135:3300/0 conn(0x7f8c3c0cbf30 0x7f8c3c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 -- 172.21.15.86:0/3983230807 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0ad370 con 0x7f8c3c15a270 2023-10-09T11:42:16.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3affd700 1 --2- 172.21.15.86:0/3983230807 >> v2:172.21.15.135:3300/0 conn(0x7f8c3c0cbf30 0x7f8c3c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:16.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.166+0000 7f8c3b7fe700 1 --2- 172.21.15.86:0/3983230807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c15a270 0x7f8c3c0b1250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c063d40 tx=0x7f8c34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b511620e3c4acce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c39ffb700 1 -- 172.21.15.86:0/3983230807 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400e070 con 0x7f8c3c15a270 2023-10-09T11:42:16.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c39ffb700 1 -- 172.21.15.86:0/3983230807 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3400b990 con 0x7f8c3c15a270 2023-10-09T11:42:16.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c39ffb700 1 -- 172.21.15.86:0/3983230807 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340092e0 con 0x7f8c3c15a270 2023-10-09T11:42:16.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 -- 172.21.15.86:0/3983230807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c15a270 msgr2=0x7f8c3c0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 --2- 172.21.15.86:0/3983230807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c15a270 0x7f8c3c0b1250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c063d40 tx=0x7f8c34009840 comp rx=0 tx=0).stop 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 -- 172.21.15.86:0/3983230807 shutdown_connections 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 --2- 172.21.15.86:0/3983230807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c15a270 0x7f8c3c0b1250 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 --2- 172.21.15.86:0/3983230807 >> v2:172.21.15.135:3300/0 conn(0x7f8c3c0cbf30 0x7f8c3c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 --2- 172.21.15.86:0/3983230807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0ccf90 0x7f8c3c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 -- 172.21.15.86:0/3983230807 >> 172.21.15.86:0/3983230807 conn(0x7f8c3c06a320 msgr2=0x7f8c3c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 -- 172.21.15.86:0/3983230807 shutdown_connections 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.167+0000 7f8c419ff700 1 -- 172.21.15.86:0/3983230807 wait complete. 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.169+0000 7f8c419ff700 1 Processor -- start 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.169+0000 7f8c419ff700 1 -- start start 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c419ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0cbf30 0x7f8c3c169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c419ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c0ccf90 0x7f8c3c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c419ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c3c15a270 0x7f8c3c06e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c419ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c1554e0 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c419ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c158510 con 0x7f8c3c15a270 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c419ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c159090 con 0x7f8c3c0cbf30 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c0ccf90 0x7f8c3c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c0ccf90 0x7f8c3c154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39062/0 (socket says 172.21.15.86:39062) 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 -- 172.21.15.86:0/1598509504 learned_addr learned my addr 172.21.15.86:0/1598509504 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3affd700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0cbf30 0x7f8c3c169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3b7fe700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c3c15a270 0x7f8c3c06e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 -- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0cbf30 msgr2=0x7f8c3c169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0cbf30 0x7f8c3c169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 -- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c3c15a270 msgr2=0x7f8c3c06e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c3c15a270 0x7f8c3c06e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3a7fc700 1 -- 172.21.15.86:0/1598509504 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34009ae0 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.170+0000 7f8c3b7fe700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c3c15a270 0x7f8c3c06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.171+0000 7f8c3a7fc700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c0ccf90 0x7f8c3c154850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000ec80 tx=0x7f8c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.171+0000 7f8c22ffd700 1 -- 172.21.15.86:0/1598509504 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000c9d0 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.171+0000 7f8c22ffd700 1 -- 172.21.15.86:0/1598509504 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000cb50 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.171+0000 7f8c22ffd700 1 -- 172.21.15.86:0/1598509504 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30013470 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.171+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c158760 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.171+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c158d20 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.172+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c169f00 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.173+0000 7f8c22ffd700 1 -- 172.21.15.86:0/1598509504 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c30013860 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.175+0000 7f8c22ffd700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8c28066f30 0x7f8c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.175+0000 7f8c22ffd700 1 -- 172.21.15.86:0/1598509504 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c300849b0 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.175+0000 7f8c3affd700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8c28066f30 0x7f8c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.175+0000 7f8c3affd700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8c28066f30 0x7f8c280693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c006f00 tx=0x7f8c2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.178+0000 7f8c22ffd700 1 -- 172.21.15.86:0/1598509504 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c30051b80 con 0x7f8c3c0ccf90 2023-10-09T11:42:16.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.400+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c3c04c3c0 con 0x7f8c28066f30 2023-10-09T11:42:16.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.402+0000 7f8c22ffd700 1 -- 172.21.15.86:0/1598509504 <== mgr.4104 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8c3c04c3c0 con 0x7f8c28066f30 2023-10-09T11:42:16.404 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:42:16.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:42:16.404 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T11:42:16.404 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:42:16.404 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:42:16.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8c28066f30 msgr2=0x7f8c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8c28066f30 0x7f8c280693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c006f00 tx=0x7f8c2c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:16.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c0ccf90 msgr2=0x7f8c3c154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c0ccf90 0x7f8c3c154850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000ec80 tx=0x7f8c300091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 shutdown_connections 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8c28066f30 0x7f8c280693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c3c15a270 0x7f8c3c06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c3c0cbf30 0x7f8c3c169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 --2- 172.21.15.86:0/1598509504 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c3c0ccf90 0x7f8c3c154850 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 >> 172.21.15.86:0/1598509504 conn(0x7f8c3c06a320 msgr2=0x7f8c3c15ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 shutdown_connections 2023-10-09T11:42:16.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.404+0000 7f8c419ff700 1 -- 172.21.15.86:0/1598509504 wait complete. 2023-10-09T11:42:16.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T11:42:16.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.605+0000 7fc93cdff700 1 Processor -- start 2023-10-09T11:42:16.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.605+0000 7fc93cdff700 1 -- start start 2023-10-09T11:42:16.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.606+0000 7fc93cdff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc9380c70b0 0x7fc938069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc93cdff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc938069cb0 0x7fc9380ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc93cdff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93806e950 con 0x7fc938155eb0 2023-10-09T11:42:16.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc93cdff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93806a130 con 0x7fc9380c70b0 2023-10-09T11:42:16.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc93cdff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93806eb90 con 0x7fc938069cb0 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc935d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc9380c70b0 0x7fc938069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc935d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc9380c70b0 0x7fc938069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39078/0 (socket says 172.21.15.86:39078) 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc935d9b700 1 -- 172.21.15.86:0/2279238976 learned_addr learned my addr 172.21.15.86:0/2279238976 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc936d9d700 1 --2- 172.21.15.86:0/2279238976 >> v2:172.21.15.135:3300/0 conn(0x7fc938069cb0 0x7fc9380ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc935d9b700 1 -- 172.21.15.86:0/2279238976 >> v2:172.21.15.135:3300/0 conn(0x7fc938069cb0 msgr2=0x7fc9380ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc935d9b700 1 --2- 172.21.15.86:0/2279238976 >> v2:172.21.15.135:3300/0 conn(0x7fc938069cb0 0x7fc9380ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc935d9b700 1 -- 172.21.15.86:0/2279238976 >> v1:172.21.15.135:6789/0 conn(0x7fc938155eb0 legacy=0x7fc93806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.607+0000 7fc935d9b700 1 -- 172.21.15.86:0/2279238976 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93806ee70 con 0x7fc9380c70b0 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc935d9b700 1 --2- 172.21.15.86:0/2279238976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9380c70b0 0x7fc938069770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc9380cc450 tx=0x7fc92c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef495040af45fbba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93559a700 1 -- 172.21.15.86:0/2279238976 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00dc50 con 0x7fc9380c70b0 2023-10-09T11:42:16.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93559a700 1 -- 172.21.15.86:0/2279238976 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c00ddb0 con 0x7fc9380c70b0 2023-10-09T11:42:16.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93559a700 1 -- 172.21.15.86:0/2279238976 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0196d0 con 0x7fc9380c70b0 2023-10-09T11:42:16.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 -- 172.21.15.86:0/2279238976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9380c70b0 msgr2=0x7fc938069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 --2- 172.21.15.86:0/2279238976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9380c70b0 0x7fc938069770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc9380cc450 tx=0x7fc92c00b4f0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 -- 172.21.15.86:0/2279238976 shutdown_connections 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 --2- 172.21.15.86:0/2279238976 >> v2:172.21.15.135:3300/0 conn(0x7fc938069cb0 0x7fc9380ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 --2- 172.21.15.86:0/2279238976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9380c70b0 0x7fc938069770 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 -- 172.21.15.86:0/2279238976 >> 172.21.15.86:0/2279238976 conn(0x7fc938068e10 msgr2=0x7fc9380cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 -- 172.21.15.86:0/2279238976 shutdown_connections 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.608+0000 7fc93cdff700 1 -- 172.21.15.86:0/2279238976 wait complete. 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.610+0000 7fc93cdff700 1 Processor -- start 2023-10-09T11:42:16.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.610+0000 7fc93cdff700 1 -- start start 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93cdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc938069cb0 0x7fc938165c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93cdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9380c70b0 0x7fc9380c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93cdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc938155eb0 0x7fc9381509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93cdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380abcf0 con 0x7fc938155eb0 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93cdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc938166260 con 0x7fc938069cb0 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93cdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc938166540 con 0x7fc9380c70b0 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc938155eb0 0x7fc9381509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc938155eb0 0x7fc9381509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39086/0 (socket says 172.21.15.86:39086) 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 -- 172.21.15.86:0/3190898228 learned_addr learned my addr 172.21.15.86:0/3190898228 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93659c700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc938069cb0 0x7fc938165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc935d9b700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9380c70b0 0x7fc9380c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 -- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9380c70b0 msgr2=0x7fc9380c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9380c70b0 0x7fc9380c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 -- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc938069cb0 msgr2=0x7fc938165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc938069cb0 0x7fc938165c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc936d9d700 1 -- 172.21.15.86:0/3190898228 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c00b790 con 0x7fc938155eb0 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.611+0000 7fc93659c700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc938069cb0 0x7fc938165c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.612+0000 7fc936d9d700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc938155eb0 0x7fc9381509f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc930009fa0 tx=0x7fc930009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.612+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93000ed20 con 0x7fc938155eb0 2023-10-09T11:42:16.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.612+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93000ee80 con 0x7fc938155eb0 2023-10-09T11:42:16.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.612+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930014670 con 0x7fc938155eb0 2023-10-09T11:42:16.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.612+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc938166820 con 0x7fc938155eb0 2023-10-09T11:42:16.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.612+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9380c4780 con 0x7fc938155eb0 2023-10-09T11:42:16.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.613+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9380abe60 con 0x7fc938155eb0 2023-10-09T11:42:16.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.614+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9300149e0 con 0x7fc938155eb0 2023-10-09T11:42:16.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.615+0000 7fc9267fc700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc918066f30 0x7fc9180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.615+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc930084d50 con 0x7fc938155eb0 2023-10-09T11:42:16.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.615+0000 7fc93659c700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc918066f30 0x7fc9180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.616+0000 7fc93659c700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc918066f30 0x7fc9180693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc928007fd0 tx=0x7fc928009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.619+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc930051f20 con 0x7fc938155eb0 2023-10-09T11:42:16.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:16.862+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc93804c3c0 con 0x7fc938155eb0 2023-10-09T11:42:17.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.593+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fc930012dc0 con 0x7fc938155eb0 2023-10-09T11:42:17.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.594+0000 7fc9267fc700 1 -- 172.21.15.86:0/3190898228 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc9300559b0 con 0x7fc938155eb0 2023-10-09T11:42:17.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc918066f30 msgr2=0x7fc9180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc918066f30 0x7fc9180693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc928007fd0 tx=0x7fc928009040 comp rx=0 tx=0).stop 2023-10-09T11:42:17.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc938155eb0 msgr2=0x7fc9381509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc938155eb0 0x7fc9381509f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc930009fa0 tx=0x7fc930009900 comp rx=0 tx=0).stop 2023-10-09T11:42:17.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 shutdown_connections 2023-10-09T11:42:17.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc918066f30 0x7fc9180693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc938155eb0 0x7fc9381509f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc938069cb0 0x7fc938165c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 --2- 172.21.15.86:0/3190898228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9380c70b0 0x7fc9380c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 >> 172.21.15.86:0/3190898228 conn(0x7fc938068e10 msgr2=0x7fc938154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:17.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 shutdown_connections 2023-10-09T11:42:17.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.597+0000 7fc93cdff700 1 -- 172.21.15.86:0/3190898228 wait complete. 2023-10-09T11:42:17.618 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T11:42:17.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.808+0000 7fe2f519d700 1 Processor -- start 2023-10-09T11:42:17.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.808+0000 7fe2f519d700 1 -- start start 2023-10-09T11:42:17.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2f519d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2f00b4e70 0x7fe2f00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2f519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2f519d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f00cfb00 con 0x7fe2f00b16d0 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2f519d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00b5c40 con 0x7fe2f00b4e70 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2f519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b5f20 con 0x7fe2f00b1b40 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2effff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2f00b4e70 0x7fe2f00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2effff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2f00b4e70 0x7fe2f00ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39108/0 (socket says 172.21.15.86:39108) 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2effff700 1 -- 172.21.15.86:0/1600153522 learned_addr learned my addr 172.21.15.86:0/1600153522 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2f499c700 1 --2- 172.21.15.86:0/1600153522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2effff700 1 -- 172.21.15.86:0/1600153522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 msgr2=0x7fe2f015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2effff700 1 --2- 172.21.15.86:0/1600153522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2effff700 1 -- 172.21.15.86:0/1600153522 >> v1:172.21.15.135:6789/0 conn(0x7fe2f00b16d0 legacy=0x7fe2f015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.810+0000 7fe2effff700 1 -- 172.21.15.86:0/1600153522 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00b6200 con 0x7fe2f00b4e70 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.811+0000 7fe2effff700 1 --2- 172.21.15.86:0/1600153522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b4e70 0x7fe2f00ccff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00099b0 tx=0x7fe2e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98403750df1a07c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.811+0000 7fe2eeffd700 1 -- 172.21.15.86:0/1600153522 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0009ea0 con 0x7fe2f00b4e70 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.811+0000 7fe2eeffd700 1 -- 172.21.15.86:0/1600153522 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000b860 con 0x7fe2f00b4e70 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.811+0000 7fe2eeffd700 1 -- 172.21.15.86:0/1600153522 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000bc00 con 0x7fe2f00b4e70 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 -- 172.21.15.86:0/1600153522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b4e70 msgr2=0x7fe2f00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 --2- 172.21.15.86:0/1600153522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b4e70 0x7fe2f00ccff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00099b0 tx=0x7fe2e0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 -- 172.21.15.86:0/1600153522 shutdown_connections 2023-10-09T11:42:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 --2- 172.21.15.86:0/1600153522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 --2- 172.21.15.86:0/1600153522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b4e70 0x7fe2f00ccff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 -- 172.21.15.86:0/1600153522 >> 172.21.15.86:0/1600153522 conn(0x7fe2f00d10c0 msgr2=0x7fe2f00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 -- 172.21.15.86:0/1600153522 shutdown_connections 2023-10-09T11:42:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.812+0000 7fe2f519d700 1 -- 172.21.15.86:0/1600153522 wait complete. 2023-10-09T11:42:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.813+0000 7fe2f519d700 1 Processor -- start 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.813+0000 7fe2f519d700 1 -- start start 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2f519d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b16d0 0x7fe2f00c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2f519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f00cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2f519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00b4e70 0x7fe2f00cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2f519d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00c86d0 con 0x7fe2f00b16d0 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2f519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00c89b0 con 0x7fe2f00b4e70 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2f519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00c8c90 con 0x7fe2f00b1b40 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2effff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b16d0 0x7fe2f00c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2effff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b16d0 0x7fe2f00c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39114/0 (socket says 172.21.15.86:39114) 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.814+0000 7fe2effff700 1 -- 172.21.15.86:0/772630663 learned_addr learned my addr 172.21.15.86:0/772630663 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:17.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2f499c700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00b4e70 0x7fe2f00cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2ef7fe700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f00cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2effff700 1 -- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 msgr2=0x7fe2f00cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2effff700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f00cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2effff700 1 -- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00b4e70 msgr2=0x7fe2f00cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2effff700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00b4e70 0x7fe2f00cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2effff700 1 -- 172.21.15.86:0/772630663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00094f0 con 0x7fe2f00b16d0 2023-10-09T11:42:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2effff700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b16d0 0x7fe2f00c7e30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0070dd0 tx=0x7fe2e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.815+0000 7fe2d7fff700 1 -- 172.21.15.86:0/772630663 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0000d10 con 0x7fe2f00b16d0 2023-10-09T11:42:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.816+0000 7fe2d7fff700 1 -- 172.21.15.86:0/772630663 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000bbe0 con 0x7fe2f00b16d0 2023-10-09T11:42:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.816+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f016b2c0 con 0x7fe2f00b16d0 2023-10-09T11:42:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.816+0000 7fe2d7fff700 1 -- 172.21.15.86:0/772630663 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0011670 con 0x7fe2f00b16d0 2023-10-09T11:42:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.816+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f016abc0 con 0x7fe2f00b16d0 2023-10-09T11:42:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.817+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f016b120 con 0x7fe2f00b16d0 2023-10-09T11:42:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.818+0000 7fe2d7fff700 1 -- 172.21.15.86:0/772630663 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fe2e0011aa0 con 0x7fe2f00b16d0 2023-10-09T11:42:17.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.819+0000 7fe2d7fff700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 0x7fe2dc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.819+0000 7fe2ef7fe700 1 -- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 msgr2=0x7fe2dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:17.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.819+0000 7fe2d7fff700 1 -- 172.21.15.86:0/772630663 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2e0085d80 con 0x7fe2f00b16d0 2023-10-09T11:42:17.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.819+0000 7fe2ef7fe700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 0x7fe2dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:42:17.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:17.823+0000 7fe2d7fff700 1 -- 172.21.15.86:0/772630663 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2f016b120 con 0x7fe2f00b16d0 2023-10-09T11:42:18.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.020+0000 7fe2ef7fe700 1 -- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 msgr2=0x7fe2dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:18.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.020+0000 7fe2ef7fe700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 0x7fe2dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:42:18.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.023+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe2f016b500 con 0x7fe2f00b16d0 2023-10-09T11:42:18.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.027+0000 7fe2d7fff700 1 -- 172.21.15.86:0/772630663 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe2f016b500 con 0x7fe2f00b16d0 2023-10-09T11:42:18.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 msgr2=0x7fe2dc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:42:18.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 0x7fe2dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b16d0 msgr2=0x7fe2f00c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b16d0 0x7fe2f00c7e30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0070dd0 tx=0x7fe2e0017000 comp rx=0 tx=0).stop 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 shutdown_connections 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe2dc066f80 0x7fe2dc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2f00b16d0 0x7fe2f00c7e30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2f00b4e70 0x7fe2f00cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 --2- 172.21.15.86:0/772630663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2f00b1b40 0x7fe2f00cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.029+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 >> 172.21.15.86:0/772630663 conn(0x7fe2f00d10c0 msgr2=0x7fe2f015c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.030+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 shutdown_connections 2023-10-09T11:42:18.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.030+0000 7fe2f519d700 1 -- 172.21.15.86:0/772630663 wait complete. 2023-10-09T11:42:18.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T11:42:18.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.235+0000 7f4ec8f9d700 1 Processor -- start 2023-10-09T11:42:18.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.235+0000 7f4ec8f9d700 1 -- start start 2023-10-09T11:42:18.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.237+0000 7f4ec8f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ec4159a60 0x7f4ec40c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec8f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4ec40cb230 0x7f4ec40cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec8f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40cbb90 con 0x7f4ec40ccc00 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec8f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec406dfc0 con 0x7f4ec4159a60 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec8f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40c9cb0 con 0x7f4ec40cb230 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ec4159a60 0x7f4ec40c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ec4159a60 0x7f4ec40c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39126/0 (socket says 172.21.15.86:39126) 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec37fe700 1 -- 172.21.15.86:0/2003543080 learned_addr learned my addr 172.21.15.86:0/2003543080 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec2ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4ec40ccc00 0x7f4ec4069ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56414/0 (socket says 172.21.15.86:56414) 2023-10-09T11:42:18.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec3fff700 1 --2- 172.21.15.86:0/2003543080 >> v2:172.21.15.135:3300/0 conn(0x7f4ec40cb230 0x7f4ec40cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec37fe700 1 -- 172.21.15.86:0/2003543080 >> v2:172.21.15.135:3300/0 conn(0x7f4ec40cb230 msgr2=0x7f4ec40cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec37fe700 1 --2- 172.21.15.86:0/2003543080 >> v2:172.21.15.135:3300/0 conn(0x7f4ec40cb230 0x7f4ec40cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec37fe700 1 -- 172.21.15.86:0/2003543080 >> v1:172.21.15.86:6789/0 conn(0x7f4ec40ccc00 legacy=0x7f4ec4069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec37fe700 1 -- 172.21.15.86:0/2003543080 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40c9f30 con 0x7f4ec4159a60 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.238+0000 7f4ec27fc700 1 -- 172.21.15.86:0/2003543080 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879934192 0 0) 0x7f4ec40cbb90 con 0x7f4ec40ccc00 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.239+0000 7f4ec37fe700 1 --2- 172.21.15.86:0/2003543080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c9770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40cc410 tx=0x7f4eb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac021ff6cefdf09 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.239+0000 7f4ec27fc700 1 -- 172.21.15.86:0/2003543080 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4009e70 con 0x7f4ec4159a60 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.239+0000 7f4ec27fc700 1 -- 172.21.15.86:0/2003543080 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb400b8f0 con 0x7f4ec4159a60 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.239+0000 7f4ec27fc700 1 -- 172.21.15.86:0/2003543080 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400bc90 con 0x7f4ec4159a60 2023-10-09T11:42:18.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.239+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/2003543080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 msgr2=0x7f4ec40c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.239+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/2003543080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c9770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40cc410 tx=0x7f4eb4009250 comp rx=0 tx=0).stop 2023-10-09T11:42:18.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.239+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/2003543080 shutdown_connections 2023-10-09T11:42:18.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.240+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/2003543080 >> v2:172.21.15.135:3300/0 conn(0x7f4ec40cb230 0x7f4ec40cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.240+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/2003543080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c9770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.240+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/2003543080 >> 172.21.15.86:0/2003543080 conn(0x7f4ec406baa0 msgr2=0x7f4ec406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.240+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/2003543080 shutdown_connections 2023-10-09T11:42:18.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.240+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/2003543080 wait complete. 2023-10-09T11:42:18.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.241+0000 7f4ec8f9d700 1 Processor -- start 2023-10-09T11:42:18.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.241+0000 7f4ec8f9d700 1 -- start start 2023-10-09T11:42:18.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec8f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ec40cb230 0x7f4ec4144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec8f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ec40ccc00 0x7f4ec40c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec8f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec8f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40a9960 con 0x7f4ec4159a60 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec8f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40c7de0 con 0x7f4ec40ccc00 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec8f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40c5a00 con 0x7f4ec40cb230 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39130/0 (socket says 172.21.15.86:39130) 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec3fff700 1 -- 172.21.15.86:0/4115769940 learned_addr learned my addr 172.21.15.86:0/4115769940 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec2ffd700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ec40ccc00 0x7f4ec40c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.242+0000 7f4ec37fe700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ec40cb230 0x7f4ec4144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec3fff700 1 -- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ec40cb230 msgr2=0x7f4ec4144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec3fff700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ec40cb230 0x7f4ec4144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec3fff700 1 -- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ec40ccc00 msgr2=0x7f4ec40c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec3fff700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ec40ccc00 0x7f4ec40c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec3fff700 1 -- 172.21.15.86:0/4115769940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40094f0 con 0x7f4ec4159a60 2023-10-09T11:42:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec3fff700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c6b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009e90 tx=0x7f4ebc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4eab7fe700 1 -- 172.21.15.86:0/4115769940 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00cc00 con 0x7f4ec4159a60 2023-10-09T11:42:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4eab7fe700 1 -- 172.21.15.86:0/4115769940 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc00f040 con 0x7f4ec4159a60 2023-10-09T11:42:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec4145200 con 0x7f4ec4159a60 2023-10-09T11:42:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4eab7fe700 1 -- 172.21.15.86:0/4115769940 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc014480 con 0x7f4ec4159a60 2023-10-09T11:42:18.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.243+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec40c74b0 con 0x7f4ec4159a60 2023-10-09T11:42:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.244+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40c7f90 con 0x7f4ec4159a60 2023-10-09T11:42:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.245+0000 7f4eab7fe700 1 -- 172.21.15.86:0/4115769940 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f4ebc014830 con 0x7f4ec4159a60 2023-10-09T11:42:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.246+0000 7f4eab7fe700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 0x7f4eb0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.247+0000 7f4ec37fe700 1 -- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 msgr2=0x7f4eb0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.247+0000 7f4eab7fe700 1 -- 172.21.15.86:0/4115769940 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ebc085310 con 0x7f4ec4159a60 2023-10-09T11:42:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.247+0000 7f4ec37fe700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 0x7f4eb0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:42:18.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.251+0000 7f4eab7fe700 1 -- 172.21.15.86:0/4115769940 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ec40c7f90 con 0x7f4ec4159a60 2023-10-09T11:42:18.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.448+0000 7f4ec37fe700 1 -- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 msgr2=0x7f4eb0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:18.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.448+0000 7f4ec37fe700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 0x7f4eb0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:42:18.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.451+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f4ec40c7f50 con 0x7f4ec4159a60 2023-10-09T11:42:18.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.455+0000 7f4eab7fe700 1 -- 172.21.15.86:0/4115769940 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4ebc055f70 con 0x7f4ec4159a60 2023-10-09T11:42:18.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.457+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 msgr2=0x7f4eb0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:42:18.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.457+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 0x7f4eb0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.457+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 msgr2=0x7f4ec40c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.457+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c6b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009e90 tx=0x7f4ebc00b040 comp rx=0 tx=0).stop 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 shutdown_connections 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4eb0066f80 0x7f4eb0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ec4159a60 0x7f4ec40c6b70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ec40cb230 0x7f4ec4144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 --2- 172.21.15.86:0/4115769940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ec40ccc00 0x7f4ec40c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 >> 172.21.15.86:0/4115769940 conn(0x7f4ec406baa0 msgr2=0x7f4ec415a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 shutdown_connections 2023-10-09T11:42:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.458+0000 7f4ec8f9d700 1 -- 172.21.15.86:0/4115769940 wait complete. 2023-10-09T11:42:18.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:18.477 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T11:42:18.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:18.522 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-10-09T11:42:18.601 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T11:42:18.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.830+0000 7f4274f9d700 1 Processor -- start 2023-10-09T11:42:18.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.830+0000 7f4274f9d700 1 -- start start 2023-10-09T11:42:18.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.831+0000 7f4274f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42700b03c0 0x7f42700cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.831+0000 7f4274f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42700b0790 0x7f42700b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f4274f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42700cfa00 con 0x7f42701591e0 2023-10-09T11:42:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f4274f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700cb580 con 0x7f42700b0790 2023-10-09T11:42:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f4274f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42700b2de0 con 0x7f42700b03c0 2023-10-09T11:42:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f426ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f42701591e0 0x7f4270159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56422/0 (socket says 172.21.15.86:56422) 2023-10-09T11:42:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f426ffff700 1 -- 172.21.15.86:0/1969953198 learned_addr learned my addr 172.21.15.86:0/1969953198 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f426f7fe700 1 --2- 172.21.15.86:0/1969953198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42700b03c0 0x7f42700cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f426effd700 1 --2- 172.21.15.86:0/1969953198 >> v2:172.21.15.135:3300/0 conn(0x7f42700b0790 0x7f42700b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f426e7fc700 1 -- 172.21.15.86:0/1969953198 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325747431 0 0) 0x7f42700cfa00 con 0x7f42701591e0 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.832+0000 7f426e7fc700 1 -- 172.21.15.86:0/1969953198 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4258003570 con 0x7f42701591e0 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426f7fe700 1 -- 172.21.15.86:0/1969953198 >> v2:172.21.15.135:3300/0 conn(0x7f42700b0790 msgr2=0x7f42700b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426f7fe700 1 --2- 172.21.15.86:0/1969953198 >> v2:172.21.15.135:3300/0 conn(0x7f42700b0790 0x7f42700b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426f7fe700 1 -- 172.21.15.86:0/1969953198 >> v1:172.21.15.86:6789/0 conn(0x7f42701591e0 legacy=0x7f4270159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426f7fe700 1 -- 172.21.15.86:0/1969953198 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700cf160 con 0x7f42700b03c0 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426effd700 1 --2- 172.21.15.86:0/1969953198 >> v2:172.21.15.135:3300/0 conn(0x7f42700b0790 0x7f42700b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:18.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426f7fe700 1 --2- 172.21.15.86:0/1969953198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42700b03c0 0x7f42700cea70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42600098e0 tx=0x7f42600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5e8cac615348d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426e7fc700 1 -- 172.21.15.86:0/1969953198 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011630 con 0x7f42700b03c0 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426e7fc700 1 -- 172.21.15.86:0/1969953198 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260011790 con 0x7f42700b03c0 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.833+0000 7f426e7fc700 1 -- 172.21.15.86:0/1969953198 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011b30 con 0x7f42700b03c0 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 -- 172.21.15.86:0/1969953198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42700b03c0 msgr2=0x7f42700cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 --2- 172.21.15.86:0/1969953198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42700b03c0 0x7f42700cea70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42600098e0 tx=0x7f42600091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 -- 172.21.15.86:0/1969953198 shutdown_connections 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 --2- 172.21.15.86:0/1969953198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42700b03c0 0x7f42700cea70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 --2- 172.21.15.86:0/1969953198 >> v2:172.21.15.135:3300/0 conn(0x7f42700b0790 0x7f42700b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 -- 172.21.15.86:0/1969953198 >> 172.21.15.86:0/1969953198 conn(0x7f4270063230 msgr2=0x7f4270063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 -- 172.21.15.86:0/1969953198 shutdown_connections 2023-10-09T11:42:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.834+0000 7f4274f9d700 1 -- 172.21.15.86:0/1969953198 wait complete. 2023-10-09T11:42:18.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.835+0000 7f4274f9d700 1 Processor -- start 2023-10-09T11:42:18.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.836+0000 7f4274f9d700 1 -- start start 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.836+0000 7f4274f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42700b03c0 0x7f4270157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.836+0000 7f4274f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700b0790 0x7f427015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.836+0000 7f4274f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42701591e0 0x7f427015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.836+0000 7f4274f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270159dc0 con 0x7f42700b0790 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.836+0000 7f4274f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427015ac20 con 0x7f42700b03c0 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.836+0000 7f4274f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427015a010 con 0x7f42701591e0 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700b0790 0x7f427015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42700b03c0 0x7f4270157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700b0790 0x7f427015b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39138/0 (socket says 172.21.15.86:39138) 2023-10-09T11:42:18.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426effd700 1 -- 172.21.15.86:0/2899734627 learned_addr learned my addr 172.21.15.86:0/2899734627 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426ffff700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42701591e0 0x7f427015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426f7fe700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42701591e0 msgr2=0x7f427015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426f7fe700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42701591e0 0x7f427015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426f7fe700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700b0790 msgr2=0x7f427015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426f7fe700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700b0790 0x7f427015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426f7fe700 1 -- 172.21.15.86:0/2899734627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009420 con 0x7f42700b03c0 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700b0790 0x7f427015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.837+0000 7f426f7fe700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42700b03c0 0x7f4270157ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4260016000 tx=0x7f4260017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.838+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011900 con 0x7f42700b03c0 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.838+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260011a60 con 0x7f42700b03c0 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.838+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260025640 con 0x7f42700b03c0 2023-10-09T11:42:18.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.838+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4260009420 con 0x7f42700b03c0 2023-10-09T11:42:18.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.838+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427015a5d0 con 0x7f42700b03c0 2023-10-09T11:42:18.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.839+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427015af00 con 0x7f42700b03c0 2023-10-09T11:42:18.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.840+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f42600259f0 con 0x7f42700b03c0 2023-10-09T11:42:18.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.841+0000 7f42577fe700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.841+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4260085c30 con 0x7f42700b03c0 2023-10-09T11:42:18.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.841+0000 7f426effd700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 msgr2=0x7f425c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:18.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.841+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:42:18.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:18.845+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4260052e00 con 0x7f42700b03c0 2023-10-09T11:42:18.867 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:18.866+0000 7fb16dc85180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:42:18.935 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:18.934+0000 7f040ac6b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:42:19.029 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:19.029+0000 7fb16dc85180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:42:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:19.042+0000 7f426effd700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 msgr2=0x7f425c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:19.042+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:42:19.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:19.087+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f427004c3c0 con 0x7f425c066f80 2023-10-09T11:42:19.102 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:19.100+0000 7f040ac6b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:42:19.115 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:19.114+0000 7fb16dc85180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:42:19.186 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:19.184+0000 7f040ac6b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:42:19.337 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:19.336+0000 7fb16dc85180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:42:19.409 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:19.407+0000 7f040ac6b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:42:19.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:19.443+0000 7f426effd700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 msgr2=0x7f425c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:19.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:19.443+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:42:19.512 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:19.511+0000 7fb16dc85180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:42:19.586 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:19.585+0000 7f040ac6b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:42:19.602 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:19.601+0000 7fb16dc85180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:42:19.677 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:19.676+0000 7f040ac6b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:42:19.762 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:19.762+0000 7fb16dc85180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:42:19.837 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:19.836+0000 7f040ac6b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:42:19.861 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:19.860+0000 7fb16dc85180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:42:19.937 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:19.936+0000 7f040ac6b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:42:20.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:20.244+0000 7f426effd700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 msgr2=0x7f425c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:20.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:20.244+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T11:42:20.341 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:20.340+0000 7fb16dc85180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:42:20.416 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:20.415+0000 7f040ac6b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:42:20.433 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:20.433+0000 7fb16dc85180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:42:20.509 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:20.508+0000 7f040ac6b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:42:20.522 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:20.521+0000 7fb16dc85180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:42:20.599 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:20.597+0000 7f040ac6b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:42:21.137 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:21.137+0000 7fb16dc85180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:42:21.215 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:21.213+0000 7f040ac6b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:42:21.307 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:21.307+0000 7fb16dc85180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:42:21.386 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:21.385+0000 7f040ac6b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:42:21.401 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:21.401+0000 7fb16dc85180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:42:21.480 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:21.479+0000 7f040ac6b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:42:21.691 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:21.691+0000 7fb16dc85180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:42:21.770 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:21.768+0000 7f040ac6b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:42:21.785 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:21.784+0000 7fb16dc85180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:42:21.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:21.846+0000 7f426effd700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 msgr2=0x7f425c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:42:21.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:21.846+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T11:42:21.863 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:21.862+0000 7f040ac6b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:42:22.485 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:22.485+0000 7fb16dc85180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:42:22.554 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:22.553+0000 7f040ac6b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:42:22.769 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:22.768+0000 7fb16dc85180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:42:22.835 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:22.834+0000 7f040ac6b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:42:22.861 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:22.861+0000 7fb16dc85180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:42:22.926 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:22.925+0000 7f040ac6b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:42:23.016 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:23.015+0000 7fb16dc85180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:42:23.077 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.076+0000 7f040ac6b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:42:23.120 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:23.120+0000 7fb16dc85180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:42:23.179 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.178+0000 7f040ac6b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:42:23.309 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:23.309+0000 7fb16dc85180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:42:23.366 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.365+0000 7f040ac6b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:42:23.400 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:23.400+0000 7fb16dc85180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:42:23.456 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.455+0000 7f040ac6b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:42:23.491 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:23.490+0000 7fb16dc85180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:42:23.547 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.545+0000 7f040ac6b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:42:23.583 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:42:23.583+0000 7fb16dc85180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:42:23.638 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.637+0000 7f040ac6b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:42:23.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:23.643+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 7) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f42600531d0 con 0x7f42700b03c0 2023-10-09T11:42:23.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:23.658+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 8) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f4260059f70 con 0x7f42700b03c0 2023-10-09T11:42:23.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:23.659+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 msgr2=0x7f425c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:42:23.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:23.659+0000 7f42577fe700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:23.786 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037ffb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.786 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037ffb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.786 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037ffb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037ffb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037ffb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037b7ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037b7ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037b7ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037b7ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:23.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:42:23.784+0000 7f037b7ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:42:24.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.664+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mon.1 v2:172.21.15.135:3300/0 9 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f4260053aa0 con 0x7f42700b03c0 2023-10-09T11:42:24.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.664+0000 7f42577fe700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:24.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.664+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f427004c3c0 con 0x7f425c066f80 2023-10-09T11:42:24.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.666+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:24.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.668+0000 7f426effd700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c0693b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42700b5590 tx=0x7f42640091a0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:24.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.760+0000 7f42577fe700 1 -- 172.21.15.86:0/2899734627 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f427004c3c0 con 0x7f425c066f80 2023-10-09T11:42:24.762 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir0 2023-10-09T11:42:24.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 msgr2=0x7f425c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:24.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c0693b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42700b5590 tx=0x7f42640091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:24.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42700b03c0 msgr2=0x7f4270157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:24.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42700b03c0 0x7f4270157ee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4260016000 tx=0x7f4260017000 comp rx=0 tx=0).stop 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 shutdown_connections 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f425c066f80 0x7f425c0693b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42701591e0 0x7f427015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42700b03c0 0x7f4270157ee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 --2- 172.21.15.86:0/2899734627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700b0790 0x7f427015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 >> 172.21.15.86:0/2899734627 conn(0x7f4270063230 msgr2=0x7f4270158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 shutdown_connections 2023-10-09T11:42:24.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:24.763+0000 7f4274f9d700 1 -- 172.21.15.86:0/2899734627 wait complete. 2023-10-09T11:42:24.783 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-10-09T11:42:24.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:24.783 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-10-09T11:42:24.821 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T11:42:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.048+0000 7fccf13ff700 1 Processor -- start 2023-10-09T11:42:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.048+0000 7fccf13ff700 1 -- start start 2023-10-09T11:42:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.049+0000 7fccf13ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fccec0c6ac0 0x7fccec068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.049+0000 7fccf13ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.049+0000 7fccf13ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec0ac030 con 0x7fccec0c8490 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.049+0000 7fccf13ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec0ab820 con 0x7fccec0c6ac0 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.049+0000 7fccf13ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec06dbb0 con 0x7fccec069a50 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.049+0000 7fccea7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fccec0c6ac0 0x7fccec068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fccea7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fccec0c6ac0 0x7fccec068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51200/0 (socket says 172.21.15.86:51200) 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fccea7fc700 1 -- 172.21.15.86:0/2139615440 learned_addr learned my addr 172.21.15.86:0/2139615440 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fcceb7fe700 1 --2- 172.21.15.86:0/2139615440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fccea7fc700 1 -- 172.21.15.86:0/2139615440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 msgr2=0x7fccec156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fccea7fc700 1 --2- 172.21.15.86:0/2139615440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fccea7fc700 1 -- 172.21.15.86:0/2139615440 >> v1:172.21.15.135:6789/0 conn(0x7fccec0c8490 legacy=0x7fccec15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fccea7fc700 1 -- 172.21.15.86:0/2139615440 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0c6f10 con 0x7fccec0c6ac0 2023-10-09T11:42:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fccea7fc700 1 --2- 172.21.15.86:0/2139615440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c6ac0 0x7fccec068390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcce00099b0 tx=0x7fcce0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cd14706abe3274 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.050+0000 7fcce9ffb700 1 -- 172.21.15.86:0/2139615440 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000b860 con 0x7fccec0c6ac0 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fcce9ffb700 1 -- 172.21.15.86:0/2139615440 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000b9c0 con 0x7fccec0c6ac0 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fcce9ffb700 1 -- 172.21.15.86:0/2139615440 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000bd60 con 0x7fccec0c6ac0 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 -- 172.21.15.86:0/2139615440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c6ac0 msgr2=0x7fccec068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 --2- 172.21.15.86:0/2139615440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c6ac0 0x7fccec068390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcce00099b0 tx=0x7fcce0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 -- 172.21.15.86:0/2139615440 shutdown_connections 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 --2- 172.21.15.86:0/2139615440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 --2- 172.21.15.86:0/2139615440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c6ac0 0x7fccec068390 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 -- 172.21.15.86:0/2139615440 >> 172.21.15.86:0/2139615440 conn(0x7fccec0c8f90 msgr2=0x7fccec0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 -- 172.21.15.86:0/2139615440 shutdown_connections 2023-10-09T11:42:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.051+0000 7fccf13ff700 1 -- 172.21.15.86:0/2139615440 wait complete. 2023-10-09T11:42:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.053+0000 7fccf13ff700 1 Processor -- start 2023-10-09T11:42:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.053+0000 7fccf13ff700 1 -- start start 2023-10-09T11:42:25.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fccf13ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fccf13ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccec0c6ac0 0x7fccec0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fccf13ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c8490 0x7fccec0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fccf13ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0ae950 con 0x7fccec0c8490 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fccf13ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec147f90 con 0x7fccec0c6ac0 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fccf13ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0ae670 con 0x7fccec069a50 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c8490 0x7fccec0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c8490 0x7fccec0c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51202/0 (socket says 172.21.15.86:51202) 2023-10-09T11:42:25.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 -- 172.21.15.86:0/866417619 learned_addr learned my addr 172.21.15.86:0/866417619 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fccea7fc700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccec0c6ac0 0x7fccec0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceaffd700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 -- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 msgr2=0x7fccec149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 -- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccec0c6ac0 msgr2=0x7fccec0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccec0c6ac0 0x7fccec0c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceb7fe700 1 -- 172.21.15.86:0/866417619 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00094f0 con 0x7fccec0c8490 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.054+0000 7fcceaffd700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.055+0000 7fcceb7fe700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c8490 0x7fccec0c3a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009fa0 tx=0x7fcce4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.055+0000 7fccd2ffd700 1 -- 172.21.15.86:0/866417619 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400ec70 con 0x7fccec0c8490 2023-10-09T11:42:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.055+0000 7fccd2ffd700 1 -- 172.21.15.86:0/866417619 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400edd0 con 0x7fccec0c8490 2023-10-09T11:42:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.055+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec147940 con 0x7fccec0c8490 2023-10-09T11:42:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.055+0000 7fccd2ffd700 1 -- 172.21.15.86:0/866417619 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4014670 con 0x7fccec0c8490 2023-10-09T11:42:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.055+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec14a4b0 con 0x7fccec0c8490 2023-10-09T11:42:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.056+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec1477a0 con 0x7fccec0c8490 2023-10-09T11:42:25.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.057+0000 7fccd2ffd700 1 -- 172.21.15.86:0/866417619 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fcce40149e0 con 0x7fccec0c8490 2023-10-09T11:42:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.058+0000 7fccd2ffd700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fccd8066dd0 0x7fccd8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.058+0000 7fccd2ffd700 1 -- 172.21.15.86:0/866417619 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fcce4084a80 con 0x7fccec0c8490 2023-10-09T11:42:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.058+0000 7fcceaffd700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fccd8066dd0 0x7fccd8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.058+0000 7fcceaffd700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fccd8066dd0 0x7fccd8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fccdc007fd0 tx=0x7fccdc009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.062+0000 7fccd2ffd700 1 -- 172.21.15.86:0/866417619 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccec1477a0 con 0x7fccec0c8490 2023-10-09T11:42:25.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.278+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fccec1477a0 con 0x7fccd8066dd0 2023-10-09T11:42:25.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.339+0000 7fccd2ffd700 1 -- 172.21.15.86:0/866417619 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fccec1477a0 con 0x7fccd8066dd0 2023-10-09T11:42:25.341 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir1 2023-10-09T11:42:25.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fccd8066dd0 msgr2=0x7fccd8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fccd8066dd0 0x7fccd8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fccdc007fd0 tx=0x7fccdc009040 comp rx=0 tx=0).stop 2023-10-09T11:42:25.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c8490 msgr2=0x7fccec0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c8490 0x7fccec0c3a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009fa0 tx=0x7fcce4009900 comp rx=0 tx=0).stop 2023-10-09T11:42:25.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 shutdown_connections 2023-10-09T11:42:25.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fccd8066dd0 0x7fccd8069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccec0c8490 0x7fccec0c3a70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccec069a50 0x7fccec149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 --2- 172.21.15.86:0/866417619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccec0c6ac0 0x7fccec0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 >> 172.21.15.86:0/866417619 conn(0x7fccec0c8f90 msgr2=0x7fccec0aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:25.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 shutdown_connections 2023-10-09T11:42:25.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.341+0000 7fccf13ff700 1 -- 172.21.15.86:0/866417619 wait complete. 2023-10-09T11:42:25.360 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-10-09T11:42:25.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:25.360 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-10-09T11:42:25.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T11:42:25.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.623+0000 7f1d1b59e700 1 Processor -- start 2023-10-09T11:42:25.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.623+0000 7f1d1b59e700 1 -- start start 2023-10-09T11:42:25.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.624+0000 7f1d1b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1d1c0b0790 0x7f1d1c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.624+0000 7f1d1b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.624+0000 7f1d1b59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0cfa00 con 0x7f1d1c0b03c0 2023-10-09T11:42:25.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.624+0000 7f1d1b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0cb580 con 0x7f1d1c0b0790 2023-10-09T11:42:25.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.624+0000 7f1d1b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0cf160 con 0x7f1d1c1591e0 2023-10-09T11:42:25.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.624+0000 7f1d19d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1d1c0b0790 0x7f1d1c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.624+0000 7f1d1ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d19d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1d1c0b0790 0x7f1d1c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:56344/0 (socket says 172.21.15.86:56344) 2023-10-09T11:42:25.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d19d9b700 1 -- 172.21.15.86:0/4099704726 learned_addr learned my addr 172.21.15.86:0/4099704726 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:25.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d1a59c700 1 --1- 172.21.15.86:0/4099704726 >> v1:172.21.15.135:6789/0 conn(0x7f1d1c0b03c0 0x7f1d1c0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:38384/0 (socket says 172.21.15.86:38384) 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d19d9b700 1 -- 172.21.15.86:0/4099704726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 msgr2=0x7f1d1c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d19d9b700 1 --2- 172.21.15.86:0/4099704726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d19d9b700 1 -- 172.21.15.86:0/4099704726 >> v1:172.21.15.135:6789/0 conn(0x7f1d1c0b03c0 legacy=0x7f1d1c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d19d9b700 1 -- 172.21.15.86:0/4099704726 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0cf440 con 0x7f1d1c0b0790 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.625+0000 7f1d19d9b700 1 --2- 172.21.15.86:0/4099704726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0cea70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1d100099e0 tx=0x7f1d10009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db2fcfc0d325421c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1959a700 1 -- 172.21.15.86:0/4099704726 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000b820 con 0x7f1d1c0b0790 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1959a700 1 -- 172.21.15.86:0/4099704726 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000b980 con 0x7f1d1c0b0790 2023-10-09T11:42:25.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1959a700 1 -- 172.21.15.86:0/4099704726 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000bd20 con 0x7f1d1c0b0790 2023-10-09T11:42:25.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 -- 172.21.15.86:0/4099704726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b0790 msgr2=0x7f1d1c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/4099704726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0cea70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1d100099e0 tx=0x7f1d10009250 comp rx=0 tx=0).stop 2023-10-09T11:42:25.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 -- 172.21.15.86:0/4099704726 shutdown_connections 2023-10-09T11:42:25.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/4099704726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/4099704726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0cea70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 -- 172.21.15.86:0/4099704726 >> 172.21.15.86:0/4099704726 conn(0x7f1d1c063230 msgr2=0x7f1d1c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:25.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 -- 172.21.15.86:0/4099704726 shutdown_connections 2023-10-09T11:42:25.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.626+0000 7f1d1b59e700 1 -- 172.21.15.86:0/4099704726 wait complete. 2023-10-09T11:42:25.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.628+0000 7f1d1b59e700 1 Processor -- start 2023-10-09T11:42:25.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.628+0000 7f1d1b59e700 1 -- start start 2023-10-09T11:42:25.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b03c0 0x7f1d1c0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c6320 con 0x7f1d1c0b0790 2023-10-09T11:42:25.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c7160 con 0x7f1d1c0b03c0 2023-10-09T11:42:25.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c158fe0 con 0x7f1d1c1591e0 2023-10-09T11:42:25.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51204/0 (socket says 172.21.15.86:51204) 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 -- 172.21.15.86:0/2371881002 learned_addr learned my addr 172.21.15.86:0/2371881002 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1a59c700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b03c0 0x7f1d1c0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d1ad9d700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 -- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 msgr2=0x7f1d1c158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 -- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b03c0 msgr2=0x7f1d1c0c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b03c0 0x7f1d1c0c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.629+0000 7f1d19d9b700 1 -- 172.21.15.86:0/2371881002 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100094f0 con 0x7f1d1c0b0790 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.630+0000 7f1d1ad9d700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:25.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.630+0000 7f1d19d9b700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0c5de0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009290 tx=0x7f1d10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.630+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10024440 con 0x7f1d1c0b0790 2023-10-09T11:42:25.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.630+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d100245e0 con 0x7f1d1c0b0790 2023-10-09T11:42:25.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.630+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d100249a0 con 0x7f1d1c0b0790 2023-10-09T11:42:25.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.630+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c0c6550 con 0x7f1d1c0b0790 2023-10-09T11:42:25.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.630+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c0c6b10 con 0x7f1d1c0b0790 2023-10-09T11:42:25.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.631+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c04c3c0 con 0x7f1d1c0b0790 2023-10-09T11:42:25.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.632+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f1d1001a420 con 0x7f1d1c0b0790 2023-10-09T11:42:25.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.633+0000 7f1d0a7fc700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1cfc066dd0 0x7f1cfc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:25.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.633+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1d100861d0 con 0x7f1d1c0b0790 2023-10-09T11:42:25.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.633+0000 7f1d1a59c700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1cfc066dd0 0x7f1cfc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:25.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.634+0000 7f1d1a59c700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1cfc066dd0 0x7f1cfc069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c007fd0 tx=0x7f1d0c007d70 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:25.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.638+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d10053520 con 0x7f1d1c0b0790 2023-10-09T11:42:25.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.671+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f1d100538f0 con 0x7f1d1c0b0790 2023-10-09T11:42:25.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.859+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d1c0cad50 con 0x7f1cfc066dd0 2023-10-09T11:42:25.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.928+0000 7f1d0a7fc700 1 -- 172.21.15.86:0/2371881002 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f1d1c0cad50 con 0x7f1cfc066dd0 2023-10-09T11:42:25.930 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir2 2023-10-09T11:42:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.930+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1cfc066dd0 msgr2=0x7f1cfc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.930+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1cfc066dd0 0x7f1cfc069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c007fd0 tx=0x7f1d0c007d70 comp rx=0 tx=0).stop 2023-10-09T11:42:25.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.930+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1c0b0790 msgr2=0x7f1d1c0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.930+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0c5de0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009290 tx=0x7f1d10017000 comp rx=0 tx=0).stop 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 shutdown_connections 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1cfc066dd0 0x7f1cfc069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d1c1591e0 0x7f1d1c158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d1c0b03c0 0x7f1d1c0c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 --2- 172.21.15.86:0/2371881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1c0b0790 0x7f1d1c0c5de0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 >> 172.21.15.86:0/2371881002 conn(0x7f1d1c063230 msgr2=0x7f1d1c0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 shutdown_connections 2023-10-09T11:42:25.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:25.931+0000 7f1d1b59e700 1 -- 172.21.15.86:0/2371881002 wait complete. 2023-10-09T11:42:25.950 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-10-09T11:42:25.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:25.950 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-10-09T11:42:25.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T11:42:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.213+0000 7f95a09ff700 1 Processor -- start 2023-10-09T11:42:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.213+0000 7f95a09ff700 1 -- start start 2023-10-09T11:42:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.214+0000 7f95a09ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f959c159ec0 0x7f959c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.214+0000 7f95a09ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0b53d0 0x7f959c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.214+0000 7f95a09ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f959c0cce40 0x7f959c0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.214+0000 7f95a09ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0b5b00 con 0x7f959c0cce40 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.214+0000 7f95a09ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0b5850 con 0x7f959c159ec0 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.214+0000 7f95a09ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0b5da0 con 0x7f959c0b53d0 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f959c0cce40 0x7f959c0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f959c0cce40 0x7f959c0cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51206/0 (socket says 172.21.15.86:51206) 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 -- 172.21.15.86:0/3251029256 learned_addr learned my addr 172.21.15.86:0/3251029256 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f9599d9b700 1 --2- 172.21.15.86:0/3251029256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0b53d0 0x7f959c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959a59c700 1 --2- 172.21.15.86:0/3251029256 >> v2:172.21.15.135:3300/0 conn(0x7f959c159ec0 0x7f959c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 -- 172.21.15.86:0/3251029256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0b53d0 msgr2=0x7f959c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 --2- 172.21.15.86:0/3251029256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0b53d0 0x7f959c0cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 -- 172.21.15.86:0/3251029256 >> v2:172.21.15.135:3300/0 conn(0x7f959c159ec0 msgr2=0x7f959c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 --2- 172.21.15.86:0/3251029256 >> v2:172.21.15.135:3300/0 conn(0x7f959c159ec0 0x7f959c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 -- 172.21.15.86:0/3251029256 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0b6080 con 0x7f959c0cce40 2023-10-09T11:42:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.215+0000 7f959ad9d700 1 --2- 172.21.15.86:0/3251029256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0cce40 0x7f959c0cd2a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f959c089120 tx=0x7f9594009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92424d2634d1709 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f959959a700 1 -- 172.21.15.86:0/3251029256 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959400e070 con 0x7f959c0cce40 2023-10-09T11:42:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f959959a700 1 -- 172.21.15.86:0/3251029256 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959400ba50 con 0x7f959c0cce40 2023-10-09T11:42:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f959959a700 1 -- 172.21.15.86:0/3251029256 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940092e0 con 0x7f959c0cce40 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 -- 172.21.15.86:0/3251029256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0cce40 msgr2=0x7f959c0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3251029256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0cce40 0x7f959c0cd2a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f959c089120 tx=0x7f9594009840 comp rx=0 tx=0).stop 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 -- 172.21.15.86:0/3251029256 shutdown_connections 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3251029256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0cce40 0x7f959c0cd2a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3251029256 >> v2:172.21.15.135:3300/0 conn(0x7f959c159ec0 0x7f959c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3251029256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0b53d0 0x7f959c0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 -- 172.21.15.86:0/3251029256 >> 172.21.15.86:0/3251029256 conn(0x7f959c0999f0 msgr2=0x7f959c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 -- 172.21.15.86:0/3251029256 shutdown_connections 2023-10-09T11:42:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.216+0000 7f95a09ff700 1 -- 172.21.15.86:0/3251029256 wait complete. 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.218+0000 7f95a09ff700 1 Processor -- start 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.218+0000 7f95a09ff700 1 -- start start 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f95a09ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0b53d0 0x7f959c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f95a09ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0cce40 0x7f959c147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f95a09ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c159ec0 0x7f959c06a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f95a09ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c156fb0 con 0x7f959c0b53d0 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f95a09ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c06b340 con 0x7f959c159ec0 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f95a09ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c06b060 con 0x7f959c0cce40 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f959a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0b53d0 0x7f959c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f959a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0b53d0 0x7f959c156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51218/0 (socket says 172.21.15.86:51218) 2023-10-09T11:42:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f959a59c700 1 -- 172.21.15.86:0/3446325269 learned_addr learned my addr 172.21.15.86:0/3446325269 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f9599d9b700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0cce40 0x7f959c147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.219+0000 7f959ad9d700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c159ec0 0x7f959c06a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f959a59c700 1 -- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0cce40 msgr2=0x7f959c147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f959a59c700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0cce40 0x7f959c147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f959a59c700 1 -- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c159ec0 msgr2=0x7f959c06a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f959a59c700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c159ec0 0x7f959c06a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f959a59c700 1 -- 172.21.15.86:0/3446325269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594009ae0 con 0x7f959c0b53d0 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f959a59c700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0b53d0 0x7f959c156a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f958c00d810 tx=0x7f958c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f958a7fc700 1 -- 172.21.15.86:0/3446325269 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0125f0 con 0x7f959c0b53d0 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f958a7fc700 1 -- 172.21.15.86:0/3446325269 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c012750 con 0x7f959c0b53d0 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c155f90 con 0x7f959c0b53d0 2023-10-09T11:42:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f958a7fc700 1 -- 172.21.15.86:0/3446325269 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c012b10 con 0x7f959c0b53d0 2023-10-09T11:42:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.220+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c156550 con 0x7f959c0b53d0 2023-10-09T11:42:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.221+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c063c90 con 0x7f959c0b53d0 2023-10-09T11:42:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.222+0000 7f958a7fc700 1 -- 172.21.15.86:0/3446325269 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f958c01e460 con 0x7f959c0b53d0 2023-10-09T11:42:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.223+0000 7f958a7fc700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f957c067130 0x7f957c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.223+0000 7f958a7fc700 1 -- 172.21.15.86:0/3446325269 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f958c084ff0 con 0x7f959c0b53d0 2023-10-09T11:42:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.223+0000 7f9599d9b700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f957c067130 0x7f957c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.224+0000 7f9599d9b700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f957c067130 0x7f957c0695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f959c09e4c0 tx=0x7f9590008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:26.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.227+0000 7f958a7fc700 1 -- 172.21.15.86:0/3446325269 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f958c051e60 con 0x7f959c0b53d0 2023-10-09T11:42:26.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.443+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f959c0718b0 con 0x7f957c067130 2023-10-09T11:42:26.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.508+0000 7f958a7fc700 1 -- 172.21.15.86:0/3446325269 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f959c0718b0 con 0x7f957c067130 2023-10-09T11:42:26.510 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir3 2023-10-09T11:42:26.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f957c067130 msgr2=0x7f957c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f957c067130 0x7f957c0695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f959c09e4c0 tx=0x7f9590008040 comp rx=0 tx=0).stop 2023-10-09T11:42:26.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0b53d0 msgr2=0x7f959c156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0b53d0 0x7f959c156a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f958c00d810 tx=0x7f958c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:26.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 shutdown_connections 2023-10-09T11:42:26.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f957c067130 0x7f957c0695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c0b53d0 0x7f959c156a70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c159ec0 0x7f959c06a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 --2- 172.21.15.86:0/3446325269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0cce40 0x7f959c147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 >> 172.21.15.86:0/3446325269 conn(0x7f959c0999f0 msgr2=0x7f959c1555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 shutdown_connections 2023-10-09T11:42:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.511+0000 7f95a09ff700 1 -- 172.21.15.86:0/3446325269 wait complete. 2023-10-09T11:42:26.530 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-10-09T11:42:26.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:26.531 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-10-09T11:42:26.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T11:42:26.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.793+0000 7f9aa7dff700 1 Processor -- start 2023-10-09T11:42:26.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.793+0000 7f9aa7dff700 1 -- start start 2023-10-09T11:42:26.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa7dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9aa01563b0 0x7f9aa0156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa7dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9aa015a440 0x7f9aa00acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa7dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa015a9b0 con 0x7f9aa0068890 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa7dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa015ac90 con 0x7f9aa015a440 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa7dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa015af70 con 0x7f9aa01563b0 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa539a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9aa015a440 0x7f9aa00acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa539a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9aa015a440 0x7f9aa00acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51232/0 (socket says 172.21.15.86:51232) 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa539a700 1 -- 172.21.15.86:0/2556307439 learned_addr learned my addr 172.21.15.86:0/2556307439 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.794+0000 7f9aa5b9b700 1 --2- 172.21.15.86:0/2556307439 >> v2:172.21.15.135:3300/0 conn(0x7f9aa01563b0 0x7f9aa0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa539a700 1 -- 172.21.15.86:0/2556307439 >> v2:172.21.15.135:3300/0 conn(0x7f9aa01563b0 msgr2=0x7f9aa0156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa539a700 1 --2- 172.21.15.86:0/2556307439 >> v2:172.21.15.135:3300/0 conn(0x7f9aa01563b0 0x7f9aa0156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa539a700 1 -- 172.21.15.86:0/2556307439 >> v1:172.21.15.135:6789/0 conn(0x7f9aa0068890 legacy=0x7f9aa00c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa539a700 1 -- 172.21.15.86:0/2556307439 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa015b250 con 0x7f9aa015a440 2023-10-09T11:42:26.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa539a700 1 --2- 172.21.15.86:0/2556307439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa015a440 0x7f9aa00acf30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9aa006a9f0 tx=0x7f9a90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7672057f15c75573 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:26.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa4b99700 1 -- 172.21.15.86:0/2556307439 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000b860 con 0x7f9aa015a440 2023-10-09T11:42:26.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa4b99700 1 -- 172.21.15.86:0/2556307439 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9000b9c0 con 0x7f9aa015a440 2023-10-09T11:42:26.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.795+0000 7f9aa4b99700 1 -- 172.21.15.86:0/2556307439 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000bd60 con 0x7f9aa015a440 2023-10-09T11:42:26.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 -- 172.21.15.86:0/2556307439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa015a440 msgr2=0x7f9aa00acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/2556307439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa015a440 0x7f9aa00acf30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9aa006a9f0 tx=0x7f9a90009250 comp rx=0 tx=0).stop 2023-10-09T11:42:26.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 -- 172.21.15.86:0/2556307439 shutdown_connections 2023-10-09T11:42:26.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/2556307439 >> v2:172.21.15.135:3300/0 conn(0x7f9aa01563b0 0x7f9aa0156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/2556307439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa015a440 0x7f9aa00acf30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 -- 172.21.15.86:0/2556307439 >> 172.21.15.86:0/2556307439 conn(0x7f9aa00c8f90 msgr2=0x7f9aa00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:26.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 -- 172.21.15.86:0/2556307439 shutdown_connections 2023-10-09T11:42:26.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.796+0000 7f9aa7dff700 1 -- 172.21.15.86:0/2556307439 wait complete. 2023-10-09T11:42:26.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.797+0000 7f9aa7dff700 1 Processor -- start 2023-10-09T11:42:26.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.797+0000 7f9aa7dff700 1 -- start start 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa7dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa0068890 0x7f9aa00c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa7dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa01563b0 0x7f9aa01440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa7dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9aa015a440 0x7f9aa00cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa7dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0159350 con 0x7f9aa01563b0 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa7dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00ca7c0 con 0x7f9aa0068890 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa7dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00cb060 con 0x7f9aa015a440 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa01563b0 0x7f9aa01440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.798+0000 7f9aa539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa01563b0 0x7f9aa01440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51244/0 (socket says 172.21.15.86:51244) 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa539a700 1 -- 172.21.15.86:0/3551735188 learned_addr learned my addr 172.21.15.86:0/3551735188 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa5b9b700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa0068890 0x7f9aa00c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa639c700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9aa015a440 0x7f9aa00cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa539a700 1 -- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9aa015a440 msgr2=0x7f9aa00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa539a700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9aa015a440 0x7f9aa00cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa539a700 1 -- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa0068890 msgr2=0x7f9aa00c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa539a700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa0068890 0x7f9aa00c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa539a700 1 -- 172.21.15.86:0/3551735188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a900094f0 con 0x7f9aa01563b0 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa539a700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa01563b0 0x7f9aa01440c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9aa006bbb0 tx=0x7f9a90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9a95ffb700 1 -- 172.21.15.86:0/3551735188 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90011e60 con 0x7f9aa01563b0 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9a95ffb700 1 -- 172.21.15.86:0/3551735188 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9001a630 con 0x7f9aa01563b0 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0159b90 con 0x7f9aa01563b0 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.799+0000 7f9a95ffb700 1 -- 172.21.15.86:0/3551735188 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9001a9f0 con 0x7f9aa01563b0 2023-10-09T11:42:26.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.800+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00cacf0 con 0x7f9aa01563b0 2023-10-09T11:42:26.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.801+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa00cb1d0 con 0x7f9aa01563b0 2023-10-09T11:42:26.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.801+0000 7f9a95ffb700 1 -- 172.21.15.86:0/3551735188 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f9a9002d430 con 0x7f9aa01563b0 2023-10-09T11:42:26.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.803+0000 7f9a95ffb700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9a84067160 0x7f9a84069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:26.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.803+0000 7f9a95ffb700 1 -- 172.21.15.86:0/3551735188 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9a90086500 con 0x7f9aa01563b0 2023-10-09T11:42:26.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.803+0000 7f9aa5b9b700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9a84067160 0x7f9a84069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:26.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.804+0000 7f9aa5b9b700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9a84067160 0x7f9a84069610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c006fd0 tx=0x7f9a9c008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:26.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:26.807+0000 7f9a95ffb700 1 -- 172.21.15.86:0/3551735188 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a900533d0 con 0x7f9aa01563b0 2023-10-09T11:42:27.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.020+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9aa00718b0 con 0x7f9a84067160 2023-10-09T11:42:27.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.098+0000 7f9a95ffb700 1 -- 172.21.15.86:0/3551735188 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9aa00718b0 con 0x7f9a84067160 2023-10-09T11:42:27.099 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir4 2023-10-09T11:42:27.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9a84067160 msgr2=0x7f9a84069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9a84067160 0x7f9a84069610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c006fd0 tx=0x7f9a9c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:27.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa01563b0 msgr2=0x7f9aa01440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa01563b0 0x7f9aa01440c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9aa006bbb0 tx=0x7f9a90017000 comp rx=0 tx=0).stop 2023-10-09T11:42:27.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 shutdown_connections 2023-10-09T11:42:27.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9a84067160 0x7f9a84069610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9aa015a440 0x7f9aa00cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa0068890 0x7f9aa00c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 --2- 172.21.15.86:0/3551735188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa01563b0 0x7f9aa01440c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 >> 172.21.15.86:0/3551735188 conn(0x7f9aa00c8f90 msgr2=0x7f9aa006e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:27.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 shutdown_connections 2023-10-09T11:42:27.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.100+0000 7f9aa7dff700 1 -- 172.21.15.86:0/3551735188 wait complete. 2023-10-09T11:42:27.119 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-10-09T11:42:27.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:27.119 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-10-09T11:42:27.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T11:42:27.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.381+0000 7f0cf6d9d700 1 Processor -- start 2023-10-09T11:42:27.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.381+0000 7f0cf6d9d700 1 -- start start 2023-10-09T11:42:27.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0cf00cca20 0x7f0cf00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf6d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf00cfa00 con 0x7f0cf00b03c0 2023-10-09T11:42:27.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf6d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf00cb580 con 0x7f0cf00b0790 2023-10-09T11:42:27.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf6d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf00cf160 con 0x7f0cf00cca20 2023-10-09T11:42:27.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0cf00cca20 0x7f0cf00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0cf00cca20 0x7f0cf00cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51250/0 (socket says 172.21.15.86:51250) 2023-10-09T11:42:27.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf659c700 1 -- 172.21.15.86:0/4278010978 learned_addr learned my addr 172.21.15.86:0/4278010978 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:27.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf5d9b700 1 --1- 172.21.15.86:0/4278010978 >> v1:172.21.15.86:6789/0 conn(0x7f0cf00b03c0 0x7f0cf00b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33998/0 (socket says 172.21.15.86:33998) 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf659c700 1 -- 172.21.15.86:0/4278010978 >> v1:172.21.15.135:6789/0 conn(0x7f0cf00b0790 legacy=0x7f0cf01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf659c700 1 -- 172.21.15.86:0/4278010978 >> v1:172.21.15.86:6789/0 conn(0x7f0cf00b03c0 legacy=0x7f0cf00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf659c700 1 -- 172.21.15.86:0/4278010978 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00cf440 con 0x7f0cf00cca20 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.383+0000 7f0cf4d99700 1 -- 172.21.15.86:0/4278010978 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188647598 0 0) 0x7f0cf00cfa00 con 0x7f0cf00b03c0 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf659c700 1 --2- 172.21.15.86:0/4278010978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00cea70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009f50 tx=0x7f0ce8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e60c5580d2aec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf4d99700 1 -- 172.21.15.86:0/4278010978 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800e070 con 0x7f0cf00cca20 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf4d99700 1 -- 172.21.15.86:0/4278010978 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce800ba70 con 0x7f0cf00cca20 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf4d99700 1 -- 172.21.15.86:0/4278010978 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80092e0 con 0x7f0cf00cca20 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/4278010978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 msgr2=0x7f0cf00cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/4278010978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00cea70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009f50 tx=0x7f0ce8009840 comp rx=0 tx=0).stop 2023-10-09T11:42:27.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/4278010978 shutdown_connections 2023-10-09T11:42:27.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/4278010978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00cea70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.384+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/4278010978 >> 172.21.15.86:0/4278010978 conn(0x7f0cf0063230 msgr2=0x7f0cf0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:27.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.385+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/4278010978 shutdown_connections 2023-10-09T11:42:27.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.385+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/4278010978 wait complete. 2023-10-09T11:42:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.386+0000 7f0cf6d9d700 1 Processor -- start 2023-10-09T11:42:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.386+0000 7f0cf6d9d700 1 -- start start 2023-10-09T11:42:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cf00b03c0 0x7f0cf014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf6d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cf00b0790 0x7f0cf00c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf6d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0158b90 con 0x7f0cf00cca20 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf6d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf015b4d0 con 0x7f0cf00b03c0 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf6d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf01588b0 con 0x7f0cf00b0790 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51260/0 (socket says 172.21.15.86:51260) 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf659c700 1 -- 172.21.15.86:0/2656272547 learned_addr learned my addr 172.21.15.86:0/2656272547 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf5d9b700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cf00b03c0 0x7f0cf014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.387+0000 7f0cf559a700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cf00b0790 0x7f0cf00c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf659c700 1 -- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cf00b0790 msgr2=0x7f0cf00c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf659c700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cf00b0790 0x7f0cf00c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf659c700 1 -- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cf00b03c0 msgr2=0x7f0cf014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf659c700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cf00b03c0 0x7f0cf014fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf659c700 1 -- 172.21.15.86:0/2656272547 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8009ae0 con 0x7f0cf00cca20 2023-10-09T11:42:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf659c700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00c44b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800b770 tx=0x7f0ce8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0ce5ffb700 1 -- 172.21.15.86:0/2656272547 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8007d00 con 0x7f0cf00cca20 2023-10-09T11:42:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0ce5ffb700 1 -- 172.21.15.86:0/2656272547 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce8007e80 con 0x7f0cf00cca20 2023-10-09T11:42:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0ce5ffb700 1 -- 172.21.15.86:0/2656272547 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80266b0 con 0x7f0cf00cca20 2023-10-09T11:42:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf015ae80 con 0x7f0cf00cca20 2023-10-09T11:42:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.388+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf0150220 con 0x7f0cf00cca20 2023-10-09T11:42:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.389+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf015b320 con 0x7f0cf00cca20 2023-10-09T11:42:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.390+0000 7f0ce5ffb700 1 -- 172.21.15.86:0/2656272547 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f0ce801d420 con 0x7f0cf00cca20 2023-10-09T11:42:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.391+0000 7f0ce5ffb700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0cd4067130 0x7f0cd40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.391+0000 7f0ce5ffb700 1 -- 172.21.15.86:0/2656272547 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0ce8086c00 con 0x7f0cf00cca20 2023-10-09T11:42:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.391+0000 7f0cf5d9b700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0cd4067130 0x7f0cd40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.392+0000 7f0cf5d9b700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0cd4067130 0x7f0cd40695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000c00 tx=0x7f0cec007ed0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.396+0000 7f0ce5ffb700 1 -- 172.21.15.86:0/2656272547 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ce8053aa0 con 0x7f0cf00cca20 2023-10-09T11:42:27.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.610+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cf004c3c0 con 0x7f0cd4067130 2023-10-09T11:42:27.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.680+0000 7f0ce5ffb700 1 -- 172.21.15.86:0/2656272547 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f0cf004c3c0 con 0x7f0cd4067130 2023-10-09T11:42:27.681 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir5 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.682+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0cd4067130 msgr2=0x7f0cd40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.682+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0cd4067130 0x7f0cd40695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000c00 tx=0x7f0cec007ed0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 msgr2=0x7f0cf00c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00c44b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800b770 tx=0x7f0ce8018000 comp rx=0 tx=0).stop 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 shutdown_connections 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0cd4067130 0x7f0cd40695e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf00cca20 0x7f0cf00c44b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cf00b03c0 0x7f0cf014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 --2- 172.21.15.86:0/2656272547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cf00b0790 0x7f0cf00c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 >> 172.21.15.86:0/2656272547 conn(0x7f0cf0063230 msgr2=0x7f0cf015d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:27.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 shutdown_connections 2023-10-09T11:42:27.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.683+0000 7f0cf6d9d700 1 -- 172.21.15.86:0/2656272547 wait complete. 2023-10-09T11:42:27.701 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-10-09T11:42:27.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:27.702 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-10-09T11:42:27.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T11:42:27.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.964+0000 7f2740bff700 1 Processor -- start 2023-10-09T11:42:27.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.964+0000 7f2740bff700 1 -- start start 2023-10-09T11:42:27.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.965+0000 7f2740bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f273c159b80 0x7f273c06a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.965+0000 7f2740bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c163650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.965+0000 7f2740bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0af900 con 0x7f273c1597b0 2023-10-09T11:42:27.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2740bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c068390 con 0x7f273c159b80 2023-10-09T11:42:27.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2740bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0ac530 con 0x7f273c06a7f0 2023-10-09T11:42:27.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2739d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f273c159b80 0x7f273c06a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2739d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f273c159b80 0x7f273c06a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51264/0 (socket says 172.21.15.86:51264) 2023-10-09T11:42:27.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2739d9b700 1 -- 172.21.15.86:0/3698413338 learned_addr learned my addr 172.21.15.86:0/3698413338 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:27.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f273ad9d700 1 --2- 172.21.15.86:0/3698413338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c163650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2739d9b700 1 -- 172.21.15.86:0/3698413338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 msgr2=0x7f273c163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:27.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2739d9b700 1 --2- 172.21.15.86:0/3698413338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c163650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2739d9b700 1 -- 172.21.15.86:0/3698413338 >> v1:172.21.15.135:6789/0 conn(0x7f273c1597b0 legacy=0x7f273c0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.966+0000 7f2739d9b700 1 -- 172.21.15.86:0/3698413338 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c06ac30 con 0x7f273c159b80 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f2739d9b700 1 --2- 172.21.15.86:0/3698413338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c159b80 0x7f273c06a2b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f27300099e0 tx=0x7f2730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ccfea9819622b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f273959a700 1 -- 172.21.15.86:0/3698413338 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000b820 con 0x7f273c159b80 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f273959a700 1 -- 172.21.15.86:0/3698413338 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273000b980 con 0x7f273c159b80 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f273959a700 1 -- 172.21.15.86:0/3698413338 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000bd20 con 0x7f273c159b80 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f2740bff700 1 -- 172.21.15.86:0/3698413338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c159b80 msgr2=0x7f273c06a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f2740bff700 1 --2- 172.21.15.86:0/3698413338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c159b80 0x7f273c06a2b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f27300099e0 tx=0x7f2730009250 comp rx=0 tx=0).stop 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f2740bff700 1 -- 172.21.15.86:0/3698413338 shutdown_connections 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f2740bff700 1 --2- 172.21.15.86:0/3698413338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c163650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f2740bff700 1 --2- 172.21.15.86:0/3698413338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c159b80 0x7f273c06a2b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.967+0000 7f2740bff700 1 -- 172.21.15.86:0/3698413338 >> 172.21.15.86:0/3698413338 conn(0x7f273c0cd880 msgr2=0x7f273c0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:27.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.968+0000 7f2740bff700 1 -- 172.21.15.86:0/3698413338 shutdown_connections 2023-10-09T11:42:27.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.968+0000 7f2740bff700 1 -- 172.21.15.86:0/3698413338 wait complete. 2023-10-09T11:42:27.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.969+0000 7f2740bff700 1 Processor -- start 2023-10-09T11:42:27.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.969+0000 7f2740bff700 1 -- start start 2023-10-09T11:42:27.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2740bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c16a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2740bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c1597b0 0x7f273c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2740bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c159b80 0x7f273c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2740bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c15be70 con 0x7f273c1597b0 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2740bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c16aa70 con 0x7f273c159b80 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2740bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c16ad50 con 0x7f273c06a7f0 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2739d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c1597b0 0x7f273c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2739d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c1597b0 0x7f273c15c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51266/0 (socket says 172.21.15.86:51266) 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.970+0000 7f2739d9b700 1 -- 172.21.15.86:0/3677328738 learned_addr learned my addr 172.21.15.86:0/3677328738 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f273ad9d700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c159b80 0x7f273c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f273a59c700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c16a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2739d9b700 1 -- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 msgr2=0x7f273c16a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2739d9b700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c16a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2739d9b700 1 -- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c159b80 msgr2=0x7f273c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2739d9b700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c159b80 0x7f273c1563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2739d9b700 1 -- 172.21.15.86:0/3677328738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300094f0 con 0x7f273c1597b0 2023-10-09T11:42:27.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f273ad9d700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c159b80 0x7f273c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:27.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2739d9b700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c1597b0 0x7f273c15c800 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2730009290 tx=0x7f2730017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f272a7fc700 1 -- 172.21.15.86:0/3677328738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730011e70 con 0x7f273c1597b0 2023-10-09T11:42:27.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f272a7fc700 1 -- 172.21.15.86:0/3677328738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2730024430 con 0x7f273c1597b0 2023-10-09T11:42:27.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f272a7fc700 1 -- 172.21.15.86:0/3677328738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730024810 con 0x7f273c1597b0 2023-10-09T11:42:27.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c156d20 con 0x7f273c1597b0 2023-10-09T11:42:27.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.971+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c15c330 con 0x7f273c1597b0 2023-10-09T11:42:27.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.972+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c16af00 con 0x7f273c1597b0 2023-10-09T11:42:27.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.973+0000 7f272a7fc700 1 -- 172.21.15.86:0/3677328738 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f273001a420 con 0x7f273c1597b0 2023-10-09T11:42:27.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.974+0000 7f272a7fc700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f271c067130 0x7f271c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.974+0000 7f272a7fc700 1 -- 172.21.15.86:0/3677328738 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f2730085e60 con 0x7f273c1597b0 2023-10-09T11:42:27.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.974+0000 7f273a59c700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f271c067130 0x7f271c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.975+0000 7f273a59c700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f271c067130 0x7f271c0695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f273c15b4e0 tx=0x7f272c009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:27.978+0000 7f272a7fc700 1 -- 172.21.15.86:0/3677328738 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f273c16af00 con 0x7f273c1597b0 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.197+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f273c0aaf20 con 0x7f271c067130 2023-10-09T11:42:28.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.258+0000 7f272a7fc700 1 -- 172.21.15.86:0/3677328738 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f273c0aaf20 con 0x7f271c067130 2023-10-09T11:42:28.260 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir6 2023-10-09T11:42:28.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f271c067130 msgr2=0x7f271c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f271c067130 0x7f271c0695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f273c15b4e0 tx=0x7f272c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c1597b0 msgr2=0x7f273c15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c1597b0 0x7f273c15c800 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2730009290 tx=0x7f2730017000 comp rx=0 tx=0).stop 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 shutdown_connections 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f271c067130 0x7f271c0695e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c159b80 0x7f273c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c06a7f0 0x7f273c16a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 --2- 172.21.15.86:0/3677328738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c1597b0 0x7f273c15c800 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.260+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 >> 172.21.15.86:0/3677328738 conn(0x7f273c0cd880 msgr2=0x7f273c158890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.261+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 shutdown_connections 2023-10-09T11:42:28.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.261+0000 7f2740bff700 1 -- 172.21.15.86:0/3677328738 wait complete. 2023-10-09T11:42:28.280 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-10-09T11:42:28.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:28.280 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-10-09T11:42:28.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T11:42:28.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.543+0000 7f74655ff700 1 Processor -- start 2023-10-09T11:42:28.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.543+0000 7f74655ff700 1 -- start start 2023-10-09T11:42:28.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.544+0000 7f74655ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7460157740 0x7f74600adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f74655ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7460068aa0 0x7f746006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f74655ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746006dc20 con 0x7f74600b2100 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f74655ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600acc00 con 0x7f7460068aa0 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f74655ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746006d6a0 con 0x7f7460157740 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7460068aa0 0x7f746006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7460068aa0 0x7f746006e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51268/0 (socket says 172.21.15.86:51268) 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745f7fe700 1 -- 172.21.15.86:0/3145330586 learned_addr learned my addr 172.21.15.86:0/3145330586 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745effd700 1 --2- 172.21.15.86:0/3145330586 >> v2:172.21.15.135:3300/0 conn(0x7f7460157740 0x7f74600adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745f7fe700 1 -- 172.21.15.86:0/3145330586 >> v2:172.21.15.135:3300/0 conn(0x7f7460157740 msgr2=0x7f74600adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745f7fe700 1 --2- 172.21.15.86:0/3145330586 >> v2:172.21.15.135:3300/0 conn(0x7f7460157740 0x7f74600adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745f7fe700 1 -- 172.21.15.86:0/3145330586 >> v1:172.21.15.135:6789/0 conn(0x7f74600b2100 legacy=0x7f7460068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:28.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.545+0000 7f745f7fe700 1 -- 172.21.15.86:0/3145330586 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600ae910 con 0x7f7460068aa0 2023-10-09T11:42:28.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.546+0000 7f745f7fe700 1 --2- 172.21.15.86:0/3145330586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f746006e0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f74600abfa0 tx=0x7f7458009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b617c832ce8266 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.546+0000 7f745e7fc700 1 -- 172.21.15.86:0/3145330586 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745800e070 con 0x7f7460068aa0 2023-10-09T11:42:28.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.546+0000 7f745e7fc700 1 -- 172.21.15.86:0/3145330586 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745800ba10 con 0x7f7460068aa0 2023-10-09T11:42:28.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.546+0000 7f745e7fc700 1 -- 172.21.15.86:0/3145330586 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580092e0 con 0x7f7460068aa0 2023-10-09T11:42:28.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.546+0000 7f74655ff700 1 -- 172.21.15.86:0/3145330586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 msgr2=0x7f746006e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.546+0000 7f74655ff700 1 --2- 172.21.15.86:0/3145330586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f746006e0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f74600abfa0 tx=0x7f7458009840 comp rx=0 tx=0).stop 2023-10-09T11:42:28.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.547+0000 7f74655ff700 1 -- 172.21.15.86:0/3145330586 shutdown_connections 2023-10-09T11:42:28.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.547+0000 7f74655ff700 1 --2- 172.21.15.86:0/3145330586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f746006e0b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.547+0000 7f74655ff700 1 --2- 172.21.15.86:0/3145330586 >> v2:172.21.15.135:3300/0 conn(0x7f7460157740 0x7f74600adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.547+0000 7f74655ff700 1 -- 172.21.15.86:0/3145330586 >> 172.21.15.86:0/3145330586 conn(0x7f74600c8f90 msgr2=0x7f74600c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.547+0000 7f74655ff700 1 -- 172.21.15.86:0/3145330586 shutdown_connections 2023-10-09T11:42:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.547+0000 7f74655ff700 1 -- 172.21.15.86:0/3145330586 wait complete. 2023-10-09T11:42:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.548+0000 7f74655ff700 1 Processor -- start 2023-10-09T11:42:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.548+0000 7f74655ff700 1 -- start start 2023-10-09T11:42:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f74655ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f74600a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f74655ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74600b2100 0x7f74600c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f74655ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7460157740 0x7f74600af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f74655ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600a9fe0 con 0x7f7460068aa0 2023-10-09T11:42:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f74655ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600aa2c0 con 0x7f7460157740 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f74655ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600aa5a0 con 0x7f74600b2100 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f745effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f74600a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f745effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f74600a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51278/0 (socket says 172.21.15.86:51278) 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.549+0000 7f745effd700 1 -- 172.21.15.86:0/1240400944 learned_addr learned my addr 172.21.15.86:0/1240400944 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745f7fe700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7460157740 0x7f74600af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745effd700 1 -- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74600b2100 msgr2=0x7f74600c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f7457fff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74600b2100 0x7f74600c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745effd700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74600b2100 0x7f74600c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745effd700 1 -- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7460157740 msgr2=0x7f74600af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745effd700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7460157740 0x7f74600af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745effd700 1 -- 172.21.15.86:0/1240400944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7458009ae0 con 0x7f7460068aa0 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745f7fe700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7460157740 0x7f74600af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f7457fff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74600b2100 0x7f74600c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f745effd700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f74600a98e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f745000d860 tx=0x7f7450008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f7456ffd700 1 -- 172.21.15.86:0/1240400944 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500125f0 con 0x7f7460068aa0 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f7456ffd700 1 -- 172.21.15.86:0/1240400944 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7450012750 con 0x7f7460068aa0 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74600aa880 con 0x7f7460068aa0 2023-10-09T11:42:28.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f7456ffd700 1 -- 172.21.15.86:0/1240400944 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7450012b10 con 0x7f7460068aa0 2023-10-09T11:42:28.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.550+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74600c8550 con 0x7f7460068aa0 2023-10-09T11:42:28.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.551+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74600718b0 con 0x7f7460068aa0 2023-10-09T11:42:28.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.552+0000 7f7456ffd700 1 -- 172.21.15.86:0/1240400944 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f745001e460 con 0x7f7460068aa0 2023-10-09T11:42:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.553+0000 7f7456ffd700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7440067130 0x7f74400695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.553+0000 7f7456ffd700 1 -- 172.21.15.86:0/1240400944 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f74500850e0 con 0x7f7460068aa0 2023-10-09T11:42:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.553+0000 7f7457fff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7440067130 0x7f74400695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.554+0000 7f7457fff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7440067130 0x7f74400695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7448002880 tx=0x7f7448009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.557+0000 7f7456ffd700 1 -- 172.21.15.86:0/1240400944 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74500559c0 con 0x7f7460068aa0 2023-10-09T11:42:28.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.775+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f74600aa430 con 0x7f7440067130 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.853+0000 7f7456ffd700 1 -- 172.21.15.86:0/1240400944 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f74600aa430 con 0x7f7440067130 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir7 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7440067130 msgr2=0x7f74400695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7440067130 0x7f74400695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7448002880 tx=0x7f7448009040 comp rx=0 tx=0).stop 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 msgr2=0x7f74600a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f74600a98e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f745000d860 tx=0x7f7450008040 comp rx=0 tx=0).stop 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 shutdown_connections 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7440067130 0x7f74400695e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7460068aa0 0x7f74600a98e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7460157740 0x7f74600af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 --2- 172.21.15.86:0/1240400944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74600b2100 0x7f74600c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 >> 172.21.15.86:0/1240400944 conn(0x7f74600c8f90 msgr2=0x7f74600caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 shutdown_connections 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:28.855+0000 7f74655ff700 1 -- 172.21.15.86:0/1240400944 wait complete. 2023-10-09T11:42:28.874 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:28.874 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-10-09T11:42:28.912 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T11:42:29.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.136+0000 7f4b0739d700 1 Processor -- start 2023-10-09T11:42:29.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.137+0000 7f4b0739d700 1 -- start start 2023-10-09T11:42:29.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b0739d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b000b0760 0x7f4b000b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b0739d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b000ace60 0x7f4b000ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b0739d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b000b1110 con 0x7f4b00156350 2023-10-09T11:42:29.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b0739d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b000b0570 con 0x7f4b000ace60 2023-10-09T11:42:29.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b0739d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b000af4d0 con 0x7f4b000b0760 2023-10-09T11:42:29.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b06b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b000ace60 0x7f4b000ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b06b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b000ace60 0x7f4b000ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51282/0 (socket says 172.21.15.86:51282) 2023-10-09T11:42:29.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b06b9c700 1 -- 172.21.15.86:0/1770140907 learned_addr learned my addr 172.21.15.86:0/1770140907 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:29.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.138+0000 7f4b05b9a700 1 --2- 172.21.15.86:0/1770140907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b000b0760 0x7f4b000b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b06b9c700 1 -- 172.21.15.86:0/1770140907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b000b0760 msgr2=0x7f4b000b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b06b9c700 1 --2- 172.21.15.86:0/1770140907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b000b0760 0x7f4b000b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b06b9c700 1 -- 172.21.15.86:0/1770140907 >> v1:172.21.15.135:6789/0 conn(0x7f4b00156350 legacy=0x7f4b00157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b06b9c700 1 -- 172.21.15.86:0/1770140907 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b000af7b0 con 0x7f4b000ace60 2023-10-09T11:42:29.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b06b9c700 1 --2- 172.21.15.86:0/1770140907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b000ad2a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009f20 tx=0x7f4af8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c62d51887d9e59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b05399700 1 -- 172.21.15.86:0/1770140907 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800e070 con 0x7f4b000ace60 2023-10-09T11:42:29.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b05399700 1 -- 172.21.15.86:0/1770140907 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800ba80 con 0x7f4b000ace60 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.139+0000 7f4b05399700 1 -- 172.21.15.86:0/1770140907 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80092e0 con 0x7f4b000ace60 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 -- 172.21.15.86:0/1770140907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 msgr2=0x7f4b000ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 --2- 172.21.15.86:0/1770140907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b000ad2a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009f20 tx=0x7f4af8009840 comp rx=0 tx=0).stop 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 -- 172.21.15.86:0/1770140907 shutdown_connections 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 --2- 172.21.15.86:0/1770140907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b000ad2a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 --2- 172.21.15.86:0/1770140907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b000b0760 0x7f4b000b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 -- 172.21.15.86:0/1770140907 >> 172.21.15.86:0/1770140907 conn(0x7f4b00068e20 msgr2=0x7f4b000cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 -- 172.21.15.86:0/1770140907 shutdown_connections 2023-10-09T11:42:29.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.140+0000 7f4b0739d700 1 -- 172.21.15.86:0/1770140907 wait complete. 2023-10-09T11:42:29.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.141+0000 7f4b0739d700 1 Processor -- start 2023-10-09T11:42:29.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.141+0000 7f4b0739d700 1 -- start start 2023-10-09T11:42:29.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.142+0000 7f4b0739d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b0013d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.142+0000 7f4b0739d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b000b0760 0x7f4b0015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.142+0000 7f4b0739d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b00156350 0x7f4b0015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.142+0000 7f4b0739d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0016a2a0 con 0x7f4b000ace60 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.142+0000 7f4b0739d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b000a98d0 con 0x7f4b000b0760 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.142+0000 7f4b0739d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0015ed60 con 0x7f4b00156350 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b0013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b0013d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51288/0 (socket says 172.21.15.86:51288) 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 -- 172.21.15.86:0/3931422837 learned_addr learned my addr 172.21.15.86:0/3931422837 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 -- 172.21.15.86:0/3931422837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b00156350 msgr2=0x7f4b0015c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b00156350 0x7f4b0015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 -- 172.21.15.86:0/3931422837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b000b0760 msgr2=0x7f4b0015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b000b0760 0x7f4b0015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 -- 172.21.15.86:0/3931422837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8009ae0 con 0x7f4b000ace60 2023-10-09T11:42:29.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0639b700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b0013d550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00c4e0 tx=0x7f4afc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4af67fc700 1 -- 172.21.15.86:0/3931422837 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc011590 con 0x7f4b000ace60 2023-10-09T11:42:29.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4af67fc700 1 -- 172.21.15.86:0/3931422837 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc011710 con 0x7f4b000ace60 2023-10-09T11:42:29.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4af67fc700 1 -- 172.21.15.86:0/3931422837 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc011ad0 con 0x7f4b000ace60 2023-10-09T11:42:29.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.143+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0015f040 con 0x7f4b000ace60 2023-10-09T11:42:29.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.144+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b000a9e70 con 0x7f4b000ace60 2023-10-09T11:42:29.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.144+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0004c3c0 con 0x7f4b000ace60 2023-10-09T11:42:29.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.145+0000 7f4af67fc700 1 -- 172.21.15.86:0/3931422837 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f4afc01b3b0 con 0x7f4b000ace60 2023-10-09T11:42:29.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.147+0000 7f4af67fc700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ae4067130 0x7f4ae40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.147+0000 7f4af67fc700 1 -- 172.21.15.86:0/3931422837 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4afc083fa0 con 0x7f4b000ace60 2023-10-09T11:42:29.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.147+0000 7f4b05b9a700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ae4067130 0x7f4ae40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.147+0000 7f4b05b9a700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ae4067130 0x7f4ae40695e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4b00167b20 tx=0x7f4af0008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.151+0000 7f4af67fc700 1 -- 172.21.15.86:0/3931422837 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4afc050df0 con 0x7f4b000ace60 2023-10-09T11:42:29.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.366+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b000afa90 con 0x7f4ae4067130 2023-10-09T11:42:29.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.427+0000 7f4af67fc700 1 -- 172.21.15.86:0/3931422837 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4b000afa90 con 0x7f4ae4067130 2023-10-09T11:42:29.428 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir8 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ae4067130 msgr2=0x7f4ae40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ae4067130 0x7f4ae40695e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4b00167b20 tx=0x7f4af0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 msgr2=0x7f4b0013d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b0013d550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00c4e0 tx=0x7f4afc00c8a0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 shutdown_connections 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ae4067130 0x7f4ae40695e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b000ace60 0x7f4b0013d550 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b00156350 0x7f4b0015c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 --2- 172.21.15.86:0/3931422837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b000b0760 0x7f4b0015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 >> 172.21.15.86:0/3931422837 conn(0x7f4b00068e20 msgr2=0x7f4b000adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 shutdown_connections 2023-10-09T11:42:29.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.429+0000 7f4b0739d700 1 -- 172.21.15.86:0/3931422837 wait complete. 2023-10-09T11:42:29.448 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-10-09T11:42:29.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:29.448 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-10-09T11:42:29.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T11:42:29.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.715+0000 7f0638bff700 1 Processor -- start 2023-10-09T11:42:29.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.715+0000 7f0638bff700 1 -- start start 2023-10-09T11:42:29.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.716+0000 7f0638bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06341563b0 0x7f0634156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.716+0000 7f0638bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f063415a440 0x7f06340acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.716+0000 7f0638bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0634068890 0x7f06340c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.716+0000 7f0638bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063415a9b0 con 0x7f0634068890 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0638bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063415ac90 con 0x7f063415a440 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0638bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063415af70 con 0x7f06341563b0 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0634068890 0x7f06340c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0634068890 0x7f06340c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51294/0 (socket says 172.21.15.86:51294) 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 -- 172.21.15.86:0/1817588707 learned_addr learned my addr 172.21.15.86:0/1817588707 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0631d9b700 1 --2- 172.21.15.86:0/1817588707 >> v2:172.21.15.135:3300/0 conn(0x7f063415a440 0x7f06340acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f063259c700 1 --2- 172.21.15.86:0/1817588707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06341563b0 0x7f0634156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 -- 172.21.15.86:0/1817588707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06341563b0 msgr2=0x7f0634156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 --2- 172.21.15.86:0/1817588707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06341563b0 0x7f0634156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 -- 172.21.15.86:0/1817588707 >> v2:172.21.15.135:3300/0 conn(0x7f063415a440 msgr2=0x7f06340acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 --2- 172.21.15.86:0/1817588707 >> v2:172.21.15.135:3300/0 conn(0x7f063415a440 0x7f06340acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 -- 172.21.15.86:0/1817588707 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063415b250 con 0x7f0634068890 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0631d9b700 1 --2- 172.21.15.86:0/1817588707 >> v2:172.21.15.135:3300/0 conn(0x7f063415a440 0x7f06340acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.717+0000 7f0632d9d700 1 --2- 172.21.15.86:0/1817588707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0634068890 0x7f06340c8230 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f063406aa20 tx=0x7f062c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9f978aaeb00c66 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f063159a700 1 -- 172.21.15.86:0/1817588707 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00e070 con 0x7f0634068890 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f063159a700 1 -- 172.21.15.86:0/1817588707 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00ba50 con 0x7f0634068890 2023-10-09T11:42:29.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f063159a700 1 -- 172.21.15.86:0/1817588707 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0092e0 con 0x7f0634068890 2023-10-09T11:42:29.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 -- 172.21.15.86:0/1817588707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0634068890 msgr2=0x7f06340c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 --2- 172.21.15.86:0/1817588707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0634068890 0x7f06340c8230 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f063406aa20 tx=0x7f062c009840 comp rx=0 tx=0).stop 2023-10-09T11:42:29.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 -- 172.21.15.86:0/1817588707 shutdown_connections 2023-10-09T11:42:29.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 --2- 172.21.15.86:0/1817588707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0634068890 0x7f06340c8230 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 --2- 172.21.15.86:0/1817588707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06341563b0 0x7f0634156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 --2- 172.21.15.86:0/1817588707 >> v2:172.21.15.135:3300/0 conn(0x7f063415a440 0x7f06340acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 -- 172.21.15.86:0/1817588707 >> 172.21.15.86:0/1817588707 conn(0x7f06340c8f90 msgr2=0x7f06340c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 -- 172.21.15.86:0/1817588707 shutdown_connections 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.718+0000 7f0638bff700 1 -- 172.21.15.86:0/1817588707 wait complete. 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.720+0000 7f0638bff700 1 Processor -- start 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.720+0000 7f0638bff700 1 -- start start 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0638bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0634068890 0x7f0634155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0638bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06341563b0 0x7f06340cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0638bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063415a440 0x7f06340ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0638bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c28c0 con 0x7f06341563b0 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0638bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c1c40 con 0x7f063415a440 2023-10-09T11:42:29.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0638bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c1f20 con 0x7f0634068890 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06341563b0 0x7f06340cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06341563b0 0x7f06340cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51304/0 (socket says 172.21.15.86:51304) 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 -- 172.21.15.86:0/2275426870 learned_addr learned my addr 172.21.15.86:0/2275426870 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f063259c700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0634068890 0x7f0634155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0632d9d700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063415a440 0x7f06340ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 -- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0634068890 msgr2=0x7f0634155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0634068890 0x7f0634155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 -- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063415a440 msgr2=0x7f06340ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063415a440 0x7f06340ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.721+0000 7f0631d9b700 1 -- 172.21.15.86:0/2275426870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c009ae0 con 0x7f06341563b0 2023-10-09T11:42:29.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.722+0000 7f0631d9b700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06341563b0 0x7f06340cca40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f062800d860 tx=0x7f0628008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.722+0000 7f06227fc700 1 -- 172.21.15.86:0/2275426870 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06280125f0 con 0x7f06341563b0 2023-10-09T11:42:29.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.722+0000 7f06227fc700 1 -- 172.21.15.86:0/2275426870 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0628012750 con 0x7f06341563b0 2023-10-09T11:42:29.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.722+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06340c2200 con 0x7f06341563b0 2023-10-09T11:42:29.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.722+0000 7f06227fc700 1 -- 172.21.15.86:0/2275426870 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628012ad0 con 0x7f06341563b0 2023-10-09T11:42:29.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.722+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06340c0f10 con 0x7f06341563b0 2023-10-09T11:42:29.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.723+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06340ac830 con 0x7f06341563b0 2023-10-09T11:42:29.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.724+0000 7f06227fc700 1 -- 172.21.15.86:0/2275426870 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f062801e460 con 0x7f06341563b0 2023-10-09T11:42:29.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.725+0000 7f06227fc700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0614067130 0x7f06140695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.725+0000 7f06227fc700 1 -- 172.21.15.86:0/2275426870 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0628085120 con 0x7f06341563b0 2023-10-09T11:42:29.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.725+0000 7f063259c700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0614067130 0x7f06140695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.726+0000 7f063259c700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0614067130 0x7f06140695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0624006fd0 tx=0x7f0624008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.729+0000 7f06227fc700 1 -- 172.21.15.86:0/2275426870 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0628055a00 con 0x7f06341563b0 2023-10-09T11:42:29.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:29.943+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f06340718b0 con 0x7f0614067130 2023-10-09T11:42:30.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.016+0000 7f06227fc700 1 -- 172.21.15.86:0/2275426870 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f06340718b0 con 0x7f0614067130 2023-10-09T11:42:30.018 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/dir9 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0614067130 msgr2=0x7f06140695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0614067130 0x7f06140695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0624006fd0 tx=0x7f0624008040 comp rx=0 tx=0).stop 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06341563b0 msgr2=0x7f06340cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06341563b0 0x7f06340cca40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f062800d860 tx=0x7f0628008040 comp rx=0 tx=0).stop 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 shutdown_connections 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0614067130 0x7f06140695e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f063415a440 0x7f06340ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0634068890 0x7f0634155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 --2- 172.21.15.86:0/2275426870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06341563b0 0x7f06340cca40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 >> 172.21.15.86:0/2275426870 conn(0x7f06340c8f90 msgr2=0x7f06340c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 shutdown_connections 2023-10-09T11:42:30.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.019+0000 7f0638bff700 1 -- 172.21.15.86:0/2275426870 wait complete. 2023-10-09T11:42:30.038 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-10-09T11:42:30.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T11:42:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.223+0000 7f2a44f9d700 1 Processor -- start 2023-10-09T11:42:30.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.223+0000 7f2a44f9d700 1 -- start start 2023-10-09T11:42:30.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.224+0000 7f2a44f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2a4015a8c0 0x7f2a4015d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.224+0000 7f2a44f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2a400a9fe0 0x7f2a4015d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.224+0000 7f2a44f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a400aa4b0 con 0x7f2a401594e0 2023-10-09T11:42:30.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.224+0000 7f2a44f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400ab130 con 0x7f2a4015a8c0 2023-10-09T11:42:30.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.224+0000 7f2a44f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4015e0b0 con 0x7f2a400a9fe0 2023-10-09T11:42:30.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.224+0000 7f2a3effd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2a4015a8c0 0x7f2a4015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3effd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2a4015a8c0 0x7f2a4015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51318/0 (socket says 172.21.15.86:51318) 2023-10-09T11:42:30.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3effd700 1 -- 172.21.15.86:0/3352822587 learned_addr learned my addr 172.21.15.86:0/3352822587 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:30.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3ffff700 1 --2- 172.21.15.86:0/3352822587 >> v2:172.21.15.135:3300/0 conn(0x7f2a400a9fe0 0x7f2a4015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3effd700 1 -- 172.21.15.86:0/3352822587 >> v2:172.21.15.135:3300/0 conn(0x7f2a400a9fe0 msgr2=0x7f2a4015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:30.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3effd700 1 --2- 172.21.15.86:0/3352822587 >> v2:172.21.15.135:3300/0 conn(0x7f2a400a9fe0 0x7f2a4015d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3effd700 1 -- 172.21.15.86:0/3352822587 >> v1:172.21.15.135:6789/0 conn(0x7f2a401594e0 legacy=0x7f2a400a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3effd700 1 -- 172.21.15.86:0/3352822587 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400aa790 con 0x7f2a4015a8c0 2023-10-09T11:42:30.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.225+0000 7f2a3effd700 1 --2- 172.21.15.86:0/3352822587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a4015a8c0 0x7f2a4015d250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2a400695c0 tx=0x7f2a34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f421d11be26fce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a3e7fc700 1 -- 172.21.15.86:0/3352822587 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34009e70 con 0x7f2a4015a8c0 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a3e7fc700 1 -- 172.21.15.86:0/3352822587 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400b8f0 con 0x7f2a4015a8c0 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a3e7fc700 1 -- 172.21.15.86:0/3352822587 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400bc90 con 0x7f2a4015a8c0 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 -- 172.21.15.86:0/3352822587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a4015a8c0 msgr2=0x7f2a4015d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/3352822587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a4015a8c0 0x7f2a4015d250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2a400695c0 tx=0x7f2a34009250 comp rx=0 tx=0).stop 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 -- 172.21.15.86:0/3352822587 shutdown_connections 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/3352822587 >> v2:172.21.15.135:3300/0 conn(0x7f2a400a9fe0 0x7f2a4015d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/3352822587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a4015a8c0 0x7f2a4015d250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 -- 172.21.15.86:0/3352822587 >> 172.21.15.86:0/3352822587 conn(0x7f2a40068e20 msgr2=0x7f2a400cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 -- 172.21.15.86:0/3352822587 shutdown_connections 2023-10-09T11:42:30.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.226+0000 7f2a44f9d700 1 -- 172.21.15.86:0/3352822587 wait complete. 2023-10-09T11:42:30.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.228+0000 7f2a44f9d700 1 Processor -- start 2023-10-09T11:42:30.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.228+0000 7f2a44f9d700 1 -- start start 2023-10-09T11:42:30.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a44f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a400a9fe0 0x7f2a40143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a44f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a401594e0 0x7f2a400b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a44f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a4015a8c0 0x7f2a400b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a44f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4016d9f0 con 0x7f2a400a9fe0 2023-10-09T11:42:30.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a44f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a401554d0 con 0x7f2a4015a8c0 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a44f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4016d0c0 con 0x7f2a401594e0 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a400a9fe0 0x7f2a40143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a400a9fe0 0x7f2a40143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51330/0 (socket says 172.21.15.86:51330) 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 -- 172.21.15.86:0/98045430 learned_addr learned my addr 172.21.15.86:0/98045430 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3effd700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a401594e0 0x7f2a400b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3ffff700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a4015a8c0 0x7f2a400b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 -- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a401594e0 msgr2=0x7f2a400b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a401594e0 0x7f2a400b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 -- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a4015a8c0 msgr2=0x7f2a400b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a4015a8c0 0x7f2a400b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.229+0000 7f2a3f7fe700 1 -- 172.21.15.86:0/98045430 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a340094f0 con 0x7f2a400a9fe0 2023-10-09T11:42:30.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.230+0000 7f2a3f7fe700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a400a9fe0 0x7f2a40143ac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000c590 tx=0x7f2a3000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.230+0000 7f2a277fe700 1 -- 172.21.15.86:0/98045430 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30011590 con 0x7f2a400a9fe0 2023-10-09T11:42:30.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.230+0000 7f2a277fe700 1 -- 172.21.15.86:0/98045430 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30011710 con 0x7f2a400a9fe0 2023-10-09T11:42:30.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.230+0000 7f2a277fe700 1 -- 172.21.15.86:0/98045430 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30011ad0 con 0x7f2a400a9fe0 2023-10-09T11:42:30.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.230+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4016d3a0 con 0x7f2a400a9fe0 2023-10-09T11:42:30.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.230+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a40144000 con 0x7f2a400a9fe0 2023-10-09T11:42:30.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.231+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a40144190 con 0x7f2a400a9fe0 2023-10-09T11:42:30.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.232+0000 7f2a277fe700 1 -- 172.21.15.86:0/98045430 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f2a3001b3b0 con 0x7f2a400a9fe0 2023-10-09T11:42:30.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.233+0000 7f2a277fe700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2a2c067130 0x7f2a2c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.233+0000 7f2a277fe700 1 -- 172.21.15.86:0/98045430 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f2a30083ec0 con 0x7f2a400a9fe0 2023-10-09T11:42:30.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.233+0000 7f2a3effd700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2a2c067130 0x7f2a2c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.234+0000 7f2a3effd700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2a2c067130 0x7f2a2c0695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a400642c0 tx=0x7f2a34017000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.237+0000 7f2a277fe700 1 -- 172.21.15.86:0/98045430 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a30050d10 con 0x7f2a400a9fe0 2023-10-09T11:42:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.451+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a4016db30 con 0x7f2a2c067130 2023-10-09T11:42:30.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.502+0000 7f2a277fe700 1 -- 172.21.15.86:0/98045430 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2a34000d00 con 0x7f2a2c067130 2023-10-09T11:42:30.503 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2a2c067130 msgr2=0x7f2a2c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2a2c067130 0x7f2a2c0695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a400642c0 tx=0x7f2a34017000 comp rx=0 tx=0).stop 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a400a9fe0 msgr2=0x7f2a40143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a400a9fe0 0x7f2a40143ac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000c590 tx=0x7f2a3000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 shutdown_connections 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2a2c067130 0x7f2a2c0695e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a400a9fe0 0x7f2a40143ac0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a4015a8c0 0x7f2a400b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 --2- 172.21.15.86:0/98045430 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a401594e0 0x7f2a400b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 >> 172.21.15.86:0/98045430 conn(0x7f2a40068e20 msgr2=0x7f2a40158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 shutdown_connections 2023-10-09T11:42:30.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.504+0000 7f2a44f9d700 1 -- 172.21.15.86:0/98045430 wait complete. 2023-10-09T11:42:30.523 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-10-09T11:42:30.523 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T11:42:30.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.708+0000 7f7871d9d700 1 Processor -- start 2023-10-09T11:42:30.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.708+0000 7f7871d9d700 1 -- start start 2023-10-09T11:42:30.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.709+0000 7f7871d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.709+0000 7f7871d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f786c0b0760 0x7f786c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.709+0000 7f7871d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c0b1110 con 0x7f786c159f20 2023-10-09T11:42:30.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.709+0000 7f7871d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0b0570 con 0x7f786c0b0760 2023-10-09T11:42:30.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.709+0000 7f7871d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c1578b0 con 0x7f786c156350 2023-10-09T11:42:30.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f7870d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f786c0b0760 0x7f786c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f786c0b0760 0x7f786c0b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:56496/0 (socket says 172.21.15.86:56496) 2023-10-09T11:42:30.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f7870d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:39804/0 (socket says 172.21.15.86:39804) 2023-10-09T11:42:30.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 -- 172.21.15.86:0/2631621987 learned_addr learned my addr 172.21.15.86:0/2631621987 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:30.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 -- 172.21.15.86:0/2631621987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 msgr2=0x7f786c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 --2- 172.21.15.86:0/2631621987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 -- 172.21.15.86:0/2631621987 >> v1:172.21.15.135:6789/0 conn(0x7f786c159f20 legacy=0x7f786c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 -- 172.21.15.86:0/2631621987 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0af4d0 con 0x7f786c0b0760 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.710+0000 7f786bfff700 1 --2- 172.21.15.86:0/2631621987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 0x7f786c0b0bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f78580099b0 tx=0x7f7858009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05162b83d0e06f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f786b7fe700 1 -- 172.21.15.86:0/2631621987 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858009ea0 con 0x7f786c0b0760 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f786b7fe700 1 -- 172.21.15.86:0/2631621987 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800b860 con 0x7f786c0b0760 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f786b7fe700 1 -- 172.21.15.86:0/2631621987 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800bc00 con 0x7f786c0b0760 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 -- 172.21.15.86:0/2631621987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 msgr2=0x7f786c0b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2631621987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 0x7f786c0b0bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f78580099b0 tx=0x7f7858009250 comp rx=0 tx=0).stop 2023-10-09T11:42:30.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 -- 172.21.15.86:0/2631621987 shutdown_connections 2023-10-09T11:42:30.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2631621987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2631621987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 0x7f786c0b0bd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 -- 172.21.15.86:0/2631621987 >> 172.21.15.86:0/2631621987 conn(0x7f786c068e20 msgr2=0x7f786c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 -- 172.21.15.86:0/2631621987 shutdown_connections 2023-10-09T11:42:30.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.711+0000 7f7871d9d700 1 -- 172.21.15.86:0/2631621987 wait complete. 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.713+0000 7f7871d9d700 1 Processor -- start 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.713+0000 7f7871d9d700 1 -- start start 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f7871d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 0x7f786c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f7871d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f7871d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f786c159f20 0x7f786c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f7871d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0caa20 con 0x7f786c159f20 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f7871d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0ca0f0 con 0x7f786c0b0760 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f7871d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0ca3d0 con 0x7f786c156350 2023-10-09T11:42:30.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f787159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f786c159f20 0x7f786c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f787159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f786c159f20 0x7f786c0cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51332/0 (socket says 172.21.15.86:51332) 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f787159c700 1 -- 172.21.15.86:0/2396275170 learned_addr learned my addr 172.21.15.86:0/2396275170 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f7870d9b700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 0x7f786c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.714+0000 7f786bfff700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f787159c700 1 -- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 msgr2=0x7f786c0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f787159c700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f787159c700 1 -- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 msgr2=0x7f786c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f787159c700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 0x7f786c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f787159c700 1 -- 172.21.15.86:0/2396275170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580094f0 con 0x7f786c159f20 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f787159c700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f786c159f20 0x7f786c0cb3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f786400c560 tx=0x7f7864007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f7868ff9700 1 -- 172.21.15.86:0/2396275170 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864011590 con 0x7f786c159f20 2023-10-09T11:42:30.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f7868ff9700 1 -- 172.21.15.86:0/2396275170 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78640116f0 con 0x7f786c159f20 2023-10-09T11:42:30.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c0ca6b0 con 0x7f786c159f20 2023-10-09T11:42:30.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f7868ff9700 1 -- 172.21.15.86:0/2396275170 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864011ab0 con 0x7f786c159f20 2023-10-09T11:42:30.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.715+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c14fa90 con 0x7f786c159f20 2023-10-09T11:42:30.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.716+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c0cab90 con 0x7f786c159f20 2023-10-09T11:42:30.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.717+0000 7f7868ff9700 1 -- 172.21.15.86:0/2396275170 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f786401b3b0 con 0x7f786c159f20 2023-10-09T11:42:30.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.718+0000 7f7868ff9700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7850067130 0x7f78500695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:30.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.718+0000 7f7868ff9700 1 -- 172.21.15.86:0/2396275170 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f7864083e10 con 0x7f786c159f20 2023-10-09T11:42:30.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.718+0000 7f7870d9b700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7850067130 0x7f78500695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:30.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.719+0000 7f7870d9b700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7850067130 0x7f78500695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f786000bfd0 tx=0x7f786000d040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:30.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.722+0000 7f7868ff9700 1 -- 172.21.15.86:0/2396275170 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7864087030 con 0x7f786c159f20 2023-10-09T11:42:30.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.938+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f786c04c3c0 con 0x7f7850067130 2023-10-09T11:42:30.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.987+0000 7f7868ff9700 1 -- 172.21.15.86:0/2396275170 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f786c04c3c0 con 0x7f7850067130 2023-10-09T11:42:30.990 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-10-09T11:42:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7850067130 msgr2=0x7f78500695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7850067130 0x7f78500695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f786000bfd0 tx=0x7f786000d040 comp rx=0 tx=0).stop 2023-10-09T11:42:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f786c159f20 msgr2=0x7f786c0cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:30.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f786c159f20 0x7f786c0cb3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f786400c560 tx=0x7f7864007ef0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 shutdown_connections 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7850067130 0x7f78500695e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f786c159f20 0x7f786c0cb3f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f786c0b0760 0x7f786c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 --2- 172.21.15.86:0/2396275170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f786c156350 0x7f786c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 >> 172.21.15.86:0/2396275170 conn(0x7f786c068e20 msgr2=0x7f786c1552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 shutdown_connections 2023-10-09T11:42:30.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:30.989+0000 7f7871d9d700 1 -- 172.21.15.86:0/2396275170 wait complete. 2023-10-09T11:42:31.008 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-10-09T11:42:31.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T11:42:31.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.193+0000 7f87d959d700 1 Processor -- start 2023-10-09T11:42:31.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.193+0000 7f87d959d700 1 -- start start 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d959d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4153480 0x7f87d40ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d959d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87d4153850 0x7f87d41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d959d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87d4159bf0 0x7f87d41560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d959d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d415a050 con 0x7f87d4159bf0 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d959d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40aec90 con 0x7f87d4153850 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d959d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d415a480 con 0x7f87d4153480 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d8d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87d4159bf0 0x7f87d41560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d8d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87d4159bf0 0x7f87d41560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51340/0 (socket says 172.21.15.86:51340) 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d8d9c700 1 -- 172.21.15.86:0/3410262890 learned_addr learned my addr 172.21.15.86:0/3410262890 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d3fff700 1 --2- 172.21.15.86:0/3410262890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4153480 0x7f87d40ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.194+0000 7f87d37fe700 1 --2- 172.21.15.86:0/3410262890 >> v2:172.21.15.135:3300/0 conn(0x7f87d4153850 0x7f87d41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d8d9c700 1 -- 172.21.15.86:0/3410262890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4153480 msgr2=0x7f87d40ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d8d9c700 1 --2- 172.21.15.86:0/3410262890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4153480 0x7f87d40ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d8d9c700 1 -- 172.21.15.86:0/3410262890 >> v2:172.21.15.135:3300/0 conn(0x7f87d4153850 msgr2=0x7f87d41596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d8d9c700 1 --2- 172.21.15.86:0/3410262890 >> v2:172.21.15.135:3300/0 conn(0x7f87d4153850 0x7f87d41596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d8d9c700 1 -- 172.21.15.86:0/3410262890 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40afb40 con 0x7f87d4159bf0 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d8d9c700 1 --2- 172.21.15.86:0/3410262890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4159bf0 0x7f87d41560b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f87d4070f40 tx=0x7f87cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87aef9054203e12a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d2ffd700 1 -- 172.21.15.86:0/3410262890 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00e070 con 0x7f87d4159bf0 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d2ffd700 1 -- 172.21.15.86:0/3410262890 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc00b970 con 0x7f87d4159bf0 2023-10-09T11:42:31.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.195+0000 7f87d2ffd700 1 -- 172.21.15.86:0/3410262890 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0092e0 con 0x7f87d4159bf0 2023-10-09T11:42:31.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 -- 172.21.15.86:0/3410262890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4159bf0 msgr2=0x7f87d41560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 --2- 172.21.15.86:0/3410262890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4159bf0 0x7f87d41560b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f87d4070f40 tx=0x7f87cc009840 comp rx=0 tx=0).stop 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 -- 172.21.15.86:0/3410262890 shutdown_connections 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 --2- 172.21.15.86:0/3410262890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4159bf0 0x7f87d41560b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 --2- 172.21.15.86:0/3410262890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4153480 0x7f87d40ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 --2- 172.21.15.86:0/3410262890 >> v2:172.21.15.135:3300/0 conn(0x7f87d4153850 0x7f87d41596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 -- 172.21.15.86:0/3410262890 >> 172.21.15.86:0/3410262890 conn(0x7f87d4068e20 msgr2=0x7f87d40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 -- 172.21.15.86:0/3410262890 shutdown_connections 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.196+0000 7f87d959d700 1 -- 172.21.15.86:0/3410262890 wait complete. 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.197+0000 7f87d959d700 1 Processor -- start 2023-10-09T11:42:31.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.198+0000 7f87d959d700 1 -- start start 2023-10-09T11:42:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.198+0000 7f87d959d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4153480 0x7f87d4156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.198+0000 7f87d959d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87d4153850 0x7f87d4141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d959d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4159bf0 0x7f87d4144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d959d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d4142b10 con 0x7f87d4153480 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d959d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d41427e0 con 0x7f87d4153850 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d959d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d4149b80 con 0x7f87d4159bf0 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4153480 0x7f87d4156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4153480 0x7f87d4156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51356/0 (socket says 172.21.15.86:51356) 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 -- 172.21.15.86:0/3127931517 learned_addr learned my addr 172.21.15.86:0/3127931517 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d8d9c700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4159bf0 0x7f87d4144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d37fe700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87d4153850 0x7f87d4141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 -- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4159bf0 msgr2=0x7f87d4144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4159bf0 0x7f87d4144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 -- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87d4153850 msgr2=0x7f87d4141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87d4153850 0x7f87d4141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 -- 172.21.15.86:0/3127931517 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc009ae0 con 0x7f87d4153480 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d37fe700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87d4153850 0x7f87d4141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d8d9c700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4159bf0 0x7f87d4144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.199+0000 7f87d3fff700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4153480 0x7f87d4156b80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87c400ec80 tx=0x7f87c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.200+0000 7f87bbfff700 1 -- 172.21.15.86:0/3127931517 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400c9d0 con 0x7f87d4153480 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.200+0000 7f87bbfff700 1 -- 172.21.15.86:0/3127931517 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c400cb50 con 0x7f87d4153480 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.200+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d4149e60 con 0x7f87d4153480 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.200+0000 7f87bbfff700 1 -- 172.21.15.86:0/3127931517 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4013470 con 0x7f87d4153480 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.200+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d4141a80 con 0x7f87d4153480 2023-10-09T11:42:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.201+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d404c3c0 con 0x7f87d4153480 2023-10-09T11:42:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.202+0000 7f87bbfff700 1 -- 172.21.15.86:0/3127931517 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f87c4013860 con 0x7f87d4153480 2023-10-09T11:42:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.203+0000 7f87bbfff700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f87c0067130 0x7f87c00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.203+0000 7f87bbfff700 1 -- 172.21.15.86:0/3127931517 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f87c4084e20 con 0x7f87d4153480 2023-10-09T11:42:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.203+0000 7f87d37fe700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f87c0067130 0x7f87c00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.203+0000 7f87d37fe700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f87c0067130 0x7f87c00695e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87c8006f00 tx=0x7f87c8008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.207+0000 7f87bbfff700 1 -- 172.21.15.86:0/3127931517 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87c4051c70 con 0x7f87d4153480 2023-10-09T11:42:31.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.426+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f87d4142c50 con 0x7f87c0067130 2023-10-09T11:42:31.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.469+0000 7f87bbfff700 1 -- 172.21.15.86:0/3127931517 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f87c8009e40 con 0x7f87c0067130 2023-10-09T11:42:31.471 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-10-09T11:42:31.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f87c0067130 msgr2=0x7f87c00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f87c0067130 0x7f87c00695e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87c8006f00 tx=0x7f87c8008040 comp rx=0 tx=0).stop 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4153480 msgr2=0x7f87d4156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4153480 0x7f87d4156b80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87c400ec80 tx=0x7f87c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 shutdown_connections 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f87c0067130 0x7f87c00695e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87d4153480 0x7f87d4156b80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87d4159bf0 0x7f87d4144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 --2- 172.21.15.86:0/3127931517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87d4153850 0x7f87d4141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 >> 172.21.15.86:0/3127931517 conn(0x7f87d4068e20 msgr2=0x7f87d406ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 shutdown_connections 2023-10-09T11:42:31.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.472+0000 7f87d959d700 1 -- 172.21.15.86:0/3127931517 wait complete. 2023-10-09T11:42:31.491 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-10-09T11:42:31.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T11:42:31.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.677+0000 7f509519d700 1 Processor -- start 2023-10-09T11:42:31.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.677+0000 7f509519d700 1 -- start start 2023-10-09T11:42:31.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f509519d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50900b03c0 0x7f50900cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f509519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b0790 0x7f50900b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f509519d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50900cfa00 con 0x7f50901591e0 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f509519d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50900cb580 con 0x7f50900b03c0 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f509519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900b2de0 con 0x7f50900b0790 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f508ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50900b03c0 0x7f50900cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f509499c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f50901591e0 0x7f5090159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34004/0 (socket says 172.21.15.86:34004) 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f508ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50900b03c0 0x7f50900cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51360/0 (socket says 172.21.15.86:51360) 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.678+0000 7f509499c700 1 -- 172.21.15.86:0/1035996932 learned_addr learned my addr 172.21.15.86:0/1035996932 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508f7fe700 1 --2- 172.21.15.86:0/1035996932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b0790 0x7f50900b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508ffff700 1 -- 172.21.15.86:0/1035996932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b0790 msgr2=0x7f50900b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508ffff700 1 --2- 172.21.15.86:0/1035996932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b0790 0x7f50900b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508ffff700 1 -- 172.21.15.86:0/1035996932 >> v1:172.21.15.86:6789/0 conn(0x7f50901591e0 legacy=0x7f5090159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508ffff700 1 -- 172.21.15.86:0/1035996932 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900cf160 con 0x7f50900b03c0 2023-10-09T11:42:31.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508f7fe700 1 --2- 172.21.15.86:0/1035996932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b0790 0x7f50900b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:31.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508effd700 1 -- 172.21.15.86:0/1035996932 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250055408 0 0) 0x7f50900cfa00 con 0x7f50901591e0 2023-10-09T11:42:31.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508ffff700 1 --2- 172.21.15.86:0/1035996932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b03c0 0x7f50900cea70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f50800098e0 tx=0x7f50800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c4bcd8ab84195c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508effd700 1 -- 172.21.15.86:0/1035996932 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080009e80 con 0x7f50900b03c0 2023-10-09T11:42:31.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508effd700 1 -- 172.21.15.86:0/1035996932 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508000b860 con 0x7f50900b03c0 2023-10-09T11:42:31.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.679+0000 7f508effd700 1 -- 172.21.15.86:0/1035996932 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000bbe0 con 0x7f50900b03c0 2023-10-09T11:42:31.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 -- 172.21.15.86:0/1035996932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b03c0 msgr2=0x7f50900cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 --2- 172.21.15.86:0/1035996932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b03c0 0x7f50900cea70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f50800098e0 tx=0x7f50800091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 -- 172.21.15.86:0/1035996932 shutdown_connections 2023-10-09T11:42:31.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 --2- 172.21.15.86:0/1035996932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b03c0 0x7f50900cea70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 --2- 172.21.15.86:0/1035996932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b0790 0x7f50900b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 -- 172.21.15.86:0/1035996932 >> 172.21.15.86:0/1035996932 conn(0x7f5090063230 msgr2=0x7f5090063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 -- 172.21.15.86:0/1035996932 shutdown_connections 2023-10-09T11:42:31.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.680+0000 7f509519d700 1 -- 172.21.15.86:0/1035996932 wait complete. 2023-10-09T11:42:31.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.682+0000 7f509519d700 1 Processor -- start 2023-10-09T11:42:31.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.682+0000 7f509519d700 1 -- start start 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f509519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b03c0 0x7f5090145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f509519d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b0790 0x7f50900c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f509519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50901591e0 0x7f50900c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f509519d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c76d0 con 0x7f50900b0790 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f509519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c9de0 con 0x7f50901591e0 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f509519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900ca090 con 0x7f50900b03c0 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b0790 0x7f50900c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b0790 0x7f50900c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51364/0 (socket says 172.21.15.86:51364) 2023-10-09T11:42:31.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 -- 172.21.15.86:0/2808240049 learned_addr learned my addr 172.21.15.86:0/2808240049 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f509499c700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50901591e0 0x7f50900c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508ffff700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b03c0 0x7f5090145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 -- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b03c0 msgr2=0x7f5090145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b03c0 0x7f5090145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 -- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50901591e0 msgr2=0x7f50900c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50901591e0 0x7f50900c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.683+0000 7f508f7fe700 1 -- 172.21.15.86:0/2808240049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009420 con 0x7f50900b0790 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.684+0000 7f508f7fe700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b0790 0x7f50900c9360 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f508400e8d0 tx=0x7f5084008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.684+0000 7f5077fff700 1 -- 172.21.15.86:0/2808240049 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400ee70 con 0x7f50900b0790 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.684+0000 7f5077fff700 1 -- 172.21.15.86:0/2808240049 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508400c5e0 con 0x7f50900b0790 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.684+0000 7f5077fff700 1 -- 172.21.15.86:0/2808240049 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400c980 con 0x7f50900b0790 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.684+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50900ca370 con 0x7f50900b0790 2023-10-09T11:42:31.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.684+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50900ca930 con 0x7f50900b0790 2023-10-09T11:42:31.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.685+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509004c3c0 con 0x7f50900b0790 2023-10-09T11:42:31.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.688+0000 7f5077fff700 1 -- 172.21.15.86:0/2808240049 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f5084025480 con 0x7f50900b0790 2023-10-09T11:42:31.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.689+0000 7f5077fff700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f507c067130 0x7f507c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:31.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.689+0000 7f5077fff700 1 -- 172.21.15.86:0/2808240049 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5084084d90 con 0x7f50900b0790 2023-10-09T11:42:31.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.689+0000 7f508ffff700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f507c067130 0x7f507c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:31.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.690+0000 7f508ffff700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f507c067130 0x7f507c0695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50800091e0 tx=0x7f5080017000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:31.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.691+0000 7f5077fff700 1 -- 172.21.15.86:0/2808240049 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50840555e0 con 0x7f50900b0790 2023-10-09T11:42:31.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.908+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f50900cad50 con 0x7f507c067130 2023-10-09T11:42:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.961+0000 7f5077fff700 1 -- 172.21.15.86:0/2808240049 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f50900cad50 con 0x7f507c067130 2023-10-09T11:42:31.962 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-10-09T11:42:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f507c067130 msgr2=0x7f507c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f507c067130 0x7f507c0695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50800091e0 tx=0x7f5080017000 comp rx=0 tx=0).stop 2023-10-09T11:42:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b0790 msgr2=0x7f50900c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b0790 0x7f50900c9360 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f508400e8d0 tx=0x7f5084008040 comp rx=0 tx=0).stop 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 shutdown_connections 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f507c067130 0x7f507c0695e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50901591e0 0x7f50900c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50900b03c0 0x7f5090145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 --2- 172.21.15.86:0/2808240049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50900b0790 0x7f50900c9360 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 >> 172.21.15.86:0/2808240049 conn(0x7f5090063230 msgr2=0x7f50900b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.963+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 shutdown_connections 2023-10-09T11:42:31.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:31.964+0000 7f509519d700 1 -- 172.21.15.86:0/2808240049 wait complete. 2023-10-09T11:42:31.984 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-10-09T11:42:31.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T11:42:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.170+0000 7f1e0ffff700 1 Processor -- start 2023-10-09T11:42:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.170+0000 7f1e0ffff700 1 -- start start 2023-10-09T11:42:32.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.171+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 0x7f1e100ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.171+0000 7f1e0ffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e10157a50 con 0x7f1e1015bb30 2023-10-09T11:42:32.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.171+0000 7f1e0ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e10158f10 con 0x7f1e100cc8d0 2023-10-09T11:42:32.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.171+0000 7f1e0ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e101591b0 con 0x7f1e1015b050 2023-10-09T11:42:32.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.171+0000 7f1e0f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1e1015bb30 0x7f1e100ada30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34018/0 (socket says 172.21.15.86:34018) 2023-10-09T11:42:32.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.171+0000 7f1e0f7fe700 1 -- 172.21.15.86:0/2860818939 learned_addr learned my addr 172.21.15.86:0/2860818939 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:32.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0effd700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 0x7f1e100ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362223638 0 0) 0x7f1e10157a50 con 0x7f1e1015bb30 2023-10-09T11:42:32.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df8003570 con 0x7f1e1015bb30 2023-10-09T11:42:32.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2035546890 0 0) 0x7f1df8003570 con 0x7f1e1015bb30 2023-10-09T11:42:32.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 msgr2=0x7f1e100ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:32.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 0x7f1e100ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 >> v1:172.21.15.135:6789/0 conn(0x7f1e100cc8d0 legacy=0x7f1e1015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100ca9e0 con 0x7f1e1015bb30 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f1e08001470 con 0x7f1e1015bb30 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 >> v1:172.21.15.86:6789/0 conn(0x7f1e1015bb30 legacy=0x7f1e100ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 0x7f1df8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1df8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df8004d50 0x7f1df80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e101591b0 con 0x7f1df8004010 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df800bbf0 con 0x7f1df8004d50 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.172+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df800bdb0 con 0x7f1e1015b050 2023-10-09T11:42:32.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0effd700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 0x7f1df8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0e7fc700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1df8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0f7fe700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df8004d50 0x7f1df80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0e7fc700 1 -- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 msgr2=0x7f1df8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0e7fc700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 0x7f1df8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0e7fc700 1 -- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df8004d50 msgr2=0x7f1df80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0e7fc700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df8004d50 0x7f1df80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0e7fc700 1 -- 172.21.15.86:0/2860818939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8003570 con 0x7f1df8004010 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0effd700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e1015b050 0x7f1df8003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.173+0000 7f1e0e7fc700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1df8004810 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1e04001880 tx=0x7f1e04007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cf81642b354ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04012420 con 0x7f1df8004010 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04012580 con 0x7f1df8004010 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0dffb700 1 -- 172.21.15.86:0/2860818939 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04012920 con 0x7f1df8004010 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0ffff700 1 -- 172.21.15.86:0/2860818939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 msgr2=0x7f1df8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0ffff700 1 --2- 172.21.15.86:0/2860818939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1df8004810 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1e04001880 tx=0x7f1e04007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0f7fe700 1 -- 172.21.15.86:0/2860818939 reap_dead start 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0ffff700 1 -- 172.21.15.86:0/2860818939 shutdown_connections 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0ffff700 1 -- 172.21.15.86:0/2860818939 >> 172.21.15.86:0/2860818939 conn(0x7f1e10068e20 msgr2=0x7f1e100cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0ffff700 1 -- 172.21.15.86:0/2860818939 shutdown_connections 2023-10-09T11:42:32.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.174+0000 7f1e0ffff700 1 -- 172.21.15.86:0/2860818939 wait complete. 2023-10-09T11:42:32.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.176+0000 7f1e0ffff700 1 Processor -- start 2023-10-09T11:42:32.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.176+0000 7f1e0ffff700 1 -- start start 2023-10-09T11:42:32.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1e10142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e10151080 0x7f1e101514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e100693a0 0x7f1e10069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10151a30 con 0x7f1df8004010 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10069d50 con 0x7f1e10151080 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10151f20 con 0x7f1e100693a0 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1e10142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1e10142cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51380/0 (socket says 172.21.15.86:51380) 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 -- 172.21.15.86:0/118246793 learned_addr learned my addr 172.21.15.86:0/118246793 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0e7fc700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e10151080 0x7f1e101514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0f7fe700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e100693a0 0x7f1e10069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 -- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e100693a0 msgr2=0x7f1e10069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e100693a0 0x7f1e10069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 -- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e10151080 msgr2=0x7f1e101514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e10151080 0x7f1e101514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 -- 172.21.15.86:0/118246793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100c1860 con 0x7f1df8004010 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0f7fe700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e100693a0 0x7f1e10069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.177+0000 7f1e0effd700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1e10142cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000f360 tx=0x7f1e0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.178+0000 7f1df6ffd700 1 -- 172.21.15.86:0/118246793 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000e040 con 0x7f1df8004010 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.178+0000 7f1df6ffd700 1 -- 172.21.15.86:0/118246793 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000f040 con 0x7f1df8004010 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.178+0000 7f1df6ffd700 1 -- 172.21.15.86:0/118246793 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00015680 con 0x7f1df8004010 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.178+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e10150470 con 0x7f1df8004010 2023-10-09T11:42:32.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.178+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100c1210 con 0x7f1df8004010 2023-10-09T11:42:32.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.179+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e100c1070 con 0x7f1df8004010 2023-10-09T11:42:32.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.180+0000 7f1df6ffd700 1 -- 172.21.15.86:0/118246793 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f1e00003020 con 0x7f1df8004010 2023-10-09T11:42:32.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.181+0000 7f1df6ffd700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dfc067130 0x7f1dfc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.181+0000 7f1df6ffd700 1 -- 172.21.15.86:0/118246793 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1e000856f0 con 0x7f1df8004010 2023-10-09T11:42:32.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.181+0000 7f1e0e7fc700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dfc067130 0x7f1dfc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.181+0000 7f1e0e7fc700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dfc067130 0x7f1dfc0695e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e04008fd0 tx=0x7f1e04015000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.185+0000 7f1df6ffd700 1 -- 172.21.15.86:0/118246793 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e100c1070 con 0x7f1df8004010 2023-10-09T11:42:32.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.407+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e100c1070 con 0x7f1dfc067130 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.458+0000 7f1df6ffd700 1 -- 172.21.15.86:0/118246793 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1e100c1070 con 0x7f1dfc067130 2023-10-09T11:42:32.460 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-10-09T11:42:32.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dfc067130 msgr2=0x7f1dfc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dfc067130 0x7f1dfc0695e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e04008fd0 tx=0x7f1e04015000 comp rx=0 tx=0).stop 2023-10-09T11:42:32.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 msgr2=0x7f1e10142cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1e10142cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000f360 tx=0x7f1e0000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:32.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 shutdown_connections 2023-10-09T11:42:32.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1dfc067130 0x7f1dfc0695e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df8004010 0x7f1e10142cc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e100693a0 0x7f1e10069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 --2- 172.21.15.86:0/118246793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e10151080 0x7f1e101514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 >> 172.21.15.86:0/118246793 conn(0x7f1e10068e20 msgr2=0x7f1e1006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 shutdown_connections 2023-10-09T11:42:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.461+0000 7f1e0ffff700 1 -- 172.21.15.86:0/118246793 wait complete. 2023-10-09T11:42:32.480 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-10-09T11:42:32.480 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T11:42:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.664+0000 7fa92c1ff700 1 Processor -- start 2023-10-09T11:42:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.664+0000 7fa92c1ff700 1 -- start start 2023-10-09T11:42:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.665+0000 7fa92c1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa924157740 0x7fa9240adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.665+0000 7fa92c1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa924068aa0 0x7fa92406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.665+0000 7fa92c1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92406dc20 con 0x7fa9240b2100 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.665+0000 7fa92c1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9240acc00 con 0x7fa924157740 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.665+0000 7fa92c1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92406d6a0 con 0x7fa924068aa0 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa924157740 0x7fa9240adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa924157740 0x7fa9240adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51388/0 (socket says 172.21.15.86:51388) 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 -- 172.21.15.86:0/1063518965 learned_addr learned my addr 172.21.15.86:0/1063518965 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa92a79c700 1 --2- 172.21.15.86:0/1063518965 >> v2:172.21.15.135:3300/0 conn(0x7fa924068aa0 0x7fa92406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 -- 172.21.15.86:0/1063518965 >> v2:172.21.15.135:3300/0 conn(0x7fa924068aa0 msgr2=0x7fa92406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 --2- 172.21.15.86:0/1063518965 >> v2:172.21.15.135:3300/0 conn(0x7fa924068aa0 0x7fa92406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 -- 172.21.15.86:0/1063518965 >> v1:172.21.15.135:6789/0 conn(0x7fa9240b2100 legacy=0x7fa924068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 -- 172.21.15.86:0/1063518965 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240ae910 con 0x7fa924157740 2023-10-09T11:42:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa92a79c700 1 --2- 172.21.15.86:0/1063518965 >> v2:172.21.15.135:3300/0 conn(0x7fa924068aa0 0x7fa92406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.666+0000 7fa929f9b700 1 --2- 172.21.15.86:0/1063518965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa9240adfc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9240c6a50 tx=0x7fa920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f881bc3a570c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa928f99700 1 -- 172.21.15.86:0/1063518965 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000b860 con 0x7fa924157740 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa928f99700 1 -- 172.21.15.86:0/1063518965 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92000b9c0 con 0x7fa924157740 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa928f99700 1 -- 172.21.15.86:0/1063518965 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000bd60 con 0x7fa924157740 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1063518965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 msgr2=0x7fa9240adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1063518965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa9240adfc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9240c6a50 tx=0x7fa920009250 comp rx=0 tx=0).stop 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1063518965 shutdown_connections 2023-10-09T11:42:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1063518965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa9240adfc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1063518965 >> v2:172.21.15.135:3300/0 conn(0x7fa924068aa0 0x7fa92406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1063518965 >> 172.21.15.86:0/1063518965 conn(0x7fa9240c8f90 msgr2=0x7fa9240c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1063518965 shutdown_connections 2023-10-09T11:42:32.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.667+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1063518965 wait complete. 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.669+0000 7fa92c1ff700 1 Processor -- start 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.669+0000 7fa92c1ff700 1 -- start start 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92c1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa924068aa0 0x7fa9240c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92c1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9240b2100 0x7fa92414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92c1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa92406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92c1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92414ff30 con 0x7fa924157740 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92c1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92406f1b0 con 0x7fa9240b2100 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92c1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240c3bc0 con 0x7fa924068aa0 2023-10-09T11:42:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa92406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa92406ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51400/0 (socket says 172.21.15.86:51400) 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 -- 172.21.15.86:0/1499249877 learned_addr learned my addr 172.21.15.86:0/1499249877 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa929f9b700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa924068aa0 0x7fa9240c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92979a700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9240b2100 0x7fa92414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 -- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa924068aa0 msgr2=0x7fa9240c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa924068aa0 0x7fa9240c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 -- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9240b2100 msgr2=0x7fa92414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9240b2100 0x7fa92414f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.670+0000 7fa92a79c700 1 -- 172.21.15.86:0/1499249877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200094f0 con 0x7fa924157740 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.671+0000 7fa92979a700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9240b2100 0x7fa92414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.671+0000 7fa92a79c700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa92406ec70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00d150 tx=0x7fa91c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.671+0000 7fa919ffb700 1 -- 172.21.15.86:0/1499249877 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c00dd40 con 0x7fa924157740 2023-10-09T11:42:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.671+0000 7fa919ffb700 1 -- 172.21.15.86:0/1499249877 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c00f040 con 0x7fa924157740 2023-10-09T11:42:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.671+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9240c3ea0 con 0x7fa924157740 2023-10-09T11:42:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.671+0000 7fa919ffb700 1 -- 172.21.15.86:0/1499249877 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c015690 con 0x7fa924157740 2023-10-09T11:42:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.671+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9240c4460 con 0x7fa924157740 2023-10-09T11:42:32.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.672+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9240718b0 con 0x7fa924157740 2023-10-09T11:42:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.673+0000 7fa919ffb700 1 -- 172.21.15.86:0/1499249877 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fa91c01e3b0 con 0x7fa924157740 2023-10-09T11:42:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.674+0000 7fa919ffb700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa908067130 0x7fa9080695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.674+0000 7fa919ffb700 1 -- 172.21.15.86:0/1499249877 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa91c085060 con 0x7fa924157740 2023-10-09T11:42:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.674+0000 7fa929f9b700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa908067130 0x7fa9080695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:32.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.675+0000 7fa929f9b700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa908067130 0x7fa9080695e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9240c6a50 tx=0x7fa920017000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:32.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.678+0000 7fa919ffb700 1 -- 172.21.15.86:0/1499249877 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa91c051da0 con 0x7fa924157740 2023-10-09T11:42:32.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.898+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9240aebf0 con 0x7fa908067130 2023-10-09T11:42:32.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.942+0000 7fa919ffb700 1 -- 172.21.15.86:0/1499249877 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa9240aebf0 con 0x7fa908067130 2023-10-09T11:42:32.944 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa908067130 msgr2=0x7fa9080695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa908067130 0x7fa9080695e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9240c6a50 tx=0x7fa920017000 comp rx=0 tx=0).stop 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 msgr2=0x7fa92406ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa92406ec70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00d150 tx=0x7fa91c009a50 comp rx=0 tx=0).stop 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 shutdown_connections 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa908067130 0x7fa9080695e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa924157740 0x7fa92406ec70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa924068aa0 0x7fa9240c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 --2- 172.21.15.86:0/1499249877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9240b2100 0x7fa92414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 >> 172.21.15.86:0/1499249877 conn(0x7fa9240c8f90 msgr2=0x7fa9240adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 shutdown_connections 2023-10-09T11:42:32.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:32.945+0000 7fa92c1ff700 1 -- 172.21.15.86:0/1499249877 wait complete. 2023-10-09T11:42:32.964 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-10-09T11:42:32.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T11:42:33.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.147+0000 7f0fe4fff700 1 Processor -- start 2023-10-09T11:42:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.147+0000 7f0fe4fff700 1 -- start start 2023-10-09T11:42:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.148+0000 7f0fe4fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0fe0153f50 0x7f0fe00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.148+0000 7f0fe4fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0154320 0x7f0fe006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.148+0000 7f0fe4fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0fe015a190 0x7f0fe006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.148+0000 7f0fe4fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe00b4570 con 0x7f0fe015a190 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.148+0000 7f0fe4fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe015a730 con 0x7f0fe0153f50 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.148+0000 7f0fe4fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe015aa10 con 0x7f0fe0154320 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.148+0000 7f0fded9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0fe015a190 0x7f0fe006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0fe015a190 0x7f0fe006d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51412/0 (socket says 172.21.15.86:51412) 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 -- 172.21.15.86:0/2948690645 learned_addr learned my addr 172.21.15.86:0/2948690645 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fde59c700 1 --2- 172.21.15.86:0/2948690645 >> v2:172.21.15.135:3300/0 conn(0x7f0fe0153f50 0x7f0fe00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fddd9b700 1 --2- 172.21.15.86:0/2948690645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0154320 0x7f0fe006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 -- 172.21.15.86:0/2948690645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0154320 msgr2=0x7f0fe006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 --2- 172.21.15.86:0/2948690645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0154320 0x7f0fe006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 -- 172.21.15.86:0/2948690645 >> v2:172.21.15.135:3300/0 conn(0x7f0fe0153f50 msgr2=0x7f0fe00b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 --2- 172.21.15.86:0/2948690645 >> v2:172.21.15.135:3300/0 conn(0x7f0fe0153f50 0x7f0fe00b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 -- 172.21.15.86:0/2948690645 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe015acf0 con 0x7f0fe015a190 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fde59c700 1 --2- 172.21.15.86:0/2948690645 >> v2:172.21.15.135:3300/0 conn(0x7f0fe0153f50 0x7f0fe00b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fddd9b700 1 --2- 172.21.15.86:0/2948690645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0154320 0x7f0fe006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fded9d700 1 --2- 172.21.15.86:0/2948690645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe006d670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0fe006f4c0 tx=0x7f0fd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d001cecb10ed01 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fdd59a700 1 -- 172.21.15.86:0/2948690645 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd800e070 con 0x7f0fe015a190 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.149+0000 7f0fdd59a700 1 -- 172.21.15.86:0/2948690645 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd800ba50 con 0x7f0fe015a190 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fdd59a700 1 -- 172.21.15.86:0/2948690645 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd80092e0 con 0x7f0fe015a190 2023-10-09T11:42:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 -- 172.21.15.86:0/2948690645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 msgr2=0x7f0fe006d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/2948690645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe006d670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0fe006f4c0 tx=0x7f0fd8009840 comp rx=0 tx=0).stop 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 -- 172.21.15.86:0/2948690645 shutdown_connections 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/2948690645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe006d670 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/2948690645 >> v2:172.21.15.135:3300/0 conn(0x7f0fe0153f50 0x7f0fe00b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/2948690645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0154320 0x7f0fe006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 -- 172.21.15.86:0/2948690645 >> 172.21.15.86:0/2948690645 conn(0x7f0fe006baf0 msgr2=0x7f0fe006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 -- 172.21.15.86:0/2948690645 shutdown_connections 2023-10-09T11:42:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.150+0000 7f0fe4fff700 1 -- 172.21.15.86:0/2948690645 wait complete. 2023-10-09T11:42:33.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.152+0000 7f0fe4fff700 1 Processor -- start 2023-10-09T11:42:33.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.152+0000 7f0fe4fff700 1 -- start start 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fe4fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0153f50 0x7f0fe015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fe4fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe0154320 0x7f0fe0151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fe4fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe00ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fe4fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe015eb90 con 0x7f0fe015a190 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fe4fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe015d5b0 con 0x7f0fe0154320 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fe4fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe015d890 con 0x7f0fe0153f50 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe00ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe00ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51426/0 (socket says 172.21.15.86:51426) 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 -- 172.21.15.86:0/3391881899 learned_addr learned my addr 172.21.15.86:0/3391881899 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fddd9b700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe0154320 0x7f0fe0151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 -- 172.21.15.86:0/3391881899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0153f50 msgr2=0x7f0fe015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0153f50 0x7f0fe015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 -- 172.21.15.86:0/3391881899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe0154320 msgr2=0x7f0fe0151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe0154320 0x7f0fe0151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.153+0000 7f0fded9d700 1 -- 172.21.15.86:0/3391881899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd8009ae0 con 0x7f0fe015a190 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.154+0000 7f0fded9d700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe00ccd90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0fe006f610 tx=0x7f0fd8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.154+0000 7f0fce7fc700 1 -- 172.21.15.86:0/3391881899 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8008e80 con 0x7f0fe015a190 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.154+0000 7f0fce7fc700 1 -- 172.21.15.86:0/3391881899 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd801c410 con 0x7f0fe015a190 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.154+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe015db70 con 0x7f0fe015a190 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.154+0000 7f0fce7fc700 1 -- 172.21.15.86:0/3391881899 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd801c7d0 con 0x7f0fe015a190 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.154+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe015e130 con 0x7f0fe015a190 2023-10-09T11:42:33.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.155+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe00718b0 con 0x7f0fe015a190 2023-10-09T11:42:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.156+0000 7f0fce7fc700 1 -- 172.21.15.86:0/3391881899 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f0fd8003040 con 0x7f0fe015a190 2023-10-09T11:42:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.157+0000 7f0fce7fc700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0fc0067130 0x7f0fc00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.157+0000 7f0fce7fc700 1 -- 172.21.15.86:0/3391881899 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0fd8086570 con 0x7f0fe015a190 2023-10-09T11:42:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.157+0000 7f0fde59c700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0fc0067130 0x7f0fc00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.157+0000 7f0fde59c700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0fc0067130 0x7f0fc00695e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0007970 tx=0x7f0fd0008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.161+0000 7f0fce7fc700 1 -- 172.21.15.86:0/3391881899 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fd80532b0 con 0x7f0fe015a190 2023-10-09T11:42:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.377+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fe015afd0 con 0x7f0fc0067130 2023-10-09T11:42:33.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.426+0000 7f0fce7fc700 1 -- 172.21.15.86:0/3391881899 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0fe015afd0 con 0x7f0fc0067130 2023-10-09T11:42:33.428 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-10-09T11:42:33.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0fc0067130 msgr2=0x7f0fc00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0fc0067130 0x7f0fc00695e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0007970 tx=0x7f0fd0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 msgr2=0x7f0fe00ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe00ccd90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0fe006f610 tx=0x7f0fd8018000 comp rx=0 tx=0).stop 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 shutdown_connections 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0fc0067130 0x7f0fc00695e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fe015a190 0x7f0fe00ccd90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fe0153f50 0x7f0fe015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 --2- 172.21.15.86:0/3391881899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fe0154320 0x7f0fe0151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 >> 172.21.15.86:0/3391881899 conn(0x7f0fe006baf0 msgr2=0x7f0fe00c97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 shutdown_connections 2023-10-09T11:42:33.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.429+0000 7f0fe4fff700 1 -- 172.21.15.86:0/3391881899 wait complete. 2023-10-09T11:42:33.448 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-10-09T11:42:33.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T11:42:33.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.632+0000 7f464759e700 1 Processor -- start 2023-10-09T11:42:33.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.632+0000 7f464759e700 1 -- start start 2023-10-09T11:42:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f464759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4648156350 0x7f4648157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f464759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b0760 0x7f46480b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f464759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46480b1110 con 0x7f4648159f20 2023-10-09T11:42:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f464759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46480b0570 con 0x7f4648156350 2023-10-09T11:42:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f464759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46481578b0 con 0x7f46480b0760 2023-10-09T11:42:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f464659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4648156350 0x7f4648157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f4646d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4648159f20 0x7f464815a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34020/0 (socket says 172.21.15.86:34020) 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f464659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4648156350 0x7f4648157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51432/0 (socket says 172.21.15.86:51432) 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.633+0000 7f4646d9d700 1 -- 172.21.15.86:0/2890805180 learned_addr learned my addr 172.21.15.86:0/2890805180 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f4645d9b700 1 --2- 172.21.15.86:0/2890805180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b0760 0x7f46480b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464659c700 1 -- 172.21.15.86:0/2890805180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b0760 msgr2=0x7f46480b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464659c700 1 --2- 172.21.15.86:0/2890805180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b0760 0x7f46480b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464659c700 1 -- 172.21.15.86:0/2890805180 >> v1:172.21.15.86:6789/0 conn(0x7f4648159f20 legacy=0x7f464815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464659c700 1 -- 172.21.15.86:0/2890805180 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480af4d0 con 0x7f4648156350 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464559a700 1 -- 172.21.15.86:0/2890805180 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510209860 0 0) 0x7f46480b1110 con 0x7f4648159f20 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464659c700 1 --2- 172.21.15.86:0/2890805180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f4648157370 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4638009e60 tx=0x7f4638009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea638e20b2bde42 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464559a700 1 -- 172.21.15.86:0/2890805180 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463800e070 con 0x7f4648156350 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464559a700 1 -- 172.21.15.86:0/2890805180 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463800bb60 con 0x7f4648156350 2023-10-09T11:42:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.634+0000 7f464559a700 1 -- 172.21.15.86:0/2890805180 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638012430 con 0x7f4648156350 2023-10-09T11:42:33.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 -- 172.21.15.86:0/2890805180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 msgr2=0x7f4648157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 --2- 172.21.15.86:0/2890805180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f4648157370 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4638009e60 tx=0x7f4638009780 comp rx=0 tx=0).stop 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 -- 172.21.15.86:0/2890805180 shutdown_connections 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 --2- 172.21.15.86:0/2890805180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f4648157370 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 --2- 172.21.15.86:0/2890805180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46480b0760 0x7f46480b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 -- 172.21.15.86:0/2890805180 >> 172.21.15.86:0/2890805180 conn(0x7f4648068e20 msgr2=0x7f46480cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 -- 172.21.15.86:0/2890805180 shutdown_connections 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.635+0000 7f464759e700 1 -- 172.21.15.86:0/2890805180 wait complete. 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.637+0000 7f464759e700 1 Processor -- start 2023-10-09T11:42:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.637+0000 7f464759e700 1 -- start start 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.637+0000 7f464759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46480b0760 0x7f46480cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.637+0000 7f464759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f464814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f464759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4648159f20 0x7f46480ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f464759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480cb770 con 0x7f4648156350 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f464759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480cab60 con 0x7f46480b0760 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f464759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46480cae40 con 0x7f4648159f20 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f464814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f464814a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51440/0 (socket says 172.21.15.86:51440) 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 -- 172.21.15.86:0/963758793 learned_addr learned my addr 172.21.15.86:0/963758793 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4646d9d700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4648159f20 0x7f46480ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f464659c700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46480b0760 0x7f46480cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 -- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4648159f20 msgr2=0x7f46480ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4648159f20 0x7f46480ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 -- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46480b0760 msgr2=0x7f46480cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46480b0760 0x7f46480cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 -- 172.21.15.86:0/963758793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4638009a20 con 0x7f4648156350 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.638+0000 7f4645d9b700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f464814a090 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f463c00e930 tx=0x7f463c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.639+0000 7f46367fc700 1 -- 172.21.15.86:0/963758793 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c009510 con 0x7f4648156350 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.639+0000 7f46367fc700 1 -- 172.21.15.86:0/963758793 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00c850 con 0x7f4648156350 2023-10-09T11:42:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.639+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46480cb120 con 0x7f4648156350 2023-10-09T11:42:33.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.639+0000 7f46367fc700 1 -- 172.21.15.86:0/963758793 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00cc10 con 0x7f4648156350 2023-10-09T11:42:33.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.639+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46480ca730 con 0x7f4648156350 2023-10-09T11:42:33.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.640+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46480cb8e0 con 0x7f4648156350 2023-10-09T11:42:33.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.641+0000 7f46367fc700 1 -- 172.21.15.86:0/963758793 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f463c013470 con 0x7f4648156350 2023-10-09T11:42:33.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.641+0000 7f46367fc700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4628067130 0x7f46280695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:33.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.642+0000 7f46367fc700 1 -- 172.21.15.86:0/963758793 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f463c084b90 con 0x7f4648156350 2023-10-09T11:42:33.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.642+0000 7f464659c700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4628067130 0x7f46280695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:33.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.642+0000 7f464659c700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4628067130 0x7f46280695e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46380097c0 tx=0x7f4638019000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:33.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.646+0000 7f46367fc700 1 -- 172.21.15.86:0/963758793 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f463c0519e0 con 0x7f4648156350 2023-10-09T11:42:33.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.865+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f464804c3c0 con 0x7f4628067130 2023-10-09T11:42:33.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.914+0000 7f46367fc700 1 -- 172.21.15.86:0/963758793 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f464804c3c0 con 0x7f4628067130 2023-10-09T11:42:33.916 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-10-09T11:42:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4628067130 msgr2=0x7f46280695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4628067130 0x7f46280695e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46380097c0 tx=0x7f4638019000 comp rx=0 tx=0).stop 2023-10-09T11:42:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 msgr2=0x7f464814a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f464814a090 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f463c00e930 tx=0x7f463c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 shutdown_connections 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4628067130 0x7f46280695e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4648159f20 0x7f46480ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46480b0760 0x7f46480cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 --2- 172.21.15.86:0/963758793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4648156350 0x7f464814a090 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 >> 172.21.15.86:0/963758793 conn(0x7f4648068e20 msgr2=0x7f46481617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.916+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 shutdown_connections 2023-10-09T11:42:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:33.917+0000 7f464759e700 1 -- 172.21.15.86:0/963758793 wait complete. 2023-10-09T11:42:33.936 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-10-09T11:42:33.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T11:42:34.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.119+0000 7f575ad9d700 1 Processor -- start 2023-10-09T11:42:34.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.120+0000 7f575ad9d700 1 -- start start 2023-10-09T11:42:34.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575ad9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5754156350 0x7f5754157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57540b0760 0x7f57540b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575ad9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540b0570 con 0x7f5754159f20 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575ad9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57540b1140 con 0x7f57540b0760 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575ad9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57541578b0 con 0x7f5754156350 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575959a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57540b0760 0x7f57540b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575959a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57540b0760 0x7f57540b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51454/0 (socket says 172.21.15.86:51454) 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f575959a700 1 -- 172.21.15.86:0/1840060028 learned_addr learned my addr 172.21.15.86:0/1840060028 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.121+0000 7f5759d9b700 1 --2- 172.21.15.86:0/1840060028 >> v2:172.21.15.135:3300/0 conn(0x7f5754156350 0x7f5754157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f575959a700 1 -- 172.21.15.86:0/1840060028 >> v2:172.21.15.135:3300/0 conn(0x7f5754156350 msgr2=0x7f5754157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f575959a700 1 --2- 172.21.15.86:0/1840060028 >> v2:172.21.15.135:3300/0 conn(0x7f5754156350 0x7f5754157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f575959a700 1 -- 172.21.15.86:0/1840060028 >> v1:172.21.15.135:6789/0 conn(0x7f5754159f20 legacy=0x7f575415a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f575959a700 1 -- 172.21.15.86:0/1840060028 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540af4d0 con 0x7f57540b0760 2023-10-09T11:42:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f575959a700 1 --2- 172.21.15.86:0/1840060028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57540b0760 0x7f57540b0c00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5754065950 tx=0x7f5744009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d02732e63ac7d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f5758d99700 1 -- 172.21.15.86:0/1840060028 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744009e70 con 0x7f57540b0760 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f5758d99700 1 -- 172.21.15.86:0/1840060028 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574400b860 con 0x7f57540b0760 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.122+0000 7f5758d99700 1 -- 172.21.15.86:0/1840060028 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574400bc00 con 0x7f57540b0760 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 -- 172.21.15.86:0/1840060028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57540b0760 msgr2=0x7f57540b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 --2- 172.21.15.86:0/1840060028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57540b0760 0x7f57540b0c00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5754065950 tx=0x7f5744009250 comp rx=0 tx=0).stop 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 -- 172.21.15.86:0/1840060028 shutdown_connections 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 --2- 172.21.15.86:0/1840060028 >> v2:172.21.15.135:3300/0 conn(0x7f5754156350 0x7f5754157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 --2- 172.21.15.86:0/1840060028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57540b0760 0x7f57540b0c00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 -- 172.21.15.86:0/1840060028 >> 172.21.15.86:0/1840060028 conn(0x7f5754068e20 msgr2=0x7f57540cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 -- 172.21.15.86:0/1840060028 shutdown_connections 2023-10-09T11:42:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.123+0000 7f575ad9d700 1 -- 172.21.15.86:0/1840060028 wait complete. 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.125+0000 7f575ad9d700 1 Processor -- start 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.125+0000 7f575ad9d700 1 -- start start 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57540b0760 0x7f57540c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5754156350 0x7f575406e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5754159f20 0x7f5754169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575ad9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57540ca500 con 0x7f5754156350 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575ad9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57540acf00 con 0x7f57540b0760 2023-10-09T11:42:34.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575ad9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57540ad1e0 con 0x7f5754159f20 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5754156350 0x7f575406e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5754156350 0x7f575406e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51468/0 (socket says 172.21.15.86:51468) 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 -- 172.21.15.86:0/3873912804 learned_addr learned my addr 172.21.15.86:0/3873912804 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f5759d9b700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57540b0760 0x7f57540c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575a59c700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5754159f20 0x7f5754169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 -- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5754159f20 msgr2=0x7f5754169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5754159f20 0x7f5754169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 -- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57540b0760 msgr2=0x7f57540c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57540b0760 0x7f57540c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575959a700 1 -- 172.21.15.86:0/3873912804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440094f0 con 0x7f5754156350 2023-10-09T11:42:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.126+0000 7f575a59c700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5754159f20 0x7f5754169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.127+0000 7f575959a700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5754156350 0x7f575406e710 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f57540714a0 tx=0x7f5744017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.127+0000 7f5749ffb700 1 -- 172.21.15.86:0/3873912804 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744026450 con 0x7f5754156350 2023-10-09T11:42:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.127+0000 7f5749ffb700 1 -- 172.21.15.86:0/3873912804 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57440265d0 con 0x7f5754156350 2023-10-09T11:42:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.127+0000 7f5749ffb700 1 -- 172.21.15.86:0/3873912804 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744026990 con 0x7f5754156350 2023-10-09T11:42:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.127+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57540ad4c0 con 0x7f5754156350 2023-10-09T11:42:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.127+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575406ec50 con 0x7f5754156350 2023-10-09T11:42:34.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.128+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575406eec0 con 0x7f5754156350 2023-10-09T11:42:34.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.129+0000 7f5749ffb700 1 -- 172.21.15.86:0/3873912804 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f5744011420 con 0x7f5754156350 2023-10-09T11:42:34.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.130+0000 7f5749ffb700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5738067130 0x7f57380695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.130+0000 7f5749ffb700 1 -- 172.21.15.86:0/3873912804 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f57440865c0 con 0x7f5754156350 2023-10-09T11:42:34.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.130+0000 7f5759d9b700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5738067130 0x7f57380695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.131+0000 7f5759d9b700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5738067130 0x7f57380695e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5750009db0 tx=0x7f57500091a0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.134+0000 7f5749ffb700 1 -- 172.21.15.86:0/3873912804 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f575406eec0 con 0x7f5754156350 2023-10-09T11:42:34.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.351+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f57540ad070 con 0x7f5738067130 2023-10-09T11:42:34.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.397+0000 7f5749ffb700 1 -- 172.21.15.86:0/3873912804 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f57540ad070 con 0x7f5738067130 2023-10-09T11:42:34.399 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-10-09T11:42:34.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5738067130 msgr2=0x7f57380695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5738067130 0x7f57380695e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5750009db0 tx=0x7f57500091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5754156350 msgr2=0x7f575406e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5754156350 0x7f575406e710 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f57540714a0 tx=0x7f5744017000 comp rx=0 tx=0).stop 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 shutdown_connections 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5738067130 0x7f57380695e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5754159f20 0x7f5754169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57540b0760 0x7f57540c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 --2- 172.21.15.86:0/3873912804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5754156350 0x7f575406e710 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 >> 172.21.15.86:0/3873912804 conn(0x7f5754068e20 msgr2=0x7f5754151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 shutdown_connections 2023-10-09T11:42:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.399+0000 7f575ad9d700 1 -- 172.21.15.86:0/3873912804 wait complete. 2023-10-09T11:42:34.418 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-10-09T11:42:34.421 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T11:42:34.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.606+0000 7f48da1ff700 1 Processor -- start 2023-10-09T11:42:34.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.606+0000 7f48da1ff700 1 -- start start 2023-10-09T11:42:34.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.607+0000 7f48da1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48d40c8490 0x7f48d40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.607+0000 7f48da1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d4069e20 0x7f48d41569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.607+0000 7f48da1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d40ac030 con 0x7f48d4069a50 2023-10-09T11:42:34.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48da1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d40ab820 con 0x7f48d40c8490 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48da1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d406dbb0 con 0x7f48d4069e20 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48d40c8490 0x7f48d40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d37fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f48d4069a50 0x7f48d415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34030/0 (socket says 172.21.15.86:34030) 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d37fe700 1 -- 172.21.15.86:0/3880397715 learned_addr learned my addr 172.21.15.86:0/3880397715 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48d40c8490 0x7f48d40c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51478/0 (socket says 172.21.15.86:51478) 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d2ffd700 1 -- 172.21.15.86:0/3880397715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d4069e20 msgr2=0x7f48d41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d3fff700 1 --2- 172.21.15.86:0/3880397715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d4069e20 0x7f48d41569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d27fc700 1 -- 172.21.15.86:0/3880397715 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306237436 0 0) 0x7f48c4001110 con 0x7f48d4069a50 2023-10-09T11:42:34.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/3880397715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d4069e20 0x7f48d41569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d2ffd700 1 -- 172.21.15.86:0/3880397715 >> v1:172.21.15.86:6789/0 conn(0x7f48d4069a50 legacy=0x7f48d415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d2ffd700 1 -- 172.21.15.86:0/3880397715 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40aba70 con 0x7f48d40c8490 2023-10-09T11:42:34.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.608+0000 7f48d3fff700 1 --2- 172.21.15.86:0/3880397715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d4069e20 0x7f48d41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:34.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/3880397715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40c8490 0x7f48d40c6ac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48c800bb90 tx=0x7f48c800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4a234bfb8086e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48d27fc700 1 -- 172.21.15.86:0/3880397715 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800dba0 con 0x7f48d40c8490 2023-10-09T11:42:34.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48d27fc700 1 -- 172.21.15.86:0/3880397715 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c800dd00 con 0x7f48d40c8490 2023-10-09T11:42:34.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48d27fc700 1 -- 172.21.15.86:0/3880397715 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c80196b0 con 0x7f48d40c8490 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 -- 172.21.15.86:0/3880397715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40c8490 msgr2=0x7f48d40c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3880397715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40c8490 0x7f48d40c6ac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48c800bb90 tx=0x7f48c800b430 comp rx=0 tx=0).stop 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 -- 172.21.15.86:0/3880397715 shutdown_connections 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3880397715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d4069e20 0x7f48d41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3880397715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40c8490 0x7f48d40c6ac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 -- 172.21.15.86:0/3880397715 >> 172.21.15.86:0/3880397715 conn(0x7f48d40c8f90 msgr2=0x7f48d40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 -- 172.21.15.86:0/3880397715 shutdown_connections 2023-10-09T11:42:34.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.609+0000 7f48da1ff700 1 -- 172.21.15.86:0/3880397715 wait complete. 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.611+0000 7f48da1ff700 1 Processor -- start 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.611+0000 7f48da1ff700 1 -- start start 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48da1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d4069a50 0x7f48d4150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48da1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d4069e20 0x7f48d40c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48da1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40c8490 0x7f48d40ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48da1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40c28b0 con 0x7f48d4069e20 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48da1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40c1ca0 con 0x7f48d4069a50 2023-10-09T11:42:34.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48da1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40c1f80 con 0x7f48d40c8490 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d4069e20 0x7f48d40c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d4069e20 0x7f48d40c12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51494/0 (socket says 172.21.15.86:51494) 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d2ffd700 1 -- 172.21.15.86:0/3050779164 learned_addr learned my addr 172.21.15.86:0/3050779164 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d37fe700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d4069a50 0x7f48d4150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d3fff700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40c8490 0x7f48d40ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d2ffd700 1 -- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40c8490 msgr2=0x7f48d40ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40c8490 0x7f48d40ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d2ffd700 1 -- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d4069a50 msgr2=0x7f48d4150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.612+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d4069a50 0x7f48d4150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.613+0000 7f48d2ffd700 1 -- 172.21.15.86:0/3050779164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c800b6d0 con 0x7f48d4069e20 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.613+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d4069e20 0x7f48d40c12c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48c800b2c0 tx=0x7f48c801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.613+0000 7f48bb7fe700 1 -- 172.21.15.86:0/3050779164 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8010720 con 0x7f48d4069e20 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.613+0000 7f48bb7fe700 1 -- 172.21.15.86:0/3050779164 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8010880 con 0x7f48d4069e20 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.613+0000 7f48bb7fe700 1 -- 172.21.15.86:0/3050779164 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8010c40 con 0x7f48d4069e20 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.613+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d40c2260 con 0x7f48d4069e20 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.613+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d41510e0 con 0x7f48d4069e20 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.614+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d41525a0 con 0x7f48d4069e20 2023-10-09T11:42:34.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.615+0000 7f48bb7fe700 1 -- 172.21.15.86:0/3050779164 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f48c8024420 con 0x7f48d4069e20 2023-10-09T11:42:34.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.616+0000 7f48bb7fe700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f48c0067130 0x7f48c00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:34.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.617+0000 7f48bb7fe700 1 -- 172.21.15.86:0/3050779164 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f48c8020070 con 0x7f48d4069e20 2023-10-09T11:42:34.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.617+0000 7f48d37fe700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f48c0067130 0x7f48c00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:34.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.617+0000 7f48d37fe700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f48c0067130 0x7f48c00695e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48c40018a0 tx=0x7f48c4009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:34.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.621+0000 7f48bb7fe700 1 -- 172.21.15.86:0/3050779164 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48d41525a0 con 0x7f48d4069e20 2023-10-09T11:42:34.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.841+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f48d40c20f0 con 0x7f48c0067130 2023-10-09T11:42:34.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.894+0000 7f48bb7fe700 1 -- 172.21.15.86:0/3050779164 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f48d40c20f0 con 0x7f48c0067130 2023-10-09T11:42:34.896 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-10-09T11:42:34.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.896+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f48c0067130 msgr2=0x7f48c00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.896+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f48c0067130 0x7f48c00695e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48c40018a0 tx=0x7f48c4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.896+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d4069e20 msgr2=0x7f48d40c12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.896+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d4069e20 0x7f48d40c12c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48c800b2c0 tx=0x7f48c801b000 comp rx=0 tx=0).stop 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 shutdown_connections 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f48c0067130 0x7f48c00695e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40c8490 0x7f48d40ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d4069a50 0x7f48d4150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 --2- 172.21.15.86:0/3050779164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d4069e20 0x7f48d40c12c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 >> 172.21.15.86:0/3050779164 conn(0x7f48d40c8f90 msgr2=0x7f48d406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 shutdown_connections 2023-10-09T11:42:34.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:42:34.897+0000 7f48da1ff700 1 -- 172.21.15.86:0/3050779164 wait complete. 2023-10-09T11:42:34.916 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-10-09T11:42:37.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:37.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:00.412 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:43:00.411+0000 7f036bf8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:43:00.412 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:43:00.411+0000 7f036bf8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:43:00.412 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:43:00.411+0000 7f036bf8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:43:00.412 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:43:00.411+0000 7f036bf8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:43:00.412 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:43:00.411+0000 7f036bf8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:43:07.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:07.527 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:37.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:37.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:07.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:07.760 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:37.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:37.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:07.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:07.977 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:38.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:38.107 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:08.208 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:08.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:38.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:38.320 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:08.428 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:08.433 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:38.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:38.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:00.089 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:48:00.088+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:48:00.089 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:48:00.088+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:48:00.090 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:48:00.088+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:48:00.090 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:48:00.088+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:48:00.090 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:48:00.088+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:48:08.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:08.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:38.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:38.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:49:08.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:49:08.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:49:38.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:49:38.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:50:00.498 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:50:00.496+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:50:00.498 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:50:00.496+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:50:00.498 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:50:00.497+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:50:00.498 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:50:00.497+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:50:00.498 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:50:00.497+0000 7f036cf91700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:50:09.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:50:09.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:50:39.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:50:39.264 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:51:09.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:51:09.419 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:51:39.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:51:39.525 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:52:09.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:52:09.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:52:39.747 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:52:39.753 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:53:09.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:53:09.858 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:53:19.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T11:53:20.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.113+0000 7f82e2dff700 1 Processor -- start 2023-10-09T11:53:20.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.113+0000 7f82e2dff700 1 -- start start 2023-10-09T11:53:20.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.114+0000 7f82e2dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f82dc06ab40 0x7f82dc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.114+0000 7f82e2dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc068900 con 0x7f82dc068390 2023-10-09T11:53:20.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.114+0000 7f82e2dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc068be0 con 0x7f82dc0af8c0 2023-10-09T11:53:20.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.114+0000 7f82e2dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc068ec0 con 0x7f82dc06ab40 2023-10-09T11:53:20.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82dbfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f82dc068390 0x7f82dc0c10c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35850/0 (socket says 172.21.15.86:35850) 2023-10-09T11:53:20.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82dbfff700 1 -- 172.21.15.86:0/3422953308 learned_addr learned my addr 172.21.15.86:0/3422953308 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:20.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82e0b9b700 1 --2- 172.21.15.86:0/3422953308 >> v2:172.21.15.135:3300/0 conn(0x7f82dc06ab40 0x7f82dc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983392142 0 0) 0x7f82dc068900 con 0x7f82dc068390 2023-10-09T11:53:20.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82cc003570 con 0x7f82dc068390 2023-10-09T11:53:20.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632951763 0 0) 0x7f82cc003570 con 0x7f82dc068390 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 >> v2:172.21.15.135:3300/0 conn(0x7f82dc06ab40 msgr2=0x7f82dc0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 --2- 172.21.15.86:0/3422953308 >> v2:172.21.15.135:3300/0 conn(0x7f82dc06ab40 0x7f82dc0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 >> v1:172.21.15.135:6789/0 conn(0x7f82dc0af8c0 legacy=0x7f82dc159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0691a0 con 0x7f82dc068390 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f82c8001470 con 0x7f82dc068390 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 >> v1:172.21.15.86:6789/0 conn(0x7f82dc068390 legacy=0x7f82dc0c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82cc003ab0 0x7f82cc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.115+0000 7f82db7fe700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82db7fe700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82cc005210 0x7f82cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc068ec0 con 0x7f82cc004810 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc00c130 con 0x7f82cc005210 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc00c2f0 con 0x7f82cc003ab0 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82e0b9b700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82cc003ab0 0x7f82cc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82e139c700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82cc005210 0x7f82cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82dbfff700 1 -- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82cc003ab0 msgr2=0x7f82cc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82cc003ab0 0x7f82cc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82dbfff700 1 -- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82cc005210 msgr2=0x7f82cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82cc005210 0x7f82cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82dbfff700 1 -- 172.21.15.86:0/3422953308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc003570 con 0x7f82cc004810 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82e139c700 1 -- 172.21.15.86:0/3422953308 reap_dead start 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82cc004c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c2d0 tx=0x7f82c8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ded7f566ef8119 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.116+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800cba0 con 0x7f82cc004810 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c800cd20 con 0x7f82cc004810 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82db7fe700 1 -- 172.21.15.86:0/3422953308 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8005b70 con 0x7f82cc004810 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82e2dff700 1 -- 172.21.15.86:0/3422953308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 msgr2=0x7f82cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82cc004c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c2d0 tx=0x7f82c8001d80 comp rx=0 tx=0).stop 2023-10-09T11:53:20.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82e2dff700 1 -- 172.21.15.86:0/3422953308 shutdown_connections 2023-10-09T11:53:20.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3422953308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82cc004c80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82e2dff700 1 -- 172.21.15.86:0/3422953308 >> 172.21.15.86:0/3422953308 conn(0x7f82dc0cd640 msgr2=0x7f82dc0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:20.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82e2dff700 1 -- 172.21.15.86:0/3422953308 shutdown_connections 2023-10-09T11:53:20.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.117+0000 7f82e2dff700 1 -- 172.21.15.86:0/3422953308 wait complete. 2023-10-09T11:53:20.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.119+0000 7f82e2dff700 1 Processor -- start 2023-10-09T11:53:20.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.119+0000 7f82e2dff700 1 -- start start 2023-10-09T11:53:20.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e2dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82dc0c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e2dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82dc15cc00 0x7f82dc16a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e2dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82dc16a810 0x7f82dc16acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e2dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc16b1f0 con 0x7f82cc004810 2023-10-09T11:53:20.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e2dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0c5df0 con 0x7f82dc15cc00 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e2dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0c51e0 con 0x7f82dc16a810 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e0b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82dc0c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e0b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82dc0c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58676/0 (socket says 172.21.15.86:58676) 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e0b9b700 1 -- 172.21.15.86:0/3470898104 learned_addr learned my addr 172.21.15.86:0/3470898104 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82dc15cc00 0x7f82dc16a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.120+0000 7f82e139c700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82dc16a810 0x7f82dc16acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e0b9b700 1 -- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82dc16a810 msgr2=0x7f82dc16acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e0b9b700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82dc16a810 0x7f82dc16acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e0b9b700 1 -- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82dc15cc00 msgr2=0x7f82dc16a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e0b9b700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82dc15cc00 0x7f82dc16a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e0b9b700 1 -- 172.21.15.86:0/3470898104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0c54c0 con 0x7f82cc004810 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82dc15cc00 0x7f82dc16a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e0b9b700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82dc0c7100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f82d0011700 tx=0x7f82d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82d8ff9700 1 -- 172.21.15.86:0/3470898104 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0015670 con 0x7f82cc004810 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82d8ff9700 1 -- 172.21.15.86:0/3470898104 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d00157d0 con 0x7f82cc004810 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82d8ff9700 1 -- 172.21.15.86:0/3470898104 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0015b50 con 0x7f82cc004810 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc0c57a0 con 0x7f82cc004810 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.121+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc0c7640 con 0x7f82cc004810 2023-10-09T11:53:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.122+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc0718b0 con 0x7f82cc004810 2023-10-09T11:53:20.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.123+0000 7f82d8ff9700 1 -- 172.21.15.86:0/3470898104 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f82d0013410 con 0x7f82cc004810 2023-10-09T11:53:20.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.124+0000 7f82d8ff9700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f82c0067130 0x7f82c00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.124+0000 7f82d8ff9700 1 -- 172.21.15.86:0/3470898104 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f82d0084d90 con 0x7f82cc004810 2023-10-09T11:53:20.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.124+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f82c0067130 0x7f82c00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.125+0000 7f82dbfff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f82c0067130 0x7f82c00695e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82c8007c00 tx=0x7f82c8015000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:20.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.129+0000 7f82d8ff9700 1 -- 172.21.15.86:0/3470898104 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d0055720 con 0x7f82cc004810 2023-10-09T11:53:20.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.348+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f82dc069480 con 0x7f82c0067130 2023-10-09T11:53:20.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.415+0000 7f82d8ff9700 1 -- 172.21.15.86:0/3470898104 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f82dc069480 con 0x7f82c0067130 2023-10-09T11:53:20.417 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f82c0067130 msgr2=0x7f82c00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f82c0067130 0x7f82c00695e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82c8007c00 tx=0x7f82c8015000 comp rx=0 tx=0).stop 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 msgr2=0x7f82dc0c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82dc0c7100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f82d0011700 tx=0x7f82d0008040 comp rx=0 tx=0).stop 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 shutdown_connections 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f82c0067130 0x7f82c00695e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82cc004810 0x7f82dc0c7100 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82dc16a810 0x7f82dc16acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 --2- 172.21.15.86:0/3470898104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82dc15cc00 0x7f82dc16a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 >> 172.21.15.86:0/3470898104 conn(0x7f82dc0cd640 msgr2=0x7f82dc06e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:20.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 shutdown_connections 2023-10-09T11:53:20.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.418+0000 7f82e2dff700 1 -- 172.21.15.86:0/3470898104 wait complete. 2023-10-09T11:53:20.436 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-10-09T11:53:20.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T11:53:20.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.622+0000 7f38677ff700 1 Processor -- start 2023-10-09T11:53:20.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.623+0000 7f38677ff700 1 -- start start 2023-10-09T11:53:20.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f38677ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f38601563b0 0x7f3860156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f38677ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f386015a440 0x7f38600acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f38677ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3860068890 0x7f38600c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f38677ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386015a9b0 con 0x7f386015a440 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f38677ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386015ac90 con 0x7f38601563b0 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f38677ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386015af70 con 0x7f3860068890 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f3864d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f386015a440 0x7f38600acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f3864d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f386015a440 0x7f38600acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58684/0 (socket says 172.21.15.86:58684) 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f3864d9a700 1 -- 172.21.15.86:0/2719891446 learned_addr learned my addr 172.21.15.86:0/2719891446 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:20.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f386559b700 1 --2- 172.21.15.86:0/2719891446 >> v2:172.21.15.135:3300/0 conn(0x7f38601563b0 0x7f3860156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.624+0000 7f3865d9c700 1 --2- 172.21.15.86:0/2719891446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3860068890 0x7f38600c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3864d9a700 1 -- 172.21.15.86:0/2719891446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3860068890 msgr2=0x7f38600c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3864d9a700 1 --2- 172.21.15.86:0/2719891446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3860068890 0x7f38600c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3864d9a700 1 -- 172.21.15.86:0/2719891446 >> v2:172.21.15.135:3300/0 conn(0x7f38601563b0 msgr2=0x7f3860156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3864d9a700 1 --2- 172.21.15.86:0/2719891446 >> v2:172.21.15.135:3300/0 conn(0x7f38601563b0 0x7f3860156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3864d9a700 1 -- 172.21.15.86:0/2719891446 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386015b250 con 0x7f386015a440 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3865d9c700 1 --2- 172.21.15.86:0/2719891446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3860068890 0x7f38600c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:20.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3864d9a700 1 --2- 172.21.15.86:0/2719891446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386015a440 0x7f38600acf30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f386006a9f0 tx=0x7f3850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7024a2c72abf5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3857fff700 1 -- 172.21.15.86:0/2719891446 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850009e70 con 0x7f386015a440 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3857fff700 1 -- 172.21.15.86:0/2719891446 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385000b860 con 0x7f386015a440 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.625+0000 7f3857fff700 1 -- 172.21.15.86:0/2719891446 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000bc00 con 0x7f386015a440 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 -- 172.21.15.86:0/2719891446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386015a440 msgr2=0x7f38600acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 --2- 172.21.15.86:0/2719891446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386015a440 0x7f38600acf30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f386006a9f0 tx=0x7f3850009250 comp rx=0 tx=0).stop 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 -- 172.21.15.86:0/2719891446 shutdown_connections 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 --2- 172.21.15.86:0/2719891446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3860068890 0x7f38600c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 --2- 172.21.15.86:0/2719891446 >> v2:172.21.15.135:3300/0 conn(0x7f38601563b0 0x7f3860156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 --2- 172.21.15.86:0/2719891446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f386015a440 0x7f38600acf30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 -- 172.21.15.86:0/2719891446 >> 172.21.15.86:0/2719891446 conn(0x7f38600c8f90 msgr2=0x7f38600c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:20.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 -- 172.21.15.86:0/2719891446 shutdown_connections 2023-10-09T11:53:20.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.626+0000 7f38677ff700 1 -- 172.21.15.86:0/2719891446 wait complete. 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.627+0000 7f38677ff700 1 Processor -- start 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.627+0000 7f38677ff700 1 -- start start 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.628+0000 7f38677ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3860068890 0x7f38600af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.628+0000 7f38677ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38601563b0 0x7f386016a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.628+0000 7f38677ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f386015a440 0x7f38601545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.628+0000 7f38677ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600cd210 con 0x7f3860068890 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.628+0000 7f38677ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600b00a0 con 0x7f386015a440 2023-10-09T11:53:20.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.628+0000 7f38677ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386016a2f0 con 0x7f38601563b0 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3860068890 0x7f38600af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3860068890 0x7f38600af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58688/0 (socket says 172.21.15.86:58688) 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 -- 172.21.15.86:0/168977493 learned_addr learned my addr 172.21.15.86:0/168977493 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f3864d9a700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38601563b0 0x7f386016a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f3865d9c700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f386015a440 0x7f38601545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 -- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38601563b0 msgr2=0x7f386016a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38601563b0 0x7f386016a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 -- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f386015a440 msgr2=0x7f38601545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f386015a440 0x7f38601545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 -- 172.21.15.86:0/168977493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38500094f0 con 0x7f3860068890 2023-10-09T11:53:20.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.629+0000 7f386559b700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3860068890 0x7f38600af2d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f385c00ec80 tx=0x7f385c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.630+0000 7f38557fa700 1 -- 172.21.15.86:0/168977493 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00c850 con 0x7f3860068890 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.630+0000 7f38557fa700 1 -- 172.21.15.86:0/168977493 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00c9b0 con 0x7f3860068890 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.630+0000 7f38557fa700 1 -- 172.21.15.86:0/168977493 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00cd50 con 0x7f3860068890 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.630+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38600af810 con 0x7f3860068890 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.630+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600afdc0 con 0x7f3860068890 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.631+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386016a5d0 con 0x7f3860068890 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.632+0000 7f38557fa700 1 -- 172.21.15.86:0/168977493 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f385c013680 con 0x7f3860068890 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.632+0000 7f38557fa700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3844067130 0x7f38440695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:20.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.633+0000 7f38557fa700 1 -- 172.21.15.86:0/168977493 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f385c084b90 con 0x7f3860068890 2023-10-09T11:53:20.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.633+0000 7f3864d9a700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3844067130 0x7f38440695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:20.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.633+0000 7f3864d9a700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3844067130 0x7f38440695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f386006a9f0 tx=0x7f3850017000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:20.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.637+0000 7f38557fa700 1 -- 172.21.15.86:0/168977493 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f385c051a80 con 0x7f3860068890 2023-10-09T11:53:20.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.854+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3860071920 con 0x7f3844067130 2023-10-09T11:53:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.920+0000 7f38557fa700 1 -- 172.21.15.86:0/168977493 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3860071920 con 0x7f3844067130 2023-10-09T11:53:20.922 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-10-09T11:53:20.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.922+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3844067130 msgr2=0x7f38440695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.922+0000 7f38677ff700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3844067130 0x7f38440695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f386006a9f0 tx=0x7f3850017000 comp rx=0 tx=0).stop 2023-10-09T11:53:20.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3860068890 msgr2=0x7f38600af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3860068890 0x7f38600af2d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f385c00ec80 tx=0x7f385c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 shutdown_connections 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3844067130 0x7f38440695e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3860068890 0x7f38600af2d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f386015a440 0x7f38601545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 --2- 172.21.15.86:0/168977493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38601563b0 0x7f386016a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 >> 172.21.15.86:0/168977493 conn(0x7f38600c8f90 msgr2=0x7f3860159830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 shutdown_connections 2023-10-09T11:53:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:20.923+0000 7f38677ff700 1 -- 172.21.15.86:0/168977493 wait complete. 2023-10-09T11:53:20.941 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-10-09T11:53:20.942 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T11:53:21.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.126+0000 7f937cfff700 1 Processor -- start 2023-10-09T11:53:21.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.127+0000 7f937cfff700 1 -- start start 2023-10-09T11:53:21.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937cfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f93781563b0 0x7f9378156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937cfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937815a9b0 con 0x7f937815a440 2023-10-09T11:53:21.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937cfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937815ac90 con 0x7f9378068890 2023-10-09T11:53:21.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937cfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937815af70 con 0x7f93781563b0 2023-10-09T11:53:21.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f93781563b0 0x7f9378156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f93781563b0 0x7f9378156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58694/0 (socket says 172.21.15.86:58694) 2023-10-09T11:53:21.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937659c700 1 -- 172.21.15.86:0/2775786426 learned_addr learned my addr 172.21.15.86:0/2775786426 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:21.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f9375d9b700 1 --1- 172.21.15.86:0/2775786426 >> v1:172.21.15.86:6789/0 conn(0x7f937815a440 0x7f93780acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35858/0 (socket says 172.21.15.86:35858) 2023-10-09T11:53:21.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937659c700 1 -- 172.21.15.86:0/2775786426 >> v1:172.21.15.135:6789/0 conn(0x7f9378068890 legacy=0x7f93780c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937659c700 1 -- 172.21.15.86:0/2775786426 >> v1:172.21.15.86:6789/0 conn(0x7f937815a440 legacy=0x7f93780acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937659c700 1 -- 172.21.15.86:0/2775786426 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937815b250 con 0x7f93781563b0 2023-10-09T11:53:21.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.128+0000 7f937559a700 1 -- 172.21.15.86:0/2775786426 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300149431 0 0) 0x7f937815a9b0 con 0x7f937815a440 2023-10-09T11:53:21.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.129+0000 7f937659c700 1 --2- 172.21.15.86:0/2775786426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781563b0 0x7f9378156780 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f93680099b0 tx=0x7f9368009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4a0b791b4a5392 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:21.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.129+0000 7f937559a700 1 -- 172.21.15.86:0/2775786426 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800b860 con 0x7f93781563b0 2023-10-09T11:53:21.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.129+0000 7f937559a700 1 -- 172.21.15.86:0/2775786426 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800b9c0 con 0x7f93781563b0 2023-10-09T11:53:21.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.129+0000 7f937559a700 1 -- 172.21.15.86:0/2775786426 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800bd60 con 0x7f93781563b0 2023-10-09T11:53:21.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.129+0000 7f937cfff700 1 -- 172.21.15.86:0/2775786426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781563b0 msgr2=0x7f9378156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.129+0000 7f937cfff700 1 --2- 172.21.15.86:0/2775786426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781563b0 0x7f9378156780 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f93680099b0 tx=0x7f9368009250 comp rx=0 tx=0).stop 2023-10-09T11:53:21.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.130+0000 7f937cfff700 1 -- 172.21.15.86:0/2775786426 shutdown_connections 2023-10-09T11:53:21.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.130+0000 7f937cfff700 1 --2- 172.21.15.86:0/2775786426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781563b0 0x7f9378156780 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.130+0000 7f937cfff700 1 -- 172.21.15.86:0/2775786426 >> 172.21.15.86:0/2775786426 conn(0x7f93780c8f90 msgr2=0x7f93780c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:21.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.130+0000 7f937cfff700 1 -- 172.21.15.86:0/2775786426 shutdown_connections 2023-10-09T11:53:21.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.130+0000 7f937cfff700 1 -- 172.21.15.86:0/2775786426 wait complete. 2023-10-09T11:53:21.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.131+0000 7f937cfff700 1 Processor -- start 2023-10-09T11:53:21.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.131+0000 7f937cfff700 1 -- start start 2023-10-09T11:53:21.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937cfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9378068890 0x7f93780b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937cfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93781563b0 0x7f937814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937cfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937815a440 0x7f93780caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937cfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9378149f50 con 0x7f9378068890 2023-10-09T11:53:21.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937cfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780b2290 con 0x7f937815a440 2023-10-09T11:53:21.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937cfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93780b1cd0 con 0x7f93781563b0 2023-10-09T11:53:21.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9378068890 0x7f93780b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9378068890 0x7f93780b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58702/0 (socket says 172.21.15.86:58702) 2023-10-09T11:53:21.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f937659c700 1 -- 172.21.15.86:0/1633556915 learned_addr learned my addr 172.21.15.86:0/1633556915 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:21.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f9376d9d700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937815a440 0x7f93780caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.132+0000 7f9375d9b700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93781563b0 0x7f937814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937659c700 1 -- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93781563b0 msgr2=0x7f937814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937659c700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93781563b0 0x7f937814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937659c700 1 -- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937815a440 msgr2=0x7f93780caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937659c700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937815a440 0x7f93780caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937659c700 1 -- 172.21.15.86:0/1633556915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680094f0 con 0x7f9378068890 2023-10-09T11:53:21.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937659c700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9378068890 0x7f93780b16c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9368006f50 tx=0x7f9368017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f93667fc700 1 -- 172.21.15.86:0/1633556915 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936801f070 con 0x7f9378068890 2023-10-09T11:53:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f93667fc700 1 -- 172.21.15.86:0/1633556915 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368011c60 con 0x7f9378068890 2023-10-09T11:53:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f93667fc700 1 -- 172.21.15.86:0/1633556915 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368025420 con 0x7f9378068890 2023-10-09T11:53:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93780b1fb0 con 0x7f9378068890 2023-10-09T11:53:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.133+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93780c2dc0 con 0x7f9378068890 2023-10-09T11:53:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.134+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9378149a40 con 0x7f9378068890 2023-10-09T11:53:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.135+0000 7f93667fc700 1 -- 172.21.15.86:0/1633556915 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f9368023070 con 0x7f9378068890 2023-10-09T11:53:21.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.136+0000 7f93667fc700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9358067130 0x7f93580695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.136+0000 7f93667fc700 1 -- 172.21.15.86:0/1633556915 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9368085ac0 con 0x7f9378068890 2023-10-09T11:53:21.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.136+0000 7f9375d9b700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9358067130 0x7f93580695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.137+0000 7f9375d9b700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9358067130 0x7f93580695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f93780b1c00 tx=0x7f936c007bd0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:21.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.140+0000 7f93667fc700 1 -- 172.21.15.86:0/1633556915 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9378149a40 con 0x7f9378068890 2023-10-09T11:53:21.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.360+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9378149a40 con 0x7f9358067130 2023-10-09T11:53:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.427+0000 7f93667fc700 1 -- 172.21.15.86:0/1633556915 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9378149a40 con 0x7f9358067130 2023-10-09T11:53:21.428 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-10-09T11:53:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.429+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9358067130 msgr2=0x7f93580695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.429+0000 7f937cfff700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9358067130 0x7f93580695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f93780b1c00 tx=0x7f936c007bd0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.429+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9378068890 msgr2=0x7f93780b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.429+0000 7f937cfff700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9378068890 0x7f93780b16c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9368006f50 tx=0x7f9368017000 comp rx=0 tx=0).stop 2023-10-09T11:53:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.429+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 shutdown_connections 2023-10-09T11:53:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.430+0000 7f937cfff700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f9358067130 0x7f93580695e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.430+0000 7f937cfff700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9378068890 0x7f93780b16c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.430+0000 7f937cfff700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f937815a440 0x7f93780caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.430+0000 7f937cfff700 1 --2- 172.21.15.86:0/1633556915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93781563b0 0x7f937814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.430+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 >> 172.21.15.86:0/1633556915 conn(0x7f93780c8f90 msgr2=0x7f937806e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.430+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 shutdown_connections 2023-10-09T11:53:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.430+0000 7f937cfff700 1 -- 172.21.15.86:0/1633556915 wait complete. 2023-10-09T11:53:21.448 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-10-09T11:53:21.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T11:53:21.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.633+0000 7fe0e239d700 1 Processor -- start 2023-10-09T11:53:21.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.633+0000 7fe0e239d700 1 -- start start 2023-10-09T11:53:21.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15b050 0x7fe0dc0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e239d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe0dc15bb30 0x7fe0dc0ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e239d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc157a50 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e239d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc158f10 con 0x7fe0dc15bb30 2023-10-09T11:53:21.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc1591b0 con 0x7fe0dc15b050 2023-10-09T11:53:21.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e1b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe0dc15bb30 0x7fe0dc0ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e139b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15b050 0x7fe0dc0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e0b9a700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe0dc0cc8d0 0x7fe0dc15b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:39000/0 (socket says 172.21.15.86:39000) 2023-10-09T11:53:21.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e0b9a700 1 -- 172.21.15.86:0/3187215870 learned_addr learned my addr 172.21.15.86:0/3187215870 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:21.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e1b9c700 1 -- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15b050 msgr2=0x7fe0dc0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:21.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e1b9c700 1 --2- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15b050 0x7fe0dc0ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e1b9c700 1 -- 172.21.15.86:0/3187215870 >> v1:172.21.15.135:6789/0 conn(0x7fe0dc0cc8d0 legacy=0x7fe0dc15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e1b9c700 1 -- 172.21.15.86:0/3187215870 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0ca9e0 con 0x7fe0dc15bb30 2023-10-09T11:53:21.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0e139b700 1 --2- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15b050 0x7fe0dc0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:21.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.635+0000 7fe0d3fff700 1 -- 172.21.15.86:0/3187215870 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537938314 0 0) 0x7fe0dc157a50 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.636+0000 7fe0e1b9c700 1 --2- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15bb30 0x7fe0dc0ada30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009e60 tx=0x7fe0d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8b706998d73c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:21.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.636+0000 7fe0d3fff700 1 -- 172.21.15.86:0/3187215870 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d400e070 con 0x7fe0dc15bb30 2023-10-09T11:53:21.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.636+0000 7fe0d3fff700 1 -- 172.21.15.86:0/3187215870 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d400bb60 con 0x7fe0dc15bb30 2023-10-09T11:53:21.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.636+0000 7fe0d3fff700 1 -- 172.21.15.86:0/3187215870 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4012430 con 0x7fe0dc15bb30 2023-10-09T11:53:21.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.636+0000 7fe0e239d700 1 -- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15bb30 msgr2=0x7fe0dc0ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.636+0000 7fe0e239d700 1 --2- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15bb30 0x7fe0dc0ada30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009e60 tx=0x7fe0d4009780 comp rx=0 tx=0).stop 2023-10-09T11:53:21.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.637+0000 7fe0e239d700 1 -- 172.21.15.86:0/3187215870 shutdown_connections 2023-10-09T11:53:21.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.637+0000 7fe0e239d700 1 --2- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15b050 0x7fe0dc0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.637+0000 7fe0e239d700 1 --2- 172.21.15.86:0/3187215870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15bb30 0x7fe0dc0ada30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.637+0000 7fe0e239d700 1 -- 172.21.15.86:0/3187215870 >> 172.21.15.86:0/3187215870 conn(0x7fe0dc068e20 msgr2=0x7fe0dc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:21.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.637+0000 7fe0e239d700 1 -- 172.21.15.86:0/3187215870 shutdown_connections 2023-10-09T11:53:21.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.637+0000 7fe0e239d700 1 -- 172.21.15.86:0/3187215870 wait complete. 2023-10-09T11:53:21.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.638+0000 7fe0e239d700 1 Processor -- start 2023-10-09T11:53:21.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.638+0000 7fe0e239d700 1 -- start start 2023-10-09T11:53:21.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e239d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0dc0cc8d0 0x7fe0dc0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15b050 0x7fe0dc155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15bb30 0x7fe0dc0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e239d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0b0140 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0c7740 con 0x7fe0dc15b050 2023-10-09T11:53:21.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0c6e50 con 0x7fe0dc15bb30 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0dc0cc8d0 0x7fe0dc0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0dc0cc8d0 0x7fe0dc0afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58714/0 (socket says 172.21.15.86:58714) 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.639+0000 7fe0e139b700 1 -- 172.21.15.86:0/621072184 learned_addr learned my addr 172.21.15.86:0/621072184 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e0b9a700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15b050 0x7fe0dc155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e139b700 1 -- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15bb30 msgr2=0x7fe0dc0c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e139b700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15bb30 0x7fe0dc0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e139b700 1 -- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15b050 msgr2=0x7fe0dc155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e139b700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15b050 0x7fe0dc155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e139b700 1 -- 172.21.15.86:0/621072184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009420 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e0b9a700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15b050 0x7fe0dc155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:21.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e139b700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0dc0cc8d0 0x7fe0dc0afc00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800ec80 tx=0x7fe0d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:21.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0d17fa700 1 -- 172.21.15.86:0/621072184 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800c9d0 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0d17fa700 1 -- 172.21.15.86:0/621072184 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d800cb30 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d4009a20 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0d17fa700 1 -- 172.21.15.86:0/621072184 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800ceb0 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.640+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc0b0f90 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.641+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc0c74f0 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.642+0000 7fe0d17fa700 1 -- 172.21.15.86:0/621072184 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe0d8013680 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.643+0000 7fe0d17fa700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe0c0067130 0x7fe0c00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:21.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.643+0000 7fe0d17fa700 1 -- 172.21.15.86:0/621072184 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe0d8084ee0 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.643+0000 7fe0e0b9a700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe0c0067130 0x7fe0c00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:21.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.644+0000 7fe0e0b9a700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe0c0067130 0x7fe0c00695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0cbab0 tx=0x7fe0cc009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:21.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.648+0000 7fe0d17fa700 1 -- 172.21.15.86:0/621072184 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0d8051d30 con 0x7fe0dc0cc8d0 2023-10-09T11:53:21.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.864+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0dc0c7880 con 0x7fe0c0067130 2023-10-09T11:53:21.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.931+0000 7fe0d17fa700 1 -- 172.21.15.86:0/621072184 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe0cc001c50 con 0x7fe0c0067130 2023-10-09T11:53:21.933 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-10-09T11:53:21.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.933+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe0c0067130 msgr2=0x7fe0c00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.933+0000 7fe0e239d700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe0c0067130 0x7fe0c00695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0cbab0 tx=0x7fe0cc009040 comp rx=0 tx=0).stop 2023-10-09T11:53:21.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.933+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0dc0cc8d0 msgr2=0x7fe0dc0afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:21.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.933+0000 7fe0e239d700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0dc0cc8d0 0x7fe0dc0afc00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800ec80 tx=0x7fe0d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 shutdown_connections 2023-10-09T11:53:21.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fe0c0067130 0x7fe0c00695e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0dc0cc8d0 0x7fe0dc0afc00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0dc15bb30 0x7fe0dc0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 --2- 172.21.15.86:0/621072184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc15b050 0x7fe0dc155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:21.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 >> 172.21.15.86:0/621072184 conn(0x7fe0dc068e20 msgr2=0x7fe0dc06e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:21.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 shutdown_connections 2023-10-09T11:53:21.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:21.934+0000 7fe0e239d700 1 -- 172.21.15.86:0/621072184 wait complete. 2023-10-09T11:53:21.952 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-10-09T11:53:21.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T11:53:22.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.138+0000 7f41123ff700 1 Processor -- start 2023-10-09T11:53:22.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.138+0000 7f41123ff700 1 -- start start 2023-10-09T11:53:22.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f41123ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f410c069a50 0x7f410c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f41123ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0ac030 con 0x7f410c069e20 2023-10-09T11:53:22.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f41123ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0ab820 con 0x7f410c0c8490 2023-10-09T11:53:22.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f41123ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c06dbb0 con 0x7f410c069a50 2023-10-09T11:53:22.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f411099c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f410c069e20 0x7f410c1569b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35874/0 (socket says 172.21.15.86:35874) 2023-10-09T11:53:22.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f411099c700 1 -- 172.21.15.86:0/1732445126 learned_addr learned my addr 172.21.15.86:0/1732445126 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:22.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f410bfff700 1 --2- 172.21.15.86:0/1732445126 >> v2:172.21.15.135:3300/0 conn(0x7f410c069a50 0x7f410c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f410affd700 1 -- 172.21.15.86:0/1732445126 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409588518 0 0) 0x7f4104001110 con 0x7f410c069e20 2023-10-09T11:53:22.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.139+0000 7f410affd700 1 -- 172.21.15.86:0/1732445126 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f4003570 con 0x7f410c069e20 2023-10-09T11:53:22.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.140+0000 7f410bfff700 1 -- 172.21.15.86:0/1732445126 >> v1:172.21.15.135:6789/0 conn(0x7f410c0c8490 legacy=0x7f410c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.140+0000 7f410bfff700 1 -- 172.21.15.86:0/1732445126 >> v1:172.21.15.86:6789/0 conn(0x7f410c069e20 legacy=0x7f410c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.140+0000 7f410bfff700 1 -- 172.21.15.86:0/1732445126 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0aba70 con 0x7f410c069a50 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.140+0000 7f410bfff700 1 --2- 172.21.15.86:0/1732445126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 0x7f410c0c6ac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009e60 tx=0x7f40fc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=119240016b07989c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.140+0000 7f410affd700 1 -- 172.21.15.86:0/1732445126 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc00bb60 con 0x7f410c069a50 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.140+0000 7f410affd700 1 -- 172.21.15.86:0/1732445126 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc00bcc0 con 0x7f410c069a50 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.140+0000 7f410affd700 1 -- 172.21.15.86:0/1732445126 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0116b0 con 0x7f410c069a50 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.141+0000 7f41123ff700 1 -- 172.21.15.86:0/1732445126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 msgr2=0x7f410c0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.141+0000 7f41123ff700 1 --2- 172.21.15.86:0/1732445126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 0x7f410c0c6ac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009e60 tx=0x7f40fc009780 comp rx=0 tx=0).stop 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.141+0000 7f41123ff700 1 -- 172.21.15.86:0/1732445126 shutdown_connections 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.141+0000 7f41123ff700 1 --2- 172.21.15.86:0/1732445126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 0x7f410c0c6ac0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.141+0000 7f41123ff700 1 -- 172.21.15.86:0/1732445126 >> 172.21.15.86:0/1732445126 conn(0x7f410c0c8f90 msgr2=0x7f410c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:22.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.141+0000 7f41123ff700 1 -- 172.21.15.86:0/1732445126 shutdown_connections 2023-10-09T11:53:22.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.141+0000 7f41123ff700 1 -- 172.21.15.86:0/1732445126 wait complete. 2023-10-09T11:53:22.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.142+0000 7f41123ff700 1 Processor -- start 2023-10-09T11:53:22.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.142+0000 7f41123ff700 1 -- start start 2023-10-09T11:53:22.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.143+0000 7f41123ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 0x7f410c1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.143+0000 7f41123ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f410c069e20 0x7f410c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.143+0000 7f41123ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f410c0c8490 0x7f410c0b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.143+0000 7f41123ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c153ee0 con 0x7f410c069e20 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.143+0000 7f41123ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0ad280 con 0x7f410c069a50 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.143+0000 7f41123ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0ad560 con 0x7f410c0c8490 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f410c069e20 0x7f410c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f410c069e20 0x7f410c0b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58730/0 (socket says 172.21.15.86:58730) 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 -- 172.21.15.86:0/2850156792 learned_addr learned my addr 172.21.15.86:0/2850156792 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410bfff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 0x7f410c1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f411099c700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f410c0c8490 0x7f410c0b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 -- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f410c0c8490 msgr2=0x7f410c0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f410c0c8490 0x7f410c0b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 -- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 msgr2=0x7f410c1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 0x7f410c1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 -- 172.21.15.86:0/2850156792 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc009a20 con 0x7f410c069e20 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f411099c700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f410c0c8490 0x7f410c0b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.144+0000 7f410b7fe700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f410c069e20 0x7f410c0b1750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f410000c590 tx=0x7f410000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.145+0000 7f40f3fff700 1 -- 172.21.15.86:0/2850156792 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100011590 con 0x7f410c069e20 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.145+0000 7f40f3fff700 1 -- 172.21.15.86:0/2850156792 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4100011710 con 0x7f410c069e20 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.145+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c0ad840 con 0x7f410c069e20 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.145+0000 7f40f3fff700 1 -- 172.21.15.86:0/2850156792 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100011ad0 con 0x7f410c069e20 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.145+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c0ade00 con 0x7f410c069e20 2023-10-09T11:53:22.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.146+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c0ae020 con 0x7f410c069e20 2023-10-09T11:53:22.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.148+0000 7f40f3fff700 1 -- 172.21.15.86:0/2850156792 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f410001b3b0 con 0x7f410c069e20 2023-10-09T11:53:22.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.148+0000 7f40f3fff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f40f8067130 0x7f40f80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.148+0000 7f40f3fff700 1 -- 172.21.15.86:0/2850156792 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4100083e70 con 0x7f410c069e20 2023-10-09T11:53:22.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.148+0000 7f410bfff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f40f8067130 0x7f40f80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.149+0000 7f410bfff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f40f8067130 0x7f40f80695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0099f0 tx=0x7f40fc01b000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:22.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.152+0000 7f40f3fff700 1 -- 172.21.15.86:0/2850156792 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4100050cc0 con 0x7f410c069e20 2023-10-09T11:53:22.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.376+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f410c0718b0 con 0x7f40f8067130 2023-10-09T11:53:22.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.449+0000 7f40f3fff700 1 -- 172.21.15.86:0/2850156792 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f410c0718b0 con 0x7f40f8067130 2023-10-09T11:53:22.449 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f40f8067130 msgr2=0x7f40f80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f40f8067130 0x7f40f80695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0099f0 tx=0x7f40fc01b000 comp rx=0 tx=0).stop 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f410c069e20 msgr2=0x7f410c0b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f410c069e20 0x7f410c0b1750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f410000c590 tx=0x7f410000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 shutdown_connections 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f40f8067130 0x7f40f80695e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f410c0c8490 0x7f410c0b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c069a50 0x7f410c1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 --2- 172.21.15.86:0/2850156792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f410c069e20 0x7f410c0b1750 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 >> 172.21.15.86:0/2850156792 conn(0x7f410c0c8f90 msgr2=0x7f410c156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:22.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 shutdown_connections 2023-10-09T11:53:22.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.451+0000 7f41123ff700 1 -- 172.21.15.86:0/2850156792 wait complete. 2023-10-09T11:53:22.469 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-10-09T11:53:22.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T11:53:22.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.654+0000 7f4f0cd9d700 1 Processor -- start 2023-10-09T11:53:22.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.655+0000 7f4f0cd9d700 1 -- start start 2023-10-09T11:53:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.656+0000 7f4f0cd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 0x7f4f080b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.656+0000 7f4f0cd9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f080b1110 con 0x7f4f080ace60 2023-10-09T11:53:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.656+0000 7f4f0cd9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f080b0570 con 0x7f4f08156350 2023-10-09T11:53:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.656+0000 7f4f0cd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080af4d0 con 0x7f4f080b0760 2023-10-09T11:53:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.656+0000 7f4f07fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4f080ace60 0x7f4f080ad2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35876/0 (socket says 172.21.15.86:35876) 2023-10-09T11:53:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.656+0000 7f4f07fff700 1 -- 172.21.15.86:0/498155227 learned_addr learned my addr 172.21.15.86:0/498155227 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f06ffd700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 0x7f4f080b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782272313 0 0) 0x7f4f080b1110 con 0x7f4f080ace60 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef0003570 con 0x7f4f080ace60 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554052100 0 0) 0x7f4f080b0570 con 0x7f4f08156350 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f080b1110 con 0x7f4f08156350 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2025518232 0 0) 0x7f4ef0003570 con 0x7f4f080ace60 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 msgr2=0x7f4f080b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 0x7f4f080b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 >> v1:172.21.15.135:6789/0 conn(0x7f4f08156350 legacy=0x7f4f08157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080af7b0 con 0x7f4f080ace60 2023-10-09T11:53:22.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f4f000017f0 con 0x7f4f080ace60 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 >> v1:172.21.15.86:6789/0 conn(0x7f4f080ace60 legacy=0x7f4f080ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4ef0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ef0004810 0x7f4ef0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 0x7f4ef0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080af4d0 con 0x7f4ef0003c20 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef000bc20 con 0x7f4ef0004810 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef000dff0 con 0x7f4f080b0760 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.657+0000 7f4f077fe700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4ef0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f06ffd700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ef0004810 0x7f4ef0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f07fff700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 0x7f4ef0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f077fe700 1 -- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 msgr2=0x7f4ef0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f077fe700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f080b0760 0x7f4ef0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f077fe700 1 -- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ef0004810 msgr2=0x7f4ef0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f077fe700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ef0004810 0x7f4ef0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f077fe700 1 -- 172.21.15.86:0/498155227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0003570 con 0x7f4ef0003c20 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f077fe700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4ef0004010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8001a10 tx=0x7f4ef8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f02e6b3f2e73aae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800c5d0 con 0x7f4ef0003c20 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800c730 con 0x7f4ef0003c20 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.658+0000 7f4f067fc700 1 -- 172.21.15.86:0/498155227 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800cad0 con 0x7f4ef0003c20 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.659+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/498155227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 msgr2=0x7f4ef0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.659+0000 7f4f0cd9d700 1 --2- 172.21.15.86:0/498155227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4ef0004010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8001a10 tx=0x7f4ef8007d30 comp rx=0 tx=0).stop 2023-10-09T11:53:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.659+0000 7f4f07fff700 1 -- 172.21.15.86:0/498155227 reap_dead start 2023-10-09T11:53:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.659+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/498155227 shutdown_connections 2023-10-09T11:53:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.659+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/498155227 >> 172.21.15.86:0/498155227 conn(0x7f4f08068e20 msgr2=0x7f4f080cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.659+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/498155227 shutdown_connections 2023-10-09T11:53:22.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.659+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/498155227 wait complete. 2023-10-09T11:53:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.661+0000 7f4f0cd9d700 1 Processor -- start 2023-10-09T11:53:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.661+0000 7f4f0cd9d700 1 -- start start 2023-10-09T11:53:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.661+0000 7f4f0cd9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4f0816d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f0cd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f080c1070 0x7f4f080cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f0cd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f08150b60 0x7f4f08150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f0cd9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08151510 con 0x7f4ef0003c20 2023-10-09T11:53:22.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f0cd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0816a5a0 con 0x7f4f080c1070 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f0cd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f081699d0 con 0x7f4f08150b60 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4f0816d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4f0816d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58742/0 (socket says 172.21.15.86:58742) 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 -- 172.21.15.86:0/3197208814 learned_addr learned my addr 172.21.15.86:0/3197208814 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 -- 172.21.15.86:0/3197208814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f08150b60 msgr2=0x7f4f08150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f08150b60 0x7f4f08150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 -- 172.21.15.86:0/3197208814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f080c1070 msgr2=0x7f4f080cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f080c1070 0x7f4f080cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 -- 172.21.15.86:0/3197208814 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08169c70 con 0x7f4ef0003c20 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.662+0000 7f4f077fe700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4f0816d8f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000c00 tx=0x7f4ef8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:22.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.663+0000 7f4eef7fe700 1 -- 172.21.15.86:0/3197208814 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8000fe0 con 0x7f4ef0003c20 2023-10-09T11:53:22.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.663+0000 7f4eef7fe700 1 -- 172.21.15.86:0/3197208814 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800cab0 con 0x7f4ef0003c20 2023-10-09T11:53:22.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.663+0000 7f4eef7fe700 1 -- 172.21.15.86:0/3197208814 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8006a50 con 0x7f4ef0003c20 2023-10-09T11:53:22.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.663+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f08169f50 con 0x7f4ef0003c20 2023-10-09T11:53:22.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.663+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f080cbe80 con 0x7f4ef0003c20 2023-10-09T11:53:22.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.664+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0804c3c0 con 0x7f4ef0003c20 2023-10-09T11:53:22.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.665+0000 7f4eef7fe700 1 -- 172.21.15.86:0/3197208814 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f4ef8019070 con 0x7f4ef0003c20 2023-10-09T11:53:22.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.665+0000 7f4eef7fe700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ef4067130 0x7f4ef40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:22.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.666+0000 7f4eef7fe700 1 -- 172.21.15.86:0/3197208814 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4ef8086250 con 0x7f4ef0003c20 2023-10-09T11:53:22.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.666+0000 7f4f06ffd700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ef4067130 0x7f4ef40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:22.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.666+0000 7f4f06ffd700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ef4067130 0x7f4ef40695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f080ae000 tx=0x7f4efc0091a0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:22.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.670+0000 7f4eef7fe700 1 -- 172.21.15.86:0/3197208814 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ef8053140 con 0x7f4ef0003c20 2023-10-09T11:53:22.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.885+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f080afa90 con 0x7f4ef4067130 2023-10-09T11:53:22.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.954+0000 7f4eef7fe700 1 -- 172.21.15.86:0/3197208814 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f4f080afa90 con 0x7f4ef4067130 2023-10-09T11:53:22.955 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-10-09T11:53:22.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ef4067130 msgr2=0x7f4ef40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ef4067130 0x7f4ef40695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f080ae000 tx=0x7f4efc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 msgr2=0x7f4f0816d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4f0816d8f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000c00 tx=0x7f4ef8015000 comp rx=0 tx=0).stop 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 shutdown_connections 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f4ef4067130 0x7f4ef40695e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef0003c20 0x7f4f0816d8f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f08150b60 0x7f4f08150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 --2- 172.21.15.86:0/3197208814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f080c1070 0x7f4f080cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 >> 172.21.15.86:0/3197208814 conn(0x7f4f08068e20 msgr2=0x7f4f080ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:22.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 shutdown_connections 2023-10-09T11:53:22.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:22.957+0000 7f4f0cd9d700 1 -- 172.21.15.86:0/3197208814 wait complete. 2023-10-09T11:53:22.974 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-10-09T11:53:22.974 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T11:53:23.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.161+0000 7f26387ff700 1 Processor -- start 2023-10-09T11:53:23.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.161+0000 7f26387ff700 1 -- start start 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.162+0000 7f26387ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2630159ec0 0x7f26300b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.162+0000 7f26387ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300b5b00 con 0x7f26300b53d0 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.162+0000 7f26387ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300b5850 con 0x7f26300cf350 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.162+0000 7f26387ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300b5da0 con 0x7f2630159ec0 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f2635d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f26300b53d0 0x7f26300cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35886/0 (socket says 172.21.15.86:35886) 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f2635d9a700 1 -- 172.21.15.86:0/4266706753 learned_addr learned my addr 172.21.15.86:0/4266706753 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f263659b700 1 --2- 172.21.15.86:0/4266706753 >> v2:172.21.15.135:3300/0 conn(0x7f2630159ec0 0x7f26300b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f2635599700 1 -- 172.21.15.86:0/4266706753 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891751149 0 0) 0x7f26300b5b00 con 0x7f26300b53d0 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f2635599700 1 -- 172.21.15.86:0/4266706753 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f261c003570 con 0x7f26300b53d0 2023-10-09T11:53:23.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f2635599700 1 -- 172.21.15.86:0/4266706753 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482030562 0 0) 0x7f26300b5850 con 0x7f26300cf350 2023-10-09T11:53:23.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f2635599700 1 -- 172.21.15.86:0/4266706753 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26300b5b00 con 0x7f26300cf350 2023-10-09T11:53:23.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f263659b700 1 -- 172.21.15.86:0/4266706753 >> v1:172.21.15.135:6789/0 conn(0x7f26300cf350 legacy=0x7f26300cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f263659b700 1 -- 172.21.15.86:0/4266706753 >> v1:172.21.15.86:6789/0 conn(0x7f26300b53d0 legacy=0x7f26300cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.163+0000 7f263659b700 1 -- 172.21.15.86:0/4266706753 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300b6080 con 0x7f2630159ec0 2023-10-09T11:53:23.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f263659b700 1 --2- 172.21.15.86:0/4266706753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f26300b4e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f262c0098d0 tx=0x7f262c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17774155cee83e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:23.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f2635599700 1 -- 172.21.15.86:0/4266706753 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c005c10 con 0x7f2630159ec0 2023-10-09T11:53:23.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f2635599700 1 -- 172.21.15.86:0/4266706753 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c005d70 con 0x7f2630159ec0 2023-10-09T11:53:23.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f2635599700 1 -- 172.21.15.86:0/4266706753 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c006260 con 0x7f2630159ec0 2023-10-09T11:53:23.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f26387ff700 1 -- 172.21.15.86:0/4266706753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 msgr2=0x7f26300b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f26387ff700 1 --2- 172.21.15.86:0/4266706753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f26300b4e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f262c0098d0 tx=0x7f262c009120 comp rx=0 tx=0).stop 2023-10-09T11:53:23.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f26387ff700 1 -- 172.21.15.86:0/4266706753 shutdown_connections 2023-10-09T11:53:23.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f26387ff700 1 --2- 172.21.15.86:0/4266706753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f26300b4e90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.164+0000 7f26387ff700 1 -- 172.21.15.86:0/4266706753 >> 172.21.15.86:0/4266706753 conn(0x7f26300999f0 msgr2=0x7f26300b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:23.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.165+0000 7f26387ff700 1 -- 172.21.15.86:0/4266706753 shutdown_connections 2023-10-09T11:53:23.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.165+0000 7f26387ff700 1 -- 172.21.15.86:0/4266706753 wait complete. 2023-10-09T11:53:23.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.166+0000 7f26387ff700 1 Processor -- start 2023-10-09T11:53:23.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.166+0000 7f26387ff700 1 -- start start 2023-10-09T11:53:23.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f26387ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26300b53d0 0x7f26300c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f26387ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26300cf350 0x7f26300c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f26387ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f2630069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f26387ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630141f60 con 0x7f26300b53d0 2023-10-09T11:53:23.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f26387ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630142240 con 0x7f2630159ec0 2023-10-09T11:53:23.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f26387ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2630142520 con 0x7f26300cf350 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f263659b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26300b53d0 0x7f26300c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f263659b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26300b53d0 0x7f26300c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58744/0 (socket says 172.21.15.86:58744) 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.167+0000 7f263659b700 1 -- 172.21.15.86:0/3699263714 learned_addr learned my addr 172.21.15.86:0/3699263714 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f2635d9a700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26300cf350 0x7f26300c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f2636d9c700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f2630069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f263659b700 1 -- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26300cf350 msgr2=0x7f26300c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f263659b700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26300cf350 0x7f26300c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f263659b700 1 -- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 msgr2=0x7f2630069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f263659b700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f2630069510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f263659b700 1 -- 172.21.15.86:0/3699263714 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0093c0 con 0x7f26300b53d0 2023-10-09T11:53:23.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f2635d9a700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26300cf350 0x7f26300c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:23.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f2636d9c700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f2630069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:23.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f263659b700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26300b53d0 0x7f26300c5510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f262c009160 tx=0x7f262c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:23.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f26267fc700 1 -- 172.21.15.86:0/3699263714 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c01d9e0 con 0x7f26300b53d0 2023-10-09T11:53:23.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f26267fc700 1 -- 172.21.15.86:0/3699263714 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c01db60 con 0x7f26300b53d0 2023-10-09T11:53:23.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f26267fc700 1 -- 172.21.15.86:0/3699263714 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c01b480 con 0x7f26300b53d0 2023-10-09T11:53:23.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630142800 con 0x7f26300b53d0 2023-10-09T11:53:23.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.168+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2630141bf0 con 0x7f26300b53d0 2023-10-09T11:53:23.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.169+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2630063c90 con 0x7f26300b53d0 2023-10-09T11:53:23.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.170+0000 7f26267fc700 1 -- 172.21.15.86:0/3699263714 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f262c01b7f0 con 0x7f26300b53d0 2023-10-09T11:53:23.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.171+0000 7f26267fc700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2614067130 0x7f26140695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.171+0000 7f26267fc700 1 -- 172.21.15.86:0/3699263714 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f262c086a10 con 0x7f26300b53d0 2023-10-09T11:53:23.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.171+0000 7f2635d9a700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2614067130 0x7f26140695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.172+0000 7f2635d9a700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2614067130 0x7f26140695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2620007fd0 tx=0x7f2620009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:23.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.175+0000 7f26267fc700 1 -- 172.21.15.86:0/3699263714 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f262c053860 con 0x7f26300b53d0 2023-10-09T11:53:23.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.394+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f26300718b0 con 0x7f2614067130 2023-10-09T11:53:23.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.463+0000 7f26267fc700 1 -- 172.21.15.86:0/3699263714 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f26300718b0 con 0x7f2614067130 2023-10-09T11:53:23.463 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-10-09T11:53:23.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2614067130 msgr2=0x7f26140695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2614067130 0x7f26140695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2620007fd0 tx=0x7f2620009040 comp rx=0 tx=0).stop 2023-10-09T11:53:23.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26300b53d0 msgr2=0x7f26300c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26300b53d0 0x7f26300c5510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f262c009160 tx=0x7f262c016000 comp rx=0 tx=0).stop 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 shutdown_connections 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2614067130 0x7f26140695e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26300b53d0 0x7f26300c5510 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630159ec0 0x7f2630069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 --2- 172.21.15.86:0/3699263714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26300cf350 0x7f26300c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 >> 172.21.15.86:0/3699263714 conn(0x7f26300999f0 msgr2=0x7f26300b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.465+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 shutdown_connections 2023-10-09T11:53:23.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.466+0000 7f26387ff700 1 -- 172.21.15.86:0/3699263714 wait complete. 2023-10-09T11:53:23.483 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-10-09T11:53:23.483 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T11:53:23.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.668+0000 7f08d85ff700 1 Processor -- start 2023-10-09T11:53:23.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.669+0000 7f08d85ff700 1 -- start start 2023-10-09T11:53:23.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d85ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d85ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08d0069e20 0x7f08d01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d85ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00ac030 con 0x7f08d00c8490 2023-10-09T11:53:23.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d85ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00ab820 con 0x7f08d0069e20 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d85ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d006dbb0 con 0x7f08d0069a50 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d6b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08d0069e20 0x7f08d01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d6b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08d0069e20 0x7f08d01569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58752/0 (socket says 172.21.15.86:58752) 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d6b9c700 1 -- 172.21.15.86:0/2331505032 learned_addr learned my addr 172.21.15.86:0/2331505032 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d639b700 1 --2- 172.21.15.86:0/2331505032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d6b9c700 1 -- 172.21.15.86:0/2331505032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 msgr2=0x7f08d00c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d6b9c700 1 --2- 172.21.15.86:0/2331505032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d6b9c700 1 -- 172.21.15.86:0/2331505032 >> v1:172.21.15.135:6789/0 conn(0x7f08d00c8490 legacy=0x7f08d015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.670+0000 7f08d6b9c700 1 -- 172.21.15.86:0/2331505032 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00aba70 con 0x7f08d0069e20 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.671+0000 7f08d6b9c700 1 --2- 172.21.15.86:0/2331505032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d01569b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009f50 tx=0x7f08c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16ecf4cbe1fba93 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:23.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.671+0000 7f08d5399700 1 -- 172.21.15.86:0/2331505032 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c800e070 con 0x7f08d0069e20 2023-10-09T11:53:23.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.671+0000 7f08d5399700 1 -- 172.21.15.86:0/2331505032 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c800ba30 con 0x7f08d0069e20 2023-10-09T11:53:23.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.671+0000 7f08d5399700 1 -- 172.21.15.86:0/2331505032 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c80092e0 con 0x7f08d0069e20 2023-10-09T11:53:23.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.671+0000 7f08d85ff700 1 -- 172.21.15.86:0/2331505032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 msgr2=0x7f08d01569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.671+0000 7f08d85ff700 1 --2- 172.21.15.86:0/2331505032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d01569b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009f50 tx=0x7f08c8009840 comp rx=0 tx=0).stop 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.672+0000 7f08d85ff700 1 -- 172.21.15.86:0/2331505032 shutdown_connections 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.672+0000 7f08d85ff700 1 --2- 172.21.15.86:0/2331505032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d01569b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.672+0000 7f08d85ff700 1 --2- 172.21.15.86:0/2331505032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.672+0000 7f08d85ff700 1 -- 172.21.15.86:0/2331505032 >> 172.21.15.86:0/2331505032 conn(0x7f08d00c8f90 msgr2=0x7f08d00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.672+0000 7f08d85ff700 1 -- 172.21.15.86:0/2331505032 shutdown_connections 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.672+0000 7f08d85ff700 1 -- 172.21.15.86:0/2331505032 wait complete. 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.673+0000 7f08d85ff700 1 Processor -- start 2023-10-09T11:53:23.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.673+0000 7f08d85ff700 1 -- start start 2023-10-09T11:53:23.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d85ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d85ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d00c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d85ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08d00c8490 0x7f08d0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d85ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00c3a70 con 0x7f08d0069e20 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d85ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00c48b0 con 0x7f08d00c8490 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d85ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0155010 con 0x7f08d0069a50 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d5b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d00c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d5b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d00c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58754/0 (socket says 172.21.15.86:58754) 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d5b9a700 1 -- 172.21.15.86:0/1253140083 learned_addr learned my addr 172.21.15.86:0/1253140083 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d639b700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.674+0000 7f08d6b9c700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08d00c8490 0x7f08d0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08d5b9a700 1 -- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 msgr2=0x7f08d00c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08d5b9a700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08d5b9a700 1 -- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08d00c8490 msgr2=0x7f08d0154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08d5b9a700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08d00c8490 0x7f08d0154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08d5b9a700 1 -- 172.21.15.86:0/1253140083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8009ae0 con 0x7f08d0069e20 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08d5b9a700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d00c3530 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f08c000b5e0 tx=0x7f08c0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08c67fc700 1 -- 172.21.15.86:0/1253140083 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c000f510 con 0x7f08d0069e20 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08c67fc700 1 -- 172.21.15.86:0/1253140083 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c000f690 con 0x7f08d0069e20 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08c67fc700 1 -- 172.21.15.86:0/1253140083 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c000fa50 con 0x7f08d0069e20 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.675+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d00c3ca0 con 0x7f08d0069e20 2023-10-09T11:53:23.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.676+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d00c4260 con 0x7f08d0069e20 2023-10-09T11:53:23.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.677+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d00718b0 con 0x7f08d0069e20 2023-10-09T11:53:23.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.677+0000 7f08c67fc700 1 -- 172.21.15.86:0/1253140083 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f08c001a400 con 0x7f08d0069e20 2023-10-09T11:53:23.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.678+0000 7f08c67fc700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f08b4067160 0x7f08b4069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:23.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.678+0000 7f08c67fc700 1 -- 172.21.15.86:0/1253140083 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f08c0084320 con 0x7f08d0069e20 2023-10-09T11:53:23.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.678+0000 7f08d639b700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f08b4067160 0x7f08b4069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:23.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.679+0000 7f08d639b700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f08b4067160 0x7f08b4069610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08cc006fd0 tx=0x7f08cc008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:23.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.682+0000 7f08c67fc700 1 -- 172.21.15.86:0/1253140083 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08c00511f0 con 0x7f08d0069e20 2023-10-09T11:53:23.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.902+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f08d00ab530 con 0x7f08b4067160 2023-10-09T11:53:23.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.968+0000 7f08c67fc700 1 -- 172.21.15.86:0/1253140083 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f08d00ab530 con 0x7f08b4067160 2023-10-09T11:53:23.968 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-10-09T11:53:23.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.970+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f08b4067160 msgr2=0x7f08b4069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.970+0000 7f08d85ff700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f08b4067160 0x7f08b4069610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08cc006fd0 tx=0x7f08cc008040 comp rx=0 tx=0).stop 2023-10-09T11:53:23.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 msgr2=0x7f08d00c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:23.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d00c3530 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f08c000b5e0 tx=0x7f08c0009120 comp rx=0 tx=0).stop 2023-10-09T11:53:23.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 shutdown_connections 2023-10-09T11:53:23.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f08b4067160 0x7f08b4069610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08d00c8490 0x7f08d0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08d0069a50 0x7f08d00c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 --2- 172.21.15.86:0/1253140083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08d0069e20 0x7f08d00c3530 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:23.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 >> 172.21.15.86:0/1253140083 conn(0x7f08d00c8f90 msgr2=0x7f08d00c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:23.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 shutdown_connections 2023-10-09T11:53:23.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:23.971+0000 7f08d85ff700 1 -- 172.21.15.86:0/1253140083 wait complete. 2023-10-09T11:53:23.988 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-10-09T11:53:23.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T11:53:24.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.172+0000 7fa5d29ff700 1 Processor -- start 2023-10-09T11:53:24.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.172+0000 7fa5d29ff700 1 -- start start 2023-10-09T11:53:24.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5d29ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5cc069a50 0x7fa5cc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5d29ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5cc0c8490 0x7fa5cc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5d29ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5d29ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5cc0ac030 con 0x7fa5cc069a50 2023-10-09T11:53:24.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5d29ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5cc0ab820 con 0x7fa5cc0c8490 2023-10-09T11:53:24.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5d29ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc06dbb0 con 0x7fa5cc069e20 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5cc069a50 0x7fa5cc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5cc069a50 0x7fa5cc0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58766/0 (socket says 172.21.15.86:58766) 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2803239279 learned_addr learned my addr 172.21.15.86:0/2803239279 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5d0f9c700 1 --2- 172.21.15.86:0/2803239279 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5c3fff700 1 --2- 172.21.15.86:0/2803239279 >> v2:172.21.15.135:3300/0 conn(0x7fa5cc0c8490 0x7fa5cc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2803239279 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 msgr2=0x7fa5cc06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 --2- 172.21.15.86:0/2803239279 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2803239279 >> v2:172.21.15.135:3300/0 conn(0x7fa5cc0c8490 msgr2=0x7fa5cc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 --2- 172.21.15.86:0/2803239279 >> v2:172.21.15.135:3300/0 conn(0x7fa5cc0c8490 0x7fa5cc15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2803239279 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc15a9d0 con 0x7fa5cc069a50 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.174+0000 7fa5c3fff700 1 --2- 172.21.15.86:0/2803239279 >> v2:172.21.15.135:3300/0 conn(0x7fa5cc0c8490 0x7fa5cc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:24.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.175+0000 7fa5cbfff700 1 --2- 172.21.15.86:0/2803239279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc0c6ac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc06b920 tx=0x7fa5bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c889d175fe094c4d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:24.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.175+0000 7fa5cb7fe700 1 -- 172.21.15.86:0/2803239279 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc009ea0 con 0x7fa5cc069a50 2023-10-09T11:53:24.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.175+0000 7fa5cb7fe700 1 -- 172.21.15.86:0/2803239279 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00b820 con 0x7fa5cc069a50 2023-10-09T11:53:24.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.175+0000 7fa5cb7fe700 1 -- 172.21.15.86:0/2803239279 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00bbc0 con 0x7fa5cc069a50 2023-10-09T11:53:24.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.175+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2803239279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 msgr2=0x7fa5cc0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.175+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2803239279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc0c6ac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc06b920 tx=0x7fa5bc009250 comp rx=0 tx=0).stop 2023-10-09T11:53:24.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.176+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2803239279 shutdown_connections 2023-10-09T11:53:24.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.176+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2803239279 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.176+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2803239279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc0c6ac0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.176+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2803239279 >> v2:172.21.15.135:3300/0 conn(0x7fa5cc0c8490 0x7fa5cc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.176+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2803239279 >> 172.21.15.86:0/2803239279 conn(0x7fa5cc0c8f90 msgr2=0x7fa5cc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.176+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2803239279 shutdown_connections 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.176+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2803239279 wait complete. 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.177+0000 7fa5d29ff700 1 Processor -- start 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.177+0000 7fa5d29ff700 1 -- start start 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5d29ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5d29ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5d29ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5cc0c8490 0x7fa5cc1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5d29ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc0c1e80 con 0x7fa5cc069a50 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5d29ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc153960 con 0x7fa5cc0c8490 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5d29ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc0c1550 con 0x7fa5cc069e20 2023-10-09T11:53:24.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5cbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5cbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58770/0 (socket says 172.21.15.86:58770) 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2811765598 learned_addr learned my addr 172.21.15.86:0/2811765598 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5c3fff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.178+0000 7fa5d0f9c700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5cc0c8490 0x7fa5cc1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 msgr2=0x7fa5cc151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5cbfff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5cc0c8490 msgr2=0x7fa5cc1542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5cbfff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5cc0c8490 0x7fa5cc1542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5cbfff700 1 -- 172.21.15.86:0/2811765598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0094f0 con 0x7fa5cc069a50 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5d0f9c700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5cc0c8490 0x7fa5cc1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:24.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5cbfff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc154ff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009290 tx=0x7fa5bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:24.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5c8ff9700 1 -- 172.21.15.86:0/2811765598 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc000d10 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5c8ff9700 1 -- 172.21.15.86:0/2811765598 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc01f070 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5c8ff9700 1 -- 172.21.15.86:0/2811765598 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0266d0 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc0c1830 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.179+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc151ba0 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.181+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5cc0c1690 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.181+0000 7fa5c8ff9700 1 -- 172.21.15.86:0/2811765598 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fa5bc01a430 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.182+0000 7fa5c8ff9700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa5ac067130 0x7fa5ac0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.182+0000 7fa5c8ff9700 1 -- 172.21.15.86:0/2811765598 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa5bc021070 con 0x7fa5cc069a50 2023-10-09T11:53:24.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.182+0000 7fa5c3fff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa5ac067130 0x7fa5ac0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.183+0000 7fa5c3fff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa5ac067130 0x7fa5ac0695e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0c6770 tx=0x7fa5b4008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:24.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.186+0000 7fa5c8ff9700 1 -- 172.21.15.86:0/2811765598 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5cc0c1690 con 0x7fa5cc069a50 2023-10-09T11:53:24.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.404+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5cc0c1fc0 con 0x7fa5ac067130 2023-10-09T11:53:24.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.471+0000 7fa5c8ff9700 1 -- 172.21.15.86:0/2811765598 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa5b40107b0 con 0x7fa5ac067130 2023-10-09T11:53:24.471 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa5ac067130 msgr2=0x7fa5ac0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa5ac067130 0x7fa5ac0695e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0c6770 tx=0x7fa5b4008040 comp rx=0 tx=0).stop 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 msgr2=0x7fa5cc154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc154ff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009290 tx=0x7fa5bc017000 comp rx=0 tx=0).stop 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 shutdown_connections 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa5ac067130 0x7fa5ac0695e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc069a50 0x7fa5cc154ff0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5cc0c8490 0x7fa5cc1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 --2- 172.21.15.86:0/2811765598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5cc069e20 0x7fa5cc151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 >> 172.21.15.86:0/2811765598 conn(0x7fa5cc0c8f90 msgr2=0x7fa5cc0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:24.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 shutdown_connections 2023-10-09T11:53:24.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.473+0000 7fa5d29ff700 1 -- 172.21.15.86:0/2811765598 wait complete. 2023-10-09T11:53:24.491 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-10-09T11:53:24.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T11:53:24.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.676+0000 7fb8759ff700 1 Processor -- start 2023-10-09T11:53:24.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.676+0000 7fb8759ff700 1 -- start start 2023-10-09T11:53:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb8759ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8701563b0 0x7fb870156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb8759ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb87015a440 0x7fb8700acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb8759ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87015a9b0 con 0x7fb870068890 2023-10-09T11:53:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb8759ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87015ac90 con 0x7fb87015a440 2023-10-09T11:53:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb8759ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015af70 con 0x7fb8701563b0 2023-10-09T11:53:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86e7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb87015a440 0x7fb8700acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86e7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb87015a440 0x7fb8700acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58774/0 (socket says 172.21.15.86:58774) 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86e7fc700 1 -- 172.21.15.86:0/3901908728 learned_addr learned my addr 172.21.15.86:0/3901908728 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86effd700 1 --2- 172.21.15.86:0/3901908728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8701563b0 0x7fb870156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86e7fc700 1 -- 172.21.15.86:0/3901908728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8701563b0 msgr2=0x7fb870156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86e7fc700 1 --2- 172.21.15.86:0/3901908728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8701563b0 0x7fb870156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86e7fc700 1 -- 172.21.15.86:0/3901908728 >> v1:172.21.15.135:6789/0 conn(0x7fb870068890 legacy=0x7fb8700c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.678+0000 7fb86e7fc700 1 -- 172.21.15.86:0/3901908728 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87015b250 con 0x7fb87015a440 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.679+0000 7fb86e7fc700 1 --2- 172.21.15.86:0/3901908728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb87015a440 0x7fb8700acf30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8640099b0 tx=0x7fb864009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933d11304f752c18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.679+0000 7fb86dffb700 1 -- 172.21.15.86:0/3901908728 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400b860 con 0x7fb87015a440 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.679+0000 7fb86dffb700 1 -- 172.21.15.86:0/3901908728 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400b9c0 con 0x7fb87015a440 2023-10-09T11:53:24.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.679+0000 7fb86dffb700 1 -- 172.21.15.86:0/3901908728 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400bd60 con 0x7fb87015a440 2023-10-09T11:53:24.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.679+0000 7fb8759ff700 1 -- 172.21.15.86:0/3901908728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb87015a440 msgr2=0x7fb8700acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.679+0000 7fb8759ff700 1 --2- 172.21.15.86:0/3901908728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb87015a440 0x7fb8700acf30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8640099b0 tx=0x7fb864009250 comp rx=0 tx=0).stop 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.680+0000 7fb8759ff700 1 -- 172.21.15.86:0/3901908728 shutdown_connections 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.680+0000 7fb8759ff700 1 --2- 172.21.15.86:0/3901908728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8701563b0 0x7fb870156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.680+0000 7fb8759ff700 1 --2- 172.21.15.86:0/3901908728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb87015a440 0x7fb8700acf30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.680+0000 7fb8759ff700 1 -- 172.21.15.86:0/3901908728 >> 172.21.15.86:0/3901908728 conn(0x7fb8700c8f90 msgr2=0x7fb8700c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.680+0000 7fb8759ff700 1 -- 172.21.15.86:0/3901908728 shutdown_connections 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.680+0000 7fb8759ff700 1 -- 172.21.15.86:0/3901908728 wait complete. 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.681+0000 7fb8759ff700 1 Processor -- start 2023-10-09T11:53:24.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.681+0000 7fb8759ff700 1 -- start start 2023-10-09T11:53:24.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb8759ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb870068890 0x7fb8701598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb8759ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8701563b0 0x7fb8700afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb8759ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb87015a440 0x7fb8701467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb8759ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b01d0 con 0x7fb8701563b0 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb8759ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870157610 con 0x7fb87015a440 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb8759ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8701578f0 con 0x7fb870068890 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb86e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8701563b0 0x7fb8700afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb86e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8701563b0 0x7fb8700afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58780/0 (socket says 172.21.15.86:58780) 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.682+0000 7fb86e7fc700 1 -- 172.21.15.86:0/1231863160 learned_addr learned my addr 172.21.15.86:0/1231863160 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86e7fc700 1 -- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb870068890 msgr2=0x7fb8701598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86effd700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb870068890 0x7fb8701598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86f7fe700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb87015a440 0x7fb8701467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86e7fc700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb870068890 0x7fb8701598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86e7fc700 1 -- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb87015a440 msgr2=0x7fb8701467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86e7fc700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb87015a440 0x7fb8701467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86e7fc700 1 -- 172.21.15.86:0/1231863160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640094f0 con 0x7fb8701563b0 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86effd700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb870068890 0x7fb8701598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86f7fe700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb87015a440 0x7fb8701467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb86e7fc700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8701563b0 0x7fb8700afc90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb864006fd0 tx=0x7fb864017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb856ffd700 1 -- 172.21.15.86:0/1231863160 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864024440 con 0x7fb8701563b0 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb856ffd700 1 -- 172.21.15.86:0/1231863160 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8640245c0 con 0x7fb8701563b0 2023-10-09T11:53:24.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8700b03c0 con 0x7fb8701563b0 2023-10-09T11:53:24.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb856ffd700 1 -- 172.21.15.86:0/1231863160 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864024980 con 0x7fb8701563b0 2023-10-09T11:53:24.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.683+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8700b0980 con 0x7fb8701563b0 2023-10-09T11:53:24.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.684+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8700718b0 con 0x7fb8701563b0 2023-10-09T11:53:24.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.685+0000 7fb856ffd700 1 -- 172.21.15.86:0/1231863160 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fb86401a420 con 0x7fb8701563b0 2023-10-09T11:53:24.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.686+0000 7fb856ffd700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb85c067130 0x7fb85c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:24.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.686+0000 7fb856ffd700 1 -- 172.21.15.86:0/1231863160 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fb864086870 con 0x7fb8701563b0 2023-10-09T11:53:24.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.686+0000 7fb86effd700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb85c067130 0x7fb85c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:24.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.687+0000 7fb86effd700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb85c067130 0x7fb85c0695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb860007540 tx=0x7fb86000b040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:24.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.690+0000 7fb856ffd700 1 -- 172.21.15.86:0/1231863160 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8640536c0 con 0x7fb8701563b0 2023-10-09T11:53:24.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.909+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb87006d6a0 con 0x7fb85c067130 2023-10-09T11:53:24.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.977+0000 7fb856ffd700 1 -- 172.21.15.86:0/1231863160 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb87006d6a0 con 0x7fb85c067130 2023-10-09T11:53:24.978 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-10-09T11:53:24.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb85c067130 msgr2=0x7fb85c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb85c067130 0x7fb85c0695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb860007540 tx=0x7fb86000b040 comp rx=0 tx=0).stop 2023-10-09T11:53:24.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8701563b0 msgr2=0x7fb8700afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:24.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8701563b0 0x7fb8700afc90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb864006fd0 tx=0x7fb864017000 comp rx=0 tx=0).stop 2023-10-09T11:53:24.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 shutdown_connections 2023-10-09T11:53:24.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fb85c067130 0x7fb85c0695e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb87015a440 0x7fb8701467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb870068890 0x7fb8701598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 --2- 172.21.15.86:0/1231863160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8701563b0 0x7fb8700afc90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:24.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 >> 172.21.15.86:0/1231863160 conn(0x7fb8700c8f90 msgr2=0x7fb8700c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:24.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 shutdown_connections 2023-10-09T11:53:24.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:24.980+0000 7fb8759ff700 1 -- 172.21.15.86:0/1231863160 wait complete. 2023-10-09T11:53:24.998 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-10-09T11:53:24.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:24.999 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:25.038 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:25.039 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:25.039 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:25.039 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:25.040 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:25.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-10-09T11:53:25.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.265+0000 7f3d23dff700 1 Processor -- start 2023-10-09T11:53:25.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.265+0000 7f3d23dff700 1 -- start start 2023-10-09T11:53:25.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d23dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d1c069a50 0x7f3d1c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d23dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3d1c069e20 0x7f3d1c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d23dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c0ac030 con 0x7f3d1c0c8490 2023-10-09T11:53:25.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d23dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c0ab820 con 0x7f3d1c069a50 2023-10-09T11:53:25.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d23dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c06dbb0 con 0x7f3d1c069e20 2023-10-09T11:53:25.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d21b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d1c069a50 0x7f3d1c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d21b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d1c069a50 0x7f3d1c0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53706/0 (socket says 172.21.15.86:53706) 2023-10-09T11:53:25.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d21b9b700 1 -- 172.21.15.86:0/1873297666 learned_addr learned my addr 172.21.15.86:0/1873297666 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:25.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d2239c700 1 --2- 172.21.15.86:0/1873297666 >> v2:172.21.15.135:3300/0 conn(0x7f3d1c069e20 0x7f3d1c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d21b9b700 1 -- 172.21.15.86:0/1873297666 >> v2:172.21.15.135:3300/0 conn(0x7f3d1c069e20 msgr2=0x7f3d1c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:25.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d21b9b700 1 --2- 172.21.15.86:0/1873297666 >> v2:172.21.15.135:3300/0 conn(0x7f3d1c069e20 0x7f3d1c1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d21b9b700 1 -- 172.21.15.86:0/1873297666 >> v1:172.21.15.135:6789/0 conn(0x7f3d1c0c8490 legacy=0x7f3d1c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d21b9b700 1 -- 172.21.15.86:0/1873297666 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0aba70 con 0x7f3d1c069a50 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.267+0000 7f3d2239c700 1 --2- 172.21.15.86:0/1873297666 >> v2:172.21.15.135:3300/0 conn(0x7f3d1c069e20 0x7f3d1c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d21b9b700 1 --2- 172.21.15.86:0/1873297666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c069a50 0x7f3d1c0c6ac0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c06db20 tx=0x7f3d1800b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4822672a74bde260 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d20b99700 1 -- 172.21.15.86:0/1873297666 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800dad0 con 0x7f3d1c069a50 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d20b99700 1 -- 172.21.15.86:0/1873297666 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1800dc30 con 0x7f3d1c069a50 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d20b99700 1 -- 172.21.15.86:0/1873297666 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18017410 con 0x7f3d1c069a50 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 -- 172.21.15.86:0/1873297666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c069a50 msgr2=0x7f3d1c0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 --2- 172.21.15.86:0/1873297666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c069a50 0x7f3d1c0c6ac0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c06db20 tx=0x7f3d1800b4e0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 -- 172.21.15.86:0/1873297666 shutdown_connections 2023-10-09T11:53:25.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 --2- 172.21.15.86:0/1873297666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c069a50 0x7f3d1c0c6ac0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 --2- 172.21.15.86:0/1873297666 >> v2:172.21.15.135:3300/0 conn(0x7f3d1c069e20 0x7f3d1c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 -- 172.21.15.86:0/1873297666 >> 172.21.15.86:0/1873297666 conn(0x7f3d1c0c8f90 msgr2=0x7f3d1c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:25.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 -- 172.21.15.86:0/1873297666 shutdown_connections 2023-10-09T11:53:25.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.268+0000 7f3d23dff700 1 -- 172.21.15.86:0/1873297666 wait complete. 2023-10-09T11:53:25.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.270+0000 7f3d23dff700 1 Processor -- start 2023-10-09T11:53:25.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.270+0000 7f3d23dff700 1 -- start start 2023-10-09T11:53:25.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d23dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d1c069a50 0x7f3d1c14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d23dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d1c069e20 0x7f3d1c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d23dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c0c8490 0x7f3d1c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d23dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c1524b0 con 0x7f3d1c0c8490 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d23dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c157ab0 con 0x7f3d1c069e20 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d23dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0ade50 con 0x7f3d1c069a50 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d2239c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c0c8490 0x7f3d1c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d2239c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c0c8490 0x7f3d1c0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53710/0 (socket says 172.21.15.86:53710) 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d2239c700 1 -- 172.21.15.86:0/4190818224 learned_addr learned my addr 172.21.15.86:0/4190818224 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d21b9b700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d1c069a50 0x7f3d1c14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.271+0000 7f3d2139a700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d1c069e20 0x7f3d1c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d2239c700 1 -- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d1c069a50 msgr2=0x7f3d1c14daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d2239c700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d1c069a50 0x7f3d1c14daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d2239c700 1 -- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d1c069e20 msgr2=0x7f3d1c0cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d2239c700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d1c069e20 0x7f3d1c0cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d2239c700 1 -- 172.21.15.86:0/4190818224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1800b780 con 0x7f3d1c0c8490 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d21b9b700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d1c069a50 0x7f3d1c14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d2139a700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d1c069e20 0x7f3d1c0cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d2239c700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c0c8490 0x7f3d1c0ccab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400a380 tx=0x7f3d14007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d11ffb700 1 -- 172.21.15.86:0/4190818224 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400ae10 con 0x7f3d1c0c8490 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d11ffb700 1 -- 172.21.15.86:0/4190818224 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1400d650 con 0x7f3d1c0c8490 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c0ae130 con 0x7f3d1c0c8490 2023-10-09T11:53:25.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d11ffb700 1 -- 172.21.15.86:0/4190818224 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400da10 con 0x7f3d1c0c8490 2023-10-09T11:53:25.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.272+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c0ae6f0 con 0x7f3d1c0c8490 2023-10-09T11:53:25.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.273+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c157c60 con 0x7f3d1c0c8490 2023-10-09T11:53:25.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.274+0000 7f3d11ffb700 1 -- 172.21.15.86:0/4190818224 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f3d1401e3b0 con 0x7f3d1c0c8490 2023-10-09T11:53:25.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.275+0000 7f3d11ffb700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d00067130 0x7f3d000695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.275+0000 7f3d11ffb700 1 -- 172.21.15.86:0/4190818224 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f3d14085450 con 0x7f3d1c0c8490 2023-10-09T11:53:25.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.275+0000 7f3d21b9b700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d00067130 0x7f3d000695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.276+0000 7f3d21b9b700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d00067130 0x7f3d000695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c06db20 tx=0x7f3d18019000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:25.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.279+0000 7f3d11ffb700 1 -- 172.21.15.86:0/4190818224 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d1c157c60 con 0x7f3d1c0c8490 2023-10-09T11:53:25.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.492+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d1c157c20 con 0x7f3d00067130 2023-10-09T11:53:25.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.500+0000 7f3d11ffb700 1 -- 172.21.15.86:0/4190818224 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f3d1c157c20 con 0x7f3d00067130 2023-10-09T11:53:25.501 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:25.501 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:24", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d00067130 msgr2=0x7f3d000695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d00067130 0x7f3d000695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c06db20 tx=0x7f3d18019000 comp rx=0 tx=0).stop 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c0c8490 msgr2=0x7f3d1c0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c0c8490 0x7f3d1c0ccab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400a380 tx=0x7f3d14007900 comp rx=0 tx=0).stop 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 shutdown_connections 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f3d00067130 0x7f3d000695e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d1c0c8490 0x7f3d1c0ccab0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d1c069a50 0x7f3d1c14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 --2- 172.21.15.86:0/4190818224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d1c069e20 0x7f3d1c0cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 >> 172.21.15.86:0/4190818224 conn(0x7f3d1c0c8f90 msgr2=0x7f3d1c0c2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:25.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 shutdown_connections 2023-10-09T11:53:25.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.503+0000 7f3d23dff700 1 -- 172.21.15.86:0/4190818224 wait complete. 2023-10-09T11:53:25.520 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:24", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:25.521 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:24', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:25.521 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:25.521 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:25.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:25.521 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-09T11:53:25.559 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_01_UTC 2023-10-09T11:53:25.559 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:25.559 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:25.560 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:25.560 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:25.560 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:25.560 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:25.560 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:25.560 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:25.561 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:25.561 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:25.562 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_01_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:25.562 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-10-09T11:53:25.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.787+0000 7fc2133ff700 1 Processor -- start 2023-10-09T11:53:25.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.788+0000 7fc2133ff700 1 -- start start 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc2133ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc20c0c8490 0x7fc20c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc2133ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc20c069e20 0x7fc20c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc2133ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c0ac030 con 0x7fc20c069a50 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc2133ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c0ab820 con 0x7fc20c0c8490 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc2133ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c06dbb0 con 0x7fc20c069e20 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21099a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc20c0c8490 0x7fc20c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21099a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc20c0c8490 0x7fc20c0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53712/0 (socket says 172.21.15.86:53712) 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21099a700 1 -- 172.21.15.86:0/3837790742 learned_addr learned my addr 172.21.15.86:0/3837790742 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:25.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21199c700 1 --2- 172.21.15.86:0/3837790742 >> v2:172.21.15.135:3300/0 conn(0x7fc20c069e20 0x7fc20c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21099a700 1 -- 172.21.15.86:0/3837790742 >> v2:172.21.15.135:3300/0 conn(0x7fc20c069e20 msgr2=0x7fc20c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:25.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21099a700 1 --2- 172.21.15.86:0/3837790742 >> v2:172.21.15.135:3300/0 conn(0x7fc20c069e20 0x7fc20c1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21099a700 1 -- 172.21.15.86:0/3837790742 >> v1:172.21.15.135:6789/0 conn(0x7fc20c069a50 legacy=0x7fc20c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.789+0000 7fc21099a700 1 -- 172.21.15.86:0/3837790742 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0aba70 con 0x7fc20c0c8490 2023-10-09T11:53:25.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.790+0000 7fc21099a700 1 --2- 172.21.15.86:0/3837790742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c0c8490 0x7fc20c0c6ac0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06db20 tx=0x7fc1fc00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb72a6991a9506f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:25.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.790+0000 7fc203fff700 1 -- 172.21.15.86:0/3837790742 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00da60 con 0x7fc20c0c8490 2023-10-09T11:53:25.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.790+0000 7fc203fff700 1 -- 172.21.15.86:0/3837790742 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc00dbc0 con 0x7fc20c0c8490 2023-10-09T11:53:25.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.790+0000 7fc203fff700 1 -- 172.21.15.86:0/3837790742 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc017410 con 0x7fc20c0c8490 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.790+0000 7fc2133ff700 1 -- 172.21.15.86:0/3837790742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c0c8490 msgr2=0x7fc20c0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.790+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3837790742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c0c8490 0x7fc20c0c6ac0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06db20 tx=0x7fc1fc00b4e0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.791+0000 7fc2133ff700 1 -- 172.21.15.86:0/3837790742 shutdown_connections 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.791+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3837790742 >> v2:172.21.15.135:3300/0 conn(0x7fc20c069e20 0x7fc20c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.791+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3837790742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c0c8490 0x7fc20c0c6ac0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.791+0000 7fc2133ff700 1 -- 172.21.15.86:0/3837790742 >> 172.21.15.86:0/3837790742 conn(0x7fc20c0c8f90 msgr2=0x7fc20c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.791+0000 7fc2133ff700 1 -- 172.21.15.86:0/3837790742 shutdown_connections 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.791+0000 7fc2133ff700 1 -- 172.21.15.86:0/3837790742 wait complete. 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.792+0000 7fc2133ff700 1 Processor -- start 2023-10-09T11:53:25.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.792+0000 7fc2133ff700 1 -- start start 2023-10-09T11:53:25.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc2133ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c069a50 0x7fc20c0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc2133ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c069e20 0x7fc20c0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc2133ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20c0c8490 0x7fc20c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc2133ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0af760 con 0x7fc20c069e20 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc2133ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c166280 con 0x7fc20c069a50 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc2133ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c6150 con 0x7fc20c0c8490 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc21099a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c069e20 0x7fc20c0c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc21099a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c069e20 0x7fc20c0c5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53714/0 (socket says 172.21.15.86:53714) 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc21099a700 1 -- 172.21.15.86:0/3944473029 learned_addr learned my addr 172.21.15.86:0/3944473029 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.793+0000 7fc21119b700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c069a50 0x7fc20c0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc21199c700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20c0c8490 0x7fc20c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc21099a700 1 -- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20c0c8490 msgr2=0x7fc20c154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc21099a700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20c0c8490 0x7fc20c154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc21099a700 1 -- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c069a50 msgr2=0x7fc20c0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc21099a700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c069a50 0x7fc20c0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc21099a700 1 -- 172.21.15.86:0/3944473029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc00b780 con 0x7fc20c069e20 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc21099a700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c069e20 0x7fc20c0c5920 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0cc0b0 tx=0x7fc1fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.794+0000 7fc2017fa700 1 -- 172.21.15.86:0/3944473029 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc022610 con 0x7fc20c069e20 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.795+0000 7fc2017fa700 1 -- 172.21.15.86:0/3944473029 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc022770 con 0x7fc20c069e20 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.795+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c0c6430 con 0x7fc20c069e20 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.795+0000 7fc2017fa700 1 -- 172.21.15.86:0/3944473029 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc022b10 con 0x7fc20c069e20 2023-10-09T11:53:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.795+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c0c5e60 con 0x7fc20c069e20 2023-10-09T11:53:25.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.796+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c0af910 con 0x7fc20c069e20 2023-10-09T11:53:25.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.796+0000 7fc2017fa700 1 -- 172.21.15.86:0/3944473029 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fc1fc015070 con 0x7fc20c069e20 2023-10-09T11:53:25.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.797+0000 7fc2017fa700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc1f0067130 0x7fc1f00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:25.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.797+0000 7fc2017fa700 1 -- 172.21.15.86:0/3944473029 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fc1fc088850 con 0x7fc20c069e20 2023-10-09T11:53:25.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.798+0000 7fc21119b700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc1f0067130 0x7fc1f00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:25.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.798+0000 7fc21119b700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc1f0067130 0x7fc1f00695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc2080039e0 tx=0x7fc208007ec0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:25.801+0000 7fc2017fa700 1 -- 172.21.15.86:0/3944473029 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc20c0af910 con 0x7fc20c069e20 2023-10-09T11:53:26.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.020+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc20c0718b0 con 0x7fc1f0067130 2023-10-09T11:53:26.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.028+0000 7fc2017fa700 1 -- 172.21.15.86:0/3944473029 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fc20c0718b0 con 0x7fc1f0067130 2023-10-09T11:53:26.029 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:26.029 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:25", "first": "2023-10-09T11:43:01", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:26.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc1f0067130 msgr2=0x7fc1f00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc1f0067130 0x7fc1f00695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc2080039e0 tx=0x7fc208007ec0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c069e20 msgr2=0x7fc20c0c5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c069e20 0x7fc20c0c5920 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0cc0b0 tx=0x7fc1fc019000 comp rx=0 tx=0).stop 2023-10-09T11:53:26.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 shutdown_connections 2023-10-09T11:53:26.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc1f0067130 0x7fc1f00695e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20c0c8490 0x7fc20c154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc20c069a50 0x7fc20c0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 --2- 172.21.15.86:0/3944473029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc20c069e20 0x7fc20c0c5920 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 >> 172.21.15.86:0/3944473029 conn(0x7fc20c0c8f90 msgr2=0x7fc20c156580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:26.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 shutdown_connections 2023-10-09T11:53:26.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.031+0000 7fc2133ff700 1 -- 172.21.15.86:0/3944473029 wait complete. 2023-10-09T11:53:26.048 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:25", "first": "2023-10-09T11:43:01", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:26.049 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:25', 'first': '2023-10-09T11:43:01', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:26.049 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:26.049 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:26.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:26.049 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-09T11:53:26.087 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:26.087 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:26.087 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:26.087 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:26.087 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:26.087 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:26.088 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:26.088 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:26.088 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:26.088 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:26.088 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:26.089 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:26.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-10-09T11:53:26.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.316+0000 7f51c6b9d700 1 Processor -- start 2023-10-09T11:53:26.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.316+0000 7f51c6b9d700 1 -- start start 2023-10-09T11:53:26.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.317+0000 7f51c6b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51c00ae180 0x7f51c00acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.317+0000 7f51c6b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c00aeb10 con 0x7f51c00656e0 2023-10-09T11:53:26.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.317+0000 7f51c6b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c00af540 con 0x7f51c006b290 2023-10-09T11:53:26.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.317+0000 7f51c6b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c00aedf0 con 0x7f51c00ae180 2023-10-09T11:53:26.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.317+0000 7f51c539a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f51c00656e0 0x7f51c00ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33334/0 (socket says 172.21.15.86:33334) 2023-10-09T11:53:26.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.317+0000 7f51c539a700 1 -- 172.21.15.86:0/3496696725 learned_addr learned my addr 172.21.15.86:0/3496696725 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.317+0000 7f51c5b9b700 1 --2- 172.21.15.86:0/3496696725 >> v2:172.21.15.135:3300/0 conn(0x7f51c00ae180 0x7f51c00acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167482358 0 0) 0x7f51c00aeb10 con 0x7f51c00656e0 2023-10-09T11:53:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ac003570 con 0x7f51c00656e0 2023-10-09T11:53:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312032927 0 0) 0x7f51ac003570 con 0x7f51c00656e0 2023-10-09T11:53:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 >> v2:172.21.15.135:3300/0 conn(0x7f51c00ae180 msgr2=0x7f51c00acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 --2- 172.21.15.86:0/3496696725 >> v2:172.21.15.135:3300/0 conn(0x7f51c00ae180 0x7f51c00acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 >> v1:172.21.15.135:6789/0 conn(0x7f51c006b290 legacy=0x7f51c00b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00af820 con 0x7f51c00656e0 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f51b0001470 con 0x7f51c00656e0 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 >> v1:172.21.15.86:6789/0 conn(0x7f51c00656e0 legacy=0x7f51c00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac003a60 0x7f51ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0051c0 0x7f51ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00aedf0 con 0x7f51ac004810 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac00c160 con 0x7f51ac0051c0 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac00c320 con 0x7f51ac003a60 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c539a700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c639c700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0051c0 0x7f51ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.318+0000 7f51c5b9b700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac003a60 0x7f51ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c539a700 1 -- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac003a60 msgr2=0x7f51ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c539a700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51ac003a60 0x7f51ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c539a700 1 -- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0051c0 msgr2=0x7f51ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c539a700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac0051c0 0x7f51ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c539a700 1 -- 172.21.15.86:0/3496696725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac003570 con 0x7f51ac004810 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c639c700 1 -- 172.21.15.86:0/3496696725 reap_dead start 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c539a700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51ac004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f51c0065ab0 tx=0x7f51b0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbb2f9ead7d40c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000cc30 con 0x7f51ac004810 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000cd90 con 0x7f51ac004810 2023-10-09T11:53:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.319+0000 7f51c4b99700 1 -- 172.21.15.86:0/3496696725 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0005b50 con 0x7f51ac004810 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.320+0000 7f51c6b9d700 1 -- 172.21.15.86:0/3496696725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 msgr2=0x7f51ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.320+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51ac004c80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f51c0065ab0 tx=0x7f51b0001e50 comp rx=0 tx=0).stop 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.320+0000 7f51c6b9d700 1 -- 172.21.15.86:0/3496696725 shutdown_connections 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.320+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/3496696725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51ac004c80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.320+0000 7f51c6b9d700 1 -- 172.21.15.86:0/3496696725 >> 172.21.15.86:0/3496696725 conn(0x7f51c006f6a0 msgr2=0x7f51c006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.320+0000 7f51c6b9d700 1 -- 172.21.15.86:0/3496696725 shutdown_connections 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.320+0000 7f51c6b9d700 1 -- 172.21.15.86:0/3496696725 wait complete. 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.321+0000 7f51c6b9d700 1 Processor -- start 2023-10-09T11:53:26.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.321+0000 7f51c6b9d700 1 -- start start 2023-10-09T11:53:26.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.322+0000 7f51c6b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51c00c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.322+0000 7f51c6b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51c00cb880 0x7f51c015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.322+0000 7f51c6b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c015a250 0x7f51c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.322+0000 7f51c6b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c34a0 con 0x7f51ac004810 2023-10-09T11:53:26.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.322+0000 7f51c6b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0157d80 con 0x7f51c015a250 2023-10-09T11:53:26.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.322+0000 7f51c6b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c015e260 con 0x7f51c00cb880 2023-10-09T11:53:26.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51c00c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51c00c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53746/0 (socket says 172.21.15.86:53746) 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 -- 172.21.15.86:0/954940102 learned_addr learned my addr 172.21.15.86:0/954940102 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c539a700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51c00cb880 0x7f51c015e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c639c700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c015a250 0x7f51c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 -- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51c00cb880 msgr2=0x7f51c015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51c00cb880 0x7f51c015e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 -- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c015a250 msgr2=0x7f51c015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c015a250 0x7f51c015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 -- 172.21.15.86:0/954940102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c015e540 con 0x7f51ac004810 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c539a700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51c00cb880 0x7f51c015e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:26.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c639c700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c015a250 0x7f51c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c5b9b700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51c00c1d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f51bc011a30 tx=0x7f51bc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51b5ffb700 1 -- 172.21.15.86:0/954940102 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc005a00 con 0x7f51ac004810 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51b5ffb700 1 -- 172.21.15.86:0/954940102 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc005b60 con 0x7f51ac004810 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c015bc20 con 0x7f51ac004810 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.323+0000 7f51b5ffb700 1 -- 172.21.15.86:0/954940102 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00f8e0 con 0x7f51ac004810 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.324+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c015acb0 con 0x7f51ac004810 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.324+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c004c3c0 con 0x7f51ac004810 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.325+0000 7f51b5ffb700 1 -- 172.21.15.86:0/954940102 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f51bc00fcd0 con 0x7f51ac004810 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.326+0000 7f51b5ffb700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f51a4067130 0x7f51a40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.326+0000 7f51b5ffb700 1 -- 172.21.15.86:0/954940102 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f51bc018030 con 0x7f51ac004810 2023-10-09T11:53:26.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.326+0000 7f51c539a700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f51a4067130 0x7f51a40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.327+0000 7f51c539a700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f51a4067130 0x7f51a40695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f51c015c5a0 tx=0x7f51b0015000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:26.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.330+0000 7f51b5ffb700 1 -- 172.21.15.86:0/954940102 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51bc052300 con 0x7f51ac004810 2023-10-09T11:53:26.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.543+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51c00ac5f0 con 0x7f51a4067130 2023-10-09T11:53:26.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.551+0000 7f51b5ffb700 1 -- 172.21.15.86:0/954940102 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f51c00ac5f0 con 0x7f51a4067130 2023-10-09T11:53:26.552 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:26.552 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:25", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f51a4067130 msgr2=0x7f51a40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f51a4067130 0x7f51a40695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f51c015c5a0 tx=0x7f51b0015000 comp rx=0 tx=0).stop 2023-10-09T11:53:26.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 msgr2=0x7f51c00c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51c00c1d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f51bc011a30 tx=0x7f51bc009120 comp rx=0 tx=0).stop 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 shutdown_connections 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f51a4067130 0x7f51a40695e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ac004810 0x7f51c00c1d90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c015a250 0x7f51c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 --2- 172.21.15.86:0/954940102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51c00cb880 0x7f51c015e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 >> 172.21.15.86:0/954940102 conn(0x7f51c006f6a0 msgr2=0x7f51c0096770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 shutdown_connections 2023-10-09T11:53:26.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.554+0000 7f51c6b9d700 1 -- 172.21.15.86:0/954940102 wait complete. 2023-10-09T11:53:26.572 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:25", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:26.572 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:25', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:26.572 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:26.572 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:26.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:26.572 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-09T11:53:26.610 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_01_UTC 2023-10-09T11:53:26.610 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:26.610 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:26.610 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:26.610 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:26.610 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:26.611 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:26.611 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:26.611 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:26.611 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:26.611 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:26.612 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_01_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:26.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-10-09T11:53:26.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.837+0000 7f51523ff700 1 Processor -- start 2023-10-09T11:53:26.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.838+0000 7f51523ff700 1 -- start start 2023-10-09T11:53:26.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f51523ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f514c156480 0x7f514c06e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f51523ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c06df80 con 0x7f514c1560b0 2023-10-09T11:53:26.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f51523ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0c79a0 con 0x7f514c0c6890 2023-10-09T11:53:26.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f51523ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c0acc60 con 0x7f514c156480 2023-10-09T11:53:26.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f514bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f514c1560b0 0x7f514c0ac550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33350/0 (socket says 172.21.15.86:33350) 2023-10-09T11:53:26.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f514bfff700 1 -- 172.21.15.86:0/3818884029 learned_addr learned my addr 172.21.15.86:0/3818884029 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:26.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f515099c700 1 --2- 172.21.15.86:0/3818884029 >> v2:172.21.15.135:3300/0 conn(0x7f514c156480 0x7f514c06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f514affd700 1 -- 172.21.15.86:0/3818884029 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267292366 0 0) 0x7f514c06df80 con 0x7f514c1560b0 2023-10-09T11:53:26.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.839+0000 7f514affd700 1 -- 172.21.15.86:0/3818884029 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5134004680 con 0x7f514c1560b0 2023-10-09T11:53:26.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f515099c700 1 -- 172.21.15.86:0/3818884029 >> v1:172.21.15.135:6789/0 conn(0x7f514c0c6890 legacy=0x7f514c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f515099c700 1 -- 172.21.15.86:0/3818884029 >> v1:172.21.15.86:6789/0 conn(0x7f514c1560b0 legacy=0x7f514c0ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f514affd700 1 -- 172.21.15.86:0/3818884029 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3682656615 0 0) 0x7f5134004680 con 0x7f514c1560b0 2023-10-09T11:53:26.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f515099c700 1 -- 172.21.15.86:0/3818884029 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0c6d90 con 0x7f514c156480 2023-10-09T11:53:26.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f515099c700 1 --2- 172.21.15.86:0/3818884029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c156480 0x7f514c06e380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5144009e60 tx=0x7f5144009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8b36fa836055173 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:26.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f514affd700 1 -- 172.21.15.86:0/3818884029 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0015f0 con 0x7f514c156480 2023-10-09T11:53:26.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f514affd700 1 -- 172.21.15.86:0/3818884029 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514400b850 con 0x7f514c156480 2023-10-09T11:53:26.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.840+0000 7f514affd700 1 -- 172.21.15.86:0/3818884029 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400bbf0 con 0x7f514c156480 2023-10-09T11:53:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.841+0000 7f51523ff700 1 -- 172.21.15.86:0/3818884029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c156480 msgr2=0x7f514c06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.841+0000 7f51523ff700 1 --2- 172.21.15.86:0/3818884029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c156480 0x7f514c06e380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5144009e60 tx=0x7f5144009780 comp rx=0 tx=0).stop 2023-10-09T11:53:26.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.841+0000 7f51523ff700 1 -- 172.21.15.86:0/3818884029 shutdown_connections 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.841+0000 7f51523ff700 1 --2- 172.21.15.86:0/3818884029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c156480 0x7f514c06e380 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.841+0000 7f51523ff700 1 -- 172.21.15.86:0/3818884029 >> 172.21.15.86:0/3818884029 conn(0x7f514c068390 msgr2=0x7f514c068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.841+0000 7f51523ff700 1 -- 172.21.15.86:0/3818884029 shutdown_connections 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.841+0000 7f51523ff700 1 -- 172.21.15.86:0/3818884029 wait complete. 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.842+0000 7f51523ff700 1 Processor -- start 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.843+0000 7f51523ff700 1 -- start start 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.843+0000 7f51523ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f514c0c6890 0x7f514c165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.843+0000 7f51523ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c1560b0 0x7f514c0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.843+0000 7f51523ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f514c156480 0x7f514c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.843+0000 7f51523ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0b01e0 con 0x7f514c0c6890 2023-10-09T11:53:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.843+0000 7f51523ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0b04c0 con 0x7f514c1560b0 2023-10-09T11:53:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.843+0000 7f51523ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0b07a0 con 0x7f514c156480 2023-10-09T11:53:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f514c0c6890 0x7f514c165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f514c0c6890 0x7f514c165710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53758/0 (socket says 172.21.15.86:53758) 2023-10-09T11:53:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 -- 172.21.15.86:0/2294213608 learned_addr learned my addr 172.21.15.86:0/2294213608 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f515099c700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f514c156480 0x7f514c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 -- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f514c156480 msgr2=0x7f514c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514b7fe700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c1560b0 0x7f514c0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f514c156480 0x7f514c0b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 -- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c1560b0 msgr2=0x7f514c0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c1560b0 0x7f514c0c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 -- 172.21.15.86:0/2294213608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009a20 con 0x7f514c0c6890 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f515099c700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f514c156480 0x7f514c0b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514b7fe700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c1560b0 0x7f514c0c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f514bfff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f514c0c6890 0x7f514c165710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f513c00cb90 tx=0x7f513c002ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:26.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.844+0000 7f5133fff700 1 -- 172.21.15.86:0/2294213608 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c007300 con 0x7f514c0c6890 2023-10-09T11:53:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.845+0000 7f5133fff700 1 -- 172.21.15.86:0/2294213608 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c007460 con 0x7f514c0c6890 2023-10-09T11:53:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.845+0000 7f5133fff700 1 -- 172.21.15.86:0/2294213608 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0057f0 con 0x7f514c0c6890 2023-10-09T11:53:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.845+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c0b0a80 con 0x7f514c0c6890 2023-10-09T11:53:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.845+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c165c50 con 0x7f514c0c6890 2023-10-09T11:53:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.846+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c0b0f20 con 0x7f514c0c6890 2023-10-09T11:53:26.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.847+0000 7f5133fff700 1 -- 172.21.15.86:0/2294213608 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f513c005c20 con 0x7f514c0c6890 2023-10-09T11:53:26.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.848+0000 7f5133fff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5138067130 0x7f51380695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:26.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.848+0000 7f5133fff700 1 -- 172.21.15.86:0/2294213608 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f513c084790 con 0x7f514c0c6890 2023-10-09T11:53:26.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.848+0000 7f514b7fe700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5138067130 0x7f51380695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.849+0000 7f514b7fe700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5138067130 0x7f51380695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5140001840 tx=0x7f5140009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:26.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:26.852+0000 7f5133fff700 1 -- 172.21.15.86:0/2294213608 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f513c051700 con 0x7f514c0c6890 2023-10-09T11:53:27.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.066+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f514c0b0630 con 0x7f5138067130 2023-10-09T11:53:27.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.075+0000 7f5133fff700 1 -- 172.21.15.86:0/2294213608 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f514c0b0630 con 0x7f5138067130 2023-10-09T11:53:27.075 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:27.075 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:26", "first": "2023-10-09T11:43:01", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:27.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5138067130 msgr2=0x7f51380695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5138067130 0x7f51380695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5140001840 tx=0x7f5140009040 comp rx=0 tx=0).stop 2023-10-09T11:53:27.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f514c0c6890 msgr2=0x7f514c165710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f514c0c6890 0x7f514c165710 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f513c00cb90 tx=0x7f513c002ad0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 shutdown_connections 2023-10-09T11:53:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f5138067130 0x7f51380695e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f514c0c6890 0x7f514c165710 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f514c156480 0x7f514c0b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 --2- 172.21.15.86:0/2294213608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f514c1560b0 0x7f514c0c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 >> 172.21.15.86:0/2294213608 conn(0x7f514c068390 msgr2=0x7f514c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 shutdown_connections 2023-10-09T11:53:27.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.077+0000 7f51523ff700 1 -- 172.21.15.86:0/2294213608 wait complete. 2023-10-09T11:53:27.094 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:26", "first": "2023-10-09T11:43:01", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:27.095 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:26', 'first': '2023-10-09T11:43:01', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:27.095 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:27.095 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:27.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:27.095 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-09T11:53:27.133 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:27.133 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:27.133 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:27.133 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:27.133 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:27.133 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:27.134 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_01_UTC 2023-10-09T11:53:27.134 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:27.134 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:27.134 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:27.134 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:27.135 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_01_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:27.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-10-09T11:53:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.364+0000 7fcbb37ff700 1 Processor -- start 2023-10-09T11:53:27.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.364+0000 7fcbb37ff700 1 -- start start 2023-10-09T11:53:27.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.365+0000 7fcbb37ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcbac0c8490 0x7fcbac0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.365+0000 7fcbb37ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcbac069e20 0x7fcbac1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb37ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0ac030 con 0x7fcbac069a50 2023-10-09T11:53:27.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb37ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0ab820 con 0x7fcbac069e20 2023-10-09T11:53:27.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb37ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac06dbb0 con 0x7fcbac0c8490 2023-10-09T11:53:27.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb1d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcbac069e20 0x7fcbac1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb1d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcbac069e20 0x7fcbac1569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53774/0 (socket says 172.21.15.86:53774) 2023-10-09T11:53:27.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb1d9c700 1 -- 172.21.15.86:0/2114589115 learned_addr learned my addr 172.21.15.86:0/2114589115 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:27.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb159b700 1 --1- 172.21.15.86:0/2114589115 >> v1:172.21.15.86:6789/0 conn(0x7fcbac069a50 0x7fcbac15a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33360/0 (socket says 172.21.15.86:33360) 2023-10-09T11:53:27.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb0d9a700 1 --2- 172.21.15.86:0/2114589115 >> v2:172.21.15.135:3300/0 conn(0x7fcbac0c8490 0x7fcbac0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb1d9c700 1 -- 172.21.15.86:0/2114589115 >> v2:172.21.15.135:3300/0 conn(0x7fcbac0c8490 msgr2=0x7fcbac0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:27.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb1d9c700 1 --2- 172.21.15.86:0/2114589115 >> v2:172.21.15.135:3300/0 conn(0x7fcbac0c8490 0x7fcbac0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb1d9c700 1 -- 172.21.15.86:0/2114589115 >> v1:172.21.15.86:6789/0 conn(0x7fcbac069a50 legacy=0x7fcbac15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb1d9c700 1 -- 172.21.15.86:0/2114589115 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0aba70 con 0x7fcbac069e20 2023-10-09T11:53:27.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcbb0d9a700 1 --2- 172.21.15.86:0/2114589115 >> v2:172.21.15.135:3300/0 conn(0x7fcbac0c8490 0x7fcbac0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:27.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.366+0000 7fcba3fff700 1 -- 172.21.15.86:0/2114589115 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936804848 0 0) 0x7fcba8001110 con 0x7fcbac069a50 2023-10-09T11:53:27.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcbb1d9c700 1 --2- 172.21.15.86:0/2114589115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069e20 0x7fcbac1569b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcbac06b920 tx=0x7fcba400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5ad9ad9baa66c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:27.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcba3fff700 1 -- 172.21.15.86:0/2114589115 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4010070 con 0x7fcbac069e20 2023-10-09T11:53:27.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcba3fff700 1 -- 172.21.15.86:0/2114589115 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba400de90 con 0x7fcbac069e20 2023-10-09T11:53:27.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcba3fff700 1 -- 172.21.15.86:0/2114589115 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400b320 con 0x7fcbac069e20 2023-10-09T11:53:27.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2114589115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069e20 msgr2=0x7fcbac1569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2114589115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069e20 0x7fcbac1569b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcbac06b920 tx=0x7fcba400ba50 comp rx=0 tx=0).stop 2023-10-09T11:53:27.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2114589115 shutdown_connections 2023-10-09T11:53:27.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2114589115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069e20 0x7fcbac1569b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2114589115 >> v2:172.21.15.135:3300/0 conn(0x7fcbac0c8490 0x7fcbac0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.367+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2114589115 >> 172.21.15.86:0/2114589115 conn(0x7fcbac0c8f90 msgr2=0x7fcbac0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:27.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.368+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2114589115 shutdown_connections 2023-10-09T11:53:27.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.368+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2114589115 wait complete. 2023-10-09T11:53:27.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.369+0000 7fcbb37ff700 1 Processor -- start 2023-10-09T11:53:27.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.369+0000 7fcbb37ff700 1 -- start start 2023-10-09T11:53:27.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb37ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069a50 0x7fcbac154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb37ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac069e20 0x7fcbac157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb37ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbac0c8490 0x7fcbac0c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb37ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0c11d0 con 0x7fcbac069a50 2023-10-09T11:53:27.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb37ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0b06f0 con 0x7fcbac069e20 2023-10-09T11:53:27.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb37ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0b0990 con 0x7fcbac0c8490 2023-10-09T11:53:27.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb159b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069a50 0x7fcbac154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb159b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069a50 0x7fcbac154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53782/0 (socket says 172.21.15.86:53782) 2023-10-09T11:53:27.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb159b700 1 -- 172.21.15.86:0/2658641935 learned_addr learned my addr 172.21.15.86:0/2658641935 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:27.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb0d9a700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac069e20 0x7fcbac157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.370+0000 7fcbb1d9c700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbac0c8490 0x7fcbac0c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb159b700 1 -- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbac0c8490 msgr2=0x7fcbac0c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb159b700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbac0c8490 0x7fcbac0c1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb159b700 1 -- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac069e20 msgr2=0x7fcbac157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb159b700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac069e20 0x7fcbac157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb159b700 1 -- 172.21.15.86:0/2658641935 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba400bcf0 con 0x7fcbac069a50 2023-10-09T11:53:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb0d9a700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac069e20 0x7fcbac157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb159b700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069a50 0x7fcbac154a20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c5b0 tx=0x7fcba8001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcba17fa700 1 -- 172.21.15.86:0/2658641935 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8005a70 con 0x7fcbac069a50 2023-10-09T11:53:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcba17fa700 1 -- 172.21.15.86:0/2658641935 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8005bd0 con 0x7fcbac069a50 2023-10-09T11:53:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcba17fa700 1 -- 172.21.15.86:0/2658641935 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba80070d0 con 0x7fcbac069a50 2023-10-09T11:53:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac0b0c70 con 0x7fcbac069a50 2023-10-09T11:53:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.371+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac0b1230 con 0x7fcbac069a50 2023-10-09T11:53:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.372+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac0b1420 con 0x7fcbac069a50 2023-10-09T11:53:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.373+0000 7fcba17fa700 1 -- 172.21.15.86:0/2658641935 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fcba8007480 con 0x7fcbac069a50 2023-10-09T11:53:27.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.374+0000 7fcba17fa700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb90067130 0x7fcb900695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.374+0000 7fcba17fa700 1 -- 172.21.15.86:0/2658641935 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fcba8083dd0 con 0x7fcbac069a50 2023-10-09T11:53:27.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.374+0000 7fcbb0d9a700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb90067130 0x7fcb900695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.375+0000 7fcbb0d9a700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb90067130 0x7fcb900695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c006f00 tx=0x7fcb9c008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:27.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.378+0000 7fcba17fa700 1 -- 172.21.15.86:0/2658641935 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcba8050c20 con 0x7fcbac069a50 2023-10-09T11:53:27.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.594+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbac0ac030 con 0x7fcb90067130 2023-10-09T11:53:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.602+0000 7fcba17fa700 1 -- 172.21.15.86:0/2658641935 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fcbac0ac030 con 0x7fcb90067130 2023-10-09T11:53:27.602 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:27.603 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:27", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb90067130 msgr2=0x7fcb900695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb90067130 0x7fcb900695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c006f00 tx=0x7fcb9c008040 comp rx=0 tx=0).stop 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069a50 msgr2=0x7fcbac154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069a50 0x7fcbac154a20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c5b0 tx=0x7fcba8001040 comp rx=0 tx=0).stop 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 shutdown_connections 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcb90067130 0x7fcb900695e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbac069a50 0x7fcbac154a20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbac0c8490 0x7fcbac0c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 --2- 172.21.15.86:0/2658641935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac069e20 0x7fcbac157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 >> 172.21.15.86:0/2658641935 conn(0x7fcbac0c8f90 msgr2=0x7fcbac0c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 shutdown_connections 2023-10-09T11:53:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.605+0000 7fcbb37ff700 1 -- 172.21.15.86:0/2658641935 wait complete. 2023-10-09T11:53:27.622 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:27", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:27.622 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:27', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:27.622 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:27.622 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:27.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:27.623 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:27.660 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:27.661 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:27.661 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:27.661 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:27.662 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:27.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-10-09T11:53:27.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.888+0000 7f10c09fe700 1 Processor -- start 2023-10-09T11:53:27.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.888+0000 7f10c09fe700 1 -- start start 2023-10-09T11:53:27.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.889+0000 7f10c09fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f10bc0b0790 0x7f10bc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.889+0000 7f10c09fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0cfa00 con 0x7f10bc0b03c0 2023-10-09T11:53:27.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.889+0000 7f10c09fe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0cb580 con 0x7f10bc1591e0 2023-10-09T11:53:27.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.889+0000 7f10c09fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0cf160 con 0x7f10bc0b0790 2023-10-09T11:53:27.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.889+0000 7f10bad9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f10bc0b03c0 0x7f10bc0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33370/0 (socket says 172.21.15.86:33370) 2023-10-09T11:53:27.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.889+0000 7f10bad9d700 1 -- 172.21.15.86:0/3980299081 learned_addr learned my addr 172.21.15.86:0/3980299081 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.889+0000 7f10ba59c700 1 --2- 172.21.15.86:0/3980299081 >> v2:172.21.15.135:3300/0 conn(0x7f10bc0b0790 0x7f10bc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473694978 0 0) 0x7f10bc0cfa00 con 0x7f10bc0b03c0 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a0003570 con 0x7f10bc0b03c0 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3724740610 0 0) 0x7f10a0003570 con 0x7f10bc0b03c0 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 >> v2:172.21.15.135:3300/0 conn(0x7f10bc0b0790 msgr2=0x7f10bc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 --2- 172.21.15.86:0/3980299081 >> v2:172.21.15.135:3300/0 conn(0x7f10bc0b0790 0x7f10bc0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 >> v1:172.21.15.135:6789/0 conn(0x7f10bc1591e0 legacy=0x7f10bc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0cf440 con 0x7f10bc0b03c0 2023-10-09T11:53:27.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f10ac001470 con 0x7f10bc0b03c0 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 >> v1:172.21.15.86:6789/0 conn(0x7f10bc0b03c0 legacy=0x7f10bc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10a0003a90 0x7f10a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a0004810 0x7f10a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a00052e0 0x7f10a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0cf160 con 0x7f10a00052e0 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a000c230 con 0x7f10a0004810 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a000c3f0 con 0x7f10a0003a90 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10bb59e700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a00052e0 0x7f10a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.890+0000 7f10ba59c700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a0004810 0x7f10a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bad9d700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10a0003a90 0x7f10a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bb59e700 1 -- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10a0003a90 msgr2=0x7f10a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bb59e700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10a0003a90 0x7f10a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bb59e700 1 -- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a0004810 msgr2=0x7f10a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bb59e700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a0004810 0x7f10a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bb59e700 1 -- 172.21.15.86:0/3980299081 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0003570 con 0x7f10a00052e0 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bb59e700 1 -- 172.21.15.86:0/3980299081 reap_dead start 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10bb59e700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a00052e0 0x7f10a000ba60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f10b4001fc0 tx=0x7f10b4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed0fbd1394614db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4001950 con 0x7f10a00052e0 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400c8b0 con 0x7f10a00052e0 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.891+0000 7f10b9d9b700 1 -- 172.21.15.86:0/3980299081 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400cc50 con 0x7f10a00052e0 2023-10-09T11:53:27.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.892+0000 7f10c09fe700 1 -- 172.21.15.86:0/3980299081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a00052e0 msgr2=0x7f10a000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.892+0000 7f10c09fe700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a00052e0 0x7f10a000ba60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f10b4001fc0 tx=0x7f10b4001640 comp rx=0 tx=0).stop 2023-10-09T11:53:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.892+0000 7f10c09fe700 1 -- 172.21.15.86:0/3980299081 shutdown_connections 2023-10-09T11:53:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.892+0000 7f10c09fe700 1 --2- 172.21.15.86:0/3980299081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a00052e0 0x7f10a000ba60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.892+0000 7f10c09fe700 1 -- 172.21.15.86:0/3980299081 >> 172.21.15.86:0/3980299081 conn(0x7f10bc063230 msgr2=0x7f10bc063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.892+0000 7f10c09fe700 1 -- 172.21.15.86:0/3980299081 shutdown_connections 2023-10-09T11:53:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.892+0000 7f10c09fe700 1 -- 172.21.15.86:0/3980299081 wait complete. 2023-10-09T11:53:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.893+0000 7f10c09fe700 1 Processor -- start 2023-10-09T11:53:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.894+0000 7f10c09fe700 1 -- start start 2023-10-09T11:53:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.894+0000 7f10c09fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00052e0 0x7f10bc0af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.894+0000 7f10c09fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10bc0c6a60 0x7f10bc0c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.894+0000 7f10c09fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10bc0c5570 0x7f10bc068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.894+0000 7f10c09fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0c8ba0 con 0x7f10bc0c6a60 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.894+0000 7f10c09fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0c5a00 con 0x7f10a00052e0 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.894+0000 7f10c09fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0c5ca0 con 0x7f10bc0c5570 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10bc0c6a60 0x7f10bc0c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10bc0c6a60 0x7f10bc0c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53804/0 (socket says 172.21.15.86:53804) 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 -- 172.21.15.86:0/2716102296 learned_addr learned my addr 172.21.15.86:0/2716102296 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10bad9d700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00052e0 0x7f10bc0af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10bb59e700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10bc0c5570 0x7f10bc068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 -- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10bc0c5570 msgr2=0x7f10bc068d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10bc0c5570 0x7f10bc068d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 -- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00052e0 msgr2=0x7f10bc0af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00052e0 0x7f10bc0af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 -- 172.21.15.86:0/2716102296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0c5f80 con 0x7f10bc0c6a60 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10bb59e700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10bc0c5570 0x7f10bc068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.895+0000 7f10ba59c700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10bc0c6a60 0x7f10bc0c5030 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006ac0 tx=0x7f10a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.896+0000 7f10b2ffd700 1 -- 172.21.15.86:0/2716102296 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800f940 con 0x7f10bc0c6a60 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.896+0000 7f10b2ffd700 1 -- 172.21.15.86:0/2716102296 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a800faa0 con 0x7f10bc0c6a60 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.896+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc0c6260 con 0x7f10bc0c6a60 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.896+0000 7f10b2ffd700 1 -- 172.21.15.86:0/2716102296 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800fe20 con 0x7f10bc0c6a60 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.896+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc0afb30 con 0x7f10bc0c6a60 2023-10-09T11:53:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.897+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc04c3c0 con 0x7f10bc0c6a60 2023-10-09T11:53:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.898+0000 7f10b2ffd700 1 -- 172.21.15.86:0/2716102296 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f10a8014650 con 0x7f10bc0c6a60 2023-10-09T11:53:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.899+0000 7f10b2ffd700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f10a4067130 0x7f10a40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.899+0000 7f10b2ffd700 1 -- 172.21.15.86:0/2716102296 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f10a8018030 con 0x7f10bc0c6a60 2023-10-09T11:53:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.899+0000 7f10bad9d700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f10a4067130 0x7f10a40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:27.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.899+0000 7f10bad9d700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f10a4067130 0x7f10a40695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f10ac000e10 tx=0x7f10ac007040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:27.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:27.902+0000 7f10b2ffd700 1 -- 172.21.15.86:0/2716102296 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10a8052240 con 0x7f10bc0c6a60 2023-10-09T11:53:28.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.118+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10bc0cf720 con 0x7f10a4067130 2023-10-09T11:53:28.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.126+0000 7f10b2ffd700 1 -- 172.21.15.86:0/2716102296 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f10bc0cf720 con 0x7f10a4067130 2023-10-09T11:53:28.126 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:28.127 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:27", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:28.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.128+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f10a4067130 msgr2=0x7f10a40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.128+0000 7f10c09fe700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f10a4067130 0x7f10a40695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f10ac000e10 tx=0x7f10ac007040 comp rx=0 tx=0).stop 2023-10-09T11:53:28.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.128+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10bc0c6a60 msgr2=0x7f10bc0c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.128+0000 7f10c09fe700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10bc0c6a60 0x7f10bc0c5030 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006ac0 tx=0x7f10a80091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 shutdown_connections 2023-10-09T11:53:28.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f10a4067130 0x7f10a40695e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10bc0c5570 0x7f10bc068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00052e0 0x7f10bc0af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 --2- 172.21.15.86:0/2716102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10bc0c6a60 0x7f10bc0c5030 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 >> 172.21.15.86:0/2716102296 conn(0x7f10bc063230 msgr2=0x7f10bc0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:28.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 shutdown_connections 2023-10-09T11:53:28.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.129+0000 7f10c09fe700 1 -- 172.21.15.86:0/2716102296 wait complete. 2023-10-09T11:53:28.146 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:27", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:28.146 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:27', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:28.147 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:28.147 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:28.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:28.147 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-09T11:53:28.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:28.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:28.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:28.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:28.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:28.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:28.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:28.186 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_01_UTC 2023-10-09T11:53:28.186 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:28.186 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:28.186 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:28.187 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_01_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:28.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-10-09T11:53:28.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.415+0000 7f3a0b7ff700 1 Processor -- start 2023-10-09T11:53:28.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.415+0000 7f3a0b7ff700 1 -- start start 2023-10-09T11:53:28.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.416+0000 7f3a0b7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 0x7f3a04164660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.416+0000 7f3a0b7ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a040af900 con 0x7f3a041597b0 2023-10-09T11:53:28.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.416+0000 7f3a0b7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a04069d80 con 0x7f3a04159b80 2023-10-09T11:53:28.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.416+0000 7f3a0b7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04068390 con 0x7f3a0406a9c0 2023-10-09T11:53:28.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.417+0000 7f3a0959b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3a041597b0 0x7f3a040af1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33374/0 (socket says 172.21.15.86:33374) 2023-10-09T11:53:28.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.417+0000 7f3a0959b700 1 -- 172.21.15.86:0/2239892368 learned_addr learned my addr 172.21.15.86:0/2239892368 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:28.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.417+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131553652 0 0) 0x7f3a040af900 con 0x7f3a041597b0 2023-10-09T11:53:28.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.417+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f0003570 con 0x7f3a041597b0 2023-10-09T11:53:28.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.417+0000 7f3a09d9c700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 0x7f3a04164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.417+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2723462939 0 0) 0x7f39f0003570 con 0x7f3a041597b0 2023-10-09T11:53:28.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 msgr2=0x7f3a04164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 0x7f3a04164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 >> v1:172.21.15.135:6789/0 conn(0x7f3a04159b80 legacy=0x7f3a0406a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040aa680 con 0x7f3a041597b0 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f3a00001470 con 0x7f3a041597b0 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 >> v1:172.21.15.86:6789/0 conn(0x7f3a041597b0 legacy=0x7f3a040af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0003a90 0x7f39f0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 0x7f39f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39f0004d50 0x7f39f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04068390 con 0x7f39f0004d50 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f000bb70 con 0x7f39f0003a90 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f000bd30 con 0x7f3a0406a9c0 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a09d9c700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39f0004d50 0x7f39f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a0959b700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0003a90 0x7f39f0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a08d9a700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 0x7f39f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a09d9c700 1 -- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 msgr2=0x7f39f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a09d9c700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 0x7f39f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a09d9c700 1 -- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0003a90 msgr2=0x7f39f0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a09d9c700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0003a90 0x7f39f0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a09d9c700 1 -- 172.21.15.86:0/2239892368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f0003570 con 0x7f39f0004d50 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.418+0000 7f3a08d9a700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0406a9c0 0x7f39f0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.419+0000 7f3a09d9c700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39f0004d50 0x7f39f00051c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3a0406adc0 tx=0x7f39fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d31e6e0599bac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.419+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00ea90 con 0x7f39f0004d50 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.419+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc00f040 con 0x7f39f0004d50 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.419+0000 7f39fbfff700 1 -- 172.21.15.86:0/2239892368 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00ee40 con 0x7f39f0004d50 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.419+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2239892368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39f0004d50 msgr2=0x7f39f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.419+0000 7f3a0b7ff700 1 --2- 172.21.15.86:0/2239892368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39f0004d50 0x7f39f00051c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3a0406adc0 tx=0x7f39fc00b040 comp rx=0 tx=0).stop 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.419+0000 7f3a09d9c700 1 -- 172.21.15.86:0/2239892368 reap_dead start 2023-10-09T11:53:28.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.420+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2239892368 shutdown_connections 2023-10-09T11:53:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.420+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2239892368 >> 172.21.15.86:0/2239892368 conn(0x7f3a040cd880 msgr2=0x7f3a040ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.420+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2239892368 shutdown_connections 2023-10-09T11:53:28.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.420+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2239892368 wait complete. 2023-10-09T11:53:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.421+0000 7f3a0b7ff700 1 Processor -- start 2023-10-09T11:53:28.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.421+0000 7f3a0b7ff700 1 -- start start 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a0b7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0004d50 0x7f3a0416dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a0b7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041584c0 0x7f3a040cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a0b7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0415b5e0 0x7f3a0415ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a0b7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0416e240 con 0x7f3a041584c0 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a0b7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0415b150 con 0x7f39f0004d50 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a0b7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0415a540 con 0x7f3a0415b5e0 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a08d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041584c0 0x7f3a040cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a08d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041584c0 0x7f3a040cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53822/0 (socket says 172.21.15.86:53822) 2023-10-09T11:53:28.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a08d9a700 1 -- 172.21.15.86:0/2395729923 learned_addr learned my addr 172.21.15.86:0/2395729923 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a0959b700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0004d50 0x7f3a0416dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.422+0000 7f3a09d9c700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0415b5e0 0x7f3a0415ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a08d9a700 1 -- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0415b5e0 msgr2=0x7f3a0415ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a08d9a700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0415b5e0 0x7f3a0415ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a08d9a700 1 -- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0004d50 msgr2=0x7f3a0416dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a08d9a700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0004d50 0x7f3a0416dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a08d9a700 1 -- 172.21.15.86:0/2395729923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0415a820 con 0x7f3a041584c0 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a0959b700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0004d50 0x7f3a0416dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a08d9a700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041584c0 0x7f3a040cbb60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f39f400e5a0 tx=0x7f39f4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f39f97fa700 1 -- 172.21.15.86:0/2395729923 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4010490 con 0x7f3a041584c0 2023-10-09T11:53:28.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f39f97fa700 1 -- 172.21.15.86:0/2395729923 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f4010040 con 0x7f3a041584c0 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0415ab00 con 0x7f3a041584c0 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f39f97fa700 1 -- 172.21.15.86:0/2395729923 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4010820 con 0x7f3a041584c0 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.423+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a040cc0a0 con 0x7f3a041584c0 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.424+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0415b2e0 con 0x7f3a041584c0 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.425+0000 7f39f97fa700 1 -- 172.21.15.86:0/2395729923 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f39f4010c50 con 0x7f3a041584c0 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.426+0000 7f39f97fa700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f39e8067130 0x7f39e80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.426+0000 7f39f97fa700 1 -- 172.21.15.86:0/2395729923 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f39f4083eb0 con 0x7f3a041584c0 2023-10-09T11:53:28.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.426+0000 7f3a0959b700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f39e8067130 0x7f39e80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.427+0000 7f3a0959b700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f39e8067130 0x7f39e80695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a000015a0 tx=0x7f3a00009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:28.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.430+0000 7f39f97fa700 1 -- 172.21.15.86:0/2395729923 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39f404d5a0 con 0x7f3a041584c0 2023-10-09T11:53:28.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.644+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a040718b0 con 0x7f39e8067130 2023-10-09T11:53:28.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.652+0000 7f39f97fa700 1 -- 172.21.15.86:0/2395729923 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f3a040718b0 con 0x7f39e8067130 2023-10-09T11:53:28.652 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:28.652 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:28", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:28.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.654+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f39e8067130 msgr2=0x7f39e80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.654+0000 7f3a0b7ff700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f39e8067130 0x7f39e80695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a000015a0 tx=0x7f3a00009040 comp rx=0 tx=0).stop 2023-10-09T11:53:28.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.654+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041584c0 msgr2=0x7f3a040cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.654+0000 7f3a0b7ff700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041584c0 0x7f3a040cbb60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f39f400e5a0 tx=0x7f39f4009040 comp rx=0 tx=0).stop 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 shutdown_connections 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f39e8067130 0x7f39e80695e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a0415b5e0 0x7f3a0415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f0004d50 0x7f3a0416dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 --2- 172.21.15.86:0/2395729923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a041584c0 0x7f3a040cbb60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 >> 172.21.15.86:0/2395729923 conn(0x7f3a040cd880 msgr2=0x7f3a040afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 shutdown_connections 2023-10-09T11:53:28.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.655+0000 7f3a0b7ff700 1 -- 172.21.15.86:0/2395729923 wait complete. 2023-10-09T11:53:28.672 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:28", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:28.672 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:28', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:28.672 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:28.672 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:28.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:28.673 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-09T11:53:28.710 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:28.710 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:28.710 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:28.710 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:28.710 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:28.711 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:28.711 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:28.711 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:28.711 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:28.711 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:28.711 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:28.712 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:28.712 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-10-09T11:53:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.937+0000 7f6c9e3ff700 1 Processor -- start 2023-10-09T11:53:28.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.937+0000 7f6c9e3ff700 1 -- start start 2023-10-09T11:53:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c9e3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c98159ec0 0x7f6c980b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c9e3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c980b53d0 0x7f6c980cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c9e3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980b5b00 con 0x7f6c980cce40 2023-10-09T11:53:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c9e3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980b5850 con 0x7f6c98159ec0 2023-10-09T11:53:28.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c9e3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980b5da0 con 0x7f6c980b53d0 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c97fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c98159ec0 0x7f6c980b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c97fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c98159ec0 0x7f6c980b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53824/0 (socket says 172.21.15.86:53824) 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c97fff700 1 -- 172.21.15.86:0/3507926753 learned_addr learned my addr 172.21.15.86:0/3507926753 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c977fe700 1 --2- 172.21.15.86:0/3507926753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c980b53d0 0x7f6c980cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c97fff700 1 -- 172.21.15.86:0/3507926753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c980b53d0 msgr2=0x7f6c980cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c97fff700 1 --2- 172.21.15.86:0/3507926753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c980b53d0 0x7f6c980cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c97fff700 1 -- 172.21.15.86:0/3507926753 >> v1:172.21.15.135:6789/0 conn(0x7f6c980cce40 legacy=0x7f6c980cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.939+0000 7f6c97fff700 1 -- 172.21.15.86:0/3507926753 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980b6080 con 0x7f6c98159ec0 2023-10-09T11:53:28.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.940+0000 7f6c97fff700 1 --2- 172.21.15.86:0/3507926753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c98159ec0 0x7f6c980b4e90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009990 tx=0x7f6c88009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f800a649054b3ca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:28.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.940+0000 7f6c96ffd700 1 -- 172.21.15.86:0/3507926753 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88009e80 con 0x7f6c98159ec0 2023-10-09T11:53:28.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.940+0000 7f6c96ffd700 1 -- 172.21.15.86:0/3507926753 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88005c10 con 0x7f6c98159ec0 2023-10-09T11:53:28.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.940+0000 7f6c96ffd700 1 -- 172.21.15.86:0/3507926753 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8800b650 con 0x7f6c98159ec0 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.940+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/3507926753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c98159ec0 msgr2=0x7f6c980b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.940+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/3507926753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c98159ec0 0x7f6c980b4e90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009990 tx=0x7f6c88009220 comp rx=0 tx=0).stop 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.941+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/3507926753 shutdown_connections 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.941+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/3507926753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c98159ec0 0x7f6c980b4e90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.941+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/3507926753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c980b53d0 0x7f6c980cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.941+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/3507926753 >> 172.21.15.86:0/3507926753 conn(0x7f6c980999f0 msgr2=0x7f6c980b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.941+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/3507926753 shutdown_connections 2023-10-09T11:53:28.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.941+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/3507926753 wait complete. 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.942+0000 7f6c9e3ff700 1 Processor -- start 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.942+0000 7f6c9e3ff700 1 -- start start 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c9e3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c980b53d0 0x7f6c9813eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c9e3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c980cce40 0x7f6c981547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c9e3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c98159ec0 0x7f6c980ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c9e3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9813f020 con 0x7f6c980b53d0 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c9e3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98151740 con 0x7f6c980cce40 2023-10-09T11:53:28.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c9e3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c981551d0 con 0x7f6c98159ec0 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c97fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c980b53d0 0x7f6c9813eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c97fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c980b53d0 0x7f6c9813eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53830/0 (socket says 172.21.15.86:53830) 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.943+0000 7f6c97fff700 1 -- 172.21.15.86:0/365771826 learned_addr learned my addr 172.21.15.86:0/365771826 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c97fff700 1 -- 172.21.15.86:0/365771826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c98159ec0 msgr2=0x7f6c980ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c97fff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c98159ec0 0x7f6c980ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c97fff700 1 -- 172.21.15.86:0/365771826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c980cce40 msgr2=0x7f6c981547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c97fff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c980cce40 0x7f6c981547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c97fff700 1 -- 172.21.15.86:0/365771826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88009480 con 0x7f6c980b53d0 2023-10-09T11:53:28.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c97fff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c980b53d0 0x7f6c9813eae0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6c88011750 tx=0x7f6c88016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:28.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c7ffff700 1 -- 172.21.15.86:0/365771826 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88011ad0 con 0x7f6c980b53d0 2023-10-09T11:53:28.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c7ffff700 1 -- 172.21.15.86:0/365771826 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88020070 con 0x7f6c980b53d0 2023-10-09T11:53:28.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98069150 con 0x7f6c980b53d0 2023-10-09T11:53:28.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c7ffff700 1 -- 172.21.15.86:0/365771826 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88011e60 con 0x7f6c980b53d0 2023-10-09T11:53:28.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.944+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98068b00 con 0x7f6c980b53d0 2023-10-09T11:53:28.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.945+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98063c90 con 0x7f6c980b53d0 2023-10-09T11:53:28.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.946+0000 7f6c7ffff700 1 -- 172.21.15.86:0/365771826 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f6c88022030 con 0x7f6c980b53d0 2023-10-09T11:53:28.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.947+0000 7f6c7ffff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6c84067130 0x7f6c840695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:28.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.948+0000 7f6c7ffff700 1 -- 172.21.15.86:0/365771826 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6c88086640 con 0x7f6c980b53d0 2023-10-09T11:53:28.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.948+0000 7f6c977fe700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6c84067130 0x7f6c840695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:28.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.948+0000 7f6c977fe700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6c84067130 0x7f6c840695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c980b6580 tx=0x7f6c8c0091a0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:28.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:28.952+0000 7f6c7ffff700 1 -- 172.21.15.86:0/365771826 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c88053490 con 0x7f6c980b53d0 2023-10-09T11:53:29.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.165+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c980718b0 con 0x7f6c84067130 2023-10-09T11:53:29.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.174+0000 7f6c7ffff700 1 -- 172.21.15.86:0/365771826 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6c980718b0 con 0x7f6c84067130 2023-10-09T11:53:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:29.174 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:28", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6c84067130 msgr2=0x7f6c840695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6c84067130 0x7f6c840695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c980b6580 tx=0x7f6c8c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c980b53d0 msgr2=0x7f6c9813eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c980b53d0 0x7f6c9813eae0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6c88011750 tx=0x7f6c88016000 comp rx=0 tx=0).stop 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 shutdown_connections 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f6c84067130 0x7f6c840695e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c980b53d0 0x7f6c9813eae0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c98159ec0 0x7f6c980ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 --2- 172.21.15.86:0/365771826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c980cce40 0x7f6c981547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 >> 172.21.15.86:0/365771826 conn(0x7f6c980999f0 msgr2=0x7f6c980b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 shutdown_connections 2023-10-09T11:53:29.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.176+0000 7f6c9e3ff700 1 -- 172.21.15.86:0/365771826 wait complete. 2023-10-09T11:53:29.194 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:28", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:29.194 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:28', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:29.194 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:29.194 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:29.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:29.195 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-09T11:53:29.231 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:29.232 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:29.233 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:29.233 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-10-09T11:53:29.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.458+0000 7f7ac77ff700 1 Processor -- start 2023-10-09T11:53:29.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.458+0000 7f7ac77ff700 1 -- start start 2023-10-09T11:53:29.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.459+0000 7f7ac77ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7ac0157740 0x7f7ac00adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.459+0000 7f7ac77ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 0x7f7ac006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.459+0000 7f7ac77ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac006dc20 con 0x7f7ac00b2100 2023-10-09T11:53:29.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.459+0000 7f7ac77ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac00acc00 con 0x7f7ac0157740 2023-10-09T11:53:29.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.459+0000 7f7ac77ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac006d6a0 con 0x7f7ac0068aa0 2023-10-09T11:53:29.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ac4d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7ac00b2100 0x7f7ac0068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33388/0 (socket says 172.21.15.86:33388) 2023-10-09T11:53:29.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ac4d9a700 1 -- 172.21.15.86:0/2319210506 learned_addr learned my addr 172.21.15.86:0/2319210506 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:29.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ac559b700 1 --2- 172.21.15.86:0/2319210506 >> v2:172.21.15.135:3300/0 conn(0x7f7ac0157740 0x7f7ac00adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 0x7f7ac006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404198251 0 0) 0x7f7ac006dc20 con 0x7f7ac00b2100 2023-10-09T11:53:29.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aac003570 con 0x7f7ac00b2100 2023-10-09T11:53:29.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129122768 0 0) 0x7f7aac003570 con 0x7f7ac00b2100 2023-10-09T11:53:29.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 msgr2=0x7f7ac006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 0x7f7ac006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 >> v2:172.21.15.135:3300/0 conn(0x7f7ac0157740 msgr2=0x7f7ac00adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 --2- 172.21.15.86:0/2319210506 >> v2:172.21.15.135:3300/0 conn(0x7f7ac0157740 0x7f7ac00adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac00ae910 con 0x7f7ac00b2100 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f7ab0001470 con 0x7f7ac00b2100 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 0x7f7ac006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 >> v1:172.21.15.86:6789/0 conn(0x7f7ac00b2100 legacy=0x7f7ac0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 0x7f7aac003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aac004070 0x7f7aac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.460+0000 7f7ab7fff700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aac004d50 0x7f7aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00acc00 con 0x7f7aac004d50 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac006d6a0 con 0x7f7aac004070 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac00bb10 con 0x7f7ac0068aa0 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac559b700 1 --2- 172.21.15.86:0/2319210506 >> v2:172.21.15.135:3300/0 conn(0x7f7ac0157740 0x7f7ac00adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aac004d50 0x7f7aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac4d9a700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aac004070 0x7f7aac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac559b700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 0x7f7aac003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 msgr2=0x7f7aac003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ac0068aa0 0x7f7aac003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aac004070 msgr2=0x7f7aac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aac004070 0x7f7aac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2319210506 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009a20 con 0x7f7aac004d50 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac4d9a700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aac004070 0x7f7aac004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.461+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aac004d50 0x7f7aac0051c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0068ea0 tx=0x7f7ab800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f381e3fbdb5ed5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8009c50 con 0x7f7aac004d50 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800f040 con 0x7f7aac004d50 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ab7fff700 1 -- 172.21.15.86:0/2319210506 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800ee60 con 0x7f7aac004d50 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2319210506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aac004d50 msgr2=0x7f7aac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ac77ff700 1 --2- 172.21.15.86:0/2319210506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aac004d50 0x7f7aac0051c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0068ea0 tx=0x7f7ab800b040 comp rx=0 tx=0).stop 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2319210506 reap_dead start 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2319210506 shutdown_connections 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2319210506 >> 172.21.15.86:0/2319210506 conn(0x7f7ac00c8f90 msgr2=0x7f7ac00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2319210506 shutdown_connections 2023-10-09T11:53:29.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.462+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2319210506 wait complete. 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.464+0000 7f7ac77ff700 1 Processor -- start 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.464+0000 7f7ac77ff700 1 -- start start 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac77ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aac004d50 0x7f7ac0155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac77ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ac0155e30 0x7f7ac01682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac77ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ac0069700 0x7f7ac0069b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac77ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac006a0c0 con 0x7f7ac0069700 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac77ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00c53f0 con 0x7f7ac0155e30 2023-10-09T11:53:29.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac77ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0168830 con 0x7f7aac004d50 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ac0069700 0x7f7ac0069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ac0069700 0x7f7ac0069b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53840/0 (socket says 172.21.15.86:53840) 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2390203854 learned_addr learned my addr 172.21.15.86:0/2390203854 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac559b700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aac004d50 0x7f7ac0155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac4d9a700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ac0155e30 0x7f7ac01682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aac004d50 msgr2=0x7f7ac0155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aac004d50 0x7f7ac0155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ac0155e30 msgr2=0x7f7ac01682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ac0155e30 0x7f7ac01682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.465+0000 7f7ac5d9c700 1 -- 172.21.15.86:0/2390203854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac00c4500 con 0x7f7ac0069700 2023-10-09T11:53:29.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.466+0000 7f7ac5d9c700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ac0069700 0x7f7ac0069b80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8002230 tx=0x7f7ab801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.466+0000 7f7ab57fa700 1 -- 172.21.15.86:0/2390203854 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8009c50 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.466+0000 7f7ab57fa700 1 -- 172.21.15.86:0/2390203854 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab801d630 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.466+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac00c47e0 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.466+0000 7f7ab57fa700 1 -- 172.21.15.86:0/2390203854 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab801d9f0 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.466+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac00c4da0 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.467+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac00718b0 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.468+0000 7f7ab57fa700 1 -- 172.21.15.86:0/2390203854 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f7ab80133e0 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.469+0000 7f7ab57fa700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7aa4067130 0x7f7aa40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.469+0000 7f7ab57fa700 1 -- 172.21.15.86:0/2390203854 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f7ab8085b90 con 0x7f7ac0069700 2023-10-09T11:53:29.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.469+0000 7f7ac559b700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7aa4067130 0x7f7aa40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.470+0000 7f7ac559b700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7aa4067130 0x7f7aa40695e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0093f0 tx=0x7f7abc008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:29.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.473+0000 7f7ab57fa700 1 -- 172.21.15.86:0/2390203854 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ab80529f0 con 0x7f7ac0069700 2023-10-09T11:53:29.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.685+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ac00aebf0 con 0x7f7aa4067130 2023-10-09T11:53:29.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.694+0000 7f7ab57fa700 1 -- 172.21.15.86:0/2390203854 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f7ac00aebf0 con 0x7f7aa4067130 2023-10-09T11:53:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:29.694 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:29", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:29.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7aa4067130 msgr2=0x7f7aa40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7aa4067130 0x7f7aa40695e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0093f0 tx=0x7f7abc008040 comp rx=0 tx=0).stop 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ac0069700 msgr2=0x7f7ac0069b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ac0069700 0x7f7ac0069b80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8002230 tx=0x7f7ab801a000 comp rx=0 tx=0).stop 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 shutdown_connections 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7aa4067130 0x7f7aa40695e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ac0069700 0x7f7ac0069b80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aac004d50 0x7f7ac0155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 --2- 172.21.15.86:0/2390203854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ac0155e30 0x7f7ac01682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 >> 172.21.15.86:0/2390203854 conn(0x7f7ac00c8f90 msgr2=0x7f7ac00ac1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 shutdown_connections 2023-10-09T11:53:29.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.696+0000 7f7ac77ff700 1 -- 172.21.15.86:0/2390203854 wait complete. 2023-10-09T11:53:29.714 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:29", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:29.714 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:29', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:29.714 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:29.714 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:29.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:29.714 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-09T11:53:29.752 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:29.752 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:29.752 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:29.752 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:29.753 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:29.753 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:29.753 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:29.753 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:29.753 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:29.753 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:29.753 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:29.754 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-11_43_00_UTC', 'scheduled-2023-10-09-11_44_00_UTC', 'scheduled-2023-10-09-11_45_00_UTC', 'scheduled-2023-10-09-11_46_00_UTC', 'scheduled-2023-10-09-11_47_00_UTC', 'scheduled-2023-10-09-11_48_00_UTC', 'scheduled-2023-10-09-11_49_00_UTC', 'scheduled-2023-10-09-11_50_00_UTC', 'scheduled-2023-10-09-11_51_00_UTC', 'scheduled-2023-10-09-11_52_00_UTC', 'scheduled-2023-10-09-11_53_00_UTC'] 2023-10-09T11:53:29.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-10-09T11:53:29.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.979+0000 7f0eea79d700 1 Processor -- start 2023-10-09T11:53:29.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.979+0000 7f0eea79d700 1 -- start start 2023-10-09T11:53:29.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.980+0000 7f0eea79d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ee40b0760 0x7f0ee40b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.980+0000 7f0eea79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 0x7f0ee40ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.980+0000 7f0eea79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40b0570 con 0x7f0ee4156350 2023-10-09T11:53:29.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.980+0000 7f0eea79d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee40b1140 con 0x7f0ee40b0760 2023-10-09T11:53:29.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.980+0000 7f0eea79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40af4d0 con 0x7f0ee40ace60 2023-10-09T11:53:29.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.980+0000 7f0ee979b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0ee4156350 0x7f0ee4157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33402/0 (socket says 172.21.15.86:33402) 2023-10-09T11:53:29.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.980+0000 7f0ee979b700 1 -- 172.21.15.86:0/2671060119 learned_addr learned my addr 172.21.15.86:0/2671060119 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:29.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 0x7f0ee40ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0ee8f9a700 1 --2- 172.21.15.86:0/2671060119 >> v2:172.21.15.135:3300/0 conn(0x7f0ee40b0760 0x7f0ee40b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567499665 0 0) 0x7f0ee40b0570 con 0x7f0ee4156350 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed0003570 con 0x7f0ee4156350 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 831893872 0 0) 0x7f0ed0003570 con 0x7f0ee4156350 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 msgr2=0x7f0ee40ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 0x7f0ee40ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 >> v2:172.21.15.135:3300/0 conn(0x7f0ee40b0760 msgr2=0x7f0ee40b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 --2- 172.21.15.86:0/2671060119 >> v2:172.21.15.135:3300/0 conn(0x7f0ee40b0760 0x7f0ee40b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40af7b0 con 0x7f0ee4156350 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f0ee0001470 con 0x7f0ee4156350 2023-10-09T11:53:29.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 >> v1:172.21.15.86:6789/0 conn(0x7f0ee4156350 legacy=0x7f0ee4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0003a60 0x7f0ed0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 0x7f0ed0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0004d50 0x7f0ed00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b1140 con 0x7f0ed0004d50 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40af4d0 con 0x7f0ed0003a60 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed000ba60 con 0x7f0ee40ace60 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.981+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0004d50 0x7f0ed00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee8f9a700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 0x7f0ed0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee979b700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0003a60 0x7f0ed0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 msgr2=0x7f0ed0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee40ace60 0x7f0ed0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0003a60 msgr2=0x7f0ed0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0003a60 0x7f0ed0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/2671060119 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0003570 con 0x7f0ed0004d50 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0004d50 0x7f0ed00051c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00e210 tx=0x7f0edc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe03c3b35a7b44d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00ea60 con 0x7f0ed0004d50 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00f040 con 0x7f0ed0004d50 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.982+0000 7f0edbfff700 1 -- 172.21.15.86:0/2671060119 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00ee10 con 0x7f0ed0004d50 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.983+0000 7f0eea79d700 1 -- 172.21.15.86:0/2671060119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0004d50 msgr2=0x7f0ed00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.983+0000 7f0eea79d700 1 --2- 172.21.15.86:0/2671060119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0004d50 0x7f0ed00051c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00e210 tx=0x7f0edc00b040 comp rx=0 tx=0).stop 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.983+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/2671060119 reap_dead start 2023-10-09T11:53:29.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.983+0000 7f0eea79d700 1 -- 172.21.15.86:0/2671060119 shutdown_connections 2023-10-09T11:53:29.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.983+0000 7f0eea79d700 1 -- 172.21.15.86:0/2671060119 >> 172.21.15.86:0/2671060119 conn(0x7f0ee4068e20 msgr2=0x7f0ee40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:29.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.983+0000 7f0eea79d700 1 -- 172.21.15.86:0/2671060119 shutdown_connections 2023-10-09T11:53:29.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.983+0000 7f0eea79d700 1 -- 172.21.15.86:0/2671060119 wait complete. 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.984+0000 7f0eea79d700 1 Processor -- start 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.985+0000 7f0eea79d700 1 -- start start 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.985+0000 7f0eea79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0004d50 0x7f0ee414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.985+0000 7f0eea79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4150980 0x7f0ee40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.985+0000 7f0eea79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ee4152100 0x7f0ee4152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.985+0000 7f0eea79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4152ab0 con 0x7f0ee4152100 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.985+0000 7f0eea79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee414fb50 con 0x7f0ed0004d50 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.985+0000 7f0eea79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40c9910 con 0x7f0ee4150980 2023-10-09T11:53:29.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ee4152100 0x7f0ee4152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ee4152100 0x7f0ee4152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53860/0 (socket says 172.21.15.86:53860) 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/642767783 learned_addr learned my addr 172.21.15.86:0/642767783 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/642767783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4150980 msgr2=0x7f0ee40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4150980 0x7f0ee40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/642767783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0004d50 msgr2=0x7f0ee414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0004d50 0x7f0ee414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 -- 172.21.15.86:0/642767783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40c9bf0 con 0x7f0ee4152100 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ee9f9c700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ee4152100 0x7f0ee4152570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0edc016000 tx=0x7f0edc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ed97fa700 1 -- 172.21.15.86:0/642767783 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc01d630 con 0x7f0ee4152100 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ed97fa700 1 -- 172.21.15.86:0/642767783 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc01d7b0 con 0x7f0ee4152100 2023-10-09T11:53:29.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee40c9ed0 con 0x7f0ee4152100 2023-10-09T11:53:29.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.986+0000 7f0ed97fa700 1 -- 172.21.15.86:0/642767783 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc01db70 con 0x7f0ee4152100 2023-10-09T11:53:29.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.987+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee40c9600 con 0x7f0ee4152100 2023-10-09T11:53:29.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.987+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee415c520 con 0x7f0ee4152100 2023-10-09T11:53:29.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.988+0000 7f0ed97fa700 1 -- 172.21.15.86:0/642767783 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f0edc003040 con 0x7f0ee4152100 2023-10-09T11:53:29.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.989+0000 7f0ed97fa700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0ec8067130 0x7f0ec80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:29.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.989+0000 7f0ed97fa700 1 -- 172.21.15.86:0/642767783 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f0edc085fe0 con 0x7f0ee4152100 2023-10-09T11:53:29.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.989+0000 7f0ee979b700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0ec8067130 0x7f0ec80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:29.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.990+0000 7f0ee979b700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0ec8067130 0x7f0ec80695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007db0 tx=0x7f0ee0001e90 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:29.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:29.993+0000 7f0ed97fa700 1 -- 172.21.15.86:0/642767783 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ee415c520 con 0x7f0ee4152100 2023-10-09T11:53:30.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.207+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ee415c520 con 0x7f0ec8067130 2023-10-09T11:53:30.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.215+0000 7f0ed97fa700 1 -- 172.21.15.86:0/642767783 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f0ee415c520 con 0x7f0ec8067130 2023-10-09T11:53:30.216 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:30.216 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:29", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.217+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0ec8067130 msgr2=0x7f0ec80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.217+0000 7f0eea79d700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0ec8067130 0x7f0ec80695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007db0 tx=0x7f0ee0001e90 comp rx=0 tx=0).stop 2023-10-09T11:53:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ee4152100 msgr2=0x7f0ee4152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ee4152100 0x7f0ee4152570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0edc016000 tx=0x7f0edc01a000 comp rx=0 tx=0).stop 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 shutdown_connections 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f0ec8067130 0x7f0ec80695e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ee4152100 0x7f0ee4152570 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed0004d50 0x7f0ee414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 --2- 172.21.15.86:0/642767783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4150980 0x7f0ee40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 >> 172.21.15.86:0/642767783 conn(0x7f0ee4068e20 msgr2=0x7f0ee4153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 shutdown_connections 2023-10-09T11:53:30.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.218+0000 7f0eea79d700 1 -- 172.21.15.86:0/642767783 wait complete. 2023-10-09T11:53:30.235 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:42:29", "first": "2023-10-09T11:43:00", "last": "2023-10-09T11:53:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-09T11:53:30.235 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T11:42:29', 'first': '2023-10-09T11:43:00', 'last': '2023-10-09T11:53:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-09T11:53:30.235 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T11:53:30.235 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T11:53:30.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-10-09T11:53:30.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.422+0000 7f2072dff700 1 Processor -- start 2023-10-09T11:53:30.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.422+0000 7f2072dff700 1 -- start start 2023-10-09T11:53:30.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.423+0000 7f2072dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f206c1563b0 0x7f206c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:30.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.423+0000 7f2072dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c15a440 0x7f206c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.423+0000 7f2072dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c15a9b0 con 0x7f206c068890 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.423+0000 7f2072dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c15ac90 con 0x7f206c1563b0 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.423+0000 7f2072dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15af70 con 0x7f206c15a440 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.423+0000 7f207139c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f206c068890 0x7f206c0c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33410/0 (socket says 172.21.15.86:33410) 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f207139c700 1 -- 172.21.15.86:0/3076619650 learned_addr learned my addr 172.21.15.86:0/3076619650 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f206bfff700 1 --2- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c15a440 0x7f206c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f2070b9b700 1 --2- 172.21.15.86:0/3076619650 >> v2:172.21.15.135:3300/0 conn(0x7f206c1563b0 0x7f206c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f206b7fe700 1 -- 172.21.15.86:0/3076619650 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773440261 0 0) 0x7f206c15a9b0 con 0x7f206c068890 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f206b7fe700 1 -- 172.21.15.86:0/3076619650 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c003570 con 0x7f206c068890 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f2070b9b700 1 -- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c15a440 msgr2=0x7f206c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:30.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f2070b9b700 1 --2- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c15a440 0x7f206c0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f2070b9b700 1 -- 172.21.15.86:0/3076619650 >> v1:172.21.15.86:6789/0 conn(0x7f206c068890 legacy=0x7f206c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f2070b9b700 1 -- 172.21.15.86:0/3076619650 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c15b250 con 0x7f206c1563b0 2023-10-09T11:53:30.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f206bfff700 1 --2- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c15a440 0x7f206c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:30.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.424+0000 7f2070b9b700 1 --2- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c1563b0 0x7f206c156780 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f20600098e0 tx=0x7f20600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f3e137dabec32a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:30.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f206b7fe700 1 -- 172.21.15.86:0/3076619650 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060011630 con 0x7f206c1563b0 2023-10-09T11:53:30.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f206b7fe700 1 -- 172.21.15.86:0/3076619650 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060011790 con 0x7f206c1563b0 2023-10-09T11:53:30.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f206b7fe700 1 -- 172.21.15.86:0/3076619650 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060011b30 con 0x7f206c1563b0 2023-10-09T11:53:30.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 -- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c1563b0 msgr2=0x7f206c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 --2- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c1563b0 0x7f206c156780 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f20600098e0 tx=0x7f20600091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 -- 172.21.15.86:0/3076619650 shutdown_connections 2023-10-09T11:53:30.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 --2- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c1563b0 0x7f206c156780 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 --2- 172.21.15.86:0/3076619650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c15a440 0x7f206c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 -- 172.21.15.86:0/3076619650 >> 172.21.15.86:0/3076619650 conn(0x7f206c0c8f90 msgr2=0x7f206c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:30.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 -- 172.21.15.86:0/3076619650 shutdown_connections 2023-10-09T11:53:30.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.425+0000 7f2072dff700 1 -- 172.21.15.86:0/3076619650 wait complete. 2023-10-09T11:53:30.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.427+0000 7f2072dff700 1 Processor -- start 2023-10-09T11:53:30.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.427+0000 7f2072dff700 1 -- start start 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2072dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c068890 0x7f206c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2072dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c1563b0 0x7f206c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2072dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f206c15a440 0x7f206c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2072dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c149850 con 0x7f206c15a440 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2072dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c158e80 con 0x7f206c068890 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2072dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c14cae0 con 0x7f206c1563b0 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f206c15a440 0x7f206c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:30.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f206c15a440 0x7f206c156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53868/0 (socket says 172.21.15.86:53868) 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 -- 172.21.15.86:0/1284542730 learned_addr learned my addr 172.21.15.86:0/1284542730 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f206bfff700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c1563b0 0x7f206c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2070b9b700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c068890 0x7f206c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 -- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c1563b0 msgr2=0x7f206c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c1563b0 0x7f206c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 -- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c068890 msgr2=0x7f206c14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c068890 0x7f206c14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f207139c700 1 -- 172.21.15.86:0/1284542730 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058009420 con 0x7f206c15a440 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.428+0000 7f2070b9b700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c068890 0x7f206c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.429+0000 7f207139c700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f206c15a440 0x7f206c156e60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2064001460 tx=0x7f2064001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:30.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.429+0000 7f2068ff9700 1 -- 172.21.15.86:0/1284542730 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400a940 con 0x7f206c15a440 2023-10-09T11:53:30.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.429+0000 7f2068ff9700 1 -- 172.21.15.86:0/1284542730 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206400aaa0 con 0x7f206c15a440 2023-10-09T11:53:30.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.429+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2060009420 con 0x7f206c15a440 2023-10-09T11:53:30.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.429+0000 7f2068ff9700 1 -- 172.21.15.86:0/1284542730 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400ae20 con 0x7f206c15a440 2023-10-09T11:53:30.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.429+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c14c560 con 0x7f206c15a440 2023-10-09T11:53:30.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.430+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c159010 con 0x7f206c15a440 2023-10-09T11:53:30.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.431+0000 7f2068ff9700 1 -- 172.21.15.86:0/1284542730 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f2064007300 con 0x7f206c15a440 2023-10-09T11:53:30.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.432+0000 7f2068ff9700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2050067130 0x7f20500695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:30.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.432+0000 7f2068ff9700 1 -- 172.21.15.86:0/1284542730 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f2064084e90 con 0x7f206c15a440 2023-10-09T11:53:30.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.432+0000 7f2070b9b700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2050067130 0x7f20500695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:30.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.433+0000 7f2070b9b700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2050067130 0x7f20500695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f20600091e0 tx=0x7f2060017000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:30.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.436+0000 7f2068ff9700 1 -- 172.21.15.86:0/1284542730 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2064051d60 con 0x7f206c15a440 2023-10-09T11:53:30.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.651+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f206c0718b0 con 0x7f2050067130 2023-10-09T11:53:30.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.726+0000 7f2068ff9700 1 -- 172.21.15.86:0/1284542730 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f206c0718b0 con 0x7f2050067130 2023-10-09T11:53:30.726 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-10-09T11:53:30.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2050067130 msgr2=0x7f20500695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2050067130 0x7f20500695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f20600091e0 tx=0x7f2060017000 comp rx=0 tx=0).stop 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f206c15a440 msgr2=0x7f206c156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f206c15a440 0x7f206c156e60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2064001460 tx=0x7f2064001ae0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 shutdown_connections 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2050067130 0x7f20500695e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f206c15a440 0x7f206c156e60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f206c068890 0x7f206c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 --2- 172.21.15.86:0/1284542730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f206c1563b0 0x7f206c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 >> 172.21.15.86:0/1284542730 conn(0x7f206c0c8f90 msgr2=0x7f206c0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 shutdown_connections 2023-10-09T11:53:30.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:30.728+0000 7f2072dff700 1 -- 172.21.15.86:0/1284542730 wait complete. 2023-10-09T11:53:30.745 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-10-09T11:53:30.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:30.746 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:30.784 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:30.785 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:30.785 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:30.785 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:30.786 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:30.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:30.786 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:30.871 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:30.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:30.872 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:30.959 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:30.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:30.959 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:31.004 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:31.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.005 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:31.090 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:31.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.090 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:31.178 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:31.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.178 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:31.223 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:31.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.224 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:31.311 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:31.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.312 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:31.356 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:31.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.356 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:31.439 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:31.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.439 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:31.522 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:31.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.522 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:31.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:31.606 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-10-09T11:53:31.687 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-10-09T11:53:31.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.914+0000 7ff6695ff700 1 Processor -- start 2023-10-09T11:53:31.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.914+0000 7ff6695ff700 1 -- start start 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.915+0000 7ff6695ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.915+0000 7ff6695ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6640c8490 0x7ff66415a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.915+0000 7ff6695ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6640ac030 con 0x7ff664069e20 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.915+0000 7ff6695ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6640ab820 con 0x7ff6640c8490 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.915+0000 7ff6695ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66406dbb0 con 0x7ff664069a50 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.915+0000 7ff6627fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6640c8490 0x7ff66415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.915+0000 7ff6627fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6640c8490 0x7ff66415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53882/0 (socket says 172.21.15.86:53882) 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff6627fc700 1 -- 172.21.15.86:0/2969714505 learned_addr learned my addr 172.21.15.86:0/2969714505 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff662ffd700 1 --2- 172.21.15.86:0/2969714505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff6627fc700 1 -- 172.21.15.86:0/2969714505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 msgr2=0x7ff6640c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff6627fc700 1 --2- 172.21.15.86:0/2969714505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff6627fc700 1 -- 172.21.15.86:0/2969714505 >> v1:172.21.15.135:6789/0 conn(0x7ff664069e20 legacy=0x7ff66406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff6627fc700 1 -- 172.21.15.86:0/2969714505 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66415a9d0 con 0x7ff6640c8490 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff661ffb700 1 -- 172.21.15.86:0/2969714505 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200560064 0 0) 0x7ff65c001490 con 0x7ff664069e20 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff6627fc700 1 --2- 172.21.15.86:0/2969714505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6640c8490 0x7ff66415a490 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff65800bc70 tx=0x7ff65800b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87f9bdb81a82092 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.916+0000 7ff661ffb700 1 -- 172.21.15.86:0/2969714505 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65800da80 con 0x7ff6640c8490 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff661ffb700 1 -- 172.21.15.86:0/2969714505 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65800dbe0 con 0x7ff6640c8490 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff661ffb700 1 -- 172.21.15.86:0/2969714505 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658017410 con 0x7ff6640c8490 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 -- 172.21.15.86:0/2969714505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6640c8490 msgr2=0x7ff66415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:31.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2969714505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6640c8490 0x7ff66415a490 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff65800bc70 tx=0x7ff65800b4e0 comp rx=0 tx=0).stop 2023-10-09T11:53:31.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 -- 172.21.15.86:0/2969714505 shutdown_connections 2023-10-09T11:53:31.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2969714505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:31.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2969714505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6640c8490 0x7ff66415a490 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:31.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 -- 172.21.15.86:0/2969714505 >> 172.21.15.86:0/2969714505 conn(0x7ff6640c8f90 msgr2=0x7ff6640c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:31.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 -- 172.21.15.86:0/2969714505 shutdown_connections 2023-10-09T11:53:31.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.917+0000 7ff6695ff700 1 -- 172.21.15.86:0/2969714505 wait complete. 2023-10-09T11:53:31.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.919+0000 7ff6695ff700 1 Processor -- start 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.919+0000 7ff6695ff700 1 -- start start 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6695ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6695ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664069e20 0x7ff6640ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6695ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6640c8490 0x7ff6640adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6695ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640ad600 con 0x7ff664069e20 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6695ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640ac9c0 con 0x7ff6640c8490 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6695ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640acc60 con 0x7ff664069a50 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664069e20 0x7ff6640ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664069e20 0x7ff6640ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53888/0 (socket says 172.21.15.86:53888) 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 -- 172.21.15.86:0/2241347545 learned_addr learned my addr 172.21.15.86:0/2241347545 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:31.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff662ffd700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:31.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6637fe700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6640c8490 0x7ff6640adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:31.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 -- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 msgr2=0x7ff6640af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:31.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:31.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 -- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6640c8490 msgr2=0x7ff6640adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:31.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6640c8490 0x7ff6640adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:31.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.920+0000 7ff6627fc700 1 -- 172.21.15.86:0/2241347545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65800b780 con 0x7ff664069e20 2023-10-09T11:53:31.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.921+0000 7ff6627fc700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664069e20 0x7ff6640ada20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff6640cc0b0 tx=0x7ff658019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:31.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.921+0000 7ff64affd700 1 -- 172.21.15.86:0/2241347545 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658021660 con 0x7ff664069e20 2023-10-09T11:53:31.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.921+0000 7ff64affd700 1 -- 172.21.15.86:0/2241347545 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6580217e0 con 0x7ff664069e20 2023-10-09T11:53:31.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.921+0000 7ff64affd700 1 -- 172.21.15.86:0/2241347545 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658021ba0 con 0x7ff664069e20 2023-10-09T11:53:31.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.921+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6640acf40 con 0x7ff664069e20 2023-10-09T11:53:31.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.921+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6640ae4a0 con 0x7ff664069e20 2023-10-09T11:53:31.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.922+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6640ad740 con 0x7ff664069e20 2023-10-09T11:53:31.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.923+0000 7ff64affd700 1 -- 172.21.15.86:0/2241347545 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7ff65800dd50 con 0x7ff664069e20 2023-10-09T11:53:31.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.924+0000 7ff64affd700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff650067130 0x7ff6500695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:31.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.925+0000 7ff64affd700 1 -- 172.21.15.86:0/2241347545 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff6580886b0 con 0x7ff664069e20 2023-10-09T11:53:31.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.925+0000 7ff662ffd700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff650067130 0x7ff6500695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:31.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.925+0000 7ff662ffd700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff650067130 0x7ff6500695e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff654009c80 tx=0x7ff6540091a0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:31.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:31.929+0000 7ff64affd700 1 -- 172.21.15.86:0/2241347545 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6640ad740 con 0x7ff664069e20 2023-10-09T11:53:32.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.146+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6640ad740 con 0x7ff650067130 2023-10-09T11:53:32.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.221+0000 7ff64affd700 1 -- 172.21.15.86:0/2241347545 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff6640ad740 con 0x7ff650067130 2023-10-09T11:53:32.221 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-10-09T11:53:32.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff650067130 msgr2=0x7ff6500695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:32.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff650067130 0x7ff6500695e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff654009c80 tx=0x7ff6540091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664069e20 msgr2=0x7ff6640ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664069e20 0x7ff6640ada20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff6640cc0b0 tx=0x7ff658019000 comp rx=0 tx=0).stop 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 shutdown_connections 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7ff650067130 0x7ff6500695e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6640c8490 0x7ff6640adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff664069a50 0x7ff6640af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 --2- 172.21.15.86:0/2241347545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664069e20 0x7ff6640ada20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 >> 172.21.15.86:0/2241347545 conn(0x7ff6640c8f90 msgr2=0x7ff6640cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 shutdown_connections 2023-10-09T11:53:32.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:32.223+0000 7ff6695ff700 1 -- 172.21.15.86:0/2241347545 wait complete. 2023-10-09T11:53:32.240 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-10-09T11:53:32.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.240 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-09T11:53:32.278 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_01_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:32.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:32.280 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_43_01_UTC 2023-10-09T11:53:32.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.281 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_43_01_UTC) 2023-10-09T11:53:32.370 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:32.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.370 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:32.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:32.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.414 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:32.498 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:32.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.498 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:32.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:32.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.582 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:32.665 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:32.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.665 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:32.750 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:32.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.751 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:32.835 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:32.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.835 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:32.921 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:32.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:32.922 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:33.006 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:33.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:33.006 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:33.089 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:33.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:33.090 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:33.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:33.174 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-10-09T11:53:33.253 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-10-09T11:53:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.477+0000 7fae1cdff700 1 Processor -- start 2023-10-09T11:53:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.477+0000 7fae1cdff700 1 -- start start 2023-10-09T11:53:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1cdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 0x7fae1806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1cdff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae180c79a0 con 0x7fae18156480 2023-10-09T11:53:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1cdff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae180c6d90 con 0x7fae181560b0 2023-10-09T11:53:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1cdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180acc60 con 0x7fae180c6890 2023-10-09T11:53:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae16d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fae18156480 0x7fae1806e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33412/0 (socket says 172.21.15.86:33412) 2023-10-09T11:53:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae16d9d700 1 -- 172.21.15.86:0/1198103885 learned_addr learned my addr 172.21.15.86:0/1198103885 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae15d9b700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 0x7fae1806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127752330 0 0) 0x7fae180c79a0 con 0x7fae18156480 2023-10-09T11:53:33.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae00004680 con 0x7fae18156480 2023-10-09T11:53:33.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600513885 0 0) 0x7fae180c6d90 con 0x7fae181560b0 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.479+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae180c79a0 con 0x7fae181560b0 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3159674006 0 0) 0x7fae00004680 con 0x7fae18156480 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 msgr2=0x7fae1806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 0x7fae1806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 >> v1:172.21.15.135:6789/0 conn(0x7fae181560b0 legacy=0x7fae180ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180c7070 con 0x7fae18156480 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fae100017f0 con 0x7fae18156480 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae15d9b700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 0x7fae1806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 >> v1:172.21.15.86:6789/0 conn(0x7fae18156480 legacy=0x7fae1806e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae00004d30 0x7fae00005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 0x7fae00005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae00005e60 0x7fae000062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180acc60 con 0x7fae00005e60 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0000cc20 con 0x7fae00004d30 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae00003510 con 0x7fae180c6890 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae16d9d700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae00005e60 0x7fae000062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae1659c700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae00004d30 0x7fae00005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.480+0000 7fae15d9b700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 0x7fae00005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae16d9d700 1 -- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 msgr2=0x7fae00005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae16d9d700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae180c6890 0x7fae00005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae16d9d700 1 -- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae00004d30 msgr2=0x7fae00005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae16d9d700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae00004d30 0x7fae00005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae16d9d700 1 -- 172.21.15.86:0/1198103885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c009420 con 0x7fae00005e60 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae16d9d700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae00005e60 0x7fae000062d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae1000a8d0 tx=0x7fae10002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bcee98e0b8c065 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae100070d0 con 0x7fae00005e60 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10007230 con 0x7fae00005e60 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae1559a700 1 -- 172.21.15.86:0/1198103885 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae100075f0 con 0x7fae00005e60 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae1cdff700 1 -- 172.21.15.86:0/1198103885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae00005e60 msgr2=0x7fae000062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae1cdff700 1 --2- 172.21.15.86:0/1198103885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae00005e60 0x7fae000062d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae1000a8d0 tx=0x7fae10002190 comp rx=0 tx=0).stop 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.481+0000 7fae16d9d700 1 -- 172.21.15.86:0/1198103885 reap_dead start 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.482+0000 7fae1cdff700 1 -- 172.21.15.86:0/1198103885 shutdown_connections 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.482+0000 7fae1cdff700 1 -- 172.21.15.86:0/1198103885 >> 172.21.15.86:0/1198103885 conn(0x7fae18068390 msgr2=0x7fae18068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.482+0000 7fae1cdff700 1 -- 172.21.15.86:0/1198103885 shutdown_connections 2023-10-09T11:53:33.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.482+0000 7fae1cdff700 1 -- 172.21.15.86:0/1198103885 wait complete. 2023-10-09T11:53:33.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.483+0000 7fae1cdff700 1 Processor -- start 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.483+0000 7fae1cdff700 1 -- start start 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae1cdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae00005e60 0x7fae180af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae1cdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae180b1110 0x7fae180c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae1cdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae1814e7d0 0x7fae1814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae1cdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1814f180 con 0x7fae1814e7d0 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae1cdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180c0800 con 0x7fae180b1110 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae1cdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180c04f0 con 0x7fae00005e60 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae16d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae1814e7d0 0x7fae1814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae16d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae1814e7d0 0x7fae1814ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53912/0 (socket says 172.21.15.86:53912) 2023-10-09T11:53:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae16d9d700 1 -- 172.21.15.86:0/3156954578 learned_addr learned my addr 172.21.15.86:0/3156954578 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae15d9b700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae180b1110 0x7fae180c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.484+0000 7fae1659c700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae00005e60 0x7fae180af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae16d9d700 1 -- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae00005e60 msgr2=0x7fae180af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae16d9d700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae00005e60 0x7fae180af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae16d9d700 1 -- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae180b1110 msgr2=0x7fae180c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae16d9d700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae180b1110 0x7fae180c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae16d9d700 1 -- 172.21.15.86:0/3156954578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180af730 con 0x7fae1814e7d0 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae16d9d700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae1814e7d0 0x7fae1814ec40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fae1000a8a0 tx=0x7fae10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae067fc700 1 -- 172.21.15.86:0/3156954578 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10023070 con 0x7fae1814e7d0 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae067fc700 1 -- 172.21.15.86:0/3156954578 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10007b40 con 0x7fae1814e7d0 2023-10-09T11:53:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae067fc700 1 -- 172.21.15.86:0/3156954578 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10001ed0 con 0x7fae1814e7d0 2023-10-09T11:53:33.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae180afa10 con 0x7fae1814e7d0 2023-10-09T11:53:33.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.485+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae180b1580 con 0x7fae1814e7d0 2023-10-09T11:53:33.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.486+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae180aff30 con 0x7fae1814e7d0 2023-10-09T11:53:33.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.487+0000 7fae067fc700 1 -- 172.21.15.86:0/3156954578 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fae1001e640 con 0x7fae1814e7d0 2023-10-09T11:53:33.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.488+0000 7fae067fc700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fadf8067100 0x7fadf80695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:33.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.488+0000 7fae067fc700 1 -- 172.21.15.86:0/3156954578 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fae10086580 con 0x7fae1814e7d0 2023-10-09T11:53:33.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.488+0000 7fae1659c700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fadf8067100 0x7fadf80695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:33.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.489+0000 7fae1659c700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fadf8067100 0x7fadf80695b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae08007e90 tx=0x7fae08009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:33.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.492+0000 7fae067fc700 1 -- 172.21.15.86:0/3156954578 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae10053470 con 0x7fae1814e7d0 2023-10-09T11:53:33.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.706+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fae180ab9e0 con 0x7fadf8067100 2023-10-09T11:53:33.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.786+0000 7fae067fc700 1 -- 172.21.15.86:0/3156954578 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fae180ab9e0 con 0x7fadf8067100 2023-10-09T11:53:33.788 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-10-09T11:53:33.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fadf8067100 msgr2=0x7fadf80695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:33.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fadf8067100 0x7fadf80695b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae08007e90 tx=0x7fae08009040 comp rx=0 tx=0).stop 2023-10-09T11:53:33.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae1814e7d0 msgr2=0x7fae1814ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:33.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae1814e7d0 0x7fae1814ec40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fae1000a8a0 tx=0x7fae10016000 comp rx=0 tx=0).stop 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 shutdown_connections 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fadf8067100 0x7fadf80695b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae1814e7d0 0x7fae1814ec40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae00005e60 0x7fae180af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 --2- 172.21.15.86:0/3156954578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae180b1110 0x7fae180c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 >> 172.21.15.86:0/3156954578 conn(0x7fae18068390 msgr2=0x7fae180ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 shutdown_connections 2023-10-09T11:53:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:33.789+0000 7fae1cdff700 1 -- 172.21.15.86:0/3156954578 wait complete. 2023-10-09T11:53:33.806 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-10-09T11:53:33.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:33.807 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-09T11:53:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:33.844 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:33.845 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:33.845 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:33.845 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:33.845 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:33.846 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:33.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:33.846 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:33.931 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:33.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:33.932 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:34.015 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:34.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.015 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:34.099 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:34.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.099 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:34.183 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:34.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.183 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:34.268 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:34.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.268 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:34.353 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:34.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.407 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:34.453 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:34.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.453 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:34.537 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:34.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.537 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:34.620 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:34.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.621 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:34.703 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:34.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.704 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:34.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:34.788 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-10-09T11:53:34.867 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-10-09T11:53:35.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.091+0000 7fa3d21ff700 1 Processor -- start 2023-10-09T11:53:35.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.091+0000 7fa3d21ff700 1 -- start start 2023-10-09T11:53:35.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.092+0000 7fa3d21ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc15a440 0x7fa3cc0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:35.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3d21ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa3cc068890 0x7fa3cc0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:35.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3d21ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc15a9b0 con 0x7fa3cc1563b0 2023-10-09T11:53:35.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3d21ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc15ac90 con 0x7fa3cc068890 2023-10-09T11:53:35.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3d21ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc15af70 con 0x7fa3cc15a440 2023-10-09T11:53:35.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3cb7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa3cc1563b0 0x7fa3cc156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56876/0 (socket says 172.21.15.86:56876) 2023-10-09T11:53:35.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3cb7fe700 1 -- 172.21.15.86:0/4159219441 learned_addr learned my addr 172.21.15.86:0/4159219441 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:35.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3cbfff700 1 --2- 172.21.15.86:0/4159219441 >> v2:172.21.15.86:3300/0 conn(0x7fa3cc068890 0x7fa3cc0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:35.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3caffd700 1 --2- 172.21.15.86:0/4159219441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc15a440 0x7fa3cc0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:35.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3ca7fc700 1 -- 172.21.15.86:0/4159219441 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744049195 0 0) 0x7fa3cc15a9b0 con 0x7fa3cc1563b0 2023-10-09T11:53:35.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3ca7fc700 1 -- 172.21.15.86:0/4159219441 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b4003570 con 0x7fa3cc1563b0 2023-10-09T11:53:35.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3cbfff700 1 -- 172.21.15.86:0/4159219441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc15a440 msgr2=0x7fa3cc0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:35.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3cbfff700 1 --2- 172.21.15.86:0/4159219441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc15a440 0x7fa3cc0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3cbfff700 1 -- 172.21.15.86:0/4159219441 >> v1:172.21.15.86:6789/0 conn(0x7fa3cc1563b0 legacy=0x7fa3cc156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.093+0000 7fa3cbfff700 1 -- 172.21.15.86:0/4159219441 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc15b250 con 0x7fa3cc068890 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3cbfff700 1 --2- 172.21.15.86:0/4159219441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc068890 0x7fa3cc0c8230 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40098e0 tx=0x7fa3c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f661cf27c54b286d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3ca7fc700 1 -- 172.21.15.86:0/4159219441 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400b640 con 0x7fa3cc068890 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3ca7fc700 1 -- 172.21.15.86:0/4159219441 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c400b7a0 con 0x7fa3cc068890 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3ca7fc700 1 -- 172.21.15.86:0/4159219441 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400bb40 con 0x7fa3cc068890 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3d21ff700 1 -- 172.21.15.86:0/4159219441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc068890 msgr2=0x7fa3cc0c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/4159219441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc068890 0x7fa3cc0c8230 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40098e0 tx=0x7fa3c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3d21ff700 1 -- 172.21.15.86:0/4159219441 shutdown_connections 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/4159219441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc068890 0x7fa3cc0c8230 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/4159219441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc15a440 0x7fa3cc0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3d21ff700 1 -- 172.21.15.86:0/4159219441 >> 172.21.15.86:0/4159219441 conn(0x7fa3cc0c8f90 msgr2=0x7fa3cc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:35.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.094+0000 7fa3d21ff700 1 -- 172.21.15.86:0/4159219441 shutdown_connections 2023-10-09T11:53:35.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.095+0000 7fa3d21ff700 1 -- 172.21.15.86:0/4159219441 wait complete. 2023-10-09T11:53:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.096+0000 7fa3d21ff700 1 Processor -- start 2023-10-09T11:53:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.096+0000 7fa3d21ff700 1 -- start start 2023-10-09T11:53:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3d21ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3cc068890 0x7fa3cc155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3d21ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc1563b0 0x7fa3cc0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:35.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3d21ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc15a440 0x7fa3cc0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3d21ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc155f70 con 0x7fa3cc15a440 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3d21ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0b0520 con 0x7fa3cc068890 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3d21ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0b0800 con 0x7fa3cc1563b0 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3cbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc15a440 0x7fa3cc0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3cbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc15a440 0x7fa3cc0c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53316/0 (socket says 172.21.15.86:53316) 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3cbfff700 1 -- 172.21.15.86:0/3140847650 learned_addr learned my addr 172.21.15.86:0/3140847650 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3caffd700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc1563b0 0x7fa3cc0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3cb7fe700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3cc068890 0x7fa3cc155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3cbfff700 1 -- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc1563b0 msgr2=0x7fa3cc0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.097+0000 7fa3cbfff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc1563b0 0x7fa3cc0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3cbfff700 1 -- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3cc068890 msgr2=0x7fa3cc155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:35.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3cbfff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3cc068890 0x7fa3cc155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3cbfff700 1 -- 172.21.15.86:0/3140847650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009420 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3cbfff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc15a440 0x7fa3cc0c2340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc06bbb0 tx=0x7fa3c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3b37fe700 1 -- 172.21.15.86:0/3140847650 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c401be40 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3b37fe700 1 -- 172.21.15.86:0/3140847650 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c4011630 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3b37fe700 1 -- 172.21.15.86:0/3140847650 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40119f0 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc0b0ae0 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.098+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc169b40 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.099+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc16a090 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.100+0000 7fa3b37fe700 1 -- 172.21.15.86:0/3140847650 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fa3c402e440 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.101+0000 7fa3b37fe700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa3b8067130 0x7fa3b80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.101+0000 7fa3b37fe700 1 -- 172.21.15.86:0/3140847650 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa3c40866d0 con 0x7fa3cc15a440 2023-10-09T11:53:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.101+0000 7fa3cb7fe700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa3b8067130 0x7fa3b80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:35.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.102+0000 7fa3cb7fe700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa3b8067130 0x7fa3b80695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc005c50 tx=0x7fa3bc009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:35.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.105+0000 7fa3b37fe700 1 -- 172.21.15.86:0/3140847650 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3c4053520 con 0x7fa3cc15a440 2023-10-09T11:53:35.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.322+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3cc0718b0 con 0x7fa3b8067130 2023-10-09T11:53:35.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.523+0000 7fa3b37fe700 1 -- 172.21.15.86:0/3140847650 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fa3cc0718b0 con 0x7fa3b8067130 2023-10-09T11:53:35.523 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-10-09T11:53:35.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa3b8067130 msgr2=0x7fa3b80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:35.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa3b8067130 0x7fa3b80695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc005c50 tx=0x7fa3bc009040 comp rx=0 tx=0).stop 2023-10-09T11:53:35.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc15a440 msgr2=0x7fa3cc0c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:35.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc15a440 0x7fa3cc0c2340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc06bbb0 tx=0x7fa3c4017000 comp rx=0 tx=0).stop 2023-10-09T11:53:35.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 shutdown_connections 2023-10-09T11:53:35.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa3b8067130 0x7fa3b80695e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc15a440 0x7fa3cc0c2340 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3cc068890 0x7fa3cc155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 --2- 172.21.15.86:0/3140847650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3cc1563b0 0x7fa3cc0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:35.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 >> 172.21.15.86:0/3140847650 conn(0x7fa3cc0c8f90 msgr2=0x7fa3cc069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:35.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.525+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 shutdown_connections 2023-10-09T11:53:35.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:35.526+0000 7fa3d21ff700 1 -- 172.21.15.86:0/3140847650 wait complete. 2023-10-09T11:53:35.543 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-10-09T11:53:35.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.544 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_01_UTC 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:35.582 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:35.582 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:35.582 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:35.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_43_01_UTC 2023-10-09T11:53:35.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.583 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_43_01_UTC) 2023-10-09T11:53:35.702 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:35.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.702 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:35.781 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:35.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.781 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:35.839 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:35.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.839 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:35.907 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:35.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.908 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:35.954 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:35.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.954 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:35.997 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:35.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:35.998 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:36.081 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:36.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:36.082 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:36.165 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:36.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:36.165 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:36.248 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:36.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:36.248 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:36.343 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:36.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:36.343 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:36.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:36.391 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-10-09T11:53:36.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-10-09T11:53:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.697+0000 7f199edff700 1 Processor -- start 2023-10-09T11:53:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.697+0000 7f199edff700 1 -- start start 2023-10-09T11:53:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199edff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19980c8490 0x7f19980c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199edff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1998069e20 0x7f19981569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199edff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19980ac030 con 0x7f1998069a50 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199edff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19980ab820 con 0x7f19980c8490 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199edff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199806dbb0 con 0x7f1998069e20 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f1997fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19980c8490 0x7f19980c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199cb9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1998069a50 0x7f199815a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56878/0 (socket says 172.21.15.86:56878) 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199cb9b700 1 -- 172.21.15.86:0/1845065006 learned_addr learned my addr 172.21.15.86:0/1845065006 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f199d39c700 1 --2- 172.21.15.86:0/1845065006 >> v2:172.21.15.135:3300/0 conn(0x7f1998069e20 0x7f19981569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f1997fff700 1 -- 172.21.15.86:0/1845065006 >> v2:172.21.15.135:3300/0 conn(0x7f1998069e20 msgr2=0x7f19981569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f1997fff700 1 --2- 172.21.15.86:0/1845065006 >> v2:172.21.15.135:3300/0 conn(0x7f1998069e20 0x7f19981569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f1997fff700 1 -- 172.21.15.86:0/1845065006 >> v1:172.21.15.86:6789/0 conn(0x7f1998069a50 legacy=0x7f199815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:36.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f19977fe700 1 -- 172.21.15.86:0/1845065006 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61129118 0 0) 0x7f198c001110 con 0x7f1998069a50 2023-10-09T11:53:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.699+0000 7f1997fff700 1 -- 172.21.15.86:0/1845065006 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19980aba70 con 0x7f19980c8490 2023-10-09T11:53:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f1997fff700 1 --2- 172.21.15.86:0/1845065006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19980c8490 0x7f19980c6ac0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f199806db20 tx=0x7f198400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac95e79618d97194 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f19977fe700 1 -- 172.21.15.86:0/1845065006 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400c970 con 0x7f19980c8490 2023-10-09T11:53:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f19977fe700 1 -- 172.21.15.86:0/1845065006 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198400cad0 con 0x7f19980c8490 2023-10-09T11:53:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f19977fe700 1 -- 172.21.15.86:0/1845065006 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400ce70 con 0x7f19980c8490 2023-10-09T11:53:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f199edff700 1 -- 172.21.15.86:0/1845065006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19980c8490 msgr2=0x7f19980c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f199edff700 1 --2- 172.21.15.86:0/1845065006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19980c8490 0x7f19980c6ac0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f199806db20 tx=0x7f198400a330 comp rx=0 tx=0).stop 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f199edff700 1 -- 172.21.15.86:0/1845065006 shutdown_connections 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f199edff700 1 --2- 172.21.15.86:0/1845065006 >> v2:172.21.15.135:3300/0 conn(0x7f1998069e20 0x7f19981569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f199edff700 1 --2- 172.21.15.86:0/1845065006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19980c8490 0x7f19980c6ac0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.700+0000 7f199edff700 1 -- 172.21.15.86:0/1845065006 >> 172.21.15.86:0/1845065006 conn(0x7f19980c8f90 msgr2=0x7f19980c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.701+0000 7f199edff700 1 -- 172.21.15.86:0/1845065006 shutdown_connections 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.701+0000 7f199edff700 1 -- 172.21.15.86:0/1845065006 wait complete. 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.702+0000 7f199edff700 1 Processor -- start 2023-10-09T11:53:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.702+0000 7f199edff700 1 -- start start 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199edff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1998069a50 0x7f199814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199edff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998069e20 0x7f1998156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199edff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19980c8490 0x7f1998156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199edff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1998168ec0 con 0x7f1998069a50 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199edff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1998169a40 con 0x7f1998069e20 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199edff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1998169110 con 0x7f19980c8490 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199cb9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1998069a50 0x7f199814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199cb9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1998069a50 0x7f199814fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53336/0 (socket says 172.21.15.86:53336) 2023-10-09T11:53:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.703+0000 7f199cb9b700 1 -- 172.21.15.86:0/1708922363 learned_addr learned my addr 172.21.15.86:0/1708922363 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199cb9b700 1 -- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19980c8490 msgr2=0x7f1998156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199d39c700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19980c8490 0x7f1998156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f1997fff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998069e20 0x7f1998156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199cb9b700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19980c8490 0x7f1998156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199cb9b700 1 -- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998069e20 msgr2=0x7f1998156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199cb9b700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998069e20 0x7f1998156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199cb9b700 1 -- 172.21.15.86:0/1708922363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198400a5d0 con 0x7f1998069a50 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199d39c700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19980c8490 0x7f1998156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f1997fff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998069e20 0x7f1998156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199cb9b700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1998069a50 0x7f199814fb10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f198c00c5b0 tx=0x7f198c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f1994ff9700 1 -- 172.21.15.86:0/1708922363 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c005b30 con 0x7f1998069a50 2023-10-09T11:53:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f1994ff9700 1 -- 172.21.15.86:0/1708922363 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c005c90 con 0x7f1998069a50 2023-10-09T11:53:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f1994ff9700 1 -- 172.21.15.86:0/1708922363 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c007300 con 0x7f1998069a50 2023-10-09T11:53:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19981693f0 con 0x7f1998069a50 2023-10-09T11:53:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.704+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1998150050 con 0x7f1998069a50 2023-10-09T11:53:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.705+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19980718b0 con 0x7f1998069a50 2023-10-09T11:53:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.706+0000 7f1994ff9700 1 -- 172.21.15.86:0/1708922363 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f198c01b3b0 con 0x7f1998069a50 2023-10-09T11:53:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.707+0000 7f1994ff9700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f197c067130 0x7f197c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.707+0000 7f1994ff9700 1 -- 172.21.15.86:0/1708922363 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6403+0+0 (secure 0 0 0) 0x7f198c083fc0 con 0x7f1998069a50 2023-10-09T11:53:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.707+0000 7f1997fff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f197c067130 0x7f197c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.707+0000 7f1997fff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f197c067130 0x7f197c0695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1998153890 tx=0x7f198401a000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:36.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.711+0000 7f1994ff9700 1 -- 172.21.15.86:0/1708922363 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f198c050c50 con 0x7f1998069a50 2023-10-09T11:53:36.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:36.945+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f19980ac030 con 0x7f197c067130 2023-10-09T11:53:37.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.023+0000 7f1994ff9700 1 -- 172.21.15.86:0/1708922363 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f19980ac030 con 0x7f197c067130 2023-10-09T11:53:37.024 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-10-09T11:53:37.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f197c067130 msgr2=0x7f197c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f197c067130 0x7f197c0695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1998153890 tx=0x7f198401a000 comp rx=0 tx=0).stop 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1998069a50 msgr2=0x7f199814fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1998069a50 0x7f199814fb10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f198c00c5b0 tx=0x7f198c001070 comp rx=0 tx=0).stop 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 shutdown_connections 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f197c067130 0x7f197c0695e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1998069a50 0x7f199814fb10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19980c8490 0x7f1998156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 --2- 172.21.15.86:0/1708922363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998069e20 0x7f1998156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 >> 172.21.15.86:0/1708922363 conn(0x7f19980c8f90 msgr2=0x7f1998159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 shutdown_connections 2023-10-09T11:53:37.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:37.026+0000 7f199edff700 1 -- 172.21.15.86:0/1708922363 wait complete. 2023-10-09T11:53:37.045 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-10-09T11:53:37.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.045 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-09T11:53:37.082 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_01_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:37.083 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:37.084 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:37.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.084 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:37.170 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:37.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.170 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:37.255 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:37.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.255 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:37.355 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:37.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.355 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:37.415 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:37.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.416 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:37.461 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:37.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.461 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:37.545 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_49_01_UTC 2023-10-09T11:53:37.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.546 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_49_01_UTC) 2023-10-09T11:53:37.630 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:37.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.630 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:37.715 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:37.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.715 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:37.804 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:37.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.804 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:37.848 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:37.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.848 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:37.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:37.936 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-10-09T11:53:37.975 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-10-09T11:53:38.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.201+0000 7efee1dff700 1 Processor -- start 2023-10-09T11:53:38.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.201+0000 7efee1dff700 1 -- start start 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.202+0000 7efee1dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efedc069a50 0x7efedc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.202+0000 7efee1dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efedc0c8490 0x7efedc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.202+0000 7efee1dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc0ac030 con 0x7efedc069e20 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.202+0000 7efee1dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc068aa0 con 0x7efedc0c8490 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.202+0000 7efee1dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc0ab820 con 0x7efedc069a50 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.202+0000 7efedaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efedc0c8490 0x7efedc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efedc0c8490 0x7efedc15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53348/0 (socket says 172.21.15.86:53348) 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedaffd700 1 -- 172.21.15.86:0/1901561233 learned_addr learned my addr 172.21.15.86:0/1901561233 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:38.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedbfff700 1 --1- 172.21.15.86:0/1901561233 >> v1:172.21.15.86:6789/0 conn(0x7efedc069e20 0x7efedc068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56882/0 (socket says 172.21.15.86:56882) 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedb7fe700 1 --2- 172.21.15.86:0/1901561233 >> v2:172.21.15.135:3300/0 conn(0x7efedc069a50 0x7efedc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedaffd700 1 -- 172.21.15.86:0/1901561233 >> v2:172.21.15.135:3300/0 conn(0x7efedc069a50 msgr2=0x7efedc0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedaffd700 1 --2- 172.21.15.86:0/1901561233 >> v2:172.21.15.135:3300/0 conn(0x7efedc069a50 0x7efedc0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedaffd700 1 -- 172.21.15.86:0/1901561233 >> v1:172.21.15.86:6789/0 conn(0x7efedc069e20 legacy=0x7efedc068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedaffd700 1 -- 172.21.15.86:0/1901561233 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc06dbb0 con 0x7efedc0c8490 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efeda7fc700 1 -- 172.21.15.86:0/1901561233 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052502643 0 0) 0x7efed4001490 con 0x7efedc069e20 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efedaffd700 1 --2- 172.21.15.86:0/1901561233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc15a490 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efedc06b970 tx=0x7efed0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c6404d0639bf30 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.203+0000 7efeda7fc700 1 -- 172.21.15.86:0/1901561233 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000b860 con 0x7efedc0c8490 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efeda7fc700 1 -- 172.21.15.86:0/1901561233 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000b9c0 con 0x7efedc0c8490 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efeda7fc700 1 -- 172.21.15.86:0/1901561233 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000bd60 con 0x7efedc0c8490 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 -- 172.21.15.86:0/1901561233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 msgr2=0x7efedc15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:38.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 --2- 172.21.15.86:0/1901561233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc15a490 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efedc06b970 tx=0x7efed0009250 comp rx=0 tx=0).stop 2023-10-09T11:53:38.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 -- 172.21.15.86:0/1901561233 shutdown_connections 2023-10-09T11:53:38.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 --2- 172.21.15.86:0/1901561233 >> v2:172.21.15.135:3300/0 conn(0x7efedc069a50 0x7efedc0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 --2- 172.21.15.86:0/1901561233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc15a490 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 -- 172.21.15.86:0/1901561233 >> 172.21.15.86:0/1901561233 conn(0x7efedc0c8f90 msgr2=0x7efedc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 -- 172.21.15.86:0/1901561233 shutdown_connections 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.204+0000 7efee1dff700 1 -- 172.21.15.86:0/1901561233 wait complete. 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.206+0000 7efee1dff700 1 Processor -- start 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.206+0000 7efee1dff700 1 -- start start 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efee1dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efedc069a50 0x7efedc158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efee1dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efedc069e20 0x7efedc154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efee1dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc0ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efee1dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c4400 con 0x7efedc0c8490 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efee1dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c46e0 con 0x7efedc069e20 2023-10-09T11:53:38.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efee1dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c49c0 con 0x7efedc069a50 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc0ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc0ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53358/0 (socket says 172.21.15.86:53358) 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 -- 172.21.15.86:0/1338610331 learned_addr learned my addr 172.21.15.86:0/1338610331 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedaffd700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efedc069e20 0x7efedc154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedb7fe700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efedc069a50 0x7efedc158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 -- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efedc069a50 msgr2=0x7efedc158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efedc069a50 0x7efedc158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 -- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efedc069e20 msgr2=0x7efedc154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efedc069e20 0x7efedc154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.207+0000 7efedbfff700 1 -- 172.21.15.86:0/1338610331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00094f0 con 0x7efedc0c8490 2023-10-09T11:53:38.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.208+0000 7efedbfff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc0ad650 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efed400cd50 tx=0x7efed4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:38.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.208+0000 7efec37fe700 1 -- 172.21.15.86:0/1338610331 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4005df0 con 0x7efedc0c8490 2023-10-09T11:53:38.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.208+0000 7efec37fe700 1 -- 172.21.15.86:0/1338610331 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed400a8b0 con 0x7efedc0c8490 2023-10-09T11:53:38.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.208+0000 7efec37fe700 1 -- 172.21.15.86:0/1338610331 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400ac70 con 0x7efedc0c8490 2023-10-09T11:53:38.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.208+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc0c4ca0 con 0x7efedc0c8490 2023-10-09T11:53:38.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.208+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc1593a0 con 0x7efedc0c8490 2023-10-09T11:53:38.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.209+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc06fbe0 con 0x7efedc0c8490 2023-10-09T11:53:38.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.210+0000 7efec37fe700 1 -- 172.21.15.86:0/1338610331 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7efed4007300 con 0x7efedc0c8490 2023-10-09T11:53:38.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.211+0000 7efec37fe700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efec8067130 0x7efec80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:38.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.211+0000 7efec37fe700 1 -- 172.21.15.86:0/1338610331 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6499+0+0 (secure 0 0 0) 0x7efed4084ac0 con 0x7efedc0c8490 2023-10-09T11:53:38.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.211+0000 7efedb7fe700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efec8067130 0x7efec80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:38.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.211+0000 7efedb7fe700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efec8067130 0x7efec80695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efecc006fd0 tx=0x7efecc008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:38.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.215+0000 7efec37fe700 1 -- 172.21.15.86:0/1338610331 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efed4051810 con 0x7efedc0c8490 2023-10-09T11:53:38.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.444+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efedc0c4850 con 0x7efec8067130 2023-10-09T11:53:38.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.523+0000 7efec37fe700 1 -- 172.21.15.86:0/1338610331 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7efedc0c4850 con 0x7efec8067130 2023-10-09T11:53:38.523 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-10-09T11:53:38.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efec8067130 msgr2=0x7efec80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:38.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efec8067130 0x7efec80695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efecc006fd0 tx=0x7efecc008040 comp rx=0 tx=0).stop 2023-10-09T11:53:38.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 msgr2=0x7efedc0ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc0ad650 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efed400cd50 tx=0x7efed4001b10 comp rx=0 tx=0).stop 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 shutdown_connections 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7efec8067130 0x7efec80695e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efedc0c8490 0x7efedc0ad650 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efedc069a50 0x7efedc158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 --2- 172.21.15.86:0/1338610331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efedc069e20 0x7efedc154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 >> 172.21.15.86:0/1338610331 conn(0x7efedc0c8f90 msgr2=0x7efedc1562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 shutdown_connections 2023-10-09T11:53:38.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:38.525+0000 7efee1dff700 1 -- 172.21.15.86:0/1338610331 wait complete. 2023-10-09T11:53:38.542 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-10-09T11:53:38.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:38.542 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:38.580 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:38.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:38.581 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:38.581 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:38.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:38.582 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:38.667 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:38.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:38.669 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:38.750 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:38.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:38.750 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:38.833 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:38.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:38.833 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:38.915 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:38.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:38.916 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:38.998 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:38.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:38.999 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:39.081 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:39.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:39.082 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:39.164 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:39.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:39.165 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:39.248 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:39.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:39.248 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:39.330 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:39.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:39.331 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:39.433 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:39.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:39.434 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:39.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:39.476 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-10-09T11:53:39.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-10-09T11:53:39.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.780+0000 7fad9af9d700 1 Processor -- start 2023-10-09T11:53:39.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.781+0000 7fad9af9d700 1 -- start start 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.782+0000 7fad9af9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 0x7fad94157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.782+0000 7fad9af9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940b0570 con 0x7fad940b0760 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.782+0000 7fad9af9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9415ad40 con 0x7fad940b0bd0 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.782+0000 7fad9af9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad941578b0 con 0x7fad94156350 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.782+0000 7fad9979a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fad940b0760 0x7fad94159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56886/0 (socket says 172.21.15.86:56886) 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.782+0000 7fad9979a700 1 -- 172.21.15.86:0/2092590416 learned_addr learned my addr 172.21.15.86:0/2092590416 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.782+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 0x7fad94157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252027734 0 0) 0x7fad940b0570 con 0x7fad940b0760 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad80003570 con 0x7fad940b0760 2023-10-09T11:53:39.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3741702540 0 0) 0x7fad80003570 con 0x7fad940b0760 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 msgr2=0x7fad94157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 0x7fad94157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 >> v1:172.21.15.135:6789/0 conn(0x7fad940b0bd0 legacy=0x7fad9415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940af4d0 con 0x7fad940b0760 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fad84001470 con 0x7fad940b0760 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 >> v1:172.21.15.86:6789/0 conn(0x7fad940b0760 legacy=0x7fad94159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad80003b10 0x7fad80003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80004810 0x7fad80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 0x7fad8000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941578b0 con 0x7fad80003b10 2023-10-09T11:53:39.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80005540 con 0x7fad80004810 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8000bfa0 con 0x7fad94156350 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.783+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad80003b10 0x7fad80003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad9979a700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80004810 0x7fad80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad9a79c700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 0x7fad8000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad99f9b700 1 -- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 msgr2=0x7fad8000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad94156350 0x7fad8000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad99f9b700 1 -- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80004810 msgr2=0x7fad80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80004810 0x7fad80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad99f9b700 1 -- 172.21.15.86:0/2092590416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80003570 con 0x7fad80003b10 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad9979a700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80004810 0x7fad80004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:39.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad80003b10 0x7fad80003f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad9000bb90 tx=0x7fad90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3d6f7ce5d18a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:39.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000d5d0 con 0x7fad80003b10 2023-10-09T11:53:39.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000d730 con 0x7fad80003b10 2023-10-09T11:53:39.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.784+0000 7fad98f99700 1 -- 172.21.15.86:0/2092590416 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000daf0 con 0x7fad80003b10 2023-10-09T11:53:39.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.785+0000 7fad9af9d700 1 -- 172.21.15.86:0/2092590416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad80003b10 msgr2=0x7fad80003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.785+0000 7fad9af9d700 1 --2- 172.21.15.86:0/2092590416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad80003b10 0x7fad80003f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad9000bb90 tx=0x7fad90008040 comp rx=0 tx=0).stop 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.785+0000 7fad9a79c700 1 -- 172.21.15.86:0/2092590416 reap_dead start 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.785+0000 7fad9af9d700 1 -- 172.21.15.86:0/2092590416 shutdown_connections 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.785+0000 7fad9af9d700 1 -- 172.21.15.86:0/2092590416 >> 172.21.15.86:0/2092590416 conn(0x7fad94068e20 msgr2=0x7fad940cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.785+0000 7fad9af9d700 1 -- 172.21.15.86:0/2092590416 shutdown_connections 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.785+0000 7fad9af9d700 1 -- 172.21.15.86:0/2092590416 wait complete. 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.787+0000 7fad9af9d700 1 Processor -- start 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.787+0000 7fad9af9d700 1 -- start start 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9af9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80003b10 0x7fad9413d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9af9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad940c90c0 0x7fad940c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9af9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9406d4f0 0x7fad9406d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9af9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c9a70 con 0x7fad9406d4f0 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9af9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94155390 con 0x7fad80003b10 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9af9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad940ac150 con 0x7fad940c90c0 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9406d4f0 0x7fad9406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9406d4f0 0x7fad9406d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53378/0 (socket says 172.21.15.86:53378) 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 -- 172.21.15.86:0/2656657708 learned_addr learned my addr 172.21.15.86:0/2656657708 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80003b10 0x7fad9413d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9979a700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad940c90c0 0x7fad940c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 -- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad940c90c0 msgr2=0x7fad940c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:39.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad940c90c0 0x7fad940c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 -- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80003b10 msgr2=0x7fad9413d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80003b10 0x7fad9413d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.788+0000 7fad9a79c700 1 -- 172.21.15.86:0/2656657708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940ac710 con 0x7fad9406d4f0 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.789+0000 7fad9a79c700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9406d4f0 0x7fad9406d970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad94064f30 tx=0x7fad8c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.789+0000 7fad89ffb700 1 -- 172.21.15.86:0/2656657708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c006db0 con 0x7fad9406d4f0 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.789+0000 7fad89ffb700 1 -- 172.21.15.86:0/2656657708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c003070 con 0x7fad9406d4f0 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.789+0000 7fad89ffb700 1 -- 172.21.15.86:0/2656657708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c002470 con 0x7fad9406d4f0 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.789+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9406e200 con 0x7fad9406d4f0 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.789+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad940ac3a0 con 0x7fad9406d4f0 2023-10-09T11:53:39.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.790+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad941576b0 con 0x7fad9406d4f0 2023-10-09T11:53:39.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.791+0000 7fad89ffb700 1 -- 172.21.15.86:0/2656657708 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fad8c002860 con 0x7fad9406d4f0 2023-10-09T11:53:39.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.792+0000 7fad89ffb700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad78067100 0x7fad780695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:39.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.792+0000 7fad89ffb700 1 -- 172.21.15.86:0/2656657708 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fad8c084440 con 0x7fad9406d4f0 2023-10-09T11:53:39.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.792+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad78067100 0x7fad780695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:39.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.793+0000 7fad99f9b700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad78067100 0x7fad780695b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad9000bb90 tx=0x7fad9001b000 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:39.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:39.797+0000 7fad89ffb700 1 -- 172.21.15.86:0/2656657708 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad8c04c5a0 con 0x7fad9406d4f0 2023-10-09T11:53:39.966 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:53:39.971 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:53:40.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.044+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad9404c3c0 con 0x7fad78067100 2023-10-09T11:53:40.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.115+0000 7fad89ffb700 1 -- 172.21.15.86:0/2656657708 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fad9404c3c0 con 0x7fad78067100 2023-10-09T11:53:40.116 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-10-09T11:53:40.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad78067100 msgr2=0x7fad780695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad78067100 0x7fad780695b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad9000bb90 tx=0x7fad9001b000 comp rx=0 tx=0).stop 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9406d4f0 msgr2=0x7fad9406d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9406d4f0 0x7fad9406d970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad94064f30 tx=0x7fad8c009040 comp rx=0 tx=0).stop 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 shutdown_connections 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fad78067100 0x7fad780695b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9406d4f0 0x7fad9406d970 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80003b10 0x7fad9413d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 --2- 172.21.15.86:0/2656657708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad940c90c0 0x7fad940c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 >> 172.21.15.86:0/2656657708 conn(0x7fad94068e20 msgr2=0x7fad941527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 shutdown_connections 2023-10-09T11:53:40.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:40.118+0000 7fad9af9d700 1 -- 172.21.15.86:0/2656657708 wait complete. 2023-10-09T11:53:40.135 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-10-09T11:53:40.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.136 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_01_UTC 2023-10-09T11:53:40.173 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:40.174 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:40.174 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:40.174 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:40.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.175 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:40.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:40.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.261 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:40.343 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:40.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.344 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:40.439 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:40.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.440 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:40.515 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:40.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.515 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:40.563 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:40.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.563 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:40.645 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:40.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.646 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:40.728 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_50_01_UTC 2023-10-09T11:53:40.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.729 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_50_01_UTC) 2023-10-09T11:53:40.811 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:40.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.811 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:40.893 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:40.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.894 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:40.976 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:40.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:40.977 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:41.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:41.059 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-10-09T11:53:41.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-10-09T11:53:41.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.371+0000 7f87beb9d700 1 Processor -- start 2023-10-09T11:53:41.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.372+0000 7f87beb9d700 1 -- start start 2023-10-09T11:53:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.373+0000 7f87beb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 0x7f87b80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.373+0000 7f87beb9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80cfa00 con 0x7f87b81591e0 2023-10-09T11:53:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.373+0000 7f87beb9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80cb580 con 0x7f87b80b0790 2023-10-09T11:53:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.373+0000 7f87beb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80cf160 con 0x7f87b80b03c0 2023-10-09T11:53:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.373+0000 7f87be39c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f87b81591e0 0x7f87b8159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56892/0 (socket says 172.21.15.86:56892) 2023-10-09T11:53:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87be39c700 1 -- 172.21.15.86:0/971479626 learned_addr learned my addr 172.21.15.86:0/971479626 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:41.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bdb9b700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 0x7f87b80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511453799 0 0) 0x7f87b80cfa00 con 0x7f87b81591e0 2023-10-09T11:53:41.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a4003570 con 0x7f87b81591e0 2023-10-09T11:53:41.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58319748 0 0) 0x7f87b80cb580 con 0x7f87b80b0790 2023-10-09T11:53:41.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87b80cfa00 con 0x7f87b80b0790 2023-10-09T11:53:41.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4100845099 0 0) 0x7f87a4003570 con 0x7f87b81591e0 2023-10-09T11:53:41.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 msgr2=0x7f87b80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:41.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 0x7f87b80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 >> v1:172.21.15.135:6789/0 conn(0x7f87b80b0790 legacy=0x7f87b80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80cf440 con 0x7f87b81591e0 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f87b00017f0 con 0x7f87b81591e0 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 >> v1:172.21.15.86:6789/0 conn(0x7f87b81591e0 legacy=0x7f87b8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 0x7f87a4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a4004180 0x7f87a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87a4004d50 0x7f87a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80cf160 con 0x7f87a4004180 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a400bba0 con 0x7f87a4004d50 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.374+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a400bd60 con 0x7f87b80b03c0 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bd39a700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a4004180 0x7f87a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bdb9b700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 0x7f87a4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87be39c700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87a4004d50 0x7f87a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bd39a700 1 -- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 msgr2=0x7f87a4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bd39a700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 0x7f87a4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bd39a700 1 -- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87a4004d50 msgr2=0x7f87a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:41.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bd39a700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87a4004d50 0x7f87a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bd39a700 1 -- 172.21.15.86:0/971479626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4003570 con 0x7f87a4004180 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bdb9b700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87b80b03c0 0x7f87a4003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.375+0000 7f87bd39a700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a4004180 0x7f87a4004810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001a10 tx=0x7f87a8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbcf8661fc01997 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800c5d0 con 0x7f87a4004180 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a800c730 con 0x7f87a4004180 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87bcb99700 1 -- 172.21.15.86:0/971479626 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800cad0 con 0x7f87a4004180 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87beb9d700 1 -- 172.21.15.86:0/971479626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a4004180 msgr2=0x7f87a4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:41.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87beb9d700 1 --2- 172.21.15.86:0/971479626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a4004180 0x7f87a4004810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001a10 tx=0x7f87a8007d30 comp rx=0 tx=0).stop 2023-10-09T11:53:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87be39c700 1 -- 172.21.15.86:0/971479626 reap_dead start 2023-10-09T11:53:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87beb9d700 1 -- 172.21.15.86:0/971479626 shutdown_connections 2023-10-09T11:53:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.376+0000 7f87beb9d700 1 -- 172.21.15.86:0/971479626 >> 172.21.15.86:0/971479626 conn(0x7f87b8063230 msgr2=0x7f87b8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.377+0000 7f87beb9d700 1 -- 172.21.15.86:0/971479626 shutdown_connections 2023-10-09T11:53:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.377+0000 7f87beb9d700 1 -- 172.21.15.86:0/971479626 wait complete. 2023-10-09T11:53:41.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.378+0000 7f87beb9d700 1 Processor -- start 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.378+0000 7f87beb9d700 1 -- start start 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87beb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87a4004180 0x7f87b80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87beb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87b80c88c0 0x7f87b80c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87beb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87b80c5d10 0x7f87b80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87beb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815a410 con 0x7f87b80c5d10 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87beb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80c4c90 con 0x7f87b80c88c0 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87beb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80c4f40 con 0x7f87a4004180 2023-10-09T11:53:41.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87b80c5d10 0x7f87b80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87b80c5d10 0x7f87b80c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53392/0 (socket says 172.21.15.86:53392) 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 -- 172.21.15.86:0/2176389060 learned_addr learned my addr 172.21.15.86:0/2176389060 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87bdb9b700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87a4004180 0x7f87b80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87bd39a700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87b80c88c0 0x7f87b80c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 -- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87a4004180 msgr2=0x7f87b80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87a4004180 0x7f87b80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 -- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87b80c88c0 msgr2=0x7f87b80c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87b80c88c0 0x7f87b80c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.379+0000 7f87be39c700 1 -- 172.21.15.86:0/2176389060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80c5220 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.380+0000 7f87be39c700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87b80c5d10 0x7f87b80c6180 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f87b80b1cf0 tx=0x7f87b80b0c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.380+0000 7f87adffb700 1 -- 172.21.15.86:0/2176389060 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000acd0 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.380+0000 7f87adffb700 1 -- 172.21.15.86:0/2176389060 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b000ae70 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.380+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b8159dc0 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.380+0000 7f87adffb700 1 -- 172.21.15.86:0/2176389060 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0013620 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.380+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b81691a0 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.381+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b804c3c0 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.382+0000 7f87adffb700 1 -- 172.21.15.86:0/2176389060 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f87b00139d0 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.383+0000 7f87adffb700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f879c067130 0x7f879c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.383+0000 7f87adffb700 1 -- 172.21.15.86:0/2176389060 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6371+0+0 (secure 0 0 0) 0x7f87b0085430 con 0x7f87b80c5d10 2023-10-09T11:53:41.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.383+0000 7f87bdb9b700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f879c067130 0x7f879c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:41.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.383+0000 7f87bdb9b700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f879c067130 0x7f879c0695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87b4006dc0 tx=0x7f87b4008040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:41.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.387+0000 7f87adffb700 1 -- 172.21.15.86:0/2176389060 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87b0052180 con 0x7f87b80c5d10 2023-10-09T11:53:41.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.613+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f87b80cf720 con 0x7f879c067130 2023-10-09T11:53:41.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.687+0000 7f87adffb700 1 -- 172.21.15.86:0/2176389060 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f87b80cf720 con 0x7f879c067130 2023-10-09T11:53:41.687 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-10-09T11:53:41.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f879c067130 msgr2=0x7f879c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:41.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f879c067130 0x7f879c0695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87b4006dc0 tx=0x7f87b4008040 comp rx=0 tx=0).stop 2023-10-09T11:53:41.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87b80c5d10 msgr2=0x7f87b80c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:41.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87b80c5d10 0x7f87b80c6180 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f87b80b1cf0 tx=0x7f87b80b0c40 comp rx=0 tx=0).stop 2023-10-09T11:53:41.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 shutdown_connections 2023-10-09T11:53:41.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f879c067130 0x7f879c0695e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87b80c5d10 0x7f87b80c6180 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87a4004180 0x7f87b80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 --2- 172.21.15.86:0/2176389060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87b80c88c0 0x7f87b80c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:41.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.689+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 >> 172.21.15.86:0/2176389060 conn(0x7f87b8063230 msgr2=0x7f87b80b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:41.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.690+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 shutdown_connections 2023-10-09T11:53:41.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:41.690+0000 7f87beb9d700 1 -- 172.21.15.86:0/2176389060 wait complete. 2023-10-09T11:53:41.707 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-10-09T11:53:41.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:41.707 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-09T11:53:41.745 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:41.746 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:41.747 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:41.747 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:41.747 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:41.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:41.748 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:41.832 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:41.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:41.833 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:41.917 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:41.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:41.917 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:42.001 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:42.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.001 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:42.084 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:42.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.084 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:42.167 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:42.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.167 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:42.276 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:42.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.276 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:42.324 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:42.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.325 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:42.369 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:42.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.369 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:42.452 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:42.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.452 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:42.534 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:42.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.534 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:42.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:42.618 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-10-09T11:53:42.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-10-09T11:53:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.946+0000 7f8e0cf9d700 1 Processor -- start 2023-10-09T11:53:42.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.946+0000 7f8e0cf9d700 1 -- start start 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e0cf9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8e080cc8d0 0x7f8e0815b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e0cf9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8e0815b960 0x7f8e080ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e0cf9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e08157a50 con 0x7f8e0815b050 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e0cf9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e08158f10 con 0x7f8e080cc8d0 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e0cf9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e081591b0 con 0x7f8e0815b960 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e06ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8e080cc8d0 0x7f8e0815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e06ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8e080cc8d0 0x7f8e0815b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53404/0 (socket says 172.21.15.86:53404) 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.947+0000 7f8e06ffd700 1 -- 172.21.15.86:0/2677651484 learned_addr learned my addr 172.21.15.86:0/2677651484 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:42.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e07fff700 1 --2- 172.21.15.86:0/2677651484 >> v2:172.21.15.135:3300/0 conn(0x7f8e0815b960 0x7f8e080ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:42.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e06ffd700 1 -- 172.21.15.86:0/2677651484 >> v2:172.21.15.135:3300/0 conn(0x7f8e0815b960 msgr2=0x7f8e080ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e06ffd700 1 --2- 172.21.15.86:0/2677651484 >> v2:172.21.15.135:3300/0 conn(0x7f8e0815b960 0x7f8e080ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e06ffd700 1 -- 172.21.15.86:0/2677651484 >> v1:172.21.15.135:6789/0 conn(0x7f8e0815b050 legacy=0x7f8e080ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e06ffd700 1 -- 172.21.15.86:0/2677651484 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080ca9e0 con 0x7f8e080cc8d0 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e06ffd700 1 --2- 172.21.15.86:0/2677651484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e080cc8d0 0x7f8e0815b420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8e080645e0 tx=0x7f8dfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780fc60146e3c455 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e067fc700 1 -- 172.21.15.86:0/2677651484 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc009e70 con 0x7f8e080cc8d0 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e067fc700 1 -- 172.21.15.86:0/2677651484 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc00b860 con 0x7f8e080cc8d0 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.948+0000 7f8e067fc700 1 -- 172.21.15.86:0/2677651484 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00bc00 con 0x7f8e080cc8d0 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2677651484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e080cc8d0 msgr2=0x7f8e0815b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2677651484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e080cc8d0 0x7f8e0815b420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8e080645e0 tx=0x7f8dfc009250 comp rx=0 tx=0).stop 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2677651484 shutdown_connections 2023-10-09T11:53:42.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2677651484 >> v2:172.21.15.135:3300/0 conn(0x7f8e0815b960 0x7f8e080ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:42.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2677651484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e080cc8d0 0x7f8e0815b420 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:42.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2677651484 >> 172.21.15.86:0/2677651484 conn(0x7f8e08068e20 msgr2=0x7f8e080cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:42.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2677651484 shutdown_connections 2023-10-09T11:53:42.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.949+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2677651484 wait complete. 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.950+0000 7f8e0cf9d700 1 Processor -- start 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.951+0000 7f8e0cf9d700 1 -- start start 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.951+0000 7f8e0cf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e080cc8d0 0x7f8e08150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.951+0000 7f8e0cf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e0815b050 0x7f8e0816cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.951+0000 7f8e0cf9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e0815b960 0x7f8e0814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.951+0000 7f8e0cf9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080b02a0 con 0x7f8e0815b960 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.951+0000 7f8e0cf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0816d4f0 con 0x7f8e0815b050 2023-10-09T11:53:42.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e0cf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0816d750 con 0x7f8e080cc8d0 2023-10-09T11:53:42.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e0815b960 0x7f8e0814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:42.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e0815b960 0x7f8e0814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53408/0 (socket says 172.21.15.86:53408) 2023-10-09T11:53:42.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 -- 172.21.15.86:0/2109194702 learned_addr learned my addr 172.21.15.86:0/2109194702 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e06ffd700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e0815b050 0x7f8e0816cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 -- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e080cc8d0 msgr2=0x7f8e08150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e080cc8d0 0x7f8e08150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 -- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e0815b050 msgr2=0x7f8e0816cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e0815b050 0x7f8e0816cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 -- 172.21.15.86:0/2109194702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0094f0 con 0x7f8e0815b960 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e06ffd700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e0815b050 0x7f8e0816cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.952+0000 7f8e07fff700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e0815b960 0x7f8e0814b330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009e90 tx=0x7f8e0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:42.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.953+0000 7f8def7fe700 1 -- 172.21.15.86:0/2109194702 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000cc20 con 0x7f8e0815b960 2023-10-09T11:53:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.953+0000 7f8def7fe700 1 -- 172.21.15.86:0/2109194702 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0000f040 con 0x7f8e0815b960 2023-10-09T11:53:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.953+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0816da30 con 0x7f8e0815b960 2023-10-09T11:53:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.953+0000 7f8def7fe700 1 -- 172.21.15.86:0/2109194702 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00014480 con 0x7f8e0815b960 2023-10-09T11:53:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.953+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e080b04f0 con 0x7f8e0815b960 2023-10-09T11:53:42.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.954+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0804c3c0 con 0x7f8e0815b960 2023-10-09T11:53:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.955+0000 7f8def7fe700 1 -- 172.21.15.86:0/2109194702 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f8e00014830 con 0x7f8e0815b960 2023-10-09T11:53:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.956+0000 7f8def7fe700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8df4067130 0x7f8df40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.956+0000 7f8def7fe700 1 -- 172.21.15.86:0/2109194702 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f8e00085860 con 0x7f8e0815b960 2023-10-09T11:53:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.956+0000 7f8e077fe700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8df4067130 0x7f8df40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:42.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.956+0000 7f8e077fe700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8df4067130 0x7f8df40695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8df8001680 tx=0x7f8df8007ab0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:42.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:42.960+0000 7f8def7fe700 1 -- 172.21.15.86:0/2109194702 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e000522e0 con 0x7f8e0815b960 2023-10-09T11:53:43.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.175+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e0806b7c0 con 0x7f8df4067130 2023-10-09T11:53:43.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.269+0000 7f8def7fe700 1 -- 172.21.15.86:0/2109194702 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8e0806b7c0 con 0x7f8df4067130 2023-10-09T11:53:43.270 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8df4067130 msgr2=0x7f8df40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8df4067130 0x7f8df40695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8df8001680 tx=0x7f8df8007ab0 comp rx=0 tx=0).stop 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e0815b960 msgr2=0x7f8e0814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e0815b960 0x7f8e0814b330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009e90 tx=0x7f8e0000b040 comp rx=0 tx=0).stop 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 shutdown_connections 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f8df4067130 0x7f8df40695e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e0815b960 0x7f8e0814b330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e080cc8d0 0x7f8e08150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:43.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 --2- 172.21.15.86:0/2109194702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e0815b050 0x7f8e0816cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:43.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 >> 172.21.15.86:0/2109194702 conn(0x7f8e08068e20 msgr2=0x7f8e08159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:43.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 shutdown_connections 2023-10-09T11:53:43.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:43.272+0000 7f8e0cf9d700 1 -- 172.21.15.86:0/2109194702 wait complete. 2023-10-09T11:53:43.290 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-10-09T11:53:43.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.290 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-09T11:53:43.328 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:43.328 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:43.329 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:43.330 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:43.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.330 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:43.416 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:43.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.417 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:43.499 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:43.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.500 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:43.583 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:43.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.583 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:43.668 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:43.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.669 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:43.755 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:43.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.756 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:43.800 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:43.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.800 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:43.886 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:43.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.886 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:43.970 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:43.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:43.971 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:44.056 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:44.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:44.056 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:44.140 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:44.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:44.140 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:44.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:44.246 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-10-09T11:53:44.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-10-09T11:53:44.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.525+0000 7f21709fe700 1 Processor -- start 2023-10-09T11:53:44.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.525+0000 7f21709fe700 1 -- start start 2023-10-09T11:53:44.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f21709fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f216c0b0c00 0x7f216c0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:44.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f21709fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0b0570 con 0x7f216c0b0760 2023-10-09T11:53:44.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f21709fe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0af4d0 con 0x7f216c156350 2023-10-09T11:53:44.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f21709fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0af7b0 con 0x7f216c0b0c00 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f216a59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f216c0b0760 0x7f216c0ace60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56894/0 (socket says 172.21.15.86:56894) 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f216a59c700 1 -- 172.21.15.86:0/1731346336 learned_addr learned my addr 172.21.15.86:0/1731346336 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f216b59e700 1 --2- 172.21.15.86:0/1731346336 >> v2:172.21.15.86:3300/0 conn(0x7f216c0b0c00 0x7f216c0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f2169d9b700 1 -- 172.21.15.86:0/1731346336 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673861293 0 0) 0x7f216c0b0570 con 0x7f216c0b0760 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f2169d9b700 1 -- 172.21.15.86:0/1731346336 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2154003570 con 0x7f216c0b0760 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.527+0000 7f2169d9b700 1 -- 172.21.15.86:0/1731346336 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925006400 0 0) 0x7f216c0af4d0 con 0x7f216c156350 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f216b59e700 1 -- 172.21.15.86:0/1731346336 >> v1:172.21.15.135:6789/0 conn(0x7f216c156350 legacy=0x7f216c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f216b59e700 1 -- 172.21.15.86:0/1731346336 >> v1:172.21.15.86:6789/0 conn(0x7f216c0b0760 legacy=0x7f216c0ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f216b59e700 1 -- 172.21.15.86:0/1731346336 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0afa90 con 0x7f216c0b0c00 2023-10-09T11:53:44.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f216b59e700 1 --2- 172.21.15.86:0/1731346336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0c00 0x7f216c0ad570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2164009e60 tx=0x7f2164009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cf9b9474a2aeb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:44.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f2169d9b700 1 -- 172.21.15.86:0/1731346336 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400bb60 con 0x7f216c0b0c00 2023-10-09T11:53:44.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f2169d9b700 1 -- 172.21.15.86:0/1731346336 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400bcc0 con 0x7f216c0b0c00 2023-10-09T11:53:44.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f2169d9b700 1 -- 172.21.15.86:0/1731346336 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164011460 con 0x7f216c0b0c00 2023-10-09T11:53:44.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f21709fe700 1 -- 172.21.15.86:0/1731346336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0c00 msgr2=0x7f216c0ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:44.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.528+0000 7f21709fe700 1 --2- 172.21.15.86:0/1731346336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0c00 0x7f216c0ad570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2164009e60 tx=0x7f2164009780 comp rx=0 tx=0).stop 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.529+0000 7f21709fe700 1 -- 172.21.15.86:0/1731346336 shutdown_connections 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.529+0000 7f21709fe700 1 --2- 172.21.15.86:0/1731346336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0c00 0x7f216c0ad570 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.529+0000 7f21709fe700 1 -- 172.21.15.86:0/1731346336 >> 172.21.15.86:0/1731346336 conn(0x7f216c068e20 msgr2=0x7f216c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.529+0000 7f21709fe700 1 -- 172.21.15.86:0/1731346336 shutdown_connections 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.529+0000 7f21709fe700 1 -- 172.21.15.86:0/1731346336 wait complete. 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.530+0000 7f21709fe700 1 Processor -- start 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.530+0000 7f21709fe700 1 -- start start 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f21709fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0760 0x7f216c15a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:44.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f21709fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c0b0c00 0x7f216c141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f21709fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f216c156350 0x7f216c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f21709fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c90c0 con 0x7f216c0b0760 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f21709fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c93a0 con 0x7f216c0b0c00 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f21709fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c158890 con 0x7f216c156350 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f216ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0760 0x7f216c15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f216ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0760 0x7f216c15a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53420/0 (socket says 172.21.15.86:53420) 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f216ad9d700 1 -- 172.21.15.86:0/3148201894 learned_addr learned my addr 172.21.15.86:0/3148201894 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f216a59c700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c0b0c00 0x7f216c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.531+0000 7f216b59e700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f216c156350 0x7f216c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:44.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f216ad9d700 1 -- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f216c156350 msgr2=0x7f216c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f216ad9d700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f216c156350 0x7f216c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f216ad9d700 1 -- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c0b0c00 msgr2=0x7f216c141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f216ad9d700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c0b0c00 0x7f216c141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f216ad9d700 1 -- 172.21.15.86:0/3148201894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009a20 con 0x7f216c0b0760 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f216ad9d700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0760 0x7f216c15a5d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c7e0 tx=0x7f215c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f2152ffd700 1 -- 172.21.15.86:0/3148201894 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0105c0 con 0x7f216c0b0760 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f2152ffd700 1 -- 172.21.15.86:0/3148201894 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c010740 con 0x7f216c0b0760 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c158b30 con 0x7f216c0b0760 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f2152ffd700 1 -- 172.21.15.86:0/3148201894 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c010b00 con 0x7f216c0b0760 2023-10-09T11:53:44.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.532+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c1590f0 con 0x7f216c0b0760 2023-10-09T11:53:44.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.533+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c04c3c0 con 0x7f216c0b0760 2023-10-09T11:53:44.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.534+0000 7f2152ffd700 1 -- 172.21.15.86:0/3148201894 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f215c01b3b0 con 0x7f216c0b0760 2023-10-09T11:53:44.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.535+0000 7f2152ffd700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2158067130 0x7f21580695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:44.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.535+0000 7f2152ffd700 1 -- 172.21.15.86:0/3148201894 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6451+0+0 (secure 0 0 0) 0x7f215c084200 con 0x7f216c0b0760 2023-10-09T11:53:44.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.535+0000 7f216a59c700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2158067130 0x7f21580695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:44.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.536+0000 7f216a59c700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2158067130 0x7f21580695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f216c0ae750 tx=0x7f2160009040 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:44.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.539+0000 7f2152ffd700 1 -- 172.21.15.86:0/3148201894 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f215c050e60 con 0x7f216c0b0760 2023-10-09T11:53:44.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.762+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 --> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f216c0afd70 con 0x7f2158067130 2023-10-09T11:53:44.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.852+0000 7f2152ffd700 1 -- 172.21.15.86:0/3148201894 <== mgr.5121 v2:172.21.15.86:6832/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f216c0afd70 con 0x7f2158067130 2023-10-09T11:53:44.853 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-10-09T11:53:44.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2158067130 msgr2=0x7f21580695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:44.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2158067130 0x7f21580695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f216c0ae750 tx=0x7f2160009040 comp rx=0 tx=0).stop 2023-10-09T11:53:44.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0760 msgr2=0x7f216c15a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:44.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0760 0x7f216c15a5d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c7e0 tx=0x7f215c007df0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 shutdown_connections 2023-10-09T11:53:44.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f2158067130 0x7f21580695e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f216c0b0760 0x7f216c15a5d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f216c156350 0x7f216c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 --2- 172.21.15.86:0/3148201894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f216c0b0c00 0x7f216c141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:44.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 >> 172.21.15.86:0/3148201894 conn(0x7f216c068e20 msgr2=0x7f216c0add60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:44.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 shutdown_connections 2023-10-09T11:53:44.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:44.855+0000 7f21709fe700 1 -- 172.21.15.86:0/3148201894 wait complete. 2023-10-09T11:53:44.872 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-10-09T11:53:44.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:44.872 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-09T11:53:44.910 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:44.910 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:44.910 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:44.910 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:44.911 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:44.911 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:44.911 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:44.911 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:44.911 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:44.911 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:44.912 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:44.912 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_43_00_UTC 2023-10-09T11:53:44.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:44.913 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_43_00_UTC) 2023-10-09T11:53:44.997 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_44_00_UTC 2023-10-09T11:53:44.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:44.998 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_44_00_UTC) 2023-10-09T11:53:45.083 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_45_00_UTC 2023-10-09T11:53:45.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.083 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_45_00_UTC) 2023-10-09T11:53:45.168 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_46_00_UTC 2023-10-09T11:53:45.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.169 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_46_00_UTC) 2023-10-09T11:53:45.293 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_47_00_UTC 2023-10-09T11:53:45.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.293 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_47_00_UTC) 2023-10-09T11:53:45.337 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_48_00_UTC 2023-10-09T11:53:45.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.338 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_48_00_UTC) 2023-10-09T11:53:45.422 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_49_00_UTC 2023-10-09T11:53:45.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.423 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_49_00_UTC) 2023-10-09T11:53:45.506 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_50_00_UTC 2023-10-09T11:53:45.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.506 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_50_00_UTC) 2023-10-09T11:53:45.589 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_51_00_UTC 2023-10-09T11:53:45.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.589 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_51_00_UTC) 2023-10-09T11:53:45.672 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_52_00_UTC 2023-10-09T11:53:45.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.673 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_52_00_UTC) 2023-10-09T11:53:45.755 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_53_00_UTC 2023-10-09T11:53:45.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.755 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-09-11_53_00_UTC) 2023-10-09T11:53:45.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:45.870 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-10-09T11:53:45.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T11:53:46.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.130+0000 7f138759e700 1 Processor -- start 2023-10-09T11:53:46.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.130+0000 7f138759e700 1 -- start start 2023-10-09T11:53:46.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f138759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f13880ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f138759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f13880b1b40 0x7f138815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f138759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13880cfb00 con 0x7f13880b16d0 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f138759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13880b5c40 con 0x7f13880b1b40 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f138759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13880b5f20 con 0x7f13880b4e70 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f1386d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f13880b1b40 0x7f138815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f1385d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f13880b16d0 0x7f138815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56260/0 (socket says 172.21.15.86:56260) 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.131+0000 7f1385d9b700 1 -- 172.21.15.86:0/4229818068 learned_addr learned my addr 172.21.15.86:0/4229818068 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f138659c700 1 --2- 172.21.15.86:0/4229818068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f13880ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:46.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f1386d9d700 1 -- 172.21.15.86:0/4229818068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 msgr2=0x7f13880ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f1386d9d700 1 --2- 172.21.15.86:0/4229818068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f13880ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f1386d9d700 1 -- 172.21.15.86:0/4229818068 >> v1:172.21.15.86:6789/0 conn(0x7f13880b16d0 legacy=0x7f138815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f1386d9d700 1 -- 172.21.15.86:0/4229818068 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880b6200 con 0x7f13880b1b40 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f138559a700 1 -- 172.21.15.86:0/4229818068 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609493335 0 0) 0x7f13880cfb00 con 0x7f13880b16d0 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f1386d9d700 1 --2- 172.21.15.86:0/4229818068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f138815d950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1380009e60 tx=0x7f1380009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4771769fb6bbf20 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f138559a700 1 -- 172.21.15.86:0/4229818068 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000e070 con 0x7f13880b1b40 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f138559a700 1 -- 172.21.15.86:0/4229818068 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138000bb60 con 0x7f13880b1b40 2023-10-09T11:53:46.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.132+0000 7f138559a700 1 -- 172.21.15.86:0/4229818068 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380012430 con 0x7f13880b1b40 2023-10-09T11:53:46.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 -- 172.21.15.86:0/4229818068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 msgr2=0x7f138815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:46.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 --2- 172.21.15.86:0/4229818068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f138815d950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1380009e60 tx=0x7f1380009780 comp rx=0 tx=0).stop 2023-10-09T11:53:46.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 -- 172.21.15.86:0/4229818068 shutdown_connections 2023-10-09T11:53:46.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 --2- 172.21.15.86:0/4229818068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f138815d950 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:46.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 --2- 172.21.15.86:0/4229818068 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f13880ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:46.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 -- 172.21.15.86:0/4229818068 >> 172.21.15.86:0/4229818068 conn(0x7f13880d10c0 msgr2=0x7f13880affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:46.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 -- 172.21.15.86:0/4229818068 shutdown_connections 2023-10-09T11:53:46.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.133+0000 7f138759e700 1 -- 172.21.15.86:0/4229818068 wait complete. 2023-10-09T11:53:46.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.135+0000 7f138759e700 1 Processor -- start 2023-10-09T11:53:46.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.135+0000 7f138759e700 1 -- start start 2023-10-09T11:53:46.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f138759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13880b16d0 0x7f138815cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:46.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f138759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f13880cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:46.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f138759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f1388144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:46.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f138759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138815c6a0 con 0x7f13880b1b40 2023-10-09T11:53:46.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f138759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138815ba90 con 0x7f13880b16d0 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f138759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138815bd70 con 0x7f13880b4e70 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f13880cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f13880cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36882/0 (socket says 172.21.15.86:36882) 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 -- 172.21.15.86:0/64959457 learned_addr learned my addr 172.21.15.86:0/64959457 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f138659c700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13880b16d0 0x7f138815cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1386d9d700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f1388144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 -- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 msgr2=0x7f1388144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f1388144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 -- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13880b16d0 msgr2=0x7f138815cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:46.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13880b16d0 0x7f138815cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 -- 172.21.15.86:0/64959457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380009a20 con 0x7f13880b1b40 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.136+0000 7f1385d9b700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f13880cbb20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f137c00c5b0 tx=0x7f137c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.137+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c005b30 con 0x7f13880b1b40 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.137+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c005c90 con 0x7f13880b1b40 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.137+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c007320 con 0x7f13880b1b40 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.137+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138815c050 con 0x7f13880b1b40 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.137+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13880cc060 con 0x7f13880b1b40 2023-10-09T11:53:46.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.138+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138815c810 con 0x7f13880b1b40 2023-10-09T11:53:46.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.139+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f137c01b3b0 con 0x7f13880b1b40 2023-10-09T11:53:46.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.140+0000 7f13767fc700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1368067130 0x7f13680695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:46.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.140+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f137c083ff0 con 0x7f13880b1b40 2023-10-09T11:53:46.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.140+0000 7f138659c700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1368067130 0x7f13680695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:46.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.141+0000 7f138659c700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1368067130 0x7f13680695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1378009db0 tx=0x7f13780091a0 comp rx=0 tx=0).ready entity=mgr.5121 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:46.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.144+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f137c050c50 con 0x7f13880b1b40 2023-10-09T11:53:46.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:46.410+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f138804bb80 con 0x7f13880b1b40 2023-10-09T11:53:47.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.386+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f137c051020 con 0x7f13880b1b40 2023-10-09T11:53:47.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.387+0000 7f13767fc700 1 -- 172.21.15.86:0/64959457 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v16) v1 ==== 93+0+0 (secure 0 0 0) 0x7f137c050c50 con 0x7f13880b1b40 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1368067130 msgr2=0x7f13680695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1368067130 0x7f13680695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1378009db0 tx=0x7f13780091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 msgr2=0x7f13880cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f13880cbb20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f137c00c5b0 tx=0x7f137c001070 comp rx=0 tx=0).stop 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 shutdown_connections 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f1368067130 0x7f13680695e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13880b4e70 0x7f1388144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13880b16d0 0x7f138815cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 --2- 172.21.15.86:0/64959457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13880b1b40 0x7f13880cbb20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 >> 172.21.15.86:0/64959457 conn(0x7f13880d10c0 msgr2=0x7f13880b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:47.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 shutdown_connections 2023-10-09T11:53:47.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.390+0000 7f138759e700 1 -- 172.21.15.86:0/64959457 wait complete. 2023-10-09T11:53:47.417 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:53:47.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:53:47.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:53:47.589 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:53:47.589 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:53:47.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:53:47.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:53:47.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:53:47.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:53:47.701 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:53:47.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:53:47.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.975+0000 7fd9d8b9d700 1 Processor -- start 2023-10-09T11:53:47.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.976+0000 7fd9d8b9d700 1 -- start start 2023-10-09T11:53:47.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d8b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9d41597f0 0x7fd9d40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d8b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d415d230 0x7fd9d415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d8b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d415dbb0 con 0x7fd9d4159420 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d8b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40b11d0 con 0x7fd9d41597f0 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d8b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40b14b0 con 0x7fd9d415d230 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d37fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd9d4159420 0x7fd9d40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56274/0 (socket says 172.21.15.86:56274) 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d37fe700 1 -- 172.21.15.86:0/467367875 learned_addr learned my addr 172.21.15.86:0/467367875 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d2ffd700 1 --2- 172.21.15.86:0/467367875 >> v2:172.21.15.86:3300/0 conn(0x7fd9d41597f0 0x7fd9d40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:47.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.978+0000 7fd9d3fff700 1 --2- 172.21.15.86:0/467367875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d415d230 0x7fd9d415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:47.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.979+0000 7fd9d3fff700 1 -- 172.21.15.86:0/467367875 >> v2:172.21.15.86:3300/0 conn(0x7fd9d41597f0 msgr2=0x7fd9d40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:47.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.979+0000 7fd9d3fff700 1 --2- 172.21.15.86:0/467367875 >> v2:172.21.15.86:3300/0 conn(0x7fd9d41597f0 0x7fd9d40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.979+0000 7fd9d3fff700 1 -- 172.21.15.86:0/467367875 >> v1:172.21.15.86:6789/0 conn(0x7fd9d4159420 legacy=0x7fd9d40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:47.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.979+0000 7fd9d3fff700 1 -- 172.21.15.86:0/467367875 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40b1790 con 0x7fd9d415d230 2023-10-09T11:53:47.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.979+0000 7fd9d3fff700 1 --2- 172.21.15.86:0/467367875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d415d230 0x7fd9d415d670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40098e0 tx=0x7fd9c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=830b27ad9689929d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:47.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.980+0000 7fd9d27fc700 1 -- 172.21.15.86:0/467367875 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400b640 con 0x7fd9d415d230 2023-10-09T11:53:47.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.980+0000 7fd9d27fc700 1 -- 172.21.15.86:0/467367875 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c400b7a0 con 0x7fd9d415d230 2023-10-09T11:53:47.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.980+0000 7fd9d27fc700 1 -- 172.21.15.86:0/467367875 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400bb60 con 0x7fd9d415d230 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 -- 172.21.15.86:0/467367875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d415d230 msgr2=0x7fd9d415d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 --2- 172.21.15.86:0/467367875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d415d230 0x7fd9d415d670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40098e0 tx=0x7fd9c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 -- 172.21.15.86:0/467367875 shutdown_connections 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 --2- 172.21.15.86:0/467367875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d415d230 0x7fd9d415d670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 --2- 172.21.15.86:0/467367875 >> v2:172.21.15.86:3300/0 conn(0x7fd9d41597f0 0x7fd9d40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 -- 172.21.15.86:0/467367875 >> 172.21.15.86:0/467367875 conn(0x7fd9d40d0660 msgr2=0x7fd9d40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 -- 172.21.15.86:0/467367875 shutdown_connections 2023-10-09T11:53:47.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.981+0000 7fd9d8b9d700 1 -- 172.21.15.86:0/467367875 wait complete. 2023-10-09T11:53:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.983+0000 7fd9d8b9d700 1 Processor -- start 2023-10-09T11:53:47.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.984+0000 7fd9d8b9d700 1 -- start start 2023-10-09T11:53:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.986+0000 7fd9d8b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d4159420 0x7fd9d41543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.986+0000 7fd9d8b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d41597f0 0x7fd9d40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.986+0000 7fd9d8b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d415d230 0x7fd9d40b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:47.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.986+0000 7fd9d8b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40b4c00 con 0x7fd9d415d230 2023-10-09T11:53:47.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.986+0000 7fd9d8b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40c5940 con 0x7fd9d41597f0 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.986+0000 7fd9d8b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40b3ff0 con 0x7fd9d4159420 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d4159420 0x7fd9d41543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d4159420 0x7fd9d41543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:34550/0 (socket says 172.21.15.86:34550) 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 -- 172.21.15.86:0/514002536 learned_addr learned my addr 172.21.15.86:0/514002536 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d3fff700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d415d230 0x7fd9d40b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d2ffd700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d41597f0 0x7fd9d40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 -- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d41597f0 msgr2=0x7fd9d40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d41597f0 0x7fd9d40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 -- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d415d230 msgr2=0x7fd9d40b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d415d230 0x7fd9d40b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 -- 172.21.15.86:0/514002536 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4009420 con 0x7fd9d4159420 2023-10-09T11:53:47.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.987+0000 7fd9d37fe700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d4159420 0x7fd9d41543f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c7c0 tx=0x7fd9bc007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:47.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.988+0000 7fd9cb7fe700 1 -- 172.21.15.86:0/514002536 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc005b30 con 0x7fd9d4159420 2023-10-09T11:53:47.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.988+0000 7fd9cb7fe700 1 -- 172.21.15.86:0/514002536 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc005c90 con 0x7fd9d4159420 2023-10-09T11:53:47.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.988+0000 7fd9cb7fe700 1 -- 172.21.15.86:0/514002536 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc004a60 con 0x7fd9d4159420 2023-10-09T11:53:47.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.988+0000 7fd9d8b9d700 1 -- 172.21.15.86:0/514002536 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d40b42d0 con 0x7fd9d4159420 2023-10-09T11:53:47.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.989+0000 7fd9d8b9d700 1 -- 172.21.15.86:0/514002536 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d40b4890 con 0x7fd9d4159420 2023-10-09T11:53:47.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.990+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b00052b0 con 0x7fd9d4159420 2023-10-09T11:53:47.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.990+0000 7fd9cb7fe700 1 -- 172.21.15.86:0/514002536 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fd9bc0070d0 con 0x7fd9d4159420 2023-10-09T11:53:47.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.991+0000 7fd9cb7fe700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 0x7fd9b8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:47.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.991+0000 7fd9cb7fe700 1 -- 172.21.15.86:0/514002536 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6831+0+0 (secure 0 0 0) 0x7fd9bc0840d0 con 0x7fd9d4159420 2023-10-09T11:53:47.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.991+0000 7fd9d2ffd700 1 -- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 msgr2=0x7fd9b8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:47.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.991+0000 7fd9d2ffd700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 0x7fd9b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:47.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:47.996+0000 7fd9cb7fe700 1 -- 172.21.15.86:0/514002536 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9bc04b5a0 con 0x7fd9d4159420 2023-10-09T11:53:48.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.192+0000 7fd9d2ffd700 1 -- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 msgr2=0x7fd9b8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:48.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.192+0000 7fd9d2ffd700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 0x7fd9b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:48.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.237+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9b0005560 con 0x7fd9d4159420 2023-10-09T11:53:48.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.238+0000 7fd9cb7fe700 1 -- 172.21.15.86:0/514002536 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fd9bc050bc0 con 0x7fd9d4159420 2023-10-09T11:53:48.239 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:48.239 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1552998028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1552998028},{"type":"v1","addr":"172.21.15.135:6834","nonce":1552998028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3861152933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3861152933},{"type":"v1","addr":"172.21.15.135:6835","nonce":3861152933}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4887,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/647611791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":647611791},{"type":"v1","addr":"172.21.15.86:6836","nonce":647611791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:07.793130+0000","modified":"2023-10-09T11:42:11.321775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6837/1725825433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1725825433},{"type":"v1","addr":"172.21.15.86:6837","nonce":1725825433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 msgr2=0x7fd9b8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 0x7fd9b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d4159420 msgr2=0x7fd9d41543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d4159420 0x7fd9d41543f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c7c0 tx=0x7fd9bc007f70 comp rx=0 tx=0).stop 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 shutdown_connections 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd9b80670e0 0x7fd9b8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d415d230 0x7fd9d40b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9d4159420 0x7fd9d41543f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 --2- 172.21.15.86:0/514002536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d41597f0 0x7fd9d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 >> 172.21.15.86:0/514002536 conn(0x7fd9d40d0660 msgr2=0x7fd9d40b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:48.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 shutdown_connections 2023-10-09T11:53:48.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.241+0000 7fd9c97fa700 1 -- 172.21.15.86:0/514002536 wait complete. 2023-10-09T11:53:48.244 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2023-10-09T11:53:48.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:53:48.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.457+0000 7f00a4f9d700 1 Processor -- start 2023-10-09T11:53:48.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.457+0000 7f00a4f9d700 1 -- start start 2023-10-09T11:53:48.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f00a4f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00a015d230 0x7f00a015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f00a4f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a00b2980 con 0x7f00a01597f0 2023-10-09T11:53:48.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f00a4f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a015db70 con 0x7f00a0159420 2023-10-09T11:53:48.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f00a4f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a00b11d0 con 0x7f00a015d230 2023-10-09T11:53:48.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f009effd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f00a01597f0 0x7f00a00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56290/0 (socket says 172.21.15.86:56290) 2023-10-09T11:53:48.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f009effd700 1 -- 172.21.15.86:0/2140326741 learned_addr learned my addr 172.21.15.86:0/2140326741 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:48.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f009ffff700 1 --2- 172.21.15.86:0/2140326741 >> v2:172.21.15.86:3300/0 conn(0x7f00a015d230 0x7f00a015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f009ffff700 1 -- 172.21.15.86:0/2140326741 >> v1:172.21.15.135:6789/0 conn(0x7f00a0159420 legacy=0x7f00a00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f009ffff700 1 -- 172.21.15.86:0/2140326741 >> v1:172.21.15.86:6789/0 conn(0x7f00a01597f0 legacy=0x7f00a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.459+0000 7f009ffff700 1 -- 172.21.15.86:0/2140326741 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00b14b0 con 0x7f00a015d230 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.460+0000 7f009ffff700 1 --2- 172.21.15.86:0/2140326741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a015d230 0x7f00a015d630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0098009e60 tx=0x7f0098009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa9e9e967d1e010 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.460+0000 7f009e7fc700 1 -- 172.21.15.86:0/2140326741 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800e070 con 0x7f00a015d230 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.460+0000 7f009e7fc700 1 -- 172.21.15.86:0/2140326741 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009800bc30 con 0x7f00a015d230 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.460+0000 7f009e7fc700 1 -- 172.21.15.86:0/2140326741 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098012430 con 0x7f00a015d230 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.460+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2140326741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a015d230 msgr2=0x7f00a015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.460+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2140326741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a015d230 0x7f00a015d630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0098009e60 tx=0x7f0098009780 comp rx=0 tx=0).stop 2023-10-09T11:53:48.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.461+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2140326741 shutdown_connections 2023-10-09T11:53:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.461+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2140326741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a015d230 0x7f00a015d630 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.461+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2140326741 >> 172.21.15.86:0/2140326741 conn(0x7f00a00d0660 msgr2=0x7f00a00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.461+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2140326741 shutdown_connections 2023-10-09T11:53:48.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.461+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2140326741 wait complete. 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.462+0000 7f00a4f9d700 1 Processor -- start 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.462+0000 7f00a4f9d700 1 -- start start 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f00a4f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00a0159420 0x7f00a0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f00a4f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a01597f0 0x7f00a00cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f00a4f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00a015d230 0x7f00a00cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f00a4f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00cc340 con 0x7f00a01597f0 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f00a4f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00cbaa0 con 0x7f00a0159420 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f00a4f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00cbd80 con 0x7f00a015d230 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f009effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a01597f0 0x7f00a00cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f009effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a01597f0 0x7f00a00cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36938/0 (socket says 172.21.15.86:36938) 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f009effd700 1 -- 172.21.15.86:0/2581959321 learned_addr learned my addr 172.21.15.86:0/2581959321 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f009f7fe700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00a0159420 0x7f00a0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.463+0000 7f009ffff700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00a015d230 0x7f00a00cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f009effd700 1 -- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00a015d230 msgr2=0x7f00a00cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f009effd700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00a015d230 0x7f00a00cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f009effd700 1 -- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00a0159420 msgr2=0x7f00a0154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f009effd700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00a0159420 0x7f00a0154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f009effd700 1 -- 172.21.15.86:0/2581959321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098009a20 con 0x7f00a01597f0 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f009ffff700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00a015d230 0x7f00a00cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f009effd700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a01597f0 0x7f00a00cad40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f009400c790 tx=0x7f0094007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f00877fe700 1 -- 172.21.15.86:0/2581959321 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094005b30 con 0x7f00a01597f0 2023-10-09T11:53:48.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f00877fe700 1 -- 172.21.15.86:0/2581959321 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0094005c90 con 0x7f00a01597f0 2023-10-09T11:53:48.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f00877fe700 1 -- 172.21.15.86:0/2581959321 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094004a80 con 0x7f00a01597f0 2023-10-09T11:53:48.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a00cc060 con 0x7f00a01597f0 2023-10-09T11:53:48.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.464+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a00cb7c0 con 0x7f00a01597f0 2023-10-09T11:53:48.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.465+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0144130 con 0x7f00a01597f0 2023-10-09T11:53:48.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.466+0000 7f00877fe700 1 -- 172.21.15.86:0/2581959321 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f00940070d0 con 0x7f00a01597f0 2023-10-09T11:53:48.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.468+0000 7f00877fe700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 0x7f008c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.468+0000 7f00877fe700 1 -- 172.21.15.86:0/2581959321 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f00940840f0 con 0x7f00a01597f0 2023-10-09T11:53:48.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.468+0000 7f009f7fe700 1 -- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 msgr2=0x7f008c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:48.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.468+0000 7f009f7fe700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 0x7f008c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:48.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.472+0000 7f00877fe700 1 -- 172.21.15.86:0/2581959321 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f009404b5a0 con 0x7f00a01597f0 2023-10-09T11:53:48.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.669+0000 7f009f7fe700 1 -- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 msgr2=0x7f008c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:48.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.669+0000 7f009f7fe700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 0x7f008c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:48.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.671+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00a004c3c0 con 0x7f00a01597f0 2023-10-09T11:53:48.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.673+0000 7f00877fe700 1 -- 172.21.15.86:0/2581959321 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+17102 (secure 0 0 0) 0x7f00a0144130 con 0x7f00a01597f0 2023-10-09T11:53:48.674 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:48.675 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":49,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:53:47.212437+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:05.325678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:06.736222+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6833/85490":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2422899393":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/1379635191":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2164323904":"2023-10-10T11:42:23.645474+0000","172.21.15.86:6832/85490":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2564271480":"2023-10-10T11:42:23.645474+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":108,"length":1},{"begin":193,"length":28}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":22,"length":1},{"begin":32,"length":1},{"begin":43,"length":1},{"begin":54,"length":1},{"begin":64,"length":1},{"begin":75,"length":1},{"begin":86,"length":1},{"begin":97,"length":1},{"begin":213,"length":8}]}],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":8,"length":2},{"begin":12,"length":2},{"begin":17,"length":1},{"begin":23,"length":2},{"begin":28,"length":2},{"begin":33,"length":2},{"begin":38,"length":2},{"begin":45,"length":1},{"begin":49,"length":2},{"begin":56,"length":1},{"begin":60,"length":2},{"begin":66,"length":1},{"begin":70,"length":3},{"begin":77,"length":1},{"begin":81,"length":3},{"begin":88,"length":1},{"begin":93,"length":2},{"begin":99,"length":1},{"begin":103,"length":2},{"begin":109,"length":1},{"begin":158,"length":35}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 msgr2=0x7f008c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 0x7f008c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a01597f0 msgr2=0x7f00a00cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a01597f0 0x7f00a00cad40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f009400c790 tx=0x7f0094007f40 comp rx=0 tx=0).stop 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 shutdown_connections 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f008c0670e0 0x7f008c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00a015d230 0x7f00a00cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00a0159420 0x7f00a0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 --2- 172.21.15.86:0/2581959321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00a01597f0 0x7f00a00cad40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 >> 172.21.15.86:0/2581959321 conn(0x7f00a00d0660 msgr2=0x7f00a0155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:48.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 shutdown_connections 2023-10-09T11:53:48.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.676+0000 7f00a4f9d700 1 -- 172.21.15.86:0/2581959321 wait complete. 2023-10-09T11:53:48.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:42:05.325678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:42:06.736222+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:53:48.699 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:53:48.714 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:48.714+0000 7fa011062180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:53:48.770 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:48.769+0000 7f7d2e689180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:53:48.878 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:48.877+0000 7fa011062180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:53:48.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.896+0000 7f90d519d700 1 Processor -- start 2023-10-09T11:53:48.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.897+0000 7f90d519d700 1 -- start start 2023-10-09T11:53:48.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d519d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f90d00b4e70 0x7f90d00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d519d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f90d00b1b40 0x7f90d015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d519d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d00cfb00 con 0x7f90d00b16d0 2023-10-09T11:53:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d519d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d00b5c40 con 0x7f90d00b1b40 2023-10-09T11:53:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d519d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d00b5f20 con 0x7f90d00b4e70 2023-10-09T11:53:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d499c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f90d00b1b40 0x7f90d015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d499c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f90d00b1b40 0x7f90d015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36946/0 (socket says 172.21.15.86:36946) 2023-10-09T11:53:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90d499c700 1 -- 172.21.15.86:0/3571685390 learned_addr learned my addr 172.21.15.86:0/3571685390 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:48.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.898+0000 7f90cffff700 1 --2- 172.21.15.86:0/3571685390 >> v2:172.21.15.135:3300/0 conn(0x7f90d00b4e70 0x7f90d00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90d499c700 1 -- 172.21.15.86:0/3571685390 >> v2:172.21.15.135:3300/0 conn(0x7f90d00b4e70 msgr2=0x7f90d00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:48.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90d499c700 1 --2- 172.21.15.86:0/3571685390 >> v2:172.21.15.135:3300/0 conn(0x7f90d00b4e70 0x7f90d00ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90d499c700 1 -- 172.21.15.86:0/3571685390 >> v1:172.21.15.86:6789/0 conn(0x7f90d00b16d0 legacy=0x7f90d015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90d499c700 1 -- 172.21.15.86:0/3571685390 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00b6200 con 0x7f90d00b1b40 2023-10-09T11:53:48.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90d499c700 1 --2- 172.21.15.86:0/3571685390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d015d950 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f90d0064910 tx=0x7f90c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bac571fb066ed4a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:48.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90ceffd700 1 -- 172.21.15.86:0/3571685390 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c800e070 con 0x7f90d00b1b40 2023-10-09T11:53:48.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90ceffd700 1 -- 172.21.15.86:0/3571685390 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c800ba20 con 0x7f90d00b1b40 2023-10-09T11:53:48.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.899+0000 7f90ceffd700 1 -- 172.21.15.86:0/3571685390 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80092e0 con 0x7f90d00b1b40 2023-10-09T11:53:48.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 -- 172.21.15.86:0/3571685390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 msgr2=0x7f90d015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 --2- 172.21.15.86:0/3571685390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d015d950 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f90d0064910 tx=0x7f90c8009840 comp rx=0 tx=0).stop 2023-10-09T11:53:48.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 -- 172.21.15.86:0/3571685390 shutdown_connections 2023-10-09T11:53:48.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 --2- 172.21.15.86:0/3571685390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d015d950 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 --2- 172.21.15.86:0/3571685390 >> v2:172.21.15.135:3300/0 conn(0x7f90d00b4e70 0x7f90d00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 -- 172.21.15.86:0/3571685390 >> 172.21.15.86:0/3571685390 conn(0x7f90d00d10c0 msgr2=0x7f90d00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:48.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 -- 172.21.15.86:0/3571685390 shutdown_connections 2023-10-09T11:53:48.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.900+0000 7f90d519d700 1 -- 172.21.15.86:0/3571685390 wait complete. 2023-10-09T11:53:48.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.901+0000 7f90d519d700 1 Processor -- start 2023-10-09T11:53:48.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.901+0000 7f90d519d700 1 -- start start 2023-10-09T11:53:48.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.902+0000 7f90d519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90d00b16d0 0x7f90d00c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.902+0000 7f90d519d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d00c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.902+0000 7f90d519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d00b4e70 0x7f90d0169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.902+0000 7f90d519d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00c7070 con 0x7f90d00b1b40 2023-10-09T11:53:48.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.902+0000 7f90d519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d016ae10 con 0x7f90d00b4e70 2023-10-09T11:53:48.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.902+0000 7f90d519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00c6ab0 con 0x7f90d00b16d0 2023-10-09T11:53:48.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d00c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90d00b16d0 0x7f90d00c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d00c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36952/0 (socket says 172.21.15.86:36952) 2023-10-09T11:53:48.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 -- 172.21.15.86:0/3486282816 learned_addr learned my addr 172.21.15.86:0/3486282816 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:48.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90d499c700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d00b4e70 0x7f90d0169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:48.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 -- 172.21.15.86:0/3486282816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90d00b16d0 msgr2=0x7f90d00c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90d00b16d0 0x7f90d00c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 -- 172.21.15.86:0/3486282816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d00b4e70 msgr2=0x7f90d0169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:48.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d00b4e70 0x7f90d0169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:48.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 -- 172.21.15.86:0/3486282816 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8009ae0 con 0x7f90d00b1b40 2023-10-09T11:53:48.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.903+0000 7f90cf7fe700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d00c6290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f90c400c590 tx=0x7f90c400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:48.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.904+0000 7f90b7fff700 1 -- 172.21.15.86:0/3486282816 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4011590 con 0x7f90d00b1b40 2023-10-09T11:53:48.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.904+0000 7f90b7fff700 1 -- 172.21.15.86:0/3486282816 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4011710 con 0x7f90d00b1b40 2023-10-09T11:53:48.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.904+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d00c6d90 con 0x7f90d00b1b40 2023-10-09T11:53:48.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.904+0000 7f90b7fff700 1 -- 172.21.15.86:0/3486282816 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4011ad0 con 0x7f90d00b1b40 2023-10-09T11:53:48.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.904+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d00c67d0 con 0x7f90d00b1b40 2023-10-09T11:53:48.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.906+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d016b2f0 con 0x7f90d00b1b40 2023-10-09T11:53:48.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.907+0000 7f90b7fff700 1 -- 172.21.15.86:0/3486282816 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f90c401b3b0 con 0x7f90d00b1b40 2023-10-09T11:53:48.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.908+0000 7f90b7fff700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 0x7f90bc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:48.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.908+0000 7f90b7fff700 1 -- 172.21.15.86:0/3486282816 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f90c40840e0 con 0x7f90d00b1b40 2023-10-09T11:53:48.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.908+0000 7f90cffff700 1 -- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 msgr2=0x7f90bc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:48.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.908+0000 7f90cffff700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 0x7f90bc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:48.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:48.913+0000 7f90b7fff700 1 -- 172.21.15.86:0/3486282816 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90d016b2f0 con 0x7f90d00b1b40 2023-10-09T11:53:48.943 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:48.942+0000 7f7d2e689180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:53:48.964 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:48.962+0000 7fa011062180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:53:49.031 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:49.029+0000 7f7d2e689180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:53:49.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.109+0000 7f90cffff700 1 -- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 msgr2=0x7f90bc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:49.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.109+0000 7f90cffff700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 0x7f90bc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:49.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.126+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90d016b2f0 con 0x7f90d00b1b40 2023-10-09T11:53:49.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.127+0000 7f90b7fff700 1 -- 172.21.15.86:0/3486282816 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90d016b2f0 con 0x7f90d00b1b40 2023-10-09T11:53:49.128 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:53:49.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 msgr2=0x7f90bc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:49.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 0x7f90bc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 msgr2=0x7f90d00c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d00c6290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f90c400c590 tx=0x7f90c400c8a0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 shutdown_connections 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f90bc0670e0 0x7f90bc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d00b4e70 0x7f90d0169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90d00b16d0 0x7f90d00c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 --2- 172.21.15.86:0/3486282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d00b1b40 0x7f90d00c6290 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 >> 172.21.15.86:0/3486282816 conn(0x7f90d00d10c0 msgr2=0x7f90d00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 shutdown_connections 2023-10-09T11:53:49.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.129+0000 7f90d519d700 1 -- 172.21.15.86:0/3486282816 wait complete. 2023-10-09T11:53:49.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:53:49.187 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:49.186+0000 7fa011062180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:53:49.265 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:49.264+0000 7f7d2e689180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:53:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.336+0000 7fbf9b59e700 1 Processor -- start 2023-10-09T11:53:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.336+0000 7fbf9b59e700 1 -- start start 2023-10-09T11:53:49.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.337+0000 7fbf9b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf9c0b4e70 0x7fbf9c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.337+0000 7fbf9b59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbf9c0b16d0 0x7fbf9c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.337+0000 7fbf9b59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c0b2080 con 0x7fbf9c15d240 2023-10-09T11:53:49.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.337+0000 7fbf9b59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c0cfb00 con 0x7fbf9c0b16d0 2023-10-09T11:53:49.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.337+0000 7fbf9b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c0b5c40 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.337+0000 7fbf99d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbf9c0b16d0 0x7fbf9c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf99d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbf9c0b16d0 0x7fbf9c0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36966/0 (socket says 172.21.15.86:36966) 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf99d9b700 1 -- 172.21.15.86:0/2484438385 learned_addr learned my addr 172.21.15.86:0/2484438385 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf9a59c700 1 --2- 172.21.15.86:0/2484438385 >> v2:172.21.15.135:3300/0 conn(0x7fbf9c0b4e70 0x7fbf9c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf99d9b700 1 -- 172.21.15.86:0/2484438385 >> v2:172.21.15.135:3300/0 conn(0x7fbf9c0b4e70 msgr2=0x7fbf9c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf99d9b700 1 --2- 172.21.15.86:0/2484438385 >> v2:172.21.15.135:3300/0 conn(0x7fbf9c0b4e70 0x7fbf9c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf99d9b700 1 -- 172.21.15.86:0/2484438385 >> v1:172.21.15.135:6789/0 conn(0x7fbf9c15d240 legacy=0x7fbf9c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf99d9b700 1 -- 172.21.15.86:0/2484438385 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c0b5f20 con 0x7fbf9c0b16d0 2023-10-09T11:53:49.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf99d9b700 1 --2- 172.21.15.86:0/2484438385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c0b1b40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c064910 tx=0x7fbf90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b94cbec7d75606 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf9959a700 1 -- 172.21.15.86:0/2484438385 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90009e70 con 0x7fbf9c0b16d0 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf9959a700 1 -- 172.21.15.86:0/2484438385 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000b860 con 0x7fbf9c0b16d0 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.338+0000 7fbf9959a700 1 -- 172.21.15.86:0/2484438385 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000bc00 con 0x7fbf9c0b16d0 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 -- 172.21.15.86:0/2484438385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b16d0 msgr2=0x7fbf9c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/2484438385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c0b1b40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c064910 tx=0x7fbf90009250 comp rx=0 tx=0).stop 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 -- 172.21.15.86:0/2484438385 shutdown_connections 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/2484438385 >> v2:172.21.15.135:3300/0 conn(0x7fbf9c0b4e70 0x7fbf9c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/2484438385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c0b1b40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 -- 172.21.15.86:0/2484438385 >> 172.21.15.86:0/2484438385 conn(0x7fbf9c0d10c0 msgr2=0x7fbf9c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:49.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 -- 172.21.15.86:0/2484438385 shutdown_connections 2023-10-09T11:53:49.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.339+0000 7fbf9b59e700 1 -- 172.21.15.86:0/2484438385 wait complete. 2023-10-09T11:53:49.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.341+0000 7fbf9b59e700 1 Processor -- start 2023-10-09T11:53:49.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.341+0000 7fbf9b59e700 1 -- start start 2023-10-09T11:53:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b4e70 0x7fbf9c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9c15d240 0x7fbf9c15cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c6280 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c14b690 con 0x7fbf9c0b16d0 2023-10-09T11:53:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c15c1c0 con 0x7fbf9c15d240 2023-10-09T11:53:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b4e70 0x7fbf9c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b4e70 0x7fbf9c15c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36978/0 (socket says 172.21.15.86:36978) 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 -- 172.21.15.86:0/225092892 learned_addr learned my addr 172.21.15.86:0/225092892 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9a59c700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9ad9d700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9c15d240 0x7fbf9c15cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 -- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9c15d240 msgr2=0x7fbf9c15cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9c15d240 0x7fbf9c15cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 -- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9c0b16d0 msgr2=0x7fbf9c14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c14b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf99d9b700 1 -- 172.21.15.86:0/225092892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900094f0 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.342+0000 7fbf9a59c700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.343+0000 7fbf99d9b700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b4e70 0x7fbf9c15c650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbf90006fd0 tx=0x7fbf90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.343+0000 7fbf8a7fc700 1 -- 172.21.15.86:0/225092892 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90011420 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.343+0000 7fbf8a7fc700 1 -- 172.21.15.86:0/225092892 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90011580 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.343+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c15b5b0 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.343+0000 7fbf8a7fc700 1 -- 172.21.15.86:0/225092892 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90011940 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.343+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c15bbf0 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.344+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c15bf70 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.346+0000 7fbf8a7fc700 1 -- 172.21.15.86:0/225092892 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fbf9002c3b0 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.347+0000 7fbf8a7fc700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 0x7fbf7c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.347+0000 7fbf9a59c700 1 -- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 msgr2=0x7fbf7c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.347+0000 7fbf8a7fc700 1 -- 172.21.15.86:0/225092892 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6831+0+0 (secure 0 0 0) 0x7fbf90086360 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.347+0000 7fbf9a59c700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 0x7fbf7c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:49.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.352+0000 7fbf8a7fc700 1 -- 172.21.15.86:0/225092892 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf90052ed0 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.365 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:49.364+0000 7fa011062180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:53:49.452 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:49.451+0000 7f7d2e689180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:53:49.458 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:49.456+0000 7fa011062180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:53:49.547 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:49.546+0000 7f7d2e689180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:53:49.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.548+0000 7fbf9a59c700 1 -- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 msgr2=0x7fbf7c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:49.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.548+0000 7fbf9a59c700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 0x7fbf7c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:49.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.555+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf9c15c300 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.555+0000 7fbf8a7fc700 1 -- 172.21.15.86:0/225092892 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf900564f0 con 0x7fbf9c0b4e70 2023-10-09T11:53:49.556 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:53:49.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 msgr2=0x7fbf7c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 0x7fbf7c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b4e70 msgr2=0x7fbf9c15c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b4e70 0x7fbf9c15c650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbf90006fd0 tx=0x7fbf90017000 comp rx=0 tx=0).stop 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 shutdown_connections 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fbf7c0670e0 0x7fbf7c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf9c15d240 0x7fbf9c15cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf9c0b16d0 0x7fbf9c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 --2- 172.21.15.86:0/225092892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9c0b4e70 0x7fbf9c15c650 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 >> 172.21.15.86:0/225092892 conn(0x7fbf9c0d10c0 msgr2=0x7fbf9c158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 shutdown_connections 2023-10-09T11:53:49.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.558+0000 7fbf9b59e700 1 -- 172.21.15.86:0/225092892 wait complete. 2023-10-09T11:53:49.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:53:49.622 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:49.620+0000 7fa011062180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:53:49.716 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:49.715+0000 7f7d2e689180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:53:49.722 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:49.721+0000 7fa011062180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:53:49.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.767+0000 7fede699d700 1 Processor -- start 2023-10-09T11:53:49.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.767+0000 7fede699d700 1 -- start start 2023-10-09T11:53:49.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.768+0000 7fede699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 0x7fede00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.768+0000 7fede699d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede00cfb00 con 0x7fede00b16d0 2023-10-09T11:53:49.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.768+0000 7fede699d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede00b5c40 con 0x7fede00b4e70 2023-10-09T11:53:49.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.768+0000 7fede699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede00b5f20 con 0x7fede00b1b40 2023-10-09T11:53:49.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede519a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fede00b16d0 0x7fede00b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56312/0 (socket says 172.21.15.86:56312) 2023-10-09T11:53:49.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede519a700 1 -- 172.21.15.86:0/1221623896 learned_addr learned my addr 172.21.15.86:0/1221623896 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:49.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede619c700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 0x7fede00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272476414 0 0) 0x7fede00cfb00 con 0x7fede00b16d0 2023-10-09T11:53:49.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedcc003570 con 0x7fede00b16d0 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722317148 0 0) 0x7fede00b5c40 con 0x7fede00b4e70 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede00cfb00 con 0x7fede00b4e70 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 954549026 0 0) 0x7fedcc003570 con 0x7fede00b16d0 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 msgr2=0x7fede00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 0x7fede00b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 >> v1:172.21.15.135:6789/0 conn(0x7fede00b4e70 legacy=0x7fede00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00b6200 con 0x7fede00b16d0 2023-10-09T11:53:49.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.769+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fedd0001470 con 0x7fede00b16d0 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 >> v1:172.21.15.86:6789/0 conn(0x7fede00b16d0 legacy=0x7fede00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede4999700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fedcc005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede4999700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 0x7fedcc0037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede4999700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc003cf0 0x7fedcc004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00b5f20 con 0x7fedcc004c80 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc00bbf0 con 0x7fedcc003cf0 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc00bdb0 con 0x7fede00b1b40 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede599b700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fedcc005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede519a700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 0x7fedcc0037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede619c700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc003cf0 0x7fedcc004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede599b700 1 -- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 msgr2=0x7fedcc0037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede599b700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 0x7fedcc0037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede599b700 1 -- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc003cf0 msgr2=0x7fedcc004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede599b700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedcc003cf0 0x7fedcc004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede599b700 1 -- 172.21.15.86:0/1221623896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc003570 con 0x7fedcc004c80 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.770+0000 7fede519a700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede00b1b40 0x7fedcc0037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.771+0000 7fede599b700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fedcc005070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7feddc001a50 tx=0x7feddc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199f7d68854715a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.771+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00c5d0 con 0x7fedcc004c80 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.771+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc00c730 con 0x7fedcc004c80 2023-10-09T11:53:49.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.771+0000 7fede4999700 1 -- 172.21.15.86:0/1221623896 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00cad0 con 0x7fedcc004c80 2023-10-09T11:53:49.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.771+0000 7fede699d700 1 -- 172.21.15.86:0/1221623896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 msgr2=0x7fedcc005070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.771+0000 7fede699d700 1 --2- 172.21.15.86:0/1221623896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fedcc005070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7feddc001a50 tx=0x7feddc007d30 comp rx=0 tx=0).stop 2023-10-09T11:53:49.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.771+0000 7fede619c700 1 -- 172.21.15.86:0/1221623896 reap_dead start 2023-10-09T11:53:49.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.772+0000 7fede699d700 1 -- 172.21.15.86:0/1221623896 shutdown_connections 2023-10-09T11:53:49.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.772+0000 7fede699d700 1 -- 172.21.15.86:0/1221623896 >> 172.21.15.86:0/1221623896 conn(0x7fede00d10c0 msgr2=0x7fede00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:49.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.772+0000 7fede699d700 1 -- 172.21.15.86:0/1221623896 shutdown_connections 2023-10-09T11:53:49.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.772+0000 7fede699d700 1 -- 172.21.15.86:0/1221623896 wait complete. 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.773+0000 7fede699d700 1 Processor -- start 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.773+0000 7fede699d700 1 -- start start 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede699d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fede0149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede699d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede016a5e0 0x7fede015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede015abd0 0x7fede015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede699d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede016a150 con 0x7fedcc004c80 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede699d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede015b200 con 0x7fede016a5e0 2023-10-09T11:53:49.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede015b4e0 con 0x7fede015abd0 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede599b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fede0149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede599b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fede0149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37004/0 (socket says 172.21.15.86:37004) 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.774+0000 7fede599b700 1 -- 172.21.15.86:0/2682195287 learned_addr learned my addr 172.21.15.86:0/2682195287 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede519a700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede016a5e0 0x7fede015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede619c700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede015abd0 0x7fede015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede599b700 1 -- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede015abd0 msgr2=0x7fede015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede599b700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede015abd0 0x7fede015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede599b700 1 -- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede016a5e0 msgr2=0x7fede015a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede599b700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede016a5e0 0x7fede015a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede599b700 1 -- 172.21.15.86:0/2682195287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0169de0 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede599b700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fede0149140 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feddc001ed0 tx=0x7feddc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fedd5ffb700 1 -- 172.21.15.86:0/2682195287 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc023070 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fedd5ffb700 1 -- 172.21.15.86:0/2682195287 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc00cab0 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fedd5ffb700 1 -- 172.21.15.86:0/2682195287 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00c5d0 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede01561e0 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.775+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede016aa50 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.777+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede015afd0 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.777+0000 7fedd5ffb700 1 -- 172.21.15.86:0/2682195287 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7feddc019070 con 0x7fedcc004c80 2023-10-09T11:53:49.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.778+0000 7fedd5ffb700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 0x7fedc4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:49.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.778+0000 7fedd5ffb700 1 -- 172.21.15.86:0/2682195287 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6831+0+0 (secure 0 0 0) 0x7feddc085b90 con 0x7fedcc004c80 2023-10-09T11:53:49.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.778+0000 7fede519a700 1 -- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 msgr2=0x7fedc4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:49.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.778+0000 7fede519a700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 0x7fedc4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:49.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.785+0000 7fedd5ffb700 1 -- 172.21.15.86:0/2682195287 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feddc052720 con 0x7fedcc004c80 2023-10-09T11:53:49.824 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:49.823+0000 7f7d2e689180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:53:49.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.979+0000 7fede519a700 1 -- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 msgr2=0x7fedc4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:49.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.979+0000 7fede519a700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 0x7fedc4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.984+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fede016a430 con 0x7fedcc004c80 2023-10-09T11:53:49.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.985+0000 7fedd5ffb700 1 -- 172.21.15.86:0/2682195287 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7feddc017030 con 0x7fedcc004c80 2023-10-09T11:53:49.986 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:53:49.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 msgr2=0x7fedc4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 0x7fedc4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 msgr2=0x7fede0149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fede0149140 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feddc001ed0 tx=0x7feddc015000 comp rx=0 tx=0).stop 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 shutdown_connections 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fedc40670e0 0x7fedc4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedcc004c80 0x7fede0149140 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fede015abd0 0x7fede015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 --2- 172.21.15.86:0/2682195287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede016a5e0 0x7fede015a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 >> 172.21.15.86:0/2682195287 conn(0x7fede00d10c0 msgr2=0x7fede0069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:49.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 shutdown_connections 2023-10-09T11:53:49.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:49.987+0000 7fede699d700 1 -- 172.21.15.86:0/2682195287 wait complete. 2023-10-09T11:53:50.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:53:50.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.198+0000 7fdc0c9fe700 1 Processor -- start 2023-10-09T11:53:50.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.199+0000 7fdc0c9fe700 1 -- start start 2023-10-09T11:53:50.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0c9fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc08156310 0x7fdc080c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0c9fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdc081566e0 0x7fdc080ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0c9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc080ca300 0x7fdc080ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0c9fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc080ca860 con 0x7fdc08156310 2023-10-09T11:53:50.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0c9fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc080cab40 con 0x7fdc081566e0 2023-10-09T11:53:50.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0c9fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080cae20 con 0x7fdc080ca300 2023-10-09T11:53:50.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc06d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc08156310 0x7fdc080c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc06d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc08156310 0x7fdc080c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37020/0 (socket says 172.21.15.86:37020) 2023-10-09T11:53:50.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc06d9d700 1 -- 172.21.15.86:0/784169461 learned_addr learned my addr 172.21.15.86:0/784169461 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0759e700 1 --2- 172.21.15.86:0/784169461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc080ca300 0x7fdc080ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.200+0000 7fdc0659c700 1 --2- 172.21.15.86:0/784169461 >> v2:172.21.15.135:3300/0 conn(0x7fdc081566e0 0x7fdc080ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc06d9d700 1 -- 172.21.15.86:0/784169461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc080ca300 msgr2=0x7fdc080ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc06d9d700 1 --2- 172.21.15.86:0/784169461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc080ca300 0x7fdc080ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc06d9d700 1 -- 172.21.15.86:0/784169461 >> v2:172.21.15.135:3300/0 conn(0x7fdc081566e0 msgr2=0x7fdc080ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc06d9d700 1 --2- 172.21.15.86:0/784169461 >> v2:172.21.15.135:3300/0 conn(0x7fdc081566e0 0x7fdc080ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc06d9d700 1 -- 172.21.15.86:0/784169461 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080cb100 con 0x7fdc08156310 2023-10-09T11:53:50.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc0759e700 1 --2- 172.21.15.86:0/784169461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc080ca300 0x7fdc080ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:50.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc0659c700 1 --2- 172.21.15.86:0/784169461 >> v2:172.21.15.135:3300/0 conn(0x7fdc081566e0 0x7fdc080ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:50.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc06d9d700 1 --2- 172.21.15.86:0/784169461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc080c9dc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdc0806c000 tx=0x7fdbf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f12c5ef96b768e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:50.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc05d9b700 1 -- 172.21.15.86:0/784169461 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800b860 con 0x7fdc08156310 2023-10-09T11:53:50.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc05d9b700 1 -- 172.21.15.86:0/784169461 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800b9c0 con 0x7fdc08156310 2023-10-09T11:53:50.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.201+0000 7fdc05d9b700 1 -- 172.21.15.86:0/784169461 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800bd60 con 0x7fdc08156310 2023-10-09T11:53:50.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/784169461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 msgr2=0x7fdc080c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/784169461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc080c9dc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdc0806c000 tx=0x7fdbf8009250 comp rx=0 tx=0).stop 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/784169461 shutdown_connections 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/784169461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc080ca300 0x7fdc080ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/784169461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc080c9dc0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/784169461 >> v2:172.21.15.135:3300/0 conn(0x7fdc081566e0 0x7fdc080ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/784169461 >> 172.21.15.86:0/784169461 conn(0x7fdc080cc1f0 msgr2=0x7fdc080cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/784169461 shutdown_connections 2023-10-09T11:53:50.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.202+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/784169461 wait complete. 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.203+0000 7fdc0c9fe700 1 Processor -- start 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.203+0000 7fdc0c9fe700 1 -- start start 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.204+0000 7fdc0c9fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc080ca300 0x7fdc08144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.204+0000 7fdc0c9fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc0814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.204+0000 7fdc0c9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc081566e0 0x7fdc0814aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.204+0000 7fdc0c9fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc08144fb0 con 0x7fdc08156310 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.204+0000 7fdc0c9fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc08149970 con 0x7fdc080ca300 2023-10-09T11:53:50.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.204+0000 7fdc0c9fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc08149c50 con 0x7fdc081566e0 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc0814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc0814cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37034/0 (socket says 172.21.15.86:37034) 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 -- 172.21.15.86:0/3031261979 learned_addr learned my addr 172.21.15.86:0/3031261979 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc06d9d700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc080ca300 0x7fdc08144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0759e700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc081566e0 0x7fdc0814aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 -- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc081566e0 msgr2=0x7fdc0814aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc081566e0 0x7fdc0814aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 -- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc080ca300 msgr2=0x7fdc08144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc080ca300 0x7fdc08144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 -- 172.21.15.86:0/3031261979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf80094f0 con 0x7fdc08156310 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.205+0000 7fdc0659c700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc0814cba0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e870 tx=0x7fdbfc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.206+0000 7fdbeeffd700 1 -- 172.21.15.86:0/3031261979 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc013410 con 0x7fdc08156310 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.206+0000 7fdbeeffd700 1 -- 172.21.15.86:0/3031261979 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc013570 con 0x7fdc08156310 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.206+0000 7fdbeeffd700 1 -- 172.21.15.86:0/3031261979 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc013930 con 0x7fdc08156310 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.206+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc08149f30 con 0x7fdc08156310 2023-10-09T11:53:50.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.206+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0814a4f0 con 0x7fdc08156310 2023-10-09T11:53:50.212 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:50.206+0000 7fa011062180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:53:50.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.207+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0814a6b0 con 0x7fdc08156310 2023-10-09T11:53:50.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.208+0000 7fdbeeffd700 1 -- 172.21.15.86:0/3031261979 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fdbfc013ca0 con 0x7fdc08156310 2023-10-09T11:53:50.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.209+0000 7fdbeeffd700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 0x7fdbf4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.210+0000 7fdbeeffd700 1 -- 172.21.15.86:0/3031261979 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6831+0+0 (secure 0 0 0) 0x7fdbfc084ac0 con 0x7fdc08156310 2023-10-09T11:53:50.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.210+0000 7fdc06d9d700 1 -- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 msgr2=0x7fdbf4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:50.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.210+0000 7fdc06d9d700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 0x7fdbf4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:50.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.214+0000 7fdbeeffd700 1 -- 172.21.15.86:0/3031261979 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbfc051540 con 0x7fdc08156310 2023-10-09T11:53:50.302 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:50.301+0000 7fa011062180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:53:50.333 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:50.332+0000 7f7d2e689180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:53:50.392 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:50.391+0000 7fa011062180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:53:50.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.411+0000 7fdc06d9d700 1 -- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 msgr2=0x7fdbf4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:50.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.411+0000 7fdc06d9d700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 0x7fdbf4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:50.435 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:50.434+0000 7f7d2e689180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:53:50.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.462+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc0804c3c0 con 0x7fdc08156310 2023-10-09T11:53:50.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.463+0000 7fdbeeffd700 1 -- 172.21.15.86:0/3031261979 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fdbfc054b60 con 0x7fdc08156310 2023-10-09T11:53:50.464 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:50.464 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1552998028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1552998028},{"type":"v1","addr":"172.21.15.135:6834","nonce":1552998028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3861152933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3861152933},{"type":"v1","addr":"172.21.15.135:6835","nonce":3861152933}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4887,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/647611791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":647611791},{"type":"v1","addr":"172.21.15.86:6836","nonce":647611791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:07.793130+0000","modified":"2023-10-09T11:42:11.321775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6837/1725825433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1725825433},{"type":"v1","addr":"172.21.15.86:6837","nonce":1725825433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:53:50.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 msgr2=0x7fdbf4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:50.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 0x7fdbf4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 msgr2=0x7fdc0814cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc0814cba0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e870 tx=0x7fdbfc008040 comp rx=0 tx=0).stop 2023-10-09T11:53:50.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 shutdown_connections 2023-10-09T11:53:50.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fdbf40670e0 0x7fdbf4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc081566e0 0x7fdc0814aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc080ca300 0x7fdc08144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 --2- 172.21.15.86:0/3031261979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc08156310 0x7fdc0814cba0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.465+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 >> 172.21.15.86:0/3031261979 conn(0x7fdc080cc1f0 msgr2=0x7fdc080c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:50.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.466+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 shutdown_connections 2023-10-09T11:53:50.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.466+0000 7fdc0c9fe700 1 -- 172.21.15.86:0/3031261979 wait complete. 2023-10-09T11:53:50.468 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2023-10-09T11:53:50.485 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:53:50.533 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:50.532+0000 7f7d2e689180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:53:50.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.671+0000 7fc2d7fff700 1 Processor -- start 2023-10-09T11:53:50.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.671+0000 7fc2d7fff700 1 -- start start 2023-10-09T11:53:50.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.672+0000 7fc2d7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc2d8150550 0x7fc2d8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.672+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d80c7410 0x7fc2d8069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.672+0000 7fc2d7fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d806e2a0 con 0x7fc2d8150180 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.672+0000 7fc2d7fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d806b2e0 con 0x7fc2d8150550 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.672+0000 7fc2d7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80c78e0 con 0x7fc2d80c7410 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.672+0000 7fc2d6ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc2d8150180 0x7fc2d80c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56320/0 (socket says 172.21.15.86:56320) 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d6ffd700 1 -- 172.21.15.86:0/3412240828 learned_addr learned my addr 172.21.15.86:0/3412240828 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d77fe700 1 --2- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d80c7410 0x7fc2d8069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d67fc700 1 --2- 172.21.15.86:0/3412240828 >> v2:172.21.15.135:3300/0 conn(0x7fc2d8150550 0x7fc2d8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d5ffb700 1 -- 172.21.15.86:0/3412240828 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940837448 0 0) 0x7fc2d806e2a0 con 0x7fc2d8150180 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d5ffb700 1 -- 172.21.15.86:0/3412240828 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2c0003570 con 0x7fc2d8150180 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d67fc700 1 -- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d80c7410 msgr2=0x7fc2d8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:50.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d67fc700 1 --2- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d80c7410 0x7fc2d8069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d67fc700 1 -- 172.21.15.86:0/3412240828 >> v1:172.21.15.86:6789/0 conn(0x7fc2d8150180 legacy=0x7fc2d80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d67fc700 1 -- 172.21.15.86:0/3412240828 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80c7bc0 con 0x7fc2d8150550 2023-10-09T11:53:50.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.673+0000 7fc2d77fe700 1 --2- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d80c7410 0x7fc2d8069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:50.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.674+0000 7fc2d67fc700 1 --2- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150550 0x7fc2d8157770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00dd10 tx=0x7fc2cc00d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7970ecd5e4abd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:50.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.674+0000 7fc2d5ffb700 1 -- 172.21.15.86:0/3412240828 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc012070 con 0x7fc2d8150550 2023-10-09T11:53:50.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.674+0000 7fc2d5ffb700 1 -- 172.21.15.86:0/3412240828 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc00de70 con 0x7fc2d8150550 2023-10-09T11:53:50.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.674+0000 7fc2d5ffb700 1 -- 172.21.15.86:0/3412240828 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00fab0 con 0x7fc2d8150550 2023-10-09T11:53:50.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.674+0000 7fc2d7fff700 1 -- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150550 msgr2=0x7fc2d8157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.674+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150550 0x7fc2d8157770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00dd10 tx=0x7fc2cc00d630 comp rx=0 tx=0).stop 2023-10-09T11:53:50.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.675+0000 7fc2d7fff700 1 -- 172.21.15.86:0/3412240828 shutdown_connections 2023-10-09T11:53:50.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.675+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d80c7410 0x7fc2d8069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.675+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/3412240828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150550 0x7fc2d8157770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.675+0000 7fc2d7fff700 1 -- 172.21.15.86:0/3412240828 >> 172.21.15.86:0/3412240828 conn(0x7fc2d80cc1f0 msgr2=0x7fc2d80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:50.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.675+0000 7fc2d7fff700 1 -- 172.21.15.86:0/3412240828 shutdown_connections 2023-10-09T11:53:50.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.675+0000 7fc2d7fff700 1 -- 172.21.15.86:0/3412240828 wait complete. 2023-10-09T11:53:50.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.676+0000 7fc2d7fff700 1 Processor -- start 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.676+0000 7fc2d7fff700 1 -- start start 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2d80c7410 0x7fc2d80b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150180 0x7fc2d814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d8150550 0x7fc2d80abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d7fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80c5b10 con 0x7fc2d80c7410 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80c5df0 con 0x7fc2d8150180 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80c60d0 con 0x7fc2d8150550 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2d80c7410 0x7fc2d80b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2d80c7410 0x7fc2d80b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37038/0 (socket says 172.21.15.86:37038) 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d6ffd700 1 -- 172.21.15.86:0/1485916386 learned_addr learned my addr 172.21.15.86:0/1485916386 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.677+0000 7fc2d67fc700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150180 0x7fc2d814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d77fe700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d8150550 0x7fc2d80abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d6ffd700 1 -- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d8150550 msgr2=0x7fc2d80abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d6ffd700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d8150550 0x7fc2d80abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d6ffd700 1 -- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150180 msgr2=0x7fc2d814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d6ffd700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150180 0x7fc2d814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d6ffd700 1 -- 172.21.15.86:0/1485916386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d000ba40 con 0x7fc2d80c7410 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d67fc700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150180 0x7fc2d814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d6ffd700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2d80c7410 0x7fc2d80b1800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c7c0 tx=0x7fc2c8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:50.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2beffd700 1 -- 172.21.15.86:0/1485916386 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8005cd0 con 0x7fc2d80c7410 2023-10-09T11:53:50.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2beffd700 1 -- 172.21.15.86:0/1485916386 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8005e30 con 0x7fc2d80c7410 2023-10-09T11:53:50.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2beffd700 1 -- 172.21.15.86:0/1485916386 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8007320 con 0x7fc2d80c7410 2023-10-09T11:53:50.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.678+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc00d8d0 con 0x7fc2d80c7410 2023-10-09T11:53:50.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.679+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d80af310 con 0x7fc2d80c7410 2023-10-09T11:53:50.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.680+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d804c3c0 con 0x7fc2d80c7410 2023-10-09T11:53:50.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.680+0000 7fc2beffd700 1 -- 172.21.15.86:0/1485916386 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fc2c801b3b0 con 0x7fc2d80c7410 2023-10-09T11:53:50.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.681+0000 7fc2beffd700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 0x7fc2c4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:50.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.682+0000 7fc2beffd700 1 -- 172.21.15.86:0/1485916386 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fc2c8084220 con 0x7fc2d80c7410 2023-10-09T11:53:50.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.682+0000 7fc2d67fc700 1 -- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 msgr2=0x7fc2c4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:50.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.682+0000 7fc2d67fc700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 0x7fc2c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:50.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.685+0000 7fc2beffd700 1 -- 172.21.15.86:0/1485916386 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2c8050ee0 con 0x7fc2d80c7410 2023-10-09T11:53:50.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.883+0000 7fc2d67fc700 1 -- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 msgr2=0x7fc2c4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:50.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.883+0000 7fc2d67fc700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 0x7fc2c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:50.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.885+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2d806ada0 con 0x7fc2d80c7410 2023-10-09T11:53:50.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.886+0000 7fc2beffd700 1 -- 172.21.15.86:0/1485916386 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16385 (secure 0 0 0) 0x7fc2c8054500 con 0x7fc2d80c7410 2023-10-09T11:53:50.888 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:50.888 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":50,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:53:50.384460+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:05.325678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:06.736222+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6833/85490":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2422899393":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/1379635191":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2164323904":"2023-10-10T11:42:23.645474+0000","172.21.15.86:6832/85490":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2564271480":"2023-10-10T11:42:23.645474+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:53:50.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 msgr2=0x7fc2c4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:50.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 0x7fc2c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2d80c7410 msgr2=0x7fc2d80b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:50.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2d80c7410 0x7fc2d80b1800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c7c0 tx=0x7fc2c8007e00 comp rx=0 tx=0).stop 2023-10-09T11:53:50.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 shutdown_connections 2023-10-09T11:53:50.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fc2c40670e0 0x7fc2c4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2d80c7410 0x7fc2d80b1800 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2d8150550 0x7fc2d80abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 --2- 172.21.15.86:0/1485916386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d8150180 0x7fc2d814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:50.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 >> 172.21.15.86:0/1485916386 conn(0x7fc2d80cc1f0 msgr2=0x7fc2d8156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:50.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 shutdown_connections 2023-10-09T11:53:50.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:50.889+0000 7fc2d7fff700 1 -- 172.21.15.86:0/1485916386 wait complete. 2023-10-09T11:53:50.908 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:53:50.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:53:51.019 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:51.018+0000 7fa011062180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:53:51.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.126+0000 7fd3b999d700 1 Processor -- start 2023-10-09T11:53:51.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.127+0000 7fd3b999d700 1 -- start start 2023-10-09T11:53:51.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.128+0000 7fd3b999d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3b4159510 0x7fd3b40ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.128+0000 7fd3b999d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b40a9c20 con 0x7fd3b41598e0 2023-10-09T11:53:51.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.128+0000 7fd3b999d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b4159d30 con 0x7fd3b406a3f0 2023-10-09T11:53:51.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.128+0000 7fd3b999d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b415e400 con 0x7fd3b4159510 2023-10-09T11:53:51.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.128+0000 7fd3b3fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd3b41598e0 0x7fd3b406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56322/0 (socket says 172.21.15.86:56322) 2023-10-09T11:53:51.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.128+0000 7fd3b3fff700 1 -- 172.21.15.86:0/2954409144 learned_addr learned my addr 172.21.15.86:0/2954409144 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:51.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.129+0000 7fd3b899b700 1 --2- 172.21.15.86:0/2954409144 >> v2:172.21.15.86:3300/0 conn(0x7fd3b4159510 0x7fd3b40ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.129+0000 7fd3b37fe700 1 -- 172.21.15.86:0/2954409144 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182935966 0 0) 0x7fd3b40a9c20 con 0x7fd3b41598e0 2023-10-09T11:53:51.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.129+0000 7fd3b37fe700 1 -- 172.21.15.86:0/2954409144 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a0003570 con 0x7fd3b41598e0 2023-10-09T11:53:51.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.129+0000 7fd3b899b700 1 -- 172.21.15.86:0/2954409144 >> v1:172.21.15.135:6789/0 conn(0x7fd3b406a3f0 legacy=0x7fd3b406a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.129+0000 7fd3b37fe700 1 -- 172.21.15.86:0/2954409144 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379299349 0 0) 0x7fd3a4001110 con 0x7fd3b406a3f0 2023-10-09T11:53:51.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.129+0000 7fd3b899b700 1 -- 172.21.15.86:0/2954409144 >> v1:172.21.15.86:6789/0 conn(0x7fd3b41598e0 legacy=0x7fd3b406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.129+0000 7fd3b899b700 1 -- 172.21.15.86:0/2954409144 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b40696c0 con 0x7fd3b4159510 2023-10-09T11:53:51.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.130+0000 7fd3b899b700 1 --2- 172.21.15.86:0/2954409144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b4159510 0x7fd3b40ca660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009e60 tx=0x7fd3ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ab6e64f50d02fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:51.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.130+0000 7fd3b37fe700 1 -- 172.21.15.86:0/2954409144 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00e070 con 0x7fd3b4159510 2023-10-09T11:53:51.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.130+0000 7fd3b37fe700 1 -- 172.21.15.86:0/2954409144 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00b8e0 con 0x7fd3b4159510 2023-10-09T11:53:51.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.130+0000 7fd3b37fe700 1 -- 172.21.15.86:0/2954409144 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c001470 con 0x7fd3b4159510 2023-10-09T11:53:51.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.130+0000 7fd3b999d700 1 -- 172.21.15.86:0/2954409144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b4159510 msgr2=0x7fd3b40ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.130+0000 7fd3b999d700 1 --2- 172.21.15.86:0/2954409144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b4159510 0x7fd3b40ca660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009e60 tx=0x7fd3ac009780 comp rx=0 tx=0).stop 2023-10-09T11:53:51.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.131+0000 7fd3b999d700 1 -- 172.21.15.86:0/2954409144 shutdown_connections 2023-10-09T11:53:51.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.131+0000 7fd3b999d700 1 --2- 172.21.15.86:0/2954409144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b4159510 0x7fd3b40ca660 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.131+0000 7fd3b999d700 1 -- 172.21.15.86:0/2954409144 >> 172.21.15.86:0/2954409144 conn(0x7fd3b40cc1f0 msgr2=0x7fd3b40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:51.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.131+0000 7fd3b999d700 1 -- 172.21.15.86:0/2954409144 shutdown_connections 2023-10-09T11:53:51.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.131+0000 7fd3b999d700 1 -- 172.21.15.86:0/2954409144 wait complete. 2023-10-09T11:53:51.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.132+0000 7fd3b999d700 1 Processor -- start 2023-10-09T11:53:51.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.133+0000 7fd3b999d700 1 -- start start 2023-10-09T11:53:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.133+0000 7fd3b999d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b406a3f0 0x7fd3b416cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b999d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3b4159510 0x7fd3b40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b999d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3b41598e0 0x7fd3b4156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b999d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4153650 con 0x7fd3b406a3f0 2023-10-09T11:53:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b999d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b40c33d0 con 0x7fd3b4159510 2023-10-09T11:53:51.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b999d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b40c36b0 con 0x7fd3b41598e0 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b406a3f0 0x7fd3b416cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b406a3f0 0x7fd3b416cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37050/0 (socket says 172.21.15.86:37050) 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 -- 172.21.15.86:0/3466984341 learned_addr learned my addr 172.21.15.86:0/3466984341 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b3fff700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3b4159510 0x7fd3b40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b919c700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3b41598e0 0x7fd3b4156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 -- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3b41598e0 msgr2=0x7fd3b4156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3b41598e0 0x7fd3b4156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 -- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3b4159510 msgr2=0x7fd3b40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3b4159510 0x7fd3b40b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.134+0000 7fd3b899b700 1 -- 172.21.15.86:0/3466984341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009a20 con 0x7fd3b406a3f0 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.135+0000 7fd3b899b700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b406a3f0 0x7fd3b416cc10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0097c0 tx=0x7fd3ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.135+0000 7fd3b0ff9700 1 -- 172.21.15.86:0/3466984341 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac026bb0 con 0x7fd3b406a3f0 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.135+0000 7fd3b0ff9700 1 -- 172.21.15.86:0/3466984341 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac026d30 con 0x7fd3b406a3f0 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.135+0000 7fd3b0ff9700 1 -- 172.21.15.86:0/3466984341 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac02f420 con 0x7fd3b406a3f0 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.135+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b40c3990 con 0x7fd3b406a3f0 2023-10-09T11:53:51.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.135+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b40c3f50 con 0x7fd3b406a3f0 2023-10-09T11:53:51.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.136+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b40c4140 con 0x7fd3b406a3f0 2023-10-09T11:53:51.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.137+0000 7fd3b0ff9700 1 -- 172.21.15.86:0/3466984341 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fd3ac02c020 con 0x7fd3b406a3f0 2023-10-09T11:53:51.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.138+0000 7fd3b0ff9700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 0x7fd394069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.138+0000 7fd3b0ff9700 1 -- 172.21.15.86:0/3466984341 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fd3ac08efe0 con 0x7fd3b406a3f0 2023-10-09T11:53:51.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.138+0000 7fd3b3fff700 1 -- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 msgr2=0x7fd394069660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:51.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.138+0000 7fd3b3fff700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 0x7fd394069660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:51.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.142+0000 7fd3b0ff9700 1 -- 172.21.15.86:0/3466984341 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3ac05bd20 con 0x7fd3b406a3f0 2023-10-09T11:53:51.187 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:51.186+0000 7f7d2e689180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:53:51.190 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:51.189+0000 7fa011062180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:53:51.285 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:51.284+0000 7fa011062180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:53:51.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.339+0000 7fd3b3fff700 1 -- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 msgr2=0x7fd394069660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:51.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.339+0000 7fd3b3fff700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 0x7fd394069660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:51.364 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:51.363+0000 7f7d2e689180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:53:51.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.385+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3b404c3c0 con 0x7fd3b406a3f0 2023-10-09T11:53:51.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.385+0000 7fd3b0ff9700 1 -- 172.21.15.86:0/3466984341 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fd3ac05f340 con 0x7fd3b406a3f0 2023-10-09T11:53:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:51.387 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1552998028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1552998028},{"type":"v1","addr":"172.21.15.135:6834","nonce":1552998028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3861152933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3861152933},{"type":"v1","addr":"172.21.15.135:6835","nonce":3861152933}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4887,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/647611791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":647611791},{"type":"v1","addr":"172.21.15.86:6836","nonce":647611791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:07.793130+0000","modified":"2023-10-09T11:42:11.321775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6837/1725825433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1725825433},{"type":"v1","addr":"172.21.15.86:6837","nonce":1725825433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:53:51.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 msgr2=0x7fd394069660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:51.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 0x7fd394069660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b406a3f0 msgr2=0x7fd3b416cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b406a3f0 0x7fd3b416cc10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0097c0 tx=0x7fd3ac017000 comp rx=0 tx=0).stop 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 shutdown_connections 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fd3940671b0 0x7fd394069660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b406a3f0 0x7fd3b416cc10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3b41598e0 0x7fd3b4156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 --2- 172.21.15.86:0/3466984341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3b4159510 0x7fd3b40b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 >> 172.21.15.86:0/3466984341 conn(0x7fd3b40cc1f0 msgr2=0x7fd3b40c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 shutdown_connections 2023-10-09T11:53:51.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.388+0000 7fd3b999d700 1 -- 172.21.15.86:0/3466984341 wait complete. 2023-10-09T11:53:51.391 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2023-10-09T11:53:51.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:53:51.471 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:51.470+0000 7f7d2e689180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:53:51.580 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:51.579+0000 7fa011062180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:53:51.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.601+0000 7fcda65ff700 1 Processor -- start 2023-10-09T11:53:51.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.601+0000 7fcda65ff700 1 -- start start 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.602+0000 7fcda65ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcda0159c60 0x7fcda015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.602+0000 7fcda65ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.602+0000 7fcda65ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda015a160 con 0x7fcda0159890 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.602+0000 7fcda65ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda015df50 con 0x7fcda0159c60 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.602+0000 7fcda65ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00d13a0 con 0x7fcda015db10 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcda0159890 0x7fcda015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56326/0 (socket says 172.21.15.86:56326) 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9ffff700 1 -- 172.21.15.86:0/4213920513 learned_addr learned my addr 172.21.15.86:0/4213920513 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9f7fe700 1 --2- 172.21.15.86:0/4213920513 >> v2:172.21.15.86:3300/0 conn(0x7fcda0159c60 0x7fcda015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcda4b9c700 1 --2- 172.21.15.86:0/4213920513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9f7fe700 1 -- 172.21.15.86:0/4213920513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 msgr2=0x7fcda0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9f7fe700 1 --2- 172.21.15.86:0/4213920513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9f7fe700 1 -- 172.21.15.86:0/4213920513 >> v1:172.21.15.86:6789/0 conn(0x7fcda0159890 legacy=0x7fcda015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9f7fe700 1 -- 172.21.15.86:0/4213920513 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda015e140 con 0x7fcda0159c60 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcda4b9c700 1 --2- 172.21.15.86:0/4213920513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.603+0000 7fcd9f7fe700 1 --2- 172.21.15.86:0/4213920513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda015d5d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcd940098e0 tx=0x7fcd940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5aa6095f2b01904 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.604+0000 7fcd9effd700 1 -- 172.21.15.86:0/4213920513 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94009e80 con 0x7fcda0159c60 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.604+0000 7fcd9effd700 1 -- 172.21.15.86:0/4213920513 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400b860 con 0x7fcda0159c60 2023-10-09T11:53:51.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.604+0000 7fcd9effd700 1 -- 172.21.15.86:0/4213920513 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400bbe0 con 0x7fcda0159c60 2023-10-09T11:53:51.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.604+0000 7fcda65ff700 1 -- 172.21.15.86:0/4213920513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 msgr2=0x7fcda015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.604+0000 7fcda65ff700 1 --2- 172.21.15.86:0/4213920513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda015d5d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcd940098e0 tx=0x7fcd940091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.605+0000 7fcda65ff700 1 -- 172.21.15.86:0/4213920513 shutdown_connections 2023-10-09T11:53:51.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.605+0000 7fcda65ff700 1 --2- 172.21.15.86:0/4213920513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.605+0000 7fcda65ff700 1 --2- 172.21.15.86:0/4213920513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda015d5d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.605+0000 7fcda65ff700 1 -- 172.21.15.86:0/4213920513 >> 172.21.15.86:0/4213920513 conn(0x7fcda0068e20 msgr2=0x7fcda00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:51.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.605+0000 7fcda65ff700 1 -- 172.21.15.86:0/4213920513 shutdown_connections 2023-10-09T11:53:51.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.605+0000 7fcda65ff700 1 -- 172.21.15.86:0/4213920513 wait complete. 2023-10-09T11:53:51.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.606+0000 7fcda65ff700 1 Processor -- start 2023-10-09T11:53:51.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.606+0000 7fcda65ff700 1 -- start start 2023-10-09T11:53:51.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.607+0000 7fcda65ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcda0159890 0x7fcda0169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.607+0000 7fcda65ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda0169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.607+0000 7fcda65ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda016a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.607+0000 7fcda65ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00b3590 con 0x7fcda0159c60 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.607+0000 7fcda65ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00cfee0 con 0x7fcda0159890 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.607+0000 7fcda65ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00cf920 con 0x7fcda015db10 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.607+0000 7fcd9f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda0169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda0169f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37082/0 (socket says 172.21.15.86:37082) 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 -- 172.21.15.86:0/3426406528 learned_addr learned my addr 172.21.15.86:0/3426406528 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcda4b9c700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda016a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9ffff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcda0159890 0x7fcda0169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 -- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 msgr2=0x7fcda016a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda016a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 -- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcda0159890 msgr2=0x7fcda0169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcda0159890 0x7fcda0169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 -- 172.21.15.86:0/3426406528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94009420 con 0x7fcda0159c60 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd9f7fe700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda0169f50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcda00899c0 tx=0x7fcd94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.608+0000 7fcd87fff700 1 -- 172.21.15.86:0/3426406528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400b9d0 con 0x7fcda0159c60 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.609+0000 7fcd87fff700 1 -- 172.21.15.86:0/3426406528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400bb30 con 0x7fcda0159c60 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.609+0000 7fcd87fff700 1 -- 172.21.15.86:0/3426406528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011650 con 0x7fcda0159c60 2023-10-09T11:53:51.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.609+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda00cfc00 con 0x7fcda0159c60 2023-10-09T11:53:51.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.609+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda00b08c0 con 0x7fcda0159c60 2023-10-09T11:53:51.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.610+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda00b0ae0 con 0x7fcda0159c60 2023-10-09T11:53:51.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.610+0000 7fcd87fff700 1 -- 172.21.15.86:0/3426406528 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fcd94011a80 con 0x7fcda0159c60 2023-10-09T11:53:51.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.612+0000 7fcd87fff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 0x7fcd8c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:51.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.612+0000 7fcd87fff700 1 -- 172.21.15.86:0/3426406528 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fcd94086380 con 0x7fcda0159c60 2023-10-09T11:53:51.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.612+0000 7fcd9ffff700 1 -- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 msgr2=0x7fcd8c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:51.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.612+0000 7fcd9ffff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 0x7fcd8c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:51.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.616+0000 7fcd87fff700 1 -- 172.21.15.86:0/3426406528 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd94053040 con 0x7fcda0159c60 2023-10-09T11:53:51.676 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:51.674+0000 7fa011062180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:53:51.775 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:51.774+0000 7f7d2e689180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:53:51.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.813+0000 7fcd9ffff700 1 -- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 msgr2=0x7fcd8c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:51.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.813+0000 7fcd9ffff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 0x7fcd8c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:51.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.858+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcda004c3c0 con 0x7fcda0159c60 2023-10-09T11:53:51.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.859+0000 7fcd87fff700 1 -- 172.21.15.86:0/3426406528 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fcd94056660 con 0x7fcda0159c60 2023-10-09T11:53:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:51.860 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1552998028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1552998028},{"type":"v1","addr":"172.21.15.135:6834","nonce":1552998028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3861152933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3861152933},{"type":"v1","addr":"172.21.15.135:6835","nonce":3861152933}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4887,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/647611791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":647611791},{"type":"v1","addr":"172.21.15.86:6836","nonce":647611791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:07.793130+0000","modified":"2023-10-09T11:42:11.321775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6837/1725825433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":1725825433},{"type":"v1","addr":"172.21.15.86:6837","nonce":1725825433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 msgr2=0x7fcd8c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 0x7fcd8c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 msgr2=0x7fcda0169f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda0169f50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcda00899c0 tx=0x7fcd94017000 comp rx=0 tx=0).stop 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 shutdown_connections 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fcd8c0670e0 0x7fcd8c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcda015db10 0x7fcda016a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcda0159890 0x7fcda0169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 --2- 172.21.15.86:0/3426406528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0159c60 0x7fcda0169f50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 >> 172.21.15.86:0/3426406528 conn(0x7fcda0068e20 msgr2=0x7fcda0153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:51.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 shutdown_connections 2023-10-09T11:53:51.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:51.861+0000 7fcda65ff700 1 -- 172.21.15.86:0/3426406528 wait complete. 2023-10-09T11:53:51.864 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 17 2023-10-09T11:53:51.873 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:51.872+0000 7f7d2e689180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:53:51.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:53:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.064+0000 7f468339d700 1 Processor -- start 2023-10-09T11:53:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.064+0000 7f468339d700 1 -- start start 2023-10-09T11:53:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.065+0000 7f468339d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f467c142ea0 0x7f467c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f468339d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c0b40f0 con 0x7f467c0ad870 2023-10-09T11:53:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f468339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c069640 con 0x7f467c06c0f0 2023-10-09T11:53:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f468339d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c069920 con 0x7f467c142ea0 2023-10-09T11:53:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f4681b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f467c0ad870 0x7f467c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56328/0 (socket says 172.21.15.86:56328) 2023-10-09T11:53:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f4681b9a700 1 -- 172.21.15.86:0/528295333 learned_addr learned my addr 172.21.15.86:0/528295333 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:52.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f468239b700 1 --2- 172.21.15.86:0/528295333 >> v2:172.21.15.135:3300/0 conn(0x7f467c142ea0 0x7f467c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f4681399700 1 -- 172.21.15.86:0/528295333 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313043704 0 0) 0x7f467c0b40f0 con 0x7f467c0ad870 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f4681399700 1 -- 172.21.15.86:0/528295333 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4668003570 con 0x7f467c0ad870 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f4681399700 1 -- 172.21.15.86:0/528295333 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085237790 0 0) 0x7f467c069640 con 0x7f467c06c0f0 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.066+0000 7f4681399700 1 -- 172.21.15.86:0/528295333 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467c0b40f0 con 0x7f467c06c0f0 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.067+0000 7f468239b700 1 -- 172.21.15.86:0/528295333 >> v1:172.21.15.135:6789/0 conn(0x7f467c06c0f0 legacy=0x7f467c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.067+0000 7f468239b700 1 -- 172.21.15.86:0/528295333 >> v1:172.21.15.86:6789/0 conn(0x7f467c0ad870 legacy=0x7f467c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.067+0000 7f468239b700 1 -- 172.21.15.86:0/528295333 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c069c00 con 0x7f467c142ea0 2023-10-09T11:53:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.067+0000 7f468239b700 1 --2- 172.21.15.86:0/528295333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c142ea0 0x7f467c0b3630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46780098e0 tx=0x7f46780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6479b797d4234799 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.067+0000 7f4681399700 1 -- 172.21.15.86:0/528295333 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678011630 con 0x7f467c142ea0 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.067+0000 7f4681399700 1 -- 172.21.15.86:0/528295333 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4678011790 con 0x7f467c142ea0 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.067+0000 7f4681399700 1 -- 172.21.15.86:0/528295333 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678011b30 con 0x7f467c142ea0 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.068+0000 7f468339d700 1 -- 172.21.15.86:0/528295333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c142ea0 msgr2=0x7f467c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.068+0000 7f468339d700 1 --2- 172.21.15.86:0/528295333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c142ea0 0x7f467c0b3630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46780098e0 tx=0x7f46780091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.068+0000 7f468339d700 1 -- 172.21.15.86:0/528295333 shutdown_connections 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.068+0000 7f468339d700 1 --2- 172.21.15.86:0/528295333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c142ea0 0x7f467c0b3630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.068+0000 7f468339d700 1 -- 172.21.15.86:0/528295333 >> 172.21.15.86:0/528295333 conn(0x7f467c0ce430 msgr2=0x7f467c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.068+0000 7f468339d700 1 -- 172.21.15.86:0/528295333 shutdown_connections 2023-10-09T11:53:52.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.068+0000 7f468339d700 1 -- 172.21.15.86:0/528295333 wait complete. 2023-10-09T11:53:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.069+0000 7f468339d700 1 Processor -- start 2023-10-09T11:53:52.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.069+0000 7f468339d700 1 -- start start 2023-10-09T11:53:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f468339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c06c0f0 0x7f467c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f468339d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c142ea0 0x7f467c13e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f468339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467c13eac0 0x7f467c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f468339d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c13ef40 con 0x7f467c142ea0 2023-10-09T11:53:52.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f468339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0c90e0 con 0x7f467c06c0f0 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f468339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0c78c0 con 0x7f467c13eac0 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f4681b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c142ea0 0x7f467c13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f4681b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c142ea0 0x7f467c13e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37094/0 (socket says 172.21.15.86:37094) 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.070+0000 7f4681b9a700 1 -- 172.21.15.86:0/3184134524 learned_addr learned my addr 172.21.15.86:0/3184134524 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f468239b700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c06c0f0 0x7f467c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f4682b9c700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467c13eac0 0x7f467c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f4681b9a700 1 -- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467c13eac0 msgr2=0x7f467c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f4681b9a700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467c13eac0 0x7f467c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f4681b9a700 1 -- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c06c0f0 msgr2=0x7f467c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f4681b9a700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c06c0f0 0x7f467c0c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f4681b9a700 1 -- 172.21.15.86:0/3184134524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678009420 con 0x7f467c142ea0 2023-10-09T11:53:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f4681b9a700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c142ea0 0x7f467c13e580 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c790 tx=0x7f466c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f46727fc700 1 -- 172.21.15.86:0/3184134524 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c005b30 con 0x7f467c142ea0 2023-10-09T11:53:52.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f46727fc700 1 -- 172.21.15.86:0/3184134524 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c005c90 con 0x7f467c142ea0 2023-10-09T11:53:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.071+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c15d180 con 0x7f467c142ea0 2023-10-09T11:53:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.072+0000 7f46727fc700 1 -- 172.21.15.86:0/3184134524 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0072e0 con 0x7f467c142ea0 2023-10-09T11:53:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.072+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c15d740 con 0x7f467c142ea0 2023-10-09T11:53:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.073+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c04c3c0 con 0x7f467c142ea0 2023-10-09T11:53:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.073+0000 7f46727fc700 1 -- 172.21.15.86:0/3184134524 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f466c007690 con 0x7f467c142ea0 2023-10-09T11:53:52.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.074+0000 7f46727fc700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 0x7f4660069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.074+0000 7f46727fc700 1 -- 172.21.15.86:0/3184134524 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f466c083f60 con 0x7f467c142ea0 2023-10-09T11:53:52.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.074+0000 7f468239b700 1 -- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 msgr2=0x7f4660069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:52.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.074+0000 7f468239b700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 0x7f4660069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:52.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.078+0000 7f46727fc700 1 -- 172.21.15.86:0/3184134524 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f466c04b5a0 con 0x7f467c142ea0 2023-10-09T11:53:52.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.275+0000 7f468239b700 1 -- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 msgr2=0x7f4660069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:52.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.275+0000 7f468239b700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 0x7f4660069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.276+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f467c143270 con 0x7f467c142ea0 2023-10-09T11:53:52.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.277+0000 7f46727fc700 1 -- 172.21.15.86:0/3184134524 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16385 (secure 0 0 0) 0x7f466c017020 con 0x7f467c142ea0 2023-10-09T11:53:52.279 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:52.279 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":50,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:53:50.384460+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:05.325678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:06.736222+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6833/85490":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2422899393":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/1379635191":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2164323904":"2023-10-10T11:42:23.645474+0000","172.21.15.86:6832/85490":"2023-10-10T11:42:23.645474+0000","172.21.15.86:0/2564271480":"2023-10-10T11:42:23.645474+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:53:52.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.279+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 msgr2=0x7f4660069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:52.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 0x7f4660069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c142ea0 msgr2=0x7f467c13e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c142ea0 0x7f467c13e580 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c790 tx=0x7f466c007e40 comp rx=0 tx=0).stop 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 shutdown_connections 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f46600670e0 0x7f4660069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467c13eac0 0x7f467c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f467c06c0f0 0x7f467c0c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 --2- 172.21.15.86:0/3184134524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c142ea0 0x7f467c13e580 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 >> 172.21.15.86:0/3184134524 conn(0x7f467c0ce430 msgr2=0x7f467c06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 shutdown_connections 2023-10-09T11:53:52.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.280+0000 7f468339d700 1 -- 172.21.15.86:0/3184134524 wait complete. 2023-10-09T11:53:52.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:53:52.373 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:52.372+0000 7fa011062180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:53:52.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.489+0000 7fa8a599d700 1 Processor -- start 2023-10-09T11:53:52.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.489+0000 7fa8a599d700 1 -- start start 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa8a599d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a0159420 0x7fa8a00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa8a599d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00b2980 con 0x7fa8a01597f0 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa8a599d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00b11d0 con 0x7fa8a015d230 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa8a599d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b14b0 con 0x7fa8a0159420 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa89ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa8a01597f0 0x7fa8a00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56340/0 (socket says 172.21.15.86:56340) 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa89ffff700 1 -- 172.21.15.86:0/3947867311 learned_addr learned my addr 172.21.15.86:0/3947867311 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa8a499b700 1 --2- 172.21.15.86:0/3947867311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a0159420 0x7fa8a00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa89f7fe700 1 -- 172.21.15.86:0/3947867311 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144811061 0 0) 0x7fa8a00b2980 con 0x7fa8a01597f0 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa89f7fe700 1 -- 172.21.15.86:0/3947867311 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa890003570 con 0x7fa8a01597f0 2023-10-09T11:53:52.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.491+0000 7fa89f7fe700 1 -- 172.21.15.86:0/3947867311 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899175875 0 0) 0x7fa8a00b11d0 con 0x7fa8a015d230 2023-10-09T11:53:52.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa89f7fe700 1 -- 172.21.15.86:0/3947867311 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a00b2980 con 0x7fa8a015d230 2023-10-09T11:53:52.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa8a499b700 1 -- 172.21.15.86:0/3947867311 >> v1:172.21.15.135:6789/0 conn(0x7fa8a015d230 legacy=0x7fa8a00b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa8a499b700 1 -- 172.21.15.86:0/3947867311 >> v1:172.21.15.86:6789/0 conn(0x7fa8a01597f0 legacy=0x7fa8a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa8a499b700 1 -- 172.21.15.86:0/3947867311 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00b1790 con 0x7fa8a0159420 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa8a499b700 1 --2- 172.21.15.86:0/3947867311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a0159420 0x7fa8a00b5f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa894009910 tx=0x7fa8940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9503c229ffb1cfd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa89f7fe700 1 -- 172.21.15.86:0/3947867311 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011630 con 0x7fa8a0159420 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa89f7fe700 1 -- 172.21.15.86:0/3947867311 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894011790 con 0x7fa8a0159420 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.492+0000 7fa89f7fe700 1 -- 172.21.15.86:0/3947867311 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011b30 con 0x7fa8a0159420 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.493+0000 7fa8a599d700 1 -- 172.21.15.86:0/3947867311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a0159420 msgr2=0x7fa8a00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.493+0000 7fa8a599d700 1 --2- 172.21.15.86:0/3947867311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a0159420 0x7fa8a00b5f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa894009910 tx=0x7fa8940091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.493+0000 7fa8a599d700 1 -- 172.21.15.86:0/3947867311 shutdown_connections 2023-10-09T11:53:52.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.493+0000 7fa8a599d700 1 --2- 172.21.15.86:0/3947867311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a0159420 0x7fa8a00b5f40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.493+0000 7fa8a599d700 1 -- 172.21.15.86:0/3947867311 >> 172.21.15.86:0/3947867311 conn(0x7fa8a00d0660 msgr2=0x7fa8a00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:52.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.493+0000 7fa8a599d700 1 -- 172.21.15.86:0/3947867311 shutdown_connections 2023-10-09T11:53:52.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.493+0000 7fa8a599d700 1 -- 172.21.15.86:0/3947867311 wait complete. 2023-10-09T11:53:52.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.494+0000 7fa8a599d700 1 Processor -- start 2023-10-09T11:53:52.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.494+0000 7fa8a599d700 1 -- start start 2023-10-09T11:53:52.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.495+0000 7fa8a599d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8a0159420 0x7fa8a00c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.495+0000 7fa8a599d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a01597f0 0x7fa8a016cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.495+0000 7fa8a599d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a015d230 0x7fa8a016d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.495+0000 7fa8a599d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a015b0e0 con 0x7fa8a01597f0 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.495+0000 7fa8a599d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a015a4d0 con 0x7fa8a0159420 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.495+0000 7fa8a599d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a015a7b0 con 0x7fa8a015d230 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a01597f0 0x7fa8a016cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a01597f0 0x7fa8a016cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37098/0 (socket says 172.21.15.86:37098) 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 -- 172.21.15.86:0/2576413241 learned_addr learned my addr 172.21.15.86:0/2576413241 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa8a499b700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8a0159420 0x7fa8a00c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa8a519c700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a015d230 0x7fa8a016d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 -- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a015d230 msgr2=0x7fa8a016d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a015d230 0x7fa8a016d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 -- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8a0159420 msgr2=0x7fa8a00c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8a0159420 0x7fa8a00c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 -- 172.21.15.86:0/2576413241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009420 con 0x7fa8a01597f0 2023-10-09T11:53:52.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.496+0000 7fa89ffff700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a01597f0 0x7fa8a016cf50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c790 tx=0x7fa88c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:52.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.497+0000 7fa89cff9700 1 -- 172.21.15.86:0/2576413241 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c005b30 con 0x7fa8a01597f0 2023-10-09T11:53:52.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.497+0000 7fa89cff9700 1 -- 172.21.15.86:0/2576413241 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c005cd0 con 0x7fa8a01597f0 2023-10-09T11:53:52.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.497+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a015aa90 con 0x7fa8a01597f0 2023-10-09T11:53:52.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.497+0000 7fa89cff9700 1 -- 172.21.15.86:0/2576413241 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c007320 con 0x7fa8a01597f0 2023-10-09T11:53:52.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.497+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a0154810 con 0x7fa8a01597f0 2023-10-09T11:53:52.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.498+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a015b290 con 0x7fa8a01597f0 2023-10-09T11:53:52.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.499+0000 7fa89cff9700 1 -- 172.21.15.86:0/2576413241 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fa88c012400 con 0x7fa8a01597f0 2023-10-09T11:53:52.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.500+0000 7fa89cff9700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 0x7fa884069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.500+0000 7fa89cff9700 1 -- 172.21.15.86:0/2576413241 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fa88c083f40 con 0x7fa8a01597f0 2023-10-09T11:53:52.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.500+0000 7fa8a499b700 1 -- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 msgr2=0x7fa884069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:52.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.500+0000 7fa8a499b700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 0x7fa884069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:53:52.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.504+0000 7fa89cff9700 1 -- 172.21.15.86:0/2576413241 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa88c04b5a0 con 0x7fa8a01597f0 2023-10-09T11:53:52.607 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:52.606+0000 7f7d2e689180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:53:52.660 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:52.659+0000 7fa011062180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:53:52.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.701+0000 7fa8a499b700 1 -- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 msgr2=0x7fa884069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6832/85490 2023-10-09T11:53:52.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.701+0000 7fa8a499b700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 0x7fa884069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:53:52.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.744+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa8a004c3c0 con 0x7fa8a01597f0 2023-10-09T11:53:52.746 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T11:53:52.745+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:53:52.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.749+0000 7fa89cff9700 1 -- 172.21.15.86:0/2576413241 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa88c017090 con 0x7fa8a01597f0 2023-10-09T11:53:52.751 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:52.749+0000 7fa011062180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 msgr2=0x7fa884069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 0x7fa884069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a01597f0 msgr2=0x7fa8a016cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a01597f0 0x7fa8a016cf50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c790 tx=0x7fa88c007e80 comp rx=0 tx=0).stop 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 shutdown_connections 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7fa8840670e0 0x7fa884069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8a015d230 0x7fa8a016d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8a0159420 0x7fa8a00c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 --2- 172.21.15.86:0/2576413241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a01597f0 0x7fa8a016cf50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 >> 172.21.15.86:0/2576413241 conn(0x7fa8a00d0660 msgr2=0x7fa8a00b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:52.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 shutdown_connections 2023-10-09T11:53:52.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.752+0000 7fa8a599d700 1 -- 172.21.15.86:0/2576413241 wait complete. 2023-10-09T11:53:52.755 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:53:52.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:53:52.823 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:53:52.905 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:52.903+0000 7fa011062180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:53:52.908 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:52.907+0000 7f7d2e689180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:53:52.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.961+0000 7f7fab59e700 1 Processor -- start 2023-10-09T11:53:52.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.961+0000 7f7fab59e700 1 -- start start 2023-10-09T11:53:52.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fab59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7fac0b4e70 0x7f7fac0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fab59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fac0b16d0 0x7f7fac0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fab59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0b2080 con 0x7f7fac15d240 2023-10-09T11:53:52.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fab59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0cfb00 con 0x7f7fac0b16d0 2023-10-09T11:53:52.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fab59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0b5c40 con 0x7f7fac0b4e70 2023-10-09T11:53:52.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fa9d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fac0b16d0 0x7f7fac0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fa9d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fac0b16d0 0x7f7fac0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37132/0 (socket says 172.21.15.86:37132) 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3718881432 learned_addr learned my addr 172.21.15.86:0/3718881432 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7faa59c700 1 --2- 172.21.15.86:0/3718881432 >> v2:172.21.15.135:3300/0 conn(0x7f7fac0b4e70 0x7f7fac0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.963+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3718881432 >> v2:172.21.15.135:3300/0 conn(0x7f7fac0b4e70 msgr2=0x7f7fac0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.964+0000 7f7fa9d9b700 1 --2- 172.21.15.86:0/3718881432 >> v2:172.21.15.135:3300/0 conn(0x7f7fac0b4e70 0x7f7fac0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.964+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3718881432 >> v1:172.21.15.135:6789/0 conn(0x7f7fac15d240 legacy=0x7f7fac15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.964+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3718881432 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0b5f20 con 0x7f7fac0b16d0 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.964+0000 7f7fa9d9b700 1 --2- 172.21.15.86:0/3718881432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b16d0 0x7f7fac0b1b40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7fac064910 tx=0x7f7fa0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bde3a8e663488fd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.964+0000 7f7fa959a700 1 -- 172.21.15.86:0/3718881432 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0009e70 con 0x7f7fac0b16d0 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.964+0000 7f7fa959a700 1 -- 172.21.15.86:0/3718881432 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000b860 con 0x7f7fac0b16d0 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.964+0000 7f7fa959a700 1 -- 172.21.15.86:0/3718881432 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000bc00 con 0x7f7fac0b16d0 2023-10-09T11:53:52.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 -- 172.21.15.86:0/3718881432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b16d0 msgr2=0x7f7fac0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3718881432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b16d0 0x7f7fac0b1b40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7fac064910 tx=0x7f7fa0009250 comp rx=0 tx=0).stop 2023-10-09T11:53:52.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 -- 172.21.15.86:0/3718881432 shutdown_connections 2023-10-09T11:53:52.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3718881432 >> v2:172.21.15.135:3300/0 conn(0x7f7fac0b4e70 0x7f7fac0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3718881432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b16d0 0x7f7fac0b1b40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 -- 172.21.15.86:0/3718881432 >> 172.21.15.86:0/3718881432 conn(0x7f7fac0d10c0 msgr2=0x7f7fac0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:52.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 -- 172.21.15.86:0/3718881432 shutdown_connections 2023-10-09T11:53:52.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.965+0000 7f7fab59e700 1 -- 172.21.15.86:0/3718881432 wait complete. 2023-10-09T11:53:52.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.966+0000 7f7fab59e700 1 Processor -- start 2023-10-09T11:53:52.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.967+0000 7f7fab59e700 1 -- start start 2023-10-09T11:53:52.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.967+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fac0b16d0 0x7f7fac1477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.967+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b4e70 0x7f7fac147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.967+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fac15d240 0x7f7fac0a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.967+0000 7f7fab59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c9aa0 con 0x7f7fac0b4e70 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.967+0000 7f7fab59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c9d80 con 0x7f7fac15d240 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.967+0000 7f7fab59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0ca060 con 0x7f7fac0b16d0 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b4e70 0x7f7fac147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b4e70 0x7f7fac147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37144/0 (socket says 172.21.15.86:37144) 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3407292001 learned_addr learned my addr 172.21.15.86:0/3407292001 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7faad9d700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fac15d240 0x7f7fac0a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7faa59c700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fac0b16d0 0x7f7fac1477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fac0b16d0 msgr2=0x7f7fac1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fac0b16d0 0x7f7fac1477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fac15d240 msgr2=0x7f7fac0a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:52.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fac15d240 0x7f7fac0a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 -- 172.21.15.86:0/3407292001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa00094f0 con 0x7f7fac0b4e70 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.968+0000 7f7fa9d9b700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b4e70 0x7f7fac147cf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7fac070dd0 tx=0x7f7fa0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.969+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000bbe0 con 0x7f7fac0b4e70 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.969+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0011420 con 0x7f7fac0b4e70 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.969+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00117c0 con 0x7f7fac0b4e70 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.969+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac0ca340 con 0x7f7fac0b4e70 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.969+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac0a7440 con 0x7f7fac0b4e70 2023-10-09T11:53:52.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.970+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac088990 con 0x7f7fac0b4e70 2023-10-09T11:53:52.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.971+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f7fa0011bf0 con 0x7f7fac0b4e70 2023-10-09T11:53:52.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.972+0000 7f7f9a7fc700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f8c0670e0 0x7f7f8c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:52.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.972+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f7fa0085fe0 con 0x7f7fac0b4e70 2023-10-09T11:53:52.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.972+0000 7f7faa59c700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f8c0670e0 0x7f7f8c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:52.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.972+0000 7f7faa59c700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f8c0670e0 0x7f7f8c069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2023-10-09T11:53:52.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.972+0000 7f7faa59c700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f8c0670e0 0x7f7f8c069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.972+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f8c0670e0 msgr2=0x7f7f8c069590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-09T11:53:52.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.972+0000 7f7f9a7fc700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f8c0670e0 0x7f7f8c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:52.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:52.976+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fa0052ca0 con 0x7f7fac0b4e70 2023-10-09T11:53:53.005 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:53.004+0000 7f7d2e689180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:53:53.009 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:53.007+0000 7fa011062180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:53:53.162 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:53.161+0000 7f7d2e689180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:53:53.195 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:53.193+0000 7fa011062180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:53:53.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.217+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7fac0cc4a0 con 0x7f7fac0b4e70 2023-10-09T11:53:53.266 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:53.265+0000 7f7d2e689180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:53:53.285 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:53.284+0000 7fa011062180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:53:53.374 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:53.373+0000 7fa011062180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:53:53.452 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:53.451+0000 7f7d2e689180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:53:53.467 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:53:53.466+0000 7fa011062180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:53:53.544 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:53.543+0000 7f7d2e689180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:53:53.634 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:53.633+0000 7f7d2e689180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:53:53.727 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:53:53.726+0000 7f7d2e689180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:53:53.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.736+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 17) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f7fa0053070 con 0x7f7fac0b4e70 2023-10-09T11:53:53.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.750+0000 7f7f9a7fc700 1 -- 172.21.15.86:0/3407292001 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7fa0056730 con 0x7f7fac0b4e70 2023-10-09T11:53:53.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b4e70 msgr2=0x7f7fac147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:53.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b4e70 0x7f7fac147cf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7fac070dd0 tx=0x7f7fa0017000 comp rx=0 tx=0).stop 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 shutdown_connections 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:6832/85490,v1:172.21.15.86:6833/85490] conn(0x7f7f8c0670e0 0x7f7f8c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fac15d240 0x7f7fac0a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fac0b16d0 0x7f7fac1477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 --2- 172.21.15.86:0/3407292001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fac0b4e70 0x7f7fac147cf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 >> 172.21.15.86:0/3407292001 conn(0x7f7fac0d10c0 msgr2=0x7f7fac068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 shutdown_connections 2023-10-09T11:53:53.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.753+0000 7f7fab59e700 1 -- 172.21.15.86:0/3407292001 wait complete. 2023-10-09T11:53:53.775 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:53:53.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.967+0000 7fdbc69ff700 1 Processor -- start 2023-10-09T11:53:53.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.967+0000 7fdbc69ff700 1 -- start start 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.968+0000 7fdbc69ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdbc0159b80 0x7fdbc006a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.968+0000 7fdbc69ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdbc006a7f0 0x7fdbc0163650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.968+0000 7fdbc69ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc00af900 con 0x7fdbc01597b0 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.968+0000 7fdbc69ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc0068390 con 0x7fdbc006a7f0 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.968+0000 7fdbc69ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc00ac530 con 0x7fdbc0159b80 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.968+0000 7fdbc4f9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdbc006a7f0 0x7fdbc0163650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbc4f9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdbc006a7f0 0x7fdbc0163650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37220/0 (socket says 172.21.15.86:37220) 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/2961744667 learned_addr learned my addr 172.21.15.86:0/2961744667 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:53.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbbf7fe700 1 --2- 172.21.15.86:0/2961744667 >> v2:172.21.15.135:3300/0 conn(0x7fdbc0159b80 0x7fdbc006a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/2961744667 >> v2:172.21.15.135:3300/0 conn(0x7fdbc0159b80 msgr2=0x7fdbc006a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbc4f9c700 1 --2- 172.21.15.86:0/2961744667 >> v2:172.21.15.135:3300/0 conn(0x7fdbc0159b80 0x7fdbc006a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/2961744667 >> v1:172.21.15.135:6789/0 conn(0x7fdbc01597b0 legacy=0x7fdbc00af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/2961744667 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc006ac30 con 0x7fdbc006a7f0 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbc4f9c700 1 --2- 172.21.15.86:0/2961744667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc006a7f0 0x7fdbc0163650 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009f50 tx=0x7fdbb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433f97787ae5bde9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.969+0000 7fdbbeffd700 1 -- 172.21.15.86:0/2961744667 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800e070 con 0x7fdbc006a7f0 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbbeffd700 1 -- 172.21.15.86:0/2961744667 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb800ba30 con 0x7fdbc006a7f0 2023-10-09T11:53:53.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbbeffd700 1 -- 172.21.15.86:0/2961744667 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80092e0 con 0x7fdbc006a7f0 2023-10-09T11:53:53.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 -- 172.21.15.86:0/2961744667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc006a7f0 msgr2=0x7fdbc0163650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:53.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 --2- 172.21.15.86:0/2961744667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc006a7f0 0x7fdbc0163650 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009f50 tx=0x7fdbb8009840 comp rx=0 tx=0).stop 2023-10-09T11:53:53.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 -- 172.21.15.86:0/2961744667 shutdown_connections 2023-10-09T11:53:53.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 --2- 172.21.15.86:0/2961744667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc006a7f0 0x7fdbc0163650 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 --2- 172.21.15.86:0/2961744667 >> v2:172.21.15.135:3300/0 conn(0x7fdbc0159b80 0x7fdbc006a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 -- 172.21.15.86:0/2961744667 >> 172.21.15.86:0/2961744667 conn(0x7fdbc00cd880 msgr2=0x7fdbc00ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:53.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 -- 172.21.15.86:0/2961744667 shutdown_connections 2023-10-09T11:53:53.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.970+0000 7fdbc69ff700 1 -- 172.21.15.86:0/2961744667 wait complete. 2023-10-09T11:53:53.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.972+0000 7fdbc69ff700 1 Processor -- start 2023-10-09T11:53:53.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.972+0000 7fdbc69ff700 1 -- start start 2023-10-09T11:53:53.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc69ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc006a7f0 0x7fdbc015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc69ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbc01597b0 0x7fdbc00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc69ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc0159b80 0x7fdbc0149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc69ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc015eb80 con 0x7fdbc0159b80 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc69ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc015ee20 con 0x7fdbc006a7f0 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc69ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc015f100 con 0x7fdbc01597b0 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc0159b80 0x7fdbc0149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc0159b80 0x7fdbc0149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37228/0 (socket says 172.21.15.86:37228) 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/3842883094 learned_addr learned my addr 172.21.15.86:0/3842883094 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:53.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbbf7fe700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbc01597b0 0x7fdbc00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbbffff700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc006a7f0 0x7fdbc015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbc01597b0 msgr2=0x7fdbc00c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbc01597b0 0x7fdbc00c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc006a7f0 msgr2=0x7fdbc015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc006a7f0 0x7fdbc015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbc4f9c700 1 -- 172.21.15.86:0/3842883094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8009ae0 con 0x7fdbc0159b80 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.973+0000 7fdbbf7fe700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbc01597b0 0x7fdbc00c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.974+0000 7fdbc4f9c700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc0159b80 0x7fdbc0149480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006d940 tx=0x7fdbb8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:53.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.974+0000 7fdba7fff700 1 -- 172.21.15.86:0/3842883094 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8008e40 con 0x7fdbc0159b80 2023-10-09T11:53:53.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.974+0000 7fdba7fff700 1 -- 172.21.15.86:0/3842883094 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb800be40 con 0x7fdbc0159b80 2023-10-09T11:53:53.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.974+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc015f3e0 con 0x7fdbc0159b80 2023-10-09T11:53:53.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.974+0000 7fdba7fff700 1 -- 172.21.15.86:0/3842883094 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80266b0 con 0x7fdbc0159b80 2023-10-09T11:53:53.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.974+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc015bf40 con 0x7fdbc0159b80 2023-10-09T11:53:53.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.975+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc015f900 con 0x7fdbc0159b80 2023-10-09T11:53:53.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.976+0000 7fdba7fff700 1 -- 172.21.15.86:0/3842883094 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fdbb8003040 con 0x7fdbc0159b80 2023-10-09T11:53:53.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.977+0000 7fdba7fff700 1 -- 172.21.15.86:0/3842883094 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fdbb8086470 con 0x7fdbc0159b80 2023-10-09T11:53:53.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:53.981+0000 7fdba7fff700 1 -- 172.21.15.86:0/3842883094 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbc015f900 con 0x7fdbc0159b80 2023-10-09T11:53:54.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.171+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbc015f900 con 0x7fdbc0159b80 2023-10-09T11:53:54.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.752+0000 7fdba7fff700 1 -- 172.21.15.86:0/3842883094 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdbc015f900 con 0x7fdbc0159b80 2023-10-09T11:53:54.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.755+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc0159b80 msgr2=0x7fdbc0149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:54.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.755+0000 7fdbc69ff700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc0159b80 0x7fdbc0149480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006d940 tx=0x7fdbb8018000 comp rx=0 tx=0).stop 2023-10-09T11:53:54.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.755+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 shutdown_connections 2023-10-09T11:53:54.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.756+0000 7fdbc69ff700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbc0159b80 0x7fdbc0149480 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.756+0000 7fdbc69ff700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc006a7f0 0x7fdbc015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.756+0000 7fdbc69ff700 1 --2- 172.21.15.86:0/3842883094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbc01597b0 0x7fdbc00c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.756+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 >> 172.21.15.86:0/3842883094 conn(0x7fdbc00cd880 msgr2=0x7fdbc00af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:54.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.756+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 shutdown_connections 2023-10-09T11:53:54.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.756+0000 7fdbc69ff700 1 -- 172.21.15.86:0/3842883094 wait complete. 2023-10-09T11:53:54.758 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:53:54.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:53:54.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.977+0000 7f101d3ff700 1 Processor -- start 2023-10-09T11:53:54.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.977+0000 7f101d3ff700 1 -- start start 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.978+0000 7f101d3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1018156910 0x7f101806d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.978+0000 7f101d3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1018156ce0 0x7f10180cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.978+0000 7f101d3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10180ade00 con 0x7f10180acd10 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.978+0000 7f101d3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180abca0 con 0x7f1018156910 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.978+0000 7f101d3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180c9b50 con 0x7f1018156ce0 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f1016ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1018156910 0x7f101806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f10167fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f10180acd10 0x7f10180c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52752/0 (socket says 172.21.15.86:52752) 2023-10-09T11:53:54.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f1016ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1018156910 0x7f101806d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54074/0 (socket says 172.21.15.86:54074) 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f10167fc700 1 -- 172.21.15.86:0/325456426 learned_addr learned my addr 172.21.15.86:0/325456426 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f10177fe700 1 --2- 172.21.15.86:0/325456426 >> v2:172.21.15.135:3300/0 conn(0x7f1018156ce0 0x7f10180cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f1016ffd700 1 -- 172.21.15.86:0/325456426 >> v2:172.21.15.135:3300/0 conn(0x7f1018156ce0 msgr2=0x7f10180cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f1016ffd700 1 --2- 172.21.15.86:0/325456426 >> v2:172.21.15.135:3300/0 conn(0x7f1018156ce0 0x7f10180cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f1016ffd700 1 -- 172.21.15.86:0/325456426 >> v1:172.21.15.86:6789/0 conn(0x7f10180acd10 legacy=0x7f10180c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f1016ffd700 1 -- 172.21.15.86:0/325456426 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10180ad1f0 con 0x7f1018156910 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f10177fe700 1 --2- 172.21.15.86:0/325456426 >> v2:172.21.15.135:3300/0 conn(0x7f1018156ce0 0x7f10180cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.979+0000 7f1016ffd700 1 --2- 172.21.15.86:0/325456426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f101806d460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1018069340 tx=0x7f1008009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d437cc31e61faf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:54.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.980+0000 7f1015ffb700 1 -- 172.21.15.86:0/325456426 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008005c10 con 0x7f1018156910 2023-10-09T11:53:54.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.980+0000 7f1015ffb700 1 -- 172.21.15.86:0/325456426 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008005d70 con 0x7f1018156910 2023-10-09T11:53:54.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.980+0000 7f1015ffb700 1 -- 172.21.15.86:0/325456426 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008006260 con 0x7f1018156910 2023-10-09T11:53:54.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.980+0000 7f101d3ff700 1 -- 172.21.15.86:0/325456426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 msgr2=0x7f101806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:54.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.980+0000 7f101d3ff700 1 --2- 172.21.15.86:0/325456426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f101806d460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1018069340 tx=0x7f1008009120 comp rx=0 tx=0).stop 2023-10-09T11:53:54.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.981+0000 7f101d3ff700 1 -- 172.21.15.86:0/325456426 shutdown_connections 2023-10-09T11:53:54.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.981+0000 7f101d3ff700 1 --2- 172.21.15.86:0/325456426 >> v2:172.21.15.135:3300/0 conn(0x7f1018156ce0 0x7f10180cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.981+0000 7f101d3ff700 1 --2- 172.21.15.86:0/325456426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f101806d460 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.981+0000 7f101d3ff700 1 -- 172.21.15.86:0/325456426 >> 172.21.15.86:0/325456426 conn(0x7f1018068390 msgr2=0x7f1018068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:54.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.981+0000 7f101d3ff700 1 -- 172.21.15.86:0/325456426 shutdown_connections 2023-10-09T11:53:54.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.981+0000 7f101d3ff700 1 -- 172.21.15.86:0/325456426 wait complete. 2023-10-09T11:53:54.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.983+0000 7f101d3ff700 1 Processor -- start 2023-10-09T11:53:54.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.983+0000 7f101d3ff700 1 -- start start 2023-10-09T11:53:54.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f101d3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10180acd10 0x7f10180ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f101d3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f10180afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f101d3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018156ce0 0x7f101814c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f101d3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018157f40 con 0x7f1018156910 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f101d3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018158220 con 0x7f1018156ce0 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f101d3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1018158500 con 0x7f10180acd10 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f10167fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f10180afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f10167fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f10180afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54086/0 (socket says 172.21.15.86:54086) 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f10167fc700 1 -- 172.21.15.86:0/498874970 learned_addr learned my addr 172.21.15.86:0/498874970 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f10177fe700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018156ce0 0x7f101814c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:54.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.984+0000 7f1016ffd700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10180acd10 0x7f10180ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f10167fc700 1 -- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10180acd10 msgr2=0x7f10180ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f10167fc700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10180acd10 0x7f10180ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f10167fc700 1 -- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018156ce0 msgr2=0x7f101814c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f10167fc700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018156ce0 0x7f101814c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f10167fc700 1 -- 172.21.15.86:0/498874970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080093c0 con 0x7f1018156910 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f1016ffd700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10180acd10 0x7f10180ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f10167fc700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f10180afa20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c590 tx=0x7f100c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c005b30 con 0x7f1018156910 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c005cb0 con 0x7f1018156910 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c007320 con 0x7f1018156910 2023-10-09T11:53:54.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10181587e0 con 0x7f1018156910 2023-10-09T11:53:54.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.985+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10180bfd50 con 0x7f1018156910 2023-10-09T11:53:54.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.986+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1018158d00 con 0x7f1018156910 2023-10-09T11:53:54.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.987+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f100c01b3b0 con 0x7f1018156910 2023-10-09T11:53:54.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.988+0000 7f0ffeffd700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1004066d80 0x7f1004069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:54.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.988+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f100c0839a0 con 0x7f1018156910 2023-10-09T11:53:54.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.988+0000 7f1016ffd700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1004066d80 0x7f1004069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:54.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.989+0000 7f1016ffd700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1004066d80 0x7f1004069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1008009360 tx=0x7f1008018000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:54.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:54.993+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1018158d00 con 0x7f1018156910 2023-10-09T11:53:55.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.182+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1018158d00 con 0x7f1018156910 2023-10-09T11:53:55.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.777+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f100c050f90 con 0x7f1018156910 2023-10-09T11:53:55.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.777+0000 7f0ffeffd700 1 -- 172.21.15.86:0/498874970 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f100c048210 con 0x7f1018156910 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1004066d80 msgr2=0x7f1004069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1004066d80 0x7f1004069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1008009360 tx=0x7f1008018000 comp rx=0 tx=0).stop 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 msgr2=0x7f10180afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f10180afa20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c590 tx=0x7f100c001020 comp rx=0 tx=0).stop 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 shutdown_connections 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1018156ce0 0x7f101814c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10180acd10 0x7f10180ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1004066d80 0x7f1004069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 --2- 172.21.15.86:0/498874970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1018156910 0x7f10180afa20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 >> 172.21.15.86:0/498874970 conn(0x7f1018068390 msgr2=0x7f101806e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:55.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 shutdown_connections 2023-10-09T11:53:55.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.780+0000 7f101d3ff700 1 -- 172.21.15.86:0/498874970 wait complete. 2023-10-09T11:53:55.783 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T11:53:55.803 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T11:53:55.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.988+0000 7f89d7fff700 1 Processor -- start 2023-10-09T11:53:55.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.988+0000 7f89d7fff700 1 -- start start 2023-10-09T11:53:55.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f89d006bcd0 0x7f89d00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:55.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89d006c0a0 0x7f89d015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:55.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:55.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d7fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d015d7e0 con 0x7f89d006c0a0 2023-10-09T11:53:55.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d7fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d015dac0 con 0x7f89d006bcd0 2023-10-09T11:53:55.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d015aa30 con 0x7f89d015df50 2023-10-09T11:53:55.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d559a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89d006c0a0 0x7f89d015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:55.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d559a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89d006c0a0 0x7f89d015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54100/0 (socket says 172.21.15.86:54100) 2023-10-09T11:53:55.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d559a700 1 -- 172.21.15.86:0/3267581073 learned_addr learned my addr 172.21.15.86:0/3267581073 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d5d9b700 1 --2- 172.21.15.86:0/3267581073 >> v2:172.21.15.135:3300/0 conn(0x7f89d006bcd0 0x7f89d00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.990+0000 7f89d659c700 1 --2- 172.21.15.86:0/3267581073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d559a700 1 -- 172.21.15.86:0/3267581073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 msgr2=0x7f89d015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d559a700 1 --2- 172.21.15.86:0/3267581073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d559a700 1 -- 172.21.15.86:0/3267581073 >> v2:172.21.15.135:3300/0 conn(0x7f89d006bcd0 msgr2=0x7f89d00caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d559a700 1 --2- 172.21.15.86:0/3267581073 >> v2:172.21.15.135:3300/0 conn(0x7f89d006bcd0 0x7f89d00caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d559a700 1 -- 172.21.15.86:0/3267581073 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d015ad10 con 0x7f89d006c0a0 2023-10-09T11:53:55.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d659c700 1 --2- 172.21.15.86:0/3267581073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d559a700 1 --2- 172.21.15.86:0/3267581073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d015a1e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f89d00691a0 tx=0x7f89c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cd4be9fd310494 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d4d99700 1 -- 172.21.15.86:0/3267581073 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000b860 con 0x7f89d006c0a0 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d4d99700 1 -- 172.21.15.86:0/3267581073 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000b9c0 con 0x7f89d006c0a0 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.991+0000 7f89d4d99700 1 -- 172.21.15.86:0/3267581073 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000bd80 con 0x7f89d006c0a0 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 -- 172.21.15.86:0/3267581073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 msgr2=0x7f89d015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 --2- 172.21.15.86:0/3267581073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d015a1e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f89d00691a0 tx=0x7f89c0009250 comp rx=0 tx=0).stop 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 -- 172.21.15.86:0/3267581073 shutdown_connections 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 --2- 172.21.15.86:0/3267581073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 --2- 172.21.15.86:0/3267581073 >> v2:172.21.15.135:3300/0 conn(0x7f89d006bcd0 0x7f89d00caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 --2- 172.21.15.86:0/3267581073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d015a1e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 -- 172.21.15.86:0/3267581073 >> 172.21.15.86:0/3267581073 conn(0x7f89d00ce600 msgr2=0x7f89d00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 -- 172.21.15.86:0/3267581073 shutdown_connections 2023-10-09T11:53:55.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.992+0000 7f89d7fff700 1 -- 172.21.15.86:0/3267581073 wait complete. 2023-10-09T11:53:55.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.993+0000 7f89d7fff700 1 Processor -- start 2023-10-09T11:53:55.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.993+0000 7f89d7fff700 1 -- start start 2023-10-09T11:53:55.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.994+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d006bcd0 0x7f89d0153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:55.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.994+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d0143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:55.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.994+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d01443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:55.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.994+0000 7f89d7fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0157e00 con 0x7f89d006c0a0 2023-10-09T11:53:55.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.994+0000 7f89d7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0158c60 con 0x7f89d006bcd0 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.994+0000 7f89d7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00b4340 con 0x7f89d015df50 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.994+0000 7f89d559a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d0143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d0143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54102/0 (socket says 172.21.15.86:54102) 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 -- 172.21.15.86:0/2472682886 learned_addr learned my addr 172.21.15.86:0/2472682886 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d5d9b700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d006bcd0 0x7f89d0153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d659c700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d01443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 -- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 msgr2=0x7f89d01443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d01443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 -- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d006bcd0 msgr2=0x7f89d0153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:55.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d006bcd0 0x7f89d0153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 -- 172.21.15.86:0/2472682886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00094f0 con 0x7f89d006c0a0 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d659c700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d01443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d559a700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d0143e80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f89c0006fd0 tx=0x7f89c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89c5ffb700 1 -- 172.21.15.86:0/2472682886 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c001f070 con 0x7f89d006c0a0 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89c5ffb700 1 -- 172.21.15.86:0/2472682886 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0011e20 con 0x7f89d006c0a0 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.995+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d0158050 con 0x7f89d006c0a0 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.996+0000 7f89c5ffb700 1 -- 172.21.15.86:0/2472682886 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c001a670 con 0x7f89d006c0a0 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.996+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d0158610 con 0x7f89d006c0a0 2023-10-09T11:53:56.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.997+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0158dd0 con 0x7f89d006c0a0 2023-10-09T11:53:56.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.997+0000 7f89c5ffb700 1 -- 172.21.15.86:0/2472682886 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89c001aa20 con 0x7f89d006c0a0 2023-10-09T11:53:56.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.998+0000 7f89c5ffb700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f89b4066f30 0x7f89b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.998+0000 7f89c5ffb700 1 -- 172.21.15.86:0/2472682886 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7f89c0085b20 con 0x7f89d006c0a0 2023-10-09T11:53:56.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.998+0000 7f89d5d9b700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f89b4066f30 0x7f89b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:55.999+0000 7f89d5d9b700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f89b4066f30 0x7f89b40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f89cc006fd0 tx=0x7f89cc008040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.002+0000 7f89c5ffb700 1 -- 172.21.15.86:0/2472682886 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89c0052ce0 con 0x7f89d006c0a0 2023-10-09T11:53:56.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.193+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f89d0071280 con 0x7f89d006c0a0 2023-10-09T11:53:56.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.198+0000 7f89c5ffb700 1 -- 172.21.15.86:0/2472682886 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f89c00150b0 con 0x7f89d006c0a0 2023-10-09T11:53:56.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f89b4066f30 msgr2=0x7f89b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f89b4066f30 0x7f89b40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f89cc006fd0 tx=0x7f89cc008040 comp rx=0 tx=0).stop 2023-10-09T11:53:56.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 msgr2=0x7f89d0143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d0143e80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f89c0006fd0 tx=0x7f89c0017000 comp rx=0 tx=0).stop 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 shutdown_connections 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89d015df50 0x7f89d01443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d006bcd0 0x7f89d0153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f89b4066f30 0x7f89b40693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 --2- 172.21.15.86:0/2472682886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d006c0a0 0x7f89d0143e80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 >> 172.21.15.86:0/2472682886 conn(0x7f89d00ce600 msgr2=0x7f89d006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 shutdown_connections 2023-10-09T11:53:56.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.201+0000 7f89d7fff700 1 -- 172.21.15.86:0/2472682886 wait complete. 2023-10-09T11:53:56.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T11:53:56.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.400+0000 7eff6c5ff700 1 Processor -- start 2023-10-09T11:53:56.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.400+0000 7eff6c5ff700 1 -- start start 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6c5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff640caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6c5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff6415df50 0x7eff6415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6c5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6415d7e0 con 0x7eff6406bcd0 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6c5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6415dac0 con 0x7eff6415df50 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6c5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6415aa30 con 0x7eff6406c0a0 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6ab9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff6415df50 0x7eff6415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6ab9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff6415df50 0x7eff6415e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54114/0 (socket says 172.21.15.86:54114) 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6a39b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7eff6406bcd0 0x7eff6415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52768/0 (socket says 172.21.15.86:52768) 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6ab9c700 1 -- 172.21.15.86:0/397156424 learned_addr learned my addr 172.21.15.86:0/397156424 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:56.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff69b9a700 1 --2- 172.21.15.86:0/397156424 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff640caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6ab9c700 1 -- 172.21.15.86:0/397156424 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 msgr2=0x7eff640caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:56.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6ab9c700 1 --2- 172.21.15.86:0/397156424 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff640caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6ab9c700 1 -- 172.21.15.86:0/397156424 >> v1:172.21.15.86:6789/0 conn(0x7eff6406bcd0 legacy=0x7eff6415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.402+0000 7eff6ab9c700 1 -- 172.21.15.86:0/397156424 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6415ad10 con 0x7eff6415df50 2023-10-09T11:53:56.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.403+0000 7eff6ab9c700 1 --2- 172.21.15.86:0/397156424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6415e3c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009f20 tx=0x7eff5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0eba322f89b77e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.403+0000 7eff69399700 1 -- 172.21.15.86:0/397156424 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00e070 con 0x7eff6415df50 2023-10-09T11:53:56.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.403+0000 7eff69399700 1 -- 172.21.15.86:0/397156424 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00ba80 con 0x7eff6415df50 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.403+0000 7eff69399700 1 -- 172.21.15.86:0/397156424 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0092e0 con 0x7eff6415df50 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.403+0000 7eff6c5ff700 1 -- 172.21.15.86:0/397156424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 msgr2=0x7eff6415e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.403+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/397156424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6415e3c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009f20 tx=0x7eff5c009840 comp rx=0 tx=0).stop 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.404+0000 7eff6c5ff700 1 -- 172.21.15.86:0/397156424 shutdown_connections 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.404+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/397156424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6415e3c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.404+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/397156424 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff640caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.404+0000 7eff6c5ff700 1 -- 172.21.15.86:0/397156424 >> 172.21.15.86:0/397156424 conn(0x7eff640ce600 msgr2=0x7eff640cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.404+0000 7eff6c5ff700 1 -- 172.21.15.86:0/397156424 shutdown_connections 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.404+0000 7eff6c5ff700 1 -- 172.21.15.86:0/397156424 wait complete. 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.405+0000 7eff6c5ff700 1 Processor -- start 2023-10-09T11:53:56.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.405+0000 7eff6c5ff700 1 -- start start 2023-10-09T11:53:56.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff6406bcd0 0x7eff6414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6c5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff6416d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6c5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6416de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6c5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640c85e0 con 0x7eff6415df50 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640b3670 con 0x7eff6406bcd0 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6c5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff640b3eb0 con 0x7eff6406c0a0 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6ab9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6416de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6ab9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6416de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54124/0 (socket says 172.21.15.86:54124) 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6ab9c700 1 -- 172.21.15.86:0/4214956155 learned_addr learned my addr 172.21.15.86:0/4214956155 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff6a39b700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff6406bcd0 0x7eff6414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.406+0000 7eff69b9a700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff6416d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6ab9c700 1 -- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 msgr2=0x7eff6416d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6ab9c700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff6416d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6ab9c700 1 -- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff6406bcd0 msgr2=0x7eff6414a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6ab9c700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff6406bcd0 0x7eff6414a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6ab9c700 1 -- 172.21.15.86:0/4214956155 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009ae0 con 0x7eff6415df50 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6ab9c700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6416de70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00b6c0 tx=0x7eff5c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff5a7fc700 1 -- 172.21.15.86:0/4214956155 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0092e0 con 0x7eff6415df50 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff5a7fc700 1 -- 172.21.15.86:0/4214956155 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c007b40 con 0x7eff6415df50 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff5a7fc700 1 -- 172.21.15.86:0/4214956155 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c01d420 con 0x7eff6415df50 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff640b4340 con 0x7eff6415df50 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.407+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff640c83b0 con 0x7eff6415df50 2023-10-09T11:53:56.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.408+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6404c3c0 con 0x7eff6415df50 2023-10-09T11:53:56.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.409+0000 7eff5a7fc700 1 -- 172.21.15.86:0/4214956155 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff5c003050 con 0x7eff6415df50 2023-10-09T11:53:56.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.410+0000 7eff5a7fc700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7eff48066f30 0x7eff480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.410+0000 7eff5a7fc700 1 -- 172.21.15.86:0/4214956155 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7eff5c086300 con 0x7eff6415df50 2023-10-09T11:53:56.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.410+0000 7eff6a39b700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7eff48066f30 0x7eff480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.411+0000 7eff6a39b700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7eff48066f30 0x7eff480693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff60004fd0 tx=0x7eff60007eb0 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.414+0000 7eff5a7fc700 1 -- 172.21.15.86:0/4214956155 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff5c053440 con 0x7eff6415df50 2023-10-09T11:53:56.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.603+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7eff640b0f20 con 0x7eff6415df50 2023-10-09T11:53:56.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.607+0000 7eff5a7fc700 1 -- 172.21.15.86:0/4214956155 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7eff5c056a60 con 0x7eff6415df50 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7eff48066f30 msgr2=0x7eff480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7eff48066f30 0x7eff480693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff60004fd0 tx=0x7eff60007eb0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 msgr2=0x7eff6416de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6416de70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00b6c0 tx=0x7eff5c018000 comp rx=0 tx=0).stop 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 shutdown_connections 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7eff48066f30 0x7eff480693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff6415df50 0x7eff6416de70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff6406bcd0 0x7eff6414a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 --2- 172.21.15.86:0/4214956155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff6406c0a0 0x7eff6416d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 >> 172.21.15.86:0/4214956155 conn(0x7eff640ce600 msgr2=0x7eff6406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:56.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 shutdown_connections 2023-10-09T11:53:56.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.610+0000 7eff6c5ff700 1 -- 172.21.15.86:0/4214956155 wait complete. 2023-10-09T11:53:56.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:53:56.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.812+0000 7f620579d700 1 Processor -- start 2023-10-09T11:53:56.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.813+0000 7f620579d700 1 -- start start 2023-10-09T11:53:56.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f620579d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f62000c9db0 0x7f620006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f620579d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620006e150 con 0x7f6200153900 2023-10-09T11:53:56.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f620579d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62000c7800 con 0x7f6200157130 2023-10-09T11:53:56.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f620579d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000c7610 con 0x7f62000c9db0 2023-10-09T11:53:56.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f61fffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6200153900 0x7f62000c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52784/0 (socket says 172.21.15.86:52784) 2023-10-09T11:53:56.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f61fffff700 1 -- 172.21.15.86:0/208378639 learned_addr learned my addr 172.21.15.86:0/208378639 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:56.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972455294 0 0) 0x7f620006e150 con 0x7f6200153900 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.814+0000 7f61ff7fe700 1 --2- 172.21.15.86:0/208378639 >> v2:172.21.15.135:3300/0 conn(0x7f62000c9db0 0x7f620006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e8003570 con 0x7f6200153900 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3793598497 0 0) 0x7f61e8003570 con 0x7f6200153900 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 >> v2:172.21.15.135:3300/0 conn(0x7f62000c9db0 msgr2=0x7f620006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 --2- 172.21.15.86:0/208378639 >> v2:172.21.15.135:3300/0 conn(0x7f62000c9db0 0x7f620006a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 >> v1:172.21.15.135:6789/0 conn(0x7f6200157130 legacy=0x7f620006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000c7ae0 con 0x7f6200153900 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f61f0001470 con 0x7f6200153900 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 >> v1:172.21.15.86:6789/0 conn(0x7f6200153900 legacy=0x7f62000c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8003a60 0x7f61e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e8004810 0x7f61e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61e80051c0 0x7f61e800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e800e340 con 0x7f61e8003a60 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e800e4b0 con 0x7f61e8004810 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e800e670 con 0x7f61e80051c0 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61fffff700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8003a60 0x7f61e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f61ff7fe700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e8004810 0x7f61e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.815+0000 7f6204f9c700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61e80051c0 0x7f61e800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61ff7fe700 1 -- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61e80051c0 msgr2=0x7f61e800dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61ff7fe700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61e80051c0 0x7f61e800dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61ff7fe700 1 -- 172.21.15.86:0/208378639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8003a60 msgr2=0x7f61e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61ff7fe700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8003a60 0x7f61e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61ff7fe700 1 -- 172.21.15.86:0/208378639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8003570 con 0x7f61e8004810 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f6204f9c700 1 -- 172.21.15.86:0/208378639 reap_dead start 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61fffff700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8003a60 0x7f61e8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61ff7fe700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e8004810 0x7f61e8004c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62000ca1d0 tx=0x7f61f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891200b555932b76 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400e710 con 0x7f61e8004810 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f400e870 con 0x7f61e8004810 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.816+0000 7f61feffd700 1 -- 172.21.15.86:0/208378639 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400ec30 con 0x7f61e8004810 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.817+0000 7f620579d700 1 -- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e8004810 msgr2=0x7f61e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.817+0000 7f620579d700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e8004810 0x7f61e8004c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62000ca1d0 tx=0x7f61f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.817+0000 7f620579d700 1 -- 172.21.15.86:0/208378639 shutdown_connections 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.817+0000 7f620579d700 1 --2- 172.21.15.86:0/208378639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61e8004810 0x7f61e8004c80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.817+0000 7f620579d700 1 -- 172.21.15.86:0/208378639 >> 172.21.15.86:0/208378639 conn(0x7f62000cc1e0 msgr2=0x7f62000cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:56.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.817+0000 7f620579d700 1 -- 172.21.15.86:0/208378639 shutdown_connections 2023-10-09T11:53:56.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.817+0000 7f620579d700 1 -- 172.21.15.86:0/208378639 wait complete. 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.818+0000 7f620579d700 1 Processor -- start 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.819+0000 7f620579d700 1 -- start start 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.819+0000 7f620579d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8004810 0x7f6200152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.819+0000 7f620579d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62000aa2e0 0x7f62000aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.819+0000 7f620579d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62000b12f0 0x7f62000b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.819+0000 7f620579d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000aada0 con 0x7f61e8004810 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.819+0000 7f620579d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000ab080 con 0x7f62000b12f0 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.819+0000 7f620579d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62000acb10 con 0x7f62000aa2e0 2023-10-09T11:53:56.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8004810 0x7f6200152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8004810 0x7f6200152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54132/0 (socket says 172.21.15.86:54132) 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 -- 172.21.15.86:0/175412921 learned_addr learned my addr 172.21.15.86:0/175412921 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 -- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62000aa2e0 msgr2=0x7f62000aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62000aa2e0 0x7f62000aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f6204f9c700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62000b12f0 0x7f62000b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 -- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62000b12f0 msgr2=0x7f62000b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62000b12f0 0x7f62000b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 -- 172.21.15.86:0/175412921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000acdf0 con 0x7f61e8004810 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f6204f9c700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62000b12f0 0x7f62000b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61fffff700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8004810 0x7f6200152700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f61f00076f0 tx=0x7f61f0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.820+0000 7f61e7fff700 1 -- 172.21.15.86:0/175412921 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0018030 con 0x7f61e8004810 2023-10-09T11:53:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.821+0000 7f61e7fff700 1 -- 172.21.15.86:0/175412921 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f000fc60 con 0x7f61e8004810 2023-10-09T11:53:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.821+0000 7f61e7fff700 1 -- 172.21.15.86:0/175412921 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00133f0 con 0x7f61e8004810 2023-10-09T11:53:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.821+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62000b1cd0 con 0x7f61e8004810 2023-10-09T11:53:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.821+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62000c6330 con 0x7f61e8004810 2023-10-09T11:53:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.822+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62000ad030 con 0x7f61e8004810 2023-10-09T11:53:56.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.822+0000 7f61e7fff700 1 -- 172.21.15.86:0/175412921 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61f001b070 con 0x7f61e8004810 2023-10-09T11:53:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.823+0000 7f61e7fff700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f61ec066f30 0x7f61ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.823+0000 7f61e7fff700 1 -- 172.21.15.86:0/175412921 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7f61f0019070 con 0x7f61e8004810 2023-10-09T11:53:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.824+0000 7f61ff7fe700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f61ec066f30 0x7f61ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:56.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.824+0000 7f61ff7fe700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f61ec066f30 0x7f61ec0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f62000ac1d0 tx=0x7f61f401a000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:56.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:56.828+0000 7f61e7fff700 1 -- 172.21.15.86:0/175412921 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62000ad030 con 0x7f61e8004810 2023-10-09T11:53:57.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.017+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f62000ad030 con 0x7f61e8004810 2023-10-09T11:53:57.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.022+0000 7f61e7fff700 1 -- 172.21.15.86:0/175412921 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62000ad030 con 0x7f61e8004810 2023-10-09T11:53:57.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f61ec066f30 msgr2=0x7f61ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f61ec066f30 0x7f61ec0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f62000ac1d0 tx=0x7f61f401a000 comp rx=0 tx=0).stop 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8004810 msgr2=0x7f6200152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8004810 0x7f6200152700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f61f00076f0 tx=0x7f61f0001e50 comp rx=0 tx=0).stop 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 shutdown_connections 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f61ec066f30 0x7f61ec0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61e8004810 0x7f6200152700 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62000b12f0 0x7f62000b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 --2- 172.21.15.86:0/175412921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62000aa2e0 0x7f62000aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 >> 172.21.15.86:0/175412921 conn(0x7f62000cc1e0 msgr2=0x7f62000c1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:57.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 shutdown_connections 2023-10-09T11:53:57.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.024+0000 7f620579d700 1 -- 172.21.15.86:0/175412921 wait complete. 2023-10-09T11:53:57.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-09T11:53:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.224+0000 7f518b59d700 1 Processor -- start 2023-10-09T11:53:57.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.224+0000 7f518b59d700 1 -- start start 2023-10-09T11:53:57.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.225+0000 7f518b59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51841597f0 0x7f51840b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.225+0000 7f518b59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51840b11d0 con 0x7f518415d230 2023-10-09T11:53:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.225+0000 7f518b59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51840b14b0 con 0x7f5184159420 2023-10-09T11:53:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.225+0000 7f518b59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51840b1790 con 0x7f51841597f0 2023-10-09T11:53:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.225+0000 7f518ad9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f518415d230 0x7f518415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52798/0 (socket says 172.21.15.86:52798) 2023-10-09T11:53:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f518ad9c700 1 -- 172.21.15.86:0/1354254251 learned_addr learned my addr 172.21.15.86:0/1354254251 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:57.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189d9a700 1 --2- 172.21.15.86:0/1354254251 >> v2:172.21.15.135:3300/0 conn(0x7f51841597f0 0x7f51840b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189599700 1 -- 172.21.15.86:0/1354254251 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464523609 0 0) 0x7f51840b11d0 con 0x7f518415d230 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189599700 1 -- 172.21.15.86:0/1354254251 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5170003570 con 0x7f518415d230 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189599700 1 -- 172.21.15.86:0/1354254251 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023231561 0 0) 0x7f51840b14b0 con 0x7f5184159420 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189599700 1 -- 172.21.15.86:0/1354254251 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51840b11d0 con 0x7f5184159420 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189d9a700 1 -- 172.21.15.86:0/1354254251 >> v1:172.21.15.135:6789/0 conn(0x7f5184159420 legacy=0x7f51840b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189d9a700 1 -- 172.21.15.86:0/1354254251 >> v1:172.21.15.86:6789/0 conn(0x7f518415d230 legacy=0x7f518415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189d9a700 1 -- 172.21.15.86:0/1354254251 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51840b1a70 con 0x7f51841597f0 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.226+0000 7f5189d9a700 1 --2- 172.21.15.86:0/1354254251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f51840b2270 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51740098e0 tx=0x7f51740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1303232499e42b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:57.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f5189599700 1 -- 172.21.15.86:0/1354254251 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174011630 con 0x7f51841597f0 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f5189599700 1 -- 172.21.15.86:0/1354254251 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5174011790 con 0x7f51841597f0 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f5189599700 1 -- 172.21.15.86:0/1354254251 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174011b30 con 0x7f51841597f0 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f518b59d700 1 -- 172.21.15.86:0/1354254251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 msgr2=0x7f51840b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f518b59d700 1 --2- 172.21.15.86:0/1354254251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f51840b2270 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51740098e0 tx=0x7f51740091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f518b59d700 1 -- 172.21.15.86:0/1354254251 shutdown_connections 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f518b59d700 1 --2- 172.21.15.86:0/1354254251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f51840b2270 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f518b59d700 1 -- 172.21.15.86:0/1354254251 >> 172.21.15.86:0/1354254251 conn(0x7f51840d0660 msgr2=0x7f51840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f518b59d700 1 -- 172.21.15.86:0/1354254251 shutdown_connections 2023-10-09T11:53:57.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.227+0000 7f518b59d700 1 -- 172.21.15.86:0/1354254251 wait complete. 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.229+0000 7f518b59d700 1 Processor -- start 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.229+0000 7f518b59d700 1 -- start start 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518b59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5184159420 0x7f518415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518b59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f5184068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518b59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f518415d230 0x7f51840690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518b59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840c6fe0 con 0x7f518415d230 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518b59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51840c6360 con 0x7f51841597f0 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518b59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51840c6640 con 0x7f5184159420 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518ad9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f518415d230 0x7f51840690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518ad9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f518415d230 0x7f51840690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54144/0 (socket says 172.21.15.86:54144) 2023-10-09T11:53:57.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518ad9c700 1 -- 172.21.15.86:0/1288952089 learned_addr learned my addr 172.21.15.86:0/1288952089 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f5189d9a700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f5184068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518a59b700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5184159420 0x7f518415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518ad9c700 1 -- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5184159420 msgr2=0x7f518415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518ad9c700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5184159420 0x7f518415c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518ad9c700 1 -- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 msgr2=0x7f5184068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.230+0000 7f518ad9c700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f5184068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f518ad9c700 1 -- 172.21.15.86:0/1288952089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5174009420 con 0x7f518415d230 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f5189d9a700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f5184068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f518ad9c700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f518415d230 0x7f51840690f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f517c001460 tx=0x7f517c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f517a7fc700 1 -- 172.21.15.86:0/1288952089 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c00a910 con 0x7f518415d230 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f517a7fc700 1 -- 172.21.15.86:0/1288952089 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c00aa70 con 0x7f518415d230 2023-10-09T11:53:57.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f517a7fc700 1 -- 172.21.15.86:0/1288952089 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c00ae30 con 0x7f518415d230 2023-10-09T11:53:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51840c6920 con 0x7f518415d230 2023-10-09T11:53:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.231+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518415cc90 con 0x7f518415d230 2023-10-09T11:53:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.232+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51840c7120 con 0x7f518415d230 2023-10-09T11:53:57.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.233+0000 7f517a7fc700 1 -- 172.21.15.86:0/1288952089 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f517c007300 con 0x7f518415d230 2023-10-09T11:53:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.234+0000 7f517a7fc700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5168066f30 0x7f51680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.234+0000 7f517a7fc700 1 -- 172.21.15.86:0/1288952089 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7f517c0849f0 con 0x7f518415d230 2023-10-09T11:53:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.234+0000 7f518a59b700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5168066f30 0x7f51680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.235+0000 7f518a59b700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5168066f30 0x7f51680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5180003870 tx=0x7f5180009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:57.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.238+0000 7f517a7fc700 1 -- 172.21.15.86:0/1288952089 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f517c051bb0 con 0x7f518415d230 2023-10-09T11:53:57.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.504+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f518404c3c0 con 0x7f518415d230 2023-10-09T11:53:57.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.775+0000 7f517a7fc700 1 -- 172.21.15.86:0/1288952089 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v453) v1 ==== 158+0+0 (secure 0 0 0) 0x7f517c0551d0 con 0x7f518415d230 2023-10-09T11:53:57.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5168066f30 msgr2=0x7f51680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5168066f30 0x7f51680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5180003870 tx=0x7f5180009040 comp rx=0 tx=0).stop 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f518415d230 msgr2=0x7f51840690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f518415d230 0x7f51840690f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f517c001460 tx=0x7f517c001a20 comp rx=0 tx=0).stop 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 shutdown_connections 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5168066f30 0x7f51680693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f518415d230 0x7f51840690f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5184159420 0x7f518415c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 --2- 172.21.15.86:0/1288952089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51841597f0 0x7f5184068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 >> 172.21.15.86:0/1288952089 conn(0x7f51840d0660 msgr2=0x7f5184155240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 shutdown_connections 2023-10-09T11:53:57.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.778+0000 7f518b59d700 1 -- 172.21.15.86:0/1288952089 wait complete. 2023-10-09T11:53:57.796 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-10-09T11:53:57.797 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-10-09T11:53:57.797 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T11:53:57.797 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-09T11:53:57.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.975+0000 7f1da0dff700 1 Processor -- start 2023-10-09T11:53:57.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.975+0000 7f1da0dff700 1 -- start start 2023-10-09T11:53:57.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1da0dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1d9c0b1420 0x7f1d9c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1da0dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d9c0ccf90 0x7f1d9c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1da0dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0cc300 con 0x7f1d9c0cbf30 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1da0dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c156bf0 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1da0dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0ae950 con 0x7f1d9c0b1420 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d9ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d9c0ccf90 0x7f1d9c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d9ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d9c0ccf90 0x7f1d9c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54158/0 (socket says 172.21.15.86:54158) 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/1691523808 learned_addr learned my addr 172.21.15.86:0/1691523808 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d93fff700 1 --2- 172.21.15.86:0/1691523808 >> v2:172.21.15.135:3300/0 conn(0x7f1d9c0b1420 0x7f1d9c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/1691523808 >> v2:172.21.15.135:3300/0 conn(0x7f1d9c0b1420 msgr2=0x7f1d9c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d9ad9d700 1 --2- 172.21.15.86:0/1691523808 >> v2:172.21.15.135:3300/0 conn(0x7f1d9c0b1420 0x7f1d9c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/1691523808 >> v1:172.21.15.135:6789/0 conn(0x7f1d9c0cbf30 legacy=0x7f1d9c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/1691523808 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0ad370 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.977+0000 7f1d93fff700 1 --2- 172.21.15.86:0/1691523808 >> v2:172.21.15.135:3300/0 conn(0x7f1d9c0b1420 0x7f1d9c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:53:57.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.978+0000 7f1d9ad9d700 1 --2- 172.21.15.86:0/1691523808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c0c9740 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0c9280 tx=0x7f1d94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39facf0c9a743f88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:57.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.978+0000 7f1d99d9b700 1 -- 172.21.15.86:0/1691523808 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400e070 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.978+0000 7f1d99d9b700 1 -- 172.21.15.86:0/1691523808 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400ba40 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.978+0000 7f1d99d9b700 1 -- 172.21.15.86:0/1691523808 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940092e0 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.978+0000 7f1da0dff700 1 -- 172.21.15.86:0/1691523808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 msgr2=0x7f1d9c0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.978+0000 7f1da0dff700 1 --2- 172.21.15.86:0/1691523808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c0c9740 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0c9280 tx=0x7f1d94009840 comp rx=0 tx=0).stop 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.979+0000 7f1da0dff700 1 -- 172.21.15.86:0/1691523808 shutdown_connections 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.979+0000 7f1da0dff700 1 --2- 172.21.15.86:0/1691523808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c0c9740 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.979+0000 7f1da0dff700 1 --2- 172.21.15.86:0/1691523808 >> v2:172.21.15.135:3300/0 conn(0x7f1d9c0b1420 0x7f1d9c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.979+0000 7f1da0dff700 1 -- 172.21.15.86:0/1691523808 >> 172.21.15.86:0/1691523808 conn(0x7f1d9c06a320 msgr2=0x7f1d9c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.979+0000 7f1da0dff700 1 -- 172.21.15.86:0/1691523808 shutdown_connections 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.979+0000 7f1da0dff700 1 -- 172.21.15.86:0/1691523808 wait complete. 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.980+0000 7f1da0dff700 1 Processor -- start 2023-10-09T11:53:57.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.980+0000 7f1da0dff700 1 -- start start 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1da0dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d9c0b1420 0x7f1d9c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1da0dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d9c0cbf30 0x7f1d9c153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1da0dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1da0dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0aa850 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1da0dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0c1810 con 0x7f1d9c0b1420 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1da0dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0a9c40 con 0x7f1d9c0cbf30 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1d9ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1d9ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54170/0 (socket says 172.21.15.86:54170) 2023-10-09T11:53:57.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.981+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/930287514 learned_addr learned my addr 172.21.15.86:0/930287514 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d9c0cbf30 msgr2=0x7f1d9c153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9ad9d700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d9c0cbf30 0x7f1d9c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d9c0b1420 msgr2=0x7f1d9c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9a59c700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d9c0b1420 0x7f1d9c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9ad9d700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d9c0b1420 0x7f1d9c0c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9ad9d700 1 -- 172.21.15.86:0/930287514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009ae0 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9a59c700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d9c0b1420 0x7f1d9c0c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d9ad9d700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c155be0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009880 tx=0x7f1d94018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d927fc700 1 -- 172.21.15.86:0/930287514 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94008e40 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d927fc700 1 -- 172.21.15.86:0/930287514 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400be50 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1d927fc700 1 -- 172.21.15.86:0/930287514 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9401c660 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.982+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c0a9f20 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.983+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c0aa4e0 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.983+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c0aa9c0 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.984+0000 7f1d927fc700 1 -- 172.21.15.86:0/930287514 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d94003040 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.985+0000 7f1d927fc700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d7c066f30 0x7f1d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:57.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.985+0000 7f1d927fc700 1 -- 172.21.15.86:0/930287514 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7f1d94085eb0 con 0x7f1d9c0ccf90 2023-10-09T11:53:57.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.985+0000 7f1d9a59c700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d7c066f30 0x7f1d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:57.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.986+0000 7f1d9a59c700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d7c066f30 0x7f1d7c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c001840 tx=0x7f1d8c009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:57.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:57.989+0000 7f1d927fc700 1 -- 172.21.15.86:0/930287514 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d94052ff0 con 0x7f1d9c0ccf90 2023-10-09T11:53:58.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.254+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f1d9c04c3c0 con 0x7f1d9c0ccf90 2023-10-09T11:53:58.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.777+0000 7f1d927fc700 1 -- 172.21.15.86:0/930287514 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v454) v1 ==== 157+0+0 (secure 0 0 0) 0x7f1d94056610 con 0x7f1d9c0ccf90 2023-10-09T11:53:58.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d7c066f30 msgr2=0x7f1d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:58.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d7c066f30 0x7f1d7c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c001840 tx=0x7f1d8c009040 comp rx=0 tx=0).stop 2023-10-09T11:53:58.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 msgr2=0x7f1d9c155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c155be0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009880 tx=0x7f1d94018000 comp rx=0 tx=0).stop 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 shutdown_connections 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d7c066f30 0x7f1d7c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d9c0ccf90 0x7f1d9c155be0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d9c0b1420 0x7f1d9c0c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 --2- 172.21.15.86:0/930287514 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d9c0cbf30 0x7f1d9c153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 >> 172.21.15.86:0/930287514 conn(0x7f1d9c06a320 msgr2=0x7f1d9c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 shutdown_connections 2023-10-09T11:53:58.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.780+0000 7f1da0dff700 1 -- 172.21.15.86:0/930287514 wait complete. 2023-10-09T11:53:58.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:53:58.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.984+0000 7f9a1319d700 1 Processor -- start 2023-10-09T11:53:58.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.984+0000 7f9a1319d700 1 -- start start 2023-10-09T11:53:58.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.985+0000 7f9a1319d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a0c0cb1a0 0x7f9a0c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:58.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a1319d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c06ebd0 con 0x7f9a0c15a8a0 2023-10-09T11:53:58.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a1319d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c15ad20 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a1319d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c15b2e0 con 0x7f9a0c0cb1a0 2023-10-09T11:53:58.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a1199a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9a0c15a8a0 0x7f9a0c06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52804/0 (socket says 172.21.15.86:52804) 2023-10-09T11:53:58.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a1199a700 1 -- 172.21.15.86:0/1230858955 learned_addr learned my addr 172.21.15.86:0/1230858955 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:58.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a1219b700 1 --2- 172.21.15.86:0/1230858955 >> v2:172.21.15.135:3300/0 conn(0x7f9a0c0cb1a0 0x7f9a0c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:58.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a11199700 1 -- 172.21.15.86:0/1230858955 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469179028 0 0) 0x7f9a0c06ebd0 con 0x7f9a0c15a8a0 2023-10-09T11:53:58.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.986+0000 7f9a11199700 1 -- 172.21.15.86:0/1230858955 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f8003570 con 0x7f9a0c15a8a0 2023-10-09T11:53:58.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a1219b700 1 -- 172.21.15.86:0/1230858955 >> v1:172.21.15.135:6789/0 conn(0x7f9a0c0ae0d0 legacy=0x7f9a0c0ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:58.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a11199700 1 -- 172.21.15.86:0/1230858955 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369802444 0 0) 0x7f9a0c15ad20 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a1219b700 1 -- 172.21.15.86:0/1230858955 >> v1:172.21.15.86:6789/0 conn(0x7f9a0c15a8a0 legacy=0x7f9a0c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a1219b700 1 -- 172.21.15.86:0/1230858955 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c15b000 con 0x7f9a0c0cb1a0 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a1219b700 1 --2- 172.21.15.86:0/1230858955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c15a360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85be1c74f1866d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a11199700 1 -- 172.21.15.86:0/1230858955 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc001470 con 0x7f9a0c0cb1a0 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a11199700 1 -- 172.21.15.86:0/1230858955 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08011420 con 0x7f9a0c0cb1a0 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.987+0000 7f9a11199700 1 -- 172.21.15.86:0/1230858955 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080117c0 con 0x7f9a0c0cb1a0 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.988+0000 7f9a1319d700 1 -- 172.21.15.86:0/1230858955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 msgr2=0x7f9a0c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.988+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1230858955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c15a360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.988+0000 7f9a1319d700 1 -- 172.21.15.86:0/1230858955 shutdown_connections 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.988+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1230858955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c15a360 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.988+0000 7f9a1319d700 1 -- 172.21.15.86:0/1230858955 >> 172.21.15.86:0/1230858955 conn(0x7f9a0c0cc1e0 msgr2=0x7f9a0c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:58.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.988+0000 7f9a1319d700 1 -- 172.21.15.86:0/1230858955 shutdown_connections 2023-10-09T11:53:58.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.988+0000 7f9a1319d700 1 -- 172.21.15.86:0/1230858955 wait complete. 2023-10-09T11:53:58.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.989+0000 7f9a1319d700 1 Processor -- start 2023-10-09T11:53:58.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.989+0000 7f9a1319d700 1 -- start start 2023-10-09T11:53:58.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1319d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a0c0ae0d0 0x7f9a0c153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:58.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1319d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c16dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:58.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1319d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a0c153ba0 0x7f9a0c158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:58.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1319d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c16d7c0 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1319d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c16a690 con 0x7f9a0c0cb1a0 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1319d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c16a970 con 0x7f9a0c153ba0 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1219b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a0c0ae0d0 0x7f9a0c153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.990+0000 7f9a1219b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a0c0ae0d0 0x7f9a0c153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54186/0 (socket says 172.21.15.86:54186) 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1219b700 1 -- 172.21.15.86:0/1628235551 learned_addr learned my addr 172.21.15.86:0/1628235551 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1219b700 1 -- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a0c153ba0 msgr2=0x7f9a0c158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1199a700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c16dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1299c700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a0c153ba0 0x7f9a0c158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1219b700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a0c153ba0 0x7f9a0c158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1219b700 1 -- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 msgr2=0x7f9a0c16dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1219b700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c16dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:58.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1219b700 1 -- 172.21.15.86:0/1628235551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009420 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1199a700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c16dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1299c700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a0c153ba0 0x7f9a0c158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1219b700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a0c0ae0d0 0x7f9a0c153600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9a080093f0 tx=0x7f9a08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a027fc700 1 -- 172.21.15.86:0/1628235551 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800bd70 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a027fc700 1 -- 172.21.15.86:0/1628235551 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0801d430 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.991+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c16d170 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.992+0000 7f9a027fc700 1 -- 172.21.15.86:0/1628235551 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0801d7f0 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.992+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c159340 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.993+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c16d610 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.993+0000 7f9a027fc700 1 -- 172.21.15.86:0/1628235551 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a0801dc20 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.994+0000 7f9a027fc700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f99f0066f60 0x7f99f0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.994+0000 7f9a027fc700 1 -- 172.21.15.86:0/1628235551 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7f9a08086290 con 0x7f9a0c0ae0d0 2023-10-09T11:53:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.995+0000 7f9a1199a700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f99f0066f60 0x7f99f0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:58.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.995+0000 7f9a1199a700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f99f0066f60 0x7f99f0069410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0011e0 tx=0x7f99fc009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:58.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:58.998+0000 7f9a027fc700 1 -- 172.21.15.86:0/1628235551 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a080533d0 con 0x7f9a0c0ae0d0 2023-10-09T11:53:59.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.188+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9a0c06e860 con 0x7f9a0c0ae0d0 2023-10-09T11:53:59.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.192+0000 7f9a027fc700 1 -- 172.21.15.86:0/1628235551 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9a080569f0 con 0x7f9a0c0ae0d0 2023-10-09T11:53:59.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f99f0066f60 msgr2=0x7f99f0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f99f0066f60 0x7f99f0069410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0011e0 tx=0x7f99fc009040 comp rx=0 tx=0).stop 2023-10-09T11:53:59.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a0c0ae0d0 msgr2=0x7f9a0c153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a0c0ae0d0 0x7f9a0c153600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9a080093f0 tx=0x7f9a08017000 comp rx=0 tx=0).stop 2023-10-09T11:53:59.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 shutdown_connections 2023-10-09T11:53:59.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f99f0066f60 0x7f99f0069410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a0c0ae0d0 0x7f9a0c153600 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a0c153ba0 0x7f9a0c158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 --2- 172.21.15.86:0/1628235551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0c0cb1a0 0x7f9a0c16dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 >> 172.21.15.86:0/1628235551 conn(0x7f9a0c0cc1e0 msgr2=0x7f9a0c155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:59.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 shutdown_connections 2023-10-09T11:53:59.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.195+0000 7f9a1319d700 1 -- 172.21.15.86:0/1628235551 wait complete. 2023-10-09T11:53:59.213 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:53:59.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:53:59.300 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:53:59.383 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:53:59.383 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:53:59.383 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:53:59.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.562+0000 7f8e9339d700 1 Processor -- start 2023-10-09T11:53:59.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.562+0000 7f8e9339d700 1 -- start start 2023-10-09T11:53:59.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.563+0000 7f8e9339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150550 0x7f8e8c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:59.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.563+0000 7f8e9339d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8e8c0c7410 0x7f8e8c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:59.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.563+0000 7f8e9339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c06e2a0 con 0x7f8e8c150180 2023-10-09T11:53:59.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.563+0000 7f8e9339d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c06b2e0 con 0x7f8e8c0c7410 2023-10-09T11:53:59.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.563+0000 7f8e9339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0c78e0 con 0x7f8e8c150550 2023-10-09T11:53:59.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e92b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8e8c0c7410 0x7f8e8c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:59.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e9239b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8e8c150180 0x7f8e8c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:54910/0 (socket says 172.21.15.86:54910) 2023-10-09T11:53:59.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e9239b700 1 -- 172.21.15.86:0/1499818818 learned_addr learned my addr 172.21.15.86:0/1499818818 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:53:59.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e91b9a700 1 --2- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150550 0x7f8e8c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:59.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e91399700 1 -- 172.21.15.86:0/1499818818 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485687957 0 0) 0x7f8e8c06e2a0 con 0x7f8e8c150180 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e91399700 1 -- 172.21.15.86:0/1499818818 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e78004680 con 0x7f8e8c150180 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e92b9c700 1 -- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150550 msgr2=0x7f8e8c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e92b9c700 1 --2- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150550 0x7f8e8c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e92b9c700 1 -- 172.21.15.86:0/1499818818 >> v1:172.21.15.135:6789/0 conn(0x7f8e8c150180 legacy=0x7f8e8c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e92b9c700 1 -- 172.21.15.86:0/1499818818 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0c7bc0 con 0x7f8e8c0c7410 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.564+0000 7f8e91b9a700 1 --2- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150550 0x7f8e8c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.565+0000 7f8e92b9c700 1 --2- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 0x7f8e8c069f50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009e90 tx=0x7f8e84009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cc70ea36e09adff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.565+0000 7f8e91399700 1 -- 172.21.15.86:0/1499818818 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400e070 con 0x7f8e8c0c7410 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.565+0000 7f8e91399700 1 -- 172.21.15.86:0/1499818818 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8400bb40 con 0x7f8e8c0c7410 2023-10-09T11:53:59.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.565+0000 7f8e91399700 1 -- 172.21.15.86:0/1499818818 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012430 con 0x7f8e8c0c7410 2023-10-09T11:53:59.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.565+0000 7f8e9339d700 1 -- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 msgr2=0x7f8e8c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.565+0000 7f8e9339d700 1 --2- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 0x7f8e8c069f50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009e90 tx=0x7f8e84009780 comp rx=0 tx=0).stop 2023-10-09T11:53:59.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.566+0000 7f8e9339d700 1 -- 172.21.15.86:0/1499818818 shutdown_connections 2023-10-09T11:53:59.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.566+0000 7f8e9339d700 1 --2- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 0x7f8e8c069f50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.566+0000 7f8e9339d700 1 --2- 172.21.15.86:0/1499818818 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150550 0x7f8e8c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.566+0000 7f8e9339d700 1 -- 172.21.15.86:0/1499818818 >> 172.21.15.86:0/1499818818 conn(0x7f8e8c0cc1f0 msgr2=0x7f8e8c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:59.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.566+0000 7f8e9339d700 1 -- 172.21.15.86:0/1499818818 shutdown_connections 2023-10-09T11:53:59.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.566+0000 7f8e9339d700 1 -- 172.21.15.86:0/1499818818 wait complete. 2023-10-09T11:53:59.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.567+0000 7f8e9339d700 1 Processor -- start 2023-10-09T11:53:59.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.567+0000 7f8e9339d700 1 -- start start 2023-10-09T11:53:59.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e9339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 0x7f8e8c148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:59.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e9339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150180 0x7f8e8c0c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e9339d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e8c150550 0x7f8e8c0a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e9339d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c06a810 con 0x7f8e8c150550 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e9339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0ac990 con 0x7f8e8c0c7410 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e9339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0ac660 con 0x7f8e8c150180 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e92b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e8c150550 0x7f8e8c0a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e92b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e8c150550 0x7f8e8c0a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54200/0 (socket says 172.21.15.86:54200) 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e92b9c700 1 -- 172.21.15.86:0/3646112114 learned_addr learned my addr 172.21.15.86:0/3646112114 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.568+0000 7f8e9239b700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 0x7f8e8c148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e91b9a700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150180 0x7f8e8c0c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e92b9c700 1 -- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150180 msgr2=0x7f8e8c0c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e92b9c700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150180 0x7f8e8c0c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e92b9c700 1 -- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 msgr2=0x7f8e8c148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e92b9c700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 0x7f8e8c148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e92b9c700 1 -- 172.21.15.86:0/3646112114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009420 con 0x7f8e8c150550 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e92b9c700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e8c150550 0x7f8e8c0a98d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e84013000 tx=0x7f8e84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e827fc700 1 -- 172.21.15.86:0/3646112114 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84027470 con 0x7f8e8c150550 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e827fc700 1 -- 172.21.15.86:0/3646112114 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e840275d0 con 0x7f8e8c150550 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e827fc700 1 -- 172.21.15.86:0/3646112114 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84027990 con 0x7f8e8c150550 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.569+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e84009a20 con 0x7f8e8c150550 2023-10-09T11:53:59.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.570+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c06a530 con 0x7f8e8c150550 2023-10-09T11:53:59.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.571+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c0ac4c0 con 0x7f8e8c150550 2023-10-09T11:53:59.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.571+0000 7f8e827fc700 1 -- 172.21.15.86:0/3646112114 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e84024070 con 0x7f8e8c150550 2023-10-09T11:53:59.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.572+0000 7f8e827fc700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:53:59.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.572+0000 7f8e827fc700 1 -- 172.21.15.86:0/3646112114 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7f8e84086c80 con 0x7f8e8c150550 2023-10-09T11:53:59.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.572+0000 7f8e9239b700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:53:59.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.573+0000 7f8e9239b700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e70066f30 0x7f8e700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007fd0 tx=0x7f8e88009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:53:59.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.576+0000 7f8e827fc700 1 -- 172.21.15.86:0/3646112114 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e8c0ac4c0 con 0x7f8e8c150550 2023-10-09T11:53:59.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.812+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e8c0ac4c0 con 0x7f8e8c150550 2023-10-09T11:53:59.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.812+0000 7f8e827fc700 1 -- 172.21.15.86:0/3646112114 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f8e8c0ac4c0 con 0x7f8e8c150550 2023-10-09T11:53:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:53:59.814 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1552998028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1552998028},{"type":"v1","addr":"172.21.15.135:6834","nonce":1552998028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4607,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3861152933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3861152933},{"type":"v1","addr":"172.21.15.135:6835","nonce":3861152933}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4887,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/647611791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":647611791},{"type":"v1","addr":"172.21.15.86:6836","nonce":647611791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/531479939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":531479939},{"type":"v1","addr":"172.21.15.86:6833","nonce":531479939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-09T11:53:59.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.814+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e70066f30 msgr2=0x7f8e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.814+0000 7f8e9339d700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e70066f30 0x7f8e700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007fd0 tx=0x7f8e88009040 comp rx=0 tx=0).stop 2023-10-09T11:53:59.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.814+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e8c150550 msgr2=0x7f8e8c0a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:53:59.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.814+0000 7f8e9339d700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e8c150550 0x7f8e8c0a98d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e84013000 tx=0x7f8e84019000 comp rx=0 tx=0).stop 2023-10-09T11:53:59.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 shutdown_connections 2023-10-09T11:53:59.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e70066f30 0x7f8e700693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e8c150550 0x7f8e8c0a98d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c0c7410 0x7f8e8c148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 --2- 172.21.15.86:0/3646112114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c150180 0x7f8e8c0c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:53:59.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 >> 172.21.15.86:0/3646112114 conn(0x7f8e8c0cc1f0 msgr2=0x7f8e8c1494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:53:59.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 shutdown_connections 2023-10-09T11:53:59.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:53:59.815+0000 7f8e9339d700 1 -- 172.21.15.86:0/3646112114 wait complete. 2023-10-09T11:53:59.817 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 19 2023-10-09T11:53:59.833 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:53:59.833 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:53:59.834 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:53:59.834 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:53:59.834 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:53:59.834 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:53:59.834 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:53:59.834 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:53:59.835 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:53:59.835 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:53:59.835 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:53:59.835 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:53:59.835 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:53:59.835 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:53:59.835 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:53:59.836 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:53:59.848 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:53:59.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:53:59.849 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:53:59.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:53:59.851 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:53:59.851 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:53:59.852 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:53:59.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:53:59.893 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:53:59.893 DEBUG:teuthology.parallel:result is None 2023-10-09T11:53:59.895 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:53:59.896 DEBUG:teuthology.parallel:result is None 2023-10-09T11:53:59.896 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:53:59.896 DEBUG:teuthology.parallel:result is None 2023-10-09T11:53:59.899 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:53:59.899 DEBUG:teuthology.parallel:result is None 2023-10-09T11:53:59.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:54:00.026 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:54:00.032 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:54:00.039 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T11:54:00.040 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:54:00.041 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-10-09T11:54:00.040+0000 7f6e25ffd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-09T11:54:00.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.093+0000 7f9062fff700 1 Processor -- start 2023-10-09T11:54:00.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.093+0000 7f9062fff700 1 -- start start 2023-10-09T11:54:00.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9062fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f905c0b1850 0x7f905c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:00.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9062fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:00.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9062fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905c0cb300 con 0x7f905c0ae680 2023-10-09T11:54:00.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9062fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905c06fc30 con 0x7f905c0b1850 2023-10-09T11:54:00.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9062fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0cc260 con 0x7f905c1579f0 2023-10-09T11:54:00.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9060d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f905c0b1850 0x7f905c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:00.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f906159c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:00.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9060d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f905c0b1850 0x7f905c0b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54224/0 (socket says 172.21.15.86:54224) 2023-10-09T11:54:00.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9060d9b700 1 -- 172.21.15.86:0/3126687091 learned_addr learned my addr 172.21.15.86:0/3126687091 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:00.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f905bfff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f905c0ae680 0x7f905c1572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:54932/0 (socket says 172.21.15.86:54932) 2023-10-09T11:54:00.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f905b7fe700 1 -- 172.21.15.86:0/3126687091 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613864596 0 0) 0x7f905c0cb300 con 0x7f905c0ae680 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f905b7fe700 1 -- 172.21.15.86:0/3126687091 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f904c003570 con 0x7f905c0ae680 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9060d9b700 1 -- 172.21.15.86:0/3126687091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 msgr2=0x7f905c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9060d9b700 1 --2- 172.21.15.86:0/3126687091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.095+0000 7f9060d9b700 1 -- 172.21.15.86:0/3126687091 >> v1:172.21.15.135:6789/0 conn(0x7f905c0ae680 legacy=0x7f905c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f9060d9b700 1 -- 172.21.15.86:0/3126687091 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0cb5e0 con 0x7f905c0b1850 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f906159c700 1 --2- 172.21.15.86:0/3126687091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f9060d9b700 1 --2- 172.21.15.86:0/3126687091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c0b1c20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f90500099e0 tx=0x7f9050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90a907644fcdeb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f905b7fe700 1 -- 172.21.15.86:0/3126687091 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000b640 con 0x7f905c0b1850 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f905b7fe700 1 -- 172.21.15.86:0/3126687091 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905000b7a0 con 0x7f905c0b1850 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f905b7fe700 1 -- 172.21.15.86:0/3126687091 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000bb40 con 0x7f905c0b1850 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f9062fff700 1 -- 172.21.15.86:0/3126687091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 msgr2=0x7f905c0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:00.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.096+0000 7f9062fff700 1 --2- 172.21.15.86:0/3126687091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c0b1c20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f90500099e0 tx=0x7f9050009250 comp rx=0 tx=0).stop 2023-10-09T11:54:00.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.097+0000 7f9062fff700 1 -- 172.21.15.86:0/3126687091 shutdown_connections 2023-10-09T11:54:00.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.097+0000 7f9062fff700 1 --2- 172.21.15.86:0/3126687091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:00.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.097+0000 7f9062fff700 1 --2- 172.21.15.86:0/3126687091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c0b1c20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:00.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.097+0000 7f9062fff700 1 -- 172.21.15.86:0/3126687091 >> 172.21.15.86:0/3126687091 conn(0x7f905c06a320 msgr2=0x7f905c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:00.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.097+0000 7f9062fff700 1 -- 172.21.15.86:0/3126687091 shutdown_connections 2023-10-09T11:54:00.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.097+0000 7f9062fff700 1 -- 172.21.15.86:0/3126687091 wait complete. 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.098+0000 7f9062fff700 1 Processor -- start 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.098+0000 7f9062fff700 1 -- start start 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f9062fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f905c0ae680 0x7f905c14b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f9062fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f9062fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f9062fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c16ae10 con 0x7f905c0b1850 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f9062fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c14f300 con 0x7f905c0ae680 2023-10-09T11:54:00.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f9062fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c14b5d0 con 0x7f905c1579f0 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f905bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f905bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c14fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54230/0 (socket says 172.21.15.86:54230) 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.099+0000 7f905bfff700 1 -- 172.21.15.86:0/567954120 learned_addr learned my addr 172.21.15.86:0/567954120 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f906159c700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f9060d9b700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f905c0ae680 0x7f905c14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f905bfff700 1 -- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 msgr2=0x7f905c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f905bfff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f905bfff700 1 -- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f905c0ae680 msgr2=0x7f905c14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f905bfff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f905c0ae680 0x7f905c14b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f905bfff700 1 -- 172.21.15.86:0/567954120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054009a20 con 0x7f905c0b1850 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f905bfff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c14fd80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f904800c7f0 tx=0x7f9048007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:00.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f9058ff9700 1 -- 172.21.15.86:0/567954120 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048005a70 con 0x7f905c0b1850 2023-10-09T11:54:00.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f9058ff9700 1 -- 172.21.15.86:0/567954120 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048005bd0 con 0x7f905c0b1850 2023-10-09T11:54:00.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90500094f0 con 0x7f905c0b1850 2023-10-09T11:54:00.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.100+0000 7f9058ff9700 1 -- 172.21.15.86:0/567954120 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480070d0 con 0x7f905c0b1850 2023-10-09T11:54:00.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.101+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c14ecb0 con 0x7f905c0b1850 2023-10-09T11:54:00.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.101+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c04c3c0 con 0x7f905c0b1850 2023-10-09T11:54:00.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.102+0000 7f9058ff9700 1 -- 172.21.15.86:0/567954120 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90480074c0 con 0x7f905c0b1850 2023-10-09T11:54:00.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.103+0000 7f9058ff9700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9040066f30 0x7f90400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:00.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.103+0000 7f9058ff9700 1 -- 172.21.15.86:0/567954120 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5846+0+0 (secure 0 0 0) 0x7f9048083aa0 con 0x7f905c0b1850 2023-10-09T11:54:00.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.103+0000 7f9060d9b700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9040066f30 0x7f90400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:00.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.104+0000 7f9060d9b700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9040066f30 0x7f90400693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90500099e0 tx=0x7f9050017000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:00.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.107+0000 7f9058ff9700 1 -- 172.21.15.86:0/567954120 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9048050ca0 con 0x7f905c0b1850 2023-10-09T11:54:00.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:00.315+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f905c14f440 con 0x7f905c0b1850 2023-10-09T11:54:01.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.210+0000 7f9058ff9700 1 -- 172.21.15.86:0/567954120 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9048017070 con 0x7f905c0b1850 2023-10-09T11:54:01.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9040066f30 msgr2=0x7f90400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9040066f30 0x7f90400693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90500099e0 tx=0x7f9050017000 comp rx=0 tx=0).stop 2023-10-09T11:54:01.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 msgr2=0x7f905c14fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c14fd80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f904800c7f0 tx=0x7f9048007e00 comp rx=0 tx=0).stop 2023-10-09T11:54:01.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 shutdown_connections 2023-10-09T11:54:01.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f905c1579f0 0x7f905c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f905c0ae680 0x7f905c14b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9040066f30 0x7f90400693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 --2- 172.21.15.86:0/567954120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f905c0b1850 0x7f905c14fd80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 >> 172.21.15.86:0/567954120 conn(0x7f905c06a320 msgr2=0x7f905c15f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:01.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 shutdown_connections 2023-10-09T11:54:01.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.213+0000 7f9062fff700 1 -- 172.21.15.86:0/567954120 wait complete. 2023-10-09T11:54:01.216 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T11:54:01.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:54:01.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.418+0000 7f3b9f1ff700 1 Processor -- start 2023-10-09T11:54:01.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.418+0000 7f3b9f1ff700 1 -- start start 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.419+0000 7f3b9f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980cbf30 0x7f3b980ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.419+0000 7f3b9f1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b980b1420 0x7f3b980c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.419+0000 7f3b9f1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980cc300 con 0x7f3b980ccf90 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.419+0000 7f3b9f1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b98156bf0 con 0x7f3b980b1420 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.419+0000 7f3b9f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980ae950 con 0x7f3b980cbf30 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b980b1420 0x7f3b980c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b980b1420 0x7f3b980c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54244/0 (socket says 172.21.15.86:54244) 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 -- 172.21.15.86:0/2697681845 learned_addr learned my addr 172.21.15.86:0/2697681845 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9cf9b700 1 --2- 172.21.15.86:0/2697681845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980cbf30 0x7f3b980ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 -- 172.21.15.86:0/2697681845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980cbf30 msgr2=0x7f3b980ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:01.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 --2- 172.21.15.86:0/2697681845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980cbf30 0x7f3b980ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 -- 172.21.15.86:0/2697681845 >> v1:172.21.15.135:6789/0 conn(0x7f3b980ccf90 legacy=0x7f3b980b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 -- 172.21.15.86:0/2697681845 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980ad370 con 0x7f3b980b1420 2023-10-09T11:54:01.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.420+0000 7f3b9d79c700 1 --2- 172.21.15.86:0/2697681845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980b1420 0x7f3b980c9740 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009f50 tx=0x7f3b90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c930438fda8c270 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:01.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b977fe700 1 -- 172.21.15.86:0/2697681845 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000e070 con 0x7f3b980b1420 2023-10-09T11:54:01.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b977fe700 1 -- 172.21.15.86:0/2697681845 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9000ba70 con 0x7f3b980b1420 2023-10-09T11:54:01.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b977fe700 1 -- 172.21.15.86:0/2697681845 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900092e0 con 0x7f3b980b1420 2023-10-09T11:54:01.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/2697681845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980b1420 msgr2=0x7f3b980c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/2697681845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980b1420 0x7f3b980c9740 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009f50 tx=0x7f3b90009840 comp rx=0 tx=0).stop 2023-10-09T11:54:01.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/2697681845 shutdown_connections 2023-10-09T11:54:01.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/2697681845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980b1420 0x7f3b980c9740 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/2697681845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980cbf30 0x7f3b980ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/2697681845 >> 172.21.15.86:0/2697681845 conn(0x7f3b9806a320 msgr2=0x7f3b980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:01.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/2697681845 shutdown_connections 2023-10-09T11:54:01.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.421+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/2697681845 wait complete. 2023-10-09T11:54:01.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.423+0000 7f3b9f1ff700 1 Processor -- start 2023-10-09T11:54:01.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.423+0000 7f3b9f1ff700 1 -- start start 2023-10-09T11:54:01.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980b1420 0x7f3b9814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b980cbf30 0x7f3b981594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9f1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980ccf90 0x7f3b981508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9f1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981483b0 con 0x7f3b980ccf90 2023-10-09T11:54:01.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98159040 con 0x7f3b980cbf30 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98158430 con 0x7f3b980b1420 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980ccf90 0x7f3b981508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980ccf90 0x7f3b981508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54248/0 (socket says 172.21.15.86:54248) 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 -- 172.21.15.86:0/814566277 learned_addr learned my addr 172.21.15.86:0/814566277 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9cf9b700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980b1420 0x7f3b9814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b97fff700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b980cbf30 0x7f3b981594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 -- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980b1420 msgr2=0x7f3b9814dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980b1420 0x7f3b9814dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 -- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b980cbf30 msgr2=0x7f3b981594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b980cbf30 0x7f3b981594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9d79c700 1 -- 172.21.15.86:0/814566277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009ae0 con 0x7f3b980ccf90 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.424+0000 7f3b9cf9b700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980b1420 0x7f3b9814dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.425+0000 7f3b9d79c700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980ccf90 0x7f3b981508d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b90012000 tx=0x7f3b90018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.425+0000 7f3b94ff9700 1 -- 172.21.15.86:0/814566277 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900032f0 con 0x7f3b980ccf90 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.425+0000 7f3b94ff9700 1 -- 172.21.15.86:0/814566277 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90008e40 con 0x7f3b980ccf90 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.425+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b98158710 con 0x7f3b980ccf90 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.425+0000 7f3b94ff9700 1 -- 172.21.15.86:0/814566277 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90026690 con 0x7f3b980ccf90 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.425+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b98158cd0 con 0x7f3b980ccf90 2023-10-09T11:54:01.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.426+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b981591f0 con 0x7f3b980ccf90 2023-10-09T11:54:01.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.427+0000 7f3b94ff9700 1 -- 172.21.15.86:0/814566277 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b90003040 con 0x7f3b980ccf90 2023-10-09T11:54:01.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.428+0000 7f3b94ff9700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.428+0000 7f3b94ff9700 1 -- 172.21.15.86:0/814566277 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5201+0+0 (secure 0 0 0) 0x7f3b90085ea0 con 0x7f3b980ccf90 2023-10-09T11:54:01.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.428+0000 7f3b9cf9b700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.428+0000 7f3b9cf9b700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b7c066f30 0x7f3b7c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006fd0 tx=0x7f3b8c008040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:01.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.432+0000 7f3b94ff9700 1 -- 172.21.15.86:0/814566277 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b981591f0 con 0x7f3b980ccf90 2023-10-09T11:54:01.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.693+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3b981591f0 con 0x7f3b980ccf90 2023-10-09T11:54:01.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.694+0000 7f3b94ff9700 1 -- 172.21.15.86:0/814566277 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3b981591f0 con 0x7f3b980ccf90 2023-10-09T11:54:01.695 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:54:01.696 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.699 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.700 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T11:54:01.702 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.703 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.704 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.705 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T11:54:01.706 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.707 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:54:01.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T11:54:01.710 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:54:01.711 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:54:01.711 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:54:01.711 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:54:01.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:01.711 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T11:54:01.711 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:54:01.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b7c066f30 msgr2=0x7f3b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b7c066f30 0x7f3b7c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006fd0 tx=0x7f3b8c008040 comp rx=0 tx=0).stop 2023-10-09T11:54:01.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980ccf90 msgr2=0x7f3b981508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980ccf90 0x7f3b981508d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b90012000 tx=0x7f3b90018000 comp rx=0 tx=0).stop 2023-10-09T11:54:01.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 shutdown_connections 2023-10-09T11:54:01.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b980ccf90 0x7f3b981508d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b980b1420 0x7f3b9814dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 --2- 172.21.15.86:0/814566277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b980cbf30 0x7f3b981594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.696+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 >> 172.21.15.86:0/814566277 conn(0x7f3b9806a320 msgr2=0x7f3b980afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:01.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.697+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 shutdown_connections 2023-10-09T11:54:01.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.697+0000 7f3b9f1ff700 1 -- 172.21.15.86:0/814566277 wait complete. 2023-10-09T11:54:01.715 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:54:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.895+0000 7fa84cdff700 1 Processor -- start 2023-10-09T11:54:01.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.895+0000 7fa84cdff700 1 -- start start 2023-10-09T11:54:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.896+0000 7fa84cdff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa848155c10 0x7fa848155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.896+0000 7fa84cdff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480acac0 con 0x7fa8480ac6d0 2023-10-09T11:54:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.896+0000 7fa84cdff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480ad930 con 0x7fa8480ac230 2023-10-09T11:54:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.896+0000 7fa84cdff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480acd20 con 0x7fa848155c10 2023-10-09T11:54:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa84659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa848155c10 0x7fa848155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa846d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa8480ac6d0 0x7fa8480b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52814/0 (socket says 172.21.15.86:52814) 2023-10-09T11:54:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa846d9d700 1 -- 172.21.15.86:0/1660036708 learned_addr learned my addr 172.21.15.86:0/1660036708 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa84659c700 1 -- 172.21.15.86:0/1660036708 >> v1:172.21.15.135:6789/0 conn(0x7fa8480ac230 legacy=0x7fa8481568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa84659c700 1 -- 172.21.15.86:0/1660036708 >> v1:172.21.15.86:6789/0 conn(0x7fa8480ac6d0 legacy=0x7fa8480b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa84659c700 1 -- 172.21.15.86:0/1660036708 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480ad000 con 0x7fa848155c10 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa84559a700 1 -- 172.21.15.86:0/1660036708 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136328953 0 0) 0x7fa8480acac0 con 0x7fa8480ac6d0 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.897+0000 7fa84659c700 1 --2- 172.21.15.86:0/1660036708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848155c10 0x7fa848155fe0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa83800aa90 tx=0x7fa83800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f216b50f9b20d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84559a700 1 -- 172.21.15.86:0/1660036708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800ca40 con 0x7fa848155c10 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84559a700 1 -- 172.21.15.86:0/1660036708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800cba0 con 0x7fa848155c10 2023-10-09T11:54:01.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84559a700 1 -- 172.21.15.86:0/1660036708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838018400 con 0x7fa848155c10 2023-10-09T11:54:01.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84cdff700 1 -- 172.21.15.86:0/1660036708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848155c10 msgr2=0x7fa848155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1660036708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848155c10 0x7fa848155fe0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa83800aa90 tx=0x7fa83800a330 comp rx=0 tx=0).stop 2023-10-09T11:54:01.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84cdff700 1 -- 172.21.15.86:0/1660036708 shutdown_connections 2023-10-09T11:54:01.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1660036708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848155c10 0x7fa848155fe0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84cdff700 1 -- 172.21.15.86:0/1660036708 >> 172.21.15.86:0/1660036708 conn(0x7fa84806a320 msgr2=0x7fa8480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:01.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84cdff700 1 -- 172.21.15.86:0/1660036708 shutdown_connections 2023-10-09T11:54:01.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.898+0000 7fa84cdff700 1 -- 172.21.15.86:0/1660036708 wait complete. 2023-10-09T11:54:01.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.900+0000 7fa84cdff700 1 Processor -- start 2023-10-09T11:54:01.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.900+0000 7fa84cdff700 1 -- start start 2023-10-09T11:54:01.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa84cdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8480ac230 0x7fa8480c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa84cdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8480ac6d0 0x7fa8481678c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa84cdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848155c10 0x7fa848152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa84cdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa848168860 con 0x7fa8480ac6d0 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa84cdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa848167fc0 con 0x7fa848155c10 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa84cdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481682a0 con 0x7fa8480ac230 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa845d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8480ac6d0 0x7fa8481678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa845d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8480ac6d0 0x7fa8481678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54270/0 (socket says 172.21.15.86:54270) 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa845d9b700 1 -- 172.21.15.86:0/1276884962 learned_addr learned my addr 172.21.15.86:0/1276884962 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa84659c700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8480ac230 0x7fa8480c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.901+0000 7fa846d9d700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848155c10 0x7fa848152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa845d9b700 1 -- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8480ac230 msgr2=0x7fa8480c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa845d9b700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8480ac230 0x7fa8480c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa845d9b700 1 -- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848155c10 msgr2=0x7fa848152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa845d9b700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848155c10 0x7fa848152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa845d9b700 1 -- 172.21.15.86:0/1276884962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83800a5d0 con 0x7fa8480ac6d0 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa845d9b700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8480ac6d0 0x7fa8481678c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00c590 tx=0x7fa83c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa8367fc700 1 -- 172.21.15.86:0/1276884962 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c011590 con 0x7fa8480ac6d0 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa8367fc700 1 -- 172.21.15.86:0/1276884962 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c011710 con 0x7fa8480ac6d0 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa848168580 con 0x7fa8480ac6d0 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa8367fc700 1 -- 172.21.15.86:0/1276884962 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c011ad0 con 0x7fa8480ac6d0 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.902+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa848152580 con 0x7fa8480ac6d0 2023-10-09T11:54:01.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.903+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84804c3c0 con 0x7fa8480ac6d0 2023-10-09T11:54:01.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.904+0000 7fa8367fc700 1 -- 172.21.15.86:0/1276884962 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa83c01b3b0 con 0x7fa8480ac6d0 2023-10-09T11:54:01.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.905+0000 7fa8367fc700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:01.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.905+0000 7fa8367fc700 1 -- 172.21.15.86:0/1276884962 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5201+0+0 (secure 0 0 0) 0x7fa83c0837b0 con 0x7fa8480ac6d0 2023-10-09T11:54:01.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.905+0000 7fa84659c700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:01.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.906+0000 7fa84659c700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa828066f30 0x7fa8280693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa83800af80 tx=0x7fa83801a000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:01.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:01.909+0000 7fa8367fc700 1 -- 172.21.15.86:0/1276884962 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa83c050c10 con 0x7fa8480ac6d0 2023-10-09T11:54:02.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.101+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8480ad2e0 con 0x7fa8480ac6d0 2023-10-09T11:54:02.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.102+0000 7fa8367fc700 1 -- 172.21.15.86:0/1276884962 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+12708 (secure 0 0 0) 0x7fa83c017020 con 0x7fa8480ac6d0 2023-10-09T11:54:02.103 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:02.104 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":59,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:54:01.206121+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:54:02.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa828066f30 msgr2=0x7fa8280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa828066f30 0x7fa8280693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa83800af80 tx=0x7fa83801a000 comp rx=0 tx=0).stop 2023-10-09T11:54:02.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8480ac6d0 msgr2=0x7fa8481678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8480ac6d0 0x7fa8481678c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00c590 tx=0x7fa83c00c8a0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 shutdown_connections 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848155c10 0x7fa848152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8480ac230 0x7fa8480c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 --2- 172.21.15.86:0/1276884962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8480ac6d0 0x7fa8481678c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 >> 172.21.15.86:0/1276884962 conn(0x7fa84806a320 msgr2=0x7fa8480c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 shutdown_connections 2023-10-09T11:54:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.105+0000 7fa84cdff700 1 -- 172.21.15.86:0/1276884962 wait complete. 2023-10-09T11:54:02.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:54:02.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:54:02.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.308+0000 7f7a8d99d700 1 Processor -- start 2023-10-09T11:54:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.308+0000 7f7a8d99d700 1 -- start start 2023-10-09T11:54:02.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8d99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7a880b16d0 0x7f7a880b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8d99d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a880b33b0 0x7f7a880b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8d99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a880b2080 con 0x7f7a880b4e70 2023-10-09T11:54:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8d99d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a880cfb00 con 0x7f7a880b33b0 2023-10-09T11:54:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8d99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a880b5c40 con 0x7f7a880b16d0 2023-10-09T11:54:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8d19c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a880b33b0 0x7f7a880b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8c99b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7a880b4e70 0x7f7a880ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52830/0 (socket says 172.21.15.86:52830) 2023-10-09T11:54:02.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.309+0000 7f7a8c99b700 1 -- 172.21.15.86:0/2530946322 learned_addr learned my addr 172.21.15.86:0/2530946322 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a87fff700 1 --2- 172.21.15.86:0/2530946322 >> v2:172.21.15.135:3300/0 conn(0x7f7a880b16d0 0x7f7a880b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a8d19c700 1 -- 172.21.15.86:0/2530946322 >> v2:172.21.15.135:3300/0 conn(0x7f7a880b16d0 msgr2=0x7f7a880b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a8d19c700 1 --2- 172.21.15.86:0/2530946322 >> v2:172.21.15.135:3300/0 conn(0x7f7a880b16d0 0x7f7a880b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a8d19c700 1 -- 172.21.15.86:0/2530946322 >> v1:172.21.15.86:6789/0 conn(0x7f7a880b4e70 legacy=0x7f7a880ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a8d19c700 1 -- 172.21.15.86:0/2530946322 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a880b5f20 con 0x7f7a880b33b0 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a87fff700 1 --2- 172.21.15.86:0/2530946322 >> v2:172.21.15.135:3300/0 conn(0x7f7a880b16d0 0x7f7a880b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a877fe700 1 -- 172.21.15.86:0/2530946322 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569695014 0 0) 0x7f7a880b2080 con 0x7f7a880b4e70 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a8d19c700 1 --2- 172.21.15.86:0/2530946322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880b37d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7a88089830 tx=0x7f7a80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e5ed9aa5412a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.310+0000 7f7a877fe700 1 -- 172.21.15.86:0/2530946322 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000e070 con 0x7f7a880b33b0 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a877fe700 1 -- 172.21.15.86:0/2530946322 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000bc30 con 0x7f7a880b33b0 2023-10-09T11:54:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a877fe700 1 -- 172.21.15.86:0/2530946322 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80012430 con 0x7f7a880b33b0 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 -- 172.21.15.86:0/2530946322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 msgr2=0x7f7a880b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/2530946322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880b37d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7a88089830 tx=0x7f7a80009780 comp rx=0 tx=0).stop 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 -- 172.21.15.86:0/2530946322 shutdown_connections 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/2530946322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880b37d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/2530946322 >> v2:172.21.15.135:3300/0 conn(0x7f7a880b16d0 0x7f7a880b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 -- 172.21.15.86:0/2530946322 >> 172.21.15.86:0/2530946322 conn(0x7f7a880d10c0 msgr2=0x7f7a880affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 -- 172.21.15.86:0/2530946322 shutdown_connections 2023-10-09T11:54:02.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.311+0000 7f7a8d99d700 1 -- 172.21.15.86:0/2530946322 wait complete. 2023-10-09T11:54:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.313+0000 7f7a8d99d700 1 Processor -- start 2023-10-09T11:54:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.313+0000 7f7a8d99d700 1 -- start start 2023-10-09T11:54:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880b16d0 0x7f7a88145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a880b4e70 0x7f7a880ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88146db0 con 0x7f7a880b33b0 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a881461a0 con 0x7f7a880b16d0 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88146480 con 0x7f7a880b4e70 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54294/0 (socket says 172.21.15.86:54294) 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 -- 172.21.15.86:0/3032523458 learned_addr learned my addr 172.21.15.86:0/3032523458 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8c99b700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880b16d0 0x7f7a88145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d19c700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a880b4e70 0x7f7a880ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 -- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a880b4e70 msgr2=0x7f7a880ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a880b4e70 0x7f7a880ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 -- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880b16d0 msgr2=0x7f7a88145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880b16d0 0x7f7a88145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a87fff700 1 -- 172.21.15.86:0/3032523458 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009a20 con 0x7f7a880b33b0 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.314+0000 7f7a8d19c700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a880b4e70 0x7f7a880ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.315+0000 7f7a87fff700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880cbed0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400c850 tx=0x7f7a74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.315+0000 7f7a84ff9700 1 -- 172.21.15.86:0/3032523458 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74011600 con 0x7f7a880b33b0 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.315+0000 7f7a84ff9700 1 -- 172.21.15.86:0/3032523458 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a74011760 con 0x7f7a880b33b0 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.315+0000 7f7a84ff9700 1 -- 172.21.15.86:0/3032523458 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74011b20 con 0x7f7a880b33b0 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.315+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a88146760 con 0x7f7a880b33b0 2023-10-09T11:54:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.315+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a880ca7a0 con 0x7f7a880b33b0 2023-10-09T11:54:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.316+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a88146f60 con 0x7f7a880b33b0 2023-10-09T11:54:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.317+0000 7f7a84ff9700 1 -- 172.21.15.86:0/3032523458 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a74018350 con 0x7f7a880b33b0 2023-10-09T11:54:02.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.318+0000 7f7a84ff9700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7a6c066f30 0x7f7a6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.318+0000 7f7a84ff9700 1 -- 172.21.15.86:0/3032523458 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5201+0+0 (secure 0 0 0) 0x7f7a74084300 con 0x7f7a880b33b0 2023-10-09T11:54:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.318+0000 7f7a8c99b700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7a6c066f30 0x7f7a6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.318+0000 7f7a8c99b700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7a6c066f30 0x7f7a6c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7a880c9d40 tx=0x7f7a7c007d30 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:02.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.322+0000 7f7a84ff9700 1 -- 172.21.15.86:0/3032523458 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a88146f60 con 0x7f7a880b33b0 2023-10-09T11:54:02.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.512+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a88146ef0 con 0x7f7a880b33b0 2023-10-09T11:54:02.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.512+0000 7f7a84ff9700 1 -- 172.21.15.86:0/3032523458 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a74055150 con 0x7f7a880b33b0 2023-10-09T11:54:02.513 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7a6c066f30 msgr2=0x7f7a6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7a6c066f30 0x7f7a6c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7a880c9d40 tx=0x7f7a7c007d30 comp rx=0 tx=0).stop 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 msgr2=0x7f7a880cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880cbed0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400c850 tx=0x7f7a74008040 comp rx=0 tx=0).stop 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 shutdown_connections 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a880b4e70 0x7f7a880ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880b16d0 0x7f7a88145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7a6c066f30 0x7f7a6c0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 --2- 172.21.15.86:0/3032523458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a880b33b0 0x7f7a880cbed0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 >> 172.21.15.86:0/3032523458 conn(0x7f7a880d10c0 msgr2=0x7f7a88158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 shutdown_connections 2023-10-09T11:54:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.514+0000 7f7a8d99d700 1 -- 172.21.15.86:0/3032523458 wait complete. 2023-10-09T11:54:02.533 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:54:02.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.712+0000 7f543699d700 1 Processor -- start 2023-10-09T11:54:02.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.713+0000 7f543699d700 1 -- start start 2023-10-09T11:54:02.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150550 0x7f5430157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543699d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54300c7410 0x7f5430069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543699d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543006e2a0 con 0x7f5430150180 2023-10-09T11:54:02.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543699d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543006b2e0 con 0x7f54300c7410 2023-10-09T11:54:02.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54300c78e0 con 0x7f5430150550 2023-10-09T11:54:02.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543599b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5430150180 0x7f54300c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52846/0 (socket says 172.21.15.86:52846) 2023-10-09T11:54:02.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543599b700 1 -- 172.21.15.86:0/1694295050 learned_addr learned my addr 172.21.15.86:0/1694295050 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:02.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.714+0000 7f543619c700 1 --2- 172.21.15.86:0/1694295050 >> v2:172.21.15.86:3300/0 conn(0x7f54300c7410 0x7f5430069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f543519a700 1 --2- 172.21.15.86:0/1694295050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150550 0x7f5430157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f5434999700 1 -- 172.21.15.86:0/1694295050 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722204737 0 0) 0x7f543006e2a0 con 0x7f5430150180 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f5434999700 1 -- 172.21.15.86:0/1694295050 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f541c005780 con 0x7f5430150180 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f543619c700 1 -- 172.21.15.86:0/1694295050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150550 msgr2=0x7f5430157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f543619c700 1 --2- 172.21.15.86:0/1694295050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150550 0x7f5430157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f543619c700 1 -- 172.21.15.86:0/1694295050 >> v1:172.21.15.86:6789/0 conn(0x7f5430150180 legacy=0x7f54300c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f543619c700 1 -- 172.21.15.86:0/1694295050 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300c7bc0 con 0x7f54300c7410 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f543619c700 1 --2- 172.21.15.86:0/1694295050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f5430069f50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5428009d80 tx=0x7f5428009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1af112b528800d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f5434999700 1 -- 172.21.15.86:0/1694295050 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800bb20 con 0x7f54300c7410 2023-10-09T11:54:02.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f5434999700 1 -- 172.21.15.86:0/1694295050 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542800bc80 con 0x7f54300c7410 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.715+0000 7f5434999700 1 -- 172.21.15.86:0/1694295050 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428011430 con 0x7f54300c7410 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 -- 172.21.15.86:0/1694295050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 msgr2=0x7f5430069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 --2- 172.21.15.86:0/1694295050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f5430069f50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5428009d80 tx=0x7f5428009780 comp rx=0 tx=0).stop 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 -- 172.21.15.86:0/1694295050 shutdown_connections 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 --2- 172.21.15.86:0/1694295050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f5430069f50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 --2- 172.21.15.86:0/1694295050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150550 0x7f5430157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 -- 172.21.15.86:0/1694295050 >> 172.21.15.86:0/1694295050 conn(0x7f54300cc1f0 msgr2=0x7f54300cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 -- 172.21.15.86:0/1694295050 shutdown_connections 2023-10-09T11:54:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.716+0000 7f543699d700 1 -- 172.21.15.86:0/1694295050 wait complete. 2023-10-09T11:54:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.717+0000 7f543699d700 1 Processor -- start 2023-10-09T11:54:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.718+0000 7f543699d700 1 -- start start 2023-10-09T11:54:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.718+0000 7f543699d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f54300c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.718+0000 7f543699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150180 0x7f543014b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.718+0000 7f543699d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5430150550 0x7f54300b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.718+0000 7f543699d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54300c4520 con 0x7f54300c7410 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543699d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54300b1e20 con 0x7f5430150550 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54300c3910 con 0x7f5430150180 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f54300c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f54300c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54304/0 (socket says 172.21.15.86:54304) 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 -- 172.21.15.86:0/1749383355 learned_addr learned my addr 172.21.15.86:0/1749383355 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 -- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150180 msgr2=0x7f543014b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543519a700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150180 0x7f543014b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543619c700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5430150550 0x7f54300b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150180 0x7f543014b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 -- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5430150550 msgr2=0x7f54300b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5430150550 0x7f54300b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 -- 172.21.15.86:0/1749383355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542800d040 con 0x7f54300c7410 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543519a700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150180 0x7f543014b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543619c700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5430150550 0x7f54300b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.719+0000 7f543599b700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f54300c32a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f542c00c7c0 tx=0x7f542c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.720+0000 7f5425ffb700 1 -- 172.21.15.86:0/1749383355 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c005b30 con 0x7f54300c7410 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.720+0000 7f5425ffb700 1 -- 172.21.15.86:0/1749383355 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c005c90 con 0x7f54300c7410 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.720+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54300c3bf0 con 0x7f54300c7410 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.720+0000 7f5425ffb700 1 -- 172.21.15.86:0/1749383355 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c007340 con 0x7f54300c7410 2023-10-09T11:54:02.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.720+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54300c41b0 con 0x7f54300c7410 2023-10-09T11:54:02.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.721+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543004c3c0 con 0x7f54300c7410 2023-10-09T11:54:02.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.722+0000 7f5425ffb700 1 -- 172.21.15.86:0/1749383355 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f542c01b400 con 0x7f54300c7410 2023-10-09T11:54:02.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.722+0000 7f5425ffb700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5414066f30 0x7f54140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:02.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.723+0000 7f5425ffb700 1 -- 172.21.15.86:0/1749383355 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5201+0+0 (secure 0 0 0) 0x7f542c083e80 con 0x7f54300c7410 2023-10-09T11:54:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.723+0000 7f543519a700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5414066f30 0x7f54140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.723+0000 7f543519a700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5414066f30 0x7f54140693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5430157330 tx=0x7f5420008040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:02.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.726+0000 7f5425ffb700 1 -- 172.21.15.86:0/1749383355 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f542c0512c0 con 0x7f54300c7410 2023-10-09T11:54:02.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.923+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f543006d650 con 0x7f54300c7410 2023-10-09T11:54:02.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.923+0000 7f5425ffb700 1 -- 172.21.15.86:0/1749383355 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+65 (secure 0 0 0) 0x7f542c0548e0 con 0x7f54300c7410 2023-10-09T11:54:02.924 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:02.924 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:54:02.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:02.925 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T11:54:02.925 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T11:54:02.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:02.925 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:54:02.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5414066f30 msgr2=0x7f54140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5414066f30 0x7f54140693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5430157330 tx=0x7f5420008040 comp rx=0 tx=0).stop 2023-10-09T11:54:02.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 msgr2=0x7f54300c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:02.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f54300c32a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f542c00c7c0 tx=0x7f542c007e00 comp rx=0 tx=0).stop 2023-10-09T11:54:02.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 shutdown_connections 2023-10-09T11:54:02.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5414066f30 0x7f54140693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54300c7410 0x7f54300c32a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5430150550 0x7f54300b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 --2- 172.21.15.86:0/1749383355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5430150180 0x7f543014b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:02.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.925+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 >> 172.21.15.86:0/1749383355 conn(0x7f54300cc1f0 msgr2=0x7f54300a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:02.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.926+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 shutdown_connections 2023-10-09T11:54:02.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:02.926+0000 7f543699d700 1 -- 172.21.15.86:0/1749383355 wait complete. 2023-10-09T11:54:02.944 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:54:02.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:54:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.127+0000 7fc17bfff700 1 Processor -- start 2023-10-09T11:54:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.128+0000 7fc17bfff700 1 -- start start 2023-10-09T11:54:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc17c15bb30 0x7fc17c1623f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c157a50 con 0x7fc17c15b050 2023-10-09T11:54:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c158f10 con 0x7fc17c0cc8d0 2023-10-09T11:54:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c1591b0 con 0x7fc17c15bb30 2023-10-09T11:54:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17affd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc17c15b050 0x7fc17c0ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52858/0 (socket says 172.21.15.86:52858) 2023-10-09T11:54:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17affd700 1 -- 172.21.15.86:0/1736113733 learned_addr learned my addr 172.21.15.86:0/1736113733 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17b7fe700 1 --2- 172.21.15.86:0/1736113733 >> v2:172.21.15.135:3300/0 conn(0x7fc17c15bb30 0x7fc17c1623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.129+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224189326 0 0) 0x7fc17c157a50 con 0x7fc17c15b050 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc168003570 con 0x7fc17c15b050 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779701363 0 0) 0x7fc168003570 con 0x7fc17c15b050 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 >> v2:172.21.15.135:3300/0 conn(0x7fc17c15bb30 msgr2=0x7fc17c1623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 --2- 172.21.15.86:0/1736113733 >> v2:172.21.15.135:3300/0 conn(0x7fc17c15bb30 0x7fc17c1623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 >> v1:172.21.15.135:6789/0 conn(0x7fc17c0cc8d0 legacy=0x7fc17c15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0ca9e0 con 0x7fc17c15b050 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fc16c001470 con 0x7fc17c15b050 2023-10-09T11:54:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 >> v1:172.21.15.86:6789/0 conn(0x7fc17c15b050 legacy=0x7fc17c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168003a60 0x7fc168003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1680051c0 0x7fc16800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1591b0 con 0x7fc168004810 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16800c0d0 con 0x7fc1680051c0 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16800c290 con 0x7fc168003a60 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc173fff700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17affd700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168003a60 0x7fc168003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.130+0000 7fc17b7fe700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1680051c0 0x7fc16800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc173fff700 1 -- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168003a60 msgr2=0x7fc168003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:03.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc173fff700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc168003a60 0x7fc168003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc173fff700 1 -- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1680051c0 msgr2=0x7fc16800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc173fff700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1680051c0 0x7fc16800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc173fff700 1 -- 172.21.15.86:0/1736113733 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168003570 con 0x7fc168004810 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc17b7fe700 1 -- 172.21.15.86:0/1736113733 reap_dead start 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc173fff700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc168004c80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc1640018b0 tx=0x7fc164007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd37920f61d98d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164012420 con 0x7fc168004810 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640125a0 con 0x7fc168004810 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.131+0000 7fc17a7fc700 1 -- 172.21.15.86:0/1736113733 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164012960 con 0x7fc168004810 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.132+0000 7fc17bfff700 1 -- 172.21.15.86:0/1736113733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 msgr2=0x7fc168004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.132+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc168004c80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc1640018b0 tx=0x7fc164007d30 comp rx=0 tx=0).stop 2023-10-09T11:54:03.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.132+0000 7fc17bfff700 1 -- 172.21.15.86:0/1736113733 shutdown_connections 2023-10-09T11:54:03.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.132+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1736113733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc168004c80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.132+0000 7fc17bfff700 1 -- 172.21.15.86:0/1736113733 >> 172.21.15.86:0/1736113733 conn(0x7fc17c068e20 msgr2=0x7fc17c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:03.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.132+0000 7fc17bfff700 1 -- 172.21.15.86:0/1736113733 shutdown_connections 2023-10-09T11:54:03.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.132+0000 7fc17bfff700 1 -- 172.21.15.86:0/1736113733 wait complete. 2023-10-09T11:54:03.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.133+0000 7fc17bfff700 1 Processor -- start 2023-10-09T11:54:03.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.133+0000 7fc17bfff700 1 -- start start 2023-10-09T11:54:03.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc17c145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc17c153210 0x7fc17c0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc17c0c6c10 0x7fc17c0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c168950 con 0x7fc168004810 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c168bf0 con 0x7fc17c153210 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c168ed0 con 0x7fc17c0c6c10 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc17c145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc17c145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54330/0 (socket says 172.21.15.86:54330) 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.134+0000 7fc17affd700 1 -- 172.21.15.86:0/1943466362 learned_addr learned my addr 172.21.15.86:0/1943466362 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc173fff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc17c153210 0x7fc17c0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17b7fe700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc17c0c6c10 0x7fc17c0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17affd700 1 -- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc17c0c6c10 msgr2=0x7fc17c0694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17affd700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc17c0c6c10 0x7fc17c0694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17affd700 1 -- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc17c153210 msgr2=0x7fc17c0c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17affd700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc17c153210 0x7fc17c0c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17affd700 1 -- 172.21.15.86:0/1943466362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c1691b0 con 0x7fc168004810 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc173fff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc17c153210 0x7fc17c0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17b7fe700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc17c0c6c10 0x7fc17c0694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17affd700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc17c145e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc16c007390 tx=0x7fc17c0cc0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc172ffd700 1 -- 172.21.15.86:0/1943466362 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c000ce0 con 0x7fc168004810 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc172ffd700 1 -- 172.21.15.86:0/1943466362 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00f8d0 con 0x7fc168004810 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c169490 con 0x7fc168004810 2023-10-09T11:54:03.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc172ffd700 1 -- 172.21.15.86:0/1943466362 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00fc90 con 0x7fc168004810 2023-10-09T11:54:03.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.135+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c0699e0 con 0x7fc168004810 2023-10-09T11:54:03.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.136+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c1696b0 con 0x7fc168004810 2023-10-09T11:54:03.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.137+0000 7fc172ffd700 1 -- 172.21.15.86:0/1943466362 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc16c013600 con 0x7fc168004810 2023-10-09T11:54:03.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.138+0000 7fc172ffd700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc15c066f20 0x7fc15c0693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:03.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.138+0000 7fc172ffd700 1 -- 172.21.15.86:0/1943466362 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5201+0+0 (secure 0 0 0) 0x7fc16c0844a0 con 0x7fc168004810 2023-10-09T11:54:03.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.138+0000 7fc173fff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc15c066f20 0x7fc15c0693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:03.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.139+0000 7fc173fff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc15c066f20 0x7fc15c0693d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc17c15ba10 tx=0x7fc164015000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:03.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.142+0000 7fc172ffd700 1 -- 172.21.15.86:0/1943466362 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc16c051900 con 0x7fc168004810 2023-10-09T11:54:03.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.333+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc17c0c29f0 con 0x7fc168004810 2023-10-09T11:54:03.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.802+0000 7fc172ffd700 1 -- 172.21.15.86:0/1943466362 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc16c054f20 con 0x7fc168004810 2023-10-09T11:54:03.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc15c066f20 msgr2=0x7fc15c0693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc15c066f20 0x7fc15c0693d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc17c15ba10 tx=0x7fc164015000 comp rx=0 tx=0).stop 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 msgr2=0x7fc17c145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc17c145e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc16c007390 tx=0x7fc17c0cc0d0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 shutdown_connections 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc15c066f20 0x7fc15c0693d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc168004810 0x7fc17c145e00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc17c0c6c10 0x7fc17c0694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 --2- 172.21.15.86:0/1943466362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc17c153210 0x7fc17c0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:03.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 >> 172.21.15.86:0/1943466362 conn(0x7fc17c068e20 msgr2=0x7fc17c155e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:03.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 shutdown_connections 2023-10-09T11:54:03.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:03.809+0000 7fc17bfff700 1 -- 172.21.15.86:0/1943466362 wait complete. 2023-10-09T11:54:03.812 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T11:54:03.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:54:04.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.015+0000 7fd2a83ff700 1 Processor -- start 2023-10-09T11:54:04.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.015+0000 7fd2a83ff700 1 -- start start 2023-10-09T11:54:04.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.016+0000 7fd2a83ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a0069fa0 0x7fd2a006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:04.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.016+0000 7fd2a83ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2a0156ee0 0x7fd2a00c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.016+0000 7fd2a83ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a0156340 con 0x7fd2a00c85c0 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.016+0000 7fd2a83ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00c8990 con 0x7fd2a0156ee0 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.016+0000 7fd2a83ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a006ee20 con 0x7fd2a0069fa0 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a699c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2a0156ee0 0x7fd2a00c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a699c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2a0156ee0 0x7fd2a00c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54340/0 (socket says 172.21.15.86:54340) 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a699c700 1 -- 172.21.15.86:0/2465065695 learned_addr learned my addr 172.21.15.86:0/2465065695 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a599a700 1 --2- 172.21.15.86:0/2465065695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a0069fa0 0x7fd2a006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a699c700 1 -- 172.21.15.86:0/2465065695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a0069fa0 msgr2=0x7fd2a006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a699c700 1 --2- 172.21.15.86:0/2465065695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a0069fa0 0x7fd2a006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a699c700 1 -- 172.21.15.86:0/2465065695 >> v1:172.21.15.135:6789/0 conn(0x7fd2a00c85c0 legacy=0x7fd2a0069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:04.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.017+0000 7fd2a699c700 1 -- 172.21.15.86:0/2465065695 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a006dd80 con 0x7fd2a0156ee0 2023-10-09T11:54:04.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a699c700 1 --2- 172.21.15.86:0/2465065695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0156ee0 0x7fd2a00c6ae0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd29800d1a0 tx=0x7fd29800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbbe1b9b2d54325 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:04.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a5199700 1 -- 172.21.15.86:0/2465065695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298010070 con 0x7fd2a0156ee0 2023-10-09T11:54:04.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a5199700 1 -- 172.21.15.86:0/2465065695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29800dcb0 con 0x7fd2a0156ee0 2023-10-09T11:54:04.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a5199700 1 -- 172.21.15.86:0/2465065695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298016630 con 0x7fd2a0156ee0 2023-10-09T11:54:04.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a83ff700 1 -- 172.21.15.86:0/2465065695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0156ee0 msgr2=0x7fd2a00c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:04.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/2465065695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0156ee0 0x7fd2a00c6ae0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd29800d1a0 tx=0x7fd29800ba50 comp rx=0 tx=0).stop 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a83ff700 1 -- 172.21.15.86:0/2465065695 shutdown_connections 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/2465065695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0156ee0 0x7fd2a00c6ae0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/2465065695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a0069fa0 0x7fd2a006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.018+0000 7fd2a83ff700 1 -- 172.21.15.86:0/2465065695 >> 172.21.15.86:0/2465065695 conn(0x7fd2a00cc540 msgr2=0x7fd2a00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.019+0000 7fd2a83ff700 1 -- 172.21.15.86:0/2465065695 shutdown_connections 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.019+0000 7fd2a83ff700 1 -- 172.21.15.86:0/2465065695 wait complete. 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.020+0000 7fd2a83ff700 1 Processor -- start 2023-10-09T11:54:04.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.020+0000 7fd2a83ff700 1 -- start start 2023-10-09T11:54:04.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a83ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0069fa0 0x7fd2a00bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:04.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a83ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a00c85c0 0x7fd2a00b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a83ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a0156ee0 0x7fd2a00b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a83ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00c0b70 con 0x7fd2a0069fa0 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a83ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00ab380 con 0x7fd2a0156ee0 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a83ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00c1350 con 0x7fd2a00c85c0 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a619b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0069fa0 0x7fd2a00bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a619b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0069fa0 0x7fd2a00bfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54354/0 (socket says 172.21.15.86:54354) 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a619b700 1 -- 172.21.15.86:0/3082890042 learned_addr learned my addr 172.21.15.86:0/3082890042 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a599a700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a00c85c0 0x7fd2a00b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.021+0000 7fd2a699c700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a0156ee0 0x7fd2a00b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a619b700 1 -- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a00c85c0 msgr2=0x7fd2a00b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:04.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a619b700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a00c85c0 0x7fd2a00b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a619b700 1 -- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a0156ee0 msgr2=0x7fd2a00b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a619b700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a0156ee0 0x7fd2a00b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a619b700 1 -- 172.21.15.86:0/3082890042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29800bcf0 con 0x7fd2a0069fa0 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a619b700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0069fa0 0x7fd2a00bfbd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00c590 tx=0x7fd29c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2967fc700 1 -- 172.21.15.86:0/3082890042 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011590 con 0x7fd2a0069fa0 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2967fc700 1 -- 172.21.15.86:0/3082890042 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c011710 con 0x7fd2a0069fa0 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a00c02d0 con 0x7fd2a0069fa0 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2967fc700 1 -- 172.21.15.86:0/3082890042 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011ad0 con 0x7fd2a0069fa0 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.022+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a00c0890 con 0x7fd2a0069fa0 2023-10-09T11:54:04.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.023+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a00718b0 con 0x7fd2a0069fa0 2023-10-09T11:54:04.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.024+0000 7fd2967fc700 1 -- 172.21.15.86:0/3082890042 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd29c01b3b0 con 0x7fd2a0069fa0 2023-10-09T11:54:04.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.025+0000 7fd2967fc700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:04.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.025+0000 7fd2967fc700 1 -- 172.21.15.86:0/3082890042 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5571+0+0 (secure 0 0 0) 0x7fd29c083920 con 0x7fd2a0069fa0 2023-10-09T11:54:04.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.025+0000 7fd2a599a700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:04.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.026+0000 7fd2a599a700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fd284066f30 0x7fd2840693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2a016cd90 tx=0x7fd290008040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:04.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.030+0000 7fd2967fc700 1 -- 172.21.15.86:0/3082890042 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd29c050c10 con 0x7fd2a0069fa0 2023-10-09T11:54:04.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.220+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd2a006e060 con 0x7fd2a0069fa0 2023-10-09T11:54:04.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.808+0000 7fd2967fc700 1 -- 172.21.15.86:0/3082890042 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd29c017070 con 0x7fd2a0069fa0 2023-10-09T11:54:04.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.820+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fd284066f30 msgr2=0x7fd2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:04.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.820+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fd284066f30 0x7fd2840693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2a016cd90 tx=0x7fd290008040 comp rx=0 tx=0).stop 2023-10-09T11:54:04.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.820+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0069fa0 msgr2=0x7fd2a00bfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:04.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.820+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0069fa0 0x7fd2a00bfbd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00c590 tx=0x7fd29c00c8a0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 shutdown_connections 2023-10-09T11:54:04.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2a0069fa0 0x7fd2a00bfbd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2a0156ee0 0x7fd2a00b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 --2- 172.21.15.86:0/3082890042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2a00c85c0 0x7fd2a00b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 >> 172.21.15.86:0/3082890042 conn(0x7fd2a00cc540 msgr2=0x7fd2a00cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 shutdown_connections 2023-10-09T11:54:04.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:04.822+0000 7fd2a83ff700 1 -- 172.21.15.86:0/3082890042 wait complete. 2023-10-09T11:54:04.828 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T11:54:04.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:54:05.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.030+0000 7f4c205ff700 1 Processor -- start 2023-10-09T11:54:05.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.030+0000 7f4c205ff700 1 -- start start 2023-10-09T11:54:05.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c205ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4c180c83f0 0x7f4c180c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:05.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c205ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c181561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:05.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c205ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1815b0d0 con 0x7f4c180c87c0 2023-10-09T11:54:05.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c205ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c180c7a60 con 0x7f4c180c83f0 2023-10-09T11:54:05.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c205ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1815a4c0 con 0x7f4c180ccee0 2023-10-09T11:54:05.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c1e39b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4c180c83f0 0x7f4c180c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:05.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c1db9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c181561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:05.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c1db9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c181561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35548/0 (socket says 172.21.15.86:35548) 2023-10-09T11:54:05.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c1e39b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4c180c83f0 0x7f4c180c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57030/0 (socket says 172.21.15.86:57030) 2023-10-09T11:54:05.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c1db9a700 1 -- 172.21.15.86:0/2374432981 learned_addr learned my addr 172.21.15.86:0/2374432981 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.032+0000 7f4c1eb9c700 1 --1- 172.21.15.86:0/2374432981 >> v1:172.21.15.135:6789/0 conn(0x7f4c180c87c0 0x7f4c1806eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:45590/0 (socket says 172.21.15.86:45590) 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1db9a700 1 -- 172.21.15.86:0/2374432981 >> v2:172.21.15.135:3300/0 conn(0x7f4c180c83f0 msgr2=0x7f4c180c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1db9a700 1 --2- 172.21.15.86:0/2374432981 >> v2:172.21.15.135:3300/0 conn(0x7f4c180c83f0 0x7f4c180c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1db9a700 1 -- 172.21.15.86:0/2374432981 >> v1:172.21.15.135:6789/0 conn(0x7f4c180c87c0 legacy=0x7f4c1806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1db9a700 1 -- 172.21.15.86:0/2374432981 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1815a7a0 con 0x7f4c180ccee0 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1e39b700 1 --2- 172.21.15.86:0/2374432981 >> v2:172.21.15.135:3300/0 conn(0x7f4c180c83f0 0x7f4c180c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1db9a700 1 --2- 172.21.15.86:0/2374432981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c181561d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c080099b0 tx=0x7f4c08009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd35eb9fc92cd21e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1d399700 1 -- 172.21.15.86:0/2374432981 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08009ea0 con 0x7f4c180ccee0 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1d399700 1 -- 172.21.15.86:0/2374432981 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0800b860 con 0x7f4c180ccee0 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.033+0000 7f4c1d399700 1 -- 172.21.15.86:0/2374432981 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800bc00 con 0x7f4c180ccee0 2023-10-09T11:54:05.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 -- 172.21.15.86:0/2374432981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 msgr2=0x7f4c181561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 --2- 172.21.15.86:0/2374432981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c181561d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c080099b0 tx=0x7f4c08009250 comp rx=0 tx=0).stop 2023-10-09T11:54:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 -- 172.21.15.86:0/2374432981 shutdown_connections 2023-10-09T11:54:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 --2- 172.21.15.86:0/2374432981 >> v2:172.21.15.135:3300/0 conn(0x7f4c180c83f0 0x7f4c180c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 --2- 172.21.15.86:0/2374432981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c181561d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 -- 172.21.15.86:0/2374432981 >> 172.21.15.86:0/2374432981 conn(0x7f4c18068e10 msgr2=0x7f4c180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 -- 172.21.15.86:0/2374432981 shutdown_connections 2023-10-09T11:54:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.034+0000 7f4c205ff700 1 -- 172.21.15.86:0/2374432981 wait complete. 2023-10-09T11:54:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.035+0000 7f4c205ff700 1 Processor -- start 2023-10-09T11:54:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.036+0000 7f4c205ff700 1 -- start start 2023-10-09T11:54:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.036+0000 7f4c205ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180c83f0 0x7f4c180c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.036+0000 7f4c205ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c180c87c0 0x7f4c18134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.036+0000 7f4c205ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c1814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.036+0000 7f4c205ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1814b3e0 con 0x7f4c180c87c0 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.036+0000 7f4c205ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18146730 con 0x7f4c180c83f0 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.036+0000 7f4c205ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1814ab40 con 0x7f4c180ccee0 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c180c87c0 0x7f4c18134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c180c87c0 0x7f4c18134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58456/0 (socket says 172.21.15.86:58456) 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 -- 172.21.15.86:0/130016616 learned_addr learned my addr 172.21.15.86:0/130016616 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1e39b700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180c83f0 0x7f4c180c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1eb9c700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c1814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 -- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 msgr2=0x7f4c1814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c1814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 -- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180c83f0 msgr2=0x7f4c180c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180c83f0 0x7f4c180c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 -- 172.21.15.86:0/130016616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009420 con 0x7f4c180c87c0 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.037+0000 7f4c1db9a700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c180c87c0 0x7f4c18134db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4c1815a600 tx=0x7f4c08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.038+0000 7f4c0e7fc700 1 -- 172.21.15.86:0/130016616 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800bbe0 con 0x7f4c180c87c0 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.038+0000 7f4c0e7fc700 1 -- 172.21.15.86:0/130016616 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08011420 con 0x7f4c180c87c0 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.038+0000 7f4c0e7fc700 1 -- 172.21.15.86:0/130016616 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c080117c0 con 0x7f4c180c87c0 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.038+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c080094f0 con 0x7f4c180c87c0 2023-10-09T11:54:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.038+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1814b100 con 0x7f4c180c87c0 2023-10-09T11:54:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.039+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c181468e0 con 0x7f4c180c87c0 2023-10-09T11:54:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.040+0000 7f4c0e7fc700 1 -- 172.21.15.86:0/130016616 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c08011bf0 con 0x7f4c180c87c0 2023-10-09T11:54:05.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.041+0000 7f4c0e7fc700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4bfc066f30 0x7f4bfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:05.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.041+0000 7f4c0e7fc700 1 -- 172.21.15.86:0/130016616 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f4c08085cb0 con 0x7f4c180c87c0 2023-10-09T11:54:05.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.041+0000 7f4c1e39b700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4bfc066f30 0x7f4bfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:05.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.042+0000 7f4c1e39b700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4bfc066f30 0x7f4bfc0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c14f0 tx=0x7f4c140091a0 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.045+0000 7f4c0e7fc700 1 -- 172.21.15.86:0/130016616 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c08052f80 con 0x7f4c180c87c0 2023-10-09T11:54:05.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.277+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4c181468a0 con 0x7f4c180c87c0 2023-10-09T11:54:05.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.833+0000 7f4c0e7fc700 1 -- 172.21.15.86:0/130016616 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4c080565a0 con 0x7f4c180c87c0 2023-10-09T11:54:05.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4bfc066f30 msgr2=0x7f4bfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:05.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4bfc066f30 0x7f4bfc0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c14f0 tx=0x7f4c140091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c180c87c0 msgr2=0x7f4c18134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:05.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c180c87c0 0x7f4c18134db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4c1815a600 tx=0x7f4c08017000 comp rx=0 tx=0).stop 2023-10-09T11:54:05.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 shutdown_connections 2023-10-09T11:54:05.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c180ccee0 0x7f4c1814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c180c83f0 0x7f4c180c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4bfc066f30 0x7f4bfc0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 --2- 172.21.15.86:0/130016616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c180c87c0 0x7f4c18134db0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:05.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.840+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 >> 172.21.15.86:0/130016616 conn(0x7f4c18068e10 msgr2=0x7f4c180c1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:05.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.846+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 shutdown_connections 2023-10-09T11:54:05.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:05.846+0000 7f4c205ff700 1 -- 172.21.15.86:0/130016616 wait complete. 2023-10-09T11:54:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 6 and data pool 7 2023-10-09T11:54:05.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:54:06.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.053+0000 7fe3cabff700 1 Processor -- start 2023-10-09T11:54:06.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.053+0000 7fe3cabff700 1 -- start start 2023-10-09T11:54:06.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3cabff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe3c40ccf90 0x7fe3c40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3cabff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c40cc300 con 0x7fe3c40b1420 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3cabff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c40ad370 con 0x7fe3c40cbf30 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3cabff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c4156bf0 con 0x7fe3c40ccf90 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3c3fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe3c40b1420 0x7fe3c40c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48282/0 (socket says 172.21.15.86:48282) 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3c3fff700 1 -- 172.21.15.86:0/447905592 learned_addr learned my addr 172.21.15.86:0/447905592 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3c919c700 1 --2- 172.21.15.86:0/447905592 >> v2:172.21.15.135:3300/0 conn(0x7fe3c40ccf90 0x7fe3c40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120743804 0 0) 0x7fe3c40cc300 con 0x7fe3c40b1420 2023-10-09T11:54:06.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.055+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b4003570 con 0x7fe3c40b1420 2023-10-09T11:54:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649681238 0 0) 0x7fe3b4003570 con 0x7fe3c40b1420 2023-10-09T11:54:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 >> v2:172.21.15.135:3300/0 conn(0x7fe3c40ccf90 msgr2=0x7fe3c40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 --2- 172.21.15.86:0/447905592 >> v2:172.21.15.135:3300/0 conn(0x7fe3c40ccf90 0x7fe3c40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 >> v1:172.21.15.135:6789/0 conn(0x7fe3c40cbf30 legacy=0x7fe3c40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40ad650 con 0x7fe3c40b1420 2023-10-09T11:54:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fe3b0001470 con 0x7fe3c40b1420 2023-10-09T11:54:06.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 >> v1:172.21.15.86:6789/0 conn(0x7fe3c40b1420 legacy=0x7fe3c40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3b4003ab0 0x7fe3b4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4004810 0x7fe3b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b4005210 0x7fe3b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4156bf0 con 0x7fe3b4003ab0 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b400c130 con 0x7fe3b4005210 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b400c2f0 con 0x7fe3b4004810 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c899b700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3b4003ab0 0x7fe3b4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c919c700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b4005210 0x7fe3b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.056+0000 7fe3c3fff700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4004810 0x7fe3b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c899b700 1 -- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4004810 msgr2=0x7fe3b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c899b700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4004810 0x7fe3b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c899b700 1 -- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b4005210 msgr2=0x7fe3b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c899b700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b4005210 0x7fe3b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c899b700 1 -- 172.21.15.86:0/447905592 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4003570 con 0x7fe3b4003ab0 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c919c700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b4005210 0x7fe3b400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c919c700 1 -- 172.21.15.86:0/447905592 reap_dead start 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c899b700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3b4003ab0 0x7fe3b4003ec0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80018b0 tx=0x7fe3b8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b55c8036c2751db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8012420 con 0x7fe3b4003ab0 2023-10-09T11:54:06.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b80125a0 con 0x7fe3b4003ab0 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.057+0000 7fe3c37fe700 1 -- 172.21.15.86:0/447905592 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8012960 con 0x7fe3b4003ab0 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.058+0000 7fe3cabff700 1 -- 172.21.15.86:0/447905592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3b4003ab0 msgr2=0x7fe3b4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.058+0000 7fe3cabff700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3b4003ab0 0x7fe3b4003ec0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80018b0 tx=0x7fe3b8007d30 comp rx=0 tx=0).stop 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.058+0000 7fe3cabff700 1 -- 172.21.15.86:0/447905592 shutdown_connections 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.058+0000 7fe3cabff700 1 --2- 172.21.15.86:0/447905592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3b4003ab0 0x7fe3b4003ec0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.058+0000 7fe3cabff700 1 -- 172.21.15.86:0/447905592 >> 172.21.15.86:0/447905592 conn(0x7fe3c406a320 msgr2=0x7fe3c40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.058+0000 7fe3cabff700 1 -- 172.21.15.86:0/447905592 shutdown_connections 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.058+0000 7fe3cabff700 1 -- 172.21.15.86:0/447905592 wait complete. 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.059+0000 7fe3cabff700 1 Processor -- start 2023-10-09T11:54:06.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.059+0000 7fe3cabff700 1 -- start start 2023-10-09T11:54:06.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3cabff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4003ab0 0x7fe3c40ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3cabff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3c416ad40 0x7fe3c40c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3cabff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c40abc70 0x7fe3c40ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3cabff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40ab810 con 0x7fe3c40abc70 2023-10-09T11:54:06.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3cabff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40ac650 con 0x7fe3c416ad40 2023-10-09T11:54:06.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3cabff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40c68b0 con 0x7fe3b4003ab0 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3c919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c40abc70 0x7fe3c40ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3c919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c40abc70 0x7fe3c40ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58474/0 (socket says 172.21.15.86:58474) 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.060+0000 7fe3c919c700 1 -- 172.21.15.86:0/3484260365 learned_addr learned my addr 172.21.15.86:0/3484260365 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c899b700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4003ab0 0x7fe3c40ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c3fff700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3c416ad40 0x7fe3c40c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c919c700 1 -- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4003ab0 msgr2=0x7fe3c40ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c919c700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4003ab0 0x7fe3c40ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c919c700 1 -- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3c416ad40 msgr2=0x7fe3c40c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c919c700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3c416ad40 0x7fe3c40c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c919c700 1 -- 172.21.15.86:0/3484260365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40c6d40 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c919c700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c40abc70 0x7fe3c40ac110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe3c406d670 tx=0x7fe3bc00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c0ff9700 1 -- 172.21.15.86:0/3484260365 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc01c070 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c0ff9700 1 -- 172.21.15.86:0/3484260365 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc011040 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3c0ff9700 1 -- 172.21.15.86:0/3484260365 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc010db0 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c40c5ca0 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.061+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c40c6260 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.062+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c40c6a60 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.063+0000 7fe3c0ff9700 1 -- 172.21.15.86:0/3484260365 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3bc003020 con 0x7fe3c40abc70 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.064+0000 7fe3c0ff9700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe3a8066f30 0x7fe3a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.064+0000 7fe3c0ff9700 1 -- 172.21.15.86:0/3484260365 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fe3bc0852b0 con 0x7fe3c40abc70 2023-10-09T11:54:06.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.064+0000 7fe3c899b700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe3a8066f30 0x7fe3a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.065+0000 7fe3c899b700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe3a8066f30 0x7fe3a80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40c71f0 tx=0x7fe3b8015000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.068+0000 7fe3c0ff9700 1 -- 172.21.15.86:0/3484260365 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3c40c6a60 con 0x7fe3c40abc70 2023-10-09T11:54:06.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.259+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3c40c6a20 con 0x7fe3c40abc70 2023-10-09T11:54:06.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.260+0000 7fe3c0ff9700 1 -- 172.21.15.86:0/3484260365 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15937 (secure 0 0 0) 0x7fe3bc052320 con 0x7fe3c40abc70 2023-10-09T11:54:06.261 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:06.261 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":62,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:54:05.279050+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:54:03.372722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:54:04.259159+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:54:06.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe3a8066f30 msgr2=0x7fe3a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe3a8066f30 0x7fe3a80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40c71f0 tx=0x7fe3b8015000 comp rx=0 tx=0).stop 2023-10-09T11:54:06.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c40abc70 msgr2=0x7fe3c40ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c40abc70 0x7fe3c40ac110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe3c406d670 tx=0x7fe3bc00d040 comp rx=0 tx=0).stop 2023-10-09T11:54:06.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 shutdown_connections 2023-10-09T11:54:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe3a8066f30 0x7fe3a80693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c40abc70 0x7fe3c40ac110 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b4003ab0 0x7fe3c40ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 --2- 172.21.15.86:0/3484260365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3c416ad40 0x7fe3c40c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 >> 172.21.15.86:0/3484260365 conn(0x7fe3c406a320 msgr2=0x7fe3c40ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 shutdown_connections 2023-10-09T11:54:06.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.262+0000 7fe3cabff700 1 -- 172.21.15.86:0/3484260365 wait complete. 2023-10-09T11:54:06.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:54:06.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.459+0000 7f22efbff700 1 Processor -- start 2023-10-09T11:54:06.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.459+0000 7f22efbff700 1 -- start start 2023-10-09T11:54:06.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.460+0000 7f22efbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 0x7f22e8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.460+0000 7f22efbff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f22e80ac6a0 0x7f22e80b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.460+0000 7f22efbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e80acac0 con 0x7f22e80ac230 2023-10-09T11:54:06.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.460+0000 7f22efbff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e80ad930 con 0x7f22e80ac6a0 2023-10-09T11:54:06.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.460+0000 7f22efbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80acd20 con 0x7f22e8155c10 2023-10-09T11:54:06.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ed19a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f22e80ac230 0x7f22e81568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48284/0 (socket says 172.21.15.86:48284) 2023-10-09T11:54:06.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ed19a700 1 -- 172.21.15.86:0/2363414952 learned_addr learned my addr 172.21.15.86:0/2363414952 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ee19c700 1 --2- 172.21.15.86:0/2363414952 >> v2:172.21.15.135:3300/0 conn(0x7f22e80ac6a0 0x7f22e80b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ed99b700 1 --2- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 0x7f22e8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ec999700 1 -- 172.21.15.86:0/2363414952 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538223832 0 0) 0x7f22e80acac0 con 0x7f22e80ac230 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ec999700 1 -- 172.21.15.86:0/2363414952 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d4003570 con 0x7f22e80ac230 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ec999700 1 -- 172.21.15.86:0/2363414952 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 501391621 0 0) 0x7f22d4003570 con 0x7f22e80ac230 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ee19c700 1 -- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 msgr2=0x7f22e8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ee19c700 1 --2- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 0x7f22e8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ee19c700 1 -- 172.21.15.86:0/2363414952 >> v1:172.21.15.86:6789/0 conn(0x7f22e80ac230 legacy=0x7f22e81568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.461+0000 7f22ee19c700 1 -- 172.21.15.86:0/2363414952 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80ad000 con 0x7f22e80ac6a0 2023-10-09T11:54:06.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22ee19c700 1 --2- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e80b0300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009e60 tx=0x7f22e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35627b375385be9a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22ec999700 1 -- 172.21.15.86:0/2363414952 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8001470 con 0x7f22e80ac6a0 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22ec999700 1 -- 172.21.15.86:0/2363414952 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e000b7a0 con 0x7f22e80ac6a0 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22ec999700 1 -- 172.21.15.86:0/2363414952 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e000bb60 con 0x7f22e80ac6a0 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22efbff700 1 -- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 msgr2=0x7f22e80b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22efbff700 1 --2- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e80b0300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009e60 tx=0x7f22e0009780 comp rx=0 tx=0).stop 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22efbff700 1 -- 172.21.15.86:0/2363414952 shutdown_connections 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22efbff700 1 --2- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e80b0300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22efbff700 1 --2- 172.21.15.86:0/2363414952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 0x7f22e8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.462+0000 7f22efbff700 1 -- 172.21.15.86:0/2363414952 >> 172.21.15.86:0/2363414952 conn(0x7f22e806a320 msgr2=0x7f22e80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.463+0000 7f22efbff700 1 -- 172.21.15.86:0/2363414952 shutdown_connections 2023-10-09T11:54:06.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.463+0000 7f22efbff700 1 -- 172.21.15.86:0/2363414952 wait complete. 2023-10-09T11:54:06.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.464+0000 7f22efbff700 1 Processor -- start 2023-10-09T11:54:06.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.464+0000 7f22efbff700 1 -- start start 2023-10-09T11:54:06.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22efbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e80ac230 0x7f22e81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22efbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e816a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22efbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 0x7f22e8150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22efbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e816bdb0 con 0x7f22e80ac230 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22efbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e815a110 con 0x7f22e80ac6a0 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22efbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e816b1a0 con 0x7f22e8155c10 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22ed99b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e80ac230 0x7f22e81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22ed99b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e80ac230 0x7f22e81574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58480/0 (socket says 172.21.15.86:58480) 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22ed99b700 1 -- 172.21.15.86:0/2045347528 learned_addr learned my addr 172.21.15.86:0/2045347528 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22ed99b700 1 -- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 msgr2=0x7f22e8150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22ed99b700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 0x7f22e8150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22ed99b700 1 -- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 msgr2=0x7f22e816a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.465+0000 7f22ed19a700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e816a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22ed99b700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e816a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22ed99b700 1 -- 172.21.15.86:0/2045347528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0009a20 con 0x7f22e80ac230 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22ed19a700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e816a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22ed99b700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e80ac230 0x7f22e81574a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f22e400e930 tx=0x7f22e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22ddffb700 1 -- 172.21.15.86:0/2045347528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4009510 con 0x7f22e80ac230 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22ddffb700 1 -- 172.21.15.86:0/2045347528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e400c850 con 0x7f22e80ac230 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22ddffb700 1 -- 172.21.15.86:0/2045347528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400cc10 con 0x7f22e80ac230 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e816b480 con 0x7f22e80ac230 2023-10-09T11:54:06.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.466+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e816ba40 con 0x7f22e80ac230 2023-10-09T11:54:06.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.467+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e816abb0 con 0x7f22e80ac230 2023-10-09T11:54:06.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.468+0000 7f22ddffb700 1 -- 172.21.15.86:0/2045347528 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22e4013470 con 0x7f22e80ac230 2023-10-09T11:54:06.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.469+0000 7f22ddffb700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.469+0000 7f22ddffb700 1 -- 172.21.15.86:0/2045347528 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f22e4084820 con 0x7f22e80ac230 2023-10-09T11:54:06.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.469+0000 7f22ed19a700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.470+0000 7f22ed19a700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f22cc066f30 0x7f22cc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22d80011e0 tx=0x7f22d8009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.473+0000 7f22ddffb700 1 -- 172.21.15.86:0/2045347528 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22e4051930 con 0x7f22e80ac230 2023-10-09T11:54:06.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.663+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22e804c3c0 con 0x7f22e80ac230 2023-10-09T11:54:06.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.664+0000 7f22ddffb700 1 -- 172.21.15.86:0/2045347528 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15937 (secure 0 0 0) 0x7f22e4054f50 con 0x7f22e80ac230 2023-10-09T11:54:06.666 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:06.666 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":62,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:54:05.279050+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:54:03.372722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:54:04.259159+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:54:06.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f22cc066f30 msgr2=0x7f22cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f22cc066f30 0x7f22cc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22d80011e0 tx=0x7f22d8009040 comp rx=0 tx=0).stop 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e80ac230 msgr2=0x7f22e81574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e80ac230 0x7f22e81574a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f22e400e930 tx=0x7f22e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 shutdown_connections 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e80ac230 0x7f22e81574a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e8155c10 0x7f22e8150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 --2- 172.21.15.86:0/2045347528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22e80ac6a0 0x7f22e816a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 >> 172.21.15.86:0/2045347528 conn(0x7f22e806a320 msgr2=0x7f22e81535d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 shutdown_connections 2023-10-09T11:54:06.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.667+0000 7f22efbff700 1 -- 172.21.15.86:0/2045347528 wait complete. 2023-10-09T11:54:06.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:54:06.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.872+0000 7f9acb9ff700 1 Processor -- start 2023-10-09T11:54:06.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.872+0000 7f9acb9ff700 1 -- start start 2023-10-09T11:54:06.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.873+0000 7f9acb9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9ac4069560 0x7f9ac40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.873+0000 7f9acb9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac4069ee0 con 0x7f9ac4159890 2023-10-09T11:54:06.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.873+0000 7f9acb9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac415a160 con 0x7f9ac4159c60 2023-10-09T11:54:06.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.873+0000 7f9acb9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac40d13a0 con 0x7f9ac4069560 2023-10-09T11:54:06.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9ac979b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9ac4159890 0x7f9ac415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48286/0 (socket says 172.21.15.86:48286) 2023-10-09T11:54:06.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9ac979b700 1 -- 172.21.15.86:0/2331727656 learned_addr learned my addr 172.21.15.86:0/2331727656 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:06.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9ac9f9c700 1 --2- 172.21.15.86:0/2331727656 >> v2:172.21.15.135:3300/0 conn(0x7f9ac4069560 0x7f9ac40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822567608 0 0) 0x7f9ac4069ee0 con 0x7f9ac4159890 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab0003570 con 0x7f9ac4159890 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2875211578 0 0) 0x7f9ab0003570 con 0x7f9ac4159890 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 >> v2:172.21.15.135:3300/0 conn(0x7f9ac4069560 msgr2=0x7f9ac40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 --2- 172.21.15.86:0/2331727656 >> v2:172.21.15.135:3300/0 conn(0x7f9ac4069560 0x7f9ac40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 >> v1:172.21.15.135:6789/0 conn(0x7f9ac4159c60 legacy=0x7f9ac415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac415e140 con 0x7f9ac4159890 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f9ac0001470 con 0x7f9ac4159890 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.874+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 >> v1:172.21.15.86:6789/0 conn(0x7f9ac4159890 legacy=0x7f9ac415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9abbfff700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0003ab0 0x7f9ab0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9abbfff700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab0004810 0x7f9ab0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9abbfff700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab0005210 0x7f9ab000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40d13a0 con 0x7f9ab0005210 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab000c130 con 0x7f9ab0004810 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab000c2f0 con 0x7f9ab0003ab0 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac9f9c700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab0005210 0x7f9ab000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac979b700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0003ab0 0x7f9ab0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac8f9a700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab0004810 0x7f9ab0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac9f9c700 1 -- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0003ab0 msgr2=0x7f9ab0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:06.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac9f9c700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0003ab0 0x7f9ab0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac9f9c700 1 -- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab0004810 msgr2=0x7f9ab0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac9f9c700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab0004810 0x7f9ab0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac9f9c700 1 -- 172.21.15.86:0/2331727656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0003570 con 0x7f9ab0005210 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac8f9a700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab0004810 0x7f9ab0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.875+0000 7f9ac9f9c700 1 -- 172.21.15.86:0/2331727656 reap_dead start 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9ac9f9c700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab0005210 0x7f9ab000ba60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00e210 tx=0x7f9abc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e444601afa9068 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00eac0 con 0x7f9ab0005210 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc00f040 con 0x7f9ab0005210 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9abbfff700 1 -- 172.21.15.86:0/2331727656 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00ee70 con 0x7f9ab0005210 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2331727656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab0005210 msgr2=0x7f9ab000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab0005210 0x7f9ab000ba60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00e210 tx=0x7f9abc00b040 comp rx=0 tx=0).stop 2023-10-09T11:54:06.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2331727656 shutdown_connections 2023-10-09T11:54:06.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2331727656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab0005210 0x7f9ab000ba60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2331727656 >> 172.21.15.86:0/2331727656 conn(0x7f9ac4068e20 msgr2=0x7f9ac40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:06.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2331727656 shutdown_connections 2023-10-09T11:54:06.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.876+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2331727656 wait complete. 2023-10-09T11:54:06.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.878+0000 7f9acb9ff700 1 Processor -- start 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.878+0000 7f9acb9ff700 1 -- start start 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9acb9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0005210 0x7f9ac40b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9acb9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ac4157580 0x7f9ac41579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9acb9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac40cd0c0 0x7f9ac40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9acb9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4157f30 con 0x7f9ac4157580 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9acb9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b11b0 con 0x7f9ac40cd0c0 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9acb9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b05a0 con 0x7f9ab0005210 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ac4157580 0x7f9ac41579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ac4157580 0x7f9ac41579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58504/0 (socket says 172.21.15.86:58504) 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 -- 172.21.15.86:0/2625893969 learned_addr learned my addr 172.21.15.86:0/2625893969 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac9f9c700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac40cd0c0 0x7f9ac40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac979b700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0005210 0x7f9ac40b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 -- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0005210 msgr2=0x7f9ac40b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0005210 0x7f9ac40b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 -- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac40cd0c0 msgr2=0x7f9ac40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac40cd0c0 0x7f9ac40cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac8f9a700 1 -- 172.21.15.86:0/2625893969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40b0880 con 0x7f9ac4157580 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.879+0000 7f9ac979b700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0005210 0x7f9ac40b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:54:06.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.880+0000 7f9ac8f9a700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ac4157580 0x7f9ac41579f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400e550 tx=0x7f9ab4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.880+0000 7f9ab97fa700 1 -- 172.21.15.86:0/2625893969 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4011460 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.880+0000 7f9ab97fa700 1 -- 172.21.15.86:0/2625893969 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4010040 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.880+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac40b0b60 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.880+0000 7f9ab97fa700 1 -- 172.21.15.86:0/2625893969 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40117d0 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.880+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac40b6240 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.881+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac40b1360 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.882+0000 7f9ab97fa700 1 -- 172.21.15.86:0/2625893969 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ab4011b80 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.883+0000 7f9ab97fa700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.883+0000 7f9ab97fa700 1 -- 172.21.15.86:0/2625893969 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f9ab4083a20 con 0x7f9ac4157580 2023-10-09T11:54:06.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.883+0000 7f9ac979b700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:06.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.884+0000 7f9ac979b700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9aa8066f30 0x7f9aa80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00015a0 tx=0x7f9ac0009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:06.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:06.887+0000 7f9ab97fa700 1 -- 172.21.15.86:0/2625893969 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ab404d5a0 con 0x7f9ac4157580 2023-10-09T11:54:07.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.121+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ac404c3c0 con 0x7f9ac4157580 2023-10-09T11:54:07.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.835+0000 7f9ab97fa700 1 -- 172.21.15.86:0/2625893969 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ab40190b0 con 0x7f9ac4157580 2023-10-09T11:54:07.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9aa8066f30 msgr2=0x7f9aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9aa8066f30 0x7f9aa80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00015a0 tx=0x7f9ac0009040 comp rx=0 tx=0).stop 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ac4157580 msgr2=0x7f9ac41579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ac4157580 0x7f9ac41579f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400e550 tx=0x7f9ab4009040 comp rx=0 tx=0).stop 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 shutdown_connections 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac40cd0c0 0x7f9ac40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab0005210 0x7f9ac40b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 --2- 172.21.15.86:0/2625893969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ac4157580 0x7f9ac41579f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:07.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 >> 172.21.15.86:0/2625893969 conn(0x7f9ac4068e20 msgr2=0x7f9ac4158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:07.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 shutdown_connections 2023-10-09T11:54:07.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:07.839+0000 7f9acb9ff700 1 -- 172.21.15.86:0/2625893969 wait complete. 2023-10-09T11:54:07.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:54:08.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.045+0000 7fb5f359d700 1 Processor -- start 2023-10-09T11:54:08.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.045+0000 7fb5f359d700 1 -- start start 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.046+0000 7fb5f359d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5ec15a3b0 0x7fb5ec15a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.046+0000 7fb5f359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec0aef00 0x7fb5ec15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.046+0000 7fb5f359d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec0aea70 con 0x7fb5ec06e470 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.046+0000 7fb5f359d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec0ae480 con 0x7fb5ec15a3b0 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.046+0000 7fb5f359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec15acc0 con 0x7fb5ec0aef00 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5ec15a3b0 0x7fb5ec15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5ec15a3b0 0x7fb5ec15a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58516/0 (socket says 172.21.15.86:58516) 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 -- 172.21.15.86:0/1967153842 learned_addr learned my addr 172.21.15.86:0/1967153842 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f1d9a700 1 --2- 172.21.15.86:0/1967153842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec0aef00 0x7fb5ec15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:08.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 -- 172.21.15.86:0/1967153842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec0aef00 msgr2=0x7fb5ec15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:08.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 --2- 172.21.15.86:0/1967153842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec0aef00 0x7fb5ec15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:08.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 -- 172.21.15.86:0/1967153842 >> v1:172.21.15.135:6789/0 conn(0x7fb5ec06e470 legacy=0x7fb5ec0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:08.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 -- 172.21.15.86:0/1967153842 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec15dd30 con 0x7fb5ec15a3b0 2023-10-09T11:54:08.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f259b700 1 --2- 172.21.15.86:0/1967153842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec15a3b0 0x7fb5ec15a780 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099b0 tx=0x7fb5e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108a8fd1afa619ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:08.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.047+0000 7fb5f1599700 1 -- 172.21.15.86:0/1967153842 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800b860 con 0x7fb5ec15a3b0 2023-10-09T11:54:08.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f1599700 1 -- 172.21.15.86:0/1967153842 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800b9c0 con 0x7fb5ec15a3b0 2023-10-09T11:54:08.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f1599700 1 -- 172.21.15.86:0/1967153842 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800bd60 con 0x7fb5ec15a3b0 2023-10-09T11:54:08.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 -- 172.21.15.86:0/1967153842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec15a3b0 msgr2=0x7fb5ec15a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:08.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 --2- 172.21.15.86:0/1967153842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec15a3b0 0x7fb5ec15a780 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099b0 tx=0x7fb5e8009250 comp rx=0 tx=0).stop 2023-10-09T11:54:08.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 -- 172.21.15.86:0/1967153842 shutdown_connections 2023-10-09T11:54:08.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 --2- 172.21.15.86:0/1967153842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec15a3b0 0x7fb5ec15a780 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:08.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 --2- 172.21.15.86:0/1967153842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec0aef00 0x7fb5ec15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:08.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 -- 172.21.15.86:0/1967153842 >> 172.21.15.86:0/1967153842 conn(0x7fb5ec0c9f70 msgr2=0x7fb5ec06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:08.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 -- 172.21.15.86:0/1967153842 shutdown_connections 2023-10-09T11:54:08.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.048+0000 7fb5f359d700 1 -- 172.21.15.86:0/1967153842 wait complete. 2023-10-09T11:54:08.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.050+0000 7fb5f359d700 1 Processor -- start 2023-10-09T11:54:08.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.050+0000 7fb5f359d700 1 -- start start 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f359d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ec06e470 0x7fb5ec1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f359d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec0aef00 0x7fb5ec0b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec15a3b0 0x7fb5ec0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f359d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec169b70 con 0x7fb5ec0aef00 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f359d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec159b70 con 0x7fb5ec06e470 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b1920 con 0x7fb5ec15a3b0 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f1d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec0aef00 0x7fb5ec0b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f1d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec0aef00 0x7fb5ec0b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58520/0 (socket says 172.21.15.86:58520) 2023-10-09T11:54:08.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f1d9a700 1 -- 172.21.15.86:0/697484490 learned_addr learned my addr 172.21.15.86:0/697484490 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f259b700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ec06e470 0x7fb5ec1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.051+0000 7fb5f2d9c700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec15a3b0 0x7fb5ec0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f1d9a700 1 -- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec15a3b0 msgr2=0x7fb5ec0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f1d9a700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec15a3b0 0x7fb5ec0af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f1d9a700 1 -- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ec06e470 msgr2=0x7fb5ec1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f1d9a700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ec06e470 0x7fb5ec1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f1d9a700 1 -- 172.21.15.86:0/697484490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80094f0 con 0x7fb5ec0aef00 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f259b700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ec06e470 0x7fb5ec1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f2d9c700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec15a3b0 0x7fb5ec0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f1d9a700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec0aef00 0x7fb5ec0b13e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00d890 tx=0x7fb5dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:08.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5e27fc700 1 -- 172.21.15.86:0/697484490 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00b600 con 0x7fb5ec0aef00 2023-10-09T11:54:08.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5e27fc700 1 -- 172.21.15.86:0/697484490 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc00b760 con 0x7fb5ec0aef00 2023-10-09T11:54:08.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5e27fc700 1 -- 172.21.15.86:0/697484490 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00bae0 con 0x7fb5ec0aef00 2023-10-09T11:54:08.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec0c3c10 con 0x7fb5ec0aef00 2023-10-09T11:54:08.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.052+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec0c4250 con 0x7fb5ec0aef00 2023-10-09T11:54:08.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.053+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec06cfa0 con 0x7fb5ec0aef00 2023-10-09T11:54:08.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.054+0000 7fb5e27fc700 1 -- 172.21.15.86:0/697484490 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5dc01e460 con 0x7fb5ec0aef00 2023-10-09T11:54:08.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.055+0000 7fb5e27fc700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5d0066f30 0x7fb5d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:08.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.055+0000 7fb5e27fc700 1 -- 172.21.15.86:0/697484490 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fb5dc084de0 con 0x7fb5ec0aef00 2023-10-09T11:54:08.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.056+0000 7fb5f259b700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5d0066f30 0x7fb5d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:08.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.056+0000 7fb5f259b700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5d0066f30 0x7fb5d00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099b0 tx=0x7fb5e8017000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:08.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.060+0000 7fb5e27fc700 1 -- 172.21.15.86:0/697484490 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5dc051e50 con 0x7fb5ec0aef00 2023-10-09T11:54:08.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:08.292+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb5ec15e010 con 0x7fb5ec0aef00 2023-10-09T11:54:09.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.225+0000 7fb5e27fc700 1 -- 172.21.15.86:0/697484490 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb5dc055470 con 0x7fb5ec0aef00 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5d0066f30 msgr2=0x7fb5d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5d0066f30 0x7fb5d00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099b0 tx=0x7fb5e8017000 comp rx=0 tx=0).stop 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec0aef00 msgr2=0x7fb5ec0b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec0aef00 0x7fb5ec0b13e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00d890 tx=0x7fb5dc008040 comp rx=0 tx=0).stop 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 shutdown_connections 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5ec15a3b0 0x7fb5ec0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ec06e470 0x7fb5ec1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5d0066f30 0x7fb5d00693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 --2- 172.21.15.86:0/697484490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5ec0aef00 0x7fb5ec0b13e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.228+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 >> 172.21.15.86:0/697484490 conn(0x7fb5ec0c9f70 msgr2=0x7fb5ec15b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:09.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.229+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 shutdown_connections 2023-10-09T11:54:09.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.229+0000 7fb5f359d700 1 -- 172.21.15.86:0/697484490 wait complete. 2023-10-09T11:54:09.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:54:09.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.433+0000 7f9abafff700 1 Processor -- start 2023-10-09T11:54:09.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.433+0000 7f9abafff700 1 -- start start 2023-10-09T11:54:09.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9abafff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ab4155c10 0x7f9ab4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9abafff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab40acac0 con 0x7f9ab40ac230 2023-10-09T11:54:09.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9abafff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab40ad930 con 0x7f9ab40ac6d0 2023-10-09T11:54:09.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9abafff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab40acd20 con 0x7f9ab4155c10 2023-10-09T11:54:09.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9ab8d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ab4155c10 0x7f9ab4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9ab3fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9ab40ac230 0x7f9ab41568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48288/0 (socket says 172.21.15.86:48288) 2023-10-09T11:54:09.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9ab8d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ab4155c10 0x7f9ab4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58536/0 (socket says 172.21.15.86:58536) 2023-10-09T11:54:09.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9ab3fff700 1 -- 172.21.15.86:0/2583130020 learned_addr learned my addr 172.21.15.86:0/2583130020 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:09.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9ab8d9b700 1 -- 172.21.15.86:0/2583130020 >> v1:172.21.15.135:6789/0 conn(0x7f9ab40ac6d0 legacy=0x7f9ab40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9ab8d9b700 1 -- 172.21.15.86:0/2583130020 >> v1:172.21.15.86:6789/0 conn(0x7f9ab40ac230 legacy=0x7f9ab41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.436+0000 7f9ab8d9b700 1 -- 172.21.15.86:0/2583130020 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40ad000 con 0x7f9ab4155c10 2023-10-09T11:54:09.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.435+0000 7f9ab37fe700 1 -- 172.21.15.86:0/2583130020 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174399031 0 0) 0x7f9ab40acac0 con 0x7f9ab40ac230 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.436+0000 7f9ab8d9b700 1 --2- 172.21.15.86:0/2583130020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab4155c10 0x7f9ab4155fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80098e0 tx=0x7f9aa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00b771001410084 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.436+0000 7f9ab37fe700 1 -- 172.21.15.86:0/2583130020 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8009e80 con 0x7f9ab4155c10 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.436+0000 7f9ab37fe700 1 -- 172.21.15.86:0/2583130020 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800b860 con 0x7f9ab4155c10 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.436+0000 7f9ab37fe700 1 -- 172.21.15.86:0/2583130020 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800bbe0 con 0x7f9ab4155c10 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.436+0000 7f9abafff700 1 -- 172.21.15.86:0/2583130020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab4155c10 msgr2=0x7f9ab4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.436+0000 7f9abafff700 1 --2- 172.21.15.86:0/2583130020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab4155c10 0x7f9ab4155fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80098e0 tx=0x7f9aa80091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.437+0000 7f9abafff700 1 -- 172.21.15.86:0/2583130020 shutdown_connections 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.437+0000 7f9abafff700 1 --2- 172.21.15.86:0/2583130020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab4155c10 0x7f9ab4155fe0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.437+0000 7f9abafff700 1 -- 172.21.15.86:0/2583130020 >> 172.21.15.86:0/2583130020 conn(0x7f9ab406a320 msgr2=0x7f9ab40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.437+0000 7f9abafff700 1 -- 172.21.15.86:0/2583130020 shutdown_connections 2023-10-09T11:54:09.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.437+0000 7f9abafff700 1 -- 172.21.15.86:0/2583130020 wait complete. 2023-10-09T11:54:09.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.438+0000 7f9abafff700 1 Processor -- start 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.438+0000 7f9abafff700 1 -- start start 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9abafff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab40ac230 0x7f9ab4144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9abafff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab40ac6d0 0x7f9ab4147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9abafff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab4155c10 0x7f9ab40a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9abafff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4148040 con 0x7f9ab40ac230 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9abafff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4145180 con 0x7f9ab4155c10 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9abafff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41485b0 con 0x7f9ab40ac6d0 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9ab8d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab40ac230 0x7f9ab4144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9ab8d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab40ac230 0x7f9ab4144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58548/0 (socket says 172.21.15.86:58548) 2023-10-09T11:54:09.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.439+0000 7f9ab8d9b700 1 -- 172.21.15.86:0/3746339704 learned_addr learned my addr 172.21.15.86:0/3746339704 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab3fff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab40ac6d0 0x7f9ab4147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab959c700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab4155c10 0x7f9ab40a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab8d9b700 1 -- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab40ac6d0 msgr2=0x7f9ab4147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab8d9b700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab40ac6d0 0x7f9ab4147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab8d9b700 1 -- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab4155c10 msgr2=0x7f9ab40a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab8d9b700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab4155c10 0x7f9ab40a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab8d9b700 1 -- 172.21.15.86:0/3746339704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8009420 con 0x7f9ab40ac230 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab8d9b700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab40ac230 0x7f9ab4144c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40acc50 tx=0x7f9aa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab0ff9700 1 -- 172.21.15.86:0/3746339704 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa801f070 con 0x7f9ab40ac230 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab0ff9700 1 -- 172.21.15.86:0/3746339704 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800b9d0 con 0x7f9ab40ac230 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9ab0ff9700 1 -- 172.21.15.86:0/3746339704 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8025670 con 0x7f9ab40ac230 2023-10-09T11:54:09.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab41400a0 con 0x7f9ab40ac230 2023-10-09T11:54:09.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.440+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab4169fd0 con 0x7f9ab40ac230 2023-10-09T11:54:09.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.441+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab4163c40 con 0x7f9ab40ac230 2023-10-09T11:54:09.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.442+0000 7f9ab0ff9700 1 -- 172.21.15.86:0/3746339704 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aa8023070 con 0x7f9ab40ac230 2023-10-09T11:54:09.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.443+0000 7f9ab0ff9700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a98066f30 0x7f9a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.443+0000 7f9ab0ff9700 1 -- 172.21.15.86:0/3746339704 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f9aa8085c60 con 0x7f9ab40ac230 2023-10-09T11:54:09.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.443+0000 7f9ab3fff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a98066f30 0x7f9a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.444+0000 7f9ab3fff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a98066f30 0x7f9a980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ab416d4b0 tx=0x7f9aa0009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:09.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.447+0000 7f9ab0ff9700 1 -- 172.21.15.86:0/3746339704 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9aa8052d70 con 0x7f9ab40ac230 2023-10-09T11:54:09.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.683+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ab404c3c0 con 0x7f9ab40ac230 2023-10-09T11:54:09.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.684+0000 7f9ab0ff9700 1 -- 172.21.15.86:0/3746339704 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f9aa802a090 con 0x7f9ab40ac230 2023-10-09T11:54:09.684 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:09.685 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/569752766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":569752766},{"type":"v1","addr":"172.21.15.135:6834","nonce":569752766}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/312603704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":312603704},{"type":"v1","addr":"172.21.15.135:6835","nonce":312603704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/4036553983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":4036553983},{"type":"v1","addr":"172.21.15.86:6833","nonce":4036553983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:54:05.279420+0000","modified":"2023-10-09T11:54:09.221890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6836/3777239940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3777239940},{"type":"v1","addr":"172.21.15.86:6836","nonce":3777239940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:54:09.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.686+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a98066f30 msgr2=0x7f9a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.686+0000 7f9abafff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a98066f30 0x7f9a980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ab416d4b0 tx=0x7f9aa0009040 comp rx=0 tx=0).stop 2023-10-09T11:54:09.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.686+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab40ac230 msgr2=0x7f9ab4144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab40ac230 0x7f9ab4144c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40acc50 tx=0x7f9aa8017000 comp rx=0 tx=0).stop 2023-10-09T11:54:09.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 shutdown_connections 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a98066f30 0x7f9a980693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ab40ac230 0x7f9ab4144c40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ab4155c10 0x7f9ab40a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 --2- 172.21.15.86:0/3746339704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ab40ac6d0 0x7f9ab4147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 >> 172.21.15.86:0/3746339704 conn(0x7f9ab406a320 msgr2=0x7f9ab406e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 shutdown_connections 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.687+0000 7f9abafff700 1 -- 172.21.15.86:0/3746339704 wait complete. 2023-10-09T11:54:09.688 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2023-10-09T11:54:09.704 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:54:09.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.886+0000 7f9e1a1ff700 1 Processor -- start 2023-10-09T11:54:09.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.886+0000 7f9e1a1ff700 1 -- start start 2023-10-09T11:54:09.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e1a1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e1a1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9e140ccf90 0x7f9e140b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e1a1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140cc300 con 0x7f9e1415a270 2023-10-09T11:54:09.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e1a1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e14156bf0 con 0x7f9e140ccf90 2023-10-09T11:54:09.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e1a1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140ae950 con 0x7f9e140cbf30 2023-10-09T11:54:09.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e137fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e0bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9e140ccf90 0x7f9e140b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e13fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9e1415a270 0x7f9e140c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:45634/0 (socket says 172.21.15.86:45634) 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.888+0000 7f9e13fff700 1 -- 172.21.15.86:0/1585303478 learned_addr learned my addr 172.21.15.86:0/1585303478 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e12ffd700 1 -- 172.21.15.86:0/1585303478 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384781008 0 0) 0x7f9e140cc300 con 0x7f9e1415a270 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e12ffd700 1 -- 172.21.15.86:0/1585303478 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e00003570 con 0x7f9e1415a270 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e137fe700 1 -- 172.21.15.86:0/1585303478 >> v2:172.21.15.135:3300/0 conn(0x7f9e140ccf90 msgr2=0x7f9e140b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e137fe700 1 --2- 172.21.15.86:0/1585303478 >> v2:172.21.15.135:3300/0 conn(0x7f9e140ccf90 0x7f9e140b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e137fe700 1 -- 172.21.15.86:0/1585303478 >> v1:172.21.15.135:6789/0 conn(0x7f9e1415a270 legacy=0x7f9e140c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e137fe700 1 -- 172.21.15.86:0/1585303478 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140ad370 con 0x7f9e140cbf30 2023-10-09T11:54:09.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e0bfff700 1 --2- 172.21.15.86:0/1585303478 >> v2:172.21.15.135:3300/0 conn(0x7f9e140ccf90 0x7f9e140b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.889+0000 7f9e137fe700 1 --2- 172.21.15.86:0/1585303478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140ae410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e040098e0 tx=0x7f9e040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd737d30dc87062 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e12ffd700 1 -- 172.21.15.86:0/1585303478 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011630 con 0x7f9e140cbf30 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e12ffd700 1 -- 172.21.15.86:0/1585303478 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04011790 con 0x7f9e140cbf30 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e12ffd700 1 -- 172.21.15.86:0/1585303478 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011b30 con 0x7f9e140cbf30 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/1585303478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 msgr2=0x7f9e140ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/1585303478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140ae410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e040098e0 tx=0x7f9e040091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/1585303478 shutdown_connections 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/1585303478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140ae410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/1585303478 >> v2:172.21.15.135:3300/0 conn(0x7f9e140ccf90 0x7f9e140b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/1585303478 >> 172.21.15.86:0/1585303478 conn(0x7f9e1406a320 msgr2=0x7f9e140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/1585303478 shutdown_connections 2023-10-09T11:54:09.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.890+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/1585303478 wait complete. 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.892+0000 7f9e1a1ff700 1 Processor -- start 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.892+0000 7f9e1a1ff700 1 -- start start 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e1a1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e1a1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e140ccf90 0x7f9e14159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e1a1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e1415a270 0x7f9e140a8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e1a1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140aa6b0 con 0x7f9e1415a270 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e1a1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140a5d30 con 0x7f9e140ccf90 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e1a1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140a6010 con 0x7f9e140cbf30 2023-10-09T11:54:09.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e13fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e1415a270 0x7f9e140a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e13fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e1415a270 0x7f9e140a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58558/0 (socket says 172.21.15.86:58558) 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e13fff700 1 -- 172.21.15.86:0/4159712203 learned_addr learned my addr 172.21.15.86:0/4159712203 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e0bfff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e140ccf90 0x7f9e14159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.893+0000 7f9e137fe700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e13fff700 1 -- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 msgr2=0x7f9e140aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e13fff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140aa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e13fff700 1 -- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e140ccf90 msgr2=0x7f9e14159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e13fff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e140ccf90 0x7f9e14159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e13fff700 1 -- 172.21.15.86:0/4159712203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc009420 con 0x7f9e1415a270 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e0bfff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e140ccf90 0x7f9e14159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:54:09.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e13fff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e1415a270 0x7f9e140a8290 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c001460 tx=0x7f9e0c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:09.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e0b7fe700 1 -- 172.21.15.86:0/4159712203 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00a950 con 0x7f9e1415a270 2023-10-09T11:54:09.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e0b7fe700 1 -- 172.21.15.86:0/4159712203 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c00aab0 con 0x7f9e1415a270 2023-10-09T11:54:09.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e0b7fe700 1 -- 172.21.15.86:0/4159712203 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00ae30 con 0x7f9e1415a270 2023-10-09T11:54:09.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04009420 con 0x7f9e1415a270 2023-10-09T11:54:09.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.894+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e140a68b0 con 0x7f9e1415a270 2023-10-09T11:54:09.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.895+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e140a63e0 con 0x7f9e1415a270 2023-10-09T11:54:09.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.896+0000 7f9e0b7fe700 1 -- 172.21.15.86:0/4159712203 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e0c007300 con 0x7f9e1415a270 2023-10-09T11:54:09.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.897+0000 7f9e0b7fe700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9df4066fb0 0x7f9df4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:09.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.897+0000 7f9e0b7fe700 1 -- 172.21.15.86:0/4159712203 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f9e0c084bd0 con 0x7f9e1415a270 2023-10-09T11:54:09.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.897+0000 7f9e137fe700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9df4066fb0 0x7f9df4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:09.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.898+0000 7f9e137fe700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9df4066fb0 0x7f9df4069460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e040093a0 tx=0x7f9e04017000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:09.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:09.901+0000 7f9e0b7fe700 1 -- 172.21.15.86:0/4159712203 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e0c051c30 con 0x7f9e1415a270 2023-10-09T11:54:10.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:54:10.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:54:10.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.092+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e1404c3c0 con 0x7f9e1415a270 2023-10-09T11:54:10.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.093+0000 7f9e0b7fe700 1 -- 172.21.15.86:0/4159712203 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15924 (secure 0 0 0) 0x7f9e0c055250 con 0x7f9e1415a270 2023-10-09T11:54:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:10.095 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":63,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:54:06.823287+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:54:03.372722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:54:04.259159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.095+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9df4066fb0 msgr2=0x7f9df4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.095+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9df4066fb0 0x7f9df4069460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e040093a0 tx=0x7f9e04017000 comp rx=0 tx=0).stop 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.095+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e1415a270 msgr2=0x7f9e140a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.095+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e1415a270 0x7f9e140a8290 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c001460 tx=0x7f9e0c001a40 comp rx=0 tx=0).stop 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 shutdown_connections 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9df4066fb0 0x7f9df4069460 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e1415a270 0x7f9e140a8290 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e140cbf30 0x7f9e140aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 --2- 172.21.15.86:0/4159712203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e140ccf90 0x7f9e14159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 >> 172.21.15.86:0/4159712203 conn(0x7f9e1406a320 msgr2=0x7f9e140b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:10.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 shutdown_connections 2023-10-09T11:54:10.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.096+0000 7f9e1a1ff700 1 -- 172.21.15.86:0/4159712203 wait complete. 2023-10-09T11:54:10.114 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:54:10.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:54:10.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.337+0000 7f4ac39ff700 1 Processor -- start 2023-10-09T11:54:10.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.337+0000 7f4ac39ff700 1 -- start start 2023-10-09T11:54:10.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.338+0000 7f4ac39ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4abc0b2320 0x7f4abc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.338+0000 7f4ac39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc159c10 0x7f4abc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.338+0000 7f4ac39ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4abc06aff0 con 0x7f4abc159840 2023-10-09T11:54:10.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.338+0000 7f4ac39ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4abc06a130 con 0x7f4abc0b2320 2023-10-09T11:54:10.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.338+0000 7f4ac39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc06a3e0 con 0x7f4abc159c10 2023-10-09T11:54:10.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac0f9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4abc0b2320 0x7f4abc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac1f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc159c10 0x7f4abc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac0f9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4abc0b2320 0x7f4abc0696b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57140/0 (socket says 172.21.15.86:57140) 2023-10-09T11:54:10.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3353336716 learned_addr learned my addr 172.21.15.86:0/3353336716 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:10.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac179b700 1 --1- 172.21.15.86:0/3353336716 >> v1:172.21.15.135:6789/0 conn(0x7f4abc159840 0x7f4abc0b1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:45642/0 (socket says 172.21.15.86:45642) 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc159c10 msgr2=0x7f4abc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac0f9a700 1 --2- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc159c10 0x7f4abc069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3353336716 >> v1:172.21.15.135:6789/0 conn(0x7f4abc159840 legacy=0x7f4abc0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ab3fff700 1 -- 172.21.15.86:0/3353336716 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424971768 0 0) 0x7f4abc06aff0 con 0x7f4abc159840 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3353336716 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc06a6c0 con 0x7f4abc0b2320 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.339+0000 7f4ac1f9c700 1 --2- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc159c10 0x7f4abc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.340+0000 7f4ac0f9a700 1 --2- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc0b2320 0x7f4abc0696b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0099b0 tx=0x7f4aac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf2d0f89f223f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.340+0000 7f4ab3fff700 1 -- 172.21.15.86:0/3353336716 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac009ea0 con 0x7f4abc0b2320 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.340+0000 7f4ab3fff700 1 -- 172.21.15.86:0/3353336716 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00b860 con 0x7f4abc0b2320 2023-10-09T11:54:10.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.340+0000 7f4ab3fff700 1 -- 172.21.15.86:0/3353336716 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00bc00 con 0x7f4abc0b2320 2023-10-09T11:54:10.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.340+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc0b2320 msgr2=0x7f4abc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.341+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc0b2320 0x7f4abc0696b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0099b0 tx=0x7f4aac009250 comp rx=0 tx=0).stop 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.341+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3353336716 shutdown_connections 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.341+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc159c10 0x7f4abc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.341+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3353336716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc0b2320 0x7f4abc0696b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.341+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3353336716 >> 172.21.15.86:0/3353336716 conn(0x7f4abc0ce540 msgr2=0x7f4abc0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.341+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3353336716 shutdown_connections 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.341+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3353336716 wait complete. 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.342+0000 7f4ac39ff700 1 Processor -- start 2023-10-09T11:54:10.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.342+0000 7f4ac39ff700 1 -- start start 2023-10-09T11:54:10.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.343+0000 7f4ac39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc0b2320 0x7f4abc149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.343+0000 7f4ac39ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4abc159840 0x7f4abc16b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.343+0000 7f4ac39ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc159c10 0x7f4abc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.343+0000 7f4ac39ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc155d60 con 0x7f4abc159840 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.343+0000 7f4ac39ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc16cdb0 con 0x7f4abc159c10 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.343+0000 7f4ac39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc16c1a0 con 0x7f4abc0b2320 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4abc159840 0x7f4abc16b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4abc159840 0x7f4abc16b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58560/0 (socket says 172.21.15.86:58560) 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3076007000 learned_addr learned my addr 172.21.15.86:0/3076007000 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac1f9c700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc159c10 0x7f4abc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac179b700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc0b2320 0x7f4abc149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc0b2320 msgr2=0x7f4abc149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc0b2320 0x7f4abc149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc159c10 msgr2=0x7f4abc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc159c10 0x7f4abc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 -- 172.21.15.86:0/3076007000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4009a20 con 0x7f4abc159840 2023-10-09T11:54:10.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.344+0000 7f4ac0f9a700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4abc159840 0x7f4abc16b8a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4abc06f4b0 tx=0x7f4aac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:10.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.345+0000 7f4ab17fa700 1 -- 172.21.15.86:0/3076007000 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac000d10 con 0x7f4abc159840 2023-10-09T11:54:10.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.345+0000 7f4ab17fa700 1 -- 172.21.15.86:0/3076007000 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00bbe0 con 0x7f4abc159840 2023-10-09T11:54:10.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.345+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac0094f0 con 0x7f4abc159840 2023-10-09T11:54:10.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.345+0000 7f4ab17fa700 1 -- 172.21.15.86:0/3076007000 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac011690 con 0x7f4abc159840 2023-10-09T11:54:10.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.345+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc16c760 con 0x7f4abc159840 2023-10-09T11:54:10.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.346+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc16cf40 con 0x7f4abc159840 2023-10-09T11:54:10.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.347+0000 7f4ab17fa700 1 -- 172.21.15.86:0/3076007000 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4aac011ac0 con 0x7f4abc159840 2023-10-09T11:54:10.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.347+0000 7f4ab17fa700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4aa0066f30 0x7f4aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.348+0000 7f4ab17fa700 1 -- 172.21.15.86:0/3076007000 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f4aac085f80 con 0x7f4abc159840 2023-10-09T11:54:10.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.348+0000 7f4ac179b700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4aa0066f30 0x7f4aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.348+0000 7f4ac179b700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4aa0066f30 0x7f4aa00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8007fd0 tx=0x7f4ab8007d50 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:10.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.352+0000 7f4ab17fa700 1 -- 172.21.15.86:0/3076007000 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4aac0b75a0 con 0x7f4abc159840 2023-10-09T11:54:10.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.540+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4abc04c3c0 con 0x7f4aa0066f30 2023-10-09T11:54:10.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.550+0000 7f4ab17fa700 1 -- 172.21.15.86:0/3076007000 <== mgr.5538 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278076 (secure 0 0 0) 0x7f4abc04c3c0 con 0x7f4aa0066f30 2023-10-09T11:54:10.553 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.553+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4aa0066f30 msgr2=0x7f4aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.553+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4aa0066f30 0x7f4aa00693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8007fd0 tx=0x7f4ab8007d50 comp rx=0 tx=0).stop 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4abc159840 msgr2=0x7f4abc16b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4abc159840 0x7f4abc16b8a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4abc06f4b0 tx=0x7f4aac017000 comp rx=0 tx=0).stop 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 shutdown_connections 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4abc159c10 0x7f4abc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4abc0b2320 0x7f4abc149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4aa0066f30 0x7f4aa00693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 --2- 172.21.15.86:0/3076007000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4abc159840 0x7f4abc16b8a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 >> 172.21.15.86:0/3076007000 conn(0x7f4abc0ce540 msgr2=0x7f4abc157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:10.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 shutdown_connections 2023-10-09T11:54:10.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.554+0000 7f4ac39ff700 1 -- 172.21.15.86:0/3076007000 wait complete. 2023-10-09T11:54:10.557 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:54:10.571 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:54:09.750681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2425896,"kb_used_data":6632,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752548824,"statfs":{"total":773094113280,"available":770609995776,"internally_reserved":0,"allocated":6791168,"data_stored":3762656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.950955"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804988+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:46.920453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804007+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:43.667401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.807664+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:07.172960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808039+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:38.115682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805998+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:54.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803394+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:19.199266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802553+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:59.399434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.810236+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:47.740702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803011+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:42.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809323+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:53.174706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808788+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:07.352232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805151+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:15.430158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805566+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:20.445983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808039+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:14.908569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805090+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:58.745342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809283+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:55.546449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805073+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:43.629702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803190+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:23.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802176+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:12.021657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805358+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:43.565153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804959+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:40.080032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802176+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:34.269113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809227+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:03.311271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808279+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:48.260132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805216+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:54.146487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808130+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:51.945674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.807030+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.010987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808193+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.154526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802728+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:53:13.937158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.806408+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:04.679159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809804+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:27.810667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802183+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:36.683393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":274,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T11:54:01.866613+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:54:01.866613+0000","last_peered":"2023-10-09T11:54:01.866613+0000","last_clean":"2023-10-09T11:54:01.866613+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:54:01.866613+0000","last_undegraded":"2023-10-09T11:54:01.866613+0000","last_fullsized":"2023-10-09T11:54:01.866613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1294336,"data_stored":913108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.67100000000000004},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":0.873,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.70499999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93400000000000005,"5min":1.014,"15min":1.0349999999999999},"last":0.749}]},{"osd":2,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.69599999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.44600000000000001},"max":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":1.1599999999999999},"last":0.876},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.048,"15min":1.202},"last":0.93500000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1.016},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92500000000000004,"5min":1.073,"15min":1.073},"last":0.89200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.73999999999999999,"5min":0.91000000000000003,"15min":0.94099999999999995},"last":0.83699999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.96199999999999997},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.048},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":0.79600000000000004,"5min":0.95699999999999996,"15min":1.0620000000000001},"last":0.99299999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.748,"15min":0.751},"min":{"1min":0.59699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":0.95599999999999996,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.60699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.95099999999999996,"5min":0.98399999999999999,"15min":1.216},"last":0.82299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.439},"max":{"1min":1.008,"5min":1.008,"15min":1.139},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.47299999999999998},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.431},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.502},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.244},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.92600000000000005,"15min":1.613},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.94899999999999995,"15min":1.143},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.2410000000000001},"last":0.495}]},{"osd":7,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.495,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":1.506},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":1.6759999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.385},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.374,"15min":0.318},"max":{"1min":0.77800000000000002,"5min":0.83199999999999996,"15min":1.099},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64800000000000002,"5min":0.80000000000000004,"15min":1.536},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.746,"15min":1.272},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82899999999999996,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.48899999999999999},"max":{"1min":1.115,"5min":1.1479999999999999,"15min":1.7210000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.56799999999999995,"15min":0.46899999999999997},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.181,"15min":1.677},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.81699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.55300000000000005},"max":{"1min":1.0669999999999999,"5min":1.135,"15min":1.778},"last":0.501}]},{"osd":6,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.51100000000000001},"max":{"1min":1.0760000000000001,"5min":1.2430000000000001,"15min":1.623},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.65200000000000002,"5min":0.61699999999999999,"15min":0.50700000000000001},"max":{"1min":1.02,"5min":1.274,"15min":1.708},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.84099999999999997},"min":{"1min":0.65000000000000002,"5min":0.62,"15min":0.52900000000000003},"max":{"1min":1.032,"5min":1.2130000000000001,"15min":1.659},"last":0.627},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.0880000000000001,"5min":1.194,"15min":1.736},"last":0.56399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":913108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47599999999999998,"15min":0.48499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57199999999999995,"5min":0.753,"15min":1.367},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68700000000000006,"5min":0.85599999999999998,"15min":1.4930000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":1.8340000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.83499999999999996,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":1.855},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.752,"5min":0.84799999999999998,"15min":1.2330000000000001},"last":0.62}]},{"osd":4,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0449999999999999,"5min":1.169,"15min":1.254},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47199999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.099},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48099999999999998},"max":{"1min":1.129,"5min":1.1890000000000001,"15min":1.2},"last":0.86699999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.57899999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.028,"5min":1.169,"15min":1.321},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.1299999999999999,"15min":1.24},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.2849999999999999},"last":0.83899999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542302,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306164,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065676,"statfs":{"total":96636764160,"available":96323252224,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47199999999999998,"15min":0.46000000000000002},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.66500000000000004,"5min":0.755,"15min":0.83799999999999997},"last":0.5}]},{"osd":1,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.97299999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.32200000000000001},"max":{"1min":0.65900000000000003,"5min":0.81200000000000006,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.79700000000000004},"min":{"1min":0.59999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.79700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.50700000000000001},"max":{"1min":1.0309999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82399999999999995,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83699999999999997,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.56299999999999994},"max":{"1min":1.0569999999999999,"5min":1.204,"15min":1.27},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.66200000000000003,"5min":0.621,"15min":0.53100000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.246},"last":0.63},{"interface":"front","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.67900000000000005,"5min":0.63400000000000001,"15min":0.57299999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.2130000000000001},"last":0.68000000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.34699999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.70999999999999996,"15min":1.208},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":1.1970000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":1.0229999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.311},"max":{"1min":0.624,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.55100000000000005},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.624}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.65000000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.327},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.70599999999999996,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.141,"15min":1.2689999999999999},"last":1.0620000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":1.109,"5min":1.109,"15min":1.2829999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.66800000000000004,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.3660000000000001},"last":0.94199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.50700000000000001,"15min":0.47999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.1459999999999999,"15min":1.218},"last":0.91600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.46999999999999997},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.333},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.54700000000000004},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.3560000000000001},"last":1.024}]}]},{"osd":4,"up_from":16,"seq":68719476894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310260,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061580,"statfs":{"total":96636764160,"available":96319057920,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":1.071},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.39100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.2569999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.94299999999999995,"5min":1.05,"15min":1.2909999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74299999999999999,"15min":0.73199999999999998},"min":{"1min":0.60499999999999998,"5min":0.54900000000000004,"15min":0.45400000000000001},"max":{"1min":0.90800000000000003,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90800000000000003,"5min":0.995,"15min":1.234},"last":0.84699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.432},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.94699999999999995,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91700000000000004,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.125},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.82599999999999996,"5min":0.91900000000000004,"15min":1.373},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":1.2410000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":1.1200000000000001,"15min":1.222},"last":0.74199999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.1180000000000001,"15min":1.48},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.318},"max":{"1min":0.877,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.86799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.41199999999999998},"max":{"1min":0.88500000000000001,"5min":0.95299999999999996,"15min":1.0840000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.47799999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":1.21},"last":0.79300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.0389999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72799999999999998,"15min":0.70099999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.90300000000000002,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.45900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.363},"last":0.746},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91800000000000004,"5min":1.0029999999999999,"15min":1.508},"last":0.90600000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77500000000000002,"5min":1.018,"15min":1.018},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61399999999999999,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68799999999999994,"5min":0.998,"15min":1.321},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":1.0269999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.49199999999999999,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.0669999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86199999999999999,"5min":1.0129999999999999,"15min":3.3620000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.755},"min":{"1min":0.51400000000000001,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":3.3149999999999999},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:54:10.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:54:10.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.790+0000 7f668e9ff700 1 Processor -- start 2023-10-09T11:54:10.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.790+0000 7f668e9ff700 1 -- start start 2023-10-09T11:54:10.791 INFO:tasks.ceph.mds.c.smithi086.stderr:2023-10-09T11:54:10.790+0000 7f6e021f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:54:10.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.791+0000 7f668e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 0x7f66880699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f668e9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6688069ee0 con 0x7f6688159c60 2023-10-09T11:54:10.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f668e9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668815a160 con 0x7f6688159890 2023-10-09T11:54:10.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f668e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880d13a0 con 0x7f6688069560 2023-10-09T11:54:10.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f66877fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6688159c60 0x7f668815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48292/0 (socket says 172.21.15.86:48292) 2023-10-09T11:54:10.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f66877fe700 1 -- 172.21.15.86:0/376320702 learned_addr learned my addr 172.21.15.86:0/376320702 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467672613 0 0) 0x7f6688069ee0 con 0x7f6688159c60 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6670003570 con 0x7f6688159c60 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f668cf9c700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 0x7f66880699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307597323 0 0) 0x7f6670003570 con 0x7f6688159c60 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 msgr2=0x7f66880699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 0x7f66880699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 >> v1:172.21.15.135:6789/0 conn(0x7f6688159890 legacy=0x7f668815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668815e140 con 0x7f6688159c60 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.792+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f667c001470 con 0x7f6688159c60 2023-10-09T11:54:10.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 >> v1:172.21.15.86:6789/0 conn(0x7f6688159c60 legacy=0x7f668815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6686ffd700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670003a90 0x7f6670003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6686ffd700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 0x7f6670004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6686ffd700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670004d50 0x7f66700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880d13a0 con 0x7f6670003a90 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667000bba0 con 0x7f6670004d50 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667000bd60 con 0x7f6688069560 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6687fff700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670003a90 0x7f6670003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f66877fe700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 0x7f6670004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f668cf9c700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670004d50 0x7f66700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6687fff700 1 -- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 msgr2=0x7f6670004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6687fff700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6688069560 0x7f6670004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6687fff700 1 -- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670004d50 msgr2=0x7f66700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6687fff700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670004d50 0x7f66700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6687fff700 1 -- 172.21.15.86:0/376320702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670003570 con 0x7f6670003a90 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.793+0000 7f6687fff700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670003a90 0x7f6670003ea0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6678001870 tx=0x7f6678007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd5e416678e43f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678012400 con 0x7f6670003a90 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678012580 con 0x7f6670003a90 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f6686ffd700 1 -- 172.21.15.86:0/376320702 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678012940 con 0x7f6670003a90 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f668e9ff700 1 -- 172.21.15.86:0/376320702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670003a90 msgr2=0x7f6670003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f668e9ff700 1 --2- 172.21.15.86:0/376320702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670003a90 0x7f6670003ea0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6678001870 tx=0x7f6678007d10 comp rx=0 tx=0).stop 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f668cf9c700 1 -- 172.21.15.86:0/376320702 reap_dead start 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f668e9ff700 1 -- 172.21.15.86:0/376320702 shutdown_connections 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f668e9ff700 1 -- 172.21.15.86:0/376320702 >> 172.21.15.86:0/376320702 conn(0x7f6688068e20 msgr2=0x7f66880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:10.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f668e9ff700 1 -- 172.21.15.86:0/376320702 shutdown_connections 2023-10-09T11:54:10.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.794+0000 7f668e9ff700 1 -- 172.21.15.86:0/376320702 wait complete. 2023-10-09T11:54:10.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.796+0000 7f668e9ff700 1 Processor -- start 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.796+0000 7f668e9ff700 1 -- start start 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f668e9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670003a90 0x7f66880b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f668e9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880b51a0 0x7f66880cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f668e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66880cfc40 0x7f668815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f668e9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668816a1a0 con 0x7f66880b51a0 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f668e9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668816a480 con 0x7f6670003a90 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f668e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668816a760 con 0x7f66880cfc40 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880b51a0 0x7f66880cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880b51a0 0x7f66880cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58570/0 (socket says 172.21.15.86:58570) 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 -- 172.21.15.86:0/3280852008 learned_addr learned my addr 172.21.15.86:0/3280852008 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:10.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f668cf9c700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66880cfc40 0x7f668815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f6687fff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670003a90 0x7f66880b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 -- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66880cfc40 msgr2=0x7f668815c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66880cfc40 0x7f668815c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 -- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670003a90 msgr2=0x7f66880b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670003a90 0x7f66880b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 -- 172.21.15.86:0/3280852008 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668816aa40 con 0x7f66880b51a0 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f6687fff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670003a90 0x7f66880b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.797+0000 7f66877fe700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880b51a0 0x7f66880cf700 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f667c00eb10 tx=0x7f667c000d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.798+0000 7f666ffff700 1 -- 172.21.15.86:0/3280852008 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00c760 con 0x7f66880b51a0 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.798+0000 7f666ffff700 1 -- 172.21.15.86:0/3280852008 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00c8e0 con 0x7f66880b51a0 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.798+0000 7f666ffff700 1 -- 172.21.15.86:0/3280852008 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00cca0 con 0x7f66880b51a0 2023-10-09T11:54:10.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.798+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66880b3ad0 con 0x7f66880b51a0 2023-10-09T11:54:10.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.798+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66880b5610 con 0x7f66880b51a0 2023-10-09T11:54:10.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.799+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668804c3c0 con 0x7f66880b51a0 2023-10-09T11:54:10.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.800+0000 7f666ffff700 1 -- 172.21.15.86:0/3280852008 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f667c013630 con 0x7f66880b51a0 2023-10-09T11:54:10.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.801+0000 7f666ffff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6674066f30 0x7f66740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:10.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.801+0000 7f666ffff700 1 -- 172.21.15.86:0/3280852008 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f667c0846a0 con 0x7f66880b51a0 2023-10-09T11:54:10.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.801+0000 7f6687fff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6674066f30 0x7f66740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:10.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.802+0000 7f6687fff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6674066f30 0x7f66740693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6678001eb0 tx=0x7f6678015000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:10.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.805+0000 7f666ffff700 1 -- 172.21.15.86:0/3280852008 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f667c0517b0 con 0x7f66880b51a0 2023-10-09T11:54:10.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.990+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f668816a5f0 con 0x7f6674066f30 2023-10-09T11:54:10.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:10.998+0000 7f666ffff700 1 -- 172.21.15.86:0/3280852008 <== mgr.5538 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278076 (secure 0 0 0) 0x7f668816a5f0 con 0x7f6674066f30 2023-10-09T11:54:11.002 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6674066f30 msgr2=0x7f66740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6674066f30 0x7f66740693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6678001eb0 tx=0x7f6678015000 comp rx=0 tx=0).stop 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880b51a0 msgr2=0x7f66880cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880b51a0 0x7f66880cf700 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f667c00eb10 tx=0x7f667c000d70 comp rx=0 tx=0).stop 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 shutdown_connections 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66880cfc40 0x7f668815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6670003a90 0x7f66880b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6674066f30 0x7f66740693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 --2- 172.21.15.86:0/3280852008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66880b51a0 0x7f66880cf700 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 >> 172.21.15.86:0/3280852008 conn(0x7f6688068e20 msgr2=0x7f668815d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:11.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.002+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 shutdown_connections 2023-10-09T11:54:11.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.003+0000 7f668e9ff700 1 -- 172.21.15.86:0/3280852008 wait complete. 2023-10-09T11:54:11.005 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:54:11.020 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:54:09.750681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2425896,"kb_used_data":6632,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752548824,"statfs":{"total":773094113280,"available":770609995776,"internally_reserved":0,"allocated":6791168,"data_stored":3762656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.950955"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804988+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:46.920453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804007+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:43.667401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.807664+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:07.172960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808039+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:38.115682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805998+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:54.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803394+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:19.199266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802553+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:59.399434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.810236+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:47.740702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803011+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:42.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809323+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:53.174706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808788+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:07.352232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805151+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:15.430158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805566+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:20.445983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808039+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:14.908569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805090+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:58.745342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809283+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:55.546449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805073+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:43.629702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803190+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:23.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802176+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:12.021657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805358+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:43.565153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804959+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:40.080032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802176+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:34.269113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809227+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:03.311271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808279+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:48.260132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805216+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:54.146487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808130+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:51.945674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.807030+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.010987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808193+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.154526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802728+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:53:13.937158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.806408+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:04.679159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809804+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:27.810667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802183+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:36.683393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":274,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T11:54:01.866613+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:54:01.866613+0000","last_peered":"2023-10-09T11:54:01.866613+0000","last_clean":"2023-10-09T11:54:01.866613+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:54:01.866613+0000","last_undegraded":"2023-10-09T11:54:01.866613+0000","last_fullsized":"2023-10-09T11:54:01.866613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1294336,"data_stored":913108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.67100000000000004},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":0.873,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.70499999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93400000000000005,"5min":1.014,"15min":1.0349999999999999},"last":0.749}]},{"osd":2,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.69599999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.44600000000000001},"max":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":1.1599999999999999},"last":0.876},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.048,"15min":1.202},"last":0.93500000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1.016},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92500000000000004,"5min":1.073,"15min":1.073},"last":0.89200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.73999999999999999,"5min":0.91000000000000003,"15min":0.94099999999999995},"last":0.83699999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.96199999999999997},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.048},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":0.79600000000000004,"5min":0.95699999999999996,"15min":1.0620000000000001},"last":0.99299999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.748,"15min":0.751},"min":{"1min":0.59699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":0.95599999999999996,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.60699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.95099999999999996,"5min":0.98399999999999999,"15min":1.216},"last":0.82299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.439},"max":{"1min":1.008,"5min":1.008,"15min":1.139},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.47299999999999998},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.431},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.502},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.244},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.92600000000000005,"15min":1.613},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.94899999999999995,"15min":1.143},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.2410000000000001},"last":0.495}]},{"osd":7,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.495,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":1.506},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":1.6759999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.385},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.374,"15min":0.318},"max":{"1min":0.77800000000000002,"5min":0.83199999999999996,"15min":1.099},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64800000000000002,"5min":0.80000000000000004,"15min":1.536},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.746,"15min":1.272},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82899999999999996,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.48899999999999999},"max":{"1min":1.115,"5min":1.1479999999999999,"15min":1.7210000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.56799999999999995,"15min":0.46899999999999997},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.181,"15min":1.677},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.81699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.55300000000000005},"max":{"1min":1.0669999999999999,"5min":1.135,"15min":1.778},"last":0.501}]},{"osd":6,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.51100000000000001},"max":{"1min":1.0760000000000001,"5min":1.2430000000000001,"15min":1.623},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.65200000000000002,"5min":0.61699999999999999,"15min":0.50700000000000001},"max":{"1min":1.02,"5min":1.274,"15min":1.708},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.84099999999999997},"min":{"1min":0.65000000000000002,"5min":0.62,"15min":0.52900000000000003},"max":{"1min":1.032,"5min":1.2130000000000001,"15min":1.659},"last":0.627},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.0880000000000001,"5min":1.194,"15min":1.736},"last":0.56399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":913108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47599999999999998,"15min":0.48499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57199999999999995,"5min":0.753,"15min":1.367},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68700000000000006,"5min":0.85599999999999998,"15min":1.4930000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":1.8340000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.83499999999999996,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":1.855},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.752,"5min":0.84799999999999998,"15min":1.2330000000000001},"last":0.62}]},{"osd":4,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0449999999999999,"5min":1.169,"15min":1.254},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47199999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.099},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48099999999999998},"max":{"1min":1.129,"5min":1.1890000000000001,"15min":1.2},"last":0.86699999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.57899999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.028,"5min":1.169,"15min":1.321},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.1299999999999999,"15min":1.24},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.2849999999999999},"last":0.83899999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542302,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306164,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065676,"statfs":{"total":96636764160,"available":96323252224,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47199999999999998,"15min":0.46000000000000002},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.66500000000000004,"5min":0.755,"15min":0.83799999999999997},"last":0.5}]},{"osd":1,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.97299999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.32200000000000001},"max":{"1min":0.65900000000000003,"5min":0.81200000000000006,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.79700000000000004},"min":{"1min":0.59999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.79700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.50700000000000001},"max":{"1min":1.0309999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82399999999999995,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83699999999999997,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.56299999999999994},"max":{"1min":1.0569999999999999,"5min":1.204,"15min":1.27},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.66200000000000003,"5min":0.621,"15min":0.53100000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.246},"last":0.63},{"interface":"front","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.67900000000000005,"5min":0.63400000000000001,"15min":0.57299999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.2130000000000001},"last":0.68000000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.34699999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.70999999999999996,"15min":1.208},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":1.1970000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":1.0229999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.311},"max":{"1min":0.624,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.55100000000000005},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.624}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.65000000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.327},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.70599999999999996,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.141,"15min":1.2689999999999999},"last":1.0620000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":1.109,"5min":1.109,"15min":1.2829999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.66800000000000004,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.3660000000000001},"last":0.94199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.50700000000000001,"15min":0.47999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.1459999999999999,"15min":1.218},"last":0.91600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.46999999999999997},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.333},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.54700000000000004},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.3560000000000001},"last":1.024}]}]},{"osd":4,"up_from":16,"seq":68719476894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310260,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061580,"statfs":{"total":96636764160,"available":96319057920,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":1.071},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.39100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.2569999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.94299999999999995,"5min":1.05,"15min":1.2909999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74299999999999999,"15min":0.73199999999999998},"min":{"1min":0.60499999999999998,"5min":0.54900000000000004,"15min":0.45400000000000001},"max":{"1min":0.90800000000000003,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90800000000000003,"5min":0.995,"15min":1.234},"last":0.84699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.432},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.94699999999999995,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91700000000000004,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.125},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.82599999999999996,"5min":0.91900000000000004,"15min":1.373},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":1.2410000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":1.1200000000000001,"15min":1.222},"last":0.74199999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.1180000000000001,"15min":1.48},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.318},"max":{"1min":0.877,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.86799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.41199999999999998},"max":{"1min":0.88500000000000001,"5min":0.95299999999999996,"15min":1.0840000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.47799999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":1.21},"last":0.79300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.0389999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72799999999999998,"15min":0.70099999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.90300000000000002,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.45900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.363},"last":0.746},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91800000000000004,"5min":1.0029999999999999,"15min":1.508},"last":0.90600000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77500000000000002,"5min":1.018,"15min":1.018},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61399999999999999,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68799999999999994,"5min":0.998,"15min":1.321},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":1.0269999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.49199999999999999,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.0669999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86199999999999999,"5min":1.0129999999999999,"15min":3.3620000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.755},"min":{"1min":0.51400000000000001,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":3.3149999999999999},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:54:11.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:54:11.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.240+0000 7f2d407ff700 1 Processor -- start 2023-10-09T11:54:11.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.240+0000 7f2d407ff700 1 -- start start 2023-10-09T11:54:11.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.241+0000 7f2d407ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d38068550 0x7f2d38068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.241+0000 7f2d407ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 0x7f2d38159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.241+0000 7f2d407ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3806ec70 con 0x7f2d3815e010 2023-10-09T11:54:11.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.241+0000 7f2d407ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380b3430 con 0x7f2d38068550 2023-10-09T11:54:11.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.241+0000 7f2d407ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3806fc70 con 0x7f2d3806f810 2023-10-09T11:54:11.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.241+0000 7f2d3dd9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2d3815e010 0x7f2d3806f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48300/0 (socket says 172.21.15.86:48300) 2023-10-09T11:54:11.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3dd9a700 1 -- 172.21.15.86:0/2695985701 learned_addr learned my addr 172.21.15.86:0/2695985701 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:11.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/2695985701 >> v2:172.21.15.135:3300/0 conn(0x7f2d38068550 0x7f2d38068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3ed9c700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 0x7f2d38159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110867210 0 0) 0x7f2d3806ec70 con 0x7f2d3815e010 2023-10-09T11:54:11.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d24003570 con 0x7f2d3815e010 2023-10-09T11:54:11.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3011006921 0 0) 0x7f2d24003570 con 0x7f2d3815e010 2023-10-09T11:54:11.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 msgr2=0x7f2d38159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:11.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 0x7f2d38159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 >> v2:172.21.15.135:3300/0 conn(0x7f2d38068550 msgr2=0x7f2d38068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 --2- 172.21.15.86:0/2695985701 >> v2:172.21.15.135:3300/0 conn(0x7f2d38068550 0x7f2d38068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d380b2e70 con 0x7f2d3815e010 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f2d28001470 con 0x7f2d3815e010 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 >> v1:172.21.15.86:6789/0 conn(0x7f2d3815e010 legacy=0x7f2d3806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d24003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 0x7f2d24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d24004d50 0x7f2d240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3806fc70 con 0x7f2d24003ae0 2023-10-09T11:54:11.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2400bb10 con 0x7f2d24004d50 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.242+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2400bc80 con 0x7f2d3806f810 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d24003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3dd9a700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 0x7f2d24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3ed9c700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d24004d50 0x7f2d240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3e59b700 1 -- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 msgr2=0x7f2d24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d3806f810 0x7f2d24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3e59b700 1 -- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d24004d50 msgr2=0x7f2d240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d24004d50 0x7f2d240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3e59b700 1 -- 172.21.15.86:0/2695985701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24003570 con 0x7f2d24003ae0 2023-10-09T11:54:11.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d24003ef0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009c00 tx=0x7f2d340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91bc776f91cfc96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.243+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400e6b0 con 0x7f2d24003ae0 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3400e810 con 0x7f2d24003ae0 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d3d599700 1 -- 172.21.15.86:0/2695985701 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400ebd0 con 0x7f2d24003ae0 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d407ff700 1 -- 172.21.15.86:0/2695985701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 msgr2=0x7f2d24003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d407ff700 1 --2- 172.21.15.86:0/2695985701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d24003ef0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009c00 tx=0x7f2d340091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d3ed9c700 1 -- 172.21.15.86:0/2695985701 reap_dead start 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d407ff700 1 -- 172.21.15.86:0/2695985701 shutdown_connections 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d407ff700 1 -- 172.21.15.86:0/2695985701 >> 172.21.15.86:0/2695985701 conn(0x7f2d380cd480 msgr2=0x7f2d380cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:11.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d407ff700 1 -- 172.21.15.86:0/2695985701 shutdown_connections 2023-10-09T11:54:11.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.244+0000 7f2d407ff700 1 -- 172.21.15.86:0/2695985701 wait complete. 2023-10-09T11:54:11.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.246+0000 7f2d407ff700 1 Processor -- start 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.246+0000 7f2d407ff700 1 -- start start 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.246+0000 7f2d407ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d38137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.246+0000 7f2d407ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d38149130 0x7f2d3814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d407ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3814f580 0x7f2d380ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d407ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38137f30 con 0x7f2d24003ae0 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d407ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38138210 con 0x7f2d3814f580 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d407ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3814fab0 con 0x7f2d38149130 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d38137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d38137570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58584/0 (socket says 172.21.15.86:58584) 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 -- 172.21.15.86:0/633743479 learned_addr learned my addr 172.21.15.86:0/633743479 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3ed9c700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3814f580 0x7f2d380ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3dd9a700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d38149130 0x7f2d3814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 -- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d38149130 msgr2=0x7f2d3814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d38149130 0x7f2d3814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 -- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3814f580 msgr2=0x7f2d380ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3814f580 0x7f2d380ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 -- 172.21.15.86:0/633743479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3814fd90 con 0x7f2d24003ae0 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3dd9a700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d38149130 0x7f2d3814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3ed9c700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3814f580 0x7f2d380ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d3e59b700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d38137570 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400e4b0 tx=0x7f2d3401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.247+0000 7f2d2e7fc700 1 -- 172.21.15.86:0/633743479 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34022070 con 0x7f2d24003ae0 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.248+0000 7f2d2e7fc700 1 -- 172.21.15.86:0/633743479 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3400e980 con 0x7f2d24003ae0 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.248+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d38150070 con 0x7f2d24003ae0 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.248+0000 7f2d2e7fc700 1 -- 172.21.15.86:0/633743479 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34027470 con 0x7f2d24003ae0 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.248+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380ae3b0 con 0x7f2d24003ae0 2023-10-09T11:54:11.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.249+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3804c3c0 con 0x7f2d24003ae0 2023-10-09T11:54:11.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.249+0000 7f2d2e7fc700 1 -- 172.21.15.86:0/633743479 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d3401c450 con 0x7f2d24003ae0 2023-10-09T11:54:11.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.251+0000 7f2d2e7fc700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d1c066f30 0x7f2d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.251+0000 7f2d2e7fc700 1 -- 172.21.15.86:0/633743479 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f2d34086200 con 0x7f2d24003ae0 2023-10-09T11:54:11.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.251+0000 7f2d3dd9a700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d1c066f30 0x7f2d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.251+0000 7f2d3dd9a700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d1c066f30 0x7f2d1c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d28001660 tx=0x7f2d28009040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:11.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.255+0000 7f2d2e7fc700 1 -- 172.21.15.86:0/633743479 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d340533d0 con 0x7f2d24003ae0 2023-10-09T11:54:11.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.439+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d38138350 con 0x7f2d1c066f30 2023-10-09T11:54:11.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.447+0000 7f2d2e7fc700 1 -- 172.21.15.86:0/633743479 <== mgr.5538 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278076 (secure 0 0 0) 0x7f2d28001430 con 0x7f2d1c066f30 2023-10-09T11:54:11.451 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:11.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d1c066f30 msgr2=0x7f2d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d1c066f30 0x7f2d1c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d28001660 tx=0x7f2d28009040 comp rx=0 tx=0).stop 2023-10-09T11:54:11.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 msgr2=0x7f2d38137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d38137570 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400e4b0 tx=0x7f2d3401a000 comp rx=0 tx=0).stop 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 shutdown_connections 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d1c066f30 0x7f2d1c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d24003ae0 0x7f2d38137570 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d3814f580 0x7f2d380ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 --2- 172.21.15.86:0/633743479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d38149130 0x7f2d3814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 >> 172.21.15.86:0/633743479 conn(0x7f2d380cd480 msgr2=0x7f2d38152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 shutdown_connections 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.451+0000 7f2d407ff700 1 -- 172.21.15.86:0/633743479 wait complete. 2023-10-09T11:54:11.454 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:54:11.469 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:54:09.750681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2425896,"kb_used_data":6632,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752548824,"statfs":{"total":773094113280,"available":770609995776,"internally_reserved":0,"allocated":6791168,"data_stored":3762656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.950955"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804988+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:46.920453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804007+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:43.667401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.807664+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:07.172960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808039+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:38.115682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805998+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:54.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803394+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:19.199266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802553+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:59.399434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.810236+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:47.740702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803011+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:42.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809323+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:53.174706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808788+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:07.352232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805151+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:15.430158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805566+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:20.445983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808039+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:14.908569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805090+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:58.745342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809283+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:55.546449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805073+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:07:43.629702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.803190+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:23.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802176+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:12.021657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805358+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:43.565153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.804959+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:40.080032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802176+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:34.269113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809227+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:03.311271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808279+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:48.260132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.805216+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:54.146487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808130+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:51.945674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.807030+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:26.010987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.808193+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.154526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802728+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:53:13.937158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.806408+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:04.679159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.809804+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:27.810667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:54:04.798659+0000","last_change":"2023-10-09T11:54:04.798659+0000","last_active":"2023-10-09T11:54:04.798659+0000","last_peered":"2023-10-09T11:54:04.798659+0000","last_clean":"2023-10-09T11:54:04.798659+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:04.798659+0000","last_undegraded":"2023-10-09T11:54:04.798659+0000","last_fullsized":"2023-10-09T11:54:04.798659+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:54:03.792688+0000","last_change":"2023-10-09T11:54:03.802183+0000","last_active":"2023-10-09T11:54:03.792688+0000","last_peered":"2023-10-09T11:54:03.792688+0000","last_clean":"2023-10-09T11:54:03.792688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:54:03.792688+0000","last_undegraded":"2023-10-09T11:54:03.792688+0000","last_fullsized":"2023-10-09T11:54:03.792688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:36.683393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":274,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T11:54:01.866613+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:54:01.866613+0000","last_peered":"2023-10-09T11:54:01.866613+0000","last_clean":"2023-10-09T11:54:01.866613+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:54:01.866613+0000","last_undegraded":"2023-10-09T11:54:01.866613+0000","last_fullsized":"2023-10-09T11:54:01.866613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1294336,"data_stored":913108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.67100000000000004},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":0.873,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.70499999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93400000000000005,"5min":1.014,"15min":1.0349999999999999},"last":0.749}]},{"osd":2,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.69599999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.44600000000000001},"max":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":1.1599999999999999},"last":0.876},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.048,"15min":1.202},"last":0.93500000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1.016},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92500000000000004,"5min":1.073,"15min":1.073},"last":0.89200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.73999999999999999,"5min":0.91000000000000003,"15min":0.94099999999999995},"last":0.83699999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.96199999999999997},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.048},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":0.79600000000000004,"5min":0.95699999999999996,"15min":1.0620000000000001},"last":0.99299999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.748,"15min":0.751},"min":{"1min":0.59699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":0.95599999999999996,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.60699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.95099999999999996,"5min":0.98399999999999999,"15min":1.216},"last":0.82299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.439},"max":{"1min":1.008,"5min":1.008,"15min":1.139},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.47299999999999998},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.431},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.502},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.244},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.92600000000000005,"15min":1.613},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.94899999999999995,"15min":1.143},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.2410000000000001},"last":0.495}]},{"osd":7,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.495,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":1.506},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":1.6759999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.385},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.374,"15min":0.318},"max":{"1min":0.77800000000000002,"5min":0.83199999999999996,"15min":1.099},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64800000000000002,"5min":0.80000000000000004,"15min":1.536},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.746,"15min":1.272},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82899999999999996,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.48899999999999999},"max":{"1min":1.115,"5min":1.1479999999999999,"15min":1.7210000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.56799999999999995,"15min":0.46899999999999997},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.181,"15min":1.677},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.81699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.55300000000000005},"max":{"1min":1.0669999999999999,"5min":1.135,"15min":1.778},"last":0.501}]},{"osd":6,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.51100000000000001},"max":{"1min":1.0760000000000001,"5min":1.2430000000000001,"15min":1.623},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.65200000000000002,"5min":0.61699999999999999,"15min":0.50700000000000001},"max":{"1min":1.02,"5min":1.274,"15min":1.708},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.84099999999999997},"min":{"1min":0.65000000000000002,"5min":0.62,"15min":0.52900000000000003},"max":{"1min":1.032,"5min":1.2130000000000001,"15min":1.659},"last":0.627},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.0880000000000001,"5min":1.194,"15min":1.736},"last":0.56399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":913108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47599999999999998,"15min":0.48499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57199999999999995,"5min":0.753,"15min":1.367},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68700000000000006,"5min":0.85599999999999998,"15min":1.4930000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":1.8340000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.83499999999999996,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":1.855},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.752,"5min":0.84799999999999998,"15min":1.2330000000000001},"last":0.62}]},{"osd":4,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0449999999999999,"5min":1.169,"15min":1.254},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47199999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.099},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48099999999999998},"max":{"1min":1.129,"5min":1.1890000000000001,"15min":1.2},"last":0.86699999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.57899999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.028,"5min":1.169,"15min":1.321},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.1299999999999999,"15min":1.24},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.2849999999999999},"last":0.83899999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542302,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306164,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065676,"statfs":{"total":96636764160,"available":96323252224,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47199999999999998,"15min":0.46000000000000002},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.66500000000000004,"5min":0.755,"15min":0.83799999999999997},"last":0.5}]},{"osd":1,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.97299999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.32200000000000001},"max":{"1min":0.65900000000000003,"5min":0.81200000000000006,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.79700000000000004},"min":{"1min":0.59999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.79700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.50700000000000001},"max":{"1min":1.0309999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82399999999999995,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83699999999999997,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.56299999999999994},"max":{"1min":1.0569999999999999,"5min":1.204,"15min":1.27},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.66200000000000003,"5min":0.621,"15min":0.53100000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.246},"last":0.63},{"interface":"front","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.67900000000000005,"5min":0.63400000000000001,"15min":0.57299999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.2130000000000001},"last":0.68000000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.34699999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.70999999999999996,"15min":1.208},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":1.1970000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":1.0229999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.311},"max":{"1min":0.624,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.55100000000000005},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.624}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.65000000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.327},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.70599999999999996,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.141,"15min":1.2689999999999999},"last":1.0620000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":1.109,"5min":1.109,"15min":1.2829999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.66800000000000004,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.3660000000000001},"last":0.94199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.50700000000000001,"15min":0.47999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.1459999999999999,"15min":1.218},"last":0.91600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.46999999999999997},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.333},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.54700000000000004},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.3560000000000001},"last":1.024}]}]},{"osd":4,"up_from":16,"seq":68719476894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310260,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061580,"statfs":{"total":96636764160,"available":96319057920,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":1.071},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.39100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.2569999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.94299999999999995,"5min":1.05,"15min":1.2909999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74299999999999999,"15min":0.73199999999999998},"min":{"1min":0.60499999999999998,"5min":0.54900000000000004,"15min":0.45400000000000001},"max":{"1min":0.90800000000000003,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90800000000000003,"5min":0.995,"15min":1.234},"last":0.84699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.432},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.94699999999999995,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91700000000000004,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.125},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.82599999999999996,"5min":0.91900000000000004,"15min":1.373},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":1.2410000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":1.1200000000000001,"15min":1.222},"last":0.74199999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302068,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069772,"statfs":{"total":96636764160,"available":96327446528,"internally_reserved":0,"allocated":700416,"data_stored":322740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.1180000000000001,"15min":1.48},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.318},"max":{"1min":0.877,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.86799999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.41199999999999998},"max":{"1min":0.88500000000000001,"5min":0.95299999999999996,"15min":1.0840000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.47799999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":1.21},"last":0.79300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.0389999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72799999999999998,"15min":0.70099999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.90300000000000002,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.45900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.363},"last":0.746},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91800000000000004,"5min":1.0029999999999999,"15min":1.508},"last":0.90600000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77500000000000002,"5min":1.018,"15min":1.018},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61399999999999999,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68799999999999994,"5min":0.998,"15min":1.321},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":1.0269999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.49199999999999999,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.0669999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86199999999999999,"5min":1.0129999999999999,"15min":3.3620000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.755},"min":{"1min":0.51400000000000001,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":3.3149999999999999},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:54:11.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-10-09T11:54:11.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-10-09T11:54:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-10-09T11:54:11.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-10-09T11:54:11.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-09T11:54:11.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.804988+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:01:46.920453+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.804007+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:09:43.667401+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.807664+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:01:07.172960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-10-09T11:54:11.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.808039+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:21:38.115682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.805998+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:56:54.434659+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-10-09T11:54:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.803394+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:04:19.199266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.802553+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:02:59.399434+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.810236+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:50:47.740702+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-09T11:54:11.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.803011+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:04:42.038644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.809323+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:07:53.174706+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.808788+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:38:07.352232+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.805151+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:25:15.430158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.805566+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:38:20.445983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:54:11.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.808039+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:15:14.908569+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.805090+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:28:58.745342+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-10-09T11:54:11.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.809283+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:33:55.546449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.805073+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:07:43.629702+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-10-09T11:54:11.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.803190+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:56:23.690948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.802176+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:43:12.021657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.805358+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:56:43.565153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:54:11.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.804959+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:38:40.080032+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.802176+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:40:34.269113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-10-09T11:54:11.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.809227+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:49:03.311271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.808279+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:20:48.260132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-09T11:54:11.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.805216+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:35:54.146487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.808130+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:27:51.945674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.807030+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:30:26.010987+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-10-09T11:54:11.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.808193+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:25:53.154526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.802728+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:53:13.937158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-10-09T11:54:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.806408+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:54:04.679159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.809804+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:22:27.810667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:54:04.798659+0000', 'last_change': '2023-10-09T11:54:04.798659+0000', 'last_active': '2023-10-09T11:54:04.798659+0000', 'last_peered': '2023-10-09T11:54:04.798659+0000', 'last_clean': '2023-10-09T11:54:04.798659+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:04.798659+0000', 'last_undegraded': '2023-10-09T11:54:04.798659+0000', 'last_fullsized': '2023-10-09T11:54:04.798659+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:04.798659+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-10-09T11:54:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:54:03.792688+0000', 'last_change': '2023-10-09T11:54:03.802183+0000', 'last_active': '2023-10-09T11:54:03.792688+0000', 'last_peered': '2023-10-09T11:54:03.792688+0000', 'last_clean': '2023-10-09T11:54:03.792688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:54:03.792688+0000', 'last_undegraded': '2023-10-09T11:54:03.792688+0000', 'last_fullsized': '2023-10-09T11:54:03.792688+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'last_clean_scrub_stamp': '2023-10-09T11:54:03.792688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:47:36.683393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:54:11.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:54:11.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.688+0000 7f870dbff700 1 Processor -- start 2023-10-09T11:54:11.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.688+0000 7f870dbff700 1 -- start start 2023-10-09T11:54:11.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f870dbff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87080ccc40 0x7f87080ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f870dbff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87080cd010 0x7f87080acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f870dbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8708153f10 con 0x7f87081564a0 2023-10-09T11:54:11.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f870dbff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080ad9d0 con 0x7f87080ccc40 2023-10-09T11:54:11.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f870dbff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080aed00 con 0x7f87080cd010 2023-10-09T11:54:11.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f87077fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87080ccc40 0x7f87080ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f8707fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f87081564a0 0x7f87081568d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48314/0 (socket says 172.21.15.86:48314) 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f8707fff700 1 -- 172.21.15.86:0/1358429114 learned_addr learned my addr 172.21.15.86:0/1358429114 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f8706ffd700 1 --2- 172.21.15.86:0/1358429114 >> v2:172.21.15.135:3300/0 conn(0x7f87080cd010 0x7f87080acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f87067fc700 1 -- 172.21.15.86:0/1358429114 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999901729 0 0) 0x7f8708153f10 con 0x7f87081564a0 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f87067fc700 1 -- 172.21.15.86:0/1358429114 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f0003570 con 0x7f87081564a0 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f87077fe700 1 -- 172.21.15.86:0/1358429114 >> v2:172.21.15.135:3300/0 conn(0x7f87080cd010 msgr2=0x7f87080acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f87077fe700 1 --2- 172.21.15.86:0/1358429114 >> v2:172.21.15.135:3300/0 conn(0x7f87080cd010 0x7f87080acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f87077fe700 1 -- 172.21.15.86:0/1358429114 >> v1:172.21.15.86:6789/0 conn(0x7f87081564a0 legacy=0x7f87081568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.690+0000 7f87077fe700 1 -- 172.21.15.86:0/1358429114 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87080af800 con 0x7f87080ccc40 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.691+0000 7f87077fe700 1 --2- 172.21.15.86:0/1358429114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080ccc40 0x7f87080ac800 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f870806d310 tx=0x7f86f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f903a37ed7bde37 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.691+0000 7f87067fc700 1 -- 172.21.15.86:0/1358429114 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011630 con 0x7f87080ccc40 2023-10-09T11:54:11.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.691+0000 7f87067fc700 1 -- 172.21.15.86:0/1358429114 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8011790 con 0x7f87080ccc40 2023-10-09T11:54:11.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.691+0000 7f87067fc700 1 -- 172.21.15.86:0/1358429114 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011b30 con 0x7f87080ccc40 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.691+0000 7f870dbff700 1 -- 172.21.15.86:0/1358429114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080ccc40 msgr2=0x7f87080ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.691+0000 7f870dbff700 1 --2- 172.21.15.86:0/1358429114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080ccc40 0x7f87080ac800 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f870806d310 tx=0x7f86f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.692+0000 7f870dbff700 1 -- 172.21.15.86:0/1358429114 shutdown_connections 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.692+0000 7f870dbff700 1 --2- 172.21.15.86:0/1358429114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080ccc40 0x7f87080ac800 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.692+0000 7f870dbff700 1 --2- 172.21.15.86:0/1358429114 >> v2:172.21.15.135:3300/0 conn(0x7f87080cd010 0x7f87080acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.692+0000 7f870dbff700 1 -- 172.21.15.86:0/1358429114 >> 172.21.15.86:0/1358429114 conn(0x7f870806a310 msgr2=0x7f87080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.692+0000 7f870dbff700 1 -- 172.21.15.86:0/1358429114 shutdown_connections 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.692+0000 7f870dbff700 1 -- 172.21.15.86:0/1358429114 wait complete. 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.693+0000 7f870dbff700 1 Processor -- start 2023-10-09T11:54:11.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.693+0000 7f870dbff700 1 -- start start 2023-10-09T11:54:11.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f870dbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87080ccc40 0x7f87080c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f870dbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080cd010 0x7f87080cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f870dbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87081564a0 0x7f8708147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f870dbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87080cc2c0 con 0x7f87080cd010 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f870dbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870806dac0 con 0x7f87080ccc40 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f870dbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87080cb760 con 0x7f87081564a0 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f8706ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080cd010 0x7f87080cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f8706ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080cd010 0x7f87080cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58600/0 (socket says 172.21.15.86:58600) 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.694+0000 7f8706ffd700 1 -- 172.21.15.86:0/1830232161 learned_addr learned my addr 172.21.15.86:0/1830232161 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f87077fe700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87080ccc40 0x7f87080c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8706ffd700 1 -- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87081564a0 msgr2=0x7f8708147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8707fff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87081564a0 0x7f8708147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8706ffd700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87081564a0 0x7f8708147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8706ffd700 1 -- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87080ccc40 msgr2=0x7f87080c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8706ffd700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87080ccc40 0x7f87080c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8706ffd700 1 -- 172.21.15.86:0/1830232161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8009420 con 0x7f87080cd010 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f87077fe700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87080ccc40 0x7f87080c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8707fff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87081564a0 0x7f8708147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f8706ffd700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080cd010 0x7f87080cb220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d860 tx=0x7f86fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f86ef7fe700 1 -- 172.21.15.86:0/1830232161 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc009610 con 0x7f87080cd010 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f86ef7fe700 1 -- 172.21.15.86:0/1830232161 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc009770 con 0x7f87080cd010 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87080cba20 con 0x7f87080cd010 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f86ef7fe700 1 -- 172.21.15.86:0/1830232161 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc009b30 con 0x7f87080cd010 2023-10-09T11:54:11.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.695+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87080cbfe0 con 0x7f87080cd010 2023-10-09T11:54:11.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.696+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870806d890 con 0x7f87080cd010 2023-10-09T11:54:11.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.697+0000 7f86ef7fe700 1 -- 172.21.15.86:0/1830232161 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86fc01e460 con 0x7f87080cd010 2023-10-09T11:54:11.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.699+0000 7f86ef7fe700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f86f4066f30 0x7f86f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:11.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.699+0000 7f86ef7fe700 1 -- 172.21.15.86:0/1830232161 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f86fc084cc0 con 0x7f87080cd010 2023-10-09T11:54:11.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.699+0000 7f87077fe700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f86f4066f30 0x7f86f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:11.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.699+0000 7f87077fe700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f86f4066f30 0x7f86f40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86f80091e0 tx=0x7f86f8017000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:11.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.703+0000 7f86ef7fe700 1 -- 172.21.15.86:0/1830232161 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f870806d890 con 0x7f87080cd010 2023-10-09T11:54:11.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.970+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f870806d890 con 0x7f87080cd010 2023-10-09T11:54:11.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.970+0000 7f86ef7fe700 1 -- 172.21.15.86:0/1830232161 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1111 (secure 0 0 0) 0x7f870806d890 con 0x7f87080cd010 2023-10-09T11:54:11.971 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:11.971 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":804,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":63,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2484117504,"bytes_avail":770609995776,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5724}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-09T11:43:25.681263+0000","services":{}},"progress_events":{}} 2023-10-09T11:54:11.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f86f4066f30 msgr2=0x7f86f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f86f4066f30 0x7f86f40693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86f80091e0 tx=0x7f86f8017000 comp rx=0 tx=0).stop 2023-10-09T11:54:11.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080cd010 msgr2=0x7f87080cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:11.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080cd010 0x7f87080cb220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d860 tx=0x7f86fc008040 comp rx=0 tx=0).stop 2023-10-09T11:54:11.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 shutdown_connections 2023-10-09T11:54:11.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87081564a0 0x7f8708147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87080ccc40 0x7f87080c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f86f4066f30 0x7f86f40693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 --2- 172.21.15.86:0/1830232161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87080cd010 0x7f87080cb220 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 >> 172.21.15.86:0/1830232161 conn(0x7f870806a310 msgr2=0x7f870814b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 shutdown_connections 2023-10-09T11:54:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:11.973+0000 7f870dbff700 1 -- 172.21.15.86:0/1830232161 wait complete. 2023-10-09T11:54:11.991 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:54:11.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:54:12.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.172+0000 7f39217ff700 1 Processor -- start 2023-10-09T11:54:12.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.172+0000 7f39217ff700 1 -- start start 2023-10-09T11:54:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f39217ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f391c0afc40 0x7f391c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f39217ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f391c0b0010 0x7f391c15df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f39217ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c0b0750 con 0x7f391c0b2140 2023-10-09T11:54:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f39217ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0aca70 con 0x7f391c0afc40 2023-10-09T11:54:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f39217ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0acd50 con 0x7f391c0b0010 2023-10-09T11:54:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391a7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f391c0b2140 0x7f391c15d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48328/0 (socket says 172.21.15.86:48328) 2023-10-09T11:54:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391a7fc700 1 -- 172.21.15.86:0/895212072 learned_addr learned my addr 172.21.15.86:0/895212072 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391affd700 1 --2- 172.21.15.86:0/895212072 >> v2:172.21.15.86:3300/0 conn(0x7f391c0afc40 0x7f391c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391b7fe700 1 --2- 172.21.15.86:0/895212072 >> v2:172.21.15.135:3300/0 conn(0x7f391c0b0010 0x7f391c15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f3919ffb700 1 -- 172.21.15.86:0/895212072 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086628289 0 0) 0x7f391c0b0750 con 0x7f391c0b2140 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f3919ffb700 1 -- 172.21.15.86:0/895212072 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3904003570 con 0x7f391c0b2140 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391affd700 1 -- 172.21.15.86:0/895212072 >> v2:172.21.15.135:3300/0 conn(0x7f391c0b0010 msgr2=0x7f391c15df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391affd700 1 --2- 172.21.15.86:0/895212072 >> v2:172.21.15.135:3300/0 conn(0x7f391c0b0010 0x7f391c15df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391affd700 1 -- 172.21.15.86:0/895212072 >> v1:172.21.15.86:6789/0 conn(0x7f391c0b2140 legacy=0x7f391c15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391affd700 1 -- 172.21.15.86:0/895212072 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0ad030 con 0x7f391c0afc40 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.174+0000 7f391b7fe700 1 --2- 172.21.15.86:0/895212072 >> v2:172.21.15.135:3300/0 conn(0x7f391c0b0010 0x7f391c15df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.175+0000 7f391affd700 1 --2- 172.21.15.86:0/895212072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0afc40 0x7f391c0b1c00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f391c0695d0 tx=0x7f390c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb713da72175a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.175+0000 7f3919ffb700 1 -- 172.21.15.86:0/895212072 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00e070 con 0x7f391c0afc40 2023-10-09T11:54:12.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.175+0000 7f3919ffb700 1 -- 172.21.15.86:0/895212072 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c00bb60 con 0x7f391c0afc40 2023-10-09T11:54:12.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.175+0000 7f3919ffb700 1 -- 172.21.15.86:0/895212072 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c012430 con 0x7f391c0afc40 2023-10-09T11:54:12.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.175+0000 7f39217ff700 1 -- 172.21.15.86:0/895212072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0afc40 msgr2=0x7f391c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.175+0000 7f39217ff700 1 --2- 172.21.15.86:0/895212072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0afc40 0x7f391c0b1c00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f391c0695d0 tx=0x7f390c009780 comp rx=0 tx=0).stop 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.175+0000 7f39217ff700 1 -- 172.21.15.86:0/895212072 shutdown_connections 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.176+0000 7f39217ff700 1 --2- 172.21.15.86:0/895212072 >> v2:172.21.15.135:3300/0 conn(0x7f391c0b0010 0x7f391c15df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.176+0000 7f39217ff700 1 --2- 172.21.15.86:0/895212072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0afc40 0x7f391c0b1c00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.176+0000 7f39217ff700 1 -- 172.21.15.86:0/895212072 >> 172.21.15.86:0/895212072 conn(0x7f391c06a320 msgr2=0x7f391c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.176+0000 7f39217ff700 1 -- 172.21.15.86:0/895212072 shutdown_connections 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.176+0000 7f39217ff700 1 -- 172.21.15.86:0/895212072 wait complete. 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.177+0000 7f39217ff700 1 Processor -- start 2023-10-09T11:54:12.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.177+0000 7f39217ff700 1 -- start start 2023-10-09T11:54:12.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f39217ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0afc40 0x7f391c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:12.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f39217ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c0b0010 0x7f391c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:12.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f39217ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0b2140 0x7f391c06efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:12.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f39217ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c152fc0 con 0x7f391c0b2140 2023-10-09T11:54:12.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f39217ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c1612f0 con 0x7f391c0afc40 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f39217ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c1615d0 con 0x7f391c0b0010 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f391b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0b2140 0x7f391c06efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f391b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0b2140 0x7f391c06efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58622/0 (socket says 172.21.15.86:58622) 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.178+0000 7f391b7fe700 1 -- 172.21.15.86:0/731943963 learned_addr learned my addr 172.21.15.86:0/731943963 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391affd700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0afc40 0x7f391c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391b7fe700 1 -- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c0b0010 msgr2=0x7f391c160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391b7fe700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c0b0010 0x7f391c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391b7fe700 1 -- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0afc40 msgr2=0x7f391c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391b7fe700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0afc40 0x7f391c152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391b7fe700 1 -- 172.21.15.86:0/731943963 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c009a20 con 0x7f391c0b2140 2023-10-09T11:54:12.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391affd700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0afc40 0x7f391c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f391b7fe700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0b2140 0x7f391c06efd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f391400c880 tx=0x7f3914008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f3902ffd700 1 -- 172.21.15.86:0/731943963 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914011600 con 0x7f391c0b2140 2023-10-09T11:54:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f3902ffd700 1 -- 172.21.15.86:0/731943963 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3914011760 con 0x7f391c0b2140 2023-10-09T11:54:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c1618b0 con 0x7f391c0b2140 2023-10-09T11:54:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f3902ffd700 1 -- 172.21.15.86:0/731943963 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914011b20 con 0x7f391c0b2140 2023-10-09T11:54:12.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.179+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c156940 con 0x7f391c0b2140 2023-10-09T11:54:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.180+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c156bc0 con 0x7f391c0b2140 2023-10-09T11:54:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.181+0000 7f3902ffd700 1 -- 172.21.15.86:0/731943963 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39140193b0 con 0x7f391c0b2140 2023-10-09T11:54:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.182+0000 7f3902ffd700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3908066f30 0x7f39080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.182+0000 7f3902ffd700 1 -- 172.21.15.86:0/731943963 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f3914084770 con 0x7f391c0b2140 2023-10-09T11:54:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.182+0000 7f391affd700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3908066f30 0x7f39080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:12.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.183+0000 7f391affd700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3908066f30 0x7f39080693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f390c0099f0 tx=0x7f390c019000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:12.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.186+0000 7f3902ffd700 1 -- 172.21.15.86:0/731943963 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3914051880 con 0x7f391c0b2140 2023-10-09T11:54:12.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.380+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f391c04c3c0 con 0x7f3908066f30 2023-10-09T11:54:12.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.389+0000 7f3902ffd700 1 -- 172.21.15.86:0/731943963 <== mgr.5538 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288917 (secure 0 0 0) 0x7f391c04c3c0 con 0x7f3908066f30 2023-10-09T11:54:12.392 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3908066f30 msgr2=0x7f39080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3908066f30 0x7f39080693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f390c0099f0 tx=0x7f390c019000 comp rx=0 tx=0).stop 2023-10-09T11:54:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0b2140 msgr2=0x7f391c06efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0b2140 0x7f391c06efd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f391400c880 tx=0x7f3914008040 comp rx=0 tx=0).stop 2023-10-09T11:54:12.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 shutdown_connections 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f3908066f30 0x7f39080693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f391c0b2140 0x7f391c06efd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0afc40 0x7f391c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 --2- 172.21.15.86:0/731943963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c0b0010 0x7f391c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 >> 172.21.15.86:0/731943963 conn(0x7f391c06a320 msgr2=0x7f391c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 shutdown_connections 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:12.393+0000 7f39217ff700 1 -- 172.21.15.86:0/731943963 wait complete. 2023-10-09T11:54:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:54:12.411 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:54:11.750996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426248,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752548472,"statfs":{"total":773094113280,"available":770609635328,"internally_reserved":0,"allocated":7151616,"data_stored":3930068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.945396"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.837342+0000","last_change":"2023-10-09T11:54:05.835364+0000","last_active":"2023-10-09T11:54:05.837342+0000","last_peered":"2023-10-09T11:54:05.837342+0000","last_clean":"2023-10-09T11:54:05.837342+0000","last_became_active":"2023-10-09T11:54:05.834615+0000","last_became_peered":"2023-10-09T11:54:05.834615+0000","last_unstale":"2023-10-09T11:54:05.837342+0000","last_undegraded":"2023-10-09T11:54:05.837342+0000","last_fullsized":"2023-10-09T11:54:05.837342+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:09.879704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.858414+0000","last_change":"2023-10-09T11:54:05.854809+0000","last_active":"2023-10-09T11:54:05.858414+0000","last_peered":"2023-10-09T11:54:05.858414+0000","last_clean":"2023-10-09T11:54:05.858414+0000","last_became_active":"2023-10-09T11:54:05.854539+0000","last_became_peered":"2023-10-09T11:54:05.854539+0000","last_unstale":"2023-10-09T11:54:05.858414+0000","last_undegraded":"2023-10-09T11:54:05.858414+0000","last_fullsized":"2023-10-09T11:54:05.858414+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:27.168236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.834050+0000","last_change":"2023-10-09T11:54:05.829419+0000","last_active":"2023-10-09T11:54:05.834050+0000","last_peered":"2023-10-09T11:54:05.834050+0000","last_clean":"2023-10-09T11:54:05.834050+0000","last_became_active":"2023-10-09T11:54:05.829139+0000","last_became_peered":"2023-10-09T11:54:05.829139+0000","last_unstale":"2023-10-09T11:54:05.834050+0000","last_undegraded":"2023-10-09T11:54:05.834050+0000","last_fullsized":"2023-10-09T11:54:05.834050+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:35.275084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.831008+0000","last_change":"2023-10-09T11:54:05.828465+0000","last_active":"2023-10-09T11:54:05.831008+0000","last_peered":"2023-10-09T11:54:05.831008+0000","last_clean":"2023-10-09T11:54:05.831008+0000","last_became_active":"2023-10-09T11:54:05.828206+0000","last_became_peered":"2023-10-09T11:54:05.828206+0000","last_unstale":"2023-10-09T11:54:05.831008+0000","last_undegraded":"2023-10-09T11:54:05.831008+0000","last_fullsized":"2023-10-09T11:54:05.831008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:08.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.858352+0000","last_change":"2023-10-09T11:54:05.854247+0000","last_active":"2023-10-09T11:54:05.858352+0000","last_peered":"2023-10-09T11:54:05.858352+0000","last_clean":"2023-10-09T11:54:05.858352+0000","last_became_active":"2023-10-09T11:54:05.853991+0000","last_became_peered":"2023-10-09T11:54:05.853991+0000","last_unstale":"2023-10-09T11:54:05.858352+0000","last_undegraded":"2023-10-09T11:54:05.858352+0000","last_fullsized":"2023-10-09T11:54:05.858352+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:31.642917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838246+0000","last_change":"2023-10-09T11:54:05.830847+0000","last_active":"2023-10-09T11:54:05.838246+0000","last_peered":"2023-10-09T11:54:05.838246+0000","last_clean":"2023-10-09T11:54:05.838246+0000","last_became_active":"2023-10-09T11:54:05.830593+0000","last_became_peered":"2023-10-09T11:54:05.830593+0000","last_unstale":"2023-10-09T11:54:05.838246+0000","last_undegraded":"2023-10-09T11:54:05.838246+0000","last_fullsized":"2023-10-09T11:54:05.838246+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:05.275034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839048+0000","last_change":"2023-10-09T11:54:05.835402+0000","last_active":"2023-10-09T11:54:05.839048+0000","last_peered":"2023-10-09T11:54:05.839048+0000","last_clean":"2023-10-09T11:54:05.839048+0000","last_became_active":"2023-10-09T11:54:05.835072+0000","last_became_peered":"2023-10-09T11:54:05.835072+0000","last_unstale":"2023-10-09T11:54:05.839048+0000","last_undegraded":"2023-10-09T11:54:05.839048+0000","last_fullsized":"2023-10-09T11:54:05.839048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:00.104429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.852391+0000","last_change":"2023-10-09T11:54:05.845018+0000","last_active":"2023-10-09T11:54:05.852391+0000","last_peered":"2023-10-09T11:54:05.852391+0000","last_clean":"2023-10-09T11:54:05.852391+0000","last_became_active":"2023-10-09T11:54:05.844622+0000","last_became_peered":"2023-10-09T11:54:05.844622+0000","last_unstale":"2023-10-09T11:54:05.852391+0000","last_undegraded":"2023-10-09T11:54:05.852391+0000","last_fullsized":"2023-10-09T11:54:05.852391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:35.115148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.832493+0000","last_change":"2023-10-09T11:54:05.831778+0000","last_active":"2023-10-09T11:54:05.832493+0000","last_peered":"2023-10-09T11:54:05.832493+0000","last_clean":"2023-10-09T11:54:05.832493+0000","last_became_active":"2023-10-09T11:54:05.831523+0000","last_became_peered":"2023-10-09T11:54:05.831523+0000","last_unstale":"2023-10-09T11:54:05.832493+0000","last_undegraded":"2023-10-09T11:54:05.832493+0000","last_fullsized":"2023-10-09T11:54:05.832493+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:40.966425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.830232+0000","last_change":"2023-10-09T11:54:05.828695+0000","last_active":"2023-10-09T11:54:05.830232+0000","last_peered":"2023-10-09T11:54:05.830232+0000","last_clean":"2023-10-09T11:54:05.830232+0000","last_became_active":"2023-10-09T11:54:05.828267+0000","last_became_peered":"2023-10-09T11:54:05.828267+0000","last_unstale":"2023-10-09T11:54:05.830232+0000","last_undegraded":"2023-10-09T11:54:05.830232+0000","last_fullsized":"2023-10-09T11:54:05.830232+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:39.608155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855157+0000","last_change":"2023-10-09T11:54:05.852215+0000","last_active":"2023-10-09T11:54:05.855157+0000","last_peered":"2023-10-09T11:54:05.855157+0000","last_clean":"2023-10-09T11:54:05.855157+0000","last_became_active":"2023-10-09T11:54:05.851956+0000","last_became_peered":"2023-10-09T11:54:05.851956+0000","last_unstale":"2023-10-09T11:54:05.855157+0000","last_undegraded":"2023-10-09T11:54:05.855157+0000","last_fullsized":"2023-10-09T11:54:05.855157+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:13.247716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849759+0000","last_change":"2023-10-09T11:54:05.848435+0000","last_active":"2023-10-09T11:54:05.849759+0000","last_peered":"2023-10-09T11:54:05.849759+0000","last_clean":"2023-10-09T11:54:05.849759+0000","last_became_active":"2023-10-09T11:54:05.848167+0000","last_became_peered":"2023-10-09T11:54:05.848167+0000","last_unstale":"2023-10-09T11:54:05.849759+0000","last_undegraded":"2023-10-09T11:54:05.849759+0000","last_fullsized":"2023-10-09T11:54:05.849759+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:29.140818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848329+0000","last_change":"2023-10-09T11:54:05.846978+0000","last_active":"2023-10-09T11:54:05.848329+0000","last_peered":"2023-10-09T11:54:05.848329+0000","last_clean":"2023-10-09T11:54:05.848329+0000","last_became_active":"2023-10-09T11:54:05.846704+0000","last_became_peered":"2023-10-09T11:54:05.846704+0000","last_unstale":"2023-10-09T11:54:05.848329+0000","last_undegraded":"2023-10-09T11:54:05.848329+0000","last_fullsized":"2023-10-09T11:54:05.848329+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:59.751313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835380+0000","last_change":"2023-10-09T11:54:05.832280+0000","last_active":"2023-10-09T11:54:05.835380+0000","last_peered":"2023-10-09T11:54:05.835380+0000","last_clean":"2023-10-09T11:54:05.835380+0000","last_became_active":"2023-10-09T11:54:05.832028+0000","last_became_peered":"2023-10-09T11:54:05.832028+0000","last_unstale":"2023-10-09T11:54:05.835380+0000","last_undegraded":"2023-10-09T11:54:05.835380+0000","last_fullsized":"2023-10-09T11:54:05.835380+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:00.160458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.854887+0000","last_change":"2023-10-09T11:54:05.838584+0000","last_active":"2023-10-09T11:54:05.854887+0000","last_peered":"2023-10-09T11:54:05.854887+0000","last_clean":"2023-10-09T11:54:05.854887+0000","last_became_active":"2023-10-09T11:54:05.838145+0000","last_became_peered":"2023-10-09T11:54:05.838145+0000","last_unstale":"2023-10-09T11:54:05.854887+0000","last_undegraded":"2023-10-09T11:54:05.854887+0000","last_fullsized":"2023-10-09T11:54:05.854887+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:16.678827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835409+0000","last_change":"2023-10-09T11:54:05.830465+0000","last_active":"2023-10-09T11:54:05.835409+0000","last_peered":"2023-10-09T11:54:05.835409+0000","last_clean":"2023-10-09T11:54:05.835409+0000","last_became_active":"2023-10-09T11:54:05.830182+0000","last_became_peered":"2023-10-09T11:54:05.830182+0000","last_unstale":"2023-10-09T11:54:05.835409+0000","last_undegraded":"2023-10-09T11:54:05.835409+0000","last_fullsized":"2023-10-09T11:54:05.835409+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:51.069416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.845268+0000","last_change":"2023-10-09T11:54:05.842651+0000","last_active":"2023-10-09T11:54:05.845268+0000","last_peered":"2023-10-09T11:54:05.845268+0000","last_clean":"2023-10-09T11:54:05.845268+0000","last_became_active":"2023-10-09T11:54:05.842093+0000","last_became_peered":"2023-10-09T11:54:05.842093+0000","last_unstale":"2023-10-09T11:54:05.845268+0000","last_undegraded":"2023-10-09T11:54:05.845268+0000","last_fullsized":"2023-10-09T11:54:05.845268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:32.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835217+0000","last_change":"2023-10-09T11:54:05.830891+0000","last_active":"2023-10-09T11:54:05.835217+0000","last_peered":"2023-10-09T11:54:05.835217+0000","last_clean":"2023-10-09T11:54:05.835217+0000","last_became_active":"2023-10-09T11:54:05.830637+0000","last_became_peered":"2023-10-09T11:54:05.830637+0000","last_unstale":"2023-10-09T11:54:05.835217+0000","last_undegraded":"2023-10-09T11:54:05.835217+0000","last_fullsized":"2023-10-09T11:54:05.835217+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:05.870696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836791+0000","last_change":"2023-10-09T11:54:05.832575+0000","last_active":"2023-10-09T11:54:05.836791+0000","last_peered":"2023-10-09T11:54:05.836791+0000","last_clean":"2023-10-09T11:54:05.836791+0000","last_became_active":"2023-10-09T11:54:05.832332+0000","last_became_peered":"2023-10-09T11:54:05.832332+0000","last_unstale":"2023-10-09T11:54:05.836791+0000","last_undegraded":"2023-10-09T11:54:05.836791+0000","last_fullsized":"2023-10-09T11:54:05.836791+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:54.160497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.847781+0000","last_change":"2023-10-09T11:54:05.835125+0000","last_active":"2023-10-09T11:54:05.847781+0000","last_peered":"2023-10-09T11:54:05.847781+0000","last_clean":"2023-10-09T11:54:05.847781+0000","last_became_active":"2023-10-09T11:54:05.834864+0000","last_became_peered":"2023-10-09T11:54:05.834864+0000","last_unstale":"2023-10-09T11:54:05.847781+0000","last_undegraded":"2023-10-09T11:54:05.847781+0000","last_fullsized":"2023-10-09T11:54:05.847781+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:42.175886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838236+0000","last_change":"2023-10-09T11:54:05.830776+0000","last_active":"2023-10-09T11:54:05.838236+0000","last_peered":"2023-10-09T11:54:05.838236+0000","last_clean":"2023-10-09T11:54:05.838236+0000","last_became_active":"2023-10-09T11:54:05.830517+0000","last_became_peered":"2023-10-09T11:54:05.830517+0000","last_unstale":"2023-10-09T11:54:05.838236+0000","last_undegraded":"2023-10-09T11:54:05.838236+0000","last_fullsized":"2023-10-09T11:54:05.838236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:59:44.094531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848493+0000","last_change":"2023-10-09T11:54:05.835242+0000","last_active":"2023-10-09T11:54:05.848493+0000","last_peered":"2023-10-09T11:54:05.848493+0000","last_clean":"2023-10-09T11:54:05.848493+0000","last_became_active":"2023-10-09T11:54:05.834976+0000","last_became_peered":"2023-10-09T11:54:05.834976+0000","last_unstale":"2023-10-09T11:54:05.848493+0000","last_undegraded":"2023-10-09T11:54:05.848493+0000","last_fullsized":"2023-10-09T11:54:05.848493+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:32:38.288415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.842731+0000","last_change":"2023-10-09T11:54:05.838617+0000","last_active":"2023-10-09T11:54:05.842731+0000","last_peered":"2023-10-09T11:54:05.842731+0000","last_clean":"2023-10-09T11:54:05.842731+0000","last_became_active":"2023-10-09T11:54:05.838336+0000","last_became_peered":"2023-10-09T11:54:05.838336+0000","last_unstale":"2023-10-09T11:54:05.842731+0000","last_undegraded":"2023-10-09T11:54:05.842731+0000","last_fullsized":"2023-10-09T11:54:05.842731+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:27.168236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841601+0000","last_change":"2023-10-09T11:54:05.837880+0000","last_active":"2023-10-09T11:54:05.841601+0000","last_peered":"2023-10-09T11:54:05.841601+0000","last_clean":"2023-10-09T11:54:05.841601+0000","last_became_active":"2023-10-09T11:54:05.837594+0000","last_became_peered":"2023-10-09T11:54:05.837594+0000","last_unstale":"2023-10-09T11:54:05.841601+0000","last_undegraded":"2023-10-09T11:54:05.841601+0000","last_fullsized":"2023-10-09T11:54:05.841601+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:52.951646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836828+0000","last_change":"2023-10-09T11:54:05.831351+0000","last_active":"2023-10-09T11:54:05.836828+0000","last_peered":"2023-10-09T11:54:05.836828+0000","last_clean":"2023-10-09T11:54:05.836828+0000","last_became_active":"2023-10-09T11:54:05.830904+0000","last_became_peered":"2023-10-09T11:54:05.830904+0000","last_unstale":"2023-10-09T11:54:05.836828+0000","last_undegraded":"2023-10-09T11:54:05.836828+0000","last_fullsized":"2023-10-09T11:54:05.836828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:39.121654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849576+0000","last_change":"2023-10-09T11:54:05.847704+0000","last_active":"2023-10-09T11:54:05.849576+0000","last_peered":"2023-10-09T11:54:05.849576+0000","last_clean":"2023-10-09T11:54:05.849576+0000","last_became_active":"2023-10-09T11:54:05.847445+0000","last_became_peered":"2023-10-09T11:54:05.847445+0000","last_unstale":"2023-10-09T11:54:05.849576+0000","last_undegraded":"2023-10-09T11:54:05.849576+0000","last_fullsized":"2023-10-09T11:54:05.849576+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:46.156787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.845325+0000","last_change":"2023-10-09T11:54:05.843388+0000","last_active":"2023-10-09T11:54:05.845325+0000","last_peered":"2023-10-09T11:54:05.845325+0000","last_clean":"2023-10-09T11:54:05.845325+0000","last_became_active":"2023-10-09T11:54:05.842914+0000","last_became_peered":"2023-10-09T11:54:05.842914+0000","last_unstale":"2023-10-09T11:54:05.845325+0000","last_undegraded":"2023-10-09T11:54:05.845325+0000","last_fullsized":"2023-10-09T11:54:05.845325+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:02.203016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849779+0000","last_change":"2023-10-09T11:54:05.848459+0000","last_active":"2023-10-09T11:54:05.849779+0000","last_peered":"2023-10-09T11:54:05.849779+0000","last_clean":"2023-10-09T11:54:05.849779+0000","last_became_active":"2023-10-09T11:54:05.848172+0000","last_became_peered":"2023-10-09T11:54:05.848172+0000","last_unstale":"2023-10-09T11:54:05.849779+0000","last_undegraded":"2023-10-09T11:54:05.849779+0000","last_fullsized":"2023-10-09T11:54:05.849779+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:51.069416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838834+0000","last_change":"2023-10-09T11:54:05.835023+0000","last_active":"2023-10-09T11:54:05.838834+0000","last_peered":"2023-10-09T11:54:05.838834+0000","last_clean":"2023-10-09T11:54:05.838834+0000","last_became_active":"2023-10-09T11:54:05.833763+0000","last_became_peered":"2023-10-09T11:54:05.833763+0000","last_unstale":"2023-10-09T11:54:05.838834+0000","last_undegraded":"2023-10-09T11:54:05.838834+0000","last_fullsized":"2023-10-09T11:54:05.838834+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:35.769662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841564+0000","last_change":"2023-10-09T11:54:05.837811+0000","last_active":"2023-10-09T11:54:05.841564+0000","last_peered":"2023-10-09T11:54:05.841564+0000","last_clean":"2023-10-09T11:54:05.841564+0000","last_became_active":"2023-10-09T11:54:05.837543+0000","last_became_peered":"2023-10-09T11:54:05.837543+0000","last_unstale":"2023-10-09T11:54:05.841564+0000","last_undegraded":"2023-10-09T11:54:05.841564+0000","last_fullsized":"2023-10-09T11:54:05.841564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:37.689364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855010+0000","last_change":"2023-10-09T11:54:05.844380+0000","last_active":"2023-10-09T11:54:05.855010+0000","last_peered":"2023-10-09T11:54:05.855010+0000","last_clean":"2023-10-09T11:54:05.855010+0000","last_became_active":"2023-10-09T11:54:05.844126+0000","last_became_peered":"2023-10-09T11:54:05.844126+0000","last_unstale":"2023-10-09T11:54:05.855010+0000","last_undegraded":"2023-10-09T11:54:05.855010+0000","last_fullsized":"2023-10-09T11:54:05.855010+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:11.631481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.854550+0000","last_change":"2023-10-09T11:54:05.853004+0000","last_active":"2023-10-09T11:54:05.854550+0000","last_peered":"2023-10-09T11:54:05.854550+0000","last_clean":"2023-10-09T11:54:05.854550+0000","last_became_active":"2023-10-09T11:54:05.852742+0000","last_became_peered":"2023-10-09T11:54:05.852742+0000","last_unstale":"2023-10-09T11:54:05.854550+0000","last_undegraded":"2023-10-09T11:54:05.854550+0000","last_fullsized":"2023-10-09T11:54:05.854550+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:40.511061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855388+0000","last_change":"2023-10-09T11:54:05.853324+0000","last_active":"2023-10-09T11:54:05.855388+0000","last_peered":"2023-10-09T11:54:05.855388+0000","last_clean":"2023-10-09T11:54:05.855388+0000","last_became_active":"2023-10-09T11:54:05.853031+0000","last_became_peered":"2023-10-09T11:54:05.853031+0000","last_unstale":"2023-10-09T11:54:05.855388+0000","last_undegraded":"2023-10-09T11:54:05.855388+0000","last_fullsized":"2023-10-09T11:54:05.855388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:00.405405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855561+0000","last_change":"2023-10-09T11:54:04.830958+0000","last_active":"2023-10-09T11:54:05.855561+0000","last_peered":"2023-10-09T11:54:05.855561+0000","last_clean":"2023-10-09T11:54:05.855561+0000","last_became_active":"2023-10-09T11:54:04.830736+0000","last_became_peered":"2023-10-09T11:54:04.830736+0000","last_unstale":"2023-10-09T11:54:05.855561+0000","last_undegraded":"2023-10-09T11:54:05.855561+0000","last_fullsized":"2023-10-09T11:54:05.855561+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:52.331908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838863+0000","last_change":"2023-10-09T11:54:05.833884+0000","last_active":"2023-10-09T11:54:05.838863+0000","last_peered":"2023-10-09T11:54:05.838863+0000","last_clean":"2023-10-09T11:54:05.838863+0000","last_became_active":"2023-10-09T11:54:05.833361+0000","last_became_peered":"2023-10-09T11:54:05.833361+0000","last_unstale":"2023-10-09T11:54:05.838863+0000","last_undegraded":"2023-10-09T11:54:05.838863+0000","last_fullsized":"2023-10-09T11:54:05.838863+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:08.358204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.851810+0000","last_change":"2023-10-09T11:54:04.827351+0000","last_active":"2023-10-09T11:54:05.851810+0000","last_peered":"2023-10-09T11:54:05.851810+0000","last_clean":"2023-10-09T11:54:05.851810+0000","last_became_active":"2023-10-09T11:54:04.827086+0000","last_became_peered":"2023-10-09T11:54:04.827086+0000","last_unstale":"2023-10-09T11:54:05.851810+0000","last_undegraded":"2023-10-09T11:54:05.851810+0000","last_fullsized":"2023-10-09T11:54:05.851810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:01.820086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.858954+0000","last_change":"2023-10-09T11:54:05.855963+0000","last_active":"2023-10-09T11:54:05.858954+0000","last_peered":"2023-10-09T11:54:05.858954+0000","last_clean":"2023-10-09T11:54:05.858954+0000","last_became_active":"2023-10-09T11:54:05.855549+0000","last_became_peered":"2023-10-09T11:54:05.855549+0000","last_unstale":"2023-10-09T11:54:05.858954+0000","last_undegraded":"2023-10-09T11:54:05.858954+0000","last_fullsized":"2023-10-09T11:54:05.858954+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:55.542811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.853237+0000","last_change":"2023-10-09T11:54:04.824609+0000","last_active":"2023-10-09T11:54:05.853237+0000","last_peered":"2023-10-09T11:54:05.853237+0000","last_clean":"2023-10-09T11:54:05.853237+0000","last_became_active":"2023-10-09T11:54:04.824350+0000","last_became_peered":"2023-10-09T11:54:04.824350+0000","last_unstale":"2023-10-09T11:54:05.853237+0000","last_undegraded":"2023-10-09T11:54:05.853237+0000","last_fullsized":"2023-10-09T11:54:05.853237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:17.599972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.853960+0000","last_change":"2023-10-09T11:54:05.850479+0000","last_active":"2023-10-09T11:54:05.853960+0000","last_peered":"2023-10-09T11:54:05.853960+0000","last_clean":"2023-10-09T11:54:05.853960+0000","last_became_active":"2023-10-09T11:54:05.850127+0000","last_became_peered":"2023-10-09T11:54:05.850127+0000","last_unstale":"2023-10-09T11:54:05.853960+0000","last_undegraded":"2023-10-09T11:54:05.853960+0000","last_fullsized":"2023-10-09T11:54:05.853960+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:05.870696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848997+0000","last_change":"2023-10-09T11:54:04.825164+0000","last_active":"2023-10-09T11:54:05.848997+0000","last_peered":"2023-10-09T11:54:05.848997+0000","last_clean":"2023-10-09T11:54:05.848997+0000","last_became_active":"2023-10-09T11:54:04.824917+0000","last_became_peered":"2023-10-09T11:54:04.824917+0000","last_unstale":"2023-10-09T11:54:05.848997+0000","last_undegraded":"2023-10-09T11:54:05.848997+0000","last_fullsized":"2023-10-09T11:54:05.848997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:28.134846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835606+0000","last_change":"2023-10-09T11:54:05.832202+0000","last_active":"2023-10-09T11:54:05.835606+0000","last_peered":"2023-10-09T11:54:05.835606+0000","last_clean":"2023-10-09T11:54:05.835606+0000","last_became_active":"2023-10-09T11:54:05.831954+0000","last_became_peered":"2023-10-09T11:54:05.831954+0000","last_unstale":"2023-10-09T11:54:05.835606+0000","last_undegraded":"2023-10-09T11:54:05.835606+0000","last_fullsized":"2023-10-09T11:54:05.835606+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:32.862266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855803+0000","last_change":"2023-10-09T11:54:04.823095+0000","last_active":"2023-10-09T11:54:05.855803+0000","last_peered":"2023-10-09T11:54:05.855803+0000","last_clean":"2023-10-09T11:54:05.855803+0000","last_became_active":"2023-10-09T11:54:04.822811+0000","last_became_peered":"2023-10-09T11:54:04.822811+0000","last_unstale":"2023-10-09T11:54:05.855803+0000","last_undegraded":"2023-10-09T11:54:05.855803+0000","last_fullsized":"2023-10-09T11:54:05.855803+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:34.107330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.845255+0000","last_change":"2023-10-09T11:54:05.837662+0000","last_active":"2023-10-09T11:54:05.845255+0000","last_peered":"2023-10-09T11:54:05.845255+0000","last_clean":"2023-10-09T11:54:05.845255+0000","last_became_active":"2023-10-09T11:54:05.837404+0000","last_became_peered":"2023-10-09T11:54:05.837404+0000","last_unstale":"2023-10-09T11:54:05.845255+0000","last_undegraded":"2023-10-09T11:54:05.845255+0000","last_fullsized":"2023-10-09T11:54:05.845255+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:15.590176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.851725+0000","last_change":"2023-10-09T11:54:04.824928+0000","last_active":"2023-10-09T11:54:05.851725+0000","last_peered":"2023-10-09T11:54:05.851725+0000","last_clean":"2023-10-09T11:54:05.851725+0000","last_became_active":"2023-10-09T11:54:04.824639+0000","last_became_peered":"2023-10-09T11:54:04.824639+0000","last_unstale":"2023-10-09T11:54:05.851725+0000","last_undegraded":"2023-10-09T11:54:05.851725+0000","last_fullsized":"2023-10-09T11:54:05.851725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:50.977295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.847616+0000","last_change":"2023-10-09T11:54:05.835995+0000","last_active":"2023-10-09T11:54:05.847616+0000","last_peered":"2023-10-09T11:54:05.847616+0000","last_clean":"2023-10-09T11:54:05.847616+0000","last_became_active":"2023-10-09T11:54:05.835701+0000","last_became_peered":"2023-10-09T11:54:05.835701+0000","last_unstale":"2023-10-09T11:54:05.847616+0000","last_undegraded":"2023-10-09T11:54:05.847616+0000","last_fullsized":"2023-10-09T11:54:05.847616+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:04:16.071613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.834576+0000","last_change":"2023-10-09T11:54:04.820282+0000","last_active":"2023-10-09T11:54:05.834576+0000","last_peered":"2023-10-09T11:54:05.834576+0000","last_clean":"2023-10-09T11:54:05.834576+0000","last_became_active":"2023-10-09T11:54:04.820023+0000","last_became_peered":"2023-10-09T11:54:04.820023+0000","last_unstale":"2023-10-09T11:54:05.834576+0000","last_undegraded":"2023-10-09T11:54:05.834576+0000","last_fullsized":"2023-10-09T11:54:05.834576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:04.864724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841955+0000","last_change":"2023-10-09T11:54:05.835680+0000","last_active":"2023-10-09T11:54:05.841955+0000","last_peered":"2023-10-09T11:54:05.841955+0000","last_clean":"2023-10-09T11:54:05.841955+0000","last_became_active":"2023-10-09T11:54:05.833891+0000","last_became_peered":"2023-10-09T11:54:05.833891+0000","last_unstale":"2023-10-09T11:54:05.841955+0000","last_undegraded":"2023-10-09T11:54:05.841955+0000","last_fullsized":"2023-10-09T11:54:05.841955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:15.914541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.817927+0000","last_change":"2023-10-09T11:54:04.826690+0000","last_active":"2023-10-09T11:54:05.817927+0000","last_peered":"2023-10-09T11:54:05.817927+0000","last_clean":"2023-10-09T11:54:05.817927+0000","last_became_active":"2023-10-09T11:54:04.825787+0000","last_became_peered":"2023-10-09T11:54:04.825787+0000","last_unstale":"2023-10-09T11:54:05.817927+0000","last_undegraded":"2023-10-09T11:54:05.817927+0000","last_fullsized":"2023-10-09T11:54:05.817927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:34.062210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835197+0000","last_change":"2023-10-09T11:54:05.830120+0000","last_active":"2023-10-09T11:54:05.835197+0000","last_peered":"2023-10-09T11:54:05.835197+0000","last_clean":"2023-10-09T11:54:05.835197+0000","last_became_active":"2023-10-09T11:54:05.829819+0000","last_became_peered":"2023-10-09T11:54:05.829819+0000","last_unstale":"2023-10-09T11:54:05.835197+0000","last_undegraded":"2023-10-09T11:54:05.835197+0000","last_fullsized":"2023-10-09T11:54:05.835197+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:00.405405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.821653+0000","last_change":"2023-10-09T11:54:04.822493+0000","last_active":"2023-10-09T11:54:05.821653+0000","last_peered":"2023-10-09T11:54:05.821653+0000","last_clean":"2023-10-09T11:54:05.821653+0000","last_became_active":"2023-10-09T11:54:04.822155+0000","last_became_peered":"2023-10-09T11:54:04.822155+0000","last_unstale":"2023-10-09T11:54:05.821653+0000","last_undegraded":"2023-10-09T11:54:05.821653+0000","last_fullsized":"2023-10-09T11:54:05.821653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:00.701626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.844879+0000","last_change":"2023-10-09T11:54:05.842508+0000","last_active":"2023-10-09T11:54:05.844879+0000","last_peered":"2023-10-09T11:54:05.844879+0000","last_clean":"2023-10-09T11:54:05.844879+0000","last_became_active":"2023-10-09T11:54:05.842171+0000","last_became_peered":"2023-10-09T11:54:05.842171+0000","last_unstale":"2023-10-09T11:54:05.844879+0000","last_undegraded":"2023-10-09T11:54:05.844879+0000","last_fullsized":"2023-10-09T11:54:05.844879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:30.580854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.818522+0000","last_change":"2023-10-09T11:54:04.826692+0000","last_active":"2023-10-09T11:54:05.818522+0000","last_peered":"2023-10-09T11:54:05.818522+0000","last_clean":"2023-10-09T11:54:05.818522+0000","last_became_active":"2023-10-09T11:54:04.826412+0000","last_became_peered":"2023-10-09T11:54:04.826412+0000","last_unstale":"2023-10-09T11:54:05.818522+0000","last_undegraded":"2023-10-09T11:54:05.818522+0000","last_fullsized":"2023-10-09T11:54:05.818522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:37.432269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838872+0000","last_change":"2023-10-09T11:54:05.829971+0000","last_active":"2023-10-09T11:54:05.838872+0000","last_peered":"2023-10-09T11:54:05.838872+0000","last_clean":"2023-10-09T11:54:05.838872+0000","last_became_active":"2023-10-09T11:54:05.829708+0000","last_became_peered":"2023-10-09T11:54:05.829708+0000","last_unstale":"2023-10-09T11:54:05.838872+0000","last_undegraded":"2023-10-09T11:54:05.838872+0000","last_fullsized":"2023-10-09T11:54:05.838872+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:13.247716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849528+0000","last_change":"2023-10-09T11:54:04.829888+0000","last_active":"2023-10-09T11:54:05.849528+0000","last_peered":"2023-10-09T11:54:05.849528+0000","last_clean":"2023-10-09T11:54:05.849528+0000","last_became_active":"2023-10-09T11:54:04.829615+0000","last_became_peered":"2023-10-09T11:54:04.829615+0000","last_unstale":"2023-10-09T11:54:05.849528+0000","last_undegraded":"2023-10-09T11:54:05.849528+0000","last_fullsized":"2023-10-09T11:54:05.849528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:35.011509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.852048+0000","last_change":"2023-10-09T11:54:05.851489+0000","last_active":"2023-10-09T11:54:05.852048+0000","last_peered":"2023-10-09T11:54:05.852048+0000","last_clean":"2023-10-09T11:54:05.852048+0000","last_became_active":"2023-10-09T11:54:05.851138+0000","last_became_peered":"2023-10-09T11:54:05.851138+0000","last_unstale":"2023-10-09T11:54:05.852048+0000","last_undegraded":"2023-10-09T11:54:05.852048+0000","last_fullsized":"2023-10-09T11:54:05.852048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:24.109375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"62'6","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.859135+0000","last_change":"2023-10-09T11:54:04.815746+0000","last_active":"2023-10-09T11:54:05.859135+0000","last_peered":"2023-10-09T11:54:05.859135+0000","last_clean":"2023-10-09T11:54:05.859135+0000","last_became_active":"2023-10-09T11:54:04.815395+0000","last_became_peered":"2023-10-09T11:54:04.815395+0000","last_unstale":"2023-10-09T11:54:05.859135+0000","last_undegraded":"2023-10-09T11:54:05.859135+0000","last_fullsized":"2023-10-09T11:54:05.859135+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:03.311271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836023+0000","last_change":"2023-10-09T11:54:05.830992+0000","last_active":"2023-10-09T11:54:05.836023+0000","last_peered":"2023-10-09T11:54:05.836023+0000","last_clean":"2023-10-09T11:54:05.836023+0000","last_became_active":"2023-10-09T11:54:05.830727+0000","last_became_peered":"2023-10-09T11:54:05.830727+0000","last_unstale":"2023-10-09T11:54:05.836023+0000","last_undegraded":"2023-10-09T11:54:05.836023+0000","last_fullsized":"2023-10-09T11:54:05.836023+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:49.266104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.857039+0000","last_change":"2023-10-09T11:54:04.820308+0000","last_active":"2023-10-09T11:54:05.857039+0000","last_peered":"2023-10-09T11:54:05.857039+0000","last_clean":"2023-10-09T11:54:05.857039+0000","last_became_active":"2023-10-09T11:54:04.819546+0000","last_became_peered":"2023-10-09T11:54:04.819546+0000","last_unstale":"2023-10-09T11:54:05.857039+0000","last_undegraded":"2023-10-09T11:54:05.857039+0000","last_fullsized":"2023-10-09T11:54:05.857039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:12.308724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.832524+0000","last_change":"2023-10-09T11:54:05.830997+0000","last_active":"2023-10-09T11:54:05.832524+0000","last_peered":"2023-10-09T11:54:05.832524+0000","last_clean":"2023-10-09T11:54:05.832524+0000","last_became_active":"2023-10-09T11:54:05.830733+0000","last_became_peered":"2023-10-09T11:54:05.830733+0000","last_unstale":"2023-10-09T11:54:05.832524+0000","last_undegraded":"2023-10-09T11:54:05.832524+0000","last_fullsized":"2023-10-09T11:54:05.832524+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:43.361406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826394+0000","last_change":"2023-10-09T11:54:04.822182+0000","last_active":"2023-10-09T11:54:05.826394+0000","last_peered":"2023-10-09T11:54:05.826394+0000","last_clean":"2023-10-09T11:54:05.826394+0000","last_became_active":"2023-10-09T11:54:04.821788+0000","last_became_peered":"2023-10-09T11:54:04.821788+0000","last_unstale":"2023-10-09T11:54:05.826394+0000","last_undegraded":"2023-10-09T11:54:05.826394+0000","last_fullsized":"2023-10-09T11:54:05.826394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:50.063444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839635+0000","last_change":"2023-10-09T11:54:05.829241+0000","last_active":"2023-10-09T11:54:05.839635+0000","last_peered":"2023-10-09T11:54:05.839635+0000","last_clean":"2023-10-09T11:54:05.839635+0000","last_became_active":"2023-10-09T11:54:05.828988+0000","last_became_peered":"2023-10-09T11:54:05.828988+0000","last_unstale":"2023-10-09T11:54:05.839635+0000","last_undegraded":"2023-10-09T11:54:05.839635+0000","last_fullsized":"2023-10-09T11:54:05.839635+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:40.966425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.819386+0000","last_change":"2023-10-09T11:54:04.819962+0000","last_active":"2023-10-09T11:54:05.819386+0000","last_peered":"2023-10-09T11:54:05.819386+0000","last_clean":"2023-10-09T11:54:05.819386+0000","last_became_active":"2023-10-09T11:54:04.819667+0000","last_became_peered":"2023-10-09T11:54:04.819667+0000","last_unstale":"2023-10-09T11:54:05.819386+0000","last_undegraded":"2023-10-09T11:54:05.819386+0000","last_fullsized":"2023-10-09T11:54:05.819386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:37.915131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839171+0000","last_change":"2023-10-09T11:54:05.835445+0000","last_active":"2023-10-09T11:54:05.839171+0000","last_peered":"2023-10-09T11:54:05.839171+0000","last_clean":"2023-10-09T11:54:05.839171+0000","last_became_active":"2023-10-09T11:54:05.835167+0000","last_became_peered":"2023-10-09T11:54:05.835167+0000","last_unstale":"2023-10-09T11:54:05.839171+0000","last_undegraded":"2023-10-09T11:54:05.839171+0000","last_fullsized":"2023-10-09T11:54:05.839171+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:05.486471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"62'8","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.859422+0000","last_change":"2023-10-09T11:54:04.826868+0000","last_active":"2023-10-09T11:54:05.859422+0000","last_peered":"2023-10-09T11:54:05.859422+0000","last_clean":"2023-10-09T11:54:05.859422+0000","last_became_active":"2023-10-09T11:54:04.826059+0000","last_became_peered":"2023-10-09T11:54:04.826059+0000","last_unstale":"2023-10-09T11:54:05.859422+0000","last_undegraded":"2023-10-09T11:54:05.859422+0000","last_fullsized":"2023-10-09T11:54:05.859422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:14.461878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.847858+0000","last_change":"2023-10-09T11:54:05.842701+0000","last_active":"2023-10-09T11:54:05.847858+0000","last_peered":"2023-10-09T11:54:05.847858+0000","last_clean":"2023-10-09T11:54:05.847858+0000","last_became_active":"2023-10-09T11:54:05.842370+0000","last_became_peered":"2023-10-09T11:54:05.842370+0000","last_unstale":"2023-10-09T11:54:05.847858+0000","last_undegraded":"2023-10-09T11:54:05.847858+0000","last_fullsized":"2023-10-09T11:54:05.847858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:47.926425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856164+0000","last_change":"2023-10-09T11:54:04.821833+0000","last_active":"2023-10-09T11:54:05.856164+0000","last_peered":"2023-10-09T11:54:05.856164+0000","last_clean":"2023-10-09T11:54:05.856164+0000","last_became_active":"2023-10-09T11:54:04.821533+0000","last_became_peered":"2023-10-09T11:54:04.821533+0000","last_unstale":"2023-10-09T11:54:05.856164+0000","last_undegraded":"2023-10-09T11:54:05.856164+0000","last_fullsized":"2023-10-09T11:54:05.856164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:53.174706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.829345+0000","last_change":"2023-10-09T11:54:05.826630+0000","last_active":"2023-10-09T11:54:05.829345+0000","last_peered":"2023-10-09T11:54:05.829345+0000","last_clean":"2023-10-09T11:54:05.829345+0000","last_became_active":"2023-10-09T11:54:05.826333+0000","last_became_peered":"2023-10-09T11:54:05.826333+0000","last_unstale":"2023-10-09T11:54:05.829345+0000","last_undegraded":"2023-10-09T11:54:05.829345+0000","last_fullsized":"2023-10-09T11:54:05.829345+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:35.113302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855766+0000","last_change":"2023-10-09T11:54:04.820592+0000","last_active":"2023-10-09T11:54:05.855766+0000","last_peered":"2023-10-09T11:54:05.855766+0000","last_clean":"2023-10-09T11:54:05.855766+0000","last_became_active":"2023-10-09T11:54:04.820277+0000","last_became_peered":"2023-10-09T11:54:04.820277+0000","last_unstale":"2023-10-09T11:54:05.855766+0000","last_undegraded":"2023-10-09T11:54:05.855766+0000","last_fullsized":"2023-10-09T11:54:05.855766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:44.267357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836056+0000","last_change":"2023-10-09T11:54:05.831187+0000","last_active":"2023-10-09T11:54:05.836056+0000","last_peered":"2023-10-09T11:54:05.836056+0000","last_clean":"2023-10-09T11:54:05.836056+0000","last_became_active":"2023-10-09T11:54:05.830652+0000","last_became_peered":"2023-10-09T11:54:05.830652+0000","last_unstale":"2023-10-09T11:54:05.836056+0000","last_undegraded":"2023-10-09T11:54:05.836056+0000","last_fullsized":"2023-10-09T11:54:05.836056+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:29.140818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855932+0000","last_change":"2023-10-09T11:54:04.824903+0000","last_active":"2023-10-09T11:54:05.855932+0000","last_peered":"2023-10-09T11:54:05.855932+0000","last_clean":"2023-10-09T11:54:05.855932+0000","last_became_active":"2023-10-09T11:54:04.824606+0000","last_became_peered":"2023-10-09T11:54:04.824606+0000","last_unstale":"2023-10-09T11:54:05.855932+0000","last_undegraded":"2023-10-09T11:54:05.855932+0000","last_fullsized":"2023-10-09T11:54:05.855932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:34.763690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856487+0000","last_change":"2023-10-09T11:54:05.853090+0000","last_active":"2023-10-09T11:54:05.856487+0000","last_peered":"2023-10-09T11:54:05.856487+0000","last_clean":"2023-10-09T11:54:05.856487+0000","last_became_active":"2023-10-09T11:54:05.852829+0000","last_became_peered":"2023-10-09T11:54:05.852829+0000","last_unstale":"2023-10-09T11:54:05.856487+0000","last_undegraded":"2023-10-09T11:54:05.856487+0000","last_fullsized":"2023-10-09T11:54:05.856487+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:33.053385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.819934+0000","last_change":"2023-10-09T11:54:04.827150+0000","last_active":"2023-10-09T11:54:05.819934+0000","last_peered":"2023-10-09T11:54:05.819934+0000","last_clean":"2023-10-09T11:54:05.819934+0000","last_became_active":"2023-10-09T11:54:04.826888+0000","last_became_peered":"2023-10-09T11:54:04.826888+0000","last_unstale":"2023-10-09T11:54:05.819934+0000","last_undegraded":"2023-10-09T11:54:05.819934+0000","last_fullsized":"2023-10-09T11:54:05.819934+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:02.727018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835932+0000","last_change":"2023-10-09T11:54:05.828185+0000","last_active":"2023-10-09T11:54:05.835932+0000","last_peered":"2023-10-09T11:54:05.835932+0000","last_clean":"2023-10-09T11:54:05.835932+0000","last_became_active":"2023-10-09T11:54:05.827929+0000","last_became_peered":"2023-10-09T11:54:05.827929+0000","last_unstale":"2023-10-09T11:54:05.835932+0000","last_undegraded":"2023-10-09T11:54:05.835932+0000","last_fullsized":"2023-10-09T11:54:05.835932+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:07.807187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856458+0000","last_change":"2023-10-09T11:54:04.823251+0000","last_active":"2023-10-09T11:54:05.856458+0000","last_peered":"2023-10-09T11:54:05.856458+0000","last_clean":"2023-10-09T11:54:05.856458+0000","last_became_active":"2023-10-09T11:54:04.822635+0000","last_became_peered":"2023-10-09T11:54:04.822635+0000","last_unstale":"2023-10-09T11:54:05.856458+0000","last_undegraded":"2023-10-09T11:54:05.856458+0000","last_fullsized":"2023-10-09T11:54:05.856458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:32:37.282444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849887+0000","last_change":"2023-10-09T11:54:05.842523+0000","last_active":"2023-10-09T11:54:05.849887+0000","last_peered":"2023-10-09T11:54:05.849887+0000","last_clean":"2023-10-09T11:54:05.849887+0000","last_became_active":"2023-10-09T11:54:05.842236+0000","last_became_peered":"2023-10-09T11:54:05.842236+0000","last_unstale":"2023-10-09T11:54:05.849887+0000","last_undegraded":"2023-10-09T11:54:05.849887+0000","last_fullsized":"2023-10-09T11:54:05.849887+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:02.203016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.831327+0000","last_change":"2023-10-09T11:54:04.830526+0000","last_active":"2023-10-09T11:54:05.831327+0000","last_peered":"2023-10-09T11:54:05.831327+0000","last_clean":"2023-10-09T11:54:05.831327+0000","last_became_active":"2023-10-09T11:54:04.829709+0000","last_became_peered":"2023-10-09T11:54:04.829709+0000","last_unstale":"2023-10-09T11:54:05.831327+0000","last_undegraded":"2023-10-09T11:54:05.831327+0000","last_fullsized":"2023-10-09T11:54:05.831327+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:01.197044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848156+0000","last_change":"2023-10-09T11:54:05.846301+0000","last_active":"2023-10-09T11:54:05.848156+0000","last_peered":"2023-10-09T11:54:05.848156+0000","last_clean":"2023-10-09T11:54:05.848156+0000","last_became_active":"2023-10-09T11:54:05.846046+0000","last_became_peered":"2023-10-09T11:54:05.846046+0000","last_unstale":"2023-10-09T11:54:05.848156+0000","last_undegraded":"2023-10-09T11:54:05.848156+0000","last_fullsized":"2023-10-09T11:54:05.848156+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:41.086003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.817901+0000","last_change":"2023-10-09T11:54:04.826120+0000","last_active":"2023-10-09T11:54:05.817901+0000","last_peered":"2023-10-09T11:54:05.817901+0000","last_clean":"2023-10-09T11:54:05.817901+0000","last_became_active":"2023-10-09T11:54:04.825856+0000","last_became_peered":"2023-10-09T11:54:04.825856+0000","last_unstale":"2023-10-09T11:54:05.817901+0000","last_undegraded":"2023-10-09T11:54:05.817901+0000","last_fullsized":"2023-10-09T11:54:05.817901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:28.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.846441+0000","last_change":"2023-10-09T11:54:05.835427+0000","last_active":"2023-10-09T11:54:05.846441+0000","last_peered":"2023-10-09T11:54:05.846441+0000","last_clean":"2023-10-09T11:54:05.846441+0000","last_became_active":"2023-10-09T11:54:05.835188+0000","last_became_peered":"2023-10-09T11:54:05.835188+0000","last_unstale":"2023-10-09T11:54:05.846441+0000","last_undegraded":"2023-10-09T11:54:05.846441+0000","last_fullsized":"2023-10-09T11:54:05.846441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:52.088129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826225+0000","last_change":"2023-10-09T11:54:04.822700+0000","last_active":"2023-10-09T11:54:05.826225+0000","last_peered":"2023-10-09T11:54:05.826225+0000","last_clean":"2023-10-09T11:54:05.826225+0000","last_became_active":"2023-10-09T11:54:04.822453+0000","last_became_peered":"2023-10-09T11:54:04.822453+0000","last_unstale":"2023-10-09T11:54:05.826225+0000","last_undegraded":"2023-10-09T11:54:05.826225+0000","last_fullsized":"2023-10-09T11:54:05.826225+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:26.162264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838842+0000","last_change":"2023-10-09T11:54:05.833272+0000","last_active":"2023-10-09T11:54:05.838842+0000","last_peered":"2023-10-09T11:54:05.838842+0000","last_clean":"2023-10-09T11:54:05.838842+0000","last_became_active":"2023-10-09T11:54:05.832930+0000","last_became_peered":"2023-10-09T11:54:05.832930+0000","last_unstale":"2023-10-09T11:54:05.838842+0000","last_undegraded":"2023-10-09T11:54:05.838842+0000","last_fullsized":"2023-10-09T11:54:05.838842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:55.542811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.819678+0000","last_change":"2023-10-09T11:54:04.820249+0000","last_active":"2023-10-09T11:54:05.819678+0000","last_peered":"2023-10-09T11:54:05.819678+0000","last_clean":"2023-10-09T11:54:05.819678+0000","last_became_active":"2023-10-09T11:54:04.820019+0000","last_became_peered":"2023-10-09T11:54:04.820019+0000","last_unstale":"2023-10-09T11:54:05.819678+0000","last_undegraded":"2023-10-09T11:54:05.819678+0000","last_fullsized":"2023-10-09T11:54:05.819678+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:59.661173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.831048+0000","last_change":"2023-10-09T11:54:05.829676+0000","last_active":"2023-10-09T11:54:05.831048+0000","last_peered":"2023-10-09T11:54:05.831048+0000","last_clean":"2023-10-09T11:54:05.831048+0000","last_became_active":"2023-10-09T11:54:05.829355+0000","last_became_peered":"2023-10-09T11:54:05.829355+0000","last_unstale":"2023-10-09T11:54:05.831048+0000","last_undegraded":"2023-10-09T11:54:05.831048+0000","last_fullsized":"2023-10-09T11:54:05.831048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:13.314695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826271+0000","last_change":"2023-10-09T11:54:04.830055+0000","last_active":"2023-10-09T11:54:05.826271+0000","last_peered":"2023-10-09T11:54:05.826271+0000","last_clean":"2023-10-09T11:54:05.826271+0000","last_became_active":"2023-10-09T11:54:04.829775+0000","last_became_peered":"2023-10-09T11:54:04.829775+0000","last_unstale":"2023-10-09T11:54:05.826271+0000","last_undegraded":"2023-10-09T11:54:05.826271+0000","last_fullsized":"2023-10-09T11:54:05.826271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:54.536840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839079+0000","last_change":"2023-10-09T11:54:05.836364+0000","last_active":"2023-10-09T11:54:05.839079+0000","last_peered":"2023-10-09T11:54:05.839079+0000","last_clean":"2023-10-09T11:54:05.839079+0000","last_became_active":"2023-10-09T11:54:05.836020+0000","last_became_peered":"2023-10-09T11:54:05.836020+0000","last_unstale":"2023-10-09T11:54:05.839079+0000","last_undegraded":"2023-10-09T11:54:05.839079+0000","last_fullsized":"2023-10-09T11:54:05.839079+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:25.181391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.825451+0000","last_change":"2023-10-09T11:54:04.825097+0000","last_active":"2023-10-09T11:54:05.825451+0000","last_peered":"2023-10-09T11:54:05.825451+0000","last_clean":"2023-10-09T11:54:05.825451+0000","last_became_active":"2023-10-09T11:54:04.824856+0000","last_became_peered":"2023-10-09T11:54:04.824856+0000","last_unstale":"2023-10-09T11:54:05.825451+0000","last_undegraded":"2023-10-09T11:54:05.825451+0000","last_fullsized":"2023-10-09T11:54:05.825451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:07.207663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.853219+0000","last_change":"2023-10-09T11:54:05.836917+0000","last_active":"2023-10-09T11:54:05.853219+0000","last_peered":"2023-10-09T11:54:05.853219+0000","last_clean":"2023-10-09T11:54:05.853219+0000","last_became_active":"2023-10-09T11:54:05.836669+0000","last_became_peered":"2023-10-09T11:54:05.836669+0000","last_unstale":"2023-10-09T11:54:05.853219+0000","last_undegraded":"2023-10-09T11:54:05.853219+0000","last_fullsized":"2023-10-09T11:54:05.853219+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:23.916906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.828183+0000","last_change":"2023-10-09T11:54:04.830449+0000","last_active":"2023-10-09T11:54:05.828183+0000","last_peered":"2023-10-09T11:54:05.828183+0000","last_clean":"2023-10-09T11:54:05.828183+0000","last_became_active":"2023-10-09T11:54:04.829980+0000","last_became_peered":"2023-10-09T11:54:04.829980+0000","last_unstale":"2023-10-09T11:54:05.828183+0000","last_undegraded":"2023-10-09T11:54:05.828183+0000","last_fullsized":"2023-10-09T11:54:05.828183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:30.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838194+0000","last_change":"2023-10-09T11:54:05.829928+0000","last_active":"2023-10-09T11:54:05.838194+0000","last_peered":"2023-10-09T11:54:05.838194+0000","last_clean":"2023-10-09T11:54:05.838194+0000","last_became_active":"2023-10-09T11:54:05.829619+0000","last_became_peered":"2023-10-09T11:54:05.829619+0000","last_unstale":"2023-10-09T11:54:05.838194+0000","last_undegraded":"2023-10-09T11:54:05.838194+0000","last_fullsized":"2023-10-09T11:54:05.838194+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:30.429980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.820412+0000","last_change":"2023-10-09T11:54:04.825951+0000","last_active":"2023-10-09T11:54:05.820412+0000","last_peered":"2023-10-09T11:54:05.820412+0000","last_clean":"2023-10-09T11:54:05.820412+0000","last_became_active":"2023-10-09T11:54:04.825689+0000","last_became_peered":"2023-10-09T11:54:04.825689+0000","last_unstale":"2023-10-09T11:54:05.820412+0000","last_undegraded":"2023-10-09T11:54:05.820412+0000","last_fullsized":"2023-10-09T11:54:05.820412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:44.366168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855814+0000","last_change":"2023-10-09T11:54:05.852980+0000","last_active":"2023-10-09T11:54:05.855814+0000","last_peered":"2023-10-09T11:54:05.855814+0000","last_clean":"2023-10-09T11:54:05.855814+0000","last_became_active":"2023-10-09T11:54:05.852668+0000","last_became_peered":"2023-10-09T11:54:05.852668+0000","last_unstale":"2023-10-09T11:54:05.855814+0000","last_undegraded":"2023-10-09T11:54:05.855814+0000","last_fullsized":"2023-10-09T11:54:05.855814+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:08.358204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.830185+0000","last_change":"2023-10-09T11:54:04.827713+0000","last_active":"2023-10-09T11:54:05.830185+0000","last_peered":"2023-10-09T11:54:05.830185+0000","last_clean":"2023-10-09T11:54:05.830185+0000","last_became_active":"2023-10-09T11:54:04.827316+0000","last_became_peered":"2023-10-09T11:54:04.827316+0000","last_unstale":"2023-10-09T11:54:05.830185+0000","last_undegraded":"2023-10-09T11:54:05.830185+0000","last_fullsized":"2023-10-09T11:54:05.830185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:12.967027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841581+0000","last_change":"2023-10-09T11:54:05.838113+0000","last_active":"2023-10-09T11:54:05.841581+0000","last_peered":"2023-10-09T11:54:05.841581+0000","last_clean":"2023-10-09T11:54:05.841581+0000","last_became_active":"2023-10-09T11:54:05.837071+0000","last_became_peered":"2023-10-09T11:54:05.837071+0000","last_unstale":"2023-10-09T11:54:05.841581+0000","last_undegraded":"2023-10-09T11:54:05.841581+0000","last_fullsized":"2023-10-09T11:54:05.841581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:35.769662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.817849+0000","last_change":"2023-10-09T11:54:04.827046+0000","last_active":"2023-10-09T11:54:05.817849+0000","last_peered":"2023-10-09T11:54:05.817849+0000","last_clean":"2023-10-09T11:54:05.817849+0000","last_became_active":"2023-10-09T11:54:04.826423+0000","last_became_peered":"2023-10-09T11:54:04.826423+0000","last_unstale":"2023-10-09T11:54:05.817849+0000","last_undegraded":"2023-10-09T11:54:05.817849+0000","last_fullsized":"2023-10-09T11:54:05.817849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:52.670983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835890+0000","last_change":"2023-10-09T11:54:05.834338+0000","last_active":"2023-10-09T11:54:05.835890+0000","last_peered":"2023-10-09T11:54:05.835890+0000","last_clean":"2023-10-09T11:54:05.835890+0000","last_became_active":"2023-10-09T11:54:05.834054+0000","last_became_peered":"2023-10-09T11:54:05.834054+0000","last_unstale":"2023-10-09T11:54:05.835890+0000","last_undegraded":"2023-10-09T11:54:05.835890+0000","last_fullsized":"2023-10-09T11:54:05.835890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:18.758117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856227+0000","last_change":"2023-10-09T11:54:04.824210+0000","last_active":"2023-10-09T11:54:05.856227+0000","last_peered":"2023-10-09T11:54:05.856227+0000","last_clean":"2023-10-09T11:54:05.856227+0000","last_became_active":"2023-10-09T11:54:04.823578+0000","last_became_peered":"2023-10-09T11:54:04.823578+0000","last_unstale":"2023-10-09T11:54:05.856227+0000","last_undegraded":"2023-10-09T11:54:05.856227+0000","last_fullsized":"2023-10-09T11:54:05.856227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:31.725573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":277,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826322+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:54:05.826322+0000","last_peered":"2023-10-09T11:54:05.826322+0000","last_clean":"2023-10-09T11:54:05.826322+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:54:05.826322+0000","last_undegraded":"2023-10-09T11:54:05.826322+0000","last_fullsized":"2023-10-09T11:54:05.826322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476895,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":933548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.67100000000000004},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":0.873,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.70499999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93400000000000005,"5min":1.014,"15min":1.0349999999999999},"last":0.75}]},{"osd":2,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.69599999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.44600000000000001},"max":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":1.1599999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.048,"15min":1.202},"last":0.56899999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1.016},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92500000000000004,"5min":1.073,"15min":1.073},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.73999999999999999,"5min":0.91000000000000003,"15min":0.94099999999999995},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.96199999999999997},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.048},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":0.79600000000000004,"5min":0.95699999999999996,"15min":1.0620000000000001},"last":0.66500000000000004}]}]},{"osd":6,"up_from":16,"seq":68719476896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":745472,"data_stored":343734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.748,"15min":0.751},"min":{"1min":0.59699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":0.95599999999999996,"15min":1.121},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.60699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.95099999999999996,"5min":0.98399999999999999,"15min":1.216},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.439},"max":{"1min":1.008,"5min":1.008,"15min":1.139},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.47299999999999998},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.431},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.502},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.244},"last":0.68400000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.92600000000000005,"15min":1.613},"last":0.628},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.94899999999999995,"15min":1.143},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.2410000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.495,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":1.506},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.89600000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509600,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":343160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":1.6759999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.385},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.374,"15min":0.318},"max":{"1min":0.77800000000000002,"5min":0.83199999999999996,"15min":1.099},"last":0.45700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64800000000000002,"5min":0.80000000000000004,"15min":1.536},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.746,"15min":1.272},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82899999999999996,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.48899999999999999},"max":{"1min":1.115,"5min":1.1479999999999999,"15min":1.7210000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.56799999999999995,"15min":0.46899999999999997},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.67500000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.181,"15min":1.677},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.81699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.55300000000000005},"max":{"1min":1.0669999999999999,"5min":1.135,"15min":1.778},"last":0.65800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.51100000000000001},"max":{"1min":1.0760000000000001,"5min":1.2430000000000001,"15min":1.623},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.65200000000000002,"5min":0.61699999999999999,"15min":0.50700000000000001},"max":{"1min":1.02,"5min":1.274,"15min":1.708},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.84099999999999997},"min":{"1min":0.65000000000000002,"5min":0.62,"15min":0.52900000000000003},"max":{"1min":1.032,"5min":1.2130000000000001,"15min":1.659},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.0880000000000001,"5min":1.194,"15min":1.736},"last":0.69099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542303,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":933492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47599999999999998,"15min":0.48499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57199999999999995,"5min":0.753,"15min":1.367},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68700000000000006,"5min":0.85599999999999998,"15min":1.4930000000000001},"last":0.309}]},{"osd":2,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":1.8340000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.83499999999999996,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":1.855},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.752,"5min":0.84799999999999998,"15min":1.2330000000000001},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0449999999999999,"5min":1.169,"15min":1.254},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47199999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.099},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48099999999999998},"max":{"1min":1.129,"5min":1.1890000000000001,"15min":1.2},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.57899999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.028,"5min":1.169,"15min":1.321},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.755}]},{"osd":7,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.1299999999999999,"15min":1.24},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.2849999999999999},"last":0.70399999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306216,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065624,"statfs":{"total":96636764160,"available":96323198976,"internally_reserved":0,"allocated":753664,"data_stored":344648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47199999999999998,"15min":0.46000000000000002},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.66500000000000004,"5min":0.755,"15min":0.83799999999999997},"last":0.5}]},{"osd":1,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.97299999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.32200000000000001},"max":{"1min":0.65900000000000003,"5min":0.81200000000000006,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.79700000000000004},"min":{"1min":0.59999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.79700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.50700000000000001},"max":{"1min":1.0309999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82399999999999995,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83699999999999997,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.56299999999999994},"max":{"1min":1.0569999999999999,"5min":1.204,"15min":1.27},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.66200000000000003,"5min":0.621,"15min":0.53100000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.246},"last":0.63},{"interface":"front","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.67900000000000005,"5min":0.63400000000000001,"15min":0.57299999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.2130000000000001},"last":0.68000000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509600,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":749568,"data_stored":343700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.34699999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.70999999999999996,"15min":1.208},"last":0.371},{"interface":"front","average":{"1min":0.503,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":1.1970000000000001},"last":0.48699999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":1.0229999999999999},"last":0.442},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.311},"max":{"1min":0.624,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.55100000000000005},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.503}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.65000000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.327},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.70599999999999996,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.141,"15min":1.2689999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":1.109,"5min":1.109,"15min":1.2829999999999999},"last":0.628},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.66800000000000004,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.3660000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.50700000000000001,"15min":0.47999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.1459999999999999,"15min":1.218},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.46999999999999997},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.333},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.54700000000000004},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.3560000000000001},"last":0.77700000000000002}]}]},{"osd":4,"up_from":16,"seq":68719476895,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310308,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061532,"statfs":{"total":96636764160,"available":96319008768,"internally_reserved":0,"allocated":749568,"data_stored":344626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":1.071},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.39100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.80100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.2569999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.94299999999999995,"5min":1.05,"15min":1.2909999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74299999999999999,"15min":0.73199999999999998},"min":{"1min":0.60499999999999998,"5min":0.54900000000000004,"15min":0.45400000000000001},"max":{"1min":0.90800000000000003,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90800000000000003,"5min":0.995,"15min":1.234},"last":0.89000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.432},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.94699999999999995,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91700000000000004,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.125},"last":0.747},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.82599999999999996,"5min":0.91900000000000004,"15min":1.373},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":1.2410000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":1.1200000000000001,"15min":1.222},"last":0.81100000000000005}]}]},{"osd":5,"up_from":16,"seq":68719476895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":343160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.1180000000000001,"15min":1.48},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.318},"max":{"1min":0.877,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.93500000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.41199999999999998},"max":{"1min":0.88500000000000001,"5min":0.95299999999999996,"15min":1.0840000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.47799999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":1.21},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.0389999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72799999999999998,"15min":0.70099999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.90300000000000002,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.84799999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.45900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.363},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91800000000000004,"5min":1.0029999999999999,"15min":1.508},"last":0.88}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77500000000000002,"5min":1.018,"15min":1.018},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61399999999999999,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68799999999999994,"5min":0.998,"15min":1.321},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":1.0269999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.49199999999999999,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.0669999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86199999999999999,"5min":1.0129999999999999,"15min":3.3620000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.755},"min":{"1min":0.51400000000000001,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":3.3149999999999999},"last":0.627}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:54:15.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:54:15.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.607+0000 7fbba8dff700 1 Processor -- start 2023-10-09T11:54:15.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.607+0000 7fbba8dff700 1 -- start start 2023-10-09T11:54:15.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbba8dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba4155c10 0x7fbba4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:15.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbba8dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbba40ac230 0x7fbba40ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:15.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbba8dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba40ad930 con 0x7fbba41568a0 2023-10-09T11:54:15.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbba8dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba40acd20 con 0x7fbba40ac230 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbba8dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40ad000 con 0x7fbba4155c10 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbb9bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbba40ac230 0x7fbba40ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbb9bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbba40ac230 0x7fbba40ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44456/0 (socket says 172.21.15.86:44456) 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbb9bfff700 1 -- 172.21.15.86:0/2274594491 learned_addr learned my addr 172.21.15.86:0/2274594491 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbba259c700 1 --2- 172.21.15.86:0/2274594491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba4155c10 0x7fbba4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbb9bfff700 1 -- 172.21.15.86:0/2274594491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba4155c10 msgr2=0x7fbba4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbb9bfff700 1 --2- 172.21.15.86:0/2274594491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba4155c10 0x7fbba4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.609+0000 7fbb9bfff700 1 -- 172.21.15.86:0/2274594491 >> v1:172.21.15.135:6789/0 conn(0x7fbba41568a0 legacy=0x7fbba4156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.610+0000 7fbb9bfff700 1 -- 172.21.15.86:0/2274594491 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40ad2e0 con 0x7fbba40ac230 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.610+0000 7fbb9bfff700 1 --2- 172.21.15.86:0/2274594491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba40ac230 0x7fbba40ac6a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00bc50 tx=0x7fbb8c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20ee2327610b277 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.610+0000 7fbba1d9b700 1 -- 172.21.15.86:0/2274594491 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00dbf0 con 0x7fbba40ac230 2023-10-09T11:54:15.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.610+0000 7fbba1d9b700 1 -- 172.21.15.86:0/2274594491 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00dd50 con 0x7fbba40ac230 2023-10-09T11:54:15.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.610+0000 7fbba1d9b700 1 -- 172.21.15.86:0/2274594491 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0196b0 con 0x7fbba40ac230 2023-10-09T11:54:15.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 -- 172.21.15.86:0/2274594491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba40ac230 msgr2=0x7fbba40ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 --2- 172.21.15.86:0/2274594491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba40ac230 0x7fbba40ac6a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00bc50 tx=0x7fbb8c00b4f0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 -- 172.21.15.86:0/2274594491 shutdown_connections 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 --2- 172.21.15.86:0/2274594491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba4155c10 0x7fbba4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 --2- 172.21.15.86:0/2274594491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba40ac230 0x7fbba40ac6a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 -- 172.21.15.86:0/2274594491 >> 172.21.15.86:0/2274594491 conn(0x7fbba406a320 msgr2=0x7fbba40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 -- 172.21.15.86:0/2274594491 shutdown_connections 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.611+0000 7fbba8dff700 1 -- 172.21.15.86:0/2274594491 wait complete. 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.612+0000 7fbba8dff700 1 Processor -- start 2023-10-09T11:54:15.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.612+0000 7fbba8dff700 1 -- start start 2023-10-09T11:54:15.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba8dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba40ac230 0x7fbba4145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:15.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba8dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4155c10 0x7fbba415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:15.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba8dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba41568a0 0x7fbba4159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:15.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba8dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba415b0a0 con 0x7fbba41568a0 2023-10-09T11:54:15.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba8dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba415a490 con 0x7fbba4155c10 2023-10-09T11:54:15.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba8dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba415a770 con 0x7fbba40ac230 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba41568a0 0x7fbba4159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba41568a0 0x7fbba4159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44462/0 (socket says 172.21.15.86:44462) 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.613+0000 7fbba2d9d700 1 -- 172.21.15.86:0/295224738 learned_addr learned my addr 172.21.15.86:0/295224738 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba2d9d700 1 -- 172.21.15.86:0/295224738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba40ac230 msgr2=0x7fbba4145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba2d9d700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba40ac230 0x7fbba4145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba2d9d700 1 -- 172.21.15.86:0/295224738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4155c10 msgr2=0x7fbba415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba2d9d700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4155c10 0x7fbba415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba2d9d700 1 -- 172.21.15.86:0/295224738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c00b790 con 0x7fbba41568a0 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba2d9d700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba41568a0 0x7fbba4159ab0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00c840 tx=0x7fbb9c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbb9a7fc700 1 -- 172.21.15.86:0/295224738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c012630 con 0x7fbba41568a0 2023-10-09T11:54:15.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbb9a7fc700 1 -- 172.21.15.86:0/295224738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0127b0 con 0x7fbba41568a0 2023-10-09T11:54:15.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbb9a7fc700 1 -- 172.21.15.86:0/295224738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c012b70 con 0x7fbba41568a0 2023-10-09T11:54:15.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba415aa50 con 0x7fbba41568a0 2023-10-09T11:54:15.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.614+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba41464c0 con 0x7fbba41568a0 2023-10-09T11:54:15.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.615+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba404c3c0 con 0x7fbba41568a0 2023-10-09T11:54:15.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.616+0000 7fbb9a7fc700 1 -- 172.21.15.86:0/295224738 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb9c003030 con 0x7fbba41568a0 2023-10-09T11:54:15.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.617+0000 7fbb9a7fc700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fbb84066f30 0x7fbb840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:15.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.617+0000 7fbb9a7fc700 1 -- 172.21.15.86:0/295224738 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fbb9c0846f0 con 0x7fbba41568a0 2023-10-09T11:54:15.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.617+0000 7fbba259c700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fbb84066f30 0x7fbb840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:15.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.618+0000 7fbba259c700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fbb84066f30 0x7fbb840693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbba41597f0 tx=0x7fbb940091a0 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:15.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.621+0000 7fbb9a7fc700 1 -- 172.21.15.86:0/295224738 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb9c051760 con 0x7fbba41568a0 2023-10-09T11:54:15.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.807+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbba415b1e0 con 0x7fbb84066f30 2023-10-09T11:54:15.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.816+0000 7fbb9a7fc700 1 -- 172.21.15.86:0/295224738 <== mgr.5538 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288865 (secure 0 0 0) 0x7fbba415b1e0 con 0x7fbb84066f30 2023-10-09T11:54:15.820 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:15.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fbb84066f30 msgr2=0x7fbb840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:15.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fbb84066f30 0x7fbb840693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbba41597f0 tx=0x7fbb940091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba41568a0 msgr2=0x7fbba4159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:15.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba41568a0 0x7fbba4159ab0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00c840 tx=0x7fbb9c001670 comp rx=0 tx=0).stop 2023-10-09T11:54:15.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 shutdown_connections 2023-10-09T11:54:15.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fbb84066f30 0x7fbb840693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbba41568a0 0x7fbba4159ab0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba40ac230 0x7fbba4145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 --2- 172.21.15.86:0/295224738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4155c10 0x7fbba415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 >> 172.21.15.86:0/295224738 conn(0x7fbba406a320 msgr2=0x7fbba415ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 shutdown_connections 2023-10-09T11:54:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:15.820+0000 7fbba8dff700 1 -- 172.21.15.86:0/295224738 wait complete. 2023-10-09T11:54:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:54:15.837 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T11:54:15.751874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426248,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752548472,"statfs":{"total":773094113280,"available":770609635328,"internally_reserved":0,"allocated":7151616,"data_stored":3930068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.935125"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.837342+0000","last_change":"2023-10-09T11:54:05.835364+0000","last_active":"2023-10-09T11:54:05.837342+0000","last_peered":"2023-10-09T11:54:05.837342+0000","last_clean":"2023-10-09T11:54:05.837342+0000","last_became_active":"2023-10-09T11:54:05.834615+0000","last_became_peered":"2023-10-09T11:54:05.834615+0000","last_unstale":"2023-10-09T11:54:05.837342+0000","last_undegraded":"2023-10-09T11:54:05.837342+0000","last_fullsized":"2023-10-09T11:54:05.837342+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:09.879704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.858414+0000","last_change":"2023-10-09T11:54:05.854809+0000","last_active":"2023-10-09T11:54:05.858414+0000","last_peered":"2023-10-09T11:54:05.858414+0000","last_clean":"2023-10-09T11:54:05.858414+0000","last_became_active":"2023-10-09T11:54:05.854539+0000","last_became_peered":"2023-10-09T11:54:05.854539+0000","last_unstale":"2023-10-09T11:54:05.858414+0000","last_undegraded":"2023-10-09T11:54:05.858414+0000","last_fullsized":"2023-10-09T11:54:05.858414+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:27.168236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.834050+0000","last_change":"2023-10-09T11:54:05.829419+0000","last_active":"2023-10-09T11:54:05.834050+0000","last_peered":"2023-10-09T11:54:05.834050+0000","last_clean":"2023-10-09T11:54:05.834050+0000","last_became_active":"2023-10-09T11:54:05.829139+0000","last_became_peered":"2023-10-09T11:54:05.829139+0000","last_unstale":"2023-10-09T11:54:05.834050+0000","last_undegraded":"2023-10-09T11:54:05.834050+0000","last_fullsized":"2023-10-09T11:54:05.834050+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:35.275084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.831008+0000","last_change":"2023-10-09T11:54:05.828465+0000","last_active":"2023-10-09T11:54:05.831008+0000","last_peered":"2023-10-09T11:54:05.831008+0000","last_clean":"2023-10-09T11:54:05.831008+0000","last_became_active":"2023-10-09T11:54:05.828206+0000","last_became_peered":"2023-10-09T11:54:05.828206+0000","last_unstale":"2023-10-09T11:54:05.831008+0000","last_undegraded":"2023-10-09T11:54:05.831008+0000","last_fullsized":"2023-10-09T11:54:05.831008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:08.140136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.858352+0000","last_change":"2023-10-09T11:54:05.854247+0000","last_active":"2023-10-09T11:54:05.858352+0000","last_peered":"2023-10-09T11:54:05.858352+0000","last_clean":"2023-10-09T11:54:05.858352+0000","last_became_active":"2023-10-09T11:54:05.853991+0000","last_became_peered":"2023-10-09T11:54:05.853991+0000","last_unstale":"2023-10-09T11:54:05.858352+0000","last_undegraded":"2023-10-09T11:54:05.858352+0000","last_fullsized":"2023-10-09T11:54:05.858352+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:31.642917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838246+0000","last_change":"2023-10-09T11:54:05.830847+0000","last_active":"2023-10-09T11:54:05.838246+0000","last_peered":"2023-10-09T11:54:05.838246+0000","last_clean":"2023-10-09T11:54:05.838246+0000","last_became_active":"2023-10-09T11:54:05.830593+0000","last_became_peered":"2023-10-09T11:54:05.830593+0000","last_unstale":"2023-10-09T11:54:05.838246+0000","last_undegraded":"2023-10-09T11:54:05.838246+0000","last_fullsized":"2023-10-09T11:54:05.838246+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:05.275034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839048+0000","last_change":"2023-10-09T11:54:05.835402+0000","last_active":"2023-10-09T11:54:05.839048+0000","last_peered":"2023-10-09T11:54:05.839048+0000","last_clean":"2023-10-09T11:54:05.839048+0000","last_became_active":"2023-10-09T11:54:05.835072+0000","last_became_peered":"2023-10-09T11:54:05.835072+0000","last_unstale":"2023-10-09T11:54:05.839048+0000","last_undegraded":"2023-10-09T11:54:05.839048+0000","last_fullsized":"2023-10-09T11:54:05.839048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:00.104429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.852391+0000","last_change":"2023-10-09T11:54:05.845018+0000","last_active":"2023-10-09T11:54:05.852391+0000","last_peered":"2023-10-09T11:54:05.852391+0000","last_clean":"2023-10-09T11:54:05.852391+0000","last_became_active":"2023-10-09T11:54:05.844622+0000","last_became_peered":"2023-10-09T11:54:05.844622+0000","last_unstale":"2023-10-09T11:54:05.852391+0000","last_undegraded":"2023-10-09T11:54:05.852391+0000","last_fullsized":"2023-10-09T11:54:05.852391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:35.115148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.832493+0000","last_change":"2023-10-09T11:54:05.831778+0000","last_active":"2023-10-09T11:54:05.832493+0000","last_peered":"2023-10-09T11:54:05.832493+0000","last_clean":"2023-10-09T11:54:05.832493+0000","last_became_active":"2023-10-09T11:54:05.831523+0000","last_became_peered":"2023-10-09T11:54:05.831523+0000","last_unstale":"2023-10-09T11:54:05.832493+0000","last_undegraded":"2023-10-09T11:54:05.832493+0000","last_fullsized":"2023-10-09T11:54:05.832493+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:40.966425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.830232+0000","last_change":"2023-10-09T11:54:05.828695+0000","last_active":"2023-10-09T11:54:05.830232+0000","last_peered":"2023-10-09T11:54:05.830232+0000","last_clean":"2023-10-09T11:54:05.830232+0000","last_became_active":"2023-10-09T11:54:05.828267+0000","last_became_peered":"2023-10-09T11:54:05.828267+0000","last_unstale":"2023-10-09T11:54:05.830232+0000","last_undegraded":"2023-10-09T11:54:05.830232+0000","last_fullsized":"2023-10-09T11:54:05.830232+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:39.608155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855157+0000","last_change":"2023-10-09T11:54:05.852215+0000","last_active":"2023-10-09T11:54:05.855157+0000","last_peered":"2023-10-09T11:54:05.855157+0000","last_clean":"2023-10-09T11:54:05.855157+0000","last_became_active":"2023-10-09T11:54:05.851956+0000","last_became_peered":"2023-10-09T11:54:05.851956+0000","last_unstale":"2023-10-09T11:54:05.855157+0000","last_undegraded":"2023-10-09T11:54:05.855157+0000","last_fullsized":"2023-10-09T11:54:05.855157+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:13.247716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849759+0000","last_change":"2023-10-09T11:54:05.848435+0000","last_active":"2023-10-09T11:54:05.849759+0000","last_peered":"2023-10-09T11:54:05.849759+0000","last_clean":"2023-10-09T11:54:05.849759+0000","last_became_active":"2023-10-09T11:54:05.848167+0000","last_became_peered":"2023-10-09T11:54:05.848167+0000","last_unstale":"2023-10-09T11:54:05.849759+0000","last_undegraded":"2023-10-09T11:54:05.849759+0000","last_fullsized":"2023-10-09T11:54:05.849759+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:29.140818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848329+0000","last_change":"2023-10-09T11:54:05.846978+0000","last_active":"2023-10-09T11:54:05.848329+0000","last_peered":"2023-10-09T11:54:05.848329+0000","last_clean":"2023-10-09T11:54:05.848329+0000","last_became_active":"2023-10-09T11:54:05.846704+0000","last_became_peered":"2023-10-09T11:54:05.846704+0000","last_unstale":"2023-10-09T11:54:05.848329+0000","last_undegraded":"2023-10-09T11:54:05.848329+0000","last_fullsized":"2023-10-09T11:54:05.848329+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:59.751313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835380+0000","last_change":"2023-10-09T11:54:05.832280+0000","last_active":"2023-10-09T11:54:05.835380+0000","last_peered":"2023-10-09T11:54:05.835380+0000","last_clean":"2023-10-09T11:54:05.835380+0000","last_became_active":"2023-10-09T11:54:05.832028+0000","last_became_peered":"2023-10-09T11:54:05.832028+0000","last_unstale":"2023-10-09T11:54:05.835380+0000","last_undegraded":"2023-10-09T11:54:05.835380+0000","last_fullsized":"2023-10-09T11:54:05.835380+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:00.160458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.854887+0000","last_change":"2023-10-09T11:54:05.838584+0000","last_active":"2023-10-09T11:54:05.854887+0000","last_peered":"2023-10-09T11:54:05.854887+0000","last_clean":"2023-10-09T11:54:05.854887+0000","last_became_active":"2023-10-09T11:54:05.838145+0000","last_became_peered":"2023-10-09T11:54:05.838145+0000","last_unstale":"2023-10-09T11:54:05.854887+0000","last_undegraded":"2023-10-09T11:54:05.854887+0000","last_fullsized":"2023-10-09T11:54:05.854887+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:16.678827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835409+0000","last_change":"2023-10-09T11:54:05.830465+0000","last_active":"2023-10-09T11:54:05.835409+0000","last_peered":"2023-10-09T11:54:05.835409+0000","last_clean":"2023-10-09T11:54:05.835409+0000","last_became_active":"2023-10-09T11:54:05.830182+0000","last_became_peered":"2023-10-09T11:54:05.830182+0000","last_unstale":"2023-10-09T11:54:05.835409+0000","last_undegraded":"2023-10-09T11:54:05.835409+0000","last_fullsized":"2023-10-09T11:54:05.835409+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:51.069416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.845268+0000","last_change":"2023-10-09T11:54:05.842651+0000","last_active":"2023-10-09T11:54:05.845268+0000","last_peered":"2023-10-09T11:54:05.845268+0000","last_clean":"2023-10-09T11:54:05.845268+0000","last_became_active":"2023-10-09T11:54:05.842093+0000","last_became_peered":"2023-10-09T11:54:05.842093+0000","last_unstale":"2023-10-09T11:54:05.845268+0000","last_undegraded":"2023-10-09T11:54:05.845268+0000","last_fullsized":"2023-10-09T11:54:05.845268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:32.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835217+0000","last_change":"2023-10-09T11:54:05.830891+0000","last_active":"2023-10-09T11:54:05.835217+0000","last_peered":"2023-10-09T11:54:05.835217+0000","last_clean":"2023-10-09T11:54:05.835217+0000","last_became_active":"2023-10-09T11:54:05.830637+0000","last_became_peered":"2023-10-09T11:54:05.830637+0000","last_unstale":"2023-10-09T11:54:05.835217+0000","last_undegraded":"2023-10-09T11:54:05.835217+0000","last_fullsized":"2023-10-09T11:54:05.835217+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:05.870696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836791+0000","last_change":"2023-10-09T11:54:05.832575+0000","last_active":"2023-10-09T11:54:05.836791+0000","last_peered":"2023-10-09T11:54:05.836791+0000","last_clean":"2023-10-09T11:54:05.836791+0000","last_became_active":"2023-10-09T11:54:05.832332+0000","last_became_peered":"2023-10-09T11:54:05.832332+0000","last_unstale":"2023-10-09T11:54:05.836791+0000","last_undegraded":"2023-10-09T11:54:05.836791+0000","last_fullsized":"2023-10-09T11:54:05.836791+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:54.160497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.847781+0000","last_change":"2023-10-09T11:54:05.835125+0000","last_active":"2023-10-09T11:54:05.847781+0000","last_peered":"2023-10-09T11:54:05.847781+0000","last_clean":"2023-10-09T11:54:05.847781+0000","last_became_active":"2023-10-09T11:54:05.834864+0000","last_became_peered":"2023-10-09T11:54:05.834864+0000","last_unstale":"2023-10-09T11:54:05.847781+0000","last_undegraded":"2023-10-09T11:54:05.847781+0000","last_fullsized":"2023-10-09T11:54:05.847781+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:42.175886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838236+0000","last_change":"2023-10-09T11:54:05.830776+0000","last_active":"2023-10-09T11:54:05.838236+0000","last_peered":"2023-10-09T11:54:05.838236+0000","last_clean":"2023-10-09T11:54:05.838236+0000","last_became_active":"2023-10-09T11:54:05.830517+0000","last_became_peered":"2023-10-09T11:54:05.830517+0000","last_unstale":"2023-10-09T11:54:05.838236+0000","last_undegraded":"2023-10-09T11:54:05.838236+0000","last_fullsized":"2023-10-09T11:54:05.838236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:59:44.094531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848493+0000","last_change":"2023-10-09T11:54:05.835242+0000","last_active":"2023-10-09T11:54:05.848493+0000","last_peered":"2023-10-09T11:54:05.848493+0000","last_clean":"2023-10-09T11:54:05.848493+0000","last_became_active":"2023-10-09T11:54:05.834976+0000","last_became_peered":"2023-10-09T11:54:05.834976+0000","last_unstale":"2023-10-09T11:54:05.848493+0000","last_undegraded":"2023-10-09T11:54:05.848493+0000","last_fullsized":"2023-10-09T11:54:05.848493+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:32:38.288415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.842731+0000","last_change":"2023-10-09T11:54:05.838617+0000","last_active":"2023-10-09T11:54:05.842731+0000","last_peered":"2023-10-09T11:54:05.842731+0000","last_clean":"2023-10-09T11:54:05.842731+0000","last_became_active":"2023-10-09T11:54:05.838336+0000","last_became_peered":"2023-10-09T11:54:05.838336+0000","last_unstale":"2023-10-09T11:54:05.842731+0000","last_undegraded":"2023-10-09T11:54:05.842731+0000","last_fullsized":"2023-10-09T11:54:05.842731+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:27.168236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841601+0000","last_change":"2023-10-09T11:54:05.837880+0000","last_active":"2023-10-09T11:54:05.841601+0000","last_peered":"2023-10-09T11:54:05.841601+0000","last_clean":"2023-10-09T11:54:05.841601+0000","last_became_active":"2023-10-09T11:54:05.837594+0000","last_became_peered":"2023-10-09T11:54:05.837594+0000","last_unstale":"2023-10-09T11:54:05.841601+0000","last_undegraded":"2023-10-09T11:54:05.841601+0000","last_fullsized":"2023-10-09T11:54:05.841601+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:52.951646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836828+0000","last_change":"2023-10-09T11:54:05.831351+0000","last_active":"2023-10-09T11:54:05.836828+0000","last_peered":"2023-10-09T11:54:05.836828+0000","last_clean":"2023-10-09T11:54:05.836828+0000","last_became_active":"2023-10-09T11:54:05.830904+0000","last_became_peered":"2023-10-09T11:54:05.830904+0000","last_unstale":"2023-10-09T11:54:05.836828+0000","last_undegraded":"2023-10-09T11:54:05.836828+0000","last_fullsized":"2023-10-09T11:54:05.836828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:39.121654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849576+0000","last_change":"2023-10-09T11:54:05.847704+0000","last_active":"2023-10-09T11:54:05.849576+0000","last_peered":"2023-10-09T11:54:05.849576+0000","last_clean":"2023-10-09T11:54:05.849576+0000","last_became_active":"2023-10-09T11:54:05.847445+0000","last_became_peered":"2023-10-09T11:54:05.847445+0000","last_unstale":"2023-10-09T11:54:05.849576+0000","last_undegraded":"2023-10-09T11:54:05.849576+0000","last_fullsized":"2023-10-09T11:54:05.849576+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:46.156787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.845325+0000","last_change":"2023-10-09T11:54:05.843388+0000","last_active":"2023-10-09T11:54:05.845325+0000","last_peered":"2023-10-09T11:54:05.845325+0000","last_clean":"2023-10-09T11:54:05.845325+0000","last_became_active":"2023-10-09T11:54:05.842914+0000","last_became_peered":"2023-10-09T11:54:05.842914+0000","last_unstale":"2023-10-09T11:54:05.845325+0000","last_undegraded":"2023-10-09T11:54:05.845325+0000","last_fullsized":"2023-10-09T11:54:05.845325+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:02.203016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849779+0000","last_change":"2023-10-09T11:54:05.848459+0000","last_active":"2023-10-09T11:54:05.849779+0000","last_peered":"2023-10-09T11:54:05.849779+0000","last_clean":"2023-10-09T11:54:05.849779+0000","last_became_active":"2023-10-09T11:54:05.848172+0000","last_became_peered":"2023-10-09T11:54:05.848172+0000","last_unstale":"2023-10-09T11:54:05.849779+0000","last_undegraded":"2023-10-09T11:54:05.849779+0000","last_fullsized":"2023-10-09T11:54:05.849779+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:51.069416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838834+0000","last_change":"2023-10-09T11:54:05.835023+0000","last_active":"2023-10-09T11:54:05.838834+0000","last_peered":"2023-10-09T11:54:05.838834+0000","last_clean":"2023-10-09T11:54:05.838834+0000","last_became_active":"2023-10-09T11:54:05.833763+0000","last_became_peered":"2023-10-09T11:54:05.833763+0000","last_unstale":"2023-10-09T11:54:05.838834+0000","last_undegraded":"2023-10-09T11:54:05.838834+0000","last_fullsized":"2023-10-09T11:54:05.838834+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:35.769662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841564+0000","last_change":"2023-10-09T11:54:05.837811+0000","last_active":"2023-10-09T11:54:05.841564+0000","last_peered":"2023-10-09T11:54:05.841564+0000","last_clean":"2023-10-09T11:54:05.841564+0000","last_became_active":"2023-10-09T11:54:05.837543+0000","last_became_peered":"2023-10-09T11:54:05.837543+0000","last_unstale":"2023-10-09T11:54:05.841564+0000","last_undegraded":"2023-10-09T11:54:05.841564+0000","last_fullsized":"2023-10-09T11:54:05.841564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:37.689364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855010+0000","last_change":"2023-10-09T11:54:05.844380+0000","last_active":"2023-10-09T11:54:05.855010+0000","last_peered":"2023-10-09T11:54:05.855010+0000","last_clean":"2023-10-09T11:54:05.855010+0000","last_became_active":"2023-10-09T11:54:05.844126+0000","last_became_peered":"2023-10-09T11:54:05.844126+0000","last_unstale":"2023-10-09T11:54:05.855010+0000","last_undegraded":"2023-10-09T11:54:05.855010+0000","last_fullsized":"2023-10-09T11:54:05.855010+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:11.631481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.854550+0000","last_change":"2023-10-09T11:54:05.853004+0000","last_active":"2023-10-09T11:54:05.854550+0000","last_peered":"2023-10-09T11:54:05.854550+0000","last_clean":"2023-10-09T11:54:05.854550+0000","last_became_active":"2023-10-09T11:54:05.852742+0000","last_became_peered":"2023-10-09T11:54:05.852742+0000","last_unstale":"2023-10-09T11:54:05.854550+0000","last_undegraded":"2023-10-09T11:54:05.854550+0000","last_fullsized":"2023-10-09T11:54:05.854550+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:40.511061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855388+0000","last_change":"2023-10-09T11:54:05.853324+0000","last_active":"2023-10-09T11:54:05.855388+0000","last_peered":"2023-10-09T11:54:05.855388+0000","last_clean":"2023-10-09T11:54:05.855388+0000","last_became_active":"2023-10-09T11:54:05.853031+0000","last_became_peered":"2023-10-09T11:54:05.853031+0000","last_unstale":"2023-10-09T11:54:05.855388+0000","last_undegraded":"2023-10-09T11:54:05.855388+0000","last_fullsized":"2023-10-09T11:54:05.855388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:00.405405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855561+0000","last_change":"2023-10-09T11:54:04.830958+0000","last_active":"2023-10-09T11:54:05.855561+0000","last_peered":"2023-10-09T11:54:05.855561+0000","last_clean":"2023-10-09T11:54:05.855561+0000","last_became_active":"2023-10-09T11:54:04.830736+0000","last_became_peered":"2023-10-09T11:54:04.830736+0000","last_unstale":"2023-10-09T11:54:05.855561+0000","last_undegraded":"2023-10-09T11:54:05.855561+0000","last_fullsized":"2023-10-09T11:54:05.855561+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:52.331908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838863+0000","last_change":"2023-10-09T11:54:05.833884+0000","last_active":"2023-10-09T11:54:05.838863+0000","last_peered":"2023-10-09T11:54:05.838863+0000","last_clean":"2023-10-09T11:54:05.838863+0000","last_became_active":"2023-10-09T11:54:05.833361+0000","last_became_peered":"2023-10-09T11:54:05.833361+0000","last_unstale":"2023-10-09T11:54:05.838863+0000","last_undegraded":"2023-10-09T11:54:05.838863+0000","last_fullsized":"2023-10-09T11:54:05.838863+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:08.358204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.851810+0000","last_change":"2023-10-09T11:54:04.827351+0000","last_active":"2023-10-09T11:54:05.851810+0000","last_peered":"2023-10-09T11:54:05.851810+0000","last_clean":"2023-10-09T11:54:05.851810+0000","last_became_active":"2023-10-09T11:54:04.827086+0000","last_became_peered":"2023-10-09T11:54:04.827086+0000","last_unstale":"2023-10-09T11:54:05.851810+0000","last_undegraded":"2023-10-09T11:54:05.851810+0000","last_fullsized":"2023-10-09T11:54:05.851810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:01.820086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.858954+0000","last_change":"2023-10-09T11:54:05.855963+0000","last_active":"2023-10-09T11:54:05.858954+0000","last_peered":"2023-10-09T11:54:05.858954+0000","last_clean":"2023-10-09T11:54:05.858954+0000","last_became_active":"2023-10-09T11:54:05.855549+0000","last_became_peered":"2023-10-09T11:54:05.855549+0000","last_unstale":"2023-10-09T11:54:05.858954+0000","last_undegraded":"2023-10-09T11:54:05.858954+0000","last_fullsized":"2023-10-09T11:54:05.858954+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:55.542811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.853237+0000","last_change":"2023-10-09T11:54:04.824609+0000","last_active":"2023-10-09T11:54:05.853237+0000","last_peered":"2023-10-09T11:54:05.853237+0000","last_clean":"2023-10-09T11:54:05.853237+0000","last_became_active":"2023-10-09T11:54:04.824350+0000","last_became_peered":"2023-10-09T11:54:04.824350+0000","last_unstale":"2023-10-09T11:54:05.853237+0000","last_undegraded":"2023-10-09T11:54:05.853237+0000","last_fullsized":"2023-10-09T11:54:05.853237+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:17.599972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.853960+0000","last_change":"2023-10-09T11:54:05.850479+0000","last_active":"2023-10-09T11:54:05.853960+0000","last_peered":"2023-10-09T11:54:05.853960+0000","last_clean":"2023-10-09T11:54:05.853960+0000","last_became_active":"2023-10-09T11:54:05.850127+0000","last_became_peered":"2023-10-09T11:54:05.850127+0000","last_unstale":"2023-10-09T11:54:05.853960+0000","last_undegraded":"2023-10-09T11:54:05.853960+0000","last_fullsized":"2023-10-09T11:54:05.853960+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:05.870696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848997+0000","last_change":"2023-10-09T11:54:04.825164+0000","last_active":"2023-10-09T11:54:05.848997+0000","last_peered":"2023-10-09T11:54:05.848997+0000","last_clean":"2023-10-09T11:54:05.848997+0000","last_became_active":"2023-10-09T11:54:04.824917+0000","last_became_peered":"2023-10-09T11:54:04.824917+0000","last_unstale":"2023-10-09T11:54:05.848997+0000","last_undegraded":"2023-10-09T11:54:05.848997+0000","last_fullsized":"2023-10-09T11:54:05.848997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:28.134846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835606+0000","last_change":"2023-10-09T11:54:05.832202+0000","last_active":"2023-10-09T11:54:05.835606+0000","last_peered":"2023-10-09T11:54:05.835606+0000","last_clean":"2023-10-09T11:54:05.835606+0000","last_became_active":"2023-10-09T11:54:05.831954+0000","last_became_peered":"2023-10-09T11:54:05.831954+0000","last_unstale":"2023-10-09T11:54:05.835606+0000","last_undegraded":"2023-10-09T11:54:05.835606+0000","last_fullsized":"2023-10-09T11:54:05.835606+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:32.862266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855803+0000","last_change":"2023-10-09T11:54:04.823095+0000","last_active":"2023-10-09T11:54:05.855803+0000","last_peered":"2023-10-09T11:54:05.855803+0000","last_clean":"2023-10-09T11:54:05.855803+0000","last_became_active":"2023-10-09T11:54:04.822811+0000","last_became_peered":"2023-10-09T11:54:04.822811+0000","last_unstale":"2023-10-09T11:54:05.855803+0000","last_undegraded":"2023-10-09T11:54:05.855803+0000","last_fullsized":"2023-10-09T11:54:05.855803+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:34.107330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.845255+0000","last_change":"2023-10-09T11:54:05.837662+0000","last_active":"2023-10-09T11:54:05.845255+0000","last_peered":"2023-10-09T11:54:05.845255+0000","last_clean":"2023-10-09T11:54:05.845255+0000","last_became_active":"2023-10-09T11:54:05.837404+0000","last_became_peered":"2023-10-09T11:54:05.837404+0000","last_unstale":"2023-10-09T11:54:05.845255+0000","last_undegraded":"2023-10-09T11:54:05.845255+0000","last_fullsized":"2023-10-09T11:54:05.845255+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:15.590176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.851725+0000","last_change":"2023-10-09T11:54:04.824928+0000","last_active":"2023-10-09T11:54:05.851725+0000","last_peered":"2023-10-09T11:54:05.851725+0000","last_clean":"2023-10-09T11:54:05.851725+0000","last_became_active":"2023-10-09T11:54:04.824639+0000","last_became_peered":"2023-10-09T11:54:04.824639+0000","last_unstale":"2023-10-09T11:54:05.851725+0000","last_undegraded":"2023-10-09T11:54:05.851725+0000","last_fullsized":"2023-10-09T11:54:05.851725+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:50.977295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.847616+0000","last_change":"2023-10-09T11:54:05.835995+0000","last_active":"2023-10-09T11:54:05.847616+0000","last_peered":"2023-10-09T11:54:05.847616+0000","last_clean":"2023-10-09T11:54:05.847616+0000","last_became_active":"2023-10-09T11:54:05.835701+0000","last_became_peered":"2023-10-09T11:54:05.835701+0000","last_unstale":"2023-10-09T11:54:05.847616+0000","last_undegraded":"2023-10-09T11:54:05.847616+0000","last_fullsized":"2023-10-09T11:54:05.847616+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:04:16.071613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.834576+0000","last_change":"2023-10-09T11:54:04.820282+0000","last_active":"2023-10-09T11:54:05.834576+0000","last_peered":"2023-10-09T11:54:05.834576+0000","last_clean":"2023-10-09T11:54:05.834576+0000","last_became_active":"2023-10-09T11:54:04.820023+0000","last_became_peered":"2023-10-09T11:54:04.820023+0000","last_unstale":"2023-10-09T11:54:05.834576+0000","last_undegraded":"2023-10-09T11:54:05.834576+0000","last_fullsized":"2023-10-09T11:54:05.834576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:04.864724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841955+0000","last_change":"2023-10-09T11:54:05.835680+0000","last_active":"2023-10-09T11:54:05.841955+0000","last_peered":"2023-10-09T11:54:05.841955+0000","last_clean":"2023-10-09T11:54:05.841955+0000","last_became_active":"2023-10-09T11:54:05.833891+0000","last_became_peered":"2023-10-09T11:54:05.833891+0000","last_unstale":"2023-10-09T11:54:05.841955+0000","last_undegraded":"2023-10-09T11:54:05.841955+0000","last_fullsized":"2023-10-09T11:54:05.841955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:15.914541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.817927+0000","last_change":"2023-10-09T11:54:04.826690+0000","last_active":"2023-10-09T11:54:05.817927+0000","last_peered":"2023-10-09T11:54:05.817927+0000","last_clean":"2023-10-09T11:54:05.817927+0000","last_became_active":"2023-10-09T11:54:04.825787+0000","last_became_peered":"2023-10-09T11:54:04.825787+0000","last_unstale":"2023-10-09T11:54:05.817927+0000","last_undegraded":"2023-10-09T11:54:05.817927+0000","last_fullsized":"2023-10-09T11:54:05.817927+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:34.062210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835197+0000","last_change":"2023-10-09T11:54:05.830120+0000","last_active":"2023-10-09T11:54:05.835197+0000","last_peered":"2023-10-09T11:54:05.835197+0000","last_clean":"2023-10-09T11:54:05.835197+0000","last_became_active":"2023-10-09T11:54:05.829819+0000","last_became_peered":"2023-10-09T11:54:05.829819+0000","last_unstale":"2023-10-09T11:54:05.835197+0000","last_undegraded":"2023-10-09T11:54:05.835197+0000","last_fullsized":"2023-10-09T11:54:05.835197+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:00.405405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.821653+0000","last_change":"2023-10-09T11:54:04.822493+0000","last_active":"2023-10-09T11:54:05.821653+0000","last_peered":"2023-10-09T11:54:05.821653+0000","last_clean":"2023-10-09T11:54:05.821653+0000","last_became_active":"2023-10-09T11:54:04.822155+0000","last_became_peered":"2023-10-09T11:54:04.822155+0000","last_unstale":"2023-10-09T11:54:05.821653+0000","last_undegraded":"2023-10-09T11:54:05.821653+0000","last_fullsized":"2023-10-09T11:54:05.821653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:00.701626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.844879+0000","last_change":"2023-10-09T11:54:05.842508+0000","last_active":"2023-10-09T11:54:05.844879+0000","last_peered":"2023-10-09T11:54:05.844879+0000","last_clean":"2023-10-09T11:54:05.844879+0000","last_became_active":"2023-10-09T11:54:05.842171+0000","last_became_peered":"2023-10-09T11:54:05.842171+0000","last_unstale":"2023-10-09T11:54:05.844879+0000","last_undegraded":"2023-10-09T11:54:05.844879+0000","last_fullsized":"2023-10-09T11:54:05.844879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:30.580854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.818522+0000","last_change":"2023-10-09T11:54:04.826692+0000","last_active":"2023-10-09T11:54:05.818522+0000","last_peered":"2023-10-09T11:54:05.818522+0000","last_clean":"2023-10-09T11:54:05.818522+0000","last_became_active":"2023-10-09T11:54:04.826412+0000","last_became_peered":"2023-10-09T11:54:04.826412+0000","last_unstale":"2023-10-09T11:54:05.818522+0000","last_undegraded":"2023-10-09T11:54:05.818522+0000","last_fullsized":"2023-10-09T11:54:05.818522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:37.432269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838872+0000","last_change":"2023-10-09T11:54:05.829971+0000","last_active":"2023-10-09T11:54:05.838872+0000","last_peered":"2023-10-09T11:54:05.838872+0000","last_clean":"2023-10-09T11:54:05.838872+0000","last_became_active":"2023-10-09T11:54:05.829708+0000","last_became_peered":"2023-10-09T11:54:05.829708+0000","last_unstale":"2023-10-09T11:54:05.838872+0000","last_undegraded":"2023-10-09T11:54:05.838872+0000","last_fullsized":"2023-10-09T11:54:05.838872+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:13.247716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849528+0000","last_change":"2023-10-09T11:54:04.829888+0000","last_active":"2023-10-09T11:54:05.849528+0000","last_peered":"2023-10-09T11:54:05.849528+0000","last_clean":"2023-10-09T11:54:05.849528+0000","last_became_active":"2023-10-09T11:54:04.829615+0000","last_became_peered":"2023-10-09T11:54:04.829615+0000","last_unstale":"2023-10-09T11:54:05.849528+0000","last_undegraded":"2023-10-09T11:54:05.849528+0000","last_fullsized":"2023-10-09T11:54:05.849528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:40:35.011509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.852048+0000","last_change":"2023-10-09T11:54:05.851489+0000","last_active":"2023-10-09T11:54:05.852048+0000","last_peered":"2023-10-09T11:54:05.852048+0000","last_clean":"2023-10-09T11:54:05.852048+0000","last_became_active":"2023-10-09T11:54:05.851138+0000","last_became_peered":"2023-10-09T11:54:05.851138+0000","last_unstale":"2023-10-09T11:54:05.852048+0000","last_undegraded":"2023-10-09T11:54:05.852048+0000","last_fullsized":"2023-10-09T11:54:05.852048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:24.109375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"62'6","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.859135+0000","last_change":"2023-10-09T11:54:04.815746+0000","last_active":"2023-10-09T11:54:05.859135+0000","last_peered":"2023-10-09T11:54:05.859135+0000","last_clean":"2023-10-09T11:54:05.859135+0000","last_became_active":"2023-10-09T11:54:04.815395+0000","last_became_peered":"2023-10-09T11:54:04.815395+0000","last_unstale":"2023-10-09T11:54:05.859135+0000","last_undegraded":"2023-10-09T11:54:05.859135+0000","last_fullsized":"2023-10-09T11:54:05.859135+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:03.311271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836023+0000","last_change":"2023-10-09T11:54:05.830992+0000","last_active":"2023-10-09T11:54:05.836023+0000","last_peered":"2023-10-09T11:54:05.836023+0000","last_clean":"2023-10-09T11:54:05.836023+0000","last_became_active":"2023-10-09T11:54:05.830727+0000","last_became_peered":"2023-10-09T11:54:05.830727+0000","last_unstale":"2023-10-09T11:54:05.836023+0000","last_undegraded":"2023-10-09T11:54:05.836023+0000","last_fullsized":"2023-10-09T11:54:05.836023+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:49.266104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.857039+0000","last_change":"2023-10-09T11:54:04.820308+0000","last_active":"2023-10-09T11:54:05.857039+0000","last_peered":"2023-10-09T11:54:05.857039+0000","last_clean":"2023-10-09T11:54:05.857039+0000","last_became_active":"2023-10-09T11:54:04.819546+0000","last_became_peered":"2023-10-09T11:54:04.819546+0000","last_unstale":"2023-10-09T11:54:05.857039+0000","last_undegraded":"2023-10-09T11:54:05.857039+0000","last_fullsized":"2023-10-09T11:54:05.857039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:12.308724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.832524+0000","last_change":"2023-10-09T11:54:05.830997+0000","last_active":"2023-10-09T11:54:05.832524+0000","last_peered":"2023-10-09T11:54:05.832524+0000","last_clean":"2023-10-09T11:54:05.832524+0000","last_became_active":"2023-10-09T11:54:05.830733+0000","last_became_peered":"2023-10-09T11:54:05.830733+0000","last_unstale":"2023-10-09T11:54:05.832524+0000","last_undegraded":"2023-10-09T11:54:05.832524+0000","last_fullsized":"2023-10-09T11:54:05.832524+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:43.361406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826394+0000","last_change":"2023-10-09T11:54:04.822182+0000","last_active":"2023-10-09T11:54:05.826394+0000","last_peered":"2023-10-09T11:54:05.826394+0000","last_clean":"2023-10-09T11:54:05.826394+0000","last_became_active":"2023-10-09T11:54:04.821788+0000","last_became_peered":"2023-10-09T11:54:04.821788+0000","last_unstale":"2023-10-09T11:54:05.826394+0000","last_undegraded":"2023-10-09T11:54:05.826394+0000","last_fullsized":"2023-10-09T11:54:05.826394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:50.063444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839635+0000","last_change":"2023-10-09T11:54:05.829241+0000","last_active":"2023-10-09T11:54:05.839635+0000","last_peered":"2023-10-09T11:54:05.839635+0000","last_clean":"2023-10-09T11:54:05.839635+0000","last_became_active":"2023-10-09T11:54:05.828988+0000","last_became_peered":"2023-10-09T11:54:05.828988+0000","last_unstale":"2023-10-09T11:54:05.839635+0000","last_undegraded":"2023-10-09T11:54:05.839635+0000","last_fullsized":"2023-10-09T11:54:05.839635+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:40.966425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.819386+0000","last_change":"2023-10-09T11:54:04.819962+0000","last_active":"2023-10-09T11:54:05.819386+0000","last_peered":"2023-10-09T11:54:05.819386+0000","last_clean":"2023-10-09T11:54:05.819386+0000","last_became_active":"2023-10-09T11:54:04.819667+0000","last_became_peered":"2023-10-09T11:54:04.819667+0000","last_unstale":"2023-10-09T11:54:05.819386+0000","last_undegraded":"2023-10-09T11:54:05.819386+0000","last_fullsized":"2023-10-09T11:54:05.819386+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:37.915131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839171+0000","last_change":"2023-10-09T11:54:05.835445+0000","last_active":"2023-10-09T11:54:05.839171+0000","last_peered":"2023-10-09T11:54:05.839171+0000","last_clean":"2023-10-09T11:54:05.839171+0000","last_became_active":"2023-10-09T11:54:05.835167+0000","last_became_peered":"2023-10-09T11:54:05.835167+0000","last_unstale":"2023-10-09T11:54:05.839171+0000","last_undegraded":"2023-10-09T11:54:05.839171+0000","last_fullsized":"2023-10-09T11:54:05.839171+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:05.486471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"62'8","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.859422+0000","last_change":"2023-10-09T11:54:04.826868+0000","last_active":"2023-10-09T11:54:05.859422+0000","last_peered":"2023-10-09T11:54:05.859422+0000","last_clean":"2023-10-09T11:54:05.859422+0000","last_became_active":"2023-10-09T11:54:04.826059+0000","last_became_peered":"2023-10-09T11:54:04.826059+0000","last_unstale":"2023-10-09T11:54:05.859422+0000","last_undegraded":"2023-10-09T11:54:05.859422+0000","last_fullsized":"2023-10-09T11:54:05.859422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:14.461878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.847858+0000","last_change":"2023-10-09T11:54:05.842701+0000","last_active":"2023-10-09T11:54:05.847858+0000","last_peered":"2023-10-09T11:54:05.847858+0000","last_clean":"2023-10-09T11:54:05.847858+0000","last_became_active":"2023-10-09T11:54:05.842370+0000","last_became_peered":"2023-10-09T11:54:05.842370+0000","last_unstale":"2023-10-09T11:54:05.847858+0000","last_undegraded":"2023-10-09T11:54:05.847858+0000","last_fullsized":"2023-10-09T11:54:05.847858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:47.926425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856164+0000","last_change":"2023-10-09T11:54:04.821833+0000","last_active":"2023-10-09T11:54:05.856164+0000","last_peered":"2023-10-09T11:54:05.856164+0000","last_clean":"2023-10-09T11:54:05.856164+0000","last_became_active":"2023-10-09T11:54:04.821533+0000","last_became_peered":"2023-10-09T11:54:04.821533+0000","last_unstale":"2023-10-09T11:54:05.856164+0000","last_undegraded":"2023-10-09T11:54:05.856164+0000","last_fullsized":"2023-10-09T11:54:05.856164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:53.174706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.829345+0000","last_change":"2023-10-09T11:54:05.826630+0000","last_active":"2023-10-09T11:54:05.829345+0000","last_peered":"2023-10-09T11:54:05.829345+0000","last_clean":"2023-10-09T11:54:05.829345+0000","last_became_active":"2023-10-09T11:54:05.826333+0000","last_became_peered":"2023-10-09T11:54:05.826333+0000","last_unstale":"2023-10-09T11:54:05.829345+0000","last_undegraded":"2023-10-09T11:54:05.829345+0000","last_fullsized":"2023-10-09T11:54:05.829345+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:35.113302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855766+0000","last_change":"2023-10-09T11:54:04.820592+0000","last_active":"2023-10-09T11:54:05.855766+0000","last_peered":"2023-10-09T11:54:05.855766+0000","last_clean":"2023-10-09T11:54:05.855766+0000","last_became_active":"2023-10-09T11:54:04.820277+0000","last_became_peered":"2023-10-09T11:54:04.820277+0000","last_unstale":"2023-10-09T11:54:05.855766+0000","last_undegraded":"2023-10-09T11:54:05.855766+0000","last_fullsized":"2023-10-09T11:54:05.855766+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:44.267357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.836056+0000","last_change":"2023-10-09T11:54:05.831187+0000","last_active":"2023-10-09T11:54:05.836056+0000","last_peered":"2023-10-09T11:54:05.836056+0000","last_clean":"2023-10-09T11:54:05.836056+0000","last_became_active":"2023-10-09T11:54:05.830652+0000","last_became_peered":"2023-10-09T11:54:05.830652+0000","last_unstale":"2023-10-09T11:54:05.836056+0000","last_undegraded":"2023-10-09T11:54:05.836056+0000","last_fullsized":"2023-10-09T11:54:05.836056+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:29.140818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855932+0000","last_change":"2023-10-09T11:54:04.824903+0000","last_active":"2023-10-09T11:54:05.855932+0000","last_peered":"2023-10-09T11:54:05.855932+0000","last_clean":"2023-10-09T11:54:05.855932+0000","last_became_active":"2023-10-09T11:54:04.824606+0000","last_became_peered":"2023-10-09T11:54:04.824606+0000","last_unstale":"2023-10-09T11:54:05.855932+0000","last_undegraded":"2023-10-09T11:54:05.855932+0000","last_fullsized":"2023-10-09T11:54:05.855932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:34.763690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856487+0000","last_change":"2023-10-09T11:54:05.853090+0000","last_active":"2023-10-09T11:54:05.856487+0000","last_peered":"2023-10-09T11:54:05.856487+0000","last_clean":"2023-10-09T11:54:05.856487+0000","last_became_active":"2023-10-09T11:54:05.852829+0000","last_became_peered":"2023-10-09T11:54:05.852829+0000","last_unstale":"2023-10-09T11:54:05.856487+0000","last_undegraded":"2023-10-09T11:54:05.856487+0000","last_fullsized":"2023-10-09T11:54:05.856487+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:33.053385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.819934+0000","last_change":"2023-10-09T11:54:04.827150+0000","last_active":"2023-10-09T11:54:05.819934+0000","last_peered":"2023-10-09T11:54:05.819934+0000","last_clean":"2023-10-09T11:54:05.819934+0000","last_became_active":"2023-10-09T11:54:04.826888+0000","last_became_peered":"2023-10-09T11:54:04.826888+0000","last_unstale":"2023-10-09T11:54:05.819934+0000","last_undegraded":"2023-10-09T11:54:05.819934+0000","last_fullsized":"2023-10-09T11:54:05.819934+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:02.727018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835932+0000","last_change":"2023-10-09T11:54:05.828185+0000","last_active":"2023-10-09T11:54:05.835932+0000","last_peered":"2023-10-09T11:54:05.835932+0000","last_clean":"2023-10-09T11:54:05.835932+0000","last_became_active":"2023-10-09T11:54:05.827929+0000","last_became_peered":"2023-10-09T11:54:05.827929+0000","last_unstale":"2023-10-09T11:54:05.835932+0000","last_undegraded":"2023-10-09T11:54:05.835932+0000","last_fullsized":"2023-10-09T11:54:05.835932+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:07.807187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856458+0000","last_change":"2023-10-09T11:54:04.823251+0000","last_active":"2023-10-09T11:54:05.856458+0000","last_peered":"2023-10-09T11:54:05.856458+0000","last_clean":"2023-10-09T11:54:05.856458+0000","last_became_active":"2023-10-09T11:54:04.822635+0000","last_became_peered":"2023-10-09T11:54:04.822635+0000","last_unstale":"2023-10-09T11:54:05.856458+0000","last_undegraded":"2023-10-09T11:54:05.856458+0000","last_fullsized":"2023-10-09T11:54:05.856458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:32:37.282444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.849887+0000","last_change":"2023-10-09T11:54:05.842523+0000","last_active":"2023-10-09T11:54:05.849887+0000","last_peered":"2023-10-09T11:54:05.849887+0000","last_clean":"2023-10-09T11:54:05.849887+0000","last_became_active":"2023-10-09T11:54:05.842236+0000","last_became_peered":"2023-10-09T11:54:05.842236+0000","last_unstale":"2023-10-09T11:54:05.849887+0000","last_undegraded":"2023-10-09T11:54:05.849887+0000","last_fullsized":"2023-10-09T11:54:05.849887+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:02.203016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.831327+0000","last_change":"2023-10-09T11:54:04.830526+0000","last_active":"2023-10-09T11:54:05.831327+0000","last_peered":"2023-10-09T11:54:05.831327+0000","last_clean":"2023-10-09T11:54:05.831327+0000","last_became_active":"2023-10-09T11:54:04.829709+0000","last_became_peered":"2023-10-09T11:54:04.829709+0000","last_unstale":"2023-10-09T11:54:05.831327+0000","last_undegraded":"2023-10-09T11:54:05.831327+0000","last_fullsized":"2023-10-09T11:54:05.831327+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:01.197044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.848156+0000","last_change":"2023-10-09T11:54:05.846301+0000","last_active":"2023-10-09T11:54:05.848156+0000","last_peered":"2023-10-09T11:54:05.848156+0000","last_clean":"2023-10-09T11:54:05.848156+0000","last_became_active":"2023-10-09T11:54:05.846046+0000","last_became_peered":"2023-10-09T11:54:05.846046+0000","last_unstale":"2023-10-09T11:54:05.848156+0000","last_undegraded":"2023-10-09T11:54:05.848156+0000","last_fullsized":"2023-10-09T11:54:05.848156+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:41.086003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.817901+0000","last_change":"2023-10-09T11:54:04.826120+0000","last_active":"2023-10-09T11:54:05.817901+0000","last_peered":"2023-10-09T11:54:05.817901+0000","last_clean":"2023-10-09T11:54:05.817901+0000","last_became_active":"2023-10-09T11:54:04.825856+0000","last_became_peered":"2023-10-09T11:54:04.825856+0000","last_unstale":"2023-10-09T11:54:05.817901+0000","last_undegraded":"2023-10-09T11:54:05.817901+0000","last_fullsized":"2023-10-09T11:54:05.817901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:28.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.846441+0000","last_change":"2023-10-09T11:54:05.835427+0000","last_active":"2023-10-09T11:54:05.846441+0000","last_peered":"2023-10-09T11:54:05.846441+0000","last_clean":"2023-10-09T11:54:05.846441+0000","last_became_active":"2023-10-09T11:54:05.835188+0000","last_became_peered":"2023-10-09T11:54:05.835188+0000","last_unstale":"2023-10-09T11:54:05.846441+0000","last_undegraded":"2023-10-09T11:54:05.846441+0000","last_fullsized":"2023-10-09T11:54:05.846441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:52.088129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826225+0000","last_change":"2023-10-09T11:54:04.822700+0000","last_active":"2023-10-09T11:54:05.826225+0000","last_peered":"2023-10-09T11:54:05.826225+0000","last_clean":"2023-10-09T11:54:05.826225+0000","last_became_active":"2023-10-09T11:54:04.822453+0000","last_became_peered":"2023-10-09T11:54:04.822453+0000","last_unstale":"2023-10-09T11:54:05.826225+0000","last_undegraded":"2023-10-09T11:54:05.826225+0000","last_fullsized":"2023-10-09T11:54:05.826225+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:26.162264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838842+0000","last_change":"2023-10-09T11:54:05.833272+0000","last_active":"2023-10-09T11:54:05.838842+0000","last_peered":"2023-10-09T11:54:05.838842+0000","last_clean":"2023-10-09T11:54:05.838842+0000","last_became_active":"2023-10-09T11:54:05.832930+0000","last_became_peered":"2023-10-09T11:54:05.832930+0000","last_unstale":"2023-10-09T11:54:05.838842+0000","last_undegraded":"2023-10-09T11:54:05.838842+0000","last_fullsized":"2023-10-09T11:54:05.838842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:55.542811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-09T11:54:08.828515+0000","last_change":"2023-10-09T11:54:04.820249+0000","last_active":"2023-10-09T11:54:08.828515+0000","last_peered":"2023-10-09T11:54:08.828515+0000","last_clean":"2023-10-09T11:54:08.828515+0000","last_became_active":"2023-10-09T11:54:04.820019+0000","last_became_peered":"2023-10-09T11:54:04.820019+0000","last_unstale":"2023-10-09T11:54:08.828515+0000","last_undegraded":"2023-10-09T11:54:08.828515+0000","last_fullsized":"2023-10-09T11:54:08.828515+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:59.661173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.831048+0000","last_change":"2023-10-09T11:54:05.829676+0000","last_active":"2023-10-09T11:54:05.831048+0000","last_peered":"2023-10-09T11:54:05.831048+0000","last_clean":"2023-10-09T11:54:05.831048+0000","last_became_active":"2023-10-09T11:54:05.829355+0000","last_became_peered":"2023-10-09T11:54:05.829355+0000","last_unstale":"2023-10-09T11:54:05.831048+0000","last_undegraded":"2023-10-09T11:54:05.831048+0000","last_fullsized":"2023-10-09T11:54:05.831048+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:13.314695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826271+0000","last_change":"2023-10-09T11:54:04.830055+0000","last_active":"2023-10-09T11:54:05.826271+0000","last_peered":"2023-10-09T11:54:05.826271+0000","last_clean":"2023-10-09T11:54:05.826271+0000","last_became_active":"2023-10-09T11:54:04.829775+0000","last_became_peered":"2023-10-09T11:54:04.829775+0000","last_unstale":"2023-10-09T11:54:05.826271+0000","last_undegraded":"2023-10-09T11:54:05.826271+0000","last_fullsized":"2023-10-09T11:54:05.826271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:54.536840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.839079+0000","last_change":"2023-10-09T11:54:05.836364+0000","last_active":"2023-10-09T11:54:05.839079+0000","last_peered":"2023-10-09T11:54:05.839079+0000","last_clean":"2023-10-09T11:54:05.839079+0000","last_became_active":"2023-10-09T11:54:05.836020+0000","last_became_peered":"2023-10-09T11:54:05.836020+0000","last_unstale":"2023-10-09T11:54:05.839079+0000","last_undegraded":"2023-10-09T11:54:05.839079+0000","last_fullsized":"2023-10-09T11:54:05.839079+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:25.181391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.825451+0000","last_change":"2023-10-09T11:54:04.825097+0000","last_active":"2023-10-09T11:54:05.825451+0000","last_peered":"2023-10-09T11:54:05.825451+0000","last_clean":"2023-10-09T11:54:05.825451+0000","last_became_active":"2023-10-09T11:54:04.824856+0000","last_became_peered":"2023-10-09T11:54:04.824856+0000","last_unstale":"2023-10-09T11:54:05.825451+0000","last_undegraded":"2023-10-09T11:54:05.825451+0000","last_fullsized":"2023-10-09T11:54:05.825451+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:07.207663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.853219+0000","last_change":"2023-10-09T11:54:05.836917+0000","last_active":"2023-10-09T11:54:05.853219+0000","last_peered":"2023-10-09T11:54:05.853219+0000","last_clean":"2023-10-09T11:54:05.853219+0000","last_became_active":"2023-10-09T11:54:05.836669+0000","last_became_peered":"2023-10-09T11:54:05.836669+0000","last_unstale":"2023-10-09T11:54:05.853219+0000","last_undegraded":"2023-10-09T11:54:05.853219+0000","last_fullsized":"2023-10-09T11:54:05.853219+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:23.916906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.828183+0000","last_change":"2023-10-09T11:54:04.830449+0000","last_active":"2023-10-09T11:54:05.828183+0000","last_peered":"2023-10-09T11:54:05.828183+0000","last_clean":"2023-10-09T11:54:05.828183+0000","last_became_active":"2023-10-09T11:54:04.829980+0000","last_became_peered":"2023-10-09T11:54:04.829980+0000","last_unstale":"2023-10-09T11:54:05.828183+0000","last_undegraded":"2023-10-09T11:54:05.828183+0000","last_fullsized":"2023-10-09T11:54:05.828183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:30.636945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.838194+0000","last_change":"2023-10-09T11:54:05.829928+0000","last_active":"2023-10-09T11:54:05.838194+0000","last_peered":"2023-10-09T11:54:05.838194+0000","last_clean":"2023-10-09T11:54:05.838194+0000","last_became_active":"2023-10-09T11:54:05.829619+0000","last_became_peered":"2023-10-09T11:54:05.829619+0000","last_unstale":"2023-10-09T11:54:05.838194+0000","last_undegraded":"2023-10-09T11:54:05.838194+0000","last_fullsized":"2023-10-09T11:54:05.838194+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:30.429980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.820412+0000","last_change":"2023-10-09T11:54:04.825951+0000","last_active":"2023-10-09T11:54:05.820412+0000","last_peered":"2023-10-09T11:54:05.820412+0000","last_clean":"2023-10-09T11:54:05.820412+0000","last_became_active":"2023-10-09T11:54:04.825689+0000","last_became_peered":"2023-10-09T11:54:04.825689+0000","last_unstale":"2023-10-09T11:54:05.820412+0000","last_undegraded":"2023-10-09T11:54:05.820412+0000","last_fullsized":"2023-10-09T11:54:05.820412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:44.366168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.855814+0000","last_change":"2023-10-09T11:54:05.852980+0000","last_active":"2023-10-09T11:54:05.855814+0000","last_peered":"2023-10-09T11:54:05.855814+0000","last_clean":"2023-10-09T11:54:05.855814+0000","last_became_active":"2023-10-09T11:54:05.852668+0000","last_became_peered":"2023-10-09T11:54:05.852668+0000","last_unstale":"2023-10-09T11:54:05.855814+0000","last_undegraded":"2023-10-09T11:54:05.855814+0000","last_fullsized":"2023-10-09T11:54:05.855814+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:08.358204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.830185+0000","last_change":"2023-10-09T11:54:04.827713+0000","last_active":"2023-10-09T11:54:05.830185+0000","last_peered":"2023-10-09T11:54:05.830185+0000","last_clean":"2023-10-09T11:54:05.830185+0000","last_became_active":"2023-10-09T11:54:04.827316+0000","last_became_peered":"2023-10-09T11:54:04.827316+0000","last_unstale":"2023-10-09T11:54:05.830185+0000","last_undegraded":"2023-10-09T11:54:05.830185+0000","last_fullsized":"2023-10-09T11:54:05.830185+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:12.967027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.841581+0000","last_change":"2023-10-09T11:54:05.838113+0000","last_active":"2023-10-09T11:54:05.841581+0000","last_peered":"2023-10-09T11:54:05.841581+0000","last_clean":"2023-10-09T11:54:05.841581+0000","last_became_active":"2023-10-09T11:54:05.837071+0000","last_became_peered":"2023-10-09T11:54:05.837071+0000","last_unstale":"2023-10-09T11:54:05.841581+0000","last_undegraded":"2023-10-09T11:54:05.841581+0000","last_fullsized":"2023-10-09T11:54:05.841581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:06:35.769662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.817849+0000","last_change":"2023-10-09T11:54:04.827046+0000","last_active":"2023-10-09T11:54:05.817849+0000","last_peered":"2023-10-09T11:54:05.817849+0000","last_clean":"2023-10-09T11:54:05.817849+0000","last_became_active":"2023-10-09T11:54:04.826423+0000","last_became_peered":"2023-10-09T11:54:04.826423+0000","last_unstale":"2023-10-09T11:54:05.817849+0000","last_undegraded":"2023-10-09T11:54:05.817849+0000","last_fullsized":"2023-10-09T11:54:05.817849+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:52.670983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.835890+0000","last_change":"2023-10-09T11:54:05.834338+0000","last_active":"2023-10-09T11:54:05.835890+0000","last_peered":"2023-10-09T11:54:05.835890+0000","last_clean":"2023-10-09T11:54:05.835890+0000","last_became_active":"2023-10-09T11:54:05.834054+0000","last_became_peered":"2023-10-09T11:54:05.834054+0000","last_unstale":"2023-10-09T11:54:05.835890+0000","last_undegraded":"2023-10-09T11:54:05.835890+0000","last_fullsized":"2023-10-09T11:54:05.835890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:04.798659+0000","last_clean_scrub_stamp":"2023-10-09T11:54:04.798659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:18.758117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.856227+0000","last_change":"2023-10-09T11:54:04.824210+0000","last_active":"2023-10-09T11:54:05.856227+0000","last_peered":"2023-10-09T11:54:05.856227+0000","last_clean":"2023-10-09T11:54:05.856227+0000","last_became_active":"2023-10-09T11:54:04.823578+0000","last_became_peered":"2023-10-09T11:54:04.823578+0000","last_unstale":"2023-10-09T11:54:05.856227+0000","last_undegraded":"2023-10-09T11:54:05.856227+0000","last_fullsized":"2023-10-09T11:54:05.856227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:54:03.792688+0000","last_clean_scrub_stamp":"2023-10-09T11:54:03.792688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:31.725573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"52'139","reported_seq":277,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T11:54:05.826322+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:54:05.826322+0000","last_peered":"2023-10-09T11:54:05.826322+0000","last_clean":"2023-10-09T11:54:05.826322+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:54:05.826322+0000","last_undegraded":"2023-10-09T11:54:05.826322+0000","last_fullsized":"2023-10-09T11:54:05.826322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":933548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.67100000000000004},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.373},"max":{"1min":0.873,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73499999999999999,"15min":0.70499999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93400000000000005,"5min":1.014,"15min":1.0349999999999999},"last":0.82399999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72299999999999998,"15min":0.69599999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.44600000000000001},"max":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":1.1599999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.048,"15min":1.202},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76100000000000001,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.92500000000000004,"5min":1.073,"15min":1.073},"last":0.755}]},{"osd":4,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.73999999999999999,"5min":0.91000000000000003,"15min":0.94099999999999995},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.96199999999999997},"last":0.78100000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.745,"15min":0.751},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.048},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":0.79600000000000004,"5min":0.95699999999999996,"15min":1.0620000000000001},"last":0.81299999999999994}]}]},{"osd":6,"up_from":16,"seq":68719476897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":745472,"data_stored":343734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73399999999999999},"min":{"1min":0.51000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.748,"15min":0.751},"min":{"1min":0.59699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":0.95599999999999996,"15min":1.121},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.60699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.95099999999999996,"5min":0.98399999999999999,"15min":1.216},"last":0.65800000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.439},"max":{"1min":1.008,"5min":1.008,"15min":1.139},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.47299999999999998},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.431},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.502},"max":{"1min":0.91900000000000004,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.244},"last":0.64200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.92600000000000005,"15min":1.613},"last":0.75},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64300000000000002,"15min":0.68100000000000005},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.64300000000000002},"min":{"1min":0.436,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.94899999999999995,"15min":1.143},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67300000000000004,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.2410000000000001},"last":0.54100000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.495,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":0.94799999999999995,"5min":0.96599999999999997,"15min":1.506},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.56299999999999994}]}]},{"osd":1,"up_from":15,"seq":64424509601,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":343160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.317},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":1.6759999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.30499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.385},"last":0.498},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.374,"15min":0.318},"max":{"1min":0.77800000000000002,"5min":0.83199999999999996,"15min":1.099},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64800000000000002,"5min":0.80000000000000004,"15min":1.536},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.746,"15min":1.272},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.82899999999999996,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.48899999999999999},"max":{"1min":1.115,"5min":1.1479999999999999,"15min":1.7210000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.56799999999999995,"15min":0.46899999999999997},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.70799999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.181,"15min":1.677},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.81699999999999995},"min":{"1min":0.60099999999999998,"5min":0.59099999999999997,"15min":0.55300000000000005},"max":{"1min":1.0669999999999999,"5min":1.135,"15min":1.778},"last":0.61199999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.64200000000000002,"5min":0.60099999999999998,"15min":0.51100000000000001},"max":{"1min":1.0760000000000001,"5min":1.2430000000000001,"15min":1.623},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82899999999999996},"min":{"1min":0.65200000000000002,"5min":0.61699999999999999,"15min":0.50700000000000001},"max":{"1min":1.02,"5min":1.274,"15min":1.708},"last":0.47099999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:53:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.84099999999999997},"min":{"1min":0.65000000000000002,"5min":0.62,"15min":0.52900000000000003},"max":{"1min":1.032,"5min":1.2130000000000001,"15min":1.659},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.0880000000000001,"5min":1.194,"15min":1.736},"last":0.55900000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542304,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":933492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47599999999999998,"15min":0.48499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57199999999999995,"5min":0.753,"15min":1.367},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68700000000000006,"5min":0.85599999999999998,"15min":1.4930000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28199999999999997},"max":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":1.8340000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.83499999999999996,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.47899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":1.855},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.752,"5min":0.84799999999999998,"15min":1.2330000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0449999999999999,"5min":1.169,"15min":1.254},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47199999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.099},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48099999999999998},"max":{"1min":1.129,"5min":1.1890000000000001,"15min":1.2},"last":0.77400000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.57899999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.028,"5min":1.169,"15min":1.321},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52500000000000002},"max":{"1min":1.0609999999999999,"5min":1.1299999999999999,"15min":1.24},"last":0.876},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.2849999999999999},"last":0.81200000000000006}]}]},{"osd":2,"up_from":14,"seq":60129542304,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306216,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065624,"statfs":{"total":96636764160,"available":96323198976,"internally_reserved":0,"allocated":753664,"data_stored":344648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:22 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47199999999999998,"15min":0.46000000000000002},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.441},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.66500000000000004,"5min":0.755,"15min":0.83799999999999997},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":0.81100000000000005,"15min":0.97299999999999998},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.32200000000000001},"max":{"1min":0.65900000000000003,"5min":0.81200000000000006,"15min":0.88800000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81699999999999995,"15min":0.79700000000000004},"min":{"1min":0.59999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.79700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.50700000000000001},"max":{"1min":1.0309999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0029999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82399999999999995,"15min":0.81299999999999994},"min":{"1min":0.68700000000000006,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83699999999999997,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.71499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.61499999999999999,"15min":0.53900000000000003},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.036},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84999999999999998,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.56299999999999994},"max":{"1min":1.0569999999999999,"5min":1.204,"15min":1.27},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:53:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.66200000000000003,"5min":0.621,"15min":0.53100000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.246},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.67900000000000005,"5min":0.63400000000000001,"15min":0.57299999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.2130000000000001},"last":0.73499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509601,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":749568,"data_stored":343700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.34699999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.70999999999999996,"15min":1.208},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.29599999999999999,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":1.1970000000000001},"last":0.42099999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":1.0229999999999999},"last":0.371},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.311},"max":{"1min":0.624,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.55100000000000005},"min":{"1min":0.46600000000000003,"5min":0.42799999999999999,"15min":0.36099999999999999},"max":{"1min":0.65700000000000003,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":0.75900000000000001,"15min":0.86699999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.65000000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.327},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.70599999999999996,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.141,"5min":1.141,"15min":1.2689999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":1.109,"5min":1.109,"15min":1.2829999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.66800000000000004,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.3660000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.50700000000000001,"15min":0.47999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.1459999999999999,"15min":1.218},"last":0.77600000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.46999999999999997},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.333},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.54700000000000004},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.3560000000000001},"last":0.76100000000000001}]}]},{"osd":4,"up_from":16,"seq":68719476896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310308,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061532,"statfs":{"total":96636764160,"available":96319008768,"internally_reserved":0,"allocated":749568,"data_stored":344626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":1.071},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.39100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.497,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94499999999999995,"5min":0.95099999999999996,"15min":1.2569999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.94299999999999995,"5min":1.05,"15min":1.2909999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74299999999999999,"15min":0.73199999999999998},"min":{"1min":0.60499999999999998,"5min":0.54900000000000004,"15min":0.45400000000000001},"max":{"1min":0.90800000000000003,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.755},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90800000000000003,"5min":0.995,"15min":1.234},"last":0.70599999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.432},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.94699999999999995,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91700000000000004,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.65000000000000002},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.621}]},{"osd":6,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.125},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.82599999999999996,"5min":0.91900000000000004,"15min":1.373},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:53:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.82199999999999995,"5min":0.92900000000000005,"15min":1.2410000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.74399999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.997,"5min":1.1200000000000001,"15min":1.222},"last":0.66900000000000004}]}]},{"osd":5,"up_from":16,"seq":68719476896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":343160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.1180000000000001,"15min":1.48},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.71199999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.318},"max":{"1min":0.877,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.41199999999999998},"max":{"1min":0.88500000000000001,"5min":0.95299999999999996,"15min":1.0840000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.47799999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":1.21},"last":0.81899999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.0389999999999999},"last":0.753},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72799999999999998,"15min":0.70099999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.90300000000000002,"5min":0.98999999999999999,"15min":1.0920000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.45900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.363},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91800000000000004,"5min":1.0029999999999999,"15min":1.508},"last":0.78500000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.40300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77500000000000002,"5min":1.018,"15min":1.018},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61399999999999999,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68799999999999994,"5min":0.998,"15min":1.321},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64800000000000002,"15min":0.66900000000000004},"min":{"1min":0.45800000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80600000000000005,"5min":0.98299999999999998,"15min":1.0269999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.49199999999999999,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":1.016,"15min":1.0669999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86199999999999999,"5min":1.0129999999999999,"15min":3.3620000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69199999999999995,"15min":0.755},"min":{"1min":0.51400000000000001,"5min":0.441,"15min":0.39900000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":3.3149999999999999},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:54:15.844 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:54:15.844 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:54:16.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.065+0000 7f4349bff700 1 Processor -- start 2023-10-09T11:54:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.065+0000 7f4349bff700 1 -- start start 2023-10-09T11:54:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.066+0000 7f4349bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4344069fa0 0x7f434406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.066+0000 7f4349bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 0x7f43440c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.066+0000 7f4349bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4344156340 con 0x7f43440c85c0 2023-10-09T11:54:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f4349bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440c8990 con 0x7f4344069fa0 2023-10-09T11:54:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f4349bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434406ee20 con 0x7f4344156ee0 2023-10-09T11:54:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43437fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f43440c85c0 0x7f4344069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39076/0 (socket says 172.21.15.86:39076) 2023-10-09T11:54:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43437fe700 1 -- 172.21.15.86:0/1625327261 learned_addr learned my addr 172.21.15.86:0/1625327261 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:16.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844870303 0 0) 0x7f4344156340 con 0x7f43440c85c0 2023-10-09T11:54:16.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f432c003570 con 0x7f43440c85c0 2023-10-09T11:54:16.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f4342ffd700 1 --2- 172.21.15.86:0/1625327261 >> v2:172.21.15.135:3300/0 conn(0x7f4344069fa0 0x7f434406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f4343fff700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 0x7f43440c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59551946 0 0) 0x7f432c003570 con 0x7f43440c85c0 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 msgr2=0x7f43440c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 0x7f43440c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 >> v2:172.21.15.135:3300/0 conn(0x7f4344069fa0 msgr2=0x7f434406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 --2- 172.21.15.86:0/1625327261 >> v2:172.21.15.135:3300/0 conn(0x7f4344069fa0 0x7f434406d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.067+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434406dd80 con 0x7f43440c85c0 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f4334001470 con 0x7f43440c85c0 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 >> v1:172.21.15.86:6789/0 conn(0x7f43440c85c0 legacy=0x7f4344069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 0x7f432c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f432c003fe0 0x7f432c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f432c004d50 0x7f432c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440c8990 con 0x7f432c003fe0 2023-10-09T11:54:16.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434406ee20 con 0x7f432c004d50 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c00ba90 con 0x7f4344156ee0 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f4342ffd700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f432c003fe0 0x7f432c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f43437fe700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 0x7f432c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f4343fff700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f432c004d50 0x7f432c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f4342ffd700 1 -- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 msgr2=0x7f432c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f4342ffd700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4344156ee0 0x7f432c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f4342ffd700 1 -- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f432c004d50 msgr2=0x7f432c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f4342ffd700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f432c004d50 0x7f432c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.068+0000 7f4342ffd700 1 -- 172.21.15.86:0/1625327261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c003570 con 0x7f432c003fe0 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f4342ffd700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f432c003fe0 0x7f432c004810 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f434406a3a0 tx=0x7f43380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493d5e3e92f88b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800e6b0 con 0x7f432c003fe0 2023-10-09T11:54:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433800e810 con 0x7f432c003fe0 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f43427fc700 1 -- 172.21.15.86:0/1625327261 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800ebd0 con 0x7f432c003fe0 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f4349bff700 1 -- 172.21.15.86:0/1625327261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f432c003fe0 msgr2=0x7f432c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f4349bff700 1 --2- 172.21.15.86:0/1625327261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f432c003fe0 0x7f432c004810 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f434406a3a0 tx=0x7f43380091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f4343fff700 1 -- 172.21.15.86:0/1625327261 reap_dead start 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f4349bff700 1 -- 172.21.15.86:0/1625327261 shutdown_connections 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.069+0000 7f4349bff700 1 -- 172.21.15.86:0/1625327261 >> 172.21.15.86:0/1625327261 conn(0x7f43440cc540 msgr2=0x7f43440cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.070+0000 7f4349bff700 1 -- 172.21.15.86:0/1625327261 shutdown_connections 2023-10-09T11:54:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.070+0000 7f4349bff700 1 -- 172.21.15.86:0/1625327261 wait complete. 2023-10-09T11:54:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.071+0000 7f4349bff700 1 Processor -- start 2023-10-09T11:54:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.071+0000 7f4349bff700 1 -- start start 2023-10-09T11:54:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4349bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f432c003fe0 0x7f43440b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4349bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43440b0040 0x7f4344155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4349bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43440a86f0 0x7f43440c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4349bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440a6280 con 0x7f43440b0040 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4349bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440a5670 con 0x7f43440a86f0 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4349bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43440a5950 con 0x7f432c003fe0 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4342ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43440b0040 0x7f4344155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4342ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43440b0040 0x7f4344155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44478/0 (socket says 172.21.15.86:44478) 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4342ffd700 1 -- 172.21.15.86:0/2548298441 learned_addr learned my addr 172.21.15.86:0/2548298441 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f4343fff700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43440a86f0 0x7f43440c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.072+0000 7f43437fe700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f432c003fe0 0x7f43440b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4342ffd700 1 -- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f432c003fe0 msgr2=0x7f43440b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4342ffd700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f432c003fe0 0x7f43440b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4342ffd700 1 -- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43440a86f0 msgr2=0x7f43440c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4342ffd700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43440a86f0 0x7f43440c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4342ffd700 1 -- 172.21.15.86:0/2548298441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440a5c30 con 0x7f43440b0040 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4342ffd700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43440b0040 0x7f4344155630 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f432c004730 tx=0x7f433801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f432b7fe700 1 -- 172.21.15.86:0/2548298441 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338022070 con 0x7f43440b0040 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f432b7fe700 1 -- 172.21.15.86:0/2548298441 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433800e980 con 0x7f43440b0040 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f432b7fe700 1 -- 172.21.15.86:0/2548298441 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800e6b0 con 0x7f43440b0040 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43440a5f10 con 0x7f43440b0040 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.073+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4344155b70 con 0x7f43440b0040 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.075+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43440a63f0 con 0x7f43440b0040 2023-10-09T11:54:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.075+0000 7f432b7fe700 1 -- 172.21.15.86:0/2548298441 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4338027680 con 0x7f43440b0040 2023-10-09T11:54:16.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.076+0000 7f432b7fe700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.076+0000 7f432b7fe700 1 -- 172.21.15.86:0/2548298441 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f4338085ff0 con 0x7f43440b0040 2023-10-09T11:54:16.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.076+0000 7f43437fe700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.077+0000 7f43437fe700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4330066f30 0x7f43300693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4334001620 tx=0x7f4334001e90 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:16.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.080+0000 7f432b7fe700 1 -- 172.21.15.86:0/2548298441 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43380b75a0 con 0x7f43440b0040 2023-10-09T11:54:16.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.346+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f43440718b0 con 0x7f43440b0040 2023-10-09T11:54:16.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.350+0000 7f432b7fe700 1 -- 172.21.15.86:0/2548298441 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f433802c0e0 con 0x7f43440b0040 2023-10-09T11:54:16.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.352+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4330066f30 msgr2=0x7f43300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.352+0000 7f4349bff700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4330066f30 0x7f43300693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4334001620 tx=0x7f4334001e90 comp rx=0 tx=0).stop 2023-10-09T11:54:16.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43440b0040 msgr2=0x7f4344155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43440b0040 0x7f4344155630 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f432c004730 tx=0x7f433801a000 comp rx=0 tx=0).stop 2023-10-09T11:54:16.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 shutdown_connections 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43440a86f0 0x7f43440c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f432c003fe0 0x7f43440b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 --2- 172.21.15.86:0/2548298441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43440b0040 0x7f4344155630 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 >> 172.21.15.86:0/2548298441 conn(0x7f43440cc540 msgr2=0x7f43440ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 shutdown_connections 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.353+0000 7f4349bff700 1 -- 172.21.15.86:0/2548298441 wait complete. 2023-10-09T11:54:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T11:54:16.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:54:16.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.550+0000 7f61bf5ff700 1 Processor -- start 2023-10-09T11:54:16.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.550+0000 7f61bf5ff700 1 -- start start 2023-10-09T11:54:16.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.551+0000 7f61bf5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f61b8159890 0x7f61b815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.551+0000 7f61bf5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b8159c60 0x7f61b815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.551+0000 7f61bf5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b815a160 con 0x7f61b815db10 2023-10-09T11:54:16.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.551+0000 7f61bf5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b80d13a0 con 0x7f61b8159890 2023-10-09T11:54:16.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.551+0000 7f61bf5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b815e140 con 0x7f61b8159c60 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bd39b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f61b8159890 0x7f61b815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bcb9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b8159c60 0x7f61b815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bcb9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b8159c60 0x7f61b815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:45712/0 (socket says 172.21.15.86:45712) 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bcb9a700 1 -- 172.21.15.86:0/138833658 learned_addr learned my addr 172.21.15.86:0/138833658 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bcb9a700 1 -- 172.21.15.86:0/138833658 >> v2:172.21.15.135:3300/0 conn(0x7f61b8159890 msgr2=0x7f61b815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bcb9a700 1 --2- 172.21.15.86:0/138833658 >> v2:172.21.15.135:3300/0 conn(0x7f61b8159890 0x7f61b815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bcb9a700 1 -- 172.21.15.86:0/138833658 >> v1:172.21.15.135:6789/0 conn(0x7f61b815db10 legacy=0x7f61b8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bcb9a700 1 -- 172.21.15.86:0/138833658 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b815a3d0 con 0x7f61b8159c60 2023-10-09T11:54:16.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.552+0000 7f61bd39b700 1 --2- 172.21.15.86:0/138833658 >> v2:172.21.15.135:3300/0 conn(0x7f61b8159890 0x7f61b815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61bcb9a700 1 --2- 172.21.15.86:0/138833658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b8159c60 0x7f61b815d5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61a80099b0 tx=0x7f61a8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2427ac01407ce3ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61affff700 1 -- 172.21.15.86:0/138833658 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a8009ea0 con 0x7f61b8159c60 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61affff700 1 -- 172.21.15.86:0/138833658 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800b860 con 0x7f61b8159c60 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61affff700 1 -- 172.21.15.86:0/138833658 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800bc00 con 0x7f61b8159c60 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61bf5ff700 1 -- 172.21.15.86:0/138833658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b8159c60 msgr2=0x7f61b815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/138833658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b8159c60 0x7f61b815d5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61a80099b0 tx=0x7f61a8009250 comp rx=0 tx=0).stop 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61bf5ff700 1 -- 172.21.15.86:0/138833658 shutdown_connections 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/138833658 >> v2:172.21.15.135:3300/0 conn(0x7f61b8159890 0x7f61b815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/138833658 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b8159c60 0x7f61b815d5d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.553+0000 7f61bf5ff700 1 -- 172.21.15.86:0/138833658 >> 172.21.15.86:0/138833658 conn(0x7f61b8068e20 msgr2=0x7f61b80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:16.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.554+0000 7f61bf5ff700 1 -- 172.21.15.86:0/138833658 shutdown_connections 2023-10-09T11:54:16.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.554+0000 7f61bf5ff700 1 -- 172.21.15.86:0/138833658 wait complete. 2023-10-09T11:54:16.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.555+0000 7f61bf5ff700 1 Processor -- start 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.555+0000 7f61bf5ff700 1 -- start start 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bf5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b8159890 0x7f61b80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bf5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b8159c60 0x7f61b8148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bf5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b815db10 0x7f61b815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bf5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b81498a0 con 0x7f61b8159c60 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bf5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80b3590 con 0x7f61b8159890 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bf5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b80cf520 con 0x7f61b815db10 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bcb9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b8159c60 0x7f61b8148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bcb9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b8159c60 0x7f61b8148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44488/0 (socket says 172.21.15.86:44488) 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bcb9a700 1 -- 172.21.15.86:0/2424508465 learned_addr learned my addr 172.21.15.86:0/2424508465 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bd39b700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b8159890 0x7f61b80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bdb9c700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b815db10 0x7f61b815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bcb9a700 1 -- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b815db10 msgr2=0x7f61b815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.556+0000 7f61bcb9a700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b815db10 0x7f61b815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61bcb9a700 1 -- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b8159890 msgr2=0x7f61b80cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61bcb9a700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b8159890 0x7f61b80cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61bcb9a700 1 -- 172.21.15.86:0/2424508465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009420 con 0x7f61b8159c60 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61bcb9a700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b8159c60 0x7f61b8148c20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:16.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61ad7fa700 1 -- 172.21.15.86:0/2424508465 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800bbe0 con 0x7f61b8159c60 2023-10-09T11:54:16.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61ad7fa700 1 -- 172.21.15.86:0/2424508465 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a8011420 con 0x7f61b8159c60 2023-10-09T11:54:16.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61ad7fa700 1 -- 172.21.15.86:0/2424508465 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80117c0 con 0x7f61b8159c60 2023-10-09T11:54:16.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a80094f0 con 0x7f61b8159c60 2023-10-09T11:54:16.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.557+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b816a320 con 0x7f61b8159c60 2023-10-09T11:54:16.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.558+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b80b3740 con 0x7f61b8159c60 2023-10-09T11:54:16.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.559+0000 7f61ad7fa700 1 -- 172.21.15.86:0/2424508465 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61a8011bf0 con 0x7f61b8159c60 2023-10-09T11:54:16.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.560+0000 7f61ad7fa700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f619c066f30 0x7f619c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:16.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.560+0000 7f61ad7fa700 1 -- 172.21.15.86:0/2424508465 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f61a8086040 con 0x7f61b8159c60 2023-10-09T11:54:16.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.560+0000 7f61bd39b700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f619c066f30 0x7f619c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:16.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.560+0000 7f61bd39b700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f619c066f30 0x7f619c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61b40093f0 tx=0x7f61b4008040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.564+0000 7f61ad7fa700 1 -- 172.21.15.86:0/2424508465 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61b80b3740 con 0x7f61b8159c60 2023-10-09T11:54:16.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.799+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61b80b3740 con 0x7f61b8159c60 2023-10-09T11:54:16.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.800+0000 7f61ad7fa700 1 -- 172.21.15.86:0/2424508465 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f61b80b3740 con 0x7f61b8159c60 2023-10-09T11:54:16.800 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:16.801 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/569752766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":569752766},{"type":"v1","addr":"172.21.15.135:6834","nonce":569752766}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/312603704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":312603704},{"type":"v1","addr":"172.21.15.135:6835","nonce":312603704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/4036553983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":4036553983},{"type":"v1","addr":"172.21.15.86:6833","nonce":4036553983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:54:05.279420+0000","modified":"2023-10-09T11:54:09.221890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6836/3777239940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3777239940},{"type":"v1","addr":"172.21.15.86:6836","nonce":3777239940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f619c066f30 msgr2=0x7f619c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f619c066f30 0x7f619c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61b40093f0 tx=0x7f61b4008040 comp rx=0 tx=0).stop 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b8159c60 msgr2=0x7f61b8148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b8159c60 0x7f61b8148c20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8017000 comp rx=0 tx=0).stop 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 shutdown_connections 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61b815db10 0x7f61b815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61b8159890 0x7f61b80cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f619c066f30 0x7f619c0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 --2- 172.21.15.86:0/2424508465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b8159c60 0x7f61b8148c20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 >> 172.21.15.86:0/2424508465 conn(0x7f61b8068e20 msgr2=0x7f61b814a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:16.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.802+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 shutdown_connections 2023-10-09T11:54:16.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:16.803+0000 7f61bf5ff700 1 -- 172.21.15.86:0/2424508465 wait complete. 2023-10-09T11:54:16.804 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2023-10-09T11:54:17.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:54:05.279420+0000', 'modified': '2023-10-09T11:54:09.221890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5724}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5724': {'gid': 5724, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6836/3777239940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 3777239940}, {'type': 'v1', 'addr': '172.21.15.86:6836', 'nonce': 3777239940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:54:17.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:54:17.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:54:17.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.406+0000 7f66fafff700 1 Processor -- start 2023-10-09T11:54:17.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.406+0000 7f66fafff700 1 -- start start 2023-10-09T11:54:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66fafff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66f40b1420 0x7f66f40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66fafff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f40cc300 con 0x7f66f40cbf30 2023-10-09T11:54:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66fafff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f40ad370 con 0x7f66f40ccf90 2023-10-09T11:54:17.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66fafff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f4156bf0 con 0x7f66f40b1420 2023-10-09T11:54:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66f8d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f66f40cbf30 0x7f66f40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39080/0 (socket says 172.21.15.86:39080) 2023-10-09T11:54:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66f8d9b700 1 -- 172.21.15.86:0/1088786848 learned_addr learned my addr 172.21.15.86:0/1088786848 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66f3fff700 1 --2- 172.21.15.86:0/1088786848 >> v2:172.21.15.135:3300/0 conn(0x7f66f40b1420 0x7f66f40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248716321 0 0) 0x7f66f40cc300 con 0x7f66f40cbf30 2023-10-09T11:54:17.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e4003570 con 0x7f66f40cbf30 2023-10-09T11:54:17.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.408+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14155424 0 0) 0x7f66e4003570 con 0x7f66f40cbf30 2023-10-09T11:54:17.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 >> v2:172.21.15.135:3300/0 conn(0x7f66f40b1420 msgr2=0x7f66f40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 --2- 172.21.15.86:0/1088786848 >> v2:172.21.15.135:3300/0 conn(0x7f66f40b1420 0x7f66f40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 >> v1:172.21.15.135:6789/0 conn(0x7f66f40ccf90 legacy=0x7f66f40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40ad650 con 0x7f66f40cbf30 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f66e8001470 con 0x7f66f40cbf30 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 >> v1:172.21.15.86:6789/0 conn(0x7f66f40cbf30 legacy=0x7f66f40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66e4003ab0 0x7f66e4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4004810 0x7f66e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66e4005210 0x7f66e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4156bf0 con 0x7f66e4003ab0 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e400c130 con 0x7f66e4004810 2023-10-09T11:54:17.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e400c2f0 con 0x7f66e4005210 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66e4003ab0 0x7f66e4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f3fff700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4004810 0x7f66e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f959c700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66e4005210 0x7f66e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f8d9b700 1 -- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66e4005210 msgr2=0x7f66e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66e4005210 0x7f66e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f8d9b700 1 -- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4004810 msgr2=0x7f66e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4004810 0x7f66e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f8d9b700 1 -- 172.21.15.86:0/1088786848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4003570 con 0x7f66e4003ab0 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.409+0000 7f66f959c700 1 -- 172.21.15.86:0/1088786848 reap_dead start 2023-10-09T11:54:17.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66e4003ab0 0x7f66e4003ec0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c2d0 tx=0x7f66e8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae7a2aeef36497d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e800cba0 con 0x7f66e4003ab0 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e800cd20 con 0x7f66e4003ab0 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66f37fe700 1 -- 172.21.15.86:0/1088786848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8005b70 con 0x7f66e4003ab0 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66fafff700 1 -- 172.21.15.86:0/1088786848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66e4003ab0 msgr2=0x7f66e4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66fafff700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66e4003ab0 0x7f66e4003ec0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c2d0 tx=0x7f66e8001d80 comp rx=0 tx=0).stop 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66fafff700 1 -- 172.21.15.86:0/1088786848 shutdown_connections 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66fafff700 1 --2- 172.21.15.86:0/1088786848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66e4003ab0 0x7f66e4003ec0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66fafff700 1 -- 172.21.15.86:0/1088786848 >> 172.21.15.86:0/1088786848 conn(0x7f66f406a320 msgr2=0x7f66f40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66fafff700 1 -- 172.21.15.86:0/1088786848 shutdown_connections 2023-10-09T11:54:17.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.410+0000 7f66fafff700 1 -- 172.21.15.86:0/1088786848 wait complete. 2023-10-09T11:54:17.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.412+0000 7f66fafff700 1 Processor -- start 2023-10-09T11:54:17.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.412+0000 7f66fafff700 1 -- start start 2023-10-09T11:54:17.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66fafff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4003ab0 0x7f66f4159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66fafff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66f4151dc0 0x7f66f416b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66fafff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66f416be70 0x7f66f4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66fafff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4151930 con 0x7f66f4151dc0 2023-10-09T11:54:17.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66fafff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4150d20 con 0x7f66e4003ab0 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66fafff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4151000 con 0x7f66f416be70 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66f4151dc0 0x7f66f416b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66f4151dc0 0x7f66f416b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44512/0 (socket says 172.21.15.86:44512) 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 -- 172.21.15.86:0/610544147 learned_addr learned my addr 172.21.15.86:0/610544147 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4003ab0 0x7f66f4159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f959c700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66f416be70 0x7f66f4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 -- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66f416be70 msgr2=0x7f66f4153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66f416be70 0x7f66f4153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 -- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4003ab0 msgr2=0x7f66f4159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4003ab0 0x7f66f4159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f3fff700 1 -- 172.21.15.86:0/610544147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f41512e0 con 0x7f66f4151dc0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.413+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4003ab0 0x7f66f4159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.414+0000 7f66f3fff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66f4151dc0 0x7f66f416b930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f66e0011af0 tx=0x7f66e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.414+0000 7f66f0ff9700 1 -- 172.21.15.86:0/610544147 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e000fa10 con 0x7f66f4151dc0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.414+0000 7f66f0ff9700 1 -- 172.21.15.86:0/610544147 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e000fb70 con 0x7f66f4151dc0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.414+0000 7f66f0ff9700 1 -- 172.21.15.86:0/610544147 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0014440 con 0x7f66f4151dc0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.414+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41515c0 con 0x7f66f4151dc0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.414+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f4150ac0 con 0x7f66f4151dc0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.416+0000 7f66f0ff9700 1 -- 172.21.15.86:0/610544147 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66e00147f0 con 0x7f66f4151dc0 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.417+0000 7f66f0ff9700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f66d8066f30 0x7f66d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.417+0000 7f66f0ff9700 1 -- 172.21.15.86:0/610544147 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f66e0018030 con 0x7f66f4151dc0 2023-10-09T11:54:17.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.417+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f66d8066f30 0x7f66d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.417+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f66d8066f30 0x7f66d80693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f66e8007c00 tx=0x7f66e8015000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.419+0000 7f67097e3b80 1 Processor -- start 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.419+0000 7f67097e3b80 1 -- start start 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da3aa50 0x56208da3ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da84d00 0x56208da63a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da36cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f67097e3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208d991a70 con 0x56208da63f60 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208d98f270 con 0x56208da3aa50 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56208d98b060 con 0x56208da84d00 2023-10-09T11:54:17.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f66f959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da36cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f66f959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da36cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44520/0 (socket says 172.21.15.86:44520) 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f66f959c700 1 -- 172.21.15.86:0/1853889875 learned_addr learned my addr 172.21.15.86:0/1853889875 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f66f3fff700 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da84d00 0x56208da63a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.420+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da3aa50 0x56208da3ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66f959c700 1 -- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da84d00 msgr2=0x56208da63a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66f959c700 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da84d00 0x56208da63a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66f959c700 1 -- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da3aa50 msgr2=0x56208da3ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66f959c700 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da3aa50 0x56208da3ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66f959c700 1 -- 172.21.15.86:0/1853889875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56208d825270 con 0x56208da63f60 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66f3fff700 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da84d00 0x56208da63a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66f959c700 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da36cf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f66f406d670 tx=0x7f66ec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f4fd89de904ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66ddffb700 1 -- 172.21.15.86:0/1853889875 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00f6f0 con 0x56208da63f60 2023-10-09T11:54:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66ddffb700 1 -- 172.21.15.86:0/1853889875 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00f850 con 0x56208da63f60 2023-10-09T11:54:17.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.421+0000 7f66ddffb700 1 -- 172.21.15.86:0/1853889875 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00fbd0 con 0x56208da63f60 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 -- 172.21.15.86:0/1853889875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 msgr2=0x56208da36cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da36cf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f66f406d670 tx=0x7f66ec009040 comp rx=0 tx=0).stop 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 -- 172.21.15.86:0/1853889875 shutdown_connections 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da36cf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da3aa50 0x56208da3ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 --2- 172.21.15.86:0/1853889875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da84d00 0x56208da63a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 -- 172.21.15.86:0/1853889875 >> 172.21.15.86:0/1853889875 conn(0x56208da3c370 msgr2=0x56208da3c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 -- 172.21.15.86:0/1853889875 shutdown_connections 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.422+0000 7f67097e3b80 1 -- 172.21.15.86:0/1853889875 wait complete. 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.423+0000 7f67097e3b80 1 -- start start 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.423+0000 7f67097e3b80 1 Processor -- start 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da60860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da7c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 0x56208da7ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f67097e3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208d936890 con 0x56208da63f60 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208d951ea0 con 0x56208da84d00 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56208d80de30 con 0x56208da3aa50 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f67097e3b80 10 client.0 _ll_register_callbacks cb 0x56208d9fe110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:54:17.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da7c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da7c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44532/0 (socket says 172.21.15.86:44532) 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 -- 172.21.15.86:0/2372126006 learned_addr learned my addr 172.21.15.86:0/2372126006 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 -- 172.21.15.86:0/2372126006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 msgr2=0x56208da60860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da60860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 -- 172.21.15.86:0/2372126006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 msgr2=0x56208da7ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 0x56208da7ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.424+0000 7f66f3fff700 1 -- 172.21.15.86:0/2372126006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e0056e70 con 0x56208da63f60 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f66f3fff700 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da7c1d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f66e0011ac0 tx=0x7f66e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9edc488ca506b0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f66d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:54:17.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2372126006 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e005ce00 con 0x56208da63f60 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2372126006 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f66e006c1e0 con 0x56208da63f60 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56208da2fb70 con 0x56208da63f60 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2372126006 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66e005b0b0 con 0x56208da63f60 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f67097e3b80 10 client.5886 fetch_fsmap learned FSMap version 25 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x7f66f40ad370 con 0x56208da63f60 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2372126006 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e0062070 con 0x56208da63f60 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2372126006 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f66e0055350 con 0x56208da63f60 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f67097e3b80 10 client.5886 fetch_fsmap finished waiting for FSMap version 25 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f67097e3b80 10 client.5886 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:54:17.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f67097e3b80 20 client.5886 populate_metadata read hostname 'smithi086' 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.425+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208da84130 0x56208da84500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.426+0000 7f67097e3b80 4 client.5886 mds_command: new command op to 5724 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.426+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 --> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56208da0caa0 con 0x56208da84130 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.426+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208da84130 0x56208da84500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.426+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208da84130 0x56208da84500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9713a6d33a0eda26 server_cookie=7a358db53b009c91 in_seq=0 out_seq=0 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.426+0000 7f66d2ffd700 10 client.5886 ms_handle_connect on v2:172.21.15.86:6834/3777239940 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2372126006 <== mds.0 v2:172.21.15.86:6834/3777239940 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56208da0caa0 con 0x56208da84130 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f66d2ffd700 10 client.5886 handle_command_reply: tid=0 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 client.5886 shutdown 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 msgr2=0x56208da7c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da7c1d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f66e0011ac0 tx=0x7f66e0008040 comp rx=0 tx=0).stop 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 shutdown_connections 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208da84130 0x56208da84500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 0x56208da7ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da60860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2372126006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da63f60 0x56208da7c1d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f66d2ffd700 0 client.5886 ms_handle_reset on v2:172.21.15.86:6834/3777239940 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 >> 172.21.15.86:0/2372126006 conn(0x56208da3c370 msgr2=0x56208da80550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 shutdown_connections 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.427+0000 7f67097e3b80 1 -- 172.21.15.86:0/2372126006 wait complete. 2023-10-09T11:54:17.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.428+0000 7f67097e3b80 20 client.5886 trim_cache size 0 max 16384 2023-10-09T11:54:17.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.444+0000 7f67097e3b80 1 Processor -- start 2023-10-09T11:54:17.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.445+0000 7f67097e3b80 1 -- start start 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.445+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da37780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.445+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da63f60 0x56208da37cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.445+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da84d00 0x56208da92eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.445+0000 7f67097e3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208da80e20 con 0x56208da84d00 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.445+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208da355a0 con 0x56208da63f60 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.445+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56208da35830 con 0x56208da3aa50 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da84d00 0x56208da92eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da84d00 0x56208da92eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44540/0 (socket says 172.21.15.86:44540) 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 -- 172.21.15.86:0/3734879476 learned_addr learned my addr 172.21.15.86:0/3734879476 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:17.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da37780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f3fff700 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da63f60 0x56208da37cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 -- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 msgr2=0x56208da37780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da37780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 -- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da63f60 msgr2=0x56208da37cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da63f60 0x56208da37cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 -- 172.21.15.86:0/3734879476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56208d7c7fe0 con 0x56208da84d00 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da37780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f3fff700 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da63f60 0x56208da37cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.446+0000 7f66f959c700 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da84d00 0x56208da92eb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f66ec014000 tx=0x7f66ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314b0e94a828ea49 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f66de7fc700 1 -- 172.21.15.86:0/3734879476 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec001680 con 0x56208da84d00 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f66de7fc700 1 -- 172.21.15.86:0/3734879476 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00f9c0 con 0x56208da84d00 2023-10-09T11:54:17.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f66de7fc700 1 -- 172.21.15.86:0/3734879476 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec006ba0 con 0x56208da84d00 2023-10-09T11:54:17.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 -- 172.21.15.86:0/3734879476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da84d00 msgr2=0x56208da92eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da84d00 0x56208da92eb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f66ec014000 tx=0x7f66ec01a000 comp rx=0 tx=0).stop 2023-10-09T11:54:17.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 -- 172.21.15.86:0/3734879476 shutdown_connections 2023-10-09T11:54:17.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da84d00 0x56208da92eb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da3aa50 0x56208da37780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 --2- 172.21.15.86:0/3734879476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da63f60 0x56208da37cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 -- 172.21.15.86:0/3734879476 >> 172.21.15.86:0/3734879476 conn(0x56208da3c370 msgr2=0x56208da36aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 -- 172.21.15.86:0/3734879476 shutdown_connections 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.447+0000 7f67097e3b80 1 -- 172.21.15.86:0/3734879476 wait complete. 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.448+0000 7f67097e3b80 1 -- start start 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.448+0000 7f67097e3b80 1 Processor -- start 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da3aa50 0x56208da77560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da63f60 0x56208da3d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f67097e3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 0x56208da3de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f67097e3b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208da7e4e0 con 0x56208da3aa50 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208da7e940 con 0x56208da84d00 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f67097e3b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56208daeb870 con 0x56208da63f60 2023-10-09T11:54:17.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f67097e3b80 10 client.0 _ll_register_callbacks cb 0x56208d9fe110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f66f8d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da3aa50 0x56208da77560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f66f8d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da3aa50 0x56208da77560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44548/0 (socket says 172.21.15.86:44548) 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f66f8d9b700 1 -- 172.21.15.86:0/2086611894 learned_addr learned my addr 172.21.15.86:0/2086611894 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f66f959c700 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 0x56208da3de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.449+0000 7f66f3fff700 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da63f60 0x56208da3d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66f8d9b700 1 -- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da63f60 msgr2=0x56208da3d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da63f60 0x56208da3d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66f8d9b700 1 -- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 msgr2=0x56208da3de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 0x56208da3de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66f8d9b700 1 -- 172.21.15.86:0/2086611894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56208d825270 con 0x56208da3aa50 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66f8d9b700 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da3aa50 0x56208da77560 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f66e40057d0 tx=0x7f66e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918bd1981eadbec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2086611894 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8000bc0 con 0x56208da3aa50 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2086611894 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f66e8004830 con 0x56208da3aa50 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66f414da20 con 0x56208da3aa50 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2086611894 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66e8000d20 con 0x56208da3aa50 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f67097e3b80 10 client.5892 fetch_fsmap learned FSMap version 25 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.450+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x56208d959780 con 0x56208da3aa50 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2086611894 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f414da20 con 0x56208da3aa50 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2086611894 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f66e8004c20 con 0x56208da3aa50 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f67097e3b80 10 client.5892 fetch_fsmap finished waiting for FSMap version 25 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f67097e3b80 10 client.5892 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:54:17.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f67097e3b80 20 client.5892 populate_metadata read hostname 'smithi086' 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208dae77f0 0x56208dae7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f67097e3b80 4 client.5892 mds_command: new command op to 5724 tid=0[{"prefix": "status"}] 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 --> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f66ec00f850 con 0x56208dae77f0 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f66f3fff700 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208dae77f0 0x56208dae7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f66d2ffd700 10 client.5892 ms_handle_connect on v2:172.21.15.86:6834/3777239940 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.451+0000 7f66f3fff700 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208dae77f0 0x56208dae7bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51af04e8ac1bbf17 server_cookie=d8d46a685fddaa9c in_seq=0 out_seq=0 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f66d2ffd700 1 -- 172.21.15.86:0/2086611894 <== mds.0 v2:172.21.15.86:6834/3777239940 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f66ec00f850 con 0x56208dae77f0 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f66d2ffd700 10 client.5892 handle_command_reply: tid=0 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 client.5892 shutdown 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da3aa50 msgr2=0x56208da77560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da3aa50 0x56208da77560 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f66e40057d0 tx=0x7f66e8012000 comp rx=0 tx=0).stop 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 shutdown_connections 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:6834/3777239940,v1:172.21.15.86:6836/3777239940] conn(0x56208dae77f0 0x56208dae7bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56208da3aa50 0x56208da77560 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56208da84d00 0x56208da3de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f66d2ffd700 0 client.5892 ms_handle_reset on v2:172.21.15.86:6834/3777239940 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 --2- 172.21.15.86:0/2086611894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56208da63f60 0x56208da3d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 >> 172.21.15.86:0/2086611894 conn(0x56208da3c370 msgr2=0x56208da6a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 shutdown_connections 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 1 -- 172.21.15.86:0/2086611894 wait complete. 2023-10-09T11:54:17.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.452+0000 7f67097e3b80 20 client.5892 trim_cache size 0 max 16384 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 5724, 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.627653073999999, 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 25, 2023-10-09T11:54:17.459 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 63, 2023-10-09T11:54:17.460 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 63, 2023-10-09T11:54:17.460 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 17.415711310999999 2023-10-09T11:54:17.460 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f66d8066f30 msgr2=0x7f66d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f66d8066f30 0x7f66d80693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f66e8007c00 tx=0x7f66e8015000 comp rx=0 tx=0).stop 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66f4151dc0 msgr2=0x7f66f416b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66f4151dc0 0x7f66f416b930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f66e0011af0 tx=0x7f66e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 shutdown_connections 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66f416be70 0x7f66f4153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66e4003ab0 0x7f66f4159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f66d8066f30 0x7f66d80693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 --2- 172.21.15.86:0/610544147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66f4151dc0 0x7f66f416b930 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 >> 172.21.15.86:0/610544147 conn(0x7f66f406a320 msgr2=0x7f66f40ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 shutdown_connections 2023-10-09T11:54:17.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.453+0000 7f66fafff700 1 -- 172.21.15.86:0/610544147 wait complete. 2023-10-09T11:54:17.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:54:17.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.650+0000 7f11a91ff700 1 Processor -- start 2023-10-09T11:54:17.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.651+0000 7f11a91ff700 1 -- start start 2023-10-09T11:54:17.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a91ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a40ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a91ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11a40ad250 0x7f11a40ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a91ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a40adbf0 con 0x7f11a4159720 2023-10-09T11:54:17.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a91ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a40aba20 con 0x7f11a40ad250 2023-10-09T11:54:17.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a91ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40ac020 con 0x7f11a4159af0 2023-10-09T11:54:17.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11a40ad250 0x7f11a40ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a259c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a40ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11a40ad250 0x7f11a40ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:48322/0 (socket says 172.21.15.86:48322) 2023-10-09T11:54:17.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a2d9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f11a4159720 0x7f11a40a98d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:56480/0 (socket says 172.21.15.86:56480) 2023-10-09T11:54:17.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a359e700 1 -- 172.21.15.86:0/2462102970 learned_addr learned my addr 172.21.15.86:0/2462102970 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:17.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.652+0000 7f11a259c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a40ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:45774/0 (socket says 172.21.15.86:45774) 2023-10-09T11:54:17.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a359e700 1 -- 172.21.15.86:0/2462102970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 msgr2=0x7f11a40ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:17.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a359e700 1 --2- 172.21.15.86:0/2462102970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a40ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a359e700 1 -- 172.21.15.86:0/2462102970 >> v1:172.21.15.135:6789/0 conn(0x7f11a4159720 legacy=0x7f11a40a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a1d9b700 1 -- 172.21.15.86:0/2462102970 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608197473 0 0) 0x7f1194001110 con 0x7f11a4159720 2023-10-09T11:54:17.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a359e700 1 -- 172.21.15.86:0/2462102970 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40aa440 con 0x7f11a40ad250 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a359e700 1 --2- 172.21.15.86:0/2462102970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a40ad250 0x7f11a40ad6b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f119c009f20 tx=0x7f119c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34bd03da779ca60e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a1d9b700 1 -- 172.21.15.86:0/2462102970 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00e070 con 0x7f11a40ad250 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a1d9b700 1 -- 172.21.15.86:0/2462102970 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00b9d0 con 0x7f11a40ad250 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.653+0000 7f11a1d9b700 1 -- 172.21.15.86:0/2462102970 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c0092e0 con 0x7f11a40ad250 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 -- 172.21.15.86:0/2462102970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a40ad250 msgr2=0x7f11a40ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 --2- 172.21.15.86:0/2462102970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a40ad250 0x7f11a40ad6b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f119c009f20 tx=0x7f119c009840 comp rx=0 tx=0).stop 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 -- 172.21.15.86:0/2462102970 shutdown_connections 2023-10-09T11:54:17.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 --2- 172.21.15.86:0/2462102970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a40ad250 0x7f11a40ad6b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 --2- 172.21.15.86:0/2462102970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a40ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 -- 172.21.15.86:0/2462102970 >> 172.21.15.86:0/2462102970 conn(0x7f11a406a320 msgr2=0x7f11a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 -- 172.21.15.86:0/2462102970 shutdown_connections 2023-10-09T11:54:17.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.654+0000 7f11a91ff700 1 -- 172.21.15.86:0/2462102970 wait complete. 2023-10-09T11:54:17.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.655+0000 7f11a91ff700 1 Processor -- start 2023-10-09T11:54:17.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.656+0000 7f11a91ff700 1 -- start start 2023-10-09T11:54:17.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.656+0000 7f11a91ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a40ad250 0x7f11a406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.656+0000 7f11a91ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a4159720 0x7f11a414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.656+0000 7f11a91ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a4148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.656+0000 7f11a91ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a414dfd0 con 0x7f11a40ad250 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.656+0000 7f11a91ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4169a30 con 0x7f11a4159720 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.656+0000 7f11a91ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a414d730 con 0x7f11a4159af0 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a40ad250 0x7f11a406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a40ad250 0x7f11a406eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44552/0 (socket says 172.21.15.86:44552) 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 -- 172.21.15.86:0/838734737 learned_addr learned my addr 172.21.15.86:0/838734737 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:17.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 -- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 msgr2=0x7f11a4148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a4148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a259c700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a4159720 0x7f11a414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 -- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a4159720 msgr2=0x7f11a414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a4159720 0x7f11a414cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 -- 172.21.15.86:0/838734737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c009ae0 con 0x7f11a40ad250 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a259c700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a4159720 0x7f11a414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.657+0000 7f11a2d9d700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a40ad250 0x7f11a406eb80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f119400c810 tx=0x7f1194007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.658+0000 7f118affd700 1 -- 172.21.15.86:0/838734737 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194007300 con 0x7f11a40ad250 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.658+0000 7f118affd700 1 -- 172.21.15.86:0/838734737 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1194007480 con 0x7f11a40ad250 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.658+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a414da10 con 0x7f11a40ad250 2023-10-09T11:54:17.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.658+0000 7f118affd700 1 -- 172.21.15.86:0/838734737 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194004830 con 0x7f11a40ad250 2023-10-09T11:54:17.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.658+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a414b830 con 0x7f11a40ad250 2023-10-09T11:54:17.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.659+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a4169830 con 0x7f11a40ad250 2023-10-09T11:54:17.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.660+0000 7f118affd700 1 -- 172.21.15.86:0/838734737 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1194004be0 con 0x7f11a40ad250 2023-10-09T11:54:17.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.661+0000 7f118affd700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1190066f30 0x7f11900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:17.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.661+0000 7f118affd700 1 -- 172.21.15.86:0/838734737 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f1194083a10 con 0x7f11a40ad250 2023-10-09T11:54:17.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.661+0000 7f11a259c700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1190066f30 0x7f11900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:17.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.662+0000 7f11a259c700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1190066f30 0x7f11900693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1198006f00 tx=0x7f1198008040 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:17.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.665+0000 7f118affd700 1 -- 172.21.15.86:0/838734737 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1194050a80 con 0x7f11a40ad250 2023-10-09T11:54:17.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.900+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11a40adbf0 con 0x7f11a40ad250 2023-10-09T11:54:17.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.901+0000 7f118affd700 1 -- 172.21.15.86:0/838734737 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f11a40adbf0 con 0x7f11a40ad250 2023-10-09T11:54:17.901 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:54:17.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.903+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1190066f30 msgr2=0x7f11900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.903+0000 7f11a91ff700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1190066f30 0x7f11900693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1198006f00 tx=0x7f1198008040 comp rx=0 tx=0).stop 2023-10-09T11:54:17.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.903+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a40ad250 msgr2=0x7f11a406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:17.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.903+0000 7f11a91ff700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a40ad250 0x7f11a406eb80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f119400c810 tx=0x7f1194007c50 comp rx=0 tx=0).stop 2023-10-09T11:54:17.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.903+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 shutdown_connections 2023-10-09T11:54:17.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.904+0000 7f11a91ff700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f1190066f30 0x7f11900693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.904+0000 7f11a91ff700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a40ad250 0x7f11a406eb80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.904+0000 7f11a91ff700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11a4159af0 0x7f11a4148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.904+0000 7f11a91ff700 1 --2- 172.21.15.86:0/838734737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11a4159720 0x7f11a414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:17.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.904+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 >> 172.21.15.86:0/838734737 conn(0x7f11a406a320 msgr2=0x7f11a414bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:17.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.904+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 shutdown_connections 2023-10-09T11:54:17.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:17.904+0000 7f11a91ff700 1 -- 172.21.15.86:0/838734737 wait complete. 2023-10-09T11:54:17.921 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:54:17.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:54:17.921 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:54:17.921 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:54:17.921 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:54:17.922 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:54:17.922 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:54:17.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:54:17.922 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:54:17.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:54:17.922 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:54:17.959 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41485sec preferred_lft 41485sec 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:54:17.960 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:54:17.961 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:54:17.962 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:54:17.962 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T11:54:17.962 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:54:17.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:54:17.962 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:54:18.057 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:54:18.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:54:18.061 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:54:18.099 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:54:18.099 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:54:18.099 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:54:18.099 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:54:18.099 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:54:18.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:54:18.100 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:54:18.100 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:54:18.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:54:18.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:54:18.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:54:18.101 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:54:18.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:54:18.296 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:54:18.331 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:54:18.331 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:54:18.332 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:54:18.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:54:18.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T11:54:18.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:54:18.432 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:54:18.468 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:54:18.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:54:18.468 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:54:18.543 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:54:18.543 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:54:18.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:54:18.672 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:54:18.673 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:54:18.701 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:54:18.701 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:54:18.701 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:54:18.701 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:54:18.701 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:54:18.705 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:54:18.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:54:18.706 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:54:18.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:54:18.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.947+0000 7f82531ff700 1 Processor -- start 2023-10-09T11:54:18.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.947+0000 7f82531ff700 1 -- start start 2023-10-09T11:54:18.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f82531ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f824c1599e0 0x7f824c069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:18.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f82531ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f824c159db0 0x7f824c069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:18.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f82531ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c06a2b0 0x7f824c06a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:18.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f82531ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0c96a0 con 0x7f824c1599e0 2023-10-09T11:54:18.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f82531ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0cb9e0 con 0x7f824c159db0 2023-10-09T11:54:18.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f82531ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0cab60 con 0x7f824c06a2b0 2023-10-09T11:54:18.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f8250f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f824c1599e0 0x7f824c069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:18.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f824bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f824c159db0 0x7f824c069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f8250f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f824c1599e0 0x7f824c069ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44566/0 (socket says 172.21.15.86:44566) 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f8250f9b700 1 -- 172.21.15.86:0/2262721006 learned_addr learned my addr 172.21.15.86:0/2262721006 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.949+0000 7f825179c700 1 --2- 172.21.15.86:0/2262721006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c06a2b0 0x7f824c06a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f8250f9b700 1 -- 172.21.15.86:0/2262721006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c06a2b0 msgr2=0x7f824c06a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f8250f9b700 1 --2- 172.21.15.86:0/2262721006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c06a2b0 0x7f824c06a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f8250f9b700 1 -- 172.21.15.86:0/2262721006 >> v2:172.21.15.135:3300/0 conn(0x7f824c159db0 msgr2=0x7f824c069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f8250f9b700 1 --2- 172.21.15.86:0/2262721006 >> v2:172.21.15.135:3300/0 conn(0x7f824c159db0 0x7f824c069080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f8250f9b700 1 -- 172.21.15.86:0/2262721006 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0cb420 con 0x7f824c1599e0 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f8250f9b700 1 --2- 172.21.15.86:0/2262721006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c069ac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f824c0c73c0 tx=0x7f8240009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcfac90a358e4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f824b7fe700 1 -- 172.21.15.86:0/2262721006 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824000b640 con 0x7f824c1599e0 2023-10-09T11:54:18.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f824b7fe700 1 -- 172.21.15.86:0/2262721006 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824000b7a0 con 0x7f824c1599e0 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.950+0000 7f824b7fe700 1 -- 172.21.15.86:0/2262721006 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824000bb60 con 0x7f824c1599e0 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 -- 172.21.15.86:0/2262721006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 msgr2=0x7f824c069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 --2- 172.21.15.86:0/2262721006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c069ac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f824c0c73c0 tx=0x7f8240009250 comp rx=0 tx=0).stop 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 -- 172.21.15.86:0/2262721006 shutdown_connections 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 --2- 172.21.15.86:0/2262721006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c06a2b0 0x7f824c06a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 --2- 172.21.15.86:0/2262721006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c069ac0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 --2- 172.21.15.86:0/2262721006 >> v2:172.21.15.135:3300/0 conn(0x7f824c159db0 0x7f824c069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 -- 172.21.15.86:0/2262721006 >> 172.21.15.86:0/2262721006 conn(0x7f824c0c9860 msgr2=0x7f824c0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 -- 172.21.15.86:0/2262721006 shutdown_connections 2023-10-09T11:54:18.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.951+0000 7f82531ff700 1 -- 172.21.15.86:0/2262721006 wait complete. 2023-10-09T11:54:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.952+0000 7f82531ff700 1 Processor -- start 2023-10-09T11:54:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.953+0000 7f82531ff700 1 -- start start 2023-10-09T11:54:18.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.953+0000 7f82531ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f824c06a2b0 0x7f824c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f82531ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f82531ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c159db0 0x7f824c158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f82531ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0c4bc0 con 0x7f824c1599e0 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f82531ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c14f010 con 0x7f824c06a2b0 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f82531ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0c3fb0 con 0x7f824c159db0 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44576/0 (socket says 172.21.15.86:44576) 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 -- 172.21.15.86:0/3786422915 learned_addr learned my addr 172.21.15.86:0/3786422915 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f8250f9b700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f824c06a2b0 0x7f824c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f825179c700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c159db0 0x7f824c158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:18.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 -- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c159db0 msgr2=0x7f824c158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c159db0 0x7f824c158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 -- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f824c06a2b0 msgr2=0x7f824c14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f824c06a2b0 0x7f824c14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.954+0000 7f824bfff700 1 -- 172.21.15.86:0/3786422915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82400094f0 con 0x7f824c1599e0 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.955+0000 7f824bfff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c157f40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f823800e900 tx=0x7f82380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.955+0000 7f8248ff9700 1 -- 172.21.15.86:0/3786422915 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238013680 con 0x7f824c1599e0 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.955+0000 7f8248ff9700 1 -- 172.21.15.86:0/3786422915 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82380137e0 con 0x7f824c1599e0 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.955+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c0c4290 con 0x7f824c1599e0 2023-10-09T11:54:18.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.955+0000 7f8248ff9700 1 -- 172.21.15.86:0/3786422915 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238013ba0 con 0x7f824c1599e0 2023-10-09T11:54:18.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.955+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c0c4850 con 0x7f824c1599e0 2023-10-09T11:54:18.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.956+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c14f150 con 0x7f824c1599e0 2023-10-09T11:54:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.957+0000 7f8248ff9700 1 -- 172.21.15.86:0/3786422915 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82380123d0 con 0x7f824c1599e0 2023-10-09T11:54:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.958+0000 7f8248ff9700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8230066f30 0x7f82300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.958+0000 7f8248ff9700 1 -- 172.21.15.86:0/3786422915 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f8238084820 con 0x7f824c1599e0 2023-10-09T11:54:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.958+0000 7f8250f9b700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8230066f30 0x7f82300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:18.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.958+0000 7f8250f9b700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8230066f30 0x7f82300693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f824c0c73c0 tx=0x7f8240017000 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:18.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:18.961+0000 7f8248ff9700 1 -- 172.21.15.86:0/3786422915 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8238051890 con 0x7f824c1599e0 2023-10-09T11:54:19.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.179+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f824c04c3c0 con 0x7f8230066f30 2023-10-09T11:54:19.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.180+0000 7f8248ff9700 1 -- 172.21.15.86:0/3786422915 <== mgr.5538 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f824c04c3c0 con 0x7f8230066f30 2023-10-09T11:54:19.180 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:54:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:54:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T11:54:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:54:19.181 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8230066f30 msgr2=0x7f82300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8230066f30 0x7f82300693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f824c0c73c0 tx=0x7f8240017000 comp rx=0 tx=0).stop 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 msgr2=0x7f824c157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c157f40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f823800e900 tx=0x7f82380091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 shutdown_connections 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f824c159db0 0x7f824c158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f824c06a2b0 0x7f824c14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8230066f30 0x7f82300693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 --2- 172.21.15.86:0/3786422915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f824c1599e0 0x7f824c157f40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 >> 172.21.15.86:0/3786422915 conn(0x7f824c0c9860 msgr2=0x7f824c0c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:19.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 shutdown_connections 2023-10-09T11:54:19.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.182+0000 7f82531ff700 1 -- 172.21.15.86:0/3786422915 wait complete. 2023-10-09T11:54:19.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T11:54:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.382+0000 7f19cffff700 1 Processor -- start 2023-10-09T11:54:19.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.382+0000 7f19cffff700 1 -- start start 2023-10-09T11:54:19.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.383+0000 7f19cffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 0x7f19c80c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:19.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.383+0000 7f19cffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19c80ccee0 0x7f19c81561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:19.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.383+0000 7f19cffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c815b0d0 con 0x7f19c80c87c0 2023-10-09T11:54:19.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.383+0000 7f19cffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c80c7a60 con 0x7f19c80ccee0 2023-10-09T11:54:19.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.383+0000 7f19cffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c815a4c0 con 0x7f19c80c83f0 2023-10-09T11:54:19.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cdd9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 0x7f19c80c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:19.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cd59a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19c80ccee0 0x7f19c81561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:19.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cd59a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19c80ccee0 0x7f19c81561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:48368/0 (socket says 172.21.15.86:48368) 2023-10-09T11:54:19.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cd59a700 1 -- 172.21.15.86:0/197349060 learned_addr learned my addr 172.21.15.86:0/197349060 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:19.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cd59a700 1 -- 172.21.15.86:0/197349060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 msgr2=0x7f19c80c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:19.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cd59a700 1 --2- 172.21.15.86:0/197349060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 0x7f19c80c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cd59a700 1 -- 172.21.15.86:0/197349060 >> v1:172.21.15.135:6789/0 conn(0x7f19c80c87c0 legacy=0x7f19c806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:19.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.384+0000 7f19cd59a700 1 -- 172.21.15.86:0/197349060 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c815a7a0 con 0x7f19c80ccee0 2023-10-09T11:54:19.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.385+0000 7f19cd59a700 1 --2- 172.21.15.86:0/197349060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c81561d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f19b80099b0 tx=0x7f19b8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb5aa1f76951299 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:19.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.385+0000 7f19ccd99700 1 -- 172.21.15.86:0/197349060 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8009ea0 con 0x7f19c80ccee0 2023-10-09T11:54:19.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.385+0000 7f19ccd99700 1 -- 172.21.15.86:0/197349060 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800b860 con 0x7f19c80ccee0 2023-10-09T11:54:19.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.385+0000 7f19ccd99700 1 -- 172.21.15.86:0/197349060 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800bc00 con 0x7f19c80ccee0 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 -- 172.21.15.86:0/197349060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 msgr2=0x7f19c81561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 --2- 172.21.15.86:0/197349060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c81561d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f19b80099b0 tx=0x7f19b8009250 comp rx=0 tx=0).stop 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 -- 172.21.15.86:0/197349060 shutdown_connections 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 --2- 172.21.15.86:0/197349060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 0x7f19c80c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 --2- 172.21.15.86:0/197349060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c81561d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 -- 172.21.15.86:0/197349060 >> 172.21.15.86:0/197349060 conn(0x7f19c8068e10 msgr2=0x7f19c80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 -- 172.21.15.86:0/197349060 shutdown_connections 2023-10-09T11:54:19.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.386+0000 7f19cffff700 1 -- 172.21.15.86:0/197349060 wait complete. 2023-10-09T11:54:19.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.387+0000 7f19cffff700 1 Processor -- start 2023-10-09T11:54:19.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.387+0000 7f19cffff700 1 -- start start 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 0x7f19c8148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c80c87c0 0x7f19c80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c80c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c816d6c0 con 0x7f19c80c87c0 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c816d9a0 con 0x7f19c80ccee0 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c816dc80 con 0x7f19c80c83f0 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cd59a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c80c87c0 0x7f19c80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cd59a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c80c87c0 0x7f19c80c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44582/0 (socket says 172.21.15.86:44582) 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.388+0000 7f19cd59a700 1 -- 172.21.15.86:0/1191802543 learned_addr learned my addr 172.21.15.86:0/1191802543 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:19.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19cd59a700 1 -- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 msgr2=0x7f19c8148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19cd59a700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 0x7f19c8148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19cd59a700 1 -- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 msgr2=0x7f19c80c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19ce59c700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c80c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19cd59a700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c80c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19cd59a700 1 -- 172.21.15.86:0/1191802543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80094f0 con 0x7f19c80c87c0 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19ce59c700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c80c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19cd59a700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c80c87c0 0x7f19c80c5b20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19c8063d40 tx=0x7f19b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800bbe0 con 0x7f19c80c87c0 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8011420 con 0x7f19c80c87c0 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.389+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b80117c0 con 0x7f19c80c87c0 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.390+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c816df60 con 0x7f19c80c87c0 2023-10-09T11:54:19.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.390+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8148550 con 0x7f19c80c87c0 2023-10-09T11:54:19.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.391+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c804c3c0 con 0x7f19c80c87c0 2023-10-09T11:54:19.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.391+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19b8011bf0 con 0x7f19c80c87c0 2023-10-09T11:54:19.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.392+0000 7f19bdffb700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19ac066f30 0x7f19ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:19.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.392+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f19b8085fe0 con 0x7f19c80c87c0 2023-10-09T11:54:19.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.393+0000 7f19cdd9b700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19ac066f30 0x7f19ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:19.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.393+0000 7f19cdd9b700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19ac066f30 0x7f19ac0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009bb0 tx=0x7f19c40091a0 comp rx=0 tx=0).ready entity=mgr.5538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:19.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.397+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19b8053090 con 0x7f19c80c87c0 2023-10-09T11:54:19.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:19.639+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f19c815aa80 con 0x7f19c80c87c0 2023-10-09T11:54:20.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.271+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 20) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f19b8053460 con 0x7f19c80c87c0 2023-10-09T11:54:20.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.272+0000 7f19bdffb700 1 -- 172.21.15.86:0/1191802543 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v20) v1 ==== 92+0+0 (secure 0 0 0) 0x7f19b80550f0 con 0x7f19c80c87c0 2023-10-09T11:54:20.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.274+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19ac066f30 msgr2=0x7f19ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.274+0000 7f19cffff700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19ac066f30 0x7f19ac0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009bb0 tx=0x7f19c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.274+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c80c87c0 msgr2=0x7f19c80c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.274+0000 7f19cffff700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c80c87c0 0x7f19c80c5b20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19c8063d40 tx=0x7f19b8017000 comp rx=0 tx=0).stop 2023-10-09T11:54:20.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 shutdown_connections 2023-10-09T11:54:20.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19c80ccee0 0x7f19c80c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19c80c83f0 0x7f19c8148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19ac066f30 0x7f19ac0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 --2- 172.21.15.86:0/1191802543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c80c87c0 0x7f19c80c5b20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 >> 172.21.15.86:0/1191802543 conn(0x7f19c8068e10 msgr2=0x7f19c814c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 shutdown_connections 2023-10-09T11:54:20.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.275+0000 7f19cffff700 1 -- 172.21.15.86:0/1191802543 wait complete. 2023-10-09T11:54:20.293 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T11:54:20.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.483+0000 7fc36119d700 1 Processor -- start 2023-10-09T11:54:20.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.484+0000 7fc36119d700 1 -- start start 2023-10-09T11:54:20.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc36119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc36119d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc35c0b33b0 0x7fc35c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc36119d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0b2080 con 0x7fc35c0b4e70 2023-10-09T11:54:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc36119d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0cfb00 con 0x7fc35c0b33b0 2023-10-09T11:54:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc36119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b5c40 con 0x7fc35c0b16d0 2023-10-09T11:54:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc35bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc35c0b4e70 0x7fc35c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39088/0 (socket says 172.21.15.86:39088) 2023-10-09T11:54:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc35bfff700 1 -- 172.21.15.86:0/498352419 learned_addr learned my addr 172.21.15.86:0/498352419 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc36099c700 1 --2- 172.21.15.86:0/498352419 >> v2:172.21.15.135:3300/0 conn(0x7fc35c0b33b0 0x7fc35c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.485+0000 7fc35b7fe700 1 --2- 172.21.15.86:0/498352419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35affd700 1 -- 172.21.15.86:0/498352419 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222951395 0 0) 0x7fc35c0b2080 con 0x7fc35c0b4e70 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35affd700 1 -- 172.21.15.86:0/498352419 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc344003570 con 0x7fc35c0b4e70 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35b7fe700 1 -- 172.21.15.86:0/498352419 >> v2:172.21.15.135:3300/0 conn(0x7fc35c0b33b0 msgr2=0x7fc35c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35b7fe700 1 --2- 172.21.15.86:0/498352419 >> v2:172.21.15.135:3300/0 conn(0x7fc35c0b33b0 0x7fc35c0b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35b7fe700 1 -- 172.21.15.86:0/498352419 >> v1:172.21.15.86:6789/0 conn(0x7fc35c0b4e70 legacy=0x7fc35c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35b7fe700 1 -- 172.21.15.86:0/498352419 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0b5f20 con 0x7fc35c0b16d0 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc36099c700 1 --2- 172.21.15.86:0/498352419 >> v2:172.21.15.135:3300/0 conn(0x7fc35c0b33b0 0x7fc35c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35b7fe700 1 --2- 172.21.15.86:0/498352419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c0b1b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc3500098e0 tx=0x7fc3500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33629b2dcfea1d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35affd700 1 -- 172.21.15.86:0/498352419 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350011630 con 0x7fc35c0b16d0 2023-10-09T11:54:20.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35affd700 1 -- 172.21.15.86:0/498352419 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350011790 con 0x7fc35c0b16d0 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.486+0000 7fc35affd700 1 -- 172.21.15.86:0/498352419 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350011b30 con 0x7fc35c0b16d0 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 -- 172.21.15.86:0/498352419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 msgr2=0x7fc35c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 --2- 172.21.15.86:0/498352419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c0b1b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc3500098e0 tx=0x7fc3500091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 -- 172.21.15.86:0/498352419 shutdown_connections 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 --2- 172.21.15.86:0/498352419 >> v2:172.21.15.135:3300/0 conn(0x7fc35c0b33b0 0x7fc35c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 --2- 172.21.15.86:0/498352419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c0b1b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 -- 172.21.15.86:0/498352419 >> 172.21.15.86:0/498352419 conn(0x7fc35c0d10c0 msgr2=0x7fc35c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 -- 172.21.15.86:0/498352419 shutdown_connections 2023-10-09T11:54:20.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.487+0000 7fc36119d700 1 -- 172.21.15.86:0/498352419 wait complete. 2023-10-09T11:54:20.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.488+0000 7fc36119d700 1 Processor -- start 2023-10-09T11:54:20.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.489+0000 7fc36119d700 1 -- start start 2023-10-09T11:54:20.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.489+0000 7fc36119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.489+0000 7fc36119d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c0b33b0 0x7fc35c16a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36119d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc35c0b4e70 0x7fc35c0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36119d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0c8c80 con 0x7fc35c0b4e70 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36119d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0c8f60 con 0x7fc35c0b33b0 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0c9240 con 0x7fc35c0b16d0 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc35c0b4e70 0x7fc35c0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc35c0b4e70 0x7fc35c0cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44610/0 (socket says 172.21.15.86:44610) 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 -- 172.21.15.86:0/1270316615 learned_addr learned my addr 172.21.15.86:0/1270316615 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc35bfff700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc35b7fe700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c0b33b0 0x7fc35c16a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 -- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 msgr2=0x7fc35c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 -- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c0b33b0 msgr2=0x7fc35c16a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c0b33b0 0x7fc35c16a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.490+0000 7fc36099c700 1 -- 172.21.15.86:0/1270316615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009a20 con 0x7fc35c0b4e70 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.491+0000 7fc36099c700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc35c0b4e70 0x7fc35c0cac50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc354009fc0 tx=0x7fc35400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.491+0000 7fc343fff700 1 -- 172.21.15.86:0/1270316615 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400cbd0 con 0x7fc35c0b4e70 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.491+0000 7fc343fff700 1 -- 172.21.15.86:0/1270316615 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400f040 con 0x7fc35c0b4e70 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.491+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc350009420 con 0x7fc35c0b4e70 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.491+0000 7fc343fff700 1 -- 172.21.15.86:0/1270316615 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354014480 con 0x7fc35c0b4e70 2023-10-09T11:54:20.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.491+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c0c9800 con 0x7fc35c0b4e70 2023-10-09T11:54:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.492+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c088990 con 0x7fc35c0b4e70 2023-10-09T11:54:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.493+0000 7fc343fff700 1 -- 172.21.15.86:0/1270316615 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fc354003020 con 0x7fc35c0b4e70 2023-10-09T11:54:20.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.494+0000 7fc343fff700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 0x7fc348069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.494+0000 7fc343fff700 1 -- 172.21.15.86:0/1270316615 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fc354085010 con 0x7fc35c0b4e70 2023-10-09T11:54:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.494+0000 7fc35bfff700 1 -- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 msgr2=0x7fc348069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:20.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.494+0000 7fc35bfff700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 0x7fc348069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:54:20.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.502+0000 7fc343fff700 1 -- 172.21.15.86:0/1270316615 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc354052120 con 0x7fc35c0b4e70 2023-10-09T11:54:20.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.695+0000 7fc35bfff700 1 -- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 msgr2=0x7fc348069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:20.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.695+0000 7fc35bfff700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 0x7fc348069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:54:20.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.703+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fc35c0cd900 con 0x7fc35c0b4e70 2023-10-09T11:54:20.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.707+0000 7fc343fff700 1 -- 172.21.15.86:0/1270316615 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc354055740 con 0x7fc35c0b4e70 2023-10-09T11:54:20.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 msgr2=0x7fc348069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:54:20.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 0x7fc348069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc35c0b4e70 msgr2=0x7fc35c0cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc35c0b4e70 0x7fc35c0cac50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc354009fc0 tx=0x7fc35400b040 comp rx=0 tx=0).stop 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 shutdown_connections 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fc348066f80 0x7fc348069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc35c0b4e70 0x7fc35c0cac50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35c0b16d0 0x7fc35c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 --2- 172.21.15.86:0/1270316615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c0b33b0 0x7fc35c16a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.709+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 >> 172.21.15.86:0/1270316615 conn(0x7fc35c0d10c0 msgr2=0x7fc35c15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.710+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 shutdown_connections 2023-10-09T11:54:20.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.710+0000 7fc36119d700 1 -- 172.21.15.86:0/1270316615 wait complete. 2023-10-09T11:54:20.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T11:54:20.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.917+0000 7f5e34dff700 1 Processor -- start 2023-10-09T11:54:20.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.917+0000 7f5e34dff700 1 -- start start 2023-10-09T11:54:20.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.918+0000 7f5e34dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5e3006b160 0x7f5e3006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.918+0000 7f5e34dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300ac450 con 0x7f5e3006a2b0 2023-10-09T11:54:20.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.918+0000 7f5e34dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e30069d00 con 0x7f5e300637d0 2023-10-09T11:54:20.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.918+0000 7f5e34dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e300693d0 con 0x7f5e3006b160 2023-10-09T11:54:20.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.918+0000 7f5e2ed9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5e3006a2b0 0x7f5e3006a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39100/0 (socket says 172.21.15.86:39100) 2023-10-09T11:54:20.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.918+0000 7f5e2ed9d700 1 -- 172.21.15.86:0/3719451223 learned_addr learned my addr 172.21.15.86:0/3719451223 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:20.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.919+0000 7f5e2e59c700 1 --2- 172.21.15.86:0/3719451223 >> v2:172.21.15.135:3300/0 conn(0x7f5e3006b160 0x7f5e3006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.919+0000 7f5e2d59a700 1 -- 172.21.15.86:0/3719451223 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939909218 0 0) 0x7f5e300ac450 con 0x7f5e3006a2b0 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.919+0000 7f5e2d59a700 1 -- 172.21.15.86:0/3719451223 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e18003570 con 0x7f5e3006a2b0 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.919+0000 7f5e2e59c700 1 -- 172.21.15.86:0/3719451223 >> v1:172.21.15.135:6789/0 conn(0x7f5e300637d0 legacy=0x7f5e30068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.919+0000 7f5e2e59c700 1 -- 172.21.15.86:0/3719451223 >> v1:172.21.15.86:6789/0 conn(0x7f5e3006a2b0 legacy=0x7f5e3006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.919+0000 7f5e2e59c700 1 -- 172.21.15.86:0/3719451223 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30068830 con 0x7f5e3006b160 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.919+0000 7f5e2e59c700 1 --2- 172.21.15.86:0/3719451223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 0x7f5e3006b530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098e0 tx=0x7f5e200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c45c019ed76fed38 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e2d59a700 1 -- 172.21.15.86:0/3719451223 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000b640 con 0x7f5e3006b160 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e2d59a700 1 -- 172.21.15.86:0/3719451223 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000b7a0 con 0x7f5e3006b160 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e2d59a700 1 -- 172.21.15.86:0/3719451223 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000bb40 con 0x7f5e3006b160 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e34dff700 1 -- 172.21.15.86:0/3719451223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 msgr2=0x7f5e3006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e34dff700 1 --2- 172.21.15.86:0/3719451223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 0x7f5e3006b530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5e200098e0 tx=0x7f5e200091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e34dff700 1 -- 172.21.15.86:0/3719451223 shutdown_connections 2023-10-09T11:54:20.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e34dff700 1 --2- 172.21.15.86:0/3719451223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 0x7f5e3006b530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e34dff700 1 -- 172.21.15.86:0/3719451223 >> 172.21.15.86:0/3719451223 conn(0x7f5e3006ded0 msgr2=0x7f5e3006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:20.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e34dff700 1 -- 172.21.15.86:0/3719451223 shutdown_connections 2023-10-09T11:54:20.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.920+0000 7f5e34dff700 1 -- 172.21.15.86:0/3719451223 wait complete. 2023-10-09T11:54:20.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.922+0000 7f5e34dff700 1 Processor -- start 2023-10-09T11:54:20.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.922+0000 7f5e34dff700 1 -- start start 2023-10-09T11:54:20.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e34dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e300637d0 0x7f5e3016ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e34dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e3006a2b0 0x7f5e3014e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e34dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 0x7f5e300b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e34dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30155c40 con 0x7f5e300637d0 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e34dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300b0220 con 0x7f5e3006b160 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e34dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3016b240 con 0x7f5e3006a2b0 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e300637d0 0x7f5e3016ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e300637d0 0x7f5e3016ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44626/0 (socket says 172.21.15.86:44626) 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e2e59c700 1 -- 172.21.15.86:0/975791076 learned_addr learned my addr 172.21.15.86:0/975791076 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e2ed9d700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 0x7f5e300b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.923+0000 7f5e2dd9b700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e3006a2b0 0x7f5e3014e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e2e59c700 1 -- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e3006a2b0 msgr2=0x7f5e3014e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e2e59c700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e3006a2b0 0x7f5e3014e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e2e59c700 1 -- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 msgr2=0x7f5e300b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e2e59c700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 0x7f5e300b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e2e59c700 1 -- 172.21.15.86:0/975791076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20009420 con 0x7f5e300637d0 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e2e59c700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e300637d0 0x7f5e3016ad00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5e3006d580 tx=0x7f5e20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e1e7fc700 1 -- 172.21.15.86:0/975791076 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20006af0 con 0x7f5e300637d0 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e1e7fc700 1 -- 172.21.15.86:0/975791076 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e20000bc0 con 0x7f5e300637d0 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e300b26f0 con 0x7f5e300637d0 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e1e7fc700 1 -- 172.21.15.86:0/975791076 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000bb40 con 0x7f5e300637d0 2023-10-09T11:54:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.924+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e300afbd0 con 0x7f5e300637d0 2023-10-09T11:54:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.926+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3004c3c0 con 0x7f5e300637d0 2023-10-09T11:54:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.926+0000 7f5e1e7fc700 1 -- 172.21.15.86:0/975791076 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f5e20023070 con 0x7f5e300637d0 2023-10-09T11:54:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.927+0000 7f5e1e7fc700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 0x7f5e10069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.927+0000 7f5e1e7fc700 1 -- 172.21.15.86:0/975791076 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f5e20085880 con 0x7f5e300637d0 2023-10-09T11:54:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.927+0000 7f5e2dd9b700 1 -- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 msgr2=0x7f5e10069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.927+0000 7f5e2dd9b700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 0x7f5e10069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:54:20.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:20.932+0000 7f5e1e7fc700 1 -- 172.21.15.86:0/975791076 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e20052990 con 0x7f5e300637d0 2023-10-09T11:54:21.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.128+0000 7f5e2dd9b700 1 -- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 msgr2=0x7f5e10069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:21.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.128+0000 7f5e2dd9b700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 0x7f5e10069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:54:21.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.133+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f5e300635b0 con 0x7f5e300637d0 2023-10-09T11:54:21.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.138+0000 7f5e1e7fc700 1 -- 172.21.15.86:0/975791076 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5e200150c0 con 0x7f5e300637d0 2023-10-09T11:54:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 msgr2=0x7f5e10069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:54:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 0x7f5e10069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e300637d0 msgr2=0x7f5e3016ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e300637d0 0x7f5e3016ad00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5e3006d580 tx=0x7f5e20017000 comp rx=0 tx=0).stop 2023-10-09T11:54:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 shutdown_connections 2023-10-09T11:54:21.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f5e10066f80 0x7f5e10069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e300637d0 0x7f5e3016ad00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3006b160 0x7f5e300b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 --2- 172.21.15.86:0/975791076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e3006a2b0 0x7f5e3014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.140+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 >> 172.21.15.86:0/975791076 conn(0x7f5e3006ded0 msgr2=0x7f5e301506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.141+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 shutdown_connections 2023-10-09T11:54:21.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.141+0000 7f5e34dff700 1 -- 172.21.15.86:0/975791076 wait complete. 2023-10-09T11:54:21.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:21.159 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T11:54:21.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T11:54:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.431+0000 7f751b59e700 1 Processor -- start 2023-10-09T11:54:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.431+0000 7f751b59e700 1 -- start start 2023-10-09T11:54:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.432+0000 7f751b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c0b03c0 0x7f751c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.432+0000 7f751b59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f751c1591e0 0x7f751c159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.432+0000 7f751b59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c0cfa00 con 0x7f751c0b0790 2023-10-09T11:54:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.432+0000 7f751b59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0cb580 con 0x7f751c1591e0 2023-10-09T11:54:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.432+0000 7f751b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0cf160 con 0x7f751c0b03c0 2023-10-09T11:54:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f7519d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f751c0b0790 0x7f751c0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39110/0 (socket says 172.21.15.86:39110) 2023-10-09T11:54:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f7519d9b700 1 -- 172.21.15.86:0/2818608975 learned_addr learned my addr 172.21.15.86:0/2818608975 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:54:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751ad9d700 1 --2- 172.21.15.86:0/2818608975 >> v2:172.21.15.86:3300/0 conn(0x7f751c1591e0 0x7f751c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751a59c700 1 --2- 172.21.15.86:0/2818608975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c0b03c0 0x7f751c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:21.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751959a700 1 -- 172.21.15.86:0/2818608975 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267036731 0 0) 0x7f751c0cfa00 con 0x7f751c0b0790 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751959a700 1 -- 172.21.15.86:0/2818608975 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7504003570 con 0x7f751c0b0790 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751ad9d700 1 -- 172.21.15.86:0/2818608975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c0b03c0 msgr2=0x7f751c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751ad9d700 1 --2- 172.21.15.86:0/2818608975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c0b03c0 0x7f751c0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751ad9d700 1 -- 172.21.15.86:0/2818608975 >> v1:172.21.15.86:6789/0 conn(0x7f751c0b0790 legacy=0x7f751c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.433+0000 7f751ad9d700 1 -- 172.21.15.86:0/2818608975 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0cf440 con 0x7f751c1591e0 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.434+0000 7f751ad9d700 1 --2- 172.21.15.86:0/2818608975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c1591e0 0x7f751c159620 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7514009e60 tx=0x7f7514009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7571f1e3c1b9589f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.434+0000 7f751959a700 1 -- 172.21.15.86:0/2818608975 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400e070 con 0x7f751c1591e0 2023-10-09T11:54:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.434+0000 7f751959a700 1 -- 172.21.15.86:0/2818608975 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400bab0 con 0x7f751c1591e0 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.434+0000 7f751959a700 1 -- 172.21.15.86:0/2818608975 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400be70 con 0x7f751c1591e0 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.434+0000 7f751b59e700 1 -- 172.21.15.86:0/2818608975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c1591e0 msgr2=0x7f751c159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.434+0000 7f751b59e700 1 --2- 172.21.15.86:0/2818608975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c1591e0 0x7f751c159620 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7514009e60 tx=0x7f7514009780 comp rx=0 tx=0).stop 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.435+0000 7f751b59e700 1 -- 172.21.15.86:0/2818608975 shutdown_connections 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.435+0000 7f751b59e700 1 --2- 172.21.15.86:0/2818608975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c1591e0 0x7f751c159620 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.435+0000 7f751b59e700 1 --2- 172.21.15.86:0/2818608975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c0b03c0 0x7f751c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.435+0000 7f751b59e700 1 -- 172.21.15.86:0/2818608975 >> 172.21.15.86:0/2818608975 conn(0x7f751c063230 msgr2=0x7f751c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.435+0000 7f751b59e700 1 -- 172.21.15.86:0/2818608975 shutdown_connections 2023-10-09T11:54:21.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.435+0000 7f751b59e700 1 -- 172.21.15.86:0/2818608975 wait complete. 2023-10-09T11:54:21.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.436+0000 7f751b59e700 1 Processor -- start 2023-10-09T11:54:21.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.436+0000 7f751b59e700 1 -- start start 2023-10-09T11:54:21.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c0b03c0 0x7f751c0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:21.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f751c0b0790 0x7f751c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c1591e0 0x7f751c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c15ac30 con 0x7f751c0b03c0 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c15a900 con 0x7f751c0b0790 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0c8cd0 con 0x7f751c1591e0 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c0b03c0 0x7f751c0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c0b03c0 0x7f751c0c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44658/0 (socket says 172.21.15.86:44658) 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751a59c700 1 -- 172.21.15.86:0/826843079 learned_addr learned my addr 172.21.15.86:0/826843079 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:21.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f751c0b0790 0x7f751c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:21.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.437+0000 7f751ad9d700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c1591e0 0x7f751c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:21.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f751a59c700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c1591e0 msgr2=0x7f751c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:21.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f751a59c700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c1591e0 0x7f751c0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f751a59c700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f751c0b0790 msgr2=0x7f751c14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:21.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f751a59c700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f751c0b0790 0x7f751c14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:21.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f751a59c700 1 -- 172.21.15.86:0/826843079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514009a20 con 0x7f751c0b03c0 2023-10-09T11:54:21.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f751a59c700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c0b03c0 0x7f751c0c8430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f750c00e930 tx=0x7f750c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:21.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c013680 con 0x7f751c0b03c0 2023-10-09T11:54:21.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c0137e0 con 0x7f751c0b03c0 2023-10-09T11:54:21.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c0c8fb0 con 0x7f751c0b03c0 2023-10-09T11:54:21.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.438+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c013b80 con 0x7f751c0b03c0 2023-10-09T11:54:21.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.439+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c0c8970 con 0x7f751c0b03c0 2023-10-09T11:54:21.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.440+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c0c94b0 con 0x7f751c0b03c0 2023-10-09T11:54:21.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.441+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 20) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f750c00c3e0 con 0x7f751c0b03c0 2023-10-09T11:54:21.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.443+0000 7f750a7fc700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:21.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.443+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f750c0847e0 con 0x7f751c0b03c0 2023-10-09T11:54:21.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.443+0000 7f7519d9b700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 msgr2=0x7f74fc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:21.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.443+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:54:21.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.447+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f750c0518f0 con 0x7f751c0b03c0 2023-10-09T11:54:21.549 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:21.549+0000 7f539c669180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:54:21.605 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:21.604+0000 7f5462d3b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:54:21.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.644+0000 7f7519d9b700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 msgr2=0x7f74fc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:21.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.644+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:54:21.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:21.674+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f751c15ad70 con 0x7f74fc066f80 2023-10-09T11:54:21.714 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:21.714+0000 7f539c669180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:54:21.771 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:21.771+0000 7f5462d3b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:54:21.801 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:21.801+0000 7f539c669180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:54:21.860 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:21.860+0000 7f5462d3b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:54:22.030 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:22.029+0000 7f539c669180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:54:22.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:22.045+0000 7f7519d9b700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 msgr2=0x7f74fc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:22.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:22.045+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:54:22.085 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:22.085+0000 7f5462d3b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:54:22.207 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:22.206+0000 7f539c669180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:54:22.262 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:22.262+0000 7f5462d3b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:54:22.301 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:22.300+0000 7f539c669180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:54:22.353 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:22.353+0000 7f5462d3b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:54:22.463 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:22.463+0000 7f539c669180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:54:22.515 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:22.515+0000 7f5462d3b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:54:22.565 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:22.564+0000 7f539c669180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:54:22.615 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:22.615+0000 7f5462d3b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:54:22.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:22.846+0000 7f7519d9b700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 msgr2=0x7f74fc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:22.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:22.846+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T11:54:23.048 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:23.048+0000 7f539c669180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:54:23.095 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:23.095+0000 7f5462d3b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:54:23.141 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:23.141+0000 7f539c669180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:54:23.189 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:23.189+0000 7f5462d3b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:54:23.231 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:23.231+0000 7f539c669180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:54:23.279 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:23.279+0000 7f5462d3b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:54:23.852 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:23.851+0000 7f539c669180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:54:23.895 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:23.895+0000 7f5462d3b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:54:24.023 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:24.022+0000 7f539c669180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:54:24.067 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:24.066+0000 7f5462d3b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:54:24.117 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:24.117+0000 7f539c669180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:54:24.162 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:24.162+0000 7f5462d3b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:54:24.410 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:24.410+0000 7f539c669180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:54:24.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:24.447+0000 7f7519d9b700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 msgr2=0x7f74fc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:54:24.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:24.447+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T11:54:24.454 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:24.454+0000 7f5462d3b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:54:24.506 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:24.506+0000 7f539c669180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:54:24.548 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:24.548+0000 7f5462d3b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:54:25.209 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:25.208+0000 7f539c669180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:54:25.243 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:25.243+0000 7f5462d3b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:54:25.495 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:25.494+0000 7f539c669180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:54:25.525 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:25.525+0000 7f5462d3b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:54:25.588 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:25.588+0000 7f539c669180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:54:25.617 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:25.617+0000 7f5462d3b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:54:25.741 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:25.741+0000 7f539c669180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:54:25.769 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:25.769+0000 7f5462d3b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:54:25.844 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:25.844+0000 7f539c669180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:54:25.873 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:25.873+0000 7f5462d3b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:54:26.031 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:26.031+0000 7f539c669180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:54:26.059 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.059+0000 7f5462d3b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:54:26.124 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:26.124+0000 7f539c669180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:54:26.151 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.151+0000 7f5462d3b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:54:26.216 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:26.216+0000 7f539c669180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:54:26.241 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.241+0000 7f5462d3b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:54:26.309 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:54:26.309+0000 7f539c669180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:54:26.334 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.334+0000 7f5462d3b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:54:26.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:26.347+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 21) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f750c051cc0 con 0x7f751c0b03c0 2023-10-09T11:54:26.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:26.347+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 msgr2=0x7f74fc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:54:26.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:26.347+0000 7f750a7fc700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:26.477 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d386e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.477 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d386e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.477 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d386e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.478 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d386e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.478 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d386e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.478 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d7876700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.478 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d7876700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.478 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d7876700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.478 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d7876700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:26.478 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:54:26.477+0000 7f53d7876700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:54:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.378+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 22) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f750c0609b0 con 0x7f751c0b03c0 2023-10-09T11:54:27.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.378+0000 7f750a7fc700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.378+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f74fc033970 con 0x7f74fc066f80 2023-10-09T11:54:27.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.379+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:27.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.383+0000 7f7519d9b700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc0693b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f751c16cec0 tx=0x7f7510009040 comp rx=0 tx=0).ready entity=mgr.5916 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:27.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.455+0000 7f750a7fc700 1 -- 172.21.15.86:0/826843079 <== mgr.5916 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f74fc033970 con 0x7f74fc066f80 2023-10-09T11:54:27.455 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path snap_test_dir1 2023-10-09T11:54:27.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 msgr2=0x7f74fc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:27.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc0693b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f751c16cec0 tx=0x7f7510009040 comp rx=0 tx=0).stop 2023-10-09T11:54:27.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c0b03c0 msgr2=0x7f751c0c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:27.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c0b03c0 0x7f751c0c8430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f750c00e930 tx=0x7f750c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 shutdown_connections 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f74fc066f80 0x7f74fc0693b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f751c0b03c0 0x7f751c0c8430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f751c1591e0 0x7f751c0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 --2- 172.21.15.86:0/826843079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f751c0b0790 0x7f751c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 >> 172.21.15.86:0/826843079 conn(0x7f751c063230 msgr2=0x7f751c0cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 shutdown_connections 2023-10-09T11:54:27.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.458+0000 7f751b59e700 1 -- 172.21.15.86:0/826843079 wait complete. 2023-10-09T11:54:27.477 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T11:54:27.477 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-10-09T11:54:27.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.662+0000 7fe105b9d700 1 Processor -- start 2023-10-09T11:54:27.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.663+0000 7fe105b9d700 1 -- start start 2023-10-09T11:54:27.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe105b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe1000b0760 0x7fe1000b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:27.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe105b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1000ace60 0x7fe1000ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:27.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe105b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1000b0570 con 0x7fe100156350 2023-10-09T11:54:27.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe105b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000b1140 con 0x7fe1000b0760 2023-10-09T11:54:27.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe105b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000af4d0 con 0x7fe1000ace60 2023-10-09T11:54:27.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe0fffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe1000b0760 0x7fe1000b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:27.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe0fffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe1000b0760 0x7fe1000b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41836/0 (socket says 172.21.15.86:41836) 2023-10-09T11:54:27.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe0fffff700 1 -- 172.21.15.86:0/3443729180 learned_addr learned my addr 172.21.15.86:0/3443729180 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:27.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.664+0000 7fe10539c700 1 --2- 172.21.15.86:0/3443729180 >> v2:172.21.15.135:3300/0 conn(0x7fe1000ace60 0x7fe1000ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:27.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0fffff700 1 -- 172.21.15.86:0/3443729180 >> v2:172.21.15.135:3300/0 conn(0x7fe1000ace60 msgr2=0x7fe1000ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:27.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0fffff700 1 --2- 172.21.15.86:0/3443729180 >> v2:172.21.15.135:3300/0 conn(0x7fe1000ace60 0x7fe1000ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0fffff700 1 -- 172.21.15.86:0/3443729180 >> v1:172.21.15.135:6789/0 conn(0x7fe100156350 legacy=0x7fe100157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:27.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0fffff700 1 -- 172.21.15.86:0/3443729180 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1000af7b0 con 0x7fe1000b0760 2023-10-09T11:54:27.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0fffff700 1 --2- 172.21.15.86:0/3443729180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000b0760 0x7fe1000b0c00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe100071450 tx=0x7fe0ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6778c4ee35b0692d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:27.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0ff7fe700 1 -- 172.21.15.86:0/3443729180 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00b820 con 0x7fe1000b0760 2023-10-09T11:54:27.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0ff7fe700 1 -- 172.21.15.86:0/3443729180 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec00b980 con 0x7fe1000b0760 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.665+0000 7fe0ff7fe700 1 -- 172.21.15.86:0/3443729180 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00bd20 con 0x7fe1000b0760 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 -- 172.21.15.86:0/3443729180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000b0760 msgr2=0x7fe1000b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3443729180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000b0760 0x7fe1000b0c00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe100071450 tx=0x7fe0ec009250 comp rx=0 tx=0).stop 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 -- 172.21.15.86:0/3443729180 shutdown_connections 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3443729180 >> v2:172.21.15.135:3300/0 conn(0x7fe1000ace60 0x7fe1000ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3443729180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000b0760 0x7fe1000b0c00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 -- 172.21.15.86:0/3443729180 >> 172.21.15.86:0/3443729180 conn(0x7fe100068e20 msgr2=0x7fe1000cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 -- 172.21.15.86:0/3443729180 shutdown_connections 2023-10-09T11:54:27.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.666+0000 7fe105b9d700 1 -- 172.21.15.86:0/3443729180 wait complete. 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.667+0000 7fe105b9d700 1 Processor -- start 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.667+0000 7fe105b9d700 1 -- start start 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.668+0000 7fe105b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000ace60 0x7fe1000a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.668+0000 7fe105b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1000b0760 0x7fe1001475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.668+0000 7fe105b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe100156350 0x7fe1000aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.668+0000 7fe105b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000a9070 con 0x7fe1000ace60 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.668+0000 7fe105b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000a8460 con 0x7fe1000b0760 2023-10-09T11:54:27.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.668+0000 7fe105b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000a8740 con 0x7fe100156350 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.668+0000 7fe104b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000ace60 0x7fe1000a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000ace60 0x7fe1000a7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41852/0 (socket says 172.21.15.86:41852) 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 -- 172.21.15.86:0/3787807307 learned_addr learned my addr 172.21.15.86:0/3787807307 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 -- 172.21.15.86:0/3787807307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe100156350 msgr2=0x7fe1000aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe100156350 0x7fe1000aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 -- 172.21.15.86:0/3787807307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1000b0760 msgr2=0x7fe1001475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1000b0760 0x7fe1001475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 -- 172.21.15.86:0/3787807307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0094f0 con 0x7fe1000ace60 2023-10-09T11:54:27.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe104b9b700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000ace60 0x7fe1000a7e80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b5e0 tx=0x7fe0f4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:27.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe0fcff9700 1 -- 172.21.15.86:0/3787807307 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400f510 con 0x7fe1000ace60 2023-10-09T11:54:27.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe0fcff9700 1 -- 172.21.15.86:0/3787807307 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f400f670 con 0x7fe1000ace60 2023-10-09T11:54:27.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1000a8a20 con 0x7fe1000ace60 2023-10-09T11:54:27.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe0fcff9700 1 -- 172.21.15.86:0/3787807307 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400fa30 con 0x7fe1000ace60 2023-10-09T11:54:27.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.669+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1000aaca0 con 0x7fe1000ace60 2023-10-09T11:54:27.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.670+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10004c3c0 con 0x7fe1000ace60 2023-10-09T11:54:27.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.671+0000 7fe0fcff9700 1 -- 172.21.15.86:0/3787807307 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 22) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fe0f401a400 con 0x7fe1000ace60 2023-10-09T11:54:27.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.673+0000 7fe0fcff9700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe0e4066dd0 0x7fe0e4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:27.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.673+0000 7fe0fcff9700 1 -- 172.21.15.86:0/3787807307 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fe0f4083fd0 con 0x7fe1000ace60 2023-10-09T11:54:27.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.673+0000 7fe0fffff700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe0e4066dd0 0x7fe0e4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:27.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.673+0000 7fe0fffff700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe0e4066dd0 0x7fe0e4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe100071450 tx=0x7fe0ec016000 comp rx=0 tx=0).ready entity=mgr.5916 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:27.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.677+0000 7fe0fcff9700 1 -- 172.21.15.86:0/3787807307 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0f4051310 con 0x7fe1000ace60 2023-10-09T11:54:27.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.891+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1000a91b0 con 0x7fe0e4066dd0 2023-10-09T11:54:27.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.958+0000 7fe0fcff9700 1 -- 172.21.15.86:0/3787807307 <== mgr.5916 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe0ec020070 con 0x7fe0e4066dd0 2023-10-09T11:54:27.958 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path snap_test_dir1 2023-10-09T11:54:27.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.960+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe0e4066dd0 msgr2=0x7fe0e4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:27.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.960+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe0e4066dd0 0x7fe0e4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe100071450 tx=0x7fe0ec016000 comp rx=0 tx=0).stop 2023-10-09T11:54:27.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.960+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000ace60 msgr2=0x7fe1000a7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:27.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.960+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000ace60 0x7fe1000a7e80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b5e0 tx=0x7fe0f4009120 comp rx=0 tx=0).stop 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.960+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 shutdown_connections 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.961+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fe0e4066dd0 0x7fe0e4069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.961+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1000ace60 0x7fe1000a7e80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.961+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe100156350 0x7fe1000aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.961+0000 7fe105b9d700 1 --2- 172.21.15.86:0/3787807307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1000b0760 0x7fe1001475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.961+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 >> 172.21.15.86:0/3787807307 conn(0x7fe100068e20 msgr2=0x7fe100069a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.961+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 shutdown_connections 2023-10-09T11:54:27.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:27.961+0000 7fe105b9d700 1 -- 172.21.15.86:0/3787807307 wait complete. 2023-10-09T11:54:27.978 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T11:54:27.978 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-11_55_00 in ~33s... 2023-10-09T11:54:27.978 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-11_56_00 in ~93s... 2023-10-09T11:54:27.978 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-10-09T11:54:27.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T11:54:28.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.164+0000 7f7386bff700 1 Processor -- start 2023-10-09T11:54:28.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.164+0000 7f7386bff700 1 -- start start 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.165+0000 7f7386bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f738015a440 0x7f73800acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.165+0000 7f7386bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7380068890 0x7f73800c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.165+0000 7f7386bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738015a9b0 con 0x7f73801563b0 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.165+0000 7f7386bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738015ac90 con 0x7f738015a440 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.165+0000 7f7386bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738015af70 con 0x7f7380068890 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f738015a440 0x7f73800acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f738015a440 0x7f73800acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41860/0 (socket says 172.21.15.86:41860) 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 -- 172.21.15.86:0/3119247019 learned_addr learned my addr 172.21.15.86:0/3119247019 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f738519c700 1 --2- 172.21.15.86:0/3119247019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7380068890 0x7f73800c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:28.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 -- 172.21.15.86:0/3119247019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7380068890 msgr2=0x7f73800c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 --2- 172.21.15.86:0/3119247019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7380068890 0x7f73800c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 -- 172.21.15.86:0/3119247019 >> v1:172.21.15.86:6789/0 conn(0x7f73801563b0 legacy=0x7f7380156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 -- 172.21.15.86:0/3119247019 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738015b250 con 0x7f738015a440 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737f7fe700 1 -- 172.21.15.86:0/3119247019 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200174421 0 0) 0x7f738015a9b0 con 0x7f73801563b0 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.166+0000 7f737ffff700 1 --2- 172.21.15.86:0/3119247019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f738015a440 0x7f73800acf30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f736c00bc50 tx=0x7f736c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636f684b409434eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f737f7fe700 1 -- 172.21.15.86:0/3119247019 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00be60 con 0x7f738015a440 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f737f7fe700 1 -- 172.21.15.86:0/3119247019 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c00de00 con 0x7f738015a440 2023-10-09T11:54:28.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f737f7fe700 1 -- 172.21.15.86:0/3119247019 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0196b0 con 0x7f738015a440 2023-10-09T11:54:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 -- 172.21.15.86:0/3119247019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f738015a440 msgr2=0x7f73800acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 --2- 172.21.15.86:0/3119247019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f738015a440 0x7f73800acf30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f736c00bc50 tx=0x7f736c00b4f0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 -- 172.21.15.86:0/3119247019 shutdown_connections 2023-10-09T11:54:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 --2- 172.21.15.86:0/3119247019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7380068890 0x7f73800c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 --2- 172.21.15.86:0/3119247019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f738015a440 0x7f73800acf30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 -- 172.21.15.86:0/3119247019 >> 172.21.15.86:0/3119247019 conn(0x7f73800c8f90 msgr2=0x7f73800c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 -- 172.21.15.86:0/3119247019 shutdown_connections 2023-10-09T11:54:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.167+0000 7f7386bff700 1 -- 172.21.15.86:0/3119247019 wait complete. 2023-10-09T11:54:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.169+0000 7f7386bff700 1 Processor -- start 2023-10-09T11:54:28.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.169+0000 7f7386bff700 1 -- start start 2023-10-09T11:54:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f7386bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7380068890 0x7f7380159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f7386bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73801563b0 0x7f7380150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f7386bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f738015a440 0x7f73800afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f7386bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380159d80 con 0x7f73801563b0 2023-10-09T11:54:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f7386bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73800cad60 con 0x7f7380068890 2023-10-09T11:54:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f7386bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73800ca750 con 0x7f738015a440 2023-10-09T11:54:28.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f737ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73801563b0 0x7f7380150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f737ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73801563b0 0x7f7380150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41864/0 (socket says 172.21.15.86:41864) 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f737ffff700 1 -- 172.21.15.86:0/1664236789 learned_addr learned my addr 172.21.15.86:0/1664236789 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f738519c700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f738015a440 0x7f73800afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.170+0000 7f738499b700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7380068890 0x7f7380159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737ffff700 1 -- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f738015a440 msgr2=0x7f73800afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737ffff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f738015a440 0x7f73800afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737ffff700 1 -- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7380068890 msgr2=0x7f7380159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737ffff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7380068890 0x7f7380159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737ffff700 1 -- 172.21.15.86:0/1664236789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c00b790 con 0x7f73801563b0 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737ffff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73801563b0 0x7f7380150070 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f73800bff50 tx=0x7f736c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:28.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c010540 con 0x7f73801563b0 2023-10-09T11:54:28.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c0106c0 con 0x7f73801563b0 2023-10-09T11:54:28.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c010a80 con 0x7f73801563b0 2023-10-09T11:54:28.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7380158f90 con 0x7f73801563b0 2023-10-09T11:54:28.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.171+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73800ca9f0 con 0x7f73801563b0 2023-10-09T11:54:28.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.172+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73800718b0 con 0x7f73801563b0 2023-10-09T11:54:28.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.173+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 22) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f736c022030 con 0x7f73801563b0 2023-10-09T11:54:28.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.174+0000 7f737cff9700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7364066dd0 0x7f7364069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:54:28.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.174+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f736c014070 con 0x7f73801563b0 2023-10-09T11:54:28.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.174+0000 7f738499b700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7364066dd0 0x7f7364069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:54:28.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.175+0000 7f738499b700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7364066dd0 0x7f7364069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73740011e0 tx=0x7f7374009040 comp rx=0 tx=0).ready entity=mgr.5916 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:54:28.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.178+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f736c055890 con 0x7f73801563b0 2023-10-09T11:54:28.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.386+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 23) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f736c055c60 con 0x7f73801563b0 2023-10-09T11:54:28.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.399+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f738006d6a0 con 0x7f7364066dd0 2023-10-09T11:54:28.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.407+0000 7f737cff9700 1 -- 172.21.15.86:0/1664236789 <== mgr.5916 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f738006d6a0 con 0x7f7364066dd0 2023-10-09T11:54:28.408 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:54:28.408 INFO:teuthology.orchestra.run.smithi086.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7364066dd0 msgr2=0x7f7364069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7364066dd0 0x7f7364069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73740011e0 tx=0x7f7374009040 comp rx=0 tx=0).stop 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73801563b0 msgr2=0x7f7380150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73801563b0 0x7f7380150070 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f73800bff50 tx=0x7f736c01b000 comp rx=0 tx=0).stop 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 shutdown_connections 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f738015a440 0x7f73800afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7380068890 0x7f7380159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f7364066dd0 0x7f7364069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 --2- 172.21.15.86:0/1664236789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73801563b0 0x7f7380150070 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:54:28.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 >> 172.21.15.86:0/1664236789 conn(0x7f73800c8f90 msgr2=0x7f73800ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:54:28.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 shutdown_connections 2023-10-09T11:54:28.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:54:28.410+0000 7f7386bff700 1 -- 172.21.15.86:0/1664236789 wait complete. 2023-10-09T11:54:28.428 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-09T11:54:28.428 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-10-09T11:54:28.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:28.428 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:28.466 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:28.466 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:28.467 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:29.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:29.467 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:29.508 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:29.508 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:29.509 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:30.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:30.509 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:30.552 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:30.552 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:30.552 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:31.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:31.553 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:31.596 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:31.596 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:31.596 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:32.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:32.597 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:32.640 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:32.640 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:32.640 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:33.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:33.641 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:33.684 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:33.684 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:33.684 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:34.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:34.684 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:34.727 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:34.727 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:34.727 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:35.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:35.728 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:35.771 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:35.771 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:35.771 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:36.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:36.772 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:36.814 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:36.814 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:36.814 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:37.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:37.816 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:37.861 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:37.861 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:37.861 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:38.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:38.862 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:38.904 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:38.904 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:38.904 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:39.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:39.906 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:39.948 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:39.948 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:39.948 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:40.202 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:54:40.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:54:40.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:40.949 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:40.991 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:40.991 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:40.991 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:41.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:41.992 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:42.034 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:42.034 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:42.035 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:43.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:43.035 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:43.078 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:43.078 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:43.078 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:44.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:44.079 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:44.121 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:44.121 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:44.122 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:45.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:45.123 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:45.166 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:45.166 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:45.166 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:46.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:46.168 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:46.210 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:46.210 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:46.210 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:47.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:47.211 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:47.254 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:47.254 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:47.254 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:48.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:48.256 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:48.299 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:48.299 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:48.299 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:49.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:49.300 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:49.343 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:49.343 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:49.343 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:50.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:50.344 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:50.387 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:50.387 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:50.387 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:51.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:51.388 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:51.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:51.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:51.431 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:52.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:52.433 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:52.475 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:52.475 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:52.475 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:53.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:53.476 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:53.518 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:53.518 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:53.518 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:54.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:54.519 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:54.562 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:54.562 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:54.562 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:55.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:55.563 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:55.605 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:55.606 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:55.606 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:56.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:56.606 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:56.650 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:56.650 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:56.650 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:57.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:57.651 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:57.693 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:57.693 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:57.693 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:58.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:58.695 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:58.737 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:58.737 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:58.737 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:54:59.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:54:59.738 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:54:59.780 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:54:59.780 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:54:59.780 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:00.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:00.781 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:00.824 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:55:00.825 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:00.825 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:00.971 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:55:00.971+0000 7f53c7055700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:55:00.971 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:55:00.971+0000 7f53c7055700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:55:00.971 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:55:00.971+0000 7f53c7055700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:55:00.971 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:55:00.971+0000 7f53c7055700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:55:00.971 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:55:00.971+0000 7f53c7055700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:55:01.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:01.826 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:01.869 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:01.870 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:01.870 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:01.870 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:01.870 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-11_55_00_UTC'] 2023-10-09T11:55:01.870 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696852467.978635, now = 1696852501.870603, timo = 33 2023-10-09T11:55:02.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:02.871 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:02.912 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:02.913 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:02.914 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:02.914 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:03.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:03.915 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:03.956 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:03.957 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:03.957 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:03.957 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:04.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:04.958 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:04.999 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:05.000 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:05.000 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:05.000 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:06.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:06.002 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:06.043 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:06.044 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:06.044 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:06.044 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:07.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:07.046 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:07.095 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:07.096 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:07.096 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:07.097 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:08.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:08.098 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:08.142 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:08.143 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:08.143 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:08.143 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:09.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:09.144 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:09.185 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:09.186 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:09.186 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:09.186 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:10.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:10.187 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:10.229 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:10.230 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:10.230 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:10.230 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:10.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:55:10.340 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:55:11.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:11.231 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:11.272 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:11.273 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:11.273 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:11.274 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:12.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:12.274 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:12.316 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:12.317 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:12.317 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:12.317 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:13.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:13.318 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:13.359 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:13.360 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:13.360 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:13.360 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:14.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:14.362 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:14.403 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:14.404 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:14.404 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:14.404 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:15.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:15.406 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:15.446 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:15.448 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:15.448 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:15.448 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:16.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:16.449 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:16.490 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:16.491 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:16.491 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:16.491 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:17.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:17.492 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:17.533 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:17.534 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:17.534 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:17.534 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:18.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:18.536 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:18.577 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:18.578 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:18.578 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:18.578 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:19.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:19.579 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:19.620 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:19.621 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:19.621 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:19.621 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:20.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:20.622 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:20.664 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:20.665 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:20.665 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:20.665 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:21.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:21.666 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:21.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:21.708 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:21.708 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:21.708 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:22.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:22.709 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:22.751 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:22.752 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:22.752 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:22.752 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:23.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:23.753 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:23.794 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:23.795 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:23.795 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:23.795 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:24.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:24.797 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:24.839 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:24.840 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:24.841 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:24.841 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:25.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:25.841 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:25.884 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:25.885 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:25.885 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:25.885 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:26.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:26.886 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:26.927 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:26.928 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:26.928 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:26.929 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:27.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:27.930 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:27.973 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:27.974 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:27.974 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:27.974 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:28.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:28.975 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:29.018 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:29.019 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:29.019 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:29.019 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:30.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:30.021 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:30.062 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:30.063 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:30.063 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:30.063 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:31.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:31.065 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:31.106 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:31.107 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:31.107 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:31.107 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:32.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:32.109 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:32.150 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:32.151 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:32.151 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:32.151 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:33.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:33.153 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:33.194 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:33.195 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:33.195 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:33.195 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:34.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:34.196 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:34.237 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:34.238 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:34.238 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:34.239 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:35.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:35.240 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:35.281 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:35.282 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:35.283 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:35.283 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:36.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:36.284 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:36.326 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:36.327 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:36.327 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:36.327 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:37.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:37.328 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:37.369 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:37.370 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:37.370 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:37.370 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:38.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:38.372 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:38.413 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:38.414 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:38.414 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:38.414 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:39.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:39.415 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:39.456 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:39.457 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:39.457 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:39.457 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:40.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:40.459 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:40.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:55:40.501 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:40.501 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:40.502 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:40.502 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:40.504 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:55:41.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:41.503 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:41.544 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:41.545 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:41.546 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:41.546 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:42.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:42.547 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:42.588 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:42.589 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:42.589 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:42.590 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:43.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:43.590 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:43.632 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:43.633 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:43.633 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:43.633 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:44.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:44.634 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:44.676 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:44.677 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:44.677 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:44.677 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:45.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:45.678 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:45.719 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:45.720 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:45.720 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:45.720 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:46.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:46.721 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:46.763 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:46.764 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:46.764 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:46.764 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:47.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:47.765 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:47.805 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:47.806 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:47.807 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:47.807 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:48.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:48.808 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:48.850 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:48.851 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:48.851 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:48.851 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:49.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:49.852 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:49.894 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:49.895 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:49.895 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:49.895 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:50.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:50.896 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:50.938 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:50.939 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:50.939 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:50.939 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:51.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:51.940 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:51.982 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:51.983 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:51.983 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:51.983 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:52.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:52.985 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:53.026 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:53.027 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:53.027 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:53.027 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:54.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:54.028 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:54.072 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:54.073 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:54.073 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:54.073 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:55.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:55.074 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:55.116 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:55.117 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:55.117 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:55.117 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:56.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:56.118 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:56.160 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:56.161 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:56.161 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:56.161 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:57.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:57.162 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:57.203 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:57.204 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:57.204 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:57.204 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:58.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:58.206 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:58.247 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:58.248 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:58.248 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:58.248 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:55:59.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:55:59.250 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:55:59.291 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:55:59.292 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:55:59.292 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:55:59.293 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:56:00.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:00.294 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:56:00.334 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:56:00.334 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_56_00_UTC 2023-10-09T11:56:00.335 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-11_56_00_UTC', 'scheduled-2023-10-09-11_55_00_UTC'} 2023-10-09T11:56:00.335 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-11_56_00_UTC'} 2023-10-09T11:56:00.335 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:56:00.335 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-11_56_00_UTC'] 2023-10-09T11:56:00.336 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696852467.978635, now = 1696852560.3360388, timo = 93 2023-10-09T11:56:01.336 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T11:56:01.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.532+0000 7ff58bfff700 1 Processor -- start 2023-10-09T11:56:01.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.532+0000 7ff58bfff700 1 -- start start 2023-10-09T11:56:01.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.533+0000 7ff58bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff58c159dc0 0x7ff58c160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.533+0000 7ff58bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c15a480 con 0x7ff58c153850 2023-10-09T11:56:01.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.533+0000 7ff58bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0afb40 con 0x7ff58c153480 2023-10-09T11:56:01.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.533+0000 7ff58bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58c0afe20 con 0x7ff58c159dc0 2023-10-09T11:56:01.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.533+0000 7ff583fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff58c153850 0x7ff58c1596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52360/0 (socket says 172.21.15.86:52360) 2023-10-09T11:56:01.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.533+0000 7ff583fff700 1 -- 172.21.15.86:0/769664048 learned_addr learned my addr 172.21.15.86:0/769664048 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:01.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/769664048 >> v2:172.21.15.135:3300/0 conn(0x7ff58c159dc0 0x7ff58c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310686774 0 0) 0x7ff58c15a480 con 0x7ff58c153850 2023-10-09T11:56:01.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff578003570 con 0x7ff58c153850 2023-10-09T11:56:01.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033871556 0 0) 0x7ff58c0afb40 con 0x7ff58c153480 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff58c15a480 con 0x7ff58c153480 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096475323 0 0) 0x7ff578003570 con 0x7ff58c153850 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 >> v2:172.21.15.135:3300/0 conn(0x7ff58c159dc0 msgr2=0x7ff58c160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 --2- 172.21.15.86:0/769664048 >> v2:172.21.15.135:3300/0 conn(0x7ff58c159dc0 0x7ff58c160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 >> v1:172.21.15.135:6789/0 conn(0x7ff58c153480 legacy=0x7ff58c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0b0100 con 0x7ff58c153850 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7ff574001470 con 0x7ff58c153850 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/769664048 >> v2:172.21.15.135:3300/0 conn(0x7ff58c159dc0 0x7ff58c160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:01.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 >> v1:172.21.15.86:6789/0 conn(0x7ff58c153850 legacy=0x7ff58c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578003c40 0x7ff578004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff578004810 0x7ff578004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff578005210 0x7ff57800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0afe20 con 0x7ff578005210 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800c130 con 0x7ff578004810 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.534+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57800e4d0 con 0x7ff578003c40 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff578005210 0x7ff57800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff583fff700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff578004810 0x7ff578004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58affd700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578003c40 0x7ff578004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 -- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578003c40 msgr2=0x7ff578004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578003c40 0x7ff578004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 -- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff578004810 msgr2=0x7ff578004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff578004810 0x7ff578004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 -- 172.21.15.86:0/769664048 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578003570 con 0x7ff578005210 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 -- 172.21.15.86:0/769664048 reap_dead start 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff578005210 0x7ff57800ba60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff58c064670 tx=0x7ff58400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948e88bbe12e1e45 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.535+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400f040 con 0x7ff578005210 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584007dc0 con 0x7ff578005210 2023-10-09T11:56:01.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58a7fc700 1 -- 172.21.15.86:0/769664048 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400a2e0 con 0x7ff578005210 2023-10-09T11:56:01.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58bfff700 1 -- 172.21.15.86:0/769664048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff578005210 msgr2=0x7ff57800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:01.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58bfff700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff578005210 0x7ff57800ba60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff58c064670 tx=0x7ff58400a890 comp rx=0 tx=0).stop 2023-10-09T11:56:01.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58bfff700 1 -- 172.21.15.86:0/769664048 shutdown_connections 2023-10-09T11:56:01.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58bfff700 1 --2- 172.21.15.86:0/769664048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff578005210 0x7ff57800ba60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58bfff700 1 -- 172.21.15.86:0/769664048 >> 172.21.15.86:0/769664048 conn(0x7ff58c068e20 msgr2=0x7ff58c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:01.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58bfff700 1 -- 172.21.15.86:0/769664048 shutdown_connections 2023-10-09T11:56:01.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.536+0000 7ff58bfff700 1 -- 172.21.15.86:0/769664048 wait complete. 2023-10-09T11:56:01.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.537+0000 7ff58bfff700 1 Processor -- start 2023-10-09T11:56:01.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.538+0000 7ff58bfff700 1 -- start start 2023-10-09T11:56:01.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578005210 0x7ff58c0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58c16a830 0x7ff58c0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c16cc60 0x7ff58c16d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c16d640 con 0x7ff58c16cc60 2023-10-09T11:56:01.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c14d9f0 con 0x7ff58c16a830 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0cb550 con 0x7ff578005210 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c16cc60 0x7ff58c16d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c16cc60 0x7ff58c16d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60398/0 (socket says 172.21.15.86:60398) 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 -- 172.21.15.86:0/2513684641 learned_addr learned my addr 172.21.15.86:0/2513684641 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58affd700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578005210 0x7ff58c0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff583fff700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58c16a830 0x7ff58c0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 -- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578005210 msgr2=0x7ff58c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578005210 0x7ff58c0c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 -- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58c16a830 msgr2=0x7ff58c0c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58c16a830 0x7ff58c0c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.539+0000 7ff58b7fe700 1 -- 172.21.15.86:0/2513684641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0c79d0 con 0x7ff58c16cc60 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.540+0000 7ff58b7fe700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c16cc60 0x7ff58c16d100 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0af490 tx=0x7ff584016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.540+0000 7ff582ffd700 1 -- 172.21.15.86:0/2513684641 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400f030 con 0x7ff58c16cc60 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.540+0000 7ff582ffd700 1 -- 172.21.15.86:0/2513684641 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58400ad60 con 0x7ff58c16cc60 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.540+0000 7ff582ffd700 1 -- 172.21.15.86:0/2513684641 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58401c850 con 0x7ff58c16cc60 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.540+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c0c7cb0 con 0x7ff58c16cc60 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.540+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c166f70 con 0x7ff58c16cc60 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.541+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c14db80 con 0x7ff58c16cc60 2023-10-09T11:56:01.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.542+0000 7ff582ffd700 1 -- 172.21.15.86:0/2513684641 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) v1 ==== 84871+0+0 (secure 0 0 0) 0x7ff584003040 con 0x7ff58c16cc60 2023-10-09T11:56:01.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.542+0000 7ff582ffd700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7ff56c0670a0 0x7ff56c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:01.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.543+0000 7ff582ffd700 1 -- 172.21.15.86:0/2513684641 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6369+0+0 (secure 0 0 0) 0x7ff5840861c0 con 0x7ff58c16cc60 2023-10-09T11:56:01.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.543+0000 7ff58affd700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7ff56c0670a0 0x7ff56c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:01.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.543+0000 7ff58affd700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7ff56c0670a0 0x7ff56c069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0010e0 tx=0x7ff57c007d30 comp rx=0 tx=0).ready entity=mgr.5916 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:01.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.547+0000 7ff582ffd700 1 -- 172.21.15.86:0/2513684641 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff584052ed0 con 0x7ff58c16cc60 2023-10-09T11:56:01.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.762+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 --> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff58c04c3c0 con 0x7ff56c0670a0 2023-10-09T11:56:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.826+0000 7ff582ffd700 1 -- 172.21.15.86:0/2513684641 <== mgr.5916 v2:172.21.15.86:6835/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff58c04c3c0 con 0x7ff56c0670a0 2023-10-09T11:56:01.827 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path snap_test_dir1 2023-10-09T11:56:01.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7ff56c0670a0 msgr2=0x7ff56c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:01.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7ff56c0670a0 0x7ff56c069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0010e0 tx=0x7ff57c007d30 comp rx=0 tx=0).stop 2023-10-09T11:56:01.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c16cc60 msgr2=0x7ff58c16d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:01.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c16cc60 0x7ff58c16d100 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0af490 tx=0x7ff584016000 comp rx=0 tx=0).stop 2023-10-09T11:56:01.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 shutdown_connections 2023-10-09T11:56:01.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7ff56c0670a0 0x7ff56c069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c16cc60 0x7ff58c16d100 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff578005210 0x7ff58c0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 --2- 172.21.15.86:0/2513684641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58c16a830 0x7ff58c0c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:01.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 >> 172.21.15.86:0/2513684641 conn(0x7ff58c068e20 msgr2=0x7ff58c1587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:01.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 shutdown_connections 2023-10-09T11:56:01.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:01.829+0000 7ff58bfff700 1 -- 172.21.15.86:0/2513684641 wait complete. 2023-10-09T11:56:01.847 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T11:56:01.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:01.848 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:56:01.884 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:56:01.884 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-11_56_00_UTC 2023-10-09T11:56:01.885 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-11_55_00_UTC 2023-10-09T11:56:01.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:01.886 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-11_55_00_UTC) 2023-10-09T11:56:01.967 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-11_56_00_UTC 2023-10-09T11:56:01.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:01.968 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-11_56_00_UTC) 2023-10-09T11:56:02.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:02.050 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T11:56:02.129 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T11:56:02.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.352+0000 7f6a9d79d700 1 Processor -- start 2023-10-09T11:56:02.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.352+0000 7f6a9d79d700 1 -- start start 2023-10-09T11:56:02.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.353+0000 7f6a9d79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 0x7f6a980ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.353+0000 7f6a9d79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a980cfb00 con 0x7f6a980b16d0 2023-10-09T11:56:02.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.353+0000 7f6a9d79d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9815e060 con 0x7f6a980b1b40 2023-10-09T11:56:02.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.353+0000 7f6a9d79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980b5c40 con 0x7f6a980b4e70 2023-10-09T11:56:02.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a977fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6a980b16d0 0x7f6a9815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52364/0 (socket says 172.21.15.86:52364) 2023-10-09T11:56:02.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a977fe700 1 -- 172.21.15.86:0/1028087579 learned_addr learned my addr 172.21.15.86:0/1028087579 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a97fff700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 0x7f6a980ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666476119 0 0) 0x7f6a980cfb00 con 0x7f6a980b16d0 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a80003570 con 0x7f6a980b16d0 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198563953 0 0) 0x7f6a80003570 con 0x7f6a980b16d0 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 msgr2=0x7f6a980ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 0x7f6a980ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 >> v1:172.21.15.135:6789/0 conn(0x7f6a980b1b40 legacy=0x7f6a9815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:02.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980b5f20 con 0x7f6a980b16d0 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f6a8c001470 con 0x7f6a980b16d0 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.354+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 >> v1:172.21.15.86:6789/0 conn(0x7f6a980b16d0 legacy=0x7f6a9815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a96ffd700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a80003a90 0x7f6a80003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a96ffd700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a96ffd700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 0x7f6a800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980b5c40 con 0x7f6a80004810 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8000bb10 con 0x7f6a80003a90 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8000bcd0 con 0x7f6a980b4e70 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a977fe700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:02.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a97fff700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a80003a90 0x7f6a80003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a9cf9c700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 0x7f6a800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a977fe700 1 -- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 msgr2=0x7f6a800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a977fe700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980b4e70 0x7f6a800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a977fe700 1 -- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a80003a90 msgr2=0x7f6a80003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a977fe700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a80003a90 0x7f6a80003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a977fe700 1 -- 172.21.15.86:0/1028087579 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80003570 con 0x7f6a80004810 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.355+0000 7f6a977fe700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a80004c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00c3c0 tx=0x7f6a8c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894281f135ba3b00 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00cc90 con 0x7f6a80004810 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00cdf0 con 0x7f6a80004810 2023-10-09T11:56:02.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a96ffd700 1 -- 172.21.15.86:0/1028087579 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c005b70 con 0x7f6a80004810 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1028087579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 msgr2=0x7f6a80004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a9d79d700 1 --2- 172.21.15.86:0/1028087579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a80004c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00c3c0 tx=0x7f6a8c001e70 comp rx=0 tx=0).stop 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a9cf9c700 1 -- 172.21.15.86:0/1028087579 reap_dead start 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1028087579 shutdown_connections 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1028087579 >> 172.21.15.86:0/1028087579 conn(0x7f6a980d10c0 msgr2=0x7f6a980affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1028087579 shutdown_connections 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.356+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1028087579 wait complete. 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.358+0000 7f6a9d79d700 1 Processor -- start 2023-10-09T11:56:02.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.358+0000 7f6a9d79d700 1 -- start start 2023-10-09T11:56:02.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a9d79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a98144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a9d79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980ca660 0x7f6a980caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a9d79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a980c5550 0x7f6a980c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a9d79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980c7c70 con 0x7f6a80004810 2023-10-09T11:56:02.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a9d79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980cb010 con 0x7f6a980c5550 2023-10-09T11:56:02.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a9d79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980c6280 con 0x7f6a980ca660 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a98144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a98144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60412/0 (socket says 172.21.15.86:60412) 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 -- 172.21.15.86:0/1854987864 learned_addr learned my addr 172.21.15.86:0/1854987864 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 -- 172.21.15.86:0/1854987864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980ca660 msgr2=0x7f6a980caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980ca660 0x7f6a980caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 -- 172.21.15.86:0/1854987864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a980c5550 msgr2=0x7f6a980c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a980c5550 0x7f6a980c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 -- 172.21.15.86:0/1854987864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980c6560 con 0x7f6a80004810 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.359+0000 7f6a97fff700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a98144780 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6a88011d40 tx=0x7f6a880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:02.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.360+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800fac0 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.360+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800fc20 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.360+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88014440 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.360+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a980c6840 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.360+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a980c5ee0 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.361+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a980c7f50 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.362+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f6a88014a80 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.363+0000 7f6a7ffff700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a840670a0 0x7f6a84069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.363+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6369+0+0 (secure 0 0 0) 0x7f6a88018030 con 0x7f6a80004810 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.363+0000 7f6a977fe700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a840670a0 0x7f6a84069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:02.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.364+0000 7f6a977fe700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a840670a0 0x7f6a84069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a9814b7c0 tx=0x7f6a8c015000 comp rx=0 tx=0).ready entity=mgr.5916 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:02.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.367+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a880525f0 con 0x7f6a80004810 2023-10-09T11:56:02.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:02.611+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f6a980cd4a0 con 0x7f6a80004810 2023-10-09T11:56:03.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.315+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6a88083d50 con 0x7f6a80004810 2023-10-09T11:56:03.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.316+0000 7f6a7ffff700 1 -- 172.21.15.86:0/1854987864 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v26) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6a880525f0 con 0x7f6a80004810 2023-10-09T11:56:03.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a840670a0 msgr2=0x7f6a84069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:03.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a840670a0 0x7f6a84069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a9814b7c0 tx=0x7f6a8c015000 comp rx=0 tx=0).stop 2023-10-09T11:56:03.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 msgr2=0x7f6a98144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:03.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a98144780 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6a88011d40 tx=0x7f6a880091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 shutdown_connections 2023-10-09T11:56:03.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a840670a0 0x7f6a84069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a80004810 0x7f6a98144780 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a980c5550 0x7f6a980c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 --2- 172.21.15.86:0/1854987864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a980ca660 0x7f6a980caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 >> 172.21.15.86:0/1854987864 conn(0x7f6a980d10c0 msgr2=0x7f6a98156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:03.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.319+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 shutdown_connections 2023-10-09T11:56:03.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.320+0000 7f6a9d79d700 1 -- 172.21.15.86:0/1854987864 wait complete. 2023-10-09T11:56:03.341 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:56:03.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:03.433 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:03.513 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:56:03.513 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:56:03.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:03.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:56:03.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:56:03.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:03.602 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:56:03.639 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.864+0000 7f6da9f9d700 1 Processor -- start 2023-10-09T11:56:03.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.864+0000 7f6da9f9d700 1 -- start start 2023-10-09T11:56:03.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.865+0000 7f6da9f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6da40ad870 0x7f6da406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:03.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.865+0000 7f6da9f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da406bf20 0x7f6da406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:03.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.865+0000 7f6da9f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40b40f0 con 0x7f6da4142ea0 2023-10-09T11:56:03.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.865+0000 7f6da9f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da406c3a0 con 0x7f6da40ad870 2023-10-09T11:56:03.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.865+0000 7f6da9f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4069640 con 0x7f6da406bf20 2023-10-09T11:56:03.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.865+0000 7f6da8f9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6da4142ea0 0x7f6da40b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52382/0 (socket says 172.21.15.86:52382) 2023-10-09T11:56:03.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.865+0000 7f6da8f9b700 1 -- 172.21.15.86:0/2571504226 learned_addr learned my addr 172.21.15.86:0/2571504226 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da3fff700 1 --2- 172.21.15.86:0/2571504226 >> v2:172.21.15.135:3300/0 conn(0x7f6da40ad870 0x7f6da406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da979c700 1 --2- 172.21.15.86:0/2571504226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da406bf20 0x7f6da406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da37fe700 1 -- 172.21.15.86:0/2571504226 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807854823 0 0) 0x7f6da40b40f0 con 0x7f6da4142ea0 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da37fe700 1 -- 172.21.15.86:0/2571504226 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d94003570 con 0x7f6da4142ea0 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da979c700 1 -- 172.21.15.86:0/2571504226 >> v2:172.21.15.135:3300/0 conn(0x7f6da40ad870 msgr2=0x7f6da406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da979c700 1 --2- 172.21.15.86:0/2571504226 >> v2:172.21.15.135:3300/0 conn(0x7f6da40ad870 0x7f6da406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da979c700 1 -- 172.21.15.86:0/2571504226 >> v1:172.21.15.86:6789/0 conn(0x7f6da4142ea0 legacy=0x7f6da40b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da979c700 1 -- 172.21.15.86:0/2571504226 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4069920 con 0x7f6da406bf20 2023-10-09T11:56:03.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.866+0000 7f6da979c700 1 --2- 172.21.15.86:0/2571504226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da406bf20 0x7f6da406a120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009e60 tx=0x7f6d9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb2e5712d21e2f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:03.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da37fe700 1 -- 172.21.15.86:0/2571504226 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00e070 con 0x7f6da406bf20 2023-10-09T11:56:03.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da37fe700 1 -- 172.21.15.86:0/2571504226 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00bab0 con 0x7f6da406bf20 2023-10-09T11:56:03.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da37fe700 1 -- 172.21.15.86:0/2571504226 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00be70 con 0x7f6da406bf20 2023-10-09T11:56:03.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 -- 172.21.15.86:0/2571504226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da406bf20 msgr2=0x7f6da406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:03.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/2571504226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da406bf20 0x7f6da406a120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009e60 tx=0x7f6d9c009780 comp rx=0 tx=0).stop 2023-10-09T11:56:03.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 -- 172.21.15.86:0/2571504226 shutdown_connections 2023-10-09T11:56:03.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/2571504226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da406bf20 0x7f6da406a120 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/2571504226 >> v2:172.21.15.135:3300/0 conn(0x7f6da40ad870 0x7f6da406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 -- 172.21.15.86:0/2571504226 >> 172.21.15.86:0/2571504226 conn(0x7f6da40ce430 msgr2=0x7f6da40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:03.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 -- 172.21.15.86:0/2571504226 shutdown_connections 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.867+0000 7f6da9f9d700 1 -- 172.21.15.86:0/2571504226 wait complete. 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.869+0000 7f6da9f9d700 1 Processor -- start 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.869+0000 7f6da9f9d700 1 -- start start 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da9f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da406bf20 0x7f6da40c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da9f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4142ea0 0x7f6da415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da9f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6da415d410 0x7f6da4169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da9f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c8bf0 con 0x7f6da415d410 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da9f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41407f0 con 0x7f6da406bf20 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da9f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c7d00 con 0x7f6da4142ea0 2023-10-09T11:56:03.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6da415d410 0x7f6da4169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6da415d410 0x7f6da4169a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60424/0 (socket says 172.21.15.86:60424) 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da979c700 1 -- 172.21.15.86:0/4082282664 learned_addr learned my addr 172.21.15.86:0/4082282664 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da3fff700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4142ea0 0x7f6da415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.870+0000 7f6da8f9b700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da406bf20 0x7f6da40c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da979c700 1 -- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4142ea0 msgr2=0x7f6da415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da979c700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4142ea0 0x7f6da415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da979c700 1 -- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da406bf20 msgr2=0x7f6da40c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da979c700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da406bf20 0x7f6da40c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:03.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da979c700 1 -- 172.21.15.86:0/4082282664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009a20 con 0x7f6da415d410 2023-10-09T11:56:03.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da979c700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6da415d410 0x7f6da4169a80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6da406f0d0 tx=0x7f6d9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:03.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da0ff9700 1 -- 172.21.15.86:0/4082282664 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c012e10 con 0x7f6da415d410 2023-10-09T11:56:03.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da0ff9700 1 -- 172.21.15.86:0/4082282664 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c027470 con 0x7f6da415d410 2023-10-09T11:56:03.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da0ff9700 1 -- 172.21.15.86:0/4082282664 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c027830 con 0x7f6da415d410 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da40c7fe0 con 0x7f6da415d410 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.871+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da40c85a0 con 0x7f6da415d410 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.872+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da40c8da0 con 0x7f6da415d410 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.873+0000 7f6da0ff9700 1 -- 172.21.15.86:0/4082282664 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6d9c024070 con 0x7f6da415d410 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.875+0000 7f6da0ff9700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 0x7f6d88069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.875+0000 7f6da8f9b700 1 -- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 msgr2=0x7f6d88069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.875+0000 7f6da0ff9700 1 -- 172.21.15.86:0/4082282664 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6369+0+0 (secure 0 0 0) 0x7f6d9c0873e0 con 0x7f6da415d410 2023-10-09T11:56:03.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.875+0000 7f6da8f9b700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 0x7f6d88069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:03.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:03.879+0000 7f6da0ff9700 1 -- 172.21.15.86:0/4082282664 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6da40c8da0 con 0x7f6da415d410 2023-10-09T11:56:04.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.076+0000 7f6da8f9b700 1 -- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 msgr2=0x7f6d88069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:04.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.076+0000 7f6da8f9b700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 0x7f6d88069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:04.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.125+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6da404c3c0 con 0x7f6da415d410 2023-10-09T11:56:04.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.126+0000 7f6da0ff9700 1 -- 172.21.15.86:0/4082282664 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f6d9c054200 con 0x7f6da415d410 2023-10-09T11:56:04.127 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:04.127 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/569752766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":569752766},{"type":"v1","addr":"172.21.15.135:6834","nonce":569752766}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/312603704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":312603704},{"type":"v1","addr":"172.21.15.135:6835","nonce":312603704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/4036553983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":4036553983},{"type":"v1","addr":"172.21.15.86:6833","nonce":4036553983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:54:05.279420+0000","modified":"2023-10-09T11:54:09.221890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6836/3777239940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3777239940},{"type":"v1","addr":"172.21.15.86:6836","nonce":3777239940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:56:04.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 msgr2=0x7f6d88069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:04.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 0x7f6d88069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6da415d410 msgr2=0x7f6da4169a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6da415d410 0x7f6da4169a80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6da406f0d0 tx=0x7f6d9c019000 comp rx=0 tx=0).stop 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 shutdown_connections 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6d88067050 0x7f6d88069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6da415d410 0x7f6da4169a80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6da406bf20 0x7f6da40c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 --2- 172.21.15.86:0/4082282664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6da4142ea0 0x7f6da415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 >> 172.21.15.86:0/4082282664 conn(0x7f6da40ce430 msgr2=0x7f6da40cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.128+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 shutdown_connections 2023-10-09T11:56:04.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.129+0000 7f6da9f9d700 1 -- 172.21.15.86:0/4082282664 wait complete. 2023-10-09T11:56:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2023-10-09T11:56:04.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:04.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.335+0000 7fa95bfff700 1 Processor -- start 2023-10-09T11:56:04.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.335+0000 7fa95bfff700 1 -- start start 2023-10-09T11:56:04.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa95c142ea0 0x7fa95c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0ad870 0x7fa95c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95c0b40f0 con 0x7fa95c0b3b70 2023-10-09T11:56:04.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95bfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95c069640 con 0x7fa95c142ea0 2023-10-09T11:56:04.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c069920 con 0x7fa95c0ad870 2023-10-09T11:56:04.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa95c142ea0 0x7fa95c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa95c0b3b70 0x7fa95c06cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52392/0 (socket says 172.21.15.86:52392) 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.336+0000 7fa95b7fe700 1 -- 172.21.15.86:0/1357600105 learned_addr learned my addr 172.21.15.86:0/1357600105 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa95a7fc700 1 --2- 172.21.15.86:0/1357600105 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0ad870 0x7fa95c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa959ffb700 1 -- 172.21.15.86:0/1357600105 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013605883 0 0) 0x7fa95c0b40f0 con 0x7fa95c0b3b70 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa959ffb700 1 -- 172.21.15.86:0/1357600105 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa944003570 con 0x7fa95c0b3b70 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa95affd700 1 -- 172.21.15.86:0/1357600105 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0ad870 msgr2=0x7fa95c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa95affd700 1 --2- 172.21.15.86:0/1357600105 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0ad870 0x7fa95c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa95affd700 1 -- 172.21.15.86:0/1357600105 >> v1:172.21.15.86:6789/0 conn(0x7fa95c0b3b70 legacy=0x7fa95c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa95affd700 1 -- 172.21.15.86:0/1357600105 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c069c00 con 0x7fa95c142ea0 2023-10-09T11:56:04.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.337+0000 7fa95affd700 1 --2- 172.21.15.86:0/1357600105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c142ea0 0x7fa95c0b3630 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0098e0 tx=0x7fa94c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa42342737d71cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:04.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa959ffb700 1 -- 172.21.15.86:0/1357600105 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c011630 con 0x7fa95c142ea0 2023-10-09T11:56:04.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa959ffb700 1 -- 172.21.15.86:0/1357600105 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c011790 con 0x7fa95c142ea0 2023-10-09T11:56:04.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa959ffb700 1 -- 172.21.15.86:0/1357600105 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c011b30 con 0x7fa95c142ea0 2023-10-09T11:56:04.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 -- 172.21.15.86:0/1357600105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c142ea0 msgr2=0x7fa95c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 --2- 172.21.15.86:0/1357600105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c142ea0 0x7fa95c0b3630 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0098e0 tx=0x7fa94c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 -- 172.21.15.86:0/1357600105 shutdown_connections 2023-10-09T11:56:04.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 --2- 172.21.15.86:0/1357600105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c142ea0 0x7fa95c0b3630 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 --2- 172.21.15.86:0/1357600105 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0ad870 0x7fa95c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 -- 172.21.15.86:0/1357600105 >> 172.21.15.86:0/1357600105 conn(0x7fa95c0ce430 msgr2=0x7fa95c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 -- 172.21.15.86:0/1357600105 shutdown_connections 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.338+0000 7fa95bfff700 1 -- 172.21.15.86:0/1357600105 wait complete. 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.340+0000 7fa95bfff700 1 Processor -- start 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.340+0000 7fa95bfff700 1 -- start start 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0b3b70 0x7fa95c16a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c142ea0 0x7fa95c0aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c158f70 0x7fa95c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c0c9460 con 0x7fa95c158f70 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c16a930 con 0x7fa95c142ea0 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c0c8820 con 0x7fa95c0b3b70 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c158f70 0x7fa95c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c158f70 0x7fa95c15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60448/0 (socket says 172.21.15.86:60448) 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 -- 172.21.15.86:0/4120062539 learned_addr learned my addr 172.21.15.86:0/4120062539 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95a7fc700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c142ea0 0x7fa95c0aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95affd700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0b3b70 0x7fa95c16a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 -- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0b3b70 msgr2=0x7fa95c16a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0b3b70 0x7fa95c16a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 -- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c142ea0 msgr2=0x7fa95c0aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c142ea0 0x7fa95c0aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.341+0000 7fa95b7fe700 1 -- 172.21.15.86:0/4120062539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c009420 con 0x7fa95c158f70 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.342+0000 7fa95b7fe700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c158f70 0x7fa95c15a720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa954001460 tx=0x7fa954001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.342+0000 7fa942ffd700 1 -- 172.21.15.86:0/4120062539 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95400a890 con 0x7fa95c158f70 2023-10-09T11:56:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.342+0000 7fa942ffd700 1 -- 172.21.15.86:0/4120062539 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95400a9f0 con 0x7fa95c158f70 2023-10-09T11:56:04.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.342+0000 7fa942ffd700 1 -- 172.21.15.86:0/4120062539 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95400ad70 con 0x7fa95c158f70 2023-10-09T11:56:04.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.342+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95c0c8e10 con 0x7fa95c158f70 2023-10-09T11:56:04.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.342+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95c0af300 con 0x7fa95c158f70 2023-10-09T11:56:04.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.343+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95c0c8c70 con 0x7fa95c158f70 2023-10-09T11:56:04.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.344+0000 7fa942ffd700 1 -- 172.21.15.86:0/4120062539 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa954007300 con 0x7fa95c158f70 2023-10-09T11:56:04.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.345+0000 7fa942ffd700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 0x7fa948069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.345+0000 7fa942ffd700 1 -- 172.21.15.86:0/4120062539 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6369+0+0 (secure 0 0 0) 0x7fa954084e70 con 0x7fa95c158f70 2023-10-09T11:56:04.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.346+0000 7fa95affd700 1 -- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 msgr2=0x7fa948069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:04.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.346+0000 7fa95affd700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 0x7fa948069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:04.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.349+0000 7fa942ffd700 1 -- 172.21.15.86:0/4120062539 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa95c0c8c70 con 0x7fa95c158f70 2023-10-09T11:56:04.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.547+0000 7fa95affd700 1 -- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 msgr2=0x7fa948069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:04.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.547+0000 7fa95affd700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 0x7fa948069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:04.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.553+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa95c0c8c70 con 0x7fa95c158f70 2023-10-09T11:56:04.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.554+0000 7fa942ffd700 1 -- 172.21.15.86:0/4120062539 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16386 (secure 0 0 0) 0x7fa95c0c8c70 con 0x7fa95c158f70 2023-10-09T11:56:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:04.556 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":66,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:55:27.430831+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:54:03.372722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:54:04.259159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.32","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:54:26.336882+0000","172.21.15.86:6835/85490":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/1068719317":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/2060727677":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/1731608138":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/848505418":"2023-10-10T11:54:26.336882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:04.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 msgr2=0x7fa948069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:04.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 0x7fa948069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c158f70 msgr2=0x7fa95c15a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c158f70 0x7fa95c15a720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa954001460 tx=0x7fa954001ae0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 shutdown_connections 2023-10-09T11:56:04.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa948067050 0x7fa948069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa95c158f70 0x7fa95c15a720 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa95c0b3b70 0x7fa95c16a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 --2- 172.21.15.86:0/4120062539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95c142ea0 0x7fa95c0aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 >> 172.21.15.86:0/4120062539 conn(0x7fa95c0ce430 msgr2=0x7fa95c142120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:04.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 shutdown_connections 2023-10-09T11:56:04.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.556+0000 7fa95bfff700 1 -- 172.21.15.86:0/4120062539 wait complete. 2023-10-09T11:56:04.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:54:03.372722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:54:04.259159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:56:04.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:56:04.598 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:04.598+0000 7f15f1328180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:56:04.654 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:04.652+0000 7fd86a496180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:56:04.762 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:04.761+0000 7f15f1328180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.765+0000 7f8deaf9d700 1 Processor -- start 2023-10-09T11:56:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.765+0000 7f8deaf9d700 1 -- start start 2023-10-09T11:56:04.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.766+0000 7f8deaf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de40b4e70 0x7f8de40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.766+0000 7f8deaf9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8de40b16d0 0x7f8de40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.766+0000 7f8deaf9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40b2080 con 0x7f8de415d240 2023-10-09T11:56:04.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.766+0000 7f8deaf9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de40cfb00 con 0x7f8de40b16d0 2023-10-09T11:56:04.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.766+0000 7f8deaf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b5c40 con 0x7f8de40b4e70 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8de40b16d0 0x7f8de40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8de40b16d0 0x7f8de40b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60456/0 (socket says 172.21.15.86:60456) 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 -- 172.21.15.86:0/805323156 learned_addr learned my addr 172.21.15.86:0/805323156 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de9f9b700 1 --2- 172.21.15.86:0/805323156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de40b4e70 0x7f8de40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 -- 172.21.15.86:0/805323156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de40b4e70 msgr2=0x7f8de40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 --2- 172.21.15.86:0/805323156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de40b4e70 0x7f8de40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 -- 172.21.15.86:0/805323156 >> v1:172.21.15.135:6789/0 conn(0x7f8de415d240 legacy=0x7f8de415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de8f99700 1 -- 172.21.15.86:0/805323156 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955489525 0 0) 0x7f8de40b2080 con 0x7f8de415d240 2023-10-09T11:56:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 -- 172.21.15.86:0/805323156 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40b5f20 con 0x7f8de40b16d0 2023-10-09T11:56:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.767+0000 7f8de979a700 1 --2- 172.21.15.86:0/805323156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b16d0 0x7f8de40b1b40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40099b0 tx=0x7f8dd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0b973ec9c0bcb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8de8f99700 1 -- 172.21.15.86:0/805323156 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4009ea0 con 0x7f8de40b16d0 2023-10-09T11:56:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8de8f99700 1 -- 172.21.15.86:0/805323156 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd400b860 con 0x7f8de40b16d0 2023-10-09T11:56:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8de8f99700 1 -- 172.21.15.86:0/805323156 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400bc00 con 0x7f8de40b16d0 2023-10-09T11:56:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 -- 172.21.15.86:0/805323156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b16d0 msgr2=0x7f8de40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/805323156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b16d0 0x7f8de40b1b40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40099b0 tx=0x7f8dd4009250 comp rx=0 tx=0).stop 2023-10-09T11:56:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 -- 172.21.15.86:0/805323156 shutdown_connections 2023-10-09T11:56:04.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/805323156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de40b4e70 0x7f8de40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/805323156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b16d0 0x7f8de40b1b40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 -- 172.21.15.86:0/805323156 >> 172.21.15.86:0/805323156 conn(0x7f8de40d10c0 msgr2=0x7f8de40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:04.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 -- 172.21.15.86:0/805323156 shutdown_connections 2023-10-09T11:56:04.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.768+0000 7f8deaf9d700 1 -- 172.21.15.86:0/805323156 wait complete. 2023-10-09T11:56:04.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.770+0000 7f8deaf9d700 1 Processor -- start 2023-10-09T11:56:04.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.770+0000 7f8deaf9d700 1 -- start start 2023-10-09T11:56:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8deaf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de40b16d0 0x7f8de4157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8deaf9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b4e70 0x7f8de40c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8deaf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de415d240 0x7f8de415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8deaf9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de415b550 con 0x7f8de40b4e70 2023-10-09T11:56:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8deaf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de415b830 con 0x7f8de40b16d0 2023-10-09T11:56:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8deaf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de415bb10 con 0x7f8de415d240 2023-10-09T11:56:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8de979a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b4e70 0x7f8de40c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8de979a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b4e70 0x7f8de40c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60464/0 (socket says 172.21.15.86:60464) 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8de979a700 1 -- 172.21.15.86:0/439048287 learned_addr learned my addr 172.21.15.86:0/439048287 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8dea79c700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de415d240 0x7f8de415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.771+0000 7f8de9f9b700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de40b16d0 0x7f8de4157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8de979a700 1 -- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de415d240 msgr2=0x7f8de415c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8de979a700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de415d240 0x7f8de415c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8de979a700 1 -- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de40b16d0 msgr2=0x7f8de4157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8de979a700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de40b16d0 0x7f8de4157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8de979a700 1 -- 172.21.15.86:0/439048287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40094f0 con 0x7f8de40b4e70 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8de979a700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b4e70 0x7f8de40c6f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009290 tx=0x7f8dd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:04.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8dd9ffb700 1 -- 172.21.15.86:0/439048287 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400b9d0 con 0x7f8de40b4e70 2023-10-09T11:56:04.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8dd9ffb700 1 -- 172.21.15.86:0/439048287 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd400bb30 con 0x7f8de40b4e70 2023-10-09T11:56:04.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de415bdf0 con 0x7f8de40b4e70 2023-10-09T11:56:04.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8dd9ffb700 1 -- 172.21.15.86:0/439048287 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4025650 con 0x7f8de40b4e70 2023-10-09T11:56:04.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.772+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de40c5e40 con 0x7f8de40b4e70 2023-10-09T11:56:04.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.774+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de415c310 con 0x7f8de40b4e70 2023-10-09T11:56:04.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.774+0000 7f8dd9ffb700 1 -- 172.21.15.86:0/439048287 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f8dd4023070 con 0x7f8de40b4e70 2023-10-09T11:56:04.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.775+0000 7f8dd9ffb700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 0x7f8dc8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:04.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.775+0000 7f8dd9ffb700 1 -- 172.21.15.86:0/439048287 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6369+0+0 (secure 0 0 0) 0x7f8dd4085e30 con 0x7f8de40b4e70 2023-10-09T11:56:04.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.775+0000 7f8de9f9b700 1 -- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 msgr2=0x7f8dc8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:04.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.775+0000 7f8de9f9b700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 0x7f8dc8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:04.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.779+0000 7f8dd9ffb700 1 -- 172.21.15.86:0/439048287 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8de415c310 con 0x7f8de40b4e70 2023-10-09T11:56:04.827 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:04.826+0000 7fd86a496180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:04.850 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:04.850+0000 7f15f1328180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:56:04.916 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:04.915+0000 7fd86a496180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:56:04.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.976+0000 7f8de9f9b700 1 -- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 msgr2=0x7f8dc8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:04.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.976+0000 7f8de9f9b700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 0x7f8dc8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:04.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.980+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8de415c310 con 0x7f8de40b4e70 2023-10-09T11:56:04.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.980+0000 7f8dd9ffb700 1 -- 172.21.15.86:0/439048287 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8de415c310 con 0x7f8de40b4e70 2023-10-09T11:56:04.982 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:56:04.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 msgr2=0x7f8dc8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 0x7f8dc8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b4e70 msgr2=0x7f8de40c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b4e70 0x7f8de40c6f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009290 tx=0x7f8dd4017000 comp rx=0 tx=0).stop 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 shutdown_connections 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8de415d240 0x7f8de415c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8de40b16d0 0x7f8de4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8dc8067050 0x7f8dc8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 --2- 172.21.15.86:0/439048287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de40b4e70 0x7f8de40c6f90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 >> 172.21.15.86:0/439048287 conn(0x7f8de40d10c0 msgr2=0x7f8de4069b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:04.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 shutdown_connections 2023-10-09T11:56:04.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:04.983+0000 7f8deaf9d700 1 -- 172.21.15.86:0/439048287 wait complete. 2023-10-09T11:56:05.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:56:05.077 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:05.077+0000 7f15f1328180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:05.152 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:05.151+0000 7fd86a496180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:05.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.191+0000 7fb067fff700 1 Processor -- start 2023-10-09T11:56:05.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.191+0000 7fb067fff700 1 -- start start 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.192+0000 7fb067fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb0680b4e70 0x7fb0680ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.192+0000 7fb067fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb0680b1b40 0x7fb06815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.192+0000 7fb067fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680cfb00 con 0x7fb0680b16d0 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.192+0000 7fb067fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680b5c40 con 0x7fb0680b4e70 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.192+0000 7fb067fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680b5f20 con 0x7fb0680b1b40 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.192+0000 7fb066ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb0680b4e70 0x7fb0680ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb066ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb0680b4e70 0x7fb0680ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40416/0 (socket says 172.21.15.86:40416) 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb066ffd700 1 -- 172.21.15.86:0/3205519600 learned_addr learned my addr 172.21.15.86:0/3205519600 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb0667fc700 1 --1- 172.21.15.86:0/3205519600 >> v1:172.21.15.86:6789/0 conn(0x7fb0680b16d0 0x7fb06815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48466/0 (socket says 172.21.15.86:48466) 2023-10-09T11:56:05.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb0677fe700 1 --2- 172.21.15.86:0/3205519600 >> v2:172.21.15.135:3300/0 conn(0x7fb0680b1b40 0x7fb06815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb065ffb700 1 -- 172.21.15.86:0/3205519600 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179939674 0 0) 0x7fb0680cfb00 con 0x7fb0680b16d0 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb065ffb700 1 -- 172.21.15.86:0/3205519600 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb050003570 con 0x7fb0680b16d0 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb066ffd700 1 -- 172.21.15.86:0/3205519600 >> v2:172.21.15.135:3300/0 conn(0x7fb0680b1b40 msgr2=0x7fb06815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb066ffd700 1 --2- 172.21.15.86:0/3205519600 >> v2:172.21.15.135:3300/0 conn(0x7fb0680b1b40 0x7fb06815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb066ffd700 1 -- 172.21.15.86:0/3205519600 >> v1:172.21.15.86:6789/0 conn(0x7fb0680b16d0 legacy=0x7fb06815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb066ffd700 1 -- 172.21.15.86:0/3205519600 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680b6200 con 0x7fb0680b4e70 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.193+0000 7fb066ffd700 1 --2- 172.21.15.86:0/3205519600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b4e70 0x7fb0680ccff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb068071380 tx=0x7fb058009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c724c17bdfa57cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb065ffb700 1 -- 172.21.15.86:0/3205519600 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800b640 con 0x7fb0680b4e70 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb065ffb700 1 -- 172.21.15.86:0/3205519600 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05800b7a0 con 0x7fb0680b4e70 2023-10-09T11:56:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb065ffb700 1 -- 172.21.15.86:0/3205519600 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800bb60 con 0x7fb0680b4e70 2023-10-09T11:56:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 -- 172.21.15.86:0/3205519600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b4e70 msgr2=0x7fb0680ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 --2- 172.21.15.86:0/3205519600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b4e70 0x7fb0680ccff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb068071380 tx=0x7fb058009250 comp rx=0 tx=0).stop 2023-10-09T11:56:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 -- 172.21.15.86:0/3205519600 shutdown_connections 2023-10-09T11:56:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 --2- 172.21.15.86:0/3205519600 >> v2:172.21.15.135:3300/0 conn(0x7fb0680b1b40 0x7fb06815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 --2- 172.21.15.86:0/3205519600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b4e70 0x7fb0680ccff0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 -- 172.21.15.86:0/3205519600 >> 172.21.15.86:0/3205519600 conn(0x7fb0680d10c0 msgr2=0x7fb0680affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 -- 172.21.15.86:0/3205519600 shutdown_connections 2023-10-09T11:56:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.194+0000 7fb067fff700 1 -- 172.21.15.86:0/3205519600 wait complete. 2023-10-09T11:56:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.196+0000 7fb067fff700 1 Processor -- start 2023-10-09T11:56:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.196+0000 7fb067fff700 1 -- start start 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb067fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b16d0 0x7fb06816da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb067fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0680b1b40 0x7fb068069490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb067fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0680b4e70 0x7fb0680699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb067fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c8690 con 0x7fb0680b16d0 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb067fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c63a0 con 0x7fb0680b1b40 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb067fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c69c0 con 0x7fb0680b4e70 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b16d0 0x7fb06816da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b16d0 0x7fb06816da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40430/0 (socket says 172.21.15.86:40430) 2023-10-09T11:56:05.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 -- 172.21.15.86:0/4066642683 learned_addr learned my addr 172.21.15.86:0/4066642683 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb0677fe700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0680b4e70 0x7fb0680699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb0667fc700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0680b1b40 0x7fb068069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 -- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0680b4e70 msgr2=0x7fb0680699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0680b4e70 0x7fb0680699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 -- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0680b1b40 msgr2=0x7fb068069490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0680b1b40 0x7fb068069490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.197+0000 7fb066ffd700 1 -- 172.21.15.86:0/4066642683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580094f0 con 0x7fb0680b16d0 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.198+0000 7fb066ffd700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b16d0 0x7fb06816da90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb068070dd0 tx=0x7fb058017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.198+0000 7fb04effd700 1 -- 172.21.15.86:0/4066642683 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800bb20 con 0x7fb0680b16d0 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.198+0000 7fb04effd700 1 -- 172.21.15.86:0/4066642683 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058000c90 con 0x7fb0680b16d0 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.198+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0680c6ca0 con 0x7fb0680b16d0 2023-10-09T11:56:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.198+0000 7fb04effd700 1 -- 172.21.15.86:0/4066642683 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058011670 con 0x7fb0680b16d0 2023-10-09T11:56:05.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.198+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0680c7260 con 0x7fb0680b16d0 2023-10-09T11:56:05.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.199+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0680c6710 con 0x7fb0680b16d0 2023-10-09T11:56:05.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.200+0000 7fb04effd700 1 -- 172.21.15.86:0/4066642683 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fb0580119e0 con 0x7fb0680b16d0 2023-10-09T11:56:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.201+0000 7fb04effd700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 0x7fb054069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.201+0000 7fb04effd700 1 -- 172.21.15.86:0/4066642683 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6369+0+0 (secure 0 0 0) 0x7fb058085fa0 con 0x7fb0680b16d0 2023-10-09T11:56:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.201+0000 7fb0667fc700 1 -- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 msgr2=0x7fb054069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.201+0000 7fb0667fc700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 0x7fb054069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.205+0000 7fb04effd700 1 -- 172.21.15.86:0/4066642683 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0580b75a0 con 0x7fb0680b16d0 2023-10-09T11:56:05.256 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:05.255+0000 7f15f1328180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:56:05.342 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:05.341+0000 7fd86a496180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:56:05.354 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:05.354+0000 7f15f1328180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:56:05.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.402+0000 7fb0667fc700 1 -- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 msgr2=0x7fb054069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:05.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.402+0000 7fb0667fc700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 0x7fb054069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:05.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.409+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb06804bb80 con 0x7fb0680b16d0 2023-10-09T11:56:05.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.410+0000 7fb04effd700 1 -- 172.21.15.86:0/4066642683 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb058052e60 con 0x7fb0680b16d0 2023-10-09T11:56:05.411 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:56:05.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 msgr2=0x7fb054069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 0x7fb054069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b16d0 msgr2=0x7fb06816da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b16d0 0x7fb06816da90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb068070dd0 tx=0x7fb058017000 comp rx=0 tx=0).stop 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 shutdown_connections 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fb054067050 0x7fb054069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0680b16d0 0x7fb06816da90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0680b4e70 0x7fb0680699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 --2- 172.21.15.86:0/4066642683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0680b1b40 0x7fb068069490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 >> 172.21.15.86:0/4066642683 conn(0x7fb0680d10c0 msgr2=0x7fb0680c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 shutdown_connections 2023-10-09T11:56:05.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.412+0000 7fb067fff700 1 -- 172.21.15.86:0/4066642683 wait complete. 2023-10-09T11:56:05.431 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:56:05.438 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:05.437+0000 7fd86a496180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:56:05.515 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:05.515+0000 7f15f1328180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:56:05.613 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:05.612+0000 7fd86a496180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:56:05.623 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:05.622+0000 7f15f1328180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:05.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.629+0000 7f85aa39d700 1 Processor -- start 2023-10-09T11:56:05.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.629+0000 7f85aa39d700 1 -- start start 2023-10-09T11:56:05.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.630+0000 7f85aa39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f85a40b4e70 0x7f85a40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.630+0000 7f85aa39d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a40cfb00 con 0x7f85a40b1b40 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.630+0000 7f85aa39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a415e060 con 0x7f85a40b16d0 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.630+0000 7f85aa39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a40b5c40 con 0x7f85a40b4e70 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f85a9b9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f85a40b1b40 0x7f85a415d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48472/0 (socket says 172.21.15.86:48472) 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f85a9b9c700 1 -- 172.21.15.86:0/945266840 learned_addr learned my addr 172.21.15.86:0/945266840 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f85a939b700 1 --2- 172.21.15.86:0/945266840 >> v2:172.21.15.135:3300/0 conn(0x7f85a40b4e70 0x7f85a40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f859bfff700 1 -- 172.21.15.86:0/945266840 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329600329 0 0) 0x7f85a40cfb00 con 0x7f85a40b1b40 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f859bfff700 1 -- 172.21.15.86:0/945266840 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8590003570 con 0x7f85a40b1b40 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f85a939b700 1 -- 172.21.15.86:0/945266840 >> v1:172.21.15.135:6789/0 conn(0x7f85a40b16d0 legacy=0x7f85a415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f85a939b700 1 -- 172.21.15.86:0/945266840 >> v1:172.21.15.86:6789/0 conn(0x7f85a40b1b40 legacy=0x7f85a415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.631+0000 7f85a939b700 1 -- 172.21.15.86:0/945266840 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40b5f20 con 0x7f85a40b4e70 2023-10-09T11:56:05.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f85a939b700 1 --2- 172.21.15.86:0/945266840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b4e70 0x7f85a40ccff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f85a00098e0 tx=0x7f85a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3979b1d8632ff056 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:05.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f859bfff700 1 -- 172.21.15.86:0/945266840 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a000b640 con 0x7f85a40b4e70 2023-10-09T11:56:05.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f859bfff700 1 -- 172.21.15.86:0/945266840 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a000b7a0 con 0x7f85a40b4e70 2023-10-09T11:56:05.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f859bfff700 1 -- 172.21.15.86:0/945266840 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a000bb20 con 0x7f85a40b4e70 2023-10-09T11:56:05.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f85aa39d700 1 -- 172.21.15.86:0/945266840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b4e70 msgr2=0x7f85a40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f85aa39d700 1 --2- 172.21.15.86:0/945266840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b4e70 0x7f85a40ccff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f85a00098e0 tx=0x7f85a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f85aa39d700 1 -- 172.21.15.86:0/945266840 shutdown_connections 2023-10-09T11:56:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f85aa39d700 1 --2- 172.21.15.86:0/945266840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b4e70 0x7f85a40ccff0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f85aa39d700 1 -- 172.21.15.86:0/945266840 >> 172.21.15.86:0/945266840 conn(0x7f85a40d10c0 msgr2=0x7f85a40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.632+0000 7f85aa39d700 1 -- 172.21.15.86:0/945266840 shutdown_connections 2023-10-09T11:56:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.633+0000 7f85aa39d700 1 -- 172.21.15.86:0/945266840 wait complete. 2023-10-09T11:56:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.634+0000 7f85aa39d700 1 Processor -- start 2023-10-09T11:56:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.634+0000 7f85aa39d700 1 -- start start 2023-10-09T11:56:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85aa39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b16d0 0x7f85a4156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85aa39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85a40b1b40 0x7f85a40c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85aa39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40b4e70 0x7f85a4069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85aa39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40c7330 con 0x7f85a40b1b40 2023-10-09T11:56:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85aa39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a4156db0 con 0x7f85a40b16d0 2023-10-09T11:56:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85aa39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40c9d60 con 0x7f85a40b4e70 2023-10-09T11:56:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85a8b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85a40b1b40 0x7f85a40c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85a8b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85a40b1b40 0x7f85a40c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40432/0 (socket says 172.21.15.86:40432) 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85a8b9a700 1 -- 172.21.15.86:0/1331453640 learned_addr learned my addr 172.21.15.86:0/1331453640 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85a939b700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b16d0 0x7f85a4156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.635+0000 7f85a9b9c700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40b4e70 0x7f85a4069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85a8b9a700 1 -- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40b4e70 msgr2=0x7f85a4069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85a8b9a700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40b4e70 0x7f85a4069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85a8b9a700 1 -- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b16d0 msgr2=0x7f85a4156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85a8b9a700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b16d0 0x7f85a4156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85a8b9a700 1 -- 172.21.15.86:0/1331453640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009420 con 0x7f85a40b1b40 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85a939b700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b16d0 0x7f85a4156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85a8b9a700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85a40b1b40 0x7f85a40c9510 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f859400c790 tx=0x7f8594007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85997fa700 1 -- 172.21.15.86:0/1331453640 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594011590 con 0x7f85a40b1b40 2023-10-09T11:56:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85997fa700 1 -- 172.21.15.86:0/1331453640 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594011710 con 0x7f85a40b1b40 2023-10-09T11:56:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a40ca040 con 0x7f85a40b1b40 2023-10-09T11:56:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85997fa700 1 -- 172.21.15.86:0/1331453640 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594011ad0 con 0x7f85a40b1b40 2023-10-09T11:56:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.636+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a40c9a50 con 0x7f85a40b1b40 2023-10-09T11:56:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.637+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a4088990 con 0x7f85a40b1b40 2023-10-09T11:56:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.639+0000 7f85997fa700 1 -- 172.21.15.86:0/1331453640 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f859401b3b0 con 0x7f85a40b1b40 2023-10-09T11:56:05.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.640+0000 7f85997fa700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 0x7f8588069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:05.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.640+0000 7f85997fa700 1 -- 172.21.15.86:0/1331453640 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6425+0+0 (secure 0 0 0) 0x7f8594083dc0 con 0x7f85a40b1b40 2023-10-09T11:56:05.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.640+0000 7f85a939b700 1 -- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 msgr2=0x7f8588069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.640+0000 7f85a939b700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 0x7f8588069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.644+0000 7f85997fa700 1 -- 172.21.15.86:0/1331453640 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8594050c50 con 0x7f85a40b1b40 2023-10-09T11:56:05.721 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:05.720+0000 7fd86a496180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:05.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.841+0000 7f85a939b700 1 -- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 msgr2=0x7f8588069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:05.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.841+0000 7f85a939b700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 0x7f8588069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:05.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.847+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85a404bb80 con 0x7f85a40b1b40 2023-10-09T11:56:05.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.847+0000 7f85997fa700 1 -- 172.21.15.86:0/1331453640 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8594017070 con 0x7f85a40b1b40 2023-10-09T11:56:05.849 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:56:05.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 msgr2=0x7f8588069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 0x7f8588069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85a40b1b40 msgr2=0x7f85a40c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85a40b1b40 0x7f85a40c9510 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f859400c790 tx=0x7f8594007f40 comp rx=0 tx=0).stop 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 shutdown_connections 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40b4e70 0x7f85a4069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a40b16d0 0x7f85a4156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f8588067050 0x7f8588069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 --2- 172.21.15.86:0/1331453640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85a40b1b40 0x7f85a40c9510 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 >> 172.21.15.86:0/1331453640 conn(0x7f85a40d10c0 msgr2=0x7f85a4157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 shutdown_connections 2023-10-09T11:56:05.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:05.850+0000 7f85aa39d700 1 -- 172.21.15.86:0/1331453640 wait complete. 2023-10-09T11:56:05.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.097+0000 7f92c359e700 1 Processor -- start 2023-10-09T11:56:06.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.097+0000 7f92c359e700 1 -- start start 2023-10-09T11:56:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.098+0000 7f92c359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92c4159420 0x7f92c40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.098+0000 7f92c359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c40b2980 con 0x7f92c415d230 2023-10-09T11:56:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.098+0000 7f92c359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c40b11d0 con 0x7f92c41597f0 2023-10-09T11:56:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.098+0000 7f92c359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40b14b0 con 0x7f92c4159420 2023-10-09T11:56:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.098+0000 7f92c2d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f92c415d230 0x7f92c415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48476/0 (socket says 172.21.15.86:48476) 2023-10-09T11:56:06.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.098+0000 7f92c2d9d700 1 -- 172.21.15.86:0/1617830574 learned_addr learned my addr 172.21.15.86:0/1617830574 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c259c700 1 --2- 172.21.15.86:0/1617830574 >> v2:172.21.15.135:3300/0 conn(0x7f92c4159420 0x7f92c40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c159a700 1 -- 172.21.15.86:0/1617830574 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728589523 0 0) 0x7f92c40b2980 con 0x7f92c415d230 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c159a700 1 -- 172.21.15.86:0/1617830574 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ac003570 con 0x7f92c415d230 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c159a700 1 -- 172.21.15.86:0/1617830574 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254422022 0 0) 0x7f92c40b11d0 con 0x7f92c41597f0 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c159a700 1 -- 172.21.15.86:0/1617830574 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c40b2980 con 0x7f92c41597f0 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c259c700 1 -- 172.21.15.86:0/1617830574 >> v1:172.21.15.135:6789/0 conn(0x7f92c41597f0 legacy=0x7f92c40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c259c700 1 -- 172.21.15.86:0/1617830574 >> v1:172.21.15.86:6789/0 conn(0x7f92c415d230 legacy=0x7f92c415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c259c700 1 -- 172.21.15.86:0/1617830574 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40b1790 con 0x7f92c4159420 2023-10-09T11:56:06.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.099+0000 7f92c259c700 1 --2- 172.21.15.86:0/1617830574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c4159420 0x7f92c40b5f40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92b40098e0 tx=0x7f92b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d22e4b3e71ff039 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:06.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c159a700 1 -- 172.21.15.86:0/1617830574 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4011630 con 0x7f92c4159420 2023-10-09T11:56:06.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c159a700 1 -- 172.21.15.86:0/1617830574 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4011790 con 0x7f92c4159420 2023-10-09T11:56:06.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c159a700 1 -- 172.21.15.86:0/1617830574 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4011b30 con 0x7f92c4159420 2023-10-09T11:56:06.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c359e700 1 -- 172.21.15.86:0/1617830574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c4159420 msgr2=0x7f92c40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c359e700 1 --2- 172.21.15.86:0/1617830574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c4159420 0x7f92c40b5f40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92b40098e0 tx=0x7f92b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c359e700 1 -- 172.21.15.86:0/1617830574 shutdown_connections 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c359e700 1 --2- 172.21.15.86:0/1617830574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c4159420 0x7f92c40b5f40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c359e700 1 -- 172.21.15.86:0/1617830574 >> 172.21.15.86:0/1617830574 conn(0x7f92c40d0660 msgr2=0x7f92c40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c359e700 1 -- 172.21.15.86:0/1617830574 shutdown_connections 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.100+0000 7f92c359e700 1 -- 172.21.15.86:0/1617830574 wait complete. 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.102+0000 7f92c359e700 1 Processor -- start 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.102+0000 7f92c359e700 1 -- start start 2023-10-09T11:56:06.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c4159420 0x7f92c4143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92c41597f0 0x7f92c4068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c415d230 0x7f92c40688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4069bf0 con 0x7f92c41597f0 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4169ca0 con 0x7f92c415d230 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4155830 con 0x7f92c4159420 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92c41597f0 0x7f92c4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c259c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c4159420 0x7f92c4143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92c41597f0 0x7f92c4068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40438/0 (socket says 172.21.15.86:40438) 2023-10-09T11:56:06.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c1d9b700 1 -- 172.21.15.86:0/1172034383 learned_addr learned my addr 172.21.15.86:0/1172034383 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.103+0000 7f92c2d9d700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c415d230 0x7f92c40688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c259c700 1 -- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c415d230 msgr2=0x7f92c40688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c259c700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c415d230 0x7f92c40688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c259c700 1 -- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92c41597f0 msgr2=0x7f92c4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c259c700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92c41597f0 0x7f92c4068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c259c700 1 -- 172.21.15.86:0/1172034383 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4009420 con 0x7f92c4159420 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c259c700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c4159420 0x7f92c4143a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92b4016000 tx=0x7f92b4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92b27fc700 1 -- 172.21.15.86:0/1172034383 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b401f070 con 0x7f92c4159420 2023-10-09T11:56:06.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92b27fc700 1 -- 172.21.15.86:0/1172034383 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4000bc0 con 0x7f92c4159420 2023-10-09T11:56:06.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c4068f70 con 0x7f92c4159420 2023-10-09T11:56:06.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92b27fc700 1 -- 172.21.15.86:0/1172034383 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4025420 con 0x7f92c4159420 2023-10-09T11:56:06.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.104+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c4069530 con 0x7f92c4159420 2023-10-09T11:56:06.109 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:06.105+0000 7f15f1328180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:56:06.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.105+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c404c3c0 con 0x7f92c4159420 2023-10-09T11:56:06.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.106+0000 7f92b27fc700 1 -- 172.21.15.86:0/1172034383 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f92b4023070 con 0x7f92c4159420 2023-10-09T11:56:06.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.107+0000 7f92b27fc700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 0x7f92a4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.107+0000 7f92c1d9b700 1 -- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 msgr2=0x7f92a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:06.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.107+0000 7f92b27fc700 1 -- 172.21.15.86:0/1172034383 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6425+0+0 (secure 0 0 0) 0x7f92b4085ae0 con 0x7f92c4159420 2023-10-09T11:56:06.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.107+0000 7f92c1d9b700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 0x7f92a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:06.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.112+0000 7f92b27fc700 1 -- 172.21.15.86:0/1172034383 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92b40528d0 con 0x7f92c4159420 2023-10-09T11:56:06.200 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:06.199+0000 7f15f1328180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:56:06.229 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:06.227+0000 7fd86a496180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:56:06.289 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:06.288+0000 7f15f1328180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:56:06.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.308+0000 7f92c1d9b700 1 -- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 msgr2=0x7f92a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:06.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.308+0000 7f92c1d9b700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 0x7f92a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:06.326 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:06.325+0000 7fd86a496180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:56:06.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.353+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92c40b1a70 con 0x7f92c4159420 2023-10-09T11:56:06.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.354+0000 7f92b27fc700 1 -- 172.21.15.86:0/1172034383 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f92b4015090 con 0x7f92c4159420 2023-10-09T11:56:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:06.355 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/569752766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":569752766},{"type":"v1","addr":"172.21.15.135:6834","nonce":569752766}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/312603704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":312603704},{"type":"v1","addr":"172.21.15.135:6835","nonce":312603704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/4036553983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":4036553983},{"type":"v1","addr":"172.21.15.86:6833","nonce":4036553983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:54:05.279420+0000","modified":"2023-10-09T11:54:09.221890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6836/3777239940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3777239940},{"type":"v1","addr":"172.21.15.86:6836","nonce":3777239940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:56:06.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 msgr2=0x7f92a4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:06.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 0x7f92a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c4159420 msgr2=0x7f92c4143a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c4159420 0x7f92c4143a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92b4016000 tx=0x7f92b4017000 comp rx=0 tx=0).stop 2023-10-09T11:56:06.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 shutdown_connections 2023-10-09T11:56:06.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c415d230 0x7f92c40688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92c4159420 0x7f92c4143a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f92a4067050 0x7f92a4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 --2- 172.21.15.86:0/1172034383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92c41597f0 0x7f92c4068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 >> 172.21.15.86:0/1172034383 conn(0x7f92c40d0660 msgr2=0x7f92c41576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 shutdown_connections 2023-10-09T11:56:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.356+0000 7f92c359e700 1 -- 172.21.15.86:0/1172034383 wait complete. 2023-10-09T11:56:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2023-10-09T11:56:06.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:06.421 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:06.420+0000 7fd86a496180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:56:06.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.561+0000 7f19dbfff700 1 Processor -- start 2023-10-09T11:56:06.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.561+0000 7f19dbfff700 1 -- start start 2023-10-09T11:56:06.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.562+0000 7f19dbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19dc1595a0 0x7f19dc0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.562+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc0c8830 0x7f19dc159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.562+0000 7f19dbfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0b1410 con 0x7f19dc0c6c60 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.562+0000 7f19dbfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0b2b90 con 0x7f19dc1595a0 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.562+0000 7f19dbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc063230 con 0x7f19dc0c8830 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19daffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19dc1595a0 0x7f19dc0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19da7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f19dc0c6c60 0x7f19dc0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48484/0 (socket says 172.21.15.86:48484) 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19da7fc700 1 -- 172.21.15.86:0/40152077 learned_addr learned my addr 172.21.15.86:0/40152077 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19daffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19dc1595a0 0x7f19dc0b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40442/0 (socket says 172.21.15.86:40442) 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19db7fe700 1 --2- 172.21.15.86:0/40152077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc0c8830 0x7f19dc159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19d9ffb700 1 -- 172.21.15.86:0/40152077 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400737929 0 0) 0x7f19dc0b1410 con 0x7f19dc0c6c60 2023-10-09T11:56:06.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19daffd700 1 -- 172.21.15.86:0/40152077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc0c8830 msgr2=0x7f19dc159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:06.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19daffd700 1 --2- 172.21.15.86:0/40152077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc0c8830 0x7f19dc159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19daffd700 1 -- 172.21.15.86:0/40152077 >> v1:172.21.15.86:6789/0 conn(0x7f19dc0c6c60 legacy=0x7f19dc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19daffd700 1 -- 172.21.15.86:0/40152077 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0634f0 con 0x7f19dc1595a0 2023-10-09T11:56:06.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.563+0000 7f19daffd700 1 --2- 172.21.15.86:0/40152077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc1595a0 0x7f19dc0b18a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098e0 tx=0x7f19cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedbf605ba7d00b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:06.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19d9ffb700 1 -- 172.21.15.86:0/40152077 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00b640 con 0x7f19dc1595a0 2023-10-09T11:56:06.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19d9ffb700 1 -- 172.21.15.86:0/40152077 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc00b7a0 con 0x7f19dc1595a0 2023-10-09T11:56:06.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19d9ffb700 1 -- 172.21.15.86:0/40152077 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc00bb40 con 0x7f19dc1595a0 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 -- 172.21.15.86:0/40152077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc1595a0 msgr2=0x7f19dc0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 --2- 172.21.15.86:0/40152077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc1595a0 0x7f19dc0b18a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0098e0 tx=0x7f19cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 -- 172.21.15.86:0/40152077 shutdown_connections 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 --2- 172.21.15.86:0/40152077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc0c8830 0x7f19dc159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 --2- 172.21.15.86:0/40152077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc1595a0 0x7f19dc0b18a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 -- 172.21.15.86:0/40152077 >> 172.21.15.86:0/40152077 conn(0x7f19dc06ddb0 msgr2=0x7f19dc06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 -- 172.21.15.86:0/40152077 shutdown_connections 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.564+0000 7f19dbfff700 1 -- 172.21.15.86:0/40152077 wait complete. 2023-10-09T11:56:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.566+0000 7f19dbfff700 1 Processor -- start 2023-10-09T11:56:06.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.566+0000 7f19dbfff700 1 -- start start 2023-10-09T11:56:06.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19dc0c6c60 0x7f19dc137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc0c8830 0x7f19dc152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc1595a0 0x7f19dc14b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19dbfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc153d10 con 0x7f19dc0c8830 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19dbfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc153a30 con 0x7f19dc0c6c60 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19dbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc159a10 con 0x7f19dc1595a0 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc0c8830 0x7f19dc152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc0c8830 0x7f19dc152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40456/0 (socket says 172.21.15.86:40456) 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 -- 172.21.15.86:0/3890314416 learned_addr learned my addr 172.21.15.86:0/3890314416 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19db7fe700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc1595a0 0x7f19dc14b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19daffd700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19dc0c6c60 0x7f19dc137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 -- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc1595a0 msgr2=0x7f19dc14b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc1595a0 0x7f19dc14b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 -- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19dc0c6c60 msgr2=0x7f19dc137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19dc0c6c60 0x7f19dc137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.567+0000 7f19da7fc700 1 -- 172.21.15.86:0/3890314416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc009420 con 0x7f19dc0c8830 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.568+0000 7f19da7fc700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc0c8830 0x7f19dc152fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c810 tx=0x7f19d0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.568+0000 7f19c2ffd700 1 -- 172.21.15.86:0/3890314416 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0005c00 con 0x7f19dc0c8830 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.568+0000 7f19c2ffd700 1 -- 172.21.15.86:0/3890314416 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0005d60 con 0x7f19dc0c8830 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.568+0000 7f19c2ffd700 1 -- 172.21.15.86:0/3890314416 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0007300 con 0x7f19dc0c8830 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.568+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc159cf0 con 0x7f19dc0c8830 2023-10-09T11:56:06.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.568+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc1522c0 con 0x7f19dc0c8830 2023-10-09T11:56:06.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.569+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc15a210 con 0x7f19dc0c8830 2023-10-09T11:56:06.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.570+0000 7f19c2ffd700 1 -- 172.21.15.86:0/3890314416 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f19d001b3b0 con 0x7f19dc0c8830 2023-10-09T11:56:06.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.572+0000 7f19c2ffd700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 0x7f19c8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:06.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.572+0000 7f19c2ffd700 1 -- 172.21.15.86:0/3890314416 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6425+0+0 (secure 0 0 0) 0x7f19d0083ee0 con 0x7f19dc0c8830 2023-10-09T11:56:06.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.572+0000 7f19daffd700 1 -- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 msgr2=0x7f19c8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:06.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.572+0000 7f19daffd700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 0x7f19c8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:06.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.576+0000 7f19c2ffd700 1 -- 172.21.15.86:0/3890314416 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19dc15a210 con 0x7f19dc0c8830 2023-10-09T11:56:06.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.773+0000 7f19daffd700 1 -- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 msgr2=0x7f19c8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:06.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.773+0000 7f19daffd700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 0x7f19c8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:06.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.791+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19dc15a210 con 0x7f19dc0c8830 2023-10-09T11:56:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.792+0000 7f19c2ffd700 1 -- 172.21.15.86:0/3890314416 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16495 (secure 0 0 0) 0x7f19dc15a210 con 0x7f19dc0c8830 2023-10-09T11:56:06.794 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:06.794 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":67,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:05.312258+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:54:03.372722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:54:04.259159+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":67,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.32","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:54:26.336882+0000","172.21.15.86:6835/85490":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/1068719317":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/2060727677":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/1731608138":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/848505418":"2023-10-10T11:54:26.336882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 msgr2=0x7f19c8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 0x7f19c8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc0c8830 msgr2=0x7f19dc152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc0c8830 0x7f19dc152fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c810 tx=0x7f19d0007db0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 shutdown_connections 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19dc1595a0 0x7f19dc14b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19dc0c6c60 0x7f19dc137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f19c8067050 0x7f19c8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 --2- 172.21.15.86:0/3890314416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19dc0c8830 0x7f19dc152fc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 >> 172.21.15.86:0/3890314416 conn(0x7f19dc06ddb0 msgr2=0x7f19dc14af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 shutdown_connections 2023-10-09T11:56:06.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:06.795+0000 7f19dbfff700 1 -- 172.21.15.86:0/3890314416 wait complete. 2023-10-09T11:56:06.814 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:56:06.814 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:06.909 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:06.908+0000 7f15f1328180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:56:07.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.027+0000 7f9d8e19d700 1 Processor -- start 2023-10-09T11:56:07.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.027+0000 7f9d8e19d700 1 -- start start 2023-10-09T11:56:07.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.028+0000 7f9d8e19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d88150550 0x7f9d88157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.028+0000 7f9d8e19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9d880c7410 0x7f9d88069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8e19d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8806e2a0 con 0x7f9d88150180 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8e19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8806b2e0 con 0x7f9d88150550 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8c99a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d88150550 0x7f9d88157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8e19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d880c78e0 con 0x7f9d880c7410 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8c99a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d88150550 0x7f9d88157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40464/0 (socket says 172.21.15.86:40464) 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8c99a700 1 -- 172.21.15.86:0/1198182118 learned_addr learned my addr 172.21.15.86:0/1198182118 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8d99c700 1 --2- 172.21.15.86:0/1198182118 >> v2:172.21.15.135:3300/0 conn(0x7f9d880c7410 0x7f9d88069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8c99a700 1 -- 172.21.15.86:0/1198182118 >> v2:172.21.15.135:3300/0 conn(0x7f9d880c7410 msgr2=0x7f9d88069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8c99a700 1 --2- 172.21.15.86:0/1198182118 >> v2:172.21.15.135:3300/0 conn(0x7f9d880c7410 0x7f9d88069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8c99a700 1 -- 172.21.15.86:0/1198182118 >> v1:172.21.15.86:6789/0 conn(0x7f9d88150180 legacy=0x7f9d880c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.029+0000 7f9d8c99a700 1 -- 172.21.15.86:0/1198182118 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d880c7bc0 con 0x7f9d88150550 2023-10-09T11:56:07.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d8c99a700 1 --2- 172.21.15.86:0/1198182118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150550 0x7f9d88157770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9d88156270 tx=0x7f9d78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923cc9f360ec5c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d7ffff700 1 -- 172.21.15.86:0/1198182118 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800b860 con 0x7f9d88150550 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d7ffff700 1 -- 172.21.15.86:0/1198182118 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800b9c0 con 0x7f9d88150550 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d7ffff700 1 -- 172.21.15.86:0/1198182118 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800bd60 con 0x7f9d88150550 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d8e19d700 1 -- 172.21.15.86:0/1198182118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150550 msgr2=0x7f9d88157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/1198182118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150550 0x7f9d88157770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9d88156270 tx=0x7f9d78009250 comp rx=0 tx=0).stop 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d8e19d700 1 -- 172.21.15.86:0/1198182118 shutdown_connections 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/1198182118 >> v2:172.21.15.135:3300/0 conn(0x7f9d880c7410 0x7f9d88069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.030+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/1198182118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150550 0x7f9d88157770 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.031+0000 7f9d8e19d700 1 -- 172.21.15.86:0/1198182118 >> 172.21.15.86:0/1198182118 conn(0x7f9d880cc1f0 msgr2=0x7f9d880cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:07.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.031+0000 7f9d8e19d700 1 -- 172.21.15.86:0/1198182118 shutdown_connections 2023-10-09T11:56:07.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.031+0000 7f9d8e19d700 1 -- 172.21.15.86:0/1198182118 wait complete. 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.032+0000 7f9d8e19d700 1 Processor -- start 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.032+0000 7f9d8e19d700 1 -- start start 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8e19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d880c7410 0x7f9d880aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8e19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150180 0x7f9d880add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8e19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d88150550 0x7f9d88140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8e19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880ae5d0 con 0x7f9d88150180 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8e19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88142ca0 con 0x7f9d88150550 2023-10-09T11:56:07.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8e19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881437d0 con 0x7f9d880c7410 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8c99a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150180 0x7f9d880add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8c99a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150180 0x7f9d880add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40480/0 (socket says 172.21.15.86:40480) 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8c99a700 1 -- 172.21.15.86:0/3427060452 learned_addr learned my addr 172.21.15.86:0/3427060452 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8d99c700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d88150550 0x7f9d88140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.033+0000 7f9d8d19b700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d880c7410 0x7f9d880aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8c99a700 1 -- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d880c7410 msgr2=0x7f9d880aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8c99a700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d880c7410 0x7f9d880aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8c99a700 1 -- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d88150550 msgr2=0x7f9d88140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8c99a700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d88150550 0x7f9d88140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8c99a700 1 -- 172.21.15.86:0/3427060452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780094f0 con 0x7f9d88150180 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8d99c700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d88150550 0x7f9d88140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:07.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8d19b700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d880c7410 0x7f9d880aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:07.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8c99a700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150180 0x7f9d880add80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9d8806fe40 tx=0x7f9d78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:07.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d7d7fa700 1 -- 172.21.15.86:0/3427060452 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78011e60 con 0x7f9d88150180 2023-10-09T11:56:07.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d7d7fa700 1 -- 172.21.15.86:0/3427060452 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7801a630 con 0x7f9d88150180 2023-10-09T11:56:07.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d7d7fa700 1 -- 172.21.15.86:0/3427060452 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7801a9f0 con 0x7f9d88150180 2023-10-09T11:56:07.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d88142ea0 con 0x7f9d88150180 2023-10-09T11:56:07.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.034+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d88143460 con 0x7f9d88150180 2023-10-09T11:56:07.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.036+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88143960 con 0x7f9d88150180 2023-10-09T11:56:07.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.037+0000 7f9d7d7fa700 1 -- 172.21.15.86:0/3427060452 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f9d7802d440 con 0x7f9d88150180 2023-10-09T11:56:07.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.038+0000 7f9d7d7fa700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 0x7f9d6c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.038+0000 7f9d7d7fa700 1 -- 172.21.15.86:0/3427060452 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6425+0+0 (secure 0 0 0) 0x7f9d780865f0 con 0x7f9d88150180 2023-10-09T11:56:07.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.038+0000 7f9d8d19b700 1 -- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 msgr2=0x7f9d6c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:07.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.038+0000 7f9d8d19b700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 0x7f9d6c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.042+0000 7f9d7d7fa700 1 -- 172.21.15.86:0/3427060452 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d780533e0 con 0x7f9d88150180 2023-10-09T11:56:07.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:07.080+0000 7f15f1328180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:07.088 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:07.087+0000 7fd86a496180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:56:07.175 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:07.175+0000 7f15f1328180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:56:07.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.239+0000 7f9d8d19b700 1 -- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 msgr2=0x7f9d6c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:07.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.239+0000 7f9d8d19b700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 0x7f9d6c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:07.266 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:07.265+0000 7fd86a496180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:07.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.285+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d8804c3c0 con 0x7f9d88150180 2023-10-09T11:56:07.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.286+0000 7f9d7d7fa700 1 -- 172.21.15.86:0/3427060452 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f9d78056a00 con 0x7f9d88150180 2023-10-09T11:56:07.287 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:07.287 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/569752766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":569752766},{"type":"v1","addr":"172.21.15.135:6834","nonce":569752766}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/312603704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":312603704},{"type":"v1","addr":"172.21.15.135:6835","nonce":312603704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/4036553983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":4036553983},{"type":"v1","addr":"172.21.15.86:6833","nonce":4036553983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:54:05.279420+0000","modified":"2023-10-09T11:54:09.221890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6836/3777239940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3777239940},{"type":"v1","addr":"172.21.15.86:6836","nonce":3777239940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:56:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 msgr2=0x7f9d6c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 0x7f9d6c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150180 msgr2=0x7f9d880add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150180 0x7f9d880add80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9d8806fe40 tx=0x7f9d78017000 comp rx=0 tx=0).stop 2023-10-09T11:56:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 shutdown_connections 2023-10-09T11:56:07.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d88150550 0x7f9d88140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d880c7410 0x7f9d880aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d6c067050 0x7f9d6c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 --2- 172.21.15.86:0/3427060452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d88150180 0x7f9d880add80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 >> 172.21.15.86:0/3427060452 conn(0x7f9d880cc1f0 msgr2=0x7f9d880c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:07.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.288+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 shutdown_connections 2023-10-09T11:56:07.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.289+0000 7f9d8e19d700 1 -- 172.21.15.86:0/3427060452 wait complete. 2023-10-09T11:56:07.291 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2023-10-09T11:56:07.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:07.368 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:07.367+0000 7fd86a496180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:56:07.467 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:07.467+0000 7f15f1328180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:56:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.495+0000 7fa04e1ff700 1 Processor -- start 2023-10-09T11:56:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.495+0000 7fa04e1ff700 1 -- start start 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa04e1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0480cbf30 0x7fa0480ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa04e1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa0480ccf90 0x7fa0480b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa04e1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa04815a270 0x7fa0480b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa04e1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa048156bf0 con 0x7fa0480cbf30 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa04e1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480ae950 con 0x7fa0480ccf90 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa04e1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480cc300 con 0x7fa04815a270 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa0477fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0480cbf30 0x7fa0480ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa0477fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0480cbf30 0x7fa0480ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40494/0 (socket says 172.21.15.86:40494) 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa046ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa0480ccf90 0x7fa0480b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa0477fe700 1 -- 172.21.15.86:0/38592848 learned_addr learned my addr 172.21.15.86:0/38592848 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.496+0000 7fa047fff700 1 --2- 172.21.15.86:0/38592848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa04815a270 0x7fa0480b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0477fe700 1 -- 172.21.15.86:0/38592848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa04815a270 msgr2=0x7fa0480b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0477fe700 1 --2- 172.21.15.86:0/38592848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa04815a270 0x7fa0480b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0477fe700 1 -- 172.21.15.86:0/38592848 >> v2:172.21.15.135:3300/0 conn(0x7fa0480ccf90 msgr2=0x7fa0480b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0477fe700 1 --2- 172.21.15.86:0/38592848 >> v2:172.21.15.135:3300/0 conn(0x7fa0480ccf90 0x7fa0480b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0477fe700 1 -- 172.21.15.86:0/38592848 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480ad370 con 0x7fa0480cbf30 2023-10-09T11:56:07.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0477fe700 1 --2- 172.21.15.86:0/38592848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa0480ae410 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa04806d670 tx=0x7fa038009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bea4ed3f811a391 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:07.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0467fc700 1 -- 172.21.15.86:0/38592848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800b640 con 0x7fa0480cbf30 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0467fc700 1 -- 172.21.15.86:0/38592848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800b7a0 con 0x7fa0480cbf30 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.497+0000 7fa0467fc700 1 -- 172.21.15.86:0/38592848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800bb40 con 0x7fa0480cbf30 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 -- 172.21.15.86:0/38592848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 msgr2=0x7fa0480ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/38592848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa0480ae410 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa04806d670 tx=0x7fa038009250 comp rx=0 tx=0).stop 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 -- 172.21.15.86:0/38592848 shutdown_connections 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/38592848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa04815a270 0x7fa0480b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/38592848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa0480ae410 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/38592848 >> v2:172.21.15.135:3300/0 conn(0x7fa0480ccf90 0x7fa0480b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 -- 172.21.15.86:0/38592848 >> 172.21.15.86:0/38592848 conn(0x7fa04806a320 msgr2=0x7fa0480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 -- 172.21.15.86:0/38592848 shutdown_connections 2023-10-09T11:56:07.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.498+0000 7fa04e1ff700 1 -- 172.21.15.86:0/38592848 wait complete. 2023-10-09T11:56:07.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.500+0000 7fa04e1ff700 1 Processor -- start 2023-10-09T11:56:07.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.500+0000 7fa04e1ff700 1 -- start start 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa04e1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa048148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa04e1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0480ccf90 0x7fa0480ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa04e1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04815a270 0x7fa0480a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa04e1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04816ba70 con 0x7fa0480cbf30 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa04e1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04816b140 con 0x7fa04815a270 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa04e1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04816b420 con 0x7fa0480ccf90 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa0477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa048148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa0477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa048148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40498/0 (socket says 172.21.15.86:40498) 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa0477fe700 1 -- 172.21.15.86:0/3322191662 learned_addr learned my addr 172.21.15.86:0/3322191662 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa046ffd700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0480ccf90 0x7fa0480ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.501+0000 7fa047fff700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04815a270 0x7fa0480a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa0477fe700 1 -- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0480ccf90 msgr2=0x7fa0480ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa0477fe700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0480ccf90 0x7fa0480ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa0477fe700 1 -- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04815a270 msgr2=0x7fa0480a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa0477fe700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04815a270 0x7fa0480a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa0477fe700 1 -- 172.21.15.86:0/3322191662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380094f0 con 0x7fa0480cbf30 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa0477fe700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa048148ef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa0380099b0 tx=0x7fa038017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa02f7fe700 1 -- 172.21.15.86:0/3322191662 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800bb20 con 0x7fa0480cbf30 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa02f7fe700 1 -- 172.21.15.86:0/3322191662 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038000c90 con 0x7fa0480cbf30 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa02f7fe700 1 -- 172.21.15.86:0/3322191662 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038011650 con 0x7fa0480cbf30 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04816b700 con 0x7fa0480cbf30 2023-10-09T11:56:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.502+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04816ab30 con 0x7fa0480cbf30 2023-10-09T11:56:07.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.504+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04804c3c0 con 0x7fa0480cbf30 2023-10-09T11:56:07.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.504+0000 7fa02f7fe700 1 -- 172.21.15.86:0/3322191662 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa038011a40 con 0x7fa0480cbf30 2023-10-09T11:56:07.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.505+0000 7fa02f7fe700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 0x7fa034069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.505+0000 7fa02f7fe700 1 -- 172.21.15.86:0/3322191662 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6425+0+0 (secure 0 0 0) 0x7fa0380861b0 con 0x7fa0480cbf30 2023-10-09T11:56:07.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.505+0000 7fa046ffd700 1 -- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 msgr2=0x7fa034069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:07.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.505+0000 7fa046ffd700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 0x7fa034069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:07.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.510+0000 7fa02f7fe700 1 -- 172.21.15.86:0/3322191662 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa038053040 con 0x7fa0480cbf30 2023-10-09T11:56:07.564 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:07.564+0000 7f15f1328180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:56:07.672 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:07.671+0000 7fd86a496180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:56:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.706+0000 7fa046ffd700 1 -- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 msgr2=0x7fa034069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.706+0000 7fa046ffd700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 0x7fa034069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:07.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.753+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0480ae510 con 0x7fa0480cbf30 2023-10-09T11:56:07.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.754+0000 7fa02f7fe700 1 -- 172.21.15.86:0/3322191662 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fa038056660 con 0x7fa0480cbf30 2023-10-09T11:56:07.755 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:07.755 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/569752766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":569752766},{"type":"v1","addr":"172.21.15.135:6834","nonce":569752766}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/312603704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":312603704},{"type":"v1","addr":"172.21.15.135:6835","nonce":312603704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/4036553983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":4036553983},{"type":"v1","addr":"172.21.15.86:6833","nonce":4036553983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:54:05.279420+0000","modified":"2023-10-09T11:54:09.221890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5724},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5724":{"gid":5724,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6836/3777239940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3777239940},{"type":"v1","addr":"172.21.15.86:6836","nonce":3777239940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:56:07.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 msgr2=0x7fa034069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:07.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 0x7fa034069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 msgr2=0x7fa048148ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa048148ef0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa0380099b0 tx=0x7fa038017000 comp rx=0 tx=0).stop 2023-10-09T11:56:07.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 shutdown_connections 2023-10-09T11:56:07.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7fa034067050 0x7fa034069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0480cbf30 0x7fa048148ef0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04815a270 0x7fa0480a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 --2- 172.21.15.86:0/3322191662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0480ccf90 0x7fa0480ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 >> 172.21.15.86:0/3322191662 conn(0x7fa04806a320 msgr2=0x7fa0480ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:07.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 shutdown_connections 2023-10-09T11:56:07.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.756+0000 7fa04e1ff700 1 -- 172.21.15.86:0/3322191662 wait complete. 2023-10-09T11:56:07.759 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 25 2023-10-09T11:56:07.773 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:07.772+0000 7fd86a496180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:56:07.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:07.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.960+0000 7f603359e700 1 Processor -- start 2023-10-09T11:56:07.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.961+0000 7f603359e700 1 -- start start 2023-10-09T11:56:07.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.962+0000 7f603359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f603415d230 0x7f603415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.962+0000 7f603359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340b2980 con 0x7f6034159420 2023-10-09T11:56:07.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.962+0000 7f603359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603415db70 con 0x7f60341597f0 2023-10-09T11:56:07.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.962+0000 7f603359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60340b11d0 con 0x7f603415d230 2023-10-09T11:56:07.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.962+0000 7f6032d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f603415d230 0x7f603415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.962+0000 7f603259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6034159420 0x7f60340b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48506/0 (socket says 172.21.15.86:48506) 2023-10-09T11:56:07.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.962+0000 7f603259c700 1 -- 172.21.15.86:0/3833179049 learned_addr learned my addr 172.21.15.86:0/3833179049 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:07.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f603159a700 1 -- 172.21.15.86:0/3833179049 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748052531 0 0) 0x7f60340b2980 con 0x7f6034159420 2023-10-09T11:56:07.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f603159a700 1 -- 172.21.15.86:0/3833179049 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c003570 con 0x7f6034159420 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f6032d9d700 1 -- 172.21.15.86:0/3833179049 >> v1:172.21.15.135:6789/0 conn(0x7f60341597f0 legacy=0x7f60340b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f6032d9d700 1 -- 172.21.15.86:0/3833179049 >> v1:172.21.15.86:6789/0 conn(0x7f6034159420 legacy=0x7f60340b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f6032d9d700 1 -- 172.21.15.86:0/3833179049 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340b14b0 con 0x7f603415d230 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f6032d9d700 1 --2- 172.21.15.86:0/3833179049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f603415d230 0x7f603415d630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f602c009e60 tx=0x7f602c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16856e6dca148e8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f603159a700 1 -- 172.21.15.86:0/3833179049 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00e070 con 0x7f603415d230 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f603159a700 1 -- 172.21.15.86:0/3833179049 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00bb60 con 0x7f603415d230 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.963+0000 7f603159a700 1 -- 172.21.15.86:0/3833179049 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c012430 con 0x7f603415d230 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.964+0000 7f603359e700 1 -- 172.21.15.86:0/3833179049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f603415d230 msgr2=0x7f603415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.964+0000 7f603359e700 1 --2- 172.21.15.86:0/3833179049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f603415d230 0x7f603415d630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f602c009e60 tx=0x7f602c009780 comp rx=0 tx=0).stop 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.964+0000 7f603359e700 1 -- 172.21.15.86:0/3833179049 shutdown_connections 2023-10-09T11:56:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.964+0000 7f603359e700 1 --2- 172.21.15.86:0/3833179049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f603415d230 0x7f603415d630 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.964+0000 7f603359e700 1 -- 172.21.15.86:0/3833179049 >> 172.21.15.86:0/3833179049 conn(0x7f60340d0660 msgr2=0x7f60340d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:07.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.964+0000 7f603359e700 1 -- 172.21.15.86:0/3833179049 shutdown_connections 2023-10-09T11:56:07.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.964+0000 7f603359e700 1 -- 172.21.15.86:0/3833179049 wait complete. 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.965+0000 7f603359e700 1 Processor -- start 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.966+0000 7f603359e700 1 -- start start 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.966+0000 7f603359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6034159420 0x7f603415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.966+0000 7f603359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60341597f0 0x7f60341561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603415d230 0x7f6034157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6034156720 con 0x7f6034159420 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603415c640 con 0x7f60341597f0 2023-10-09T11:56:07.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603415b370 con 0x7f603415d230 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6034159420 0x7f603415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6034159420 0x7f603415ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40520/0 (socket says 172.21.15.86:40520) 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 -- 172.21.15.86:0/2279894932 learned_addr learned my addr 172.21.15.86:0/2279894932 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f6032d9d700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603415d230 0x7f6034157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f6031d9b700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60341597f0 0x7f60341561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 -- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603415d230 msgr2=0x7f6034157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603415d230 0x7f6034157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 -- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60341597f0 msgr2=0x7f60341561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60341597f0 0x7f60341561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 -- 172.21.15.86:0/2279894932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c009a20 con 0x7f6034159420 2023-10-09T11:56:07.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f6032d9d700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603415d230 0x7f6034157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:07.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.967+0000 7f603259c700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6034159420 0x7f603415ac70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f602400c7c0 tx=0x7f6024007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:07.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.968+0000 7f60227fc700 1 -- 172.21.15.86:0/2279894932 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024005b30 con 0x7f6034159420 2023-10-09T11:56:07.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.968+0000 7f60227fc700 1 -- 172.21.15.86:0/2279894932 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024005c90 con 0x7f6034159420 2023-10-09T11:56:07.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.968+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603415b650 con 0x7f6034159420 2023-10-09T11:56:07.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.968+0000 7f60227fc700 1 -- 172.21.15.86:0/2279894932 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024007340 con 0x7f6034159420 2023-10-09T11:56:07.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.968+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603415bc10 con 0x7f6034159420 2023-10-09T11:56:07.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.969+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603404c3c0 con 0x7f6034159420 2023-10-09T11:56:07.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.971+0000 7f60227fc700 1 -- 172.21.15.86:0/2279894932 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f602401b400 con 0x7f6034159420 2023-10-09T11:56:07.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.972+0000 7f60227fc700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 0x7f6014069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:07.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.972+0000 7f60227fc700 1 -- 172.21.15.86:0/2279894932 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6425+0+0 (secure 0 0 0) 0x7f6024084490 con 0x7f6034159420 2023-10-09T11:56:07.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.972+0000 7f6031d9b700 1 -- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 msgr2=0x7f6014069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:07.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.972+0000 7f6031d9b700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 0x7f6014069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:07.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:07.976+0000 7f60227fc700 1 -- 172.21.15.86:0/2279894932 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60240513a0 con 0x7f6034159420 2023-10-09T11:56:08.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.173+0000 7f6031d9b700 1 -- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 msgr2=0x7f6014069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:08.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.173+0000 7f6031d9b700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 0x7f6014069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:08.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.173+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60340b1790 con 0x7f6034159420 2023-10-09T11:56:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.175+0000 7f60227fc700 1 -- 172.21.15.86:0/2279894932 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16495 (secure 0 0 0) 0x7f60240549c0 con 0x7f6034159420 2023-10-09T11:56:08.176 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:08.176 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":67,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:05.312258+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:54:03.372722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:54:04.259159+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":67,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.32","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:54:26.336882+0000","172.21.15.86:6835/85490":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/1068719317":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/2060727677":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/1731608138":"2023-10-10T11:54:26.336882+0000","172.21.15.86:0/848505418":"2023-10-10T11:54:26.336882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 msgr2=0x7f6014069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 0x7f6014069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6034159420 msgr2=0x7f603415ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6034159420 0x7f603415ac70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f602400c7c0 tx=0x7f6024007e00 comp rx=0 tx=0).stop 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 shutdown_connections 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f6014067050 0x7f6014069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6034159420 0x7f603415ac70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603415d230 0x7f6034157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 --2- 172.21.15.86:0/2279894932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60341597f0 0x7f60341561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 >> 172.21.15.86:0/2279894932 conn(0x7f60340d0660 msgr2=0x7f6034157190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:08.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 shutdown_connections 2023-10-09T11:56:08.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.177+0000 7f603359e700 1 -- 172.21.15.86:0/2279894932 wait complete. 2023-10-09T11:56:08.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:56:08.264 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:08.263+0000 7f15f1328180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:56:08.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.383+0000 7f33bbfff700 1 Processor -- start 2023-10-09T11:56:08.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.384+0000 7f33bbfff700 1 -- start start 2023-10-09T11:56:08.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33bbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc159420 0x7f33bc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33bbfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f33bc1597f0 0x7f33bc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33bbfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc0b11d0 con 0x7f33bc15d230 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33bbfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc0b14b0 con 0x7f33bc1597f0 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33bbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0b1790 con 0x7f33bc159420 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33baffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc159420 0x7f33bc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33baffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc159420 0x7f33bc0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:46748/0 (socket says 172.21.15.86:46748) 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33baffd700 1 -- 172.21.15.86:0/2148818199 learned_addr learned my addr 172.21.15.86:0/2148818199 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:08.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.385+0000 7f33ba7fc700 1 --2- 172.21.15.86:0/2148818199 >> v2:172.21.15.135:3300/0 conn(0x7f33bc1597f0 0x7f33bc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33baffd700 1 -- 172.21.15.86:0/2148818199 >> v2:172.21.15.135:3300/0 conn(0x7f33bc1597f0 msgr2=0x7f33bc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33baffd700 1 --2- 172.21.15.86:0/2148818199 >> v2:172.21.15.135:3300/0 conn(0x7f33bc1597f0 0x7f33bc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33baffd700 1 -- 172.21.15.86:0/2148818199 >> v1:172.21.15.135:6789/0 conn(0x7f33bc15d230 legacy=0x7f33bc0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33baffd700 1 -- 172.21.15.86:0/2148818199 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc0b1a70 con 0x7f33bc159420 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33baffd700 1 --2- 172.21.15.86:0/2148818199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc159420 0x7f33bc0b5f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0099b0 tx=0x7f33ac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0922bdcd6b68dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33b9ffb700 1 -- 172.21.15.86:0/2148818199 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac009ea0 con 0x7f33bc159420 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33b9ffb700 1 -- 172.21.15.86:0/2148818199 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac00b860 con 0x7f33bc159420 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.386+0000 7f33b9ffb700 1 -- 172.21.15.86:0/2148818199 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00bc00 con 0x7f33bc159420 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 -- 172.21.15.86:0/2148818199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc159420 msgr2=0x7f33bc0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2148818199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc159420 0x7f33bc0b5f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0099b0 tx=0x7f33ac009250 comp rx=0 tx=0).stop 2023-10-09T11:56:08.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 -- 172.21.15.86:0/2148818199 shutdown_connections 2023-10-09T11:56:08.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2148818199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc159420 0x7f33bc0b5f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2148818199 >> v2:172.21.15.135:3300/0 conn(0x7f33bc1597f0 0x7f33bc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 -- 172.21.15.86:0/2148818199 >> 172.21.15.86:0/2148818199 conn(0x7f33bc0d0660 msgr2=0x7f33bc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:08.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 -- 172.21.15.86:0/2148818199 shutdown_connections 2023-10-09T11:56:08.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.387+0000 7f33bbfff700 1 -- 172.21.15.86:0/2148818199 wait complete. 2023-10-09T11:56:08.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.388+0000 7f33bbfff700 1 Processor -- start 2023-10-09T11:56:08.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.389+0000 7f33bbfff700 1 -- start start 2023-10-09T11:56:08.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.389+0000 7f33bbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33bc159420 0x7f33bc159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.389+0000 7f33bbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33bc1597f0 0x7f33bc0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33bbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc15d230 0x7f33bc149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33bbfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc15ae90 con 0x7f33bc159420 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33bbfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc15a280 con 0x7f33bc1597f0 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33bbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc15a560 con 0x7f33bc15d230 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33bc159420 0x7f33bc159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33bc159420 0x7f33bc159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40530/0 (socket says 172.21.15.86:40530) 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 -- 172.21.15.86:0/2228857835 learned_addr learned my addr 172.21.15.86:0/2228857835 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33ba7fc700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33bc1597f0 0x7f33bc0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33bb7fe700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc15d230 0x7f33bc149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 -- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc15d230 msgr2=0x7f33bc149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc15d230 0x7f33bc149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 -- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33bc1597f0 msgr2=0x7f33bc0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33bc1597f0 0x7f33bc0c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33baffd700 1 -- 172.21.15.86:0/2228857835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0094f0 con 0x7f33bc159420 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.390+0000 7f33ba7fc700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33bc1597f0 0x7f33bc0c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.391+0000 7f33baffd700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33bc159420 0x7f33bc159ca0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0b18d0 tx=0x7f33ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.391+0000 7f33a2ffd700 1 -- 172.21.15.86:0/2228857835 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac000d10 con 0x7f33bc159420 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.391+0000 7f33a2ffd700 1 -- 172.21.15.86:0/2228857835 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac00bbe0 con 0x7f33bc159420 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.391+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc15a840 con 0x7f33bc159420 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.391+0000 7f33a2ffd700 1 -- 172.21.15.86:0/2228857835 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011670 con 0x7f33bc159420 2023-10-09T11:56:08.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.391+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc0c6400 con 0x7f33bc159420 2023-10-09T11:56:08.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.392+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc04c3c0 con 0x7f33bc159420 2023-10-09T11:56:08.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.394+0000 7f33a2ffd700 1 -- 172.21.15.86:0/2228857835 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f33ac011aa0 con 0x7f33bc159420 2023-10-09T11:56:08.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.395+0000 7f33a2ffd700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 0x7f33a8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.395+0000 7f33a2ffd700 1 -- 172.21.15.86:0/2228857835 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6425+0+0 (secure 0 0 0) 0x7f33ac086280 con 0x7f33bc159420 2023-10-09T11:56:08.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.395+0000 7f33ba7fc700 1 -- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 msgr2=0x7f33a8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:08.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.395+0000 7f33ba7fc700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 0x7f33a8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:08.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.399+0000 7f33a2ffd700 1 -- 172.21.15.86:0/2228857835 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33ac053070 con 0x7f33bc159420 2023-10-09T11:56:08.511 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:08.509+0000 7fd86a496180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:56:08.551 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:08.551+0000 7f15f1328180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:56:08.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.596+0000 7f33ba7fc700 1 -- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 msgr2=0x7f33a8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6835/85490 2023-10-09T11:56:08.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.596+0000 7f33ba7fc700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 0x7f33a8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:08.642 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:08.642+0000 7f15f1328180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:56:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.643+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f33bc0b1d50 con 0x7f33bc159420 2023-10-09T11:56:08.645 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T11:56:08.644+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:56:08.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.650+0000 7f33a2ffd700 1 -- 172.21.15.86:0/2228857835 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f33ac056690 con 0x7f33bc159420 2023-10-09T11:56:08.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 msgr2=0x7f33a8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:08.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 0x7f33a8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33bc159420 msgr2=0x7f33bc159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33bc159420 0x7f33bc159ca0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0b18d0 tx=0x7f33ac017000 comp rx=0 tx=0).stop 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 shutdown_connections 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f33a8067050 0x7f33a8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33bc159420 0x7f33bc159ca0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33bc15d230 0x7f33bc149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 --2- 172.21.15.86:0/2228857835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33bc1597f0 0x7f33bc0c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 >> 172.21.15.86:0/2228857835 conn(0x7f33bc0d0660 msgr2=0x7f33bc0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 shutdown_connections 2023-10-09T11:56:08.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.653+0000 7f33bbfff700 1 -- 172.21.15.86:0/2228857835 wait complete. 2023-10-09T11:56:08.656 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:56:08.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:56:08.711 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:56:08.797 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:08.797+0000 7f15f1328180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:56:08.814 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:08.812+0000 7fd86a496180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:56:08.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.869+0000 7f02fd59d700 1 Processor -- start 2023-10-09T11:56:08.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.869+0000 7f02fd59d700 1 -- start start 2023-10-09T11:56:08.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02fd59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02f80b16d0 0x7f02f80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02fd59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f80b2080 con 0x7f02f80b4e70 2023-10-09T11:56:08.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02fd59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f80cfb00 con 0x7f02f80b33b0 2023-10-09T11:56:08.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02fd59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f80b5c40 con 0x7f02f80b16d0 2023-10-09T11:56:08.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02f80b16d0 0x7f02f80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f7fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f02f80b4e70 0x7f02f80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48514/0 (socket says 172.21.15.86:48514) 2023-10-09T11:56:08.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f7fff700 1 -- 172.21.15.86:0/1205108740 learned_addr learned my addr 172.21.15.86:0/1205108740 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:08.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f77fe700 1 --2- 172.21.15.86:0/1205108740 >> v2:172.21.15.86:3300/0 conn(0x7f02f80b16d0 0x7f02f80b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40564/0 (socket says 172.21.15.86:40564) 2023-10-09T11:56:08.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f77fe700 1 -- 172.21.15.86:0/1205108740 >> v1:172.21.15.135:6789/0 conn(0x7f02f80b33b0 legacy=0x7f02f80b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f77fe700 1 -- 172.21.15.86:0/1205108740 >> v1:172.21.15.86:6789/0 conn(0x7f02f80b4e70 legacy=0x7f02f80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f77fe700 1 -- 172.21.15.86:0/1205108740 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80b5f20 con 0x7f02f80b16d0 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.871+0000 7f02f6ffd700 1 -- 172.21.15.86:0/1205108740 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195944462 0 0) 0x7f02f80b2080 con 0x7f02f80b4e70 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.872+0000 7f02f77fe700 1 --2- 172.21.15.86:0/1205108740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f80b1b40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0098e0 tx=0x7f02ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b51875d3df3204 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.872+0000 7f02f6ffd700 1 -- 172.21.15.86:0/1205108740 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec009e80 con 0x7f02f80b16d0 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.872+0000 7f02f6ffd700 1 -- 172.21.15.86:0/1205108740 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec00b860 con 0x7f02f80b16d0 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.872+0000 7f02f6ffd700 1 -- 172.21.15.86:0/1205108740 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00bbe0 con 0x7f02f80b16d0 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.873+0000 7f02fd59d700 1 -- 172.21.15.86:0/1205108740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 msgr2=0x7f02f80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.873+0000 7f02fd59d700 1 --2- 172.21.15.86:0/1205108740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f80b1b40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0098e0 tx=0x7f02ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.873+0000 7f02fd59d700 1 -- 172.21.15.86:0/1205108740 shutdown_connections 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.873+0000 7f02fd59d700 1 --2- 172.21.15.86:0/1205108740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f80b1b40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.873+0000 7f02fd59d700 1 -- 172.21.15.86:0/1205108740 >> 172.21.15.86:0/1205108740 conn(0x7f02f80d10c0 msgr2=0x7f02f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:08.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.873+0000 7f02fd59d700 1 -- 172.21.15.86:0/1205108740 shutdown_connections 2023-10-09T11:56:08.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.873+0000 7f02fd59d700 1 -- 172.21.15.86:0/1205108740 wait complete. 2023-10-09T11:56:08.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.874+0000 7f02fd59d700 1 Processor -- start 2023-10-09T11:56:08.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.874+0000 7f02fd59d700 1 -- start start 2023-10-09T11:56:08.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.875+0000 7f02fd59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f816a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.875+0000 7f02fd59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f80b33b0 0x7f02f815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.875+0000 7f02fd59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02f80b4e70 0x7f02f815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.875+0000 7f02fd59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cb600 con 0x7f02f80b16d0 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.875+0000 7f02fd59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cb8e0 con 0x7f02f80b33b0 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.875+0000 7f02fd59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cbbc0 con 0x7f02f80b4e70 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.875+0000 7f02f7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f816a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f80b33b0 0x7f02f815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f816a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40578/0 (socket says 172.21.15.86:40578) 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 -- 172.21.15.86:0/2650249508 learned_addr learned my addr 172.21.15.86:0/2650249508 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02fcd9c700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02f80b4e70 0x7f02f815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 -- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02f80b4e70 msgr2=0x7f02f815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02f80b4e70 0x7f02f815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 -- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f80b33b0 msgr2=0x7f02f815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:08.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f80b33b0 0x7f02f815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:08.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 -- 172.21.15.86:0/2650249508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec009420 con 0x7f02f80b16d0 2023-10-09T11:56:08.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f77fe700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f80b33b0 0x7f02f815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.876+0000 7f02f7fff700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f816a440 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f02e800c560 tx=0x7f02e8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.877+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8005b30 con 0x7f02f80b16d0 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.877+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e8005c90 con 0x7f02f80b16d0 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.877+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8007320 con 0x7f02f80b16d0 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.877+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f80cbea0 con 0x7f02f80b16d0 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.877+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f816ab40 con 0x7f02f80b16d0 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.878+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f8088990 con 0x7f02f80b16d0 2023-10-09T11:56:08.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.879+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 26) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f02e801b3b0 con 0x7f02f80b16d0 2023-10-09T11:56:08.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.880+0000 7f02dffff700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:08.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.880+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f02e8083de0 con 0x7f02f80b16d0 2023-10-09T11:56:08.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.880+0000 7f02f77fe700 -1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:08.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.880+0000 7f02f77fe700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:08.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:08.884+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02e8050c30 con 0x7f02f80b16d0 2023-10-09T11:56:08.902 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:08.900+0000 7f15f1328180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:56:08.911 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:08.910+0000 7fd86a496180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:56:09.068 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:09.067+0000 7fd86a496180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:56:09.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.081+0000 7f02f77fe700 -1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.081+0000 7f02f77fe700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:09.088 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:09.087+0000 7f15f1328180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:56:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.124+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f02f804bb80 con 0x7f02f80b16d0 2023-10-09T11:56:09.172 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:09.171+0000 7fd86a496180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:56:09.179 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:09.178+0000 7f15f1328180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:56:09.270 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:09.269+0000 7f15f1328180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:56:09.359 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:09.358+0000 7fd86a496180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:56:09.363 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:09.361+0000 7f15f1328180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:56:09.366 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:09.364+0000 7f15e73fc700 -1 --2- 172.21.15.135:0/112423 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x5608324b2000 0x5608324b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.450 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:09.449+0000 7fd86a496180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:56:09.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.482+0000 7f02f77fe700 -1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.482+0000 7f02f77fe700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:56:09.541 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:09.540+0000 7fd86a496180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:56:09.567 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:09.565+0000 7f15e73fc700 -1 --2- 172.21.15.135:0/112423 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x5608324b2000 0x5608324b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.585 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T11:56:09.584+0000 7f64739f9700 -1 --2- 172.21.15.86:0/85489 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55efa6017000 0x55efa68f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.585 INFO:tasks.ceph.osd.3.smithi086.stderr:2023-10-09T11:56:09.584+0000 7f93383fd700 -1 --2- [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55ca1d3eb000 0x55ca21db3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.586 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-09T11:56:09.584+0000 7fc4757fc700 -1 --2- [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55920754a400 0x5591fcd8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.586 INFO:tasks.ceph.osd.0.smithi086.stderr:2023-10-09T11:56:09.585+0000 7fe7eaffc700 -1 --2- [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x5627cd01ac00 0x5627cdeae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.586 INFO:tasks.ceph.osd.2.smithi086.stderr:2023-10-09T11:56:09.585+0000 7f60e81fd700 -1 --2- [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55e069fc5400 0x55e066b0d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.587 INFO:tasks.ceph.mon.c.smithi135.stderr:2023-10-09T11:56:09.584+0000 7fb6e1bed700 -1 --2- 172.21.15.135:0/112415 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x5571cf034800 0x5571cf0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.587 INFO:tasks.ceph.mon.b.smithi135.stderr:2023-10-09T11:56:09.584+0000 7f06f37f9700 -1 --2- 172.21.15.135:0/112410 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x557ff5cc4000 0x557ff4f5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.587 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-09T11:56:09.584+0000 7f856e3fc700 -1 --2- [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x56152f1aa000 0x561535912580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.588 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-09T11:56:09.584+0000 7fdad7ffc700 -1 --2- [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x562f14503c00 0x562f1aac8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.588 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-09T11:56:09.585+0000 7ff134bfd700 -1 --2- [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x557f2333a800 0x557f2329b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.588 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-09T11:56:09.585+0000 7f7cf51fd700 -1 --2- [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55fe35256400 0x55fe35861b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.589 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-10-09T11:56:09.586+0000 7f51265fc700 -1 --2- [v2:172.21.15.135:6832/569752766,v1:172.21.15.135:6834/569752766] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55d83d2cc400 0x55d83c4f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.589 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-10-09T11:56:09.586+0000 7f6e257fc700 -1 --2- [v2:172.21.15.135:6833/312603704,v1:172.21.15.135:6835/312603704] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x5572db010400 0x5572da257b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.589 INFO:tasks.ceph.mds.a.smithi086.stderr:2023-10-09T11:56:09.587+0000 7f29845fc700 -1 --2- [v2:172.21.15.86:6832/4036553983,v1:172.21.15.86:6833/4036553983] >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55eaff8ae000 0x55eafea85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.635 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:09.634+0000 7fd86a496180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:56:09.638 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:09.637+0000 7fd8605fc700 -1 --2- 172.21.15.86:0/85490 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x55c89fb54000 0x55c89fb5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] is using msgr V1 protocol 2023-10-09T11:56:09.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.647+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 27) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f02e8051000 con 0x7f02f80b16d0 2023-10-09T11:56:09.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.647+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 msgr2=0x7f02e4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:09.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.647+0000 7f02dffff700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.651+0000 7f02dffff700 1 -- 172.21.15.86:0/2650249508 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f02e806e9f0 con 0x7f02f80b16d0 2023-10-09T11:56:09.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.653+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 msgr2=0x7f02f816a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:09.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.653+0000 7f02fd59d700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f816a440 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f02e800c560 tx=0x7f02e8000fe0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 shutdown_connections 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:6835/85490,v1:172.21.15.86:6837/85490] conn(0x7f02e4067050 0x7f02e4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f80b16d0 0x7f02f816a440 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02f80b4e70 0x7f02f815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 --2- 172.21.15.86:0/2650249508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f80b33b0 0x7f02f815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 >> 172.21.15.86:0/2650249508 conn(0x7f02f80d10c0 msgr2=0x7f02f80c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 shutdown_connections 2023-10-09T11:56:09.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.654+0000 7f02fd59d700 1 -- 172.21.15.86:0/2650249508 wait complete. 2023-10-09T11:56:09.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:56:09.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.902+0000 7f1492d9d700 1 Processor -- start 2023-10-09T11:56:09.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.902+0000 7f1492d9d700 1 -- start start 2023-10-09T11:56:09.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.903+0000 7f1492d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c0b0c00 0x7f148c0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:09.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.903+0000 7f1492d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0b0570 con 0x7f148c156350 2023-10-09T11:56:09.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.903+0000 7f1492d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0af4d0 con 0x7f148c0b0760 2023-10-09T11:56:09.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.903+0000 7f1492d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0af7b0 con 0x7f148c0b0c00 2023-10-09T11:56:09.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f1491d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f148c156350 0x7f148c157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48518/0 (socket says 172.21.15.86:48518) 2023-10-09T11:56:09.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f1491d9b700 1 -- 172.21.15.86:0/3592251163 learned_addr learned my addr 172.21.15.86:0/3592251163 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:09.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f149259c700 1 --2- 172.21.15.86:0/3592251163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c0b0c00 0x7f148c0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:09.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f1490d99700 1 -- 172.21.15.86:0/3592251163 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123954748 0 0) 0x7f148c0b0570 con 0x7f148c156350 2023-10-09T11:56:09.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f1490d99700 1 -- 172.21.15.86:0/3592251163 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1478003570 con 0x7f148c156350 2023-10-09T11:56:09.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f1490d99700 1 -- 172.21.15.86:0/3592251163 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500127683 0 0) 0x7f148c0af4d0 con 0x7f148c0b0760 2023-10-09T11:56:09.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f1490d99700 1 -- 172.21.15.86:0/3592251163 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f148c0b0570 con 0x7f148c0b0760 2023-10-09T11:56:09.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f149259c700 1 -- 172.21.15.86:0/3592251163 >> v1:172.21.15.135:6789/0 conn(0x7f148c0b0760 legacy=0x7f148c0ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:09.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f149259c700 1 -- 172.21.15.86:0/3592251163 >> v1:172.21.15.86:6789/0 conn(0x7f148c156350 legacy=0x7f148c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.904+0000 7f149259c700 1 -- 172.21.15.86:0/3592251163 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0afa90 con 0x7f148c0b0c00 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f149259c700 1 --2- 172.21.15.86:0/3592251163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c0b0c00 0x7f148c0ad570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e90 tx=0x7f1484009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b36fda6c1dee48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1490d99700 1 -- 172.21.15.86:0/3592251163 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400e070 con 0x7f148c0b0c00 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1490d99700 1 -- 172.21.15.86:0/3592251163 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148400bb80 con 0x7f148c0b0c00 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1490d99700 1 -- 172.21.15.86:0/3592251163 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484012430 con 0x7f148c0b0c00 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1492d9d700 1 -- 172.21.15.86:0/3592251163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c0b0c00 msgr2=0x7f148c0ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1492d9d700 1 --2- 172.21.15.86:0/3592251163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c0b0c00 0x7f148c0ad570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e90 tx=0x7f1484009780 comp rx=0 tx=0).stop 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1492d9d700 1 -- 172.21.15.86:0/3592251163 shutdown_connections 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1492d9d700 1 --2- 172.21.15.86:0/3592251163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c0b0c00 0x7f148c0ad570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1492d9d700 1 -- 172.21.15.86:0/3592251163 >> 172.21.15.86:0/3592251163 conn(0x7f148c068e20 msgr2=0x7f148c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:09.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.905+0000 7f1492d9d700 1 -- 172.21.15.86:0/3592251163 shutdown_connections 2023-10-09T11:56:09.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.906+0000 7f1492d9d700 1 -- 172.21.15.86:0/3592251163 wait complete. 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.907+0000 7f1492d9d700 1 Processor -- start 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.907+0000 7f1492d9d700 1 -- start start 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1492d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b0760 0x7f148c141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1492d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f148c0b0c00 0x7f148c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1492d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c156350 0x7f148c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1492d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0cbca0 con 0x7f148c0b0760 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1492d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0abef0 con 0x7f148c0b0c00 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1492d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0ac1d0 con 0x7f148c156350 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1491d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b0760 0x7f148c141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:09.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1491d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b0760 0x7f148c141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40682/0 (socket says 172.21.15.86:40682) 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f1491d9b700 1 -- 172.21.15.86:0/337760225 learned_addr learned my addr 172.21.15.86:0/337760225 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f149259c700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c156350 0x7f148c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.908+0000 7f149159a700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f148c0b0c00 0x7f148c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1491d9b700 1 -- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c156350 msgr2=0x7f148c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1491d9b700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c156350 0x7f148c0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1491d9b700 1 -- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f148c0b0c00 msgr2=0x7f148c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1491d9b700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f148c0b0c00 0x7f148c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1491d9b700 1 -- 172.21.15.86:0/337760225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484009a20 con 0x7f148c0b0760 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1491d9b700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b0760 0x7f148c141910 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f148800c790 tx=0x7f1488007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1481ffb700 1 -- 172.21.15.86:0/337760225 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488005b30 con 0x7f148c0b0760 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1481ffb700 1 -- 172.21.15.86:0/337760225 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488005c90 con 0x7f148c0b0760 2023-10-09T11:56:09.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1481ffb700 1 -- 172.21.15.86:0/337760225 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488007300 con 0x7f148c0b0760 2023-10-09T11:56:09.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c0ac4b0 con 0x7f148c0b0760 2023-10-09T11:56:09.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.909+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c0aca70 con 0x7f148c0b0760 2023-10-09T11:56:09.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.910+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c04c3c0 con 0x7f148c0b0760 2023-10-09T11:56:09.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.911+0000 7f1481ffb700 1 -- 172.21.15.86:0/337760225 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 27) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f148801b3b0 con 0x7f148c0b0760 2023-10-09T11:56:09.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.912+0000 7f1481ffb700 1 -- 172.21.15.86:0/337760225 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6741+0+0 (secure 0 0 0) 0x7f1488083a50 con 0x7f148c0b0760 2023-10-09T11:56:09.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:09.917+0000 7f1481ffb700 1 -- 172.21.15.86:0/337760225 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1488050b80 con 0x7f148c0b0760 2023-10-09T11:56:10.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.106+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f148c0afd70 con 0x7f148c0b0760 2023-10-09T11:56:10.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:56:10.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:56:10.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.654+0000 7f1481ffb700 1 -- 172.21.15.86:0/337760225 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1488017020 con 0x7f148c0b0760 2023-10-09T11:56:10.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.659+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b0760 msgr2=0x7f148c141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:10.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.659+0000 7f1492d9d700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b0760 0x7f148c141910 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f148800c790 tx=0x7f1488007ea0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.660+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 shutdown_connections 2023-10-09T11:56:10.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.660+0000 7f1492d9d700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b0760 0x7f148c141910 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.660+0000 7f1492d9d700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148c156350 0x7f148c0cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.660+0000 7f1492d9d700 1 --2- 172.21.15.86:0/337760225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f148c0b0c00 0x7f148c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.660+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 >> 172.21.15.86:0/337760225 conn(0x7f148c068e20 msgr2=0x7f148c1520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:10.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.669+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 shutdown_connections 2023-10-09T11:56:10.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.671+0000 7f1492d9d700 1 -- 172.21.15.86:0/337760225 wait complete. 2023-10-09T11:56:10.675 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:56:10.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:56:10.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.948+0000 7ff6b85ff700 1 Processor -- start 2023-10-09T11:56:10.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.948+0000 7ff6b85ff700 1 -- start start 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.949+0000 7ff6b85ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6b0153f50 0x7ff6b00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.949+0000 7ff6b85ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b0154320 0x7ff6b006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.949+0000 7ff6b85ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff6b015a190 0x7ff6b006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.949+0000 7ff6b85ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00b4570 con 0x7ff6b0153f50 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.949+0000 7ff6b85ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b015a730 con 0x7ff6b015a190 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.949+0000 7ff6b85ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b015aa10 con 0x7ff6b0154320 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6b0153f50 0x7ff6b00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6b0153f50 0x7ff6b00b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40688/0 (socket says 172.21.15.86:40688) 2023-10-09T11:56:10.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 -- 172.21.15.86:0/3064753063 learned_addr learned my addr 172.21.15.86:0/3064753063 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b5b9a700 1 --2- 172.21.15.86:0/3064753063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b0154320 0x7ff6b006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b6b9c700 1 --2- 172.21.15.86:0/3064753063 >> v2:172.21.15.135:3300/0 conn(0x7ff6b015a190 0x7ff6b006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 -- 172.21.15.86:0/3064753063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b0154320 msgr2=0x7ff6b006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 --2- 172.21.15.86:0/3064753063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b0154320 0x7ff6b006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 -- 172.21.15.86:0/3064753063 >> v2:172.21.15.135:3300/0 conn(0x7ff6b015a190 msgr2=0x7ff6b006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 --2- 172.21.15.86:0/3064753063 >> v2:172.21.15.135:3300/0 conn(0x7ff6b015a190 0x7ff6b006d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 -- 172.21.15.86:0/3064753063 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b015acf0 con 0x7ff6b0153f50 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b5b9a700 1 --2- 172.21.15.86:0/3064753063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b0154320 0x7ff6b006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b6b9c700 1 --2- 172.21.15.86:0/3064753063 >> v2:172.21.15.135:3300/0 conn(0x7ff6b015a190 0x7ff6b006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.950+0000 7ff6b639b700 1 --2- 172.21.15.86:0/3064753063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b00b2000 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00cf1c0 tx=0x7ff6ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5794f5760aabb68b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:10.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b5399700 1 -- 172.21.15.86:0/3064753063 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00b860 con 0x7ff6b0153f50 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b5399700 1 -- 172.21.15.86:0/3064753063 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00b9c0 con 0x7ff6b0153f50 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b5399700 1 -- 172.21.15.86:0/3064753063 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00bd60 con 0x7ff6b0153f50 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3064753063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 msgr2=0x7ff6b00b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3064753063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b00b2000 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00cf1c0 tx=0x7ff6ac009250 comp rx=0 tx=0).stop 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3064753063 shutdown_connections 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3064753063 >> v2:172.21.15.135:3300/0 conn(0x7ff6b015a190 0x7ff6b006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3064753063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b00b2000 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3064753063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b0154320 0x7ff6b006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3064753063 >> 172.21.15.86:0/3064753063 conn(0x7ff6b006baf0 msgr2=0x7ff6b006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3064753063 shutdown_connections 2023-10-09T11:56:10.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.951+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3064753063 wait complete. 2023-10-09T11:56:10.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.953+0000 7ff6b85ff700 1 Processor -- start 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.953+0000 7ff6b85ff700 1 -- start start 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b85ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b01516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b85ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b0154320 0x7ff6b00cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b85ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b015a190 0x7ff6b00cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b85ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0151bf0 con 0x7ff6b0153f50 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b85ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00cbb70 con 0x7ff6b0154320 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b85ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00caf60 con 0x7ff6b015a190 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b01516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b01516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40690/0 (socket says 172.21.15.86:40690) 2023-10-09T11:56:10.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 -- 172.21.15.86:0/3326594122 learned_addr learned my addr 172.21.15.86:0/3326594122 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b6b9c700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b015a190 0x7ff6b00cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b5b9a700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b0154320 0x7ff6b00cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 -- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b015a190 msgr2=0x7ff6b00cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b015a190 0x7ff6b00cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 -- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b0154320 msgr2=0x7ff6b00cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b0154320 0x7ff6b00cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.954+0000 7ff6b639b700 1 -- 172.21.15.86:0/3326594122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0094f0 con 0x7ff6b0153f50 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.955+0000 7ff6b639b700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b01516b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009290 tx=0x7ff6ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.955+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac026480 con 0x7ff6b0153f50 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.955+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac01f070 con 0x7ff6b0153f50 2023-10-09T11:56:10.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.955+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b00cb240 con 0x7ff6b0153f50 2023-10-09T11:56:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.955+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac026830 con 0x7ff6b0153f50 2023-10-09T11:56:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.955+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b00cb800 con 0x7ff6b0153f50 2023-10-09T11:56:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.956+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b00cbe50 con 0x7ff6b0153f50 2023-10-09T11:56:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.957+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 28) v1 ==== 84578+0+0 (secure 0 0 0) 0x7ff6ac026ba0 con 0x7ff6b0153f50 2023-10-09T11:56:10.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.957+0000 7ff6a67fc700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff694066db0 0x7ff694069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:10.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.958+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6303+0+0 (secure 0 0 0) 0x7ff6ac021070 con 0x7ff6b0153f50 2023-10-09T11:56:10.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.958+0000 7ff6b5b9a700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff694066db0 0x7ff694069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:10.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.958+0000 7ff6b5b9a700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff694066db0 0x7ff694069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0006f00 tx=0x7ff6a0008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:10.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:10.962+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6ac053540 con 0x7ff6b0153f50 2023-10-09T11:56:11.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.155+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6b00718b0 con 0x7ff6b0153f50 2023-10-09T11:56:11.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.674+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6ac053910 con 0x7ff6b0153f50 2023-10-09T11:56:11.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.674+0000 7ff6a67fc700 1 -- 172.21.15.86:0/3326594122 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff6ac050300 con 0x7ff6b0153f50 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff694066db0 msgr2=0x7ff694069260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff694066db0 0x7ff694069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0006f00 tx=0x7ff6a0008040 comp rx=0 tx=0).stop 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 msgr2=0x7ff6b01516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b01516b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009290 tx=0x7ff6ac017000 comp rx=0 tx=0).stop 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 shutdown_connections 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff694066db0 0x7ff694069260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b0153f50 0x7ff6b01516b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6b015a190 0x7ff6b00cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 --2- 172.21.15.86:0/3326594122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6b0154320 0x7ff6b00cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.677+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 >> 172.21.15.86:0/3326594122 conn(0x7ff6b006baf0 msgr2=0x7ff6b0151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.678+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 shutdown_connections 2023-10-09T11:56:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.678+0000 7ff6b85ff700 1 -- 172.21.15.86:0/3326594122 wait complete. 2023-10-09T11:56:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T11:56:11.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T11:56:11.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.878+0000 7fc41319d700 1 Processor -- start 2023-10-09T11:56:11.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.878+0000 7fc41319d700 1 -- start start 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41319d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc40c0b4e70 0x7fc40c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41319d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc40c0b1b40 0x7fc40c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41319d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c0cfb00 con 0x7fc40c0b16d0 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41319d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0b5c40 con 0x7fc40c0b1b40 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41319d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0b5f20 con 0x7fc40c0b4e70 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41299c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc40c0b1b40 0x7fc40c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41299c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc40c0b1b40 0x7fc40c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40702/0 (socket says 172.21.15.86:40702) 2023-10-09T11:56:11.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.879+0000 7fc41299c700 1 -- 172.21.15.86:0/1437779875 learned_addr learned my addr 172.21.15.86:0/1437779875 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc41219b700 1 --2- 172.21.15.86:0/1437779875 >> v2:172.21.15.135:3300/0 conn(0x7fc40c0b4e70 0x7fc40c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc41299c700 1 -- 172.21.15.86:0/1437779875 >> v2:172.21.15.135:3300/0 conn(0x7fc40c0b4e70 msgr2=0x7fc40c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc41299c700 1 --2- 172.21.15.86:0/1437779875 >> v2:172.21.15.135:3300/0 conn(0x7fc40c0b4e70 0x7fc40c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc41299c700 1 -- 172.21.15.86:0/1437779875 >> v1:172.21.15.86:6789/0 conn(0x7fc40c0b16d0 legacy=0x7fc40c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc41299c700 1 -- 172.21.15.86:0/1437779875 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0b6200 con 0x7fc40c0b1b40 2023-10-09T11:56:11.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc411199700 1 -- 172.21.15.86:0/1437779875 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343690458 0 0) 0x7fc40c0cfb00 con 0x7fc40c0b16d0 2023-10-09T11:56:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc41299c700 1 --2- 172.21.15.86:0/1437779875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b1b40 0x7fc40c15d950 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc40c064910 tx=0x7fc404009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d82e5a5e35cb0af server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc411199700 1 -- 172.21.15.86:0/1437779875 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400e070 con 0x7fc40c0b1b40 2023-10-09T11:56:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc411199700 1 -- 172.21.15.86:0/1437779875 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40400ba50 con 0x7fc40c0b1b40 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.880+0000 7fc411199700 1 -- 172.21.15.86:0/1437779875 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4040092e0 con 0x7fc40c0b1b40 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 -- 172.21.15.86:0/1437779875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b1b40 msgr2=0x7fc40c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 --2- 172.21.15.86:0/1437779875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b1b40 0x7fc40c15d950 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc40c064910 tx=0x7fc404009840 comp rx=0 tx=0).stop 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 -- 172.21.15.86:0/1437779875 shutdown_connections 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 --2- 172.21.15.86:0/1437779875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b1b40 0x7fc40c15d950 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 --2- 172.21.15.86:0/1437779875 >> v2:172.21.15.135:3300/0 conn(0x7fc40c0b4e70 0x7fc40c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 -- 172.21.15.86:0/1437779875 >> 172.21.15.86:0/1437779875 conn(0x7fc40c0d10c0 msgr2=0x7fc40c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 -- 172.21.15.86:0/1437779875 shutdown_connections 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.881+0000 7fc41319d700 1 -- 172.21.15.86:0/1437779875 wait complete. 2023-10-09T11:56:11.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.882+0000 7fc41319d700 1 Processor -- start 2023-10-09T11:56:11.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.883+0000 7fc41319d700 1 -- start start 2023-10-09T11:56:11.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.883+0000 7fc41319d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc40c0b16d0 0x7fc40c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:11.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.883+0000 7fc41319d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c0b1b40 0x7fc40c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:11.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.883+0000 7fc41319d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b4e70 0x7fc40c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41319d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c158810 con 0x7fc40c0b4e70 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41319d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0c9030 con 0x7fc40c0b1b40 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41319d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0c6bf0 con 0x7fc40c0b16d0 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b4e70 0x7fc40c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b4e70 0x7fc40c0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40718/0 (socket says 172.21.15.86:40718) 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 -- 172.21.15.86:0/1920841875 learned_addr learned my addr 172.21.15.86:0/1920841875 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41219b700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc40c0b16d0 0x7fc40c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41199a700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c0b1b40 0x7fc40c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 -- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc40c0b16d0 msgr2=0x7fc40c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc40c0b16d0 0x7fc40c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 -- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c0b1b40 msgr2=0x7fc40c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c0b1b40 0x7fc40c0ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 -- 172.21.15.86:0/1920841875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009ae0 con 0x7fc40c0b4e70 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.884+0000 7fc41299c700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b4e70 0x7fc40c0caca0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc404009880 tx=0x7fc404018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.885+0000 7fc4027fc700 1 -- 172.21.15.86:0/1920841875 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400be60 con 0x7fc40c0b4e70 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.885+0000 7fc4027fc700 1 -- 172.21.15.86:0/1920841875 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404026460 con 0x7fc40c0b4e70 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.885+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c0c8700 con 0x7fc40c0b4e70 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.885+0000 7fc4027fc700 1 -- 172.21.15.86:0/1920841875 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404026820 con 0x7fc40c0b4e70 2023-10-09T11:56:11.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.885+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c0c8cc0 con 0x7fc40c0b4e70 2023-10-09T11:56:11.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.886+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c088990 con 0x7fc40c0b4e70 2023-10-09T11:56:11.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.886+0000 7fc4027fc700 1 -- 172.21.15.86:0/1920841875 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc404003040 con 0x7fc40c0b4e70 2023-10-09T11:56:11.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.887+0000 7fc4027fc700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc3f0066f30 0x7fc3f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:11.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.887+0000 7fc4027fc700 1 -- 172.21.15.86:0/1920841875 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7fc404086610 con 0x7fc40c0b4e70 2023-10-09T11:56:11.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.888+0000 7fc41219b700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc3f0066f30 0x7fc3f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:11.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.888+0000 7fc41219b700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc3f0066f30 0x7fc3f00693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc408006fd0 tx=0x7fc408008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:11.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:11.892+0000 7fc4027fc700 1 -- 172.21.15.86:0/1920841875 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4040538b0 con 0x7fc40c0b4e70 2023-10-09T11:56:12.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.082+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fc40c15ce20 con 0x7fc40c0b4e70 2023-10-09T11:56:12.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.086+0000 7fc4027fc700 1 -- 172.21.15.86:0/1920841875 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v19) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc404056ed0 con 0x7fc40c0b4e70 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc3f0066f30 msgr2=0x7fc3f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc3f0066f30 0x7fc3f00693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc408006fd0 tx=0x7fc408008040 comp rx=0 tx=0).stop 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b4e70 msgr2=0x7fc40c0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b4e70 0x7fc40c0caca0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc404009880 tx=0x7fc404018000 comp rx=0 tx=0).stop 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 shutdown_connections 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc3f0066f30 0x7fc3f00693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc40c0b4e70 0x7fc40c0caca0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc40c0b16d0 0x7fc40c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 --2- 172.21.15.86:0/1920841875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40c0b1b40 0x7fc40c0ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 >> 172.21.15.86:0/1920841875 conn(0x7fc40c0d10c0 msgr2=0x7fc40c15c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:12.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.088+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 shutdown_connections 2023-10-09T11:56:12.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.089+0000 7fc41319d700 1 -- 172.21.15.86:0/1920841875 wait complete. 2023-10-09T11:56:12.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T11:56:12.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.299+0000 7fc4c239d700 1 Processor -- start 2023-10-09T11:56:12.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.299+0000 7fc4c239d700 1 -- start start 2023-10-09T11:56:12.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c239d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4bc15a8a0 0x7fc4bc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c239d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc06ebd0 con 0x7fc4bc06f5a0 2023-10-09T11:56:12.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c239d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc15b2e0 con 0x7fc4bc15a8a0 2023-10-09T11:56:12.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15ad20 con 0x7fc4bc0cb1a0 2023-10-09T11:56:12.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c0b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4bc15a8a0 0x7fc4bc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c0b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4bc15a8a0 0x7fc4bc06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40720/0 (socket says 172.21.15.86:40720) 2023-10-09T11:56:12.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.300+0000 7fc4c0b9a700 1 -- 172.21.15.86:0/1879249324 learned_addr learned my addr 172.21.15.86:0/1879249324 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:12.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4c139b700 1 --2- 172.21.15.86:0/1879249324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4c0b9a700 1 -- 172.21.15.86:0/1879249324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc0cb1a0 msgr2=0x7fc4bc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4c0b9a700 1 --2- 172.21.15.86:0/1879249324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4c0b9a700 1 -- 172.21.15.86:0/1879249324 >> v1:172.21.15.86:6789/0 conn(0x7fc4bc06f5a0 legacy=0x7fc4bc0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4c0b9a700 1 -- 172.21.15.86:0/1879249324 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc15b000 con 0x7fc4bc15a8a0 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4b3fff700 1 -- 172.21.15.86:0/1879249324 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728702602 0 0) 0x7fc4bc06ebd0 con 0x7fc4bc06f5a0 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4c0b9a700 1 --2- 172.21.15.86:0/1879249324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a8a0 0x7fc4bc06f060 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0099b0 tx=0x7fc4ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e095db0b9aa7ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4b3fff700 1 -- 172.21.15.86:0/1879249324 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00b8f0 con 0x7fc4bc15a8a0 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4b3fff700 1 -- 172.21.15.86:0/1879249324 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00ba50 con 0x7fc4bc15a8a0 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.301+0000 7fc4b3fff700 1 -- 172.21.15.86:0/1879249324 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00bdf0 con 0x7fc4bc15a8a0 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 -- 172.21.15.86:0/1879249324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a8a0 msgr2=0x7fc4bc06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 --2- 172.21.15.86:0/1879249324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a8a0 0x7fc4bc06f060 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0099b0 tx=0x7fc4ac009250 comp rx=0 tx=0).stop 2023-10-09T11:56:12.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 -- 172.21.15.86:0/1879249324 shutdown_connections 2023-10-09T11:56:12.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 --2- 172.21.15.86:0/1879249324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc0cb1a0 0x7fc4bc15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 --2- 172.21.15.86:0/1879249324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a8a0 0x7fc4bc06f060 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 -- 172.21.15.86:0/1879249324 >> 172.21.15.86:0/1879249324 conn(0x7fc4bc0cc1e0 msgr2=0x7fc4bc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:12.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 -- 172.21.15.86:0/1879249324 shutdown_connections 2023-10-09T11:56:12.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.302+0000 7fc4c239d700 1 -- 172.21.15.86:0/1879249324 wait complete. 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.303+0000 7fc4c239d700 1 Processor -- start 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.304+0000 7fc4c239d700 1 -- start start 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.304+0000 7fc4c239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc06f5a0 0x7fc4bc0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.304+0000 7fc4c239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4bc0cb1a0 0x7fc4bc0c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.304+0000 7fc4c239d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a370 0x7fc4bc0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.304+0000 7fc4c239d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc13dfd0 con 0x7fc4bc15a370 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.304+0000 7fc4c239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1587c0 con 0x7fc4bc0cb1a0 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.304+0000 7fc4c239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c37d0 con 0x7fc4bc06f5a0 2023-10-09T11:56:12.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a370 0x7fc4bc0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a370 0x7fc4bc0c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40726/0 (socket says 172.21.15.86:40726) 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 -- 172.21.15.86:0/339012098 learned_addr learned my addr 172.21.15.86:0/339012098 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c0b9a700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4bc0cb1a0 0x7fc4bc0c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c139b700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc06f5a0 0x7fc4bc0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 -- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc06f5a0 msgr2=0x7fc4bc0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc06f5a0 0x7fc4bc0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 -- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4bc0cb1a0 msgr2=0x7fc4bc0c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4bc0cb1a0 0x7fc4bc0c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 -- 172.21.15.86:0/339012098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0094f0 con 0x7fc4bc15a370 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.305+0000 7fc4c1b9c700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a370 0x7fc4bc0c14c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400c930 tx=0x7fc4b40016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:12.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.306+0000 7fc4b17fa700 1 -- 172.21.15.86:0/339012098 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400a780 con 0x7fc4bc15a370 2023-10-09T11:56:12.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.306+0000 7fc4b17fa700 1 -- 172.21.15.86:0/339012098 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400a8e0 con 0x7fc4bc15a370 2023-10-09T11:56:12.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.306+0000 7fc4b17fa700 1 -- 172.21.15.86:0/339012098 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400aca0 con 0x7fc4bc15a370 2023-10-09T11:56:12.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.306+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc157bb0 con 0x7fc4bc15a370 2023-10-09T11:56:12.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.306+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc158170 con 0x7fc4bc15a370 2023-10-09T11:56:12.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.307+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc06c450 con 0x7fc4bc15a370 2023-10-09T11:56:12.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.308+0000 7fc4b17fa700 1 -- 172.21.15.86:0/339012098 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4b4012630 con 0x7fc4bc15a370 2023-10-09T11:56:12.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.309+0000 7fc4b17fa700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4a0066f30 0x7fc4a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.309+0000 7fc4b17fa700 1 -- 172.21.15.86:0/339012098 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7fc4b40849a0 con 0x7fc4bc15a370 2023-10-09T11:56:12.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.309+0000 7fc4c139b700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4a0066f30 0x7fc4a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.309+0000 7fc4c139b700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4a0066f30 0x7fc4a00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8006fd0 tx=0x7fc4b8008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:12.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.313+0000 7fc4b17fa700 1 -- 172.21.15.86:0/339012098 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4b4051af0 con 0x7fc4bc15a370 2023-10-09T11:56:12.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.505+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fc4bc06e860 con 0x7fc4bc15a370 2023-10-09T11:56:12.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.512+0000 7fc4b17fa700 1 -- 172.21.15.86:0/339012098 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7fc4b4055110 con 0x7fc4bc15a370 2023-10-09T11:56:12.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4a0066f30 msgr2=0x7fc4a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4a0066f30 0x7fc4a00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8006fd0 tx=0x7fc4b8008040 comp rx=0 tx=0).stop 2023-10-09T11:56:12.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a370 msgr2=0x7fc4bc0c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a370 0x7fc4bc0c14c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400c930 tx=0x7fc4b40016c0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 shutdown_connections 2023-10-09T11:56:12.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4a0066f30 0x7fc4a00693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4bc15a370 0x7fc4bc0c14c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4bc06f5a0 0x7fc4bc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 --2- 172.21.15.86:0/339012098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4bc0cb1a0 0x7fc4bc0c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.514+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 >> 172.21.15.86:0/339012098 conn(0x7fc4bc0cc1e0 msgr2=0x7fc4bc0af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:12.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.515+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 shutdown_connections 2023-10-09T11:56:12.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.515+0000 7fc4c239d700 1 -- 172.21.15.86:0/339012098 wait complete. 2023-10-09T11:56:12.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:56:12.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.718+0000 7fcd737ff700 1 Processor -- start 2023-10-09T11:56:12.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.718+0000 7fcd737ff700 1 -- start start 2023-10-09T11:56:12.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd737ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd6c0c83f0 0x7fcd6c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd737ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd6c1568e0 0x7fcd6c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd737ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6c15b0d0 con 0x7fcd6c0ccee0 2023-10-09T11:56:12.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd737ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6c0c7a60 con 0x7fcd6c0c83f0 2023-10-09T11:56:12.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd737ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6c15a4c0 con 0x7fcd6c1568e0 2023-10-09T11:56:12.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd7159b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd6c0c83f0 0x7fcd6c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd7159b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd6c0c83f0 0x7fcd6c0c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40730/0 (socket says 172.21.15.86:40730) 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd7159b700 1 -- 172.21.15.86:0/838013621 learned_addr learned my addr 172.21.15.86:0/838013621 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd71d9c700 1 --2- 172.21.15.86:0/838013621 >> v2:172.21.15.135:3300/0 conn(0x7fcd6c1568e0 0x7fcd6c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd7159b700 1 -- 172.21.15.86:0/838013621 >> v2:172.21.15.135:3300/0 conn(0x7fcd6c1568e0 msgr2=0x7fcd6c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd7159b700 1 --2- 172.21.15.86:0/838013621 >> v2:172.21.15.135:3300/0 conn(0x7fcd6c1568e0 0x7fcd6c0ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd7159b700 1 -- 172.21.15.86:0/838013621 >> v1:172.21.15.135:6789/0 conn(0x7fcd6c0ccee0 legacy=0x7fcd6c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd7159b700 1 -- 172.21.15.86:0/838013621 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c15a7a0 con 0x7fcd6c0c83f0 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.720+0000 7fcd71d9c700 1 --2- 172.21.15.86:0/838013621 >> v2:172.21.15.135:3300/0 conn(0x7fcd6c1568e0 0x7fcd6c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd7159b700 1 --2- 172.21.15.86:0/838013621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c0c83f0 0x7fcd6c0c7520 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c06d240 tx=0x7fcd6800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c30b8ff94c2e5c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd63fff700 1 -- 172.21.15.86:0/838013621 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800dc10 con 0x7fcd6c0c83f0 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd63fff700 1 -- 172.21.15.86:0/838013621 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6800dd70 con 0x7fcd6c0c83f0 2023-10-09T11:56:12.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd63fff700 1 -- 172.21.15.86:0/838013621 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd680106c0 con 0x7fcd6c0c83f0 2023-10-09T11:56:12.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd737ff700 1 -- 172.21.15.86:0/838013621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c0c83f0 msgr2=0x7fcd6c0c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd737ff700 1 --2- 172.21.15.86:0/838013621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c0c83f0 0x7fcd6c0c7520 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c06d240 tx=0x7fcd6800b4f0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd737ff700 1 -- 172.21.15.86:0/838013621 shutdown_connections 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd737ff700 1 --2- 172.21.15.86:0/838013621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c0c83f0 0x7fcd6c0c7520 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd737ff700 1 --2- 172.21.15.86:0/838013621 >> v2:172.21.15.135:3300/0 conn(0x7fcd6c1568e0 0x7fcd6c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.721+0000 7fcd737ff700 1 -- 172.21.15.86:0/838013621 >> 172.21.15.86:0/838013621 conn(0x7fcd6c068e10 msgr2=0x7fcd6c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.722+0000 7fcd737ff700 1 -- 172.21.15.86:0/838013621 shutdown_connections 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.722+0000 7fcd737ff700 1 -- 172.21.15.86:0/838013621 wait complete. 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.723+0000 7fcd737ff700 1 Processor -- start 2023-10-09T11:56:12.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.723+0000 7fcd737ff700 1 -- start start 2023-10-09T11:56:12.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd737ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd6c0c83f0 0x7fcd6c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd737ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c0ccee0 0x7fcd6c148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd737ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c1568e0 0x7fcd6c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd737ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c1592a0 con 0x7fcd6c1568e0 2023-10-09T11:56:12.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd737ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c153c40 con 0x7fcd6c0ccee0 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd737ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c158970 con 0x7fcd6c0c83f0 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd71d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c1568e0 0x7fcd6c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd71d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c1568e0 0x7fcd6c1493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40734/0 (socket says 172.21.15.86:40734) 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd71d9c700 1 -- 172.21.15.86:0/1263409348 learned_addr learned my addr 172.21.15.86:0/1263409348 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd7159b700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd6c0c83f0 0x7fcd6c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.724+0000 7fcd70d9a700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c0ccee0 0x7fcd6c148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd71d9c700 1 -- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd6c0c83f0 msgr2=0x7fcd6c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd71d9c700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd6c0c83f0 0x7fcd6c069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd71d9c700 1 -- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c0ccee0 msgr2=0x7fcd6c148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd71d9c700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c0ccee0 0x7fcd6c148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd71d9c700 1 -- 172.21.15.86:0/1263409348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6800b790 con 0x7fcd6c1568e0 2023-10-09T11:56:12.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd71d9c700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c1568e0 0x7fcd6c1493a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400cef0 tx=0x7fcd64007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:12.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd617fa700 1 -- 172.21.15.86:0/1263409348 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400ad20 con 0x7fcd6c1568e0 2023-10-09T11:56:12.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd617fa700 1 -- 172.21.15.86:0/1263409348 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd64016420 con 0x7fcd6c1568e0 2023-10-09T11:56:12.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c158c50 con 0x7fcd6c1568e0 2023-10-09T11:56:12.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd617fa700 1 -- 172.21.15.86:0/1263409348 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400aea0 con 0x7fcd6c1568e0 2023-10-09T11:56:12.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.725+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c06a320 con 0x7fcd6c1568e0 2023-10-09T11:56:12.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.726+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6c04c3c0 con 0x7fcd6c1568e0 2023-10-09T11:56:12.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.727+0000 7fcd617fa700 1 -- 172.21.15.86:0/1263409348 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd64016a70 con 0x7fcd6c1568e0 2023-10-09T11:56:12.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.728+0000 7fcd617fa700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcd50066f30 0x7fcd500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:12.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.728+0000 7fcd617fa700 1 -- 172.21.15.86:0/1263409348 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7fcd64012070 con 0x7fcd6c1568e0 2023-10-09T11:56:12.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.728+0000 7fcd7159b700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcd50066f30 0x7fcd500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:12.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.729+0000 7fcd7159b700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcd50066f30 0x7fcd500693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c06d240 tx=0x7fcd6801a000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:12.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.732+0000 7fcd617fa700 1 -- 172.21.15.86:0/1263409348 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd6404e5a0 con 0x7fcd6c1568e0 2023-10-09T11:56:12.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.924+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcd6c1593e0 con 0x7fcd6c1568e0 2023-10-09T11:56:12.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.930+0000 7fcd617fa700 1 -- 172.21.15.86:0/1263409348 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd64051fc0 con 0x7fcd6c1568e0 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcd50066f30 msgr2=0x7fcd500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcd50066f30 0x7fcd500693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c06d240 tx=0x7fcd6801a000 comp rx=0 tx=0).stop 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c1568e0 msgr2=0x7fcd6c1493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c1568e0 0x7fcd6c1493a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400cef0 tx=0x7fcd64007860 comp rx=0 tx=0).stop 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 shutdown_connections 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcd50066f30 0x7fcd500693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd6c1568e0 0x7fcd6c1493a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd6c0c83f0 0x7fcd6c069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 --2- 172.21.15.86:0/1263409348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c0ccee0 0x7fcd6c148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:12.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 >> 172.21.15.86:0/1263409348 conn(0x7fcd6c068e10 msgr2=0x7fcd6c151320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:12.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.932+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 shutdown_connections 2023-10-09T11:56:12.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:12.933+0000 7fcd737ff700 1 -- 172.21.15.86:0/1263409348 wait complete. 2023-10-09T11:56:12.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-09T11:56:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.131+0000 7fa61c7ff700 1 Processor -- start 2023-10-09T11:56:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.132+0000 7fa61c7ff700 1 -- start start 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61c7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa6140b1420 0x7fa6140ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61c7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6140ccf90 0x7fa6140c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61c7ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140cc300 con 0x7fa6140cbf30 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61c7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa614156bf0 con 0x7fa6140ccf90 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61c7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140ae950 con 0x7fa6140b1420 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61ad9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6140ccf90 0x7fa6140c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61ad9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6140ccf90 0x7fa6140c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40738/0 (socket says 172.21.15.86:40738) 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61ad9c700 1 -- 172.21.15.86:0/2498804150 learned_addr learned my addr 172.21.15.86:0/2498804150 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa61a59b700 1 --1- 172.21.15.86:0/2498804150 >> v1:172.21.15.86:6789/0 conn(0x7fa6140cbf30 0x7fa6140b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48540/0 (socket says 172.21.15.86:48540) 2023-10-09T11:56:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.133+0000 7fa619d9a700 1 --2- 172.21.15.86:0/2498804150 >> v2:172.21.15.135:3300/0 conn(0x7fa6140b1420 0x7fa6140ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa61ad9c700 1 -- 172.21.15.86:0/2498804150 >> v2:172.21.15.135:3300/0 conn(0x7fa6140b1420 msgr2=0x7fa6140ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa61ad9c700 1 --2- 172.21.15.86:0/2498804150 >> v2:172.21.15.135:3300/0 conn(0x7fa6140b1420 0x7fa6140ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa61ad9c700 1 -- 172.21.15.86:0/2498804150 >> v1:172.21.15.86:6789/0 conn(0x7fa6140cbf30 legacy=0x7fa6140b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa619599700 1 -- 172.21.15.86:0/2498804150 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257083913 0 0) 0x7fa6140cc300 con 0x7fa6140cbf30 2023-10-09T11:56:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa61ad9c700 1 -- 172.21.15.86:0/2498804150 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140ad370 con 0x7fa6140ccf90 2023-10-09T11:56:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa61ad9c700 1 --2- 172.21.15.86:0/2498804150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140ccf90 0x7fa6140c9740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa6140c9280 tx=0x7fa60c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0e733ba1257230 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:13.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa619599700 1 -- 172.21.15.86:0/2498804150 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c00e070 con 0x7fa6140ccf90 2023-10-09T11:56:13.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa619599700 1 -- 172.21.15.86:0/2498804150 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c00ba40 con 0x7fa6140ccf90 2023-10-09T11:56:13.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.134+0000 7fa619599700 1 -- 172.21.15.86:0/2498804150 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0092e0 con 0x7fa6140ccf90 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2498804150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140ccf90 msgr2=0x7fa6140c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2498804150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140ccf90 0x7fa6140c9740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa6140c9280 tx=0x7fa60c009840 comp rx=0 tx=0).stop 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2498804150 shutdown_connections 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2498804150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140ccf90 0x7fa6140c9740 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2498804150 >> v2:172.21.15.135:3300/0 conn(0x7fa6140b1420 0x7fa6140ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2498804150 >> 172.21.15.86:0/2498804150 conn(0x7fa61406a320 msgr2=0x7fa6140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2498804150 shutdown_connections 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.135+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2498804150 wait complete. 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.136+0000 7fa61c7ff700 1 Processor -- start 2023-10-09T11:56:13.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.136+0000 7fa61c7ff700 1 -- start start 2023-10-09T11:56:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61c7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140b1420 0x7fa6141491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61c7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6140cbf30 0x7fa6140ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61c7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6140ccf90 0x7fa614158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61c7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa614157de0 con 0x7fa6140b1420 2023-10-09T11:56:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61c7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140aa5c0 con 0x7fa6140ccf90 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61c7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140aa8a0 con 0x7fa6140cbf30 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61a59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140b1420 0x7fa6141491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61a59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140b1420 0x7fa6141491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40750/0 (socket says 172.21.15.86:40750) 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.137+0000 7fa61a59b700 1 -- 172.21.15.86:0/2758575094 learned_addr learned my addr 172.21.15.86:0/2758575094 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61ad9c700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6140ccf90 0x7fa614158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61a59b700 1 -- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6140cbf30 msgr2=0x7fa6140ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61a59b700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6140cbf30 0x7fa6140ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61a59b700 1 -- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6140ccf90 msgr2=0x7fa614158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61a59b700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6140ccf90 0x7fa614158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61a59b700 1 -- 172.21.15.86:0/2758575094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c009ae0 con 0x7fa6140b1420 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61ad9c700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6140ccf90 0x7fa614158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61a59b700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140b1420 0x7fa6141491c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa6100011e0 tx=0x7fa610007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa60a7fc700 1 -- 172.21.15.86:0/2758575094 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610007300 con 0x7fa6140b1420 2023-10-09T11:56:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa60a7fc700 1 -- 172.21.15.86:0/2758575094 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610007460 con 0x7fa6140b1420 2023-10-09T11:56:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa60a7fc700 1 -- 172.21.15.86:0/2758575094 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610004830 con 0x7fa6140b1420 2023-10-09T11:56:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa614158050 con 0x7fa6140b1420 2023-10-09T11:56:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.138+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6140aab80 con 0x7fa6140b1420 2023-10-09T11:56:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.139+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61404c3c0 con 0x7fa6140b1420 2023-10-09T11:56:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.140+0000 7fa60a7fc700 1 -- 172.21.15.86:0/2758575094 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa610004be0 con 0x7fa6140b1420 2023-10-09T11:56:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.142+0000 7fa60a7fc700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa5f8066f30 0x7fa5f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.142+0000 7fa60a7fc700 1 -- 172.21.15.86:0/2758575094 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7fa610083b90 con 0x7fa6140b1420 2023-10-09T11:56:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.142+0000 7fa619d9a700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa5f8066f30 0x7fa5f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.142+0000 7fa619d9a700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa5f8066f30 0x7fa5f80693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa6140aecd0 tx=0x7fa604008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:13.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.146+0000 7fa60a7fc700 1 -- 172.21.15.86:0/2758575094 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa610050d60 con 0x7fa6140b1420 2023-10-09T11:56:13.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.407+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fa6140ad650 con 0x7fa6140b1420 2023-10-09T11:56:13.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.674+0000 7fa60a7fc700 1 -- 172.21.15.86:0/2758575094 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v538) v1 ==== 154+0+0 (secure 0 0 0) 0x7fa610018020 con 0x7fa6140b1420 2023-10-09T11:56:13.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.676+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa5f8066f30 msgr2=0x7fa5f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa5f8066f30 0x7fa5f80693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa6140aecd0 tx=0x7fa604008040 comp rx=0 tx=0).stop 2023-10-09T11:56:13.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140b1420 msgr2=0x7fa6141491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140b1420 0x7fa6141491c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa6100011e0 tx=0x7fa610007e10 comp rx=0 tx=0).stop 2023-10-09T11:56:13.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 shutdown_connections 2023-10-09T11:56:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa5f8066f30 0x7fa5f80693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6140b1420 0x7fa6141491c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6140ccf90 0x7fa614158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 --2- 172.21.15.86:0/2758575094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6140cbf30 0x7fa6140ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 >> 172.21.15.86:0/2758575094 conn(0x7fa61406a320 msgr2=0x7fa6141560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 shutdown_connections 2023-10-09T11:56:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.677+0000 7fa61c7ff700 1 -- 172.21.15.86:0/2758575094 wait complete. 2023-10-09T11:56:13.696 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-10-09T11:56:13.696 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-10-09T11:56:13.696 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T11:56:13.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-09T11:56:13.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.878+0000 7f5a66b9d700 1 Processor -- start 2023-10-09T11:56:13.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.878+0000 7f5a66b9d700 1 -- start start 2023-10-09T11:56:13.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.879+0000 7f5a66b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a60159420 0x7f5a600b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.879+0000 7f5a66b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a601597f0 0x7f5a600b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.879+0000 7f5a66b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a600b11d0 con 0x7f5a6015d230 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.879+0000 7f5a66b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a600b14b0 con 0x7f5a60159420 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.879+0000 7f5a66b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600b1790 con 0x7f5a601597f0 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a6539a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a601597f0 0x7f5a600b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a65b9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a60159420 0x7f5a600b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a6539a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a601597f0 0x7f5a600b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:46950/0 (socket says 172.21.15.86:46950) 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a65b9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a60159420 0x7f5a600b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:41100/0 (socket says 172.21.15.86:41100) 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a6539a700 1 -- 172.21.15.86:0/795884683 learned_addr learned my addr 172.21.15.86:0/795884683 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a6639c700 1 --1- 172.21.15.86:0/795884683 >> v1:172.21.15.135:6789/0 conn(0x7f5a6015d230 0x7f5a600b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55930/0 (socket says 172.21.15.86:55930) 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a65b9b700 1 -- 172.21.15.86:0/795884683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a601597f0 msgr2=0x7f5a600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:13.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a65b9b700 1 --2- 172.21.15.86:0/795884683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a601597f0 0x7f5a600b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a65b9b700 1 -- 172.21.15.86:0/795884683 >> v1:172.21.15.135:6789/0 conn(0x7f5a6015d230 legacy=0x7f5a600b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.880+0000 7f5a65b9b700 1 -- 172.21.15.86:0/795884683 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a600b1a70 con 0x7f5a60159420 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.881+0000 7f5a65b9b700 1 --2- 172.21.15.86:0/795884683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60159420 0x7f5a600b5f40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0098e0 tx=0x7f5a5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a57fc7743b0f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.881+0000 7f5a64b99700 1 -- 172.21.15.86:0/795884683 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00b640 con 0x7f5a60159420 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.881+0000 7f5a64b99700 1 -- 172.21.15.86:0/795884683 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c00b7a0 con 0x7f5a60159420 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.881+0000 7f5a64b99700 1 -- 172.21.15.86:0/795884683 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00bb40 con 0x7f5a60159420 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 -- 172.21.15.86:0/795884683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60159420 msgr2=0x7f5a600b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/795884683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60159420 0x7f5a600b5f40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0098e0 tx=0x7f5a5c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 -- 172.21.15.86:0/795884683 shutdown_connections 2023-10-09T11:56:13.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/795884683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60159420 0x7f5a600b5f40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/795884683 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a601597f0 0x7f5a600b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 -- 172.21.15.86:0/795884683 >> 172.21.15.86:0/795884683 conn(0x7f5a600d0660 msgr2=0x7f5a600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:13.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 -- 172.21.15.86:0/795884683 shutdown_connections 2023-10-09T11:56:13.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.882+0000 7f5a66b9d700 1 -- 172.21.15.86:0/795884683 wait complete. 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.883+0000 7f5a66b9d700 1 Processor -- start 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.883+0000 7f5a66b9d700 1 -- start start 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.884+0000 7f5a66b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a60159420 0x7f5a60146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.884+0000 7f5a66b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a601597f0 0x7f5a600cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.884+0000 7f5a66b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a6015d230 0x7f5a60156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.884+0000 7f5a66b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6016dfb0 con 0x7f5a6015d230 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.884+0000 7f5a66b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6016d3e0 con 0x7f5a601597f0 2023-10-09T11:56:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.884+0000 7f5a66b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6016d680 con 0x7f5a60159420 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.884+0000 7f5a6639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a6015d230 0x7f5a60156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a6015d230 0x7f5a60156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40764/0 (socket says 172.21.15.86:40764) 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 -- 172.21.15.86:0/2007029539 learned_addr learned my addr 172.21.15.86:0/2007029539 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a65b9b700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a60159420 0x7f5a60146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6539a700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a601597f0 0x7f5a600cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 -- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a60159420 msgr2=0x7f5a60146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a60159420 0x7f5a60146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 -- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a601597f0 msgr2=0x7f5a600cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a601597f0 0x7f5a600cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 -- 172.21.15.86:0/2007029539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c009420 con 0x7f5a6015d230 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a65b9b700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a60159420 0x7f5a60146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6539a700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a601597f0 0x7f5a600cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:13.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a6639c700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a6015d230 0x7f5a60156e00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800cc70 tx=0x7f5a58001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:13.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a55ffb700 1 -- 172.21.15.86:0/2007029539 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58004bb0 con 0x7f5a6015d230 2023-10-09T11:56:13.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a55ffb700 1 -- 172.21.15.86:0/2007029539 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58004d10 con 0x7f5a6015d230 2023-10-09T11:56:13.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a55ffb700 1 -- 172.21.15.86:0/2007029539 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800ab90 con 0x7f5a6015d230 2023-10-09T11:56:13.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.885+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6016d960 con 0x7f5a6015d230 2023-10-09T11:56:13.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.886+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a600cfbc0 con 0x7f5a6015d230 2023-10-09T11:56:13.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.886+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6004c3c0 con 0x7f5a6015d230 2023-10-09T11:56:13.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.887+0000 7f5a55ffb700 1 -- 172.21.15.86:0/2007029539 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a580070f0 con 0x7f5a6015d230 2023-10-09T11:56:13.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.889+0000 7f5a55ffb700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5a44066f30 0x7f5a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:13.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.889+0000 7f5a55ffb700 1 -- 172.21.15.86:0/2007029539 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7f5a58084080 con 0x7f5a6015d230 2023-10-09T11:56:13.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.889+0000 7f5a65b9b700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5a44066f30 0x7f5a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:13.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.890+0000 7f5a65b9b700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5a44066f30 0x7f5a440693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c003080 tx=0x7f5a5c017000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:13.893+0000 7f5a55ffb700 1 -- 172.21.15.86:0/2007029539 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a580512f0 con 0x7f5a6015d230 2023-10-09T11:56:14.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.158+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f5a6016e0f0 con 0x7f5a6015d230 2023-10-09T11:56:14.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.674+0000 7f5a55ffb700 1 -- 172.21.15.86:0/2007029539 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v539) v1 ==== 159+0+0 (secure 0 0 0) 0x7f5a58054910 con 0x7f5a6015d230 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5a44066f30 msgr2=0x7f5a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5a44066f30 0x7f5a440693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c003080 tx=0x7f5a5c017000 comp rx=0 tx=0).stop 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a6015d230 msgr2=0x7f5a60156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a6015d230 0x7f5a60156e00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800cc70 tx=0x7f5a58001a70 comp rx=0 tx=0).stop 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 shutdown_connections 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5a44066f30 0x7f5a440693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a6015d230 0x7f5a60156e00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a60159420 0x7f5a60146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.676+0000 7f5a66b9d700 1 --2- 172.21.15.86:0/2007029539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a601597f0 0x7f5a600cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.677+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 >> 172.21.15.86:0/2007029539 conn(0x7f5a600d0660 msgr2=0x7f5a6015fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:14.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.677+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 shutdown_connections 2023-10-09T11:56:14.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.677+0000 7f5a66b9d700 1 -- 172.21.15.86:0/2007029539 wait complete. 2023-10-09T11:56:14.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:56:14.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.878+0000 7fa1145ff700 1 Processor -- start 2023-10-09T11:56:14.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.878+0000 7fa1145ff700 1 -- start start 2023-10-09T11:56:14.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa1145ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:14.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa1145ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa10c0b0a70 0x7fa10c0c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:14.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa1145ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c0af2f0 con 0x7fa10c15ac80 2023-10-09T11:56:14.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa1145ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c0af5d0 con 0x7fa10c0b0a70 2023-10-09T11:56:14.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa1145ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0c8660 con 0x7fa10c069e80 2023-10-09T11:56:14.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa111b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:14.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa112b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa10c0b0a70 0x7fa10c0c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:14.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa112b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa10c0b0a70 0x7fa10c0c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:41114/0 (socket says 172.21.15.86:41114) 2023-10-09T11:56:14.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.880+0000 7fa112b9c700 1 -- 172.21.15.86:0/358647626 learned_addr learned my addr 172.21.15.86:0/358647626 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:14.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa111399700 1 -- 172.21.15.86:0/358647626 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213043374 0 0) 0x7fa10c0af2f0 con 0x7fa10c15ac80 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa112b9c700 1 -- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 msgr2=0x7fa10c0c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa112b9c700 1 --2- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa112b9c700 1 -- 172.21.15.86:0/358647626 >> v1:172.21.15.135:6789/0 conn(0x7fa10c15ac80 legacy=0x7fa10c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa112b9c700 1 -- 172.21.15.86:0/358647626 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0c8940 con 0x7fa10c0b0a70 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa111b9a700 1 --2- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa112b9c700 1 --2- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 0x7fa10c0c70b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa104009f20 tx=0x7fa104009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a537c6894cba3543 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa111399700 1 -- 172.21.15.86:0/358647626 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10400e070 con 0x7fa10c0b0a70 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa111399700 1 -- 172.21.15.86:0/358647626 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10400b9d0 con 0x7fa10c0b0a70 2023-10-09T11:56:14.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.881+0000 7fa111399700 1 -- 172.21.15.86:0/358647626 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040092e0 con 0x7fa10c0b0a70 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 -- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 msgr2=0x7fa10c0c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 --2- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 0x7fa10c0c70b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa104009f20 tx=0x7fa104009840 comp rx=0 tx=0).stop 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 -- 172.21.15.86:0/358647626 shutdown_connections 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 --2- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 0x7fa10c0c70b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 --2- 172.21.15.86:0/358647626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 -- 172.21.15.86:0/358647626 >> 172.21.15.86:0/358647626 conn(0x7fa10c068e10 msgr2=0x7fa10c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 -- 172.21.15.86:0/358647626 shutdown_connections 2023-10-09T11:56:14.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.882+0000 7fa1145ff700 1 -- 172.21.15.86:0/358647626 wait complete. 2023-10-09T11:56:14.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.883+0000 7fa1145ff700 1 Processor -- start 2023-10-09T11:56:14.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.883+0000 7fa1145ff700 1 -- start start 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.884+0000 7fa1145ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.884+0000 7fa1145ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 0x7fa10c15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.884+0000 7fa1145ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c15ac80 0x7fa10c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.884+0000 7fa1145ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c15c1f0 con 0x7fa10c15ac80 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.884+0000 7fa1145ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c15e210 con 0x7fa10c0b0a70 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.884+0000 7fa1145ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c15bf50 con 0x7fa10c069e80 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c15ac80 0x7fa10c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c15ac80 0x7fa10c15e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40770/0 (socket says 172.21.15.86:40770) 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 -- 172.21.15.86:0/3048866871 learned_addr learned my addr 172.21.15.86:0/3048866871 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa111b9a700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 0x7fa10c15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:14.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa11239b700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 -- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 msgr2=0x7fa10c0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 -- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 msgr2=0x7fa10c15ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 0x7fa10c15ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 -- 172.21.15.86:0/3048866871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc009420 con 0x7fa10c15ac80 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.885+0000 7fa112b9c700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c15ac80 0x7fa10c15e6a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa10c063d40 tx=0x7fa104018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.886+0000 7fa1027fc700 1 -- 172.21.15.86:0/3048866871 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104008b10 con 0x7fa10c15ac80 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.886+0000 7fa1027fc700 1 -- 172.21.15.86:0/3048866871 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104008c90 con 0x7fa10c15ac80 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.886+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa104009ae0 con 0x7fa10c15ac80 2023-10-09T11:56:14.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.886+0000 7fa1027fc700 1 -- 172.21.15.86:0/3048866871 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040266b0 con 0x7fa10c15ac80 2023-10-09T11:56:14.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.886+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c15dbc0 con 0x7fa10c15ac80 2023-10-09T11:56:14.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.887+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c04c3c0 con 0x7fa10c15ac80 2023-10-09T11:56:14.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.888+0000 7fa1027fc700 1 -- 172.21.15.86:0/3048866871 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa104003040 con 0x7fa10c15ac80 2023-10-09T11:56:14.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.888+0000 7fa1027fc700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa0f0066f30 0x7fa0f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:14.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.888+0000 7fa1027fc700 1 -- 172.21.15.86:0/3048866871 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7fa104086820 con 0x7fa10c15ac80 2023-10-09T11:56:14.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.889+0000 7fa11239b700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa0f0066f30 0x7fa0f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:14.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.889+0000 7fa11239b700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa0f0066f30 0x7fa0f00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa108003a40 tx=0x7fa108007ec0 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:14.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:14.893+0000 7fa1027fc700 1 -- 172.21.15.86:0/3048866871 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa104053a10 con 0x7fa10c15ac80 2023-10-09T11:56:15.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.083+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa10c0c8c20 con 0x7fa10c15ac80 2023-10-09T11:56:15.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.087+0000 7fa1027fc700 1 -- 172.21.15.86:0/3048866871 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa104057030 con 0x7fa10c15ac80 2023-10-09T11:56:15.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.089+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa0f0066f30 msgr2=0x7fa0f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.089+0000 7fa1145ff700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa0f0066f30 0x7fa0f00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa108003a40 tx=0x7fa108007ec0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.089+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c15ac80 msgr2=0x7fa10c15e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.089+0000 7fa1145ff700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c15ac80 0x7fa10c15e6a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa10c063d40 tx=0x7fa104018000 comp rx=0 tx=0).stop 2023-10-09T11:56:15.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.089+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 shutdown_connections 2023-10-09T11:56:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.089+0000 7fa1145ff700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa0f0066f30 0x7fa0f00693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.090+0000 7fa1145ff700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c15ac80 0x7fa10c15e6a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.090+0000 7fa1145ff700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa10c069e80 0x7fa10c0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.090+0000 7fa1145ff700 1 --2- 172.21.15.86:0/3048866871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa10c0b0a70 0x7fa10c15ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.090+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 >> 172.21.15.86:0/3048866871 conn(0x7fa10c068e10 msgr2=0x7fa10c0caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.090+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 shutdown_connections 2023-10-09T11:56:15.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.090+0000 7fa1145ff700 1 -- 172.21.15.86:0/3048866871 wait complete. 2023-10-09T11:56:15.108 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:56:15.109 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:15.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:15.270 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:56:15.270 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:56:15.270 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:15.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.450+0000 7f220f3ff700 1 Processor -- start 2023-10-09T11:56:15.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.450+0000 7f220f3ff700 1 -- start start 2023-10-09T11:56:15.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.451+0000 7f220f3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f22080cbf30 0x7f22080ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.451+0000 7f220f3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080b1420 0x7f22080c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.451+0000 7f220f3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22080cc300 con 0x7f22080ccf90 2023-10-09T11:56:15.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.451+0000 7f220f3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2208156bf0 con 0x7f22080cbf30 2023-10-09T11:56:15.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.451+0000 7f220f3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080ae950 con 0x7f22080b1420 2023-10-09T11:56:15.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d19b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f22080cbf30 0x7f22080ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d99c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080b1420 0x7f22080c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d99c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080b1420 0x7f22080c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:40498/0 (socket says 172.21.15.86:40498) 2023-10-09T11:56:15.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d99c700 1 -- 172.21.15.86:0/3535980732 learned_addr learned my addr 172.21.15.86:0/3535980732 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:15.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d99c700 1 -- 172.21.15.86:0/3535980732 >> v2:172.21.15.135:3300/0 conn(0x7f22080cbf30 msgr2=0x7f22080ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:15.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d99c700 1 --2- 172.21.15.86:0/3535980732 >> v2:172.21.15.135:3300/0 conn(0x7f22080cbf30 0x7f22080ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d99c700 1 -- 172.21.15.86:0/3535980732 >> v1:172.21.15.135:6789/0 conn(0x7f22080ccf90 legacy=0x7f22080b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d99c700 1 -- 172.21.15.86:0/3535980732 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080ad370 con 0x7f22080b1420 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.452+0000 7f220d19b700 1 --2- 172.21.15.86:0/3535980732 >> v2:172.21.15.135:3300/0 conn(0x7f22080cbf30 0x7f22080ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.453+0000 7f220d99c700 1 --2- 172.21.15.86:0/3535980732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080b1420 0x7f22080c9740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2200009f20 tx=0x7f2200009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43dc0ebcb9280431 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.453+0000 7f21fffff700 1 -- 172.21.15.86:0/3535980732 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000e070 con 0x7f22080b1420 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.453+0000 7f21fffff700 1 -- 172.21.15.86:0/3535980732 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220000b9d0 con 0x7f22080b1420 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.453+0000 7f21fffff700 1 -- 172.21.15.86:0/3535980732 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000092e0 con 0x7f22080b1420 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.453+0000 7f220f3ff700 1 -- 172.21.15.86:0/3535980732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080b1420 msgr2=0x7f22080c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.453+0000 7f220f3ff700 1 --2- 172.21.15.86:0/3535980732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080b1420 0x7f22080c9740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2200009f20 tx=0x7f2200009840 comp rx=0 tx=0).stop 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.454+0000 7f220f3ff700 1 -- 172.21.15.86:0/3535980732 shutdown_connections 2023-10-09T11:56:15.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.454+0000 7f220f3ff700 1 --2- 172.21.15.86:0/3535980732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080b1420 0x7f22080c9740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.454+0000 7f220f3ff700 1 --2- 172.21.15.86:0/3535980732 >> v2:172.21.15.135:3300/0 conn(0x7f22080cbf30 0x7f22080ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.454+0000 7f220f3ff700 1 -- 172.21.15.86:0/3535980732 >> 172.21.15.86:0/3535980732 conn(0x7f220806a320 msgr2=0x7f22080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:15.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.454+0000 7f220f3ff700 1 -- 172.21.15.86:0/3535980732 shutdown_connections 2023-10-09T11:56:15.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.454+0000 7f220f3ff700 1 -- 172.21.15.86:0/3535980732 wait complete. 2023-10-09T11:56:15.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.455+0000 7f220f3ff700 1 Processor -- start 2023-10-09T11:56:15.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.455+0000 7f220f3ff700 1 -- start start 2023-10-09T11:56:15.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220f3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22080b1420 0x7f2208147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220f3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080cbf30 0x7f220806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220f3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22080ccf90 0x7f2208155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220f3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080c1c90 con 0x7f22080b1420 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220f3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080aa2e0 con 0x7f22080ccf90 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220f3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080aa8a0 con 0x7f22080cbf30 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220d19b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22080b1420 0x7f2208147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220d19b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22080b1420 0x7f2208147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50204/0 (socket says 172.21.15.86:50204) 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220d19b700 1 -- 172.21.15.86:0/4271457038 learned_addr learned my addr 172.21.15.86:0/4271457038 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220d99c700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22080ccf90 0x7f2208155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.456+0000 7f220c99a700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080cbf30 0x7f220806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220d19b700 1 -- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080cbf30 msgr2=0x7f220806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220d19b700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080cbf30 0x7f220806ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220d19b700 1 -- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22080ccf90 msgr2=0x7f2208155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220d19b700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22080ccf90 0x7f2208155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220d19b700 1 -- 172.21.15.86:0/4271457038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220400b6d0 con 0x7f22080b1420 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220d99c700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22080ccf90 0x7f2208155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220d19b700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22080b1420 0x7f2208147fa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f220400edf0 tx=0x7f220400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f21fd7fa700 1 -- 172.21.15.86:0/4271457038 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400dde0 con 0x7f22080b1420 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f21fd7fa700 1 -- 172.21.15.86:0/4271457038 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204010440 con 0x7f22080b1420 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2200009ae0 con 0x7f22080b1420 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f21fd7fa700 1 -- 172.21.15.86:0/4271457038 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040107c0 con 0x7f22080b1420 2023-10-09T11:56:15.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.457+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080c21c0 con 0x7f22080b1420 2023-10-09T11:56:15.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.458+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22080aab80 con 0x7f22080b1420 2023-10-09T11:56:15.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.459+0000 7f21fd7fa700 1 -- 172.21.15.86:0/4271457038 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2204010b30 con 0x7f22080b1420 2023-10-09T11:56:15.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.460+0000 7f21fd7fa700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21ec066f30 0x7f21ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.460+0000 7f21fd7fa700 1 -- 172.21.15.86:0/4271457038 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7f2204014030 con 0x7f22080b1420 2023-10-09T11:56:15.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.460+0000 7f220c99a700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21ec066f30 0x7f21ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.461+0000 7f220c99a700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21ec066f30 0x7f21ec0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22080ca2f0 tx=0x7f21f8009040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:15.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.464+0000 7f21fd7fa700 1 -- 172.21.15.86:0/4271457038 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2204051cc0 con 0x7f22080b1420 2023-10-09T11:56:15.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.701+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f220804c3c0 con 0x7f22080b1420 2023-10-09T11:56:15.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.701+0000 7f21fd7fa700 1 -- 172.21.15.86:0/4271457038 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f220401e020 con 0x7f22080b1420 2023-10-09T11:56:15.703 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:15.703 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/569752766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":569752766},{"type":"v1","addr":"172.21.15.135:6834","nonce":569752766}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/312603704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":312603704},{"type":"v1","addr":"172.21.15.135:6835","nonce":312603704}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/4036553983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":4036553983},{"type":"v1","addr":"172.21.15.86:6833","nonce":4036553983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4220630184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4220630184},{"type":"v1","addr":"172.21.15.86:6835","nonce":4220630184}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-09T11:56:15.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21ec066f30 msgr2=0x7f21ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21ec066f30 0x7f21ec0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22080ca2f0 tx=0x7f21f8009040 comp rx=0 tx=0).stop 2023-10-09T11:56:15.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22080b1420 msgr2=0x7f2208147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22080b1420 0x7f2208147fa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f220400edf0 tx=0x7f220400b430 comp rx=0 tx=0).stop 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 shutdown_connections 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21ec066f30 0x7f21ec0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22080b1420 0x7f2208147fa0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22080ccf90 0x7f2208155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 --2- 172.21.15.86:0/4271457038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22080cbf30 0x7f220806ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 >> 172.21.15.86:0/4271457038 conn(0x7f220806a320 msgr2=0x7f220815a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 shutdown_connections 2023-10-09T11:56:15.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.704+0000 7f220f3ff700 1 -- 172.21.15.86:0/4271457038 wait complete. 2023-10-09T11:56:15.707 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 27 2023-10-09T11:56:15.723 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:56:15.723 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:56:15.723 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:56:15.723 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:15.723 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:56:15.724 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:56:15.724 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:56:15.724 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:15.724 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:56:15.724 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:56:15.724 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:56:15.724 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:15.725 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:56:15.725 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:56:15.725 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:56:15.725 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:15.737 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:56:15.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:56:15.738 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:56:15.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:56:15.745 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:56:15.745 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:56:15.746 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:56:15.746 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:56:15.782 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:56:15.782 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:15.785 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:56:15.785 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:15.790 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:56:15.790 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:15.793 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:56:15.793 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:15.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:56:15.916 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:56:15.916 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:56:15.929 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:56:15.929 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T11:56:15.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-09T11:56:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.988+0000 7f710a19d700 1 Processor -- start 2023-10-09T11:56:15.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.988+0000 7f710a19d700 1 -- start start 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.989+0000 7f710a19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7104159420 0x7f71040b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.989+0000 7f710a19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f710415d230 0x7f710415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.989+0000 7f710a19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040b2980 con 0x7f71041597f0 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.989+0000 7f710a19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710415db70 con 0x7f7104159420 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.989+0000 7f710a19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040b11d0 con 0x7f710415d230 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.989+0000 7f710919b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7104159420 0x7f71040b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710919b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7104159420 0x7f71040b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50244/0 (socket says 172.21.15.86:50244) 2023-10-09T11:56:15.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710919b700 1 -- 172.21.15.86:0/176057516 learned_addr learned my addr 172.21.15.86:0/176057516 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710999c700 1 --2- 172.21.15.86:0/176057516 >> v2:172.21.15.135:3300/0 conn(0x7f710415d230 0x7f710415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710919b700 1 -- 172.21.15.86:0/176057516 >> v2:172.21.15.135:3300/0 conn(0x7f710415d230 msgr2=0x7f710415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710919b700 1 --2- 172.21.15.86:0/176057516 >> v2:172.21.15.135:3300/0 conn(0x7f710415d230 0x7f710415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710919b700 1 -- 172.21.15.86:0/176057516 >> v1:172.21.15.135:6789/0 conn(0x7f71041597f0 legacy=0x7f71040b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710919b700 1 -- 172.21.15.86:0/176057516 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040b14b0 con 0x7f7104159420 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f710919b700 1 --2- 172.21.15.86:0/176057516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7104159420 0x7f71040b5f40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f710415d170 tx=0x7f7100009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c936ce0337029c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f70fbfff700 1 -- 172.21.15.86:0/176057516 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000b820 con 0x7f7104159420 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f70fbfff700 1 -- 172.21.15.86:0/176057516 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710000b980 con 0x7f7104159420 2023-10-09T11:56:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.990+0000 7f70fbfff700 1 -- 172.21.15.86:0/176057516 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000bd20 con 0x7f7104159420 2023-10-09T11:56:15.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 -- 172.21.15.86:0/176057516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7104159420 msgr2=0x7f71040b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 --2- 172.21.15.86:0/176057516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7104159420 0x7f71040b5f40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f710415d170 tx=0x7f7100009250 comp rx=0 tx=0).stop 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 -- 172.21.15.86:0/176057516 shutdown_connections 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 --2- 172.21.15.86:0/176057516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7104159420 0x7f71040b5f40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 --2- 172.21.15.86:0/176057516 >> v2:172.21.15.135:3300/0 conn(0x7f710415d230 0x7f710415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 -- 172.21.15.86:0/176057516 >> 172.21.15.86:0/176057516 conn(0x7f71040d0660 msgr2=0x7f71040d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 -- 172.21.15.86:0/176057516 shutdown_connections 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.991+0000 7f710a19d700 1 -- 172.21.15.86:0/176057516 wait complete. 2023-10-09T11:56:15.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.993+0000 7f710a19d700 1 Processor -- start 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.993+0000 7f710a19d700 1 -- start start 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710a19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7104159420 0x7f7104143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710a19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71041597f0 0x7f71041412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710a19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710415d230 0x7f71041560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710a19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104155260 con 0x7f71041597f0 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710a19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71041425d0 con 0x7f7104159420 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710a19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71041419c0 con 0x7f710415d230 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71041597f0 0x7f71041412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71041597f0 0x7f71041412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50248/0 (socket says 172.21.15.86:50248) 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 -- 172.21.15.86:0/647658141 learned_addr learned my addr 172.21.15.86:0/647658141 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710919b700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7104159420 0x7f7104143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710999c700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710415d230 0x7f71041560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 -- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710415d230 msgr2=0x7f71041560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710415d230 0x7f71041560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 -- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7104159420 msgr2=0x7f7104143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7104159420 0x7f7104143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 -- 172.21.15.86:0/647658141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000094f0 con 0x7f71041597f0 2023-10-09T11:56:15.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710999c700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710415d230 0x7f71041560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:16.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.994+0000 7f710899a700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71041597f0 0x7f71041412c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c590 tx=0x7f70f4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:16.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.995+0000 7f70f97fa700 1 -- 172.21.15.86:0/647658141 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4011660 con 0x7f71041597f0 2023-10-09T11:56:16.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.995+0000 7f70f97fa700 1 -- 172.21.15.86:0/647658141 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f40117c0 con 0x7f71041597f0 2023-10-09T11:56:16.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.995+0000 7f70f97fa700 1 -- 172.21.15.86:0/647658141 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4011b80 con 0x7f71041597f0 2023-10-09T11:56:16.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.995+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7104141ca0 con 0x7f71041597f0 2023-10-09T11:56:16.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.995+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7104142260 con 0x7f71041597f0 2023-10-09T11:56:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.996+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710404c3c0 con 0x7f71041597f0 2023-10-09T11:56:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.997+0000 7f70f97fa700 1 -- 172.21.15.86:0/647658141 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70f401c460 con 0x7f71041597f0 2023-10-09T11:56:16.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.997+0000 7f70f97fa700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f70e8066f30 0x7f70e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.998+0000 7f70f97fa700 1 -- 172.21.15.86:0/647658141 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5831+0+0 (secure 0 0 0) 0x7f70f4084570 con 0x7f71041597f0 2023-10-09T11:56:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.998+0000 7f710919b700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f70e8066f30 0x7f70e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:15.998+0000 7f710919b700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f70e8066f30 0x7f70e80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f710415d170 tx=0x7f7100016000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:16.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:16.001+0000 7f70f97fa700 1 -- 172.21.15.86:0/647658141 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70f40516c0 con 0x7f71041597f0 2023-10-09T11:56:16.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:16.211+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f71040b1790 con 0x7f71041597f0 2023-10-09T11:56:17.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.118+0000 7f70f97fa700 1 -- 172.21.15.86:0/647658141 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) v1 ==== 97+0+0 (secure 0 0 0) 0x7f70f4054ce0 con 0x7f71041597f0 2023-10-09T11:56:17.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f70e8066f30 msgr2=0x7f70e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f70e8066f30 0x7f70e80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f710415d170 tx=0x7f7100016000 comp rx=0 tx=0).stop 2023-10-09T11:56:17.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71041597f0 msgr2=0x7f71041412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71041597f0 0x7f71041412c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f70f400c590 tx=0x7f70f4007f30 comp rx=0 tx=0).stop 2023-10-09T11:56:17.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 shutdown_connections 2023-10-09T11:56:17.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f710415d230 0x7f71041560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7104159420 0x7f7104143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f70e8066f30 0x7f70e80693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 --2- 172.21.15.86:0/647658141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71041597f0 0x7f71041412c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 >> 172.21.15.86:0/647658141 conn(0x7f71040d0660 msgr2=0x7f7104156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:17.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 shutdown_connections 2023-10-09T11:56:17.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.121+0000 7f710a19d700 1 -- 172.21.15.86:0/647658141 wait complete. 2023-10-09T11:56:17.124 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T11:56:17.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:56:17.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.326+0000 7ffb829ff700 1 Processor -- start 2023-10-09T11:56:17.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.326+0000 7ffb829ff700 1 -- start start 2023-10-09T11:56:17.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.327+0000 7ffb829ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffb7c0cbf30 0x7ffb7c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb829ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0cc300 con 0x7ffb7c0b1420 2023-10-09T11:56:17.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb829ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0ad370 con 0x7ffb7c0ccf90 2023-10-09T11:56:17.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb829ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c156bf0 con 0x7ffb7c0cbf30 2023-10-09T11:56:17.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb80f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ffb7c0b1420 0x7ffb7c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34364/0 (socket says 172.21.15.86:34364) 2023-10-09T11:56:17.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb80f9c700 1 -- 172.21.15.86:0/2337182322 learned_addr learned my addr 172.21.15.86:0/2337182322 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:17.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2337182322 >> v2:172.21.15.135:3300/0 conn(0x7ffb7c0cbf30 0x7ffb7c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839175660 0 0) 0x7ffb7c0cc300 con 0x7ffb7c0b1420 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.328+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb64003570 con 0x7ffb7c0b1420 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054345635 0 0) 0x7ffb64003570 con 0x7ffb7c0b1420 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 >> v2:172.21.15.135:3300/0 conn(0x7ffb7c0cbf30 msgr2=0x7ffb7c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 --2- 172.21.15.86:0/2337182322 >> v2:172.21.15.135:3300/0 conn(0x7ffb7c0cbf30 0x7ffb7c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 >> v1:172.21.15.135:6789/0 conn(0x7ffb7c0ccf90 legacy=0x7ffb7c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0ad650 con 0x7ffb7c0b1420 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7ffb740017f0 con 0x7ffb7c0b1420 2023-10-09T11:56:17.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2337182322 >> v2:172.21.15.135:3300/0 conn(0x7ffb7c0cbf30 0x7ffb7c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 >> v1:172.21.15.86:6789/0 conn(0x7ffb7c0b1420 legacy=0x7ffb7c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb64003ab0 0x7ffb64003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb64004810 0x7ffb64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64005210 0x7ffb6400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c156bf0 con 0x7ffb64003ab0 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6400c130 con 0x7ffb64004810 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6400e500 con 0x7ffb64005210 2023-10-09T11:56:17.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb64003ab0 0x7ffb64003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7b7fe700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb64004810 0x7ffb64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb80f9c700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64005210 0x7ffb6400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7bfff700 1 -- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64005210 msgr2=0x7ffb6400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64005210 0x7ffb6400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7bfff700 1 -- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb64004810 msgr2=0x7ffb64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb64004810 0x7ffb64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb7bfff700 1 -- 172.21.15.86:0/2337182322 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64003570 con 0x7ffb64003ab0 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.329+0000 7ffb80f9c700 1 -- 172.21.15.86:0/2337182322 reap_dead start 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb64003ab0 0x7ffb64003ec0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009df0 tx=0x7ffb6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78423880a639655 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:17.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c009740 con 0x7ffb64003ab0 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00e920 con 0x7ffb64003ab0 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb7affd700 1 -- 172.21.15.86:0/2337182322 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00ece0 con 0x7ffb64003ab0 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb829ff700 1 -- 172.21.15.86:0/2337182322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb64003ab0 msgr2=0x7ffb64003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb64003ab0 0x7ffb64003ec0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009df0 tx=0x7ffb6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb829ff700 1 -- 172.21.15.86:0/2337182322 shutdown_connections 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2337182322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb64003ab0 0x7ffb64003ec0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.330+0000 7ffb829ff700 1 -- 172.21.15.86:0/2337182322 >> 172.21.15.86:0/2337182322 conn(0x7ffb7c06a320 msgr2=0x7ffb7c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.331+0000 7ffb829ff700 1 -- 172.21.15.86:0/2337182322 shutdown_connections 2023-10-09T11:56:17.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.331+0000 7ffb829ff700 1 -- 172.21.15.86:0/2337182322 wait complete. 2023-10-09T11:56:17.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.332+0000 7ffb829ff700 1 Processor -- start 2023-10-09T11:56:17.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.332+0000 7ffb829ff700 1 -- start start 2023-10-09T11:56:17.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb829ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64003ab0 0x7ffb7c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb829ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c0c35e0 0x7ffb7c0c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb829ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c15b300 0x7ffb7c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb829ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c15bcc0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb829ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c2130 con 0x7ffb7c15b300 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb829ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c1840 con 0x7ffb64003ab0 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c0c35e0 0x7ffb7c0c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c0c35e0 0x7ffb7c0c3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50252/0 (socket says 172.21.15.86:50252) 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb7b7fe700 1 -- 172.21.15.86:0/2001745218 learned_addr learned my addr 172.21.15.86:0/2001745218 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64003ab0 0x7ffb7c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.333+0000 7ffb80f9c700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c15b300 0x7ffb7c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb7b7fe700 1 -- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64003ab0 msgr2=0x7ffb7c1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb7b7fe700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64003ab0 0x7ffb7c1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb7b7fe700 1 -- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c15b300 msgr2=0x7ffb7c15b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb7b7fe700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c15b300 0x7ffb7c15b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb7b7fe700 1 -- 172.21.15.86:0/2001745218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0c25c0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb80f9c700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c15b300 0x7ffb7c15b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb7b7fe700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c0c35e0 0x7ffb7c0c3a50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000e590 tx=0x7ffb70009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb63fff700 1 -- 172.21.15.86:0/2001745218 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70012590 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb63fff700 1 -- 172.21.15.86:0/2001745218 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb700126f0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb63fff700 1 -- 172.21.15.86:0/2001745218 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70012a90 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c0c1ae0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.334+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c15adb0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.335+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c04c3c0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.336+0000 7ffb63fff700 1 -- 172.21.15.86:0/2001745218 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb70013420 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.337+0000 7ffb63fff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ffb68066f30 0x7ffb680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.337+0000 7ffb63fff700 1 -- 172.21.15.86:0/2001745218 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5229+0+0 (secure 0 0 0) 0x7ffb700842e0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.337+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ffb68066f30 0x7ffb680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.338+0000 7ffb7bfff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ffb68066f30 0x7ffb680693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0093f0 tx=0x7ffb6c01a000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:17.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.342+0000 7ffb63fff700 1 -- 172.21.15.86:0/2001745218 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb70051690 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.607+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffb7c0c2270 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.607+0000 7ffb63fff700 1 -- 172.21.15.86:0/2001745218 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ffb70054cb0 con 0x7ffb7c0c35e0 2023-10-09T11:56:17.609 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:17.609 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:56:17.609 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T11:56:17.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.609 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T11:56:17.609 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.610 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T11:56:17.611 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T11:56:17.612 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.613 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.614 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T11:56:17.616 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.617 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.618 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T11:56:17.620 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.621 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:17.622 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:17.623 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T11:56:17.625 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:56:17.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ffb68066f30 msgr2=0x7ffb680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ffb68066f30 0x7ffb680693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0093f0 tx=0x7ffb6c01a000 comp rx=0 tx=0).stop 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c0c35e0 msgr2=0x7ffb7c0c3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c0c35e0 0x7ffb7c0c3a50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000e590 tx=0x7ffb70009040 comp rx=0 tx=0).stop 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 shutdown_connections 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c15b300 0x7ffb7c15b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb64003ab0 0x7ffb7c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ffb68066f30 0x7ffb680693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 --2- 172.21.15.86:0/2001745218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c0c35e0 0x7ffb7c0c3a50 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 >> 172.21.15.86:0/2001745218 conn(0x7ffb7c06a320 msgr2=0x7ffb7c0ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 shutdown_connections 2023-10-09T11:56:17.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.610+0000 7ffb829ff700 1 -- 172.21.15.86:0/2001745218 wait complete. 2023-10-09T11:56:17.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.810+0000 7f302759e700 1 Processor -- start 2023-10-09T11:56:17.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.811+0000 7f302759e700 1 -- start start 2023-10-09T11:56:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f302759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f30280c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f302759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f30281566e0 0x7f30280ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f302759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f30280ca300 0x7f30280ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f302759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280ca860 con 0x7f30280ca300 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f302759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280cab40 con 0x7f30281566e0 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f302759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30280cae20 con 0x7f3028156310 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f3026d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f30280ca300 0x7f30280ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f3026d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f30280ca300 0x7f30280ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50256/0 (socket says 172.21.15.86:50256) 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.812+0000 7f3026d9d700 1 -- 172.21.15.86:0/3772126478 learned_addr learned my addr 172.21.15.86:0/3772126478 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f301ffff700 1 --2- 172.21.15.86:0/3772126478 >> v2:172.21.15.135:3300/0 conn(0x7f30281566e0 0x7f30280ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f302659c700 1 --2- 172.21.15.86:0/3772126478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f30280c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3026d9d700 1 -- 172.21.15.86:0/3772126478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 msgr2=0x7f30280c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3026d9d700 1 --2- 172.21.15.86:0/3772126478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f30280c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3026d9d700 1 -- 172.21.15.86:0/3772126478 >> v2:172.21.15.135:3300/0 conn(0x7f30281566e0 msgr2=0x7f30280ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3026d9d700 1 --2- 172.21.15.86:0/3772126478 >> v2:172.21.15.135:3300/0 conn(0x7f30281566e0 0x7f30280ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3026d9d700 1 -- 172.21.15.86:0/3772126478 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280cb100 con 0x7f30280ca300 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3026d9d700 1 --2- 172.21.15.86:0/3772126478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280ca300 0x7f30280ae540 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f302806d1e0 tx=0x7f302000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fae367dae4057b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3025d9b700 1 -- 172.21.15.86:0/3772126478 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020010070 con 0x7f30280ca300 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3025d9b700 1 -- 172.21.15.86:0/3772126478 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000de90 con 0x7f30280ca300 2023-10-09T11:56:17.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.813+0000 7f3025d9b700 1 -- 172.21.15.86:0/3772126478 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000b320 con 0x7f30280ca300 2023-10-09T11:56:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 -- 172.21.15.86:0/3772126478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280ca300 msgr2=0x7f30280ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 --2- 172.21.15.86:0/3772126478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280ca300 0x7f30280ae540 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f302806d1e0 tx=0x7f302000ba50 comp rx=0 tx=0).stop 2023-10-09T11:56:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 -- 172.21.15.86:0/3772126478 shutdown_connections 2023-10-09T11:56:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 --2- 172.21.15.86:0/3772126478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30280ca300 0x7f30280ae540 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 --2- 172.21.15.86:0/3772126478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f30280c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 --2- 172.21.15.86:0/3772126478 >> v2:172.21.15.135:3300/0 conn(0x7f30281566e0 0x7f30280ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 -- 172.21.15.86:0/3772126478 >> 172.21.15.86:0/3772126478 conn(0x7f30280cc1f0 msgr2=0x7f30280cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 -- 172.21.15.86:0/3772126478 shutdown_connections 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.814+0000 7f302759e700 1 -- 172.21.15.86:0/3772126478 wait complete. 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.815+0000 7f302759e700 1 Processor -- start 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.816+0000 7f302759e700 1 -- start start 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.816+0000 7f302759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30280ca300 0x7f3028149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.816+0000 7f302759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f302814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f302759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30281566e0 0x7f30280b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f302759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302814c180 con 0x7f30281566e0 2023-10-09T11:56:17.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f302759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280b11c0 con 0x7f30280ca300 2023-10-09T11:56:17.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f302759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302814b570 con 0x7f3028156310 2023-10-09T11:56:17.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30281566e0 0x7f30280b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30281566e0 0x7f30280b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50268/0 (socket says 172.21.15.86:50268) 2023-10-09T11:56:17.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 -- 172.21.15.86:0/1556417420 learned_addr learned my addr 172.21.15.86:0/1556417420 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:17.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f302659c700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30280ca300 0x7f3028149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f301ffff700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f302814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 -- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 msgr2=0x7f302814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f302814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 -- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30280ca300 msgr2=0x7f3028149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30280ca300 0x7f3028149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.817+0000 7f3026d9d700 1 -- 172.21.15.86:0/1556417420 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302000bcf0 con 0x7f30281566e0 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.818+0000 7f3026d9d700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30281566e0 0x7f30280b0c80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f302806fe40 tx=0x7f302001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.818+0000 7f301e7fc700 1 -- 172.21.15.86:0/1556417420 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000ad50 con 0x7f30281566e0 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.818+0000 7f301e7fc700 1 -- 172.21.15.86:0/1556417420 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3020027460 con 0x7f30281566e0 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.818+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302814b850 con 0x7f30281566e0 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.818+0000 7f301e7fc700 1 -- 172.21.15.86:0/1556417420 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020027820 con 0x7f30281566e0 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.818+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302814be10 con 0x7f30281566e0 2023-10-09T11:56:17.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.819+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028165860 con 0x7f30281566e0 2023-10-09T11:56:17.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.820+0000 7f301e7fc700 1 -- 172.21.15.86:0/1556417420 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3020003040 con 0x7f30281566e0 2023-10-09T11:56:17.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.821+0000 7f301e7fc700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3008066f30 0x7f30080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:17.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.821+0000 7f301e7fc700 1 -- 172.21.15.86:0/1556417420 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f3020087af0 con 0x7f30281566e0 2023-10-09T11:56:17.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.821+0000 7f302659c700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3008066f30 0x7f30080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:17.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.822+0000 7f302659c700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3008066f30 0x7f30080693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3018006fd0 tx=0x7f3018008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:17.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:17.825+0000 7f301e7fc700 1 -- 172.21.15.86:0/1556417420 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3028165860 con 0x7f30281566e0 2023-10-09T11:56:18.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.017+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3028165860 con 0x7f30281566e0 2023-10-09T11:56:18.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.018+0000 7f301e7fc700 1 -- 172.21.15.86:0/1556417420 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+12752 (secure 0 0 0) 0x7f3028165860 con 0x7f30281566e0 2023-10-09T11:56:18.019 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:18.019 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":76,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:17.114979+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3008066f30 msgr2=0x7f30080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3008066f30 0x7f30080693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3018006fd0 tx=0x7f3018008040 comp rx=0 tx=0).stop 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30281566e0 msgr2=0x7f30280b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30281566e0 0x7f30280b0c80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f302806fe40 tx=0x7f302001a000 comp rx=0 tx=0).stop 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 shutdown_connections 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3008066f30 0x7f30080693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30281566e0 0x7f30280b0c80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30280ca300 0x7f3028149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 --2- 172.21.15.86:0/1556417420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3028156310 0x7f302814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 >> 172.21.15.86:0/1556417420 conn(0x7f30280cc1f0 msgr2=0x7f30280addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:18.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 shutdown_connections 2023-10-09T11:56:18.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.020+0000 7f302759e700 1 -- 172.21.15.86:0/1556417420 wait complete. 2023-10-09T11:56:18.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:56:18.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:56:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.222+0000 7f0604d9d700 1 Processor -- start 2023-10-09T11:56:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.222+0000 7f0604d9d700 1 -- start start 2023-10-09T11:56:18.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.223+0000 7f0604d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f06000cb1a0 0x7f060015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.223+0000 7f0604d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f060015a8a0 0x7f060006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.223+0000 7f0604d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060006ebd0 con 0x7f060006f5a0 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.223+0000 7f0604d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060015b2e0 con 0x7f060015a8a0 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.223+0000 7f0604d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060015ad20 con 0x7f06000cb1a0 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.223+0000 7f05fffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f060006f5a0 0x7f06000ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34366/0 (socket says 172.21.15.86:34366) 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.223+0000 7f05fffff700 1 -- 172.21.15.86:0/3177079447 learned_addr learned my addr 172.21.15.86:0/3177079447 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05feffd700 1 --2- 172.21.15.86:0/3177079447 >> v2:172.21.15.86:3300/0 conn(0x7f060015a8a0 0x7f060006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05ff7fe700 1 --2- 172.21.15.86:0/3177079447 >> v2:172.21.15.135:3300/0 conn(0x7f06000cb1a0 0x7f060015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05fe7fc700 1 -- 172.21.15.86:0/3177079447 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497205799 0 0) 0x7f060006ebd0 con 0x7f060006f5a0 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05fe7fc700 1 -- 172.21.15.86:0/3177079447 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e8003570 con 0x7f060006f5a0 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05feffd700 1 -- 172.21.15.86:0/3177079447 >> v2:172.21.15.135:3300/0 conn(0x7f06000cb1a0 msgr2=0x7f060015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05feffd700 1 --2- 172.21.15.86:0/3177079447 >> v2:172.21.15.135:3300/0 conn(0x7f06000cb1a0 0x7f060015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05feffd700 1 -- 172.21.15.86:0/3177079447 >> v1:172.21.15.86:6789/0 conn(0x7f060006f5a0 legacy=0x7f06000ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05feffd700 1 -- 172.21.15.86:0/3177079447 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060015b000 con 0x7f060015a8a0 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05feffd700 1 --2- 172.21.15.86:0/3177079447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060015a8a0 0x7f060006f060 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f06000cce10 tx=0x7f05f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d774ec331cc45e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.224+0000 7f05fe7fc700 1 -- 172.21.15.86:0/3177079447 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011630 con 0x7f060015a8a0 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f05fe7fc700 1 -- 172.21.15.86:0/3177079447 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f40117b0 con 0x7f060015a8a0 2023-10-09T11:56:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f05fe7fc700 1 -- 172.21.15.86:0/3177079447 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011b70 con 0x7f060015a8a0 2023-10-09T11:56:18.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 -- 172.21.15.86:0/3177079447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060015a8a0 msgr2=0x7f060006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 --2- 172.21.15.86:0/3177079447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060015a8a0 0x7f060006f060 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f06000cce10 tx=0x7f05f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 -- 172.21.15.86:0/3177079447 shutdown_connections 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 --2- 172.21.15.86:0/3177079447 >> v2:172.21.15.135:3300/0 conn(0x7f06000cb1a0 0x7f060015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 --2- 172.21.15.86:0/3177079447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060015a8a0 0x7f060006f060 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 -- 172.21.15.86:0/3177079447 >> 172.21.15.86:0/3177079447 conn(0x7f06000cc1e0 msgr2=0x7f06000cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 -- 172.21.15.86:0/3177079447 shutdown_connections 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.225+0000 7f0604d9d700 1 -- 172.21.15.86:0/3177079447 wait complete. 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.227+0000 7f0604d9d700 1 Processor -- start 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.227+0000 7f0604d9d700 1 -- start start 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f0604d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060006f5a0 0x7f06000c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f0604d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06000cb1a0 0x7f060014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f0604d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06000c5a50 0x7f06000b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f0604d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000af100 con 0x7f060006f5a0 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f0604d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000c5fc0 con 0x7f06000cb1a0 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f0604d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06000c62a0 con 0x7f06000c5a50 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060006f5a0 0x7f06000c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060006f5a0 0x7f06000c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50294/0 (socket says 172.21.15.86:50294) 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 -- 172.21.15.86:0/1981777434 learned_addr learned my addr 172.21.15.86:0/1981777434 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05feffd700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06000cb1a0 0x7f060014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05fffff700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06000c5a50 0x7f06000b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 -- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06000c5a50 msgr2=0x7f06000b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06000c5a50 0x7f06000b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 -- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06000cb1a0 msgr2=0x7f060014dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06000cb1a0 0x7f060014dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 -- 172.21.15.86:0/1981777434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f4009420 con 0x7f060006f5a0 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05feffd700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06000cb1a0 0x7f060014dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.228+0000 7f05ff7fe700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060006f5a0 0x7f06000c4a30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f05f000ec80 tx=0x7f05f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.229+0000 7f05e77fe700 1 -- 172.21.15.86:0/1981777434 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000c9d0 con 0x7f060006f5a0 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.229+0000 7f05e77fe700 1 -- 172.21.15.86:0/1981777434 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f000cb30 con 0x7f060006f5a0 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.229+0000 7f05e77fe700 1 -- 172.21.15.86:0/1981777434 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0013470 con 0x7f060006f5a0 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.229+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06000af3c0 con 0x7f060006f5a0 2023-10-09T11:56:18.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.229+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060014e2d0 con 0x7f060006f5a0 2023-10-09T11:56:18.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.230+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060006c450 con 0x7f060006f5a0 2023-10-09T11:56:18.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.231+0000 7f05e77fe700 1 -- 172.21.15.86:0/1981777434 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05f0013820 con 0x7f060006f5a0 2023-10-09T11:56:18.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.231+0000 7f05e77fe700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05ec066f30 0x7f05ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.231+0000 7f05e77fe700 1 -- 172.21.15.86:0/1981777434 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f05f0084740 con 0x7f060006f5a0 2023-10-09T11:56:18.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.232+0000 7f05feffd700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05ec066f30 0x7f05ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.232+0000 7f05feffd700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05ec066f30 0x7f05ec0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06000cce10 tx=0x7f05f4017000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:18.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.236+0000 7f05e77fe700 1 -- 172.21.15.86:0/1981777434 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05f0051b90 con 0x7f060006f5a0 2023-10-09T11:56:18.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.425+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f060006e860 con 0x7f060006f5a0 2023-10-09T11:56:18.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.425+0000 7f05e77fe700 1 -- 172.21.15.86:0/1981777434 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05f00551b0 con 0x7f060006f5a0 2023-10-09T11:56:18.427 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:56:18.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05ec066f30 msgr2=0x7f05ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05ec066f30 0x7f05ec0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06000cce10 tx=0x7f05f4017000 comp rx=0 tx=0).stop 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060006f5a0 msgr2=0x7f06000c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060006f5a0 0x7f06000c4a30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f05f000ec80 tx=0x7f05f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 shutdown_connections 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05ec066f30 0x7f05ec0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060006f5a0 0x7f06000c4a30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06000c5a50 0x7f06000b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 --2- 172.21.15.86:0/1981777434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06000cb1a0 0x7f060014dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 >> 172.21.15.86:0/1981777434 conn(0x7f06000cc1e0 msgr2=0x7f06000c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:18.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 shutdown_connections 2023-10-09T11:56:18.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.428+0000 7f0604d9d700 1 -- 172.21.15.86:0/1981777434 wait complete. 2023-10-09T11:56:18.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:56:18.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.625+0000 7feef579d700 1 Processor -- start 2023-10-09T11:56:18.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.625+0000 7feef579d700 1 -- start start 2023-10-09T11:56:18.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.626+0000 7feef579d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feef006c0f0 0x7feef01642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.626+0000 7feef579d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef00b40f0 con 0x7feef0142ea0 2023-10-09T11:56:18.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.626+0000 7feef579d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef0069640 con 0x7feef00ad870 2023-10-09T11:56:18.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.626+0000 7feef579d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef0069920 con 0x7feef006c0f0 2023-10-09T11:56:18.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.626+0000 7feeeffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7feef0142ea0 0x7feef00b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34378/0 (socket says 172.21.15.86:34378) 2023-10-09T11:56:18.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.626+0000 7feeeffff700 1 -- 172.21.15.86:0/1448548922 learned_addr learned my addr 172.21.15.86:0/1448548922 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:18.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feef4f9c700 1 --2- 172.21.15.86:0/1448548922 >> v2:172.21.15.135:3300/0 conn(0x7feef006c0f0 0x7feef01642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279464279 0 0) 0x7feef00b40f0 con 0x7feef0142ea0 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed8003570 con 0x7feef0142ea0 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229462926 0 0) 0x7feed8003570 con 0x7feef0142ea0 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 >> v2:172.21.15.135:3300/0 conn(0x7feef006c0f0 msgr2=0x7feef01642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 --2- 172.21.15.86:0/1448548922 >> v2:172.21.15.135:3300/0 conn(0x7feef006c0f0 0x7feef01642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 >> v1:172.21.15.135:6789/0 conn(0x7feef00ad870 legacy=0x7feef006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0069c00 con 0x7feef0142ea0 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7feee0001470 con 0x7feef0142ea0 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 >> v1:172.21.15.86:6789/0 conn(0x7feef0142ea0 legacy=0x7feef00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed8003a60 0x7feed8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed8004810 0x7feed8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed80051c0 0x7feed800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef0069920 con 0x7feed8003a60 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed800c0d0 con 0x7feed80051c0 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.627+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed800c290 con 0x7feed8004810 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeffff700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed8003a60 0x7feed8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feef4f9c700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed80051c0 0x7feed800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeef7fe700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed8004810 0x7feed8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeffff700 1 -- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed8004810 msgr2=0x7feed8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeffff700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed8004810 0x7feed8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeffff700 1 -- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed80051c0 msgr2=0x7feed800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeffff700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed80051c0 0x7feed800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeffff700 1 -- 172.21.15.86:0/1448548922 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed8003570 con 0x7feed8003a60 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feef4f9c700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed80051c0 0x7feed800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feef4f9c700 1 -- 172.21.15.86:0/1448548922 reap_dead start 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeffff700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed8003a60 0x7feed8003e70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feee000c3c0 tx=0x7feee0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cace5f083a54a8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000cc90 con 0x7feed8003a60 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee000cdf0 con 0x7feed8003a60 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.628+0000 7feeeeffd700 1 -- 172.21.15.86:0/1448548922 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0005b50 con 0x7feed8003a60 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.629+0000 7feef579d700 1 -- 172.21.15.86:0/1448548922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed8003a60 msgr2=0x7feed8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.629+0000 7feef579d700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed8003a60 0x7feed8003e70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feee000c3c0 tx=0x7feee0001e50 comp rx=0 tx=0).stop 2023-10-09T11:56:18.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.629+0000 7feef579d700 1 -- 172.21.15.86:0/1448548922 shutdown_connections 2023-10-09T11:56:18.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.629+0000 7feef579d700 1 --2- 172.21.15.86:0/1448548922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed8003a60 0x7feed8003e70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.629+0000 7feef579d700 1 -- 172.21.15.86:0/1448548922 >> 172.21.15.86:0/1448548922 conn(0x7feef00ce430 msgr2=0x7feef00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:18.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.629+0000 7feef579d700 1 -- 172.21.15.86:0/1448548922 shutdown_connections 2023-10-09T11:56:18.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.629+0000 7feef579d700 1 -- 172.21.15.86:0/1448548922 wait complete. 2023-10-09T11:56:18.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.630+0000 7feef579d700 1 Processor -- start 2023-10-09T11:56:18.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.630+0000 7feef579d700 1 -- start start 2023-10-09T11:56:18.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.631+0000 7feef579d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed8003a60 0x7feef0141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.631+0000 7feef579d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feef015f430 0x7feef015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.631+0000 7feef579d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feef015cc20 0x7feef015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.631+0000 7feef579d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00ad240 con 0x7feef015f430 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.631+0000 7feef579d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef015fde0 con 0x7feed8003a60 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.631+0000 7feef579d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef00c75e0 con 0x7feef015cc20 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feef015f430 0x7feef015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feef015f430 0x7feef015f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50318/0 (socket says 172.21.15.86:50318) 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 -- 172.21.15.86:0/2983812839 learned_addr learned my addr 172.21.15.86:0/2983812839 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeeffff700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed8003a60 0x7feef0141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feef4f9c700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feef015cc20 0x7feef015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 -- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feef015cc20 msgr2=0x7feef015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feef015cc20 0x7feef015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 -- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed8003a60 msgr2=0x7feef0141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed8003a60 0x7feef0141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 -- 172.21.15.86:0/2983812839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00c8160 con 0x7feef015f430 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feeef7fe700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feef015f430 0x7feef015f8a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7feee400e540 tx=0x7feee4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.632+0000 7feed7fff700 1 -- 172.21.15.86:0/2983812839 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4017070 con 0x7feef015f430 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.633+0000 7feed7fff700 1 -- 172.21.15.86:0/2983812839 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4006820 con 0x7feef015f430 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.633+0000 7feed7fff700 1 -- 172.21.15.86:0/2983812839 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400eee0 con 0x7feef015f430 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.633+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef015d5d0 con 0x7feef015f430 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.633+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef00c7b10 con 0x7feef015f430 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.634+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef00c82f0 con 0x7feef015f430 2023-10-09T11:56:18.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.635+0000 7feed7fff700 1 -- 172.21.15.86:0/2983812839 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feee4007020 con 0x7feef015f430 2023-10-09T11:56:18.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.636+0000 7feed7fff700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feedc066f30 0x7feedc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:18.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.636+0000 7feed7fff700 1 -- 172.21.15.86:0/2983812839 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5229+0+0 (secure 0 0 0) 0x7feee4083df0 con 0x7feef015f430 2023-10-09T11:56:18.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.636+0000 7feeeffff700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feedc066f30 0x7feedc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:18.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.637+0000 7feeeffff700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feedc066f30 0x7feedc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feee0007cd0 tx=0x7feee0015000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:18.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.640+0000 7feed7fff700 1 -- 172.21.15.86:0/2983812839 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feee40511a0 con 0x7feef015f430 2023-10-09T11:56:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.833+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feef004c3c0 con 0x7feef015f430 2023-10-09T11:56:18.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.833+0000 7feed7fff700 1 -- 172.21.15.86:0/2983812839 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+65 (secure 0 0 0) 0x7feee40547c0 con 0x7feef015f430 2023-10-09T11:56:18.834 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:18.835 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:56:18.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:18.835 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T11:56:18.835 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T11:56:18.835 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:18.835 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:56:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.835+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feedc066f30 msgr2=0x7feedc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.835+0000 7feef579d700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feedc066f30 0x7feedc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feee0007cd0 tx=0x7feee0015000 comp rx=0 tx=0).stop 2023-10-09T11:56:18.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.835+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feef015f430 msgr2=0x7feef015f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.835+0000 7feef579d700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feef015f430 0x7feef015f8a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7feee400e540 tx=0x7feee4009040 comp rx=0 tx=0).stop 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 shutdown_connections 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feef015cc20 0x7feef015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed8003a60 0x7feef0141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feedc066f30 0x7feedc0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 --2- 172.21.15.86:0/2983812839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feef015f430 0x7feef015f8a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 >> 172.21.15.86:0/2983812839 conn(0x7feef00ce430 msgr2=0x7feef00ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 shutdown_connections 2023-10-09T11:56:18.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:18.836+0000 7feef579d700 1 -- 172.21.15.86:0/2983812839 wait complete. 2023-10-09T11:56:18.855 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:56:18.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:56:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.036+0000 7f6b821ff700 1 Processor -- start 2023-10-09T11:56:19.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.037+0000 7f6b821ff700 1 -- start start 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b821ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b821ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b7c068aa0 0x7f6b7c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b821ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c06dc20 con 0x7f6b7c0b2100 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b821ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c0acc00 con 0x7f6b7c068aa0 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b821ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06d6a0 con 0x7f6b7c157740 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b7bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b7c068aa0 0x7f6b7c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b73fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6b7c0b2100 0x7f6b7c068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34388/0 (socket says 172.21.15.86:34388) 2023-10-09T11:56:19.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.038+0000 7f6b73fff700 1 -- 172.21.15.86:0/2673407226 learned_addr learned my addr 172.21.15.86:0/2673407226 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2673407226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7bfff700 1 -- 172.21.15.86:0/2673407226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 msgr2=0x7f6b7c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7bfff700 1 --2- 172.21.15.86:0/2673407226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7bfff700 1 -- 172.21.15.86:0/2673407226 >> v1:172.21.15.86:6789/0 conn(0x7f6b7c0b2100 legacy=0x7f6b7c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7bfff700 1 -- 172.21.15.86:0/2673407226 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c0ae910 con 0x7f6b7c068aa0 2023-10-09T11:56:19.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7affd700 1 -- 172.21.15.86:0/2673407226 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43468860 0 0) 0x7f6b7c06dc20 con 0x7f6b7c0b2100 2023-10-09T11:56:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7bfff700 1 --2- 172.21.15.86:0/2673407226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c06e0b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009e60 tx=0x7f6b74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659d5388e13aaf6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:19.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7affd700 1 -- 172.21.15.86:0/2673407226 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400e070 con 0x7f6b7c068aa0 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7affd700 1 -- 172.21.15.86:0/2673407226 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7400bc30 con 0x7f6b7c068aa0 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.039+0000 7f6b7affd700 1 -- 172.21.15.86:0/2673407226 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74012430 con 0x7f6b7c068aa0 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 -- 172.21.15.86:0/2673407226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c068aa0 msgr2=0x7f6b7c06e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2673407226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c06e0b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009e60 tx=0x7f6b74009780 comp rx=0 tx=0).stop 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 -- 172.21.15.86:0/2673407226 shutdown_connections 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2673407226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c06e0b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2673407226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 -- 172.21.15.86:0/2673407226 >> 172.21.15.86:0/2673407226 conn(0x7f6b7c0c8f90 msgr2=0x7f6b7c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 -- 172.21.15.86:0/2673407226 shutdown_connections 2023-10-09T11:56:19.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.040+0000 7f6b821ff700 1 -- 172.21.15.86:0/2673407226 wait complete. 2023-10-09T11:56:19.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.041+0000 7f6b821ff700 1 Processor -- start 2023-10-09T11:56:19.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.042+0000 7f6b821ff700 1 -- start start 2023-10-09T11:56:19.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.042+0000 7f6b821ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.042+0000 7f6b821ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c0b2100 0x7f6b7c0a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b821ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b821ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c5540 con 0x7f6b7c0b2100 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b821ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c63a0 con 0x7f6b7c068aa0 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b821ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c5790 con 0x7f6b7c157740 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c0b2100 0x7f6b7c0a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c0b2100 0x7f6b7c0a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50332/0 (socket says 172.21.15.86:50332) 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 -- 172.21.15.86:0/2728538735 learned_addr learned my addr 172.21.15.86:0/2728538735 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:19.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b7bfff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 -- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 msgr2=0x7f6b7c0a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 -- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068aa0 msgr2=0x7f6b7c155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 -- 172.21.15.86:0/2728538735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74009a20 con 0x7f6b7c0b2100 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.043+0000 7f6b73fff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c0b2100 0x7f6b7c0a64d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c810 tx=0x7f6b64007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.044+0000 7f6b737fe700 1 -- 172.21.15.86:0/2728538735 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64005b30 con 0x7f6b7c0b2100 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.044+0000 7f6b737fe700 1 -- 172.21.15.86:0/2728538735 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64005c90 con 0x7f6b7c0b2100 2023-10-09T11:56:19.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.044+0000 7f6b737fe700 1 -- 172.21.15.86:0/2728538735 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64007300 con 0x7f6b7c0b2100 2023-10-09T11:56:19.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.044+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c0c5a70 con 0x7f6b7c0b2100 2023-10-09T11:56:19.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.044+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c0c6030 con 0x7f6b7c0b2100 2023-10-09T11:56:19.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.045+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c0c6530 con 0x7f6b7c0b2100 2023-10-09T11:56:19.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.046+0000 7f6b737fe700 1 -- 172.21.15.86:0/2728538735 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b6401b400 con 0x7f6b7c0b2100 2023-10-09T11:56:19.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.047+0000 7f6b737fe700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b5c066f30 0x7f6b5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.047+0000 7f6b737fe700 1 -- 172.21.15.86:0/2728538735 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f6b64083e70 con 0x7f6b7c0b2100 2023-10-09T11:56:19.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.047+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b5c066f30 0x7f6b5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.047+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b5c066f30 0x7f6b5c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0ccf20 tx=0x7f6b6c008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:19.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.051+0000 7f6b737fe700 1 -- 172.21.15.86:0/2728538735 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b64051340 con 0x7f6b7c0b2100 2023-10-09T11:56:19.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.242+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6b7c0718b0 con 0x7f6b7c0b2100 2023-10-09T11:56:19.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.694+0000 7f6b737fe700 1 -- 172.21.15.86:0/2728538735 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6b64054960 con 0x7f6b7c0b2100 2023-10-09T11:56:19.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b5c066f30 msgr2=0x7f6b5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b5c066f30 0x7f6b5c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0ccf20 tx=0x7f6b6c008040 comp rx=0 tx=0).stop 2023-10-09T11:56:19.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c0b2100 msgr2=0x7f6b7c0a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c0b2100 0x7f6b7c0a64d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c810 tx=0x7f6b64007df0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 shutdown_connections 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c157740 0x7f6b7c0a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068aa0 0x7f6b7c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b5c066f30 0x7f6b5c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 --2- 172.21.15.86:0/2728538735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c0b2100 0x7f6b7c0a64d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.697+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 >> 172.21.15.86:0/2728538735 conn(0x7f6b7c0c8f90 msgr2=0x7f6b7c156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.698+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 shutdown_connections 2023-10-09T11:56:19.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.698+0000 7f6b821ff700 1 -- 172.21.15.86:0/2728538735 wait complete. 2023-10-09T11:56:19.701 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T11:56:19.730 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:56:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.918+0000 7fc84c5ff700 1 Processor -- start 2023-10-09T11:56:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.918+0000 7fc84c5ff700 1 -- start start 2023-10-09T11:56:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.919+0000 7fc84c5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc844156620 0x7fc8440c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.919+0000 7fc84c5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8441569f0 0x7fc8440ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.919+0000 7fc84c5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440ad3b0 con 0x7fc844068390 2023-10-09T11:56:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.919+0000 7fc84c5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8440c8d30 con 0x7fc8441569f0 2023-10-09T11:56:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.919+0000 7fc84c5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84415a6f0 con 0x7fc844156620 2023-10-09T11:56:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc849b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8441569f0 0x7fc8440ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc84ab9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc844068390 0x7fc84406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34398/0 (socket says 172.21.15.86:34398) 2023-10-09T11:56:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc84ab9c700 1 -- 172.21.15.86:0/943608691 learned_addr learned my addr 172.21.15.86:0/943608691 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc84a39b700 1 --2- 172.21.15.86:0/943608691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc844156620 0x7fc8440c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc849399700 1 -- 172.21.15.86:0/943608691 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571680 0 0) 0x7fc8440ad3b0 con 0x7fc844068390 2023-10-09T11:56:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc849b9a700 1 -- 172.21.15.86:0/943608691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc844156620 msgr2=0x7fc8440c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc849b9a700 1 --2- 172.21.15.86:0/943608691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc844156620 0x7fc8440c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc849b9a700 1 -- 172.21.15.86:0/943608691 >> v1:172.21.15.86:6789/0 conn(0x7fc844068390 legacy=0x7fc84406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.920+0000 7fc849b9a700 1 -- 172.21.15.86:0/943608691 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84415a9d0 con 0x7fc8441569f0 2023-10-09T11:56:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc849b9a700 1 --2- 172.21.15.86:0/943608691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8441569f0 0x7fc8440ace70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098e0 tx=0x7fc8340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68285212bddbaa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc849399700 1 -- 172.21.15.86:0/943608691 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834009e80 con 0x7fc8441569f0 2023-10-09T11:56:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc849399700 1 -- 172.21.15.86:0/943608691 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400b860 con 0x7fc8441569f0 2023-10-09T11:56:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc849399700 1 -- 172.21.15.86:0/943608691 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400bbe0 con 0x7fc8441569f0 2023-10-09T11:56:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc84c5ff700 1 -- 172.21.15.86:0/943608691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8441569f0 msgr2=0x7fc8440ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/943608691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8441569f0 0x7fc8440ace70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098e0 tx=0x7fc8340091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc84c5ff700 1 -- 172.21.15.86:0/943608691 shutdown_connections 2023-10-09T11:56:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/943608691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc844156620 0x7fc8440c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/943608691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8441569f0 0x7fc8440ace70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.921+0000 7fc84c5ff700 1 -- 172.21.15.86:0/943608691 >> 172.21.15.86:0/943608691 conn(0x7fc8440cc540 msgr2=0x7fc8440cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.922+0000 7fc84c5ff700 1 -- 172.21.15.86:0/943608691 shutdown_connections 2023-10-09T11:56:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.922+0000 7fc84c5ff700 1 -- 172.21.15.86:0/943608691 wait complete. 2023-10-09T11:56:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.923+0000 7fc84c5ff700 1 Processor -- start 2023-10-09T11:56:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.923+0000 7fc84c5ff700 1 -- start start 2023-10-09T11:56:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84c5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc844068390 0x7fc8440c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844156620 0x7fc84416b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84c5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8441569f0 0x7fc84416a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84c5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84416b590 con 0x7fc844068390 2023-10-09T11:56:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c2c80 con 0x7fc844156620 2023-10-09T11:56:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84c5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c04b0 con 0x7fc8441569f0 2023-10-09T11:56:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84a39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc844068390 0x7fc8440c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84a39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc844068390 0x7fc8440c2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50350/0 (socket says 172.21.15.86:50350) 2023-10-09T11:56:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.924+0000 7fc84a39b700 1 -- 172.21.15.86:0/2240774436 learned_addr learned my addr 172.21.15.86:0/2240774436 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:19.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84a39b700 1 -- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8441569f0 msgr2=0x7fc84416a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84a39b700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8441569f0 0x7fc84416a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84a39b700 1 -- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844156620 msgr2=0x7fc84416b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc849b9a700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844156620 0x7fc84416b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84a39b700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844156620 0x7fc84416b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84a39b700 1 -- 172.21.15.86:0/2240774436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009420 con 0x7fc844068390 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc849b9a700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844156620 0x7fc84416b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84a39b700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc844068390 0x7fc8440c2740 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc84000e190 tx=0x7fc840009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc83a7fc700 1 -- 172.21.15.86:0/2240774436 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84000edd0 con 0x7fc844068390 2023-10-09T11:56:19.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc83a7fc700 1 -- 172.21.15.86:0/2240774436 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840014420 con 0x7fc844068390 2023-10-09T11:56:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84416afd0 con 0x7fc844068390 2023-10-09T11:56:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc83a7fc700 1 -- 172.21.15.86:0/2240774436 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400147e0 con 0x7fc844068390 2023-10-09T11:56:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.925+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8440c0140 con 0x7fc844068390 2023-10-09T11:56:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.926+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84406e640 con 0x7fc844068390 2023-10-09T11:56:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.927+0000 7fc83a7fc700 1 -- 172.21.15.86:0/2240774436 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc840014b90 con 0x7fc844068390 2023-10-09T11:56:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.928+0000 7fc83a7fc700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:19.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.928+0000 7fc83a7fc700 1 -- 172.21.15.86:0/2240774436 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5599+0+0 (secure 0 0 0) 0x7fc840085b90 con 0x7fc844068390 2023-10-09T11:56:19.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.928+0000 7fc849b9a700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:19.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.929+0000 7fc849b9a700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc828066f30 0x7fc8280693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc84406d590 tx=0x7fc834017000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:19.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:19.932+0000 7fc83a7fc700 1 -- 172.21.15.86:0/2240774436 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc840052e50 con 0x7fc844068390 2023-10-09T11:56:20.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.122+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc8440718b0 con 0x7fc844068390 2023-10-09T11:56:20.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.700+0000 7fc83a7fc700 1 -- 172.21.15.86:0/2240774436 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc840009a60 con 0x7fc844068390 2023-10-09T11:56:20.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.711+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc828066f30 msgr2=0x7fc8280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:20.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.711+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc828066f30 0x7fc8280693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc84406d590 tx=0x7fc834017000 comp rx=0 tx=0).stop 2023-10-09T11:56:20.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.711+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc844068390 msgr2=0x7fc8440c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:20.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.711+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc844068390 0x7fc8440c2740 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc84000e190 tx=0x7fc840009920 comp rx=0 tx=0).stop 2023-10-09T11:56:20.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.712+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 shutdown_connections 2023-10-09T11:56:20.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.712+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc828066f30 0x7fc8280693e0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc84406d590 tx=0x7fc834017000 comp rx=0 tx=0).stop 2023-10-09T11:56:20.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.712+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc844068390 0x7fc8440c2740 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.712+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8441569f0 0x7fc84416a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.712+0000 7fc84c5ff700 1 --2- 172.21.15.86:0/2240774436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844156620 0x7fc84416b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.712+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 >> 172.21.15.86:0/2240774436 conn(0x7fc8440cc540 msgr2=0x7fc844155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:20.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.713+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 shutdown_connections 2023-10-09T11:56:20.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.713+0000 7fc84c5ff700 1 -- 172.21.15.86:0/2240774436 wait complete. 2023-10-09T11:56:20.720 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T11:56:20.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:56:20.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.921+0000 7fbfbb9ff700 1 Processor -- start 2023-10-09T11:56:20.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.922+0000 7fbfbb9ff700 1 -- start start 2023-10-09T11:56:20.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfbb9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbfb40c83f0 0x7fbfb40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfbb9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfbb9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb415b0d0 con 0x7fbfb40ccee0 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfbb9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb40c7a60 con 0x7fbfb40c83f0 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfbb9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb415a4c0 con 0x7fbfb41568e0 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfb8f9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbfb40ccee0 0x7fbfb41561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34412/0 (socket says 172.21.15.86:34412) 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfb8f9a700 1 -- 172.21.15.86:0/3668215746 learned_addr learned my addr 172.21.15.86:0/3668215746 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfb979b700 1 --2- 172.21.15.86:0/3668215746 >> v2:172.21.15.135:3300/0 conn(0x7fbfb40c83f0 0x7fbfb40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfb9f9c700 1 --2- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:20.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.923+0000 7fbfabfff700 1 -- 172.21.15.86:0/3668215746 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009474896 0 0) 0x7fbfb415b0d0 con 0x7fbfb40ccee0 2023-10-09T11:56:20.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.924+0000 7fbfabfff700 1 -- 172.21.15.86:0/3668215746 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa0003570 con 0x7fbfb40ccee0 2023-10-09T11:56:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.924+0000 7fbfb979b700 1 -- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 msgr2=0x7fbfb40ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.924+0000 7fbfb979b700 1 --2- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.924+0000 7fbfb979b700 1 -- 172.21.15.86:0/3668215746 >> v1:172.21.15.86:6789/0 conn(0x7fbfb40ccee0 legacy=0x7fbfb41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:20.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.924+0000 7fbfabfff700 1 -- 172.21.15.86:0/3668215746 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243845240 0 0) 0x7fbfa0003570 con 0x7fbfb40ccee0 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.924+0000 7fbfb979b700 1 -- 172.21.15.86:0/3668215746 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb415a7a0 con 0x7fbfb40c83f0 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.924+0000 7fbfb979b700 1 --2- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 0x7fbfb40c7520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00098e0 tx=0x7fbfb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fdde5cae2bd08ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfabfff700 1 -- 172.21.15.86:0/3668215746 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0011630 con 0x7fbfb40c83f0 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfabfff700 1 -- 172.21.15.86:0/3668215746 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0011790 con 0x7fbfb40c83f0 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfabfff700 1 -- 172.21.15.86:0/3668215746 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0011b10 con 0x7fbfb40c83f0 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 msgr2=0x7fbfb40c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 0x7fbfb40c7520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00098e0 tx=0x7fbfb00091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/3668215746 shutdown_connections 2023-10-09T11:56:20.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/3668215746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 0x7fbfb40c7520 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/3668215746 >> 172.21.15.86:0/3668215746 conn(0x7fbfb4068e10 msgr2=0x7fbfb40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:20.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/3668215746 shutdown_connections 2023-10-09T11:56:20.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.925+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/3668215746 wait complete. 2023-10-09T11:56:20.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.927+0000 7fbfbb9ff700 1 Processor -- start 2023-10-09T11:56:20.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.927+0000 7fbfbb9ff700 1 -- start start 2023-10-09T11:56:20.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfbb9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 0x7fbfb40b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:20.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfbb9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfb40ccee0 0x7fbfb40c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:20.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfbb9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:20.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfbb9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb40c6580 con 0x7fbfb40ccee0 2023-10-09T11:56:20.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfbb9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb40c4340 con 0x7fbfb40c83f0 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfbb9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb40c4620 con 0x7fbfb41568e0 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfb8f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfb40ccee0 0x7fbfb40c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfb8f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfb40ccee0 0x7fbfb40c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50356/0 (socket says 172.21.15.86:50356) 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfb8f9a700 1 -- 172.21.15.86:0/2894779852 learned_addr learned my addr 172.21.15.86:0/2894779852 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.928+0000 7fbfb979b700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 0x7fbfb40b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfb9f9c700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfb8f9a700 1 -- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 msgr2=0x7fbfb40c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfb8f9a700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfb8f9a700 1 -- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 msgr2=0x7fbfb40b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfb8f9a700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 0x7fbfb40b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfb8f9a700 1 -- 172.21.15.86:0/2894779852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0009420 con 0x7fbfb40ccee0 2023-10-09T11:56:20.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfb8f9a700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfb40ccee0 0x7fbfb40c37f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c7c0 tx=0x7fbfa4007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:20.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfa97fa700 1 -- 172.21.15.86:0/2894779852 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4007360 con 0x7fbfb40ccee0 2023-10-09T11:56:20.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfa97fa700 1 -- 172.21.15.86:0/2894779852 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40074c0 con 0x7fbfb40ccee0 2023-10-09T11:56:20.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfa97fa700 1 -- 172.21.15.86:0/2894779852 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004830 con 0x7fbfb40ccee0 2023-10-09T11:56:20.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb40c4900 con 0x7fbfb40ccee0 2023-10-09T11:56:20.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.929+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb4157fc0 con 0x7fbfb40ccee0 2023-10-09T11:56:20.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.930+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb41581e0 con 0x7fbfb40ccee0 2023-10-09T11:56:20.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.932+0000 7fbfa97fa700 1 -- 172.21.15.86:0/2894779852 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfa4004be0 con 0x7fbfb40ccee0 2023-10-09T11:56:20.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.932+0000 7fbfa97fa700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf98066f30 0x7fbf980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:20.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.932+0000 7fbfa97fa700 1 -- 172.21.15.86:0/2894779852 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5981+0+0 (secure 0 0 0) 0x7fbfa40840f0 con 0x7fbfb40ccee0 2023-10-09T11:56:20.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.933+0000 7fbfb979b700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf98066f30 0x7fbf980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:20.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.933+0000 7fbfb979b700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf98066f30 0x7fbf980693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00091e0 tx=0x7fbfb0017000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:20.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:20.936+0000 7fbfa97fa700 1 -- 172.21.15.86:0/2894779852 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfa40512b0 con 0x7fbfb40ccee0 2023-10-09T11:56:21.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.166+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbfb404c430 con 0x7fbfb40ccee0 2023-10-09T11:56:21.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.729+0000 7fbfa97fa700 1 -- 172.21.15.86:0/2894779852 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbfb404c430 con 0x7fbfb40ccee0 2023-10-09T11:56:21.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.735+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf98066f30 msgr2=0x7fbf980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:21.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.735+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf98066f30 0x7fbf980693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00091e0 tx=0x7fbfb0017000 comp rx=0 tx=0).stop 2023-10-09T11:56:21.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.735+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfb40ccee0 msgr2=0x7fbfb40c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:21.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.735+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfb40ccee0 0x7fbfb40c37f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c7c0 tx=0x7fbfa4007b70 comp rx=0 tx=0).stop 2023-10-09T11:56:21.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.736+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 shutdown_connections 2023-10-09T11:56:21.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.736+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfb41568e0 0x7fbfb40c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:21.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.736+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfb40c83f0 0x7fbfb40b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:21.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.736+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf98066f30 0x7fbf980693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:21.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.736+0000 7fbfbb9ff700 1 --2- 172.21.15.86:0/2894779852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfb40ccee0 0x7fbfb40c37f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:21.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.736+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 >> 172.21.15.86:0/2894779852 conn(0x7fbfb4068e10 msgr2=0x7fbfb414b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.740+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 shutdown_connections 2023-10-09T11:56:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.740+0000 7fbfbb9ff700 1 -- 172.21.15.86:0/2894779852 wait complete. 2023-10-09T11:56:21.744 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 8 and data pool 9 2023-10-09T11:56:21.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:21.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.940+0000 7f29a63ff700 1 Processor -- start 2023-10-09T11:56:21.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.941+0000 7f29a63ff700 1 -- start start 2023-10-09T11:56:21.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.942+0000 7f29a63ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29a00ccf90 0x7f29a00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:21.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.942+0000 7f29a63ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a00cc300 con 0x7f29a00b1420 2023-10-09T11:56:21.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.942+0000 7f29a63ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a00ad370 con 0x7f29a00cbf30 2023-10-09T11:56:21.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.942+0000 7f29a63ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a0156bf0 con 0x7f29a00ccf90 2023-10-09T11:56:21.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.942+0000 7f29a499c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29a00ccf90 0x7f29a00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:21.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.942+0000 7f299f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f29a00b1420 0x7f29a00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34416/0 (socket says 172.21.15.86:34416) 2023-10-09T11:56:21.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.942+0000 7f299f7fe700 1 -- 172.21.15.86:0/1130853187 learned_addr learned my addr 172.21.15.86:0/1130853187 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f29a499c700 1 -- 172.21.15.86:0/1130853187 >> v1:172.21.15.135:6789/0 conn(0x7f29a00cbf30 legacy=0x7f29a00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f299effd700 1 -- 172.21.15.86:0/1130853187 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451664919 0 0) 0x7f29a00cc300 con 0x7f29a00b1420 2023-10-09T11:56:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f29a499c700 1 -- 172.21.15.86:0/1130853187 >> v1:172.21.15.86:6789/0 conn(0x7f29a00b1420 legacy=0x7f29a00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f29a499c700 1 -- 172.21.15.86:0/1130853187 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00ad650 con 0x7f29a00ccf90 2023-10-09T11:56:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f29a499c700 1 --2- 172.21.15.86:0/1130853187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00ccf90 0x7f29a00ae410 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2998009e60 tx=0x7f2998009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bf9ee26bb43c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:21.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f299effd700 1 -- 172.21.15.86:0/1130853187 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800e070 con 0x7f29a00ccf90 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f299effd700 1 -- 172.21.15.86:0/1130853187 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299800bc30 con 0x7f29a00ccf90 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.943+0000 7f299effd700 1 -- 172.21.15.86:0/1130853187 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998012430 con 0x7f29a00ccf90 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.944+0000 7f29a63ff700 1 -- 172.21.15.86:0/1130853187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00ccf90 msgr2=0x7f29a00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.944+0000 7f29a63ff700 1 --2- 172.21.15.86:0/1130853187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00ccf90 0x7f29a00ae410 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2998009e60 tx=0x7f2998009780 comp rx=0 tx=0).stop 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.944+0000 7f29a63ff700 1 -- 172.21.15.86:0/1130853187 shutdown_connections 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.944+0000 7f29a63ff700 1 --2- 172.21.15.86:0/1130853187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00ccf90 0x7f29a00ae410 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.944+0000 7f29a63ff700 1 -- 172.21.15.86:0/1130853187 >> 172.21.15.86:0/1130853187 conn(0x7f29a006a320 msgr2=0x7f29a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.944+0000 7f29a63ff700 1 -- 172.21.15.86:0/1130853187 shutdown_connections 2023-10-09T11:56:21.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.944+0000 7f29a63ff700 1 -- 172.21.15.86:0/1130853187 wait complete. 2023-10-09T11:56:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.945+0000 7f29a63ff700 1 Processor -- start 2023-10-09T11:56:21.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.945+0000 7f29a63ff700 1 -- start start 2023-10-09T11:56:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.946+0000 7f29a63ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00b1420 0x7f29a00a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.946+0000 7f29a63ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a00cbf30 0x7f29a00a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.946+0000 7f29a63ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a00ccf90 0x7f29a01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.946+0000 7f29a63ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00a9d40 con 0x7f29a00b1420 2023-10-09T11:56:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.946+0000 7f29a63ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00a8840 con 0x7f29a00ccf90 2023-10-09T11:56:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.946+0000 7f29a63ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00a7a60 con 0x7f29a00cbf30 2023-10-09T11:56:21.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00b1420 0x7f29a00a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00b1420 0x7f29a00a67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50380/0 (socket says 172.21.15.86:50380) 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 -- 172.21.15.86:0/2496153266 learned_addr learned my addr 172.21.15.86:0/2496153266 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f29a499c700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a00ccf90 0x7f29a01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299f7fe700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a00cbf30 0x7f29a00a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 -- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a00cbf30 msgr2=0x7f29a00a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a00cbf30 0x7f29a00a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 -- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a00ccf90 msgr2=0x7f29a01554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a00ccf90 0x7f29a01554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:21.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 -- 172.21.15.86:0/2496153266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998009a20 con 0x7f29a00b1420 2023-10-09T11:56:21.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f299ffff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00b1420 0x7f29a00a67d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f299000c590 tx=0x7f299000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:21.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.947+0000 7f2987fff700 1 -- 172.21.15.86:0/2496153266 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990011590 con 0x7f29a00b1420 2023-10-09T11:56:21.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.948+0000 7f2987fff700 1 -- 172.21.15.86:0/2496153266 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990011710 con 0x7f29a00b1420 2023-10-09T11:56:21.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.948+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a00a7cc0 con 0x7f29a00b1420 2023-10-09T11:56:21.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.948+0000 7f2987fff700 1 -- 172.21.15.86:0/2496153266 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990011ad0 con 0x7f29a00b1420 2023-10-09T11:56:21.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.948+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a00a8300 con 0x7f29a00b1420 2023-10-09T11:56:21.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.949+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a00a9ed0 con 0x7f29a00b1420 2023-10-09T11:56:21.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.950+0000 7f2987fff700 1 -- 172.21.15.86:0/2496153266 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f299001b3b0 con 0x7f29a00b1420 2023-10-09T11:56:21.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.951+0000 7f2987fff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f298c066f60 0x7f298c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:21.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.951+0000 7f2987fff700 1 -- 172.21.15.86:0/2496153266 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f2990083b40 con 0x7f29a00b1420 2023-10-09T11:56:21.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.951+0000 7f299f7fe700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f298c066f60 0x7f298c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:21.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.951+0000 7f299f7fe700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f298c066f60 0x7f298c069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29a00b1a50 tx=0x7f2994007d30 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:21.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:21.955+0000 7f2987fff700 1 -- 172.21.15.86:0/2496153266 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29a00a9ed0 con 0x7f29a00b1420 2023-10-09T11:56:22.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.148+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29a004c3c0 con 0x7f29a00b1420 2023-10-09T11:56:22.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.149+0000 7f2987fff700 1 -- 172.21.15.86:0/2496153266 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15981 (secure 0 0 0) 0x7f2990017070 con 0x7f29a00b1420 2023-10-09T11:56:22.151 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:22.151 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":79,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:21.168357+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:19.281445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:56:20.161616+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:22.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f298c066f60 msgr2=0x7f298c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f298c066f60 0x7f298c069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29a00b1a50 tx=0x7f2994007d30 comp rx=0 tx=0).stop 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00b1420 msgr2=0x7f29a00a67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00b1420 0x7f29a00a67d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f299000c590 tx=0x7f299000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 shutdown_connections 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f298c066f60 0x7f298c069410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a00b1420 0x7f29a00a67d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a00ccf90 0x7f29a01554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 --2- 172.21.15.86:0/2496153266 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a00cbf30 0x7f29a00a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 >> 172.21.15.86:0/2496153266 conn(0x7f29a006a320 msgr2=0x7f29a015a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:22.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 shutdown_connections 2023-10-09T11:56:22.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.152+0000 7f29a63ff700 1 -- 172.21.15.86:0/2496153266 wait complete. 2023-10-09T11:56:22.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:22.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.349+0000 7f087119d700 1 Processor -- start 2023-10-09T11:56:22.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.349+0000 7f087119d700 1 -- start start 2023-10-09T11:56:22.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.350+0000 7f087119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 0x7f086c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.350+0000 7f087119d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0b2980 con 0x7f086c159420 2023-10-09T11:56:22.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.350+0000 7f087119d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c15dbb0 con 0x7f086c1597f0 2023-10-09T11:56:22.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.350+0000 7f087119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0b11d0 con 0x7f086c15d230 2023-10-09T11:56:22.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f086c159420 0x7f086c0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34424/0 (socket says 172.21.15.86:34424) 2023-10-09T11:56:22.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086bfff700 1 -- 172.21.15.86:0/2772925547 learned_addr learned my addr 172.21.15.86:0/2772925547 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:22.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096592126 0 0) 0x7f086c0b2980 con 0x7f086c159420 2023-10-09T11:56:22.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f087099c700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 0x7f086c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854003570 con 0x7f086c159420 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3653684910 0 0) 0x7f0854003570 con 0x7f086c159420 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 msgr2=0x7f086c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 0x7f086c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 >> v1:172.21.15.135:6789/0 conn(0x7f086c1597f0 legacy=0x7f086c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0b14b0 con 0x7f086c159420 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f085c001470 con 0x7f086c159420 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 >> v1:172.21.15.86:6789/0 conn(0x7f086c159420 legacy=0x7f086c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.351+0000 7f086affd700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 0x7f0854003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f086affd700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0854004060 0x7f0854004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f086affd700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f08540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0b11d0 con 0x7f0854004d50 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085400bc20 con 0x7f0854004060 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085400bde0 con 0x7f086c15d230 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f087099c700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f08540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f086bfff700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 0x7f0854003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f086b7fe700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0854004060 0x7f0854004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f087099c700 1 -- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 msgr2=0x7f0854003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f087099c700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15d230 0x7f0854003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f087099c700 1 -- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0854004060 msgr2=0x7f0854004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f087099c700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0854004060 0x7f0854004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f087099c700 1 -- 172.21.15.86:0/2772925547 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854003570 con 0x7f0854004d50 2023-10-09T11:56:22.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.352+0000 7f087099c700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f08540051c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f086400e210 tx=0x7f086400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4484cd5243759c95 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400eac0 con 0x7f0854004d50 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400f040 con 0x7f0854004d50 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f086affd700 1 -- 172.21.15.86:0/2772925547 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400ee70 con 0x7f0854004d50 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f087119d700 1 -- 172.21.15.86:0/2772925547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 msgr2=0x7f08540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f087119d700 1 --2- 172.21.15.86:0/2772925547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f08540051c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f086400e210 tx=0x7f086400b040 comp rx=0 tx=0).stop 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f087099c700 1 -- 172.21.15.86:0/2772925547 reap_dead start 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f087119d700 1 -- 172.21.15.86:0/2772925547 shutdown_connections 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f087119d700 1 -- 172.21.15.86:0/2772925547 >> 172.21.15.86:0/2772925547 conn(0x7f086c0d0660 msgr2=0x7f086c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f087119d700 1 -- 172.21.15.86:0/2772925547 shutdown_connections 2023-10-09T11:56:22.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.353+0000 7f087119d700 1 -- 172.21.15.86:0/2772925547 wait complete. 2023-10-09T11:56:22.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.355+0000 7f087119d700 1 Processor -- start 2023-10-09T11:56:22.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.355+0000 7f087119d700 1 -- start start 2023-10-09T11:56:22.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f087119d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f086c14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f087119d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c159d30 0x7f086c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f087119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15a1a0 0x7f086c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f087119d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c14cfa0 con 0x7f0854004d50 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f087119d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c15a6a0 con 0x7f086c159d30 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f087119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c15a980 con 0x7f086c15a1a0 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f086c14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f086c14b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50400/0 (socket says 172.21.15.86:50400) 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 -- 172.21.15.86:0/1830865335 learned_addr learned my addr 172.21.15.86:0/1830865335 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 -- 172.21.15.86:0/1830865335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15a1a0 msgr2=0x7f086c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15a1a0 0x7f086c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 -- 172.21.15.86:0/1830865335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c159d30 msgr2=0x7f086c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c159d30 0x7f086c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 -- 172.21.15.86:0/1830865335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c15ac60 con 0x7f0854004d50 2023-10-09T11:56:22.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.356+0000 7f086bfff700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f086c14b0a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f085c001050 tx=0x7f085c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:22.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.357+0000 7f0853fff700 1 -- 172.21.15.86:0/1830865335 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00f8d0 con 0x7f0854004d50 2023-10-09T11:56:22.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.357+0000 7f0853fff700 1 -- 172.21.15.86:0/1830865335 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00fa70 con 0x7f0854004d50 2023-10-09T11:56:22.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.357+0000 7f0853fff700 1 -- 172.21.15.86:0/1830865335 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00fe30 con 0x7f0854004d50 2023-10-09T11:56:22.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.357+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c15af40 con 0x7f0854004d50 2023-10-09T11:56:22.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.357+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c15bc80 con 0x7f0854004d50 2023-10-09T11:56:22.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.358+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c14d110 con 0x7f0854004d50 2023-10-09T11:56:22.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.359+0000 7f0853fff700 1 -- 172.21.15.86:0/1830865335 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f085c013600 con 0x7f0854004d50 2023-10-09T11:56:22.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.360+0000 7f0853fff700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.360+0000 7f0853fff700 1 -- 172.21.15.86:0/1830865335 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f085c085370 con 0x7f0854004d50 2023-10-09T11:56:22.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.360+0000 7f086b7fe700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.361+0000 7f086b7fe700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0858066f30 0x7f08580693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0860007e40 tx=0x7f0860007d30 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:22.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.363+0000 7f0853fff700 1 -- 172.21.15.86:0/1830865335 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f085c052440 con 0x7f0854004d50 2023-10-09T11:56:22.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.556+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f086c14d0e0 con 0x7f0854004d50 2023-10-09T11:56:22.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.557+0000 7f0853fff700 1 -- 172.21.15.86:0/1830865335 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15981 (secure 0 0 0) 0x7f085c055a60 con 0x7f0854004d50 2023-10-09T11:56:22.559 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:22.559 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":79,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:21.168357+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:19.281445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:56:20.161616+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:22.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.559+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0858066f30 msgr2=0x7f08580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.559+0000 7f087119d700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0858066f30 0x7f08580693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0860007e40 tx=0x7f0860007d30 comp rx=0 tx=0).stop 2023-10-09T11:56:22.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.559+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 msgr2=0x7f086c14b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.559+0000 7f087119d700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f086c14b0a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f085c001050 tx=0x7f085c001d80 comp rx=0 tx=0).stop 2023-10-09T11:56:22.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 shutdown_connections 2023-10-09T11:56:22.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0854004d50 0x7f086c14b0a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c15a1a0 0x7f086c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 --2- 172.21.15.86:0/1830865335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c159d30 0x7f086c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 >> 172.21.15.86:0/1830865335 conn(0x7f086c0d0660 msgr2=0x7f086c069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:22.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 shutdown_connections 2023-10-09T11:56:22.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.560+0000 7f087119d700 1 -- 172.21.15.86:0/1830865335 wait complete. 2023-10-09T11:56:22.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:56:22.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-09T11:56:22.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.766+0000 7f9bc1bff700 1 Processor -- start 2023-10-09T11:56:22.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.766+0000 7f9bc1bff700 1 -- start start 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.767+0000 7f9bc1bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc155eb0 0x7f9bbc06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.767+0000 7f9bc1bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9bbc0c70b0 0x7f9bbc069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.767+0000 7f9bc1bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9bbc069cb0 0x7f9bbc159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.767+0000 7f9bc1bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc06a130 con 0x7f9bbc069cb0 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.767+0000 7f9bc1bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc06eb90 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.767+0000 7f9bc1bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc06ee70 con 0x7f9bbc155eb0 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9bbc069cb0 0x7f9bbc159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9bbc069cb0 0x7f9bbc159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50410/0 (socket says 172.21.15.86:50410) 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 -- 172.21.15.86:0/2111512679 learned_addr learned my addr 172.21.15.86:0/2111512679 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:22.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbb7fe700 1 --2- 172.21.15.86:0/2111512679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc155eb0 0x7f9bbc06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbaffd700 1 --2- 172.21.15.86:0/2111512679 >> v2:172.21.15.135:3300/0 conn(0x7f9bbc0c70b0 0x7f9bbc069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 -- 172.21.15.86:0/2111512679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc155eb0 msgr2=0x7f9bbc06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 --2- 172.21.15.86:0/2111512679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc155eb0 0x7f9bbc06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 -- 172.21.15.86:0/2111512679 >> v2:172.21.15.135:3300/0 conn(0x7f9bbc0c70b0 msgr2=0x7f9bbc069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 --2- 172.21.15.86:0/2111512679 >> v2:172.21.15.135:3300/0 conn(0x7f9bbc0c70b0 0x7f9bbc069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 -- 172.21.15.86:0/2111512679 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc06f150 con 0x7f9bbc069cb0 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.768+0000 7f9bbbfff700 1 --2- 172.21.15.86:0/2111512679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc069cb0 0x7f9bbc159a60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc063d40 tx=0x7f9bb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0cf99173764b18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bba7fc700 1 -- 172.21.15.86:0/2111512679 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400e070 con 0x7f9bbc069cb0 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bba7fc700 1 -- 172.21.15.86:0/2111512679 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400b970 con 0x7f9bbc069cb0 2023-10-09T11:56:22.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bba7fc700 1 -- 172.21.15.86:0/2111512679 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40092e0 con 0x7f9bbc069cb0 2023-10-09T11:56:22.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 -- 172.21.15.86:0/2111512679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc069cb0 msgr2=0x7f9bbc159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/2111512679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc069cb0 0x7f9bbc159a60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc063d40 tx=0x7f9bb4009840 comp rx=0 tx=0).stop 2023-10-09T11:56:22.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 -- 172.21.15.86:0/2111512679 shutdown_connections 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/2111512679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc069cb0 0x7f9bbc159a60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/2111512679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc155eb0 0x7f9bbc06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/2111512679 >> v2:172.21.15.135:3300/0 conn(0x7f9bbc0c70b0 0x7f9bbc069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 -- 172.21.15.86:0/2111512679 >> 172.21.15.86:0/2111512679 conn(0x7f9bbc068e10 msgr2=0x7f9bbc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 -- 172.21.15.86:0/2111512679 shutdown_connections 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.769+0000 7f9bc1bff700 1 -- 172.21.15.86:0/2111512679 wait complete. 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.771+0000 7f9bc1bff700 1 Processor -- start 2023-10-09T11:56:22.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.771+0000 7f9bc1bff700 1 -- start start 2023-10-09T11:56:22.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bc1bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc069cb0 0x7f9bbc154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bc1bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc0c70b0 0x7f9bbc0c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bc1bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bbc155eb0 0x7f9bbc0a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bc1bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc154d40 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bc1bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0c4c10 con 0x7f9bbc155eb0 2023-10-09T11:56:22.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bc1bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0c4ef0 con 0x7f9bbc069cb0 2023-10-09T11:56:22.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc0c70b0 0x7f9bbc0c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc0c70b0 0x7f9bbc0c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50426/0 (socket says 172.21.15.86:50426) 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 -- 172.21.15.86:0/3866786849 learned_addr learned my addr 172.21.15.86:0/3866786849 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbb7fe700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc069cb0 0x7f9bbc154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbbfff700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bbc155eb0 0x7f9bbc0a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 -- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc069cb0 msgr2=0x7f9bbc154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc069cb0 0x7f9bbc154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 -- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bbc155eb0 msgr2=0x7f9bbc0a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bbc155eb0 0x7f9bbc0a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.772+0000 7f9bbaffd700 1 -- 172.21.15.86:0/3866786849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009ae0 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.773+0000 7f9bbaffd700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc0c70b0 0x7f9bbc0c4350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000bef0 tx=0x7f9bb000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:22.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.773+0000 7f9ba37fe700 1 -- 172.21.15.86:0/3866786849 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000ec50 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.773+0000 7f9ba37fe700 1 -- 172.21.15.86:0/3866786849 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0011040 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.773+0000 7f9ba37fe700 1 -- 172.21.15.86:0/3866786849 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0016480 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.773+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc0c51d0 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.773+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0c5790 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.774+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc04c3c0 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.775+0000 7f9ba37fe700 1 -- 172.21.15.86:0/3866786849 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bb00167f0 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.776+0000 7f9ba37fe700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9ba8066f30 0x7f9ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:22.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.776+0000 7f9ba37fe700 1 -- 172.21.15.86:0/3866786849 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f9bb0087390 con 0x7f9bbc0c70b0 2023-10-09T11:56:22.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.777+0000 7f9bbb7fe700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9ba8066f30 0x7f9ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:22.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.777+0000 7f9bbb7fe700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9ba8066f30 0x7f9ba80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009ca0 tx=0x7f9bac008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:22.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:22.780+0000 7f9ba37fe700 1 -- 172.21.15.86:0/3866786849 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bb00543e0 con 0x7f9bbc0c70b0 2023-10-09T11:56:23.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.013+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9bbc06f430 con 0x7f9bbc0c70b0 2023-10-09T11:56:23.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.731+0000 7f9ba37fe700 1 -- 172.21.15.86:0/3866786849 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9bb0057a00 con 0x7f9bbc0c70b0 2023-10-09T11:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9ba8066f30 msgr2=0x7f9ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9ba8066f30 0x7f9ba80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009ca0 tx=0x7f9bac008040 comp rx=0 tx=0).stop 2023-10-09T11:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc0c70b0 msgr2=0x7f9bbc0c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc0c70b0 0x7f9bbc0c4350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000bef0 tx=0x7f9bb000d040 comp rx=0 tx=0).stop 2023-10-09T11:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 shutdown_connections 2023-10-09T11:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bbc155eb0 0x7f9bbc0a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9bbc069cb0 0x7f9bbc154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9ba8066f30 0x7f9ba80693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 --2- 172.21.15.86:0/3866786849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bbc0c70b0 0x7f9bbc0c4350 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.734+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 >> 172.21.15.86:0/3866786849 conn(0x7f9bbc068e10 msgr2=0x7f9bbc0c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.735+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 shutdown_connections 2023-10-09T11:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.735+0000 7f9bc1bff700 1 -- 172.21.15.86:0/3866786849 wait complete. 2023-10-09T11:56:23.755 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:56:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.939+0000 7efc6b3ff700 1 Processor -- start 2023-10-09T11:56:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.939+0000 7efc6b3ff700 1 -- start start 2023-10-09T11:56:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.940+0000 7efc6b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 0x7efc640c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.940+0000 7efc6b3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efc640ccee0 0x7efc641561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.940+0000 7efc6b3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6415b0d0 con 0x7efc640c87c0 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.940+0000 7efc6b3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc640c7a60 con 0x7efc640ccee0 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.940+0000 7efc6b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6415a4c0 con 0x7efc640c83f0 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.940+0000 7efc6999c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7efc640c87c0 0x7efc6406eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:34430/0 (socket says 172.21.15.86:34430) 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.940+0000 7efc6999c700 1 -- 172.21.15.86:0/2126355043 learned_addr learned my addr 172.21.15.86:0/2126355043 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc6919b700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 0x7efc640c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814375934 0 0) 0x7efc6415b0d0 con 0x7efc640c87c0 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc6899a700 1 --2- 172.21.15.86:0/2126355043 >> v2:172.21.15.135:3300/0 conn(0x7efc640ccee0 0x7efc641561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc50003570 con 0x7efc640c87c0 2023-10-09T11:56:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1517624594 0 0) 0x7efc50003570 con 0x7efc640c87c0 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 msgr2=0x7efc640c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 0x7efc640c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 >> v2:172.21.15.135:3300/0 conn(0x7efc640ccee0 msgr2=0x7efc641561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 --2- 172.21.15.86:0/2126355043 >> v2:172.21.15.135:3300/0 conn(0x7efc640ccee0 0x7efc641561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6415a7a0 con 0x7efc640c87c0 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7efc5c0017f0 con 0x7efc640c87c0 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc6919b700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 0x7efc640c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 >> v1:172.21.15.86:6789/0 conn(0x7efc640c87c0 legacy=0x7efc6406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc50003a60 0x7efc50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 0x7efc50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc50004d50 0x7efc500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc640c7a60 con 0x7efc50004d50 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6415a4c0 con 0x7efc50003a60 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.941+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5000bab0 con 0x7efc640c83f0 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6999c700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc50004d50 0x7efc500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6899a700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 0x7efc50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6919b700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc50003a60 0x7efc50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6999c700 1 -- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 msgr2=0x7efc50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6999c700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc640c83f0 0x7efc50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6999c700 1 -- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc50003a60 msgr2=0x7efc50003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6999c700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc50003a60 0x7efc50003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6999c700 1 -- 172.21.15.86:0/2126355043 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50003570 con 0x7efc50004d50 2023-10-09T11:56:23.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc6999c700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc50004d50 0x7efc500051c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00a970 tx=0x7efc6406e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57ec70a7683439b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:23.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c0070d0 con 0x7efc50004d50 2023-10-09T11:56:23.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c007270 con 0x7efc50004d50 2023-10-09T11:56:23.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.942+0000 7efc5bfff700 1 -- 172.21.15.86:0/2126355043 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c007630 con 0x7efc50004d50 2023-10-09T11:56:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.943+0000 7efc6b3ff700 1 -- 172.21.15.86:0/2126355043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc50004d50 msgr2=0x7efc500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.943+0000 7efc6b3ff700 1 --2- 172.21.15.86:0/2126355043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc50004d50 0x7efc500051c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00a970 tx=0x7efc6406e870 comp rx=0 tx=0).stop 2023-10-09T11:56:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.943+0000 7efc6999c700 1 -- 172.21.15.86:0/2126355043 reap_dead start 2023-10-09T11:56:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.943+0000 7efc6b3ff700 1 -- 172.21.15.86:0/2126355043 shutdown_connections 2023-10-09T11:56:23.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.943+0000 7efc6b3ff700 1 -- 172.21.15.86:0/2126355043 >> 172.21.15.86:0/2126355043 conn(0x7efc64068e10 msgr2=0x7efc640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.943+0000 7efc6b3ff700 1 -- 172.21.15.86:0/2126355043 shutdown_connections 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.943+0000 7efc6b3ff700 1 -- 172.21.15.86:0/2126355043 wait complete. 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.944+0000 7efc6b3ff700 1 Processor -- start 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.945+0000 7efc6b3ff700 1 -- start start 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.945+0000 7efc6b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc50004d50 0x7efc64153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.945+0000 7efc6b3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc640b1780 0x7efc6414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc64168750 0x7efc64168bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6b3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc64169110 con 0x7efc640b1780 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc64153540 con 0x7efc64168750 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc640b12f0 con 0x7efc50004d50 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc640b1780 0x7efc6414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc640b1780 0x7efc6414dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50436/0 (socket says 172.21.15.86:50436) 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 -- 172.21.15.86:0/1789748957 learned_addr learned my addr 172.21.15.86:0/1789748957 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6999c700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc64168750 0x7efc64168bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 -- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc50004d50 msgr2=0x7efc64153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6919b700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc50004d50 0x7efc64153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc50004d50 0x7efc64153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 -- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc64168750 msgr2=0x7efc64168bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc64168750 0x7efc64168bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 -- 172.21.15.86:0/1789748957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640b06e0 con 0x7efc640b1780 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6999c700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc64168750 0x7efc64168bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6919b700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc50004d50 0x7efc64153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.946+0000 7efc6899a700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc640b1780 0x7efc6414dd00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7efc5400bfd0 tx=0x7efc5400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:23.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.947+0000 7efc597fa700 1 -- 172.21.15.86:0/1789748957 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54010040 con 0x7efc640b1780 2023-10-09T11:56:23.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.947+0000 7efc597fa700 1 -- 172.21.15.86:0/1789748957 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc54011040 con 0x7efc640b1780 2023-10-09T11:56:23.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.947+0000 7efc597fa700 1 -- 172.21.15.86:0/1789748957 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54017430 con 0x7efc640b1780 2023-10-09T11:56:23.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.947+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc640b09c0 con 0x7efc640b1780 2023-10-09T11:56:23.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.947+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc640b0f80 con 0x7efc640b1780 2023-10-09T11:56:23.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.948+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc640b1480 con 0x7efc640b1780 2023-10-09T11:56:23.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.949+0000 7efc597fa700 1 -- 172.21.15.86:0/1789748957 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc54017820 con 0x7efc640b1780 2023-10-09T11:56:23.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.949+0000 7efc597fa700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc48066f30 0x7efc480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:23.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.950+0000 7efc597fa700 1 -- 172.21.15.86:0/1789748957 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7efc540873c0 con 0x7efc640b1780 2023-10-09T11:56:23.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.950+0000 7efc6919b700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc48066f30 0x7efc480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:23.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.950+0000 7efc6919b700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc48066f30 0x7efc480693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc60006fd0 tx=0x7efc60008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:23.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:23.955+0000 7efc597fa700 1 -- 172.21.15.86:0/1789748957 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc54054410 con 0x7efc640b1780 2023-10-09T11:56:24.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.184+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efc6404c3c0 con 0x7efc640b1780 2023-10-09T11:56:24.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.734+0000 7efc597fa700 1 -- 172.21.15.86:0/1789748957 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7efc54057a30 con 0x7efc640b1780 2023-10-09T11:56:24.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.736+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc48066f30 msgr2=0x7efc480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:24.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc48066f30 0x7efc480693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc60006fd0 tx=0x7efc60008040 comp rx=0 tx=0).stop 2023-10-09T11:56:24.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc640b1780 msgr2=0x7efc6414dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:24.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc640b1780 0x7efc6414dd00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7efc5400bfd0 tx=0x7efc5400d040 comp rx=0 tx=0).stop 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 shutdown_connections 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc64168750 0x7efc64168bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc50004d50 0x7efc64153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc48066f30 0x7efc480693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 --2- 172.21.15.86:0/1789748957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc640b1780 0x7efc6414dd00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 >> 172.21.15.86:0/1789748957 conn(0x7efc64068e10 msgr2=0x7efc6414f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 shutdown_connections 2023-10-09T11:56:24.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.737+0000 7efc6b3ff700 1 -- 172.21.15.86:0/1789748957 wait complete. 2023-10-09T11:56:24.756 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:24.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.936+0000 7fda9699d700 1 Processor -- start 2023-10-09T11:56:24.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.936+0000 7fda9699d700 1 -- start start 2023-10-09T11:56:24.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.937+0000 7fda9699d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fda90150550 0x7fda90157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.937+0000 7fda9699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 0x7fda90069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.937+0000 7fda9699d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9006e2a0 con 0x7fda90150180 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.937+0000 7fda9699d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9006b2e0 con 0x7fda90150550 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.937+0000 7fda9699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c78e0 con 0x7fda900c7410 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.937+0000 7fda9599b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fda90150180 0x7fda900c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36608/0 (socket says 172.21.15.86:36608) 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.937+0000 7fda9599b700 1 -- 172.21.15.86:0/521458287 learned_addr learned my addr 172.21.15.86:0/521458287 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda9519a700 1 --2- 172.21.15.86:0/521458287 >> v2:172.21.15.135:3300/0 conn(0x7fda90150550 0x7fda90157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda9619c700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 0x7fda90069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956831548 0 0) 0x7fda9006e2a0 con 0x7fda90150180 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda7c003570 con 0x7fda90150180 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083488722 0 0) 0x7fda7c003570 con 0x7fda90150180 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 msgr2=0x7fda90069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 0x7fda90069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 >> v2:172.21.15.135:3300/0 conn(0x7fda90150550 msgr2=0x7fda90157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 --2- 172.21.15.86:0/521458287 >> v2:172.21.15.135:3300/0 conn(0x7fda90150550 0x7fda90157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900c7bc0 con 0x7fda90150180 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fda8c001470 con 0x7fda90150180 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 >> v1:172.21.15.86:6789/0 conn(0x7fda90150180 legacy=0x7fda900c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 0x7fda7c003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c0040b0 0x7fda7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c004d50 0x7fda7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9006b2e0 con 0x7fda7c004d50 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c78e0 con 0x7fda7c0040b0 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.938+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c00dd70 con 0x7fda900c7410 2023-10-09T11:56:24.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9619c700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c004d50 0x7fda7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9599b700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 0x7fda7c003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9519a700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c0040b0 0x7fda7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9619c700 1 -- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 msgr2=0x7fda7c003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9619c700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900c7410 0x7fda7c003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9619c700 1 -- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c0040b0 msgr2=0x7fda7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9619c700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c0040b0 0x7fda7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9619c700 1 -- 172.21.15.86:0/521458287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c003570 con 0x7fda7c004d50 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda9619c700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c004d50 0x7fda7c0051c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fda880094d0 tx=0x7fda8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71358eaf21b519f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8800ea60 con 0x7fda7c004d50 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8800f040 con 0x7fda7c004d50 2023-10-09T11:56:24.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.939+0000 7fda94999700 1 -- 172.21.15.86:0/521458287 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8800edf0 con 0x7fda7c004d50 2023-10-09T11:56:24.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.940+0000 7fda9699d700 1 -- 172.21.15.86:0/521458287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c004d50 msgr2=0x7fda7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:24.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.940+0000 7fda9699d700 1 --2- 172.21.15.86:0/521458287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c004d50 0x7fda7c0051c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fda880094d0 tx=0x7fda8800b040 comp rx=0 tx=0).stop 2023-10-09T11:56:24.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.940+0000 7fda9619c700 1 -- 172.21.15.86:0/521458287 reap_dead start 2023-10-09T11:56:24.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.940+0000 7fda9699d700 1 -- 172.21.15.86:0/521458287 shutdown_connections 2023-10-09T11:56:24.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.940+0000 7fda9699d700 1 -- 172.21.15.86:0/521458287 >> 172.21.15.86:0/521458287 conn(0x7fda900cc1f0 msgr2=0x7fda900cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:24.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.940+0000 7fda9699d700 1 -- 172.21.15.86:0/521458287 shutdown_connections 2023-10-09T11:56:24.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.940+0000 7fda9699d700 1 -- 172.21.15.86:0/521458287 wait complete. 2023-10-09T11:56:24.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.941+0000 7fda9699d700 1 Processor -- start 2023-10-09T11:56:24.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.942+0000 7fda9699d700 1 -- start start 2023-10-09T11:56:24.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.942+0000 7fda9699d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c004d50 0x7fda900aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.942+0000 7fda9699d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda9014e050 0x7fda9014abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.942+0000 7fda9699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900b0810 0x7fda901562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9699d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900b0380 con 0x7fda9014e050 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9699d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900af4d0 con 0x7fda7c004d50 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900af770 con 0x7fda900b0810 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda9014e050 0x7fda9014abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda9014e050 0x7fda9014abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37572/0 (socket says 172.21.15.86:37572) 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 -- 172.21.15.86:0/1440248254 learned_addr learned my addr 172.21.15.86:0/1440248254 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9599b700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c004d50 0x7fda900aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 -- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900b0810 msgr2=0x7fda901562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9619c700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900b0810 0x7fda901562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900b0810 0x7fda901562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 -- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c004d50 msgr2=0x7fda900aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c004d50 0x7fda900aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 -- 172.21.15.86:0/1440248254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900afa50 con 0x7fda9014e050 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9599b700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c004d50 0x7fda900aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.943+0000 7fda9519a700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda9014e050 0x7fda9014abd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fda80006ac0 tx=0x7fda800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.944+0000 7fda85ffb700 1 -- 172.21.15.86:0/1440248254 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000fa10 con 0x7fda9014e050 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.944+0000 7fda85ffb700 1 -- 172.21.15.86:0/1440248254 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000fb70 con 0x7fda9014e050 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.944+0000 7fda85ffb700 1 -- 172.21.15.86:0/1440248254 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80014440 con 0x7fda9014e050 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.944+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900afd30 con 0x7fda9014e050 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.944+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9014b110 con 0x7fda9014e050 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.945+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9004c3c0 con 0x7fda9014e050 2023-10-09T11:56:24.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.946+0000 7fda85ffb700 1 -- 172.21.15.86:0/1440248254 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda80014830 con 0x7fda9014e050 2023-10-09T11:56:24.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.947+0000 7fda85ffb700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda74066f30 0x7fda740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:24.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.947+0000 7fda85ffb700 1 -- 172.21.15.86:0/1440248254 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fda80018030 con 0x7fda9014e050 2023-10-09T11:56:24.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.947+0000 7fda9599b700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda74066f30 0x7fda740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:24.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.948+0000 7fda9599b700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda74066f30 0x7fda740693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda8c001050 tx=0x7fda8c009040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:24.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:24.951+0000 7fda85ffb700 1 -- 172.21.15.86:0/1440248254 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda80052240 con 0x7fda9014e050 2023-10-09T11:56:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.185+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda900b04c0 con 0x7fda9014e050 2023-10-09T11:56:25.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.185+0000 7fda85ffb700 1 -- 172.21.15.86:0/1440248254 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fda80055860 con 0x7fda9014e050 2023-10-09T11:56:25.186 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:25.186 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5926,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2024459788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":2024459788},{"type":"v1","addr":"172.21.15.135:6835","nonce":2024459788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/1216529409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1216529409},{"type":"v1","addr":"172.21.15.86:6833","nonce":1216529409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1408499839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1408499839},{"type":"v1","addr":"172.21.15.86:6835","nonce":1408499839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:56:21.168698+0000","modified":"2023-10-09T11:56:24.731586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3399882940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3399882940},{"type":"v1","addr":"172.21.15.135:6834","nonce":3399882940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:56:25.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda74066f30 msgr2=0x7fda740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda74066f30 0x7fda740693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda8c001050 tx=0x7fda8c009040 comp rx=0 tx=0).stop 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda9014e050 msgr2=0x7fda9014abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda9014e050 0x7fda9014abd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fda80006ac0 tx=0x7fda800091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 shutdown_connections 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda900b0810 0x7fda901562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c004d50 0x7fda900aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda74066f30 0x7fda740693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 --2- 172.21.15.86:0/1440248254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda9014e050 0x7fda9014abd0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 >> 172.21.15.86:0/1440248254 conn(0x7fda900cc1f0 msgr2=0x7fda900c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 shutdown_connections 2023-10-09T11:56:25.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.188+0000 7fda9699d700 1 -- 172.21.15.86:0/1440248254 wait complete. 2023-10-09T11:56:25.190 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2023-10-09T11:56:25.206 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:25.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.385+0000 7efdf1f9d700 1 Processor -- start 2023-10-09T11:56:25.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.385+0000 7efdf1f9d700 1 -- start start 2023-10-09T11:56:25.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.386+0000 7efdf1f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdec159420 0x7efdec0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.386+0000 7efdf1f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0b2980 con 0x7efdec15d230 2023-10-09T11:56:25.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.386+0000 7efdf1f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0b11d0 con 0x7efdec1597f0 2023-10-09T11:56:25.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.386+0000 7efdf1f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec0b14b0 con 0x7efdec159420 2023-10-09T11:56:25.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.386+0000 7efdf179c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7efdec15d230 0x7efdec15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36624/0 (socket says 172.21.15.86:36624) 2023-10-09T11:56:25.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.386+0000 7efdf179c700 1 -- 172.21.15.86:0/666167973 learned_addr learned my addr 172.21.15.86:0/666167973 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:25.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.386+0000 7efdf0f9b700 1 --2- 172.21.15.86:0/666167973 >> v2:172.21.15.86:3300/0 conn(0x7efdec159420 0x7efdec0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdeb7fe700 1 -- 172.21.15.86:0/666167973 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015905176 0 0) 0x7efdec0b2980 con 0x7efdec15d230 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdeb7fe700 1 -- 172.21.15.86:0/666167973 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efddc003570 con 0x7efdec15d230 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdf0f9b700 1 -- 172.21.15.86:0/666167973 >> v1:172.21.15.135:6789/0 conn(0x7efdec1597f0 legacy=0x7efdec0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdf0f9b700 1 -- 172.21.15.86:0/666167973 >> v1:172.21.15.86:6789/0 conn(0x7efdec15d230 legacy=0x7efdec15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdf0f9b700 1 -- 172.21.15.86:0/666167973 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0b1790 con 0x7efdec159420 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdf0f9b700 1 --2- 172.21.15.86:0/666167973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec159420 0x7efdec0b5f40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efde0009e60 tx=0x7efde0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddacd5d585a0c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdeb7fe700 1 -- 172.21.15.86:0/666167973 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000e070 con 0x7efdec159420 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdeb7fe700 1 -- 172.21.15.86:0/666167973 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000bb20 con 0x7efdec159420 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.387+0000 7efdeb7fe700 1 -- 172.21.15.86:0/666167973 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0012430 con 0x7efdec159420 2023-10-09T11:56:25.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.388+0000 7efdf1f9d700 1 -- 172.21.15.86:0/666167973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec159420 msgr2=0x7efdec0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.388+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/666167973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec159420 0x7efdec0b5f40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efde0009e60 tx=0x7efde0009780 comp rx=0 tx=0).stop 2023-10-09T11:56:25.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.388+0000 7efdf1f9d700 1 -- 172.21.15.86:0/666167973 shutdown_connections 2023-10-09T11:56:25.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.388+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/666167973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec159420 0x7efdec0b5f40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.388+0000 7efdf1f9d700 1 -- 172.21.15.86:0/666167973 >> 172.21.15.86:0/666167973 conn(0x7efdec0d0660 msgr2=0x7efdec0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:25.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.388+0000 7efdf1f9d700 1 -- 172.21.15.86:0/666167973 shutdown_connections 2023-10-09T11:56:25.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.388+0000 7efdf1f9d700 1 -- 172.21.15.86:0/666167973 wait complete. 2023-10-09T11:56:25.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.390+0000 7efdf1f9d700 1 Processor -- start 2023-10-09T11:56:25.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.390+0000 7efdf1f9d700 1 -- start start 2023-10-09T11:56:25.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf1f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec159420 0x7efdec15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf1f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec1597f0 0x7efdec1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf1f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec15d230 0x7efdec169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf1f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec15b1b0 con 0x7efdec15d230 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf1f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec15bfd0 con 0x7efdec159420 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf1f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec15b3c0 con 0x7efdec1597f0 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec15d230 0x7efdec169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec15d230 0x7efdec169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37580/0 (socket says 172.21.15.86:37580) 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 -- 172.21.15.86:0/2791733397 learned_addr learned my addr 172.21.15.86:0/2791733397 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf0f9b700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec159420 0x7efdec15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdebfff700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec1597f0 0x7efdec1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 -- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec1597f0 msgr2=0x7efdec1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec1597f0 0x7efdec1519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 -- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec159420 msgr2=0x7efdec15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec159420 0x7efdec15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf179c700 1 -- 172.21.15.86:0/2791733397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0009a20 con 0x7efdec15d230 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.391+0000 7efdf0f9b700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec159420 0x7efdec15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.392+0000 7efdf179c700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec15d230 0x7efdec169ef0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efde400c560 tx=0x7efde4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.392+0000 7efde8ff9700 1 -- 172.21.15.86:0/2791733397 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4005c00 con 0x7efdec15d230 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.392+0000 7efde8ff9700 1 -- 172.21.15.86:0/2791733397 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4005d60 con 0x7efdec15d230 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.392+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec15b6a0 con 0x7efdec15d230 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.392+0000 7efde8ff9700 1 -- 172.21.15.86:0/2791733397 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4007300 con 0x7efdec15d230 2023-10-09T11:56:25.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.392+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec15bc60 con 0x7efdec15d230 2023-10-09T11:56:25.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.393+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec15c180 con 0x7efdec15d230 2023-10-09T11:56:25.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.394+0000 7efde8ff9700 1 -- 172.21.15.86:0/2791733397 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efde401b3b0 con 0x7efdec15d230 2023-10-09T11:56:25.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.394+0000 7efde8ff9700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efdd0066f60 0x7efdd0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.395+0000 7efde8ff9700 1 -- 172.21.15.86:0/2791733397 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7efde4083ba0 con 0x7efdec15d230 2023-10-09T11:56:25.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.395+0000 7efdf0f9b700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efdd0066f60 0x7efdd0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.395+0000 7efdf0f9b700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efdd0066f60 0x7efdd0069410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efde00097c0 tx=0x7efde0018000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:25.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.398+0000 7efde8ff9700 1 -- 172.21.15.86:0/2791733397 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdec15c180 con 0x7efdec15d230 2023-10-09T11:56:25.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.591+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdec15c140 con 0x7efdec15d230 2023-10-09T11:56:25.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.592+0000 7efde8ff9700 1 -- 172.21.15.86:0/2791733397 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+15968 (secure 0 0 0) 0x7efde4017020 con 0x7efdec15d230 2023-10-09T11:56:25.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:25.592 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":80,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:22.708787+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:19.281445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:56:20.161616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efdd0066f60 msgr2=0x7efdd0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efdd0066f60 0x7efdd0069410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efde00097c0 tx=0x7efde0018000 comp rx=0 tx=0).stop 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec15d230 msgr2=0x7efdec169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec15d230 0x7efdec169ef0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efde400c560 tx=0x7efde4007d90 comp rx=0 tx=0).stop 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 shutdown_connections 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efdd0066f60 0x7efdd0069410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdec15d230 0x7efdec169ef0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec159420 0x7efdec15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 --2- 172.21.15.86:0/2791733397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec1597f0 0x7efdec1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 >> 172.21.15.86:0/2791733397 conn(0x7efdec0d0660 msgr2=0x7efdec158490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:25.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 shutdown_connections 2023-10-09T11:56:25.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.594+0000 7efdf1f9d700 1 -- 172.21.15.86:0/2791733397 wait complete. 2023-10-09T11:56:25.612 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:56:25.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:56:25.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.795+0000 7fd55afff700 1 Processor -- start 2023-10-09T11:56:25.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.795+0000 7fd55afff700 1 -- start start 2023-10-09T11:56:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.796+0000 7fd55afff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 0x7fd5540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.796+0000 7fd55afff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540cc300 con 0x7fd5540b1420 2023-10-09T11:56:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.796+0000 7fd55afff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540ad370 con 0x7fd5540cbf30 2023-10-09T11:56:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.796+0000 7fd55afff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd554156bf0 con 0x7fd5540ccf90 2023-10-09T11:56:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd553fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd5540b1420 0x7fd5540c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36630/0 (socket says 172.21.15.86:36630) 2023-10-09T11:56:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd553fff700 1 -- 172.21.15.86:0/2104558196 learned_addr learned my addr 172.21.15.86:0/2104558196 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:25.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd55959c700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 0x7fd5540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617198197 0 0) 0x7fd5540cc300 con 0x7fd5540b1420 2023-10-09T11:56:25.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd544003570 con 0x7fd5540b1420 2023-10-09T11:56:25.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273342909 0 0) 0x7fd544003570 con 0x7fd5540b1420 2023-10-09T11:56:25.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 msgr2=0x7fd5540ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:25.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 0x7fd5540ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 >> v1:172.21.15.135:6789/0 conn(0x7fd5540cbf30 legacy=0x7fd5540b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540ad650 con 0x7fd5540b1420 2023-10-09T11:56:25.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fd540001470 con 0x7fd5540b1420 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 >> v1:172.21.15.86:6789/0 conn(0x7fd5540b1420 legacy=0x7fd5540c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 0x7fd544003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004010 0x7fd544004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd544004d50 0x7fd5440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd554156bf0 con 0x7fd544004d50 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54400bbf0 con 0x7fd544004010 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.797+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54400dfc0 con 0x7fd5540ccf90 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd55959c700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd544004d50 0x7fd5440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd553fff700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004010 0x7fd544004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd558d9b700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 0x7fd544003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd55959c700 1 -- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 msgr2=0x7fd544003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:25.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd55959c700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5540ccf90 0x7fd544003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd55959c700 1 -- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004010 msgr2=0x7fd544004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd55959c700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004010 0x7fd544004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd55959c700 1 -- 172.21.15.86:0/2104558196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544003570 con 0x7fd544004d50 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd553fff700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004010 0x7fd544004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd55959c700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd544004d50 0x7fd5440051c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0094d0 tx=0x7fd54c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcdab39b014feb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00ea90 con 0x7fd544004d50 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00f040 con 0x7fd544004d50 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.798+0000 7fd5537fe700 1 -- 172.21.15.86:0/2104558196 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00ee20 con 0x7fd544004d50 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.799+0000 7fd55afff700 1 -- 172.21.15.86:0/2104558196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd544004d50 msgr2=0x7fd5440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.799+0000 7fd55afff700 1 --2- 172.21.15.86:0/2104558196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd544004d50 0x7fd5440051c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0094d0 tx=0x7fd54c00b040 comp rx=0 tx=0).stop 2023-10-09T11:56:25.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.799+0000 7fd55959c700 1 -- 172.21.15.86:0/2104558196 reap_dead start 2023-10-09T11:56:25.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.799+0000 7fd55afff700 1 -- 172.21.15.86:0/2104558196 shutdown_connections 2023-10-09T11:56:25.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.799+0000 7fd55afff700 1 -- 172.21.15.86:0/2104558196 >> 172.21.15.86:0/2104558196 conn(0x7fd55406a320 msgr2=0x7fd5540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:25.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.799+0000 7fd55afff700 1 -- 172.21.15.86:0/2104558196 shutdown_connections 2023-10-09T11:56:25.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.799+0000 7fd55afff700 1 -- 172.21.15.86:0/2104558196 wait complete. 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.800+0000 7fd55afff700 1 Processor -- start 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.801+0000 7fd55afff700 1 -- start start 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.801+0000 7fd55afff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004d50 0x7fd5540a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.801+0000 7fd55afff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5541462e0 0x7fd554147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.801+0000 7fd55afff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd554147ff0 0x7fd5540a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.801+0000 7fd55afff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd554142b40 con 0x7fd5541462e0 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.801+0000 7fd55afff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd554147620 con 0x7fd544004d50 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.801+0000 7fd55afff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd554146750 con 0x7fd554147ff0 2023-10-09T11:56:25.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5541462e0 0x7fd554147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5541462e0 0x7fd554147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37592/0 (socket says 172.21.15.86:37592) 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 -- 172.21.15.86:0/4274617945 learned_addr learned my addr 172.21.15.86:0/4274617945 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd558d9b700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004d50 0x7fd5540a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd55959c700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd554147ff0 0x7fd5540a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 -- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd554147ff0 msgr2=0x7fd5540a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd554147ff0 0x7fd5540a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 -- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004d50 msgr2=0x7fd5540a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004d50 0x7fd5540a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 -- 172.21.15.86:0/4274617945 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554146a10 con 0x7fd5541462e0 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd558d9b700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004d50 0x7fd5540a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:25.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.802+0000 7fd553fff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5541462e0 0x7fd554147ab0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd540000fd0 tx=0x7fd540001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:25.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.803+0000 7fd550ff9700 1 -- 172.21.15.86:0/4274617945 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000a580 con 0x7fd5541462e0 2023-10-09T11:56:25.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.803+0000 7fd550ff9700 1 -- 172.21.15.86:0/4274617945 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540010040 con 0x7fd5541462e0 2023-10-09T11:56:25.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.803+0000 7fd550ff9700 1 -- 172.21.15.86:0/4274617945 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000a930 con 0x7fd5541462e0 2023-10-09T11:56:25.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.803+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd554146cf0 con 0x7fd5541462e0 2023-10-09T11:56:25.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.803+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5541472b0 con 0x7fd5541462e0 2023-10-09T11:56:25.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.804+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55404c3c0 con 0x7fd5541462e0 2023-10-09T11:56:25.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.805+0000 7fd550ff9700 1 -- 172.21.15.86:0/4274617945 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd54000ace0 con 0x7fd5541462e0 2023-10-09T11:56:25.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.806+0000 7fd550ff9700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:25.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.806+0000 7fd550ff9700 1 -- 172.21.15.86:0/4274617945 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fd540083b90 con 0x7fd5541462e0 2023-10-09T11:56:25.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.806+0000 7fd558d9b700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:25.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.807+0000 7fd558d9b700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd548003980 tx=0x7fd548009040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:25.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.810+0000 7fd550ff9700 1 -- 172.21.15.86:0/4274617945 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd54004d5a0 con 0x7fd5541462e0 2023-10-09T11:56:25.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:25.999+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5540ad930 con 0x7fd538066f30 2023-10-09T11:56:26.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.008+0000 7fd550ff9700 1 -- 172.21.15.86:0/4274617945 <== mgr.6027 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278071 (secure 0 0 0) 0x7fd5540ad930 con 0x7fd538066f30 2023-10-09T11:56:26.012 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.012+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 msgr2=0x7fd5380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.012+0000 7fd55afff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd548003980 tx=0x7fd548009040 comp rx=0 tx=0).stop 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.012+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5541462e0 msgr2=0x7fd554147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.012+0000 7fd55afff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5541462e0 0x7fd554147ab0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd540000fd0 tx=0x7fd540001e50 comp rx=0 tx=0).stop 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 shutdown_connections 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd554147ff0 0x7fd5540a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd544004d50 0x7fd5540a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 --2- 172.21.15.86:0/4274617945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5541462e0 0x7fd554147ab0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 >> 172.21.15.86:0/4274617945 conn(0x7fd55406a320 msgr2=0x7fd5540afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:26.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 shutdown_connections 2023-10-09T11:56:26.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.013+0000 7fd55afff700 1 -- 172.21.15.86:0/4274617945 wait complete. 2023-10-09T11:56:26.016 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:56:26.030 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:56:25.663754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2431688,"kb_used_data":8328,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543032,"statfs":{"total":773094113280,"available":770604064768,"internally_reserved":0,"allocated":8527872,"data_stored":4650536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970953"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.702974+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:15.417124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697827+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:11.259489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700894+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:01.890558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700691+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:17.987196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698333+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:55.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700799+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.836460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700711+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:13.847715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698056+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700832+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:53.986519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697237+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:14.186197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.701132+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.066383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698363+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:26.807418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697749+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:37.253490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703854+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700145+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700834+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:11.196572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697213+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:55.038857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.702867+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:20.639767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700114+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700865+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:17.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697204+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:06.635841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704460+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:53.902088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700033+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704393+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:38.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700884+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:22.315760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703884+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700052+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:36.032519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704330+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:39.571433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698067+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:44.924572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704636+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697122+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:03.395168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703903+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":365,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:56:17.120486+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:17.120486+0000","last_peered":"2023-10-09T11:56:17.120486+0000","last_clean":"2023-10-09T11:56:17.120486+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:17.120486+0000","last_undegraded":"2023-10-09T11:56:17.120486+0000","last_fullsized":"2023-10-09T11:56:17.120486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302860,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068980,"statfs":{"total":96636764160,"available":96326635520,"internally_reserved":0,"allocated":1511424,"data_stored":1024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.48099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97199999999999998,"15min":1.0109999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.54500000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.747,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.58599999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.004,"15min":1.202},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.073},"last":0.84499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.94099999999999995},"last":0.64500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.622},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.71799999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97199999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.64800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.71099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.121},"last":0.749},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56799999999999995,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.216},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.59299999999999997,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":1.008,"15min":1.139},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.431},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.59199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.042,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.67600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.66600000000000004},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88300000000000001,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.436,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":1.143},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.437},"max":{"1min":0.96599999999999997,"5min":1.03,"15min":1.506},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.58699999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509625,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.6759999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.497,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":1.385},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":1.099},"last":0.33800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":1.536},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.272},"last":0.438}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.66000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89600000000000002,"5min":1.115,"15min":1.7210000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":1.1220000000000001,"15min":1.552},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.58799999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.677},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.71799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.103,"5min":1.135,"15min":1.778},"last":0.63400000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60999999999999999,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0580000000000001,"5min":1.22,"15min":1.623},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.022,"5min":1.0549999999999999,"15min":1.708},"last":0.621}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.659},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1419999999999999,"5min":1.1619999999999999,"15min":1.736},"last":0.56999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542328,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46899999999999997,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.79000000000000004,"15min":1.367},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.4930000000000001},"last":0.439}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":1.8340000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.80800000000000005,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":1.855},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.755,"5min":0.80000000000000004,"15min":1.2330000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0549999999999999,"5min":1.587,"15min":1.587},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47199999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.099},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60799999999999998,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.004,"5min":1.137,"15min":1.2},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0129999999999999,"5min":1.488,"15min":1.488},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.03,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0609999999999999,"15min":1.24},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81499999999999995,"15min":0.82399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0169999999999999,"5min":1.552,"15min":1.552},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306376,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065464,"statfs":{"total":96636764160,"available":96323035136,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45800000000000002},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.75,"5min":0.755,"15min":0.83799999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.65800000000000003,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.97299999999999998},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":0.76700000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.76800000000000002,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.627},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.61599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.05,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.71199999999999997,"5min":0.57099999999999995,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.216,"15min":1.216},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.026,"5min":1.204,"15min":1.27},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.73399999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.1080000000000001,"5min":1.2310000000000001,"15min":1.246},"last":0.745},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.83799999999999997},"min":{"1min":0.68899999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0720000000000001,"5min":1.155,"15min":1.2130000000000001},"last":0.63600000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509625,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306376,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065464,"statfs":{"total":96636764160,"available":96323035136,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.47699999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.208},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":1.1970000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.63400000000000001,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.41699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.86699999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.208,"15min":1.327},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.1080000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.056,"5min":1.109,"15min":1.2829999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.63200000000000001,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.0509999999999999,"5min":1.125,"15min":1.3660000000000001},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":0.999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1459999999999999,"15min":1.218},"last":0.80100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.46999999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.333},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.3560000000000001},"last":0.73599999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476920,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310472,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061368,"statfs":{"total":96636764160,"available":96318840832,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.50700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.071},"last":0.495},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.621}]},{"osd":1,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.60299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.64300000000000002,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.2909999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.752},"min":{"1min":0.621,"5min":0.52400000000000002,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.995,"15min":1.234},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.432},"max":{"1min":0.88,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.36099999999999999},"max":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.90700000000000003,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":1.125},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.373},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":0.92700000000000005,"15min":1.2410000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46999999999999997},"max":{"1min":0.86199999999999999,"5min":1.0249999999999999,"15min":1.222},"last":0.65300000000000002}]}]},{"osd":5,"up_from":16,"seq":68719476920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86399999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.318},"max":{"1min":0.88900000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.91500000000000004,"15min":1.0840000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.024,"5min":1.909,"15min":1.909},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.71599999999999997},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.70599999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.499},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.56699999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":2.105,"15min":2.105},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.02,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.751}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0489999999999999,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.44,"15min":0.39900000000000002},"max":{"1min":0.95999999999999996,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:56:26.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:56:26.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.251+0000 7fc848b9d700 1 Processor -- start 2023-10-09T11:56:26.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.251+0000 7fc848b9d700 1 -- start start 2023-10-09T11:56:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc848b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8440b02a0 0x7fc84415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc848b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84406ae70 con 0x7fc84406a0a0 2023-10-09T11:56:26.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc848b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440c8a60 con 0x7fc84406d950 2023-10-09T11:56:26.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc848b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84406a540 con 0x7fc8440b02a0 2023-10-09T11:56:26.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc843fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8440b02a0 0x7fc84415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc842ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc84406a0a0 0x7fc84415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36642/0 (socket says 172.21.15.86:36642) 2023-10-09T11:56:26.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc842ffd700 1 -- 172.21.15.86:0/2992458439 learned_addr learned my addr 172.21.15.86:0/2992458439 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:26.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc843fff700 1 -- 172.21.15.86:0/2992458439 >> v1:172.21.15.135:6789/0 conn(0x7fc84406d950 legacy=0x7fc8440c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:26.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc843fff700 1 -- 172.21.15.86:0/2992458439 >> v1:172.21.15.86:6789/0 conn(0x7fc84406a0a0 legacy=0x7fc84415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.253+0000 7fc843fff700 1 -- 172.21.15.86:0/2992458439 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84406a820 con 0x7fc8440b02a0 2023-10-09T11:56:26.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.254+0000 7fc843fff700 1 --2- 172.21.15.86:0/2992458439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc84415bb20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009e60 tx=0x7fc83c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2323a276646fff73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:26.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.254+0000 7fc8427fc700 1 -- 172.21.15.86:0/2992458439 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00e070 con 0x7fc8440b02a0 2023-10-09T11:56:26.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.254+0000 7fc8427fc700 1 -- 172.21.15.86:0/2992458439 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c00bbf0 con 0x7fc8440b02a0 2023-10-09T11:56:26.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.254+0000 7fc8427fc700 1 -- 172.21.15.86:0/2992458439 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c012430 con 0x7fc8440b02a0 2023-10-09T11:56:26.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.254+0000 7fc848b9d700 1 -- 172.21.15.86:0/2992458439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 msgr2=0x7fc84415bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.254+0000 7fc848b9d700 1 --2- 172.21.15.86:0/2992458439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc84415bb20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009e60 tx=0x7fc83c009780 comp rx=0 tx=0).stop 2023-10-09T11:56:26.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.255+0000 7fc848b9d700 1 -- 172.21.15.86:0/2992458439 shutdown_connections 2023-10-09T11:56:26.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.255+0000 7fc848b9d700 1 --2- 172.21.15.86:0/2992458439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc84415bb20 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.255+0000 7fc848b9d700 1 -- 172.21.15.86:0/2992458439 >> 172.21.15.86:0/2992458439 conn(0x7fc8440cc1f0 msgr2=0x7fc8440cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:26.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.255+0000 7fc848b9d700 1 -- 172.21.15.86:0/2992458439 shutdown_connections 2023-10-09T11:56:26.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.255+0000 7fc848b9d700 1 -- 172.21.15.86:0/2992458439 wait complete. 2023-10-09T11:56:26.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.256+0000 7fc848b9d700 1 Processor -- start 2023-10-09T11:56:26.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.256+0000 7fc848b9d700 1 -- start start 2023-10-09T11:56:26.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc848b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84406a0a0 0x7fc844150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc848b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc84406d950 0x7fc84415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc848b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc8440c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc848b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c4510 con 0x7fc8440b02a0 2023-10-09T11:56:26.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc848b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844151190 con 0x7fc84406a0a0 2023-10-09T11:56:26.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc848b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc844150eb0 con 0x7fc84406d950 2023-10-09T11:56:26.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc843fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc8440c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc843fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc8440c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37610/0 (socket says 172.21.15.86:37610) 2023-10-09T11:56:26.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.257+0000 7fc843fff700 1 -- 172.21.15.86:0/1335222337 learned_addr learned my addr 172.21.15.86:0/1335222337 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:26.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc843fff700 1 -- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc84406d950 msgr2=0x7fc84415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc842ffd700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc84406d950 0x7fc84415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc8437fe700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84406a0a0 0x7fc844150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc843fff700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc84406d950 0x7fc84415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc843fff700 1 -- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84406a0a0 msgr2=0x7fc844150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc843fff700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84406a0a0 0x7fc844150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc843fff700 1 -- 172.21.15.86:0/1335222337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c009a20 con 0x7fc8440b02a0 2023-10-09T11:56:26.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc842ffd700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc84406d950 0x7fc84415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:26.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc8437fe700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84406a0a0 0x7fc844150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:26.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc843fff700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc8440c49a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc84406fe40 tx=0x7fc83c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:26.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc82b7fe700 1 -- 172.21.15.86:0/1335222337 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c01e640 con 0x7fc8440b02a0 2023-10-09T11:56:26.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc82b7fe700 1 -- 172.21.15.86:0/1335222337 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c01e7a0 con 0x7fc8440b02a0 2023-10-09T11:56:26.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc82b7fe700 1 -- 172.21.15.86:0/1335222337 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c01eb60 con 0x7fc8440b02a0 2023-10-09T11:56:26.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440c3ec0 con 0x7fc8440b02a0 2023-10-09T11:56:26.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.258+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc844150bc0 con 0x7fc8440b02a0 2023-10-09T11:56:26.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.259+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8440c3d20 con 0x7fc8440b02a0 2023-10-09T11:56:26.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.260+0000 7fc82b7fe700 1 -- 172.21.15.86:0/1335222337 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc83c024070 con 0x7fc8440b02a0 2023-10-09T11:56:26.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.261+0000 7fc82b7fe700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.261+0000 7fc82b7fe700 1 -- 172.21.15.86:0/1335222337 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc83c087290 con 0x7fc8440b02a0 2023-10-09T11:56:26.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.261+0000 7fc8437fe700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.262+0000 7fc8437fe700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc830066f30 0x7fc8300693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc834002880 tx=0x7fc834009040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:26.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.265+0000 7fc82b7fe700 1 -- 172.21.15.86:0/1335222337 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8440c3d20 con 0x7fc8440b02a0 2023-10-09T11:56:26.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.453+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8440c3d20 con 0x7fc830066f30 2023-10-09T11:56:26.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.461+0000 7fc82b7fe700 1 -- 172.21.15.86:0/1335222337 <== mgr.6027 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278071 (secure 0 0 0) 0x7fc8440c3d20 con 0x7fc830066f30 2023-10-09T11:56:26.465 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:26.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.464+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc830066f30 msgr2=0x7fc8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.464+0000 7fc848b9d700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc830066f30 0x7fc8300693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc834002880 tx=0x7fc834009040 comp rx=0 tx=0).stop 2023-10-09T11:56:26.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.464+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 msgr2=0x7fc8440c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.464+0000 7fc848b9d700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc8440c49a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc84406fe40 tx=0x7fc83c018000 comp rx=0 tx=0).stop 2023-10-09T11:56:26.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 shutdown_connections 2023-10-09T11:56:26.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8440b02a0 0x7fc8440c49a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84406a0a0 0x7fc844150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 --2- 172.21.15.86:0/1335222337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc84406d950 0x7fc84415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 >> 172.21.15.86:0/1335222337 conn(0x7fc8440cc1f0 msgr2=0x7fc84415b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:26.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 shutdown_connections 2023-10-09T11:56:26.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.465+0000 7fc848b9d700 1 -- 172.21.15.86:0/1335222337 wait complete. 2023-10-09T11:56:26.470 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:56:26.482 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:56:25.663754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2431688,"kb_used_data":8328,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543032,"statfs":{"total":773094113280,"available":770604064768,"internally_reserved":0,"allocated":8527872,"data_stored":4650536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970953"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.702974+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:15.417124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697827+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:11.259489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700894+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:01.890558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700691+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:17.987196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698333+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:55.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700799+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.836460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700711+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:13.847715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698056+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700832+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:53.986519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697237+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:14.186197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.701132+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.066383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698363+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:26.807418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697749+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:37.253490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703854+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700145+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700834+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:11.196572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697213+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:55.038857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.702867+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:20.639767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700114+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700865+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:17.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697204+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:06.635841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704460+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:53.902088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700033+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704393+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:38.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700884+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:22.315760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703884+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700052+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:36.032519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704330+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:39.571433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698067+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:44.924572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704636+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697122+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:03.395168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703903+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":365,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:56:17.120486+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:17.120486+0000","last_peered":"2023-10-09T11:56:17.120486+0000","last_clean":"2023-10-09T11:56:17.120486+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:17.120486+0000","last_undegraded":"2023-10-09T11:56:17.120486+0000","last_fullsized":"2023-10-09T11:56:17.120486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302860,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068980,"statfs":{"total":96636764160,"available":96326635520,"internally_reserved":0,"allocated":1511424,"data_stored":1024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.48099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97199999999999998,"15min":1.0109999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.54500000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.747,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.58599999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.004,"15min":1.202},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.073},"last":0.84499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.94099999999999995},"last":0.64500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.622},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.71799999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97199999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.64800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.71099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.121},"last":0.749},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56799999999999995,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.216},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.59299999999999997,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":1.008,"15min":1.139},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.431},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.59199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.042,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.67600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.66600000000000004},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88300000000000001,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.436,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":1.143},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.437},"max":{"1min":0.96599999999999997,"5min":1.03,"15min":1.506},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.58699999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509625,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.6759999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.497,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":1.385},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":1.099},"last":0.33800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":1.536},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.272},"last":0.438}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.66000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89600000000000002,"5min":1.115,"15min":1.7210000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":1.1220000000000001,"15min":1.552},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.58799999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.677},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.71799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.103,"5min":1.135,"15min":1.778},"last":0.63400000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60999999999999999,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0580000000000001,"5min":1.22,"15min":1.623},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.022,"5min":1.0549999999999999,"15min":1.708},"last":0.621}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.659},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1419999999999999,"5min":1.1619999999999999,"15min":1.736},"last":0.56999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542328,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46899999999999997,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.79000000000000004,"15min":1.367},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.4930000000000001},"last":0.439}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":1.8340000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.80800000000000005,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":1.855},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.755,"5min":0.80000000000000004,"15min":1.2330000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0549999999999999,"5min":1.587,"15min":1.587},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47199999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.099},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60799999999999998,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.004,"5min":1.137,"15min":1.2},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0129999999999999,"5min":1.488,"15min":1.488},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.03,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0609999999999999,"15min":1.24},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81499999999999995,"15min":0.82399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0169999999999999,"5min":1.552,"15min":1.552},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306376,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065464,"statfs":{"total":96636764160,"available":96323035136,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45800000000000002},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.75,"5min":0.755,"15min":0.83799999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.65800000000000003,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.97299999999999998},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":0.76700000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.76800000000000002,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.627},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.61599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.05,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.71199999999999997,"5min":0.57099999999999995,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.216,"15min":1.216},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.026,"5min":1.204,"15min":1.27},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.73399999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.1080000000000001,"5min":1.2310000000000001,"15min":1.246},"last":0.745},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.83799999999999997},"min":{"1min":0.68899999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0720000000000001,"5min":1.155,"15min":1.2130000000000001},"last":0.63600000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509625,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306376,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065464,"statfs":{"total":96636764160,"available":96323035136,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.47699999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.208},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":1.1970000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.63400000000000001,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.41699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.86699999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.208,"15min":1.327},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.1080000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.056,"5min":1.109,"15min":1.2829999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.63200000000000001,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.0509999999999999,"5min":1.125,"15min":1.3660000000000001},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":0.999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1459999999999999,"15min":1.218},"last":0.80100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.46999999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.333},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.3560000000000001},"last":0.73599999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476920,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310472,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061368,"statfs":{"total":96636764160,"available":96318840832,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.50700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.071},"last":0.495},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.621}]},{"osd":1,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.60299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.64300000000000002,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.2909999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.752},"min":{"1min":0.621,"5min":0.52400000000000002,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.995,"15min":1.234},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.432},"max":{"1min":0.88,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.36099999999999999},"max":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.90700000000000003,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":1.125},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.373},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":0.92700000000000005,"15min":1.2410000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46999999999999997},"max":{"1min":0.86199999999999999,"5min":1.0249999999999999,"15min":1.222},"last":0.65300000000000002}]}]},{"osd":5,"up_from":16,"seq":68719476920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86399999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.318},"max":{"1min":0.88900000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.91500000000000004,"15min":1.0840000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.024,"5min":1.909,"15min":1.909},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.71599999999999997},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.70599999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.499},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.56699999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":2.105,"15min":2.105},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.02,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.751}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0489999999999999,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.44,"15min":0.39900000000000002},"max":{"1min":0.95999999999999996,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:56:26.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:56:26.690 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-10-09T11:56:26.689+0000 7f04c63f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:56:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.702+0000 7fec3e5ff700 1 Processor -- start 2023-10-09T11:56:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.702+0000 7fec3e5ff700 1 -- start start 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.703+0000 7fec3e5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380cbf30 0x7fec380ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.703+0000 7fec3e5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec380ccf90 0x7fec380b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.703+0000 7fec3e5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380cc300 con 0x7fec3815a270 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.703+0000 7fec3e5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec38156bf0 con 0x7fec380ccf90 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.703+0000 7fec3e5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380ae950 con 0x7fec380cbf30 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec380ccf90 0x7fec380b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec380ccf90 0x7fec380b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37620/0 (socket says 172.21.15.86:37620) 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 -- 172.21.15.86:0/2737815809 learned_addr learned my addr 172.21.15.86:0/2737815809 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec37fff700 1 --2- 172.21.15.86:0/2737815809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380cbf30 0x7fec380ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 -- 172.21.15.86:0/2737815809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380cbf30 msgr2=0x7fec380ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 --2- 172.21.15.86:0/2737815809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380cbf30 0x7fec380ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 -- 172.21.15.86:0/2737815809 >> v1:172.21.15.135:6789/0 conn(0x7fec3815a270 legacy=0x7fec380c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 -- 172.21.15.86:0/2737815809 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380ad370 con 0x7fec380ccf90 2023-10-09T11:56:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec37fff700 1 --2- 172.21.15.86:0/2737815809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380cbf30 0x7fec380ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec377fe700 1 --2- 172.21.15.86:0/2737815809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec380ccf90 0x7fec380b0d10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0099e0 tx=0x7fec2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712be1e22b49794 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:26.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.704+0000 7fec36ffd700 1 -- 172.21.15.86:0/2737815809 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00b820 con 0x7fec380ccf90 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec36ffd700 1 -- 172.21.15.86:0/2737815809 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c00b980 con 0x7fec380ccf90 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec36ffd700 1 -- 172.21.15.86:0/2737815809 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00bd20 con 0x7fec380ccf90 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2737815809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec380ccf90 msgr2=0x7fec380b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2737815809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec380ccf90 0x7fec380b0d10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0099e0 tx=0x7fec2c009250 comp rx=0 tx=0).stop 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2737815809 shutdown_connections 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2737815809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380cbf30 0x7fec380ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2737815809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec380ccf90 0x7fec380b0d10 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2737815809 >> 172.21.15.86:0/2737815809 conn(0x7fec3806a320 msgr2=0x7fec380cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2737815809 shutdown_connections 2023-10-09T11:56:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.705+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2737815809 wait complete. 2023-10-09T11:56:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.707+0000 7fec3e5ff700 1 Processor -- start 2023-10-09T11:56:26.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.707+0000 7fec3e5ff700 1 -- start start 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3e5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec380cbf30 0x7fec380c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3e5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380ccf90 0x7fec380c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3e5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec3815a270 0x7fec380c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3e5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c2710 con 0x7fec3815a270 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3e5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec38154850 con 0x7fec380cbf30 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3e5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c1b00 con 0x7fec380ccf90 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec3815a270 0x7fec380c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec3815a270 0x7fec380c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37628/0 (socket says 172.21.15.86:37628) 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 -- 172.21.15.86:0/2389686702 learned_addr learned my addr 172.21.15.86:0/2389686702 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:26.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec37fff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec380cbf30 0x7fec380c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec377fe700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380ccf90 0x7fec380c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 -- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380ccf90 msgr2=0x7fec380c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380ccf90 0x7fec380c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 -- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec380cbf30 msgr2=0x7fec380c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec380cbf30 0x7fec380c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec3cb9c700 1 -- 172.21.15.86:0/2389686702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0094f0 con 0x7fec3815a270 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec37fff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec380cbf30 0x7fec380c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.708+0000 7fec377fe700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380ccf90 0x7fec380c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.709+0000 7fec3cb9c700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec3815a270 0x7fec380c30e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fec3000c840 tx=0x7fec30001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:26.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.709+0000 7fec1ffff700 1 -- 172.21.15.86:0/2389686702 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec30012630 con 0x7fec3815a270 2023-10-09T11:56:26.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.709+0000 7fec1ffff700 1 -- 172.21.15.86:0/2389686702 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec300127b0 con 0x7fec3815a270 2023-10-09T11:56:26.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.709+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec380c1de0 con 0x7fec3815a270 2023-10-09T11:56:26.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.709+0000 7fec1ffff700 1 -- 172.21.15.86:0/2389686702 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec30012b70 con 0x7fec3815a270 2023-10-09T11:56:26.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.709+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec380c23a0 con 0x7fec3815a270 2023-10-09T11:56:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.710+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380c2880 con 0x7fec3815a270 2023-10-09T11:56:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.711+0000 7fec1ffff700 1 -- 172.21.15.86:0/2389686702 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec30003030 con 0x7fec3815a270 2023-10-09T11:56:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.712+0000 7fec1ffff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fec24066f30 0x7fec240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.712+0000 7fec1ffff700 1 -- 172.21.15.86:0/2389686702 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fec30084710 con 0x7fec3815a270 2023-10-09T11:56:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.712+0000 7fec37fff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fec24066f30 0x7fec240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:26.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.712+0000 7fec37fff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fec24066f30 0x7fec240693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec28006f00 tx=0x7fec28008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:26.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.716+0000 7fec1ffff700 1 -- 172.21.15.86:0/2389686702 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec30051760 con 0x7fec3815a270 2023-10-09T11:56:26.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.904+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec3804c3c0 con 0x7fec24066f30 2023-10-09T11:56:26.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.912+0000 7fec1ffff700 1 -- 172.21.15.86:0/2389686702 <== mgr.6027 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278071 (secure 0 0 0) 0x7fec3804c3c0 con 0x7fec24066f30 2023-10-09T11:56:26.916 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:26.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.916+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fec24066f30 msgr2=0x7fec240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.916+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fec24066f30 0x7fec240693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec28006f00 tx=0x7fec28008040 comp rx=0 tx=0).stop 2023-10-09T11:56:26.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.916+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec3815a270 msgr2=0x7fec380c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.916+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec3815a270 0x7fec380c30e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fec3000c840 tx=0x7fec30001670 comp rx=0 tx=0).stop 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 shutdown_connections 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fec24066f30 0x7fec240693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec3815a270 0x7fec380c30e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec380cbf30 0x7fec380c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 --2- 172.21.15.86:0/2389686702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec380ccf90 0x7fec380c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 >> 172.21.15.86:0/2389686702 conn(0x7fec3806a320 msgr2=0x7fec380c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 shutdown_connections 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:26.917+0000 7fec3e5ff700 1 -- 172.21.15.86:0/2389686702 wait complete. 2023-10-09T11:56:26.919 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:56:26.935 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:56:25.663754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2431688,"kb_used_data":8328,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543032,"statfs":{"total":773094113280,"available":770604064768,"internally_reserved":0,"allocated":8527872,"data_stored":4650536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970953"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.702974+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:15.417124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697827+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:11.259489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700894+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:01.890558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700691+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:17.987196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698333+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:55.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700799+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.836460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700711+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:13.847715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698056+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700832+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:53.986519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697237+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:14.186197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.701132+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.066383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698363+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:26.807418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697749+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:37.253490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703854+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700145+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700834+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:11.196572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697213+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:55.038857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.702867+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:20.639767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700114+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700865+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:17.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697204+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:06.635841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704460+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:53.902088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700033+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704393+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:38.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700884+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:22.315760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703884+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.700052+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:36.032519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704330+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:39.571433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.698067+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:44.924572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.704636+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.697122+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:03.395168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:56:20.691957+0000","last_change":"2023-10-09T11:56:20.691957+0000","last_active":"2023-10-09T11:56:20.691957+0000","last_peered":"2023-10-09T11:56:20.691957+0000","last_clean":"2023-10-09T11:56:20.691957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:20.691957+0000","last_undegraded":"2023-10-09T11:56:20.691957+0000","last_fullsized":"2023-10-09T11:56:20.691957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:19.686445+0000","last_change":"2023-10-09T11:56:19.703903+0000","last_active":"2023-10-09T11:56:19.686445+0000","last_peered":"2023-10-09T11:56:19.686445+0000","last_clean":"2023-10-09T11:56:19.686445+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:19.686445+0000","last_undegraded":"2023-10-09T11:56:19.686445+0000","last_fullsized":"2023-10-09T11:56:19.686445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":365,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T11:56:17.120486+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:17.120486+0000","last_peered":"2023-10-09T11:56:17.120486+0000","last_clean":"2023-10-09T11:56:17.120486+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:17.120486+0000","last_undegraded":"2023-10-09T11:56:17.120486+0000","last_fullsized":"2023-10-09T11:56:17.120486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302860,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068980,"statfs":{"total":96636764160,"available":96326635520,"internally_reserved":0,"allocated":1511424,"data_stored":1024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.48099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97199999999999998,"15min":1.0109999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.54500000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.747,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.58599999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.004,"15min":1.202},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.073},"last":0.84499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.94099999999999995},"last":0.64500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.622},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.71799999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97199999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.64800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.71099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.121},"last":0.749},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56799999999999995,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.216},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.59299999999999997,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":1.008,"15min":1.139},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.431},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.59199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.042,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.67600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.66600000000000004},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88300000000000001,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.436,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":1.143},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.437},"max":{"1min":0.96599999999999997,"5min":1.03,"15min":1.506},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.58699999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509625,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.6759999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.497,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":1.385},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":1.099},"last":0.33800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":1.536},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.272},"last":0.438}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.66000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89600000000000002,"5min":1.115,"15min":1.7210000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":1.1220000000000001,"15min":1.552},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.58799999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.677},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.71799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.103,"5min":1.135,"15min":1.778},"last":0.63400000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60999999999999999,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0580000000000001,"5min":1.22,"15min":1.623},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.022,"5min":1.0549999999999999,"15min":1.708},"last":0.621}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.659},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1419999999999999,"5min":1.1619999999999999,"15min":1.736},"last":0.56999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542328,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1024093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46899999999999997,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.79000000000000004,"15min":1.367},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.4930000000000001},"last":0.439}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":1.8340000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.80800000000000005,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":1.855},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.755,"5min":0.80000000000000004,"15min":1.2330000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0549999999999999,"5min":1.587,"15min":1.587},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47199999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.099},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60799999999999998,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.004,"5min":1.137,"15min":1.2},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0129999999999999,"5min":1.488,"15min":1.488},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.03,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0609999999999999,"15min":1.24},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81499999999999995,"15min":0.82399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0169999999999999,"5min":1.552,"15min":1.552},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306376,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065464,"statfs":{"total":96636764160,"available":96323035136,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45800000000000002},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.75,"5min":0.755,"15min":0.83799999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.65800000000000003,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.97299999999999998},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":0.76700000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.76800000000000002,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.627},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.61599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.05,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.71199999999999997,"5min":0.57099999999999995,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.216,"15min":1.216},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.026,"5min":1.204,"15min":1.27},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.73399999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.1080000000000001,"5min":1.2310000000000001,"15min":1.246},"last":0.745},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.83799999999999997},"min":{"1min":0.68899999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0720000000000001,"5min":1.155,"15min":1.2130000000000001},"last":0.63600000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509625,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306376,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065464,"statfs":{"total":96636764160,"available":96323035136,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.47699999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.208},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":1.1970000000000001},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.63400000000000001,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.41699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.86699999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.208,"15min":1.327},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.1080000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.056,"5min":1.109,"15min":1.2829999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.63200000000000001,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.0509999999999999,"5min":1.125,"15min":1.3660000000000001},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":0.999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1459999999999999,"15min":1.218},"last":0.80100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.46999999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.333},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.3560000000000001},"last":0.73599999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476920,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310472,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061368,"statfs":{"total":96636764160,"available":96318840832,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.50700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.071},"last":0.495},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.621}]},{"osd":1,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.60299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.64300000000000002,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.2909999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.752},"min":{"1min":0.621,"5min":0.52400000000000002,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.995,"15min":1.234},"last":0.58599999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.432},"max":{"1min":0.88,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.36099999999999999},"max":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.90700000000000003,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":1.125},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.373},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":0.92700000000000005,"15min":1.2410000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46999999999999997},"max":{"1min":0.86199999999999999,"5min":1.0249999999999999,"15min":1.222},"last":0.65300000000000002}]}]},{"osd":5,"up_from":16,"seq":68719476920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":917504,"data_stored":433725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86399999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.318},"max":{"1min":0.88900000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.91500000000000004,"15min":1.0840000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.024,"5min":1.909,"15min":1.909},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.71599999999999997},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.70599999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.499},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.56699999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":2.105,"15min":2.105},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.02,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.751}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0489999999999999,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.44,"15min":0.39900000000000002},"max":{"1min":0.95999999999999996,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:56:26.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-09T11:56:26.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-09T11:56:26.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-09T11:56:26.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-09T11:56:26.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-09T11:56:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-09T11:56:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.702974+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:28:15.417124+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.697827+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:22:11.259489+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-10-09T11:56:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700894+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:28:01.890558+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700691+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:08:17.987196+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-09T11:56:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.698333+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:53:55.468724+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700799+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:57:11.836460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700711+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:36:13.847715+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:56:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.698056+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700832+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:19:53.986519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-09T11:56:26.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.697237+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:59:14.186197+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.701132+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:28:54.066383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.698363+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:48:26.807418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.697749+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:25:37.253490+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-09T11:56:26.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.703854+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700145+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700834+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:13:11.196572+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:56:26.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.697213+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:59:55.038857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.702867+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:47:20.639767+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-09T11:56:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700114+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:32:06.824333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700865+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:04:17.480395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-09T11:56:26.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.697204+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:14:06.635841+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.704460+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:43:53.902088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-09T11:56:26.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700033+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.704393+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:32:38.370238+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-10-09T11:56:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700884+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:50:22.315760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.703884+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:12:39.408919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.700052+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:44:36.032519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-09T11:56:26.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.704330+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:58:39.571433+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.698067+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:33:44.924572+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-09T11:56:26.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.704636+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:52:48.577786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.697122+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:11:03.395168+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:56:20.691957+0000', 'last_change': '2023-10-09T11:56:20.691957+0000', 'last_active': '2023-10-09T11:56:20.691957+0000', 'last_peered': '2023-10-09T11:56:20.691957+0000', 'last_clean': '2023-10-09T11:56:20.691957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:20.691957+0000', 'last_undegraded': '2023-10-09T11:56:20.691957+0000', 'last_fullsized': '2023-10-09T11:56:20.691957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:20.691957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-09T11:56:26.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:19.686445+0000', 'last_change': '2023-10-09T11:56:19.703903+0000', 'last_active': '2023-10-09T11:56:19.686445+0000', 'last_peered': '2023-10-09T11:56:19.686445+0000', 'last_clean': '2023-10-09T11:56:19.686445+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:19.686445+0000', 'last_undegraded': '2023-10-09T11:56:19.686445+0000', 'last_fullsized': '2023-10-09T11:56:19.686445+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:19.686445+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:19:45.321401+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:56:26.962 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:56:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.154+0000 7f299e9ff700 1 Processor -- start 2023-10-09T11:56:27.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.154+0000 7f299e9ff700 1 -- start start 2023-10-09T11:56:27.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.155+0000 7f299e9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2998156510 0x7f29980ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.155+0000 7f299e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29980acd40 0x7f29981568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.155+0000 7f299e9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2998153f10 con 0x7f2998156e20 2023-10-09T11:56:27.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.155+0000 7f299e9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980ad9d0 con 0x7f2998156510 2023-10-09T11:56:27.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.156+0000 7f299e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980aed00 con 0x7f29980acd40 2023-10-09T11:56:27.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.156+0000 7f29977fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29980acd40 0x7f29981568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.156+0000 7f2997fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2998156510 0x7f29980ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.156+0000 7f29977fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29980acd40 0x7f29981568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:54490/0 (socket says 172.21.15.86:54490) 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.156+0000 7f2997fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2998156510 0x7f29980ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:38624/0 (socket says 172.21.15.86:38624) 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.156+0000 7f29977fe700 1 -- 172.21.15.86:0/58975707 learned_addr learned my addr 172.21.15.86:0/58975707 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2997fff700 1 -- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29980acd40 msgr2=0x7f29981568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2997fff700 1 --2- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29980acd40 0x7f29981568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2997fff700 1 -- 172.21.15.86:0/58975707 >> v1:172.21.15.135:6789/0 conn(0x7f2998156e20 legacy=0x7f29980afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2997fff700 1 -- 172.21.15.86:0/58975707 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980af800 con 0x7f2998156510 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f29977fe700 1 --2- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29980acd40 0x7f29981568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2997fff700 1 --2- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998156510 0x7f29980ac800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f298800bb90 tx=0x7f298800b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0bf30368cf32974 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2996ffd700 1 -- 172.21.15.86:0/58975707 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800db40 con 0x7f2998156510 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2996ffd700 1 -- 172.21.15.86:0/58975707 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800dca0 con 0x7f2998156510 2023-10-09T11:56:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.157+0000 7f2996ffd700 1 -- 172.21.15.86:0/58975707 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880196b0 con 0x7f2998156510 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 -- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998156510 msgr2=0x7f29980ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 --2- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998156510 0x7f29980ac800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f298800bb90 tx=0x7f298800b430 comp rx=0 tx=0).stop 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 -- 172.21.15.86:0/58975707 shutdown_connections 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 --2- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998156510 0x7f29980ac800 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 --2- 172.21.15.86:0/58975707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29980acd40 0x7f29981568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 -- 172.21.15.86:0/58975707 >> 172.21.15.86:0/58975707 conn(0x7f299806a310 msgr2=0x7f29980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 -- 172.21.15.86:0/58975707 shutdown_connections 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.158+0000 7f299e9ff700 1 -- 172.21.15.86:0/58975707 wait complete. 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.159+0000 7f299e9ff700 1 Processor -- start 2023-10-09T11:56:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.160+0000 7f299e9ff700 1 -- start start 2023-10-09T11:56:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.160+0000 7f299e9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29980acd40 0x7f29980c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f299e9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2998156510 0x7f29981514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f299e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2998156e20 0x7f29980c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f299e9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980c93f0 con 0x7f2998156510 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f299e9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980aaa80 con 0x7f29980acd40 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f299e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2998151a10 con 0x7f2998156e20 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2998156510 0x7f29981514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2998156510 0x7f29981514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37630/0 (socket says 172.21.15.86:37630) 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 -- 172.21.15.86:0/572402508 learned_addr learned my addr 172.21.15.86:0/572402508 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f2997fff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29980acd40 0x7f29980c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f299cf9c700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2998156e20 0x7f29980c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 -- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2998156e20 msgr2=0x7f29980c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2998156e20 0x7f29980c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 -- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29980acd40 msgr2=0x7f29980c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29980acd40 0x7f29980c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 -- 172.21.15.86:0/572402508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0094f0 con 0x7f2998156510 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.161+0000 7f29977fe700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2998156510 0x7f29981514d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f298c00ec80 tx=0x7f298c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.162+0000 7f297ffff700 1 -- 172.21.15.86:0/572402508 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00c920 con 0x7f2998156510 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.162+0000 7f297ffff700 1 -- 172.21.15.86:0/572402508 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00ca80 con 0x7f2998156510 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.162+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298800b6d0 con 0x7f2998156510 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.162+0000 7f297ffff700 1 -- 172.21.15.86:0/572402508 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00ce00 con 0x7f2998156510 2023-10-09T11:56:27.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.162+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29980aa150 con 0x7f2998156510 2023-10-09T11:56:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.163+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29980aac30 con 0x7f2998156510 2023-10-09T11:56:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.164+0000 7f297ffff700 1 -- 172.21.15.86:0/572402508 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f298c013680 con 0x7f2998156510 2023-10-09T11:56:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.165+0000 7f297ffff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2984066f30 0x7f29840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.165+0000 7f297ffff700 1 -- 172.21.15.86:0/572402508 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f298c084a70 con 0x7f2998156510 2023-10-09T11:56:27.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.165+0000 7f2997fff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2984066f30 0x7f29840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.165+0000 7f2997fff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2984066f30 0x7f29840693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f298800bfd0 tx=0x7f298801b000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:27.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.169+0000 7f297ffff700 1 -- 172.21.15.86:0/572402508 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29980aac30 con 0x7f2998156510 2023-10-09T11:56:27.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.436+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f29980aac30 con 0x7f2998156510 2023-10-09T11:56:27.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.436+0000 7f297ffff700 1 -- 172.21.15.86:0/572402508 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1111 (secure 0 0 0) 0x7f29980aac30 con 0x7f2998156510 2023-10-09T11:56:27.437 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:27.437 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":940,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":80,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2490048512,"bytes_avail":770604064768,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6225}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-09T11:55:28.374067+0000","services":{}},"progress_events":{}} 2023-10-09T11:56:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2984066f30 msgr2=0x7f29840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2984066f30 0x7f29840693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f298800bfd0 tx=0x7f298801b000 comp rx=0 tx=0).stop 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2998156510 msgr2=0x7f29981514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2998156510 0x7f29981514d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f298c00ec80 tx=0x7f298c009250 comp rx=0 tx=0).stop 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 shutdown_connections 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2998156e20 0x7f29980c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29980acd40 0x7f29980c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2984066f30 0x7f29840693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 --2- 172.21.15.86:0/572402508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2998156510 0x7f29981514d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 >> 172.21.15.86:0/572402508 conn(0x7f299806a310 msgr2=0x7f29980afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 shutdown_connections 2023-10-09T11:56:27.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.439+0000 7f299e9ff700 1 -- 172.21.15.86:0/572402508 wait complete. 2023-10-09T11:56:27.457 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:56:27.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:56:27.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.636+0000 7f778b3ff700 1 Processor -- start 2023-10-09T11:56:27.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.636+0000 7f778b3ff700 1 -- start start 2023-10-09T11:56:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.637+0000 7f778b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77841578b0 0x7f7784155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.637+0000 7f778b3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77840af2f0 0x7f77840af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.637+0000 7f778b3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840ad930 con 0x7f7784155c10 2023-10-09T11:56:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.637+0000 7f778b3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77840b0c60 con 0x7f77840af2f0 2023-10-09T11:56:27.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.637+0000 7f778b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77840acd20 con 0x7f77841578b0 2023-10-09T11:56:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778899a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77841578b0 0x7f7784155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778999c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77840af2f0 0x7f77840af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778999c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77840af2f0 0x7f77840af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:38636/0 (socket says 172.21.15.86:38636) 2023-10-09T11:56:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778899a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77841578b0 0x7f7784155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:54514/0 (socket says 172.21.15.86:54514) 2023-10-09T11:56:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778999c700 1 -- 172.21.15.86:0/3409524301 learned_addr learned my addr 172.21.15.86:0/3409524301 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778999c700 1 -- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77841578b0 msgr2=0x7f7784155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:27.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778999c700 1 --2- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77841578b0 0x7f7784155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778999c700 1 -- 172.21.15.86:0/3409524301 >> v1:172.21.15.135:6789/0 conn(0x7f7784155c10 legacy=0x7f77840ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778999c700 1 -- 172.21.15.86:0/3409524301 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840ad000 con 0x7f77840af2f0 2023-10-09T11:56:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f778899a700 1 --2- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77841578b0 0x7f7784155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.638+0000 7f777bfff700 1 -- 172.21.15.86:0/3409524301 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814641524 0 0) 0x7f77840ad930 con 0x7f7784155c10 2023-10-09T11:56:27.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.639+0000 7f778999c700 1 --2- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77840af2f0 0x7f77840af710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f777c00c0d0 tx=0x7f777c00a950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d70b7d950a98f924 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:27.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.639+0000 7f777bfff700 1 -- 172.21.15.86:0/3409524301 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c00f070 con 0x7f77840af2f0 2023-10-09T11:56:27.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.639+0000 7f777bfff700 1 -- 172.21.15.86:0/3409524301 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c00a2e0 con 0x7f77840af2f0 2023-10-09T11:56:27.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.639+0000 7f777bfff700 1 -- 172.21.15.86:0/3409524301 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c00cd80 con 0x7f77840af2f0 2023-10-09T11:56:27.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 -- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77840af2f0 msgr2=0x7f77840af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 --2- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77840af2f0 0x7f77840af710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f777c00c0d0 tx=0x7f777c00a950 comp rx=0 tx=0).stop 2023-10-09T11:56:27.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 -- 172.21.15.86:0/3409524301 shutdown_connections 2023-10-09T11:56:27.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 --2- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77840af2f0 0x7f77840af710 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 --2- 172.21.15.86:0/3409524301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77841578b0 0x7f7784155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 -- 172.21.15.86:0/3409524301 >> 172.21.15.86:0/3409524301 conn(0x7f778406a320 msgr2=0x7f77840cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:27.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 -- 172.21.15.86:0/3409524301 shutdown_connections 2023-10-09T11:56:27.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.640+0000 7f778b3ff700 1 -- 172.21.15.86:0/3409524301 wait complete. 2023-10-09T11:56:27.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.641+0000 7f778b3ff700 1 Processor -- start 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.642+0000 7f778b3ff700 1 -- start start 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.642+0000 7f778b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77840af2f0 0x7f778414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.642+0000 7f778b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7784155c10 0x7f778406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.642+0000 7f778b3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77841578b0 0x7f778406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778b3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778415cbb0 con 0x7f77841578b0 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778415bfa0 con 0x7f7784155c10 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778415c280 con 0x7f77840af2f0 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77841578b0 0x7f778406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77841578b0 0x7f778406f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37632/0 (socket says 172.21.15.86:37632) 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 -- 172.21.15.86:0/1931050142 learned_addr learned my addr 172.21.15.86:0/1931050142 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:27.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778899a700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7784155c10 0x7f778406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778919b700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77840af2f0 0x7f778414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 -- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77840af2f0 msgr2=0x7f778414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77840af2f0 0x7f778414e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 -- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7784155c10 msgr2=0x7f778406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7784155c10 0x7f778406ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.643+0000 7f778999c700 1 -- 172.21.15.86:0/1931050142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774009420 con 0x7f77841578b0 2023-10-09T11:56:27.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.644+0000 7f778999c700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77841578b0 0x7f778406f1c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7784064290 tx=0x7f777c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:27.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.644+0000 7f77797fa700 1 -- 172.21.15.86:0/1931050142 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c009a40 con 0x7f77841578b0 2023-10-09T11:56:27.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.644+0000 7f77797fa700 1 -- 172.21.15.86:0/1931050142 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c009be0 con 0x7f77841578b0 2023-10-09T11:56:27.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.644+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c00abf0 con 0x7f77841578b0 2023-10-09T11:56:27.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.644+0000 7f77797fa700 1 -- 172.21.15.86:0/1931050142 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c027410 con 0x7f77841578b0 2023-10-09T11:56:27.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.644+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778415c840 con 0x7f77841578b0 2023-10-09T11:56:27.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.645+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7784157d20 con 0x7f77841578b0 2023-10-09T11:56:27.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.646+0000 7f77797fa700 1 -- 172.21.15.86:0/1931050142 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f777c003040 con 0x7f77841578b0 2023-10-09T11:56:27.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.647+0000 7f77797fa700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7768066f30 0x7f77680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:27.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.647+0000 7f77797fa700 1 -- 172.21.15.86:0/1931050142 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f777c085d10 con 0x7f77841578b0 2023-10-09T11:56:27.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.647+0000 7f778919b700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7768066f30 0x7f77680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:27.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.648+0000 7f778919b700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7768066f30 0x7f77680693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7780007fd0 tx=0x7f7780007d30 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:27.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.652+0000 7f77797fa700 1 -- 172.21.15.86:0/1931050142 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f777c052d60 con 0x7f77841578b0 2023-10-09T11:56:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.839+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f778404c3c0 con 0x7f7768066f30 2023-10-09T11:56:27.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.848+0000 7f77797fa700 1 -- 172.21.15.86:0/1931050142 <== mgr.6027 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288973 (secure 0 0 0) 0x7f778404c3c0 con 0x7f7768066f30 2023-10-09T11:56:27.852 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:27.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7768066f30 msgr2=0x7f77680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7768066f30 0x7f77680693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7780007fd0 tx=0x7f7780007d30 comp rx=0 tx=0).stop 2023-10-09T11:56:27.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77841578b0 msgr2=0x7f778406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:27.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77841578b0 0x7f778406f1c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7784064290 tx=0x7f777c019000 comp rx=0 tx=0).stop 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 shutdown_connections 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7768066f30 0x7f77680693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77841578b0 0x7f778406f1c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77840af2f0 0x7f778414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 --2- 172.21.15.86:0/1931050142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7784155c10 0x7f778406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 >> 172.21.15.86:0/1931050142 conn(0x7f778406a320 msgr2=0x7f77840b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 shutdown_connections 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:27.852+0000 7f778b3ff700 1 -- 172.21.15.86:0/1931050142 wait complete. 2023-10-09T11:56:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:56:27.870 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:56:27.664148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432040,"kb_used_data":8680,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752542680,"statfs":{"total":773094113280,"available":770603704320,"internally_reserved":0,"allocated":8888320,"data_stored":4818620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.968359"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734778+0000","last_change":"2023-10-09T11:56:21.727560+0000","last_active":"2023-10-09T11:56:21.734778+0000","last_peered":"2023-10-09T11:56:21.734778+0000","last_clean":"2023-10-09T11:56:21.734778+0000","last_became_active":"2023-10-09T11:56:21.727284+0000","last_became_peered":"2023-10-09T11:56:21.727284+0000","last_unstale":"2023-10-09T11:56:21.734778+0000","last_undegraded":"2023-10-09T11:56:21.734778+0000","last_fullsized":"2023-10-09T11:56:21.734778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:48.652438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736956+0000","last_change":"2023-10-09T11:56:21.729108+0000","last_active":"2023-10-09T11:56:21.736956+0000","last_peered":"2023-10-09T11:56:21.736956+0000","last_clean":"2023-10-09T11:56:21.736956+0000","last_became_active":"2023-10-09T11:56:21.728842+0000","last_became_peered":"2023-10-09T11:56:21.728842+0000","last_unstale":"2023-10-09T11:56:21.736956+0000","last_undegraded":"2023-10-09T11:56:21.736956+0000","last_fullsized":"2023-10-09T11:56:21.736956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:26.824936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744629+0000","last_change":"2023-10-09T11:56:21.741555+0000","last_active":"2023-10-09T11:56:21.744629+0000","last_peered":"2023-10-09T11:56:21.744629+0000","last_clean":"2023-10-09T11:56:21.744629+0000","last_became_active":"2023-10-09T11:56:21.740226+0000","last_became_peered":"2023-10-09T11:56:21.740226+0000","last_unstale":"2023-10-09T11:56:21.744629+0000","last_undegraded":"2023-10-09T11:56:21.744629+0000","last_fullsized":"2023-10-09T11:56:21.744629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:16.707690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737003+0000","last_change":"2023-10-09T11:56:21.732980+0000","last_active":"2023-10-09T11:56:21.737003+0000","last_peered":"2023-10-09T11:56:21.737003+0000","last_clean":"2023-10-09T11:56:21.737003+0000","last_became_active":"2023-10-09T11:56:21.732665+0000","last_became_peered":"2023-10-09T11:56:21.732665+0000","last_unstale":"2023-10-09T11:56:21.737003+0000","last_undegraded":"2023-10-09T11:56:21.737003+0000","last_fullsized":"2023-10-09T11:56:21.737003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:23.262163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736150+0000","last_change":"2023-10-09T11:56:21.734050+0000","last_active":"2023-10-09T11:56:21.736150+0000","last_peered":"2023-10-09T11:56:21.736150+0000","last_clean":"2023-10-09T11:56:21.736150+0000","last_became_active":"2023-10-09T11:56:21.733768+0000","last_became_peered":"2023-10-09T11:56:21.733768+0000","last_unstale":"2023-10-09T11:56:21.736150+0000","last_undegraded":"2023-10-09T11:56:21.736150+0000","last_fullsized":"2023-10-09T11:56:21.736150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:06.479071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.723464+0000","last_change":"2023-10-09T11:56:21.718804+0000","last_active":"2023-10-09T11:56:21.723464+0000","last_peered":"2023-10-09T11:56:21.723464+0000","last_clean":"2023-10-09T11:56:21.723464+0000","last_became_active":"2023-10-09T11:56:21.718422+0000","last_became_peered":"2023-10-09T11:56:21.718422+0000","last_unstale":"2023-10-09T11:56:21.723464+0000","last_undegraded":"2023-10-09T11:56:21.723464+0000","last_fullsized":"2023-10-09T11:56:21.723464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:25.540806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736991+0000","last_change":"2023-10-09T11:56:21.734068+0000","last_active":"2023-10-09T11:56:21.736991+0000","last_peered":"2023-10-09T11:56:21.736991+0000","last_clean":"2023-10-09T11:56:21.736991+0000","last_became_active":"2023-10-09T11:56:21.733770+0000","last_became_peered":"2023-10-09T11:56:21.733770+0000","last_unstale":"2023-10-09T11:56:21.736991+0000","last_undegraded":"2023-10-09T11:56:21.736991+0000","last_fullsized":"2023-10-09T11:56:21.736991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:21.012489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728216+0000","last_change":"2023-10-09T11:56:21.726113+0000","last_active":"2023-10-09T11:56:21.728216+0000","last_peered":"2023-10-09T11:56:21.728216+0000","last_clean":"2023-10-09T11:56:21.728216+0000","last_became_active":"2023-10-09T11:56:21.725849+0000","last_became_peered":"2023-10-09T11:56:21.725849+0000","last_unstale":"2023-10-09T11:56:21.728216+0000","last_undegraded":"2023-10-09T11:56:21.728216+0000","last_fullsized":"2023-10-09T11:56:21.728216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:54.011094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735257+0000","last_change":"2023-10-09T11:56:21.724358+0000","last_active":"2023-10-09T11:56:21.735257+0000","last_peered":"2023-10-09T11:56:21.735257+0000","last_clean":"2023-10-09T11:56:21.735257+0000","last_became_active":"2023-10-09T11:56:21.724099+0000","last_became_peered":"2023-10-09T11:56:21.724099+0000","last_unstale":"2023-10-09T11:56:21.735257+0000","last_undegraded":"2023-10-09T11:56:21.735257+0000","last_fullsized":"2023-10-09T11:56:21.735257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:32.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727932+0000","last_change":"2023-10-09T11:56:21.720019+0000","last_active":"2023-10-09T11:56:21.727932+0000","last_peered":"2023-10-09T11:56:21.727932+0000","last_clean":"2023-10-09T11:56:21.727932+0000","last_became_active":"2023-10-09T11:56:21.719627+0000","last_became_peered":"2023-10-09T11:56:21.719627+0000","last_unstale":"2023-10-09T11:56:21.727932+0000","last_undegraded":"2023-10-09T11:56:21.727932+0000","last_fullsized":"2023-10-09T11:56:21.727932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:18.992708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.732657+0000","last_change":"2023-10-09T11:56:21.728925+0000","last_active":"2023-10-09T11:56:21.732657+0000","last_peered":"2023-10-09T11:56:21.732657+0000","last_clean":"2023-10-09T11:56:21.732657+0000","last_became_active":"2023-10-09T11:56:21.728639+0000","last_became_peered":"2023-10-09T11:56:21.728639+0000","last_unstale":"2023-10-09T11:56:21.732657+0000","last_undegraded":"2023-10-09T11:56:21.732657+0000","last_fullsized":"2023-10-09T11:56:21.732657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:14.853227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737023+0000","last_change":"2023-10-09T11:56:21.733517+0000","last_active":"2023-10-09T11:56:21.737023+0000","last_peered":"2023-10-09T11:56:21.737023+0000","last_clean":"2023-10-09T11:56:21.737023+0000","last_became_active":"2023-10-09T11:56:21.733235+0000","last_became_peered":"2023-10-09T11:56:21.733235+0000","last_unstale":"2023-10-09T11:56:21.737023+0000","last_undegraded":"2023-10-09T11:56:21.737023+0000","last_fullsized":"2023-10-09T11:56:21.737023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.661225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.730375+0000","last_change":"2023-10-09T11:56:21.725126+0000","last_active":"2023-10-09T11:56:21.730375+0000","last_peered":"2023-10-09T11:56:21.730375+0000","last_clean":"2023-10-09T11:56:21.730375+0000","last_became_active":"2023-10-09T11:56:21.724839+0000","last_became_peered":"2023-10-09T11:56:21.724839+0000","last_unstale":"2023-10-09T11:56:21.730375+0000","last_undegraded":"2023-10-09T11:56:21.730375+0000","last_fullsized":"2023-10-09T11:56:21.730375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:18.647810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.722578+0000","last_change":"2023-10-09T11:56:21.720924+0000","last_active":"2023-10-09T11:56:21.722578+0000","last_peered":"2023-10-09T11:56:21.722578+0000","last_clean":"2023-10-09T11:56:21.722578+0000","last_became_active":"2023-10-09T11:56:21.720633+0000","last_became_peered":"2023-10-09T11:56:21.720633+0000","last_unstale":"2023-10-09T11:56:21.722578+0000","last_undegraded":"2023-10-09T11:56:21.722578+0000","last_fullsized":"2023-10-09T11:56:21.722578+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:14.853227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734894+0000","last_change":"2023-10-09T11:56:21.728061+0000","last_active":"2023-10-09T11:56:21.734894+0000","last_peered":"2023-10-09T11:56:21.734894+0000","last_clean":"2023-10-09T11:56:21.734894+0000","last_became_active":"2023-10-09T11:56:21.727763+0000","last_became_peered":"2023-10-09T11:56:21.727763+0000","last_unstale":"2023-10-09T11:56:21.734894+0000","last_undegraded":"2023-10-09T11:56:21.734894+0000","last_fullsized":"2023-10-09T11:56:21.734894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:41.449746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737356+0000","last_change":"2023-10-09T11:56:21.725034+0000","last_active":"2023-10-09T11:56:21.737356+0000","last_peered":"2023-10-09T11:56:21.737356+0000","last_clean":"2023-10-09T11:56:21.737356+0000","last_became_active":"2023-10-09T11:56:21.724569+0000","last_became_peered":"2023-10-09T11:56:21.724569+0000","last_unstale":"2023-10-09T11:56:21.737356+0000","last_undegraded":"2023-10-09T11:56:21.737356+0000","last_fullsized":"2023-10-09T11:56:21.737356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:59.442411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736007+0000","last_change":"2023-10-09T11:56:21.727435+0000","last_active":"2023-10-09T11:56:21.736007+0000","last_peered":"2023-10-09T11:56:21.736007+0000","last_clean":"2023-10-09T11:56:21.736007+0000","last_became_active":"2023-10-09T11:56:21.727191+0000","last_became_peered":"2023-10-09T11:56:21.727191+0000","last_unstale":"2023-10-09T11:56:21.736007+0000","last_undegraded":"2023-10-09T11:56:21.736007+0000","last_fullsized":"2023-10-09T11:56:21.736007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:48.204740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741563+0000","last_change":"2023-10-09T11:56:21.738925+0000","last_active":"2023-10-09T11:56:21.741563+0000","last_peered":"2023-10-09T11:56:21.741563+0000","last_clean":"2023-10-09T11:56:21.741563+0000","last_became_active":"2023-10-09T11:56:21.738619+0000","last_became_peered":"2023-10-09T11:56:21.738619+0000","last_unstale":"2023-10-09T11:56:21.741563+0000","last_undegraded":"2023-10-09T11:56:21.741563+0000","last_fullsized":"2023-10-09T11:56:21.741563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:49.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735016+0000","last_change":"2023-10-09T11:56:21.728322+0000","last_active":"2023-10-09T11:56:21.735016+0000","last_peered":"2023-10-09T11:56:21.735016+0000","last_clean":"2023-10-09T11:56:21.735016+0000","last_became_active":"2023-10-09T11:56:21.728054+0000","last_became_peered":"2023-10-09T11:56:21.728054+0000","last_unstale":"2023-10-09T11:56:21.735016+0000","last_undegraded":"2023-10-09T11:56:21.735016+0000","last_fullsized":"2023-10-09T11:56:21.735016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:27.003547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741076+0000","last_change":"2023-10-09T11:56:21.737993+0000","last_active":"2023-10-09T11:56:21.741076+0000","last_peered":"2023-10-09T11:56:21.741076+0000","last_clean":"2023-10-09T11:56:21.741076+0000","last_became_active":"2023-10-09T11:56:21.737716+0000","last_became_peered":"2023-10-09T11:56:21.737716+0000","last_unstale":"2023-10-09T11:56:21.741076+0000","last_undegraded":"2023-10-09T11:56:21.741076+0000","last_fullsized":"2023-10-09T11:56:21.741076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:54.192440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744701+0000","last_change":"2023-10-09T11:56:21.743236+0000","last_active":"2023-10-09T11:56:21.744701+0000","last_peered":"2023-10-09T11:56:21.744701+0000","last_clean":"2023-10-09T11:56:21.744701+0000","last_became_active":"2023-10-09T11:56:21.742523+0000","last_became_peered":"2023-10-09T11:56:21.742523+0000","last_unstale":"2023-10-09T11:56:21.744701+0000","last_undegraded":"2023-10-09T11:56:21.744701+0000","last_fullsized":"2023-10-09T11:56:21.744701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:26.206018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734482+0000","last_change":"2023-10-09T11:56:21.727091+0000","last_active":"2023-10-09T11:56:21.734482+0000","last_peered":"2023-10-09T11:56:21.734482+0000","last_clean":"2023-10-09T11:56:21.734482+0000","last_became_active":"2023-10-09T11:56:21.726829+0000","last_became_peered":"2023-10-09T11:56:21.726829+0000","last_unstale":"2023-10-09T11:56:21.734482+0000","last_undegraded":"2023-10-09T11:56:21.734482+0000","last_fullsized":"2023-10-09T11:56:21.734482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:43.688318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.745171+0000","last_change":"2023-10-09T11:56:21.742009+0000","last_active":"2023-10-09T11:56:21.745171+0000","last_peered":"2023-10-09T11:56:21.745171+0000","last_clean":"2023-10-09T11:56:21.745171+0000","last_became_active":"2023-10-09T11:56:21.741642+0000","last_became_peered":"2023-10-09T11:56:21.741642+0000","last_unstale":"2023-10-09T11:56:21.745171+0000","last_undegraded":"2023-10-09T11:56:21.745171+0000","last_fullsized":"2023-10-09T11:56:21.745171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:24.489605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.730645+0000","last_change":"2023-10-09T11:56:21.724536+0000","last_active":"2023-10-09T11:56:21.730645+0000","last_peered":"2023-10-09T11:56:21.730645+0000","last_clean":"2023-10-09T11:56:21.730645+0000","last_became_active":"2023-10-09T11:56:21.724227+0000","last_became_peered":"2023-10-09T11:56:21.724227+0000","last_unstale":"2023-10-09T11:56:21.730645+0000","last_undegraded":"2023-10-09T11:56:21.730645+0000","last_fullsized":"2023-10-09T11:56:21.730645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:05.049086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724462+0000","last_change":"2023-10-09T11:56:21.720980+0000","last_active":"2023-10-09T11:56:21.724462+0000","last_peered":"2023-10-09T11:56:21.724462+0000","last_clean":"2023-10-09T11:56:21.724462+0000","last_became_active":"2023-10-09T11:56:21.720592+0000","last_became_peered":"2023-10-09T11:56:21.720592+0000","last_unstale":"2023-10-09T11:56:21.724462+0000","last_undegraded":"2023-10-09T11:56:21.724462+0000","last_fullsized":"2023-10-09T11:56:21.724462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:44.853284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.740331+0000","last_change":"2023-10-09T11:56:21.739142+0000","last_active":"2023-10-09T11:56:21.740331+0000","last_peered":"2023-10-09T11:56:21.740331+0000","last_clean":"2023-10-09T11:56:21.740331+0000","last_became_active":"2023-10-09T11:56:21.738876+0000","last_became_peered":"2023-10-09T11:56:21.738876+0000","last_unstale":"2023-10-09T11:56:21.740331+0000","last_undegraded":"2023-10-09T11:56:21.740331+0000","last_fullsized":"2023-10-09T11:56:21.740331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:06.346912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737216+0000","last_change":"2023-10-09T11:56:21.724392+0000","last_active":"2023-10-09T11:56:21.737216+0000","last_peered":"2023-10-09T11:56:21.737216+0000","last_clean":"2023-10-09T11:56:21.737216+0000","last_became_active":"2023-10-09T11:56:21.723762+0000","last_became_peered":"2023-10-09T11:56:21.723762+0000","last_unstale":"2023-10-09T11:56:21.737216+0000","last_undegraded":"2023-10-09T11:56:21.737216+0000","last_fullsized":"2023-10-09T11:56:21.737216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:49.591622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736205+0000","last_change":"2023-10-09T11:56:21.734029+0000","last_active":"2023-10-09T11:56:21.736205+0000","last_peered":"2023-10-09T11:56:21.736205+0000","last_clean":"2023-10-09T11:56:21.736205+0000","last_became_active":"2023-10-09T11:56:21.733735+0000","last_became_peered":"2023-10-09T11:56:21.733735+0000","last_unstale":"2023-10-09T11:56:21.736205+0000","last_undegraded":"2023-10-09T11:56:21.736205+0000","last_fullsized":"2023-10-09T11:56:21.736205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:32.576963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736373+0000","last_change":"2023-10-09T11:56:21.730249+0000","last_active":"2023-10-09T11:56:21.736373+0000","last_peered":"2023-10-09T11:56:21.736373+0000","last_clean":"2023-10-09T11:56:21.736373+0000","last_became_active":"2023-10-09T11:56:21.730001+0000","last_became_peered":"2023-10-09T11:56:21.730001+0000","last_unstale":"2023-10-09T11:56:21.736373+0000","last_undegraded":"2023-10-09T11:56:21.736373+0000","last_fullsized":"2023-10-09T11:56:21.736373+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:20.936531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744573+0000","last_change":"2023-10-09T11:56:21.741015+0000","last_active":"2023-10-09T11:56:21.744573+0000","last_peered":"2023-10-09T11:56:21.744573+0000","last_clean":"2023-10-09T11:56:21.744573+0000","last_became_active":"2023-10-09T11:56:21.740740+0000","last_became_peered":"2023-10-09T11:56:21.740740+0000","last_unstale":"2023-10-09T11:56:21.744573+0000","last_undegraded":"2023-10-09T11:56:21.744573+0000","last_fullsized":"2023-10-09T11:56:21.744573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:59.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724635+0000","last_change":"2023-10-09T11:56:21.721632+0000","last_active":"2023-10-09T11:56:21.724635+0000","last_peered":"2023-10-09T11:56:21.724635+0000","last_clean":"2023-10-09T11:56:21.724635+0000","last_became_active":"2023-10-09T11:56:21.721370+0000","last_became_peered":"2023-10-09T11:56:21.721370+0000","last_unstale":"2023-10-09T11:56:21.724635+0000","last_undegraded":"2023-10-09T11:56:21.724635+0000","last_fullsized":"2023-10-09T11:56:21.724635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:18:36.912588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737380+0000","last_change":"2023-10-09T11:56:21.726879+0000","last_active":"2023-10-09T11:56:21.737380+0000","last_peered":"2023-10-09T11:56:21.737380+0000","last_clean":"2023-10-09T11:56:21.737380+0000","last_became_active":"2023-10-09T11:56:21.726604+0000","last_became_peered":"2023-10-09T11:56:21.726604+0000","last_unstale":"2023-10-09T11:56:21.737380+0000","last_undegraded":"2023-10-09T11:56:21.737380+0000","last_fullsized":"2023-10-09T11:56:21.737380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:30.537793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737869+0000","last_change":"2023-10-09T11:56:21.730223+0000","last_active":"2023-10-09T11:56:21.737869+0000","last_peered":"2023-10-09T11:56:21.737869+0000","last_clean":"2023-10-09T11:56:21.737869+0000","last_became_active":"2023-10-09T11:56:21.729977+0000","last_became_peered":"2023-10-09T11:56:21.729977+0000","last_unstale":"2023-10-09T11:56:21.737869+0000","last_undegraded":"2023-10-09T11:56:21.737869+0000","last_fullsized":"2023-10-09T11:56:21.737869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:40.105701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749280+0000","last_change":"2023-10-09T11:56:20.719204+0000","last_active":"2023-10-09T11:56:21.749280+0000","last_peered":"2023-10-09T11:56:21.749280+0000","last_clean":"2023-10-09T11:56:21.749280+0000","last_became_active":"2023-10-09T11:56:20.718952+0000","last_became_peered":"2023-10-09T11:56:20.718952+0000","last_unstale":"2023-10-09T11:56:21.749280+0000","last_undegraded":"2023-10-09T11:56:21.749280+0000","last_fullsized":"2023-10-09T11:56:21.749280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:54.760347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.732078+0000","last_change":"2023-10-09T11:56:21.726518+0000","last_active":"2023-10-09T11:56:21.732078+0000","last_peered":"2023-10-09T11:56:21.732078+0000","last_clean":"2023-10-09T11:56:21.732078+0000","last_became_active":"2023-10-09T11:56:21.726248+0000","last_became_peered":"2023-10-09T11:56:21.726248+0000","last_unstale":"2023-10-09T11:56:21.732078+0000","last_undegraded":"2023-10-09T11:56:21.732078+0000","last_fullsized":"2023-10-09T11:56:21.732078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:30.797269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.745061+0000","last_change":"2023-10-09T11:56:20.716908+0000","last_active":"2023-10-09T11:56:21.745061+0000","last_peered":"2023-10-09T11:56:21.745061+0000","last_clean":"2023-10-09T11:56:21.745061+0000","last_became_active":"2023-10-09T11:56:20.716566+0000","last_became_peered":"2023-10-09T11:56:20.716566+0000","last_unstale":"2023-10-09T11:56:21.745061+0000","last_undegraded":"2023-10-09T11:56:21.745061+0000","last_fullsized":"2023-10-09T11:56:21.745061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:25.853333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724483+0000","last_change":"2023-10-09T11:56:21.717627+0000","last_active":"2023-10-09T11:56:21.724483+0000","last_peered":"2023-10-09T11:56:21.724483+0000","last_clean":"2023-10-09T11:56:21.724483+0000","last_became_active":"2023-10-09T11:56:21.717344+0000","last_became_peered":"2023-10-09T11:56:21.717344+0000","last_unstale":"2023-10-09T11:56:21.724483+0000","last_undegraded":"2023-10-09T11:56:21.724483+0000","last_fullsized":"2023-10-09T11:56:21.724483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:47.385573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749185+0000","last_change":"2023-10-09T11:56:20.721852+0000","last_active":"2023-10-09T11:56:21.749185+0000","last_peered":"2023-10-09T11:56:21.749185+0000","last_clean":"2023-10-09T11:56:21.749185+0000","last_became_active":"2023-10-09T11:56:20.721109+0000","last_became_peered":"2023-10-09T11:56:20.721109+0000","last_unstale":"2023-10-09T11:56:21.749185+0000","last_undegraded":"2023-10-09T11:56:21.749185+0000","last_fullsized":"2023-10-09T11:56:21.749185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:37.253490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.738875+0000","last_change":"2023-10-09T11:56:21.733024+0000","last_active":"2023-10-09T11:56:21.738875+0000","last_peered":"2023-10-09T11:56:21.738875+0000","last_clean":"2023-10-09T11:56:21.738875+0000","last_became_active":"2023-10-09T11:56:21.732750+0000","last_became_peered":"2023-10-09T11:56:21.732750+0000","last_unstale":"2023-10-09T11:56:21.738875+0000","last_undegraded":"2023-10-09T11:56:21.738875+0000","last_fullsized":"2023-10-09T11:56:21.738875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:44.583102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.747359+0000","last_change":"2023-10-09T11:56:20.720001+0000","last_active":"2023-10-09T11:56:21.747359+0000","last_peered":"2023-10-09T11:56:21.747359+0000","last_clean":"2023-10-09T11:56:21.747359+0000","last_became_active":"2023-10-09T11:56:20.719706+0000","last_became_peered":"2023-10-09T11:56:20.719706+0000","last_unstale":"2023-10-09T11:56:21.747359+0000","last_undegraded":"2023-10-09T11:56:21.747359+0000","last_fullsized":"2023-10-09T11:56:21.747359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:04.043574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734460+0000","last_change":"2023-10-09T11:56:21.726677+0000","last_active":"2023-10-09T11:56:21.734460+0000","last_peered":"2023-10-09T11:56:21.734460+0000","last_clean":"2023-10-09T11:56:21.734460+0000","last_became_active":"2023-10-09T11:56:21.726421+0000","last_became_peered":"2023-10-09T11:56:21.726421+0000","last_unstale":"2023-10-09T11:56:21.734460+0000","last_undegraded":"2023-10-09T11:56:21.734460+0000","last_fullsized":"2023-10-09T11:56:21.734460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:43.116232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.746671+0000","last_change":"2023-10-09T11:56:20.705112+0000","last_active":"2023-10-09T11:56:21.746671+0000","last_peered":"2023-10-09T11:56:21.746671+0000","last_clean":"2023-10-09T11:56:21.746671+0000","last_became_active":"2023-10-09T11:56:20.704825+0000","last_became_peered":"2023-10-09T11:56:20.704825+0000","last_unstale":"2023-10-09T11:56:21.746671+0000","last_undegraded":"2023-10-09T11:56:21.746671+0000","last_fullsized":"2023-10-09T11:56:21.746671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:13.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741040+0000","last_change":"2023-10-09T11:56:21.738417+0000","last_active":"2023-10-09T11:56:21.741040+0000","last_peered":"2023-10-09T11:56:21.741040+0000","last_clean":"2023-10-09T11:56:21.741040+0000","last_became_active":"2023-10-09T11:56:21.738157+0000","last_became_peered":"2023-10-09T11:56:21.738157+0000","last_unstale":"2023-10-09T11:56:21.741040+0000","last_undegraded":"2023-10-09T11:56:21.741040+0000","last_fullsized":"2023-10-09T11:56:21.741040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:48.060078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.746492+0000","last_change":"2023-10-09T11:56:20.717372+0000","last_active":"2023-10-09T11:56:21.746492+0000","last_peered":"2023-10-09T11:56:21.746492+0000","last_clean":"2023-10-09T11:56:21.746492+0000","last_became_active":"2023-10-09T11:56:20.717121+0000","last_became_peered":"2023-10-09T11:56:20.717121+0000","last_unstale":"2023-10-09T11:56:21.746492+0000","last_undegraded":"2023-10-09T11:56:21.746492+0000","last_fullsized":"2023-10-09T11:56:21.746492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:55.038857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736308+0000","last_change":"2023-10-09T11:56:21.731730+0000","last_active":"2023-10-09T11:56:21.736308+0000","last_peered":"2023-10-09T11:56:21.736308+0000","last_clean":"2023-10-09T11:56:21.736308+0000","last_became_active":"2023-10-09T11:56:21.731476+0000","last_became_peered":"2023-10-09T11:56:21.731476+0000","last_unstale":"2023-10-09T11:56:21.736308+0000","last_undegraded":"2023-10-09T11:56:21.736308+0000","last_fullsized":"2023-10-09T11:56:21.736308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:37.766595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726523+0000","last_change":"2023-10-09T11:56:20.713478+0000","last_active":"2023-10-09T11:56:21.726523+0000","last_peered":"2023-10-09T11:56:21.726523+0000","last_clean":"2023-10-09T11:56:21.726523+0000","last_became_active":"2023-10-09T11:56:20.713207+0000","last_became_peered":"2023-10-09T11:56:20.713207+0000","last_unstale":"2023-10-09T11:56:21.726523+0000","last_undegraded":"2023-10-09T11:56:21.726523+0000","last_fullsized":"2023-10-09T11:56:21.726523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:40.444234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735786+0000","last_change":"2023-10-09T11:56:21.726648+0000","last_active":"2023-10-09T11:56:21.735786+0000","last_peered":"2023-10-09T11:56:21.735786+0000","last_clean":"2023-10-09T11:56:21.735786+0000","last_became_active":"2023-10-09T11:56:21.726392+0000","last_became_peered":"2023-10-09T11:56:21.726392+0000","last_unstale":"2023-10-09T11:56:21.735786+0000","last_undegraded":"2023-10-09T11:56:21.735786+0000","last_fullsized":"2023-10-09T11:56:21.735786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:21.324709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.716267+0000","last_change":"2023-10-09T11:56:20.708802+0000","last_active":"2023-10-09T11:56:21.716267+0000","last_peered":"2023-10-09T11:56:21.716267+0000","last_clean":"2023-10-09T11:56:21.716267+0000","last_became_active":"2023-10-09T11:56:20.708502+0000","last_became_peered":"2023-10-09T11:56:20.708502+0000","last_unstale":"2023-10-09T11:56:21.716267+0000","last_undegraded":"2023-10-09T11:56:21.716267+0000","last_fullsized":"2023-10-09T11:56:21.716267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:53.616884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736591+0000","last_change":"2023-10-09T11:56:21.733157+0000","last_active":"2023-10-09T11:56:21.736591+0000","last_peered":"2023-10-09T11:56:21.736591+0000","last_clean":"2023-10-09T11:56:21.736591+0000","last_became_active":"2023-10-09T11:56:21.732863+0000","last_became_peered":"2023-10-09T11:56:21.732863+0000","last_unstale":"2023-10-09T11:56:21.736591+0000","last_undegraded":"2023-10-09T11:56:21.736591+0000","last_fullsized":"2023-10-09T11:56:21.736591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:26.774932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727711+0000","last_change":"2023-10-09T11:56:20.721592+0000","last_active":"2023-10-09T11:56:21.727711+0000","last_peered":"2023-10-09T11:56:21.727711+0000","last_clean":"2023-10-09T11:56:21.727711+0000","last_became_active":"2023-10-09T11:56:20.721217+0000","last_became_peered":"2023-10-09T11:56:20.721217+0000","last_unstale":"2023-10-09T11:56:21.727711+0000","last_undegraded":"2023-10-09T11:56:21.727711+0000","last_fullsized":"2023-10-09T11:56:21.727711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:05.341400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741601+0000","last_change":"2023-10-09T11:56:21.739055+0000","last_active":"2023-10-09T11:56:21.741601+0000","last_peered":"2023-10-09T11:56:21.741601+0000","last_clean":"2023-10-09T11:56:21.741601+0000","last_became_active":"2023-10-09T11:56:21.738764+0000","last_became_peered":"2023-10-09T11:56:21.738764+0000","last_unstale":"2023-10-09T11:56:21.741601+0000","last_undegraded":"2023-10-09T11:56:21.741601+0000","last_fullsized":"2023-10-09T11:56:21.741601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:13.947762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.722332+0000","last_change":"2023-10-09T11:56:20.706578+0000","last_active":"2023-10-09T11:56:21.722332+0000","last_peered":"2023-10-09T11:56:21.722332+0000","last_clean":"2023-10-09T11:56:21.722332+0000","last_became_active":"2023-10-09T11:56:20.706283+0000","last_became_peered":"2023-10-09T11:56:20.706283+0000","last_unstale":"2023-10-09T11:56:21.722332+0000","last_undegraded":"2023-10-09T11:56:21.722332+0000","last_fullsized":"2023-10-09T11:56:21.722332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:34:59.973312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728052+0000","last_change":"2023-10-09T11:56:21.725186+0000","last_active":"2023-10-09T11:56:21.728052+0000","last_peered":"2023-10-09T11:56:21.728052+0000","last_clean":"2023-10-09T11:56:21.728052+0000","last_became_active":"2023-10-09T11:56:21.724896+0000","last_became_peered":"2023-10-09T11:56:21.724896+0000","last_unstale":"2023-10-09T11:56:21.728052+0000","last_undegraded":"2023-10-09T11:56:21.728052+0000","last_fullsized":"2023-10-09T11:56:21.728052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:40.414431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.750562+0000","last_change":"2023-10-09T11:56:20.722183+0000","last_active":"2023-10-09T11:56:21.750562+0000","last_peered":"2023-10-09T11:56:21.750562+0000","last_clean":"2023-10-09T11:56:21.750562+0000","last_became_active":"2023-10-09T11:56:20.721914+0000","last_became_peered":"2023-10-09T11:56:20.721914+0000","last_unstale":"2023-10-09T11:56:21.750562+0000","last_undegraded":"2023-10-09T11:56:21.750562+0000","last_fullsized":"2023-10-09T11:56:21.750562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:22.256651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744668+0000","last_change":"2023-10-09T11:56:21.742120+0000","last_active":"2023-10-09T11:56:21.744668+0000","last_peered":"2023-10-09T11:56:21.744668+0000","last_clean":"2023-10-09T11:56:21.744668+0000","last_became_active":"2023-10-09T11:56:21.740577+0000","last_became_peered":"2023-10-09T11:56:21.740577+0000","last_unstale":"2023-10-09T11:56:21.744668+0000","last_undegraded":"2023-10-09T11:56:21.744668+0000","last_fullsized":"2023-10-09T11:56:21.744668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:53.464984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"79'6","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.752742+0000","last_change":"2023-10-09T11:56:20.720689+0000","last_active":"2023-10-09T11:56:21.752742+0000","last_peered":"2023-10-09T11:56:21.752742+0000","last_clean":"2023-10-09T11:56:21.752742+0000","last_became_active":"2023-10-09T11:56:20.720386+0000","last_became_peered":"2023-10-09T11:56:20.720386+0000","last_unstale":"2023-10-09T11:56:21.752742+0000","last_undegraded":"2023-10-09T11:56:21.752742+0000","last_fullsized":"2023-10-09T11:56:21.752742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.889018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737181+0000","last_change":"2023-10-09T11:56:21.734936+0000","last_active":"2023-10-09T11:56:21.737181+0000","last_peered":"2023-10-09T11:56:21.737181+0000","last_clean":"2023-10-09T11:56:21.737181+0000","last_became_active":"2023-10-09T11:56:21.733883+0000","last_became_peered":"2023-10-09T11:56:21.733883+0000","last_unstale":"2023-10-09T11:56:21.737181+0000","last_undegraded":"2023-10-09T11:56:21.737181+0000","last_fullsized":"2023-10-09T11:56:21.737181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:28.922470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.747265+0000","last_change":"2023-10-09T11:56:20.705581+0000","last_active":"2023-10-09T11:56:21.747265+0000","last_peered":"2023-10-09T11:56:21.747265+0000","last_clean":"2023-10-09T11:56:21.747265+0000","last_became_active":"2023-10-09T11:56:20.705258+0000","last_became_peered":"2023-10-09T11:56:20.705258+0000","last_unstale":"2023-10-09T11:56:21.747265+0000","last_undegraded":"2023-10-09T11:56:21.747265+0000","last_fullsized":"2023-10-09T11:56:21.747265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:52.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741462+0000","last_change":"2023-10-09T11:56:21.738082+0000","last_active":"2023-10-09T11:56:21.741462+0000","last_peered":"2023-10-09T11:56:21.741462+0000","last_clean":"2023-10-09T11:56:21.741462+0000","last_became_active":"2023-10-09T11:56:21.737686+0000","last_became_peered":"2023-10-09T11:56:21.737686+0000","last_unstale":"2023-10-09T11:56:21.741462+0000","last_undegraded":"2023-10-09T11:56:21.741462+0000","last_fullsized":"2023-10-09T11:56:21.741462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:34.111432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.715188+0000","last_change":"2023-10-09T11:56:20.717933+0000","last_active":"2023-10-09T11:56:21.715188+0000","last_peered":"2023-10-09T11:56:21.715188+0000","last_clean":"2023-10-09T11:56:21.715188+0000","last_became_active":"2023-10-09T11:56:20.717656+0000","last_became_peered":"2023-10-09T11:56:20.717656+0000","last_unstale":"2023-10-09T11:56:21.715188+0000","last_undegraded":"2023-10-09T11:56:21.715188+0000","last_fullsized":"2023-10-09T11:56:21.715188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:17.987196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735499+0000","last_change":"2023-10-09T11:56:21.730799+0000","last_active":"2023-10-09T11:56:21.735499+0000","last_peered":"2023-10-09T11:56:21.735499+0000","last_clean":"2023-10-09T11:56:21.735499+0000","last_became_active":"2023-10-09T11:56:21.730494+0000","last_became_peered":"2023-10-09T11:56:21.730494+0000","last_unstale":"2023-10-09T11:56:21.735499+0000","last_undegraded":"2023-10-09T11:56:21.735499+0000","last_fullsized":"2023-10-09T11:56:21.735499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:30.797269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726632+0000","last_change":"2023-10-09T11:56:20.719255+0000","last_active":"2023-10-09T11:56:21.726632+0000","last_peered":"2023-10-09T11:56:21.726632+0000","last_clean":"2023-10-09T11:56:21.726632+0000","last_became_active":"2023-10-09T11:56:20.718989+0000","last_became_peered":"2023-10-09T11:56:20.718989+0000","last_unstale":"2023-10-09T11:56:21.726632+0000","last_undegraded":"2023-10-09T11:56:21.726632+0000","last_fullsized":"2023-10-09T11:56:21.726632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:31.889787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.745152+0000","last_change":"2023-10-09T11:56:21.741336+0000","last_active":"2023-10-09T11:56:21.745152+0000","last_peered":"2023-10-09T11:56:21.745152+0000","last_clean":"2023-10-09T11:56:21.745152+0000","last_became_active":"2023-10-09T11:56:21.740591+0000","last_became_peered":"2023-10-09T11:56:21.740591+0000","last_unstale":"2023-10-09T11:56:21.745152+0000","last_undegraded":"2023-10-09T11:56:21.745152+0000","last_fullsized":"2023-10-09T11:56:21.745152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:51:58.219914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"79'8","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.753166+0000","last_change":"2023-10-09T11:56:20.722649+0000","last_active":"2023-10-09T11:56:21.753166+0000","last_peered":"2023-10-09T11:56:21.753166+0000","last_clean":"2023-10-09T11:56:21.753166+0000","last_became_active":"2023-10-09T11:56:20.722271+0000","last_became_peered":"2023-10-09T11:56:20.722271+0000","last_unstale":"2023-10-09T11:56:21.753166+0000","last_undegraded":"2023-10-09T11:56:21.753166+0000","last_fullsized":"2023-10-09T11:56:21.753166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:27.916958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741545+0000","last_change":"2023-10-09T11:56:21.738336+0000","last_active":"2023-10-09T11:56:21.741545+0000","last_peered":"2023-10-09T11:56:21.741545+0000","last_clean":"2023-10-09T11:56:21.741545+0000","last_became_active":"2023-10-09T11:56:21.738034+0000","last_became_peered":"2023-10-09T11:56:21.738034+0000","last_unstale":"2023-10-09T11:56:21.741545+0000","last_undegraded":"2023-10-09T11:56:21.741545+0000","last_fullsized":"2023-10-09T11:56:21.741545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:36.155599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744199+0000","last_change":"2023-10-09T11:56:20.706126+0000","last_active":"2023-10-09T11:56:21.744199+0000","last_peered":"2023-10-09T11:56:21.744199+0000","last_clean":"2023-10-09T11:56:21.744199+0000","last_became_active":"2023-10-09T11:56:20.705869+0000","last_became_peered":"2023-10-09T11:56:20.705869+0000","last_unstale":"2023-10-09T11:56:21.744199+0000","last_undegraded":"2023-10-09T11:56:21.744199+0000","last_fullsized":"2023-10-09T11:56:21.744199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:19.541763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737352+0000","last_change":"2023-10-09T11:56:21.735010+0000","last_active":"2023-10-09T11:56:21.737352+0000","last_peered":"2023-10-09T11:56:21.737352+0000","last_clean":"2023-10-09T11:56:21.737352+0000","last_became_active":"2023-10-09T11:56:21.734689+0000","last_became_peered":"2023-10-09T11:56:21.734689+0000","last_unstale":"2023-10-09T11:56:21.737352+0000","last_undegraded":"2023-10-09T11:56:21.737352+0000","last_fullsized":"2023-10-09T11:56:21.737352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:55.071895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749062+0000","last_change":"2023-10-09T11:56:20.718089+0000","last_active":"2023-10-09T11:56:21.749062+0000","last_peered":"2023-10-09T11:56:21.749062+0000","last_clean":"2023-10-09T11:56:21.749062+0000","last_became_active":"2023-10-09T11:56:20.717643+0000","last_became_peered":"2023-10-09T11:56:20.717643+0000","last_unstale":"2023-10-09T11:56:21.749062+0000","last_undegraded":"2023-10-09T11:56:21.749062+0000","last_fullsized":"2023-10-09T11:56:21.749062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:06.635841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727850+0000","last_change":"2023-10-09T11:56:21.726015+0000","last_active":"2023-10-09T11:56:21.727850+0000","last_peered":"2023-10-09T11:56:21.727850+0000","last_clean":"2023-10-09T11:56:21.727850+0000","last_became_active":"2023-10-09T11:56:21.725747+0000","last_became_peered":"2023-10-09T11:56:21.725747+0000","last_unstale":"2023-10-09T11:56:21.727850+0000","last_undegraded":"2023-10-09T11:56:21.727850+0000","last_fullsized":"2023-10-09T11:56:21.727850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:18.937211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.747742+0000","last_change":"2023-10-09T11:56:20.720031+0000","last_active":"2023-10-09T11:56:21.747742+0000","last_peered":"2023-10-09T11:56:21.747742+0000","last_clean":"2023-10-09T11:56:21.747742+0000","last_became_active":"2023-10-09T11:56:20.719700+0000","last_became_peered":"2023-10-09T11:56:20.719700+0000","last_unstale":"2023-10-09T11:56:21.747742+0000","last_undegraded":"2023-10-09T11:56:21.747742+0000","last_fullsized":"2023-10-09T11:56:21.747742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:20.006977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744651+0000","last_change":"2023-10-09T11:56:21.741781+0000","last_active":"2023-10-09T11:56:21.744651+0000","last_peered":"2023-10-09T11:56:21.744651+0000","last_clean":"2023-10-09T11:56:21.744651+0000","last_became_active":"2023-10-09T11:56:21.741041+0000","last_became_peered":"2023-10-09T11:56:21.741041+0000","last_unstale":"2023-10-09T11:56:21.744651+0000","last_undegraded":"2023-10-09T11:56:21.744651+0000","last_fullsized":"2023-10-09T11:56:21.744651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:33.551552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.714226+0000","last_change":"2023-10-09T11:56:20.720013+0000","last_active":"2023-10-09T11:56:21.714226+0000","last_peered":"2023-10-09T11:56:21.714226+0000","last_clean":"2023-10-09T11:56:21.714226+0000","last_became_active":"2023-10-09T11:56:20.719763+0000","last_became_peered":"2023-10-09T11:56:20.719763+0000","last_unstale":"2023-10-09T11:56:21.714226+0000","last_undegraded":"2023-10-09T11:56:21.714226+0000","last_fullsized":"2023-10-09T11:56:21.714226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:14.186197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736937+0000","last_change":"2023-10-09T11:56:21.733865+0000","last_active":"2023-10-09T11:56:21.736937+0000","last_peered":"2023-10-09T11:56:21.736937+0000","last_clean":"2023-10-09T11:56:21.736937+0000","last_became_active":"2023-10-09T11:56:21.733526+0000","last_became_peered":"2023-10-09T11:56:21.733526+0000","last_unstale":"2023-10-09T11:56:21.736937+0000","last_undegraded":"2023-10-09T11:56:21.736937+0000","last_fullsized":"2023-10-09T11:56:21.736937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:47.950942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.746443+0000","last_change":"2023-10-09T11:56:20.705349+0000","last_active":"2023-10-09T11:56:21.746443+0000","last_peered":"2023-10-09T11:56:21.746443+0000","last_clean":"2023-10-09T11:56:21.746443+0000","last_became_active":"2023-10-09T11:56:20.704738+0000","last_became_peered":"2023-10-09T11:56:20.704738+0000","last_unstale":"2023-10-09T11:56:21.746443+0000","last_undegraded":"2023-10-09T11:56:21.746443+0000","last_fullsized":"2023-10-09T11:56:21.746443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:24.134640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737185+0000","last_change":"2023-10-09T11:56:21.724048+0000","last_active":"2023-10-09T11:56:21.737185+0000","last_peered":"2023-10-09T11:56:21.737185+0000","last_clean":"2023-10-09T11:56:21.737185+0000","last_became_active":"2023-10-09T11:56:21.723332+0000","last_became_peered":"2023-10-09T11:56:21.723332+0000","last_unstale":"2023-10-09T11:56:21.737185+0000","last_undegraded":"2023-10-09T11:56:21.737185+0000","last_fullsized":"2023-10-09T11:56:21.737185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:58.120697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.711033+0000","last_change":"2023-10-09T11:56:20.712131+0000","last_active":"2023-10-09T11:56:21.711033+0000","last_peered":"2023-10-09T11:56:21.711033+0000","last_clean":"2023-10-09T11:56:21.711033+0000","last_became_active":"2023-10-09T11:56:20.711817+0000","last_became_peered":"2023-10-09T11:56:20.711817+0000","last_unstale":"2023-10-09T11:56:21.711033+0000","last_undegraded":"2023-10-09T11:56:21.711033+0000","last_fullsized":"2023-10-09T11:56:21.711033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:55.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737033+0000","last_change":"2023-10-09T11:56:21.723303+0000","last_active":"2023-10-09T11:56:21.737033+0000","last_peered":"2023-10-09T11:56:21.737033+0000","last_clean":"2023-10-09T11:56:21.737033+0000","last_became_active":"2023-10-09T11:56:21.723016+0000","last_became_peered":"2023-10-09T11:56:21.723016+0000","last_unstale":"2023-10-09T11:56:21.737033+0000","last_undegraded":"2023-10-09T11:56:21.737033+0000","last_fullsized":"2023-10-09T11:56:21.737033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:36.733118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726576+0000","last_change":"2023-10-09T11:56:20.717556+0000","last_active":"2023-10-09T11:56:21.726576+0000","last_peered":"2023-10-09T11:56:21.726576+0000","last_clean":"2023-10-09T11:56:21.726576+0000","last_became_active":"2023-10-09T11:56:20.717237+0000","last_became_peered":"2023-10-09T11:56:20.717237+0000","last_unstale":"2023-10-09T11:56:21.726576+0000","last_undegraded":"2023-10-09T11:56:21.726576+0000","last_fullsized":"2023-10-09T11:56:21.726576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:29.791757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737197+0000","last_change":"2023-10-09T11:56:21.734925+0000","last_active":"2023-10-09T11:56:21.737197+0000","last_peered":"2023-10-09T11:56:21.737197+0000","last_clean":"2023-10-09T11:56:21.737197+0000","last_became_active":"2023-10-09T11:56:21.733487+0000","last_became_peered":"2023-10-09T11:56:21.733487+0000","last_unstale":"2023-10-09T11:56:21.737197+0000","last_undegraded":"2023-10-09T11:56:21.737197+0000","last_fullsized":"2023-10-09T11:56:21.737197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:12.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749714+0000","last_change":"2023-10-09T11:56:20.716387+0000","last_active":"2023-10-09T11:56:21.749714+0000","last_peered":"2023-10-09T11:56:21.749714+0000","last_clean":"2023-10-09T11:56:21.749714+0000","last_became_active":"2023-10-09T11:56:20.716123+0000","last_became_peered":"2023-10-09T11:56:20.716123+0000","last_unstale":"2023-10-09T11:56:21.749714+0000","last_undegraded":"2023-10-09T11:56:21.749714+0000","last_fullsized":"2023-10-09T11:56:21.749714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:53.616884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737333+0000","last_change":"2023-10-09T11:56:21.734785+0000","last_active":"2023-10-09T11:56:21.737333+0000","last_peered":"2023-10-09T11:56:21.737333+0000","last_clean":"2023-10-09T11:56:21.737333+0000","last_became_active":"2023-10-09T11:56:21.734255+0000","last_became_peered":"2023-10-09T11:56:21.734255+0000","last_unstale":"2023-10-09T11:56:21.737333+0000","last_undegraded":"2023-10-09T11:56:21.737333+0000","last_fullsized":"2023-10-09T11:56:21.737333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:05.125023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.715392+0000","last_change":"2023-10-09T11:56:20.717905+0000","last_active":"2023-10-09T11:56:21.715392+0000","last_peered":"2023-10-09T11:56:21.715392+0000","last_clean":"2023-10-09T11:56:21.715392+0000","last_became_active":"2023-10-09T11:56:20.717333+0000","last_became_peered":"2023-10-09T11:56:20.717333+0000","last_unstale":"2023-10-09T11:56:21.715392+0000","last_undegraded":"2023-10-09T11:56:21.715392+0000","last_fullsized":"2023-10-09T11:56:21.715392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:03.395168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728034+0000","last_change":"2023-10-09T11:56:21.719629+0000","last_active":"2023-10-09T11:56:21.728034+0000","last_peered":"2023-10-09T11:56:21.728034+0000","last_clean":"2023-10-09T11:56:21.728034+0000","last_became_active":"2023-10-09T11:56:21.719328+0000","last_became_peered":"2023-10-09T11:56:21.719328+0000","last_unstale":"2023-10-09T11:56:21.728034+0000","last_undegraded":"2023-10-09T11:56:21.728034+0000","last_fullsized":"2023-10-09T11:56:21.728034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:07.829845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.714770+0000","last_change":"2023-10-09T11:56:20.714316+0000","last_active":"2023-10-09T11:56:21.714770+0000","last_peered":"2023-10-09T11:56:21.714770+0000","last_clean":"2023-10-09T11:56:21.714770+0000","last_became_active":"2023-10-09T11:56:20.714037+0000","last_became_peered":"2023-10-09T11:56:20.714037+0000","last_unstale":"2023-10-09T11:56:21.714770+0000","last_undegraded":"2023-10-09T11:56:21.714770+0000","last_fullsized":"2023-10-09T11:56:21.714770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:13.847715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.738894+0000","last_change":"2023-10-09T11:56:21.733365+0000","last_active":"2023-10-09T11:56:21.738894+0000","last_peered":"2023-10-09T11:56:21.738894+0000","last_clean":"2023-10-09T11:56:21.738894+0000","last_became_active":"2023-10-09T11:56:21.732184+0000","last_became_peered":"2023-10-09T11:56:21.732184+0000","last_unstale":"2023-10-09T11:56:21.738894+0000","last_undegraded":"2023-10-09T11:56:21.738894+0000","last_fullsized":"2023-10-09T11:56:21.738894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:46.578290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726965+0000","last_change":"2023-10-09T11:56:20.716214+0000","last_active":"2023-10-09T11:56:21.726965+0000","last_peered":"2023-10-09T11:56:21.726965+0000","last_clean":"2023-10-09T11:56:21.726965+0000","last_became_active":"2023-10-09T11:56:20.715940+0000","last_became_peered":"2023-10-09T11:56:20.715940+0000","last_unstale":"2023-10-09T11:56:21.726965+0000","last_undegraded":"2023-10-09T11:56:21.726965+0000","last_fullsized":"2023-10-09T11:56:21.726965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:25.769420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736198+0000","last_change":"2023-10-09T11:56:21.729064+0000","last_active":"2023-10-09T11:56:21.736198+0000","last_peered":"2023-10-09T11:56:21.736198+0000","last_clean":"2023-10-09T11:56:21.736198+0000","last_became_active":"2023-10-09T11:56:21.728805+0000","last_became_peered":"2023-10-09T11:56:21.728805+0000","last_unstale":"2023-10-09T11:56:21.736198+0000","last_undegraded":"2023-10-09T11:56:21.736198+0000","last_fullsized":"2023-10-09T11:56:21.736198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:30.637715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.711050+0000","last_change":"2023-10-09T11:56:20.717005+0000","last_active":"2023-10-09T11:56:21.711050+0000","last_peered":"2023-10-09T11:56:21.711050+0000","last_clean":"2023-10-09T11:56:21.711050+0000","last_became_active":"2023-10-09T11:56:20.716678+0000","last_became_peered":"2023-10-09T11:56:20.716678+0000","last_unstale":"2023-10-09T11:56:21.711050+0000","last_undegraded":"2023-10-09T11:56:21.711050+0000","last_fullsized":"2023-10-09T11:56:21.711050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:44.924572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.743902+0000","last_change":"2023-10-09T11:56:21.740223+0000","last_active":"2023-10-09T11:56:21.743902+0000","last_peered":"2023-10-09T11:56:21.743902+0000","last_clean":"2023-10-09T11:56:21.743902+0000","last_became_active":"2023-10-09T11:56:21.739962+0000","last_became_peered":"2023-10-09T11:56:21.739962+0000","last_unstale":"2023-10-09T11:56:21.743902+0000","last_undegraded":"2023-10-09T11:56:21.743902+0000","last_fullsized":"2023-10-09T11:56:21.743902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:27.838394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.717018+0000","last_change":"2023-10-09T11:56:20.713638+0000","last_active":"2023-10-09T11:56:21.717018+0000","last_peered":"2023-10-09T11:56:21.717018+0000","last_clean":"2023-10-09T11:56:21.717018+0000","last_became_active":"2023-10-09T11:56:20.713331+0000","last_became_peered":"2023-10-09T11:56:20.713331+0000","last_unstale":"2023-10-09T11:56:21.717018+0000","last_undegraded":"2023-10-09T11:56:21.717018+0000","last_fullsized":"2023-10-09T11:56:21.717018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:47.876712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727159+0000","last_change":"2023-10-09T11:56:21.720936+0000","last_active":"2023-10-09T11:56:21.727159+0000","last_peered":"2023-10-09T11:56:21.727159+0000","last_clean":"2023-10-09T11:56:21.727159+0000","last_became_active":"2023-10-09T11:56:21.720655+0000","last_became_peered":"2023-10-09T11:56:21.720655+0000","last_unstale":"2023-10-09T11:56:21.727159+0000","last_undegraded":"2023-10-09T11:56:21.727159+0000","last_fullsized":"2023-10-09T11:56:21.727159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:37.038031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.711033+0000","last_change":"2023-10-09T11:56:20.721360+0000","last_active":"2023-10-09T11:56:21.711033+0000","last_peered":"2023-10-09T11:56:21.711033+0000","last_clean":"2023-10-09T11:56:21.711033+0000","last_became_active":"2023-10-09T11:56:20.720991+0000","last_became_peered":"2023-10-09T11:56:20.720991+0000","last_unstale":"2023-10-09T11:56:21.711033+0000","last_undegraded":"2023-10-09T11:56:21.711033+0000","last_fullsized":"2023-10-09T11:56:21.711033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:26.807418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728243+0000","last_change":"2023-10-09T11:56:21.725970+0000","last_active":"2023-10-09T11:56:21.728243+0000","last_peered":"2023-10-09T11:56:21.728243+0000","last_clean":"2023-10-09T11:56:21.728243+0000","last_became_active":"2023-10-09T11:56:21.725616+0000","last_became_peered":"2023-10-09T11:56:21.725616+0000","last_unstale":"2023-10-09T11:56:21.728243+0000","last_undegraded":"2023-10-09T11:56:21.728243+0000","last_fullsized":"2023-10-09T11:56:21.728243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:29.363507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.721955+0000","last_change":"2023-10-09T11:56:20.718297+0000","last_active":"2023-10-09T11:56:21.721955+0000","last_peered":"2023-10-09T11:56:21.721955+0000","last_clean":"2023-10-09T11:56:21.721955+0000","last_became_active":"2023-10-09T11:56:20.718053+0000","last_became_peered":"2023-10-09T11:56:20.718053+0000","last_unstale":"2023-10-09T11:56:21.721955+0000","last_undegraded":"2023-10-09T11:56:21.721955+0000","last_fullsized":"2023-10-09T11:56:21.721955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:04.827340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736390+0000","last_change":"2023-10-09T11:56:21.730382+0000","last_active":"2023-10-09T11:56:21.736390+0000","last_peered":"2023-10-09T11:56:21.736390+0000","last_clean":"2023-10-09T11:56:21.736390+0000","last_became_active":"2023-10-09T11:56:21.730116+0000","last_became_peered":"2023-10-09T11:56:21.730116+0000","last_unstale":"2023-10-09T11:56:21.736390+0000","last_undegraded":"2023-10-09T11:56:21.736390+0000","last_fullsized":"2023-10-09T11:56:21.736390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:01.611556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.714588+0000","last_change":"2023-10-09T11:56:20.712830+0000","last_active":"2023-10-09T11:56:21.714588+0000","last_peered":"2023-10-09T11:56:21.714588+0000","last_clean":"2023-10-09T11:56:21.714588+0000","last_became_active":"2023-10-09T11:56:20.712550+0000","last_became_peered":"2023-10-09T11:56:20.712550+0000","last_unstale":"2023-10-09T11:56:21.714588+0000","last_undegraded":"2023-10-09T11:56:21.714588+0000","last_fullsized":"2023-10-09T11:56:21.714588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:29.791757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":368,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724935+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:21.724935+0000","last_peered":"2023-10-09T11:56:21.724935+0000","last_clean":"2023-10-09T11:56:21.724935+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:21.724935+0000","last_undegraded":"2023-10-09T11:56:21.724935+0000","last_fullsized":"2023-10-09T11:56:21.724935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476921,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1556480,"data_stored":1044687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.48099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97199999999999998,"15min":1.0109999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.54500000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.83999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.747,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.58599999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.871},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.004,"15min":1.202},"last":0.92000000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.073},"last":0.89000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.94099999999999995},"last":0.79400000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.99299999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.04},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.98299999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476922,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":954368,"data_stored":454159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97199999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.71099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.121},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56799999999999995,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.216},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.59299999999999997,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":1.008,"15min":1.139},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.431},"last":0.84899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.59199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.042,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.94399999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.66600000000000004},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88300000000000001,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.436,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":1.143},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.437},"max":{"1min":0.96599999999999997,"5min":1.03,"15min":1.506},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.63200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509626,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":454249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.6759999999999999},"last":0.432}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.497,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":1.385},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":1.099},"last":0.41799999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":1.536},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.272},"last":0.55100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.66000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89600000000000002,"5min":1.115,"15min":1.7210000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":1.1220000000000001,"15min":1.552},"last":0.747}]},{"osd":5,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.58799999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.677},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.71799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.103,"5min":1.135,"15min":1.778},"last":0.73099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60999999999999999,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0580000000000001,"5min":1.22,"15min":1.623},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.022,"5min":1.0549999999999999,"15min":1.708},"last":0.76400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.659},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1419999999999999,"5min":1.1619999999999999,"15min":1.736},"last":0.71599999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073024,"statfs":{"total":96636764160,"available":96330776576,"internally_reserved":0,"allocated":1564672,"data_stored":1046617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46899999999999997,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.79000000000000004,"15min":1.367},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.4930000000000001},"last":0.504}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":1.8340000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.80800000000000005,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":1.855},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.755,"5min":0.80000000000000004,"15min":1.2330000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0549999999999999,"5min":1.587,"15min":1.587},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47199999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.099},"last":1.044},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60799999999999998,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.004,"5min":1.137,"15min":1.2},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0129999999999999,"5min":1.488,"15min":1.488},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.03,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.78900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0609999999999999,"15min":1.24},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81499999999999995,"15min":0.82399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0169999999999999,"5min":1.552,"15min":1.552},"last":0.80700000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":962560,"data_stored":454215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45800000000000002},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.75,"5min":0.755,"15min":0.83799999999999997},"last":0.40600000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.65800000000000003,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.97299999999999998},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":0.76700000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.443},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.76800000000000002,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.43099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.61599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.05,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.71199999999999997,"5min":0.57099999999999995,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.216,"15min":1.216},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.026,"5min":1.204,"15min":1.27},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.73399999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.1080000000000001,"5min":1.2310000000000001,"15min":1.246},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.83799999999999997},"min":{"1min":0.68899999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0720000000000001,"5min":1.155,"15min":1.2130000000000001},"last":0.65000000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509626,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":962560,"data_stored":454215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.47699999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.208},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":1.1970000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.63400000000000001,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.86699999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.208,"15min":1.327},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.1080000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.056,"5min":1.109,"15min":1.2829999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.63200000000000001,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.0509999999999999,"5min":1.125,"15min":1.3660000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":0.999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1459999999999999,"15min":1.218},"last":0.62}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.46999999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.333},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.3560000000000001},"last":0.66500000000000004}]}]},{"osd":4,"up_from":16,"seq":68719476921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310520,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061320,"statfs":{"total":96636764160,"available":96318791680,"internally_reserved":0,"allocated":966656,"data_stored":455695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.50700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.071},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.60299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.64300000000000002,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.2909999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.752},"min":{"1min":0.621,"5min":0.52400000000000002,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.995,"15min":1.234},"last":0.72899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.432},"max":{"1min":0.88,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.36099999999999999},"max":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.90700000000000003,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":1.125},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.373},"last":0.77100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":0.92700000000000005,"15min":1.2410000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46999999999999997},"max":{"1min":0.86199999999999999,"5min":1.0249999999999999,"15min":1.222},"last":0.56699999999999995}]}]},{"osd":5,"up_from":16,"seq":68719476921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":962560,"data_stored":454783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86399999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.318},"max":{"1min":0.88900000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.91500000000000004,"15min":1.0840000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.024,"5min":1.909,"15min":1.909},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.71599999999999997},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.56699999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.77800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":2.105,"15min":2.105},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.02,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.80300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0489999999999999,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.44,"15min":0.39900000000000002},"max":{"1min":0.95999999999999996,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:56:30.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:56:31.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.067+0000 7f3d66f9d700 1 Processor -- start 2023-10-09T11:56:31.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.067+0000 7f3d66f9d700 1 -- start start 2023-10-09T11:56:31.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.068+0000 7f3d66f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3d601566e0 0x7f3d600ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.068+0000 7f3d66f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600ca860 con 0x7f3d600cb900 2023-10-09T11:56:31.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.068+0000 7f3d66f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600cab40 con 0x7f3d60156310 2023-10-09T11:56:31.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.068+0000 7f3d66f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600cae20 con 0x7f3d601566e0 2023-10-09T11:56:31.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.068+0000 7f3d6679c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3d600cb900 0x7f3d600c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36644/0 (socket says 172.21.15.86:36644) 2023-10-09T11:56:31.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.068+0000 7f3d6679c700 1 -- 172.21.15.86:0/1116178987 learned_addr learned my addr 172.21.15.86:0/1116178987 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:31.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.069+0000 7f3d6579a700 1 --2- 172.21.15.86:0/1116178987 >> v2:172.21.15.135:3300/0 conn(0x7f3d601566e0 0x7f3d600ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.069+0000 7f3d64f99700 1 -- 172.21.15.86:0/1116178987 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969038870 0 0) 0x7f3d600ca860 con 0x7f3d600cb900 2023-10-09T11:56:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.069+0000 7f3d64f99700 1 -- 172.21.15.86:0/1116178987 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d4c003570 con 0x7f3d600cb900 2023-10-09T11:56:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.069+0000 7f3d6579a700 1 -- 172.21.15.86:0/1116178987 >> v1:172.21.15.135:6789/0 conn(0x7f3d60156310 legacy=0x7f3d600c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.069+0000 7f3d6579a700 1 -- 172.21.15.86:0/1116178987 >> v1:172.21.15.86:6789/0 conn(0x7f3d600cb900 legacy=0x7f3d600c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.069+0000 7f3d64f99700 1 -- 172.21.15.86:0/1116178987 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3166660226 0 0) 0x7f3d4c003570 con 0x7f3d600cb900 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.069+0000 7f3d6579a700 1 -- 172.21.15.86:0/1116178987 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600cb100 con 0x7f3d601566e0 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d6579a700 1 --2- 172.21.15.86:0/1116178987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d601566e0 0x7f3d600ae000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098e0 tx=0x7f3d500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1cb6be9dd086125 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d64f99700 1 -- 172.21.15.86:0/1116178987 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580017f0 con 0x7f3d601566e0 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d64f99700 1 -- 172.21.15.86:0/1116178987 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50011420 con 0x7f3d601566e0 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d64f99700 1 -- 172.21.15.86:0/1116178987 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d500117c0 con 0x7f3d601566e0 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d66f9d700 1 -- 172.21.15.86:0/1116178987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d601566e0 msgr2=0x7f3d600ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/1116178987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d601566e0 0x7f3d600ae000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098e0 tx=0x7f3d500091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d66f9d700 1 -- 172.21.15.86:0/1116178987 shutdown_connections 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.070+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/1116178987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d601566e0 0x7f3d600ae000 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.071+0000 7f3d66f9d700 1 -- 172.21.15.86:0/1116178987 >> 172.21.15.86:0/1116178987 conn(0x7f3d600cc1f0 msgr2=0x7f3d600cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:31.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.071+0000 7f3d66f9d700 1 -- 172.21.15.86:0/1116178987 shutdown_connections 2023-10-09T11:56:31.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.071+0000 7f3d66f9d700 1 -- 172.21.15.86:0/1116178987 wait complete. 2023-10-09T11:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.072+0000 7f3d66f9d700 1 Processor -- start 2023-10-09T11:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.072+0000 7f3d66f9d700 1 -- start start 2023-10-09T11:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d66f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d600cb900 0x7f3d60167d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d66f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60156310 0x7f3d6016d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d66f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d601566e0 0x7f3d6016dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d66f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6016c380 con 0x7f3d601566e0 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d66f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6016b770 con 0x7f3d60156310 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d66f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6016ba50 con 0x7f3d600cb900 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d6679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d601566e0 0x7f3d6016dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d6679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d601566e0 0x7f3d6016dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37648/0 (socket says 172.21.15.86:37648) 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.073+0000 7f3d6679c700 1 -- 172.21.15.86:0/72651881 learned_addr learned my addr 172.21.15.86:0/72651881 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6579a700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60156310 0x7f3d6016d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d65f9b700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d600cb900 0x7f3d60167d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6679c700 1 -- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d600cb900 msgr2=0x7f3d60167d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6679c700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d600cb900 0x7f3d60167d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6679c700 1 -- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60156310 msgr2=0x7f3d6016d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6679c700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60156310 0x7f3d6016d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6679c700 1 -- 172.21.15.86:0/72651881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50009420 con 0x7f3d601566e0 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6579a700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60156310 0x7f3d6016d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d6679c700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d601566e0 0x7f3d6016dc00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800cbe0 tx=0x7f3d58001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d55ffb700 1 -- 172.21.15.86:0/72651881 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58004dc0 con 0x7f3d601566e0 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d55ffb700 1 -- 172.21.15.86:0/72651881 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5800a6b0 con 0x7f3d601566e0 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d55ffb700 1 -- 172.21.15.86:0/72651881 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800aa70 con 0x7f3d601566e0 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6016bd30 con 0x7f3d601566e0 2023-10-09T11:56:31.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.074+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6016b290 con 0x7f3d601566e0 2023-10-09T11:56:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.076+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d60064d80 con 0x7f3d601566e0 2023-10-09T11:56:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.076+0000 7f3d55ffb700 1 -- 172.21.15.86:0/72651881 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d58007150 con 0x7f3d601566e0 2023-10-09T11:56:31.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.078+0000 7f3d55ffb700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3d44066f30 0x7f3d440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.078+0000 7f3d55ffb700 1 -- 172.21.15.86:0/72651881 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f3d58083d70 con 0x7f3d601566e0 2023-10-09T11:56:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.078+0000 7f3d65f9b700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3d44066f30 0x7f3d440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.078+0000 7f3d65f9b700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3d44066f30 0x7f3d440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c003860 tx=0x7f3d5c009040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:31.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.082+0000 7f3d55ffb700 1 -- 172.21.15.86:0/72651881 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d58050ee0 con 0x7f3d601566e0 2023-10-09T11:56:31.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.267+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d6004c3c0 con 0x7f3d44066f30 2023-10-09T11:56:31.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.277+0000 7f3d55ffb700 1 -- 172.21.15.86:0/72651881 <== mgr.6027 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288973 (secure 0 0 0) 0x7f3d6004c3c0 con 0x7f3d44066f30 2023-10-09T11:56:31.281 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3d44066f30 msgr2=0x7f3d440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3d44066f30 0x7f3d440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c003860 tx=0x7f3d5c009040 comp rx=0 tx=0).stop 2023-10-09T11:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d601566e0 msgr2=0x7f3d6016dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d601566e0 0x7f3d6016dc00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800cbe0 tx=0x7f3d58001640 comp rx=0 tx=0).stop 2023-10-09T11:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 shutdown_connections 2023-10-09T11:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3d44066f30 0x7f3d440693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d601566e0 0x7f3d6016dc00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d600cb900 0x7f3d60167d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 --2- 172.21.15.86:0/72651881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60156310 0x7f3d6016d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 >> 172.21.15.86:0/72651881 conn(0x7f3d600cc1f0 msgr2=0x7f3d6006a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 shutdown_connections 2023-10-09T11:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.281+0000 7f3d66f9d700 1 -- 172.21.15.86:0/72651881 wait complete. 2023-10-09T11:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:56:31.299 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T11:56:29.664656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432040,"kb_used_data":8680,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752542680,"statfs":{"total":773094113280,"available":770603704320,"internally_reserved":0,"allocated":8888320,"data_stored":4818620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001799"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734778+0000","last_change":"2023-10-09T11:56:21.727560+0000","last_active":"2023-10-09T11:56:21.734778+0000","last_peered":"2023-10-09T11:56:21.734778+0000","last_clean":"2023-10-09T11:56:21.734778+0000","last_became_active":"2023-10-09T11:56:21.727284+0000","last_became_peered":"2023-10-09T11:56:21.727284+0000","last_unstale":"2023-10-09T11:56:21.734778+0000","last_undegraded":"2023-10-09T11:56:21.734778+0000","last_fullsized":"2023-10-09T11:56:21.734778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:48.652438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736956+0000","last_change":"2023-10-09T11:56:21.729108+0000","last_active":"2023-10-09T11:56:21.736956+0000","last_peered":"2023-10-09T11:56:21.736956+0000","last_clean":"2023-10-09T11:56:21.736956+0000","last_became_active":"2023-10-09T11:56:21.728842+0000","last_became_peered":"2023-10-09T11:56:21.728842+0000","last_unstale":"2023-10-09T11:56:21.736956+0000","last_undegraded":"2023-10-09T11:56:21.736956+0000","last_fullsized":"2023-10-09T11:56:21.736956+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:26.824936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744629+0000","last_change":"2023-10-09T11:56:21.741555+0000","last_active":"2023-10-09T11:56:21.744629+0000","last_peered":"2023-10-09T11:56:21.744629+0000","last_clean":"2023-10-09T11:56:21.744629+0000","last_became_active":"2023-10-09T11:56:21.740226+0000","last_became_peered":"2023-10-09T11:56:21.740226+0000","last_unstale":"2023-10-09T11:56:21.744629+0000","last_undegraded":"2023-10-09T11:56:21.744629+0000","last_fullsized":"2023-10-09T11:56:21.744629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:16.707690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737003+0000","last_change":"2023-10-09T11:56:21.732980+0000","last_active":"2023-10-09T11:56:21.737003+0000","last_peered":"2023-10-09T11:56:21.737003+0000","last_clean":"2023-10-09T11:56:21.737003+0000","last_became_active":"2023-10-09T11:56:21.732665+0000","last_became_peered":"2023-10-09T11:56:21.732665+0000","last_unstale":"2023-10-09T11:56:21.737003+0000","last_undegraded":"2023-10-09T11:56:21.737003+0000","last_fullsized":"2023-10-09T11:56:21.737003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:23.262163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736150+0000","last_change":"2023-10-09T11:56:21.734050+0000","last_active":"2023-10-09T11:56:21.736150+0000","last_peered":"2023-10-09T11:56:21.736150+0000","last_clean":"2023-10-09T11:56:21.736150+0000","last_became_active":"2023-10-09T11:56:21.733768+0000","last_became_peered":"2023-10-09T11:56:21.733768+0000","last_unstale":"2023-10-09T11:56:21.736150+0000","last_undegraded":"2023-10-09T11:56:21.736150+0000","last_fullsized":"2023-10-09T11:56:21.736150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:06.479071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.723464+0000","last_change":"2023-10-09T11:56:21.718804+0000","last_active":"2023-10-09T11:56:21.723464+0000","last_peered":"2023-10-09T11:56:21.723464+0000","last_clean":"2023-10-09T11:56:21.723464+0000","last_became_active":"2023-10-09T11:56:21.718422+0000","last_became_peered":"2023-10-09T11:56:21.718422+0000","last_unstale":"2023-10-09T11:56:21.723464+0000","last_undegraded":"2023-10-09T11:56:21.723464+0000","last_fullsized":"2023-10-09T11:56:21.723464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:25.540806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736991+0000","last_change":"2023-10-09T11:56:21.734068+0000","last_active":"2023-10-09T11:56:21.736991+0000","last_peered":"2023-10-09T11:56:21.736991+0000","last_clean":"2023-10-09T11:56:21.736991+0000","last_became_active":"2023-10-09T11:56:21.733770+0000","last_became_peered":"2023-10-09T11:56:21.733770+0000","last_unstale":"2023-10-09T11:56:21.736991+0000","last_undegraded":"2023-10-09T11:56:21.736991+0000","last_fullsized":"2023-10-09T11:56:21.736991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:21.012489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728216+0000","last_change":"2023-10-09T11:56:21.726113+0000","last_active":"2023-10-09T11:56:21.728216+0000","last_peered":"2023-10-09T11:56:21.728216+0000","last_clean":"2023-10-09T11:56:21.728216+0000","last_became_active":"2023-10-09T11:56:21.725849+0000","last_became_peered":"2023-10-09T11:56:21.725849+0000","last_unstale":"2023-10-09T11:56:21.728216+0000","last_undegraded":"2023-10-09T11:56:21.728216+0000","last_fullsized":"2023-10-09T11:56:21.728216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:59:54.011094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735257+0000","last_change":"2023-10-09T11:56:21.724358+0000","last_active":"2023-10-09T11:56:21.735257+0000","last_peered":"2023-10-09T11:56:21.735257+0000","last_clean":"2023-10-09T11:56:21.735257+0000","last_became_active":"2023-10-09T11:56:21.724099+0000","last_became_peered":"2023-10-09T11:56:21.724099+0000","last_unstale":"2023-10-09T11:56:21.735257+0000","last_undegraded":"2023-10-09T11:56:21.735257+0000","last_fullsized":"2023-10-09T11:56:21.735257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:32.895299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727932+0000","last_change":"2023-10-09T11:56:21.720019+0000","last_active":"2023-10-09T11:56:21.727932+0000","last_peered":"2023-10-09T11:56:21.727932+0000","last_clean":"2023-10-09T11:56:21.727932+0000","last_became_active":"2023-10-09T11:56:21.719627+0000","last_became_peered":"2023-10-09T11:56:21.719627+0000","last_unstale":"2023-10-09T11:56:21.727932+0000","last_undegraded":"2023-10-09T11:56:21.727932+0000","last_fullsized":"2023-10-09T11:56:21.727932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:18.992708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.732657+0000","last_change":"2023-10-09T11:56:21.728925+0000","last_active":"2023-10-09T11:56:21.732657+0000","last_peered":"2023-10-09T11:56:21.732657+0000","last_clean":"2023-10-09T11:56:21.732657+0000","last_became_active":"2023-10-09T11:56:21.728639+0000","last_became_peered":"2023-10-09T11:56:21.728639+0000","last_unstale":"2023-10-09T11:56:21.732657+0000","last_undegraded":"2023-10-09T11:56:21.732657+0000","last_fullsized":"2023-10-09T11:56:21.732657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:14.853227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737023+0000","last_change":"2023-10-09T11:56:21.733517+0000","last_active":"2023-10-09T11:56:21.737023+0000","last_peered":"2023-10-09T11:56:21.737023+0000","last_clean":"2023-10-09T11:56:21.737023+0000","last_became_active":"2023-10-09T11:56:21.733235+0000","last_became_peered":"2023-10-09T11:56:21.733235+0000","last_unstale":"2023-10-09T11:56:21.737023+0000","last_undegraded":"2023-10-09T11:56:21.737023+0000","last_fullsized":"2023-10-09T11:56:21.737023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:49.661225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.730375+0000","last_change":"2023-10-09T11:56:21.725126+0000","last_active":"2023-10-09T11:56:21.730375+0000","last_peered":"2023-10-09T11:56:21.730375+0000","last_clean":"2023-10-09T11:56:21.730375+0000","last_became_active":"2023-10-09T11:56:21.724839+0000","last_became_peered":"2023-10-09T11:56:21.724839+0000","last_unstale":"2023-10-09T11:56:21.730375+0000","last_undegraded":"2023-10-09T11:56:21.730375+0000","last_fullsized":"2023-10-09T11:56:21.730375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:18.647810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.722578+0000","last_change":"2023-10-09T11:56:21.720924+0000","last_active":"2023-10-09T11:56:21.722578+0000","last_peered":"2023-10-09T11:56:21.722578+0000","last_clean":"2023-10-09T11:56:21.722578+0000","last_became_active":"2023-10-09T11:56:21.720633+0000","last_became_peered":"2023-10-09T11:56:21.720633+0000","last_unstale":"2023-10-09T11:56:21.722578+0000","last_undegraded":"2023-10-09T11:56:21.722578+0000","last_fullsized":"2023-10-09T11:56:21.722578+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:14.853227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734894+0000","last_change":"2023-10-09T11:56:21.728061+0000","last_active":"2023-10-09T11:56:21.734894+0000","last_peered":"2023-10-09T11:56:21.734894+0000","last_clean":"2023-10-09T11:56:21.734894+0000","last_became_active":"2023-10-09T11:56:21.727763+0000","last_became_peered":"2023-10-09T11:56:21.727763+0000","last_unstale":"2023-10-09T11:56:21.734894+0000","last_undegraded":"2023-10-09T11:56:21.734894+0000","last_fullsized":"2023-10-09T11:56:21.734894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:41.449746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737356+0000","last_change":"2023-10-09T11:56:21.725034+0000","last_active":"2023-10-09T11:56:21.737356+0000","last_peered":"2023-10-09T11:56:21.737356+0000","last_clean":"2023-10-09T11:56:21.737356+0000","last_became_active":"2023-10-09T11:56:21.724569+0000","last_became_peered":"2023-10-09T11:56:21.724569+0000","last_unstale":"2023-10-09T11:56:21.737356+0000","last_undegraded":"2023-10-09T11:56:21.737356+0000","last_fullsized":"2023-10-09T11:56:21.737356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:59.442411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736007+0000","last_change":"2023-10-09T11:56:21.727435+0000","last_active":"2023-10-09T11:56:21.736007+0000","last_peered":"2023-10-09T11:56:21.736007+0000","last_clean":"2023-10-09T11:56:21.736007+0000","last_became_active":"2023-10-09T11:56:21.727191+0000","last_became_peered":"2023-10-09T11:56:21.727191+0000","last_unstale":"2023-10-09T11:56:21.736007+0000","last_undegraded":"2023-10-09T11:56:21.736007+0000","last_fullsized":"2023-10-09T11:56:21.736007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:48.204740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741563+0000","last_change":"2023-10-09T11:56:21.738925+0000","last_active":"2023-10-09T11:56:21.741563+0000","last_peered":"2023-10-09T11:56:21.741563+0000","last_clean":"2023-10-09T11:56:21.741563+0000","last_became_active":"2023-10-09T11:56:21.738619+0000","last_became_peered":"2023-10-09T11:56:21.738619+0000","last_unstale":"2023-10-09T11:56:21.741563+0000","last_undegraded":"2023-10-09T11:56:21.741563+0000","last_fullsized":"2023-10-09T11:56:21.741563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:49.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735016+0000","last_change":"2023-10-09T11:56:21.728322+0000","last_active":"2023-10-09T11:56:21.735016+0000","last_peered":"2023-10-09T11:56:21.735016+0000","last_clean":"2023-10-09T11:56:21.735016+0000","last_became_active":"2023-10-09T11:56:21.728054+0000","last_became_peered":"2023-10-09T11:56:21.728054+0000","last_unstale":"2023-10-09T11:56:21.735016+0000","last_undegraded":"2023-10-09T11:56:21.735016+0000","last_fullsized":"2023-10-09T11:56:21.735016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:27.003547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741076+0000","last_change":"2023-10-09T11:56:21.737993+0000","last_active":"2023-10-09T11:56:21.741076+0000","last_peered":"2023-10-09T11:56:21.741076+0000","last_clean":"2023-10-09T11:56:21.741076+0000","last_became_active":"2023-10-09T11:56:21.737716+0000","last_became_peered":"2023-10-09T11:56:21.737716+0000","last_unstale":"2023-10-09T11:56:21.741076+0000","last_undegraded":"2023-10-09T11:56:21.741076+0000","last_fullsized":"2023-10-09T11:56:21.741076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:54.192440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744701+0000","last_change":"2023-10-09T11:56:21.743236+0000","last_active":"2023-10-09T11:56:21.744701+0000","last_peered":"2023-10-09T11:56:21.744701+0000","last_clean":"2023-10-09T11:56:21.744701+0000","last_became_active":"2023-10-09T11:56:21.742523+0000","last_became_peered":"2023-10-09T11:56:21.742523+0000","last_unstale":"2023-10-09T11:56:21.744701+0000","last_undegraded":"2023-10-09T11:56:21.744701+0000","last_fullsized":"2023-10-09T11:56:21.744701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:26.206018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734482+0000","last_change":"2023-10-09T11:56:21.727091+0000","last_active":"2023-10-09T11:56:21.734482+0000","last_peered":"2023-10-09T11:56:21.734482+0000","last_clean":"2023-10-09T11:56:21.734482+0000","last_became_active":"2023-10-09T11:56:21.726829+0000","last_became_peered":"2023-10-09T11:56:21.726829+0000","last_unstale":"2023-10-09T11:56:21.734482+0000","last_undegraded":"2023-10-09T11:56:21.734482+0000","last_fullsized":"2023-10-09T11:56:21.734482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:43.688318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.745171+0000","last_change":"2023-10-09T11:56:21.742009+0000","last_active":"2023-10-09T11:56:21.745171+0000","last_peered":"2023-10-09T11:56:21.745171+0000","last_clean":"2023-10-09T11:56:21.745171+0000","last_became_active":"2023-10-09T11:56:21.741642+0000","last_became_peered":"2023-10-09T11:56:21.741642+0000","last_unstale":"2023-10-09T11:56:21.745171+0000","last_undegraded":"2023-10-09T11:56:21.745171+0000","last_fullsized":"2023-10-09T11:56:21.745171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:24.489605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.730645+0000","last_change":"2023-10-09T11:56:21.724536+0000","last_active":"2023-10-09T11:56:21.730645+0000","last_peered":"2023-10-09T11:56:21.730645+0000","last_clean":"2023-10-09T11:56:21.730645+0000","last_became_active":"2023-10-09T11:56:21.724227+0000","last_became_peered":"2023-10-09T11:56:21.724227+0000","last_unstale":"2023-10-09T11:56:21.730645+0000","last_undegraded":"2023-10-09T11:56:21.730645+0000","last_fullsized":"2023-10-09T11:56:21.730645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:05.049086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724462+0000","last_change":"2023-10-09T11:56:21.720980+0000","last_active":"2023-10-09T11:56:21.724462+0000","last_peered":"2023-10-09T11:56:21.724462+0000","last_clean":"2023-10-09T11:56:21.724462+0000","last_became_active":"2023-10-09T11:56:21.720592+0000","last_became_peered":"2023-10-09T11:56:21.720592+0000","last_unstale":"2023-10-09T11:56:21.724462+0000","last_undegraded":"2023-10-09T11:56:21.724462+0000","last_fullsized":"2023-10-09T11:56:21.724462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:44.853284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.740331+0000","last_change":"2023-10-09T11:56:21.739142+0000","last_active":"2023-10-09T11:56:21.740331+0000","last_peered":"2023-10-09T11:56:21.740331+0000","last_clean":"2023-10-09T11:56:21.740331+0000","last_became_active":"2023-10-09T11:56:21.738876+0000","last_became_peered":"2023-10-09T11:56:21.738876+0000","last_unstale":"2023-10-09T11:56:21.740331+0000","last_undegraded":"2023-10-09T11:56:21.740331+0000","last_fullsized":"2023-10-09T11:56:21.740331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:06.346912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737216+0000","last_change":"2023-10-09T11:56:21.724392+0000","last_active":"2023-10-09T11:56:21.737216+0000","last_peered":"2023-10-09T11:56:21.737216+0000","last_clean":"2023-10-09T11:56:21.737216+0000","last_became_active":"2023-10-09T11:56:21.723762+0000","last_became_peered":"2023-10-09T11:56:21.723762+0000","last_unstale":"2023-10-09T11:56:21.737216+0000","last_undegraded":"2023-10-09T11:56:21.737216+0000","last_fullsized":"2023-10-09T11:56:21.737216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:49.591622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736205+0000","last_change":"2023-10-09T11:56:21.734029+0000","last_active":"2023-10-09T11:56:21.736205+0000","last_peered":"2023-10-09T11:56:21.736205+0000","last_clean":"2023-10-09T11:56:21.736205+0000","last_became_active":"2023-10-09T11:56:21.733735+0000","last_became_peered":"2023-10-09T11:56:21.733735+0000","last_unstale":"2023-10-09T11:56:21.736205+0000","last_undegraded":"2023-10-09T11:56:21.736205+0000","last_fullsized":"2023-10-09T11:56:21.736205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:32.576963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736373+0000","last_change":"2023-10-09T11:56:21.730249+0000","last_active":"2023-10-09T11:56:21.736373+0000","last_peered":"2023-10-09T11:56:21.736373+0000","last_clean":"2023-10-09T11:56:21.736373+0000","last_became_active":"2023-10-09T11:56:21.730001+0000","last_became_peered":"2023-10-09T11:56:21.730001+0000","last_unstale":"2023-10-09T11:56:21.736373+0000","last_undegraded":"2023-10-09T11:56:21.736373+0000","last_fullsized":"2023-10-09T11:56:21.736373+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:20.936531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744573+0000","last_change":"2023-10-09T11:56:21.741015+0000","last_active":"2023-10-09T11:56:21.744573+0000","last_peered":"2023-10-09T11:56:21.744573+0000","last_clean":"2023-10-09T11:56:21.744573+0000","last_became_active":"2023-10-09T11:56:21.740740+0000","last_became_peered":"2023-10-09T11:56:21.740740+0000","last_unstale":"2023-10-09T11:56:21.744573+0000","last_undegraded":"2023-10-09T11:56:21.744573+0000","last_fullsized":"2023-10-09T11:56:21.744573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:59.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724635+0000","last_change":"2023-10-09T11:56:21.721632+0000","last_active":"2023-10-09T11:56:21.724635+0000","last_peered":"2023-10-09T11:56:21.724635+0000","last_clean":"2023-10-09T11:56:21.724635+0000","last_became_active":"2023-10-09T11:56:21.721370+0000","last_became_peered":"2023-10-09T11:56:21.721370+0000","last_unstale":"2023-10-09T11:56:21.724635+0000","last_undegraded":"2023-10-09T11:56:21.724635+0000","last_fullsized":"2023-10-09T11:56:21.724635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:18:36.912588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737380+0000","last_change":"2023-10-09T11:56:21.726879+0000","last_active":"2023-10-09T11:56:21.737380+0000","last_peered":"2023-10-09T11:56:21.737380+0000","last_clean":"2023-10-09T11:56:21.737380+0000","last_became_active":"2023-10-09T11:56:21.726604+0000","last_became_peered":"2023-10-09T11:56:21.726604+0000","last_unstale":"2023-10-09T11:56:21.737380+0000","last_undegraded":"2023-10-09T11:56:21.737380+0000","last_fullsized":"2023-10-09T11:56:21.737380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:30.537793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737869+0000","last_change":"2023-10-09T11:56:21.730223+0000","last_active":"2023-10-09T11:56:21.737869+0000","last_peered":"2023-10-09T11:56:21.737869+0000","last_clean":"2023-10-09T11:56:21.737869+0000","last_became_active":"2023-10-09T11:56:21.729977+0000","last_became_peered":"2023-10-09T11:56:21.729977+0000","last_unstale":"2023-10-09T11:56:21.737869+0000","last_undegraded":"2023-10-09T11:56:21.737869+0000","last_fullsized":"2023-10-09T11:56:21.737869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:40.105701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749280+0000","last_change":"2023-10-09T11:56:20.719204+0000","last_active":"2023-10-09T11:56:21.749280+0000","last_peered":"2023-10-09T11:56:21.749280+0000","last_clean":"2023-10-09T11:56:21.749280+0000","last_became_active":"2023-10-09T11:56:20.718952+0000","last_became_peered":"2023-10-09T11:56:20.718952+0000","last_unstale":"2023-10-09T11:56:21.749280+0000","last_undegraded":"2023-10-09T11:56:21.749280+0000","last_fullsized":"2023-10-09T11:56:21.749280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:54.760347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.732078+0000","last_change":"2023-10-09T11:56:21.726518+0000","last_active":"2023-10-09T11:56:21.732078+0000","last_peered":"2023-10-09T11:56:21.732078+0000","last_clean":"2023-10-09T11:56:21.732078+0000","last_became_active":"2023-10-09T11:56:21.726248+0000","last_became_peered":"2023-10-09T11:56:21.726248+0000","last_unstale":"2023-10-09T11:56:21.732078+0000","last_undegraded":"2023-10-09T11:56:21.732078+0000","last_fullsized":"2023-10-09T11:56:21.732078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:30.797269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.745061+0000","last_change":"2023-10-09T11:56:20.716908+0000","last_active":"2023-10-09T11:56:21.745061+0000","last_peered":"2023-10-09T11:56:21.745061+0000","last_clean":"2023-10-09T11:56:21.745061+0000","last_became_active":"2023-10-09T11:56:20.716566+0000","last_became_peered":"2023-10-09T11:56:20.716566+0000","last_unstale":"2023-10-09T11:56:21.745061+0000","last_undegraded":"2023-10-09T11:56:21.745061+0000","last_fullsized":"2023-10-09T11:56:21.745061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:25.853333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724483+0000","last_change":"2023-10-09T11:56:21.717627+0000","last_active":"2023-10-09T11:56:21.724483+0000","last_peered":"2023-10-09T11:56:21.724483+0000","last_clean":"2023-10-09T11:56:21.724483+0000","last_became_active":"2023-10-09T11:56:21.717344+0000","last_became_peered":"2023-10-09T11:56:21.717344+0000","last_unstale":"2023-10-09T11:56:21.724483+0000","last_undegraded":"2023-10-09T11:56:21.724483+0000","last_fullsized":"2023-10-09T11:56:21.724483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:47.385573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749185+0000","last_change":"2023-10-09T11:56:20.721852+0000","last_active":"2023-10-09T11:56:21.749185+0000","last_peered":"2023-10-09T11:56:21.749185+0000","last_clean":"2023-10-09T11:56:21.749185+0000","last_became_active":"2023-10-09T11:56:20.721109+0000","last_became_peered":"2023-10-09T11:56:20.721109+0000","last_unstale":"2023-10-09T11:56:21.749185+0000","last_undegraded":"2023-10-09T11:56:21.749185+0000","last_fullsized":"2023-10-09T11:56:21.749185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:37.253490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.738875+0000","last_change":"2023-10-09T11:56:21.733024+0000","last_active":"2023-10-09T11:56:21.738875+0000","last_peered":"2023-10-09T11:56:21.738875+0000","last_clean":"2023-10-09T11:56:21.738875+0000","last_became_active":"2023-10-09T11:56:21.732750+0000","last_became_peered":"2023-10-09T11:56:21.732750+0000","last_unstale":"2023-10-09T11:56:21.738875+0000","last_undegraded":"2023-10-09T11:56:21.738875+0000","last_fullsized":"2023-10-09T11:56:21.738875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:44.583102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.747359+0000","last_change":"2023-10-09T11:56:20.720001+0000","last_active":"2023-10-09T11:56:21.747359+0000","last_peered":"2023-10-09T11:56:21.747359+0000","last_clean":"2023-10-09T11:56:21.747359+0000","last_became_active":"2023-10-09T11:56:20.719706+0000","last_became_peered":"2023-10-09T11:56:20.719706+0000","last_unstale":"2023-10-09T11:56:21.747359+0000","last_undegraded":"2023-10-09T11:56:21.747359+0000","last_fullsized":"2023-10-09T11:56:21.747359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:04.043574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.734460+0000","last_change":"2023-10-09T11:56:21.726677+0000","last_active":"2023-10-09T11:56:21.734460+0000","last_peered":"2023-10-09T11:56:21.734460+0000","last_clean":"2023-10-09T11:56:21.734460+0000","last_became_active":"2023-10-09T11:56:21.726421+0000","last_became_peered":"2023-10-09T11:56:21.726421+0000","last_unstale":"2023-10-09T11:56:21.734460+0000","last_undegraded":"2023-10-09T11:56:21.734460+0000","last_fullsized":"2023-10-09T11:56:21.734460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:43.116232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.746671+0000","last_change":"2023-10-09T11:56:20.705112+0000","last_active":"2023-10-09T11:56:21.746671+0000","last_peered":"2023-10-09T11:56:21.746671+0000","last_clean":"2023-10-09T11:56:21.746671+0000","last_became_active":"2023-10-09T11:56:20.704825+0000","last_became_peered":"2023-10-09T11:56:20.704825+0000","last_unstale":"2023-10-09T11:56:21.746671+0000","last_undegraded":"2023-10-09T11:56:21.746671+0000","last_fullsized":"2023-10-09T11:56:21.746671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:13.831272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741040+0000","last_change":"2023-10-09T11:56:21.738417+0000","last_active":"2023-10-09T11:56:21.741040+0000","last_peered":"2023-10-09T11:56:21.741040+0000","last_clean":"2023-10-09T11:56:21.741040+0000","last_became_active":"2023-10-09T11:56:21.738157+0000","last_became_peered":"2023-10-09T11:56:21.738157+0000","last_unstale":"2023-10-09T11:56:21.741040+0000","last_undegraded":"2023-10-09T11:56:21.741040+0000","last_fullsized":"2023-10-09T11:56:21.741040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:48.060078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.746492+0000","last_change":"2023-10-09T11:56:20.717372+0000","last_active":"2023-10-09T11:56:21.746492+0000","last_peered":"2023-10-09T11:56:21.746492+0000","last_clean":"2023-10-09T11:56:21.746492+0000","last_became_active":"2023-10-09T11:56:20.717121+0000","last_became_peered":"2023-10-09T11:56:20.717121+0000","last_unstale":"2023-10-09T11:56:21.746492+0000","last_undegraded":"2023-10-09T11:56:21.746492+0000","last_fullsized":"2023-10-09T11:56:21.746492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:59:55.038857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736308+0000","last_change":"2023-10-09T11:56:21.731730+0000","last_active":"2023-10-09T11:56:21.736308+0000","last_peered":"2023-10-09T11:56:21.736308+0000","last_clean":"2023-10-09T11:56:21.736308+0000","last_became_active":"2023-10-09T11:56:21.731476+0000","last_became_peered":"2023-10-09T11:56:21.731476+0000","last_unstale":"2023-10-09T11:56:21.736308+0000","last_undegraded":"2023-10-09T11:56:21.736308+0000","last_fullsized":"2023-10-09T11:56:21.736308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:37.766595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726523+0000","last_change":"2023-10-09T11:56:20.713478+0000","last_active":"2023-10-09T11:56:21.726523+0000","last_peered":"2023-10-09T11:56:21.726523+0000","last_clean":"2023-10-09T11:56:21.726523+0000","last_became_active":"2023-10-09T11:56:20.713207+0000","last_became_peered":"2023-10-09T11:56:20.713207+0000","last_unstale":"2023-10-09T11:56:21.726523+0000","last_undegraded":"2023-10-09T11:56:21.726523+0000","last_fullsized":"2023-10-09T11:56:21.726523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:40.444234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735786+0000","last_change":"2023-10-09T11:56:21.726648+0000","last_active":"2023-10-09T11:56:21.735786+0000","last_peered":"2023-10-09T11:56:21.735786+0000","last_clean":"2023-10-09T11:56:21.735786+0000","last_became_active":"2023-10-09T11:56:21.726392+0000","last_became_peered":"2023-10-09T11:56:21.726392+0000","last_unstale":"2023-10-09T11:56:21.735786+0000","last_undegraded":"2023-10-09T11:56:21.735786+0000","last_fullsized":"2023-10-09T11:56:21.735786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:21.324709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.716267+0000","last_change":"2023-10-09T11:56:20.708802+0000","last_active":"2023-10-09T11:56:21.716267+0000","last_peered":"2023-10-09T11:56:21.716267+0000","last_clean":"2023-10-09T11:56:21.716267+0000","last_became_active":"2023-10-09T11:56:20.708502+0000","last_became_peered":"2023-10-09T11:56:20.708502+0000","last_unstale":"2023-10-09T11:56:21.716267+0000","last_undegraded":"2023-10-09T11:56:21.716267+0000","last_fullsized":"2023-10-09T11:56:21.716267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:53.616884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736591+0000","last_change":"2023-10-09T11:56:21.733157+0000","last_active":"2023-10-09T11:56:21.736591+0000","last_peered":"2023-10-09T11:56:21.736591+0000","last_clean":"2023-10-09T11:56:21.736591+0000","last_became_active":"2023-10-09T11:56:21.732863+0000","last_became_peered":"2023-10-09T11:56:21.732863+0000","last_unstale":"2023-10-09T11:56:21.736591+0000","last_undegraded":"2023-10-09T11:56:21.736591+0000","last_fullsized":"2023-10-09T11:56:21.736591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:26.774932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727711+0000","last_change":"2023-10-09T11:56:20.721592+0000","last_active":"2023-10-09T11:56:21.727711+0000","last_peered":"2023-10-09T11:56:21.727711+0000","last_clean":"2023-10-09T11:56:21.727711+0000","last_became_active":"2023-10-09T11:56:20.721217+0000","last_became_peered":"2023-10-09T11:56:20.721217+0000","last_unstale":"2023-10-09T11:56:21.727711+0000","last_undegraded":"2023-10-09T11:56:21.727711+0000","last_fullsized":"2023-10-09T11:56:21.727711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:05.341400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741601+0000","last_change":"2023-10-09T11:56:21.739055+0000","last_active":"2023-10-09T11:56:21.741601+0000","last_peered":"2023-10-09T11:56:21.741601+0000","last_clean":"2023-10-09T11:56:21.741601+0000","last_became_active":"2023-10-09T11:56:21.738764+0000","last_became_peered":"2023-10-09T11:56:21.738764+0000","last_unstale":"2023-10-09T11:56:21.741601+0000","last_undegraded":"2023-10-09T11:56:21.741601+0000","last_fullsized":"2023-10-09T11:56:21.741601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:13.947762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.722332+0000","last_change":"2023-10-09T11:56:20.706578+0000","last_active":"2023-10-09T11:56:21.722332+0000","last_peered":"2023-10-09T11:56:21.722332+0000","last_clean":"2023-10-09T11:56:21.722332+0000","last_became_active":"2023-10-09T11:56:20.706283+0000","last_became_peered":"2023-10-09T11:56:20.706283+0000","last_unstale":"2023-10-09T11:56:21.722332+0000","last_undegraded":"2023-10-09T11:56:21.722332+0000","last_fullsized":"2023-10-09T11:56:21.722332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:34:59.973312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728052+0000","last_change":"2023-10-09T11:56:21.725186+0000","last_active":"2023-10-09T11:56:21.728052+0000","last_peered":"2023-10-09T11:56:21.728052+0000","last_clean":"2023-10-09T11:56:21.728052+0000","last_became_active":"2023-10-09T11:56:21.724896+0000","last_became_peered":"2023-10-09T11:56:21.724896+0000","last_unstale":"2023-10-09T11:56:21.728052+0000","last_undegraded":"2023-10-09T11:56:21.728052+0000","last_fullsized":"2023-10-09T11:56:21.728052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:40.414431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.750562+0000","last_change":"2023-10-09T11:56:20.722183+0000","last_active":"2023-10-09T11:56:21.750562+0000","last_peered":"2023-10-09T11:56:21.750562+0000","last_clean":"2023-10-09T11:56:21.750562+0000","last_became_active":"2023-10-09T11:56:20.721914+0000","last_became_peered":"2023-10-09T11:56:20.721914+0000","last_unstale":"2023-10-09T11:56:21.750562+0000","last_undegraded":"2023-10-09T11:56:21.750562+0000","last_fullsized":"2023-10-09T11:56:21.750562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:22.256651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744668+0000","last_change":"2023-10-09T11:56:21.742120+0000","last_active":"2023-10-09T11:56:21.744668+0000","last_peered":"2023-10-09T11:56:21.744668+0000","last_clean":"2023-10-09T11:56:21.744668+0000","last_became_active":"2023-10-09T11:56:21.740577+0000","last_became_peered":"2023-10-09T11:56:21.740577+0000","last_unstale":"2023-10-09T11:56:21.744668+0000","last_undegraded":"2023-10-09T11:56:21.744668+0000","last_fullsized":"2023-10-09T11:56:21.744668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:53.464984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"79'6","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.752742+0000","last_change":"2023-10-09T11:56:20.720689+0000","last_active":"2023-10-09T11:56:21.752742+0000","last_peered":"2023-10-09T11:56:21.752742+0000","last_clean":"2023-10-09T11:56:21.752742+0000","last_became_active":"2023-10-09T11:56:20.720386+0000","last_became_peered":"2023-10-09T11:56:20.720386+0000","last_unstale":"2023-10-09T11:56:21.752742+0000","last_undegraded":"2023-10-09T11:56:21.752742+0000","last_fullsized":"2023-10-09T11:56:21.752742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.889018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737181+0000","last_change":"2023-10-09T11:56:21.734936+0000","last_active":"2023-10-09T11:56:21.737181+0000","last_peered":"2023-10-09T11:56:21.737181+0000","last_clean":"2023-10-09T11:56:21.737181+0000","last_became_active":"2023-10-09T11:56:21.733883+0000","last_became_peered":"2023-10-09T11:56:21.733883+0000","last_unstale":"2023-10-09T11:56:21.737181+0000","last_undegraded":"2023-10-09T11:56:21.737181+0000","last_fullsized":"2023-10-09T11:56:21.737181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:28.922470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.747265+0000","last_change":"2023-10-09T11:56:20.705581+0000","last_active":"2023-10-09T11:56:21.747265+0000","last_peered":"2023-10-09T11:56:21.747265+0000","last_clean":"2023-10-09T11:56:21.747265+0000","last_became_active":"2023-10-09T11:56:20.705258+0000","last_became_peered":"2023-10-09T11:56:20.705258+0000","last_unstale":"2023-10-09T11:56:21.747265+0000","last_undegraded":"2023-10-09T11:56:21.747265+0000","last_fullsized":"2023-10-09T11:56:21.747265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:52.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741462+0000","last_change":"2023-10-09T11:56:21.738082+0000","last_active":"2023-10-09T11:56:21.741462+0000","last_peered":"2023-10-09T11:56:21.741462+0000","last_clean":"2023-10-09T11:56:21.741462+0000","last_became_active":"2023-10-09T11:56:21.737686+0000","last_became_peered":"2023-10-09T11:56:21.737686+0000","last_unstale":"2023-10-09T11:56:21.741462+0000","last_undegraded":"2023-10-09T11:56:21.741462+0000","last_fullsized":"2023-10-09T11:56:21.741462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:34.111432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.715188+0000","last_change":"2023-10-09T11:56:20.717933+0000","last_active":"2023-10-09T11:56:21.715188+0000","last_peered":"2023-10-09T11:56:21.715188+0000","last_clean":"2023-10-09T11:56:21.715188+0000","last_became_active":"2023-10-09T11:56:20.717656+0000","last_became_peered":"2023-10-09T11:56:20.717656+0000","last_unstale":"2023-10-09T11:56:21.715188+0000","last_undegraded":"2023-10-09T11:56:21.715188+0000","last_fullsized":"2023-10-09T11:56:21.715188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:17.987196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.735499+0000","last_change":"2023-10-09T11:56:21.730799+0000","last_active":"2023-10-09T11:56:21.735499+0000","last_peered":"2023-10-09T11:56:21.735499+0000","last_clean":"2023-10-09T11:56:21.735499+0000","last_became_active":"2023-10-09T11:56:21.730494+0000","last_became_peered":"2023-10-09T11:56:21.730494+0000","last_unstale":"2023-10-09T11:56:21.735499+0000","last_undegraded":"2023-10-09T11:56:21.735499+0000","last_fullsized":"2023-10-09T11:56:21.735499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:30.797269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726632+0000","last_change":"2023-10-09T11:56:20.719255+0000","last_active":"2023-10-09T11:56:21.726632+0000","last_peered":"2023-10-09T11:56:21.726632+0000","last_clean":"2023-10-09T11:56:21.726632+0000","last_became_active":"2023-10-09T11:56:20.718989+0000","last_became_peered":"2023-10-09T11:56:20.718989+0000","last_unstale":"2023-10-09T11:56:21.726632+0000","last_undegraded":"2023-10-09T11:56:21.726632+0000","last_fullsized":"2023-10-09T11:56:21.726632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:31.889787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.745152+0000","last_change":"2023-10-09T11:56:21.741336+0000","last_active":"2023-10-09T11:56:21.745152+0000","last_peered":"2023-10-09T11:56:21.745152+0000","last_clean":"2023-10-09T11:56:21.745152+0000","last_became_active":"2023-10-09T11:56:21.740591+0000","last_became_peered":"2023-10-09T11:56:21.740591+0000","last_unstale":"2023-10-09T11:56:21.745152+0000","last_undegraded":"2023-10-09T11:56:21.745152+0000","last_fullsized":"2023-10-09T11:56:21.745152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:51:58.219914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"79'8","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.753166+0000","last_change":"2023-10-09T11:56:20.722649+0000","last_active":"2023-10-09T11:56:21.753166+0000","last_peered":"2023-10-09T11:56:21.753166+0000","last_clean":"2023-10-09T11:56:21.753166+0000","last_became_active":"2023-10-09T11:56:20.722271+0000","last_became_peered":"2023-10-09T11:56:20.722271+0000","last_unstale":"2023-10-09T11:56:21.753166+0000","last_undegraded":"2023-10-09T11:56:21.753166+0000","last_fullsized":"2023-10-09T11:56:21.753166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:27.916958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.741545+0000","last_change":"2023-10-09T11:56:21.738336+0000","last_active":"2023-10-09T11:56:21.741545+0000","last_peered":"2023-10-09T11:56:21.741545+0000","last_clean":"2023-10-09T11:56:21.741545+0000","last_became_active":"2023-10-09T11:56:21.738034+0000","last_became_peered":"2023-10-09T11:56:21.738034+0000","last_unstale":"2023-10-09T11:56:21.741545+0000","last_undegraded":"2023-10-09T11:56:21.741545+0000","last_fullsized":"2023-10-09T11:56:21.741545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:36.155599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744199+0000","last_change":"2023-10-09T11:56:20.706126+0000","last_active":"2023-10-09T11:56:21.744199+0000","last_peered":"2023-10-09T11:56:21.744199+0000","last_clean":"2023-10-09T11:56:21.744199+0000","last_became_active":"2023-10-09T11:56:20.705869+0000","last_became_peered":"2023-10-09T11:56:20.705869+0000","last_unstale":"2023-10-09T11:56:21.744199+0000","last_undegraded":"2023-10-09T11:56:21.744199+0000","last_fullsized":"2023-10-09T11:56:21.744199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:19.541763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737352+0000","last_change":"2023-10-09T11:56:21.735010+0000","last_active":"2023-10-09T11:56:21.737352+0000","last_peered":"2023-10-09T11:56:21.737352+0000","last_clean":"2023-10-09T11:56:21.737352+0000","last_became_active":"2023-10-09T11:56:21.734689+0000","last_became_peered":"2023-10-09T11:56:21.734689+0000","last_unstale":"2023-10-09T11:56:21.737352+0000","last_undegraded":"2023-10-09T11:56:21.737352+0000","last_fullsized":"2023-10-09T11:56:21.737352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:55.071895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749062+0000","last_change":"2023-10-09T11:56:20.718089+0000","last_active":"2023-10-09T11:56:21.749062+0000","last_peered":"2023-10-09T11:56:21.749062+0000","last_clean":"2023-10-09T11:56:21.749062+0000","last_became_active":"2023-10-09T11:56:20.717643+0000","last_became_peered":"2023-10-09T11:56:20.717643+0000","last_unstale":"2023-10-09T11:56:21.749062+0000","last_undegraded":"2023-10-09T11:56:21.749062+0000","last_fullsized":"2023-10-09T11:56:21.749062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:06.635841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727850+0000","last_change":"2023-10-09T11:56:21.726015+0000","last_active":"2023-10-09T11:56:21.727850+0000","last_peered":"2023-10-09T11:56:21.727850+0000","last_clean":"2023-10-09T11:56:21.727850+0000","last_became_active":"2023-10-09T11:56:21.725747+0000","last_became_peered":"2023-10-09T11:56:21.725747+0000","last_unstale":"2023-10-09T11:56:21.727850+0000","last_undegraded":"2023-10-09T11:56:21.727850+0000","last_fullsized":"2023-10-09T11:56:21.727850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:18.937211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.747742+0000","last_change":"2023-10-09T11:56:20.720031+0000","last_active":"2023-10-09T11:56:21.747742+0000","last_peered":"2023-10-09T11:56:21.747742+0000","last_clean":"2023-10-09T11:56:21.747742+0000","last_became_active":"2023-10-09T11:56:20.719700+0000","last_became_peered":"2023-10-09T11:56:20.719700+0000","last_unstale":"2023-10-09T11:56:21.747742+0000","last_undegraded":"2023-10-09T11:56:21.747742+0000","last_fullsized":"2023-10-09T11:56:21.747742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:20.006977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.744651+0000","last_change":"2023-10-09T11:56:21.741781+0000","last_active":"2023-10-09T11:56:21.744651+0000","last_peered":"2023-10-09T11:56:21.744651+0000","last_clean":"2023-10-09T11:56:21.744651+0000","last_became_active":"2023-10-09T11:56:21.741041+0000","last_became_peered":"2023-10-09T11:56:21.741041+0000","last_unstale":"2023-10-09T11:56:21.744651+0000","last_undegraded":"2023-10-09T11:56:21.744651+0000","last_fullsized":"2023-10-09T11:56:21.744651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:33.551552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.714226+0000","last_change":"2023-10-09T11:56:20.720013+0000","last_active":"2023-10-09T11:56:21.714226+0000","last_peered":"2023-10-09T11:56:21.714226+0000","last_clean":"2023-10-09T11:56:21.714226+0000","last_became_active":"2023-10-09T11:56:20.719763+0000","last_became_peered":"2023-10-09T11:56:20.719763+0000","last_unstale":"2023-10-09T11:56:21.714226+0000","last_undegraded":"2023-10-09T11:56:21.714226+0000","last_fullsized":"2023-10-09T11:56:21.714226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:14.186197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736937+0000","last_change":"2023-10-09T11:56:21.733865+0000","last_active":"2023-10-09T11:56:21.736937+0000","last_peered":"2023-10-09T11:56:21.736937+0000","last_clean":"2023-10-09T11:56:21.736937+0000","last_became_active":"2023-10-09T11:56:21.733526+0000","last_became_peered":"2023-10-09T11:56:21.733526+0000","last_unstale":"2023-10-09T11:56:21.736937+0000","last_undegraded":"2023-10-09T11:56:21.736937+0000","last_fullsized":"2023-10-09T11:56:21.736937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:47.950942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.746443+0000","last_change":"2023-10-09T11:56:20.705349+0000","last_active":"2023-10-09T11:56:21.746443+0000","last_peered":"2023-10-09T11:56:21.746443+0000","last_clean":"2023-10-09T11:56:21.746443+0000","last_became_active":"2023-10-09T11:56:20.704738+0000","last_became_peered":"2023-10-09T11:56:20.704738+0000","last_unstale":"2023-10-09T11:56:21.746443+0000","last_undegraded":"2023-10-09T11:56:21.746443+0000","last_fullsized":"2023-10-09T11:56:21.746443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:24.134640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737185+0000","last_change":"2023-10-09T11:56:21.724048+0000","last_active":"2023-10-09T11:56:21.737185+0000","last_peered":"2023-10-09T11:56:21.737185+0000","last_clean":"2023-10-09T11:56:21.737185+0000","last_became_active":"2023-10-09T11:56:21.723332+0000","last_became_peered":"2023-10-09T11:56:21.723332+0000","last_unstale":"2023-10-09T11:56:21.737185+0000","last_undegraded":"2023-10-09T11:56:21.737185+0000","last_fullsized":"2023-10-09T11:56:21.737185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:10:58.120697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.711033+0000","last_change":"2023-10-09T11:56:20.712131+0000","last_active":"2023-10-09T11:56:21.711033+0000","last_peered":"2023-10-09T11:56:21.711033+0000","last_clean":"2023-10-09T11:56:21.711033+0000","last_became_active":"2023-10-09T11:56:20.711817+0000","last_became_peered":"2023-10-09T11:56:20.711817+0000","last_unstale":"2023-10-09T11:56:21.711033+0000","last_undegraded":"2023-10-09T11:56:21.711033+0000","last_fullsized":"2023-10-09T11:56:21.711033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:55.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737033+0000","last_change":"2023-10-09T11:56:21.723303+0000","last_active":"2023-10-09T11:56:21.737033+0000","last_peered":"2023-10-09T11:56:21.737033+0000","last_clean":"2023-10-09T11:56:21.737033+0000","last_became_active":"2023-10-09T11:56:21.723016+0000","last_became_peered":"2023-10-09T11:56:21.723016+0000","last_unstale":"2023-10-09T11:56:21.737033+0000","last_undegraded":"2023-10-09T11:56:21.737033+0000","last_fullsized":"2023-10-09T11:56:21.737033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:36.733118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726576+0000","last_change":"2023-10-09T11:56:20.717556+0000","last_active":"2023-10-09T11:56:21.726576+0000","last_peered":"2023-10-09T11:56:21.726576+0000","last_clean":"2023-10-09T11:56:21.726576+0000","last_became_active":"2023-10-09T11:56:20.717237+0000","last_became_peered":"2023-10-09T11:56:20.717237+0000","last_unstale":"2023-10-09T11:56:21.726576+0000","last_undegraded":"2023-10-09T11:56:21.726576+0000","last_fullsized":"2023-10-09T11:56:21.726576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:29.791757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737197+0000","last_change":"2023-10-09T11:56:21.734925+0000","last_active":"2023-10-09T11:56:21.737197+0000","last_peered":"2023-10-09T11:56:21.737197+0000","last_clean":"2023-10-09T11:56:21.737197+0000","last_became_active":"2023-10-09T11:56:21.733487+0000","last_became_peered":"2023-10-09T11:56:21.733487+0000","last_unstale":"2023-10-09T11:56:21.737197+0000","last_undegraded":"2023-10-09T11:56:21.737197+0000","last_fullsized":"2023-10-09T11:56:21.737197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:12.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.749714+0000","last_change":"2023-10-09T11:56:20.716387+0000","last_active":"2023-10-09T11:56:21.749714+0000","last_peered":"2023-10-09T11:56:21.749714+0000","last_clean":"2023-10-09T11:56:21.749714+0000","last_became_active":"2023-10-09T11:56:20.716123+0000","last_became_peered":"2023-10-09T11:56:20.716123+0000","last_unstale":"2023-10-09T11:56:21.749714+0000","last_undegraded":"2023-10-09T11:56:21.749714+0000","last_fullsized":"2023-10-09T11:56:21.749714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:53.616884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.737333+0000","last_change":"2023-10-09T11:56:21.734785+0000","last_active":"2023-10-09T11:56:21.737333+0000","last_peered":"2023-10-09T11:56:21.737333+0000","last_clean":"2023-10-09T11:56:21.737333+0000","last_became_active":"2023-10-09T11:56:21.734255+0000","last_became_peered":"2023-10-09T11:56:21.734255+0000","last_unstale":"2023-10-09T11:56:21.737333+0000","last_undegraded":"2023-10-09T11:56:21.737333+0000","last_fullsized":"2023-10-09T11:56:21.737333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:05.125023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.715392+0000","last_change":"2023-10-09T11:56:20.717905+0000","last_active":"2023-10-09T11:56:21.715392+0000","last_peered":"2023-10-09T11:56:21.715392+0000","last_clean":"2023-10-09T11:56:21.715392+0000","last_became_active":"2023-10-09T11:56:20.717333+0000","last_became_peered":"2023-10-09T11:56:20.717333+0000","last_unstale":"2023-10-09T11:56:21.715392+0000","last_undegraded":"2023-10-09T11:56:21.715392+0000","last_fullsized":"2023-10-09T11:56:21.715392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:03.395168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728034+0000","last_change":"2023-10-09T11:56:21.719629+0000","last_active":"2023-10-09T11:56:21.728034+0000","last_peered":"2023-10-09T11:56:21.728034+0000","last_clean":"2023-10-09T11:56:21.728034+0000","last_became_active":"2023-10-09T11:56:21.719328+0000","last_became_peered":"2023-10-09T11:56:21.719328+0000","last_unstale":"2023-10-09T11:56:21.728034+0000","last_undegraded":"2023-10-09T11:56:21.728034+0000","last_fullsized":"2023-10-09T11:56:21.728034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:07.829845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.714770+0000","last_change":"2023-10-09T11:56:20.714316+0000","last_active":"2023-10-09T11:56:21.714770+0000","last_peered":"2023-10-09T11:56:21.714770+0000","last_clean":"2023-10-09T11:56:21.714770+0000","last_became_active":"2023-10-09T11:56:20.714037+0000","last_became_peered":"2023-10-09T11:56:20.714037+0000","last_unstale":"2023-10-09T11:56:21.714770+0000","last_undegraded":"2023-10-09T11:56:21.714770+0000","last_fullsized":"2023-10-09T11:56:21.714770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:13.847715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.738894+0000","last_change":"2023-10-09T11:56:21.733365+0000","last_active":"2023-10-09T11:56:21.738894+0000","last_peered":"2023-10-09T11:56:21.738894+0000","last_clean":"2023-10-09T11:56:21.738894+0000","last_became_active":"2023-10-09T11:56:21.732184+0000","last_became_peered":"2023-10-09T11:56:21.732184+0000","last_unstale":"2023-10-09T11:56:21.738894+0000","last_undegraded":"2023-10-09T11:56:21.738894+0000","last_fullsized":"2023-10-09T11:56:21.738894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:46.578290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.726965+0000","last_change":"2023-10-09T11:56:20.716214+0000","last_active":"2023-10-09T11:56:21.726965+0000","last_peered":"2023-10-09T11:56:21.726965+0000","last_clean":"2023-10-09T11:56:21.726965+0000","last_became_active":"2023-10-09T11:56:20.715940+0000","last_became_peered":"2023-10-09T11:56:20.715940+0000","last_unstale":"2023-10-09T11:56:21.726965+0000","last_undegraded":"2023-10-09T11:56:21.726965+0000","last_fullsized":"2023-10-09T11:56:21.726965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:25.769420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736198+0000","last_change":"2023-10-09T11:56:21.729064+0000","last_active":"2023-10-09T11:56:21.736198+0000","last_peered":"2023-10-09T11:56:21.736198+0000","last_clean":"2023-10-09T11:56:21.736198+0000","last_became_active":"2023-10-09T11:56:21.728805+0000","last_became_peered":"2023-10-09T11:56:21.728805+0000","last_unstale":"2023-10-09T11:56:21.736198+0000","last_undegraded":"2023-10-09T11:56:21.736198+0000","last_fullsized":"2023-10-09T11:56:21.736198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:30.637715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.711050+0000","last_change":"2023-10-09T11:56:20.717005+0000","last_active":"2023-10-09T11:56:21.711050+0000","last_peered":"2023-10-09T11:56:21.711050+0000","last_clean":"2023-10-09T11:56:21.711050+0000","last_became_active":"2023-10-09T11:56:20.716678+0000","last_became_peered":"2023-10-09T11:56:20.716678+0000","last_unstale":"2023-10-09T11:56:21.711050+0000","last_undegraded":"2023-10-09T11:56:21.711050+0000","last_fullsized":"2023-10-09T11:56:21.711050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:44.924572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.743902+0000","last_change":"2023-10-09T11:56:21.740223+0000","last_active":"2023-10-09T11:56:21.743902+0000","last_peered":"2023-10-09T11:56:21.743902+0000","last_clean":"2023-10-09T11:56:21.743902+0000","last_became_active":"2023-10-09T11:56:21.739962+0000","last_became_peered":"2023-10-09T11:56:21.739962+0000","last_unstale":"2023-10-09T11:56:21.743902+0000","last_undegraded":"2023-10-09T11:56:21.743902+0000","last_fullsized":"2023-10-09T11:56:21.743902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:27.838394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.717018+0000","last_change":"2023-10-09T11:56:20.713638+0000","last_active":"2023-10-09T11:56:21.717018+0000","last_peered":"2023-10-09T11:56:21.717018+0000","last_clean":"2023-10-09T11:56:21.717018+0000","last_became_active":"2023-10-09T11:56:20.713331+0000","last_became_peered":"2023-10-09T11:56:20.713331+0000","last_unstale":"2023-10-09T11:56:21.717018+0000","last_undegraded":"2023-10-09T11:56:21.717018+0000","last_fullsized":"2023-10-09T11:56:21.717018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:47.876712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.727159+0000","last_change":"2023-10-09T11:56:21.720936+0000","last_active":"2023-10-09T11:56:21.727159+0000","last_peered":"2023-10-09T11:56:21.727159+0000","last_clean":"2023-10-09T11:56:21.727159+0000","last_became_active":"2023-10-09T11:56:21.720655+0000","last_became_peered":"2023-10-09T11:56:21.720655+0000","last_unstale":"2023-10-09T11:56:21.727159+0000","last_undegraded":"2023-10-09T11:56:21.727159+0000","last_fullsized":"2023-10-09T11:56:21.727159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:37.038031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.711033+0000","last_change":"2023-10-09T11:56:20.721360+0000","last_active":"2023-10-09T11:56:21.711033+0000","last_peered":"2023-10-09T11:56:21.711033+0000","last_clean":"2023-10-09T11:56:21.711033+0000","last_became_active":"2023-10-09T11:56:20.720991+0000","last_became_peered":"2023-10-09T11:56:20.720991+0000","last_unstale":"2023-10-09T11:56:21.711033+0000","last_undegraded":"2023-10-09T11:56:21.711033+0000","last_fullsized":"2023-10-09T11:56:21.711033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:48:26.807418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.728243+0000","last_change":"2023-10-09T11:56:21.725970+0000","last_active":"2023-10-09T11:56:21.728243+0000","last_peered":"2023-10-09T11:56:21.728243+0000","last_clean":"2023-10-09T11:56:21.728243+0000","last_became_active":"2023-10-09T11:56:21.725616+0000","last_became_peered":"2023-10-09T11:56:21.725616+0000","last_unstale":"2023-10-09T11:56:21.728243+0000","last_undegraded":"2023-10-09T11:56:21.728243+0000","last_fullsized":"2023-10-09T11:56:21.728243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:29.363507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.721955+0000","last_change":"2023-10-09T11:56:20.718297+0000","last_active":"2023-10-09T11:56:21.721955+0000","last_peered":"2023-10-09T11:56:21.721955+0000","last_clean":"2023-10-09T11:56:21.721955+0000","last_became_active":"2023-10-09T11:56:20.718053+0000","last_became_peered":"2023-10-09T11:56:20.718053+0000","last_unstale":"2023-10-09T11:56:21.721955+0000","last_undegraded":"2023-10-09T11:56:21.721955+0000","last_fullsized":"2023-10-09T11:56:21.721955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:04.827340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.736390+0000","last_change":"2023-10-09T11:56:21.730382+0000","last_active":"2023-10-09T11:56:21.736390+0000","last_peered":"2023-10-09T11:56:21.736390+0000","last_clean":"2023-10-09T11:56:21.736390+0000","last_became_active":"2023-10-09T11:56:21.730116+0000","last_became_peered":"2023-10-09T11:56:21.730116+0000","last_unstale":"2023-10-09T11:56:21.736390+0000","last_undegraded":"2023-10-09T11:56:21.736390+0000","last_fullsized":"2023-10-09T11:56:21.736390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:20.691957+0000","last_clean_scrub_stamp":"2023-10-09T11:56:20.691957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:01.611556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.714588+0000","last_change":"2023-10-09T11:56:20.712830+0000","last_active":"2023-10-09T11:56:21.714588+0000","last_peered":"2023-10-09T11:56:21.714588+0000","last_clean":"2023-10-09T11:56:21.714588+0000","last_became_active":"2023-10-09T11:56:20.712550+0000","last_became_peered":"2023-10-09T11:56:20.712550+0000","last_unstale":"2023-10-09T11:56:21.714588+0000","last_undegraded":"2023-10-09T11:56:21.714588+0000","last_fullsized":"2023-10-09T11:56:21.714588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:19.686445+0000","last_clean_scrub_stamp":"2023-10-09T11:56:19.686445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:29.791757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":368,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:56:21.724935+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:21.724935+0000","last_peered":"2023-10-09T11:56:21.724935+0000","last_clean":"2023-10-09T11:56:21.724935+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:21.724935+0000","last_undegraded":"2023-10-09T11:56:21.724935+0000","last_fullsized":"2023-10-09T11:56:21.724935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476921,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302904,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068936,"statfs":{"total":96636764160,"available":96326590464,"internally_reserved":0,"allocated":1556480,"data_stored":1044687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.48099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97199999999999998,"15min":1.0109999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.54500000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.83999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.747,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.58599999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.871},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.004,"15min":1.202},"last":0.92000000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.073},"last":0.89000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.94099999999999995},"last":0.79400000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.63100000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.99299999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.04},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.45300000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.98299999999999998}]}]},{"osd":6,"up_from":16,"seq":68719476922,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":954368,"data_stored":454159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97199999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.0289999999999999,"15min":1.0349999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.71099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.121},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56799999999999995,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.216},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.59299999999999997,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":1.008,"15min":1.139},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.749},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.431},"last":0.84899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.59199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.042,"5min":1.0529999999999999,"15min":1.1040000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.72999999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.94399999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.66600000000000004},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88300000000000001,"5min":0.98199999999999998,"15min":1.7869999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.45800000000000002,"5min":0.436,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":1.143},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67800000000000005,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.437},"max":{"1min":0.96599999999999997,"5min":1.03,"15min":1.506},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.0009999999999999,"15min":1.2330000000000001},"last":0.63200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509626,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":454249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.6759999999999999},"last":0.432}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.497,"15min":0.505},"min":{"1min":0.38400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":1.385},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":1.099},"last":0.41799999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":1.536},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.272},"last":0.55100000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.66000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89600000000000002,"5min":1.115,"15min":1.7210000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":0.97499999999999998,"5min":1.1220000000000001,"15min":1.552},"last":0.747}]},{"osd":5,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.58799999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.677},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.71799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.103,"5min":1.135,"15min":1.778},"last":0.73099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60999999999999999,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0580000000000001,"5min":1.22,"15min":1.623},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.022,"5min":1.0549999999999999,"15min":1.708},"last":0.76400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.659},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1419999999999999,"5min":1.1619999999999999,"15min":1.736},"last":0.71599999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073024,"statfs":{"total":96636764160,"available":96330776576,"internally_reserved":0,"allocated":1564672,"data_stored":1046617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46899999999999997,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63100000000000001,"5min":0.79000000000000004,"15min":1.367},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.35299999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.4930000000000001},"last":0.504}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":1.8340000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.80800000000000005,"5min":1.1140000000000001,"15min":1.7130000000000001},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.72199999999999998,"5min":0.84699999999999998,"15min":1.855},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.755,"5min":0.80000000000000004,"15min":1.2330000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0549999999999999,"5min":1.587,"15min":1.587},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2769999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47199999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.099},"last":1.044},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.60799999999999998,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.004,"5min":1.137,"15min":1.2},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0129999999999999,"5min":1.488,"15min":1.488},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.80400000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.03,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.78900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0609999999999999,"15min":1.24},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81499999999999995,"15min":0.82399999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0169999999999999,"5min":1.552,"15min":1.552},"last":0.80700000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":962560,"data_stored":454215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45800000000000002},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.75,"5min":0.755,"15min":0.83799999999999997},"last":0.40600000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.65800000000000003,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.97299999999999998},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":0.76700000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.443},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.76800000000000002,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.43099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.997,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.58999999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.61599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.05,"5min":1.0900000000000001,"15min":1.2270000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.71199999999999997,"5min":0.57099999999999995,"15min":0.53900000000000003},"max":{"1min":1.056,"5min":1.216,"15min":1.216},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.026,"5min":1.204,"15min":1.27},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:55:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.83499999999999996},"min":{"1min":0.73399999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.1080000000000001,"5min":1.2310000000000001,"15min":1.246},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.83799999999999997},"min":{"1min":0.68899999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0720000000000001,"5min":1.155,"15min":1.2130000000000001},"last":0.65000000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509626,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306420,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065420,"statfs":{"total":96636764160,"available":96322990080,"internally_reserved":0,"allocated":962560,"data_stored":454215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.47699999999999998},"min":{"1min":0.32300000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.208},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.755,"15min":1.1970000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.0229999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.63400000000000001,"5min":0.78900000000000003,"15min":0.94699999999999995},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.86699999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.208,"15min":1.327},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.84499999999999997},"min":{"1min":0.69299999999999995,"5min":0.60999999999999999,"15min":0.55700000000000005},"max":{"1min":1.1080000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.056,"5min":1.109,"15min":1.2829999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.63200000000000001,"5min":0.54100000000000004,"15min":0.41299999999999998},"max":{"1min":1.0509999999999999,"5min":1.125,"15min":1.3660000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":0.999,"5min":1.0529999999999999,"15min":1.2989999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.46100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1459999999999999,"15min":1.218},"last":0.62}]},{"osd":7,"last update":"Mon Oct 9 11:55:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.46999999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.333},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.3560000000000001},"last":0.66500000000000004}]}]},{"osd":4,"up_from":16,"seq":68719476921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310520,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061320,"statfs":{"total":96636764160,"available":96318791680,"internally_reserved":0,"allocated":966656,"data_stored":455695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.50700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.071},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82399999999999995,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.60299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.64300000000000002,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.2909999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.98099999999999998,"15min":1.0149999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.752},"min":{"1min":0.621,"5min":0.52400000000000002,"15min":0.51600000000000001},"max":{"1min":0.90200000000000002,"5min":0.995,"15min":1.234},"last":0.72899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.432},"max":{"1min":0.88,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.1639999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.36099999999999999},"max":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":1.0820000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.90700000000000003,"5min":0.97999999999999998,"15min":1.1140000000000001},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":1.125},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.373},"last":0.77100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":0.92700000000000005,"15min":1.2410000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46999999999999997},"max":{"1min":0.86199999999999999,"5min":1.0249999999999999,"15min":1.222},"last":0.56699999999999995}]}]},{"osd":5,"up_from":16,"seq":68719476921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":962560,"data_stored":454783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86399999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.318},"max":{"1min":0.88900000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.503,"5min":0.376,"15min":0.376},"max":{"1min":0.84999999999999998,"5min":0.91500000000000004,"15min":1.0840000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":1.024,"5min":1.909,"15min":1.909},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.71599999999999997},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78100000000000003,"15min":0.79200000000000004},"min":{"1min":0.56699999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.77800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.45000000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":2.105,"15min":2.105},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.02,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.80300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0489999999999999,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.443,"5min":0.44,"15min":0.39900000000000002},"max":{"1min":0.95999999999999996,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:56:31.305 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:56:31.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:56:31.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.527+0000 7f7d90f9d700 1 Processor -- start 2023-10-09T11:56:31.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.527+0000 7f7d90f9d700 1 -- start start 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.528+0000 7f7d90f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d8c0c7c10 0x7f7d8c15a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.528+0000 7f7d90f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 0x7f7d8c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.528+0000 7f7d90f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c06e510 con 0x7f7d8c0c7840 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.528+0000 7f7d90f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c7220 con 0x7f7d8c0c7c10 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.528+0000 7f7d90f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c06df20 con 0x7f7d8c155860 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.528+0000 7f7d8b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7d8c0c7840 0x7f7d8c159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36658/0 (socket says 172.21.15.86:36658) 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.528+0000 7f7d8b7fe700 1 -- 172.21.15.86:0/1542474768 learned_addr learned my addr 172.21.15.86:0/1542474768 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8bfff700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 0x7f7d8c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8affd700 1 --2- 172.21.15.86:0/1542474768 >> v2:172.21.15.135:3300/0 conn(0x7f7d8c0c7c10 0x7f7d8c15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43250409 0 0) 0x7f7d8c06e510 con 0x7f7d8c0c7840 2023-10-09T11:56:31.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d74003570 con 0x7f7d8c0c7840 2023-10-09T11:56:31.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3874349774 0 0) 0x7f7d74003570 con 0x7f7d8c0c7840 2023-10-09T11:56:31.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 msgr2=0x7f7d8c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:31.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 0x7f7d8c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 >> v2:172.21.15.135:3300/0 conn(0x7f7d8c0c7c10 msgr2=0x7f7d8c15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 --2- 172.21.15.86:0/1542474768 >> v2:172.21.15.135:3300/0 conn(0x7f7d8c0c7c10 0x7f7d8c15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c157040 con 0x7f7d8c0c7840 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f7d7c001470 con 0x7f7d8c0c7840 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 >> v1:172.21.15.86:6789/0 conn(0x7f7d8c0c7840 legacy=0x7f7d8c159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 0x7f7d74003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d74003fe0 0x7f7d74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d74004d50 0x7f7d740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c7220 con 0x7f7d74003fe0 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c06df20 con 0x7f7d74004d50 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.529+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7400ba90 con 0x7f7d8c155860 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8affd700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d74003fe0 0x7f7d74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8b7fe700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 0x7f7d74003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8bfff700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d74004d50 0x7f7d740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8affd700 1 -- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 msgr2=0x7f7d74003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8affd700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d8c155860 0x7f7d74003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8affd700 1 -- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d74004d50 msgr2=0x7f7d740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8affd700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d74004d50 0x7f7d740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8affd700 1 -- 172.21.15.86:0/1542474768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74003570 con 0x7f7d74003fe0 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8affd700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d74003fe0 0x7f7d74004810 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000adb0 tx=0x7f7d8000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d727ed89a1c3dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000a760 con 0x7f7d74003fe0 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8000f9d0 con 0x7f7d74003fe0 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.530+0000 7f7d8a7fc700 1 -- 172.21.15.86:0/1542474768 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000fb60 con 0x7f7d74003fe0 2023-10-09T11:56:31.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.531+0000 7f7d90f9d700 1 -- 172.21.15.86:0/1542474768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d74003fe0 msgr2=0x7f7d74004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.531+0000 7f7d90f9d700 1 --2- 172.21.15.86:0/1542474768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d74003fe0 0x7f7d74004810 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000adb0 tx=0x7f7d8000a330 comp rx=0 tx=0).stop 2023-10-09T11:56:31.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.531+0000 7f7d8bfff700 1 -- 172.21.15.86:0/1542474768 reap_dead start 2023-10-09T11:56:31.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.531+0000 7f7d90f9d700 1 -- 172.21.15.86:0/1542474768 shutdown_connections 2023-10-09T11:56:31.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.531+0000 7f7d90f9d700 1 -- 172.21.15.86:0/1542474768 >> 172.21.15.86:0/1542474768 conn(0x7f7d8c068e20 msgr2=0x7f7d8c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:31.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.531+0000 7f7d90f9d700 1 -- 172.21.15.86:0/1542474768 shutdown_connections 2023-10-09T11:56:31.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.531+0000 7f7d90f9d700 1 -- 172.21.15.86:0/1542474768 wait complete. 2023-10-09T11:56:31.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.532+0000 7f7d90f9d700 1 Processor -- start 2023-10-09T11:56:31.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.532+0000 7f7d90f9d700 1 -- start start 2023-10-09T11:56:31.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.533+0000 7f7d90f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74003fe0 0x7f7d8c151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.533+0000 7f7d90f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8c0b0660 0x7f7d8c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.533+0000 7f7d90f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d8c0c4730 0x7f7d8c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.533+0000 7f7d90f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0b1ee0 con 0x7f7d8c0c4730 2023-10-09T11:56:31.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.533+0000 7f7d90f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c4ba0 con 0x7f7d8c0b0660 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.533+0000 7f7d90f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c3e30 con 0x7f7d74003fe0 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d8c0c4730 0x7f7d8c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d8c0c4730 0x7f7d8c0af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37664/0 (socket says 172.21.15.86:37664) 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 -- 172.21.15.86:0/3261420355 learned_addr learned my addr 172.21.15.86:0/3261420355 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8b7fe700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74003fe0 0x7f7d8c151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8affd700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8c0b0660 0x7f7d8c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 -- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74003fe0 msgr2=0x7f7d8c151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74003fe0 0x7f7d8c151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 -- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8c0b0660 msgr2=0x7f7d8c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8c0b0660 0x7f7d8c0c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 -- 172.21.15.86:0/3261420355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0b0ff0 con 0x7f7d8c0c4730 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.534+0000 7f7d8bfff700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d8c0c4730 0x7f7d8c0af0f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b23c0 tx=0x7f7d8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.535+0000 7f7d737fe700 1 -- 172.21.15.86:0/3261420355 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400e040 con 0x7f7d8c0c4730 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.535+0000 7f7d737fe700 1 -- 172.21.15.86:0/3261420355 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8400f040 con 0x7f7d8c0c4730 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.535+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c0b12d0 con 0x7f7d8c0c4730 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.535+0000 7f7d737fe700 1 -- 172.21.15.86:0/3261420355 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400fd70 con 0x7f7d8c0c4730 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.535+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c0b1890 con 0x7f7d8c0c4730 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.536+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c04c3c0 con 0x7f7d8c0c4730 2023-10-09T11:56:31.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.537+0000 7f7d737fe700 1 -- 172.21.15.86:0/3261420355 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d84015640 con 0x7f7d8c0c4730 2023-10-09T11:56:31.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.538+0000 7f7d737fe700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d78066f30 0x7f7d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:31.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.538+0000 7f7d737fe700 1 -- 172.21.15.86:0/3261420355 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f7d84084e10 con 0x7f7d8c0c4730 2023-10-09T11:56:31.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.538+0000 7f7d8b7fe700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d78066f30 0x7f7d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:31.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.539+0000 7f7d8b7fe700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d78066f30 0x7f7d780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c000e50 tx=0x7f7d7c001e90 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.542+0000 7f7d737fe700 1 -- 172.21.15.86:0/3261420355 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d84088030 con 0x7f7d8c0c4730 2023-10-09T11:56:31.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.807+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7d8c06d560 con 0x7f7d8c0c4730 2023-10-09T11:56:31.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.811+0000 7f7d737fe700 1 -- 172.21.15.86:0/3261420355 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7d84051e60 con 0x7f7d8c0c4730 2023-10-09T11:56:31.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d78066f30 msgr2=0x7f7d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d78066f30 0x7f7d780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c000e50 tx=0x7f7d7c001e90 comp rx=0 tx=0).stop 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d8c0c4730 msgr2=0x7f7d8c0af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d8c0c4730 0x7f7d8c0af0f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b23c0 tx=0x7f7d8400b040 comp rx=0 tx=0).stop 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 shutdown_connections 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d78066f30 0x7f7d780693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d8c0c4730 0x7f7d8c0af0f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74003fe0 0x7f7d8c151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 --2- 172.21.15.86:0/3261420355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8c0b0660 0x7f7d8c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 >> 172.21.15.86:0/3261420355 conn(0x7f7d8c068e20 msgr2=0x7f7d8c1598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 shutdown_connections 2023-10-09T11:56:31.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:31.814+0000 7f7d90f9d700 1 -- 172.21.15.86:0/3261420355 wait complete. 2023-10-09T11:56:31.816 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T11:56:31.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:32.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.011+0000 7f456659d700 1 Processor -- start 2023-10-09T11:56:32.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.011+0000 7f456659d700 1 -- start start 2023-10-09T11:56:32.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f456659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 0x7f4560157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f456659d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45600c7410 0x7f4560069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f456659d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456006e2a0 con 0x7f4560150550 2023-10-09T11:56:32.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f456659d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456006b2e0 con 0x7f45600c7410 2023-10-09T11:56:32.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f456659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c78e0 con 0x7f4560150180 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f4564d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4560150550 0x7f45600c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36662/0 (socket says 172.21.15.86:36662) 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f4564d9a700 1 -- 172.21.15.86:0/1159246735 learned_addr learned my addr 172.21.15.86:0/1159246735 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f4565d9c700 1 --2- 172.21.15.86:0/1159246735 >> v2:172.21.15.135:3300/0 conn(0x7f45600c7410 0x7f4560069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f456559b700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 0x7f4560157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782537152 0 0) 0x7f456006e2a0 con 0x7f4560150550 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.013+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f454c003570 con 0x7f4560150550 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2954745657 0 0) 0x7f454c003570 con 0x7f4560150550 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 msgr2=0x7f4560157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 0x7f4560157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 >> v2:172.21.15.135:3300/0 conn(0x7f45600c7410 msgr2=0x7f4560069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 --2- 172.21.15.86:0/1159246735 >> v2:172.21.15.135:3300/0 conn(0x7f45600c7410 0x7f4560069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600c7bc0 con 0x7f4560150550 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f4550001470 con 0x7f4560150550 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 >> v1:172.21.15.86:6789/0 conn(0x7f4560150550 legacy=0x7f45600c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c003a60 0x7f454c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c004810 0x7f454c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 0x7f454c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456006b2e0 con 0x7f454c004810 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c78e0 con 0x7f454c003a60 2023-10-09T11:56:32.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c00cb70 con 0x7f4560150180 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4564d9a700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c004810 0x7f454c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4565d9c700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 0x7f454c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f456559b700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c003a60 0x7f454c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.014+0000 7f4564d9a700 1 -- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 msgr2=0x7f454c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4564d9a700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 0x7f454c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4564d9a700 1 -- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c003a60 msgr2=0x7f454c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4564d9a700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c003a60 0x7f454c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4564d9a700 1 -- 172.21.15.86:0/1159246735 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c003570 con 0x7f454c004810 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4565d9c700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560150180 0x7f454c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:32.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f456559b700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c003a60 0x7f454c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4564d9a700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c004810 0x7f454c004c80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f455000c3f0 tx=0x7f456006d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfbab1a29517853 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455000cc80 con 0x7f454c004810 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455000cde0 con 0x7f454c004810 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4557fff700 1 -- 172.21.15.86:0/1159246735 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4550005b70 con 0x7f454c004810 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f456659d700 1 -- 172.21.15.86:0/1159246735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c004810 msgr2=0x7f454c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f456659d700 1 --2- 172.21.15.86:0/1159246735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c004810 0x7f454c004c80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f455000c3f0 tx=0x7f456006d620 comp rx=0 tx=0).stop 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.015+0000 7f4565d9c700 1 -- 172.21.15.86:0/1159246735 reap_dead start 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.016+0000 7f456659d700 1 -- 172.21.15.86:0/1159246735 shutdown_connections 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.016+0000 7f456659d700 1 -- 172.21.15.86:0/1159246735 >> 172.21.15.86:0/1159246735 conn(0x7f45600cc1f0 msgr2=0x7f45600cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.016+0000 7f456659d700 1 -- 172.21.15.86:0/1159246735 shutdown_connections 2023-10-09T11:56:32.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.016+0000 7f456659d700 1 -- 172.21.15.86:0/1159246735 wait complete. 2023-10-09T11:56:32.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.017+0000 7f456659d700 1 Processor -- start 2023-10-09T11:56:32.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.017+0000 7f456659d700 1 -- start start 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f456659d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c004810 0x7f456014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f456659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45600aef90 0x7f45600c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f456659d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45600aff60 0x7f45600b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f456659d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600b0940 con 0x7f45600aff60 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f456659d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c13a0 con 0x7f454c004810 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f456659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456014b570 con 0x7f45600aef90 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f4565d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45600aff60 0x7f45600b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f4565d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45600aff60 0x7f45600b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37690/0 (socket says 172.21.15.86:37690) 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f4565d9c700 1 -- 172.21.15.86:0/2463511821 learned_addr learned my addr 172.21.15.86:0/2463511821 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:32.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f456559b700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c004810 0x7f456014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.018+0000 7f4564d9a700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45600aef90 0x7f45600c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f4565d9c700 1 -- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45600aef90 msgr2=0x7f45600c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f4565d9c700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45600aef90 0x7f45600c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f4565d9c700 1 -- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c004810 msgr2=0x7f456014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f4565d9c700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c004810 0x7f456014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f4565d9c700 1 -- 172.21.15.86:0/2463511821 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560155a20 con 0x7f45600aff60 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f4565d9c700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45600aff60 0x7f45600b0400 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f45600aed30 tx=0x7f455800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f45557fa700 1 -- 172.21.15.86:0/2463511821 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455801b070 con 0x7f45600aff60 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f45557fa700 1 -- 172.21.15.86:0/2463511821 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455800f040 con 0x7f45600aff60 2023-10-09T11:56:32.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4560155d00 con 0x7f45600aff60 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f45557fa700 1 -- 172.21.15.86:0/2463511821 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455800e050 con 0x7f45600aff60 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.019+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45600c1030 con 0x7f45600aff60 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.020+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45600c1510 con 0x7f45600aff60 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.021+0000 7f45557fa700 1 -- 172.21.15.86:0/2463511821 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4558003020 con 0x7f45600aff60 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.022+0000 7f45557fa700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4544066f30 0x7f45440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.022+0000 7f45557fa700 1 -- 172.21.15.86:0/2463511821 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f4558084cc0 con 0x7f45600aff60 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.022+0000 7f456559b700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4544066f30 0x7f45440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.023+0000 7f456559b700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4544066f30 0x7f45440693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f455c006dc0 tx=0x7f455c008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.026+0000 7f45557fa700 1 -- 172.21.15.86:0/2463511821 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f455808b080 con 0x7f45600aff60 2023-10-09T11:56:32.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.258+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f456004c3c0 con 0x7f45600aff60 2023-10-09T11:56:32.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.259+0000 7f45557fa700 1 -- 172.21.15.86:0/2463511821 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f4558051d10 con 0x7f45600aff60 2023-10-09T11:56:32.259 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:32.259 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5926,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2024459788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":2024459788},{"type":"v1","addr":"172.21.15.135:6835","nonce":2024459788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/1216529409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1216529409},{"type":"v1","addr":"172.21.15.86:6833","nonce":1216529409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1408499839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1408499839},{"type":"v1","addr":"172.21.15.86:6835","nonce":1408499839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:56:21.168698+0000","modified":"2023-10-09T11:56:24.731586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3399882940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3399882940},{"type":"v1","addr":"172.21.15.135:6834","nonce":3399882940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:56:32.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4544066f30 msgr2=0x7f45440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4544066f30 0x7f45440693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f455c006dc0 tx=0x7f455c008040 comp rx=0 tx=0).stop 2023-10-09T11:56:32.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45600aff60 msgr2=0x7f45600b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45600aff60 0x7f45600b0400 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f45600aed30 tx=0x7f455800b040 comp rx=0 tx=0).stop 2023-10-09T11:56:32.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 shutdown_connections 2023-10-09T11:56:32.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4544066f30 0x7f45440693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45600aff60 0x7f45600b0400 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f454c004810 0x7f456014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 --2- 172.21.15.86:0/2463511821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45600aef90 0x7f45600c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 >> 172.21.15.86:0/2463511821 conn(0x7f45600cc1f0 msgr2=0x7f4560158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 shutdown_connections 2023-10-09T11:56:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.261+0000 7f456659d700 1 -- 172.21.15.86:0/2463511821 wait complete. 2023-10-09T11:56:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2023-10-09T11:56:32.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:56:21.168698+0000', 'modified': '2023-10-09T11:56:24.731586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6225}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6225': {'gid': 6225, 'name': 'd', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6834/3399882940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 3399882940}, {'type': 'v1', 'addr': '172.21.15.135:6834', 'nonce': 3399882940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:56:32.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:56:32.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.864+0000 7fc2491ff700 1 Processor -- start 2023-10-09T11:56:32.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.865+0000 7fc2491ff700 1 -- start start 2023-10-09T11:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc2491ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc2440b1420 0x7fc2440ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc2491ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 0x7fc2440c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc2491ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440cc300 con 0x7fc2440cbf30 2023-10-09T11:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc2491ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc244156bf0 con 0x7fc2440b1420 2023-10-09T11:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc2491ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440ae950 con 0x7fc2440ccf90 2023-10-09T11:56:32.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc242d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc2440cbf30 0x7fc2440b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36664/0 (socket says 172.21.15.86:36664) 2023-10-09T11:56:32.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc242d9d700 1 -- 172.21.15.86:0/2647514673 learned_addr learned my addr 172.21.15.86:0/2647514673 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:32.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc24259c700 1 --2- 172.21.15.86:0/2647514673 >> v2:172.21.15.135:3300/0 conn(0x7fc2440b1420 0x7fc2440ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc24359e700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 0x7fc2440c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.866+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536187560 0 0) 0x7fc2440cc300 con 0x7fc2440cbf30 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc22c003570 con 0x7fc2440cbf30 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 357469258 0 0) 0x7fc22c003570 con 0x7fc2440cbf30 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 msgr2=0x7fc2440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 0x7fc2440c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 >> v2:172.21.15.135:3300/0 conn(0x7fc2440b1420 msgr2=0x7fc2440ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 --2- 172.21.15.86:0/2647514673 >> v2:172.21.15.135:3300/0 conn(0x7fc2440b1420 0x7fc2440ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440ad370 con 0x7fc2440cbf30 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fc2340017f0 con 0x7fc2440cbf30 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 >> v1:172.21.15.86:6789/0 conn(0x7fc2440cbf30 legacy=0x7fc2440b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc22c003a90 0x7fc22c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 0x7fc22c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c004d50 0x7fc22c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244156bf0 con 0x7fc22c003a90 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440ae950 con 0x7fc22c004d50 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c00dc70 con 0x7fc2440ccf90 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.867+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc22c003a90 0x7fc22c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc24259c700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 0x7fc22c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc24359e700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c004d50 0x7fc22c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc242d9d700 1 -- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 msgr2=0x7fc22c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2440ccf90 0x7fc22c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc242d9d700 1 -- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c004d50 msgr2=0x7fc22c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c004d50 0x7fc22c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc242d9d700 1 -- 172.21.15.86:0/2647514673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c003570 con 0x7fc22c003a90 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc24359e700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c004d50 0x7fc22c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc22c003a90 0x7fc22c003ea0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc23400a900 tx=0x7fc2440c8fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa37a2b8cc9ad14 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340070d0 con 0x7fc22c003a90 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234007230 con 0x7fc22c003a90 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.868+0000 7fc241d9b700 1 -- 172.21.15.86:0/2647514673 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340075f0 con 0x7fc22c003a90 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.869+0000 7fc2491ff700 1 -- 172.21.15.86:0/2647514673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc22c003a90 msgr2=0x7fc22c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.869+0000 7fc2491ff700 1 --2- 172.21.15.86:0/2647514673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc22c003a90 0x7fc22c003ea0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc23400a900 tx=0x7fc2440c8fd0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.869+0000 7fc24359e700 1 -- 172.21.15.86:0/2647514673 reap_dead start 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.869+0000 7fc2491ff700 1 -- 172.21.15.86:0/2647514673 shutdown_connections 2023-10-09T11:56:32.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.869+0000 7fc2491ff700 1 -- 172.21.15.86:0/2647514673 >> 172.21.15.86:0/2647514673 conn(0x7fc24406a320 msgr2=0x7fc2440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.869+0000 7fc2491ff700 1 -- 172.21.15.86:0/2647514673 shutdown_connections 2023-10-09T11:56:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.869+0000 7fc2491ff700 1 -- 172.21.15.86:0/2647514673 wait complete. 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.870+0000 7fc2491ff700 1 Processor -- start 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.870+0000 7fc2491ff700 1 -- start start 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.871+0000 7fc2491ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc22c003a90 0x7fc244154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.871+0000 7fc2491ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244158090 0x7fc2440c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.871+0000 7fc2491ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2440c3740 0x7fc2440c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.871+0000 7fc2491ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c54e0 con 0x7fc2440c3740 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.871+0000 7fc2491ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c3bb0 con 0x7fc244158090 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.871+0000 7fc2491ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441585e0 con 0x7fc22c003a90 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.871+0000 7fc24359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2440c3740 0x7fc2440c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2440c3740 0x7fc2440c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37718/0 (socket says 172.21.15.86:37718) 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 -- 172.21.15.86:0/4045110239 learned_addr learned my addr 172.21.15.86:0/4045110239 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24259c700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244158090 0x7fc2440c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc242d9d700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc22c003a90 0x7fc244154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 -- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc22c003a90 msgr2=0x7fc244154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc22c003a90 0x7fc244154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 -- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244158090 msgr2=0x7fc2440c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244158090 0x7fc2440c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 -- 172.21.15.86:0/4045110239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2441588c0 con 0x7fc2440c3740 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24259c700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244158090 0x7fc2440c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc242d9d700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc22c003a90 0x7fc244154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc24359e700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2440c3740 0x7fc2440c5950 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc24406d670 tx=0x7fc23c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc22affd700 1 -- 172.21.15.86:0/4045110239 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c015740 con 0x7fc2440c3740 2023-10-09T11:56:32.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc22affd700 1 -- 172.21.15.86:0/4045110239 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c0158a0 con 0x7fc2440c3740 2023-10-09T11:56:32.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc244158ba0 con 0x7fc2440c3740 2023-10-09T11:56:32.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.872+0000 7fc22affd700 1 -- 172.21.15.86:0/4045110239 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c015c40 con 0x7fc2440c3740 2023-10-09T11:56:32.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.873+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc244154b70 con 0x7fc2440c3740 2023-10-09T11:56:32.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.875+0000 7fc22affd700 1 -- 172.21.15.86:0/4045110239 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc23c01e400 con 0x7fc2440c3740 2023-10-09T11:56:32.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.875+0000 7fc22affd700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.875+0000 7fc22affd700 1 -- 172.21.15.86:0/4045110239 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc23c084b00 con 0x7fc2440c3740 2023-10-09T11:56:32.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.876+0000 7fc242d9d700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.876+0000 7fc242d9d700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc230066f30 0x7fc2300693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc23400a900 tx=0x7fc234015000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.877+0000 7fc257958b80 1 Processor -- start 2023-10-09T11:56:32.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.877+0000 7fc257958b80 1 -- start start 2023-10-09T11:56:32.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.878+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa4e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.878+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa25f80 0x55c05fa24880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.878+0000 7fc257958b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa251f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.878+0000 7fc257958b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05f97ba70 con 0x55c05fa24dc0 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.878+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05f979270 con 0x55c05fa25f80 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.878+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05f975060 con 0x55c05fa4e050 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa251f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37720/0 (socket says 172.21.15.86:37720) 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 -- 172.21.15.86:0/2620681367 learned_addr learned my addr 172.21.15.86:0/2620681367 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa4e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24259c700 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa25f80 0x55c05fa24880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 -- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 msgr2=0x55c05fa4e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa4e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 -- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa25f80 msgr2=0x55c05fa24880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa25f80 0x55c05fa24880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 -- 172.21.15.86:0/2620681367 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05f80f270 con 0x55c05fa24dc0 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24259c700 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa25f80 0x55c05fa24880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc24359e700 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa251f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009fd0 tx=0x7fc23c082d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf465b0ceb1544b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc223fff700 1 -- 172.21.15.86:0/2620681367 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c05c810 con 0x55c05fa24dc0 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc223fff700 1 -- 172.21.15.86:0/2620681367 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c053a00 con 0x55c05fa24dc0 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.879+0000 7fc223fff700 1 -- 172.21.15.86:0/2620681367 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c055b20 con 0x55c05fa24dc0 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 -- 172.21.15.86:0/2620681367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 msgr2=0x55c05fa251f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa251f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009fd0 tx=0x7fc23c082d60 comp rx=0 tx=0).stop 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 -- 172.21.15.86:0/2620681367 shutdown_connections 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa251f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa4e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 --2- 172.21.15.86:0/2620681367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa25f80 0x55c05fa24880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 -- 172.21.15.86:0/2620681367 >> 172.21.15.86:0/2620681367 conn(0x55c05fa26370 msgr2=0x55c05fa26740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 -- 172.21.15.86:0/2620681367 shutdown_connections 2023-10-09T11:56:32.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.880+0000 7fc257958b80 1 -- 172.21.15.86:0/2620681367 wait complete. 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.881+0000 7fc257958b80 1 -- start start 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.881+0000 7fc257958b80 1 Processor -- start 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc257958b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa489c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa4e050 0x55c05fa21660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc257958b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05f920890 con 0x55c05fa24dc0 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05f93bea0 con 0x55c05fa4e050 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05f7f7e30 con 0x55c05fa25f80 2023-10-09T11:56:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc257958b80 10 client.0 _ll_register_callbacks cb 0x55c05f9e8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc242d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc242d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37734/0 (socket says 172.21.15.86:37734) 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.882+0000 7fc242d9d700 1 -- 172.21.15.86:0/2024629117 learned_addr learned my addr 172.21.15.86:0/2024629117 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc24259c700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc24359e700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa4e050 0x55c05fa21660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc242d9d700 1 -- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 msgr2=0x55c05fa542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc242d9d700 1 -- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa4e050 msgr2=0x55c05fa21660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa4e050 0x55c05fa21660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc242d9d700 1 -- 172.21.15.86:0/2024629117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc244154b70 con 0x55c05fa24dc0 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc24259c700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc24359e700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa4e050 0x55c05fa21660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc242d9d700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa489c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc23400aef0 tx=0x7fc234020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2392bd17df2e5714 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc2217fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc2217fa700 1 -- 172.21.15.86:0/2024629117 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23402b7e0 con 0x55c05fa24dc0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c05fa19b70 con 0x55c05fa24dc0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc2217fa700 1 -- 172.21.15.86:0/2024629117 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc23402b940 con 0x55c05fa24dc0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc2217fa700 1 -- 172.21.15.86:0/2024629117 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc23402bd10 con 0x55c05fa24dc0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc257958b80 10 client.6384 fetch_fsmap learned FSMap version 32 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.883+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55c05f7b1fe0 con 0x55c05fa24dc0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc2217fa700 1 -- 172.21.15.86:0/2024629117 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c05fa19b70 con 0x55c05fa24dc0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc2217fa700 1 -- 172.21.15.86:0/2024629117 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc234034440 con 0x55c05fa24dc0 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc257958b80 10 client.6384 fetch_fsmap finished waiting for FSMap version 32 2023-10-09T11:56:32.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc257958b80 10 client.6384 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc257958b80 20 client.6384 populate_metadata read hostname 'smithi086' 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc257958b80 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa51d30 0x55c05fa642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc257958b80 4 client.6384 mds_command: new command op to 6225 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 --> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c05f9f6aa0 con 0x55c05fa51d30 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.884+0000 7fc24259c700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa51d30 0x55c05fa642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.885+0000 7fc24259c700 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa51d30 0x55c05fa642c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436436d8c309efce server_cookie=c18f93ee6c36e3d4 in_seq=0 out_seq=0 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.885+0000 7fc2217fa700 10 client.6384 ms_handle_connect on v2:172.21.15.135:6832/3399882940 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc2217fa700 1 -- 172.21.15.86:0/2024629117 <== mds.0 v2:172.21.15.135:6832/3399882940 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c05f9f6aa0 con 0x55c05fa51d30 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc2217fa700 10 client.6384 handle_command_reply: tid=0 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 client.6384 shutdown 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 msgr2=0x55c05fa489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa489c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc23400aef0 tx=0x7fc234020040 comp rx=0 tx=0).stop 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 shutdown_connections 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa51d30 0x55c05fa642c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa24dc0 0x55c05fa489c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa4e050 0x55c05fa21660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc2217fa700 0 client.6384 ms_handle_reset on v2:172.21.15.135:6832/3399882940 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 --2- 172.21.15.86:0/2024629117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 >> 172.21.15.86:0/2024629117 conn(0x55c05fa26370 msgr2=0x55c05fa1fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 shutdown_connections 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.886+0000 7fc257958b80 1 -- 172.21.15.86:0/2024629117 wait complete. 2023-10-09T11:56:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.887+0000 7fc257958b80 20 client.6384 trim_cache size 0 max 16384 2023-10-09T11:56:32.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.903+0000 7fc257958b80 1 Processor -- start 2023-10-09T11:56:32.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.903+0000 7fc257958b80 1 -- start start 2023-10-09T11:56:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.904+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05fa20d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.904+0000 7fc257958b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa25f80 0x55c05fa61950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.904+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa61e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.904+0000 7fc257958b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05f9fd4b0 con 0x55c05fa25f80 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.904+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05fa88bf0 con 0x55c05fa24dc0 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.904+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05fa04510 con 0x55c05fa4e050 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa25f80 0x55c05fa61950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa25f80 0x55c05fa61950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37746/0 (socket says 172.21.15.86:37746) 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 -- 172.21.15.86:0/1118034333 learned_addr learned my addr 172.21.15.86:0/1118034333 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc242d9d700 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05fa20d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24359e700 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa61e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 -- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 msgr2=0x55c05fa61e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa61e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 -- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 msgr2=0x55c05fa20d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05fa20d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 -- 172.21.15.86:0/1118034333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05f943780 con 0x55c05fa25f80 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc242d9d700 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05fa20d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc24259c700 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa25f80 0x55c05fa61950 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc24415a780 tx=0x7fc238019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae17394e35167c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc228ff9700 1 -- 172.21.15.86:0/1118034333 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc238017db0 con 0x55c05fa25f80 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc228ff9700 1 -- 172.21.15.86:0/1118034333 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc238020470 con 0x55c05fa25f80 2023-10-09T11:56:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.905+0000 7fc228ff9700 1 -- 172.21.15.86:0/1118034333 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380207f0 con 0x55c05fa25f80 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 -- 172.21.15.86:0/1118034333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa25f80 msgr2=0x55c05fa61950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa25f80 0x55c05fa61950 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc24415a780 tx=0x7fc238019040 comp rx=0 tx=0).stop 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 -- 172.21.15.86:0/1118034333 shutdown_connections 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa4e050 0x55c05fa61e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05fa20d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 --2- 172.21.15.86:0/1118034333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa25f80 0x55c05fa61950 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 -- 172.21.15.86:0/1118034333 >> 172.21.15.86:0/1118034333 conn(0x55c05fa26370 msgr2=0x55c05fa62bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 -- 172.21.15.86:0/1118034333 shutdown_connections 2023-10-09T11:56:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.906+0000 7fc257958b80 1 -- 172.21.15.86:0/1118034333 wait complete. 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.907+0000 7fc257958b80 1 -- start start 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.907+0000 7fc257958b80 1 Processor -- start 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05facf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc257958b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa20760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc257958b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa4e050 0x55c05fa77070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc257958b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05fa91e30 con 0x55c05fa4e050 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05fa77b40 con 0x55c05fa24dc0 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc257958b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05fa91be0 con 0x55c05fa25f80 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc257958b80 10 client.0 _ll_register_callbacks cb 0x55c05f9e8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc24359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa4e050 0x55c05fa77070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc24359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa4e050 0x55c05fa77070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37762/0 (socket says 172.21.15.86:37762) 2023-10-09T11:56:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc24359e700 1 -- 172.21.15.86:0/1837217045 learned_addr learned my addr 172.21.15.86:0/1837217045 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc242d9d700 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05facf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.908+0000 7fc24259c700 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa20760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc24359e700 1 -- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 msgr2=0x55c05fa20760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc24359e700 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa20760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc24359e700 1 -- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 msgr2=0x55c05facf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc24359e700 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05facf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc24359e700 1 -- 172.21.15.86:0/1837217045 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc238009dc0 con 0x55c05fa4e050 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc24359e700 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa4e050 0x55c05fa77070 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc23c011cb0 tx=0x7fc23c06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fb3db573350973 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc2217fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc2217fa700 1 -- 172.21.15.86:0/1837217045 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c082070 con 0x55c05fa4e050 2023-10-09T11:56:32.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc2217fa700 1 -- 172.21.15.86:0/1837217045 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc23c054db0 con 0x55c05fa4e050 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2441553c0 con 0x55c05fa4e050 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc2217fa700 1 -- 172.21.15.86:0/1837217045 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc23c055b20 con 0x55c05fa4e050 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 10 client.6390 fetch_fsmap learned FSMap version 32 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55c05f92a470 con 0x55c05fa4e050 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc2217fa700 1 -- 172.21.15.86:0/1837217045 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c075080 con 0x55c05fa4e050 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc2217fa700 1 -- 172.21.15.86:0/1837217045 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc23c05c320 con 0x55c05fa4e050 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 10 client.6390 fetch_fsmap finished waiting for FSMap version 32 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 10 client.6390 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 20 client.6390 populate_metadata read hostname 'smithi086' 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa61950 0x55c05fa61d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:32.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 4 client.6390 mds_command: new command op to 6225 tid=0[{"prefix": "status"}] 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.909+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 --> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fc23c053a00 con 0x55c05fa61950 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.910+0000 7fc242d9d700 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa61950 0x55c05fa61d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.910+0000 7fc242d9d700 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa61950 0x55c05fa61d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee4e392169dc6ec3 server_cookie=d40fc18e5c9d48b4 in_seq=0 out_seq=0 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.910+0000 7fc2217fa700 10 client.6390 ms_handle_connect on v2:172.21.15.135:6832/3399882940 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc2217fa700 1 -- 172.21.15.86:0/1837217045 <== mds.0 v2:172.21.15.135:6832/3399882940 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7fc23c053a00 con 0x55c05fa61950 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc2217fa700 10 client.6390 handle_command_reply: tid=0 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 client.6390 shutdown 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa4e050 msgr2=0x55c05fa77070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa4e050 0x55c05fa77070 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc23c011cb0 tx=0x7fc23c06b000 comp rx=0 tx=0).stop 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 shutdown_connections 2023-10-09T11:56:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:6832/3399882940,v1:172.21.15.135:6834/3399882940] conn(0x55c05fa61950 0x55c05fa61d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c05fa4e050 0x55c05fa77070 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c05fa24dc0 0x55c05facf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 --2- 172.21.15.86:0/1837217045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55c05fa25f80 0x55c05fa20760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc2217fa700 0 client.6390 ms_handle_reset on v2:172.21.15.135:6832/3399882940 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 >> 172.21.15.86:0/1837217045 conn(0x55c05fa26370 msgr2=0x55c05fa63440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 shutdown_connections 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 1 -- 172.21.15.86:0/1837217045 wait complete. 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.911+0000 7fc257958b80 20 client.6390 trim_cache size 0 max 16384 2023-10-09T11:56:32.917 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 6225, 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.188233627000001, 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 32, 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 80, 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 80, 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 16.978613827 2023-10-09T11:56:32.918 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:56:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc230066f30 msgr2=0x7fc2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc230066f30 0x7fc2300693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc23400a900 tx=0x7fc234015000 comp rx=0 tx=0).stop 2023-10-09T11:56:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2440c3740 msgr2=0x7fc2440c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2440c3740 0x7fc2440c5950 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc24406d670 tx=0x7fc23c008040 comp rx=0 tx=0).stop 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 shutdown_connections 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc230066f30 0x7fc2300693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2440c3740 0x7fc2440c5950 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc22c003a90 0x7fc244154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 --2- 172.21.15.86:0/4045110239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244158090 0x7fc2440c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 >> 172.21.15.86:0/4045110239 conn(0x7fc24406a320 msgr2=0x7fc2440ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 shutdown_connections 2023-10-09T11:56:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:32.912+0000 7fc2491ff700 1 -- 172.21.15.86:0/4045110239 wait complete. 2023-10-09T11:56:32.929 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:56:33.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.109+0000 7f18119ff700 1 Processor -- start 2023-10-09T11:56:33.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.109+0000 7f18119ff700 1 -- start start 2023-10-09T11:56:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f18119ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f180c0cbf30 0x7f180c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f18119ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f18119ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c0cc300 con 0x7f180c0ccf90 2023-10-09T11:56:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f18119ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c156bf0 con 0x7f180c0cbf30 2023-10-09T11:56:33.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f18119ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0ae950 con 0x7f180c0b1420 2023-10-09T11:56:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180a7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f180c0ccf90 0x7f180c0b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36666/0 (socket says 172.21.15.86:36666) 2023-10-09T11:56:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180a7fc700 1 -- 172.21.15.86:0/1808798557 learned_addr learned my addr 172.21.15.86:0/1808798557 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180affd700 1 --2- 172.21.15.86:0/1808798557 >> v2:172.21.15.86:3300/0 conn(0x7f180c0cbf30 0x7f180c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:33.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180b7fe700 1 --2- 172.21.15.86:0/1808798557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:33.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180affd700 1 -- 172.21.15.86:0/1808798557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 msgr2=0x7f180c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:33.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f1809ffb700 1 -- 172.21.15.86:0/1808798557 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730382919 0 0) 0x7f180c0cc300 con 0x7f180c0ccf90 2023-10-09T11:56:33.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180affd700 1 --2- 172.21.15.86:0/1808798557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180affd700 1 -- 172.21.15.86:0/1808798557 >> v1:172.21.15.86:6789/0 conn(0x7f180c0ccf90 legacy=0x7f180c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180affd700 1 -- 172.21.15.86:0/1808798557 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0ad370 con 0x7f180c0cbf30 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.111+0000 7f180b7fe700 1 --2- 172.21.15.86:0/1808798557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.112+0000 7f180affd700 1 --2- 172.21.15.86:0/1808798557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0cbf30 0x7f180c0ae410 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009e90 tx=0x7f17fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef08d0ae9b596544 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.112+0000 7f1809ffb700 1 -- 172.21.15.86:0/1808798557 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc00e070 con 0x7f180c0cbf30 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.112+0000 7f1809ffb700 1 -- 172.21.15.86:0/1808798557 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc00bbf0 con 0x7f180c0cbf30 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.112+0000 7f1809ffb700 1 -- 172.21.15.86:0/1808798557 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc012430 con 0x7f180c0cbf30 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.112+0000 7f18119ff700 1 -- 172.21.15.86:0/1808798557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0cbf30 msgr2=0x7f180c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.112+0000 7f18119ff700 1 --2- 172.21.15.86:0/1808798557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0cbf30 0x7f180c0ae410 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009e90 tx=0x7f17fc009780 comp rx=0 tx=0).stop 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.113+0000 7f18119ff700 1 -- 172.21.15.86:0/1808798557 shutdown_connections 2023-10-09T11:56:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.113+0000 7f18119ff700 1 --2- 172.21.15.86:0/1808798557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.113+0000 7f18119ff700 1 --2- 172.21.15.86:0/1808798557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0cbf30 0x7f180c0ae410 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.113+0000 7f18119ff700 1 -- 172.21.15.86:0/1808798557 >> 172.21.15.86:0/1808798557 conn(0x7f180c06a320 msgr2=0x7f180c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.113+0000 7f18119ff700 1 -- 172.21.15.86:0/1808798557 shutdown_connections 2023-10-09T11:56:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.113+0000 7f18119ff700 1 -- 172.21.15.86:0/1808798557 wait complete. 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.114+0000 7f18119ff700 1 Processor -- start 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.114+0000 7f18119ff700 1 -- start start 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f18119ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f18119ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f180c0cbf30 0x7f180c166e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f18119ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0ccf90 0x7f180c168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f18119ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c1677f0 con 0x7f180c0ccf90 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f18119ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c167ad0 con 0x7f180c0cbf30 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f18119ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c167db0 con 0x7f180c0b1420 2023-10-09T11:56:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f180b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0ccf90 0x7f180c168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f180b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0ccf90 0x7f180c168dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37780/0 (socket says 172.21.15.86:37780) 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f180b7fe700 1 -- 172.21.15.86:0/391859137 learned_addr learned my addr 172.21.15.86:0/391859137 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f180affd700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.115+0000 7f180a7fc700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f180c0cbf30 0x7f180c166e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f180b7fe700 1 -- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 msgr2=0x7f180c06eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f180b7fe700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c06eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f180b7fe700 1 -- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f180c0cbf30 msgr2=0x7f180c166e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f180b7fe700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f180c0cbf30 0x7f180c166e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f180b7fe700 1 -- 172.21.15.86:0/391859137 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc009a20 con 0x7f180c0ccf90 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f180a7fc700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f180c0cbf30 0x7f180c166e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f180b7fe700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0ccf90 0x7f180c168dd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f180400e8a0 tx=0x7f1804008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f17f2ffd700 1 -- 172.21.15.86:0/391859137 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804013410 con 0x7f180c0ccf90 2023-10-09T11:56:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f17f2ffd700 1 -- 172.21.15.86:0/391859137 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804013570 con 0x7f180c0ccf90 2023-10-09T11:56:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c168090 con 0x7f180c0ccf90 2023-10-09T11:56:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f17f2ffd700 1 -- 172.21.15.86:0/391859137 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804013910 con 0x7f180c0ccf90 2023-10-09T11:56:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.116+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c06f0e0 con 0x7f180c0ccf90 2023-10-09T11:56:33.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.117+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c168590 con 0x7f180c0ccf90 2023-10-09T11:56:33.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.118+0000 7f17f2ffd700 1 -- 172.21.15.86:0/391859137 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1804013cc0 con 0x7f180c0ccf90 2023-10-09T11:56:33.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.119+0000 7f17f2ffd700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:33.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.119+0000 7f17f2ffd700 1 -- 172.21.15.86:0/391859137 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f18040845e0 con 0x7f180c0ccf90 2023-10-09T11:56:33.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.119+0000 7f180affd700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:33.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.120+0000 7f180affd700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009fd0 tx=0x7f17fc019000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.123+0000 7f17f2ffd700 1 -- 172.21.15.86:0/391859137 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1804051630 con 0x7f180c0ccf90 2023-10-09T11:56:33.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.360+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f180c04c3c0 con 0x7f180c0ccf90 2023-10-09T11:56:33.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.360+0000 7f17f2ffd700 1 -- 172.21.15.86:0/391859137 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1804054c50 con 0x7f180c0ccf90 2023-10-09T11:56:33.360 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:56:33.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 msgr2=0x7f17f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:33.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009fd0 tx=0x7f17fc019000 comp rx=0 tx=0).stop 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0ccf90 msgr2=0x7f180c168dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0ccf90 0x7f180c168dd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f180400e8a0 tx=0x7f1804008040 comp rx=0 tx=0).stop 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 shutdown_connections 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f180c0ccf90 0x7f180c168dd0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f180c0b1420 0x7f180c06eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 --2- 172.21.15.86:0/391859137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f180c0cbf30 0x7f180c166e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 >> 172.21.15.86:0/391859137 conn(0x7f180c06a320 msgr2=0x7f180c158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 shutdown_connections 2023-10-09T11:56:33.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:33.363+0000 7f18119ff700 1 -- 172.21.15.86:0/391859137 wait complete. 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:56:33.381 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:56:33.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:33.382 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:56:33.418 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:56:33.418 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:56:33.418 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:56:33.418 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:56:33.418 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:56:33.418 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:56:33.419 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41350sec preferred_lft 41350sec 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:56:33.420 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T11:56:33.421 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:56:33.421 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:56:33.421 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:56:33.421 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T11:56:33.421 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:56:33.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:33.421 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:56:33.517 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:56:33.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:33.520 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:56:33.557 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:56:33.557 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:56:33.558 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:56:33.558 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:56:33.558 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:56:33.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:33.559 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:56:33.559 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:56:33.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:56:33.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:56:33.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:56:33.559 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:56:33.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:33.753 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:56:33.789 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:56:33.789 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:56:33.790 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:56:33.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:33.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T11:56:33.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:56:33.891 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:56:33.927 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:56:33.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:56:33.927 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:56:34.002 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:56:34.002 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:56:34.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:56:34.133 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:56:34.133 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:56:34.163 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:56:34.163 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:56:34.163 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:56:34.163 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:56:34.163 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:56:34.168 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:56:34.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:34.169 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:56:34.230 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:56:34.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.412+0000 7f8882bff700 1 Processor -- start 2023-10-09T11:56:34.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.413+0000 7f8882bff700 1 -- start start 2023-10-09T11:56:34.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f8882bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f887c0b1420 0x7f887c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f8882bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0cc300 con 0x7f887c0ccf90 2023-10-09T11:56:34.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f8882bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0ad370 con 0x7f887c0cbf30 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f8882bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c156bf0 con 0x7f887c0b1420 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f888119c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f887c0ccf90 0x7f887c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36682/0 (socket says 172.21.15.86:36682) 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f888119c700 1 -- 172.21.15.86:0/2949906132 learned_addr learned my addr 172.21.15.86:0/2949906132 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f887bfff700 1 --2- 172.21.15.86:0/2949906132 >> v2:172.21.15.86:3300/0 conn(0x7f887c0b1420 0x7f887c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.414+0000 7f887b7fe700 1 -- 172.21.15.86:0/2949906132 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497911383 0 0) 0x7f887c0cc300 con 0x7f887c0ccf90 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887b7fe700 1 -- 172.21.15.86:0/2949906132 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f886c003570 con 0x7f887c0ccf90 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887bfff700 1 -- 172.21.15.86:0/2949906132 >> v1:172.21.15.135:6789/0 conn(0x7f887c0cbf30 legacy=0x7f887c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887b7fe700 1 -- 172.21.15.86:0/2949906132 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283272867 0 0) 0x7f887c0ad370 con 0x7f887c0cbf30 2023-10-09T11:56:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887bfff700 1 -- 172.21.15.86:0/2949906132 >> v1:172.21.15.86:6789/0 conn(0x7f887c0ccf90 legacy=0x7f887c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887bfff700 1 -- 172.21.15.86:0/2949906132 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0ad650 con 0x7f887c0b1420 2023-10-09T11:56:34.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887bfff700 1 --2- 172.21.15.86:0/2949906132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0ae410 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f88680098e0 tx=0x7f88680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0a517a40afab97 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:34.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887b7fe700 1 -- 172.21.15.86:0/2949906132 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800b640 con 0x7f887c0b1420 2023-10-09T11:56:34.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887b7fe700 1 -- 172.21.15.86:0/2949906132 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800b7a0 con 0x7f887c0b1420 2023-10-09T11:56:34.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.415+0000 7f887b7fe700 1 -- 172.21.15.86:0/2949906132 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800bb40 con 0x7f887c0b1420 2023-10-09T11:56:34.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.416+0000 7f8882bff700 1 -- 172.21.15.86:0/2949906132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 msgr2=0x7f887c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.416+0000 7f8882bff700 1 --2- 172.21.15.86:0/2949906132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0ae410 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f88680098e0 tx=0x7f88680091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.416+0000 7f8882bff700 1 -- 172.21.15.86:0/2949906132 shutdown_connections 2023-10-09T11:56:34.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.416+0000 7f8882bff700 1 --2- 172.21.15.86:0/2949906132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0ae410 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.416+0000 7f8882bff700 1 -- 172.21.15.86:0/2949906132 >> 172.21.15.86:0/2949906132 conn(0x7f887c06a320 msgr2=0x7f887c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.416+0000 7f8882bff700 1 -- 172.21.15.86:0/2949906132 shutdown_connections 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.416+0000 7f8882bff700 1 -- 172.21.15.86:0/2949906132 wait complete. 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.417+0000 7f8882bff700 1 Processor -- start 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.417+0000 7f8882bff700 1 -- start start 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.418+0000 7f8882bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.418+0000 7f8882bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f887c0cbf30 0x7f887c1694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.418+0000 7f8882bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f887c0ccf90 0x7f887c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.418+0000 7f8882bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c154bf0 con 0x7f887c0b1420 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.418+0000 7f8882bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0c1de0 con 0x7f887c0ccf90 2023-10-09T11:56:34.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.418+0000 7f8882bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c14eb70 con 0x7f887c0cbf30 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.418+0000 7f888099b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37812/0 (socket says 172.21.15.86:37812) 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 -- 172.21.15.86:0/1581599602 learned_addr learned my addr 172.21.15.86:0/1581599602 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f887bfff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f887c0cbf30 0x7f887c1694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888119c700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f887c0ccf90 0x7f887c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 -- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f887c0cbf30 msgr2=0x7f887c1694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f887c0cbf30 0x7f887c1694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 -- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f887c0ccf90 msgr2=0x7f887c0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f887c0ccf90 0x7f887c0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 -- 172.21.15.86:0/1581599602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009420 con 0x7f887c0b1420 2023-10-09T11:56:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f888099b700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0c1770 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f887000c7e0 tx=0x7f8870007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f8878ff9700 1 -- 172.21.15.86:0/1581599602 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870012700 con 0x7f887c0b1420 2023-10-09T11:56:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f8878ff9700 1 -- 172.21.15.86:0/1581599602 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8870012880 con 0x7f887c0b1420 2023-10-09T11:56:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f8878ff9700 1 -- 172.21.15.86:0/1581599602 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870012c40 con 0x7f887c0b1420 2023-10-09T11:56:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.419+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c0c77b0 con 0x7f887c0b1420 2023-10-09T11:56:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.420+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c154de0 con 0x7f887c0b1420 2023-10-09T11:56:34.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.421+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c04c3c0 con 0x7f887c0b1420 2023-10-09T11:56:34.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.421+0000 7f8878ff9700 1 -- 172.21.15.86:0/1581599602 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f887001b400 con 0x7f887c0b1420 2023-10-09T11:56:34.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.422+0000 7f8878ff9700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8860066f30 0x7f88600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.422+0000 7f8878ff9700 1 -- 172.21.15.86:0/1581599602 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f88700841c0 con 0x7f887c0b1420 2023-10-09T11:56:34.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.422+0000 7f887bfff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8860066f30 0x7f88600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.423+0000 7f887bfff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8860066f30 0x7f88600693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f887c0b1820 tx=0x7f8868017000 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:34.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.426+0000 7f8878ff9700 1 -- 172.21.15.86:0/1581599602 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8870051210 con 0x7f887c0b1420 2023-10-09T11:56:34.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.641+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f887c0c77b0 con 0x7f8860066f30 2023-10-09T11:56:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.643+0000 7f8878ff9700 1 -- 172.21.15.86:0/1581599602 <== mgr.6027 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f887c0c77b0 con 0x7f8860066f30 2023-10-09T11:56:34.643 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:56:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T11:56:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:34.644 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:56:34.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8860066f30 msgr2=0x7f88600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8860066f30 0x7f88600693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f887c0b1820 tx=0x7f8868017000 comp rx=0 tx=0).stop 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 msgr2=0x7f887c0c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0c1770 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f887000c7e0 tx=0x7f8870007df0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 shutdown_connections 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8860066f30 0x7f88600693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f887c0b1420 0x7f887c0c1770 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f887c0ccf90 0x7f887c0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 --2- 172.21.15.86:0/1581599602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f887c0cbf30 0x7f887c1694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 >> 172.21.15.86:0/1581599602 conn(0x7f887c06a320 msgr2=0x7f887c0afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 shutdown_connections 2023-10-09T11:56:34.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.645+0000 7f8882bff700 1 -- 172.21.15.86:0/1581599602 wait complete. 2023-10-09T11:56:34.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T11:56:34.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.846+0000 7fb1815ff700 1 Processor -- start 2023-10-09T11:56:34.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.846+0000 7fb1815ff700 1 -- start start 2023-10-09T11:56:34.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.847+0000 7fb1815ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb17c069d60 0x7fb17c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.847+0000 7fb1815ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb17c0c81f0 0x7fb17c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.847+0000 7fb1815ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c06bdb0 con 0x7fb17c0aca80 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.847+0000 7fb1815ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0cb370 con 0x7fb17c0c81f0 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.847+0000 7fb1815ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c159f60 con 0x7fb17c069d60 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb17c0c81f0 0x7fb17c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb17c0c81f0 0x7fb17c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37822/0 (socket says 172.21.15.86:37822) 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 -- 172.21.15.86:0/944910788 learned_addr learned my addr 172.21.15.86:0/944910788 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17a7fc700 1 --2- 172.21.15.86:0/944910788 >> v2:172.21.15.135:3300/0 conn(0x7fb17c069d60 0x7fb17c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 -- 172.21.15.86:0/944910788 >> v2:172.21.15.135:3300/0 conn(0x7fb17c069d60 msgr2=0x7fb17c0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 --2- 172.21.15.86:0/944910788 >> v2:172.21.15.135:3300/0 conn(0x7fb17c069d60 0x7fb17c0c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 -- 172.21.15.86:0/944910788 >> v1:172.21.15.135:6789/0 conn(0x7fb17c0aca80 legacy=0x7fb17c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 -- 172.21.15.86:0/944910788 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c06b2b0 con 0x7fb17c0c81f0 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17a7fc700 1 --2- 172.21.15.86:0/944910788 >> v2:172.21.15.135:3300/0 conn(0x7fb17c069d60 0x7fb17c0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb17b7fe700 1 --2- 172.21.15.86:0/944910788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c0cb800 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06e540 tx=0x7fb174009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958a16b9e38e24b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.848+0000 7fb179ffb700 1 -- 172.21.15.86:0/944910788 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400e070 con 0x7fb17c0c81f0 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb179ffb700 1 -- 172.21.15.86:0/944910788 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400ba10 con 0x7fb17c0c81f0 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb179ffb700 1 -- 172.21.15.86:0/944910788 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740092e0 con 0x7fb17c0c81f0 2023-10-09T11:56:34.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 -- 172.21.15.86:0/944910788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 msgr2=0x7fb17c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 --2- 172.21.15.86:0/944910788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c0cb800 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06e540 tx=0x7fb174009840 comp rx=0 tx=0).stop 2023-10-09T11:56:34.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 -- 172.21.15.86:0/944910788 shutdown_connections 2023-10-09T11:56:34.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 --2- 172.21.15.86:0/944910788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c0cb800 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 --2- 172.21.15.86:0/944910788 >> v2:172.21.15.135:3300/0 conn(0x7fb17c069d60 0x7fb17c0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 -- 172.21.15.86:0/944910788 >> 172.21.15.86:0/944910788 conn(0x7fb17c0cd670 msgr2=0x7fb17c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:34.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 -- 172.21.15.86:0/944910788 shutdown_connections 2023-10-09T11:56:34.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.849+0000 7fb1815ff700 1 -- 172.21.15.86:0/944910788 wait complete. 2023-10-09T11:56:34.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.851+0000 7fb1815ff700 1 Processor -- start 2023-10-09T11:56:34.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.851+0000 7fb1815ff700 1 -- start start 2023-10-09T11:56:34.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb1815ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb17c069d60 0x7fb17c15e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb1815ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb17c0aca80 0x7fb17c15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb1815ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb1815ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15cf80 con 0x7fb17c0c81f0 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb1815ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15c370 con 0x7fb17c069d60 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb1815ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15c650 con 0x7fb17c0aca80 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c15b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37836/0 (socket says 172.21.15.86:37836) 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 -- 172.21.15.86:0/1790632486 learned_addr learned my addr 172.21.15.86:0/1790632486 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17a7fc700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb17c0aca80 0x7fb17c15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17affd700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb17c069d60 0x7fb17c15e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 -- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb17c0aca80 msgr2=0x7fb17c15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb17c0aca80 0x7fb17c15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 -- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb17c069d60 msgr2=0x7fb17c15e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb17c069d60 0x7fb17c15e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 -- 172.21.15.86:0/1790632486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb174009ae0 con 0x7fb17c0c81f0 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17a7fc700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb17c0aca80 0x7fb17c15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.852+0000 7fb17b7fe700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c15b5d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06c6a0 tx=0x7fb174017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.853+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174012e60 con 0x7fb17c0c81f0 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.853+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740092e0 con 0x7fb17c0c81f0 2023-10-09T11:56:34.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.853+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c15c930 con 0x7fb17c0c81f0 2023-10-09T11:56:34.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.853+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17401d650 con 0x7fb17c0c81f0 2023-10-09T11:56:34.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.853+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c159720 con 0x7fb17c0c81f0 2023-10-09T11:56:34.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.854+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c04c3c0 con 0x7fb17c0c81f0 2023-10-09T11:56:34.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.855+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 29) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb17401da00 con 0x7fb17c0c81f0 2023-10-09T11:56:34.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.855+0000 7fb162ffd700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb168066f30 0x7fb1680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:34.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.856+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb174085fd0 con 0x7fb17c0c81f0 2023-10-09T11:56:34.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.856+0000 7fb17affd700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb168066f30 0x7fb1680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:34.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.856+0000 7fb17affd700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb168066f30 0x7fb1680693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0099d0 tx=0x7fb16c008040 comp rx=0 tx=0).ready entity=mgr.6027 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:34.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:34.860+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1740530c0 con 0x7fb17c0c81f0 2023-10-09T11:56:35.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.104+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb17c15df90 con 0x7fb17c0c81f0 2023-10-09T11:56:35.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.290+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 30) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb174053490 con 0x7fb17c0c81f0 2023-10-09T11:56:35.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.291+0000 7fb162ffd700 1 -- 172.21.15.86:0/1790632486 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v30) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb174056b50 con 0x7fb17c0c81f0 2023-10-09T11:56:35.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb168066f30 msgr2=0x7fb1680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb168066f30 0x7fb1680693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0099d0 tx=0x7fb16c008040 comp rx=0 tx=0).stop 2023-10-09T11:56:35.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 msgr2=0x7fb17c15b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c15b5d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06c6a0 tx=0x7fb174017000 comp rx=0 tx=0).stop 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 shutdown_connections 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb168066f30 0x7fb1680693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb17c0c81f0 0x7fb17c15b5d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb17c069d60 0x7fb17c15e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 --2- 172.21.15.86:0/1790632486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb17c0aca80 0x7fb17c15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 >> 172.21.15.86:0/1790632486 conn(0x7fb17c0cd670 msgr2=0x7fb17c0c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 shutdown_connections 2023-10-09T11:56:35.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.294+0000 7fb1815ff700 1 -- 172.21.15.86:0/1790632486 wait complete. 2023-10-09T11:56:35.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T11:56:35.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.501+0000 7ff75db9d700 1 Processor -- start 2023-10-09T11:56:35.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.501+0000 7ff75db9d700 1 -- start start 2023-10-09T11:56:35.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.502+0000 7ff75db9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff758159a60 0x7ff7580c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.502+0000 7ff75db9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7580ccc00 0x7ff758069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.502+0000 7ff75db9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7580c9cb0 con 0x7ff75806a020 2023-10-09T11:56:35.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.502+0000 7ff75db9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75806dfc0 con 0x7ff7580ccc00 2023-10-09T11:56:35.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.502+0000 7ff75db9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580c9f30 con 0x7ff758159a60 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.502+0000 7ff75d39c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff75806a020 0x7ff7580cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44984/0 (socket says 172.21.15.86:44984) 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff75d39c700 1 -- 172.21.15.86:0/536317747 learned_addr learned my addr 172.21.15.86:0/536317747 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff75cb9b700 1 --2- 172.21.15.86:0/536317747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff758159a60 0x7ff7580c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff757fff700 1 --2- 172.21.15.86:0/536317747 >> v2:172.21.15.135:3300/0 conn(0x7ff7580ccc00 0x7ff758069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff7577fe700 1 -- 172.21.15.86:0/536317747 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151630370 0 0) 0x7ff7580c9cb0 con 0x7ff75806a020 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff7577fe700 1 -- 172.21.15.86:0/536317747 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff748003570 con 0x7ff75806a020 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff75cb9b700 1 -- 172.21.15.86:0/536317747 >> v2:172.21.15.135:3300/0 conn(0x7ff7580ccc00 msgr2=0x7ff758069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff75cb9b700 1 --2- 172.21.15.86:0/536317747 >> v2:172.21.15.135:3300/0 conn(0x7ff7580ccc00 0x7ff758069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff75cb9b700 1 -- 172.21.15.86:0/536317747 >> v1:172.21.15.86:6789/0 conn(0x7ff75806a020 legacy=0x7ff7580cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff75cb9b700 1 -- 172.21.15.86:0/536317747 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7580ca470 con 0x7ff758159a60 2023-10-09T11:56:35.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.503+0000 7ff75cb9b700 1 --2- 172.21.15.86:0/536317747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff758159a60 0x7ff7580c9770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0098e0 tx=0x7ff74c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b5f497cec2d1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff7577fe700 1 -- 172.21.15.86:0/536317747 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c011630 con 0x7ff758159a60 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff7577fe700 1 -- 172.21.15.86:0/536317747 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c011790 con 0x7ff758159a60 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff7577fe700 1 -- 172.21.15.86:0/536317747 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c011b30 con 0x7ff758159a60 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff75db9d700 1 -- 172.21.15.86:0/536317747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff758159a60 msgr2=0x7ff7580c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff75db9d700 1 --2- 172.21.15.86:0/536317747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff758159a60 0x7ff7580c9770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0098e0 tx=0x7ff74c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff75db9d700 1 -- 172.21.15.86:0/536317747 shutdown_connections 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff75db9d700 1 --2- 172.21.15.86:0/536317747 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff758159a60 0x7ff7580c9770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff75db9d700 1 --2- 172.21.15.86:0/536317747 >> v2:172.21.15.135:3300/0 conn(0x7ff7580ccc00 0x7ff758069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff75db9d700 1 -- 172.21.15.86:0/536317747 >> 172.21.15.86:0/536317747 conn(0x7ff75806baa0 msgr2=0x7ff75806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:35.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.504+0000 7ff75db9d700 1 -- 172.21.15.86:0/536317747 shutdown_connections 2023-10-09T11:56:35.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.505+0000 7ff75db9d700 1 -- 172.21.15.86:0/536317747 wait complete. 2023-10-09T11:56:35.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.506+0000 7ff75db9d700 1 Processor -- start 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.506+0000 7ff75db9d700 1 -- start start 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75db9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff75806a020 0x7ff758151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75db9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7580ccc00 0x7ff7580b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75db9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff758159a60 0x7ff7580c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75db9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580b2400 con 0x7ff758159a60 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75db9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580b1e40 con 0x7ff7580ccc00 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75db9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580b2120 con 0x7ff75806a020 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75d39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff758159a60 0x7ff7580c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75cb9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff75806a020 0x7ff758151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75d39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff758159a60 0x7ff7580c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55226/0 (socket says 172.21.15.86:55226) 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff75d39c700 1 -- 172.21.15.86:0/3241924365 learned_addr learned my addr 172.21.15.86:0/3241924365 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.507+0000 7ff757fff700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7580ccc00 0x7ff7580b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75d39c700 1 -- 172.21.15.86:0/3241924365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff75806a020 msgr2=0x7ff758151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75d39c700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff75806a020 0x7ff758151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75d39c700 1 -- 172.21.15.86:0/3241924365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7580ccc00 msgr2=0x7ff7580b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75d39c700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7580ccc00 0x7ff7580b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75d39c700 1 -- 172.21.15.86:0/3241924365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c009420 con 0x7ff758159a60 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75d39c700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff758159a60 0x7ff7580c66d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff750001460 tx=0x7ff750001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff754ff9700 1 -- 172.21.15.86:0/3241924365 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75000a890 con 0x7ff758159a60 2023-10-09T11:56:35.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff754ff9700 1 -- 172.21.15.86:0/3241924365 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75000a9f0 con 0x7ff758159a60 2023-10-09T11:56:35.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7580b2bb0 con 0x7ff758159a60 2023-10-09T11:56:35.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff754ff9700 1 -- 172.21.15.86:0/3241924365 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75000ad70 con 0x7ff758159a60 2023-10-09T11:56:35.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.508+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7581522e0 con 0x7ff758159a60 2023-10-09T11:56:35.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.509+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7580b2a10 con 0x7ff758159a60 2023-10-09T11:56:35.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.510+0000 7ff754ff9700 1 -- 172.21.15.86:0/3241924365 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 30) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff750007300 con 0x7ff758159a60 2023-10-09T11:56:35.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.511+0000 7ff754ff9700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 0x7ff73c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.511+0000 7ff754ff9700 1 -- 172.21.15.86:0/3241924365 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7ff750084bf0 con 0x7ff758159a60 2023-10-09T11:56:35.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.511+0000 7ff75cb9b700 1 -- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 msgr2=0x7ff73c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:35.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.511+0000 7ff75cb9b700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 0x7ff73c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:35.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.515+0000 7ff754ff9700 1 -- 172.21.15.86:0/3241924365 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7580b2a10 con 0x7ff758159a60 2023-10-09T11:56:35.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.712+0000 7ff75cb9b700 1 -- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 msgr2=0x7ff73c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:35.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.712+0000 7ff75cb9b700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 0x7ff73c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.714+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff7580b2a10 con 0x7ff758159a60 2023-10-09T11:56:35.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.718+0000 7ff754ff9700 1 -- 172.21.15.86:0/3241924365 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff7580b2a10 con 0x7ff758159a60 2023-10-09T11:56:35.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 msgr2=0x7ff73c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 0x7ff73c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff758159a60 msgr2=0x7ff7580c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff758159a60 0x7ff7580c66d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff750001460 tx=0x7ff750001ae0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 shutdown_connections 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff73c066f80 0x7ff73c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff758159a60 0x7ff7580c66d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff75806a020 0x7ff758151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 --2- 172.21.15.86:0/3241924365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7580ccc00 0x7ff7580b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 >> 172.21.15.86:0/3241924365 conn(0x7ff75806baa0 msgr2=0x7ff758156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:35.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 shutdown_connections 2023-10-09T11:56:35.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.720+0000 7ff75db9d700 1 -- 172.21.15.86:0/3241924365 wait complete. 2023-10-09T11:56:35.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T11:56:35.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.926+0000 7f5400b9d700 1 Processor -- start 2023-10-09T11:56:35.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.926+0000 7f5400b9d700 1 -- start start 2023-10-09T11:56:35.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.927+0000 7f5400b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53fc0b1b40 0x7f53fc0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.927+0000 7f5400b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0cfb00 con 0x7f53fc0b16d0 2023-10-09T11:56:35.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.927+0000 7f5400b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0b5c40 con 0x7f53fc0b4e70 2023-10-09T11:56:35.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.927+0000 7f5400b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0b5f20 con 0x7f53fc0b1b40 2023-10-09T11:56:35.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53faffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f53fc0b16d0 0x7f53fc0b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44986/0 (socket says 172.21.15.86:44986) 2023-10-09T11:56:35.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53faffd700 1 -- 172.21.15.86:0/1940791930 learned_addr learned my addr 172.21.15.86:0/1940791930 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53fbfff700 1 --2- 172.21.15.86:0/1940791930 >> v2:172.21.15.86:3300/0 conn(0x7f53fc0b1b40 0x7f53fc0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53fa7fc700 1 -- 172.21.15.86:0/1940791930 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824073597 0 0) 0x7f53fc0cfb00 con 0x7f53fc0b16d0 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53fa7fc700 1 -- 172.21.15.86:0/1940791930 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e4003570 con 0x7f53fc0b16d0 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53fa7fc700 1 -- 172.21.15.86:0/1940791930 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685078827 0 0) 0x7f53fc0b5c40 con 0x7f53fc0b4e70 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53fbfff700 1 -- 172.21.15.86:0/1940791930 >> v1:172.21.15.135:6789/0 conn(0x7f53fc0b4e70 legacy=0x7f53fc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53fbfff700 1 -- 172.21.15.86:0/1940791930 >> v1:172.21.15.86:6789/0 conn(0x7f53fc0b16d0 legacy=0x7f53fc0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.928+0000 7f53fbfff700 1 -- 172.21.15.86:0/1940791930 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0b6200 con 0x7f53fc0b1b40 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.929+0000 7f53fbfff700 1 --2- 172.21.15.86:0/1940791930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0b3ac0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009e60 tx=0x7f53f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba64e1c180d94f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:35.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.929+0000 7f53fa7fc700 1 -- 172.21.15.86:0/1940791930 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400e070 con 0x7f53fc0b1b40 2023-10-09T11:56:35.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.929+0000 7f53fa7fc700 1 -- 172.21.15.86:0/1940791930 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f400bb60 con 0x7f53fc0b1b40 2023-10-09T11:56:35.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.929+0000 7f53fa7fc700 1 -- 172.21.15.86:0/1940791930 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4012430 con 0x7f53fc0b1b40 2023-10-09T11:56:35.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.929+0000 7f5400b9d700 1 -- 172.21.15.86:0/1940791930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 msgr2=0x7f53fc0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.929+0000 7f5400b9d700 1 --2- 172.21.15.86:0/1940791930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0b3ac0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009e60 tx=0x7f53f4009780 comp rx=0 tx=0).stop 2023-10-09T11:56:35.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.930+0000 7f5400b9d700 1 -- 172.21.15.86:0/1940791930 shutdown_connections 2023-10-09T11:56:35.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.930+0000 7f5400b9d700 1 --2- 172.21.15.86:0/1940791930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0b3ac0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.930+0000 7f5400b9d700 1 -- 172.21.15.86:0/1940791930 >> 172.21.15.86:0/1940791930 conn(0x7f53fc0d10c0 msgr2=0x7f53fc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:35.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.930+0000 7f5400b9d700 1 -- 172.21.15.86:0/1940791930 shutdown_connections 2023-10-09T11:56:35.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.930+0000 7f5400b9d700 1 -- 172.21.15.86:0/1940791930 wait complete. 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.931+0000 7f5400b9d700 1 Processor -- start 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.931+0000 7f5400b9d700 1 -- start start 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f5400b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53fc0b16d0 0x7f53fc157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f5400b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f5400b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53fc0b4e70 0x7f53fc15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f5400b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0c6760 con 0x7f53fc0b1b40 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f5400b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc158050 con 0x7f53fc0b16d0 2023-10-09T11:56:35.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f5400b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0c9460 con 0x7f53fc0b4e70 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f53faffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f53faffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55242/0 (socket says 172.21.15.86:55242) 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f53faffd700 1 -- 172.21.15.86:0/2726255896 learned_addr learned my addr 172.21.15.86:0/2726255896 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f53fb7fe700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53fc0b16d0 0x7f53fc157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.932+0000 7f53fbfff700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53fc0b4e70 0x7f53fc15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53faffd700 1 -- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53fc0b4e70 msgr2=0x7f53fc15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53faffd700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53fc0b4e70 0x7f53fc15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53faffd700 1 -- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53fc0b16d0 msgr2=0x7f53fc157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:35.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53faffd700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53fc0b16d0 0x7f53fc157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:35.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53faffd700 1 -- 172.21.15.86:0/2726255896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4009a20 con 0x7f53fc0b1b40 2023-10-09T11:56:35.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53faffd700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0c5390 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c790 tx=0x7f53f0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:35.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53e37fe700 1 -- 172.21.15.86:0/2726255896 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0005b30 con 0x7f53fc0b1b40 2023-10-09T11:56:35.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53e37fe700 1 -- 172.21.15.86:0/2726255896 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0005c90 con 0x7f53fc0b1b40 2023-10-09T11:56:35.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f53e37fe700 1 -- 172.21.15.86:0/2726255896 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0007320 con 0x7f53fc0b1b40 2023-10-09T11:56:35.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc0c5be0 con 0x7f53fc0b1b40 2023-10-09T11:56:35.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.933+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc0c61a0 con 0x7f53fc0b1b40 2023-10-09T11:56:35.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.935+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc0c95a0 con 0x7f53fc0b1b40 2023-10-09T11:56:35.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.935+0000 7f53e37fe700 1 -- 172.21.15.86:0/2726255896 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 30) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f53f0007690 con 0x7f53fc0b1b40 2023-10-09T11:56:35.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.936+0000 7f53e37fe700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 0x7f53e8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:35.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.936+0000 7f53e37fe700 1 -- 172.21.15.86:0/2726255896 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f53f0083bd0 con 0x7f53fc0b1b40 2023-10-09T11:56:35.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.936+0000 7f53fb7fe700 1 -- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 msgr2=0x7f53e8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:35.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.936+0000 7f53fb7fe700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 0x7f53e8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:35.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:35.940+0000 7f53e37fe700 1 -- 172.21.15.86:0/2726255896 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53f0050c20 con 0x7f53fc0b1b40 2023-10-09T11:56:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.137+0000 7f53fb7fe700 1 -- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 msgr2=0x7f53e8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.137+0000 7f53fb7fe700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 0x7f53e8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:36.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.160+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f53fc0cd820 con 0x7f53fc0b1b40 2023-10-09T11:56:36.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.164+0000 7f53e37fe700 1 -- 172.21.15.86:0/2726255896 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f53f0017020 con 0x7f53fc0b1b40 2023-10-09T11:56:36.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 msgr2=0x7f53e8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:36.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 0x7f53e8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 msgr2=0x7f53fc0c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0c5390 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c790 tx=0x7f53f0007df0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 shutdown_connections 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53fc0b4e70 0x7f53fc15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53fc0b16d0 0x7f53fc157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53e8066f80 0x7f53e8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 --2- 172.21.15.86:0/2726255896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53fc0b1b40 0x7f53fc0c5390 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 >> 172.21.15.86:0/2726255896 conn(0x7f53fc0d10c0 msgr2=0x7f53fc0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 shutdown_connections 2023-10-09T11:56:36.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.167+0000 7f5400b9d700 1 -- 172.21.15.86:0/2726255896 wait complete. 2023-10-09T11:56:36.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:36.186 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T11:56:36.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-09T11:56:36.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.457+0000 7fcbf2b9d700 1 Processor -- start 2023-10-09T11:56:36.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.457+0000 7fcbf2b9d700 1 -- start start 2023-10-09T11:56:36.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.458+0000 7fcbf2b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcbec0b03c0 0x7fcbec0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:36.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf2b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec1591e0 0x7fcbec159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:36.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf2b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec0cfa00 con 0x7fcbec0b0790 2023-10-09T11:56:36.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf2b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0cb580 con 0x7fcbec0b03c0 2023-10-09T11:56:36.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf2b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0cf160 con 0x7fcbec1591e0 2023-10-09T11:56:36.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf1b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcbec0b03c0 0x7fcbec0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:36.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf1b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcbec0b03c0 0x7fcbec0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55250/0 (socket says 172.21.15.86:55250) 2023-10-09T11:56:36.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/1730204833 learned_addr learned my addr 172.21.15.86:0/1730204833 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf239c700 1 --2- 172.21.15.86:0/1730204833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec1591e0 0x7fcbec159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/1730204833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec1591e0 msgr2=0x7fcbec159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/1730204833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec1591e0 0x7fcbec159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/1730204833 >> v1:172.21.15.135:6789/0 conn(0x7fcbec0b0790 legacy=0x7fcbec0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/1730204833 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0cf440 con 0x7fcbec0b03c0 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.459+0000 7fcbf0b99700 1 -- 172.21.15.86:0/1730204833 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802406232 0 0) 0x7fcbec0cfa00 con 0x7fcbec0b0790 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.460+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/1730204833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec0b03c0 0x7fcbec0cea70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80099e0 tx=0x7fcbe8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccc1186bff58537 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.460+0000 7fcbf0b99700 1 -- 172.21.15.86:0/1730204833 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800b820 con 0x7fcbec0b03c0 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.460+0000 7fcbf0b99700 1 -- 172.21.15.86:0/1730204833 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe800b980 con 0x7fcbec0b03c0 2023-10-09T11:56:36.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.460+0000 7fcbf0b99700 1 -- 172.21.15.86:0/1730204833 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800bd20 con 0x7fcbec0b03c0 2023-10-09T11:56:36.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/1730204833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec0b03c0 msgr2=0x7fcbec0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 --2- 172.21.15.86:0/1730204833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec0b03c0 0x7fcbec0cea70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80099e0 tx=0x7fcbe8009250 comp rx=0 tx=0).stop 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/1730204833 shutdown_connections 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 --2- 172.21.15.86:0/1730204833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec1591e0 0x7fcbec159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 --2- 172.21.15.86:0/1730204833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec0b03c0 0x7fcbec0cea70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/1730204833 >> 172.21.15.86:0/1730204833 conn(0x7fcbec063230 msgr2=0x7fcbec063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/1730204833 shutdown_connections 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.461+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/1730204833 wait complete. 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.462+0000 7fcbf2b9d700 1 Processor -- start 2023-10-09T11:56:36.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.462+0000 7fcbf2b9d700 1 -- start start 2023-10-09T11:56:36.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf2b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b03c0 0x7fcbec15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:36.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf2b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0b0790 0x7fcbec158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:36.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf2b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec1591e0 0x7fcbec15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:36.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf2b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0c5420 con 0x7fcbec1591e0 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf2b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0c56c0 con 0x7fcbec0b0790 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf2b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec158a80 con 0x7fcbec0b03c0 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf239c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec1591e0 0x7fcbec15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf239c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec1591e0 0x7fcbec15a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55260/0 (socket says 172.21.15.86:55260) 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf239c700 1 -- 172.21.15.86:0/28199486 learned_addr learned my addr 172.21.15.86:0/28199486 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b03c0 0x7fcbec15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.463+0000 7fcbf139a700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0b0790 0x7fcbec158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf239c700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b03c0 msgr2=0x7fcbec15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf239c700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcbec0b03c0 0x7fcbec15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf239c700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0b0790 msgr2=0x7fcbec158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf239c700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0b0790 0x7fcbec158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf239c700 1 -- 172.21.15.86:0/28199486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80094f0 con 0x7fcbec1591e0 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf239c700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec1591e0 0x7fcbec15a5b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009e20 tx=0x7fcbe400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400caa0 con 0x7fcbec1591e0 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400f040 con 0x7fcbec1591e0 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/28199486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec15d150 con 0x7fcbec1591e0 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.464+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400ce70 con 0x7fcbec1591e0 2023-10-09T11:56:36.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.465+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/28199486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec15d710 con 0x7fcbec1591e0 2023-10-09T11:56:36.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.465+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/28199486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec04c3c0 con 0x7fcbec1591e0 2023-10-09T11:56:36.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.466+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 30) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fcbe4014690 con 0x7fcbec1591e0 2023-10-09T11:56:36.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.467+0000 7fcbe1ffb700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:36.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.467+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 msgr2=0x7fcbd0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:36.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.467+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fcbe4084ff0 con 0x7fcbec1591e0 2023-10-09T11:56:36.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.467+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:36.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.471+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbe4055b10 con 0x7fcbec1591e0 2023-10-09T11:56:36.565 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:36.565+0000 7fbc572a7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:56:36.635 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:36.635+0000 7f537ce8c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:56:36.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.668+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 msgr2=0x7fcbd0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:36.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.668+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:36.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:36.697+0000 7fcbf2b9d700 1 -- 172.21.15.86:0/28199486 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbec15d930 con 0x7fcbd0066f80 2023-10-09T11:56:36.729 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:36.729+0000 7fbc572a7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:36.803 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:36.803+0000 7f537ce8c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:36.814 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:36.814+0000 7fbc572a7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:56:36.887 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:36.887+0000 7f537ce8c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:56:37.038 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:37.038+0000 7fbc572a7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:37.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:37.069+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 msgr2=0x7fcbd0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:37.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:37.069+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:56:37.110 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:37.110+0000 7f537ce8c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:37.216 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:37.215+0000 7fbc572a7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:56:37.286 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:37.286+0000 7f537ce8c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:56:37.308 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:37.308+0000 7fbc572a7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:56:37.378 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:37.378+0000 7f537ce8c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:56:37.470 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:37.470+0000 7fbc572a7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:56:37.539 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:37.539+0000 7f537ce8c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:56:37.570 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:37.570+0000 7fbc572a7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:37.638 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:37.638+0000 7f537ce8c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:37.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:37.870+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 msgr2=0x7fcbd0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:37.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:37.870+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T11:56:38.057 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:38.056+0000 7fbc572a7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:56:38.120 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:38.120+0000 7f537ce8c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:56:38.149 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:38.149+0000 7fbc572a7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:56:38.213 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:38.213+0000 7f537ce8c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:56:38.240 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:38.240+0000 7fbc572a7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:56:38.302 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:38.301+0000 7f537ce8c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:56:38.861 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:38.861+0000 7fbc572a7180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:56:38.916 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:38.916+0000 7f537ce8c180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:56:39.032 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:39.032+0000 7fbc572a7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:39.088 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:39.087+0000 7f537ce8c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:39.128 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:39.127+0000 7fbc572a7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:56:39.181 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:39.181+0000 7f537ce8c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:56:39.420 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:39.419+0000 7fbc572a7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:56:39.470 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:39.470+0000 7f537ce8c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:56:39.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:39.471+0000 7fcbf1b9b700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 msgr2=0x7fcbd0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:39.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:39.471+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T11:56:39.516 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:39.516+0000 7fbc572a7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:56:39.564 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:39.564+0000 7f537ce8c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:56:40.219 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:40.218+0000 7fbc572a7180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:56:40.256 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:40.256+0000 7f537ce8c180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:56:40.505 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:40.505+0000 7fbc572a7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:56:40.537 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:40.537+0000 7f537ce8c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:56:40.597 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:40.597+0000 7fbc572a7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:56:40.628 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:40.628+0000 7f537ce8c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:56:40.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:56:40.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:56:40.752 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:40.751+0000 7fbc572a7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:56:40.783 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:40.783+0000 7f537ce8c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:56:40.861 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:40.860+0000 7fbc572a7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:56:40.889 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:40.889+0000 7f537ce8c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:56:41.050 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:41.049+0000 7fbc572a7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:56:41.076 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.076+0000 7f537ce8c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:56:41.141 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:41.141+0000 7fbc572a7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:56:41.168 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.168+0000 7f537ce8c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:56:41.232 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:41.232+0000 7fbc572a7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:56:41.259 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.259+0000 7f537ce8c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:56:41.324 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:41.324+0000 7fbc572a7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:56:41.351 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.351+0000 7f537ce8c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:56:41.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:41.361+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 31) v1 ==== 84468+0+0 (secure 0 0 0) 0x7fcbe4052450 con 0x7fcbec1591e0 2023-10-09T11:56:41.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:41.361+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 msgr2=0x7fcbd0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:41.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:41.361+0000 7fcbe1ffb700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:41.488 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52ef171700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.488 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52ef171700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.488 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52ef171700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.489 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52ef171700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.489 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52ef171700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.489 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52f2177700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.490 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52f2177700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.490 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52f2177700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.490 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52f2177700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:41.490 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:41.488+0000 7f52f2177700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:42.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.392+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 32) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fcbe40591f0 con 0x7fcbec1591e0 2023-10-09T11:56:42.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.392+0000 7fcbe1ffb700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:42.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.392+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbec15d930 con 0x7fcbd0066f80 2023-10-09T11:56:42.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.395+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:42.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.400+0000 7fcbf1b9b700 1 --2- 172.21.15.86:0/28199486 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcbd0066f80 0x7fcbd00693b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80099e0 tx=0x7fcbe8017000 comp rx=0 tx=0).ready entity=mgr.6423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:42.409 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:42.409+0000 7f52f9185700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-09T11:56:42.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.409+0000 7fcbe1ffb700 1 -- 172.21.15.86:0/28199486 <== mgr.6423 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fcbec15d930 con 0x7fcbd0066f80 2023-10-09T11:56:42.412 INFO:teuthology.orchestra.run.smithi086.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-09T11:56:42.420 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-09T11:56:42.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:42.421 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T11:56:42.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T11:56:42.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.687+0000 7f8c4d9ff700 1 Processor -- start 2023-10-09T11:56:42.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.687+0000 7f8c4d9ff700 1 -- start start 2023-10-09T11:56:42.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.688+0000 7f8c4d9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c480ccee0 0x7f8c481561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:42.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.688+0000 7f8c4d9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4815b0d0 con 0x7f8c480c87c0 2023-10-09T11:56:42.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.688+0000 7f8c4d9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4815a4c0 con 0x7f8c480c83f0 2023-10-09T11:56:42.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.688+0000 7f8c4d9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4815a7a0 con 0x7f8c480ccee0 2023-10-09T11:56:42.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c467fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c480ccee0 0x7f8c481561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:42.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c477fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8c480c87c0 0x7f8c480ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:44990/0 (socket says 172.21.15.86:44990) 2023-10-09T11:56:42.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c477fe700 1 -- 172.21.15.86:0/2436990160 learned_addr learned my addr 172.21.15.86:0/2436990160 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:42.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c467fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c480ccee0 0x7f8c481561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55370/0 (socket says 172.21.15.86:55370) 2023-10-09T11:56:42.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c45ffb700 1 -- 172.21.15.86:0/2436990160 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916236815 0 0) 0x7f8c4815b0d0 con 0x7f8c480c87c0 2023-10-09T11:56:42.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c467fc700 1 -- 172.21.15.86:0/2436990160 >> v1:172.21.15.135:6789/0 conn(0x7f8c480c83f0 legacy=0x7f8c480c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:42.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c467fc700 1 -- 172.21.15.86:0/2436990160 >> v1:172.21.15.86:6789/0 conn(0x7f8c480c87c0 legacy=0x7f8c480ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:42.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.689+0000 7f8c467fc700 1 -- 172.21.15.86:0/2436990160 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4815aa80 con 0x7f8c480ccee0 2023-10-09T11:56:42.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c467fc700 1 --2- 172.21.15.86:0/2436990160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481561d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00bb90 tx=0x7f8c3c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f50d5586a8a56db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:42.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c45ffb700 1 -- 172.21.15.86:0/2436990160 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00dba0 con 0x7f8c480ccee0 2023-10-09T11:56:42.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c45ffb700 1 -- 172.21.15.86:0/2436990160 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c00dd00 con 0x7f8c480ccee0 2023-10-09T11:56:42.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c45ffb700 1 -- 172.21.15.86:0/2436990160 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0196b0 con 0x7f8c480ccee0 2023-10-09T11:56:42.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/2436990160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 msgr2=0x7f8c481561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:42.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/2436990160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481561d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00bb90 tx=0x7f8c3c00b430 comp rx=0 tx=0).stop 2023-10-09T11:56:42.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/2436990160 shutdown_connections 2023-10-09T11:56:42.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/2436990160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481561d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:42.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/2436990160 >> 172.21.15.86:0/2436990160 conn(0x7f8c48068e10 msgr2=0x7f8c480cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:42.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/2436990160 shutdown_connections 2023-10-09T11:56:42.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.690+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/2436990160 wait complete. 2023-10-09T11:56:42.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.692+0000 7f8c4d9ff700 1 Processor -- start 2023-10-09T11:56:42.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.692+0000 7f8c4d9ff700 1 -- start start 2023-10-09T11:56:42.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c4d9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c83f0 0x7f8c4814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:42.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c4d9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480c87c0 0x7f8c480c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:42.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c4d9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:42.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c4d9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480c59f0 con 0x7f8c480ccee0 2023-10-09T11:56:42.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c4d9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480c5cd0 con 0x7f8c480c83f0 2023-10-09T11:56:42.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c4d9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480c5fb0 con 0x7f8c480c87c0 2023-10-09T11:56:42.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:42.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55386/0 (socket says 172.21.15.86:55386) 2023-10-09T11:56:42.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c477fe700 1 -- 172.21.15.86:0/27426178 learned_addr learned my addr 172.21.15.86:0/27426178 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:42.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.693+0000 7f8c46ffd700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c83f0 0x7f8c4814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:42.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c467fc700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480c87c0 0x7f8c480c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:42.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c477fe700 1 -- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480c87c0 msgr2=0x7f8c480c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:42.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c477fe700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480c87c0 0x7f8c480c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:42.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c477fe700 1 -- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c83f0 msgr2=0x7f8c4814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:42.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c477fe700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c83f0 0x7f8c4814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:42.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c477fe700 1 -- 172.21.15.86:0/27426178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c00b6d0 con 0x7f8c480ccee0 2023-10-09T11:56:42.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c46ffd700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c83f0 0x7f8c4814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c477fe700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481512a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000cc90 tx=0x7f8c40001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4000cea0 con 0x7f8c480ccee0 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4000ab30 con 0x7f8c480ccee0 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c480c6290 con 0x7f8c480ccee0 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400070f0 con 0x7f8c480ccee0 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.694+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c481559b0 con 0x7f8c480ccee0 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.695+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4804c3c0 con 0x7f8c480ccee0 2023-10-09T11:56:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.696+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 32) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f8c400074a0 con 0x7f8c480ccee0 2023-10-09T11:56:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.697+0000 7f8c2effd700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c34066dd0 0x7f8c34069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.697+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f8c400849b0 con 0x7f8c480ccee0 2023-10-09T11:56:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.697+0000 7f8c46ffd700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c34066dd0 0x7f8c34069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.698+0000 7f8c46ffd700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c34066dd0 0x7f8c34069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007fd0 tx=0x7f8c38009040 comp rx=0 tx=0).ready entity=mgr.6423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:42.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.701+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c40051c00 con 0x7f8c480ccee0 2023-10-09T11:56:42.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:42.947+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f8c480cbd90 con 0x7f8c480ccee0 2023-10-09T11:56:43.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.402+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f8c40051fd0 con 0x7f8c480ccee0 2023-10-09T11:56:43.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.403+0000 7f8c2effd700 1 -- 172.21.15.86:0/27426178 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v33) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8c40051c00 con 0x7f8c480ccee0 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c34066dd0 msgr2=0x7f8c34069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c34066dd0 0x7f8c34069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007fd0 tx=0x7f8c38009040 comp rx=0 tx=0).stop 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 msgr2=0x7f8c481512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481512a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000cc90 tx=0x7f8c40001a20 comp rx=0 tx=0).stop 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 shutdown_connections 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c34066dd0 0x7f8c34069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c480ccee0 0x7f8c481512a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c480c83f0 0x7f8c4814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 --2- 172.21.15.86:0/27426178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c480c87c0 0x7f8c480c4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 >> 172.21.15.86:0/27426178 conn(0x7f8c48068e10 msgr2=0x7f8c480cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:43.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 shutdown_connections 2023-10-09T11:56:43.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.406+0000 7f8c4d9ff700 1 -- 172.21.15.86:0/27426178 wait complete. 2023-10-09T11:56:43.426 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:56:43.426 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:43.506 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:43.586 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:56:43.586 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:56:43.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:56:43.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:56:43.671 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:56:43.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:56:43.671 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:56:43.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:43.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.933+0000 7fb4cbfff700 1 Processor -- start 2023-10-09T11:56:43.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.934+0000 7fb4cbfff700 1 -- start start 2023-10-09T11:56:43.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4cbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4cc1597f0 0x7fb4cc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:43.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4cbfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4cc0b11d0 con 0x7fb4cc15d230 2023-10-09T11:56:43.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4cbfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4cc0b14b0 con 0x7fb4cc159420 2023-10-09T11:56:43.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4cbfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc0b1790 con 0x7fb4cc1597f0 2023-10-09T11:56:43.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4ca7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4cc1597f0 0x7fb4cc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:43.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4cb7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb4cc15d230 0x7fb4cc15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:45000/0 (socket says 172.21.15.86:45000) 2023-10-09T11:56:43.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4cb7fe700 1 -- 172.21.15.86:0/246940792 learned_addr learned my addr 172.21.15.86:0/246940792 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.936+0000 7fb4c9ffb700 1 -- 172.21.15.86:0/246940792 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761916499 0 0) 0x7fb4cc0b14b0 con 0x7fb4cc159420 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.937+0000 7fb4ca7fc700 1 -- 172.21.15.86:0/246940792 >> v1:172.21.15.135:6789/0 conn(0x7fb4cc159420 legacy=0x7fb4cc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.937+0000 7fb4ca7fc700 1 -- 172.21.15.86:0/246940792 >> v1:172.21.15.86:6789/0 conn(0x7fb4cc15d230 legacy=0x7fb4cc15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.937+0000 7fb4ca7fc700 1 -- 172.21.15.86:0/246940792 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc0b1a70 con 0x7fb4cc1597f0 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.937+0000 7fb4ca7fc700 1 --2- 172.21.15.86:0/246940792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc1597f0 0x7fb4cc0b2270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00098e0 tx=0x7fb4c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55258778d1686d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.937+0000 7fb4c9ffb700 1 -- 172.21.15.86:0/246940792 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0009e80 con 0x7fb4cc1597f0 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.937+0000 7fb4c9ffb700 1 -- 172.21.15.86:0/246940792 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c000b860 con 0x7fb4cc1597f0 2023-10-09T11:56:43.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.937+0000 7fb4c9ffb700 1 -- 172.21.15.86:0/246940792 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000bbe0 con 0x7fb4cc1597f0 2023-10-09T11:56:43.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.938+0000 7fb4cbfff700 1 -- 172.21.15.86:0/246940792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc1597f0 msgr2=0x7fb4cc0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:43.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.938+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/246940792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc1597f0 0x7fb4cc0b2270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00098e0 tx=0x7fb4c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.938+0000 7fb4cbfff700 1 -- 172.21.15.86:0/246940792 shutdown_connections 2023-10-09T11:56:43.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.938+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/246940792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc1597f0 0x7fb4cc0b2270 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.938+0000 7fb4cbfff700 1 -- 172.21.15.86:0/246940792 >> 172.21.15.86:0/246940792 conn(0x7fb4cc0d0660 msgr2=0x7fb4cc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:43.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.938+0000 7fb4cbfff700 1 -- 172.21.15.86:0/246940792 shutdown_connections 2023-10-09T11:56:43.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.938+0000 7fb4cbfff700 1 -- 172.21.15.86:0/246940792 wait complete. 2023-10-09T11:56:43.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.940+0000 7fb4cbfff700 1 Processor -- start 2023-10-09T11:56:43.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.940+0000 7fb4cbfff700 1 -- start start 2023-10-09T11:56:43.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc159420 0x7fb4cc1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:43.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4cc1597f0 0x7fb4cc0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc15d230 0x7fb4cc153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cbfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc154f00 con 0x7fb4cc15d230 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cbfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc16ace0 con 0x7fb4cc159420 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc152840 con 0x7fb4cc1597f0 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc15d230 0x7fb4cc153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc15d230 0x7fb4cc153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55418/0 (socket says 172.21.15.86:55418) 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4caffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc159420 0x7fb4cc1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4cb7fe700 1 -- 172.21.15.86:0/1936619623 learned_addr learned my addr 172.21.15.86:0/1936619623 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:43.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.942+0000 7fb4ca7fc700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4cc1597f0 0x7fb4cc0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cb7fe700 1 -- 172.21.15.86:0/1936619623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4cc1597f0 msgr2=0x7fb4cc0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cb7fe700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4cc1597f0 0x7fb4cc0cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cb7fe700 1 -- 172.21.15.86:0/1936619623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc159420 msgr2=0x7fb4cc1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cb7fe700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc159420 0x7fb4cc1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cb7fe700 1 -- 172.21.15.86:0/1936619623 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0009420 con 0x7fb4cc15d230 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cb7fe700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc15d230 0x7fb4cc153c00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400cb20 tx=0x7fb4c4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4b2ffd700 1 -- 172.21.15.86:0/1936619623 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400a7e0 con 0x7fb4cc15d230 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4b2ffd700 1 -- 172.21.15.86:0/1936619623 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400a960 con 0x7fb4cc15d230 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc16a060 con 0x7fb4cc15d230 2023-10-09T11:56:43.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4b2ffd700 1 -- 172.21.15.86:0/1936619623 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400ad20 con 0x7fb4cc15d230 2023-10-09T11:56:43.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.943+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc16a620 con 0x7fb4cc15d230 2023-10-09T11:56:43.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.944+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc16ae90 con 0x7fb4cc15d230 2023-10-09T11:56:43.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.945+0000 7fb4b2ffd700 1 -- 172.21.15.86:0/1936619623 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fb4c4007300 con 0x7fb4cc15d230 2023-10-09T11:56:43.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.947+0000 7fb4b2ffd700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 0x7fb4b8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:43.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.947+0000 7fb4caffd700 1 -- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 msgr2=0x7fb4b8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:43.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.947+0000 7fb4b2ffd700 1 -- 172.21.15.86:0/1936619623 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fb4c4084cd0 con 0x7fb4cc15d230 2023-10-09T11:56:43.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.947+0000 7fb4caffd700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 0x7fb4b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:43.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:43.950+0000 7fb4b2ffd700 1 -- 172.21.15.86:0/1936619623 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4cc16ae90 con 0x7fb4cc15d230 2023-10-09T11:56:44.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.148+0000 7fb4caffd700 1 -- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 msgr2=0x7fb4b8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:44.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.148+0000 7fb4caffd700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 0x7fb4b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:44.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.194+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4cc16ae50 con 0x7fb4cc15d230 2023-10-09T11:56:44.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.195+0000 7fb4b2ffd700 1 -- 172.21.15.86:0/1936619623 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fb4c4051a20 con 0x7fb4cc15d230 2023-10-09T11:56:44.195 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:44.195 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5926,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2024459788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":2024459788},{"type":"v1","addr":"172.21.15.135:6835","nonce":2024459788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/1216529409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1216529409},{"type":"v1","addr":"172.21.15.86:6833","nonce":1216529409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1408499839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1408499839},{"type":"v1","addr":"172.21.15.86:6835","nonce":1408499839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:56:21.168698+0000","modified":"2023-10-09T11:56:24.731586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3399882940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3399882940},{"type":"v1","addr":"172.21.15.135:6834","nonce":3399882940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:56:44.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 msgr2=0x7fb4b8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:44.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 0x7fb4b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc15d230 msgr2=0x7fb4cc153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc15d230 0x7fb4cc153c00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400cb20 tx=0x7fb4c4001930 comp rx=0 tx=0).stop 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 shutdown_connections 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb4b80670e0 0x7fb4b8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc15d230 0x7fb4cc153c00 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc159420 0x7fb4cc1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.197+0000 7fb4cbfff700 1 --2- 172.21.15.86:0/1936619623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4cc1597f0 0x7fb4cc0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.198+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 >> 172.21.15.86:0/1936619623 conn(0x7fb4cc0d0660 msgr2=0x7fb4cc069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.198+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 shutdown_connections 2023-10-09T11:56:44.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.198+0000 7fb4cbfff700 1 -- 172.21.15.86:0/1936619623 wait complete. 2023-10-09T11:56:44.200 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2023-10-09T11:56:44.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:44.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.403+0000 7f1f69f9d700 1 Processor -- start 2023-10-09T11:56:44.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.403+0000 7f1f69f9d700 1 -- start start 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.404+0000 7f1f69f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f641593b0 0x7f1f64159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.404+0000 7f1f69f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f640ceaa0 0x7f1f640b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.404+0000 7f1f69f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1f640b1740 0x7f1f640b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.404+0000 7f1f69f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f640b2100 con 0x7f1f640ceaa0 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.404+0000 7f1f69f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f640b6570 con 0x7f1f640b1740 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.404+0000 7f1f69f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640cfe20 con 0x7f1f641593b0 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f640ceaa0 0x7f1f640b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f640ceaa0 0x7f1f640b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55422/0 (socket says 172.21.15.86:55422) 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 -- 172.21.15.86:0/3943509174 learned_addr learned my addr 172.21.15.86:0/3943509174 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f68f9b700 1 --2- 172.21.15.86:0/3943509174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f641593b0 0x7f1f64159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f6979c700 1 --2- 172.21.15.86:0/3943509174 >> v2:172.21.15.135:3300/0 conn(0x7f1f640b1740 0x7f1f640b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 -- 172.21.15.86:0/3943509174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f641593b0 msgr2=0x7f1f64159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 --2- 172.21.15.86:0/3943509174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f641593b0 0x7f1f64159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 -- 172.21.15.86:0/3943509174 >> v2:172.21.15.135:3300/0 conn(0x7f1f640b1740 msgr2=0x7f1f640b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 --2- 172.21.15.86:0/3943509174 >> v2:172.21.15.135:3300/0 conn(0x7f1f640b1740 0x7f1f640b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 -- 172.21.15.86:0/3943509174 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640cf210 con 0x7f1f640ceaa0 2023-10-09T11:56:44.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f63fff700 1 --2- 172.21.15.86:0/3943509174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f640ceaa0 0x7f1f640b6030 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1f640b24b0 tx=0x7f1f50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f2b3b7c01f7254 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:44.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.405+0000 7f1f637fe700 1 -- 172.21.15.86:0/3943509174 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000b640 con 0x7f1f640ceaa0 2023-10-09T11:56:44.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f637fe700 1 -- 172.21.15.86:0/3943509174 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5000b7a0 con 0x7f1f640ceaa0 2023-10-09T11:56:44.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f637fe700 1 -- 172.21.15.86:0/3943509174 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000bb60 con 0x7f1f640ceaa0 2023-10-09T11:56:44.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 -- 172.21.15.86:0/3943509174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f640ceaa0 msgr2=0x7f1f640b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/3943509174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f640ceaa0 0x7f1f640b6030 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1f640b24b0 tx=0x7f1f50009250 comp rx=0 tx=0).stop 2023-10-09T11:56:44.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 -- 172.21.15.86:0/3943509174 shutdown_connections 2023-10-09T11:56:44.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/3943509174 >> v2:172.21.15.135:3300/0 conn(0x7f1f640b1740 0x7f1f640b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/3943509174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f641593b0 0x7f1f64159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/3943509174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f640ceaa0 0x7f1f640b6030 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 -- 172.21.15.86:0/3943509174 >> 172.21.15.86:0/3943509174 conn(0x7f1f640d1130 msgr2=0x7f1f640b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 -- 172.21.15.86:0/3943509174 shutdown_connections 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.406+0000 7f1f69f9d700 1 -- 172.21.15.86:0/3943509174 wait complete. 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.408+0000 7f1f69f9d700 1 Processor -- start 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.408+0000 7f1f69f9d700 1 -- start start 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f69f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f640b1740 0x7f1f64155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f69f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f640ceaa0 0x7f1f640c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f69f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f641593b0 0x7f1f64069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f69f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6415ac50 con 0x7f1f641593b0 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f69f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6415af30 con 0x7f1f640b1740 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f69f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6415b210 con 0x7f1f640ceaa0 2023-10-09T11:56:44.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f640b1740 0x7f1f64155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f6979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f641593b0 0x7f1f64069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f640b1740 0x7f1f64155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:55806/0 (socket says 172.21.15.86:55806) 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 -- 172.21.15.86:0/2001616867 learned_addr learned my addr 172.21.15.86:0/2001616867 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f63fff700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f640ceaa0 0x7f1f640c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 -- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f640ceaa0 msgr2=0x7f1f640c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f640ceaa0 0x7f1f640c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 -- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f641593b0 msgr2=0x7f1f64069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f641593b0 0x7f1f64069390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.409+0000 7f1f68f9b700 1 -- 172.21.15.86:0/2001616867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500094f0 con 0x7f1f640b1740 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.410+0000 7f1f68f9b700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f640b1740 0x7f1f64155370 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e950 tx=0x7f1f580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:44.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.410+0000 7f1f60ff9700 1 -- 172.21.15.86:0/2001616867 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58013680 con 0x7f1f640b1740 2023-10-09T11:56:44.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.410+0000 7f1f60ff9700 1 -- 172.21.15.86:0/2001616867 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f580137e0 con 0x7f1f640b1740 2023-10-09T11:56:44.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.410+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6415b4f0 con 0x7f1f640b1740 2023-10-09T11:56:44.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.410+0000 7f1f60ff9700 1 -- 172.21.15.86:0/2001616867 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58013ba0 con 0x7f1f640b1740 2023-10-09T11:56:44.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.410+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f640c8fc0 con 0x7f1f640b1740 2023-10-09T11:56:44.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.411+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f640c9210 con 0x7f1f640b1740 2023-10-09T11:56:44.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.412+0000 7f1f60ff9700 1 -- 172.21.15.86:0/2001616867 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1f580123d0 con 0x7f1f640b1740 2023-10-09T11:56:44.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.413+0000 7f1f60ff9700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 0x7f1f48069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.413+0000 7f1f60ff9700 1 -- 172.21.15.86:0/2001616867 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f1f58084cf0 con 0x7f1f640b1740 2023-10-09T11:56:44.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.413+0000 7f1f63fff700 1 -- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 msgr2=0x7f1f48069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:44.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.413+0000 7f1f63fff700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 0x7f1f48069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.417+0000 7f1f60ff9700 1 -- 172.21.15.86:0/2001616867 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f580519c0 con 0x7f1f640b1740 2023-10-09T11:56:44.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.614+0000 7f1f63fff700 1 -- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 msgr2=0x7f1f48069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:44.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.614+0000 7f1f63fff700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 0x7f1f48069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:44.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.619+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f6404c3c0 con 0x7f1f640b1740 2023-10-09T11:56:44.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.620+0000 7f1f60ff9700 1 -- 172.21.15.86:0/2001616867 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16332 (secure 0 0 0) 0x7f1f58017090 con 0x7f1f640b1740 2023-10-09T11:56:44.621 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:44.621 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":81,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:41.353379+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:19.281445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:56:20.161616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:56:41.353331+0000","172.21.15.86:6836/85490":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/30524912":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/348327633":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/1779894477":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/1996969927":"2023-10-10T11:56:41.353331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:44.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 msgr2=0x7f1f48069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:44.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 0x7f1f48069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f640b1740 msgr2=0x7f1f64155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f640b1740 0x7f1f64155370 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e950 tx=0x7f1f580091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 shutdown_connections 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f480670e0 0x7f1f48069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f641593b0 0x7f1f64069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f640b1740 0x7f1f64155370 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 --2- 172.21.15.86:0/2001616867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f640ceaa0 0x7f1f640c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 >> 172.21.15.86:0/2001616867 conn(0x7f1f640d1130 msgr2=0x7f1f641571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 shutdown_connections 2023-10-09T11:56:44.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.623+0000 7f1f69f9d700 1 -- 172.21.15.86:0/2001616867 wait complete. 2023-10-09T11:56:44.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:56:19.281445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:56:20.161616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:56:44.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:56:44.678 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:44.677+0000 7f54fa832180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:56:44.744 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:44.744+0000 7f7271187180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:56:44.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.832+0000 7f3fc9d9d700 1 Processor -- start 2023-10-09T11:56:44.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.832+0000 7f3fc9d9d700 1 -- start start 2023-10-09T11:56:44.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc9d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b16d0 0x7f3fc40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc9d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3fc40b33b0 0x7f3fc40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc9d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40b2080 con 0x7f3fc40b4e70 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc9d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40cfb00 con 0x7f3fc40b33b0 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc9d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40b5c40 con 0x7f3fc40b16d0 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc8d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3fc40b4e70 0x7f3fc40ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:45014/0 (socket says 172.21.15.86:45014) 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc8d9b700 1 -- 172.21.15.86:0/2500497845 learned_addr learned my addr 172.21.15.86:0/2500497845 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc959c700 1 --2- 172.21.15.86:0/2500497845 >> v2:172.21.15.86:3300/0 conn(0x7f3fc40b33b0 0x7f3fc40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc3fff700 1 --2- 172.21.15.86:0/2500497845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b16d0 0x7f3fc40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc37fe700 1 -- 172.21.15.86:0/2500497845 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449316894 0 0) 0x7f3fc40b2080 con 0x7f3fc40b4e70 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.834+0000 7f3fc37fe700 1 -- 172.21.15.86:0/2500497845 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb4003570 con 0x7f3fc40b4e70 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc959c700 1 -- 172.21.15.86:0/2500497845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b16d0 msgr2=0x7f3fc40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc959c700 1 --2- 172.21.15.86:0/2500497845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b16d0 0x7f3fc40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc959c700 1 -- 172.21.15.86:0/2500497845 >> v1:172.21.15.86:6789/0 conn(0x7f3fc40b4e70 legacy=0x7f3fc40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc959c700 1 -- 172.21.15.86:0/2500497845 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40b5f20 con 0x7f3fc40b33b0 2023-10-09T11:56:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc3fff700 1 --2- 172.21.15.86:0/2500497845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b16d0 0x7f3fc40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc959c700 1 --2- 172.21.15.86:0/2500497845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b33b0 0x7f3fc40b3830 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009e60 tx=0x7f3fbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6974b96936a007c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc37fe700 1 -- 172.21.15.86:0/2500497845 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00e070 con 0x7f3fc40b33b0 2023-10-09T11:56:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc37fe700 1 -- 172.21.15.86:0/2500497845 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc00bab0 con 0x7f3fc40b33b0 2023-10-09T11:56:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.835+0000 7f3fc37fe700 1 -- 172.21.15.86:0/2500497845 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00be50 con 0x7f3fc40b33b0 2023-10-09T11:56:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/2500497845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b33b0 msgr2=0x7f3fc40b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/2500497845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b33b0 0x7f3fc40b3830 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009e60 tx=0x7f3fbc009780 comp rx=0 tx=0).stop 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/2500497845 shutdown_connections 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/2500497845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b33b0 0x7f3fc40b3830 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/2500497845 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b16d0 0x7f3fc40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/2500497845 >> 172.21.15.86:0/2500497845 conn(0x7f3fc40d10c0 msgr2=0x7f3fc40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/2500497845 shutdown_connections 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.836+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/2500497845 wait complete. 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.837+0000 7f3fc9d9d700 1 Processor -- start 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.838+0000 7f3fc9d9d700 1 -- start start 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.838+0000 7f3fc9d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc40b16d0 0x7f3fc40c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.838+0000 7f3fc9d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b33b0 0x7f3fc40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc9d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b4e70 0x7f3fc40c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc9d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c8220 con 0x7f3fc40b4e70 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc9d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c8500 con 0x7f3fc40b16d0 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc9d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c87e0 con 0x7f3fc40b33b0 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b4e70 0x7f3fc40c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b4e70 0x7f3fc40c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55442/0 (socket says 172.21.15.86:55442) 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b33b0 0x7f3fc40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 -- 172.21.15.86:0/1041811797 learned_addr learned my addr 172.21.15.86:0/1041811797 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc8d9b700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc40b16d0 0x7f3fc40c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 -- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b33b0 msgr2=0x7f3fc40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b33b0 0x7f3fc40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 -- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc40b16d0 msgr2=0x7f3fc40c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:44.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc40b16d0 0x7f3fc40c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:44.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc959c700 1 -- 172.21.15.86:0/1041811797 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0009420 con 0x7f3fc40b4e70 2023-10-09T11:56:44.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.839+0000 7f3fc3fff700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b33b0 0x7f3fc40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.840+0000 7f3fc959c700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b4e70 0x7f3fc40c92c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b610 tx=0x7f3fbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.840+0000 7f3fc0ff9700 1 -- 172.21.15.86:0/1041811797 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc012e40 con 0x7f3fc40b4e70 2023-10-09T11:56:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.840+0000 7f3fc0ff9700 1 -- 172.21.15.86:0/1041811797 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc0263f0 con 0x7f3fc40b4e70 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.840+0000 7f3fc0ff9700 1 -- 172.21.15.86:0/1041811797 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc026790 con 0x7f3fc40b4e70 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.840+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc009a20 con 0x7f3fc40b4e70 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.840+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc40c8da0 con 0x7f3fc40b4e70 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.841+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc4088990 con 0x7f3fc40b4e70 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.842+0000 7f3fc0ff9700 1 -- 172.21.15.86:0/1041811797 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f3fbc026b40 con 0x7f3fc40b4e70 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.843+0000 7f3fc0ff9700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 0x7f3fa8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.843+0000 7f3fc0ff9700 1 -- 172.21.15.86:0/1041811797 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f3fbc0866c0 con 0x7f3fc40b4e70 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.843+0000 7f3fc8d9b700 1 -- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 msgr2=0x7f3fa8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.843+0000 7f3fc8d9b700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 0x7f3fa8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:44.845 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:44.843+0000 7f54fa832180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:44.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:44.847+0000 7f3fc0ff9700 1 -- 172.21.15.86:0/1041811797 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fbc053320 con 0x7f3fc40b4e70 2023-10-09T11:56:44.917 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:44.916+0000 7f7271187180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:44.932 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:44.931+0000 7f54fa832180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:56:45.004 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:45.004+0000 7f7271187180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:56:45.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.044+0000 7f3fc8d9b700 1 -- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 msgr2=0x7f3fa8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:45.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.044+0000 7f3fc8d9b700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 0x7f3fa8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:45.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.050+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fc404bb80 con 0x7f3fc40b4e70 2023-10-09T11:56:45.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.051+0000 7f3fc0ff9700 1 -- 172.21.15.86:0/1041811797 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fbc056940 con 0x7f3fc40b4e70 2023-10-09T11:56:45.051 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:56:45.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.053+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 msgr2=0x7f3fa8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:45.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.053+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 0x7f3fa8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.053+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b4e70 msgr2=0x7f3fc40c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:45.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.053+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b4e70 0x7f3fc40c92c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b610 tx=0x7f3fbc019000 comp rx=0 tx=0).stop 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 shutdown_connections 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3fa80670e0 0x7f3fa8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fc40b4e70 0x7f3fc40c92c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc40b16d0 0x7f3fc40c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 --2- 172.21.15.86:0/1041811797 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fc40b33b0 0x7f3fc40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 >> 172.21.15.86:0/1041811797 conn(0x7f3fc40d10c0 msgr2=0x7f3fc415f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 shutdown_connections 2023-10-09T11:56:45.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.054+0000 7f3fc9d9d700 1 -- 172.21.15.86:0/1041811797 wait complete. 2023-10-09T11:56:45.074 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:56:45.157 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:45.156+0000 7f54fa832180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:45.238 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:45.238+0000 7f7271187180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:45.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.261+0000 7f263359d700 1 Processor -- start 2023-10-09T11:56:45.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.261+0000 7f263359d700 1 -- start start 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263359d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f262c0b4e70 0x7f262c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263359d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f262c0b1b40 0x7f262c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263359d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0cfb00 con 0x7f262c0b16d0 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263359d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c0b5c40 con 0x7f262c0b4e70 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263359d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c0b5f20 con 0x7f262c0b1b40 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f262c0b4e70 0x7f262c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f262c0b4e70 0x7f262c0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34922/0 (socket says 172.21.15.86:34922) 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f263259b700 1 -- 172.21.15.86:0/637376525 learned_addr learned my addr 172.21.15.86:0/637376525 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:45.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.262+0000 7f2632d9c700 1 --2- 172.21.15.86:0/637376525 >> v2:172.21.15.135:3300/0 conn(0x7f262c0b1b40 0x7f262c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f263259b700 1 -- 172.21.15.86:0/637376525 >> v2:172.21.15.135:3300/0 conn(0x7f262c0b1b40 msgr2=0x7f262c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f263259b700 1 --2- 172.21.15.86:0/637376525 >> v2:172.21.15.135:3300/0 conn(0x7f262c0b1b40 0x7f262c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f263259b700 1 -- 172.21.15.86:0/637376525 >> v1:172.21.15.135:6789/0 conn(0x7f262c0b16d0 legacy=0x7f262c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f263259b700 1 -- 172.21.15.86:0/637376525 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0b6200 con 0x7f262c0b4e70 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f263259b700 1 --2- 172.21.15.86:0/637376525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c0ccff0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f262c071380 tx=0x7f2628009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72fe91a98254df7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f2631599700 1 -- 172.21.15.86:0/637376525 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628009e70 con 0x7f262c0b4e70 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f2631599700 1 -- 172.21.15.86:0/637376525 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262800b860 con 0x7f262c0b4e70 2023-10-09T11:56:45.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.263+0000 7f2631599700 1 -- 172.21.15.86:0/637376525 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800bc00 con 0x7f262c0b4e70 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 -- 172.21.15.86:0/637376525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 msgr2=0x7f262c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 --2- 172.21.15.86:0/637376525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c0ccff0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f262c071380 tx=0x7f2628009250 comp rx=0 tx=0).stop 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 -- 172.21.15.86:0/637376525 shutdown_connections 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 --2- 172.21.15.86:0/637376525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c0ccff0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 --2- 172.21.15.86:0/637376525 >> v2:172.21.15.135:3300/0 conn(0x7f262c0b1b40 0x7f262c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 -- 172.21.15.86:0/637376525 >> 172.21.15.86:0/637376525 conn(0x7f262c0d10c0 msgr2=0x7f262c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 -- 172.21.15.86:0/637376525 shutdown_connections 2023-10-09T11:56:45.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.264+0000 7f263359d700 1 -- 172.21.15.86:0/637376525 wait complete. 2023-10-09T11:56:45.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.266+0000 7f263359d700 1 Processor -- start 2023-10-09T11:56:45.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.266+0000 7f263359d700 1 -- start start 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f263359d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f262c0b16d0 0x7f262c14af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f263359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f262c0b1b40 0x7f262c16a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f263359d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f263359d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c15c2d0 con 0x7f262c0b4e70 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f263359d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c1608a0 con 0x7f262c0b16d0 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f263359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c160b80 con 0x7f262c0b1b40 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f2632d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f2631d9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f262c0b1b40 0x7f262c16a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f263259b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f262c0b16d0 0x7f262c14af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:45.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f2632d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c15fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34928/0 (socket says 172.21.15.86:34928) 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.267+0000 7f2632d9c700 1 -- 172.21.15.86:0/4243690608 learned_addr learned my addr 172.21.15.86:0/4243690608 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263259b700 1 -- 172.21.15.86:0/4243690608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f262c0b1b40 msgr2=0x7f262c16a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263259b700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f262c0b1b40 0x7f262c16a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263259b700 1 -- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 msgr2=0x7f262c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263259b700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263259b700 1 -- 172.21.15.86:0/4243690608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280094f0 con 0x7f262c0b16d0 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f2632d9c700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263259b700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f262c0b16d0 0x7f262c14af90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f262c089830 tx=0x7f2628017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f26227fc700 1 -- 172.21.15.86:0/4243690608 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800bbe0 con 0x7f262c0b16d0 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f26227fc700 1 -- 172.21.15.86:0/4243690608 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2628000c90 con 0x7f262c0b16d0 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c15bc80 con 0x7f262c0b16d0 2023-10-09T11:56:45.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f26227fc700 1 -- 172.21.15.86:0/4243690608 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628011650 con 0x7f262c0b16d0 2023-10-09T11:56:45.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.268+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c15b510 con 0x7f262c0b16d0 2023-10-09T11:56:45.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.269+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c088990 con 0x7f262c0b16d0 2023-10-09T11:56:45.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.270+0000 7f26227fc700 1 -- 172.21.15.86:0/4243690608 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2628011a80 con 0x7f262c0b16d0 2023-10-09T11:56:45.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.271+0000 7f26227fc700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 0x7f26100695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:45.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.271+0000 7f26227fc700 1 -- 172.21.15.86:0/4243690608 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f26280861c0 con 0x7f262c0b16d0 2023-10-09T11:56:45.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.271+0000 7f2631d9a700 1 -- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 msgr2=0x7f26100695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:45.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.271+0000 7f2631d9a700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 0x7f26100695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:45.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.275+0000 7f26227fc700 1 -- 172.21.15.86:0/4243690608 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2628052e90 con 0x7f262c0b16d0 2023-10-09T11:56:45.334 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:45.333+0000 7f54fa832180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:56:45.424 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:45.424+0000 7f7271187180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:56:45.426 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:45.426+0000 7f54fa832180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:56:45.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.472+0000 7f2631d9a700 1 -- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 msgr2=0x7f26100695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:45.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.472+0000 7f2631d9a700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 0x7f26100695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:45.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.474+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f262c04bb80 con 0x7f262c0b16d0 2023-10-09T11:56:45.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.475+0000 7f26227fc700 1 -- 172.21.15.86:0/4243690608 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26280564b0 con 0x7f262c0b16d0 2023-10-09T11:56:45.475 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:56:45.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 msgr2=0x7f26100695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:45.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 0x7f26100695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f262c0b16d0 msgr2=0x7f262c14af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:45.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f262c0b16d0 0x7f262c14af90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f262c089830 tx=0x7f2628017000 comp rx=0 tx=0).stop 2023-10-09T11:56:45.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 shutdown_connections 2023-10-09T11:56:45.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2610067110 0x7f26100695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f262c0b4e70 0x7f262c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f262c0b16d0 0x7f262c14af90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 --2- 172.21.15.86:0/4243690608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f262c0b1b40 0x7f262c16a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:45.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.477+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 >> 172.21.15.86:0/4243690608 conn(0x7f262c0d10c0 msgr2=0x7f262c0c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:45.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.478+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 shutdown_connections 2023-10-09T11:56:45.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.478+0000 7f263359d700 1 -- 172.21.15.86:0/4243690608 wait complete. 2023-10-09T11:56:45.496 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:56:45.521 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:45.521+0000 7f7271187180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:56:45.588 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:45.588+0000 7f54fa832180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:56:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.686+0000 7f2da199d700 1 Processor -- start 2023-10-09T11:56:46.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.686+0000 7f2da199d700 1 -- start start 2023-10-09T11:56:46.030 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:45.686+0000 7f54fa832180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:46.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.687+0000 7f2da199d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d9c1407e0 0x7f2d9c06a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.687+0000 7f2da199d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2d9c140bb0 0x7f2d9c06a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.687+0000 7f2da199d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.687+0000 7f2da199d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c0c6820 con 0x7f2d9c140bb0 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.687+0000 7f2da199d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c0c6de0 con 0x7f2d9c1407e0 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.687+0000 7f2da199d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c06de60 con 0x7f2d9c06d4f0 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2d9c140bb0 0x7f2d9c06a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2da099b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d9c1407e0 0x7f2d9c06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2d9c140bb0 0x7f2d9c06a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34930/0 (socket says 172.21.15.86:34930) 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 -- 172.21.15.86:0/1412544276 learned_addr learned my addr 172.21.15.86:0/1412544276 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2da119c700 1 --2- 172.21.15.86:0/1412544276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 -- 172.21.15.86:0/1412544276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 msgr2=0x7f2d9c06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 --2- 172.21.15.86:0/1412544276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c06d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 -- 172.21.15.86:0/1412544276 >> v2:172.21.15.135:3300/0 conn(0x7f2d9c1407e0 msgr2=0x7f2d9c06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 --2- 172.21.15.86:0/1412544276 >> v2:172.21.15.135:3300/0 conn(0x7f2d9c1407e0 0x7f2d9c06a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 -- 172.21.15.86:0/1412544276 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c141270 con 0x7f2d9c140bb0 2023-10-09T11:56:46.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.688+0000 7f2d9bfff700 1 --2- 172.21.15.86:0/1412544276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c06a6c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06f9a0 tx=0x7f2d88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d0589e8b96772f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2d9b7fe700 1 -- 172.21.15.86:0/1412544276 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800b640 con 0x7f2d9c140bb0 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2d9b7fe700 1 -- 172.21.15.86:0/1412544276 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8800b7a0 con 0x7f2d9c140bb0 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2d9b7fe700 1 -- 172.21.15.86:0/1412544276 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800bb60 con 0x7f2d9c140bb0 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 -- 172.21.15.86:0/1412544276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 msgr2=0x7f2d9c06a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 --2- 172.21.15.86:0/1412544276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c06a6c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06f9a0 tx=0x7f2d88009250 comp rx=0 tx=0).stop 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 -- 172.21.15.86:0/1412544276 shutdown_connections 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 --2- 172.21.15.86:0/1412544276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 --2- 172.21.15.86:0/1412544276 >> v2:172.21.15.135:3300/0 conn(0x7f2d9c1407e0 0x7f2d9c06a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 --2- 172.21.15.86:0/1412544276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c06a6c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 -- 172.21.15.86:0/1412544276 >> 172.21.15.86:0/1412544276 conn(0x7f2d9c0cc1e0 msgr2=0x7f2d9c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:46.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 -- 172.21.15.86:0/1412544276 shutdown_connections 2023-10-09T11:56:46.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.689+0000 7f2da199d700 1 -- 172.21.15.86:0/1412544276 wait complete. 2023-10-09T11:56:46.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.691+0000 7f2da199d700 1 Processor -- start 2023-10-09T11:56:46.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.691+0000 7f2da199d700 1 -- start start 2023-10-09T11:56:46.036 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:45.691+0000 7f7271187180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:56:46.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da199d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c0b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da199d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c1407e0 0x7f2d9c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da199d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c16a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da199d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c16aeb0 con 0x7f2d9c140bb0 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da199d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0afd30 con 0x7f2d9c1407e0 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da199d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0af120 con 0x7f2d9c06d4f0 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c16a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c16a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34944/0 (socket says 172.21.15.86:34944) 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 -- 172.21.15.86:0/2728419415 learned_addr learned my addr 172.21.15.86:0/2728419415 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2d9bfff700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c1407e0 0x7f2d9c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da099b700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c0b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 -- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 msgr2=0x7f2d9c0b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c0b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 -- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c1407e0 msgr2=0x7f2d9c1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c1407e0 0x7f2d9c1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.692+0000 7f2da119c700 1 -- 172.21.15.86:0/2728419415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880094f0 con 0x7f2d9c140bb0 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.693+0000 7f2da119c700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c16a970 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009e90 tx=0x7f2d9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.693+0000 7f2d98ff9700 1 -- 172.21.15.86:0/2728419415 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400cb70 con 0x7f2d9c140bb0 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.693+0000 7f2d98ff9700 1 -- 172.21.15.86:0/2728419415 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400f040 con 0x7f2d9c140bb0 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.693+0000 7f2d98ff9700 1 -- 172.21.15.86:0/2728419415 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94014480 con 0x7f2d9c140bb0 2023-10-09T11:56:46.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.693+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c0af400 con 0x7f2d9c140bb0 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.693+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0af9c0 con 0x7f2d9c140bb0 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.694+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c06c450 con 0x7f2d9c140bb0 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.695+0000 7f2d98ff9700 1 -- 172.21.15.86:0/2728419415 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2d94014830 con 0x7f2d9c140bb0 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.696+0000 7f2d98ff9700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 0x7f2d80069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.696+0000 7f2da099b700 1 -- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 msgr2=0x7f2d80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.696+0000 7f2d98ff9700 1 -- 172.21.15.86:0/2728419415 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f2d94085650 con 0x7f2d9c140bb0 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.696+0000 7f2da099b700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 0x7f2d80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:46.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.701+0000 7f2d98ff9700 1 -- 172.21.15.86:0/2728419415 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d94052210 con 0x7f2d9c140bb0 2023-10-09T11:56:46.043 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:45.824+0000 7f7271187180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:56:46.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.897+0000 7f2da099b700 1 -- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 msgr2=0x7f2d80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:46.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.897+0000 7f2da099b700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 0x7f2d80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:46.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.933+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d9c0afe70 con 0x7f2d9c140bb0 2023-10-09T11:56:46.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.934+0000 7f2d98ff9700 1 -- 172.21.15.86:0/2728419415 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d94059e60 con 0x7f2d9c140bb0 2023-10-09T11:56:46.044 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:56:46.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 msgr2=0x7f2d80069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:46.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 0x7f2d80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 msgr2=0x7f2d9c16a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c16a970 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009e90 tx=0x7f2d9400b040 comp rx=0 tx=0).stop 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 shutdown_connections 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d800670e0 0x7f2d80069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c140bb0 0x7f2d9c16a970 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c06d4f0 0x7f2d9c0b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 --2- 172.21.15.86:0/2728419415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c1407e0 0x7f2d9c1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 >> 172.21.15.86:0/2728419415 conn(0x7f2d9c0cc1e0 msgr2=0x7f2d9c0c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 shutdown_connections 2023-10-09T11:56:46.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:45.936+0000 7f2da199d700 1 -- 172.21.15.86:0/2728419415 wait complete. 2023-10-09T11:56:46.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:46.172 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:46.172+0000 7f54fa832180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:56:46.265 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:46.265+0000 7f54fa832180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:56:46.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.273+0000 7fc4f4b9d700 1 Processor -- start 2023-10-09T11:56:46.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.273+0000 7fc4f4b9d700 1 -- start start 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4f4b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4f00c6c60 0x7fc4f00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4f4b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4f006e8c0 0x7fc4f00c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4f4b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f00b1410 con 0x7fc4f01595a0 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4f4b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f00b2b90 con 0x7fc4f006e8c0 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4f4b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f0063230 con 0x7fc4f00c6c60 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4effff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4f006e8c0 0x7fc4f00c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4effff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4f006e8c0 0x7fc4f00c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34960/0 (socket says 172.21.15.86:34960) 2023-10-09T11:56:46.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4effff700 1 -- 172.21.15.86:0/2795300075 learned_addr learned my addr 172.21.15.86:0/2795300075 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:46.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.275+0000 7fc4eeffd700 1 --2- 172.21.15.86:0/2795300075 >> v2:172.21.15.135:3300/0 conn(0x7fc4f00c6c60 0x7fc4f00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4effff700 1 -- 172.21.15.86:0/2795300075 >> v2:172.21.15.135:3300/0 conn(0x7fc4f00c6c60 msgr2=0x7fc4f00c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:46.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4effff700 1 --2- 172.21.15.86:0/2795300075 >> v2:172.21.15.135:3300/0 conn(0x7fc4f00c6c60 0x7fc4f00c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4effff700 1 -- 172.21.15.86:0/2795300075 >> v1:172.21.15.135:6789/0 conn(0x7fc4f01595a0 legacy=0x7fc4f00b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4effff700 1 -- 172.21.15.86:0/2795300075 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00634f0 con 0x7fc4f006e8c0 2023-10-09T11:56:46.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4effff700 1 --2- 172.21.15.86:0/2795300075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f006e8c0 0x7fc4f00c8660 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00b07d0 tx=0x7fc4e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b72981692f5200d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4ee7fc700 1 -- 172.21.15.86:0/2795300075 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800e070 con 0x7fc4f006e8c0 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4ee7fc700 1 -- 172.21.15.86:0/2795300075 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e800ba20 con 0x7fc4f006e8c0 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.276+0000 7fc4ee7fc700 1 -- 172.21.15.86:0/2795300075 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80092e0 con 0x7fc4f006e8c0 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/2795300075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f006e8c0 msgr2=0x7fc4f00c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/2795300075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f006e8c0 0x7fc4f00c8660 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00b07d0 tx=0x7fc4e8009840 comp rx=0 tx=0).stop 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/2795300075 shutdown_connections 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/2795300075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f006e8c0 0x7fc4f00c8660 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/2795300075 >> v2:172.21.15.135:3300/0 conn(0x7fc4f00c6c60 0x7fc4f00c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/2795300075 >> 172.21.15.86:0/2795300075 conn(0x7fc4f006ddb0 msgr2=0x7fc4f006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:46.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/2795300075 shutdown_connections 2023-10-09T11:56:46.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.277+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/2795300075 wait complete. 2023-10-09T11:56:46.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.278+0000 7fc4f4b9d700 1 Processor -- start 2023-10-09T11:56:46.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.278+0000 7fc4f4b9d700 1 -- start start 2023-10-09T11:56:46.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.279+0000 7fc4f4b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4f006e8c0 0x7fc4f016a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.279+0000 7fc4f4b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f00c6c60 0x7fc4f00a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.279+0000 7fc4f4b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4f01595a0 0x7fc4f00a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.279+0000 7fc4f4b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00af440 con 0x7fc4f00c6c60 2023-10-09T11:56:46.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.279+0000 7fc4f4b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00c5660 con 0x7fc4f01595a0 2023-10-09T11:56:46.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.279+0000 7fc4f4b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00c5940 con 0x7fc4f006e8c0 2023-10-09T11:56:46.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f00c6c60 0x7fc4f00a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f00c6c60 0x7fc4f00a8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34974/0 (socket says 172.21.15.86:34974) 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 -- 172.21.15.86:0/1005227900 learned_addr learned my addr 172.21.15.86:0/1005227900 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4effff700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4f01595a0 0x7fc4f00a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4ef7fe700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4f006e8c0 0x7fc4f016a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 -- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4f006e8c0 msgr2=0x7fc4f016a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4f006e8c0 0x7fc4f016a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 -- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4f01595a0 msgr2=0x7fc4f00a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4f01595a0 0x7fc4f00a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 -- 172.21.15.86:0/1005227900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e8009ae0 con 0x7fc4f00c6c60 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4eeffd700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f00c6c60 0x7fc4f00a8960 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400ec50 tx=0x7fc4e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:46.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4d77fe700 1 -- 172.21.15.86:0/1005227900 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400c850 con 0x7fc4f00c6c60 2023-10-09T11:56:46.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4d77fe700 1 -- 172.21.15.86:0/1005227900 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e400c9b0 con 0x7fc4f00c6c60 2023-10-09T11:56:46.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.280+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f00c5c20 con 0x7fc4f00c6c60 2023-10-09T11:56:46.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.281+0000 7fc4d77fe700 1 -- 172.21.15.86:0/1005227900 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400cd70 con 0x7fc4f00c6c60 2023-10-09T11:56:46.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.281+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f00c61e0 con 0x7fc4f00c6c60 2023-10-09T11:56:46.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.282+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f004c3c0 con 0x7fc4f00c6c60 2023-10-09T11:56:46.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.283+0000 7fc4d77fe700 1 -- 172.21.15.86:0/1005227900 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc4e4013680 con 0x7fc4f00c6c60 2023-10-09T11:56:46.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.284+0000 7fc4d77fe700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 0x7fc4dc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.284+0000 7fc4ef7fe700 1 -- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 msgr2=0x7fc4dc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:46.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.284+0000 7fc4d77fe700 1 -- 172.21.15.86:0/1005227900 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fc4e4084ce0 con 0x7fc4f00c6c60 2023-10-09T11:56:46.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.284+0000 7fc4ef7fe700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 0x7fc4dc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:46.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.288+0000 7fc4d77fe700 1 -- 172.21.15.86:0/1005227900 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4e4051a50 con 0x7fc4f00c6c60 2023-10-09T11:56:46.324 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:46.324+0000 7f7271187180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:56:46.354 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:46.354+0000 7f54fa832180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:56:46.421 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:46.421+0000 7f7271187180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:56:46.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.485+0000 7fc4ef7fe700 1 -- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 msgr2=0x7fc4dc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:46.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.485+0000 7fc4ef7fe700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 0x7fc4dc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:46.514 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:46.514+0000 7f7271187180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:56:46.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.533+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4f00637d0 con 0x7fc4f00c6c60 2023-10-09T11:56:46.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.534+0000 7fc4d77fe700 1 -- 172.21.15.86:0/1005227900 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fc4e4055070 con 0x7fc4f00c6c60 2023-10-09T11:56:46.534 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:46.534 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5926,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2024459788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":2024459788},{"type":"v1","addr":"172.21.15.135:6835","nonce":2024459788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/1216529409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1216529409},{"type":"v1","addr":"172.21.15.86:6833","nonce":1216529409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1408499839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1408499839},{"type":"v1","addr":"172.21.15.86:6835","nonce":1408499839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:56:21.168698+0000","modified":"2023-10-09T11:56:24.731586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3399882940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3399882940},{"type":"v1","addr":"172.21.15.135:6834","nonce":3399882940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:56:46.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 msgr2=0x7fc4dc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 0x7fc4dc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f00c6c60 msgr2=0x7fc4f00a8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f00c6c60 0x7fc4f00a8960 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400ec50 tx=0x7fc4e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 shutdown_connections 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4f01595a0 0x7fc4f00a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4f006e8c0 0x7fc4f016a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc4dc0670e0 0x7fc4dc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 --2- 172.21.15.86:0/1005227900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4f00c6c60 0x7fc4f00a8960 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 >> 172.21.15.86:0/1005227900 conn(0x7fc4f006ddb0 msgr2=0x7fc4f0158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:46.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 shutdown_connections 2023-10-09T11:56:46.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.536+0000 7fc4f4b9d700 1 -- 172.21.15.86:0/1005227900 wait complete. 2023-10-09T11:56:46.538 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2023-10-09T11:56:46.554 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:46.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.744+0000 7fb23759e700 1 Processor -- start 2023-10-09T11:56:46.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.744+0000 7fb23759e700 1 -- start start 2023-10-09T11:56:46.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb23759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2380ad870 0x7fb23806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb23759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2380b40f0 con 0x7fb23806bf20 2023-10-09T11:56:46.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb23759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb238069640 con 0x7fb238142ea0 2023-10-09T11:56:46.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb23759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23806c3a0 con 0x7fb2380ad870 2023-10-09T11:56:46.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb236d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb23806bf20 0x7fb23806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46108/0 (socket says 172.21.15.86:46108) 2023-10-09T11:56:46.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb236d9d700 1 -- 172.21.15.86:0/2548253062 learned_addr learned my addr 172.21.15.86:0/2548253062 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:46.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb235d9b700 1 --2- 172.21.15.86:0/2548253062 >> v2:172.21.15.86:3300/0 conn(0x7fb2380ad870 0x7fb23806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb23559a700 1 -- 172.21.15.86:0/2548253062 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247496770 0 0) 0x7fb2380b40f0 con 0x7fb23806bf20 2023-10-09T11:56:46.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb23559a700 1 -- 172.21.15.86:0/2548253062 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb220003570 con 0x7fb23806bf20 2023-10-09T11:56:46.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb23559a700 1 -- 172.21.15.86:0/2548253062 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257053665 0 0) 0x7fb238069640 con 0x7fb238142ea0 2023-10-09T11:56:46.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb235d9b700 1 -- 172.21.15.86:0/2548253062 >> v1:172.21.15.135:6789/0 conn(0x7fb238142ea0 legacy=0x7fb2380b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb235d9b700 1 -- 172.21.15.86:0/2548253062 >> v1:172.21.15.86:6789/0 conn(0x7fb23806bf20 legacy=0x7fb23806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.746+0000 7fb235d9b700 1 -- 172.21.15.86:0/2548253062 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238069920 con 0x7fb2380ad870 2023-10-09T11:56:46.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.747+0000 7fb235d9b700 1 --2- 172.21.15.86:0/2548253062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2380ad870 0x7fb23806b9e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0098e0 tx=0x7fb22c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8005e1ef84532c98 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.747+0000 7fb23559a700 1 -- 172.21.15.86:0/2548253062 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00b640 con 0x7fb2380ad870 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.747+0000 7fb23559a700 1 -- 172.21.15.86:0/2548253062 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00b7a0 con 0x7fb2380ad870 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.747+0000 7fb23559a700 1 -- 172.21.15.86:0/2548253062 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00bb40 con 0x7fb2380ad870 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.748+0000 7fb23759e700 1 -- 172.21.15.86:0/2548253062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2380ad870 msgr2=0x7fb23806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.748+0000 7fb23759e700 1 --2- 172.21.15.86:0/2548253062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2380ad870 0x7fb23806b9e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0098e0 tx=0x7fb22c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.748+0000 7fb23759e700 1 -- 172.21.15.86:0/2548253062 shutdown_connections 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.748+0000 7fb23759e700 1 --2- 172.21.15.86:0/2548253062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2380ad870 0x7fb23806b9e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.748+0000 7fb23759e700 1 -- 172.21.15.86:0/2548253062 >> 172.21.15.86:0/2548253062 conn(0x7fb2380ce430 msgr2=0x7fb2380ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.748+0000 7fb23759e700 1 -- 172.21.15.86:0/2548253062 shutdown_connections 2023-10-09T11:56:46.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.748+0000 7fb23759e700 1 -- 172.21.15.86:0/2548253062 wait complete. 2023-10-09T11:56:46.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.749+0000 7fb23759e700 1 Processor -- start 2023-10-09T11:56:46.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.749+0000 7fb23759e700 1 -- start start 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.750+0000 7fb23759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb23806bf20 0x7fb2380afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.750+0000 7fb23759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb238142ea0 0x7fb238158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.750+0000 7fb23759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2380c7e90 0x7fb23813aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.750+0000 7fb23759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380b0c50 con 0x7fb238142ea0 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.750+0000 7fb23759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c8980 con 0x7fb2380c7e90 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.750+0000 7fb23759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23813de00 con 0x7fb23806bf20 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb238142ea0 0x7fb238158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb238142ea0 0x7fb238158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34986/0 (socket says 172.21.15.86:34986) 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 -- 172.21.15.86:0/887679653 learned_addr learned my addr 172.21.15.86:0/887679653 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb236d9d700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2380c7e90 0x7fb23813aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb23659c700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb23806bf20 0x7fb2380afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 -- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb23806bf20 msgr2=0x7fb2380afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb23806bf20 0x7fb2380afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 -- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2380c7e90 msgr2=0x7fb23813aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2380c7e90 0x7fb23813aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 -- 172.21.15.86:0/887679653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c009420 con 0x7fb238142ea0 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb23659c700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb23806bf20 0x7fb2380afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb236d9d700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2380c7e90 0x7fb23813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb235d9b700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb238142ea0 0x7fb238158b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb22c013000 tx=0x7fb22c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.751+0000 7fb2267fc700 1 -- 172.21.15.86:0/887679653 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c01f070 con 0x7fb238142ea0 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.752+0000 7fb2267fc700 1 -- 172.21.15.86:0/887679653 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00bb20 con 0x7fb238142ea0 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.752+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2380b03b0 con 0x7fb238142ea0 2023-10-09T11:56:46.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.752+0000 7fb2267fc700 1 -- 172.21.15.86:0/887679653 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c011650 con 0x7fb238142ea0 2023-10-09T11:56:46.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.752+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380b0970 con 0x7fb238142ea0 2023-10-09T11:56:46.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.753+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2380c8b10 con 0x7fb238142ea0 2023-10-09T11:56:46.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.754+0000 7fb2267fc700 1 -- 172.21.15.86:0/887679653 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fb22c011a40 con 0x7fb238142ea0 2023-10-09T11:56:46.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.755+0000 7fb2267fc700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 0x7fb218069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:46.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.755+0000 7fb2267fc700 1 -- 172.21.15.86:0/887679653 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fb22c085c80 con 0x7fb238142ea0 2023-10-09T11:56:46.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.755+0000 7fb23659c700 1 -- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 msgr2=0x7fb218069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:46.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.755+0000 7fb23659c700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 0x7fb218069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:46.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.765+0000 7fb2267fc700 1 -- 172.21.15.86:0/887679653 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb22c052950 con 0x7fb238142ea0 2023-10-09T11:56:46.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.956+0000 7fb23659c700 1 -- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 msgr2=0x7fb218069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:46.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.956+0000 7fb23659c700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 0x7fb218069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:46.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.965+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb23804c3c0 con 0x7fb238142ea0 2023-10-09T11:56:46.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.966+0000 7fb2267fc700 1 -- 172.21.15.86:0/887679653 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16332 (secure 0 0 0) 0x7fb22c015090 con 0x7fb238142ea0 2023-10-09T11:56:46.967 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:46.967 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":81,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:41.353379+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:19.281445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:56:20.161616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:56:41.353331+0000","172.21.15.86:6836/85490":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/30524912":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/348327633":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/1779894477":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/1996969927":"2023-10-10T11:56:41.353331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 msgr2=0x7fb218069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 0x7fb218069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb238142ea0 msgr2=0x7fb238158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb238142ea0 0x7fb238158b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb22c013000 tx=0x7fb22c017000 comp rx=0 tx=0).stop 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 shutdown_connections 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2380c7e90 0x7fb23813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb23806bf20 0x7fb2380afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb2180670e0 0x7fb218069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 --2- 172.21.15.86:0/887679653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb238142ea0 0x7fb238158b80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:46.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 >> 172.21.15.86:0/887679653 conn(0x7fb2380ce430 msgr2=0x7fb238141b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:46.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 shutdown_connections 2023-10-09T11:56:46.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:46.969+0000 7fb23759e700 1 -- 172.21.15.86:0/887679653 wait complete. 2023-10-09T11:56:46.971 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:46.971+0000 7f54fa832180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:56:46.987 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:56:46.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:47.141 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:47.141+0000 7f54fa832180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:47.166 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:47.166+0000 7f7271187180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:56:47.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.207+0000 7f909279d700 1 Processor -- start 2023-10-09T11:56:47.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.207+0000 7f909279d700 1 -- start start 2023-10-09T11:56:47.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.208+0000 7f909279d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f908c142ea0 0x7f908c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.208+0000 7f909279d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.208+0000 7f909279d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c0b40f0 con 0x7f908c0ad870 2023-10-09T11:56:47.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.208+0000 7f909279d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c069640 con 0x7f908c142ea0 2023-10-09T11:56:47.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.208+0000 7f909279d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c069920 con 0x7f908c06c0f0 2023-10-09T11:56:47.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f909179b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f908c142ea0 0x7f908c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f9091f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f909179b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f908c142ea0 0x7f908c0b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:36908/0 (socket says 172.21.15.86:36908) 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f909179b700 1 -- 172.21.15.86:0/3061884226 learned_addr learned my addr 172.21.15.86:0/3061884226 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f9091f9c700 1 -- 172.21.15.86:0/3061884226 >> v2:172.21.15.135:3300/0 conn(0x7f908c142ea0 msgr2=0x7f908c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f9091f9c700 1 --2- 172.21.15.86:0/3061884226 >> v2:172.21.15.135:3300/0 conn(0x7f908c142ea0 0x7f908c0b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f9091f9c700 1 -- 172.21.15.86:0/3061884226 >> v1:172.21.15.135:6789/0 conn(0x7f908c0ad870 legacy=0x7f908c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f9091f9c700 1 -- 172.21.15.86:0/3061884226 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c069c00 con 0x7f908c06c0f0 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.209+0000 7f9091f9c700 1 --2- 172.21.15.86:0/3061884226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c06a120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e60 tx=0x7f9084009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f995d61751e1bb71 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f9083fff700 1 -- 172.21.15.86:0/3061884226 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908400e070 con 0x7f908c06c0f0 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f9083fff700 1 -- 172.21.15.86:0/3061884226 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908400bb60 con 0x7f908c06c0f0 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f9083fff700 1 -- 172.21.15.86:0/3061884226 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084012430 con 0x7f908c06c0f0 2023-10-09T11:56:47.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 -- 172.21.15.86:0/3061884226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 msgr2=0x7f908c06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 --2- 172.21.15.86:0/3061884226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c06a120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e60 tx=0x7f9084009780 comp rx=0 tx=0).stop 2023-10-09T11:56:47.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 -- 172.21.15.86:0/3061884226 shutdown_connections 2023-10-09T11:56:47.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 --2- 172.21.15.86:0/3061884226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c06a120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 --2- 172.21.15.86:0/3061884226 >> v2:172.21.15.135:3300/0 conn(0x7f908c142ea0 0x7f908c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 -- 172.21.15.86:0/3061884226 >> 172.21.15.86:0/3061884226 conn(0x7f908c0ce430 msgr2=0x7f908c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:47.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 -- 172.21.15.86:0/3061884226 shutdown_connections 2023-10-09T11:56:47.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.210+0000 7f909279d700 1 -- 172.21.15.86:0/3061884226 wait complete. 2023-10-09T11:56:47.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.212+0000 7f909279d700 1 Processor -- start 2023-10-09T11:56:47.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.212+0000 7f909279d700 1 -- start start 2023-10-09T11:56:47.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909279d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909279d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f908c142ea0 0x7f908c15e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909279d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c15cfc0 0x7f908c158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909279d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c15e340 con 0x7f908c142ea0 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909279d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c15d460 con 0x7f908c15cfc0 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909279d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c15d730 con 0x7f908c06c0f0 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909179b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f9090f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f908c142ea0 0x7f908c15e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909179b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:56280/0 (socket says 172.21.15.86:56280) 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909179b700 1 -- 172.21.15.86:0/1287221649 learned_addr learned my addr 172.21.15.86:0/1287221649 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:47.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f9091f9c700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c15cfc0 0x7f908c158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f9090f9a700 1 -- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 msgr2=0x7f908c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f9090f9a700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f9090f9a700 1 -- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c15cfc0 msgr2=0x7f908c158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f9090f9a700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c15cfc0 0x7f908c158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f9090f9a700 1 -- 172.21.15.86:0/1287221649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084009a20 con 0x7f908c142ea0 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.213+0000 7f909179b700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.214+0000 7f9090f9a700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f908c142ea0 0x7f908c15e7d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c560 tx=0x7f907c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.214+0000 7f90817fa700 1 -- 172.21.15.86:0/1287221649 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c011590 con 0x7f908c142ea0 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.214+0000 7f90817fa700 1 -- 172.21.15.86:0/1287221649 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c011710 con 0x7f908c142ea0 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.214+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c15da10 con 0x7f908c142ea0 2023-10-09T11:56:47.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.214+0000 7f90817fa700 1 -- 172.21.15.86:0/1287221649 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c011ad0 con 0x7f908c142ea0 2023-10-09T11:56:47.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.214+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c15dfd0 con 0x7f908c142ea0 2023-10-09T11:56:47.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.215+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c15e4f0 con 0x7f908c142ea0 2023-10-09T11:56:47.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.216+0000 7f90817fa700 1 -- 172.21.15.86:0/1287221649 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f907c01b3b0 con 0x7f908c142ea0 2023-10-09T11:56:47.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.217+0000 7f90817fa700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 0x7f9070069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.217+0000 7f90817fa700 1 -- 172.21.15.86:0/1287221649 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f907c083e20 con 0x7f908c142ea0 2023-10-09T11:56:47.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.217+0000 7f909179b700 1 -- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 msgr2=0x7f9070069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:47.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.217+0000 7f909179b700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 0x7f9070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:47.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.221+0000 7f90817fa700 1 -- 172.21.15.86:0/1287221649 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f908c15e4f0 con 0x7f908c142ea0 2023-10-09T11:56:47.237 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:47.237+0000 7f54fa832180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:56:47.347 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:47.347+0000 7f7271187180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:56:47.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.418+0000 7f909179b700 1 -- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 msgr2=0x7f9070069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:47.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.418+0000 7f909179b700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 0x7f9070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:47.447 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:47.447+0000 7f7271187180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:56:47.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.465+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f908c04c3c0 con 0x7f908c142ea0 2023-10-09T11:56:47.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.465+0000 7f90817fa700 1 -- 172.21.15.86:0/1287221649 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f907c017070 con 0x7f908c142ea0 2023-10-09T11:56:47.466 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:47.466 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5926,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2024459788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":2024459788},{"type":"v1","addr":"172.21.15.135:6835","nonce":2024459788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/1216529409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1216529409},{"type":"v1","addr":"172.21.15.86:6833","nonce":1216529409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1408499839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1408499839},{"type":"v1","addr":"172.21.15.86:6835","nonce":1408499839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:56:21.168698+0000","modified":"2023-10-09T11:56:24.731586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3399882940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3399882940},{"type":"v1","addr":"172.21.15.135:6834","nonce":3399882940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:56:47.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 msgr2=0x7f9070069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:47.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 0x7f9070069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f908c142ea0 msgr2=0x7f908c15e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f908c142ea0 0x7f908c15e7d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c560 tx=0x7f907c007ec0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 shutdown_connections 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f908c15cfc0 0x7f908c158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908c06c0f0 0x7f908c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90700670e0 0x7f9070069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 --2- 172.21.15.86:0/1287221649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f908c142ea0 0x7f908c15e7d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 >> 172.21.15.86:0/1287221649 conn(0x7f908c0ce430 msgr2=0x7f908c141f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 shutdown_connections 2023-10-09T11:56:47.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.468+0000 7f909279d700 1 -- 172.21.15.86:0/1287221649 wait complete. 2023-10-09T11:56:47.470 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2023-10-09T11:56:47.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:47.530 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:47.530+0000 7f54fa832180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:56:47.625 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:47.625+0000 7f54fa832180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:56:47.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.675+0000 7feac659d700 1 Processor -- start 2023-10-09T11:56:47.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.675+0000 7feac659d700 1 -- start start 2023-10-09T11:56:47.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.676+0000 7feac659d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feac00ae710 0x7feac00c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.676+0000 7feac659d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac00ca860 con 0x7feac0156310 2023-10-09T11:56:47.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.676+0000 7feac659d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac00cab40 con 0x7feac01566e0 2023-10-09T11:56:47.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feac659d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00cae20 con 0x7feac00ae710 2023-10-09T11:56:47.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feac559b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7feac0156310 0x7feac00c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46116/0 (socket says 172.21.15.86:46116) 2023-10-09T11:56:47.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feac559b700 1 -- 172.21.15.86:0/3348223843 learned_addr learned my addr 172.21.15.86:0/3348223843 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:47.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feac5d9c700 1 --2- 172.21.15.86:0/3348223843 >> v2:172.21.15.135:3300/0 conn(0x7feac00ae710 0x7feac00c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feab7fff700 1 -- 172.21.15.86:0/3348223843 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798072592 0 0) 0x7feac00ca860 con 0x7feac0156310 2023-10-09T11:56:47.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feab7fff700 1 -- 172.21.15.86:0/3348223843 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaac003570 con 0x7feac0156310 2023-10-09T11:56:47.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feab7fff700 1 -- 172.21.15.86:0/3348223843 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362232637 0 0) 0x7feac00cab40 con 0x7feac01566e0 2023-10-09T11:56:47.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feab7fff700 1 -- 172.21.15.86:0/3348223843 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac00ca860 con 0x7feac01566e0 2023-10-09T11:56:47.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feac5d9c700 1 -- 172.21.15.86:0/3348223843 >> v1:172.21.15.135:6789/0 conn(0x7feac01566e0 legacy=0x7feac00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feac5d9c700 1 -- 172.21.15.86:0/3348223843 >> v1:172.21.15.86:6789/0 conn(0x7feac0156310 legacy=0x7feac00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.677+0000 7feac5d9c700 1 -- 172.21.15.86:0/3348223843 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00cb100 con 0x7feac00ae710 2023-10-09T11:56:47.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.678+0000 7feac5d9c700 1 --2- 172.21.15.86:0/3348223843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac00c6830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feab8009e60 tx=0x7feab8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb47e4720cb1bff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:47.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.678+0000 7feab7fff700 1 -- 172.21.15.86:0/3348223843 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800e070 con 0x7feac00ae710 2023-10-09T11:56:47.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.678+0000 7feab7fff700 1 -- 172.21.15.86:0/3348223843 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800bab0 con 0x7feac00ae710 2023-10-09T11:56:47.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.678+0000 7feab7fff700 1 -- 172.21.15.86:0/3348223843 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800be70 con 0x7feac00ae710 2023-10-09T11:56:47.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.679+0000 7feac659d700 1 -- 172.21.15.86:0/3348223843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 msgr2=0x7feac00c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.679+0000 7feac659d700 1 --2- 172.21.15.86:0/3348223843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac00c6830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feab8009e60 tx=0x7feab8009780 comp rx=0 tx=0).stop 2023-10-09T11:56:47.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.679+0000 7feac659d700 1 -- 172.21.15.86:0/3348223843 shutdown_connections 2023-10-09T11:56:47.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.679+0000 7feac659d700 1 --2- 172.21.15.86:0/3348223843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac00c6830 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.679+0000 7feac659d700 1 -- 172.21.15.86:0/3348223843 >> 172.21.15.86:0/3348223843 conn(0x7feac00cc1f0 msgr2=0x7feac00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:47.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.679+0000 7feac659d700 1 -- 172.21.15.86:0/3348223843 shutdown_connections 2023-10-09T11:56:47.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.679+0000 7feac659d700 1 -- 172.21.15.86:0/3348223843 wait complete. 2023-10-09T11:56:47.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.680+0000 7feac659d700 1 Processor -- start 2023-10-09T11:56:47.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.680+0000 7feac659d700 1 -- start start 2023-10-09T11:56:47.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.681+0000 7feac659d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.681+0000 7feac659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac0156310 0x7feac0140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.681+0000 7feac659d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac01566e0 0x7feac00c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.681+0000 7feac659d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac015be80 con 0x7feac01566e0 2023-10-09T11:56:47.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.681+0000 7feac659d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac0141130 con 0x7feac00ae710 2023-10-09T11:56:47.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.681+0000 7feac659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac015b270 con 0x7feac0156310 2023-10-09T11:56:47.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac5d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac01566e0 0x7feac00c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac5d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac01566e0 0x7feac00c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35000/0 (socket says 172.21.15.86:35000) 2023-10-09T11:56:47.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac5d9c700 1 -- 172.21.15.86:0/2871244734 learned_addr learned my addr 172.21.15.86:0/2871244734 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:47.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac4d9a700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac0156310 0x7feac0140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:47.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac559b700 1 -- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac0156310 msgr2=0x7feac0140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac559b700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac0156310 0x7feac0140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac559b700 1 -- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac01566e0 msgr2=0x7feac00c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac559b700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac01566e0 0x7feac00c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac559b700 1 -- 172.21.15.86:0/2871244734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8009a20 con 0x7feac00ae710 2023-10-09T11:56:47.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac5d9c700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac01566e0 0x7feac00c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:47.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.682+0000 7feac559b700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac014c8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feabc00c580 tx=0x7feabc007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:47.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.683+0000 7feab57fa700 1 -- 172.21.15.86:0/2871244734 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc005c00 con 0x7feac00ae710 2023-10-09T11:56:47.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.683+0000 7feab57fa700 1 -- 172.21.15.86:0/2871244734 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc005d60 con 0x7feac00ae710 2023-10-09T11:56:47.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.683+0000 7feab57fa700 1 -- 172.21.15.86:0/2871244734 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc007320 con 0x7feac00ae710 2023-10-09T11:56:47.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.683+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac015b550 con 0x7feac00ae710 2023-10-09T11:56:47.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.683+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac015bb10 con 0x7feac00ae710 2023-10-09T11:56:47.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.684+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac004c3c0 con 0x7feac00ae710 2023-10-09T11:56:47.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.685+0000 7feab57fa700 1 -- 172.21.15.86:0/2871244734 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7feabc01b3b0 con 0x7feac00ae710 2023-10-09T11:56:47.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.685+0000 7feab57fa700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 0x7feaa4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:47.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.686+0000 7feab57fa700 1 -- 172.21.15.86:0/2871244734 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7feabc084080 con 0x7feac00ae710 2023-10-09T11:56:47.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.686+0000 7feac4d9a700 1 -- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 msgr2=0x7feaa4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:47.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.686+0000 7feac4d9a700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 0x7feaa4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:47.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.690+0000 7feab57fa700 1 -- 172.21.15.86:0/2871244734 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feabc050d50 con 0x7feac00ae710 2023-10-09T11:56:47.754 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:47.753+0000 7f7271187180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:56:47.851 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:47.849+0000 7f7271187180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:56:47.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.886+0000 7feac4d9a700 1 -- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 msgr2=0x7feaa4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:47.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.886+0000 7feac4d9a700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 0x7feaa4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:47.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.928+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feac00cd0b0 con 0x7feac00ae710 2023-10-09T11:56:47.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.929+0000 7feab57fa700 1 -- 172.21.15.86:0/2871244734 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7feabc017070 con 0x7feac00ae710 2023-10-09T11:56:47.931 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:47.931 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5926,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2024459788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":2024459788},{"type":"v1","addr":"172.21.15.135:6835","nonce":2024459788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/1216529409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1216529409},{"type":"v1","addr":"172.21.15.86:6833","nonce":1216529409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1408499839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1408499839},{"type":"v1","addr":"172.21.15.86:6835","nonce":1408499839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:56:21.168698+0000","modified":"2023-10-09T11:56:24.731586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3399882940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3399882940},{"type":"v1","addr":"172.21.15.135:6834","nonce":3399882940}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:56:47.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 msgr2=0x7feaa4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 0x7feaa4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 msgr2=0x7feac014c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac014c8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feabc00c580 tx=0x7feabc007d90 comp rx=0 tx=0).stop 2023-10-09T11:56:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 shutdown_connections 2023-10-09T11:56:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feaa40670e0 0x7feaa4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac01566e0 0x7feac00c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac00ae710 0x7feac014c8a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 --2- 172.21.15.86:0/2871244734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac0156310 0x7feac0140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:47.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 >> 172.21.15.86:0/2871244734 conn(0x7feac00cc1f0 msgr2=0x7feac0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:47.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 shutdown_connections 2023-10-09T11:56:47.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:47.932+0000 7feac659d700 1 -- 172.21.15.86:0/2871244734 wait complete. 2023-10-09T11:56:47.935 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 32 2023-10-09T11:56:47.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:48.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.135+0000 7ff608f9d700 1 Processor -- start 2023-10-09T11:56:48.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.135+0000 7ff608f9d700 1 -- start start 2023-10-09T11:56:48.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff608f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff604159420 0x7ff6040b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff608f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6041597f0 0x7ff6040b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff608f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff60415d230 0x7ff60415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff608f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60415dbb0 con 0x7ff6041597f0 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff608f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040b11d0 con 0x7ff604159420 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff608f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040b14b0 con 0x7ff60415d230 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff602ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6041597f0 0x7ff6040b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff602ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6041597f0 0x7ff6040b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35004/0 (socket says 172.21.15.86:35004) 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff602ffd700 1 -- 172.21.15.86:0/1659126414 learned_addr learned my addr 172.21.15.86:0/1659126414 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff6037fe700 1 --2- 172.21.15.86:0/1659126414 >> v2:172.21.15.135:3300/0 conn(0x7ff604159420 0x7ff6040b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.138+0000 7ff603fff700 1 --2- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff60415d230 0x7ff60415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6037fe700 1 -- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff60415d230 msgr2=0x7ff60415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6037fe700 1 --2- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff60415d230 0x7ff60415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6037fe700 1 -- 172.21.15.86:0/1659126414 >> v2:172.21.15.86:3300/0 conn(0x7ff6041597f0 msgr2=0x7ff6040b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:48.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6037fe700 1 --2- 172.21.15.86:0/1659126414 >> v2:172.21.15.86:3300/0 conn(0x7ff6041597f0 0x7ff6040b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6037fe700 1 -- 172.21.15.86:0/1659126414 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040b1790 con 0x7ff604159420 2023-10-09T11:56:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff603fff700 1 --2- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff60415d230 0x7ff60415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff602ffd700 1 --2- 172.21.15.86:0/1659126414 >> v2:172.21.15.86:3300/0 conn(0x7ff6041597f0 0x7ff6040b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6037fe700 1 --2- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff604159420 0x7ff6040b5f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6040b2f20 tx=0x7ff5f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb942c3c6b7b82c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6027fc700 1 -- 172.21.15.86:0/1659126414 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4011630 con 0x7ff604159420 2023-10-09T11:56:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6027fc700 1 -- 172.21.15.86:0/1659126414 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f40117b0 con 0x7ff604159420 2023-10-09T11:56:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.139+0000 7ff6027fc700 1 -- 172.21.15.86:0/1659126414 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4011b70 con 0x7ff604159420 2023-10-09T11:56:48.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 -- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff604159420 msgr2=0x7ff6040b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 --2- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff604159420 0x7ff6040b5f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6040b2f20 tx=0x7ff5f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 -- 172.21.15.86:0/1659126414 shutdown_connections 2023-10-09T11:56:48.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 --2- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff60415d230 0x7ff60415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 --2- 172.21.15.86:0/1659126414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff604159420 0x7ff6040b5f40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 --2- 172.21.15.86:0/1659126414 >> v2:172.21.15.86:3300/0 conn(0x7ff6041597f0 0x7ff6040b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 -- 172.21.15.86:0/1659126414 >> 172.21.15.86:0/1659126414 conn(0x7ff6040d0660 msgr2=0x7ff6040d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:48.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 -- 172.21.15.86:0/1659126414 shutdown_connections 2023-10-09T11:56:48.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.140+0000 7ff608f9d700 1 -- 172.21.15.86:0/1659126414 wait complete. 2023-10-09T11:56:48.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.142+0000 7ff608f9d700 1 Processor -- start 2023-10-09T11:56:48.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.143+0000 7ff608f9d700 1 -- start start 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.144+0000 7ff608f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff604159420 0x7ff604171890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.144+0000 7ff608f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6041597f0 0x7ff604156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.144+0000 7ff608f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff60415d230 0x7ff60415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.144+0000 7ff608f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6041565a0 con 0x7ff60415d230 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.144+0000 7ff608f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60415c6e0 con 0x7ff6041597f0 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.144+0000 7ff608f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff604172710 con 0x7ff604159420 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff604159420 0x7ff604171890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff602ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6041597f0 0x7ff604156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff604159420 0x7ff604171890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:56320/0 (socket says 172.21.15.86:56320) 2023-10-09T11:56:48.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff6037fe700 1 -- 172.21.15.86:0/83332008 learned_addr learned my addr 172.21.15.86:0/83332008 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:48.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff603fff700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff60415d230 0x7ff60415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff602ffd700 1 -- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff604159420 msgr2=0x7ff604171890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff602ffd700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff604159420 0x7ff604171890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff602ffd700 1 -- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff60415d230 msgr2=0x7ff60415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff602ffd700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff60415d230 0x7ff60415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff602ffd700 1 -- 172.21.15.86:0/83332008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80094f0 con 0x7ff6041597f0 2023-10-09T11:56:48.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff6037fe700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff604159420 0x7ff604171890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:48.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.145+0000 7ff602ffd700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6041597f0 0x7ff604156060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff604159c70 tx=0x7ff5f8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:48.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.146+0000 7ff5eb7fe700 1 -- 172.21.15.86:0/83332008 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800c820 con 0x7ff6041597f0 2023-10-09T11:56:48.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.146+0000 7ff5eb7fe700 1 -- 172.21.15.86:0/83332008 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800c980 con 0x7ff6041597f0 2023-10-09T11:56:48.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.146+0000 7ff5eb7fe700 1 -- 172.21.15.86:0/83332008 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800cd00 con 0x7ff6041597f0 2023-10-09T11:56:48.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.146+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc009a20 con 0x7ff6041597f0 2023-10-09T11:56:48.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.146+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f4009420 con 0x7ff6041597f0 2023-10-09T11:56:48.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.147+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60404c3c0 con 0x7ff6041597f0 2023-10-09T11:56:48.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.148+0000 7ff5eb7fe700 1 -- 172.21.15.86:0/83332008 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7ff5f8013680 con 0x7ff6041597f0 2023-10-09T11:56:48.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.148+0000 7ff5eb7fe700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 0x7ff5f0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.149+0000 7ff5eb7fe700 1 -- 172.21.15.86:0/83332008 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7ff5f8084c30 con 0x7ff6041597f0 2023-10-09T11:56:48.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.149+0000 7ff6037fe700 1 -- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 msgr2=0x7ff5f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:48.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.149+0000 7ff6037fe700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 0x7ff5f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:48.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.153+0000 7ff5eb7fe700 1 -- 172.21.15.86:0/83332008 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5f80519c0 con 0x7ff6041597f0 2023-10-09T11:56:48.326 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:48.325+0000 7f54fa832180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:56:48.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.350+0000 7ff6037fe700 1 -- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 msgr2=0x7ff5f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:48.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.350+0000 7ff6037fe700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 0x7ff5f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:48.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.353+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6040b1a70 con 0x7ff6041597f0 2023-10-09T11:56:48.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.354+0000 7ff5eb7fe700 1 -- 172.21.15.86:0/83332008 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16332 (secure 0 0 0) 0x7ff5f800ce60 con 0x7ff6041597f0 2023-10-09T11:56:48.356 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:48.356 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":81,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:41.353379+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:19.281445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:56:20.161616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:56:41.353331+0000","172.21.15.86:6836/85490":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/30524912":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/348327633":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/1779894477":"2023-10-10T11:56:41.353331+0000","172.21.15.86:0/1996969927":"2023-10-10T11:56:41.353331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:48.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 msgr2=0x7ff5f0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:48.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 0x7ff5f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6041597f0 msgr2=0x7ff604156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6041597f0 0x7ff604156060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff604159c70 tx=0x7ff5f8009250 comp rx=0 tx=0).stop 2023-10-09T11:56:48.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 shutdown_connections 2023-10-09T11:56:48.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5f00670e0 0x7ff5f0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff60415d230 0x7ff60415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff604159420 0x7ff604171890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 --2- 172.21.15.86:0/83332008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6041597f0 0x7ff604156060 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.356+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 >> 172.21.15.86:0/83332008 conn(0x7ff6040d0660 msgr2=0x7ff6040b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:48.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.357+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 shutdown_connections 2023-10-09T11:56:48.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.357+0000 7ff608f9d700 1 -- 172.21.15.86:0/83332008 wait complete. 2023-10-09T11:56:48.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:56:48.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.563+0000 7f4bb0f9d700 1 Processor -- start 2023-10-09T11:56:48.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.563+0000 7f4bb0f9d700 1 -- start start 2023-10-09T11:56:48.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.564+0000 7f4bb0f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4bac15d230 0x7f4bac15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.564+0000 7f4bb0f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac0b2980 con 0x7f4bac1597f0 2023-10-09T11:56:48.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.564+0000 7f4bb0f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac15db70 con 0x7f4bac159420 2023-10-09T11:56:48.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.564+0000 7f4bb0f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0b11d0 con 0x7f4bac15d230 2023-10-09T11:56:48.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4baaffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4bac1597f0 0x7f4bac0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46126/0 (socket says 172.21.15.86:46126) 2023-10-09T11:56:48.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4baaffd700 1 -- 172.21.15.86:0/3756007993 learned_addr learned my addr 172.21.15.86:0/3756007993 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:48.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4babfff700 1 --2- 172.21.15.86:0/3756007993 >> v2:172.21.15.135:3300/0 conn(0x7f4bac15d230 0x7f4bac15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4baa7fc700 1 -- 172.21.15.86:0/3756007993 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446281445 0 0) 0x7f4bac0b2980 con 0x7f4bac1597f0 2023-10-09T11:56:48.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4baa7fc700 1 -- 172.21.15.86:0/3756007993 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b94003570 con 0x7f4bac1597f0 2023-10-09T11:56:48.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4babfff700 1 -- 172.21.15.86:0/3756007993 >> v1:172.21.15.135:6789/0 conn(0x7f4bac159420 legacy=0x7f4bac0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4babfff700 1 -- 172.21.15.86:0/3756007993 >> v1:172.21.15.86:6789/0 conn(0x7f4bac1597f0 legacy=0x7f4bac0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.565+0000 7f4babfff700 1 -- 172.21.15.86:0/3756007993 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0b14b0 con 0x7f4bac15d230 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4babfff700 1 --2- 172.21.15.86:0/3756007993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 0x7f4bac15d630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e60 tx=0x7f4ba4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c07b065d17d4c3cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4baa7fc700 1 -- 172.21.15.86:0/3756007993 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e070 con 0x7f4bac15d230 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4baa7fc700 1 -- 172.21.15.86:0/3756007993 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400bb60 con 0x7f4bac15d230 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4baa7fc700 1 -- 172.21.15.86:0/3756007993 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4012430 con 0x7f4bac15d230 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/3756007993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 msgr2=0x7f4bac15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/3756007993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 0x7f4bac15d630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e60 tx=0x7f4ba4009780 comp rx=0 tx=0).stop 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/3756007993 shutdown_connections 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/3756007993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 0x7f4bac15d630 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/3756007993 >> 172.21.15.86:0/3756007993 conn(0x7f4bac0d0660 msgr2=0x7f4bac0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:48.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.566+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/3756007993 shutdown_connections 2023-10-09T11:56:48.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.567+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/3756007993 wait complete. 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.568+0000 7f4bb0f9d700 1 Processor -- start 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.568+0000 7f4bb0f9d700 1 -- start start 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bb0f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bac159420 0x7f4bac15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bb0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac1597f0 0x7f4bac1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bb0f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 0x7f4bac0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bb0f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac169810 con 0x7f4bac159420 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bb0f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15c1b0 con 0x7f4bac15d230 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bb0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15c490 con 0x7f4bac1597f0 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bac159420 0x7f4bac15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bac159420 0x7f4bac15b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35022/0 (socket says 172.21.15.86:35022) 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bab7fe700 1 -- 172.21.15.86:0/575947863 learned_addr learned my addr 172.21.15.86:0/575947863 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4babfff700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 0x7f4bac0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4baaffd700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac1597f0 0x7f4bac1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bab7fe700 1 -- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac1597f0 msgr2=0x7f4bac1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.569+0000 7f4bab7fe700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac1597f0 0x7f4bac1551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4bab7fe700 1 -- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 msgr2=0x7f4bac0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4bab7fe700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 0x7f4bac0b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4bab7fe700 1 -- 172.21.15.86:0/575947863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009a20 con 0x7f4bac159420 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4bab7fe700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bac159420 0x7f4bac15b910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c590 tx=0x7f4b9c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4b937fe700 1 -- 172.21.15.86:0/575947863 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011590 con 0x7f4bac159420 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4b937fe700 1 -- 172.21.15.86:0/575947863 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c011710 con 0x7f4bac159420 2023-10-09T11:56:48.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4b937fe700 1 -- 172.21.15.86:0/575947863 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011ad0 con 0x7f4bac159420 2023-10-09T11:56:48.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac15c770 con 0x7f4bac159420 2023-10-09T11:56:48.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.570+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac15be50 con 0x7f4bac159420 2023-10-09T11:56:48.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.571+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac04c3c0 con 0x7f4bac159420 2023-10-09T11:56:48.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.572+0000 7f4b937fe700 1 -- 172.21.15.86:0/575947863 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4b9c01b3b0 con 0x7f4bac159420 2023-10-09T11:56:48.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.573+0000 7f4b937fe700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 0x7f4b98069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:48.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.573+0000 7f4b937fe700 1 -- 172.21.15.86:0/575947863 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f4b9c083f80 con 0x7f4bac159420 2023-10-09T11:56:48.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.573+0000 7f4baaffd700 1 -- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 msgr2=0x7f4b98069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:48.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.573+0000 7f4baaffd700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 0x7f4b98069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:48.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.577+0000 7f4b937fe700 1 -- 172.21.15.86:0/575947863 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b9c050c50 con 0x7f4bac159420 2023-10-09T11:56:48.597 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:48.596+0000 7f7271187180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:56:48.613 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:48.613+0000 7f54fa832180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:56:48.704 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:48.704+0000 7f54fa832180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:56:48.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.774+0000 7f4baaffd700 1 -- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 msgr2=0x7f4b98069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:48.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.774+0000 7f4baaffd700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 0x7f4b98069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:48.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.820+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4bac0b1790 con 0x7f4bac159420 2023-10-09T11:56:48.822 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T11:56:48.821+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:56:48.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.826+0000 7f4b937fe700 1 -- 172.21.15.86:0/575947863 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b9c017070 con 0x7f4bac159420 2023-10-09T11:56:48.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 msgr2=0x7f4b98069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:48.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 0x7f4b98069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bac159420 msgr2=0x7f4bac15b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:48.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bac159420 0x7f4bac15b910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c590 tx=0x7f4b9c00c8a0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 shutdown_connections 2023-10-09T11:56:48.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b980670e0 0x7f4b98069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bac159420 0x7f4bac15b910 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15d230 0x7f4bac0b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 --2- 172.21.15.86:0/575947863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac1597f0 0x7f4bac1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:48.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.828+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 >> 172.21.15.86:0/575947863 conn(0x7f4bac0d0660 msgr2=0x7f4bac0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:48.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.829+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 shutdown_connections 2023-10-09T11:56:48.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:48.829+0000 7f4bb0f9d700 1 -- 172.21.15.86:0/575947863 wait complete. 2023-10-09T11:56:48.831 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:56:48.836 INFO:tasks.ceph.mds.d.smithi135.stderr: -2205> 2023-10-09T11:56:26.689+0000 7f04c63f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:56:48.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:56:48.870 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:48.870+0000 7f54fa832180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:56:48.883 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:56:48.896 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:48.895+0000 7f7271187180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:56:48.978 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:48.978+0000 7f54fa832180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:56:48.993 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:48.992+0000 7f7271187180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:56:49.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.034+0000 7fcd10b9d700 1 Processor -- start 2023-10-09T11:56:49.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.035+0000 7fcd10b9d700 1 -- start start 2023-10-09T11:56:49.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd10b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:49.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd10b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd0c0b16d0 0x7fcd0c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:49.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd10b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd0c15d240 0x7fcd0c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:49.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd10b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c0b2080 con 0x7fcd0c15d240 2023-10-09T11:56:49.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd10b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c0cfb00 con 0x7fcd0c0b16d0 2023-10-09T11:56:49.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd10b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0b5c40 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd0bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd0c15d240 0x7fcd0c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd0affd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd0c0b16d0 0x7fcd0c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd0b7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd0bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd0c15d240 0x7fcd0c15d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35024/0 (socket says 172.21.15.86:35024) 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.036+0000 7fcd0bfff700 1 -- 172.21.15.86:0/361279431 learned_addr learned my addr 172.21.15.86:0/361279431 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0b7fe700 1 -- 172.21.15.86:0/361279431 >> v2:172.21.15.135:3300/0 conn(0x7fcd0c0b16d0 msgr2=0x7fcd0c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0b7fe700 1 --2- 172.21.15.86:0/361279431 >> v2:172.21.15.135:3300/0 conn(0x7fcd0c0b16d0 0x7fcd0c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0b7fe700 1 -- 172.21.15.86:0/361279431 >> v2:172.21.15.86:3300/0 conn(0x7fcd0c15d240 msgr2=0x7fcd0c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0b7fe700 1 --2- 172.21.15.86:0/361279431 >> v2:172.21.15.86:3300/0 conn(0x7fcd0c15d240 0x7fcd0c15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0b7fe700 1 -- 172.21.15.86:0/361279431 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c0b5f20 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0b7fe700 1 --2- 172.21.15.86:0/361279431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0ccff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c089440 tx=0x7fccfc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feabe1f492538730 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0a7fc700 1 -- 172.21.15.86:0/361279431 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc011630 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0a7fc700 1 -- 172.21.15.86:0/361279431 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc0117b0 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.037+0000 7fcd0a7fc700 1 -- 172.21.15.86:0/361279431 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc011b70 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 -- 172.21.15.86:0/361279431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 msgr2=0x7fcd0c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/361279431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0ccff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c089440 tx=0x7fccfc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 -- 172.21.15.86:0/361279431 shutdown_connections 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/361279431 >> v2:172.21.15.86:3300/0 conn(0x7fcd0c15d240 0x7fcd0c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/361279431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0ccff0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/361279431 >> v2:172.21.15.135:3300/0 conn(0x7fcd0c0b16d0 0x7fcd0c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 -- 172.21.15.86:0/361279431 >> 172.21.15.86:0/361279431 conn(0x7fcd0c0d10c0 msgr2=0x7fcd0c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:49.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 -- 172.21.15.86:0/361279431 shutdown_connections 2023-10-09T11:56:49.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.038+0000 7fcd10b9d700 1 -- 172.21.15.86:0/361279431 wait complete. 2023-10-09T11:56:49.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.039+0000 7fcd10b9d700 1 Processor -- start 2023-10-09T11:56:49.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.040+0000 7fcd10b9d700 1 -- start start 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.040+0000 7fcd10b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd0c0b16d0 0x7fcd0c0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.040+0000 7fcd10b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.040+0000 7fcd10b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0c15d240 0x7fcd0c068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.040+0000 7fcd10b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0c6ac0 con 0x7fcd0c15d240 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.040+0000 7fcd10b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0cc4a0 con 0x7fcd0c0b16d0 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.040+0000 7fcd10b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0cc1c0 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0c15d240 0x7fcd0c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd0c0b16d0 0x7fcd0c0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0affd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:49.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd0c0b16d0 0x7fcd0c0c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:36994/0 (socket says 172.21.15.86:36994) 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0b7fe700 1 -- 172.21.15.86:0/2807061903 learned_addr learned my addr 172.21.15.86:0/2807061903 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0affd700 1 -- 172.21.15.86:0/2807061903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd0c0b16d0 msgr2=0x7fcd0c0c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0affd700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd0c0b16d0 0x7fcd0c0c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0affd700 1 -- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0c15d240 msgr2=0x7fcd0c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0affd700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0c15d240 0x7fcd0c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0affd700 1 -- 172.21.15.86:0/2807061903 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009420 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.041+0000 7fcd0bfff700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0c15d240 0x7fcd0c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.042+0000 7fcd0affd700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0cb870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000ea50 tx=0x7fcd000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.042+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000ee90 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.042+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000c7f0 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.042+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000cb90 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.042+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0c6470 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.042+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c0c7490 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.043+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c0c6c70 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.044+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fcd00013470 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.045+0000 7fccf37fe700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 0x7fccf8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:49.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.045+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6425+0+0 (secure 0 0 0) 0x7fcd00084d00 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.045+0000 7fcd0b7fe700 1 -- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 msgr2=0x7fccf8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:49.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.045+0000 7fcd0b7fe700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 0x7fccf8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:56:49.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.049+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd0c0c6c70 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.155 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.154+0000 7f7271187180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:56:49.168 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:49.168+0000 7f54fa832180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:56:49.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.246+0000 7fcd0b7fe700 1 -- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 msgr2=0x7fccf8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:49.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.246+0000 7fcd0b7fe700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 0x7fccf8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:56:49.260 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:49.260+0000 7f54fa832180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:56:49.263 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.262+0000 7f7271187180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:56:49.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.293+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcd0c0c6c30 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.352 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:49.352+0000 7f54fa832180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:56:49.448 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:56:49.447+0000 7f54fa832180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:56:49.455 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.454+0000 7f7271187180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:56:49.547 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.546+0000 7f7271187180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:56:49.639 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.637+0000 7f7271187180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:56:49.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.647+0000 7fcd0b7fe700 1 -- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 msgr2=0x7fccf8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:56:49.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.647+0000 7fcd0b7fe700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 0x7fccf8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:56:49.733 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.731+0000 7f7271187180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:56:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.743+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mgrmap(e 34) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fcd00051d50 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.744+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 msgr2=0x7fccf8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:56:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.744+0000 7fccf37fe700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 0x7fccf8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71ef549700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71ef549700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71ef549700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71ef549700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71ef549700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71eb541700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.806 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71eb541700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.806 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71eb541700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.806 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71eb541700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.806 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:56:49.802+0000 7f71eb541700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:56:49.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.826+0000 7fccf37fe700 1 -- 172.21.15.86:0/2807061903 <== mon.2 v2:172.21.15.135:3301/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd0006f910 con 0x7fcd0c0b4e70 2023-10-09T11:56:49.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 msgr2=0x7fcd0c0cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:49.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0cb870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000ea50 tx=0x7fcd000091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 shutdown_connections 2023-10-09T11:56:49.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fccf80670e0 0x7fccf8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0c15d240 0x7fcd0c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd0c0b16d0 0x7fcd0c0c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 --2- 172.21.15.86:0/2807061903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd0c0b4e70 0x7fcd0c0cb870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:49.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 >> 172.21.15.86:0/2807061903 conn(0x7fcd0c0d10c0 msgr2=0x7fcd0c0697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:49.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 shutdown_connections 2023-10-09T11:56:49.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:49.829+0000 7fcd10b9d700 1 -- 172.21.15.86:0/2807061903 wait complete. 2023-10-09T11:56:49.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:56:50.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.032+0000 7f6fcc5ff700 1 Processor -- start 2023-10-09T11:56:50.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.032+0000 7f6fcc5ff700 1 -- start start 2023-10-09T11:56:50.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcc5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc415a440 0x7f6fc40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:50.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcc5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6fc4068890 0x7f6fc40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:50.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcc5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc415a9b0 con 0x7f6fc41563b0 2023-10-09T11:56:50.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcc5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc415ac90 con 0x7f6fc4068890 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcc5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc415af70 con 0x7f6fc415a440 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fca39b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6fc41563b0 0x7f6fc4156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46128/0 (socket says 172.21.15.86:46128) 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fca39b700 1 -- 172.21.15.86:0/183770648 learned_addr learned my addr 172.21.15.86:0/183770648 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcab9c700 1 --2- 172.21.15.86:0/183770648 >> v2:172.21.15.86:3300/0 conn(0x7f6fc4068890 0x7f6fc40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fc9b9a700 1 --2- 172.21.15.86:0/183770648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc415a440 0x7f6fc40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fc9399700 1 -- 172.21.15.86:0/183770648 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926977936 0 0) 0x7f6fc415a9b0 con 0x7f6fc41563b0 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcab9c700 1 -- 172.21.15.86:0/183770648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc415a440 msgr2=0x7f6fc40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcab9c700 1 --2- 172.21.15.86:0/183770648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc415a440 0x7f6fc40acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcab9c700 1 -- 172.21.15.86:0/183770648 >> v1:172.21.15.86:6789/0 conn(0x7f6fc41563b0 legacy=0x7f6fc4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:50.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.034+0000 7f6fcab9c700 1 -- 172.21.15.86:0/183770648 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc415b250 con 0x7f6fc4068890 2023-10-09T11:56:50.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fcab9c700 1 --2- 172.21.15.86:0/183770648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc4068890 0x7f6fc40c8230 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009e60 tx=0x7f6fbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a948f480c437297a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:50.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fc9399700 1 -- 172.21.15.86:0/183770648 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00e070 con 0x7f6fc4068890 2023-10-09T11:56:50.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fc9399700 1 -- 172.21.15.86:0/183770648 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc00bc30 con 0x7f6fc4068890 2023-10-09T11:56:50.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fc9399700 1 -- 172.21.15.86:0/183770648 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc012430 con 0x7f6fc4068890 2023-10-09T11:56:50.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/183770648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc4068890 msgr2=0x7f6fc40c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:50.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/183770648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc4068890 0x7f6fc40c8230 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009e60 tx=0x7f6fbc009780 comp rx=0 tx=0).stop 2023-10-09T11:56:50.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/183770648 shutdown_connections 2023-10-09T11:56:50.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/183770648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc4068890 0x7f6fc40c8230 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/183770648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc415a440 0x7f6fc40acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.035+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/183770648 >> 172.21.15.86:0/183770648 conn(0x7f6fc40c8f90 msgr2=0x7f6fc40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.036+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/183770648 shutdown_connections 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.036+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/183770648 wait complete. 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.037+0000 7f6fcc5ff700 1 Processor -- start 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.037+0000 7f6fcc5ff700 1 -- start start 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcc5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc4068890 0x7f6fc40b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcc5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fc41563b0 0x7f6fc40af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:50.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcc5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc415a440 0x7f6fc40af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcc5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40b1450 con 0x7f6fc415a440 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcc5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40c1cd0 con 0x7f6fc41563b0 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcc5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40c1840 con 0x7f6fc4068890 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcab9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc415a440 0x7f6fc40af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcab9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc415a440 0x7f6fc40af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35140/0 (socket says 172.21.15.86:35140) 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.038+0000 7f6fcab9c700 1 -- 172.21.15.86:0/2010956775 learned_addr learned my addr 172.21.15.86:0/2010956775 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fca39b700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc4068890 0x7f6fc40b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcab9c700 1 -- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc4068890 msgr2=0x7f6fc40b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:50.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fc9b9a700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fc41563b0 0x7f6fc40af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcab9c700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc4068890 0x7f6fc40b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcab9c700 1 -- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fc41563b0 msgr2=0x7f6fc40af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcab9c700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fc41563b0 0x7f6fc40af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcab9c700 1 -- 172.21.15.86:0/2010956775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc009a20 con 0x7f6fc415a440 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fca39b700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc4068890 0x7f6fc40b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fc9b9a700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fc41563b0 0x7f6fc40af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcab9c700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc415a440 0x7f6fc40af810 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00b6c0 tx=0x7f6fbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:50.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc012e00 con 0x7f6fc415a440 2023-10-09T11:56:50.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc01d630 con 0x7f6fc415a440 2023-10-09T11:56:50.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc01d9f0 con 0x7f6fc415a440 2023-10-09T11:56:50.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc40c0950 con 0x7f6fc415a440 2023-10-09T11:56:50.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.039+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc40c0f10 con 0x7f6fc415a440 2023-10-09T11:56:50.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.040+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc40718b0 con 0x7f6fc415a440 2023-10-09T11:56:50.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.041+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 34) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f6fbc024070 con 0x7f6fc415a440 2023-10-09T11:56:50.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.042+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f6fbc086d20 con 0x7f6fc415a440 2023-10-09T11:56:50.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.046+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fbc053f50 con 0x7f6fc415a440 2023-10-09T11:56:50.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.235+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6fc40c1980 con 0x7f6fc415a440 2023-10-09T11:56:50.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.745+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 35) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f6fbc003040 con 0x7f6fc415a440 2023-10-09T11:56:50.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.746+0000 7f6fba7fc700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6fa806ca10 0x7f6fa806edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:50.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.747+0000 7f6fca39b700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6fa806ca10 0x7f6fa806edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:50.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.750+0000 7f6fca39b700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6fa806ca10 0x7f6fa806edf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00018d0 tx=0x7f6fc0009040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:50.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.831+0000 7f6fba7fc700 1 -- 172.21.15.86:0/2010956775 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6fbc0297e0 con 0x7f6fc415a440 2023-10-09T11:56:50.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6fa806ca10 msgr2=0x7f6fa806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:50.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6fa806ca10 0x7f6fa806edf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00018d0 tx=0x7f6fc0009040 comp rx=0 tx=0).stop 2023-10-09T11:56:50.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc415a440 msgr2=0x7f6fc40af810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:50.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc415a440 0x7f6fc40af810 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00b6c0 tx=0x7f6fbc019000 comp rx=0 tx=0).stop 2023-10-09T11:56:50.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 shutdown_connections 2023-10-09T11:56:50.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6fa806ca10 0x7f6fa806edf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc415a440 0x7f6fc40af810 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fc4068890 0x7f6fc40b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 --2- 172.21.15.86:0/2010956775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fc41563b0 0x7f6fc40af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 >> 172.21.15.86:0/2010956775 conn(0x7f6fc40c8f90 msgr2=0x7f6fc4068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 shutdown_connections 2023-10-09T11:56:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:50.835+0000 7f6fcc5ff700 1 -- 172.21.15.86:0/2010956775 wait complete. 2023-10-09T11:56:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:56:50.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:56:51.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.045+0000 7fc6763ff700 1 Processor -- start 2023-10-09T11:56:51.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.045+0000 7fc6763ff700 1 -- start start 2023-10-09T11:56:51.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.046+0000 7fc6763ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc6700b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:51.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.046+0000 7fc6763ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6700b5b00 con 0x7fc6700cf350 2023-10-09T11:56:51.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.046+0000 7fc6763ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6700b5da0 con 0x7fc6700b53d0 2023-10-09T11:56:51.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.046+0000 7fc6763ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700b6080 con 0x7fc670159ec0 2023-10-09T11:56:51.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc67499c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc6700cf350 0x7fc6700cd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46134/0 (socket says 172.21.15.86:46134) 2023-10-09T11:56:51.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc67499c700 1 -- 172.21.15.86:0/1057609789 learned_addr learned my addr 172.21.15.86:0/1057609789 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:51.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66ffff700 1 --2- 172.21.15.86:0/1057609789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc6700b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66f7fe700 1 -- 172.21.15.86:0/1057609789 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645499965 0 0) 0x7fc6700b5b00 con 0x7fc6700cf350 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66f7fe700 1 -- 172.21.15.86:0/1057609789 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc65c003570 con 0x7fc6700cf350 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66f7fe700 1 -- 172.21.15.86:0/1057609789 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585004333 0 0) 0x7fc6700b5da0 con 0x7fc6700b53d0 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66f7fe700 1 -- 172.21.15.86:0/1057609789 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6700b5b00 con 0x7fc6700b53d0 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66ffff700 1 -- 172.21.15.86:0/1057609789 >> v1:172.21.15.135:6789/0 conn(0x7fc6700b53d0 legacy=0x7fc6700cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66ffff700 1 -- 172.21.15.86:0/1057609789 >> v1:172.21.15.86:6789/0 conn(0x7fc6700cf350 legacy=0x7fc6700cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.047+0000 7fc66ffff700 1 -- 172.21.15.86:0/1057609789 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700cc100 con 0x7fc670159ec0 2023-10-09T11:56:51.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.048+0000 7fc66ffff700 1 --2- 172.21.15.86:0/1057609789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc6700b4e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc660009ee0 tx=0x7fc660009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b121310f2fd901c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.048+0000 7fc66f7fe700 1 -- 172.21.15.86:0/1057609789 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000e070 con 0x7fc670159ec0 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.048+0000 7fc66f7fe700 1 -- 172.21.15.86:0/1057609789 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66000bb80 con 0x7fc670159ec0 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.048+0000 7fc66f7fe700 1 -- 172.21.15.86:0/1057609789 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660012430 con 0x7fc670159ec0 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.048+0000 7fc6763ff700 1 -- 172.21.15.86:0/1057609789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 msgr2=0x7fc6700b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.048+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1057609789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc6700b4e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc660009ee0 tx=0x7fc660009780 comp rx=0 tx=0).stop 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.049+0000 7fc6763ff700 1 -- 172.21.15.86:0/1057609789 shutdown_connections 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.049+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1057609789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc6700b4e90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.049+0000 7fc6763ff700 1 -- 172.21.15.86:0/1057609789 >> 172.21.15.86:0/1057609789 conn(0x7fc6700999f0 msgr2=0x7fc6700b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:51.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.049+0000 7fc6763ff700 1 -- 172.21.15.86:0/1057609789 shutdown_connections 2023-10-09T11:56:51.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.049+0000 7fc6763ff700 1 -- 172.21.15.86:0/1057609789 wait complete. 2023-10-09T11:56:51.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.050+0000 7fc6763ff700 1 Processor -- start 2023-10-09T11:56:51.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.050+0000 7fc6763ff700 1 -- start start 2023-10-09T11:56:51.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc6763ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6700b53d0 0x7fc670169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:51.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc6763ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6700cf350 0x7fc670156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:51.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc6763ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc670069730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:51.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc6763ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67009af50 con 0x7fc6700b53d0 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc6763ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc670068ad0 con 0x7fc6700cf350 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc6763ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67006a2a0 con 0x7fc670159ec0 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc66ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6700b53d0 0x7fc670169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc66ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6700b53d0 0x7fc670169cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35150/0 (socket says 172.21.15.86:35150) 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.051+0000 7fc66ffff700 1 -- 172.21.15.86:0/1708305207 learned_addr learned my addr 172.21.15.86:0/1708305207 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc667fff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6700cf350 0x7fc670156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66ffff700 1 -- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 msgr2=0x7fc670069730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66ffff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc670069730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66ffff700 1 -- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6700cf350 msgr2=0x7fc670156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66ffff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6700cf350 0x7fc670156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66ffff700 1 -- 172.21.15.86:0/1708305207 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009a20 con 0x7fc6700b53d0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc667fff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6700cf350 0x7fc670156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66ffff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6700b53d0 0x7fc670169cb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc6600099f0 tx=0x7fc660019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660012e30 con 0x7fc6700b53d0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc660026480 con 0x7fc6700b53d0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660026820 con 0x7fc6700b53d0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6701573d0 con 0x7fc6700b53d0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.052+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67009a900 con 0x7fc6700b53d0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.053+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc670063c90 con 0x7fc6700b53d0 2023-10-09T11:56:51.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.054+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 35) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fc66001c400 con 0x7fc6700b53d0 2023-10-09T11:56:51.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.055+0000 7fc66cff9700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc650066d80 0x7fc650069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:51.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.055+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fc6600863d0 con 0x7fc6700b53d0 2023-10-09T11:56:51.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.055+0000 7fc667fff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc650066d80 0x7fc650069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:51.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.056+0000 7fc667fff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc650066d80 0x7fc650069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc658007fd0 tx=0x7fc658009040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:51.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.059+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc660053600 con 0x7fc6700b53d0 2023-10-09T11:56:51.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.249+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6700718b0 con 0x7fc6700b53d0 2023-10-09T11:56:51.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.834+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6600860c0 con 0x7fc6700b53d0 2023-10-09T11:56:51.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.844+0000 7fc66cff9700 1 -- 172.21.15.86:0/1708305207 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc66006d8e0 con 0x7fc6700b53d0 2023-10-09T11:56:51.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.847+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc650066d80 msgr2=0x7fc650069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:51.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.847+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc650066d80 0x7fc650069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc658007fd0 tx=0x7fc658009040 comp rx=0 tx=0).stop 2023-10-09T11:56:51.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.847+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6700b53d0 msgr2=0x7fc670169cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:51.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.847+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6700b53d0 0x7fc670169cb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc6600099f0 tx=0x7fc660019000 comp rx=0 tx=0).stop 2023-10-09T11:56:51.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.847+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 shutdown_connections 2023-10-09T11:56:51.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.848+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc650066d80 0x7fc650069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:51.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.848+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6700b53d0 0x7fc670169cb0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:51.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.848+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc670159ec0 0x7fc670069730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:51.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.848+0000 7fc6763ff700 1 --2- 172.21.15.86:0/1708305207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6700cf350 0x7fc670156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:51.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.848+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 >> 172.21.15.86:0/1708305207 conn(0x7fc6700999f0 msgr2=0x7fc6701591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:51.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.848+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 shutdown_connections 2023-10-09T11:56:51.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:51.848+0000 7fc6763ff700 1 -- 172.21.15.86:0/1708305207 wait complete. 2023-10-09T11:56:51.851 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T11:56:51.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T11:56:52.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.053+0000 7f35f0f9d700 1 Processor -- start 2023-10-09T11:56:52.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.053+0000 7f35f0f9d700 1 -- start start 2023-10-09T11:56:52.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.054+0000 7f35f0f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35ec0b4e70 0x7f35ec0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.054+0000 7f35f0f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35ec0b1b40 0x7f35ec15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.054+0000 7f35f0f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec0cfb00 con 0x7f35ec0b16d0 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.054+0000 7f35f0f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0b5c40 con 0x7f35ec0b1b40 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.054+0000 7f35f0f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0b5f20 con 0x7f35ec0b4e70 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35ec0b1b40 0x7f35ec15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35ec0b1b40 0x7f35ec15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35152/0 (socket says 172.21.15.86:35152) 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 -- 172.21.15.86:0/626234693 learned_addr learned my addr 172.21.15.86:0/626234693 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35eaffd700 1 --1- 172.21.15.86:0/626234693 >> v1:172.21.15.86:6789/0 conn(0x7f35ec0b16d0 0x7f35ec15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46148/0 (socket says 172.21.15.86:46148) 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35eb7fe700 1 --2- 172.21.15.86:0/626234693 >> v2:172.21.15.135:3300/0 conn(0x7f35ec0b4e70 0x7f35ec0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 -- 172.21.15.86:0/626234693 >> v2:172.21.15.135:3300/0 conn(0x7f35ec0b4e70 msgr2=0x7f35ec0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 --2- 172.21.15.86:0/626234693 >> v2:172.21.15.135:3300/0 conn(0x7f35ec0b4e70 0x7f35ec0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 -- 172.21.15.86:0/626234693 >> v1:172.21.15.86:6789/0 conn(0x7f35ec0b16d0 legacy=0x7f35ec15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 -- 172.21.15.86:0/626234693 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0b6200 con 0x7f35ec0b1b40 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ea7fc700 1 -- 172.21.15.86:0/626234693 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13747378 0 0) 0x7f35ec0cfb00 con 0x7f35ec0b16d0 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.055+0000 7f35ebfff700 1 --2- 172.21.15.86:0/626234693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b1b40 0x7f35ec15d950 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f35ec064910 tx=0x7f35e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bfe6eefaa8cef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35ea7fc700 1 -- 172.21.15.86:0/626234693 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400e070 con 0x7f35ec0b1b40 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35ea7fc700 1 -- 172.21.15.86:0/626234693 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e400ba50 con 0x7f35ec0b1b40 2023-10-09T11:56:52.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35ea7fc700 1 -- 172.21.15.86:0/626234693 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40092e0 con 0x7f35ec0b1b40 2023-10-09T11:56:52.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 -- 172.21.15.86:0/626234693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b1b40 msgr2=0x7f35ec15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/626234693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b1b40 0x7f35ec15d950 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f35ec064910 tx=0x7f35e4009840 comp rx=0 tx=0).stop 2023-10-09T11:56:52.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 -- 172.21.15.86:0/626234693 shutdown_connections 2023-10-09T11:56:52.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/626234693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b1b40 0x7f35ec15d950 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/626234693 >> v2:172.21.15.135:3300/0 conn(0x7f35ec0b4e70 0x7f35ec0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 -- 172.21.15.86:0/626234693 >> 172.21.15.86:0/626234693 conn(0x7f35ec0d10c0 msgr2=0x7f35ec0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:52.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 -- 172.21.15.86:0/626234693 shutdown_connections 2023-10-09T11:56:52.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.056+0000 7f35f0f9d700 1 -- 172.21.15.86:0/626234693 wait complete. 2023-10-09T11:56:52.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.058+0000 7f35f0f9d700 1 Processor -- start 2023-10-09T11:56:52.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.058+0000 7f35f0f9d700 1 -- start start 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35f0f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec0b16d0 0x7f35ec145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35f0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35ec0b1b40 0x7f35ec0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35f0f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b4e70 0x7f35ec0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35f0f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec158810 con 0x7f35ec0b4e70 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35f0f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0c9030 con 0x7f35ec0b16d0 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35f0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0c6bf0 con 0x7f35ec0b1b40 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35ebfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b4e70 0x7f35ec0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec0b16d0 0x7f35ec145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35ebfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b4e70 0x7f35ec0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35162/0 (socket says 172.21.15.86:35162) 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35ebfff700 1 -- 172.21.15.86:0/1518607568 learned_addr learned my addr 172.21.15.86:0/1518607568 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.059+0000 7f35eaffd700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35ec0b1b40 0x7f35ec0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35ebfff700 1 -- 172.21.15.86:0/1518607568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35ec0b1b40 msgr2=0x7f35ec0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35ebfff700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35ec0b1b40 0x7f35ec0ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35ebfff700 1 -- 172.21.15.86:0/1518607568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec0b16d0 msgr2=0x7f35ec145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35ebfff700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec0b16d0 0x7f35ec145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35ebfff700 1 -- 172.21.15.86:0/1518607568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4009ae0 con 0x7f35ec0b4e70 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35ebfff700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b4e70 0x7f35ec0caca0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009880 tx=0x7f35e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35d37fe700 1 -- 172.21.15.86:0/1518607568 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400be60 con 0x7f35ec0b4e70 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35d37fe700 1 -- 172.21.15.86:0/1518607568 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e4008d60 con 0x7f35ec0b4e70 2023-10-09T11:56:52.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35d37fe700 1 -- 172.21.15.86:0/1518607568 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40266b0 con 0x7f35ec0b4e70 2023-10-09T11:56:52.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec0c8700 con 0x7f35ec0b4e70 2023-10-09T11:56:52.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.060+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec0c8cc0 con 0x7f35ec0b4e70 2023-10-09T11:56:52.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.061+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec088990 con 0x7f35ec0b4e70 2023-10-09T11:56:52.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.062+0000 7f35d37fe700 1 -- 172.21.15.86:0/1518607568 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35e4003040 con 0x7f35ec0b4e70 2023-10-09T11:56:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.063+0000 7f35d37fe700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f35d8066f30 0x7f35d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.064+0000 7f35d37fe700 1 -- 172.21.15.86:0/1518607568 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f35e4086510 con 0x7f35ec0b4e70 2023-10-09T11:56:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.064+0000 7f35eb7fe700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f35d8066f30 0x7f35d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.064+0000 7f35eb7fe700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f35d8066f30 0x7f35d80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006fd0 tx=0x7f35dc008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.068+0000 7f35d37fe700 1 -- 172.21.15.86:0/1518607568 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35e4053630 con 0x7f35ec0b4e70 2023-10-09T11:56:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.265+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f35ec15ce20 con 0x7f35ec0b4e70 2023-10-09T11:56:52.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.273+0000 7f35d37fe700 1 -- 172.21.15.86:0/1518607568 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v25) v1 ==== 115+0+0 (secure 0 0 0) 0x7f35e4056c50 con 0x7f35ec0b4e70 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.275+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f35d8066f30 msgr2=0x7f35d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.275+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f35d8066f30 0x7f35d80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35dc006fd0 tx=0x7f35dc008040 comp rx=0 tx=0).stop 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.275+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b4e70 msgr2=0x7f35ec0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.275+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b4e70 0x7f35ec0caca0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009880 tx=0x7f35e4018000 comp rx=0 tx=0).stop 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 shutdown_connections 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f35d8066f30 0x7f35d80693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0b4e70 0x7f35ec0caca0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35ec0b16d0 0x7f35ec145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 --2- 172.21.15.86:0/1518607568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35ec0b1b40 0x7f35ec0ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 >> 172.21.15.86:0/1518607568 conn(0x7f35ec0d10c0 msgr2=0x7f35ec15c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:52.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 shutdown_connections 2023-10-09T11:56:52.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.276+0000 7f35f0f9d700 1 -- 172.21.15.86:0/1518607568 wait complete. 2023-10-09T11:56:52.295 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T11:56:52.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.475+0000 7f2397dff700 1 Processor -- start 2023-10-09T11:56:52.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.476+0000 7f2397dff700 1 -- start start 2023-10-09T11:56:52.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.477+0000 7f2397dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390069e80 0x7f2390160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.477+0000 7f2397dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239006e950 con 0x7f23900c70b0 2023-10-09T11:56:52.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.477+0000 7f2397dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239006eb90 con 0x7f2390155eb0 2023-10-09T11:56:52.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.477+0000 7f2397dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239006ee70 con 0x7f2390069e80 2023-10-09T11:56:52.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.477+0000 7f239539a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f23900c70b0 0x7f2390069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46154/0 (socket says 172.21.15.86:46154) 2023-10-09T11:56:52.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.477+0000 7f239539a700 1 -- 172.21.15.86:0/32676073 learned_addr learned my addr 172.21.15.86:0/32676073 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:52.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.477+0000 7f239639c700 1 --2- 172.21.15.86:0/32676073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390069e80 0x7f2390160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516692582 0 0) 0x7f2380001110 con 0x7f23900c70b0 2023-10-09T11:56:52.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c003570 con 0x7f23900c70b0 2023-10-09T11:56:52.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427924019 0 0) 0x7f239006eb90 con 0x7f2390155eb0 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2380001110 con 0x7f2390155eb0 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2378690433 0 0) 0x7f237c003570 con 0x7f23900c70b0 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f239639c700 1 -- 172.21.15.86:0/32676073 >> v1:172.21.15.135:6789/0 conn(0x7f2390155eb0 legacy=0x7f239006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f239639c700 1 -- 172.21.15.86:0/32676073 >> v1:172.21.15.86:6789/0 conn(0x7f23900c70b0 legacy=0x7f2390069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f239639c700 1 -- 172.21.15.86:0/32676073 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239006f150 con 0x7f2390069e80 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f239639c700 1 --2- 172.21.15.86:0/32676073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390069e80 0x7f2390160bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f238800afa0 tx=0x7f238800a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=399ac00a5701a0ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800f070 con 0x7f2390069e80 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238800a0d0 con 0x7f2390069e80 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.478+0000 7f2394b99700 1 -- 172.21.15.86:0/32676073 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380001600 con 0x7f2390069e80 2023-10-09T11:56:52.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.479+0000 7f2397dff700 1 -- 172.21.15.86:0/32676073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390069e80 msgr2=0x7f2390160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.479+0000 7f2397dff700 1 --2- 172.21.15.86:0/32676073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390069e80 0x7f2390160bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f238800afa0 tx=0x7f238800a890 comp rx=0 tx=0).stop 2023-10-09T11:56:52.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.479+0000 7f2397dff700 1 -- 172.21.15.86:0/32676073 shutdown_connections 2023-10-09T11:56:52.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.479+0000 7f2397dff700 1 --2- 172.21.15.86:0/32676073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390069e80 0x7f2390160bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.479+0000 7f2397dff700 1 -- 172.21.15.86:0/32676073 >> 172.21.15.86:0/32676073 conn(0x7f2390068e10 msgr2=0x7f23900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:52.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.479+0000 7f2397dff700 1 -- 172.21.15.86:0/32676073 shutdown_connections 2023-10-09T11:56:52.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.479+0000 7f2397dff700 1 -- 172.21.15.86:0/32676073 wait complete. 2023-10-09T11:56:52.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.481+0000 7f2397dff700 1 Processor -- start 2023-10-09T11:56:52.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.481+0000 7f2397dff700 1 -- start start 2023-10-09T11:56:52.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2397dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2390069e80 0x7f23900abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2397dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23900c70b0 0x7f239015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2397dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390155eb0 0x7f2390148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2397dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900b0bb0 con 0x7f23900c70b0 2023-10-09T11:56:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2397dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900adab0 con 0x7f2390069e80 2023-10-09T11:56:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2397dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900ad7c0 con 0x7f2390155eb0 2023-10-09T11:56:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23900c70b0 0x7f239015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23900c70b0 0x7f239015a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35168/0 (socket says 172.21.15.86:35168) 2023-10-09T11:56:52.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 -- 172.21.15.86:0/463242916 learned_addr learned my addr 172.21.15.86:0/463242916 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:52.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 -- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390155eb0 msgr2=0x7f2390148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239639c700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390155eb0 0x7f2390148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390155eb0 0x7f2390148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 -- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2390069e80 msgr2=0x7f23900abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2395b9b700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2390069e80 0x7f23900abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2390069e80 0x7f23900abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f239539a700 1 -- 172.21.15.86:0/463242916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238800ab30 con 0x7f23900c70b0 2023-10-09T11:56:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.482+0000 7f2395b9b700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2390069e80 0x7f23900abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.483+0000 7f239539a700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23900c70b0 0x7f239015a8e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f238000cb90 tx=0x7f2380001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.483+0000 7f2385ffb700 1 -- 172.21.15.86:0/463242916 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380007360 con 0x7f23900c70b0 2023-10-09T11:56:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.483+0000 7f2385ffb700 1 -- 172.21.15.86:0/463242916 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23800074c0 con 0x7f23900c70b0 2023-10-09T11:56:52.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.483+0000 7f2385ffb700 1 -- 172.21.15.86:0/463242916 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380004830 con 0x7f23900c70b0 2023-10-09T11:56:52.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.483+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23900b0e00 con 0x7f23900c70b0 2023-10-09T11:56:52.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.483+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23900ac100 con 0x7f23900c70b0 2023-10-09T11:56:52.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.484+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23900adc20 con 0x7f23900c70b0 2023-10-09T11:56:52.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.485+0000 7f2385ffb700 1 -- 172.21.15.86:0/463242916 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2380004c40 con 0x7f23900c70b0 2023-10-09T11:56:52.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.486+0000 7f2385ffb700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2374066f30 0x7f23740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.486+0000 7f2385ffb700 1 -- 172.21.15.86:0/463242916 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f2380083ff0 con 0x7f23900c70b0 2023-10-09T11:56:52.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.486+0000 7f2395b9b700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2374066f30 0x7f23740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.487+0000 7f2395b9b700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2374066f30 0x7f23740693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f238c001780 tx=0x7f238c009040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.490+0000 7f2385ffb700 1 -- 172.21.15.86:0/463242916 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2380051110 con 0x7f23900c70b0 2023-10-09T11:56:52.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.683+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f239006e950 con 0x7f23900c70b0 2023-10-09T11:56:52.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.687+0000 7f2385ffb700 1 -- 172.21.15.86:0/463242916 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v26) v1 ==== 120+0+0 (secure 0 0 0) 0x7f239006e950 con 0x7f23900c70b0 2023-10-09T11:56:52.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2374066f30 msgr2=0x7f23740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2374066f30 0x7f23740693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f238c001780 tx=0x7f238c009040 comp rx=0 tx=0).stop 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23900c70b0 msgr2=0x7f239015a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23900c70b0 0x7f239015a8e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f238000cb90 tx=0x7f2380001c40 comp rx=0 tx=0).stop 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 shutdown_connections 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2390155eb0 0x7f2390148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2390069e80 0x7f23900abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2374066f30 0x7f23740693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 --2- 172.21.15.86:0/463242916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23900c70b0 0x7f239015a8e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 >> 172.21.15.86:0/463242916 conn(0x7f2390068e10 msgr2=0x7f23900c7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 shutdown_connections 2023-10-09T11:56:52.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.690+0000 7f2397dff700 1 -- 172.21.15.86:0/463242916 wait complete. 2023-10-09T11:56:52.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:56:52.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.895+0000 7f2caa39d700 1 Processor -- start 2023-10-09T11:56:52.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.895+0000 7f2caa39d700 1 -- start start 2023-10-09T11:56:52.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.896+0000 7f2caa39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2ca4157130 0x7f2ca40c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.896+0000 7f2caa39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca406e5e0 0x7f2ca406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.896+0000 7f2caa39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca406e150 con 0x7f2ca40c9db0 2023-10-09T11:56:52.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.896+0000 7f2caa39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40c7800 con 0x7f2ca4157130 2023-10-09T11:56:52.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.896+0000 7f2caa39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40c7ae0 con 0x7f2ca406e5e0 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2ca4157130 0x7f2ca40c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca9b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca406e5e0 0x7f2ca406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2ca4157130 0x7f2ca40c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:37178/0 (socket says 172.21.15.86:37178) 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca9b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca406e5e0 0x7f2ca406ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:56526/0 (socket says 172.21.15.86:56526) 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 -- 172.21.15.86:0/2763017564 learned_addr learned my addr 172.21.15.86:0/2763017564 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 -- 172.21.15.86:0/2763017564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca406e5e0 msgr2=0x7f2ca406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 --2- 172.21.15.86:0/2763017564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca406e5e0 0x7f2ca406ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 -- 172.21.15.86:0/2763017564 >> v1:172.21.15.135:6789/0 conn(0x7f2ca40c9db0 legacy=0x7f2ca4153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 -- 172.21.15.86:0/2763017564 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40c7dc0 con 0x7f2ca4157130 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.897+0000 7f2ca8b9a700 1 --2- 172.21.15.86:0/2763017564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca4157130 0x7f2ca40c6f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2c940099b0 tx=0x7f2c94009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470c36b2498634ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2c9bfff700 1 -- 172.21.15.86:0/2763017564 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94009ea0 con 0x7f2ca4157130 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2c9bfff700 1 -- 172.21.15.86:0/2763017564 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9400b860 con 0x7f2ca4157130 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2c9bfff700 1 -- 172.21.15.86:0/2763017564 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400bc00 con 0x7f2ca4157130 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 -- 172.21.15.86:0/2763017564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca4157130 msgr2=0x7f2ca40c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 --2- 172.21.15.86:0/2763017564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca4157130 0x7f2ca40c6f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2c940099b0 tx=0x7f2c94009250 comp rx=0 tx=0).stop 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 -- 172.21.15.86:0/2763017564 shutdown_connections 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 --2- 172.21.15.86:0/2763017564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca406e5e0 0x7f2ca406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 --2- 172.21.15.86:0/2763017564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca4157130 0x7f2ca40c6f00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 -- 172.21.15.86:0/2763017564 >> 172.21.15.86:0/2763017564 conn(0x7f2ca40cc1e0 msgr2=0x7f2ca40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 -- 172.21.15.86:0/2763017564 shutdown_connections 2023-10-09T11:56:52.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.898+0000 7f2caa39d700 1 -- 172.21.15.86:0/2763017564 wait complete. 2023-10-09T11:56:52.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.900+0000 7f2caa39d700 1 Processor -- start 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.900+0000 7f2caa39d700 1 -- start start 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2caa39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca406e5e0 0x7f2ca413ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2caa39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca40c9db0 0x7f2ca40b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2caa39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca4157130 0x7f2ca40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2caa39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40b0240 con 0x7f2ca406e5e0 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2caa39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40af630 con 0x7f2ca40c9db0 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2caa39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40af910 con 0x7f2ca4157130 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2ca939b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca406e5e0 0x7f2ca413ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2ca939b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca406e5e0 0x7f2ca413ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35176/0 (socket says 172.21.15.86:35176) 2023-10-09T11:56:52.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2ca939b700 1 -- 172.21.15.86:0/880339178 learned_addr learned my addr 172.21.15.86:0/880339178 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2ca8b9a700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca40c9db0 0x7f2ca40b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.901+0000 7f2ca9b9c700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca4157130 0x7f2ca40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2ca939b700 1 -- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca4157130 msgr2=0x7f2ca40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2ca939b700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca4157130 0x7f2ca40ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2ca939b700 1 -- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca40c9db0 msgr2=0x7f2ca40b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2ca939b700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca40c9db0 0x7f2ca40b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2ca939b700 1 -- 172.21.15.86:0/880339178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940094f0 con 0x7f2ca406e5e0 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2ca9b9c700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca4157130 0x7f2ca40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2ca939b700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca406e5e0 0x7f2ca413ceb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c4e0 tx=0x7f2ca000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2c997fa700 1 -- 172.21.15.86:0/880339178 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0011590 con 0x7f2ca406e5e0 2023-10-09T11:56:52.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2c997fa700 1 -- 172.21.15.86:0/880339178 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca0011710 con 0x7f2ca406e5e0 2023-10-09T11:56:52.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2c997fa700 1 -- 172.21.15.86:0/880339178 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0011ad0 con 0x7f2ca406e5e0 2023-10-09T11:56:52.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca40afbf0 con 0x7f2ca406e5e0 2023-10-09T11:56:52.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.902+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca413d3f0 con 0x7f2ca406e5e0 2023-10-09T11:56:52.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.903+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca406c450 con 0x7f2ca406e5e0 2023-10-09T11:56:52.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.904+0000 7f2c997fa700 1 -- 172.21.15.86:0/880339178 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ca001b3b0 con 0x7f2ca406e5e0 2023-10-09T11:56:52.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.905+0000 7f2c997fa700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c88066f30 0x7f2c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:52.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.905+0000 7f2c997fa700 1 -- 172.21.15.86:0/880339178 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f2ca0083bb0 con 0x7f2ca406e5e0 2023-10-09T11:56:52.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.905+0000 7f2ca8b9a700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c88066f30 0x7f2c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:52.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.906+0000 7f2ca8b9a700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c88066f30 0x7f2c880693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c940099b0 tx=0x7f2c94017000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:52.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:52.909+0000 7f2c997fa700 1 -- 172.21.15.86:0/880339178 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ca0050cd0 con 0x7f2ca406e5e0 2023-10-09T11:56:53.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.098+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2ca406dd20 con 0x7f2ca406e5e0 2023-10-09T11:56:53.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.102+0000 7f2c997fa700 1 -- 172.21.15.86:0/880339178 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2ca0017020 con 0x7f2ca406e5e0 2023-10-09T11:56:53.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c88066f30 msgr2=0x7f2c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c88066f30 0x7f2c880693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c940099b0 tx=0x7f2c94017000 comp rx=0 tx=0).stop 2023-10-09T11:56:53.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca406e5e0 msgr2=0x7f2ca413ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca406e5e0 0x7f2ca413ceb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c4e0 tx=0x7f2ca000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 shutdown_connections 2023-10-09T11:56:53.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c88066f30 0x7f2c880693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca406e5e0 0x7f2ca413ceb0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ca4157130 0x7f2ca40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 --2- 172.21.15.86:0/880339178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca40c9db0 0x7f2ca40b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 >> 172.21.15.86:0/880339178 conn(0x7f2ca40cc1e0 msgr2=0x7f2ca4155910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:53.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 shutdown_connections 2023-10-09T11:56:53.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.105+0000 7f2caa39d700 1 -- 172.21.15.86:0/880339178 wait complete. 2023-10-09T11:56:53.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-09T11:56:53.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.302+0000 7f3b9a79d700 1 Processor -- start 2023-10-09T11:56:53.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.302+0000 7f3b9a79d700 1 -- start start 2023-10-09T11:56:53.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.303+0000 7f3b9a79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b941566e0 0x7f3b940ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:53.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.303+0000 7f3b9a79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b940ca860 con 0x7f3b940cb900 2023-10-09T11:56:53.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.303+0000 7f3b9a79d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b940cab40 con 0x7f3b94156310 2023-10-09T11:56:53.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.303+0000 7f3b9a79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b940cae20 con 0x7f3b941566e0 2023-10-09T11:56:53.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b98f9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b941566e0 0x7f3b940ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:53.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b99f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3b940cb900 0x7f3b940c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46166/0 (socket says 172.21.15.86:46166) 2023-10-09T11:56:53.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b99f9c700 1 -- 172.21.15.86:0/1072495738 learned_addr learned my addr 172.21.15.86:0/1072495738 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:53.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b8bfff700 1 -- 172.21.15.86:0/1072495738 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614564875 0 0) 0x7f3b940ca860 con 0x7f3b940cb900 2023-10-09T11:56:53.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b98f9a700 1 -- 172.21.15.86:0/1072495738 >> v1:172.21.15.135:6789/0 conn(0x7f3b94156310 legacy=0x7f3b940c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b98f9a700 1 -- 172.21.15.86:0/1072495738 >> v1:172.21.15.86:6789/0 conn(0x7f3b940cb900 legacy=0x7f3b940c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b98f9a700 1 -- 172.21.15.86:0/1072495738 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940cb100 con 0x7f3b941566e0 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b98f9a700 1 --2- 172.21.15.86:0/1072495738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b941566e0 0x7f3b940ae000 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3b840098e0 tx=0x7f3b840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bfcf0f9867250b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.304+0000 7f3b8bfff700 1 -- 172.21.15.86:0/1072495738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84009e80 con 0x7f3b941566e0 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b8bfff700 1 -- 172.21.15.86:0/1072495738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400b860 con 0x7f3b941566e0 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b8bfff700 1 -- 172.21.15.86:0/1072495738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400bbe0 con 0x7f3b941566e0 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b9a79d700 1 -- 172.21.15.86:0/1072495738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b941566e0 msgr2=0x7f3b940ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/1072495738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b941566e0 0x7f3b940ae000 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3b840098e0 tx=0x7f3b840091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b9a79d700 1 -- 172.21.15.86:0/1072495738 shutdown_connections 2023-10-09T11:56:53.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/1072495738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b941566e0 0x7f3b940ae000 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b9a79d700 1 -- 172.21.15.86:0/1072495738 >> 172.21.15.86:0/1072495738 conn(0x7f3b940cc1f0 msgr2=0x7f3b940cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:53.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b9a79d700 1 -- 172.21.15.86:0/1072495738 shutdown_connections 2023-10-09T11:56:53.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.305+0000 7f3b9a79d700 1 -- 172.21.15.86:0/1072495738 wait complete. 2023-10-09T11:56:53.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.307+0000 7f3b9a79d700 1 Processor -- start 2023-10-09T11:56:53.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.307+0000 7f3b9a79d700 1 -- start start 2023-10-09T11:56:53.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9a79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b940cb900 0x7f3b9414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:53.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9a79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b94156310 0x7f3b94169b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:53.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9a79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b941566e0 0x7f3b940c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:53.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9a79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940b1d80 con 0x7f3b940cb900 2023-10-09T11:56:53.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9a79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9415ba60 con 0x7f3b94156310 2023-10-09T11:56:53.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9a79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940b0e70 con 0x7f3b941566e0 2023-10-09T11:56:53.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b940cb900 0x7f3b9414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:53.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b940cb900 0x7f3b9414fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35196/0 (socket says 172.21.15.86:35196) 2023-10-09T11:56:53.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 -- 172.21.15.86:0/805419523 learned_addr learned my addr 172.21.15.86:0/805419523 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:53.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b98f9a700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b94156310 0x7f3b94169b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 -- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b941566e0 msgr2=0x7f3b940c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b941566e0 0x7f3b940c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 -- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b94156310 msgr2=0x7f3b94169b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b94156310 0x7f3b94169b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 -- 172.21.15.86:0/805419523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84009420 con 0x7f3b940cb900 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b98f9a700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b94156310 0x7f3b94169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.308+0000 7f3b9979b700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b940cb900 0x7f3b9414fe30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c590 tx=0x7f3b9000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:53.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.309+0000 7f3b897fa700 1 -- 172.21.15.86:0/805419523 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90011590 con 0x7f3b940cb900 2023-10-09T11:56:53.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.309+0000 7f3b897fa700 1 -- 172.21.15.86:0/805419523 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900116f0 con 0x7f3b940cb900 2023-10-09T11:56:53.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.309+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b940b0b90 con 0x7f3b940cb900 2023-10-09T11:56:53.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.309+0000 7f3b897fa700 1 -- 172.21.15.86:0/805419523 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90011ab0 con 0x7f3b940cb900 2023-10-09T11:56:53.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.309+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9415b6f0 con 0x7f3b940cb900 2023-10-09T11:56:53.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.310+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9404c3c0 con 0x7f3b940cb900 2023-10-09T11:56:53.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.311+0000 7f3b897fa700 1 -- 172.21.15.86:0/805419523 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b9001b3b0 con 0x7f3b940cb900 2023-10-09T11:56:53.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.311+0000 7f3b897fa700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b78066f30 0x7f3b780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:53.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.311+0000 7f3b897fa700 1 -- 172.21.15.86:0/805419523 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f3b90083c30 con 0x7f3b940cb900 2023-10-09T11:56:53.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.312+0000 7f3b98f9a700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b78066f30 0x7f3b780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:53.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.312+0000 7f3b98f9a700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b78066f30 0x7f3b780693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b840098e0 tx=0x7f3b84017000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:53.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.315+0000 7f3b897fa700 1 -- 172.21.15.86:0/805419523 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b90050d50 con 0x7f3b940cb900 2023-10-09T11:56:53.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.583+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f3b940cd0b0 con 0x7f3b940cb900 2023-10-09T11:56:53.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.835+0000 7f3b897fa700 1 -- 172.21.15.86:0/805419523 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v572) v1 ==== 156+0+0 (secure 0 0 0) 0x7f3b90017070 con 0x7f3b940cb900 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b78066f30 msgr2=0x7f3b780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b78066f30 0x7f3b780693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b840098e0 tx=0x7f3b84017000 comp rx=0 tx=0).stop 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b940cb900 msgr2=0x7f3b9414fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b940cb900 0x7f3b9414fe30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c590 tx=0x7f3b9000c950 comp rx=0 tx=0).stop 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 shutdown_connections 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b78066f30 0x7f3b780693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b940cb900 0x7f3b9414fe30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b941566e0 0x7f3b940c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 --2- 172.21.15.86:0/805419523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b94156310 0x7f3b94169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:53.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.837+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 >> 172.21.15.86:0/805419523 conn(0x7f3b940cc1f0 msgr2=0x7f3b9406a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:53.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.838+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 shutdown_connections 2023-10-09T11:56:53.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:53.838+0000 7f3b9a79d700 1 -- 172.21.15.86:0/805419523 wait complete. 2023-10-09T11:56:53.856 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-10-09T11:56:53.857 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-10-09T11:56:53.857 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T11:56:53.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-09T11:56:54.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.035+0000 7fa6f55ff700 1 Processor -- start 2023-10-09T11:56:54.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.036+0000 7fa6f55ff700 1 -- start start 2023-10-09T11:56:54.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6f55ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6f00afc40 0x7fa6f00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:54.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6f55ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa6f00b0010 0x7fa6f015df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:54.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6f55ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f00b0750 con 0x7fa6f00b2140 2023-10-09T11:56:54.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6f55ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f00aca70 con 0x7fa6f00afc40 2023-10-09T11:56:54.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6f55ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f00acd50 con 0x7fa6f00b0010 2023-10-09T11:56:54.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6eeffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6f00afc40 0x7fa6f00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:54.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6eeffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6f00afc40 0x7fa6f00b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35198/0 (socket says 172.21.15.86:35198) 2023-10-09T11:56:54.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.037+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2453100033 learned_addr learned my addr 172.21.15.86:0/2453100033 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:54.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6ef7fe700 1 --2- 172.21.15.86:0/2453100033 >> v2:172.21.15.135:3300/0 conn(0x7fa6f00b0010 0x7fa6f015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:54.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2453100033 >> v2:172.21.15.135:3300/0 conn(0x7fa6f00b0010 msgr2=0x7fa6f015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:54.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6eeffd700 1 --2- 172.21.15.86:0/2453100033 >> v2:172.21.15.135:3300/0 conn(0x7fa6f00b0010 0x7fa6f015df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2453100033 >> v1:172.21.15.135:6789/0 conn(0x7fa6f00b2140 legacy=0x7fa6f015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:54.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2453100033 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f00ad030 con 0x7fa6f00afc40 2023-10-09T11:56:54.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6ef7fe700 1 --2- 172.21.15.86:0/2453100033 >> v2:172.21.15.135:3300/0 conn(0x7fa6f00b0010 0x7fa6f015df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:54.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6eeffd700 1 --2- 172.21.15.86:0/2453100033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f00b1c00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00695d0 tx=0x7fa6e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e56411de868c9b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:54.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6edffb700 1 -- 172.21.15.86:0/2453100033 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000b820 con 0x7fa6f00afc40 2023-10-09T11:56:54.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6edffb700 1 -- 172.21.15.86:0/2453100033 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e000b980 con 0x7fa6f00afc40 2023-10-09T11:56:54.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.038+0000 7fa6edffb700 1 -- 172.21.15.86:0/2453100033 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000bd20 con 0x7fa6f00afc40 2023-10-09T11:56:54.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2453100033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 msgr2=0x7fa6f00b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2453100033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f00b1c00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00695d0 tx=0x7fa6e0009250 comp rx=0 tx=0).stop 2023-10-09T11:56:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2453100033 shutdown_connections 2023-10-09T11:56:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2453100033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f00b1c00 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2453100033 >> v2:172.21.15.135:3300/0 conn(0x7fa6f00b0010 0x7fa6f015df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2453100033 >> 172.21.15.86:0/2453100033 conn(0x7fa6f006a320 msgr2=0x7fa6f00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:54.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2453100033 shutdown_connections 2023-10-09T11:56:54.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.039+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2453100033 wait complete. 2023-10-09T11:56:54.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.040+0000 7fa6f55ff700 1 Processor -- start 2023-10-09T11:56:54.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.040+0000 7fa6f55ff700 1 -- start start 2023-10-09T11:56:54.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6f55ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f0143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:54.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6f55ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6f00b0010 0x7fa6f0161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:54.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6f55ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6f00b2140 0x7fa6f00ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:54.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6f55ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f0160060 con 0x7fa6f00afc40 2023-10-09T11:56:54.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6f55ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f015f450 con 0x7fa6f00b2140 2023-10-09T11:56:54.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6f55ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f015f730 con 0x7fa6f00b0010 2023-10-09T11:56:54.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f0143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:54.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f0143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35212/0 (socket says 172.21.15.86:35212) 2023-10-09T11:56:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.041+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2696291190 learned_addr learned my addr 172.21.15.86:0/2696291190 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6ef7fe700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6f00b2140 0x7fa6f00ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6ee7fc700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6f00b0010 0x7fa6f0161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6f00b0010 msgr2=0x7fa6f0161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6eeffd700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6f00b0010 0x7fa6f0161450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6f00b2140 msgr2=0x7fa6f00ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6eeffd700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6f00b2140 0x7fa6f00ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6eeffd700 1 -- 172.21.15.86:0/2696291190 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00094f0 con 0x7fa6f00afc40 2023-10-09T11:56:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6ee7fc700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6f00b0010 0x7fa6f0161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6eeffd700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f0143630 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00030c0 tx=0x7fa6e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6d6ffd700 1 -- 172.21.15.86:0/2696291190 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0011db0 con 0x7fa6f00afc40 2023-10-09T11:56:54.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6d6ffd700 1 -- 172.21.15.86:0/2696291190 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0020070 con 0x7fa6f00afc40 2023-10-09T11:56:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6d6ffd700 1 -- 172.21.15.86:0/2696291190 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e001b6a0 con 0x7fa6f00afc40 2023-10-09T11:56:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.042+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f015fa10 con 0x7fa6f00afc40 2023-10-09T11:56:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.043+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f0143b70 con 0x7fa6f00afc40 2023-10-09T11:56:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.044+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f0160340 con 0x7fa6f00afc40 2023-10-09T11:56:54.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.044+0000 7fa6d6ffd700 1 -- 172.21.15.86:0/2696291190 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6e0022030 con 0x7fa6f00afc40 2023-10-09T11:56:54.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.045+0000 7fa6d6ffd700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa6dc066f30 0x7fa6dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:54.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.046+0000 7fa6d6ffd700 1 -- 172.21.15.86:0/2696291190 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7fa6e0086600 con 0x7fa6f00afc40 2023-10-09T11:56:54.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.046+0000 7fa6ee7fc700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa6dc066f30 0x7fa6dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:54.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.046+0000 7fa6ee7fc700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa6dc066f30 0x7fa6dc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006fd0 tx=0x7fa6e4008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:54.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.049+0000 7fa6d6ffd700 1 -- 172.21.15.86:0/2696291190 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6e0053720 con 0x7fa6f00afc40 2023-10-09T11:56:54.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.319+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fa6f0160340 con 0x7fa6f00afc40 2023-10-09T11:56:54.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.837+0000 7fa6d6ffd700 1 -- 172.21.15.86:0/2696291190 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v573) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa6e0056d40 con 0x7fa6f00afc40 2023-10-09T11:56:54.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa6dc066f30 msgr2=0x7fa6dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa6dc066f30 0x7fa6dc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006fd0 tx=0x7fa6e4008040 comp rx=0 tx=0).stop 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 msgr2=0x7fa6f0143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f0143630 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00030c0 tx=0x7fa6e0016000 comp rx=0 tx=0).stop 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 shutdown_connections 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa6dc066f30 0x7fa6dc0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6f00afc40 0x7fa6f0143630 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6f00b2140 0x7fa6f00ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 --2- 172.21.15.86:0/2696291190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6f00b0010 0x7fa6f0161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 >> 172.21.15.86:0/2696291190 conn(0x7fa6f006a320 msgr2=0x7fa6f01517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 shutdown_connections 2023-10-09T11:56:54.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:54.840+0000 7fa6f55ff700 1 -- 172.21.15.86:0/2696291190 wait complete. 2023-10-09T11:56:54.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:56:55.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.047+0000 7fdd83fff700 1 Processor -- start 2023-10-09T11:56:55.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.047+0000 7fdd83fff700 1 -- start start 2023-10-09T11:56:55.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd83fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdd840ccc00 0x7fdd84069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd83fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdd8406a020 0x7fdd840cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd83fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd840c9f30 con 0x7fdd84159a60 2023-10-09T11:56:55.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd83fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8406dfc0 con 0x7fdd840ccc00 2023-10-09T11:56:55.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd83fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840ca470 con 0x7fdd8406a020 2023-10-09T11:56:55.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd827fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdd840ccc00 0x7fdd84069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd827fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdd840ccc00 0x7fdd84069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49792/0 (socket says 172.21.15.86:49792) 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd82ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdd84159a60 0x7fdd840c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56704/0 (socket says 172.21.15.86:56704) 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.048+0000 7fdd827fc700 1 -- 172.21.15.86:0/3117389243 learned_addr learned my addr 172.21.15.86:0/3117389243 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd837fe700 1 --2- 172.21.15.86:0/3117389243 >> v2:172.21.15.135:3300/0 conn(0x7fdd8406a020 0x7fdd840cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd827fc700 1 -- 172.21.15.86:0/3117389243 >> v2:172.21.15.135:3300/0 conn(0x7fdd8406a020 msgr2=0x7fdd840cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd827fc700 1 --2- 172.21.15.86:0/3117389243 >> v2:172.21.15.135:3300/0 conn(0x7fdd8406a020 0x7fdd840cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd827fc700 1 -- 172.21.15.86:0/3117389243 >> v1:172.21.15.86:6789/0 conn(0x7fdd84159a60 legacy=0x7fdd840c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd827fc700 1 -- 172.21.15.86:0/3117389243 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840ca750 con 0x7fdd840ccc00 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd837fe700 1 --2- 172.21.15.86:0/3117389243 >> v2:172.21.15.135:3300/0 conn(0x7fdd8406a020 0x7fdd840cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:55.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd827fc700 1 --2- 172.21.15.86:0/3117389243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd84069ae0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdd840cc410 tx=0x7fdd78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d1aabee0fdd398 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:55.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd81ffb700 1 -- 172.21.15.86:0/3117389243 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800b8f0 con 0x7fdd840ccc00 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd81ffb700 1 -- 172.21.15.86:0/3117389243 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800ba50 con 0x7fdd840ccc00 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.049+0000 7fdd81ffb700 1 -- 172.21.15.86:0/3117389243 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800bdf0 con 0x7fdd840ccc00 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 -- 172.21.15.86:0/3117389243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 msgr2=0x7fdd84069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 --2- 172.21.15.86:0/3117389243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd84069ae0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdd840cc410 tx=0x7fdd78009250 comp rx=0 tx=0).stop 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 -- 172.21.15.86:0/3117389243 shutdown_connections 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 --2- 172.21.15.86:0/3117389243 >> v2:172.21.15.135:3300/0 conn(0x7fdd8406a020 0x7fdd840cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 --2- 172.21.15.86:0/3117389243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd84069ae0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 -- 172.21.15.86:0/3117389243 >> 172.21.15.86:0/3117389243 conn(0x7fdd8406baa0 msgr2=0x7fdd8406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 -- 172.21.15.86:0/3117389243 shutdown_connections 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.050+0000 7fdd83fff700 1 -- 172.21.15.86:0/3117389243 wait complete. 2023-10-09T11:56:55.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.051+0000 7fdd83fff700 1 Processor -- start 2023-10-09T11:56:55.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.052+0000 7fdd83fff700 1 -- start start 2023-10-09T11:56:55.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.052+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd8406a020 0x7fdd8414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.052+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd840b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.052+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd84159a60 0x7fdd8414c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.052+0000 7fdd83fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414e550 con 0x7fdd840ccc00 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.052+0000 7fdd83fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414e830 con 0x7fdd8406a020 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.052+0000 7fdd83fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414eb10 con 0x7fdd84159a60 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd840b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd840b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49794/0 (socket says 172.21.15.86:49794) 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 -- 172.21.15.86:0/2785462099 learned_addr learned my addr 172.21.15.86:0/2785462099 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 -- 172.21.15.86:0/2785462099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd84159a60 msgr2=0x7fdd8414c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd84159a60 0x7fdd8414c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 -- 172.21.15.86:0/2785462099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd8406a020 msgr2=0x7fdd8414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd8406a020 0x7fdd8414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 -- 172.21.15.86:0/2785462099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780094f0 con 0x7fdd840ccc00 2023-10-09T11:56:55.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd827fc700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd840b20a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009290 tx=0x7fdd78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:55.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd6affd700 1 -- 172.21.15.86:0/2785462099 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78011e20 con 0x7fdd840ccc00 2023-10-09T11:56:55.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd6affd700 1 -- 172.21.15.86:0/2785462099 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7801a630 con 0x7fdd840ccc00 2023-10-09T11:56:55.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8414edf0 con 0x7fdd840ccc00 2023-10-09T11:56:55.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.053+0000 7fdd6affd700 1 -- 172.21.15.86:0/2785462099 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7801a9f0 con 0x7fdd840ccc00 2023-10-09T11:56:55.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.054+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd840b25e0 con 0x7fdd840ccc00 2023-10-09T11:56:55.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.055+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8414f310 con 0x7fdd840ccc00 2023-10-09T11:56:55.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.055+0000 7fdd6affd700 1 -- 172.21.15.86:0/2785462099 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd78024440 con 0x7fdd840ccc00 2023-10-09T11:56:55.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.057+0000 7fdd6affd700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdd70066f30 0x7fdd700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.057+0000 7fdd6affd700 1 -- 172.21.15.86:0/2785462099 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7fdd780860c0 con 0x7fdd840ccc00 2023-10-09T11:56:55.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.057+0000 7fdd82ffd700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdd70066f30 0x7fdd700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.058+0000 7fdd82ffd700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdd70066f30 0x7fdd700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd74001600 tx=0x7fdd74007b30 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:55.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.061+0000 7fdd6affd700 1 -- 172.21.15.86:0/2785462099 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd8414f310 con 0x7fdd840ccc00 2023-10-09T11:56:55.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.251+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdd8414f310 con 0x7fdd840ccc00 2023-10-09T11:56:55.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.256+0000 7fdd6affd700 1 -- 172.21.15.86:0/2785462099 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdd8414f310 con 0x7fdd840ccc00 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdd70066f30 msgr2=0x7fdd700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdd70066f30 0x7fdd700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd74001600 tx=0x7fdd74007b30 comp rx=0 tx=0).stop 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 msgr2=0x7fdd840b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd840b20a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009290 tx=0x7fdd78017000 comp rx=0 tx=0).stop 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 shutdown_connections 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd84159a60 0x7fdd8414c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd8406a020 0x7fdd8414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdd70066f30 0x7fdd700693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 --2- 172.21.15.86:0/2785462099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd840ccc00 0x7fdd840b20a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 >> 172.21.15.86:0/2785462099 conn(0x7fdd8406baa0 msgr2=0x7fdd84157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:55.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 shutdown_connections 2023-10-09T11:56:55.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.258+0000 7fdd83fff700 1 -- 172.21.15.86:0/2785462099 wait complete. 2023-10-09T11:56:55.277 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:56:55.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:55.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:56:55.454 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:56:55.454 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:56:55.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:56:55.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.636+0000 7f9b8bbff700 1 Processor -- start 2023-10-09T11:56:55.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.636+0000 7f9b8bbff700 1 -- start start 2023-10-09T11:56:55.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b8bbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 0x7f9b840ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b8bbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840cc300 con 0x7f9b840ccf90 2023-10-09T11:56:55.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b8bbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840ad370 con 0x7f9b840cbf30 2023-10-09T11:56:55.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b8bbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84156bf0 con 0x7f9b840b1420 2023-10-09T11:56:55.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b8a19c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9b840ccf90 0x7f9b840c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56708/0 (socket says 172.21.15.86:56708) 2023-10-09T11:56:55.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b8a19c700 1 -- 172.21.15.86:0/3562507786 learned_addr learned my addr 172.21.15.86:0/3562507786 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:55.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b8919a700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 0x7f9b840ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259287251 0 0) 0x7f9b840cc300 con 0x7f9b840ccf90 2023-10-09T11:56:55.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.638+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b70003570 con 0x7f9b840ccf90 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1387601911 0 0) 0x7f9b70003570 con 0x7f9b840ccf90 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 msgr2=0x7f9b840ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 0x7f9b840ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 >> v1:172.21.15.135:6789/0 conn(0x7f9b840cbf30 legacy=0x7f9b840b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840ad650 con 0x7f9b840ccf90 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f9b7c0017f0 con 0x7f9b840ccf90 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 >> v1:172.21.15.86:6789/0 conn(0x7f9b840ccf90 legacy=0x7f9b840c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b70003a90 0x7f9b70003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 0x7f9b70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b70004d50 0x7f9b700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84156bf0 con 0x7f9b70003a90 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7000bb10 con 0x7f9b70004d50 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7000bcd0 con 0x7f9b840b1420 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8999b700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b70003a90 0x7f9b70003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8a19c700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b70004d50 0x7f9b700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8919a700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 0x7f9b70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8999b700 1 -- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 msgr2=0x7f9b70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8999b700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840b1420 0x7f9b70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8999b700 1 -- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b70004d50 msgr2=0x7f9b700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8999b700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b70004d50 0x7f9b700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8999b700 1 -- 172.21.15.86:0/3562507786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70003570 con 0x7f9b70003a90 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.639+0000 7f9b8a19c700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b70004d50 0x7f9b700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8999b700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b70003a90 0x7f9b70003e60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9b800019d0 tx=0x7f9b80007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427958a24f6fcf9c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000c5d0 con 0x7f9b70003a90 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000c750 con 0x7f9b70003a90 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b88999700 1 -- 172.21.15.86:0/3562507786 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000cb10 con 0x7f9b70003a90 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8bbff700 1 -- 172.21.15.86:0/3562507786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b70003a90 msgr2=0x7f9b70003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8bbff700 1 --2- 172.21.15.86:0/3562507786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b70003a90 0x7f9b70003e60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9b800019d0 tx=0x7f9b80007d30 comp rx=0 tx=0).stop 2023-10-09T11:56:55.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8a19c700 1 -- 172.21.15.86:0/3562507786 reap_dead start 2023-10-09T11:56:55.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8bbff700 1 -- 172.21.15.86:0/3562507786 shutdown_connections 2023-10-09T11:56:55.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8bbff700 1 -- 172.21.15.86:0/3562507786 >> 172.21.15.86:0/3562507786 conn(0x7f9b8406a320 msgr2=0x7f9b840cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:55.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8bbff700 1 -- 172.21.15.86:0/3562507786 shutdown_connections 2023-10-09T11:56:55.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.640+0000 7f9b8bbff700 1 -- 172.21.15.86:0/3562507786 wait complete. 2023-10-09T11:56:55.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.642+0000 7f9b8bbff700 1 Processor -- start 2023-10-09T11:56:55.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.642+0000 7f9b8bbff700 1 -- start start 2023-10-09T11:56:55.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8bbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b70003a90 0x7f9b840a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8bbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155480 0x7f9b840a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8bbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b841558f0 0x7f9b840a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8bbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840c7140 con 0x7f9b84155480 2023-10-09T11:56:55.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8bbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840c6830 con 0x7f9b841558f0 2023-10-09T11:56:55.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8bbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840c6af0 con 0x7f9b70003a90 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155480 0x7f9b840a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155480 0x7f9b840a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49818/0 (socket says 172.21.15.86:49818) 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 -- 172.21.15.86:0/1995468757 learned_addr learned my addr 172.21.15.86:0/1995468757 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8999b700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b70003a90 0x7f9b840a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8a19c700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b841558f0 0x7f9b840a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 -- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b70003a90 msgr2=0x7f9b840a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b70003a90 0x7f9b840a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 -- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b841558f0 msgr2=0x7f9b840a7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b841558f0 0x7f9b840a7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.643+0000 7f9b8919a700 1 -- 172.21.15.86:0/1995468757 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840c6dd0 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.644+0000 7f9b8919a700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155480 0x7f9b840a5ed0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9b74011990 tx=0x7f9b74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.644+0000 7f9b79ffb700 1 -- 172.21.15.86:0/1995468757 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400f6d0 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.644+0000 7f9b79ffb700 1 -- 172.21.15.86:0/1995468757 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400f830 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.644+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b840a99f0 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.644+0000 7f9b79ffb700 1 -- 172.21.15.86:0/1995468757 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400fbf0 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.644+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840a6410 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.645+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8415aab0 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.646+0000 7f9b79ffb700 1 -- 172.21.15.86:0/1995468757 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b74015460 con 0x7f9b84155480 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.647+0000 7f9b79ffb700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9b68066f20 0x7f9b680693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:55.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.647+0000 7f9b79ffb700 1 -- 172.21.15.86:0/1995468757 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f9b74084c90 con 0x7f9b84155480 2023-10-09T11:56:55.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.647+0000 7f9b8999b700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9b68066f20 0x7f9b680693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:55.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.647+0000 7f9b8999b700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9b68066f20 0x7f9b680693d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b80008fd0 tx=0x7f9b80015000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:55.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.651+0000 7f9b79ffb700 1 -- 172.21.15.86:0/1995468757 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b74051e70 con 0x7f9b84155480 2023-10-09T11:56:55.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.887+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b8404c3c0 con 0x7f9b84155480 2023-10-09T11:56:55.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.888+0000 7f9b79ffb700 1 -- 172.21.15.86:0/1995468757 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f9b74055490 con 0x7f9b84155480 2023-10-09T11:56:55.889 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:55.890 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/632458309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":632458309},{"type":"v1","addr":"172.21.15.135:6834","nonce":632458309}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5926,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2024459788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":2024459788},{"type":"v1","addr":"172.21.15.135:6835","nonce":2024459788}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/1216529409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":1216529409},{"type":"v1","addr":"172.21.15.86:6833","nonce":1216529409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1408499839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1408499839},{"type":"v1","addr":"172.21.15.86:6835","nonce":1408499839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-10-09T11:56:55.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9b68066f20 msgr2=0x7f9b680693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9b68066f20 0x7f9b680693d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b80008fd0 tx=0x7f9b80015000 comp rx=0 tx=0).stop 2023-10-09T11:56:55.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155480 msgr2=0x7f9b840a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155480 0x7f9b840a5ed0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9b74011990 tx=0x7f9b74008040 comp rx=0 tx=0).stop 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 shutdown_connections 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b841558f0 0x7f9b840a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b70003a90 0x7f9b840a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9b68066f20 0x7f9b680693d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 --2- 172.21.15.86:0/1995468757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155480 0x7f9b840a5ed0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.890+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 >> 172.21.15.86:0/1995468757 conn(0x7f9b8406a320 msgr2=0x7f9b840c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.891+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 shutdown_connections 2023-10-09T11:56:55.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:55.891+0000 7f9b8bbff700 1 -- 172.21.15.86:0/1995468757 wait complete. 2023-10-09T11:56:55.894 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 34 2023-10-09T11:56:55.909 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:56:55.910 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:56:55.910 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:56:55.910 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:55.910 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:56:55.910 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:56:55.911 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:56:55.911 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:55.911 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:56:55.911 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:56:55.911 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:56:55.911 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:55.912 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:56:55.912 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:56:55.912 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:56:55.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:56:55.927 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:56:55.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:56:55.929 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:56:55.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:56:55.930 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:56:55.930 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:56:55.931 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:56:55.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:56:55.972 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:56:55.972 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:55.975 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:56:55.975 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:56:55.975 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:55.976 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:55.977 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:56:55.978 DEBUG:teuthology.parallel:result is None 2023-10-09T11:56:55.978 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:56:56.109 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T11:56:56.109 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:56:56.109 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:56:56.109 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:56:56.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-09T11:56:56.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.168+0000 7f93917ff700 1 Processor -- start 2023-10-09T11:56:56.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.169+0000 7f93917ff700 1 -- start start 2023-10-09T11:56:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f93917ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f938c0cbf30 0x7f938c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f93917ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0cc300 con 0x7f938c0b1420 2023-10-09T11:56:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f93917ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0ad370 con 0x7f938c0ccf90 2023-10-09T11:56:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f93917ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c156bf0 con 0x7f938c0cbf30 2023-10-09T11:56:56.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f938c0cbf30 0x7f938c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f938c0b1420 0x7f938c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56714/0 (socket says 172.21.15.86:56714) 2023-10-09T11:56:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f938c0cbf30 0x7f938c0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49860/0 (socket says 172.21.15.86:49860) 2023-10-09T11:56:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938b7fe700 1 -- 172.21.15.86:0/3953452001 learned_addr learned my addr 172.21.15.86:0/3953452001 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938affd700 1 -- 172.21.15.86:0/3953452001 >> v1:172.21.15.135:6789/0 conn(0x7f938c0ccf90 legacy=0x7f938c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938affd700 1 -- 172.21.15.86:0/3953452001 >> v1:172.21.15.86:6789/0 conn(0x7f938c0b1420 legacy=0x7f938c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938affd700 1 -- 172.21.15.86:0/3953452001 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0ad650 con 0x7f938c0cbf30 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.170+0000 7f938a7fc700 1 -- 172.21.15.86:0/3953452001 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458330805 0 0) 0x7f938c0cc300 con 0x7f938c0b1420 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.171+0000 7f938affd700 1 --2- 172.21.15.86:0/3953452001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0cbf30 0x7f938c0ae410 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f937c0098e0 tx=0x7f937c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3405d9bb081c59b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.171+0000 7f938a7fc700 1 -- 172.21.15.86:0/3953452001 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c009e80 con 0x7f938c0cbf30 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.171+0000 7f938a7fc700 1 -- 172.21.15.86:0/3953452001 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00b860 con 0x7f938c0cbf30 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.171+0000 7f938a7fc700 1 -- 172.21.15.86:0/3953452001 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00bbe0 con 0x7f938c0cbf30 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.171+0000 7f93917ff700 1 -- 172.21.15.86:0/3953452001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0cbf30 msgr2=0x7f938c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.171+0000 7f93917ff700 1 --2- 172.21.15.86:0/3953452001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0cbf30 0x7f938c0ae410 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f937c0098e0 tx=0x7f937c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.172+0000 7f93917ff700 1 -- 172.21.15.86:0/3953452001 shutdown_connections 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.172+0000 7f93917ff700 1 --2- 172.21.15.86:0/3953452001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0cbf30 0x7f938c0ae410 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.172+0000 7f93917ff700 1 -- 172.21.15.86:0/3953452001 >> 172.21.15.86:0/3953452001 conn(0x7f938c06a320 msgr2=0x7f938c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:56.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.172+0000 7f93917ff700 1 -- 172.21.15.86:0/3953452001 shutdown_connections 2023-10-09T11:56:56.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.172+0000 7f93917ff700 1 -- 172.21.15.86:0/3953452001 wait complete. 2023-10-09T11:56:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.173+0000 7f93917ff700 1 Processor -- start 2023-10-09T11:56:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.173+0000 7f93917ff700 1 -- start start 2023-10-09T11:56:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f93917ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0b1420 0x7f938c1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f93917ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c0cbf30 0x7f938c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:56.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f93917ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c0ccf90 0x7f938c0a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f93917ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c159610 con 0x7f938c0b1420 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f93917ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c158a00 con 0x7f938c0ccf90 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f93917ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c158ce0 con 0x7f938c0cbf30 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f938affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0b1420 0x7f938c1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f938affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0b1420 0x7f938c1580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49876/0 (socket says 172.21.15.86:49876) 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.174+0000 7f938affd700 1 -- 172.21.15.86:0/4098512639 learned_addr learned my addr 172.21.15.86:0/4098512639 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938b7fe700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c0ccf90 0x7f938c0a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938affd700 1 -- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c0cbf30 msgr2=0x7f938c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938affd700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c0cbf30 0x7f938c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938affd700 1 -- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c0ccf90 msgr2=0x7f938c0a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938affd700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c0ccf90 0x7f938c0a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938affd700 1 -- 172.21.15.86:0/4098512639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c009420 con 0x7f938c0b1420 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938b7fe700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c0ccf90 0x7f938c0a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f938affd700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0b1420 0x7f938c1580d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f937c00b3c0 tx=0x7f937c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f9382ffd700 1 -- 172.21.15.86:0/4098512639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c01f070 con 0x7f938c0b1420 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f9382ffd700 1 -- 172.21.15.86:0/4098512639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00b9d0 con 0x7f938c0b1420 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f9382ffd700 1 -- 172.21.15.86:0/4098512639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c025650 con 0x7f938c0b1420 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c158fc0 con 0x7f938c0b1420 2023-10-09T11:56:56.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.175+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c159aa0 con 0x7f938c0b1420 2023-10-09T11:56:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.177+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c1598f0 con 0x7f938c0b1420 2023-10-09T11:56:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.177+0000 7f9382ffd700 1 -- 172.21.15.86:0/4098512639 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f937c023070 con 0x7f938c0b1420 2023-10-09T11:56:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.178+0000 7f9382ffd700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f936c066f30 0x7f936c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.178+0000 7f9382ffd700 1 -- 172.21.15.86:0/4098512639 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f937c085c10 con 0x7f938c0b1420 2023-10-09T11:56:56.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.178+0000 7f9383fff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f936c066f30 0x7f936c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.179+0000 7f9383fff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f936c066f30 0x7f936c0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f938c159d80 tx=0x7f9374007b40 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:56.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.182+0000 7f9382ffd700 1 -- 172.21.15.86:0/4098512639 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f937c052dd0 con 0x7f938c0b1420 2023-10-09T11:56:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:56.394+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f938c04c3c0 con 0x7f938c0b1420 2023-10-09T11:56:57.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.273+0000 7f9382ffd700 1 -- 172.21.15.86:0/4098512639 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f937c015080 con 0x7f938c0b1420 2023-10-09T11:56:57.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f936c066f30 msgr2=0x7f936c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f936c066f30 0x7f936c0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f938c159d80 tx=0x7f9374007b40 comp rx=0 tx=0).stop 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0b1420 msgr2=0x7f938c1580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0b1420 0x7f938c1580d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f937c00b3c0 tx=0x7f937c017000 comp rx=0 tx=0).stop 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 shutdown_connections 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f936c066f30 0x7f936c0693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f938c0b1420 0x7f938c1580d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f938c0ccf90 0x7f938c0a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 --2- 172.21.15.86:0/4098512639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f938c0cbf30 0x7f938c0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 >> 172.21.15.86:0/4098512639 conn(0x7f938c06a320 msgr2=0x7f938c0cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 shutdown_connections 2023-10-09T11:56:57.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.277+0000 7f93917ff700 1 -- 172.21.15.86:0/4098512639 wait complete. 2023-10-09T11:56:57.280 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T11:56:57.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:56:57.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.483+0000 7f3c063ff700 1 Processor -- start 2023-10-09T11:56:57.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.483+0000 7f3c063ff700 1 -- start start 2023-10-09T11:56:57.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3c063ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000cbf30 0x7f3c000ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3c063ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c000b1420 0x7f3c000c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3c063ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000cc300 con 0x7f3c000ccf90 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3c063ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c00156bf0 con 0x7f3c000b1420 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3c063ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000ae950 con 0x7f3c000cbf30 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3bfffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000cbf30 0x7f3c000ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3c0499c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c000b1420 0x7f3c000c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3bfffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000cbf30 0x7f3c000ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:33340/0 (socket says 172.21.15.86:33340) 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3bfffff700 1 -- 172.21.15.86:0/1599697952 learned_addr learned my addr 172.21.15.86:0/1599697952 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.485+0000 7f3bff7fe700 1 --1- 172.21.15.86:0/1599697952 >> v1:172.21.15.135:6789/0 conn(0x7f3c000ccf90 0x7f3c000b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:39780/0 (socket says 172.21.15.86:39780) 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfffff700 1 -- 172.21.15.86:0/1599697952 >> v2:172.21.15.135:3300/0 conn(0x7f3c000b1420 msgr2=0x7f3c000c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfffff700 1 --2- 172.21.15.86:0/1599697952 >> v2:172.21.15.135:3300/0 conn(0x7f3c000b1420 0x7f3c000c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfffff700 1 -- 172.21.15.86:0/1599697952 >> v1:172.21.15.135:6789/0 conn(0x7f3c000ccf90 legacy=0x7f3c000b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfffff700 1 -- 172.21.15.86:0/1599697952 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000ad370 con 0x7f3c000cbf30 2023-10-09T11:56:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3c0499c700 1 --2- 172.21.15.86:0/1599697952 >> v2:172.21.15.135:3300/0 conn(0x7f3c000b1420 0x7f3c000c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:56:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfffff700 1 --2- 172.21.15.86:0/1599697952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000cbf30 0x7f3c000ae410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000bc50 tx=0x7f3bf000b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=124836553cadc99f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfeffd700 1 -- 172.21.15.86:0/1599697952 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000dbf0 con 0x7f3c000cbf30 2023-10-09T11:56:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfeffd700 1 -- 172.21.15.86:0/1599697952 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf000dd50 con 0x7f3c000cbf30 2023-10-09T11:56:57.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.486+0000 7f3bfeffd700 1 -- 172.21.15.86:0/1599697952 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00196b0 con 0x7f3c000cbf30 2023-10-09T11:56:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 -- 172.21.15.86:0/1599697952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000cbf30 msgr2=0x7f3c000ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 --2- 172.21.15.86:0/1599697952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000cbf30 0x7f3c000ae410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000bc50 tx=0x7f3bf000b4f0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 -- 172.21.15.86:0/1599697952 shutdown_connections 2023-10-09T11:56:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 --2- 172.21.15.86:0/1599697952 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000cbf30 0x7f3c000ae410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 --2- 172.21.15.86:0/1599697952 >> v2:172.21.15.135:3300/0 conn(0x7f3c000b1420 0x7f3c000c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 -- 172.21.15.86:0/1599697952 >> 172.21.15.86:0/1599697952 conn(0x7f3c0006a320 msgr2=0x7f3c000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 -- 172.21.15.86:0/1599697952 shutdown_connections 2023-10-09T11:56:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.487+0000 7f3c063ff700 1 -- 172.21.15.86:0/1599697952 wait complete. 2023-10-09T11:56:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.488+0000 7f3c063ff700 1 Processor -- start 2023-10-09T11:56:57.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.489+0000 7f3c063ff700 1 -- start start 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.489+0000 7f3c063ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000b1420 0x7f3c000c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.489+0000 7f3c063ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c000cbf30 0x7f3c00144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c063ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c000ccf90 0x7f3c0016d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c063ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000c8120 con 0x7f3c000ccf90 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c063ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015a170 con 0x7f3c000cbf30 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c063ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00159840 con 0x7f3c000b1420 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c000ccf90 0x7f3c0016d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c000ccf90 0x7f3c0016d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49880/0 (socket says 172.21.15.86:49880) 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 -- 172.21.15.86:0/3988350200 learned_addr learned my addr 172.21.15.86:0/3988350200 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3bfffff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000b1420 0x7f3c000c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3bff7fe700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c000cbf30 0x7f3c00144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 -- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000b1420 msgr2=0x7f3c000c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000b1420 0x7f3c000c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 -- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c000cbf30 msgr2=0x7f3c00144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c000cbf30 0x7f3c00144b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3c0499c700 1 -- 172.21.15.86:0/3988350200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8009a20 con 0x7f3c000ccf90 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.490+0000 7f3bff7fe700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c000cbf30 0x7f3c00144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.491+0000 7f3c0499c700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c000ccf90 0x7f3c0016d3d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800ef90 tx=0x7f3bf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:57.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.491+0000 7f3be7fff700 1 -- 172.21.15.86:0/3988350200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800cc80 con 0x7f3c000ccf90 2023-10-09T11:56:57.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.491+0000 7f3be7fff700 1 -- 172.21.15.86:0/3988350200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800f040 con 0x7f3c000ccf90 2023-10-09T11:56:57.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.491+0000 7f3be7fff700 1 -- 172.21.15.86:0/3988350200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8014480 con 0x7f3c000ccf90 2023-10-09T11:56:57.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.491+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf000b790 con 0x7f3c000ccf90 2023-10-09T11:56:57.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.491+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c00159e00 con 0x7f3c000ccf90 2023-10-09T11:56:57.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.492+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0004c3c0 con 0x7f3c000ccf90 2023-10-09T11:56:57.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.493+0000 7f3be7fff700 1 -- 172.21.15.86:0/3988350200 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bf80148b0 con 0x7f3c000ccf90 2023-10-09T11:56:57.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.494+0000 7f3be7fff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3bec066f30 0x7f3bec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.494+0000 7f3be7fff700 1 -- 172.21.15.86:0/3988350200 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f3bf8085190 con 0x7f3c000ccf90 2023-10-09T11:56:57.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.494+0000 7f3bfffff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3bec066f30 0x7f3bec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.495+0000 7f3bfffff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3bec066f30 0x7f3bec0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000b760 tx=0x7f3bf001b000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:57.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.498+0000 7f3be7fff700 1 -- 172.21.15.86:0/3988350200 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bf8052540 con 0x7f3c000ccf90 2023-10-09T11:56:57.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.759+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3c000ad650 con 0x7f3c000ccf90 2023-10-09T11:56:57.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.760+0000 7f3be7fff700 1 -- 172.21.15.86:0/3988350200 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3bf8055b60 con 0x7f3c000ccf90 2023-10-09T11:56:57.761 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:57.761 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T11:56:57.764 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.766 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T11:56:57.768 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.769 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T11:56:57.771 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:56:57.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:56:57.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T11:56:57.775 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:56:57.776 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:56:57.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:57.777 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T11:56:57.777 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3bec066f30 msgr2=0x7f3bec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3bec066f30 0x7f3bec0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000b760 tx=0x7f3bf001b000 comp rx=0 tx=0).stop 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c000ccf90 msgr2=0x7f3c0016d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c000ccf90 0x7f3c0016d3d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800ef90 tx=0x7f3bf800b040 comp rx=0 tx=0).stop 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 shutdown_connections 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3bec066f30 0x7f3bec0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c000ccf90 0x7f3c0016d3d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c000b1420 0x7f3c000c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 --2- 172.21.15.86:0/3988350200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c000cbf30 0x7f3c00144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.762+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 >> 172.21.15.86:0/3988350200 conn(0x7f3c0006a320 msgr2=0x7f3c000c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:57.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.763+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 shutdown_connections 2023-10-09T11:56:57.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.763+0000 7f3c063ff700 1 -- 172.21.15.86:0/3988350200 wait complete. 2023-10-09T11:56:57.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:56:57.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.962+0000 7ff15adff700 1 Processor -- start 2023-10-09T11:56:57.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.962+0000 7ff15adff700 1 -- start start 2023-10-09T11:56:57.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.963+0000 7ff15adff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540cd010 0x7ff1540ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.963+0000 7ff15adff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1540ac770 0x7ff1540b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.963+0000 7ff15adff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1540ad930 con 0x7ff1540ccc40 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.963+0000 7ff15adff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1540acd20 con 0x7ff1540ac770 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.963+0000 7ff15adff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540ad000 con 0x7ff1540cd010 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1540ac770 0x7ff1540b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1540ac770 0x7ff1540b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49896/0 (socket says 172.21.15.86:49896) 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 -- 172.21.15.86:0/30433454 learned_addr learned my addr 172.21.15.86:0/30433454 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff153fff700 1 --2- 172.21.15.86:0/30433454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540cd010 0x7ff1540ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 -- 172.21.15.86:0/30433454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540cd010 msgr2=0x7ff1540ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:57.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 --2- 172.21.15.86:0/30433454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540cd010 0x7ff1540ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 -- 172.21.15.86:0/30433454 >> v1:172.21.15.135:6789/0 conn(0x7ff1540ccc40 legacy=0x7ff154155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 -- 172.21.15.86:0/30433454 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540ad2e0 con 0x7ff1540ac770 2023-10-09T11:56:57.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff15939c700 1 --2- 172.21.15.86:0/30433454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540ac770 0x7ff1540b0300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009f20 tx=0x7ff14c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41168ff7dc328d67 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:57.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.964+0000 7ff1537fe700 1 -- 172.21.15.86:0/30433454 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00e070 con 0x7ff1540ac770 2023-10-09T11:56:57.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff1537fe700 1 -- 172.21.15.86:0/30433454 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c00b9d0 con 0x7ff1540ac770 2023-10-09T11:56:57.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff1537fe700 1 -- 172.21.15.86:0/30433454 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0092e0 con 0x7ff1540ac770 2023-10-09T11:56:57.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 -- 172.21.15.86:0/30433454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540ac770 msgr2=0x7ff1540b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 --2- 172.21.15.86:0/30433454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540ac770 0x7ff1540b0300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009f20 tx=0x7ff14c009840 comp rx=0 tx=0).stop 2023-10-09T11:56:57.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 -- 172.21.15.86:0/30433454 shutdown_connections 2023-10-09T11:56:57.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 --2- 172.21.15.86:0/30433454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540ac770 0x7ff1540b0300 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 --2- 172.21.15.86:0/30433454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540cd010 0x7ff1540ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 -- 172.21.15.86:0/30433454 >> 172.21.15.86:0/30433454 conn(0x7ff15406a320 msgr2=0x7ff1540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:57.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 -- 172.21.15.86:0/30433454 shutdown_connections 2023-10-09T11:56:57.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.965+0000 7ff15adff700 1 -- 172.21.15.86:0/30433454 wait complete. 2023-10-09T11:56:57.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.967+0000 7ff15adff700 1 Processor -- start 2023-10-09T11:56:57.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.967+0000 7ff15adff700 1 -- start start 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1540ac770 0x7ff15415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15adff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540ccc40 0x7ff154142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15adff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540cd010 0x7ff1540cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15adff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c98c0 con 0x7ff1540cd010 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c9b50 con 0x7ff1540ac770 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15adff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540c9e30 con 0x7ff1540ccc40 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540cd010 0x7ff1540cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540cd010 0x7ff1540cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49906/0 (socket says 172.21.15.86:49906) 2023-10-09T11:56:57.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 -- 172.21.15.86:0/2275414405 learned_addr learned my addr 172.21.15.86:0/2275414405 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff153fff700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540ccc40 0x7ff154142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff158b9b700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1540ac770 0x7ff15415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 -- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540ccc40 msgr2=0x7ff154142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540ccc40 0x7ff154142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 -- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1540ac770 msgr2=0x7ff15415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1540ac770 0x7ff15415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.968+0000 7ff15939c700 1 -- 172.21.15.86:0/2275414405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c009ae0 con 0x7ff1540cd010 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.969+0000 7ff15939c700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540cd010 0x7ff1540cb970 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00b610 tx=0x7ff14c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.969+0000 7ff150ff9700 1 -- 172.21.15.86:0/2275414405 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c008ad0 con 0x7ff1540cd010 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.969+0000 7ff150ff9700 1 -- 172.21.15.86:0/2275414405 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c008c30 con 0x7ff1540cd010 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.969+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1540ca110 con 0x7ff1540cd010 2023-10-09T11:56:57.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.969+0000 7ff150ff9700 1 -- 172.21.15.86:0/2275414405 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c026460 con 0x7ff1540cd010 2023-10-09T11:56:57.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.969+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1540ca6d0 con 0x7ff1540cd010 2023-10-09T11:56:57.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.970+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15404c3c0 con 0x7ff1540cd010 2023-10-09T11:56:57.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.971+0000 7ff150ff9700 1 -- 172.21.15.86:0/2275414405 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff14c003040 con 0x7ff1540cd010 2023-10-09T11:56:57.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.972+0000 7ff150ff9700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff138066f30 0x7ff1380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:57.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.972+0000 7ff150ff9700 1 -- 172.21.15.86:0/2275414405 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5229+0+0 (secure 0 0 0) 0x7ff14c085cd0 con 0x7ff1540cd010 2023-10-09T11:56:57.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.972+0000 7ff158b9b700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff138066f30 0x7ff1380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:57.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.973+0000 7ff158b9b700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff138066f30 0x7ff1380693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff148003a80 tx=0x7ff148007ec0 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:57.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:57.976+0000 7ff150ff9700 1 -- 172.21.15.86:0/2275414405 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff14c053080 con 0x7ff1540cd010 2023-10-09T11:56:58.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.166+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1540ad5c0 con 0x7ff1540cd010 2023-10-09T11:56:58.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.167+0000 7ff150ff9700 1 -- 172.21.15.86:0/2275414405 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+12752 (secure 0 0 0) 0x7ff14c0566a0 con 0x7ff1540cd010 2023-10-09T11:56:58.169 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:58.169 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:56:57.271060+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:56:58.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff138066f30 msgr2=0x7ff1380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff138066f30 0x7ff1380693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff148003a80 tx=0x7ff148007ec0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540cd010 msgr2=0x7ff1540cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540cd010 0x7ff1540cb970 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00b610 tx=0x7ff14c018000 comp rx=0 tx=0).stop 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 shutdown_connections 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff138066f30 0x7ff1380693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1540cd010 0x7ff1540cb970 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1540ac770 0x7ff15415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 --2- 172.21.15.86:0/2275414405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1540ccc40 0x7ff154142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 >> 172.21.15.86:0/2275414405 conn(0x7ff15406a320 msgr2=0x7ff1540aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 shutdown_connections 2023-10-09T11:56:58.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.170+0000 7ff15adff700 1 -- 172.21.15.86:0/2275414405 wait complete. 2023-10-09T11:56:58.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:56:58.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:56:58.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.373+0000 7f9d41d9d700 1 Processor -- start 2023-10-09T11:56:58.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.374+0000 7f9d41d9d700 1 -- start start 2023-10-09T11:56:58.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d41d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d3c159a60 0x7f9d3c0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d41d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d41d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9d3c06a020 0x7f9d3c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d41d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c06dfc0 con 0x7f9d3c159a60 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d41d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c0c9cb0 con 0x7f9d3c06a020 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d41d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c0c9f30 con 0x7f9d3c0ccc00 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d40d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d3c159a60 0x7f9d3c0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d40d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d3c159a60 0x7f9d3c0c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49914/0 (socket says 172.21.15.86:49914) 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.375+0000 7f9d40d9b700 1 -- 172.21.15.86:0/3011982011 learned_addr learned my addr 172.21.15.86:0/3011982011 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d4159c700 1 --2- 172.21.15.86:0/3011982011 >> v2:172.21.15.135:3300/0 conn(0x7f9d3c06a020 0x7f9d3c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d3bfff700 1 --2- 172.21.15.86:0/3011982011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d40d9b700 1 -- 172.21.15.86:0/3011982011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 msgr2=0x7f9d3c069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d40d9b700 1 --2- 172.21.15.86:0/3011982011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d40d9b700 1 -- 172.21.15.86:0/3011982011 >> v2:172.21.15.135:3300/0 conn(0x7f9d3c06a020 msgr2=0x7f9d3c0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d40d9b700 1 --2- 172.21.15.86:0/3011982011 >> v2:172.21.15.135:3300/0 conn(0x7f9d3c06a020 0x7f9d3c0cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d40d9b700 1 -- 172.21.15.86:0/3011982011 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0ca470 con 0x7f9d3c159a60 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d4159c700 1 --2- 172.21.15.86:0/3011982011 >> v2:172.21.15.135:3300/0 conn(0x7f9d3c06a020 0x7f9d3c0cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d3bfff700 1 --2- 172.21.15.86:0/3011982011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d40d9b700 1 --2- 172.21.15.86:0/3011982011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c0c9770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0cf6a0 tx=0x7f9d30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368348086fcfe72c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:58.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d3b7fe700 1 -- 172.21.15.86:0/3011982011 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000b8f0 con 0x7f9d3c159a60 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d3b7fe700 1 -- 172.21.15.86:0/3011982011 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000ba50 con 0x7f9d3c159a60 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.376+0000 7f9d3b7fe700 1 -- 172.21.15.86:0/3011982011 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000bdf0 con 0x7f9d3c159a60 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3011982011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 msgr2=0x7f9d3c0c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3011982011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c0c9770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0cf6a0 tx=0x7f9d30009250 comp rx=0 tx=0).stop 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3011982011 shutdown_connections 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3011982011 >> v2:172.21.15.135:3300/0 conn(0x7f9d3c06a020 0x7f9d3c0cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3011982011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c0c9770 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3011982011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3011982011 >> 172.21.15.86:0/3011982011 conn(0x7f9d3c06baa0 msgr2=0x7f9d3c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:58.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3011982011 shutdown_connections 2023-10-09T11:56:58.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.377+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3011982011 wait complete. 2023-10-09T11:56:58.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.378+0000 7f9d41d9d700 1 Processor -- start 2023-10-09T11:56:58.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.378+0000 7f9d41d9d700 1 -- start start 2023-10-09T11:56:58.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.379+0000 7f9d41d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d3c06a020 0x7f9d3c149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.379+0000 7f9d41d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.379+0000 7f9d41d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c14bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.379+0000 7f9d41d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c14d380 con 0x7f9d3c159a60 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.379+0000 7f9d41d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c14cea0 con 0x7f9d3c06a020 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.379+0000 7f9d41d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c14a3b0 con 0x7f9d3c0ccc00 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c14bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c14bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49918/0 (socket says 172.21.15.86:49918) 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 -- 172.21.15.86:0/3019897226 learned_addr learned my addr 172.21.15.86:0/3019897226 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d40d9b700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d3c06a020 0x7f9d3c149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d3bfff700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 -- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 msgr2=0x7f9d3c149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 -- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d3c06a020 msgr2=0x7f9d3c149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d3c06a020 0x7f9d3c149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 -- 172.21.15.86:0/3019897226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d300094f0 con 0x7f9d3c159a60 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d3bfff700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d4159c700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c14bc60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400cfc0 tx=0x7f9d34007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d38ff9700 1 -- 172.21.15.86:0/3019897226 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34015440 con 0x7f9d3c159a60 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d38ff9700 1 -- 172.21.15.86:0/3019897226 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d340155a0 con 0x7f9d3c159a60 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c14c600 con 0x7f9d3c159a60 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.380+0000 7f9d38ff9700 1 -- 172.21.15.86:0/3019897226 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34015960 con 0x7f9d3c159a60 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.381+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c14cbc0 con 0x7f9d3c159a60 2023-10-09T11:56:58.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.382+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3c14d150 con 0x7f9d3c159a60 2023-10-09T11:56:58.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.382+0000 7f9d38ff9700 1 -- 172.21.15.86:0/3019897226 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d3400d440 con 0x7f9d3c159a60 2023-10-09T11:56:58.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.383+0000 7f9d38ff9700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d20066f30 0x7f9d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.383+0000 7f9d38ff9700 1 -- 172.21.15.86:0/3019897226 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f9d34084ff0 con 0x7f9d3c159a60 2023-10-09T11:56:58.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.384+0000 7f9d40d9b700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d20066f30 0x7f9d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.384+0000 7f9d40d9b700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d20066f30 0x7f9d200693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0cf6a0 tx=0x7f9d30017000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:58.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.387+0000 7f9d38ff9700 1 -- 172.21.15.86:0/3019897226 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d3c14d150 con 0x7f9d3c159a60 2023-10-09T11:56:58.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.581+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d3c14d150 con 0x7f9d3c159a60 2023-10-09T11:56:58.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.581+0000 7f9d38ff9700 1 -- 172.21.15.86:0/3019897226 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d3c14d150 con 0x7f9d3c159a60 2023-10-09T11:56:58.582 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:56:58.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d20066f30 msgr2=0x7f9d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d20066f30 0x7f9d200693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0cf6a0 tx=0x7f9d30017000 comp rx=0 tx=0).stop 2023-10-09T11:56:58.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 msgr2=0x7f9d3c14bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c14bc60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400cfc0 tx=0x7f9d34007870 comp rx=0 tx=0).stop 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 shutdown_connections 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9d20066f30 0x7f9d200693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d3c159a60 0x7f9d3c14bc60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d3c06a020 0x7f9d3c149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 --2- 172.21.15.86:0/3019897226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d3c0ccc00 0x7f9d3c149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.583+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 >> 172.21.15.86:0/3019897226 conn(0x7f9d3c06baa0 msgr2=0x7f9d3c0cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.584+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 shutdown_connections 2023-10-09T11:56:58.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.584+0000 7f9d41d9d700 1 -- 172.21.15.86:0/3019897226 wait complete. 2023-10-09T11:56:58.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:56:58.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.782+0000 7ff507fff700 1 Processor -- start 2023-10-09T11:56:58.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.782+0000 7ff507fff700 1 -- start start 2023-10-09T11:56:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.783+0000 7ff507fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50806e600 0x7ff5080ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.783+0000 7ff507fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5080a98e0 con 0x7ff50815cfb0 2023-10-09T11:56:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.783+0000 7ff507fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50806f6a0 con 0x7ff5080685e0 2023-10-09T11:56:58.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.783+0000 7ff507fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff508069200 con 0x7ff50806e600 2023-10-09T11:56:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.783+0000 7ff5077fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff50815cfb0 0x7ff50806bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56730/0 (socket says 172.21.15.86:56730) 2023-10-09T11:56:58.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.783+0000 7ff5077fe700 1 -- 172.21.15.86:0/4195815098 learned_addr learned my addr 172.21.15.86:0/4195815098 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:56:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff4fffff700 1 --2- 172.21.15.86:0/4195815098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50806e600 0x7ff5080ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff5067fc700 1 -- 172.21.15.86:0/4195815098 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239022504 0 0) 0x7ff5080a98e0 con 0x7ff50815cfb0 2023-10-09T11:56:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff5067fc700 1 -- 172.21.15.86:0/4195815098 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f4003570 con 0x7ff50815cfb0 2023-10-09T11:56:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff5067fc700 1 -- 172.21.15.86:0/4195815098 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465518070 0 0) 0x7ff50806f6a0 con 0x7ff5080685e0 2023-10-09T11:56:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff5067fc700 1 -- 172.21.15.86:0/4195815098 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5080a98e0 con 0x7ff5080685e0 2023-10-09T11:56:58.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff4fffff700 1 -- 172.21.15.86:0/4195815098 >> v1:172.21.15.135:6789/0 conn(0x7ff5080685e0 legacy=0x7ff50815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff4fffff700 1 -- 172.21.15.86:0/4195815098 >> v1:172.21.15.86:6789/0 conn(0x7ff50815cfb0 legacy=0x7ff50806bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff4fffff700 1 -- 172.21.15.86:0/4195815098 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50806ea90 con 0x7ff50806e600 2023-10-09T11:56:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.784+0000 7ff4fffff700 1 --2- 172.21.15.86:0/4195815098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50806e600 0x7ff5080ca730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009910 tx=0x7ff4f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cd358da1b8fee4b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.785+0000 7ff5067fc700 1 -- 172.21.15.86:0/4195815098 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0011630 con 0x7ff50806e600 2023-10-09T11:56:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.785+0000 7ff5067fc700 1 -- 172.21.15.86:0/4195815098 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0011790 con 0x7ff50806e600 2023-10-09T11:56:58.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.785+0000 7ff5067fc700 1 -- 172.21.15.86:0/4195815098 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0011b30 con 0x7ff50806e600 2023-10-09T11:56:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.785+0000 7ff507fff700 1 -- 172.21.15.86:0/4195815098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50806e600 msgr2=0x7ff5080ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.785+0000 7ff507fff700 1 --2- 172.21.15.86:0/4195815098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50806e600 0x7ff5080ca730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009910 tx=0x7ff4f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.786+0000 7ff507fff700 1 -- 172.21.15.86:0/4195815098 shutdown_connections 2023-10-09T11:56:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.786+0000 7ff507fff700 1 --2- 172.21.15.86:0/4195815098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50806e600 0x7ff5080ca730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.786+0000 7ff507fff700 1 -- 172.21.15.86:0/4195815098 >> 172.21.15.86:0/4195815098 conn(0x7ff5080cdcd0 msgr2=0x7ff5080c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.786+0000 7ff507fff700 1 -- 172.21.15.86:0/4195815098 shutdown_connections 2023-10-09T11:56:58.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.786+0000 7ff507fff700 1 -- 172.21.15.86:0/4195815098 wait complete. 2023-10-09T11:56:58.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.787+0000 7ff507fff700 1 Processor -- start 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.787+0000 7ff507fff700 1 -- start start 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff507fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5080685e0 0x7ff50816de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff507fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff50806e600 0x7ff5080aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff507fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50815cfb0 0x7ff5081484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff507fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50816ae10 con 0x7ff5080685e0 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff507fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50816e380 con 0x7ff50806e600 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff507fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50816a290 con 0x7ff50815cfb0 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff506ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5080685e0 0x7ff50816de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff506ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5080685e0 0x7ff50816de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49920/0 (socket says 172.21.15.86:49920) 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.788+0000 7ff506ffd700 1 -- 172.21.15.86:0/2763139840 learned_addr learned my addr 172.21.15.86:0/2763139840 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:58.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff4fffff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff50806e600 0x7ff5080aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff5077fe700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50815cfb0 0x7ff5081484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff506ffd700 1 -- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50815cfb0 msgr2=0x7ff5081484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff506ffd700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50815cfb0 0x7ff5081484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff506ffd700 1 -- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff50806e600 msgr2=0x7ff5080aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff506ffd700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff50806e600 0x7ff5080aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff506ffd700 1 -- 172.21.15.86:0/2763139840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009420 con 0x7ff5080685e0 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff506ffd700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5080685e0 0x7ff50816de40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c790 tx=0x7ff4f8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff4feffd700 1 -- 172.21.15.86:0/2763139840 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8010510 con 0x7ff5080685e0 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff4feffd700 1 -- 172.21.15.86:0/2763139840 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8010670 con 0x7ff5080685e0 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff4feffd700 1 -- 172.21.15.86:0/2763139840 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8010a10 con 0x7ff5080685e0 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.789+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50816a570 con 0x7ff5080685e0 2023-10-09T11:56:58.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.790+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50816ab30 con 0x7ff5080685e0 2023-10-09T11:56:58.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.790+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50804c3c0 con 0x7ff5080685e0 2023-10-09T11:56:58.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.792+0000 7ff4feffd700 1 -- 172.21.15.86:0/2763139840 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4f801b3b0 con 0x7ff5080685e0 2023-10-09T11:56:58.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.792+0000 7ff4feffd700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4e8066f30 0x7ff4e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:58.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.792+0000 7ff4feffd700 1 -- 172.21.15.86:0/2763139840 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5229+0+0 (secure 0 0 0) 0x7ff4f8083c90 con 0x7ff5080685e0 2023-10-09T11:56:58.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.793+0000 7ff4fffff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4e8066f30 0x7ff4e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:58.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.793+0000 7ff4fffff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4e8066f30 0x7ff4e80693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009860 tx=0x7ff4f0017000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:58.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.796+0000 7ff4feffd700 1 -- 172.21.15.86:0/2763139840 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4f8051040 con 0x7ff5080685e0 2023-10-09T11:56:58.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.991+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff50806f850 con 0x7ff5080685e0 2023-10-09T11:56:58.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.991+0000 7ff4feffd700 1 -- 172.21.15.86:0/2763139840 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff4f8017020 con 0x7ff5080685e0 2023-10-09T11:56:58.992 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:56:58.993 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:56:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:56:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T11:56:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T11:56:58.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:56:58.993 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:56:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4e8066f30 msgr2=0x7ff4e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4e8066f30 0x7ff4e80693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009860 tx=0x7ff4f0017000 comp rx=0 tx=0).stop 2023-10-09T11:56:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5080685e0 msgr2=0x7ff50816de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5080685e0 0x7ff50816de40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c790 tx=0x7ff4f8007e10 comp rx=0 tx=0).stop 2023-10-09T11:56:58.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 shutdown_connections 2023-10-09T11:56:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4e8066f30 0x7ff4e80693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5080685e0 0x7ff50816de40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff50815cfb0 0x7ff5081484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 --2- 172.21.15.86:0/2763139840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff50806e600 0x7ff5080aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.993+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 >> 172.21.15.86:0/2763139840 conn(0x7ff5080cdcd0 msgr2=0x7ff5080cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.994+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 shutdown_connections 2023-10-09T11:56:58.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:58.994+0000 7ff507fff700 1 -- 172.21.15.86:0/2763139840 wait complete. 2023-10-09T11:56:59.012 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:56:59.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:56:59.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.194+0000 7fd551fff700 1 Processor -- start 2023-10-09T11:56:59.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.195+0000 7fd551fff700 1 -- start start 2023-10-09T11:56:59.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd551fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd54c1563b0 0x7fd54c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:59.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd551fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd54c15a440 0x7fd54c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:59.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd551fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c068890 0x7fd54c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd551fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c15a9b0 con 0x7fd54c15a440 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd551fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c15ac90 con 0x7fd54c1563b0 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd551fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c15af70 con 0x7fd54c068890 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd54affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd54c15a440 0x7fd54c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd54affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd54c15a440 0x7fd54c0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49930/0 (socket says 172.21.15.86:49930) 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd54affd700 1 -- 172.21.15.86:0/2362040439 learned_addr learned my addr 172.21.15.86:0/2362040439 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd54b7fe700 1 --2- 172.21.15.86:0/2362040439 >> v2:172.21.15.135:3300/0 conn(0x7fd54c1563b0 0x7fd54c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.196+0000 7fd54bfff700 1 --2- 172.21.15.86:0/2362040439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c068890 0x7fd54c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54affd700 1 -- 172.21.15.86:0/2362040439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c068890 msgr2=0x7fd54c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54affd700 1 --2- 172.21.15.86:0/2362040439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c068890 0x7fd54c0c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54affd700 1 -- 172.21.15.86:0/2362040439 >> v2:172.21.15.135:3300/0 conn(0x7fd54c1563b0 msgr2=0x7fd54c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:56:59.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54affd700 1 --2- 172.21.15.86:0/2362040439 >> v2:172.21.15.135:3300/0 conn(0x7fd54c1563b0 0x7fd54c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54affd700 1 -- 172.21.15.86:0/2362040439 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c15b250 con 0x7fd54c15a440 2023-10-09T11:56:59.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54bfff700 1 --2- 172.21.15.86:0/2362040439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c068890 0x7fd54c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:56:59.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54affd700 1 --2- 172.21.15.86:0/2362040439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c15a440 0x7fd54c0acf30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd54c06a9f0 tx=0x7fd54000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898729eaeb87b78b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:59.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54a7fc700 1 -- 172.21.15.86:0/2362040439 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000dba0 con 0x7fd54c15a440 2023-10-09T11:56:59.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54a7fc700 1 -- 172.21.15.86:0/2362040439 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000dd00 con 0x7fd54c15a440 2023-10-09T11:56:59.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.197+0000 7fd54a7fc700 1 -- 172.21.15.86:0/2362040439 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400196d0 con 0x7fd54c15a440 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 -- 172.21.15.86:0/2362040439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c15a440 msgr2=0x7fd54c0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 --2- 172.21.15.86:0/2362040439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c15a440 0x7fd54c0acf30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd54c06a9f0 tx=0x7fd54000b4f0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 -- 172.21.15.86:0/2362040439 shutdown_connections 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 --2- 172.21.15.86:0/2362040439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c068890 0x7fd54c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 --2- 172.21.15.86:0/2362040439 >> v2:172.21.15.135:3300/0 conn(0x7fd54c1563b0 0x7fd54c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 --2- 172.21.15.86:0/2362040439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c15a440 0x7fd54c0acf30 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 -- 172.21.15.86:0/2362040439 >> 172.21.15.86:0/2362040439 conn(0x7fd54c0c8f90 msgr2=0x7fd54c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 -- 172.21.15.86:0/2362040439 shutdown_connections 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.198+0000 7fd551fff700 1 -- 172.21.15.86:0/2362040439 wait complete. 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.199+0000 7fd551fff700 1 Processor -- start 2023-10-09T11:56:59.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.199+0000 7fd551fff700 1 -- start start 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd551fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c068890 0x7fd54c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd551fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54c1563b0 0x7fd54c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd551fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c15a440 0x7fd54c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd551fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c14d130 con 0x7fd54c068890 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd551fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0cbb30 con 0x7fd54c1563b0 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd551fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0cbe10 con 0x7fd54c15a440 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd54b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c068890 0x7fd54c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd54b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c068890 0x7fd54c0ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49942/0 (socket says 172.21.15.86:49942) 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.200+0000 7fd54b7fe700 1 -- 172.21.15.86:0/1319012161 learned_addr learned my addr 172.21.15.86:0/1319012161 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54affd700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54c1563b0 0x7fd54c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54bfff700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c15a440 0x7fd54c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:59.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54b7fe700 1 -- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c15a440 msgr2=0x7fd54c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54b7fe700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c15a440 0x7fd54c157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54b7fe700 1 -- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54c1563b0 msgr2=0x7fd54c14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54b7fe700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54c1563b0 0x7fd54c14cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54b7fe700 1 -- 172.21.15.86:0/1319012161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54000b790 con 0x7fd54c068890 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd54b7fe700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c068890 0x7fd54c0ccbd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00ec80 tx=0x7fd53c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd5337fe700 1 -- 172.21.15.86:0/1319012161 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00c9d0 con 0x7fd54c068890 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd5337fe700 1 -- 172.21.15.86:0/1319012161 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00cb30 con 0x7fd54c068890 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c0cc0f0 con 0x7fd54c068890 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd5337fe700 1 -- 172.21.15.86:0/1319012161 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c013470 con 0x7fd54c068890 2023-10-09T11:56:59.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.201+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0cc6b0 con 0x7fd54c068890 2023-10-09T11:56:59.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.202+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c0cca20 con 0x7fd54c068890 2023-10-09T11:56:59.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.203+0000 7fd5337fe700 1 -- 172.21.15.86:0/1319012161 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd53c013820 con 0x7fd54c068890 2023-10-09T11:56:59.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.204+0000 7fd5337fe700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:56:59.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.204+0000 7fd5337fe700 1 -- 172.21.15.86:0/1319012161 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5229+0+0 (secure 0 0 0) 0x7fd53c084780 con 0x7fd54c068890 2023-10-09T11:56:59.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.204+0000 7fd54affd700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:56:59.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.205+0000 7fd54affd700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd54c06a9f0 tx=0x7fd54001b000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:56:59.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.208+0000 7fd5337fe700 1 -- 172.21.15.86:0/1319012161 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd53c051b30 con 0x7fd54c068890 2023-10-09T11:56:59.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.400+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd54c0718b0 con 0x7fd54c068890 2023-10-09T11:56:59.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.859+0000 7fd5337fe700 1 -- 172.21.15.86:0/1319012161 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd53c055150 con 0x7fd54c068890 2023-10-09T11:56:59.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 msgr2=0x7fd5380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:59.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd54c06a9f0 tx=0x7fd54001b000 comp rx=0 tx=0).stop 2023-10-09T11:56:59.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c068890 msgr2=0x7fd54c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:56:59.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c068890 0x7fd54c0ccbd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00ec80 tx=0x7fd53c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 shutdown_connections 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd538066f30 0x7fd5380693e0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd54c06a9f0 tx=0x7fd54001b000 comp rx=0 tx=0).stop 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd54c068890 0x7fd54c0ccbd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c15a440 0x7fd54c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 --2- 172.21.15.86:0/1319012161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd54c1563b0 0x7fd54c14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.864+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 >> 172.21.15.86:0/1319012161 conn(0x7fd54c0c8f90 msgr2=0x7fd54c0c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.865+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 shutdown_connections 2023-10-09T11:56:59.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:56:59.865+0000 7fd551fff700 1 -- 172.21.15.86:0/1319012161 wait complete. 2023-10-09T11:56:59.867 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T11:56:59.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:57:00.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.071+0000 7f6b81fff700 1 Processor -- start 2023-10-09T11:57:00.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.071+0000 7f6b81fff700 1 -- start start 2023-10-09T11:57:00.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.072+0000 7f6b81fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6b7c156620 0x7f6b7c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:00.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.072+0000 7f6b81fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b7c1569f0 0x7f6b7c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:00.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.072+0000 7f6b81fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c0ad3b0 con 0x7f6b7c068390 2023-10-09T11:57:00.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.072+0000 7f6b81fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c8d30 con 0x7f6b7c1569f0 2023-10-09T11:57:00.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.072+0000 7f6b81fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c15a6f0 con 0x7f6b7c156620 2023-10-09T11:57:00.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b7c1569f0 0x7f6b7c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:00.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b7c1569f0 0x7f6b7c0ace70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49954/0 (socket says 172.21.15.86:49954) 2023-10-09T11:57:00.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6b7c068390 0x7f6b7c06da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56732/0 (socket says 172.21.15.86:56732) 2023-10-09T11:57:00.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7affd700 1 -- 172.21.15.86:0/1373780998 learned_addr learned my addr 172.21.15.86:0/1373780998 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:00.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/1373780998 >> v2:172.21.15.135:3300/0 conn(0x7f6b7c156620 0x7f6b7c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:00.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7affd700 1 -- 172.21.15.86:0/1373780998 >> v2:172.21.15.135:3300/0 conn(0x7f6b7c156620 msgr2=0x7f6b7c0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:00.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7affd700 1 --2- 172.21.15.86:0/1373780998 >> v2:172.21.15.135:3300/0 conn(0x7f6b7c156620 0x7f6b7c0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7affd700 1 -- 172.21.15.86:0/1373780998 >> v1:172.21.15.86:6789/0 conn(0x7f6b7c068390 legacy=0x7f6b7c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:00.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7affd700 1 -- 172.21.15.86:0/1373780998 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c15a9d0 con 0x7f6b7c1569f0 2023-10-09T11:57:00.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.073+0000 7f6b7a7fc700 1 -- 172.21.15.86:0/1373780998 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394814474 0 0) 0x7f6b7c0ad3b0 con 0x7f6b7c068390 2023-10-09T11:57:00.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b7affd700 1 --2- 172.21.15.86:0/1373780998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c1569f0 0x7f6b7c0ace70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0c8f80 tx=0x7f6b70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b6ac5776feeeb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:00.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b7a7fc700 1 -- 172.21.15.86:0/1373780998 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000b860 con 0x7f6b7c1569f0 2023-10-09T11:57:00.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b7a7fc700 1 -- 172.21.15.86:0/1373780998 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000b9c0 con 0x7f6b7c1569f0 2023-10-09T11:57:00.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b7a7fc700 1 -- 172.21.15.86:0/1373780998 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000bd60 con 0x7f6b7c1569f0 2023-10-09T11:57:00.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 -- 172.21.15.86:0/1373780998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c1569f0 msgr2=0x7f6b7c0ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:00.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 --2- 172.21.15.86:0/1373780998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c1569f0 0x7f6b7c0ace70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0c8f80 tx=0x7f6b70009250 comp rx=0 tx=0).stop 2023-10-09T11:57:00.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 -- 172.21.15.86:0/1373780998 shutdown_connections 2023-10-09T11:57:00.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 --2- 172.21.15.86:0/1373780998 >> v2:172.21.15.135:3300/0 conn(0x7f6b7c156620 0x7f6b7c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 --2- 172.21.15.86:0/1373780998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c1569f0 0x7f6b7c0ace70 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 -- 172.21.15.86:0/1373780998 >> 172.21.15.86:0/1373780998 conn(0x7f6b7c0cc540 msgr2=0x7f6b7c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:00.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 -- 172.21.15.86:0/1373780998 shutdown_connections 2023-10-09T11:57:00.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.074+0000 7f6b81fff700 1 -- 172.21.15.86:0/1373780998 wait complete. 2023-10-09T11:57:00.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.076+0000 7f6b81fff700 1 Processor -- start 2023-10-09T11:57:00.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.076+0000 7f6b81fff700 1 -- start start 2023-10-09T11:57:00.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b81fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068390 0x7f6b7c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:00.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b81fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c156620 0x7f6b7c0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:00.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b81fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c1569f0 0x7f6b7c0c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:00.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b81fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c0330 con 0x7f6b7c156620 2023-10-09T11:57:00.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b81fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c22e0 con 0x7f6b7c068390 2023-10-09T11:57:00.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b81fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c2cb0 con 0x7f6b7c1569f0 2023-10-09T11:57:00.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c156620 0x7f6b7c0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c156620 0x7f6b7c0cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49958/0 (socket says 172.21.15.86:49958) 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 -- 172.21.15.86:0/2234950200 learned_addr learned my addr 172.21.15.86:0/2234950200 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068390 0x7f6b7c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7bfff700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c1569f0 0x7f6b7c0c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 -- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c1569f0 msgr2=0x7f6b7c0c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c1569f0 0x7f6b7c0c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 -- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068390 msgr2=0x7f6b7c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:00.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068390 0x7f6b7c0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.077+0000 7f6b7affd700 1 -- 172.21.15.86:0/2234950200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700094f0 con 0x7f6b7c156620 2023-10-09T11:57:00.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.078+0000 7f6b7affd700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c156620 0x7f6b7c0cbbd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6b70006f50 tx=0x7f6b70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:00.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.078+0000 7f6b637fe700 1 -- 172.21.15.86:0/2234950200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011e40 con 0x7f6b7c156620 2023-10-09T11:57:00.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.078+0000 7f6b637fe700 1 -- 172.21.15.86:0/2234950200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70024440 con 0x7f6b7c156620 2023-10-09T11:57:00.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.078+0000 7f6b637fe700 1 -- 172.21.15.86:0/2234950200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700247e0 con 0x7f6b7c156620 2023-10-09T11:57:00.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.078+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c0cb060 con 0x7f6b7c156620 2023-10-09T11:57:00.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.078+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c0c1f70 con 0x7f6b7c156620 2023-10-09T11:57:00.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.079+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c0c2470 con 0x7f6b7c156620 2023-10-09T11:57:00.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.080+0000 7f6b637fe700 1 -- 172.21.15.86:0/2234950200 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b7002d440 con 0x7f6b7c156620 2023-10-09T11:57:00.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.081+0000 7f6b637fe700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b68066f30 0x7f6b680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:00.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.081+0000 7f6b637fe700 1 -- 172.21.15.86:0/2234950200 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5599+0+0 (secure 0 0 0) 0x7f6b70085f50 con 0x7f6b7c156620 2023-10-09T11:57:00.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.081+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b68066f30 0x7f6b680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:00.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.082+0000 7f6b7b7fe700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b68066f30 0x7f6b680693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009fd0 tx=0x7f6b6c009880 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:00.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.086+0000 7f6b637fe700 1 -- 172.21.15.86:0/2234950200 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b70053190 con 0x7f6b7c156620 2023-10-09T11:57:00.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.276+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6b7c0718b0 con 0x7f6b7c156620 2023-10-09T11:57:00.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.862+0000 7f6b637fe700 1 -- 172.21.15.86:0/2234950200 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6b700567b0 con 0x7f6b7c156620 2023-10-09T11:57:00.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.872+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b68066f30 msgr2=0x7f6b680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:00.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.872+0000 7f6b81fff700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b68066f30 0x7f6b680693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009fd0 tx=0x7f6b6c009880 comp rx=0 tx=0).stop 2023-10-09T11:57:00.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.872+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c156620 msgr2=0x7f6b7c0cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:00.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.872+0000 7f6b81fff700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c156620 0x7f6b7c0cbbd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6b70006f50 tx=0x7f6b70017000 comp rx=0 tx=0).stop 2023-10-09T11:57:00.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.873+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 shutdown_connections 2023-10-09T11:57:00.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.873+0000 7f6b81fff700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b7c1569f0 0x7f6b7c0c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.873+0000 7f6b81fff700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b7c068390 0x7f6b7c0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.873+0000 7f6b81fff700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b68066f30 0x7f6b680693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.873+0000 7f6b81fff700 1 --2- 172.21.15.86:0/2234950200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b7c156620 0x7f6b7c0cbbd0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:00.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.873+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 >> 172.21.15.86:0/2234950200 conn(0x7f6b7c0cc540 msgr2=0x7f6b7c0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:00.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.874+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 shutdown_connections 2023-10-09T11:57:00.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:00.874+0000 7f6b81fff700 1 -- 172.21.15.86:0/2234950200 wait complete. 2023-10-09T11:57:00.882 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T11:57:00.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:57:01.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.083+0000 7f3cc0f9d700 1 Processor -- start 2023-10-09T11:57:01.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.083+0000 7f3cc0f9d700 1 -- start start 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.084+0000 7f3cc0f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3cbc06f060 0x7f3cbc0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.084+0000 7f3cc0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f4b0 0x7f3cbc0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.084+0000 7f3cc0f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc06ebd0 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.084+0000 7f3cc0f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc15b2e0 con 0x7f3cbc06f060 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.084+0000 7f3cc0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc15aa70 con 0x7f3cbc06f4b0 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.084+0000 7f3cbb7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3cbc0cb1a0 0x7f3cbc15a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56746/0 (socket says 172.21.15.86:56746) 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.084+0000 7f3cbb7fe700 1 -- 172.21.15.86:0/3794522457 learned_addr learned my addr 172.21.15.86:0/3794522457 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cbaffd700 1 --2- 172.21.15.86:0/3794522457 >> v2:172.21.15.135:3300/0 conn(0x7f3cbc06f060 0x7f3cbc0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cbbfff700 1 --2- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f4b0 0x7f3cbc0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:01.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cba7fc700 1 -- 172.21.15.86:0/3794522457 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592195794 0 0) 0x7f3cbc06ebd0 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cba7fc700 1 -- 172.21.15.86:0/3794522457 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca4003570 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cbaffd700 1 -- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f4b0 msgr2=0x7f3cbc0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:01.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cbaffd700 1 --2- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f4b0 0x7f3cbc0ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cbaffd700 1 -- 172.21.15.86:0/3794522457 >> v1:172.21.15.86:6789/0 conn(0x7f3cbc0cb1a0 legacy=0x7f3cbc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:01.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cbaffd700 1 -- 172.21.15.86:0/3794522457 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc15ad20 con 0x7f3cbc06f060 2023-10-09T11:57:01.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.085+0000 7f3cbbfff700 1 --2- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f4b0 0x7f3cbc0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:01.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cbaffd700 1 --2- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f060 0x7f3cbc0ae0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098e0 tx=0x7f3cb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ad92a8a438d43db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:01.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cba7fc700 1 -- 172.21.15.86:0/3794522457 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011630 con 0x7f3cbc06f060 2023-10-09T11:57:01.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cba7fc700 1 -- 172.21.15.86:0/3794522457 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb0011790 con 0x7f3cbc06f060 2023-10-09T11:57:01.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cba7fc700 1 -- 172.21.15.86:0/3794522457 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011b30 con 0x7f3cbc06f060 2023-10-09T11:57:01.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f060 msgr2=0x7f3cbc0ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f060 0x7f3cbc0ae0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098e0 tx=0x7f3cb00091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3794522457 shutdown_connections 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f4b0 0x7f3cbc0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.086+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3794522457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f060 0x7f3cbc0ae0d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.087+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3794522457 >> 172.21.15.86:0/3794522457 conn(0x7f3cbc0cc1e0 msgr2=0x7f3cbc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.087+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3794522457 shutdown_connections 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.087+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3794522457 wait complete. 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.088+0000 7f3cc0f9d700 1 Processor -- start 2023-10-09T11:57:01.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.088+0000 7f3cc0f9d700 1 -- start start 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cc0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f060 0x7f3cbc156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cc0f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f4b0 0x7f3cbc0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cc0f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc0cb1a0 0x7f3cbc153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cc0f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c4b00 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cc0f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c4820 con 0x7f3cbc06f4b0 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cc0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc1531a0 con 0x7f3cbc06f060 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cbbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc0cb1a0 0x7f3cbc153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cbbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc0cb1a0 0x7f3cbc153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49966/0 (socket says 172.21.15.86:49966) 2023-10-09T11:57:01.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.089+0000 7f3cbbfff700 1 -- 172.21.15.86:0/3024809879 learned_addr learned my addr 172.21.15.86:0/3024809879 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbb7fe700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f060 0x7f3cbc156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbaffd700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f4b0 0x7f3cbc0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbbfff700 1 -- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f060 msgr2=0x7f3cbc156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbbfff700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f060 0x7f3cbc156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbbfff700 1 -- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f4b0 msgr2=0x7f3cbc0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbbfff700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f4b0 0x7f3cbc0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbbfff700 1 -- 172.21.15.86:0/3024809879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4009a20 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbaffd700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f4b0 0x7f3cbc0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cbbfff700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc0cb1a0 0x7f3cbc153630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009fc0 tx=0x7f3cb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:01.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3ca37fe700 1 -- 172.21.15.86:0/3024809879 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400cd30 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3ca37fe700 1 -- 172.21.15.86:0/3024809879 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb400f040 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb0009420 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.090+0000 7f3ca37fe700 1 -- 172.21.15.86:0/3024809879 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40146d0 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.091+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc0c6480 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.091+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc152f50 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.093+0000 7f3ca37fe700 1 -- 172.21.15.86:0/3024809879 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cb4003020 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.094+0000 7f3ca37fe700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3ca8066f30 0x7f3ca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.094+0000 7f3ca37fe700 1 -- 172.21.15.86:0/3024809879 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f3cb4085bc0 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.094+0000 7f3cbb7fe700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3ca8066f30 0x7f3ca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:01.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.094+0000 7f3cbb7fe700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3ca8066f30 0x7f3ca80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0058d0 tx=0x7f3cac009040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:01.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.097+0000 7f3ca37fe700 1 -- 172.21.15.86:0/3024809879 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cb4052da0 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.331+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3cbc1532e0 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.888+0000 7f3ca37fe700 1 -- 172.21.15.86:0/3024809879 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3cbc1532e0 con 0x7f3cbc0cb1a0 2023-10-09T11:57:01.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.894+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3ca8066f30 msgr2=0x7f3ca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.894+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3ca8066f30 0x7f3ca80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0058d0 tx=0x7f3cac009040 comp rx=0 tx=0).stop 2023-10-09T11:57:01.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.894+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc0cb1a0 msgr2=0x7f3cbc153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:01.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.894+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc0cb1a0 0x7f3cbc153630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009fc0 tx=0x7f3cb400b040 comp rx=0 tx=0).stop 2023-10-09T11:57:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.896+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 shutdown_connections 2023-10-09T11:57:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.896+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3ca8066f30 0x7f3ca80693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.896+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cbc0cb1a0 0x7f3cbc153630 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.896+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cbc06f060 0x7f3cbc156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.896+0000 7f3cc0f9d700 1 --2- 172.21.15.86:0/3024809879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc06f4b0 0x7f3cbc0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:01.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.896+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 >> 172.21.15.86:0/3024809879 conn(0x7f3cbc0cc1e0 msgr2=0x7f3cbc155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:01.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.897+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 shutdown_connections 2023-10-09T11:57:01.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:01.899+0000 7f3cc0f9d700 1 -- 172.21.15.86:0/3024809879 wait complete. 2023-10-09T11:57:01.906 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 10 and data pool 11 2023-10-09T11:57:01.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:02.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.104+0000 7fbfe15ff700 1 Processor -- start 2023-10-09T11:57:02.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.104+0000 7fbfe15ff700 1 -- start start 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.105+0000 7fbfe15ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbfdc159c60 0x7fbfdc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.105+0000 7fbfe15ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbfdc15db10 0x7fbfdc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.105+0000 7fbfe15ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc15a160 con 0x7fbfdc159890 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.105+0000 7fbfe15ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc15df50 con 0x7fbfdc15db10 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.105+0000 7fbfe15ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0d13a0 con 0x7fbfdc159c60 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdaffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbfdc159890 0x7fbfdc15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56760/0 (socket says 172.21.15.86:56760) 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdaffd700 1 -- 172.21.15.86:0/1017241293 learned_addr learned my addr 172.21.15.86:0/1017241293 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:02.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdb7fe700 1 --2- 172.21.15.86:0/1017241293 >> v2:172.21.15.86:3300/0 conn(0x7fbfdc15db10 0x7fbfdc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfda7fc700 1 --2- 172.21.15.86:0/1017241293 >> v2:172.21.15.135:3300/0 conn(0x7fbfdc159c60 0x7fbfdc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfd9ffb700 1 -- 172.21.15.86:0/1017241293 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771615536 0 0) 0x7fbfdc15a160 con 0x7fbfdc159890 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfd9ffb700 1 -- 172.21.15.86:0/1017241293 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc4003570 con 0x7fbfdc159890 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdb7fe700 1 -- 172.21.15.86:0/1017241293 >> v2:172.21.15.135:3300/0 conn(0x7fbfdc159c60 msgr2=0x7fbfdc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdb7fe700 1 --2- 172.21.15.86:0/1017241293 >> v2:172.21.15.135:3300/0 conn(0x7fbfdc159c60 0x7fbfdc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdb7fe700 1 -- 172.21.15.86:0/1017241293 >> v1:172.21.15.86:6789/0 conn(0x7fbfdc159890 legacy=0x7fbfdc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdb7fe700 1 -- 172.21.15.86:0/1017241293 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc15e140 con 0x7fbfdc15db10 2023-10-09T11:57:02.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.106+0000 7fbfdb7fe700 1 --2- 172.21.15.86:0/1017241293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc15db10 0x7fbfdc069560 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0b67f0 tx=0x7fbfd4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64114dfec7eb75f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfd9ffb700 1 -- 172.21.15.86:0/1017241293 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400e070 con 0x7fbfdc15db10 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfd9ffb700 1 -- 172.21.15.86:0/1017241293 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd400bb60 con 0x7fbfdc15db10 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfd9ffb700 1 -- 172.21.15.86:0/1017241293 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4012430 con 0x7fbfdc15db10 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 -- 172.21.15.86:0/1017241293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc15db10 msgr2=0x7fbfdc069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/1017241293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc15db10 0x7fbfdc069560 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0b67f0 tx=0x7fbfd4009780 comp rx=0 tx=0).stop 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 -- 172.21.15.86:0/1017241293 shutdown_connections 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/1017241293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc15db10 0x7fbfdc069560 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/1017241293 >> v2:172.21.15.135:3300/0 conn(0x7fbfdc159c60 0x7fbfdc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 -- 172.21.15.86:0/1017241293 >> 172.21.15.86:0/1017241293 conn(0x7fbfdc068e20 msgr2=0x7fbfdc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 -- 172.21.15.86:0/1017241293 shutdown_connections 2023-10-09T11:57:02.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.107+0000 7fbfe15ff700 1 -- 172.21.15.86:0/1017241293 wait complete. 2023-10-09T11:57:02.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.109+0000 7fbfe15ff700 1 Processor -- start 2023-10-09T11:57:02.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.109+0000 7fbfe15ff700 1 -- start start 2023-10-09T11:57:02.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfe15ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc159890 0x7fbfdc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfe15ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfdc159c60 0x7fbfdc0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfe15ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfdc15db10 0x7fbfdc16ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfe15ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc16dbf0 con 0x7fbfdc159890 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfe15ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0b3ad0 con 0x7fbfdc159c60 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfe15ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15beb0 con 0x7fbfdc15db10 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc159890 0x7fbfdc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc159890 0x7fbfdc0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49994/0 (socket says 172.21.15.86:49994) 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 -- 172.21.15.86:0/3608934823 learned_addr learned my addr 172.21.15.86:0/3608934823 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfda7fc700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfdc159c60 0x7fbfdc0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdb7fe700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfdc15db10 0x7fbfdc16ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 -- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfdc15db10 msgr2=0x7fbfdc16ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfdc15db10 0x7fbfdc16ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 -- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfdc159c60 msgr2=0x7fbfdc0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfdc159c60 0x7fbfdc0c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdaffd700 1 -- 172.21.15.86:0/3608934823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009a20 con 0x7fbfdc159890 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.110+0000 7fbfdb7fe700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfdc15db10 0x7fbfdc16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.111+0000 7fbfdaffd700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc159890 0x7fbfdc0b3590 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c7c0 tx=0x7fbfcc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.111+0000 7fbfc2ffd700 1 -- 172.21.15.86:0/3608934823 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc005b30 con 0x7fbfdc159890 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.111+0000 7fbfc2ffd700 1 -- 172.21.15.86:0/3608934823 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc005c90 con 0x7fbfdc159890 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.111+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc15c190 con 0x7fbfdc159890 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.111+0000 7fbfc2ffd700 1 -- 172.21.15.86:0/3608934823 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc007340 con 0x7fbfdc159890 2023-10-09T11:57:02.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.111+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc15c750 con 0x7fbfdc159890 2023-10-09T11:57:02.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.112+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc04c3c0 con 0x7fbfdc159890 2023-10-09T11:57:02.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.113+0000 7fbfc2ffd700 1 -- 172.21.15.86:0/3608934823 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfcc01b400 con 0x7fbfdc159890 2023-10-09T11:57:02.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.114+0000 7fbfc2ffd700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbfc8066f30 0x7fbfc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.114+0000 7fbfc2ffd700 1 -- 172.21.15.86:0/3608934823 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fbfcc084260 con 0x7fbfdc159890 2023-10-09T11:57:02.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.114+0000 7fbfda7fc700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbfc8066f30 0x7fbfc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.114+0000 7fbfda7fc700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbfc8066f30 0x7fbfc80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc16cc20 tx=0x7fbfd0008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.117+0000 7fbfc2ffd700 1 -- 172.21.15.86:0/3608934823 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfcc051330 con 0x7fbfdc159890 2023-10-09T11:57:02.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.311+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfdc06a5b0 con 0x7fbfdc159890 2023-10-09T11:57:02.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.312+0000 7fbfc2ffd700 1 -- 172.21.15.86:0/3608934823 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+15984 (secure 0 0 0) 0x7fbfcc054950 con 0x7fbfdc159890 2023-10-09T11:57:02.314 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:02.314 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":93,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:01.333826+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:59.439269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:00.315207+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.314+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbfc8066f30 msgr2=0x7fbfc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.314+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbfc8066f30 0x7fbfc80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc16cc20 tx=0x7fbfd0008040 comp rx=0 tx=0).stop 2023-10-09T11:57:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.314+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc159890 msgr2=0x7fbfdc0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.314+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc159890 0x7fbfdc0b3590 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c7c0 tx=0x7fbfcc007e00 comp rx=0 tx=0).stop 2023-10-09T11:57:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 shutdown_connections 2023-10-09T11:57:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbfc8066f30 0x7fbfc80693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfdc159890 0x7fbfdc0b3590 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbfdc15db10 0x7fbfdc16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 --2- 172.21.15.86:0/3608934823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfdc159c60 0x7fbfdc0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 >> 172.21.15.86:0/3608934823 conn(0x7fbfdc068e20 msgr2=0x7fbfdc0b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 shutdown_connections 2023-10-09T11:57:02.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.315+0000 7fbfe15ff700 1 -- 172.21.15.86:0/3608934823 wait complete. 2023-10-09T11:57:02.333 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:02.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.514+0000 7f79367ff700 1 Processor -- start 2023-10-09T11:57:02.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.514+0000 7f79367ff700 1 -- start start 2023-10-09T11:57:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.515+0000 7f79367ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79300b0a10 0x7f7930155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.515+0000 7f79367ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300ad930 con 0x7f7930155c10 2023-10-09T11:57:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.515+0000 7f79367ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300acd20 con 0x7f79301578b0 2023-10-09T11:57:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.515+0000 7f79367ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79300ad000 con 0x7f79300b0a10 2023-10-09T11:57:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7930155c10 0x7f79300ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56770/0 (socket says 172.21.15.86:56770) 2023-10-09T11:57:02.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792ffff700 1 -- 172.21.15.86:0/2484372082 learned_addr learned my addr 172.21.15.86:0/2484372082 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:02.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f7934d9c700 1 --2- 172.21.15.86:0/2484372082 >> v2:172.21.15.135:3300/0 conn(0x7f79300b0a10 0x7f7930155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721265368 0 0) 0x7f79300ad930 con 0x7f7930155c10 2023-10-09T11:57:02.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7918003570 con 0x7f7930155c10 2023-10-09T11:57:02.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 505217720 0 0) 0x7f7918003570 con 0x7f7930155c10 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 >> v2:172.21.15.135:3300/0 conn(0x7f79300b0a10 msgr2=0x7f7930155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 --2- 172.21.15.86:0/2484372082 >> v2:172.21.15.135:3300/0 conn(0x7f79300b0a10 0x7f7930155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 >> v1:172.21.15.135:6789/0 conn(0x7f79301578b0 legacy=0x7f79300af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79300ad2e0 con 0x7f7930155c10 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f7920001470 con 0x7f7930155c10 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 >> v1:172.21.15.86:6789/0 conn(0x7f7930155c10 legacy=0x7f79300ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7918003a60 0x7f7918003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.516+0000 7f792effd700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918004810 0x7f7918004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792effd700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79180051c0 0x7f791800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79300ad000 con 0x7f7918003a60 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791800e2e0 con 0x7f79180051c0 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791800e4a0 con 0x7f7918004810 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792ffff700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7918003a60 0x7f7918003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f7934d9c700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79180051c0 0x7f791800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792f7fe700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918004810 0x7f7918004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792ffff700 1 -- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918004810 msgr2=0x7f7918004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792ffff700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918004810 0x7f7918004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792ffff700 1 -- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79180051c0 msgr2=0x7f791800dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:02.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792ffff700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79180051c0 0x7f791800dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792ffff700 1 -- 172.21.15.86:0/2484372082 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918003570 con 0x7f7918003a60 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f7934d9c700 1 -- 172.21.15.86:0/2484372082 reap_dead start 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792ffff700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7918003a60 0x7f7918003e70 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f792000c3c0 tx=0x7f7920001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67ef41a379fee24 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000cc90 con 0x7f7918003a60 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.517+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000cdf0 con 0x7f7918003a60 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f792effd700 1 -- 172.21.15.86:0/2484372082 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920005b50 con 0x7f7918003a60 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f79367ff700 1 -- 172.21.15.86:0/2484372082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7918003a60 msgr2=0x7f7918003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f79367ff700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7918003a60 0x7f7918003e70 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f792000c3c0 tx=0x7f7920001e50 comp rx=0 tx=0).stop 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f79367ff700 1 -- 172.21.15.86:0/2484372082 shutdown_connections 2023-10-09T11:57:02.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f79367ff700 1 --2- 172.21.15.86:0/2484372082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7918003a60 0x7f7918003e70 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f79367ff700 1 -- 172.21.15.86:0/2484372082 >> 172.21.15.86:0/2484372082 conn(0x7f793006a320 msgr2=0x7f79300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:02.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f79367ff700 1 -- 172.21.15.86:0/2484372082 shutdown_connections 2023-10-09T11:57:02.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.518+0000 7f79367ff700 1 -- 172.21.15.86:0/2484372082 wait complete. 2023-10-09T11:57:02.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.520+0000 7f79367ff700 1 Processor -- start 2023-10-09T11:57:02.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.520+0000 7f79367ff700 1 -- start start 2023-10-09T11:57:02.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.520+0000 7f79367ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918003a60 0x7f793014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f79367ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79300c8f80 0x7f793015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f79367ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f793015a930 0x7f7930154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f79367ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793016a940 con 0x7f79300c8f80 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f79367ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793016b9c0 con 0x7f793015a930 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f79367ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793016ab10 con 0x7f7918003a60 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79300c8f80 0x7f793015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79300c8f80 0x7f793015a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50024/0 (socket says 172.21.15.86:50024) 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 -- 172.21.15.86:0/1318948124 learned_addr learned my addr 172.21.15.86:0/1318948124 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792ffff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918003a60 0x7f793014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f7934d9c700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f793015a930 0x7f7930154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 -- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918003a60 msgr2=0x7f793014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918003a60 0x7f793014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 -- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f793015a930 msgr2=0x7f7930154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f793015a930 0x7f7930154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 -- 172.21.15.86:0/1318948124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793016adb0 con 0x7f79300c8f80 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.521+0000 7f792f7fe700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79300c8f80 0x7f793015a3f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f792400e590 tx=0x7f7924009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.522+0000 7f7917fff700 1 -- 172.21.15.86:0/1318948124 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924012660 con 0x7f79300c8f80 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.522+0000 7f7917fff700 1 -- 172.21.15.86:0/1318948124 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79240127c0 con 0x7f79300c8f80 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.522+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793016b090 con 0x7f79300c8f80 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.522+0000 7f7917fff700 1 -- 172.21.15.86:0/1318948124 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924012b60 con 0x7f79300c8f80 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.522+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793016b650 con 0x7f79300c8f80 2023-10-09T11:57:02.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.523+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793016bb30 con 0x7f79300c8f80 2023-10-09T11:57:02.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.523+0000 7f7917fff700 1 -- 172.21.15.86:0/1318948124 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7924013420 con 0x7f79300c8f80 2023-10-09T11:57:02.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.524+0000 7f7917fff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f791c066f30 0x7f791c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.524+0000 7f7917fff700 1 -- 172.21.15.86:0/1318948124 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f7924084620 con 0x7f79300c8f80 2023-10-09T11:57:02.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.525+0000 7f792ffff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f791c066f30 0x7f791c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.525+0000 7f792ffff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f791c066f30 0x7f791c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7920007cd0 tx=0x7f7920015000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.529+0000 7f7917fff700 1 -- 172.21.15.86:0/1318948124 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7924051710 con 0x7f79300c8f80 2023-10-09T11:57:02.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.720+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f793004c3c0 con 0x7f79300c8f80 2023-10-09T11:57:02.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.721+0000 7f7917fff700 1 -- 172.21.15.86:0/1318948124 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+15984 (secure 0 0 0) 0x7f7924012ed0 con 0x7f79300c8f80 2023-10-09T11:57:02.723 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:02.723 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":93,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:01.333826+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:59.439269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:00.315207+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f791c066f30 msgr2=0x7f791c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f791c066f30 0x7f791c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7920007cd0 tx=0x7f7920015000 comp rx=0 tx=0).stop 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79300c8f80 msgr2=0x7f793015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79300c8f80 0x7f793015a3f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f792400e590 tx=0x7f7924009040 comp rx=0 tx=0).stop 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 shutdown_connections 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f793015a930 0x7f7930154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7918003a60 0x7f793014ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f791c066f30 0x7f791c0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 --2- 172.21.15.86:0/1318948124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79300c8f80 0x7f793015a3f0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.723+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 >> 172.21.15.86:0/1318948124 conn(0x7f793006a320 msgr2=0x7f79300afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:02.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.724+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 shutdown_connections 2023-10-09T11:57:02.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.724+0000 7f79367ff700 1 -- 172.21.15.86:0/1318948124 wait complete. 2023-10-09T11:57:02.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:57:02.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-09T11:57:02.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.929+0000 7fb49f1ff700 1 Processor -- start 2023-10-09T11:57:02.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.929+0000 7fb49f1ff700 1 -- start start 2023-10-09T11:57:02.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.930+0000 7fb49f1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb498155eb0 0x7fb49806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.930+0000 7fb49f1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb498069770 0x7fb498069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.930+0000 7fb49f1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb498156320 con 0x7fb4980c70b0 2023-10-09T11:57:02.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.930+0000 7fb49f1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980cd350 con 0x7fb498069770 2023-10-09T11:57:02.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.930+0000 7fb49f1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49806a130 con 0x7fb498155eb0 2023-10-09T11:57:02.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb498069770 0x7fb498069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb498069770 0x7fb498069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50036/0 (socket says 172.21.15.86:50036) 2023-10-09T11:57:02.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 -- 172.21.15.86:0/1436000020 learned_addr learned my addr 172.21.15.86:0/1436000020 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:02.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb497fff700 1 --2- 172.21.15.86:0/1436000020 >> v2:172.21.15.135:3300/0 conn(0x7fb498155eb0 0x7fb49806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 -- 172.21.15.86:0/1436000020 >> v2:172.21.15.135:3300/0 conn(0x7fb498155eb0 msgr2=0x7fb49806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:02.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 --2- 172.21.15.86:0/1436000020 >> v2:172.21.15.135:3300/0 conn(0x7fb498155eb0 0x7fb49806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 -- 172.21.15.86:0/1436000020 >> v1:172.21.15.135:6789/0 conn(0x7fb4980c70b0 legacy=0x7fb4980ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:02.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 -- 172.21.15.86:0/1436000020 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49806eb90 con 0x7fb498069770 2023-10-09T11:57:02.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.931+0000 7fb49d79c700 1 --2- 172.21.15.86:0/1436000020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb498069bf0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb498065130 tx=0x7fb490009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f4808d9875e67f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb4977fe700 1 -- 172.21.15.86:0/1436000020 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000e070 con 0x7fb498069770 2023-10-09T11:57:02.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb4977fe700 1 -- 172.21.15.86:0/1436000020 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000ba10 con 0x7fb498069770 2023-10-09T11:57:02.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb4977fe700 1 -- 172.21.15.86:0/1436000020 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900092e0 con 0x7fb498069770 2023-10-09T11:57:02.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 -- 172.21.15.86:0/1436000020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 msgr2=0x7fb498069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/1436000020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb498069bf0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb498065130 tx=0x7fb490009840 comp rx=0 tx=0).stop 2023-10-09T11:57:02.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 -- 172.21.15.86:0/1436000020 shutdown_connections 2023-10-09T11:57:02.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/1436000020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb498069bf0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/1436000020 >> v2:172.21.15.135:3300/0 conn(0x7fb498155eb0 0x7fb49806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 -- 172.21.15.86:0/1436000020 >> 172.21.15.86:0/1436000020 conn(0x7fb498068e10 msgr2=0x7fb4980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:02.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 -- 172.21.15.86:0/1436000020 shutdown_connections 2023-10-09T11:57:02.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.932+0000 7fb49f1ff700 1 -- 172.21.15.86:0/1436000020 wait complete. 2023-10-09T11:57:02.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.934+0000 7fb49f1ff700 1 Processor -- start 2023-10-09T11:57:02.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.934+0000 7fb49f1ff700 1 -- start start 2023-10-09T11:57:02.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49f1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb4980b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4980c70b0 0x7fb4980ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb498155eb0 0x7fb498153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49f1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980b1540 con 0x7fb498069770 2023-10-09T11:57:02.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981538a0 con 0x7fb4980c70b0 2023-10-09T11:57:02.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980b0930 con 0x7fb498155eb0 2023-10-09T11:57:02.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb4980b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb4980b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50042/0 (socket says 172.21.15.86:50042) 2023-10-09T11:57:02.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 -- 172.21.15.86:0/586184691 learned_addr learned my addr 172.21.15.86:0/586184691 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:02.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb497fff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4980c70b0 0x7fb4980ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49d79c700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb498155eb0 0x7fb498153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 -- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb498155eb0 msgr2=0x7fb498153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb498155eb0 0x7fb498153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 -- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4980c70b0 msgr2=0x7fb4980ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:02.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4980c70b0 0x7fb4980ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:02.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.935+0000 7fb49cf9b700 1 -- 172.21.15.86:0/586184691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009ae0 con 0x7fb498069770 2023-10-09T11:57:02.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.936+0000 7fb49cf9b700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb4980b02a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c5d0 tx=0x7fb48c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.936+0000 7fb494ff9700 1 -- 172.21.15.86:0/586184691 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c011590 con 0x7fb498069770 2023-10-09T11:57:02.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.936+0000 7fb494ff9700 1 -- 172.21.15.86:0/586184691 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c011710 con 0x7fb498069770 2023-10-09T11:57:02.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.936+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4980b0c10 con 0x7fb498069770 2023-10-09T11:57:02.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.936+0000 7fb494ff9700 1 -- 172.21.15.86:0/586184691 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c011ad0 con 0x7fb498069770 2023-10-09T11:57:02.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.936+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4980b11d0 con 0x7fb498069770 2023-10-09T11:57:02.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.937+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49804c3c0 con 0x7fb498069770 2023-10-09T11:57:02.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.938+0000 7fb494ff9700 1 -- 172.21.15.86:0/586184691 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb48c01c460 con 0x7fb498069770 2023-10-09T11:57:02.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.939+0000 7fb494ff9700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb47c066f30 0x7fb47c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:02.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.939+0000 7fb494ff9700 1 -- 172.21.15.86:0/586184691 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb48c0844b0 con 0x7fb498069770 2023-10-09T11:57:02.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.939+0000 7fb497fff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb47c066f30 0x7fb47c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:02.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.939+0000 7fb497fff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb47c066f30 0x7fb47c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb498069bf0 tx=0x7fb484008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:02.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:02.942+0000 7fb494ff9700 1 -- 172.21.15.86:0/586184691 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb48c051500 con 0x7fb498069770 2023-10-09T11:57:03.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.175+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb4980c7790 con 0x7fb498069770 2023-10-09T11:57:03.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.892+0000 7fb494ff9700 1 -- 172.21.15.86:0/586184691 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb48c054b20 con 0x7fb498069770 2023-10-09T11:57:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb47c066f30 msgr2=0x7fb47c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb47c066f30 0x7fb47c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb498069bf0 tx=0x7fb484008040 comp rx=0 tx=0).stop 2023-10-09T11:57:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 msgr2=0x7fb4980b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:03.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb4980b02a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c5d0 tx=0x7fb48c007f60 comp rx=0 tx=0).stop 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 shutdown_connections 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb47c066f30 0x7fb47c0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb498069770 0x7fb4980b02a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb498155eb0 0x7fb498153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 --2- 172.21.15.86:0/586184691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4980c70b0 0x7fb4980ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 >> 172.21.15.86:0/586184691 conn(0x7fb498068e10 msgr2=0x7fb4980cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 shutdown_connections 2023-10-09T11:57:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:03.895+0000 7fb49f1ff700 1 -- 172.21.15.86:0/586184691 wait complete. 2023-10-09T11:57:03.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:57:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.099+0000 7fa8eb59d700 1 Processor -- start 2023-10-09T11:57:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.099+0000 7fa8eb59d700 1 -- start start 2023-10-09T11:57:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.100+0000 7fa8eb59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8e40b4e70 0x7fa8e40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.100+0000 7fa8eb59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa8e40b16d0 0x7fa8e40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.100+0000 7fa8eb59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.100+0000 7fa8eb59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40b2080 con 0x7fa8e40b4e70 2023-10-09T11:57:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.100+0000 7fa8eb59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40cfb00 con 0x7fa8e40b16d0 2023-10-09T11:57:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.100+0000 7fa8eb59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b5c40 con 0x7fa8e415d240 2023-10-09T11:57:04.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8e40b4e70 0x7fa8e40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8e40b4e70 0x7fa8e40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50044/0 (socket says 172.21.15.86:50044) 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 -- 172.21.15.86:0/1754106792 learned_addr learned my addr 172.21.15.86:0/1754106792 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8e9d9a700 1 --2- 172.21.15.86:0/1754106792 >> v2:172.21.15.135:3300/0 conn(0x7fa8e40b16d0 0x7fa8e40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ead9c700 1 --2- 172.21.15.86:0/1754106792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 -- 172.21.15.86:0/1754106792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 msgr2=0x7fa8e415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 --2- 172.21.15.86:0/1754106792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 -- 172.21.15.86:0/1754106792 >> v2:172.21.15.135:3300/0 conn(0x7fa8e40b16d0 msgr2=0x7fa8e40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 --2- 172.21.15.86:0/1754106792 >> v2:172.21.15.135:3300/0 conn(0x7fa8e40b16d0 0x7fa8e40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 -- 172.21.15.86:0/1754106792 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40b5f20 con 0x7fa8e40b4e70 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.101+0000 7fa8ea59b700 1 --2- 172.21.15.86:0/1754106792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b4e70 0x7fa8e40ccff0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4089830 tx=0x7fa8e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277ee18a58177bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8e9599700 1 -- 172.21.15.86:0/1754106792 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000b860 con 0x7fa8e40b4e70 2023-10-09T11:57:04.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8e9599700 1 -- 172.21.15.86:0/1754106792 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e000b9c0 con 0x7fa8e40b4e70 2023-10-09T11:57:04.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8e9599700 1 -- 172.21.15.86:0/1754106792 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000bd60 con 0x7fa8e40b4e70 2023-10-09T11:57:04.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 -- 172.21.15.86:0/1754106792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b4e70 msgr2=0x7fa8e40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:04.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/1754106792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b4e70 0x7fa8e40ccff0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4089830 tx=0x7fa8e0009250 comp rx=0 tx=0).stop 2023-10-09T11:57:04.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 -- 172.21.15.86:0/1754106792 shutdown_connections 2023-10-09T11:57:04.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/1754106792 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/1754106792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b4e70 0x7fa8e40ccff0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/1754106792 >> v2:172.21.15.135:3300/0 conn(0x7fa8e40b16d0 0x7fa8e40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 -- 172.21.15.86:0/1754106792 >> 172.21.15.86:0/1754106792 conn(0x7fa8e40d10c0 msgr2=0x7fa8e40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 -- 172.21.15.86:0/1754106792 shutdown_connections 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.102+0000 7fa8eb59d700 1 -- 172.21.15.86:0/1754106792 wait complete. 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.104+0000 7fa8eb59d700 1 Processor -- start 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.104+0000 7fa8eb59d700 1 -- start start 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8eb59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b16d0 0x7fa8e40c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:04.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8eb59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e40b4e70 0x7fa8e41459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8eb59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8eb59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40c9c30 con 0x7fa8e40b16d0 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8eb59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40c9020 con 0x7fa8e40b4e70 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8eb59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40c9300 con 0x7fa8e415d240 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b16d0 0x7fa8e40c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b16d0 0x7fa8e40c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50056/0 (socket says 172.21.15.86:50056) 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 -- 172.21.15.86:0/4103383722 learned_addr learned my addr 172.21.15.86:0/4103383722 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8e9d9a700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e40b4e70 0x7fa8e41459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ead9c700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 -- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 msgr2=0x7fa8e415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 -- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e40b4e70 msgr2=0x7fa8e41459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e40b4e70 0x7fa8e41459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.105+0000 7fa8ea59b700 1 -- 172.21.15.86:0/4103383722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00094f0 con 0x7fa8e40b16d0 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.106+0000 7fa8ea59b700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b16d0 0x7fa8e40c85a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4070dd0 tx=0x7fa8e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.106+0000 7fa8da7fc700 1 -- 172.21.15.86:0/4103383722 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0024440 con 0x7fa8e40b16d0 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.106+0000 7fa8da7fc700 1 -- 172.21.15.86:0/4103383722 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e00245a0 con 0x7fa8e40b16d0 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.106+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e40c95e0 con 0x7fa8e40b16d0 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.106+0000 7fa8da7fc700 1 -- 172.21.15.86:0/4103383722 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0024960 con 0x7fa8e40b16d0 2023-10-09T11:57:04.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.106+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e40ca610 con 0x7fa8e40b16d0 2023-10-09T11:57:04.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.107+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e4088990 con 0x7fa8e40b16d0 2023-10-09T11:57:04.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.108+0000 7fa8da7fc700 1 -- 172.21.15.86:0/4103383722 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8e001a420 con 0x7fa8e40b16d0 2023-10-09T11:57:04.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.109+0000 7fa8da7fc700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa8c8066f30 0x7fa8c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:04.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.109+0000 7fa8da7fc700 1 -- 172.21.15.86:0/4103383722 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fa8e00865b0 con 0x7fa8e40b16d0 2023-10-09T11:57:04.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.109+0000 7fa8e9d9a700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa8c8066f30 0x7fa8c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:04.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.109+0000 7fa8e9d9a700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa8c8066f30 0x7fa8c80693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa8e416d6b0 tx=0x7fa8d4008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:04.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.113+0000 7fa8da7fc700 1 -- 172.21.15.86:0/4103383722 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8e0053680 con 0x7fa8e40b16d0 2023-10-09T11:57:04.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.346+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa8e404bb80 con 0x7fa8e40b16d0 2023-10-09T11:57:04.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.894+0000 7fa8da7fc700 1 -- 172.21.15.86:0/4103383722 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8e0056ca0 con 0x7fa8e40b16d0 2023-10-09T11:57:04.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa8c8066f30 msgr2=0x7fa8c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:04.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa8c8066f30 0x7fa8c80693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa8e416d6b0 tx=0x7fa8d4008040 comp rx=0 tx=0).stop 2023-10-09T11:57:04.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b16d0 msgr2=0x7fa8e40c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:04.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b16d0 0x7fa8e40c85a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4070dd0 tx=0x7fa8e0017000 comp rx=0 tx=0).stop 2023-10-09T11:57:04.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 shutdown_connections 2023-10-09T11:57:04.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa8c8066f30 0x7fa8c80693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e40b16d0 0x7fa8e40c85a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8e415d240 0x7fa8e415eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 --2- 172.21.15.86:0/4103383722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e40b4e70 0x7fa8e41459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:04.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 >> 172.21.15.86:0/4103383722 conn(0x7fa8e40d10c0 msgr2=0x7fa8e40b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:04.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 shutdown_connections 2023-10-09T11:57:04.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:04.897+0000 7fa8eb59d700 1 -- 172.21.15.86:0/4103383722 wait complete. 2023-10-09T11:57:04.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:05.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.095+0000 7fbc3759e700 1 Processor -- start 2023-10-09T11:57:05.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.096+0000 7fbc3759e700 1 -- start start 2023-10-09T11:57:05.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc38156310 0x7fbc380c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc381566e0 0x7fbc380ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380ca860 con 0x7fbc380ca300 2023-10-09T11:57:05.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380cab40 con 0x7fbc38156310 2023-10-09T11:57:05.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380cae20 con 0x7fbc381566e0 2023-10-09T11:57:05.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc38156310 0x7fbc380c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc38156310 0x7fbc380c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43836/0 (socket says 172.21.15.86:43836) 2023-10-09T11:57:05.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.097+0000 7fbc3659c700 1 -- 172.21.15.86:0/845168915 learned_addr learned my addr 172.21.15.86:0/845168915 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:05.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc35d9b700 1 --2- 172.21.15.86:0/845168915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc381566e0 0x7fbc380ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3659c700 1 -- 172.21.15.86:0/845168915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc381566e0 msgr2=0x7fbc380ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3659c700 1 --2- 172.21.15.86:0/845168915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc381566e0 0x7fbc380ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3659c700 1 -- 172.21.15.86:0/845168915 >> v1:172.21.15.135:6789/0 conn(0x7fbc380ca300 legacy=0x7fbc380c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3659c700 1 -- 172.21.15.86:0/845168915 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380cb100 con 0x7fbc38156310 2023-10-09T11:57:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3659c700 1 --2- 172.21.15.86:0/845168915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc38156310 0x7fbc380c9dc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800bc50 tx=0x7fbc2800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c444fff98af2046f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3559a700 1 -- 172.21.15.86:0/845168915 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800be60 con 0x7fbc38156310 2023-10-09T11:57:05.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3559a700 1 -- 172.21.15.86:0/845168915 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2800de00 con 0x7fbc38156310 2023-10-09T11:57:05.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.098+0000 7fbc3559a700 1 -- 172.21.15.86:0/845168915 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280196b0 con 0x7fbc38156310 2023-10-09T11:57:05.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 -- 172.21.15.86:0/845168915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc38156310 msgr2=0x7fbc380c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 --2- 172.21.15.86:0/845168915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc38156310 0x7fbc380c9dc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800bc50 tx=0x7fbc2800b4f0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 -- 172.21.15.86:0/845168915 shutdown_connections 2023-10-09T11:57:05.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 --2- 172.21.15.86:0/845168915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc38156310 0x7fbc380c9dc0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 --2- 172.21.15.86:0/845168915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc381566e0 0x7fbc380ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 -- 172.21.15.86:0/845168915 >> 172.21.15.86:0/845168915 conn(0x7fbc380cc1f0 msgr2=0x7fbc380cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:05.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 -- 172.21.15.86:0/845168915 shutdown_connections 2023-10-09T11:57:05.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.099+0000 7fbc3759e700 1 -- 172.21.15.86:0/845168915 wait complete. 2023-10-09T11:57:05.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.100+0000 7fbc3759e700 1 Processor -- start 2023-10-09T11:57:05.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.101+0000 7fbc3759e700 1 -- start start 2023-10-09T11:57:05.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.101+0000 7fbc3759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc380ca300 0x7fbc38158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.101+0000 7fbc3759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc38156310 0x7fbc3814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.101+0000 7fbc3759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc381566e0 0x7fbc38152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.101+0000 7fbc3759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38154470 con 0x7fbc380ca300 2023-10-09T11:57:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.101+0000 7fbc3759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38157c80 con 0x7fbc381566e0 2023-10-09T11:57:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.101+0000 7fbc3759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381576c0 con 0x7fbc38156310 2023-10-09T11:57:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc380ca300 0x7fbc38158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc380ca300 0x7fbc38158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43846/0 (socket says 172.21.15.86:43846) 2023-10-09T11:57:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 -- 172.21.15.86:0/1658163361 learned_addr learned my addr 172.21.15.86:0/1658163361 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc35d9b700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc38156310 0x7fbc3814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc36d9d700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc381566e0 0x7fbc38152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 -- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc38156310 msgr2=0x7fbc3814cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc38156310 0x7fbc3814cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 -- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc381566e0 msgr2=0x7fbc38152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc381566e0 0x7fbc38152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 -- 172.21.15.86:0/1658163361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2800b790 con 0x7fbc380ca300 2023-10-09T11:57:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc36d9d700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc381566e0 0x7fbc38152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:05.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.102+0000 7fbc3659c700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc380ca300 0x7fbc38158d50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbc3806fe40 tx=0x7fbc2801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.103+0000 7fbc267fc700 1 -- 172.21.15.86:0/1658163361 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28010640 con 0x7fbc380ca300 2023-10-09T11:57:05.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.103+0000 7fbc267fc700 1 -- 172.21.15.86:0/1658163361 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280107a0 con 0x7fbc380ca300 2023-10-09T11:57:05.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.103+0000 7fbc267fc700 1 -- 172.21.15.86:0/1658163361 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28010b40 con 0x7fbc380ca300 2023-10-09T11:57:05.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.103+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc381579a0 con 0x7fbc380ca300 2023-10-09T11:57:05.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.103+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3814d470 con 0x7fbc380ca300 2023-10-09T11:57:05.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.104+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc38153f60 con 0x7fbc380ca300 2023-10-09T11:57:05.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.105+0000 7fbc267fc700 1 -- 172.21.15.86:0/1658163361 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc28022030 con 0x7fbc380ca300 2023-10-09T11:57:05.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.105+0000 7fbc267fc700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc18066f30 0x7fbc180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.106+0000 7fbc267fc700 1 -- 172.21.15.86:0/1658163361 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fbc28014070 con 0x7fbc380ca300 2023-10-09T11:57:05.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.106+0000 7fbc35d9b700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc18066f30 0x7fbc180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.106+0000 7fbc35d9b700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc18066f30 0x7fbc180693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc38155c70 tx=0x7fbc2c008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.110+0000 7fbc267fc700 1 -- 172.21.15.86:0/1658163361 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc38153f60 con 0x7fbc380ca300 2023-10-09T11:57:05.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.339+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc38153f60 con 0x7fbc380ca300 2023-10-09T11:57:05.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.339+0000 7fbc267fc700 1 -- 172.21.15.86:0/1658163361 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fbc38153f60 con 0x7fbc380ca300 2023-10-09T11:57:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:05.341 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/153919105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":153919105},{"type":"v1","addr":"172.21.15.135:6834","nonce":153919105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4109315239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4109315239},{"type":"v1","addr":"172.21.15.135:6835","nonce":4109315239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6702,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/567273052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":567273052},{"type":"v1","addr":"172.21.15.86:6834","nonce":567273052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:01.334172+0000","modified":"2023-10-09T11:57:04.892057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1853170285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":1853170285},{"type":"v1","addr":"172.21.15.86:6835","nonce":1853170285}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:57:05.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc18066f30 msgr2=0x7fbc180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc18066f30 0x7fbc180693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc38155c70 tx=0x7fbc2c008040 comp rx=0 tx=0).stop 2023-10-09T11:57:05.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc380ca300 msgr2=0x7fbc38158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc380ca300 0x7fbc38158d50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbc3806fe40 tx=0x7fbc2801b000 comp rx=0 tx=0).stop 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 shutdown_connections 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc18066f30 0x7fbc180693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc380ca300 0x7fbc38158d50 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc381566e0 0x7fbc38152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 --2- 172.21.15.86:0/1658163361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc38156310 0x7fbc3814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.341+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 >> 172.21.15.86:0/1658163361 conn(0x7fbc380cc1f0 msgr2=0x7fbc380c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.342+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 shutdown_connections 2023-10-09T11:57:05.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.342+0000 7fbc3759e700 1 -- 172.21.15.86:0/1658163361 wait complete. 2023-10-09T11:57:05.345 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2023-10-09T11:57:05.360 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:05.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.539+0000 7fe9709ff700 1 Processor -- start 2023-10-09T11:57:05.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.539+0000 7fe9709ff700 1 -- start start 2023-10-09T11:57:05.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe9709ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe96c155c10 0x7fe96c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe9709ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe96c0ac6d0 0x7fe96c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe9709ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0acac0 con 0x7fe96c0ac230 2023-10-09T11:57:05.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe9709ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0ad930 con 0x7fe96c0ac6d0 2023-10-09T11:57:05.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe9709ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0acd20 con 0x7fe96c155c10 2023-10-09T11:57:05.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe96c0ac6d0 0x7fe96c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe96c0ac6d0 0x7fe96c0b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43854/0 (socket says 172.21.15.86:43854) 2023-10-09T11:57:05.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96ad9d700 1 -- 172.21.15.86:0/661120070 learned_addr learned my addr 172.21.15.86:0/661120070 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:05.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96a59c700 1 --2- 172.21.15.86:0/661120070 >> v2:172.21.15.135:3300/0 conn(0x7fe96c155c10 0x7fe96c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96ad9d700 1 -- 172.21.15.86:0/661120070 >> v2:172.21.15.135:3300/0 conn(0x7fe96c155c10 msgr2=0x7fe96c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:05.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96ad9d700 1 --2- 172.21.15.86:0/661120070 >> v2:172.21.15.135:3300/0 conn(0x7fe96c155c10 0x7fe96c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96ad9d700 1 -- 172.21.15.86:0/661120070 >> v1:172.21.15.135:6789/0 conn(0x7fe96c0ac230 legacy=0x7fe96c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.541+0000 7fe96ad9d700 1 -- 172.21.15.86:0/661120070 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0ad000 con 0x7fe96c0ac6d0 2023-10-09T11:57:05.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe96ad9d700 1 --2- 172.21.15.86:0/661120070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac6d0 0x7fe96c0b0300 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe96c063d40 tx=0x7fe96400a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8498f5249b4b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe96959a700 1 -- 172.21.15.86:0/661120070 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400f070 con 0x7fe96c0ac6d0 2023-10-09T11:57:05.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe96959a700 1 -- 172.21.15.86:0/661120070 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400a2e0 con 0x7fe96c0ac6d0 2023-10-09T11:57:05.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe96959a700 1 -- 172.21.15.86:0/661120070 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400cd50 con 0x7fe96c0ac6d0 2023-10-09T11:57:05.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe9709ff700 1 -- 172.21.15.86:0/661120070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac6d0 msgr2=0x7fe96c0b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe9709ff700 1 --2- 172.21.15.86:0/661120070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac6d0 0x7fe96c0b0300 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe96c063d40 tx=0x7fe96400a950 comp rx=0 tx=0).stop 2023-10-09T11:57:05.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe9709ff700 1 -- 172.21.15.86:0/661120070 shutdown_connections 2023-10-09T11:57:05.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe9709ff700 1 --2- 172.21.15.86:0/661120070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac6d0 0x7fe96c0b0300 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.542+0000 7fe9709ff700 1 --2- 172.21.15.86:0/661120070 >> v2:172.21.15.135:3300/0 conn(0x7fe96c155c10 0x7fe96c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.543+0000 7fe9709ff700 1 -- 172.21.15.86:0/661120070 >> 172.21.15.86:0/661120070 conn(0x7fe96c06a320 msgr2=0x7fe96c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:05.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.543+0000 7fe9709ff700 1 -- 172.21.15.86:0/661120070 shutdown_connections 2023-10-09T11:57:05.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.543+0000 7fe9709ff700 1 -- 172.21.15.86:0/661120070 wait complete. 2023-10-09T11:57:05.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.544+0000 7fe9709ff700 1 Processor -- start 2023-10-09T11:57:05.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.544+0000 7fe9709ff700 1 -- start start 2023-10-09T11:57:05.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe9709ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac230 0x7fe96c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe9709ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe96c0ac6d0 0x7fe96c1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe9709ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe96c155c10 0x7fe96c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe9709ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1594e0 con 0x7fe96c0ac230 2023-10-09T11:57:05.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe9709ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c159050 con 0x7fe96c155c10 2023-10-09T11:57:05.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe9709ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c158440 con 0x7fe96c0ac6d0 2023-10-09T11:57:05.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe96a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac230 0x7fe96c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe96a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac230 0x7fe96c157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43870/0 (socket says 172.21.15.86:43870) 2023-10-09T11:57:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.545+0000 7fe96a59c700 1 -- 172.21.15.86:0/2070104585 learned_addr learned my addr 172.21.15.86:0/2070104585 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe96ad9d700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe96c155c10 0x7fe96c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe969d9b700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe96c0ac6d0 0x7fe96c1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe96a59c700 1 -- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe96c0ac6d0 msgr2=0x7fe96c1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe96a59c700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe96c0ac6d0 0x7fe96c1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe96a59c700 1 -- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe96c155c10 msgr2=0x7fe96c152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe96a59c700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe96c155c10 0x7fe96c152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe96a59c700 1 -- 172.21.15.86:0/2070104585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96400abf0 con 0x7fe96c0ac230 2023-10-09T11:57:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe96a59c700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac230 0x7fe96c157490 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e930 tx=0x7fe95c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe95a7fc700 1 -- 172.21.15.86:0/2070104585 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00eed0 con 0x7fe96c0ac230 2023-10-09T11:57:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe95a7fc700 1 -- 172.21.15.86:0/2070104585 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c00c850 con 0x7fe96c0ac230 2023-10-09T11:57:05.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe95a7fc700 1 -- 172.21.15.86:0/2070104585 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00cbf0 con 0x7fe96c0ac230 2023-10-09T11:57:05.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c158720 con 0x7fe96c0ac230 2023-10-09T11:57:05.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.546+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c158ce0 con 0x7fe96c0ac230 2023-10-09T11:57:05.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.547+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c04c3c0 con 0x7fe96c0ac230 2023-10-09T11:57:05.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.548+0000 7fe95a7fc700 1 -- 172.21.15.86:0/2070104585 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe95c013470 con 0x7fe96c0ac230 2023-10-09T11:57:05.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.549+0000 7fe95a7fc700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe94c066f30 0x7fe94c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.549+0000 7fe95a7fc700 1 -- 172.21.15.86:0/2070104585 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fe95c084980 con 0x7fe96c0ac230 2023-10-09T11:57:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.550+0000 7fe969d9b700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe94c066f30 0x7fe94c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.550+0000 7fe969d9b700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe94c066f30 0x7fe94c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe96c067d10 tx=0x7fe960009040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.553+0000 7fe95a7fc700 1 -- 172.21.15.86:0/2070104585 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe95c0519d0 con 0x7fe96c0ac230 2023-10-09T11:57:05.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.745+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe96c159330 con 0x7fe96c0ac230 2023-10-09T11:57:05.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.746+0000 7fe95a7fc700 1 -- 172.21.15.86:0/2070104585 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+15971 (secure 0 0 0) 0x7fe95c054ff0 con 0x7fe96c0ac230 2023-10-09T11:57:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:05.747 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:02.873442+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:59.439269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:00.315207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:05.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe94c066f30 msgr2=0x7fe94c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe94c066f30 0x7fe94c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe96c067d10 tx=0x7fe960009040 comp rx=0 tx=0).stop 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac230 msgr2=0x7fe96c157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac230 0x7fe96c157490 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e930 tx=0x7fe95c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 shutdown_connections 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe94c066f30 0x7fe94c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe96c0ac230 0x7fe96c157490 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe96c155c10 0x7fe96c152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 --2- 172.21.15.86:0/2070104585 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe96c0ac6d0 0x7fe96c1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 >> 172.21.15.86:0/2070104585 conn(0x7fe96c06a320 msgr2=0x7fe96c1548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 shutdown_connections 2023-10-09T11:57:05.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.748+0000 7fe9709ff700 1 -- 172.21.15.86:0/2070104585 wait complete. 2023-10-09T11:57:05.768 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:57:05.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:05.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.947+0000 7f71fdb9d700 1 Processor -- start 2023-10-09T11:57:05.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.948+0000 7f71fdb9d700 1 -- start start 2023-10-09T11:57:05.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fdb9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f71f81566e0 0x7f71f80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fdb9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f71f80cb900 0x7f71f80ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fdb9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80ca860 con 0x7f71f8156310 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fdb9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f80cab40 con 0x7f71f81566e0 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fdb9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f80cae20 con 0x7f71f80cb900 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71f7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f71f81566e0 0x7f71f80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fcb9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f71f8156310 0x7f71f80c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55616/0 (socket says 172.21.15.86:55616) 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fcb9b700 1 -- 172.21.15.86:0/3044640574 learned_addr learned my addr 172.21.15.86:0/3044640574 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.949+0000 7f71fd39c700 1 --2- 172.21.15.86:0/3044640574 >> v2:172.21.15.135:3300/0 conn(0x7f71f80cb900 0x7f71f80ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f7fff700 1 -- 172.21.15.86:0/3044640574 >> v2:172.21.15.135:3300/0 conn(0x7f71f80cb900 msgr2=0x7f71f80ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f7fff700 1 --2- 172.21.15.86:0/3044640574 >> v2:172.21.15.135:3300/0 conn(0x7f71f80cb900 0x7f71f80ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f7fff700 1 -- 172.21.15.86:0/3044640574 >> v1:172.21.15.86:6789/0 conn(0x7f71f8156310 legacy=0x7f71f80c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f7fff700 1 -- 172.21.15.86:0/3044640574 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80cb100 con 0x7f71f81566e0 2023-10-09T11:57:05.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f77fe700 1 -- 172.21.15.86:0/3044640574 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944578873 0 0) 0x7f71f80ca860 con 0x7f71f8156310 2023-10-09T11:57:05.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f7fff700 1 --2- 172.21.15.86:0/3044640574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f81566e0 0x7f71f80ae000 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f71f80addc0 tx=0x7f71e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db46df22a6ba231 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f77fe700 1 -- 172.21.15.86:0/3044640574 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400b6b0 con 0x7f71f81566e0 2023-10-09T11:57:05.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f77fe700 1 -- 172.21.15.86:0/3044640574 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400b810 con 0x7f71f81566e0 2023-10-09T11:57:05.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.950+0000 7f71f77fe700 1 -- 172.21.15.86:0/3044640574 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400bbb0 con 0x7f71f81566e0 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3044640574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f81566e0 msgr2=0x7f71f80ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3044640574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f81566e0 0x7f71f80ae000 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f71f80addc0 tx=0x7f71e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3044640574 shutdown_connections 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3044640574 >> v2:172.21.15.135:3300/0 conn(0x7f71f80cb900 0x7f71f80ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3044640574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f81566e0 0x7f71f80ae000 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3044640574 >> 172.21.15.86:0/3044640574 conn(0x7f71f80cc1f0 msgr2=0x7f71f80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3044640574 shutdown_connections 2023-10-09T11:57:05.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.951+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3044640574 wait complete. 2023-10-09T11:57:05.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.952+0000 7f71fdb9d700 1 Processor -- start 2023-10-09T11:57:05.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.952+0000 7f71fdb9d700 1 -- start start 2023-10-09T11:57:05.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.953+0000 7f71fdb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80cb900 0x7f71f80b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.953+0000 7f71fdb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f8156310 0x7f71f80b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.953+0000 7f71fdb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71f81566e0 0x7f71f80c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.953+0000 7f71fdb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f816aa90 con 0x7f71f8156310 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.953+0000 7f71fdb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f816a590 con 0x7f71f80cb900 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.953+0000 7f71fdb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f81699f0 con 0x7f71f81566e0 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f8156310 0x7f71f80b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f8156310 0x7f71f80b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43898/0 (socket says 172.21.15.86:43898) 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 -- 172.21.15.86:0/3952440075 learned_addr learned my addr 172.21.15.86:0/3952440075 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71fcb9b700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80cb900 0x7f71f80b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71fd39c700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71f81566e0 0x7f71f80c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 -- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71f81566e0 msgr2=0x7f71f80c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71f81566e0 0x7f71f80c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 -- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80cb900 msgr2=0x7f71f80b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80cb900 0x7f71f80b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 -- 172.21.15.86:0/3952440075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009420 con 0x7f71f8156310 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.954+0000 7f71f7fff700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f8156310 0x7f71f80b18f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f71f806fe40 tx=0x7f71e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.955+0000 7f71f4ff9700 1 -- 172.21.15.86:0/3952440075 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400b980 con 0x7f71f8156310 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.955+0000 7f71f4ff9700 1 -- 172.21.15.86:0/3952440075 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400bae0 con 0x7f71f8156310 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.955+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f80b1e30 con 0x7f71f8156310 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.955+0000 7f71f4ff9700 1 -- 172.21.15.86:0/3952440075 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4025670 con 0x7f71f8156310 2023-10-09T11:57:05.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.955+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f8169f40 con 0x7f71f8156310 2023-10-09T11:57:05.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.956+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f816a740 con 0x7f71f8156310 2023-10-09T11:57:05.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.957+0000 7f71f4ff9700 1 -- 172.21.15.86:0/3952440075 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71e4023070 con 0x7f71f8156310 2023-10-09T11:57:05.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.957+0000 7f71f4ff9700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:05.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.958+0000 7f71f4ff9700 1 -- 172.21.15.86:0/3952440075 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f71e4085cd0 con 0x7f71f8156310 2023-10-09T11:57:05.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.958+0000 7f71fcb9b700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:05.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.958+0000 7f71fcb9b700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f71dc066f30 0x7f71dc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71ec007fd0 tx=0x7f71ec007d30 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:05.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:05.962+0000 7f71f4ff9700 1 -- 172.21.15.86:0/3952440075 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71f816a740 con 0x7f71f8156310 2023-10-09T11:57:06.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.150+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71f816a740 con 0x7f71dc066f30 2023-10-09T11:57:06.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.160+0000 7f71f4ff9700 1 -- 172.21.15.86:0/3952440075 <== mgr.6507 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282053 (secure 0 0 0) 0x7f71f816a740 con 0x7f71dc066f30 2023-10-09T11:57:06.165 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:06.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f71dc066f30 msgr2=0x7f71dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f71dc066f30 0x7f71dc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71ec007fd0 tx=0x7f71ec007d30 comp rx=0 tx=0).stop 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f8156310 msgr2=0x7f71f80b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f8156310 0x7f71f80b18f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f71f806fe40 tx=0x7f71e4017000 comp rx=0 tx=0).stop 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 shutdown_connections 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71f81566e0 0x7f71f80c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80cb900 0x7f71f80b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 --2- 172.21.15.86:0/3952440075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71f8156310 0x7f71f80b18f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 >> 172.21.15.86:0/3952440075 conn(0x7f71f80cc1f0 msgr2=0x7f71f80addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:06.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.164+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 shutdown_connections 2023-10-09T11:57:06.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.165+0000 7f71fdb9d700 1 -- 172.21.15.86:0/3952440075 wait complete. 2023-10-09T11:57:06.169 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:06.183 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:57:05.754702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591938,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":288,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433236,"kb_used_data":9876,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541484,"statfs":{"total":773094113280,"available":770602479616,"internally_reserved":0,"allocated":10113024,"data_stored":5443810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1570,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896439"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907058+0000","last_change":"2023-10-09T11:57:01.904421+0000","last_active":"2023-10-09T11:57:01.907058+0000","last_peered":"2023-10-09T11:57:01.907058+0000","last_clean":"2023-10-09T11:57:01.907058+0000","last_became_active":"2023-10-09T11:57:01.904142+0000","last_became_peered":"2023-10-09T11:57:01.904142+0000","last_unstale":"2023-10-09T11:57:01.907058+0000","last_undegraded":"2023-10-09T11:57:01.907058+0000","last_fullsized":"2023-10-09T11:57:01.907058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:52.001394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.899597+0000","last_change":"2023-10-09T11:57:01.895405+0000","last_active":"2023-10-09T11:57:01.899597+0000","last_peered":"2023-10-09T11:57:01.899597+0000","last_clean":"2023-10-09T11:57:01.899597+0000","last_became_active":"2023-10-09T11:57:01.895154+0000","last_became_peered":"2023-10-09T11:57:01.895154+0000","last_unstale":"2023-10-09T11:57:01.899597+0000","last_undegraded":"2023-10-09T11:57:01.899597+0000","last_fullsized":"2023-10-09T11:57:01.899597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:45.839001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905103+0000","last_change":"2023-10-09T11:57:01.902364+0000","last_active":"2023-10-09T11:57:01.905103+0000","last_peered":"2023-10-09T11:57:01.905103+0000","last_clean":"2023-10-09T11:57:01.905103+0000","last_became_active":"2023-10-09T11:57:01.902081+0000","last_became_peered":"2023-10-09T11:57:01.902081+0000","last_unstale":"2023-10-09T11:57:01.905103+0000","last_undegraded":"2023-10-09T11:57:01.905103+0000","last_fullsized":"2023-10-09T11:57:01.905103+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:44.084236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895914+0000","last_change":"2023-10-09T11:57:01.892465+0000","last_active":"2023-10-09T11:57:01.895914+0000","last_peered":"2023-10-09T11:57:01.895914+0000","last_clean":"2023-10-09T11:57:01.895914+0000","last_became_active":"2023-10-09T11:57:01.892212+0000","last_became_peered":"2023-10-09T11:57:01.892212+0000","last_unstale":"2023-10-09T11:57:01.895914+0000","last_undegraded":"2023-10-09T11:57:01.895914+0000","last_fullsized":"2023-10-09T11:57:01.895914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:34.625153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904888+0000","last_change":"2023-10-09T11:57:01.899702+0000","last_active":"2023-10-09T11:57:01.904888+0000","last_peered":"2023-10-09T11:57:01.904888+0000","last_clean":"2023-10-09T11:57:01.904888+0000","last_became_active":"2023-10-09T11:57:01.899445+0000","last_became_peered":"2023-10-09T11:57:01.899445+0000","last_unstale":"2023-10-09T11:57:01.904888+0000","last_undegraded":"2023-10-09T11:57:01.904888+0000","last_fullsized":"2023-10-09T11:57:01.904888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:21.097692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.893987+0000","last_change":"2023-10-09T11:57:01.891259+0000","last_active":"2023-10-09T11:57:01.893987+0000","last_peered":"2023-10-09T11:57:01.893987+0000","last_clean":"2023-10-09T11:57:01.893987+0000","last_became_active":"2023-10-09T11:57:01.891009+0000","last_became_peered":"2023-10-09T11:57:01.891009+0000","last_unstale":"2023-10-09T11:57:01.893987+0000","last_undegraded":"2023-10-09T11:57:01.893987+0000","last_fullsized":"2023-10-09T11:57:01.893987+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:17.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897168+0000","last_change":"2023-10-09T11:57:01.894384+0000","last_active":"2023-10-09T11:57:01.897168+0000","last_peered":"2023-10-09T11:57:01.897168+0000","last_clean":"2023-10-09T11:57:01.897168+0000","last_became_active":"2023-10-09T11:57:01.894030+0000","last_became_peered":"2023-10-09T11:57:01.894030+0000","last_unstale":"2023-10-09T11:57:01.897168+0000","last_undegraded":"2023-10-09T11:57:01.897168+0000","last_fullsized":"2023-10-09T11:57:01.897168+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:22.726979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904781+0000","last_change":"2023-10-09T11:57:01.899804+0000","last_active":"2023-10-09T11:57:01.904781+0000","last_peered":"2023-10-09T11:57:01.904781+0000","last_clean":"2023-10-09T11:57:01.904781+0000","last_became_active":"2023-10-09T11:57:01.899555+0000","last_became_peered":"2023-10-09T11:57:01.899555+0000","last_unstale":"2023-10-09T11:57:01.904781+0000","last_undegraded":"2023-10-09T11:57:01.904781+0000","last_fullsized":"2023-10-09T11:57:01.904781+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:59.402274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906680+0000","last_change":"2023-10-09T11:57:01.904151+0000","last_active":"2023-10-09T11:57:01.906680+0000","last_peered":"2023-10-09T11:57:01.906680+0000","last_clean":"2023-10-09T11:57:01.906680+0000","last_became_active":"2023-10-09T11:57:01.903816+0000","last_became_peered":"2023-10-09T11:57:01.903816+0000","last_unstale":"2023-10-09T11:57:01.906680+0000","last_undegraded":"2023-10-09T11:57:01.906680+0000","last_fullsized":"2023-10-09T11:57:01.906680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:35.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.888244+0000","last_change":"2023-10-09T11:57:01.886855+0000","last_active":"2023-10-09T11:57:01.888244+0000","last_peered":"2023-10-09T11:57:01.888244+0000","last_clean":"2023-10-09T11:57:01.888244+0000","last_became_active":"2023-10-09T11:57:01.886601+0000","last_became_peered":"2023-10-09T11:57:01.886601+0000","last_unstale":"2023-10-09T11:57:01.888244+0000","last_undegraded":"2023-10-09T11:57:01.888244+0000","last_fullsized":"2023-10-09T11:57:01.888244+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:06.251475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863713+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:11.015970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905084+0000","last_change":"2023-10-09T11:57:01.900417+0000","last_active":"2023-10-09T11:57:01.905084+0000","last_peered":"2023-10-09T11:57:01.905084+0000","last_clean":"2023-10-09T11:57:01.905084+0000","last_became_active":"2023-10-09T11:57:01.900179+0000","last_became_peered":"2023-10-09T11:57:01.900179+0000","last_unstale":"2023-10-09T11:57:01.905084+0000","last_undegraded":"2023-10-09T11:57:01.905084+0000","last_fullsized":"2023-10-09T11:57:01.905084+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:03.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907728+0000","last_change":"2023-10-09T11:57:00.878267+0000","last_active":"2023-10-09T11:57:01.907728+0000","last_peered":"2023-10-09T11:57:01.907728+0000","last_clean":"2023-10-09T11:57:01.907728+0000","last_became_active":"2023-10-09T11:57:00.877902+0000","last_became_peered":"2023-10-09T11:57:00.877902+0000","last_unstale":"2023-10-09T11:57:01.907728+0000","last_undegraded":"2023-10-09T11:57:01.907728+0000","last_fullsized":"2023-10-09T11:57:01.907728+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:44.647321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859185+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:49.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863875+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:54.977806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.858865+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:21.719144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.865066+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895473+0000","last_change":"2023-10-09T11:57:01.889203+0000","last_active":"2023-10-09T11:57:01.895473+0000","last_peered":"2023-10-09T11:57:01.895473+0000","last_clean":"2023-10-09T11:57:01.895473+0000","last_became_active":"2023-10-09T11:57:01.888942+0000","last_became_peered":"2023-10-09T11:57:01.888942+0000","last_unstale":"2023-10-09T11:57:01.895473+0000","last_undegraded":"2023-10-09T11:57:01.895473+0000","last_fullsized":"2023-10-09T11:57:01.895473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:25.627287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877931+0000","last_change":"2023-10-09T11:57:00.875698+0000","last_active":"2023-10-09T11:57:01.877931+0000","last_peered":"2023-10-09T11:57:01.877931+0000","last_clean":"2023-10-09T11:57:01.877931+0000","last_became_active":"2023-10-09T11:57:00.875321+0000","last_became_peered":"2023-10-09T11:57:00.875321+0000","last_unstale":"2023-10-09T11:57:01.877931+0000","last_undegraded":"2023-10-09T11:57:01.877931+0000","last_fullsized":"2023-10-09T11:57:01.877931+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897543+0000","last_change":"2023-10-09T11:57:01.896694+0000","last_active":"2023-10-09T11:57:01.897543+0000","last_peered":"2023-10-09T11:57:01.897543+0000","last_clean":"2023-10-09T11:57:01.897543+0000","last_became_active":"2023-10-09T11:57:01.896409+0000","last_became_peered":"2023-10-09T11:57:01.896409+0000","last_unstale":"2023-10-09T11:57:01.897543+0000","last_undegraded":"2023-10-09T11:57:01.897543+0000","last_fullsized":"2023-10-09T11:57:01.897543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:37.788787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.883973+0000","last_change":"2023-10-09T11:57:00.873054+0000","last_active":"2023-10-09T11:57:01.883973+0000","last_peered":"2023-10-09T11:57:01.883973+0000","last_clean":"2023-10-09T11:57:01.883973+0000","last_became_active":"2023-10-09T11:57:00.872753+0000","last_became_peered":"2023-10-09T11:57:00.872753+0000","last_unstale":"2023-10-09T11:57:01.883973+0000","last_undegraded":"2023-10-09T11:57:01.883973+0000","last_fullsized":"2023-10-09T11:57:01.883973+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:27.215974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859026+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863506+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:27.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.858849+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:54.626087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897902+0000","last_change":"2023-10-09T11:57:01.894584+0000","last_active":"2023-10-09T11:57:01.897902+0000","last_peered":"2023-10-09T11:57:01.897902+0000","last_clean":"2023-10-09T11:57:01.897902+0000","last_became_active":"2023-10-09T11:57:01.894306+0000","last_became_peered":"2023-10-09T11:57:01.894306+0000","last_unstale":"2023-10-09T11:57:01.897902+0000","last_undegraded":"2023-10-09T11:57:01.897902+0000","last_fullsized":"2023-10-09T11:57:01.897902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:07.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.911706+0000","last_change":"2023-10-09T11:57:00.875047+0000","last_active":"2023-10-09T11:57:01.911706+0000","last_peered":"2023-10-09T11:57:01.911706+0000","last_clean":"2023-10-09T11:57:01.911706+0000","last_became_active":"2023-10-09T11:57:00.874667+0000","last_became_peered":"2023-10-09T11:57:00.874667+0000","last_unstale":"2023-10-09T11:57:01.911706+0000","last_undegraded":"2023-10-09T11:57:01.911706+0000","last_fullsized":"2023-10-09T11:57:01.911706+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:44.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912974+0000","last_change":"2023-10-09T11:57:00.880796+0000","last_active":"2023-10-09T11:57:01.912974+0000","last_peered":"2023-10-09T11:57:01.912974+0000","last_clean":"2023-10-09T11:57:01.912974+0000","last_became_active":"2023-10-09T11:57:00.880521+0000","last_became_peered":"2023-10-09T11:57:00.880521+0000","last_unstale":"2023-10-09T11:57:01.912974+0000","last_undegraded":"2023-10-09T11:57:01.912974+0000","last_fullsized":"2023-10-09T11:57:01.912974+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.864496+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:50.993560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896484+0000","last_change":"2023-10-09T11:57:01.891896+0000","last_active":"2023-10-09T11:57:01.896484+0000","last_peered":"2023-10-09T11:57:01.896484+0000","last_clean":"2023-10-09T11:57:01.896484+0000","last_became_active":"2023-10-09T11:57:01.891591+0000","last_became_peered":"2023-10-09T11:57:01.891591+0000","last_unstale":"2023-10-09T11:57:01.896484+0000","last_undegraded":"2023-10-09T11:57:01.896484+0000","last_fullsized":"2023-10-09T11:57:01.896484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:21.728449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862462+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905186+0000","last_change":"2023-10-09T11:57:01.902110+0000","last_active":"2023-10-09T11:57:01.905186+0000","last_peered":"2023-10-09T11:57:01.905186+0000","last_clean":"2023-10-09T11:57:01.905186+0000","last_became_active":"2023-10-09T11:57:01.901790+0000","last_became_peered":"2023-10-09T11:57:01.901790+0000","last_unstale":"2023-10-09T11:57:01.905186+0000","last_undegraded":"2023-10-09T11:57:01.905186+0000","last_fullsized":"2023-10-09T11:57:01.905186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:37.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859126+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862998+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:05:20.197863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859097+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895895+0000","last_change":"2023-10-09T11:57:01.890521+0000","last_active":"2023-10-09T11:57:01.895895+0000","last_peered":"2023-10-09T11:57:01.895895+0000","last_clean":"2023-10-09T11:57:01.895895+0000","last_became_active":"2023-10-09T11:57:01.890266+0000","last_became_peered":"2023-10-09T11:57:01.890266+0000","last_unstale":"2023-10-09T11:57:01.895895+0000","last_undegraded":"2023-10-09T11:57:01.895895+0000","last_fullsized":"2023-10-09T11:57:01.895895+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:28.835667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863640+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:33.617318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895955+0000","last_change":"2023-10-09T11:57:01.892720+0000","last_active":"2023-10-09T11:57:01.895955+0000","last_peered":"2023-10-09T11:57:01.895955+0000","last_clean":"2023-10-09T11:57:01.895955+0000","last_became_active":"2023-10-09T11:57:01.892468+0000","last_became_peered":"2023-10-09T11:57:01.892468+0000","last_unstale":"2023-10-09T11:57:01.895955+0000","last_undegraded":"2023-10-09T11:57:01.895955+0000","last_fullsized":"2023-10-09T11:57:01.895955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.797860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863104+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:15.689269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862832+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:59.164051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.861805+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:37.414967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881369+0000","last_change":"2023-10-09T11:57:00.876926+0000","last_active":"2023-10-09T11:57:01.881369+0000","last_peered":"2023-10-09T11:57:01.881369+0000","last_clean":"2023-10-09T11:57:01.881369+0000","last_became_active":"2023-10-09T11:57:00.876682+0000","last_became_peered":"2023-10-09T11:57:00.876682+0000","last_unstale":"2023-10-09T11:57:01.881369+0000","last_undegraded":"2023-10-09T11:57:01.881369+0000","last_fullsized":"2023-10-09T11:57:01.881369+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:07.220156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896441+0000","last_change":"2023-10-09T11:57:01.893674+0000","last_active":"2023-10-09T11:57:01.896441+0000","last_peered":"2023-10-09T11:57:01.896441+0000","last_clean":"2023-10-09T11:57:01.896441+0000","last_became_active":"2023-10-09T11:57:01.893411+0000","last_became_peered":"2023-10-09T11:57:01.893411+0000","last_unstale":"2023-10-09T11:57:01.896441+0000","last_undegraded":"2023-10-09T11:57:01.896441+0000","last_fullsized":"2023-10-09T11:57:01.896441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:55.633922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862423+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:04.734221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.861876+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:28.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.886070+0000","last_change":"2023-10-09T11:57:00.876079+0000","last_active":"2023-10-09T11:57:01.886070+0000","last_peered":"2023-10-09T11:57:01.886070+0000","last_clean":"2023-10-09T11:57:01.886070+0000","last_became_active":"2023-10-09T11:57:00.875547+0000","last_became_peered":"2023-10-09T11:57:00.875547+0000","last_unstale":"2023-10-09T11:57:01.886070+0000","last_undegraded":"2023-10-09T11:57:01.886070+0000","last_fullsized":"2023-10-09T11:57:01.886070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:40.767452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881971+0000","last_change":"2023-10-09T11:57:00.875237+0000","last_active":"2023-10-09T11:57:01.881971+0000","last_peered":"2023-10-09T11:57:01.881971+0000","last_clean":"2023-10-09T11:57:01.881971+0000","last_became_active":"2023-10-09T11:57:00.874940+0000","last_became_peered":"2023-10-09T11:57:00.874940+0000","last_unstale":"2023-10-09T11:57:01.881971+0000","last_undegraded":"2023-10-09T11:57:01.881971+0000","last_fullsized":"2023-10-09T11:57:01.881971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.637375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905068+0000","last_change":"2023-10-09T11:57:01.901431+0000","last_active":"2023-10-09T11:57:01.905068+0000","last_peered":"2023-10-09T11:57:01.905068+0000","last_clean":"2023-10-09T11:57:01.905068+0000","last_became_active":"2023-10-09T11:57:01.901190+0000","last_became_peered":"2023-10-09T11:57:01.901190+0000","last_unstale":"2023-10-09T11:57:01.905068+0000","last_undegraded":"2023-10-09T11:57:01.905068+0000","last_fullsized":"2023-10-09T11:57:01.905068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:36.509416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.885936+0000","last_change":"2023-10-09T11:57:00.874584+0000","last_active":"2023-10-09T11:57:01.885936+0000","last_peered":"2023-10-09T11:57:01.885936+0000","last_clean":"2023-10-09T11:57:01.885936+0000","last_became_active":"2023-10-09T11:57:00.874275+0000","last_became_peered":"2023-10-09T11:57:00.874275+0000","last_unstale":"2023-10-09T11:57:01.885936+0000","last_undegraded":"2023-10-09T11:57:01.885936+0000","last_fullsized":"2023-10-09T11:57:01.885936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:00.092427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877934+0000","last_change":"2023-10-09T11:57:00.875984+0000","last_active":"2023-10-09T11:57:01.877934+0000","last_peered":"2023-10-09T11:57:01.877934+0000","last_clean":"2023-10-09T11:57:01.877934+0000","last_became_active":"2023-10-09T11:57:00.875743+0000","last_became_peered":"2023-10-09T11:57:00.875743+0000","last_unstale":"2023-10-09T11:57:01.877934+0000","last_undegraded":"2023-10-09T11:57:01.877934+0000","last_fullsized":"2023-10-09T11:57:01.877934+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895628+0000","last_change":"2023-10-09T11:57:01.891953+0000","last_active":"2023-10-09T11:57:01.895628+0000","last_peered":"2023-10-09T11:57:01.895628+0000","last_clean":"2023-10-09T11:57:01.895628+0000","last_became_active":"2023-10-09T11:57:01.891592+0000","last_became_peered":"2023-10-09T11:57:01.891592+0000","last_unstale":"2023-10-09T11:57:01.895628+0000","last_undegraded":"2023-10-09T11:57:01.895628+0000","last_fullsized":"2023-10-09T11:57:01.895628+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:55.985641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859283+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862223+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863411+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:16.036691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"83'183","reported_seq":454,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-09T11:56:57.456878+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:57.456878+0000","last_peered":"2023-10-09T11:56:57.456878+0000","last_clean":"2023-10-09T11:56:57.456878+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:57.456878+0000","last_undegraded":"2023-10-09T11:56:57.456878+0000","last_fullsized":"2023-10-09T11:56:57.456878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1570,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303036,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068804,"statfs":{"total":96636764160,"available":96326455296,"internally_reserved":0,"allocated":1691648,"data_stored":1115129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.70799999999999996},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.755},"min":{"1min":0.60299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93899999999999995,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.755},"min":{"1min":0.501,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88800000000000001,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.202},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.53900000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.96799999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.073},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.89300000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.76100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.749}]},{"osd":6,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.04,"5min":1.083,"15min":1.083},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.111,"15min":1.111},"last":0.70699999999999996}]}]},{"osd":6,"up_from":16,"seq":68719476927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94399999999999995,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.121},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.504,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.0049999999999999,"15min":1.216},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.96399999999999997,"5min":1.008,"15min":1.139},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.431},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.1040000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94599999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.68500000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.96699999999999997,"15min":1.7869999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.93600000000000005,"15min":1.143},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82199999999999995,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.437},"max":{"1min":0.88400000000000001,"5min":1.03,"15min":1.506},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.96099999999999997,"5min":0.97499999999999998,"15min":1.2330000000000001},"last":0.80200000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":547327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46500000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.079,"5min":1.079,"15min":1.6759999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.72299999999999998,"15min":1.385},"last":0.503},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.69199999999999995,"5min":0.83199999999999996,"15min":1.099},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.536},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66700000000000004,"5min":0.78000000000000003,"15min":1.272},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.7210000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":1.0660000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":1.202,"15min":1.677},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.0980000000000001,"5min":1.103,"15min":1.778},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0760000000000001,"15min":1.623},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.042,"5min":1.0549999999999999,"15min":1.708},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81799999999999995,"15min":0.83999999999999997},"min":{"1min":0.63900000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1160000000000001,"5min":1.222,"15min":1.659},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1419999999999999,"15min":1.736},"last":0.56499999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1135571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.35599999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.367},"last":0.308},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.4930000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.7130000000000001},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.855},"last":0.436},{"interface":"front","average":{"1min":0.745,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":1.399,"5min":1.587,"15min":1.587},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.997}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54400000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.58599999999999997,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.488,"15min":1.488},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.80500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1899999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2330000000000001,"5min":1.552,"15min":1.552},"last":0.82199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":546739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27600000000000002},"max":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51000000000000001,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.75,"15min":0.83799999999999997},"last":0.374}]},{"osd":1,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.502,"15min":0.496},"min":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.876,"15min":0.97299999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.64800000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.70299999999999996,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.439}]},{"osd":4,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0029999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.97699999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.2270000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.012,"5min":1.216,"15min":1.216},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0269999999999999,"5min":1.204,"15min":1.27},"last":0.98899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.61199999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.98299999999999998,"5min":1.2310000000000001,"15min":1.246},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.022,"5min":1.155,"15min":1.2130000000000001},"last":0.96199999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47899999999999998},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.311},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.34599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.752,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.5}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.151,"5min":1.208,"15min":1.327},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.72499999999999998,"5min":0.63100000000000001,"15min":0.55700000000000005},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.624,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.246,"5min":1.246,"15min":1.2829999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.3660000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.53600000000000003,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.1240000000000001,"15min":1.218},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.333},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.66500000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.3560000000000001},"last":0.55800000000000005}]}]},{"osd":4,"up_from":16,"seq":68719476926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310648,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061192,"statfs":{"total":96636764160,"available":96318660608,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":1.071},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.56699999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":1.4419999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.56299999999999994,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.92300000000000004,"5min":0.95799999999999996,"15min":1.2909999999999999},"last":1.587}]},{"osd":2,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":0.82499999999999996,"5min":0.95399999999999996,"15min":1.0149999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.234},"last":1.419}]},{"osd":3,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84199999999999997,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":1.367},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.745,"15min":0.75900000000000001},"min":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":1.1639999999999999},"last":1.5069999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36099999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0820000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.1140000000000001},"last":1.613}]},{"osd":6,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":1.125},"last":1.5609999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.373},"last":1.6439999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.2410000000000001},"last":1.484},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91400000000000003,"5min":0.997,"15min":1.222},"last":1.5369999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.91200000000000003,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.47099999999999997,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.94399999999999995,"5min":1.909,"15min":1.909},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.997,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.44900000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":2.105,"15min":2.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97299999999999998,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.745},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.70499999999999996},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.81699999999999995,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.93000000000000005,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:06.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:06.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.401+0000 7f36f499d700 1 Processor -- start 2023-10-09T11:57:06.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.402+0000 7f36f499d700 1 -- start start 2023-10-09T11:57:06.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.403+0000 7f36f499d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f36f0156310 0x7f36f00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.403+0000 7f36f499d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00ca860 con 0x7f36f01566e0 2023-10-09T11:57:06.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.403+0000 7f36f499d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00cab40 con 0x7f36f00ae710 2023-10-09T11:57:06.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.403+0000 7f36f499d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f00cae20 con 0x7f36f0156310 2023-10-09T11:57:06.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.403+0000 7f36eeffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f36f01566e0 0x7f36f00ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55624/0 (socket says 172.21.15.86:55624) 2023-10-09T11:57:06.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.403+0000 7f36eeffd700 1 -- 172.21.15.86:0/970501913 learned_addr learned my addr 172.21.15.86:0/970501913 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:06.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.403+0000 7f36ef7fe700 1 --2- 172.21.15.86:0/970501913 >> v2:172.21.15.135:3300/0 conn(0x7f36f0156310 0x7f36f00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585365248 0 0) 0x7f36f00ca860 con 0x7f36f01566e0 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d8003570 con 0x7f36f01566e0 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393393514 0 0) 0x7f36d8003570 con 0x7f36f01566e0 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 >> v2:172.21.15.135:3300/0 conn(0x7f36f0156310 msgr2=0x7f36f00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 --2- 172.21.15.86:0/970501913 >> v2:172.21.15.135:3300/0 conn(0x7f36f0156310 0x7f36f00c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 >> v1:172.21.15.135:6789/0 conn(0x7f36f00ae710 legacy=0x7f36f00c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f00cb100 con 0x7f36f01566e0 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f36e4001470 con 0x7f36f01566e0 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 >> v1:172.21.15.86:6789/0 conn(0x7f36f01566e0 legacy=0x7f36f00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8003a60 0x7f36d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d8004810 0x7f36d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d80051c0 0x7f36d800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00cae20 con 0x7f36d8004810 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d800e2e0 con 0x7f36d80051c0 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d800e4a0 con 0x7f36d8003a60 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36ef7fe700 1 --2- 172.21.15.86:0/970501913 >> v2:172.21.15.135:3300/0 conn(0x7f36f0156310 0x7f36f00c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.404+0000 7f36eeffd700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d8004810 0x7f36d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36effff700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d80051c0 0x7f36d800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36ef7fe700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8003a60 0x7f36d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36eeffd700 1 -- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8003a60 msgr2=0x7f36d8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36eeffd700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8003a60 0x7f36d8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36eeffd700 1 -- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d80051c0 msgr2=0x7f36d800dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:06.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36eeffd700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d80051c0 0x7f36d800dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36eeffd700 1 -- 172.21.15.86:0/970501913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8003570 con 0x7f36d8004810 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36effff700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d80051c0 0x7f36d800dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36effff700 1 -- 172.21.15.86:0/970501913 reap_dead start 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36eeffd700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d8004810 0x7f36d8004c80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f36f0156b50 tx=0x7f36f00caa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a460e4211c6885 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400cc30 con 0x7f36d8004810 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e400cd90 con 0x7f36d8004810 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.405+0000 7f36ee7fc700 1 -- 172.21.15.86:0/970501913 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4005b70 con 0x7f36d8004810 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.406+0000 7f36f499d700 1 -- 172.21.15.86:0/970501913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d8004810 msgr2=0x7f36d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.406+0000 7f36f499d700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d8004810 0x7f36d8004c80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f36f0156b50 tx=0x7f36f00caa30 comp rx=0 tx=0).stop 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.406+0000 7f36f499d700 1 -- 172.21.15.86:0/970501913 shutdown_connections 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.406+0000 7f36f499d700 1 --2- 172.21.15.86:0/970501913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36d8004810 0x7f36d8004c80 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.406+0000 7f36f499d700 1 -- 172.21.15.86:0/970501913 >> 172.21.15.86:0/970501913 conn(0x7f36f00cc1f0 msgr2=0x7f36f00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:06.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.406+0000 7f36f499d700 1 -- 172.21.15.86:0/970501913 shutdown_connections 2023-10-09T11:57:06.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.406+0000 7f36f499d700 1 -- 172.21.15.86:0/970501913 wait complete. 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.407+0000 7f36f499d700 1 Processor -- start 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.407+0000 7f36f499d700 1 -- start start 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.408+0000 7f36f499d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8004810 0x7f36f0147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.408+0000 7f36f499d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36f0146dc0 0x7f36f016e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.408+0000 7f36f499d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f00b0990 0x7f36f00b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.408+0000 7f36f499d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f014d6e0 con 0x7f36f0146dc0 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.408+0000 7f36f499d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00b1340 con 0x7f36f00b0990 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.408+0000 7f36f499d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f016ede0 con 0x7f36d8004810 2023-10-09T11:57:06.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.408+0000 7f36eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36f0146dc0 0x7f36f016e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36f0146dc0 0x7f36f016e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43912/0 (socket says 172.21.15.86:43912) 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 -- 172.21.15.86:0/1901026604 learned_addr learned my addr 172.21.15.86:0/1901026604 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 -- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8004810 msgr2=0x7f36f0147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36ef7fe700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8004810 0x7f36f0147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36effff700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f00b0990 0x7f36f00b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8004810 0x7f36f0147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 -- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f00b0990 msgr2=0x7f36f00b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f00b0990 0x7f36f00b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 -- 172.21.15.86:0/1901026604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f016f0e0 con 0x7f36f0146dc0 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36effff700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f00b0990 0x7f36f00b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36ef7fe700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8004810 0x7f36f0147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:06.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36eeffd700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36f0146dc0 0x7f36f016e8a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f36e400c950 tx=0x7f36e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:06.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36d77fe700 1 -- 172.21.15.86:0/1901026604 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4001470 con 0x7f36f0146dc0 2023-10-09T11:57:06.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36d77fe700 1 -- 172.21.15.86:0/1901026604 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e40070d0 con 0x7f36f0146dc0 2023-10-09T11:57:06.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36d77fe700 1 -- 172.21.15.86:0/1901026604 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4007490 con 0x7f36f0146dc0 2023-10-09T11:57:06.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.409+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f016f3c0 con 0x7f36f0146dc0 2023-10-09T11:57:06.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.410+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f016f980 con 0x7f36f0146dc0 2023-10-09T11:57:06.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.410+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f004c3c0 con 0x7f36f0146dc0 2023-10-09T11:57:06.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.411+0000 7f36d77fe700 1 -- 172.21.15.86:0/1901026604 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36e401e430 con 0x7f36f0146dc0 2023-10-09T11:57:06.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.412+0000 7f36d77fe700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f36dc066f30 0x7f36dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.412+0000 7f36d77fe700 1 -- 172.21.15.86:0/1901026604 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f36e4085390 con 0x7f36f0146dc0 2023-10-09T11:57:06.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.413+0000 7f36ef7fe700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f36dc066f30 0x7f36dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.413+0000 7f36ef7fe700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f36dc066f30 0x7f36dc0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f36e00099f0 tx=0x7f36e000b040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:06.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.416+0000 7f36d77fe700 1 -- 172.21.15.86:0/1901026604 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36e4052480 con 0x7f36f0146dc0 2023-10-09T11:57:06.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.603+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36f00c9a20 con 0x7f36dc066f30 2023-10-09T11:57:06.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.611+0000 7f36d77fe700 1 -- 172.21.15.86:0/1901026604 <== mgr.6507 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282053 (secure 0 0 0) 0x7f36f00c9a20 con 0x7f36dc066f30 2023-10-09T11:57:06.616 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.615+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f36dc066f30 msgr2=0x7f36dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.615+0000 7f36f499d700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f36dc066f30 0x7f36dc0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f36e00099f0 tx=0x7f36e000b040 comp rx=0 tx=0).stop 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.615+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36f0146dc0 msgr2=0x7f36f016e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.615+0000 7f36f499d700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36f0146dc0 0x7f36f016e8a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f36e400c950 tx=0x7f36e4015000 comp rx=0 tx=0).stop 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.615+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 shutdown_connections 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.615+0000 7f36f499d700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f00b0990 0x7f36f00b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.616+0000 7f36f499d700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d8004810 0x7f36f0147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.616+0000 7f36f499d700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f36dc066f30 0x7f36dc0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.616+0000 7f36f499d700 1 --2- 172.21.15.86:0/1901026604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36f0146dc0 0x7f36f016e8a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.616+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 >> 172.21.15.86:0/1901026604 conn(0x7f36f00cc1f0 msgr2=0x7f36f0151cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:06.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.616+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 shutdown_connections 2023-10-09T11:57:06.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.616+0000 7f36f499d700 1 -- 172.21.15.86:0/1901026604 wait complete. 2023-10-09T11:57:06.620 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:06.634 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:57:05.754702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591938,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":288,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433236,"kb_used_data":9876,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541484,"statfs":{"total":773094113280,"available":770602479616,"internally_reserved":0,"allocated":10113024,"data_stored":5443810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1570,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896439"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907058+0000","last_change":"2023-10-09T11:57:01.904421+0000","last_active":"2023-10-09T11:57:01.907058+0000","last_peered":"2023-10-09T11:57:01.907058+0000","last_clean":"2023-10-09T11:57:01.907058+0000","last_became_active":"2023-10-09T11:57:01.904142+0000","last_became_peered":"2023-10-09T11:57:01.904142+0000","last_unstale":"2023-10-09T11:57:01.907058+0000","last_undegraded":"2023-10-09T11:57:01.907058+0000","last_fullsized":"2023-10-09T11:57:01.907058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:52.001394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.899597+0000","last_change":"2023-10-09T11:57:01.895405+0000","last_active":"2023-10-09T11:57:01.899597+0000","last_peered":"2023-10-09T11:57:01.899597+0000","last_clean":"2023-10-09T11:57:01.899597+0000","last_became_active":"2023-10-09T11:57:01.895154+0000","last_became_peered":"2023-10-09T11:57:01.895154+0000","last_unstale":"2023-10-09T11:57:01.899597+0000","last_undegraded":"2023-10-09T11:57:01.899597+0000","last_fullsized":"2023-10-09T11:57:01.899597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:45.839001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905103+0000","last_change":"2023-10-09T11:57:01.902364+0000","last_active":"2023-10-09T11:57:01.905103+0000","last_peered":"2023-10-09T11:57:01.905103+0000","last_clean":"2023-10-09T11:57:01.905103+0000","last_became_active":"2023-10-09T11:57:01.902081+0000","last_became_peered":"2023-10-09T11:57:01.902081+0000","last_unstale":"2023-10-09T11:57:01.905103+0000","last_undegraded":"2023-10-09T11:57:01.905103+0000","last_fullsized":"2023-10-09T11:57:01.905103+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:44.084236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895914+0000","last_change":"2023-10-09T11:57:01.892465+0000","last_active":"2023-10-09T11:57:01.895914+0000","last_peered":"2023-10-09T11:57:01.895914+0000","last_clean":"2023-10-09T11:57:01.895914+0000","last_became_active":"2023-10-09T11:57:01.892212+0000","last_became_peered":"2023-10-09T11:57:01.892212+0000","last_unstale":"2023-10-09T11:57:01.895914+0000","last_undegraded":"2023-10-09T11:57:01.895914+0000","last_fullsized":"2023-10-09T11:57:01.895914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:34.625153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904888+0000","last_change":"2023-10-09T11:57:01.899702+0000","last_active":"2023-10-09T11:57:01.904888+0000","last_peered":"2023-10-09T11:57:01.904888+0000","last_clean":"2023-10-09T11:57:01.904888+0000","last_became_active":"2023-10-09T11:57:01.899445+0000","last_became_peered":"2023-10-09T11:57:01.899445+0000","last_unstale":"2023-10-09T11:57:01.904888+0000","last_undegraded":"2023-10-09T11:57:01.904888+0000","last_fullsized":"2023-10-09T11:57:01.904888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:21.097692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.893987+0000","last_change":"2023-10-09T11:57:01.891259+0000","last_active":"2023-10-09T11:57:01.893987+0000","last_peered":"2023-10-09T11:57:01.893987+0000","last_clean":"2023-10-09T11:57:01.893987+0000","last_became_active":"2023-10-09T11:57:01.891009+0000","last_became_peered":"2023-10-09T11:57:01.891009+0000","last_unstale":"2023-10-09T11:57:01.893987+0000","last_undegraded":"2023-10-09T11:57:01.893987+0000","last_fullsized":"2023-10-09T11:57:01.893987+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:17.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897168+0000","last_change":"2023-10-09T11:57:01.894384+0000","last_active":"2023-10-09T11:57:01.897168+0000","last_peered":"2023-10-09T11:57:01.897168+0000","last_clean":"2023-10-09T11:57:01.897168+0000","last_became_active":"2023-10-09T11:57:01.894030+0000","last_became_peered":"2023-10-09T11:57:01.894030+0000","last_unstale":"2023-10-09T11:57:01.897168+0000","last_undegraded":"2023-10-09T11:57:01.897168+0000","last_fullsized":"2023-10-09T11:57:01.897168+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:22.726979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904781+0000","last_change":"2023-10-09T11:57:01.899804+0000","last_active":"2023-10-09T11:57:01.904781+0000","last_peered":"2023-10-09T11:57:01.904781+0000","last_clean":"2023-10-09T11:57:01.904781+0000","last_became_active":"2023-10-09T11:57:01.899555+0000","last_became_peered":"2023-10-09T11:57:01.899555+0000","last_unstale":"2023-10-09T11:57:01.904781+0000","last_undegraded":"2023-10-09T11:57:01.904781+0000","last_fullsized":"2023-10-09T11:57:01.904781+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:59.402274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906680+0000","last_change":"2023-10-09T11:57:01.904151+0000","last_active":"2023-10-09T11:57:01.906680+0000","last_peered":"2023-10-09T11:57:01.906680+0000","last_clean":"2023-10-09T11:57:01.906680+0000","last_became_active":"2023-10-09T11:57:01.903816+0000","last_became_peered":"2023-10-09T11:57:01.903816+0000","last_unstale":"2023-10-09T11:57:01.906680+0000","last_undegraded":"2023-10-09T11:57:01.906680+0000","last_fullsized":"2023-10-09T11:57:01.906680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:35.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.888244+0000","last_change":"2023-10-09T11:57:01.886855+0000","last_active":"2023-10-09T11:57:01.888244+0000","last_peered":"2023-10-09T11:57:01.888244+0000","last_clean":"2023-10-09T11:57:01.888244+0000","last_became_active":"2023-10-09T11:57:01.886601+0000","last_became_peered":"2023-10-09T11:57:01.886601+0000","last_unstale":"2023-10-09T11:57:01.888244+0000","last_undegraded":"2023-10-09T11:57:01.888244+0000","last_fullsized":"2023-10-09T11:57:01.888244+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:06.251475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863713+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:11.015970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905084+0000","last_change":"2023-10-09T11:57:01.900417+0000","last_active":"2023-10-09T11:57:01.905084+0000","last_peered":"2023-10-09T11:57:01.905084+0000","last_clean":"2023-10-09T11:57:01.905084+0000","last_became_active":"2023-10-09T11:57:01.900179+0000","last_became_peered":"2023-10-09T11:57:01.900179+0000","last_unstale":"2023-10-09T11:57:01.905084+0000","last_undegraded":"2023-10-09T11:57:01.905084+0000","last_fullsized":"2023-10-09T11:57:01.905084+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:03.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907728+0000","last_change":"2023-10-09T11:57:00.878267+0000","last_active":"2023-10-09T11:57:01.907728+0000","last_peered":"2023-10-09T11:57:01.907728+0000","last_clean":"2023-10-09T11:57:01.907728+0000","last_became_active":"2023-10-09T11:57:00.877902+0000","last_became_peered":"2023-10-09T11:57:00.877902+0000","last_unstale":"2023-10-09T11:57:01.907728+0000","last_undegraded":"2023-10-09T11:57:01.907728+0000","last_fullsized":"2023-10-09T11:57:01.907728+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:44.647321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859185+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:49.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863875+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:54.977806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.858865+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:21.719144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.865066+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895473+0000","last_change":"2023-10-09T11:57:01.889203+0000","last_active":"2023-10-09T11:57:01.895473+0000","last_peered":"2023-10-09T11:57:01.895473+0000","last_clean":"2023-10-09T11:57:01.895473+0000","last_became_active":"2023-10-09T11:57:01.888942+0000","last_became_peered":"2023-10-09T11:57:01.888942+0000","last_unstale":"2023-10-09T11:57:01.895473+0000","last_undegraded":"2023-10-09T11:57:01.895473+0000","last_fullsized":"2023-10-09T11:57:01.895473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:25.627287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877931+0000","last_change":"2023-10-09T11:57:00.875698+0000","last_active":"2023-10-09T11:57:01.877931+0000","last_peered":"2023-10-09T11:57:01.877931+0000","last_clean":"2023-10-09T11:57:01.877931+0000","last_became_active":"2023-10-09T11:57:00.875321+0000","last_became_peered":"2023-10-09T11:57:00.875321+0000","last_unstale":"2023-10-09T11:57:01.877931+0000","last_undegraded":"2023-10-09T11:57:01.877931+0000","last_fullsized":"2023-10-09T11:57:01.877931+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897543+0000","last_change":"2023-10-09T11:57:01.896694+0000","last_active":"2023-10-09T11:57:01.897543+0000","last_peered":"2023-10-09T11:57:01.897543+0000","last_clean":"2023-10-09T11:57:01.897543+0000","last_became_active":"2023-10-09T11:57:01.896409+0000","last_became_peered":"2023-10-09T11:57:01.896409+0000","last_unstale":"2023-10-09T11:57:01.897543+0000","last_undegraded":"2023-10-09T11:57:01.897543+0000","last_fullsized":"2023-10-09T11:57:01.897543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:37.788787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.883973+0000","last_change":"2023-10-09T11:57:00.873054+0000","last_active":"2023-10-09T11:57:01.883973+0000","last_peered":"2023-10-09T11:57:01.883973+0000","last_clean":"2023-10-09T11:57:01.883973+0000","last_became_active":"2023-10-09T11:57:00.872753+0000","last_became_peered":"2023-10-09T11:57:00.872753+0000","last_unstale":"2023-10-09T11:57:01.883973+0000","last_undegraded":"2023-10-09T11:57:01.883973+0000","last_fullsized":"2023-10-09T11:57:01.883973+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:27.215974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859026+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863506+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:27.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.858849+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:54.626087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897902+0000","last_change":"2023-10-09T11:57:01.894584+0000","last_active":"2023-10-09T11:57:01.897902+0000","last_peered":"2023-10-09T11:57:01.897902+0000","last_clean":"2023-10-09T11:57:01.897902+0000","last_became_active":"2023-10-09T11:57:01.894306+0000","last_became_peered":"2023-10-09T11:57:01.894306+0000","last_unstale":"2023-10-09T11:57:01.897902+0000","last_undegraded":"2023-10-09T11:57:01.897902+0000","last_fullsized":"2023-10-09T11:57:01.897902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:07.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.911706+0000","last_change":"2023-10-09T11:57:00.875047+0000","last_active":"2023-10-09T11:57:01.911706+0000","last_peered":"2023-10-09T11:57:01.911706+0000","last_clean":"2023-10-09T11:57:01.911706+0000","last_became_active":"2023-10-09T11:57:00.874667+0000","last_became_peered":"2023-10-09T11:57:00.874667+0000","last_unstale":"2023-10-09T11:57:01.911706+0000","last_undegraded":"2023-10-09T11:57:01.911706+0000","last_fullsized":"2023-10-09T11:57:01.911706+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:44.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912974+0000","last_change":"2023-10-09T11:57:00.880796+0000","last_active":"2023-10-09T11:57:01.912974+0000","last_peered":"2023-10-09T11:57:01.912974+0000","last_clean":"2023-10-09T11:57:01.912974+0000","last_became_active":"2023-10-09T11:57:00.880521+0000","last_became_peered":"2023-10-09T11:57:00.880521+0000","last_unstale":"2023-10-09T11:57:01.912974+0000","last_undegraded":"2023-10-09T11:57:01.912974+0000","last_fullsized":"2023-10-09T11:57:01.912974+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.864496+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:50.993560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896484+0000","last_change":"2023-10-09T11:57:01.891896+0000","last_active":"2023-10-09T11:57:01.896484+0000","last_peered":"2023-10-09T11:57:01.896484+0000","last_clean":"2023-10-09T11:57:01.896484+0000","last_became_active":"2023-10-09T11:57:01.891591+0000","last_became_peered":"2023-10-09T11:57:01.891591+0000","last_unstale":"2023-10-09T11:57:01.896484+0000","last_undegraded":"2023-10-09T11:57:01.896484+0000","last_fullsized":"2023-10-09T11:57:01.896484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:21.728449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862462+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905186+0000","last_change":"2023-10-09T11:57:01.902110+0000","last_active":"2023-10-09T11:57:01.905186+0000","last_peered":"2023-10-09T11:57:01.905186+0000","last_clean":"2023-10-09T11:57:01.905186+0000","last_became_active":"2023-10-09T11:57:01.901790+0000","last_became_peered":"2023-10-09T11:57:01.901790+0000","last_unstale":"2023-10-09T11:57:01.905186+0000","last_undegraded":"2023-10-09T11:57:01.905186+0000","last_fullsized":"2023-10-09T11:57:01.905186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:37.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859126+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862998+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:05:20.197863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859097+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895895+0000","last_change":"2023-10-09T11:57:01.890521+0000","last_active":"2023-10-09T11:57:01.895895+0000","last_peered":"2023-10-09T11:57:01.895895+0000","last_clean":"2023-10-09T11:57:01.895895+0000","last_became_active":"2023-10-09T11:57:01.890266+0000","last_became_peered":"2023-10-09T11:57:01.890266+0000","last_unstale":"2023-10-09T11:57:01.895895+0000","last_undegraded":"2023-10-09T11:57:01.895895+0000","last_fullsized":"2023-10-09T11:57:01.895895+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:28.835667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863640+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:33.617318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895955+0000","last_change":"2023-10-09T11:57:01.892720+0000","last_active":"2023-10-09T11:57:01.895955+0000","last_peered":"2023-10-09T11:57:01.895955+0000","last_clean":"2023-10-09T11:57:01.895955+0000","last_became_active":"2023-10-09T11:57:01.892468+0000","last_became_peered":"2023-10-09T11:57:01.892468+0000","last_unstale":"2023-10-09T11:57:01.895955+0000","last_undegraded":"2023-10-09T11:57:01.895955+0000","last_fullsized":"2023-10-09T11:57:01.895955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.797860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863104+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:15.689269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862832+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:59.164051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.861805+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:37.414967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881369+0000","last_change":"2023-10-09T11:57:00.876926+0000","last_active":"2023-10-09T11:57:01.881369+0000","last_peered":"2023-10-09T11:57:01.881369+0000","last_clean":"2023-10-09T11:57:01.881369+0000","last_became_active":"2023-10-09T11:57:00.876682+0000","last_became_peered":"2023-10-09T11:57:00.876682+0000","last_unstale":"2023-10-09T11:57:01.881369+0000","last_undegraded":"2023-10-09T11:57:01.881369+0000","last_fullsized":"2023-10-09T11:57:01.881369+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:07.220156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896441+0000","last_change":"2023-10-09T11:57:01.893674+0000","last_active":"2023-10-09T11:57:01.896441+0000","last_peered":"2023-10-09T11:57:01.896441+0000","last_clean":"2023-10-09T11:57:01.896441+0000","last_became_active":"2023-10-09T11:57:01.893411+0000","last_became_peered":"2023-10-09T11:57:01.893411+0000","last_unstale":"2023-10-09T11:57:01.896441+0000","last_undegraded":"2023-10-09T11:57:01.896441+0000","last_fullsized":"2023-10-09T11:57:01.896441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:55.633922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862423+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:04.734221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.861876+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:28.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.886070+0000","last_change":"2023-10-09T11:57:00.876079+0000","last_active":"2023-10-09T11:57:01.886070+0000","last_peered":"2023-10-09T11:57:01.886070+0000","last_clean":"2023-10-09T11:57:01.886070+0000","last_became_active":"2023-10-09T11:57:00.875547+0000","last_became_peered":"2023-10-09T11:57:00.875547+0000","last_unstale":"2023-10-09T11:57:01.886070+0000","last_undegraded":"2023-10-09T11:57:01.886070+0000","last_fullsized":"2023-10-09T11:57:01.886070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:40.767452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881971+0000","last_change":"2023-10-09T11:57:00.875237+0000","last_active":"2023-10-09T11:57:01.881971+0000","last_peered":"2023-10-09T11:57:01.881971+0000","last_clean":"2023-10-09T11:57:01.881971+0000","last_became_active":"2023-10-09T11:57:00.874940+0000","last_became_peered":"2023-10-09T11:57:00.874940+0000","last_unstale":"2023-10-09T11:57:01.881971+0000","last_undegraded":"2023-10-09T11:57:01.881971+0000","last_fullsized":"2023-10-09T11:57:01.881971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.637375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905068+0000","last_change":"2023-10-09T11:57:01.901431+0000","last_active":"2023-10-09T11:57:01.905068+0000","last_peered":"2023-10-09T11:57:01.905068+0000","last_clean":"2023-10-09T11:57:01.905068+0000","last_became_active":"2023-10-09T11:57:01.901190+0000","last_became_peered":"2023-10-09T11:57:01.901190+0000","last_unstale":"2023-10-09T11:57:01.905068+0000","last_undegraded":"2023-10-09T11:57:01.905068+0000","last_fullsized":"2023-10-09T11:57:01.905068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:36.509416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.885936+0000","last_change":"2023-10-09T11:57:00.874584+0000","last_active":"2023-10-09T11:57:01.885936+0000","last_peered":"2023-10-09T11:57:01.885936+0000","last_clean":"2023-10-09T11:57:01.885936+0000","last_became_active":"2023-10-09T11:57:00.874275+0000","last_became_peered":"2023-10-09T11:57:00.874275+0000","last_unstale":"2023-10-09T11:57:01.885936+0000","last_undegraded":"2023-10-09T11:57:01.885936+0000","last_fullsized":"2023-10-09T11:57:01.885936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:00.092427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877934+0000","last_change":"2023-10-09T11:57:00.875984+0000","last_active":"2023-10-09T11:57:01.877934+0000","last_peered":"2023-10-09T11:57:01.877934+0000","last_clean":"2023-10-09T11:57:01.877934+0000","last_became_active":"2023-10-09T11:57:00.875743+0000","last_became_peered":"2023-10-09T11:57:00.875743+0000","last_unstale":"2023-10-09T11:57:01.877934+0000","last_undegraded":"2023-10-09T11:57:01.877934+0000","last_fullsized":"2023-10-09T11:57:01.877934+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895628+0000","last_change":"2023-10-09T11:57:01.891953+0000","last_active":"2023-10-09T11:57:01.895628+0000","last_peered":"2023-10-09T11:57:01.895628+0000","last_clean":"2023-10-09T11:57:01.895628+0000","last_became_active":"2023-10-09T11:57:01.891592+0000","last_became_peered":"2023-10-09T11:57:01.891592+0000","last_unstale":"2023-10-09T11:57:01.895628+0000","last_undegraded":"2023-10-09T11:57:01.895628+0000","last_fullsized":"2023-10-09T11:57:01.895628+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:55.985641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859283+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862223+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863411+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:16.036691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"83'183","reported_seq":454,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-09T11:56:57.456878+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:57.456878+0000","last_peered":"2023-10-09T11:56:57.456878+0000","last_clean":"2023-10-09T11:56:57.456878+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:57.456878+0000","last_undegraded":"2023-10-09T11:56:57.456878+0000","last_fullsized":"2023-10-09T11:56:57.456878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1570,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303036,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068804,"statfs":{"total":96636764160,"available":96326455296,"internally_reserved":0,"allocated":1691648,"data_stored":1115129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.70799999999999996},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.755},"min":{"1min":0.60299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93899999999999995,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.755},"min":{"1min":0.501,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88800000000000001,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.202},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.53900000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.96799999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.073},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.89300000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.76100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.749}]},{"osd":6,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.04,"5min":1.083,"15min":1.083},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.111,"15min":1.111},"last":0.70699999999999996}]}]},{"osd":6,"up_from":16,"seq":68719476927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94399999999999995,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.121},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.504,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.0049999999999999,"15min":1.216},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.96399999999999997,"5min":1.008,"15min":1.139},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.431},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.1040000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94599999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.68500000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.96699999999999997,"15min":1.7869999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.93600000000000005,"15min":1.143},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82199999999999995,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.437},"max":{"1min":0.88400000000000001,"5min":1.03,"15min":1.506},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.96099999999999997,"5min":0.97499999999999998,"15min":1.2330000000000001},"last":0.80200000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":547327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46500000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.079,"5min":1.079,"15min":1.6759999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.72299999999999998,"15min":1.385},"last":0.503},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.69199999999999995,"5min":0.83199999999999996,"15min":1.099},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.536},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66700000000000004,"5min":0.78000000000000003,"15min":1.272},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.7210000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":1.0660000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":1.202,"15min":1.677},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.0980000000000001,"5min":1.103,"15min":1.778},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0760000000000001,"15min":1.623},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.042,"5min":1.0549999999999999,"15min":1.708},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81799999999999995,"15min":0.83999999999999997},"min":{"1min":0.63900000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1160000000000001,"5min":1.222,"15min":1.659},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1419999999999999,"15min":1.736},"last":0.56499999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1135571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.35599999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.367},"last":0.308},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.4930000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.7130000000000001},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.855},"last":0.436},{"interface":"front","average":{"1min":0.745,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":1.399,"5min":1.587,"15min":1.587},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.997}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54400000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.58599999999999997,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.488,"15min":1.488},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.80500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1899999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2330000000000001,"5min":1.552,"15min":1.552},"last":0.82199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":546739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27600000000000002},"max":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51000000000000001,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.75,"15min":0.83799999999999997},"last":0.374}]},{"osd":1,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.502,"15min":0.496},"min":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.876,"15min":0.97299999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.64800000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.70299999999999996,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.439}]},{"osd":4,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0029999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.97699999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.2270000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.012,"5min":1.216,"15min":1.216},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0269999999999999,"5min":1.204,"15min":1.27},"last":0.98899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.61199999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.98299999999999998,"5min":1.2310000000000001,"15min":1.246},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.022,"5min":1.155,"15min":1.2130000000000001},"last":0.96199999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47899999999999998},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.311},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.34599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.752,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.5}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.151,"5min":1.208,"15min":1.327},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.72499999999999998,"5min":0.63100000000000001,"15min":0.55700000000000005},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.624,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.246,"5min":1.246,"15min":1.2829999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.3660000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.53600000000000003,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.1240000000000001,"15min":1.218},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.333},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.66500000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.3560000000000001},"last":0.55800000000000005}]}]},{"osd":4,"up_from":16,"seq":68719476926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310648,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061192,"statfs":{"total":96636764160,"available":96318660608,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":1.071},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.56699999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":1.4419999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.56299999999999994,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.92300000000000004,"5min":0.95799999999999996,"15min":1.2909999999999999},"last":1.587}]},{"osd":2,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":0.82499999999999996,"5min":0.95399999999999996,"15min":1.0149999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.234},"last":1.419}]},{"osd":3,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84199999999999997,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":1.367},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.745,"15min":0.75900000000000001},"min":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":1.1639999999999999},"last":1.5069999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36099999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0820000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.1140000000000001},"last":1.613}]},{"osd":6,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":1.125},"last":1.5609999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.373},"last":1.6439999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.2410000000000001},"last":1.484},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91400000000000003,"5min":0.997,"15min":1.222},"last":1.5369999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.91200000000000003,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.47099999999999997,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.94399999999999995,"5min":1.909,"15min":1.909},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.997,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.44900000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":2.105,"15min":2.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97299999999999998,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.745},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.70499999999999996},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.81699999999999995,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.93000000000000005,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:06.642 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:06.851 INFO:tasks.ceph.mds.a.smithi086.stderr:2023-10-09T11:57:06.850+0000 7f6f01ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:57:06.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.852+0000 7fc6889fe700 1 Processor -- start 2023-10-09T11:57:06.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.852+0000 7fc6889fe700 1 -- start start 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc6889fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc684150180 0x7fc684157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc6889fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc6889fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc6840c7240 0x7fc684069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc6889fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6840c76c0 con 0x7fc684150180 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc6889fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68406e2a0 con 0x7fc6840c7240 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc6889fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68406b2e0 con 0x7fc684150550 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc684150180 0x7fc684157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc684150180 0x7fc684157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43926/0 (socket says 172.21.15.86:43926) 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 -- 172.21.15.86:0/582815526 learned_addr learned my addr 172.21.15.86:0/582815526 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc68259c700 1 --2- 172.21.15.86:0/582815526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc68359e700 1 --2- 172.21.15.86:0/582815526 >> v2:172.21.15.135:3300/0 conn(0x7fc6840c7240 0x7fc684069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 -- 172.21.15.86:0/582815526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 msgr2=0x7fc6840c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 --2- 172.21.15.86:0/582815526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 -- 172.21.15.86:0/582815526 >> v2:172.21.15.135:3300/0 conn(0x7fc6840c7240 msgr2=0x7fc684069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 --2- 172.21.15.86:0/582815526 >> v2:172.21.15.135:3300/0 conn(0x7fc6840c7240 0x7fc684069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc682d9d700 1 -- 172.21.15.86:0/582815526 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840c78e0 con 0x7fc684150180 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc68359e700 1 --2- 172.21.15.86:0/582815526 >> v2:172.21.15.135:3300/0 conn(0x7fc6840c7240 0x7fc684069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.854+0000 7fc68259c700 1 --2- 172.21.15.86:0/582815526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:06.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.855+0000 7fc682d9d700 1 --2- 172.21.15.86:0/582815526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc684150180 0x7fc684157770 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc6740099b0 tx=0x7fc674009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855a2093aabbbcd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:06.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.855+0000 7fc681d9b700 1 -- 172.21.15.86:0/582815526 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400b820 con 0x7fc684150180 2023-10-09T11:57:06.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.855+0000 7fc681d9b700 1 -- 172.21.15.86:0/582815526 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400b980 con 0x7fc684150180 2023-10-09T11:57:06.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.855+0000 7fc681d9b700 1 -- 172.21.15.86:0/582815526 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400bd20 con 0x7fc684150180 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.855+0000 7fc6889fe700 1 -- 172.21.15.86:0/582815526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc684150180 msgr2=0x7fc684157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.855+0000 7fc6889fe700 1 --2- 172.21.15.86:0/582815526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc684150180 0x7fc684157770 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc6740099b0 tx=0x7fc674009250 comp rx=0 tx=0).stop 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.856+0000 7fc6889fe700 1 -- 172.21.15.86:0/582815526 shutdown_connections 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.856+0000 7fc6889fe700 1 --2- 172.21.15.86:0/582815526 >> v2:172.21.15.135:3300/0 conn(0x7fc6840c7240 0x7fc684069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.856+0000 7fc6889fe700 1 --2- 172.21.15.86:0/582815526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc684150180 0x7fc684157770 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.856+0000 7fc6889fe700 1 --2- 172.21.15.86:0/582815526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.856+0000 7fc6889fe700 1 -- 172.21.15.86:0/582815526 >> 172.21.15.86:0/582815526 conn(0x7fc6840cc1f0 msgr2=0x7fc6840cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.856+0000 7fc6889fe700 1 -- 172.21.15.86:0/582815526 shutdown_connections 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.856+0000 7fc6889fe700 1 -- 172.21.15.86:0/582815526 wait complete. 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.857+0000 7fc6889fe700 1 Processor -- start 2023-10-09T11:57:06.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.857+0000 7fc6889fe700 1 -- start start 2023-10-09T11:57:06.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc6889fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6840c7240 0x7fc6840c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc6889fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc684150180 0x7fc6840ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc6889fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc6889fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840b0fa0 con 0x7fc6840c7240 2023-10-09T11:57:06.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc6889fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68416de80 con 0x7fc684150180 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc6889fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68416a8a0 con 0x7fc684150550 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc682d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6840c7240 0x7fc6840c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc682d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6840c7240 0x7fc6840c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43928/0 (socket says 172.21.15.86:43928) 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.858+0000 7fc682d9d700 1 -- 172.21.15.86:0/3800757942 learned_addr learned my addr 172.21.15.86:0/3800757942 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc682d9d700 1 -- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 msgr2=0x7fc6840add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc68359e700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc68259c700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc684150180 0x7fc6840ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc682d9d700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc682d9d700 1 -- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc684150180 msgr2=0x7fc6840ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc682d9d700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc684150180 0x7fc6840ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:06.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc682d9d700 1 -- 172.21.15.86:0/3800757942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6740094f0 con 0x7fc6840c7240 2023-10-09T11:57:06.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc68259c700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc684150180 0x7fc6840ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:06.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc682d9d700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6840c7240 0x7fc6840c6150 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc674009290 tx=0x7fc674017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:06.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc66affd700 1 -- 172.21.15.86:0/3800757942 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674026480 con 0x7fc6840c7240 2023-10-09T11:57:06.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc66affd700 1 -- 172.21.15.86:0/3800757942 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67401f070 con 0x7fc6840c7240 2023-10-09T11:57:06.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc66affd700 1 -- 172.21.15.86:0/3800757942 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674026850 con 0x7fc6840c7240 2023-10-09T11:57:06.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.859+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68416d0c0 con 0x7fc6840c7240 2023-10-09T11:57:06.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.860+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68416d680 con 0x7fc6840c7240 2023-10-09T11:57:06.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.860+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6840c8750 con 0x7fc6840c7240 2023-10-09T11:57:06.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.861+0000 7fc66affd700 1 -- 172.21.15.86:0/3800757942 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc67401a430 con 0x7fc6840c7240 2023-10-09T11:57:06.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.862+0000 7fc66affd700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc670066f30 0x7fc6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:06.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.862+0000 7fc66affd700 1 -- 172.21.15.86:0/3800757942 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc674021070 con 0x7fc6840c7240 2023-10-09T11:57:06.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.863+0000 7fc68259c700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc670066f30 0x7fc6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:06.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.863+0000 7fc68259c700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc670066f30 0x7fc6700693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc678006f00 tx=0x7fc678008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:06.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:06.866+0000 7fc66affd700 1 -- 172.21.15.86:0/3800757942 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc674053680 con 0x7fc6840c7240 2023-10-09T11:57:07.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.055+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc68404c3c0 con 0x7fc670066f30 2023-10-09T11:57:07.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.063+0000 7fc66affd700 1 -- 172.21.15.86:0/3800757942 <== mgr.6507 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282053 (secure 0 0 0) 0x7fc68404c3c0 con 0x7fc670066f30 2023-10-09T11:57:07.068 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:07.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc670066f30 msgr2=0x7fc6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc670066f30 0x7fc6700693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc678006f00 tx=0x7fc678008040 comp rx=0 tx=0).stop 2023-10-09T11:57:07.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6840c7240 msgr2=0x7fc6840c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6840c7240 0x7fc6840c6150 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc674009290 tx=0x7fc674017000 comp rx=0 tx=0).stop 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 shutdown_connections 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc670066f30 0x7fc6700693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6840c7240 0x7fc6840c6150 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc684150550 0x7fc6840add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 --2- 172.21.15.86:0/3800757942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc684150180 0x7fc6840ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.067+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 >> 172.21.15.86:0/3800757942 conn(0x7fc6840cc1f0 msgr2=0x7fc684069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.068+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 shutdown_connections 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.068+0000 7fc6889fe700 1 -- 172.21.15.86:0/3800757942 wait complete. 2023-10-09T11:57:07.071 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:07.086 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:57:05.754702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591938,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":288,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433236,"kb_used_data":9876,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541484,"statfs":{"total":773094113280,"available":770602479616,"internally_reserved":0,"allocated":10113024,"data_stored":5443810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1570,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896439"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907058+0000","last_change":"2023-10-09T11:57:01.904421+0000","last_active":"2023-10-09T11:57:01.907058+0000","last_peered":"2023-10-09T11:57:01.907058+0000","last_clean":"2023-10-09T11:57:01.907058+0000","last_became_active":"2023-10-09T11:57:01.904142+0000","last_became_peered":"2023-10-09T11:57:01.904142+0000","last_unstale":"2023-10-09T11:57:01.907058+0000","last_undegraded":"2023-10-09T11:57:01.907058+0000","last_fullsized":"2023-10-09T11:57:01.907058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:52.001394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.899597+0000","last_change":"2023-10-09T11:57:01.895405+0000","last_active":"2023-10-09T11:57:01.899597+0000","last_peered":"2023-10-09T11:57:01.899597+0000","last_clean":"2023-10-09T11:57:01.899597+0000","last_became_active":"2023-10-09T11:57:01.895154+0000","last_became_peered":"2023-10-09T11:57:01.895154+0000","last_unstale":"2023-10-09T11:57:01.899597+0000","last_undegraded":"2023-10-09T11:57:01.899597+0000","last_fullsized":"2023-10-09T11:57:01.899597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:45.839001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905103+0000","last_change":"2023-10-09T11:57:01.902364+0000","last_active":"2023-10-09T11:57:01.905103+0000","last_peered":"2023-10-09T11:57:01.905103+0000","last_clean":"2023-10-09T11:57:01.905103+0000","last_became_active":"2023-10-09T11:57:01.902081+0000","last_became_peered":"2023-10-09T11:57:01.902081+0000","last_unstale":"2023-10-09T11:57:01.905103+0000","last_undegraded":"2023-10-09T11:57:01.905103+0000","last_fullsized":"2023-10-09T11:57:01.905103+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:44.084236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895914+0000","last_change":"2023-10-09T11:57:01.892465+0000","last_active":"2023-10-09T11:57:01.895914+0000","last_peered":"2023-10-09T11:57:01.895914+0000","last_clean":"2023-10-09T11:57:01.895914+0000","last_became_active":"2023-10-09T11:57:01.892212+0000","last_became_peered":"2023-10-09T11:57:01.892212+0000","last_unstale":"2023-10-09T11:57:01.895914+0000","last_undegraded":"2023-10-09T11:57:01.895914+0000","last_fullsized":"2023-10-09T11:57:01.895914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:34.625153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904888+0000","last_change":"2023-10-09T11:57:01.899702+0000","last_active":"2023-10-09T11:57:01.904888+0000","last_peered":"2023-10-09T11:57:01.904888+0000","last_clean":"2023-10-09T11:57:01.904888+0000","last_became_active":"2023-10-09T11:57:01.899445+0000","last_became_peered":"2023-10-09T11:57:01.899445+0000","last_unstale":"2023-10-09T11:57:01.904888+0000","last_undegraded":"2023-10-09T11:57:01.904888+0000","last_fullsized":"2023-10-09T11:57:01.904888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:21.097692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.893987+0000","last_change":"2023-10-09T11:57:01.891259+0000","last_active":"2023-10-09T11:57:01.893987+0000","last_peered":"2023-10-09T11:57:01.893987+0000","last_clean":"2023-10-09T11:57:01.893987+0000","last_became_active":"2023-10-09T11:57:01.891009+0000","last_became_peered":"2023-10-09T11:57:01.891009+0000","last_unstale":"2023-10-09T11:57:01.893987+0000","last_undegraded":"2023-10-09T11:57:01.893987+0000","last_fullsized":"2023-10-09T11:57:01.893987+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:17.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897168+0000","last_change":"2023-10-09T11:57:01.894384+0000","last_active":"2023-10-09T11:57:01.897168+0000","last_peered":"2023-10-09T11:57:01.897168+0000","last_clean":"2023-10-09T11:57:01.897168+0000","last_became_active":"2023-10-09T11:57:01.894030+0000","last_became_peered":"2023-10-09T11:57:01.894030+0000","last_unstale":"2023-10-09T11:57:01.897168+0000","last_undegraded":"2023-10-09T11:57:01.897168+0000","last_fullsized":"2023-10-09T11:57:01.897168+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:22.726979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904781+0000","last_change":"2023-10-09T11:57:01.899804+0000","last_active":"2023-10-09T11:57:01.904781+0000","last_peered":"2023-10-09T11:57:01.904781+0000","last_clean":"2023-10-09T11:57:01.904781+0000","last_became_active":"2023-10-09T11:57:01.899555+0000","last_became_peered":"2023-10-09T11:57:01.899555+0000","last_unstale":"2023-10-09T11:57:01.904781+0000","last_undegraded":"2023-10-09T11:57:01.904781+0000","last_fullsized":"2023-10-09T11:57:01.904781+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:59.402274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906680+0000","last_change":"2023-10-09T11:57:01.904151+0000","last_active":"2023-10-09T11:57:01.906680+0000","last_peered":"2023-10-09T11:57:01.906680+0000","last_clean":"2023-10-09T11:57:01.906680+0000","last_became_active":"2023-10-09T11:57:01.903816+0000","last_became_peered":"2023-10-09T11:57:01.903816+0000","last_unstale":"2023-10-09T11:57:01.906680+0000","last_undegraded":"2023-10-09T11:57:01.906680+0000","last_fullsized":"2023-10-09T11:57:01.906680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:35.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.888244+0000","last_change":"2023-10-09T11:57:01.886855+0000","last_active":"2023-10-09T11:57:01.888244+0000","last_peered":"2023-10-09T11:57:01.888244+0000","last_clean":"2023-10-09T11:57:01.888244+0000","last_became_active":"2023-10-09T11:57:01.886601+0000","last_became_peered":"2023-10-09T11:57:01.886601+0000","last_unstale":"2023-10-09T11:57:01.888244+0000","last_undegraded":"2023-10-09T11:57:01.888244+0000","last_fullsized":"2023-10-09T11:57:01.888244+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:06.251475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863713+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:11.015970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905084+0000","last_change":"2023-10-09T11:57:01.900417+0000","last_active":"2023-10-09T11:57:01.905084+0000","last_peered":"2023-10-09T11:57:01.905084+0000","last_clean":"2023-10-09T11:57:01.905084+0000","last_became_active":"2023-10-09T11:57:01.900179+0000","last_became_peered":"2023-10-09T11:57:01.900179+0000","last_unstale":"2023-10-09T11:57:01.905084+0000","last_undegraded":"2023-10-09T11:57:01.905084+0000","last_fullsized":"2023-10-09T11:57:01.905084+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:03.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907728+0000","last_change":"2023-10-09T11:57:00.878267+0000","last_active":"2023-10-09T11:57:01.907728+0000","last_peered":"2023-10-09T11:57:01.907728+0000","last_clean":"2023-10-09T11:57:01.907728+0000","last_became_active":"2023-10-09T11:57:00.877902+0000","last_became_peered":"2023-10-09T11:57:00.877902+0000","last_unstale":"2023-10-09T11:57:01.907728+0000","last_undegraded":"2023-10-09T11:57:01.907728+0000","last_fullsized":"2023-10-09T11:57:01.907728+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:44.647321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859185+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:49.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863875+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:54.977806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.858865+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:21.719144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.865066+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895473+0000","last_change":"2023-10-09T11:57:01.889203+0000","last_active":"2023-10-09T11:57:01.895473+0000","last_peered":"2023-10-09T11:57:01.895473+0000","last_clean":"2023-10-09T11:57:01.895473+0000","last_became_active":"2023-10-09T11:57:01.888942+0000","last_became_peered":"2023-10-09T11:57:01.888942+0000","last_unstale":"2023-10-09T11:57:01.895473+0000","last_undegraded":"2023-10-09T11:57:01.895473+0000","last_fullsized":"2023-10-09T11:57:01.895473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:25.627287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877931+0000","last_change":"2023-10-09T11:57:00.875698+0000","last_active":"2023-10-09T11:57:01.877931+0000","last_peered":"2023-10-09T11:57:01.877931+0000","last_clean":"2023-10-09T11:57:01.877931+0000","last_became_active":"2023-10-09T11:57:00.875321+0000","last_became_peered":"2023-10-09T11:57:00.875321+0000","last_unstale":"2023-10-09T11:57:01.877931+0000","last_undegraded":"2023-10-09T11:57:01.877931+0000","last_fullsized":"2023-10-09T11:57:01.877931+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897543+0000","last_change":"2023-10-09T11:57:01.896694+0000","last_active":"2023-10-09T11:57:01.897543+0000","last_peered":"2023-10-09T11:57:01.897543+0000","last_clean":"2023-10-09T11:57:01.897543+0000","last_became_active":"2023-10-09T11:57:01.896409+0000","last_became_peered":"2023-10-09T11:57:01.896409+0000","last_unstale":"2023-10-09T11:57:01.897543+0000","last_undegraded":"2023-10-09T11:57:01.897543+0000","last_fullsized":"2023-10-09T11:57:01.897543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:37.788787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.883973+0000","last_change":"2023-10-09T11:57:00.873054+0000","last_active":"2023-10-09T11:57:01.883973+0000","last_peered":"2023-10-09T11:57:01.883973+0000","last_clean":"2023-10-09T11:57:01.883973+0000","last_became_active":"2023-10-09T11:57:00.872753+0000","last_became_peered":"2023-10-09T11:57:00.872753+0000","last_unstale":"2023-10-09T11:57:01.883973+0000","last_undegraded":"2023-10-09T11:57:01.883973+0000","last_fullsized":"2023-10-09T11:57:01.883973+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:27.215974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859026+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863506+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:27.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.858849+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:54.626087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897902+0000","last_change":"2023-10-09T11:57:01.894584+0000","last_active":"2023-10-09T11:57:01.897902+0000","last_peered":"2023-10-09T11:57:01.897902+0000","last_clean":"2023-10-09T11:57:01.897902+0000","last_became_active":"2023-10-09T11:57:01.894306+0000","last_became_peered":"2023-10-09T11:57:01.894306+0000","last_unstale":"2023-10-09T11:57:01.897902+0000","last_undegraded":"2023-10-09T11:57:01.897902+0000","last_fullsized":"2023-10-09T11:57:01.897902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:07.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.911706+0000","last_change":"2023-10-09T11:57:00.875047+0000","last_active":"2023-10-09T11:57:01.911706+0000","last_peered":"2023-10-09T11:57:01.911706+0000","last_clean":"2023-10-09T11:57:01.911706+0000","last_became_active":"2023-10-09T11:57:00.874667+0000","last_became_peered":"2023-10-09T11:57:00.874667+0000","last_unstale":"2023-10-09T11:57:01.911706+0000","last_undegraded":"2023-10-09T11:57:01.911706+0000","last_fullsized":"2023-10-09T11:57:01.911706+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:44.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912974+0000","last_change":"2023-10-09T11:57:00.880796+0000","last_active":"2023-10-09T11:57:01.912974+0000","last_peered":"2023-10-09T11:57:01.912974+0000","last_clean":"2023-10-09T11:57:01.912974+0000","last_became_active":"2023-10-09T11:57:00.880521+0000","last_became_peered":"2023-10-09T11:57:00.880521+0000","last_unstale":"2023-10-09T11:57:01.912974+0000","last_undegraded":"2023-10-09T11:57:01.912974+0000","last_fullsized":"2023-10-09T11:57:01.912974+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.864496+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:50.993560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896484+0000","last_change":"2023-10-09T11:57:01.891896+0000","last_active":"2023-10-09T11:57:01.896484+0000","last_peered":"2023-10-09T11:57:01.896484+0000","last_clean":"2023-10-09T11:57:01.896484+0000","last_became_active":"2023-10-09T11:57:01.891591+0000","last_became_peered":"2023-10-09T11:57:01.891591+0000","last_unstale":"2023-10-09T11:57:01.896484+0000","last_undegraded":"2023-10-09T11:57:01.896484+0000","last_fullsized":"2023-10-09T11:57:01.896484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:21.728449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862462+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905186+0000","last_change":"2023-10-09T11:57:01.902110+0000","last_active":"2023-10-09T11:57:01.905186+0000","last_peered":"2023-10-09T11:57:01.905186+0000","last_clean":"2023-10-09T11:57:01.905186+0000","last_became_active":"2023-10-09T11:57:01.901790+0000","last_became_peered":"2023-10-09T11:57:01.901790+0000","last_unstale":"2023-10-09T11:57:01.905186+0000","last_undegraded":"2023-10-09T11:57:01.905186+0000","last_fullsized":"2023-10-09T11:57:01.905186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:37.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859126+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862998+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:05:20.197863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859097+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895895+0000","last_change":"2023-10-09T11:57:01.890521+0000","last_active":"2023-10-09T11:57:01.895895+0000","last_peered":"2023-10-09T11:57:01.895895+0000","last_clean":"2023-10-09T11:57:01.895895+0000","last_became_active":"2023-10-09T11:57:01.890266+0000","last_became_peered":"2023-10-09T11:57:01.890266+0000","last_unstale":"2023-10-09T11:57:01.895895+0000","last_undegraded":"2023-10-09T11:57:01.895895+0000","last_fullsized":"2023-10-09T11:57:01.895895+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:28.835667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863640+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:33.617318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895955+0000","last_change":"2023-10-09T11:57:01.892720+0000","last_active":"2023-10-09T11:57:01.895955+0000","last_peered":"2023-10-09T11:57:01.895955+0000","last_clean":"2023-10-09T11:57:01.895955+0000","last_became_active":"2023-10-09T11:57:01.892468+0000","last_became_peered":"2023-10-09T11:57:01.892468+0000","last_unstale":"2023-10-09T11:57:01.895955+0000","last_undegraded":"2023-10-09T11:57:01.895955+0000","last_fullsized":"2023-10-09T11:57:01.895955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.797860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863104+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:15.689269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862832+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:59.164051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.861805+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:37.414967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881369+0000","last_change":"2023-10-09T11:57:00.876926+0000","last_active":"2023-10-09T11:57:01.881369+0000","last_peered":"2023-10-09T11:57:01.881369+0000","last_clean":"2023-10-09T11:57:01.881369+0000","last_became_active":"2023-10-09T11:57:00.876682+0000","last_became_peered":"2023-10-09T11:57:00.876682+0000","last_unstale":"2023-10-09T11:57:01.881369+0000","last_undegraded":"2023-10-09T11:57:01.881369+0000","last_fullsized":"2023-10-09T11:57:01.881369+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:07.220156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896441+0000","last_change":"2023-10-09T11:57:01.893674+0000","last_active":"2023-10-09T11:57:01.896441+0000","last_peered":"2023-10-09T11:57:01.896441+0000","last_clean":"2023-10-09T11:57:01.896441+0000","last_became_active":"2023-10-09T11:57:01.893411+0000","last_became_peered":"2023-10-09T11:57:01.893411+0000","last_unstale":"2023-10-09T11:57:01.896441+0000","last_undegraded":"2023-10-09T11:57:01.896441+0000","last_fullsized":"2023-10-09T11:57:01.896441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:55.633922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862423+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:04.734221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.861876+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:28.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.886070+0000","last_change":"2023-10-09T11:57:00.876079+0000","last_active":"2023-10-09T11:57:01.886070+0000","last_peered":"2023-10-09T11:57:01.886070+0000","last_clean":"2023-10-09T11:57:01.886070+0000","last_became_active":"2023-10-09T11:57:00.875547+0000","last_became_peered":"2023-10-09T11:57:00.875547+0000","last_unstale":"2023-10-09T11:57:01.886070+0000","last_undegraded":"2023-10-09T11:57:01.886070+0000","last_fullsized":"2023-10-09T11:57:01.886070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:40.767452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881971+0000","last_change":"2023-10-09T11:57:00.875237+0000","last_active":"2023-10-09T11:57:01.881971+0000","last_peered":"2023-10-09T11:57:01.881971+0000","last_clean":"2023-10-09T11:57:01.881971+0000","last_became_active":"2023-10-09T11:57:00.874940+0000","last_became_peered":"2023-10-09T11:57:00.874940+0000","last_unstale":"2023-10-09T11:57:01.881971+0000","last_undegraded":"2023-10-09T11:57:01.881971+0000","last_fullsized":"2023-10-09T11:57:01.881971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.637375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905068+0000","last_change":"2023-10-09T11:57:01.901431+0000","last_active":"2023-10-09T11:57:01.905068+0000","last_peered":"2023-10-09T11:57:01.905068+0000","last_clean":"2023-10-09T11:57:01.905068+0000","last_became_active":"2023-10-09T11:57:01.901190+0000","last_became_peered":"2023-10-09T11:57:01.901190+0000","last_unstale":"2023-10-09T11:57:01.905068+0000","last_undegraded":"2023-10-09T11:57:01.905068+0000","last_fullsized":"2023-10-09T11:57:01.905068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:36.509416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.885936+0000","last_change":"2023-10-09T11:57:00.874584+0000","last_active":"2023-10-09T11:57:01.885936+0000","last_peered":"2023-10-09T11:57:01.885936+0000","last_clean":"2023-10-09T11:57:01.885936+0000","last_became_active":"2023-10-09T11:57:00.874275+0000","last_became_peered":"2023-10-09T11:57:00.874275+0000","last_unstale":"2023-10-09T11:57:01.885936+0000","last_undegraded":"2023-10-09T11:57:01.885936+0000","last_fullsized":"2023-10-09T11:57:01.885936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:00.092427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877934+0000","last_change":"2023-10-09T11:57:00.875984+0000","last_active":"2023-10-09T11:57:01.877934+0000","last_peered":"2023-10-09T11:57:01.877934+0000","last_clean":"2023-10-09T11:57:01.877934+0000","last_became_active":"2023-10-09T11:57:00.875743+0000","last_became_peered":"2023-10-09T11:57:00.875743+0000","last_unstale":"2023-10-09T11:57:01.877934+0000","last_undegraded":"2023-10-09T11:57:01.877934+0000","last_fullsized":"2023-10-09T11:57:01.877934+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895628+0000","last_change":"2023-10-09T11:57:01.891953+0000","last_active":"2023-10-09T11:57:01.895628+0000","last_peered":"2023-10-09T11:57:01.895628+0000","last_clean":"2023-10-09T11:57:01.895628+0000","last_became_active":"2023-10-09T11:57:01.891592+0000","last_became_peered":"2023-10-09T11:57:01.891592+0000","last_unstale":"2023-10-09T11:57:01.895628+0000","last_undegraded":"2023-10-09T11:57:01.895628+0000","last_fullsized":"2023-10-09T11:57:01.895628+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:55.985641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.859283+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.862223+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:00.855687+0000","last_change":"2023-10-09T11:57:00.855687+0000","last_active":"2023-10-09T11:57:00.855687+0000","last_peered":"2023-10-09T11:57:00.855687+0000","last_clean":"2023-10-09T11:57:00.855687+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:00.855687+0000","last_undegraded":"2023-10-09T11:57:00.855687+0000","last_fullsized":"2023-10-09T11:57:00.855687+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:56:59.847853+0000","last_change":"2023-10-09T11:56:59.863411+0000","last_active":"2023-10-09T11:56:59.847853+0000","last_peered":"2023-10-09T11:56:59.847853+0000","last_clean":"2023-10-09T11:56:59.847853+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:56:59.847853+0000","last_undegraded":"2023-10-09T11:56:59.847853+0000","last_fullsized":"2023-10-09T11:56:59.847853+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:16.036691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"83'183","reported_seq":454,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-09T11:56:57.456878+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:56:57.456878+0000","last_peered":"2023-10-09T11:56:57.456878+0000","last_clean":"2023-10-09T11:56:57.456878+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:56:57.456878+0000","last_undegraded":"2023-10-09T11:56:57.456878+0000","last_fullsized":"2023-10-09T11:56:57.456878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1570,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303036,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068804,"statfs":{"total":96636764160,"available":96326455296,"internally_reserved":0,"allocated":1691648,"data_stored":1115129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.70799999999999996},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.755},"min":{"1min":0.60299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93899999999999995,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.755},"min":{"1min":0.501,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88800000000000001,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.202},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.53900000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.96799999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.073},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.89300000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.76100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.749}]},{"osd":6,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.04,"5min":1.083,"15min":1.083},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.111,"15min":1.111},"last":0.70699999999999996}]}]},{"osd":6,"up_from":16,"seq":68719476927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94399999999999995,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.121},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.504,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.0049999999999999,"15min":1.216},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.96399999999999997,"5min":1.008,"15min":1.139},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.431},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.1040000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94599999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.68500000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.96699999999999997,"15min":1.7869999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.93600000000000005,"15min":1.143},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82199999999999995,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.437},"max":{"1min":0.88400000000000001,"5min":1.03,"15min":1.506},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.96099999999999997,"5min":0.97499999999999998,"15min":1.2330000000000001},"last":0.80200000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":547327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46500000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.079,"5min":1.079,"15min":1.6759999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.72299999999999998,"15min":1.385},"last":0.503},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.69199999999999995,"5min":0.83199999999999996,"15min":1.099},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.536},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66700000000000004,"5min":0.78000000000000003,"15min":1.272},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.7210000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":1.0660000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":1.202,"15min":1.677},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.0980000000000001,"5min":1.103,"15min":1.778},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0760000000000001,"15min":1.623},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.042,"5min":1.0549999999999999,"15min":1.708},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81799999999999995,"15min":0.83999999999999997},"min":{"1min":0.63900000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1160000000000001,"5min":1.222,"15min":1.659},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1419999999999999,"15min":1.736},"last":0.56499999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1135571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.35599999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.367},"last":0.308},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.4930000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.7130000000000001},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.855},"last":0.436},{"interface":"front","average":{"1min":0.745,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":1.399,"5min":1.587,"15min":1.587},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.997}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54400000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.58599999999999997,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.488,"15min":1.488},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.80500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1899999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2330000000000001,"5min":1.552,"15min":1.552},"last":0.82199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":546739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27600000000000002},"max":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51000000000000001,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.75,"15min":0.83799999999999997},"last":0.374}]},{"osd":1,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.502,"15min":0.496},"min":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.876,"15min":0.97299999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.64800000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.70299999999999996,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.439}]},{"osd":4,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0029999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.97699999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.2270000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.012,"5min":1.216,"15min":1.216},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0269999999999999,"5min":1.204,"15min":1.27},"last":0.98899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.61199999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.98299999999999998,"5min":1.2310000000000001,"15min":1.246},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.022,"5min":1.155,"15min":1.2130000000000001},"last":0.96199999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47899999999999998},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.311},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.34599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.752,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.5}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.151,"5min":1.208,"15min":1.327},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.72499999999999998,"5min":0.63100000000000001,"15min":0.55700000000000005},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.624,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.246,"5min":1.246,"15min":1.2829999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.3660000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.53600000000000003,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.1240000000000001,"15min":1.218},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.333},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.66500000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.3560000000000001},"last":0.55800000000000005}]}]},{"osd":4,"up_from":16,"seq":68719476926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310648,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061192,"statfs":{"total":96636764160,"available":96318660608,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":1.071},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.56699999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":1.4419999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.56299999999999994,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.92300000000000004,"5min":0.95799999999999996,"15min":1.2909999999999999},"last":1.587}]},{"osd":2,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":0.82499999999999996,"5min":0.95399999999999996,"15min":1.0149999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.234},"last":1.419}]},{"osd":3,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84199999999999997,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":1.367},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.745,"15min":0.75900000000000001},"min":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":1.1639999999999999},"last":1.5069999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36099999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0820000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.1140000000000001},"last":1.613}]},{"osd":6,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":1.125},"last":1.5609999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.373},"last":1.6439999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.2410000000000001},"last":1.484},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91400000000000003,"5min":0.997,"15min":1.222},"last":1.5369999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":1097728,"data_stored":524761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.91200000000000003,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.47099999999999997,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.94399999999999995,"5min":1.909,"15min":1.909},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.997,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.44900000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":2.105,"15min":2.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97299999999999998,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.745},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.70499999999999996},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.81699999999999995,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.93000000000000005,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-09T11:57:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-09T11:57:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-09T11:57:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-09T11:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-09T11:57:07.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.863713+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:28:11.015970+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-09T11:57:07.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.859185+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:52:49.298938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.863875+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:11:54.977806+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.858865+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:42:21.719144+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:57:07.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.865066+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.859026+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-09T11:57:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.863506+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:37:27.827833+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.858849+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:42:54.626087+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-09T11:57:07.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.864496+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:35:50.993560+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.862462+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:23:40.488352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.859126+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-09T11:57:07.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.862998+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:05:20.197863+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.859097+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.863640+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:58:33.617318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-09T11:57:07.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.863104+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:48:15.689269+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.862832+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:17:59.164051+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-09T11:57:07.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.861805+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:01:37.414967+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.862423+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:03:04.734221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.861876+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:31:28.521497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-09T11:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.859283+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-09T11:57:07.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.862223+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:37:14.857359+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-09T11:57:07.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:00.855687+0000', 'last_change': '2023-10-09T11:57:00.855687+0000', 'last_active': '2023-10-09T11:57:00.855687+0000', 'last_peered': '2023-10-09T11:57:00.855687+0000', 'last_clean': '2023-10-09T11:57:00.855687+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:00.855687+0000', 'last_undegraded': '2023-10-09T11:57:00.855687+0000', 'last_fullsized': '2023-10-09T11:57:00.855687+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:00.855687+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:07.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-09T11:57:07.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:56:59.847853+0000', 'last_change': '2023-10-09T11:56:59.863411+0000', 'last_active': '2023-10-09T11:56:59.847853+0000', 'last_peered': '2023-10-09T11:56:59.847853+0000', 'last_clean': '2023-10-09T11:56:59.847853+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:56:59.847853+0000', 'last_undegraded': '2023-10-09T11:56:59.847853+0000', 'last_fullsized': '2023-10-09T11:56:59.847853+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'last_clean_scrub_stamp': '2023-10-09T11:56:59.847853+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:45:16.036691+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:07.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:57:07.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.305+0000 7f2eb8fff700 1 Processor -- start 2023-10-09T11:57:07.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.305+0000 7f2eb8fff700 1 -- start start 2023-10-09T11:57:07.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.306+0000 7f2eb8fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2eb40b0ca0 0x7f2eb41568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.306+0000 7f2eb8fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40acf10 0x7f2eb4156e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.306+0000 7f2eb8fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb4153f10 con 0x7f2eb4156510 2023-10-09T11:57:07.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.306+0000 7f2eb8fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb40ad9d0 con 0x7f2eb40b0ca0 2023-10-09T11:57:07.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.306+0000 7f2eb8fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40aed00 con 0x7f2eb40acf10 2023-10-09T11:57:07.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2eb4156510 0x7f2eb40ac800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55640/0 (socket says 172.21.15.86:55640) 2023-10-09T11:57:07.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb259c700 1 -- 172.21.15.86:0/2582788287 learned_addr learned my addr 172.21.15.86:0/2582788287 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:07.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb2d9d700 1 --2- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40acf10 0x7f2eb4156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb1d9b700 1 --2- 172.21.15.86:0/2582788287 >> v2:172.21.15.135:3300/0 conn(0x7f2eb40b0ca0 0x7f2eb41568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb159a700 1 -- 172.21.15.86:0/2582788287 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311573611 0 0) 0x7f2eb4153f10 con 0x7f2eb4156510 2023-10-09T11:57:07.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb159a700 1 -- 172.21.15.86:0/2582788287 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9c003570 con 0x7f2eb4156510 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb159a700 1 -- 172.21.15.86:0/2582788287 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 877650690 0 0) 0x7f2e9c003570 con 0x7f2eb4156510 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb1d9b700 1 -- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40acf10 msgr2=0x7f2eb4156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb1d9b700 1 --2- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40acf10 0x7f2eb4156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.307+0000 7f2eb1d9b700 1 -- 172.21.15.86:0/2582788287 >> v1:172.21.15.86:6789/0 conn(0x7f2eb4156510 legacy=0x7f2eb40ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.308+0000 7f2eb1d9b700 1 -- 172.21.15.86:0/2582788287 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40af800 con 0x7f2eb40b0ca0 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.308+0000 7f2eb2d9d700 1 --2- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40acf10 0x7f2eb4156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.308+0000 7f2eb1d9b700 1 --2- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb40b0ca0 0x7f2eb41568e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009910 tx=0x7f2ea80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d9205a9451cc613 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.308+0000 7f2eb159a700 1 -- 172.21.15.86:0/2582788287 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4001470 con 0x7f2eb40b0ca0 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.308+0000 7f2eb159a700 1 -- 172.21.15.86:0/2582788287 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea8011420 con 0x7f2eb40b0ca0 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.308+0000 7f2eb159a700 1 -- 172.21.15.86:0/2582788287 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80117a0 con 0x7f2eb40b0ca0 2023-10-09T11:57:07.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 -- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb40b0ca0 msgr2=0x7f2eb41568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb40b0ca0 0x7f2eb41568e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009910 tx=0x7f2ea80091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 -- 172.21.15.86:0/2582788287 shutdown_connections 2023-10-09T11:57:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40acf10 0x7f2eb4156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/2582788287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb40b0ca0 0x7f2eb41568e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 -- 172.21.15.86:0/2582788287 >> 172.21.15.86:0/2582788287 conn(0x7f2eb406a310 msgr2=0x7f2eb40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 -- 172.21.15.86:0/2582788287 shutdown_connections 2023-10-09T11:57:07.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.309+0000 7f2eb8fff700 1 -- 172.21.15.86:0/2582788287 wait complete. 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.310+0000 7f2eb8fff700 1 Processor -- start 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.310+0000 7f2eb8fff700 1 -- start start 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.311+0000 7f2eb8fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2eb40acf10 0x7f2eb41523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.311+0000 7f2eb8fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40b0ca0 0x7f2eb406d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.311+0000 7f2eb8fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4156510 0x7f2eb40a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.311+0000 7f2eb8fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4152920 con 0x7f2eb40acf10 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.311+0000 7f2eb8fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb406e200 con 0x7f2eb4156510 2023-10-09T11:57:07.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.311+0000 7f2eb8fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb406e4e0 con 0x7f2eb40b0ca0 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2eb40acf10 0x7f2eb41523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2eb40acf10 0x7f2eb41523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43934/0 (socket says 172.21.15.86:43934) 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 -- 172.21.15.86:0/486536078 learned_addr learned my addr 172.21.15.86:0/486536078 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb2d9d700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4156510 0x7f2eb40a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 -- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40b0ca0 msgr2=0x7f2eb406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40b0ca0 0x7f2eb406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 -- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4156510 msgr2=0x7f2eb40a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4156510 0x7f2eb40a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 -- 172.21.15.86:0/486536078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac009a20 con 0x7f2eb40acf10 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb2d9d700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4156510 0x7f2eb40a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb259c700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2eb40acf10 0x7f2eb41523e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400cb90 tx=0x7f2ea4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:07.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2ea27fc700 1 -- 172.21.15.86:0/486536078 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4001d40 con 0x7f2eb40acf10 2023-10-09T11:57:07.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2ea27fc700 1 -- 172.21.15.86:0/486536078 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4007360 con 0x7f2eb40acf10 2023-10-09T11:57:07.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea8009420 con 0x7f2eb40acf10 2023-10-09T11:57:07.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.312+0000 7f2ea27fc700 1 -- 172.21.15.86:0/486536078 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4004830 con 0x7f2eb40acf10 2023-10-09T11:57:07.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.313+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40a54c0 con 0x7f2eb40acf10 2023-10-09T11:57:07.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.314+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb4068ff0 con 0x7f2eb40acf10 2023-10-09T11:57:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.315+0000 7f2ea27fc700 1 -- 172.21.15.86:0/486536078 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ea4004ba0 con 0x7f2eb40acf10 2023-10-09T11:57:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.316+0000 7f2ea27fc700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2e94066f30 0x7f2e940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.316+0000 7f2ea27fc700 1 -- 172.21.15.86:0/486536078 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f2ea4083f90 con 0x7f2eb40acf10 2023-10-09T11:57:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.316+0000 7f2eb1d9b700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2e94066f30 0x7f2e940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.317+0000 7f2eb1d9b700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2e94066f30 0x7f2e940693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009910 tx=0x7f2ea8016000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:07.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.320+0000 7f2ea27fc700 1 -- 172.21.15.86:0/486536078 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ea4051100 con 0x7f2eb40acf10 2023-10-09T11:57:07.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.589+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2eb404c3c0 con 0x7f2eb40acf10 2023-10-09T11:57:07.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.589+0000 7f2ea27fc700 1 -- 172.21.15.86:0/486536078 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7f2ea4018080 con 0x7f2eb40acf10 2023-10-09T11:57:07.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:07.591 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":980,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":43},{"state_name":"active+clean","count":32},{"state_name":"creating+peering","count":22}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591938,"bytes_used":2491633664,"bytes_avail":770602479616,"bytes_total":773094113280,"unknown_pgs_ratio":0.44329896569252014,"inactive_pgs_ratio":0.22680412232875824,"write_bytes_sec":1562,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6708}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-09T11:55:28.374067+0000","services":{}},"progress_events":{}} 2023-10-09T11:57:07.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2e94066f30 msgr2=0x7f2e940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2e94066f30 0x7f2e940693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009910 tx=0x7f2ea8016000 comp rx=0 tx=0).stop 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2eb40acf10 msgr2=0x7f2eb41523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2eb40acf10 0x7f2eb41523e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400cb90 tx=0x7f2ea4001ab0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 shutdown_connections 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2e94066f30 0x7f2e940693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2eb40acf10 0x7f2eb41523e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2eb4156510 0x7f2eb40a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 --2- 172.21.15.86:0/486536078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2eb40b0ca0 0x7f2eb406d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 >> 172.21.15.86:0/486536078 conn(0x7f2eb406a310 msgr2=0x7f2eb40abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 shutdown_connections 2023-10-09T11:57:07.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.592+0000 7f2eb8fff700 1 -- 172.21.15.86:0/486536078 wait complete. 2023-10-09T11:57:07.610 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:57:07.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:07.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.791+0000 7fd2f43ff700 1 Processor -- start 2023-10-09T11:57:07.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.791+0000 7fd2f43ff700 1 -- start start 2023-10-09T11:57:07.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.792+0000 7fd2f43ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2ec1599e0 0x7fd2ec069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.792+0000 7fd2f43ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec159db0 0x7fd2ec069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.792+0000 7fd2f43ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec0c96a0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f43ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0cb9e0 con 0x7fd2ec1599e0 2023-10-09T11:57:07.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f43ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0cab60 con 0x7fd2ec159db0 2023-10-09T11:57:07.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f219b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2ec1599e0 0x7fd2ec069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f219b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2ec1599e0 0x7fd2ec069ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:33152/0 (socket says 172.21.15.86:33152) 2023-10-09T11:57:07.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f219b700 1 -- 172.21.15.86:0/440665331 learned_addr learned my addr 172.21.15.86:0/440665331 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:07.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f199a700 1 --2- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec159db0 0x7fd2ec069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f219b700 1 -- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec159db0 msgr2=0x7fd2ec069080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:07.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f219b700 1 --2- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec159db0 0x7fd2ec069080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f219b700 1 -- 172.21.15.86:0/440665331 >> v1:172.21.15.135:6789/0 conn(0x7fd2ec06a2b0 legacy=0x7fd2ec06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.793+0000 7fd2f219b700 1 -- 172.21.15.86:0/440665331 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0cb420 con 0x7fd2ec1599e0 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.794+0000 7fd2f219b700 1 --2- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec1599e0 0x7fd2ec069ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80099b0 tx=0x7fd2e8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=558cd424cb45a00c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.794+0000 7fd2f1199700 1 -- 172.21.15.86:0/440665331 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8009ea0 con 0x7fd2ec1599e0 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.794+0000 7fd2f1199700 1 -- 172.21.15.86:0/440665331 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800b860 con 0x7fd2ec1599e0 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.794+0000 7fd2f1199700 1 -- 172.21.15.86:0/440665331 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e800bc00 con 0x7fd2ec1599e0 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.794+0000 7fd2f43ff700 1 -- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec1599e0 msgr2=0x7fd2ec069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.794+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec1599e0 0x7fd2ec069ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80099b0 tx=0x7fd2e8009250 comp rx=0 tx=0).stop 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.795+0000 7fd2f43ff700 1 -- 172.21.15.86:0/440665331 shutdown_connections 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.795+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec1599e0 0x7fd2ec069ac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.795+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/440665331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec159db0 0x7fd2ec069080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.795+0000 7fd2f43ff700 1 -- 172.21.15.86:0/440665331 >> 172.21.15.86:0/440665331 conn(0x7fd2ec0c9860 msgr2=0x7fd2ec0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.795+0000 7fd2f43ff700 1 -- 172.21.15.86:0/440665331 shutdown_connections 2023-10-09T11:57:07.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.795+0000 7fd2f43ff700 1 -- 172.21.15.86:0/440665331 wait complete. 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.796+0000 7fd2f43ff700 1 Processor -- start 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.796+0000 7fd2f43ff700 1 -- start start 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f43ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2ec06a2b0 0x7fd2ec15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f43ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec1599e0 0x7fd2ec15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f43ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec159db0 0x7fd2ec0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f43ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec16add0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f43ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec14c400 con 0x7fd2ec159db0 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f43ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec16a250 con 0x7fd2ec1599e0 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f219b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2ec06a2b0 0x7fd2ec15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f219b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2ec06a2b0 0x7fd2ec15cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43940/0 (socket says 172.21.15.86:43940) 2023-10-09T11:57:07.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f219b700 1 -- 172.21.15.86:0/2631277360 learned_addr learned my addr 172.21.15.86:0/2631277360 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f199a700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec1599e0 0x7fd2ec15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.797+0000 7fd2f299c700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec159db0 0x7fd2ec0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f219b700 1 -- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec1599e0 msgr2=0x7fd2ec15c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f219b700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec1599e0 0x7fd2ec15c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f219b700 1 -- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec159db0 msgr2=0x7fd2ec0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f219b700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec159db0 0x7fd2ec0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f219b700 1 -- 172.21.15.86:0/2631277360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80094f0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f219b700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2ec06a2b0 0x7fd2ec15cc50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec06d6b0 tx=0x7fd2e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2e27fc700 1 -- 172.21.15.86:0/2631277360 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8000d10 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2e27fc700 1 -- 172.21.15.86:0/2631277360 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800bbe0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2e27fc700 1 -- 172.21.15.86:0/2631277360 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8011670 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec16a530 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.798+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec16aaf0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.799+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec04c3c0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.800+0000 7fd2e27fc700 1 -- 172.21.15.86:0/2631277360 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2e8011aa0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.801+0000 7fd2e27fc700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd2d0066f30 0x7fd2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:07.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.801+0000 7fd2e27fc700 1 -- 172.21.15.86:0/2631277360 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fd2e8085f60 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.801+0000 7fd2f199a700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd2d0066f30 0x7fd2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:07.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.802+0000 7fd2f199a700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd2d0066f30 0x7fd2d00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec15aa20 tx=0x7fd2dc0091a0 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:07.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.805+0000 7fd2e27fc700 1 -- 172.21.15.86:0/2631277360 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2e8052fb0 con 0x7fd2ec06a2b0 2023-10-09T11:57:07.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.990+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2ec0cb700 con 0x7fd2d0066f30 2023-10-09T11:57:07.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:07.998+0000 7fd2e27fc700 1 -- 172.21.15.86:0/2631277360 <== mgr.6507 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289221 (secure 0 0 0) 0x7fd2ec0cb700 con 0x7fd2d0066f30 2023-10-09T11:57:08.003 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd2d0066f30 msgr2=0x7fd2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd2d0066f30 0x7fd2d00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec15aa20 tx=0x7fd2dc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2ec06a2b0 msgr2=0x7fd2ec15cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2ec06a2b0 0x7fd2ec15cc50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec06d6b0 tx=0x7fd2e8017000 comp rx=0 tx=0).stop 2023-10-09T11:57:08.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 shutdown_connections 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd2d0066f30 0x7fd2d00693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2ec06a2b0 0x7fd2ec15cc50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2ec159db0 0x7fd2ec0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 --2- 172.21.15.86:0/2631277360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2ec1599e0 0x7fd2ec15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 >> 172.21.15.86:0/2631277360 conn(0x7fd2ec0c9860 msgr2=0x7fd2ec06b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 shutdown_connections 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:08.002+0000 7fd2f43ff700 1 -- 172.21.15.86:0/2631277360 wait complete. 2023-10-09T11:57:08.006 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:08.021 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:57:07.755207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433448,"kb_used_data":10088,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541272,"statfs":{"total":773094113280,"available":770602262528,"internally_reserved":0,"allocated":10330112,"data_stored":5546972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.895169"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907939+0000","last_change":"2023-10-09T11:57:01.899719+0000","last_active":"2023-10-09T11:57:01.907939+0000","last_peered":"2023-10-09T11:57:01.907939+0000","last_clean":"2023-10-09T11:57:01.907939+0000","last_became_active":"2023-10-09T11:57:01.899438+0000","last_became_peered":"2023-10-09T11:57:01.899438+0000","last_unstale":"2023-10-09T11:57:01.907939+0000","last_undegraded":"2023-10-09T11:57:01.907939+0000","last_fullsized":"2023-10-09T11:57:01.907939+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:09.220381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.900585+0000","last_change":"2023-10-09T11:57:01.897129+0000","last_active":"2023-10-09T11:57:01.900585+0000","last_peered":"2023-10-09T11:57:01.900585+0000","last_clean":"2023-10-09T11:57:01.900585+0000","last_became_active":"2023-10-09T11:57:01.896192+0000","last_became_peered":"2023-10-09T11:57:01.896192+0000","last_unstale":"2023-10-09T11:57:01.900585+0000","last_undegraded":"2023-10-09T11:57:01.900585+0000","last_fullsized":"2023-10-09T11:57:01.900585+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:41.514720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903687+0000","last_change":"2023-10-09T11:57:01.895577+0000","last_active":"2023-10-09T11:57:01.903687+0000","last_peered":"2023-10-09T11:57:01.903687+0000","last_clean":"2023-10-09T11:57:01.903687+0000","last_became_active":"2023-10-09T11:57:01.895289+0000","last_became_peered":"2023-10-09T11:57:01.895289+0000","last_unstale":"2023-10-09T11:57:01.903687+0000","last_undegraded":"2023-10-09T11:57:01.903687+0000","last_fullsized":"2023-10-09T11:57:01.903687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:53:11.061942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907058+0000","last_change":"2023-10-09T11:57:01.904421+0000","last_active":"2023-10-09T11:57:01.907058+0000","last_peered":"2023-10-09T11:57:01.907058+0000","last_clean":"2023-10-09T11:57:01.907058+0000","last_became_active":"2023-10-09T11:57:01.904142+0000","last_became_peered":"2023-10-09T11:57:01.904142+0000","last_unstale":"2023-10-09T11:57:01.907058+0000","last_undegraded":"2023-10-09T11:57:01.907058+0000","last_fullsized":"2023-10-09T11:57:01.907058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:52.001394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.899597+0000","last_change":"2023-10-09T11:57:01.895405+0000","last_active":"2023-10-09T11:57:01.899597+0000","last_peered":"2023-10-09T11:57:01.899597+0000","last_clean":"2023-10-09T11:57:01.899597+0000","last_became_active":"2023-10-09T11:57:01.895154+0000","last_became_peered":"2023-10-09T11:57:01.895154+0000","last_unstale":"2023-10-09T11:57:01.899597+0000","last_undegraded":"2023-10-09T11:57:01.899597+0000","last_fullsized":"2023-10-09T11:57:01.899597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:45.839001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904661+0000","last_change":"2023-10-09T11:57:01.898658+0000","last_active":"2023-10-09T11:57:01.904661+0000","last_peered":"2023-10-09T11:57:01.904661+0000","last_clean":"2023-10-09T11:57:01.904661+0000","last_became_active":"2023-10-09T11:57:01.898369+0000","last_became_peered":"2023-10-09T11:57:01.898369+0000","last_unstale":"2023-10-09T11:57:01.904661+0000","last_undegraded":"2023-10-09T11:57:01.904661+0000","last_fullsized":"2023-10-09T11:57:01.904661+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:12.023804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898451+0000","last_change":"2023-10-09T11:57:01.891512+0000","last_active":"2023-10-09T11:57:01.898451+0000","last_peered":"2023-10-09T11:57:01.898451+0000","last_clean":"2023-10-09T11:57:01.898451+0000","last_became_active":"2023-10-09T11:57:01.891174+0000","last_became_peered":"2023-10-09T11:57:01.891174+0000","last_unstale":"2023-10-09T11:57:01.898451+0000","last_undegraded":"2023-10-09T11:57:01.898451+0000","last_fullsized":"2023-10-09T11:57:01.898451+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.067477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906079+0000","last_change":"2023-10-09T11:57:01.902323+0000","last_active":"2023-10-09T11:57:01.906079+0000","last_peered":"2023-10-09T11:57:01.906079+0000","last_clean":"2023-10-09T11:57:01.906079+0000","last_became_active":"2023-10-09T11:57:01.902049+0000","last_became_peered":"2023-10-09T11:57:01.902049+0000","last_unstale":"2023-10-09T11:57:01.906079+0000","last_undegraded":"2023-10-09T11:57:01.906079+0000","last_fullsized":"2023-10-09T11:57:01.906079+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:09.494720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905103+0000","last_change":"2023-10-09T11:57:01.902364+0000","last_active":"2023-10-09T11:57:01.905103+0000","last_peered":"2023-10-09T11:57:01.905103+0000","last_clean":"2023-10-09T11:57:01.905103+0000","last_became_active":"2023-10-09T11:57:01.902081+0000","last_became_peered":"2023-10-09T11:57:01.902081+0000","last_unstale":"2023-10-09T11:57:01.905103+0000","last_undegraded":"2023-10-09T11:57:01.905103+0000","last_fullsized":"2023-10-09T11:57:01.905103+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:44.084236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.894957+0000","last_change":"2023-10-09T11:57:01.891902+0000","last_active":"2023-10-09T11:57:01.894957+0000","last_peered":"2023-10-09T11:57:01.894957+0000","last_clean":"2023-10-09T11:57:01.894957+0000","last_became_active":"2023-10-09T11:57:01.891535+0000","last_became_peered":"2023-10-09T11:57:01.891535+0000","last_unstale":"2023-10-09T11:57:01.894957+0000","last_undegraded":"2023-10-09T11:57:01.894957+0000","last_fullsized":"2023-10-09T11:57:01.894957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:44:37.971898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898247+0000","last_change":"2023-10-09T11:57:01.894728+0000","last_active":"2023-10-09T11:57:01.898247+0000","last_peered":"2023-10-09T11:57:01.898247+0000","last_clean":"2023-10-09T11:57:01.898247+0000","last_became_active":"2023-10-09T11:57:01.894077+0000","last_became_peered":"2023-10-09T11:57:01.894077+0000","last_unstale":"2023-10-09T11:57:01.898247+0000","last_undegraded":"2023-10-09T11:57:01.898247+0000","last_fullsized":"2023-10-09T11:57:01.898247+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:49.373263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895914+0000","last_change":"2023-10-09T11:57:01.892465+0000","last_active":"2023-10-09T11:57:01.895914+0000","last_peered":"2023-10-09T11:57:01.895914+0000","last_clean":"2023-10-09T11:57:01.895914+0000","last_became_active":"2023-10-09T11:57:01.892212+0000","last_became_peered":"2023-10-09T11:57:01.892212+0000","last_unstale":"2023-10-09T11:57:01.895914+0000","last_undegraded":"2023-10-09T11:57:01.895914+0000","last_fullsized":"2023-10-09T11:57:01.895914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:34.625153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904888+0000","last_change":"2023-10-09T11:57:01.899702+0000","last_active":"2023-10-09T11:57:01.904888+0000","last_peered":"2023-10-09T11:57:01.904888+0000","last_clean":"2023-10-09T11:57:01.904888+0000","last_became_active":"2023-10-09T11:57:01.899445+0000","last_became_peered":"2023-10-09T11:57:01.899445+0000","last_unstale":"2023-10-09T11:57:01.904888+0000","last_undegraded":"2023-10-09T11:57:01.904888+0000","last_fullsized":"2023-10-09T11:57:01.904888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:21.097692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.893987+0000","last_change":"2023-10-09T11:57:01.891259+0000","last_active":"2023-10-09T11:57:01.893987+0000","last_peered":"2023-10-09T11:57:01.893987+0000","last_clean":"2023-10-09T11:57:01.893987+0000","last_became_active":"2023-10-09T11:57:01.891009+0000","last_became_peered":"2023-10-09T11:57:01.891009+0000","last_unstale":"2023-10-09T11:57:01.893987+0000","last_undegraded":"2023-10-09T11:57:01.893987+0000","last_fullsized":"2023-10-09T11:57:01.893987+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:17.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897168+0000","last_change":"2023-10-09T11:57:01.894384+0000","last_active":"2023-10-09T11:57:01.897168+0000","last_peered":"2023-10-09T11:57:01.897168+0000","last_clean":"2023-10-09T11:57:01.897168+0000","last_became_active":"2023-10-09T11:57:01.894030+0000","last_became_peered":"2023-10-09T11:57:01.894030+0000","last_unstale":"2023-10-09T11:57:01.897168+0000","last_undegraded":"2023-10-09T11:57:01.897168+0000","last_fullsized":"2023-10-09T11:57:01.897168+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:22.726979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.909621+0000","last_change":"2023-10-09T11:57:01.907272+0000","last_active":"2023-10-09T11:57:01.909621+0000","last_peered":"2023-10-09T11:57:01.909621+0000","last_clean":"2023-10-09T11:57:01.909621+0000","last_became_active":"2023-10-09T11:57:01.907012+0000","last_became_peered":"2023-10-09T11:57:01.907012+0000","last_unstale":"2023-10-09T11:57:01.909621+0000","last_undegraded":"2023-10-09T11:57:01.909621+0000","last_fullsized":"2023-10-09T11:57:01.909621+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:31.145330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904781+0000","last_change":"2023-10-09T11:57:01.899804+0000","last_active":"2023-10-09T11:57:01.904781+0000","last_peered":"2023-10-09T11:57:01.904781+0000","last_clean":"2023-10-09T11:57:01.904781+0000","last_became_active":"2023-10-09T11:57:01.899555+0000","last_became_peered":"2023-10-09T11:57:01.899555+0000","last_unstale":"2023-10-09T11:57:01.904781+0000","last_undegraded":"2023-10-09T11:57:01.904781+0000","last_fullsized":"2023-10-09T11:57:01.904781+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:59.402274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906680+0000","last_change":"2023-10-09T11:57:01.904151+0000","last_active":"2023-10-09T11:57:01.906680+0000","last_peered":"2023-10-09T11:57:01.906680+0000","last_clean":"2023-10-09T11:57:01.906680+0000","last_became_active":"2023-10-09T11:57:01.903816+0000","last_became_peered":"2023-10-09T11:57:01.903816+0000","last_unstale":"2023-10-09T11:57:01.906680+0000","last_undegraded":"2023-10-09T11:57:01.906680+0000","last_fullsized":"2023-10-09T11:57:01.906680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:35.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906114+0000","last_change":"2023-10-09T11:57:01.902016+0000","last_active":"2023-10-09T11:57:01.906114+0000","last_peered":"2023-10-09T11:57:01.906114+0000","last_clean":"2023-10-09T11:57:01.906114+0000","last_became_active":"2023-10-09T11:57:01.901714+0000","last_became_peered":"2023-10-09T11:57:01.901714+0000","last_unstale":"2023-10-09T11:57:01.906114+0000","last_undegraded":"2023-10-09T11:57:01.906114+0000","last_fullsized":"2023-10-09T11:57:01.906114+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:07.153758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.888244+0000","last_change":"2023-10-09T11:57:01.886855+0000","last_active":"2023-10-09T11:57:01.888244+0000","last_peered":"2023-10-09T11:57:01.888244+0000","last_clean":"2023-10-09T11:57:01.888244+0000","last_became_active":"2023-10-09T11:57:01.886601+0000","last_became_peered":"2023-10-09T11:57:01.886601+0000","last_unstale":"2023-10-09T11:57:01.888244+0000","last_undegraded":"2023-10-09T11:57:01.888244+0000","last_fullsized":"2023-10-09T11:57:01.888244+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:06.251475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.892019+0000","last_change":"2023-10-09T11:57:01.888835+0000","last_active":"2023-10-09T11:57:01.892019+0000","last_peered":"2023-10-09T11:57:01.892019+0000","last_clean":"2023-10-09T11:57:01.892019+0000","last_became_active":"2023-10-09T11:57:01.888465+0000","last_became_peered":"2023-10-09T11:57:01.888465+0000","last_unstale":"2023-10-09T11:57:01.892019+0000","last_undegraded":"2023-10-09T11:57:01.892019+0000","last_fullsized":"2023-10-09T11:57:01.892019+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:38.442046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895342+0000","last_change":"2023-10-09T11:57:01.892858+0000","last_active":"2023-10-09T11:57:01.895342+0000","last_peered":"2023-10-09T11:57:01.895342+0000","last_clean":"2023-10-09T11:57:01.895342+0000","last_became_active":"2023-10-09T11:57:01.892579+0000","last_became_peered":"2023-10-09T11:57:01.892579+0000","last_unstale":"2023-10-09T11:57:01.895342+0000","last_undegraded":"2023-10-09T11:57:01.895342+0000","last_fullsized":"2023-10-09T11:57:01.895342+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:33.832209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896878+0000","last_change":"2023-10-09T11:57:01.893534+0000","last_active":"2023-10-09T11:57:01.896878+0000","last_peered":"2023-10-09T11:57:01.896878+0000","last_clean":"2023-10-09T11:57:01.896878+0000","last_became_active":"2023-10-09T11:57:01.893232+0000","last_became_peered":"2023-10-09T11:57:01.893232+0000","last_unstale":"2023-10-09T11:57:01.896878+0000","last_undegraded":"2023-10-09T11:57:01.896878+0000","last_fullsized":"2023-10-09T11:57:01.896878+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:32.714033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905113+0000","last_change":"2023-10-09T11:57:01.900461+0000","last_active":"2023-10-09T11:57:01.905113+0000","last_peered":"2023-10-09T11:57:01.905113+0000","last_clean":"2023-10-09T11:57:01.905113+0000","last_became_active":"2023-10-09T11:57:01.900120+0000","last_became_peered":"2023-10-09T11:57:01.900120+0000","last_unstale":"2023-10-09T11:57:01.905113+0000","last_undegraded":"2023-10-09T11:57:01.905113+0000","last_fullsized":"2023-10-09T11:57:01.905113+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:30.432171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.901047+0000","last_change":"2023-10-09T11:57:01.897211+0000","last_active":"2023-10-09T11:57:01.901047+0000","last_peered":"2023-10-09T11:57:01.901047+0000","last_clean":"2023-10-09T11:57:01.901047+0000","last_became_active":"2023-10-09T11:57:01.896917+0000","last_became_peered":"2023-10-09T11:57:01.896917+0000","last_unstale":"2023-10-09T11:57:01.901047+0000","last_undegraded":"2023-10-09T11:57:01.901047+0000","last_fullsized":"2023-10-09T11:57:01.901047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:13.655438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902954+0000","last_change":"2023-10-09T11:57:01.899654+0000","last_active":"2023-10-09T11:57:01.902954+0000","last_peered":"2023-10-09T11:57:01.902954+0000","last_clean":"2023-10-09T11:57:01.902954+0000","last_became_active":"2023-10-09T11:57:01.899356+0000","last_became_peered":"2023-10-09T11:57:01.899356+0000","last_unstale":"2023-10-09T11:57:01.902954+0000","last_undegraded":"2023-10-09T11:57:01.902954+0000","last_fullsized":"2023-10-09T11:57:01.902954+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:16.697104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903705+0000","last_change":"2023-10-09T11:57:01.899841+0000","last_active":"2023-10-09T11:57:01.903705+0000","last_peered":"2023-10-09T11:57:01.903705+0000","last_clean":"2023-10-09T11:57:01.903705+0000","last_became_active":"2023-10-09T11:57:01.899572+0000","last_became_peered":"2023-10-09T11:57:01.899572+0000","last_unstale":"2023-10-09T11:57:01.903705+0000","last_undegraded":"2023-10-09T11:57:01.903705+0000","last_fullsized":"2023-10-09T11:57:01.903705+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:36.026475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895381+0000","last_change":"2023-10-09T11:57:01.892715+0000","last_active":"2023-10-09T11:57:01.895381+0000","last_peered":"2023-10-09T11:57:01.895381+0000","last_clean":"2023-10-09T11:57:01.895381+0000","last_became_active":"2023-10-09T11:57:01.892418+0000","last_became_peered":"2023-10-09T11:57:01.892418+0000","last_unstale":"2023-10-09T11:57:01.895381+0000","last_undegraded":"2023-10-09T11:57:01.895381+0000","last_fullsized":"2023-10-09T11:57:01.895381+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:21.422159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903213+0000","last_change":"2023-10-09T11:57:01.897051+0000","last_active":"2023-10-09T11:57:01.903213+0000","last_peered":"2023-10-09T11:57:01.903213+0000","last_clean":"2023-10-09T11:57:01.903213+0000","last_became_active":"2023-10-09T11:57:01.896801+0000","last_became_peered":"2023-10-09T11:57:01.896801+0000","last_unstale":"2023-10-09T11:57:01.903213+0000","last_undegraded":"2023-10-09T11:57:01.903213+0000","last_fullsized":"2023-10-09T11:57:01.903213+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:23.163786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903370+0000","last_change":"2023-10-09T11:57:01.899475+0000","last_active":"2023-10-09T11:57:01.903370+0000","last_peered":"2023-10-09T11:57:01.903370+0000","last_clean":"2023-10-09T11:57:01.903370+0000","last_became_active":"2023-10-09T11:57:01.899189+0000","last_became_peered":"2023-10-09T11:57:01.899189+0000","last_unstale":"2023-10-09T11:57:01.903370+0000","last_undegraded":"2023-10-09T11:57:01.903370+0000","last_fullsized":"2023-10-09T11:57:01.903370+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:42.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898469+0000","last_change":"2023-10-09T11:57:01.892806+0000","last_active":"2023-10-09T11:57:01.898469+0000","last_peered":"2023-10-09T11:57:01.898469+0000","last_clean":"2023-10-09T11:57:01.898469+0000","last_became_active":"2023-10-09T11:57:01.892495+0000","last_became_peered":"2023-10-09T11:57:01.892495+0000","last_unstale":"2023-10-09T11:57:01.898469+0000","last_undegraded":"2023-10-09T11:57:01.898469+0000","last_fullsized":"2023-10-09T11:57:01.898469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:11.810735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905855+0000","last_change":"2023-10-09T11:57:01.901639+0000","last_active":"2023-10-09T11:57:01.905855+0000","last_peered":"2023-10-09T11:57:01.905855+0000","last_clean":"2023-10-09T11:57:01.905855+0000","last_became_active":"2023-10-09T11:57:01.901391+0000","last_became_peered":"2023-10-09T11:57:01.901391+0000","last_unstale":"2023-10-09T11:57:01.905855+0000","last_undegraded":"2023-10-09T11:57:01.905855+0000","last_fullsized":"2023-10-09T11:57:01.905855+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:39:55.834965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903877+0000","last_change":"2023-10-09T11:57:01.899715+0000","last_active":"2023-10-09T11:57:01.903877+0000","last_peered":"2023-10-09T11:57:01.903877+0000","last_clean":"2023-10-09T11:57:01.903877+0000","last_became_active":"2023-10-09T11:57:01.899367+0000","last_became_peered":"2023-10-09T11:57:01.899367+0000","last_unstale":"2023-10-09T11:57:01.903877+0000","last_undegraded":"2023-10-09T11:57:01.903877+0000","last_fullsized":"2023-10-09T11:57:01.903877+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:37.045739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.910186+0000","last_change":"2023-10-09T11:57:00.888942+0000","last_active":"2023-10-09T11:57:01.910186+0000","last_peered":"2023-10-09T11:57:01.910186+0000","last_clean":"2023-10-09T11:57:01.910186+0000","last_became_active":"2023-10-09T11:57:00.888631+0000","last_became_peered":"2023-10-09T11:57:00.888631+0000","last_unstale":"2023-10-09T11:57:01.910186+0000","last_undegraded":"2023-10-09T11:57:01.910186+0000","last_fullsized":"2023-10-09T11:57:01.910186+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:36.039260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905084+0000","last_change":"2023-10-09T11:57:01.900417+0000","last_active":"2023-10-09T11:57:01.905084+0000","last_peered":"2023-10-09T11:57:01.905084+0000","last_clean":"2023-10-09T11:57:01.905084+0000","last_became_active":"2023-10-09T11:57:01.900179+0000","last_became_peered":"2023-10-09T11:57:01.900179+0000","last_unstale":"2023-10-09T11:57:01.905084+0000","last_undegraded":"2023-10-09T11:57:01.905084+0000","last_fullsized":"2023-10-09T11:57:01.905084+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:03.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907728+0000","last_change":"2023-10-09T11:57:00.878267+0000","last_active":"2023-10-09T11:57:01.907728+0000","last_peered":"2023-10-09T11:57:01.907728+0000","last_clean":"2023-10-09T11:57:01.907728+0000","last_became_active":"2023-10-09T11:57:00.877902+0000","last_became_peered":"2023-10-09T11:57:00.877902+0000","last_unstale":"2023-10-09T11:57:01.907728+0000","last_undegraded":"2023-10-09T11:57:01.907728+0000","last_fullsized":"2023-10-09T11:57:01.907728+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:44.647321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902915+0000","last_change":"2023-10-09T11:57:01.899719+0000","last_active":"2023-10-09T11:57:01.902915+0000","last_peered":"2023-10-09T11:57:01.902915+0000","last_clean":"2023-10-09T11:57:01.902915+0000","last_became_active":"2023-10-09T11:57:01.899475+0000","last_became_peered":"2023-10-09T11:57:01.899475+0000","last_unstale":"2023-10-09T11:57:01.902915+0000","last_undegraded":"2023-10-09T11:57:01.902915+0000","last_fullsized":"2023-10-09T11:57:01.902915+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:10.816559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912869+0000","last_change":"2023-10-09T11:57:00.882066+0000","last_active":"2023-10-09T11:57:01.912869+0000","last_peered":"2023-10-09T11:57:01.912869+0000","last_clean":"2023-10-09T11:57:01.912869+0000","last_became_active":"2023-10-09T11:57:00.880988+0000","last_became_peered":"2023-10-09T11:57:00.880988+0000","last_unstale":"2023-10-09T11:57:01.912869+0000","last_undegraded":"2023-10-09T11:57:01.912869+0000","last_fullsized":"2023-10-09T11:57:01.912869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:05:20.197863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895219+0000","last_change":"2023-10-09T11:57:01.888086+0000","last_active":"2023-10-09T11:57:01.895219+0000","last_peered":"2023-10-09T11:57:01.895219+0000","last_clean":"2023-10-09T11:57:01.895219+0000","last_became_active":"2023-10-09T11:57:01.887785+0000","last_became_peered":"2023-10-09T11:57:01.887785+0000","last_unstale":"2023-10-09T11:57:01.895219+0000","last_undegraded":"2023-10-09T11:57:01.895219+0000","last_fullsized":"2023-10-09T11:57:01.895219+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:29.531258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912111+0000","last_change":"2023-10-09T11:57:00.883824+0000","last_active":"2023-10-09T11:57:01.912111+0000","last_peered":"2023-10-09T11:57:01.912111+0000","last_clean":"2023-10-09T11:57:01.912111+0000","last_became_active":"2023-10-09T11:57:00.883236+0000","last_became_peered":"2023-10-09T11:57:00.883236+0000","last_unstale":"2023-10-09T11:57:01.912111+0000","last_undegraded":"2023-10-09T11:57:01.912111+0000","last_fullsized":"2023-10-09T11:57:01.912111+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.543195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903389+0000","last_change":"2023-10-09T11:57:01.900090+0000","last_active":"2023-10-09T11:57:01.903389+0000","last_peered":"2023-10-09T11:57:01.903389+0000","last_clean":"2023-10-09T11:57:01.903389+0000","last_became_active":"2023-10-09T11:57:01.899793+0000","last_became_peered":"2023-10-09T11:57:01.899793+0000","last_unstale":"2023-10-09T11:57:01.903389+0000","last_undegraded":"2023-10-09T11:57:01.903389+0000","last_fullsized":"2023-10-09T11:57:01.903389+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:06.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907589+0000","last_change":"2023-10-09T11:57:00.879590+0000","last_active":"2023-10-09T11:57:01.907589+0000","last_peered":"2023-10-09T11:57:01.907589+0000","last_clean":"2023-10-09T11:57:01.907589+0000","last_became_active":"2023-10-09T11:57:00.879341+0000","last_became_peered":"2023-10-09T11:57:00.879341+0000","last_unstale":"2023-10-09T11:57:01.907589+0000","last_undegraded":"2023-10-09T11:57:01.907589+0000","last_fullsized":"2023-10-09T11:57:01.907589+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:36.780952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898650+0000","last_change":"2023-10-09T11:57:01.896371+0000","last_active":"2023-10-09T11:57:01.898650+0000","last_peered":"2023-10-09T11:57:01.898650+0000","last_clean":"2023-10-09T11:57:01.898650+0000","last_became_active":"2023-10-09T11:57:01.896126+0000","last_became_peered":"2023-10-09T11:57:01.896126+0000","last_unstale":"2023-10-09T11:57:01.898650+0000","last_undegraded":"2023-10-09T11:57:01.898650+0000","last_fullsized":"2023-10-09T11:57:01.898650+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:07.551030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912165+0000","last_change":"2023-10-09T11:57:00.887038+0000","last_active":"2023-10-09T11:57:01.912165+0000","last_peered":"2023-10-09T11:57:01.912165+0000","last_clean":"2023-10-09T11:57:01.912165+0000","last_became_active":"2023-10-09T11:57:00.886351+0000","last_became_peered":"2023-10-09T11:57:00.886351+0000","last_unstale":"2023-10-09T11:57:01.912165+0000","last_undegraded":"2023-10-09T11:57:01.912165+0000","last_fullsized":"2023-10-09T11:57:01.912165+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:20.414324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895473+0000","last_change":"2023-10-09T11:57:01.889203+0000","last_active":"2023-10-09T11:57:01.895473+0000","last_peered":"2023-10-09T11:57:01.895473+0000","last_clean":"2023-10-09T11:57:01.895473+0000","last_became_active":"2023-10-09T11:57:01.888942+0000","last_became_peered":"2023-10-09T11:57:01.888942+0000","last_unstale":"2023-10-09T11:57:01.895473+0000","last_undegraded":"2023-10-09T11:57:01.895473+0000","last_fullsized":"2023-10-09T11:57:01.895473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:25.627287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877931+0000","last_change":"2023-10-09T11:57:00.875698+0000","last_active":"2023-10-09T11:57:01.877931+0000","last_peered":"2023-10-09T11:57:01.877931+0000","last_clean":"2023-10-09T11:57:01.877931+0000","last_became_active":"2023-10-09T11:57:00.875321+0000","last_became_peered":"2023-10-09T11:57:00.875321+0000","last_unstale":"2023-10-09T11:57:01.877931+0000","last_undegraded":"2023-10-09T11:57:01.877931+0000","last_fullsized":"2023-10-09T11:57:01.877931+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897543+0000","last_change":"2023-10-09T11:57:01.896694+0000","last_active":"2023-10-09T11:57:01.897543+0000","last_peered":"2023-10-09T11:57:01.897543+0000","last_clean":"2023-10-09T11:57:01.897543+0000","last_became_active":"2023-10-09T11:57:01.896409+0000","last_became_peered":"2023-10-09T11:57:01.896409+0000","last_unstale":"2023-10-09T11:57:01.897543+0000","last_undegraded":"2023-10-09T11:57:01.897543+0000","last_fullsized":"2023-10-09T11:57:01.897543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:37.788787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.883973+0000","last_change":"2023-10-09T11:57:00.873054+0000","last_active":"2023-10-09T11:57:01.883973+0000","last_peered":"2023-10-09T11:57:01.883973+0000","last_clean":"2023-10-09T11:57:01.883973+0000","last_became_active":"2023-10-09T11:57:00.872753+0000","last_became_peered":"2023-10-09T11:57:00.872753+0000","last_unstale":"2023-10-09T11:57:01.883973+0000","last_undegraded":"2023-10-09T11:57:01.883973+0000","last_fullsized":"2023-10-09T11:57:01.883973+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:27.215974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902935+0000","last_change":"2023-10-09T11:57:01.899089+0000","last_active":"2023-10-09T11:57:01.902935+0000","last_peered":"2023-10-09T11:57:01.902935+0000","last_clean":"2023-10-09T11:57:01.902935+0000","last_became_active":"2023-10-09T11:57:01.898828+0000","last_became_peered":"2023-10-09T11:57:01.898828+0000","last_unstale":"2023-10-09T11:57:01.902935+0000","last_undegraded":"2023-10-09T11:57:01.902935+0000","last_fullsized":"2023-10-09T11:57:01.902935+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:39:55.834965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.879781+0000","last_change":"2023-10-09T11:57:00.877305+0000","last_active":"2023-10-09T11:57:01.879781+0000","last_peered":"2023-10-09T11:57:01.879781+0000","last_clean":"2023-10-09T11:57:01.879781+0000","last_became_active":"2023-10-09T11:57:00.877042+0000","last_became_peered":"2023-10-09T11:57:00.877042+0000","last_unstale":"2023-10-09T11:57:01.879781+0000","last_undegraded":"2023-10-09T11:57:01.879781+0000","last_fullsized":"2023-10-09T11:57:01.879781+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:04.734221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907957+0000","last_change":"2023-10-09T11:57:01.901274+0000","last_active":"2023-10-09T11:57:01.907957+0000","last_peered":"2023-10-09T11:57:01.907957+0000","last_clean":"2023-10-09T11:57:01.907957+0000","last_became_active":"2023-10-09T11:57:01.900960+0000","last_became_peered":"2023-10-09T11:57:01.900960+0000","last_unstale":"2023-10-09T11:57:01.907957+0000","last_undegraded":"2023-10-09T11:57:01.907957+0000","last_fullsized":"2023-10-09T11:57:01.907957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:11.791315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.891248+0000","last_change":"2023-10-09T11:57:00.884784+0000","last_active":"2023-10-09T11:57:01.891248+0000","last_peered":"2023-10-09T11:57:01.891248+0000","last_clean":"2023-10-09T11:57:01.891248+0000","last_became_active":"2023-10-09T11:57:00.884529+0000","last_became_peered":"2023-10-09T11:57:00.884529+0000","last_unstale":"2023-10-09T11:57:01.891248+0000","last_undegraded":"2023-10-09T11:57:01.891248+0000","last_fullsized":"2023-10-09T11:57:01.891248+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:28.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902898+0000","last_change":"2023-10-09T11:57:01.898096+0000","last_active":"2023-10-09T11:57:01.902898+0000","last_peered":"2023-10-09T11:57:01.902898+0000","last_clean":"2023-10-09T11:57:01.902898+0000","last_became_active":"2023-10-09T11:57:01.897528+0000","last_became_peered":"2023-10-09T11:57:01.897528+0000","last_unstale":"2023-10-09T11:57:01.902898+0000","last_undegraded":"2023-10-09T11:57:01.902898+0000","last_fullsized":"2023-10-09T11:57:01.902898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:16.697104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907711+0000","last_change":"2023-10-09T11:57:00.878261+0000","last_active":"2023-10-09T11:57:01.907711+0000","last_peered":"2023-10-09T11:57:01.907711+0000","last_clean":"2023-10-09T11:57:01.907711+0000","last_became_active":"2023-10-09T11:57:00.877980+0000","last_became_peered":"2023-10-09T11:57:00.877980+0000","last_unstale":"2023-10-09T11:57:01.907711+0000","last_undegraded":"2023-10-09T11:57:01.907711+0000","last_fullsized":"2023-10-09T11:57:01.907711+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:20.720615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897902+0000","last_change":"2023-10-09T11:57:01.894584+0000","last_active":"2023-10-09T11:57:01.897902+0000","last_peered":"2023-10-09T11:57:01.897902+0000","last_clean":"2023-10-09T11:57:01.897902+0000","last_became_active":"2023-10-09T11:57:01.894306+0000","last_became_peered":"2023-10-09T11:57:01.894306+0000","last_unstale":"2023-10-09T11:57:01.897902+0000","last_undegraded":"2023-10-09T11:57:01.897902+0000","last_fullsized":"2023-10-09T11:57:01.897902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:07.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.911706+0000","last_change":"2023-10-09T11:57:00.875047+0000","last_active":"2023-10-09T11:57:01.911706+0000","last_peered":"2023-10-09T11:57:01.911706+0000","last_clean":"2023-10-09T11:57:01.911706+0000","last_became_active":"2023-10-09T11:57:00.874667+0000","last_became_peered":"2023-10-09T11:57:00.874667+0000","last_unstale":"2023-10-09T11:57:01.911706+0000","last_undegraded":"2023-10-09T11:57:01.911706+0000","last_fullsized":"2023-10-09T11:57:01.911706+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:44.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898050+0000","last_change":"2023-10-09T11:57:01.895060+0000","last_active":"2023-10-09T11:57:01.898050+0000","last_peered":"2023-10-09T11:57:01.898050+0000","last_clean":"2023-10-09T11:57:01.898050+0000","last_became_active":"2023-10-09T11:57:01.894452+0000","last_became_peered":"2023-10-09T11:57:01.894452+0000","last_unstale":"2023-10-09T11:57:01.898050+0000","last_undegraded":"2023-10-09T11:57:01.898050+0000","last_fullsized":"2023-10-09T11:57:01.898050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:48.902498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912974+0000","last_change":"2023-10-09T11:57:00.880796+0000","last_active":"2023-10-09T11:57:01.912974+0000","last_peered":"2023-10-09T11:57:01.912974+0000","last_clean":"2023-10-09T11:57:01.912974+0000","last_became_active":"2023-10-09T11:57:00.880521+0000","last_became_peered":"2023-10-09T11:57:00.880521+0000","last_unstale":"2023-10-09T11:57:01.912974+0000","last_undegraded":"2023-10-09T11:57:01.912974+0000","last_fullsized":"2023-10-09T11:57:01.912974+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898410+0000","last_change":"2023-10-09T11:57:01.895473+0000","last_active":"2023-10-09T11:57:01.898410+0000","last_peered":"2023-10-09T11:57:01.898410+0000","last_clean":"2023-10-09T11:57:01.898410+0000","last_became_active":"2023-10-09T11:57:01.895198+0000","last_became_peered":"2023-10-09T11:57:01.895198+0000","last_unstale":"2023-10-09T11:57:01.898410+0000","last_undegraded":"2023-10-09T11:57:01.898410+0000","last_fullsized":"2023-10-09T11:57:01.898410+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:27.189015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.891490+0000","last_change":"2023-10-09T11:57:00.883630+0000","last_active":"2023-10-09T11:57:01.891490+0000","last_peered":"2023-10-09T11:57:01.891490+0000","last_clean":"2023-10-09T11:57:01.891490+0000","last_became_active":"2023-10-09T11:57:00.883359+0000","last_became_peered":"2023-10-09T11:57:00.883359+0000","last_unstale":"2023-10-09T11:57:01.891490+0000","last_undegraded":"2023-10-09T11:57:01.891490+0000","last_fullsized":"2023-10-09T11:57:01.891490+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:50.274562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896484+0000","last_change":"2023-10-09T11:57:01.891896+0000","last_active":"2023-10-09T11:57:01.896484+0000","last_peered":"2023-10-09T11:57:01.896484+0000","last_clean":"2023-10-09T11:57:01.896484+0000","last_became_active":"2023-10-09T11:57:01.891591+0000","last_became_peered":"2023-10-09T11:57:01.891591+0000","last_unstale":"2023-10-09T11:57:01.896484+0000","last_undegraded":"2023-10-09T11:57:01.896484+0000","last_fullsized":"2023-10-09T11:57:01.896484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:21.728449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.883976+0000","last_change":"2023-10-09T11:57:00.876623+0000","last_active":"2023-10-09T11:57:01.883976+0000","last_peered":"2023-10-09T11:57:01.883976+0000","last_clean":"2023-10-09T11:57:01.883976+0000","last_became_active":"2023-10-09T11:57:00.876240+0000","last_became_peered":"2023-10-09T11:57:00.876240+0000","last_unstale":"2023-10-09T11:57:01.883976+0000","last_undegraded":"2023-10-09T11:57:01.883976+0000","last_fullsized":"2023-10-09T11:57:01.883976+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:21.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905186+0000","last_change":"2023-10-09T11:57:01.902110+0000","last_active":"2023-10-09T11:57:01.905186+0000","last_peered":"2023-10-09T11:57:01.905186+0000","last_clean":"2023-10-09T11:57:01.905186+0000","last_became_active":"2023-10-09T11:57:01.901790+0000","last_became_peered":"2023-10-09T11:57:01.901790+0000","last_unstale":"2023-10-09T11:57:01.905186+0000","last_undegraded":"2023-10-09T11:57:01.905186+0000","last_fullsized":"2023-10-09T11:57:01.905186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:37.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"93'8","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.913670+0000","last_change":"2023-10-09T11:57:00.885033+0000","last_active":"2023-10-09T11:57:01.913670+0000","last_peered":"2023-10-09T11:57:01.913670+0000","last_clean":"2023-10-09T11:57:01.913670+0000","last_became_active":"2023-10-09T11:57:00.884742+0000","last_became_peered":"2023-10-09T11:57:00.884742+0000","last_unstale":"2023-10-09T11:57:01.913670+0000","last_undegraded":"2023-10-09T11:57:01.913670+0000","last_fullsized":"2023-10-09T11:57:01.913670+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:16.036691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.885358+0000","last_change":"2023-10-09T11:57:01.880662+0000","last_active":"2023-10-09T11:57:01.885358+0000","last_peered":"2023-10-09T11:57:01.885358+0000","last_clean":"2023-10-09T11:57:01.885358+0000","last_became_active":"2023-10-09T11:57:01.880392+0000","last_became_peered":"2023-10-09T11:57:01.880392+0000","last_unstale":"2023-10-09T11:57:01.885358+0000","last_undegraded":"2023-10-09T11:57:01.885358+0000","last_fullsized":"2023-10-09T11:57:01.885358+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:14.269213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912408+0000","last_change":"2023-10-09T11:57:00.886519+0000","last_active":"2023-10-09T11:57:01.912408+0000","last_peered":"2023-10-09T11:57:01.912408+0000","last_clean":"2023-10-09T11:57:01.912408+0000","last_became_active":"2023-10-09T11:57:00.886280+0000","last_became_peered":"2023-10-09T11:57:00.886280+0000","last_unstale":"2023-10-09T11:57:01.912408+0000","last_undegraded":"2023-10-09T11:57:01.912408+0000","last_fullsized":"2023-10-09T11:57:01.912408+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:37.414967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904949+0000","last_change":"2023-10-09T11:57:01.899115+0000","last_active":"2023-10-09T11:57:01.904949+0000","last_peered":"2023-10-09T11:57:01.904949+0000","last_clean":"2023-10-09T11:57:01.904949+0000","last_became_active":"2023-10-09T11:57:01.894079+0000","last_became_peered":"2023-10-09T11:57:01.894079+0000","last_unstale":"2023-10-09T11:57:01.904949+0000","last_undegraded":"2023-10-09T11:57:01.904949+0000","last_fullsized":"2023-10-09T11:57:01.904949+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:02.172995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912857+0000","last_change":"2023-10-09T11:57:00.884921+0000","last_active":"2023-10-09T11:57:01.912857+0000","last_peered":"2023-10-09T11:57:01.912857+0000","last_clean":"2023-10-09T11:57:01.912857+0000","last_became_active":"2023-10-09T11:57:00.884628+0000","last_became_peered":"2023-10-09T11:57:00.884628+0000","last_unstale":"2023-10-09T11:57:01.912857+0000","last_undegraded":"2023-10-09T11:57:01.912857+0000","last_fullsized":"2023-10-09T11:57:01.912857+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:59.164051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895895+0000","last_change":"2023-10-09T11:57:01.890521+0000","last_active":"2023-10-09T11:57:01.895895+0000","last_peered":"2023-10-09T11:57:01.895895+0000","last_clean":"2023-10-09T11:57:01.895895+0000","last_became_active":"2023-10-09T11:57:01.890266+0000","last_became_peered":"2023-10-09T11:57:01.890266+0000","last_unstale":"2023-10-09T11:57:01.895895+0000","last_undegraded":"2023-10-09T11:57:01.895895+0000","last_fullsized":"2023-10-09T11:57:01.895895+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:28.835667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.913545+0000","last_change":"2023-10-09T11:57:00.888249+0000","last_active":"2023-10-09T11:57:01.913545+0000","last_peered":"2023-10-09T11:57:01.913545+0000","last_clean":"2023-10-09T11:57:01.913545+0000","last_became_active":"2023-10-09T11:57:00.887971+0000","last_became_peered":"2023-10-09T11:57:00.887971+0000","last_unstale":"2023-10-09T11:57:01.913545+0000","last_undegraded":"2023-10-09T11:57:01.913545+0000","last_fullsized":"2023-10-09T11:57:01.913545+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:13.261379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895955+0000","last_change":"2023-10-09T11:57:01.892720+0000","last_active":"2023-10-09T11:57:01.895955+0000","last_peered":"2023-10-09T11:57:01.895955+0000","last_clean":"2023-10-09T11:57:01.895955+0000","last_became_active":"2023-10-09T11:57:01.892468+0000","last_became_peered":"2023-10-09T11:57:01.892468+0000","last_unstale":"2023-10-09T11:57:01.895955+0000","last_undegraded":"2023-10-09T11:57:01.895955+0000","last_fullsized":"2023-10-09T11:57:01.895955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.797860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877114+0000","last_change":"2023-10-09T11:57:00.887658+0000","last_active":"2023-10-09T11:57:01.877114+0000","last_peered":"2023-10-09T11:57:01.877114+0000","last_clean":"2023-10-09T11:57:01.877114+0000","last_became_active":"2023-10-09T11:57:00.887408+0000","last_became_peered":"2023-10-09T11:57:00.887408+0000","last_unstale":"2023-10-09T11:57:01.877114+0000","last_undegraded":"2023-10-09T11:57:01.877114+0000","last_fullsized":"2023-10-09T11:57:01.877114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:40.506886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902657+0000","last_change":"2023-10-09T11:57:01.893037+0000","last_active":"2023-10-09T11:57:01.902657+0000","last_peered":"2023-10-09T11:57:01.902657+0000","last_clean":"2023-10-09T11:57:01.902657+0000","last_became_active":"2023-10-09T11:57:01.891103+0000","last_became_peered":"2023-10-09T11:57:01.891103+0000","last_unstale":"2023-10-09T11:57:01.902657+0000","last_undegraded":"2023-10-09T11:57:01.902657+0000","last_fullsized":"2023-10-09T11:57:01.902657+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:14.477829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.891597+0000","last_change":"2023-10-09T11:57:00.886723+0000","last_active":"2023-10-09T11:57:01.891597+0000","last_peered":"2023-10-09T11:57:01.891597+0000","last_clean":"2023-10-09T11:57:01.891597+0000","last_became_active":"2023-10-09T11:57:00.886368+0000","last_became_peered":"2023-10-09T11:57:00.886368+0000","last_unstale":"2023-10-09T11:57:01.891597+0000","last_undegraded":"2023-10-09T11:57:01.891597+0000","last_fullsized":"2023-10-09T11:57:01.891597+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:21.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907413+0000","last_change":"2023-10-09T11:57:01.903102+0000","last_active":"2023-10-09T11:57:01.907413+0000","last_peered":"2023-10-09T11:57:01.907413+0000","last_clean":"2023-10-09T11:57:01.907413+0000","last_became_active":"2023-10-09T11:57:01.902794+0000","last_became_peered":"2023-10-09T11:57:01.902794+0000","last_unstale":"2023-10-09T11:57:01.907413+0000","last_undegraded":"2023-10-09T11:57:01.907413+0000","last_fullsized":"2023-10-09T11:57:01.907413+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:59.863484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.884090+0000","last_change":"2023-10-09T11:57:00.875414+0000","last_active":"2023-10-09T11:57:01.884090+0000","last_peered":"2023-10-09T11:57:01.884090+0000","last_clean":"2023-10-09T11:57:01.884090+0000","last_became_active":"2023-10-09T11:57:00.875153+0000","last_became_peered":"2023-10-09T11:57:00.875153+0000","last_unstale":"2023-10-09T11:57:01.884090+0000","last_undegraded":"2023-10-09T11:57:01.884090+0000","last_fullsized":"2023-10-09T11:57:01.884090+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:13.261379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905758+0000","last_change":"2023-10-09T11:57:01.901740+0000","last_active":"2023-10-09T11:57:01.905758+0000","last_peered":"2023-10-09T11:57:01.905758+0000","last_clean":"2023-10-09T11:57:01.905758+0000","last_became_active":"2023-10-09T11:57:01.901472+0000","last_became_peered":"2023-10-09T11:57:01.901472+0000","last_unstale":"2023-10-09T11:57:01.905758+0000","last_undegraded":"2023-10-09T11:57:01.905758+0000","last_fullsized":"2023-10-09T11:57:01.905758+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:07.745070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881369+0000","last_change":"2023-10-09T11:57:00.876926+0000","last_active":"2023-10-09T11:57:01.881369+0000","last_peered":"2023-10-09T11:57:01.881369+0000","last_clean":"2023-10-09T11:57:01.881369+0000","last_became_active":"2023-10-09T11:57:00.876682+0000","last_became_peered":"2023-10-09T11:57:00.876682+0000","last_unstale":"2023-10-09T11:57:01.881369+0000","last_undegraded":"2023-10-09T11:57:01.881369+0000","last_fullsized":"2023-10-09T11:57:01.881369+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:07.220156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896441+0000","last_change":"2023-10-09T11:57:01.893674+0000","last_active":"2023-10-09T11:57:01.896441+0000","last_peered":"2023-10-09T11:57:01.896441+0000","last_clean":"2023-10-09T11:57:01.896441+0000","last_became_active":"2023-10-09T11:57:01.893411+0000","last_became_peered":"2023-10-09T11:57:01.893411+0000","last_unstale":"2023-10-09T11:57:01.896441+0000","last_undegraded":"2023-10-09T11:57:01.896441+0000","last_fullsized":"2023-10-09T11:57:01.896441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:55.633922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912118+0000","last_change":"2023-10-09T11:57:00.885936+0000","last_active":"2023-10-09T11:57:01.912118+0000","last_peered":"2023-10-09T11:57:01.912118+0000","last_clean":"2023-10-09T11:57:01.912118+0000","last_became_active":"2023-10-09T11:57:00.885688+0000","last_became_peered":"2023-10-09T11:57:00.885688+0000","last_unstale":"2023-10-09T11:57:01.912118+0000","last_undegraded":"2023-10-09T11:57:01.912118+0000","last_fullsized":"2023-10-09T11:57:01.912118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:34.974290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898393+0000","last_change":"2023-10-09T11:57:01.891492+0000","last_active":"2023-10-09T11:57:01.898393+0000","last_peered":"2023-10-09T11:57:01.898393+0000","last_clean":"2023-10-09T11:57:01.898393+0000","last_became_active":"2023-10-09T11:57:01.891218+0000","last_became_peered":"2023-10-09T11:57:01.891218+0000","last_unstale":"2023-10-09T11:57:01.898393+0000","last_undegraded":"2023-10-09T11:57:01.898393+0000","last_fullsized":"2023-10-09T11:57:01.898393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:35.728411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.884246+0000","last_change":"2023-10-09T11:57:00.876989+0000","last_active":"2023-10-09T11:57:01.884246+0000","last_peered":"2023-10-09T11:57:01.884246+0000","last_clean":"2023-10-09T11:57:01.884246+0000","last_became_active":"2023-10-09T11:57:00.876282+0000","last_became_peered":"2023-10-09T11:57:00.876282+0000","last_unstale":"2023-10-09T11:57:01.884246+0000","last_undegraded":"2023-10-09T11:57:01.884246+0000","last_fullsized":"2023-10-09T11:57:01.884246+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:50.274562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905050+0000","last_change":"2023-10-09T11:57:01.901465+0000","last_active":"2023-10-09T11:57:01.905050+0000","last_peered":"2023-10-09T11:57:01.905050+0000","last_clean":"2023-10-09T11:57:01.905050+0000","last_became_active":"2023-10-09T11:57:01.901210+0000","last_became_peered":"2023-10-09T11:57:01.901210+0000","last_unstale":"2023-10-09T11:57:01.905050+0000","last_undegraded":"2023-10-09T11:57:01.905050+0000","last_fullsized":"2023-10-09T11:57:01.905050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:06.263122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.886070+0000","last_change":"2023-10-09T11:57:00.876079+0000","last_active":"2023-10-09T11:57:01.886070+0000","last_peered":"2023-10-09T11:57:01.886070+0000","last_clean":"2023-10-09T11:57:01.886070+0000","last_became_active":"2023-10-09T11:57:00.875547+0000","last_became_peered":"2023-10-09T11:57:00.875547+0000","last_unstale":"2023-10-09T11:57:01.886070+0000","last_undegraded":"2023-10-09T11:57:01.886070+0000","last_fullsized":"2023-10-09T11:57:01.886070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:40.767452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898265+0000","last_change":"2023-10-09T11:57:01.894780+0000","last_active":"2023-10-09T11:57:01.898265+0000","last_peered":"2023-10-09T11:57:01.898265+0000","last_clean":"2023-10-09T11:57:01.898265+0000","last_became_active":"2023-10-09T11:57:01.894487+0000","last_became_peered":"2023-10-09T11:57:01.894487+0000","last_unstale":"2023-10-09T11:57:01.898265+0000","last_undegraded":"2023-10-09T11:57:01.898265+0000","last_fullsized":"2023-10-09T11:57:01.898265+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:59.241594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881971+0000","last_change":"2023-10-09T11:57:00.875237+0000","last_active":"2023-10-09T11:57:01.881971+0000","last_peered":"2023-10-09T11:57:01.881971+0000","last_clean":"2023-10-09T11:57:01.881971+0000","last_became_active":"2023-10-09T11:57:00.874940+0000","last_became_peered":"2023-10-09T11:57:00.874940+0000","last_unstale":"2023-10-09T11:57:01.881971+0000","last_undegraded":"2023-10-09T11:57:01.881971+0000","last_fullsized":"2023-10-09T11:57:01.881971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.637375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905068+0000","last_change":"2023-10-09T11:57:01.901431+0000","last_active":"2023-10-09T11:57:01.905068+0000","last_peered":"2023-10-09T11:57:01.905068+0000","last_clean":"2023-10-09T11:57:01.905068+0000","last_became_active":"2023-10-09T11:57:01.901190+0000","last_became_peered":"2023-10-09T11:57:01.901190+0000","last_unstale":"2023-10-09T11:57:01.905068+0000","last_undegraded":"2023-10-09T11:57:01.905068+0000","last_fullsized":"2023-10-09T11:57:01.905068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:36.509416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.885936+0000","last_change":"2023-10-09T11:57:00.874584+0000","last_active":"2023-10-09T11:57:01.885936+0000","last_peered":"2023-10-09T11:57:01.885936+0000","last_clean":"2023-10-09T11:57:01.885936+0000","last_became_active":"2023-10-09T11:57:00.874275+0000","last_became_peered":"2023-10-09T11:57:00.874275+0000","last_unstale":"2023-10-09T11:57:01.885936+0000","last_undegraded":"2023-10-09T11:57:01.885936+0000","last_fullsized":"2023-10-09T11:57:01.885936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:00.092427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903053+0000","last_change":"2023-10-09T11:57:01.898033+0000","last_active":"2023-10-09T11:57:01.903053+0000","last_peered":"2023-10-09T11:57:01.903053+0000","last_clean":"2023-10-09T11:57:01.903053+0000","last_became_active":"2023-10-09T11:57:01.897727+0000","last_became_peered":"2023-10-09T11:57:01.897727+0000","last_unstale":"2023-10-09T11:57:01.903053+0000","last_undegraded":"2023-10-09T11:57:01.903053+0000","last_fullsized":"2023-10-09T11:57:01.903053+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:37.047094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877934+0000","last_change":"2023-10-09T11:57:00.875984+0000","last_active":"2023-10-09T11:57:01.877934+0000","last_peered":"2023-10-09T11:57:01.877934+0000","last_clean":"2023-10-09T11:57:01.877934+0000","last_became_active":"2023-10-09T11:57:00.875743+0000","last_became_peered":"2023-10-09T11:57:00.875743+0000","last_unstale":"2023-10-09T11:57:01.877934+0000","last_undegraded":"2023-10-09T11:57:01.877934+0000","last_fullsized":"2023-10-09T11:57:01.877934+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895628+0000","last_change":"2023-10-09T11:57:01.891953+0000","last_active":"2023-10-09T11:57:01.895628+0000","last_peered":"2023-10-09T11:57:01.895628+0000","last_clean":"2023-10-09T11:57:01.895628+0000","last_became_active":"2023-10-09T11:57:01.891592+0000","last_became_peered":"2023-10-09T11:57:01.891592+0000","last_unstale":"2023-10-09T11:57:01.895628+0000","last_undegraded":"2023-10-09T11:57:01.895628+0000","last_fullsized":"2023-10-09T11:57:01.895628+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:55.985641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877254+0000","last_change":"2023-10-09T11:57:00.884173+0000","last_active":"2023-10-09T11:57:01.877254+0000","last_peered":"2023-10-09T11:57:01.877254+0000","last_clean":"2023-10-09T11:57:01.877254+0000","last_became_active":"2023-10-09T11:57:00.883920+0000","last_became_peered":"2023-10-09T11:57:00.883920+0000","last_unstale":"2023-10-09T11:57:01.877254+0000","last_undegraded":"2023-10-09T11:57:01.877254+0000","last_fullsized":"2023-10-09T11:57:01.877254+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:54.977806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.910863+0000","last_change":"2023-10-09T11:57:01.902704+0000","last_active":"2023-10-09T11:57:01.910863+0000","last_peered":"2023-10-09T11:57:01.910863+0000","last_clean":"2023-10-09T11:57:01.910863+0000","last_became_active":"2023-10-09T11:57:01.902352+0000","last_became_peered":"2023-10-09T11:57:01.902352+0000","last_unstale":"2023-10-09T11:57:01.910863+0000","last_undegraded":"2023-10-09T11:57:01.910863+0000","last_fullsized":"2023-10-09T11:57:01.910863+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:42.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.890785+0000","last_change":"2023-10-09T11:57:00.879653+0000","last_active":"2023-10-09T11:57:01.890785+0000","last_peered":"2023-10-09T11:57:01.890785+0000","last_clean":"2023-10-09T11:57:01.890785+0000","last_became_active":"2023-10-09T11:57:00.879415+0000","last_became_peered":"2023-10-09T11:57:00.879415+0000","last_unstale":"2023-10-09T11:57:01.890785+0000","last_undegraded":"2023-10-09T11:57:01.890785+0000","last_fullsized":"2023-10-09T11:57:01.890785+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:37.434211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905726+0000","last_change":"2023-10-09T11:57:01.902313+0000","last_active":"2023-10-09T11:57:01.905726+0000","last_peered":"2023-10-09T11:57:01.905726+0000","last_clean":"2023-10-09T11:57:01.905726+0000","last_became_active":"2023-10-09T11:57:01.902070+0000","last_became_peered":"2023-10-09T11:57:01.902070+0000","last_unstale":"2023-10-09T11:57:01.905726+0000","last_undegraded":"2023-10-09T11:57:01.905726+0000","last_fullsized":"2023-10-09T11:57:01.905726+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:30.335164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912132+0000","last_change":"2023-10-09T11:57:00.878463+0000","last_active":"2023-10-09T11:57:01.912132+0000","last_peered":"2023-10-09T11:57:01.912132+0000","last_clean":"2023-10-09T11:57:01.912132+0000","last_became_active":"2023-10-09T11:57:00.878193+0000","last_became_peered":"2023-10-09T11:57:00.878193+0000","last_unstale":"2023-10-09T11:57:01.912132+0000","last_undegraded":"2023-10-09T11:57:01.912132+0000","last_fullsized":"2023-10-09T11:57:01.912132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:32.824374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"83'183","reported_seq":457,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877969+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:57:01.877969+0000","last_peered":"2023-10-09T11:57:01.877969+0000","last_clean":"2023-10-09T11:57:01.877969+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:57:01.877969+0000","last_undegraded":"2023-10-09T11:57:01.877969+0000","last_fullsized":"2023-10-09T11:57:01.877969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":1136159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.70799999999999996},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.755},"min":{"1min":0.60299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93899999999999995,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.755},"min":{"1min":0.501,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88800000000000001,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.202},"last":0.76800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.53900000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.96799999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.073},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.89300000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.04,"5min":1.083,"15min":1.083},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.111,"15min":1.111},"last":0.73999999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476928,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1142784,"data_stored":545295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94399999999999995,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.121},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.504,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.0049999999999999,"15min":1.216},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.96399999999999997,"5min":1.008,"15min":1.139},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.431},"last":0.74099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.1040000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94599999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.96699999999999997,"15min":1.7869999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.93600000000000005,"15min":1.143},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82199999999999995,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.437},"max":{"1min":0.88400000000000001,"5min":1.03,"15min":1.506},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.96099999999999997,"5min":0.97499999999999998,"15min":1.2330000000000001},"last":0.54800000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":547327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46500000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.079,"5min":1.079,"15min":1.6759999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.72299999999999998,"15min":1.385},"last":0.503},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.69199999999999995,"5min":0.83199999999999996,"15min":1.099},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.536},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66700000000000004,"5min":0.78000000000000003,"15min":1.272},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.7210000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":1.0660000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":1.202,"15min":1.677},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.0980000000000001,"5min":1.103,"15min":1.778},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0760000000000001,"15min":1.623},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.042,"5min":1.0549999999999999,"15min":1.708},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81799999999999995,"15min":0.83999999999999997},"min":{"1min":0.63900000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1160000000000001,"5min":1.222,"15min":1.659},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1419999999999999,"15min":1.736},"last":0.56499999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1135571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.35599999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.367},"last":0.308},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.4930000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.7130000000000001},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.855},"last":0.436},{"interface":"front","average":{"1min":0.745,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":1.399,"5min":1.587,"15min":1.587},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.997}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54400000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.58599999999999997,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.488,"15min":1.488},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.80500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1899999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2330000000000001,"5min":1.552,"15min":1.552},"last":0.82199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":546739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27600000000000002},"max":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51000000000000001,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.75,"15min":0.83799999999999997},"last":0.374}]},{"osd":1,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.502,"15min":0.496},"min":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.876,"15min":0.97299999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.64800000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.70299999999999996,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.439}]},{"osd":4,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0029999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.97699999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.2270000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.012,"5min":1.216,"15min":1.216},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0269999999999999,"5min":1.204,"15min":1.27},"last":0.98899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.61199999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.98299999999999998,"5min":1.2310000000000001,"15min":1.246},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.022,"5min":1.155,"15min":1.2130000000000001},"last":0.96199999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509632,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1142784,"data_stored":545315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47899999999999998},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.311},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.752,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.35299999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.151,"5min":1.208,"15min":1.327},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.72499999999999998,"5min":0.63100000000000001,"15min":0.55700000000000005},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.624,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.246,"5min":1.246,"15min":1.2829999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.3660000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.53600000000000003,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.1240000000000001,"15min":1.218},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.333},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.66500000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.3560000000000001},"last":0.58999999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310688,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061152,"statfs":{"total":96636764160,"available":96318619648,"internally_reserved":0,"allocated":1138688,"data_stored":545273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":1.071},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.56699999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.77900000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.56299999999999994,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.92300000000000004,"5min":0.95799999999999996,"15min":1.2909999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":0.82499999999999996,"5min":0.95399999999999996,"15min":1.0149999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.234},"last":0.81299999999999994}]},{"osd":3,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84199999999999997,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.745,"15min":0.75900000000000001},"min":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":1.1639999999999999},"last":0.96199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36099999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0820000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.1140000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":1.125},"last":0.747},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.373},"last":0.94599999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.2410000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91400000000000003,"5min":0.997,"15min":1.222},"last":0.67800000000000005}]}]},{"osd":5,"up_from":16,"seq":68719476927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1138688,"data_stored":545293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.91200000000000003,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.47099999999999997,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.94399999999999995,"5min":1.909,"15min":1.909},"last":0.624},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.997,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.77900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.44900000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":2.105,"15min":2.105},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97299999999999998,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.70499999999999996},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.81699999999999995,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.93000000000000005,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:10.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:57:10.833 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:57:11.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:11.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.214+0000 7fced79ff700 1 Processor -- start 2023-10-09T11:57:11.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.214+0000 7fced79ff700 1 -- start start 2023-10-09T11:57:11.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced79ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 0x7fced00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced79ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fced00ccf90 0x7fced00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced79ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00cc300 con 0x7fced015a270 2023-10-09T11:57:11.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced79ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced0156bf0 con 0x7fced00ccf90 2023-10-09T11:57:11.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced79ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00ae950 con 0x7fced00cbf30 2023-10-09T11:57:11.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced5f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fced015a270 0x7fced00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55654/0 (socket says 172.21.15.86:55654) 2023-10-09T11:57:11.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced5f9c700 1 -- 172.21.15.86:0/2147486396 learned_addr learned my addr 172.21.15.86:0/2147486396 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:11.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced4f9a700 1 --2- 172.21.15.86:0/2147486396 >> v2:172.21.15.135:3300/0 conn(0x7fced00ccf90 0x7fced00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fced579b700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 0x7fced00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415831996 0 0) 0x7fced00cc300 con 0x7fced015a270 2023-10-09T11:57:11.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.216+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcebc003570 con 0x7fced015a270 2023-10-09T11:57:11.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500652871 0 0) 0x7fcebc003570 con 0x7fced015a270 2023-10-09T11:57:11.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 msgr2=0x7fced00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 0x7fced00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 >> v2:172.21.15.135:3300/0 conn(0x7fced00ccf90 msgr2=0x7fced00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 --2- 172.21.15.86:0/2147486396 >> v2:172.21.15.135:3300/0 conn(0x7fced00ccf90 0x7fced00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00ad370 con 0x7fced015a270 2023-10-09T11:57:11.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fcec80017f0 con 0x7fced015a270 2023-10-09T11:57:11.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 >> v1:172.21.15.86:6789/0 conn(0x7fced015a270 legacy=0x7fced00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc003a90 0x7fcebc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 0x7fcebc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced0156bf0 con 0x7fcebc004d50 2023-10-09T11:57:11.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00ae950 con 0x7fcebc003a90 2023-10-09T11:57:11.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc00dc70 con 0x7fced00cbf30 2023-10-09T11:57:11.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fced4f9a700 1 --2- 172.21.15.86:0/2147486396 >> v2:172.21.15.135:3300/0 conn(0x7fced00ccf90 0x7fced00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:11.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fced5f9c700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fced579b700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc003a90 0x7fcebc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.217+0000 7fced4f9a700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 0x7fcebc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced5f9c700 1 -- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 msgr2=0x7fcebc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced5f9c700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00cbf30 0x7fcebc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced5f9c700 1 -- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc003a90 msgr2=0x7fcebc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced5f9c700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcebc003a90 0x7fcebc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced5f9c700 1 -- 172.21.15.86:0/2147486396 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc003570 con 0x7fcebc004d50 2023-10-09T11:57:11.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced5f9c700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fcec800a930 tx=0x7fcec80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc6f84e589556ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:11.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80070d0 con 0x7fcebc004d50 2023-10-09T11:57:11.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec8007230 con 0x7fcebc004d50 2023-10-09T11:57:11.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fcec7fff700 1 -- 172.21.15.86:0/2147486396 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80075d0 con 0x7fcebc004d50 2023-10-09T11:57:11.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced79ff700 1 -- 172.21.15.86:0/2147486396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 msgr2=0x7fcebc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced79ff700 1 --2- 172.21.15.86:0/2147486396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fcebc0051c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fcec800a930 tx=0x7fcec80021d0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.218+0000 7fced5f9c700 1 -- 172.21.15.86:0/2147486396 reap_dead start 2023-10-09T11:57:11.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.219+0000 7fced79ff700 1 -- 172.21.15.86:0/2147486396 shutdown_connections 2023-10-09T11:57:11.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.219+0000 7fced79ff700 1 -- 172.21.15.86:0/2147486396 >> 172.21.15.86:0/2147486396 conn(0x7fced006a320 msgr2=0x7fced00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:11.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.219+0000 7fced79ff700 1 -- 172.21.15.86:0/2147486396 shutdown_connections 2023-10-09T11:57:11.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.219+0000 7fced79ff700 1 -- 172.21.15.86:0/2147486396 wait complete. 2023-10-09T11:57:11.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.220+0000 7fced79ff700 1 Processor -- start 2023-10-09T11:57:11.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.220+0000 7fced79ff700 1 -- start start 2023-10-09T11:57:11.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced79ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fced00ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced79ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00abdf0 0x7fced016abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced79ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced00c2770 0x7fced00c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced79ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced016b130 con 0x7fcebc004d50 2023-10-09T11:57:11.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced79ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c17a0 con 0x7fced00c2770 2023-10-09T11:57:11.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced79ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00ac260 con 0x7fced00abdf0 2023-10-09T11:57:11.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced579b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fced00ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced579b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fced00ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43954/0 (socket says 172.21.15.86:43954) 2023-10-09T11:57:11.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced579b700 1 -- 172.21.15.86:0/1432426038 learned_addr learned my addr 172.21.15.86:0/1432426038 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:11.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.221+0000 7fced4f9a700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00abdf0 0x7fced016abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced5f9c700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced00c2770 0x7fced00c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced579b700 1 -- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00abdf0 msgr2=0x7fced016abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced579b700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00abdf0 0x7fced016abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced579b700 1 -- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced00c2770 msgr2=0x7fced00c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced579b700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced00c2770 0x7fced00c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced579b700 1 -- 172.21.15.86:0/1432426038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00c22e0 con 0x7fcebc004d50 2023-10-09T11:57:11.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced579b700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fced00ab040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcecc011b10 tx=0x7fcecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:11.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fcec57fa700 1 -- 172.21.15.86:0/1432426038 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00f9f0 con 0x7fcebc004d50 2023-10-09T11:57:11.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fcec57fa700 1 -- 172.21.15.86:0/1432426038 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00fb50 con 0x7fcebc004d50 2023-10-09T11:57:11.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fcec57fa700 1 -- 172.21.15.86:0/1432426038 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00fed0 con 0x7fcebc004d50 2023-10-09T11:57:11.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced00c2be0 con 0x7fcebc004d50 2023-10-09T11:57:11.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.222+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced00c1c90 con 0x7fcebc004d50 2023-10-09T11:57:11.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.223+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced004c3c0 con 0x7fcebc004d50 2023-10-09T11:57:11.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.224+0000 7fcec57fa700 1 -- 172.21.15.86:0/1432426038 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcecc014650 con 0x7fcebc004d50 2023-10-09T11:57:11.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.225+0000 7fcec57fa700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fceb4066f30 0x7fceb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.225+0000 7fcec57fa700 1 -- 172.21.15.86:0/1432426038 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fcecc018030 con 0x7fcebc004d50 2023-10-09T11:57:11.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.225+0000 7fced4f9a700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fceb4066f30 0x7fceb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.226+0000 7fced4f9a700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fceb4066f30 0x7fceb40693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcec00093f0 tx=0x7fcec0008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:11.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.229+0000 7fcec57fa700 1 -- 172.21.15.86:0/1432426038 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcecc052280 con 0x7fcebc004d50 2023-10-09T11:57:11.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.415+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fced00c1580 con 0x7fceb4066f30 2023-10-09T11:57:11.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.424+0000 7fcec57fa700 1 -- 172.21.15.86:0/1432426038 <== mgr.6507 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289221 (secure 0 0 0) 0x7fced00c1580 con 0x7fceb4066f30 2023-10-09T11:57:11.427 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:11.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fceb4066f30 msgr2=0x7fceb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fceb4066f30 0x7fceb40693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcec00093f0 tx=0x7fcec0008040 comp rx=0 tx=0).stop 2023-10-09T11:57:11.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 msgr2=0x7fced00ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fced00ab040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcecc011b10 tx=0x7fcecc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 shutdown_connections 2023-10-09T11:57:11.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fceb4066f30 0x7fceb40693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc004d50 0x7fced00ab040 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced00c2770 0x7fced00c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 --2- 172.21.15.86:0/1432426038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced00abdf0 0x7fced016abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 >> 172.21.15.86:0/1432426038 conn(0x7fced006a320 msgr2=0x7fced0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:11.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 shutdown_connections 2023-10-09T11:57:11.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.428+0000 7fced79ff700 1 -- 172.21.15.86:0/1432426038 wait complete. 2023-10-09T11:57:11.432 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:11.446 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T11:57:09.755641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2433448,"kb_used_data":10088,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752541272,"statfs":{"total":773094113280,"available":770602262528,"internally_reserved":0,"allocated":10330112,"data_stored":5546972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001765"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907939+0000","last_change":"2023-10-09T11:57:01.899719+0000","last_active":"2023-10-09T11:57:01.907939+0000","last_peered":"2023-10-09T11:57:01.907939+0000","last_clean":"2023-10-09T11:57:01.907939+0000","last_became_active":"2023-10-09T11:57:01.899438+0000","last_became_peered":"2023-10-09T11:57:01.899438+0000","last_unstale":"2023-10-09T11:57:01.907939+0000","last_undegraded":"2023-10-09T11:57:01.907939+0000","last_fullsized":"2023-10-09T11:57:01.907939+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:09.220381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.900585+0000","last_change":"2023-10-09T11:57:01.897129+0000","last_active":"2023-10-09T11:57:01.900585+0000","last_peered":"2023-10-09T11:57:01.900585+0000","last_clean":"2023-10-09T11:57:01.900585+0000","last_became_active":"2023-10-09T11:57:01.896192+0000","last_became_peered":"2023-10-09T11:57:01.896192+0000","last_unstale":"2023-10-09T11:57:01.900585+0000","last_undegraded":"2023-10-09T11:57:01.900585+0000","last_fullsized":"2023-10-09T11:57:01.900585+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:41.514720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903687+0000","last_change":"2023-10-09T11:57:01.895577+0000","last_active":"2023-10-09T11:57:01.903687+0000","last_peered":"2023-10-09T11:57:01.903687+0000","last_clean":"2023-10-09T11:57:01.903687+0000","last_became_active":"2023-10-09T11:57:01.895289+0000","last_became_peered":"2023-10-09T11:57:01.895289+0000","last_unstale":"2023-10-09T11:57:01.903687+0000","last_undegraded":"2023-10-09T11:57:01.903687+0000","last_fullsized":"2023-10-09T11:57:01.903687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:53:11.061942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907058+0000","last_change":"2023-10-09T11:57:01.904421+0000","last_active":"2023-10-09T11:57:01.907058+0000","last_peered":"2023-10-09T11:57:01.907058+0000","last_clean":"2023-10-09T11:57:01.907058+0000","last_became_active":"2023-10-09T11:57:01.904142+0000","last_became_peered":"2023-10-09T11:57:01.904142+0000","last_unstale":"2023-10-09T11:57:01.907058+0000","last_undegraded":"2023-10-09T11:57:01.907058+0000","last_fullsized":"2023-10-09T11:57:01.907058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:35:52.001394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.899597+0000","last_change":"2023-10-09T11:57:01.895405+0000","last_active":"2023-10-09T11:57:01.899597+0000","last_peered":"2023-10-09T11:57:01.899597+0000","last_clean":"2023-10-09T11:57:01.899597+0000","last_became_active":"2023-10-09T11:57:01.895154+0000","last_became_peered":"2023-10-09T11:57:01.895154+0000","last_unstale":"2023-10-09T11:57:01.899597+0000","last_undegraded":"2023-10-09T11:57:01.899597+0000","last_fullsized":"2023-10-09T11:57:01.899597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:45.839001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904661+0000","last_change":"2023-10-09T11:57:01.898658+0000","last_active":"2023-10-09T11:57:01.904661+0000","last_peered":"2023-10-09T11:57:01.904661+0000","last_clean":"2023-10-09T11:57:01.904661+0000","last_became_active":"2023-10-09T11:57:01.898369+0000","last_became_peered":"2023-10-09T11:57:01.898369+0000","last_unstale":"2023-10-09T11:57:01.904661+0000","last_undegraded":"2023-10-09T11:57:01.904661+0000","last_fullsized":"2023-10-09T11:57:01.904661+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:12.023804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898451+0000","last_change":"2023-10-09T11:57:01.891512+0000","last_active":"2023-10-09T11:57:01.898451+0000","last_peered":"2023-10-09T11:57:01.898451+0000","last_clean":"2023-10-09T11:57:01.898451+0000","last_became_active":"2023-10-09T11:57:01.891174+0000","last_became_peered":"2023-10-09T11:57:01.891174+0000","last_unstale":"2023-10-09T11:57:01.898451+0000","last_undegraded":"2023-10-09T11:57:01.898451+0000","last_fullsized":"2023-10-09T11:57:01.898451+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:22.067477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906079+0000","last_change":"2023-10-09T11:57:01.902323+0000","last_active":"2023-10-09T11:57:01.906079+0000","last_peered":"2023-10-09T11:57:01.906079+0000","last_clean":"2023-10-09T11:57:01.906079+0000","last_became_active":"2023-10-09T11:57:01.902049+0000","last_became_peered":"2023-10-09T11:57:01.902049+0000","last_unstale":"2023-10-09T11:57:01.906079+0000","last_undegraded":"2023-10-09T11:57:01.906079+0000","last_fullsized":"2023-10-09T11:57:01.906079+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:09.494720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905103+0000","last_change":"2023-10-09T11:57:01.902364+0000","last_active":"2023-10-09T11:57:01.905103+0000","last_peered":"2023-10-09T11:57:01.905103+0000","last_clean":"2023-10-09T11:57:01.905103+0000","last_became_active":"2023-10-09T11:57:01.902081+0000","last_became_peered":"2023-10-09T11:57:01.902081+0000","last_unstale":"2023-10-09T11:57:01.905103+0000","last_undegraded":"2023-10-09T11:57:01.905103+0000","last_fullsized":"2023-10-09T11:57:01.905103+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:44.084236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.894957+0000","last_change":"2023-10-09T11:57:01.891902+0000","last_active":"2023-10-09T11:57:01.894957+0000","last_peered":"2023-10-09T11:57:01.894957+0000","last_clean":"2023-10-09T11:57:01.894957+0000","last_became_active":"2023-10-09T11:57:01.891535+0000","last_became_peered":"2023-10-09T11:57:01.891535+0000","last_unstale":"2023-10-09T11:57:01.894957+0000","last_undegraded":"2023-10-09T11:57:01.894957+0000","last_fullsized":"2023-10-09T11:57:01.894957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:44:37.971898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898247+0000","last_change":"2023-10-09T11:57:01.894728+0000","last_active":"2023-10-09T11:57:01.898247+0000","last_peered":"2023-10-09T11:57:01.898247+0000","last_clean":"2023-10-09T11:57:01.898247+0000","last_became_active":"2023-10-09T11:57:01.894077+0000","last_became_peered":"2023-10-09T11:57:01.894077+0000","last_unstale":"2023-10-09T11:57:01.898247+0000","last_undegraded":"2023-10-09T11:57:01.898247+0000","last_fullsized":"2023-10-09T11:57:01.898247+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:49.373263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895914+0000","last_change":"2023-10-09T11:57:01.892465+0000","last_active":"2023-10-09T11:57:01.895914+0000","last_peered":"2023-10-09T11:57:01.895914+0000","last_clean":"2023-10-09T11:57:01.895914+0000","last_became_active":"2023-10-09T11:57:01.892212+0000","last_became_peered":"2023-10-09T11:57:01.892212+0000","last_unstale":"2023-10-09T11:57:01.895914+0000","last_undegraded":"2023-10-09T11:57:01.895914+0000","last_fullsized":"2023-10-09T11:57:01.895914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:34.625153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904888+0000","last_change":"2023-10-09T11:57:01.899702+0000","last_active":"2023-10-09T11:57:01.904888+0000","last_peered":"2023-10-09T11:57:01.904888+0000","last_clean":"2023-10-09T11:57:01.904888+0000","last_became_active":"2023-10-09T11:57:01.899445+0000","last_became_peered":"2023-10-09T11:57:01.899445+0000","last_unstale":"2023-10-09T11:57:01.904888+0000","last_undegraded":"2023-10-09T11:57:01.904888+0000","last_fullsized":"2023-10-09T11:57:01.904888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:28:21.097692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.893987+0000","last_change":"2023-10-09T11:57:01.891259+0000","last_active":"2023-10-09T11:57:01.893987+0000","last_peered":"2023-10-09T11:57:01.893987+0000","last_clean":"2023-10-09T11:57:01.893987+0000","last_became_active":"2023-10-09T11:57:01.891009+0000","last_became_peered":"2023-10-09T11:57:01.891009+0000","last_unstale":"2023-10-09T11:57:01.893987+0000","last_undegraded":"2023-10-09T11:57:01.893987+0000","last_fullsized":"2023-10-09T11:57:01.893987+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:32:17.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897168+0000","last_change":"2023-10-09T11:57:01.894384+0000","last_active":"2023-10-09T11:57:01.897168+0000","last_peered":"2023-10-09T11:57:01.897168+0000","last_clean":"2023-10-09T11:57:01.897168+0000","last_became_active":"2023-10-09T11:57:01.894030+0000","last_became_peered":"2023-10-09T11:57:01.894030+0000","last_unstale":"2023-10-09T11:57:01.897168+0000","last_undegraded":"2023-10-09T11:57:01.897168+0000","last_fullsized":"2023-10-09T11:57:01.897168+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:22.726979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.909621+0000","last_change":"2023-10-09T11:57:01.907272+0000","last_active":"2023-10-09T11:57:01.909621+0000","last_peered":"2023-10-09T11:57:01.909621+0000","last_clean":"2023-10-09T11:57:01.909621+0000","last_became_active":"2023-10-09T11:57:01.907012+0000","last_became_peered":"2023-10-09T11:57:01.907012+0000","last_unstale":"2023-10-09T11:57:01.909621+0000","last_undegraded":"2023-10-09T11:57:01.909621+0000","last_fullsized":"2023-10-09T11:57:01.909621+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:31.145330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904781+0000","last_change":"2023-10-09T11:57:01.899804+0000","last_active":"2023-10-09T11:57:01.904781+0000","last_peered":"2023-10-09T11:57:01.904781+0000","last_clean":"2023-10-09T11:57:01.904781+0000","last_became_active":"2023-10-09T11:57:01.899555+0000","last_became_peered":"2023-10-09T11:57:01.899555+0000","last_unstale":"2023-10-09T11:57:01.904781+0000","last_undegraded":"2023-10-09T11:57:01.904781+0000","last_fullsized":"2023-10-09T11:57:01.904781+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:59.402274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906680+0000","last_change":"2023-10-09T11:57:01.904151+0000","last_active":"2023-10-09T11:57:01.906680+0000","last_peered":"2023-10-09T11:57:01.906680+0000","last_clean":"2023-10-09T11:57:01.906680+0000","last_became_active":"2023-10-09T11:57:01.903816+0000","last_became_peered":"2023-10-09T11:57:01.903816+0000","last_unstale":"2023-10-09T11:57:01.906680+0000","last_undegraded":"2023-10-09T11:57:01.906680+0000","last_fullsized":"2023-10-09T11:57:01.906680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:35.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.906114+0000","last_change":"2023-10-09T11:57:01.902016+0000","last_active":"2023-10-09T11:57:01.906114+0000","last_peered":"2023-10-09T11:57:01.906114+0000","last_clean":"2023-10-09T11:57:01.906114+0000","last_became_active":"2023-10-09T11:57:01.901714+0000","last_became_peered":"2023-10-09T11:57:01.901714+0000","last_unstale":"2023-10-09T11:57:01.906114+0000","last_undegraded":"2023-10-09T11:57:01.906114+0000","last_fullsized":"2023-10-09T11:57:01.906114+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:07.153758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.888244+0000","last_change":"2023-10-09T11:57:01.886855+0000","last_active":"2023-10-09T11:57:01.888244+0000","last_peered":"2023-10-09T11:57:01.888244+0000","last_clean":"2023-10-09T11:57:01.888244+0000","last_became_active":"2023-10-09T11:57:01.886601+0000","last_became_peered":"2023-10-09T11:57:01.886601+0000","last_unstale":"2023-10-09T11:57:01.888244+0000","last_undegraded":"2023-10-09T11:57:01.888244+0000","last_fullsized":"2023-10-09T11:57:01.888244+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:06.251475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.892019+0000","last_change":"2023-10-09T11:57:01.888835+0000","last_active":"2023-10-09T11:57:01.892019+0000","last_peered":"2023-10-09T11:57:01.892019+0000","last_clean":"2023-10-09T11:57:01.892019+0000","last_became_active":"2023-10-09T11:57:01.888465+0000","last_became_peered":"2023-10-09T11:57:01.888465+0000","last_unstale":"2023-10-09T11:57:01.892019+0000","last_undegraded":"2023-10-09T11:57:01.892019+0000","last_fullsized":"2023-10-09T11:57:01.892019+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:38.442046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895342+0000","last_change":"2023-10-09T11:57:01.892858+0000","last_active":"2023-10-09T11:57:01.895342+0000","last_peered":"2023-10-09T11:57:01.895342+0000","last_clean":"2023-10-09T11:57:01.895342+0000","last_became_active":"2023-10-09T11:57:01.892579+0000","last_became_peered":"2023-10-09T11:57:01.892579+0000","last_unstale":"2023-10-09T11:57:01.895342+0000","last_undegraded":"2023-10-09T11:57:01.895342+0000","last_fullsized":"2023-10-09T11:57:01.895342+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:33.832209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896878+0000","last_change":"2023-10-09T11:57:01.893534+0000","last_active":"2023-10-09T11:57:01.896878+0000","last_peered":"2023-10-09T11:57:01.896878+0000","last_clean":"2023-10-09T11:57:01.896878+0000","last_became_active":"2023-10-09T11:57:01.893232+0000","last_became_peered":"2023-10-09T11:57:01.893232+0000","last_unstale":"2023-10-09T11:57:01.896878+0000","last_undegraded":"2023-10-09T11:57:01.896878+0000","last_fullsized":"2023-10-09T11:57:01.896878+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:54:32.714033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905113+0000","last_change":"2023-10-09T11:57:01.900461+0000","last_active":"2023-10-09T11:57:01.905113+0000","last_peered":"2023-10-09T11:57:01.905113+0000","last_clean":"2023-10-09T11:57:01.905113+0000","last_became_active":"2023-10-09T11:57:01.900120+0000","last_became_peered":"2023-10-09T11:57:01.900120+0000","last_unstale":"2023-10-09T11:57:01.905113+0000","last_undegraded":"2023-10-09T11:57:01.905113+0000","last_fullsized":"2023-10-09T11:57:01.905113+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:30.432171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.901047+0000","last_change":"2023-10-09T11:57:01.897211+0000","last_active":"2023-10-09T11:57:01.901047+0000","last_peered":"2023-10-09T11:57:01.901047+0000","last_clean":"2023-10-09T11:57:01.901047+0000","last_became_active":"2023-10-09T11:57:01.896917+0000","last_became_peered":"2023-10-09T11:57:01.896917+0000","last_unstale":"2023-10-09T11:57:01.901047+0000","last_undegraded":"2023-10-09T11:57:01.901047+0000","last_fullsized":"2023-10-09T11:57:01.901047+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:13.655438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902954+0000","last_change":"2023-10-09T11:57:01.899654+0000","last_active":"2023-10-09T11:57:01.902954+0000","last_peered":"2023-10-09T11:57:01.902954+0000","last_clean":"2023-10-09T11:57:01.902954+0000","last_became_active":"2023-10-09T11:57:01.899356+0000","last_became_peered":"2023-10-09T11:57:01.899356+0000","last_unstale":"2023-10-09T11:57:01.902954+0000","last_undegraded":"2023-10-09T11:57:01.902954+0000","last_fullsized":"2023-10-09T11:57:01.902954+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:16.697104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903705+0000","last_change":"2023-10-09T11:57:01.899841+0000","last_active":"2023-10-09T11:57:01.903705+0000","last_peered":"2023-10-09T11:57:01.903705+0000","last_clean":"2023-10-09T11:57:01.903705+0000","last_became_active":"2023-10-09T11:57:01.899572+0000","last_became_peered":"2023-10-09T11:57:01.899572+0000","last_unstale":"2023-10-09T11:57:01.903705+0000","last_undegraded":"2023-10-09T11:57:01.903705+0000","last_fullsized":"2023-10-09T11:57:01.903705+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:36.026475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895381+0000","last_change":"2023-10-09T11:57:01.892715+0000","last_active":"2023-10-09T11:57:01.895381+0000","last_peered":"2023-10-09T11:57:01.895381+0000","last_clean":"2023-10-09T11:57:01.895381+0000","last_became_active":"2023-10-09T11:57:01.892418+0000","last_became_peered":"2023-10-09T11:57:01.892418+0000","last_unstale":"2023-10-09T11:57:01.895381+0000","last_undegraded":"2023-10-09T11:57:01.895381+0000","last_fullsized":"2023-10-09T11:57:01.895381+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:21.422159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903213+0000","last_change":"2023-10-09T11:57:01.897051+0000","last_active":"2023-10-09T11:57:01.903213+0000","last_peered":"2023-10-09T11:57:01.903213+0000","last_clean":"2023-10-09T11:57:01.903213+0000","last_became_active":"2023-10-09T11:57:01.896801+0000","last_became_peered":"2023-10-09T11:57:01.896801+0000","last_unstale":"2023-10-09T11:57:01.903213+0000","last_undegraded":"2023-10-09T11:57:01.903213+0000","last_fullsized":"2023-10-09T11:57:01.903213+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:23.163786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903370+0000","last_change":"2023-10-09T11:57:01.899475+0000","last_active":"2023-10-09T11:57:01.903370+0000","last_peered":"2023-10-09T11:57:01.903370+0000","last_clean":"2023-10-09T11:57:01.903370+0000","last_became_active":"2023-10-09T11:57:01.899189+0000","last_became_peered":"2023-10-09T11:57:01.899189+0000","last_unstale":"2023-10-09T11:57:01.903370+0000","last_undegraded":"2023-10-09T11:57:01.903370+0000","last_fullsized":"2023-10-09T11:57:01.903370+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:42.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898469+0000","last_change":"2023-10-09T11:57:01.892806+0000","last_active":"2023-10-09T11:57:01.898469+0000","last_peered":"2023-10-09T11:57:01.898469+0000","last_clean":"2023-10-09T11:57:01.898469+0000","last_became_active":"2023-10-09T11:57:01.892495+0000","last_became_peered":"2023-10-09T11:57:01.892495+0000","last_unstale":"2023-10-09T11:57:01.898469+0000","last_undegraded":"2023-10-09T11:57:01.898469+0000","last_fullsized":"2023-10-09T11:57:01.898469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:11.810735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905855+0000","last_change":"2023-10-09T11:57:01.901639+0000","last_active":"2023-10-09T11:57:01.905855+0000","last_peered":"2023-10-09T11:57:01.905855+0000","last_clean":"2023-10-09T11:57:01.905855+0000","last_became_active":"2023-10-09T11:57:01.901391+0000","last_became_peered":"2023-10-09T11:57:01.901391+0000","last_unstale":"2023-10-09T11:57:01.905855+0000","last_undegraded":"2023-10-09T11:57:01.905855+0000","last_fullsized":"2023-10-09T11:57:01.905855+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:39:55.834965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903877+0000","last_change":"2023-10-09T11:57:01.899715+0000","last_active":"2023-10-09T11:57:01.903877+0000","last_peered":"2023-10-09T11:57:01.903877+0000","last_clean":"2023-10-09T11:57:01.903877+0000","last_became_active":"2023-10-09T11:57:01.899367+0000","last_became_peered":"2023-10-09T11:57:01.899367+0000","last_unstale":"2023-10-09T11:57:01.903877+0000","last_undegraded":"2023-10-09T11:57:01.903877+0000","last_fullsized":"2023-10-09T11:57:01.903877+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:37.045739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.910186+0000","last_change":"2023-10-09T11:57:00.888942+0000","last_active":"2023-10-09T11:57:01.910186+0000","last_peered":"2023-10-09T11:57:01.910186+0000","last_clean":"2023-10-09T11:57:01.910186+0000","last_became_active":"2023-10-09T11:57:00.888631+0000","last_became_peered":"2023-10-09T11:57:00.888631+0000","last_unstale":"2023-10-09T11:57:01.910186+0000","last_undegraded":"2023-10-09T11:57:01.910186+0000","last_fullsized":"2023-10-09T11:57:01.910186+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:36.039260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905084+0000","last_change":"2023-10-09T11:57:01.900417+0000","last_active":"2023-10-09T11:57:01.905084+0000","last_peered":"2023-10-09T11:57:01.905084+0000","last_clean":"2023-10-09T11:57:01.905084+0000","last_became_active":"2023-10-09T11:57:01.900179+0000","last_became_peered":"2023-10-09T11:57:01.900179+0000","last_unstale":"2023-10-09T11:57:01.905084+0000","last_undegraded":"2023-10-09T11:57:01.905084+0000","last_fullsized":"2023-10-09T11:57:01.905084+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:03.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907728+0000","last_change":"2023-10-09T11:57:00.878267+0000","last_active":"2023-10-09T11:57:01.907728+0000","last_peered":"2023-10-09T11:57:01.907728+0000","last_clean":"2023-10-09T11:57:01.907728+0000","last_became_active":"2023-10-09T11:57:00.877902+0000","last_became_peered":"2023-10-09T11:57:00.877902+0000","last_unstale":"2023-10-09T11:57:01.907728+0000","last_undegraded":"2023-10-09T11:57:01.907728+0000","last_fullsized":"2023-10-09T11:57:01.907728+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:44.647321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902915+0000","last_change":"2023-10-09T11:57:01.899719+0000","last_active":"2023-10-09T11:57:01.902915+0000","last_peered":"2023-10-09T11:57:01.902915+0000","last_clean":"2023-10-09T11:57:01.902915+0000","last_became_active":"2023-10-09T11:57:01.899475+0000","last_became_peered":"2023-10-09T11:57:01.899475+0000","last_unstale":"2023-10-09T11:57:01.902915+0000","last_undegraded":"2023-10-09T11:57:01.902915+0000","last_fullsized":"2023-10-09T11:57:01.902915+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:58:10.816559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912869+0000","last_change":"2023-10-09T11:57:00.882066+0000","last_active":"2023-10-09T11:57:01.912869+0000","last_peered":"2023-10-09T11:57:01.912869+0000","last_clean":"2023-10-09T11:57:01.912869+0000","last_became_active":"2023-10-09T11:57:00.880988+0000","last_became_peered":"2023-10-09T11:57:00.880988+0000","last_unstale":"2023-10-09T11:57:01.912869+0000","last_undegraded":"2023-10-09T11:57:01.912869+0000","last_fullsized":"2023-10-09T11:57:01.912869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:05:20.197863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895219+0000","last_change":"2023-10-09T11:57:01.888086+0000","last_active":"2023-10-09T11:57:01.895219+0000","last_peered":"2023-10-09T11:57:01.895219+0000","last_clean":"2023-10-09T11:57:01.895219+0000","last_became_active":"2023-10-09T11:57:01.887785+0000","last_became_peered":"2023-10-09T11:57:01.887785+0000","last_unstale":"2023-10-09T11:57:01.895219+0000","last_undegraded":"2023-10-09T11:57:01.895219+0000","last_fullsized":"2023-10-09T11:57:01.895219+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:29.531258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912111+0000","last_change":"2023-10-09T11:57:00.883824+0000","last_active":"2023-10-09T11:57:01.912111+0000","last_peered":"2023-10-09T11:57:01.912111+0000","last_clean":"2023-10-09T11:57:01.912111+0000","last_became_active":"2023-10-09T11:57:00.883236+0000","last_became_peered":"2023-10-09T11:57:00.883236+0000","last_unstale":"2023-10-09T11:57:01.912111+0000","last_undegraded":"2023-10-09T11:57:01.912111+0000","last_fullsized":"2023-10-09T11:57:01.912111+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:06.543195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903389+0000","last_change":"2023-10-09T11:57:01.900090+0000","last_active":"2023-10-09T11:57:01.903389+0000","last_peered":"2023-10-09T11:57:01.903389+0000","last_clean":"2023-10-09T11:57:01.903389+0000","last_became_active":"2023-10-09T11:57:01.899793+0000","last_became_peered":"2023-10-09T11:57:01.899793+0000","last_unstale":"2023-10-09T11:57:01.903389+0000","last_undegraded":"2023-10-09T11:57:01.903389+0000","last_fullsized":"2023-10-09T11:57:01.903389+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:44:06.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907589+0000","last_change":"2023-10-09T11:57:00.879590+0000","last_active":"2023-10-09T11:57:01.907589+0000","last_peered":"2023-10-09T11:57:01.907589+0000","last_clean":"2023-10-09T11:57:01.907589+0000","last_became_active":"2023-10-09T11:57:00.879341+0000","last_became_peered":"2023-10-09T11:57:00.879341+0000","last_unstale":"2023-10-09T11:57:01.907589+0000","last_undegraded":"2023-10-09T11:57:01.907589+0000","last_fullsized":"2023-10-09T11:57:01.907589+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:36.780952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898650+0000","last_change":"2023-10-09T11:57:01.896371+0000","last_active":"2023-10-09T11:57:01.898650+0000","last_peered":"2023-10-09T11:57:01.898650+0000","last_clean":"2023-10-09T11:57:01.898650+0000","last_became_active":"2023-10-09T11:57:01.896126+0000","last_became_peered":"2023-10-09T11:57:01.896126+0000","last_unstale":"2023-10-09T11:57:01.898650+0000","last_undegraded":"2023-10-09T11:57:01.898650+0000","last_fullsized":"2023-10-09T11:57:01.898650+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:18:07.551030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912165+0000","last_change":"2023-10-09T11:57:00.887038+0000","last_active":"2023-10-09T11:57:01.912165+0000","last_peered":"2023-10-09T11:57:01.912165+0000","last_clean":"2023-10-09T11:57:01.912165+0000","last_became_active":"2023-10-09T11:57:00.886351+0000","last_became_peered":"2023-10-09T11:57:00.886351+0000","last_unstale":"2023-10-09T11:57:01.912165+0000","last_undegraded":"2023-10-09T11:57:01.912165+0000","last_fullsized":"2023-10-09T11:57:01.912165+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:20.414324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895473+0000","last_change":"2023-10-09T11:57:01.889203+0000","last_active":"2023-10-09T11:57:01.895473+0000","last_peered":"2023-10-09T11:57:01.895473+0000","last_clean":"2023-10-09T11:57:01.895473+0000","last_became_active":"2023-10-09T11:57:01.888942+0000","last_became_peered":"2023-10-09T11:57:01.888942+0000","last_unstale":"2023-10-09T11:57:01.895473+0000","last_undegraded":"2023-10-09T11:57:01.895473+0000","last_fullsized":"2023-10-09T11:57:01.895473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:25.627287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877931+0000","last_change":"2023-10-09T11:57:00.875698+0000","last_active":"2023-10-09T11:57:01.877931+0000","last_peered":"2023-10-09T11:57:01.877931+0000","last_clean":"2023-10-09T11:57:01.877931+0000","last_became_active":"2023-10-09T11:57:00.875321+0000","last_became_peered":"2023-10-09T11:57:00.875321+0000","last_unstale":"2023-10-09T11:57:01.877931+0000","last_undegraded":"2023-10-09T11:57:01.877931+0000","last_fullsized":"2023-10-09T11:57:01.877931+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:49.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897543+0000","last_change":"2023-10-09T11:57:01.896694+0000","last_active":"2023-10-09T11:57:01.897543+0000","last_peered":"2023-10-09T11:57:01.897543+0000","last_clean":"2023-10-09T11:57:01.897543+0000","last_became_active":"2023-10-09T11:57:01.896409+0000","last_became_peered":"2023-10-09T11:57:01.896409+0000","last_unstale":"2023-10-09T11:57:01.897543+0000","last_undegraded":"2023-10-09T11:57:01.897543+0000","last_fullsized":"2023-10-09T11:57:01.897543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:39:37.788787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.883973+0000","last_change":"2023-10-09T11:57:00.873054+0000","last_active":"2023-10-09T11:57:01.883973+0000","last_peered":"2023-10-09T11:57:01.883973+0000","last_clean":"2023-10-09T11:57:01.883973+0000","last_became_active":"2023-10-09T11:57:00.872753+0000","last_became_peered":"2023-10-09T11:57:00.872753+0000","last_unstale":"2023-10-09T11:57:01.883973+0000","last_undegraded":"2023-10-09T11:57:01.883973+0000","last_fullsized":"2023-10-09T11:57:01.883973+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:27.215974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902935+0000","last_change":"2023-10-09T11:57:01.899089+0000","last_active":"2023-10-09T11:57:01.902935+0000","last_peered":"2023-10-09T11:57:01.902935+0000","last_clean":"2023-10-09T11:57:01.902935+0000","last_became_active":"2023-10-09T11:57:01.898828+0000","last_became_peered":"2023-10-09T11:57:01.898828+0000","last_unstale":"2023-10-09T11:57:01.902935+0000","last_undegraded":"2023-10-09T11:57:01.902935+0000","last_fullsized":"2023-10-09T11:57:01.902935+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:39:55.834965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.879781+0000","last_change":"2023-10-09T11:57:00.877305+0000","last_active":"2023-10-09T11:57:01.879781+0000","last_peered":"2023-10-09T11:57:01.879781+0000","last_clean":"2023-10-09T11:57:01.879781+0000","last_became_active":"2023-10-09T11:57:00.877042+0000","last_became_peered":"2023-10-09T11:57:00.877042+0000","last_unstale":"2023-10-09T11:57:01.879781+0000","last_undegraded":"2023-10-09T11:57:01.879781+0000","last_fullsized":"2023-10-09T11:57:01.879781+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:04.734221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907957+0000","last_change":"2023-10-09T11:57:01.901274+0000","last_active":"2023-10-09T11:57:01.907957+0000","last_peered":"2023-10-09T11:57:01.907957+0000","last_clean":"2023-10-09T11:57:01.907957+0000","last_became_active":"2023-10-09T11:57:01.900960+0000","last_became_peered":"2023-10-09T11:57:01.900960+0000","last_unstale":"2023-10-09T11:57:01.907957+0000","last_undegraded":"2023-10-09T11:57:01.907957+0000","last_fullsized":"2023-10-09T11:57:01.907957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:11.791315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.891248+0000","last_change":"2023-10-09T11:57:00.884784+0000","last_active":"2023-10-09T11:57:01.891248+0000","last_peered":"2023-10-09T11:57:01.891248+0000","last_clean":"2023-10-09T11:57:01.891248+0000","last_became_active":"2023-10-09T11:57:00.884529+0000","last_became_peered":"2023-10-09T11:57:00.884529+0000","last_unstale":"2023-10-09T11:57:01.891248+0000","last_undegraded":"2023-10-09T11:57:01.891248+0000","last_fullsized":"2023-10-09T11:57:01.891248+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:28.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902898+0000","last_change":"2023-10-09T11:57:01.898096+0000","last_active":"2023-10-09T11:57:01.902898+0000","last_peered":"2023-10-09T11:57:01.902898+0000","last_clean":"2023-10-09T11:57:01.902898+0000","last_became_active":"2023-10-09T11:57:01.897528+0000","last_became_peered":"2023-10-09T11:57:01.897528+0000","last_unstale":"2023-10-09T11:57:01.902898+0000","last_undegraded":"2023-10-09T11:57:01.902898+0000","last_fullsized":"2023-10-09T11:57:01.902898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:16.697104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907711+0000","last_change":"2023-10-09T11:57:00.878261+0000","last_active":"2023-10-09T11:57:01.907711+0000","last_peered":"2023-10-09T11:57:01.907711+0000","last_clean":"2023-10-09T11:57:01.907711+0000","last_became_active":"2023-10-09T11:57:00.877980+0000","last_became_peered":"2023-10-09T11:57:00.877980+0000","last_unstale":"2023-10-09T11:57:01.907711+0000","last_undegraded":"2023-10-09T11:57:01.907711+0000","last_fullsized":"2023-10-09T11:57:01.907711+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:20.720615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.897902+0000","last_change":"2023-10-09T11:57:01.894584+0000","last_active":"2023-10-09T11:57:01.897902+0000","last_peered":"2023-10-09T11:57:01.897902+0000","last_clean":"2023-10-09T11:57:01.897902+0000","last_became_active":"2023-10-09T11:57:01.894306+0000","last_became_peered":"2023-10-09T11:57:01.894306+0000","last_unstale":"2023-10-09T11:57:01.897902+0000","last_undegraded":"2023-10-09T11:57:01.897902+0000","last_fullsized":"2023-10-09T11:57:01.897902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:54:07.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"93'6","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.911706+0000","last_change":"2023-10-09T11:57:00.875047+0000","last_active":"2023-10-09T11:57:01.911706+0000","last_peered":"2023-10-09T11:57:01.911706+0000","last_clean":"2023-10-09T11:57:01.911706+0000","last_became_active":"2023-10-09T11:57:00.874667+0000","last_became_peered":"2023-10-09T11:57:00.874667+0000","last_unstale":"2023-10-09T11:57:01.911706+0000","last_undegraded":"2023-10-09T11:57:01.911706+0000","last_fullsized":"2023-10-09T11:57:01.911706+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:44.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898050+0000","last_change":"2023-10-09T11:57:01.895060+0000","last_active":"2023-10-09T11:57:01.898050+0000","last_peered":"2023-10-09T11:57:01.898050+0000","last_clean":"2023-10-09T11:57:01.898050+0000","last_became_active":"2023-10-09T11:57:01.894452+0000","last_became_peered":"2023-10-09T11:57:01.894452+0000","last_unstale":"2023-10-09T11:57:01.898050+0000","last_undegraded":"2023-10-09T11:57:01.898050+0000","last_fullsized":"2023-10-09T11:57:01.898050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:48.902498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912974+0000","last_change":"2023-10-09T11:57:00.880796+0000","last_active":"2023-10-09T11:57:01.912974+0000","last_peered":"2023-10-09T11:57:01.912974+0000","last_clean":"2023-10-09T11:57:01.912974+0000","last_became_active":"2023-10-09T11:57:00.880521+0000","last_became_peered":"2023-10-09T11:57:00.880521+0000","last_unstale":"2023-10-09T11:57:01.912974+0000","last_undegraded":"2023-10-09T11:57:01.912974+0000","last_fullsized":"2023-10-09T11:57:01.912974+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:28.644141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898410+0000","last_change":"2023-10-09T11:57:01.895473+0000","last_active":"2023-10-09T11:57:01.898410+0000","last_peered":"2023-10-09T11:57:01.898410+0000","last_clean":"2023-10-09T11:57:01.898410+0000","last_became_active":"2023-10-09T11:57:01.895198+0000","last_became_peered":"2023-10-09T11:57:01.895198+0000","last_unstale":"2023-10-09T11:57:01.898410+0000","last_undegraded":"2023-10-09T11:57:01.898410+0000","last_fullsized":"2023-10-09T11:57:01.898410+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:27.189015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.891490+0000","last_change":"2023-10-09T11:57:00.883630+0000","last_active":"2023-10-09T11:57:01.891490+0000","last_peered":"2023-10-09T11:57:01.891490+0000","last_clean":"2023-10-09T11:57:01.891490+0000","last_became_active":"2023-10-09T11:57:00.883359+0000","last_became_peered":"2023-10-09T11:57:00.883359+0000","last_unstale":"2023-10-09T11:57:01.891490+0000","last_undegraded":"2023-10-09T11:57:01.891490+0000","last_fullsized":"2023-10-09T11:57:01.891490+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:50.274562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896484+0000","last_change":"2023-10-09T11:57:01.891896+0000","last_active":"2023-10-09T11:57:01.896484+0000","last_peered":"2023-10-09T11:57:01.896484+0000","last_clean":"2023-10-09T11:57:01.896484+0000","last_became_active":"2023-10-09T11:57:01.891591+0000","last_became_peered":"2023-10-09T11:57:01.891591+0000","last_unstale":"2023-10-09T11:57:01.896484+0000","last_undegraded":"2023-10-09T11:57:01.896484+0000","last_fullsized":"2023-10-09T11:57:01.896484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:21.728449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.883976+0000","last_change":"2023-10-09T11:57:00.876623+0000","last_active":"2023-10-09T11:57:01.883976+0000","last_peered":"2023-10-09T11:57:01.883976+0000","last_clean":"2023-10-09T11:57:01.883976+0000","last_became_active":"2023-10-09T11:57:00.876240+0000","last_became_peered":"2023-10-09T11:57:00.876240+0000","last_unstale":"2023-10-09T11:57:01.883976+0000","last_undegraded":"2023-10-09T11:57:01.883976+0000","last_fullsized":"2023-10-09T11:57:01.883976+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:21.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905186+0000","last_change":"2023-10-09T11:57:01.902110+0000","last_active":"2023-10-09T11:57:01.905186+0000","last_peered":"2023-10-09T11:57:01.905186+0000","last_clean":"2023-10-09T11:57:01.905186+0000","last_became_active":"2023-10-09T11:57:01.901790+0000","last_became_peered":"2023-10-09T11:57:01.901790+0000","last_unstale":"2023-10-09T11:57:01.905186+0000","last_undegraded":"2023-10-09T11:57:01.905186+0000","last_fullsized":"2023-10-09T11:57:01.905186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:37.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"93'8","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.913670+0000","last_change":"2023-10-09T11:57:00.885033+0000","last_active":"2023-10-09T11:57:01.913670+0000","last_peered":"2023-10-09T11:57:01.913670+0000","last_clean":"2023-10-09T11:57:01.913670+0000","last_became_active":"2023-10-09T11:57:00.884742+0000","last_became_peered":"2023-10-09T11:57:00.884742+0000","last_unstale":"2023-10-09T11:57:01.913670+0000","last_undegraded":"2023-10-09T11:57:01.913670+0000","last_fullsized":"2023-10-09T11:57:01.913670+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:45:16.036691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.885358+0000","last_change":"2023-10-09T11:57:01.880662+0000","last_active":"2023-10-09T11:57:01.885358+0000","last_peered":"2023-10-09T11:57:01.885358+0000","last_clean":"2023-10-09T11:57:01.885358+0000","last_became_active":"2023-10-09T11:57:01.880392+0000","last_became_peered":"2023-10-09T11:57:01.880392+0000","last_unstale":"2023-10-09T11:57:01.885358+0000","last_undegraded":"2023-10-09T11:57:01.885358+0000","last_fullsized":"2023-10-09T11:57:01.885358+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:14.269213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912408+0000","last_change":"2023-10-09T11:57:00.886519+0000","last_active":"2023-10-09T11:57:01.912408+0000","last_peered":"2023-10-09T11:57:01.912408+0000","last_clean":"2023-10-09T11:57:01.912408+0000","last_became_active":"2023-10-09T11:57:00.886280+0000","last_became_peered":"2023-10-09T11:57:00.886280+0000","last_unstale":"2023-10-09T11:57:01.912408+0000","last_undegraded":"2023-10-09T11:57:01.912408+0000","last_fullsized":"2023-10-09T11:57:01.912408+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:37.414967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.904949+0000","last_change":"2023-10-09T11:57:01.899115+0000","last_active":"2023-10-09T11:57:01.904949+0000","last_peered":"2023-10-09T11:57:01.904949+0000","last_clean":"2023-10-09T11:57:01.904949+0000","last_became_active":"2023-10-09T11:57:01.894079+0000","last_became_peered":"2023-10-09T11:57:01.894079+0000","last_unstale":"2023-10-09T11:57:01.904949+0000","last_undegraded":"2023-10-09T11:57:01.904949+0000","last_fullsized":"2023-10-09T11:57:01.904949+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:02.172995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912857+0000","last_change":"2023-10-09T11:57:00.884921+0000","last_active":"2023-10-09T11:57:01.912857+0000","last_peered":"2023-10-09T11:57:01.912857+0000","last_clean":"2023-10-09T11:57:01.912857+0000","last_became_active":"2023-10-09T11:57:00.884628+0000","last_became_peered":"2023-10-09T11:57:00.884628+0000","last_unstale":"2023-10-09T11:57:01.912857+0000","last_undegraded":"2023-10-09T11:57:01.912857+0000","last_fullsized":"2023-10-09T11:57:01.912857+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:59.164051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895895+0000","last_change":"2023-10-09T11:57:01.890521+0000","last_active":"2023-10-09T11:57:01.895895+0000","last_peered":"2023-10-09T11:57:01.895895+0000","last_clean":"2023-10-09T11:57:01.895895+0000","last_became_active":"2023-10-09T11:57:01.890266+0000","last_became_peered":"2023-10-09T11:57:01.890266+0000","last_unstale":"2023-10-09T11:57:01.895895+0000","last_undegraded":"2023-10-09T11:57:01.895895+0000","last_fullsized":"2023-10-09T11:57:01.895895+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:28.835667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.913545+0000","last_change":"2023-10-09T11:57:00.888249+0000","last_active":"2023-10-09T11:57:01.913545+0000","last_peered":"2023-10-09T11:57:01.913545+0000","last_clean":"2023-10-09T11:57:01.913545+0000","last_became_active":"2023-10-09T11:57:00.887971+0000","last_became_peered":"2023-10-09T11:57:00.887971+0000","last_unstale":"2023-10-09T11:57:01.913545+0000","last_undegraded":"2023-10-09T11:57:01.913545+0000","last_fullsized":"2023-10-09T11:57:01.913545+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:13.261379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895955+0000","last_change":"2023-10-09T11:57:01.892720+0000","last_active":"2023-10-09T11:57:01.895955+0000","last_peered":"2023-10-09T11:57:01.895955+0000","last_clean":"2023-10-09T11:57:01.895955+0000","last_became_active":"2023-10-09T11:57:01.892468+0000","last_became_peered":"2023-10-09T11:57:01.892468+0000","last_unstale":"2023-10-09T11:57:01.895955+0000","last_undegraded":"2023-10-09T11:57:01.895955+0000","last_fullsized":"2023-10-09T11:57:01.895955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:29.797860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877114+0000","last_change":"2023-10-09T11:57:00.887658+0000","last_active":"2023-10-09T11:57:01.877114+0000","last_peered":"2023-10-09T11:57:01.877114+0000","last_clean":"2023-10-09T11:57:01.877114+0000","last_became_active":"2023-10-09T11:57:00.887408+0000","last_became_peered":"2023-10-09T11:57:00.887408+0000","last_unstale":"2023-10-09T11:57:01.877114+0000","last_undegraded":"2023-10-09T11:57:01.877114+0000","last_fullsized":"2023-10-09T11:57:01.877114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:40.506886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.902657+0000","last_change":"2023-10-09T11:57:01.893037+0000","last_active":"2023-10-09T11:57:01.902657+0000","last_peered":"2023-10-09T11:57:01.902657+0000","last_clean":"2023-10-09T11:57:01.902657+0000","last_became_active":"2023-10-09T11:57:01.891103+0000","last_became_peered":"2023-10-09T11:57:01.891103+0000","last_unstale":"2023-10-09T11:57:01.902657+0000","last_undegraded":"2023-10-09T11:57:01.902657+0000","last_fullsized":"2023-10-09T11:57:01.902657+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:14.477829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.891597+0000","last_change":"2023-10-09T11:57:00.886723+0000","last_active":"2023-10-09T11:57:01.891597+0000","last_peered":"2023-10-09T11:57:01.891597+0000","last_clean":"2023-10-09T11:57:01.891597+0000","last_became_active":"2023-10-09T11:57:00.886368+0000","last_became_peered":"2023-10-09T11:57:00.886368+0000","last_unstale":"2023-10-09T11:57:01.891597+0000","last_undegraded":"2023-10-09T11:57:01.891597+0000","last_fullsized":"2023-10-09T11:57:01.891597+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:21.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.907413+0000","last_change":"2023-10-09T11:57:01.903102+0000","last_active":"2023-10-09T11:57:01.907413+0000","last_peered":"2023-10-09T11:57:01.907413+0000","last_clean":"2023-10-09T11:57:01.907413+0000","last_became_active":"2023-10-09T11:57:01.902794+0000","last_became_peered":"2023-10-09T11:57:01.902794+0000","last_unstale":"2023-10-09T11:57:01.907413+0000","last_undegraded":"2023-10-09T11:57:01.907413+0000","last_fullsized":"2023-10-09T11:57:01.907413+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:59.863484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.884090+0000","last_change":"2023-10-09T11:57:00.875414+0000","last_active":"2023-10-09T11:57:01.884090+0000","last_peered":"2023-10-09T11:57:01.884090+0000","last_clean":"2023-10-09T11:57:01.884090+0000","last_became_active":"2023-10-09T11:57:00.875153+0000","last_became_peered":"2023-10-09T11:57:00.875153+0000","last_unstale":"2023-10-09T11:57:01.884090+0000","last_undegraded":"2023-10-09T11:57:01.884090+0000","last_fullsized":"2023-10-09T11:57:01.884090+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:13.261379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905758+0000","last_change":"2023-10-09T11:57:01.901740+0000","last_active":"2023-10-09T11:57:01.905758+0000","last_peered":"2023-10-09T11:57:01.905758+0000","last_clean":"2023-10-09T11:57:01.905758+0000","last_became_active":"2023-10-09T11:57:01.901472+0000","last_became_peered":"2023-10-09T11:57:01.901472+0000","last_unstale":"2023-10-09T11:57:01.905758+0000","last_undegraded":"2023-10-09T11:57:01.905758+0000","last_fullsized":"2023-10-09T11:57:01.905758+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:07.745070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881369+0000","last_change":"2023-10-09T11:57:00.876926+0000","last_active":"2023-10-09T11:57:01.881369+0000","last_peered":"2023-10-09T11:57:01.881369+0000","last_clean":"2023-10-09T11:57:01.881369+0000","last_became_active":"2023-10-09T11:57:00.876682+0000","last_became_peered":"2023-10-09T11:57:00.876682+0000","last_unstale":"2023-10-09T11:57:01.881369+0000","last_undegraded":"2023-10-09T11:57:01.881369+0000","last_fullsized":"2023-10-09T11:57:01.881369+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:07.220156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.896441+0000","last_change":"2023-10-09T11:57:01.893674+0000","last_active":"2023-10-09T11:57:01.896441+0000","last_peered":"2023-10-09T11:57:01.896441+0000","last_clean":"2023-10-09T11:57:01.896441+0000","last_became_active":"2023-10-09T11:57:01.893411+0000","last_became_peered":"2023-10-09T11:57:01.893411+0000","last_unstale":"2023-10-09T11:57:01.896441+0000","last_undegraded":"2023-10-09T11:57:01.896441+0000","last_fullsized":"2023-10-09T11:57:01.896441+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:55.633922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912118+0000","last_change":"2023-10-09T11:57:00.885936+0000","last_active":"2023-10-09T11:57:01.912118+0000","last_peered":"2023-10-09T11:57:01.912118+0000","last_clean":"2023-10-09T11:57:01.912118+0000","last_became_active":"2023-10-09T11:57:00.885688+0000","last_became_peered":"2023-10-09T11:57:00.885688+0000","last_unstale":"2023-10-09T11:57:01.912118+0000","last_undegraded":"2023-10-09T11:57:01.912118+0000","last_fullsized":"2023-10-09T11:57:01.912118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:34.974290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898393+0000","last_change":"2023-10-09T11:57:01.891492+0000","last_active":"2023-10-09T11:57:01.898393+0000","last_peered":"2023-10-09T11:57:01.898393+0000","last_clean":"2023-10-09T11:57:01.898393+0000","last_became_active":"2023-10-09T11:57:01.891218+0000","last_became_peered":"2023-10-09T11:57:01.891218+0000","last_unstale":"2023-10-09T11:57:01.898393+0000","last_undegraded":"2023-10-09T11:57:01.898393+0000","last_fullsized":"2023-10-09T11:57:01.898393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:14:35.728411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.884246+0000","last_change":"2023-10-09T11:57:00.876989+0000","last_active":"2023-10-09T11:57:01.884246+0000","last_peered":"2023-10-09T11:57:01.884246+0000","last_clean":"2023-10-09T11:57:01.884246+0000","last_became_active":"2023-10-09T11:57:00.876282+0000","last_became_peered":"2023-10-09T11:57:00.876282+0000","last_unstale":"2023-10-09T11:57:01.884246+0000","last_undegraded":"2023-10-09T11:57:01.884246+0000","last_fullsized":"2023-10-09T11:57:01.884246+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:50.274562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905050+0000","last_change":"2023-10-09T11:57:01.901465+0000","last_active":"2023-10-09T11:57:01.905050+0000","last_peered":"2023-10-09T11:57:01.905050+0000","last_clean":"2023-10-09T11:57:01.905050+0000","last_became_active":"2023-10-09T11:57:01.901210+0000","last_became_peered":"2023-10-09T11:57:01.901210+0000","last_unstale":"2023-10-09T11:57:01.905050+0000","last_undegraded":"2023-10-09T11:57:01.905050+0000","last_fullsized":"2023-10-09T11:57:01.905050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:06.263122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.886070+0000","last_change":"2023-10-09T11:57:00.876079+0000","last_active":"2023-10-09T11:57:01.886070+0000","last_peered":"2023-10-09T11:57:01.886070+0000","last_clean":"2023-10-09T11:57:01.886070+0000","last_became_active":"2023-10-09T11:57:00.875547+0000","last_became_peered":"2023-10-09T11:57:00.875547+0000","last_unstale":"2023-10-09T11:57:01.886070+0000","last_undegraded":"2023-10-09T11:57:01.886070+0000","last_fullsized":"2023-10-09T11:57:01.886070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:40.767452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.898265+0000","last_change":"2023-10-09T11:57:01.894780+0000","last_active":"2023-10-09T11:57:01.898265+0000","last_peered":"2023-10-09T11:57:01.898265+0000","last_clean":"2023-10-09T11:57:01.898265+0000","last_became_active":"2023-10-09T11:57:01.894487+0000","last_became_peered":"2023-10-09T11:57:01.894487+0000","last_unstale":"2023-10-09T11:57:01.898265+0000","last_undegraded":"2023-10-09T11:57:01.898265+0000","last_fullsized":"2023-10-09T11:57:01.898265+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:59.241594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.881971+0000","last_change":"2023-10-09T11:57:00.875237+0000","last_active":"2023-10-09T11:57:01.881971+0000","last_peered":"2023-10-09T11:57:01.881971+0000","last_clean":"2023-10-09T11:57:01.881971+0000","last_became_active":"2023-10-09T11:57:00.874940+0000","last_became_peered":"2023-10-09T11:57:00.874940+0000","last_unstale":"2023-10-09T11:57:01.881971+0000","last_undegraded":"2023-10-09T11:57:01.881971+0000","last_fullsized":"2023-10-09T11:57:01.881971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.637375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905068+0000","last_change":"2023-10-09T11:57:01.901431+0000","last_active":"2023-10-09T11:57:01.905068+0000","last_peered":"2023-10-09T11:57:01.905068+0000","last_clean":"2023-10-09T11:57:01.905068+0000","last_became_active":"2023-10-09T11:57:01.901190+0000","last_became_peered":"2023-10-09T11:57:01.901190+0000","last_unstale":"2023-10-09T11:57:01.905068+0000","last_undegraded":"2023-10-09T11:57:01.905068+0000","last_fullsized":"2023-10-09T11:57:01.905068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:36.509416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.885936+0000","last_change":"2023-10-09T11:57:00.874584+0000","last_active":"2023-10-09T11:57:01.885936+0000","last_peered":"2023-10-09T11:57:01.885936+0000","last_clean":"2023-10-09T11:57:01.885936+0000","last_became_active":"2023-10-09T11:57:00.874275+0000","last_became_peered":"2023-10-09T11:57:00.874275+0000","last_unstale":"2023-10-09T11:57:01.885936+0000","last_undegraded":"2023-10-09T11:57:01.885936+0000","last_fullsized":"2023-10-09T11:57:01.885936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:00.092427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.903053+0000","last_change":"2023-10-09T11:57:01.898033+0000","last_active":"2023-10-09T11:57:01.903053+0000","last_peered":"2023-10-09T11:57:01.903053+0000","last_clean":"2023-10-09T11:57:01.903053+0000","last_became_active":"2023-10-09T11:57:01.897727+0000","last_became_peered":"2023-10-09T11:57:01.897727+0000","last_unstale":"2023-10-09T11:57:01.903053+0000","last_undegraded":"2023-10-09T11:57:01.903053+0000","last_fullsized":"2023-10-09T11:57:01.903053+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:37.047094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877934+0000","last_change":"2023-10-09T11:57:00.875984+0000","last_active":"2023-10-09T11:57:01.877934+0000","last_peered":"2023-10-09T11:57:01.877934+0000","last_clean":"2023-10-09T11:57:01.877934+0000","last_became_active":"2023-10-09T11:57:00.875743+0000","last_became_peered":"2023-10-09T11:57:00.875743+0000","last_unstale":"2023-10-09T11:57:01.877934+0000","last_undegraded":"2023-10-09T11:57:01.877934+0000","last_fullsized":"2023-10-09T11:57:01.877934+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:31:51.308477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.895628+0000","last_change":"2023-10-09T11:57:01.891953+0000","last_active":"2023-10-09T11:57:01.895628+0000","last_peered":"2023-10-09T11:57:01.895628+0000","last_clean":"2023-10-09T11:57:01.895628+0000","last_became_active":"2023-10-09T11:57:01.891592+0000","last_became_peered":"2023-10-09T11:57:01.891592+0000","last_unstale":"2023-10-09T11:57:01.895628+0000","last_undegraded":"2023-10-09T11:57:01.895628+0000","last_fullsized":"2023-10-09T11:57:01.895628+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:55.985641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877254+0000","last_change":"2023-10-09T11:57:00.884173+0000","last_active":"2023-10-09T11:57:01.877254+0000","last_peered":"2023-10-09T11:57:01.877254+0000","last_clean":"2023-10-09T11:57:01.877254+0000","last_became_active":"2023-10-09T11:57:00.883920+0000","last_became_peered":"2023-10-09T11:57:00.883920+0000","last_unstale":"2023-10-09T11:57:01.877254+0000","last_undegraded":"2023-10-09T11:57:01.877254+0000","last_fullsized":"2023-10-09T11:57:01.877254+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:54.977806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.910863+0000","last_change":"2023-10-09T11:57:01.902704+0000","last_active":"2023-10-09T11:57:01.910863+0000","last_peered":"2023-10-09T11:57:01.910863+0000","last_clean":"2023-10-09T11:57:01.910863+0000","last_became_active":"2023-10-09T11:57:01.902352+0000","last_became_peered":"2023-10-09T11:57:01.902352+0000","last_unstale":"2023-10-09T11:57:01.910863+0000","last_undegraded":"2023-10-09T11:57:01.910863+0000","last_fullsized":"2023-10-09T11:57:01.910863+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:42.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.890785+0000","last_change":"2023-10-09T11:57:00.879653+0000","last_active":"2023-10-09T11:57:01.890785+0000","last_peered":"2023-10-09T11:57:01.890785+0000","last_clean":"2023-10-09T11:57:01.890785+0000","last_became_active":"2023-10-09T11:57:00.879415+0000","last_became_peered":"2023-10-09T11:57:00.879415+0000","last_unstale":"2023-10-09T11:57:01.890785+0000","last_undegraded":"2023-10-09T11:57:01.890785+0000","last_fullsized":"2023-10-09T11:57:01.890785+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:37.434211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.905726+0000","last_change":"2023-10-09T11:57:01.902313+0000","last_active":"2023-10-09T11:57:01.905726+0000","last_peered":"2023-10-09T11:57:01.905726+0000","last_clean":"2023-10-09T11:57:01.905726+0000","last_became_active":"2023-10-09T11:57:01.902070+0000","last_became_peered":"2023-10-09T11:57:01.902070+0000","last_unstale":"2023-10-09T11:57:01.905726+0000","last_undegraded":"2023-10-09T11:57:01.905726+0000","last_fullsized":"2023-10-09T11:57:01.905726+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:00.855687+0000","last_clean_scrub_stamp":"2023-10-09T11:57:00.855687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:30.335164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.912132+0000","last_change":"2023-10-09T11:57:00.878463+0000","last_active":"2023-10-09T11:57:01.912132+0000","last_peered":"2023-10-09T11:57:01.912132+0000","last_clean":"2023-10-09T11:57:01.912132+0000","last_became_active":"2023-10-09T11:57:00.878193+0000","last_became_peered":"2023-10-09T11:57:00.878193+0000","last_unstale":"2023-10-09T11:57:01.912132+0000","last_undegraded":"2023-10-09T11:57:01.912132+0000","last_fullsized":"2023-10-09T11:57:01.912132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:56:59.847853+0000","last_clean_scrub_stamp":"2023-10-09T11:56:59.847853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:32.824374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"83'183","reported_seq":457,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:57:01.877969+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:57:01.877969+0000","last_peered":"2023-10-09T11:57:01.877969+0000","last_clean":"2023-10-09T11:57:01.877969+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:57:01.877969+0000","last_undegraded":"2023-10-09T11:57:01.877969+0000","last_fullsized":"2023-10-09T11:57:01.877969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":1136159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68500000000000005,"15min":0.70799999999999996},"min":{"1min":0.52200000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.755},"min":{"1min":0.60299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93899999999999995,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.755},"min":{"1min":0.501,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88800000000000001,"5min":1.0009999999999999,"15min":1.1599999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.202},"last":0.76800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.53900000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.96799999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73999999999999999,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.073},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34200000000000003},"max":{"1min":0.89300000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":1.04,"5min":1.083,"15min":1.083},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.111,"15min":1.111},"last":0.73999999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476928,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1142784,"data_stored":545295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94399999999999995,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.40699999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.121},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.504,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.91300000000000003,"5min":1.0049999999999999,"15min":1.216},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.439},"max":{"1min":0.96399999999999997,"5min":1.008,"15min":1.139},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":1.0009999999999999,"15min":1.431},"last":0.74099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.1040000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94599999999999995,"5min":0.98999999999999999,"15min":1.244},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.76800000000000002,"5min":0.92600000000000005,"15min":1.613},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.96699999999999997,"15min":1.7869999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.89900000000000002,"5min":0.93600000000000005,"15min":1.143},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82199999999999995,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.437},"max":{"1min":0.88400000000000001,"5min":1.03,"15min":1.506},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.499,"15min":0.45400000000000001},"max":{"1min":0.96099999999999997,"5min":0.97499999999999998,"15min":1.2330000000000001},"last":0.54800000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302512,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069328,"statfs":{"total":96636764160,"available":96326991872,"internally_reserved":0,"allocated":1155072,"data_stored":547327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.44900000000000001,"15min":0.46500000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58799999999999997,"5min":0.71899999999999997,"15min":1.3899999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.079,"5min":1.079,"15min":1.6759999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.72299999999999998,"15min":1.385},"last":0.503},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.69199999999999995,"5min":0.83199999999999996,"15min":1.099},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.536},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66700000000000004,"5min":0.78000000000000003,"15min":1.272},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.7210000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.46899999999999997},"max":{"1min":1.0660000000000001,"5min":1.1220000000000001,"15min":1.552},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92000000000000004,"5min":1.202,"15min":1.677},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.0980000000000001,"5min":1.103,"15min":1.778},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.51900000000000002,"15min":0.51100000000000001},"max":{"1min":1.0109999999999999,"5min":1.0760000000000001,"15min":1.623},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.55500000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.042,"5min":1.0549999999999999,"15min":1.708},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81799999999999995,"15min":0.83999999999999997},"min":{"1min":0.63900000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1160000000000001,"5min":1.222,"15min":1.659},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81399999999999995,"15min":0.83399999999999996},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1419999999999999,"15min":1.736},"last":0.56499999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542335,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072864,"statfs":{"total":96636764160,"available":96330612736,"internally_reserved":0,"allocated":1728512,"data_stored":1135571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.35599999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.367},"last":0.308},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.4930000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.28199999999999997},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.34499999999999997,"15min":0.30199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.7130000000000001},"last":0.37}]},{"osd":3,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.855},"last":0.436},{"interface":"front","average":{"1min":0.745,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":1.399,"5min":1.587,"15min":1.587},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.997}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54400000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.58599999999999997,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.488,"15min":1.488},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.80500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1899999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2330000000000001,"5min":1.552,"15min":1.552},"last":0.82199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306600,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065240,"statfs":{"total":96636764160,"available":96322805760,"internally_reserved":0,"allocated":1146880,"data_stored":546739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.46000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27600000000000002},"max":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51000000000000001,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.28199999999999997},"max":{"1min":0.65400000000000003,"5min":0.75,"15min":0.83799999999999997},"last":0.374}]},{"osd":1,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.502,"15min":0.496},"min":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.31},"max":{"1min":0.66600000000000004,"5min":0.76600000000000001,"15min":0.83499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.379,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.876,"15min":0.97299999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.32200000000000001},"max":{"1min":0.64800000000000002,"5min":0.84099999999999997,"15min":0.88800000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.36199999999999999},"max":{"1min":0.70299999999999996,"5min":0.77900000000000003,"15min":0.95199999999999996},"last":0.439}]},{"osd":4,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0029999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.50700000000000001},"max":{"1min":1.0249999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.97699999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.2270000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.82799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.012,"5min":1.216,"15min":1.216},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0269999999999999,"5min":1.204,"15min":1.27},"last":0.98899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.61199999999999999,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.98299999999999998,"5min":1.2310000000000001,"15min":1.246},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.022,"5min":1.155,"15min":1.2130000000000001},"last":0.96199999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509632,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1142784,"data_stored":545315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47899999999999998},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.311},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.752,"5min":0.80800000000000005,"15min":1.1140000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.35299999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.54900000000000004,"15min":0.50700000000000001},"max":{"1min":1.151,"5min":1.208,"15min":1.327},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.72499999999999998,"5min":0.63100000000000001,"15min":0.55700000000000005},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.2689999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.624,"5min":0.56999999999999995,"15min":0.495},"max":{"1min":1.246,"5min":1.246,"15min":1.2829999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.3660000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.54100000000000004,"5min":0.5,"15min":0.47999999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.53600000000000003,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.1240000000000001,"15min":1.218},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.333},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.66500000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.3560000000000001},"last":0.58999999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310688,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061152,"statfs":{"total":96636764160,"available":96318619648,"internally_reserved":0,"allocated":1138688,"data_stored":545273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":1.071},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.56699999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.98899999999999999,"15min":1.2010000000000001},"last":0.77900000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":1.2569999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.56299999999999994,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":0.92300000000000004,"5min":0.95799999999999996,"15min":1.2909999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":0.82499999999999996,"5min":0.95399999999999996,"15min":1.0149999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91600000000000004,"5min":0.93700000000000006,"15min":1.234},"last":0.81299999999999994}]},{"osd":3,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84199999999999997,"5min":0.97899999999999998,"15min":1.1499999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.745,"15min":0.75900000000000001},"min":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":1.1639999999999999},"last":0.96199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.36099999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0820000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.1140000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":1.125},"last":0.747},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.373},"last":0.94599999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.2410000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91400000000000003,"5min":0.997,"15min":1.222},"last":0.67800000000000005}]}]},{"osd":5,"up_from":16,"seq":68719476927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1138688,"data_stored":545293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.91200000000000003,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.47099999999999997,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.94399999999999995,"5min":1.909,"15min":1.909},"last":0.624},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.45900000000000002},"max":{"1min":0.95699999999999996,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.997,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.77900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.44900000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.83799999999999997,"5min":2.105,"15min":2.105},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97299999999999998,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.70499999999999996},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.81699999999999995,"5min":2.2309999999999999,"15min":3.3620000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.93000000000000005,"5min":2.2130000000000001,"15min":3.3149999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:11.454 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:57:11.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:57:11.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.675+0000 7f6a67fff700 1 Processor -- start 2023-10-09T11:57:11.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.675+0000 7f6a67fff700 1 -- start start 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.676+0000 7f6a67fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6a680c7840 0x7f6a68159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.676+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 0x7f6a68159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.676+0000 7f6a67fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6806e510 con 0x7f6a6815a3a0 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.676+0000 7f6a67fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a680c7220 con 0x7f6a680c7840 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.676+0000 7f6a67fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6806df20 con 0x7f6a680c7c10 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.676+0000 7f6a677fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6a6815a3a0 0x7f6a6806e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55658/0 (socket says 172.21.15.86:55658) 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.676+0000 7f6a677fe700 1 -- 172.21.15.86:0/3080107185 learned_addr learned my addr 172.21.15.86:0/3080107185 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a667fc700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 0x7f6a68159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a66ffd700 1 --2- 172.21.15.86:0/3080107185 >> v2:172.21.15.135:3300/0 conn(0x7f6a680c7840 0x7f6a68159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794996580 0 0) 0x7f6a6806e510 con 0x7f6a6815a3a0 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a50003570 con 0x7f6a6815a3a0 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1071517274 0 0) 0x7f6a50003570 con 0x7f6a6815a3a0 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 msgr2=0x7f6a68159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 0x7f6a68159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 >> v2:172.21.15.135:3300/0 conn(0x7f6a680c7840 msgr2=0x7f6a68159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 --2- 172.21.15.86:0/3080107185 >> v2:172.21.15.135:3300/0 conn(0x7f6a680c7840 0x7f6a68159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68157040 con 0x7f6a6815a3a0 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f6a60001470 con 0x7f6a6815a3a0 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 >> v1:172.21.15.86:6789/0 conn(0x7f6a6815a3a0 legacy=0x7f6a6806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 0x7f6a50003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a50003fe0 0x7f6a50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50004d50 0x7f6a500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680c7220 con 0x7f6a50004d50 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6806df20 con 0x7f6a50003fe0 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.677+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5000ba90 con 0x7f6a680c7c10 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a677fe700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50004d50 0x7f6a500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a667fc700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a50003fe0 0x7f6a50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a66ffd700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 0x7f6a50003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a667fc700 1 -- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 msgr2=0x7f6a50003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a667fc700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680c7c10 0x7f6a50003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a667fc700 1 -- 172.21.15.86:0/3080107185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50004d50 msgr2=0x7f6a500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a667fc700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50004d50 0x7f6a500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a667fc700 1 -- 172.21.15.86:0/3080107185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50003570 con 0x7f6a50003fe0 2023-10-09T11:57:11.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a677fe700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50004d50 0x7f6a500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:11.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.678+0000 7f6a667fc700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a50003fe0 0x7f6a50004810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009c00 tx=0x7f6a5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1033cb172fe60da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:11.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00e710 con 0x7f6a50003fe0 2023-10-09T11:57:11.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00e870 con 0x7f6a50003fe0 2023-10-09T11:57:11.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a65ffb700 1 -- 172.21.15.86:0/3080107185 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00ec30 con 0x7f6a50003fe0 2023-10-09T11:57:11.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a67fff700 1 -- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a50003fe0 msgr2=0x7f6a50004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a67fff700 1 --2- 172.21.15.86:0/3080107185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a50003fe0 0x7f6a50004810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009c00 tx=0x7f6a5c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a677fe700 1 -- 172.21.15.86:0/3080107185 reap_dead start 2023-10-09T11:57:11.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a67fff700 1 -- 172.21.15.86:0/3080107185 shutdown_connections 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a67fff700 1 -- 172.21.15.86:0/3080107185 >> 172.21.15.86:0/3080107185 conn(0x7f6a68068e20 msgr2=0x7f6a680cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a67fff700 1 -- 172.21.15.86:0/3080107185 shutdown_connections 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.679+0000 7f6a67fff700 1 -- 172.21.15.86:0/3080107185 wait complete. 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.681+0000 7f6a67fff700 1 Processor -- start 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.681+0000 7f6a67fff700 1 -- start start 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50003fe0 0x7f6a680c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a680af7a0 0x7f6a680b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680afc10 0x7f6a680b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a67fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680b1d20 con 0x7f6a50003fe0 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a67fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680c4140 con 0x7f6a680af7a0 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a67fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680c4420 con 0x7f6a680afc10 2023-10-09T11:57:11.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a66ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50003fe0 0x7f6a680c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a66ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50003fe0 0x7f6a680c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43974/0 (socket says 172.21.15.86:43974) 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a66ffd700 1 -- 172.21.15.86:0/1396607079 learned_addr learned my addr 172.21.15.86:0/1396607079 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a667fc700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a680af7a0 0x7f6a680b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a677fe700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680afc10 0x7f6a680b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a66ffd700 1 -- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680afc10 msgr2=0x7f6a680b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a66ffd700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680afc10 0x7f6a680b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.682+0000 7f6a66ffd700 1 -- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a680af7a0 msgr2=0x7f6a680b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a66ffd700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a680af7a0 0x7f6a680b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a66ffd700 1 -- 172.21.15.86:0/1396607079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680c4700 con 0x7f6a50003fe0 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a66ffd700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50003fe0 0x7f6a680c5b60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6a58011f80 tx=0x7f6a5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a4effd700 1 -- 172.21.15.86:0/1396607079 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800e040 con 0x7f6a50003fe0 2023-10-09T11:57:11.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a4effd700 1 -- 172.21.15.86:0/1396607079 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5800f040 con 0x7f6a50003fe0 2023-10-09T11:57:11.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a680c49e0 con 0x7f6a50003fe0 2023-10-09T11:57:11.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a4effd700 1 -- 172.21.15.86:0/1396607079 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58015430 con 0x7f6a50003fe0 2023-10-09T11:57:11.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.683+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a680c4fa0 con 0x7f6a50003fe0 2023-10-09T11:57:11.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.684+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6804c3c0 con 0x7f6a50003fe0 2023-10-09T11:57:11.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.685+0000 7f6a4effd700 1 -- 172.21.15.86:0/1396607079 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a580157e0 con 0x7f6a50003fe0 2023-10-09T11:57:11.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.686+0000 7f6a4effd700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a54066f30 0x7f6a540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:11.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.686+0000 7f6a4effd700 1 -- 172.21.15.86:0/1396607079 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f6a58085450 con 0x7f6a50003fe0 2023-10-09T11:57:11.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.686+0000 7f6a667fc700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a54066f30 0x7f6a540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:11.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.687+0000 7f6a667fc700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a54066f30 0x7f6a540693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0091e0 tx=0x7f6a5c01a000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:11.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.690+0000 7f6a4effd700 1 -- 172.21.15.86:0/1396607079 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a58055fd0 con 0x7f6a50003fe0 2023-10-09T11:57:11.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.956+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6a6806d560 con 0x7f6a50003fe0 2023-10-09T11:57:11.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.960+0000 7f6a4effd700 1 -- 172.21.15.86:0/1396607079 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6a58055bc0 con 0x7f6a50003fe0 2023-10-09T11:57:11.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a54066f30 msgr2=0x7f6a540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a54066f30 0x7f6a540693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0091e0 tx=0x7f6a5c01a000 comp rx=0 tx=0).stop 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50003fe0 msgr2=0x7f6a680c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50003fe0 0x7f6a680c5b60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6a58011f80 tx=0x7f6a5800b040 comp rx=0 tx=0).stop 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 shutdown_connections 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6a54066f30 0x7f6a540693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a50003fe0 0x7f6a680c5b60 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a680afc10 0x7f6a680b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 --2- 172.21.15.86:0/1396607079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a680af7a0 0x7f6a680b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 >> 172.21.15.86:0/1396607079 conn(0x7f6a68068e20 msgr2=0x7f6a680c1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 shutdown_connections 2023-10-09T11:57:11.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:11.963+0000 7f6a67fff700 1 -- 172.21.15.86:0/1396607079 wait complete. 2023-10-09T11:57:11.965 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T11:57:11.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:12.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.161+0000 7fb02d9ff700 1 Processor -- start 2023-10-09T11:57:12.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.161+0000 7fb02d9ff700 1 -- start start 2023-10-09T11:57:12.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb02d9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb0280cbf30 0x7fb0280ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb02d9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb0280b1420 0x7fb0280c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb02d9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280cc300 con 0x7fb0280ccf90 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb02d9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb028156bf0 con 0x7fb0280cbf30 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb02d9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0280ae950 con 0x7fb0280b1420 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb026ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb0280cbf30 0x7fb0280ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb01ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb0280ccf90 0x7fb0280b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55674/0 (socket says 172.21.15.86:55674) 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb01ffff700 1 -- 172.21.15.86:0/3950542314 learned_addr learned my addr 172.21.15.86:0/3950542314 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb0277fe700 1 --2- 172.21.15.86:0/3950542314 >> v2:172.21.15.135:3300/0 conn(0x7fb0280b1420 0x7fb0280c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb026ffd700 1 -- 172.21.15.86:0/3950542314 >> v2:172.21.15.135:3300/0 conn(0x7fb0280b1420 msgr2=0x7fb0280c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb026ffd700 1 --2- 172.21.15.86:0/3950542314 >> v2:172.21.15.135:3300/0 conn(0x7fb0280b1420 0x7fb0280c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb026ffd700 1 -- 172.21.15.86:0/3950542314 >> v1:172.21.15.86:6789/0 conn(0x7fb0280ccf90 legacy=0x7fb0280b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:12.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.163+0000 7fb026ffd700 1 -- 172.21.15.86:0/3950542314 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280ad370 con 0x7fb0280cbf30 2023-10-09T11:57:12.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb026ffd700 1 --2- 172.21.15.86:0/3950542314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280cbf30 0x7fb0280ae410 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb0280b19e0 tx=0x7fb0180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d973d472a135b1c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:12.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb0267fc700 1 -- 172.21.15.86:0/3950542314 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018009e80 con 0x7fb0280cbf30 2023-10-09T11:57:12.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb0267fc700 1 -- 172.21.15.86:0/3950542314 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01800b820 con 0x7fb0280cbf30 2023-10-09T11:57:12.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb0267fc700 1 -- 172.21.15.86:0/3950542314 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800bba0 con 0x7fb0280cbf30 2023-10-09T11:57:12.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb02d9ff700 1 -- 172.21.15.86:0/3950542314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280cbf30 msgr2=0x7fb0280ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:12.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/3950542314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280cbf30 0x7fb0280ae410 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb0280b19e0 tx=0x7fb0180091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb02d9ff700 1 -- 172.21.15.86:0/3950542314 shutdown_connections 2023-10-09T11:57:12.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/3950542314 >> v2:172.21.15.135:3300/0 conn(0x7fb0280b1420 0x7fb0280c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/3950542314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280cbf30 0x7fb0280ae410 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.164+0000 7fb02d9ff700 1 -- 172.21.15.86:0/3950542314 >> 172.21.15.86:0/3950542314 conn(0x7fb02806a320 msgr2=0x7fb0280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:12.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.165+0000 7fb02d9ff700 1 -- 172.21.15.86:0/3950542314 shutdown_connections 2023-10-09T11:57:12.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.165+0000 7fb02d9ff700 1 -- 172.21.15.86:0/3950542314 wait complete. 2023-10-09T11:57:12.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.166+0000 7fb02d9ff700 1 Processor -- start 2023-10-09T11:57:12.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.166+0000 7fb02d9ff700 1 -- start start 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb02d9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280b1420 0x7fb02816a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb02d9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0280cbf30 0x7fb02815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb02d9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0280ccf90 0x7fb02815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb02d9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280c5e60 con 0x7fb0280b1420 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb02d9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280c8d90 con 0x7fb0280ccf90 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb02d9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280c8ab0 con 0x7fb0280cbf30 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb026ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280b1420 0x7fb02816a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb026ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280b1420 0x7fb02816a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43980/0 (socket says 172.21.15.86:43980) 2023-10-09T11:57:12.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb026ffd700 1 -- 172.21.15.86:0/827602764 learned_addr learned my addr 172.21.15.86:0/827602764 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb026ffd700 1 -- 172.21.15.86:0/827602764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0280cbf30 msgr2=0x7fb02815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.167+0000 7fb026ffd700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0280cbf30 0x7fb02815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb026ffd700 1 -- 172.21.15.86:0/827602764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0280ccf90 msgr2=0x7fb02815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb026ffd700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0280ccf90 0x7fb02815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb026ffd700 1 -- 172.21.15.86:0/827602764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018009420 con 0x7fb0280b1420 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb026ffd700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280b1420 0x7fb02816a440 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb028064290 tx=0x7fb018017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb01effd700 1 -- 172.21.15.86:0/827602764 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018011420 con 0x7fb0280b1420 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb01effd700 1 -- 172.21.15.86:0/827602764 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018011580 con 0x7fb0280b1420 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb01effd700 1 -- 172.21.15.86:0/827602764 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018011940 con 0x7fb0280b1420 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0280c5810 con 0x7fb0280b1420 2023-10-09T11:57:12.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.168+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02815bc20 con 0x7fb0280b1420 2023-10-09T11:57:12.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.169+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0280c6140 con 0x7fb0280b1420 2023-10-09T11:57:12.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.170+0000 7fb01effd700 1 -- 172.21.15.86:0/827602764 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0180253f0 con 0x7fb0280b1420 2023-10-09T11:57:12.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.171+0000 7fb01effd700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:12.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.171+0000 7fb01effd700 1 -- 172.21.15.86:0/827602764 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb0180860b0 con 0x7fb0280b1420 2023-10-09T11:57:12.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.171+0000 7fb01ffff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:12.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.172+0000 7fb01ffff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb008066f30 0x7fb0080693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb010007fd0 tx=0x7fb010007b90 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:12.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.175+0000 7fb01effd700 1 -- 172.21.15.86:0/827602764 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0180531a0 con 0x7fb0280b1420 2023-10-09T11:57:12.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.413+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb02804c3c0 con 0x7fb0280b1420 2023-10-09T11:57:12.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.413+0000 7fb01effd700 1 -- 172.21.15.86:0/827602764 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb0180567c0 con 0x7fb0280b1420 2023-10-09T11:57:12.414 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:12.414 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/153919105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":153919105},{"type":"v1","addr":"172.21.15.135:6834","nonce":153919105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4109315239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4109315239},{"type":"v1","addr":"172.21.15.135:6835","nonce":4109315239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6702,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/567273052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":567273052},{"type":"v1","addr":"172.21.15.86:6834","nonce":567273052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:01.334172+0000","modified":"2023-10-09T11:57:04.892057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1853170285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":1853170285},{"type":"v1","addr":"172.21.15.86:6835","nonce":1853170285}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:57:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.415+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb008066f30 msgr2=0x7fb0080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.415+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb008066f30 0x7fb0080693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb010007fd0 tx=0x7fb010007b90 comp rx=0 tx=0).stop 2023-10-09T11:57:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.415+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280b1420 msgr2=0x7fb02816a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.415+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280b1420 0x7fb02816a440 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb028064290 tx=0x7fb018017000 comp rx=0 tx=0).stop 2023-10-09T11:57:12.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 shutdown_connections 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0280b1420 0x7fb02816a440 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0280ccf90 0x7fb02815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 --2- 172.21.15.86:0/827602764 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0280cbf30 0x7fb02815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 >> 172.21.15.86:0/827602764 conn(0x7fb02806a320 msgr2=0x7fb0280c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 shutdown_connections 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:12.416+0000 7fb02d9ff700 1 -- 172.21.15.86:0/827602764 wait complete. 2023-10-09T11:57:12.417 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2023-10-09T11:57:12.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:57:01.334172+0000', 'modified': '2023-10-09T11:57:04.892057+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6708}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6708': {'gid': 6708, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/1853170285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6833', 'nonce': 1853170285}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 1853170285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:57:12.836 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:57:12.836 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T11:57:13.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.020+0000 7f240d3ff700 1 Processor -- start 2023-10-09T11:57:13.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.020+0000 7f240d3ff700 1 -- start start 2023-10-09T11:57:13.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.021+0000 7f240d3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 0x7f2408155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f240d3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24080acac0 con 0x7f24080ac230 2023-10-09T11:57:13.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f240d3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24080ad930 con 0x7f24080ac6a0 2023-10-09T11:57:13.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f240d3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24080acd20 con 0x7f2408155c10 2023-10-09T11:57:13.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f23fffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f24080ac230 0x7f24081568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55686/0 (socket says 172.21.15.86:55686) 2023-10-09T11:57:13.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f23fffff700 1 -- 172.21.15.86:0/1462450341 learned_addr learned my addr 172.21.15.86:0/1462450341 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:13.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 0x7f2408155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588535531 0 0) 0x7f24080acac0 con 0x7f24080ac230 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f4003570 con 0x7f24080ac230 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.022+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279623985 0 0) 0x7f24080ad930 con 0x7f24080ac6a0 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24080acac0 con 0x7f24080ac6a0 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2664094510 0 0) 0x7f23f4003570 con 0x7f24080ac230 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 msgr2=0x7f2408155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 0x7f2408155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 >> v1:172.21.15.135:6789/0 conn(0x7f24080ac6a0 legacy=0x7f24080b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24080ad000 con 0x7f24080ac230 2023-10-09T11:57:13.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f23f0001470 con 0x7f24080ac230 2023-10-09T11:57:13.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 0x7f2408155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:13.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 >> v1:172.21.15.86:6789/0 conn(0x7f24080ac230 legacy=0x7f24081568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f4003c20 0x7f23f4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f4004810 0x7f23f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 0x7f23f40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24080acd20 con 0x7f23f4003c20 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f400bbb0 con 0x7f23f4004810 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f400bd70 con 0x7f2408155c10 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f4003c20 0x7f23f4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f23fffff700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f4004810 0x7f23f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f24077fe700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 0x7f23f40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f2406ffd700 1 -- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 msgr2=0x7f23f40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2408155c10 0x7f23f40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f2406ffd700 1 -- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f4004810 msgr2=0x7f23f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f4004810 0x7f23f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.023+0000 7f2406ffd700 1 -- 172.21.15.86:0/1462450341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8009420 con 0x7f23f4003c20 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f4003c20 0x7f23f4004010 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009df0 tx=0x7f23f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9d7f1d09966896 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8009740 con 0x7f23f4003c20 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f800e920 con 0x7f23f4003c20 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f24067fc700 1 -- 172.21.15.86:0/1462450341 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800ece0 con 0x7f23f4003c20 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f240d3ff700 1 -- 172.21.15.86:0/1462450341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f4003c20 msgr2=0x7f23f4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f240d3ff700 1 --2- 172.21.15.86:0/1462450341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f4003c20 0x7f23f4004010 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009df0 tx=0x7f23f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f24077fe700 1 -- 172.21.15.86:0/1462450341 reap_dead start 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.024+0000 7f240d3ff700 1 -- 172.21.15.86:0/1462450341 shutdown_connections 2023-10-09T11:57:13.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.025+0000 7f240d3ff700 1 -- 172.21.15.86:0/1462450341 >> 172.21.15.86:0/1462450341 conn(0x7f240806a320 msgr2=0x7f24080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.025+0000 7f240d3ff700 1 -- 172.21.15.86:0/1462450341 shutdown_connections 2023-10-09T11:57:13.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.025+0000 7f240d3ff700 1 -- 172.21.15.86:0/1462450341 wait complete. 2023-10-09T11:57:13.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.026+0000 7f240d3ff700 1 Processor -- start 2023-10-09T11:57:13.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.026+0000 7f240d3ff700 1 -- start start 2023-10-09T11:57:13.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f240d3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f4003c20 0x7f2408168e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f240d3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2408152780 0x7f24081693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f240d3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24081521b0 0x7f2408167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f240d3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240815a8b0 con 0x7f2408152780 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f240d3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408159ca0 con 0x7f24081521b0 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f240d3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2408159f80 con 0x7f23f4003c20 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f23fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2408152780 0x7f24081693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f23fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2408152780 0x7f24081693c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43998/0 (socket says 172.21.15.86:43998) 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f23fffff700 1 -- 172.21.15.86:0/4212332898 learned_addr learned my addr 172.21.15.86:0/4212332898 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.027+0000 7f2406ffd700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f4003c20 0x7f2408168e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f24077fe700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24081521b0 0x7f2408167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23fffff700 1 -- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f4003c20 msgr2=0x7f2408168e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23fffff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f4003c20 0x7f2408168e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23fffff700 1 -- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24081521b0 msgr2=0x7f2408167ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23fffff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24081521b0 0x7f2408167ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23fffff700 1 -- 172.21.15.86:0/4212332898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240815a260 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23fffff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2408152780 0x7f24081693c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f23f00073c0 tx=0x7f23f0001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23feffd700 1 -- 172.21.15.86:0/4212332898 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0000c70 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23feffd700 1 -- 172.21.15.86:0/4212332898 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f000f6c0 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f23feffd700 1 -- 172.21.15.86:0/4212332898 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f000fa80 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240815a540 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.028+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2408159860 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.030+0000 7f23feffd700 1 -- 172.21.15.86:0/4212332898 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23f001d460 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.031+0000 7f23feffd700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23e8066f30 0x7f23e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.031+0000 7f23feffd700 1 -- 172.21.15.86:0/4212332898 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f23f0084770 con 0x7f2408152780 2023-10-09T11:57:13.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.032+0000 7f2406ffd700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23e8066f30 0x7f23e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.032+0000 7f2406ffd700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23e8066f30 0x7f23e80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23f80093f0 tx=0x7f23f801a000 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.033+0000 7f241bb2ab80 1 Processor -- start 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.033+0000 7f241bb2ab80 1 -- start start 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02939050 0x559e02939420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02910f80 0x559e0290f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0290fdc0 0x559e029101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e02866a70 con 0x559e02939050 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e02864270 con 0x559e02910f80 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e02860060 con 0x559e0290fdc0 2023-10-09T11:57:13.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02939050 0x559e02939420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02939050 0x559e02939420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44010/0 (socket says 172.21.15.86:44010) 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.034+0000 7f2406ffd700 1 -- 172.21.15.86:0/2414611057 learned_addr learned my addr 172.21.15.86:0/2414611057 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f24077fe700 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0290fdc0 0x559e029101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f23fffff700 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02910f80 0x559e0290f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f2406ffd700 1 -- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0290fdc0 msgr2=0x559e029101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f2406ffd700 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0290fdc0 0x559e029101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f2406ffd700 1 -- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02910f80 msgr2=0x559e0290f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f2406ffd700 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02910f80 0x559e0290f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f2406ffd700 1 -- 172.21.15.86:0/2414611057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e026fa270 con 0x559e02939050 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f2406ffd700 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02939050 0x559e02939420 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f23f400bb80 tx=0x7f23f801f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08d1075383669b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f23e7fff700 1 -- 172.21.15.86:0/2414611057 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8013820 con 0x559e02939050 2023-10-09T11:57:13.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f23e7fff700 1 -- 172.21.15.86:0/2414611057 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f8023040 con 0x559e02939050 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.035+0000 7f23e7fff700 1 -- 172.21.15.86:0/2414611057 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8013b90 con 0x559e02939050 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2414611057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02939050 msgr2=0x559e02939420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02939050 0x559e02939420 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f23f400bb80 tx=0x7f23f801f050 comp rx=0 tx=0).stop 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2414611057 shutdown_connections 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02939050 0x559e02939420 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0290fdc0 0x559e029101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2414611057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02910f80 0x559e0290f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2414611057 >> 172.21.15.86:0/2414611057 conn(0x559e02911370 msgr2=0x559e02911740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2414611057 shutdown_connections 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.036+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2414611057 wait complete. 2023-10-09T11:57:13.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.037+0000 7f241bb2ab80 1 -- start start 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.037+0000 7f241bb2ab80 1 Processor -- start 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0294e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02910f80 0x559e0296a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 0x559e0296ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e0280b890 con 0x559e0290fdc0 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e02826ea0 con 0x559e02939050 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e026e2e30 con 0x559e02910f80 2023-10-09T11:57:13.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f241bb2ab80 10 client.0 _ll_register_callbacks cb 0x559e028d3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0294e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0294e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44024/0 (socket says 172.21.15.86:44024) 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f2406ffd700 1 -- 172.21.15.86:0/1726633858 learned_addr learned my addr 172.21.15.86:0/1726633858 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f23fffff700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02910f80 0x559e0296a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.038+0000 7f24077fe700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 0x559e0296ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f2406ffd700 1 -- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02910f80 msgr2=0x559e0296a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02910f80 0x559e0296a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f2406ffd700 1 -- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 msgr2=0x559e0296ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 0x559e0296ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f2406ffd700 1 -- 172.21.15.86:0/1726633858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f8009420 con 0x559e0290fdc0 2023-10-09T11:57:13.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f23fffff700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02910f80 0x559e0296a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f2406ffd700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0294e570 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f23f8036040 tx=0x7f23f8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96c5e3ded90b97e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f23e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f23e57fa700 1 -- 172.21.15.86:0/1726633858 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800eea0 con 0x559e0290fdc0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f23e57fa700 1 -- 172.21.15.86:0/1726633858 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f23f801cbf0 con 0x559e0290fdc0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e02904b70 con 0x559e0290fdc0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f23e57fa700 1 -- 172.21.15.86:0/1726633858 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23f8029410 con 0x559e0290fdc0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f241bb2ab80 10 client.6864 fetch_fsmap learned FSMap version 39 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.039+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x559e0269cfe0 con 0x559e0290fdc0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f23e57fa700 1 -- 172.21.15.86:0/1726633858 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e02904b70 con 0x559e0290fdc0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f23e57fa700 1 -- 172.21.15.86:0/1726633858 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f23f8029570 con 0x559e0290fdc0 2023-10-09T11:57:13.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f241bb2ab80 10 client.6864 fetch_fsmap finished waiting for FSMap version 39 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f241bb2ab80 10 client.6864 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f241bb2ab80 20 client.6864 populate_metadata read hostname 'smithi086' 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e0293ed80 0x559e0293f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f241bb2ab80 4 client.6864 mds_command: new command op to 6708 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 --> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e028e1aa0 con 0x559e0293ed80 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.040+0000 7f23fffff700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e0293ed80 0x559e0293f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f23e57fa700 10 client.6864 ms_handle_connect on v2:172.21.15.86:6833/1853170285 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f23fffff700 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e0293ed80 0x559e0293f150 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3c5656579f5056e server_cookie=9eafd3b6d82c4637 in_seq=0 out_seq=0 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f23e57fa700 1 -- 172.21.15.86:0/1726633858 <== mds.0 v2:172.21.15.86:6833/1853170285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559e028e1aa0 con 0x559e0293ed80 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f23e57fa700 10 client.6864 handle_command_reply: tid=0 2023-10-09T11:57:13.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 client.6864 shutdown 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 msgr2=0x559e0294e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0294e570 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f23f8036040 tx=0x7f23f8031000 comp rx=0 tx=0).stop 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 shutdown_connections 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e0293ed80 0x559e0293f150 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0294e570 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f23e57fa700 0 client.6864 ms_handle_reset on v2:172.21.15.86:6833/1853170285 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 0x559e0296ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.041+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/1726633858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02910f80 0x559e0296a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.042+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 >> 172.21.15.86:0/1726633858 conn(0x559e02911370 msgr2=0x559e02911fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.042+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 shutdown_connections 2023-10-09T11:57:13.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.042+0000 7f241bb2ab80 1 -- 172.21.15.86:0/1726633858 wait complete. 2023-10-09T11:57:13.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.042+0000 7f241bb2ab80 20 client.6864 trim_cache size 0 max 16384 2023-10-09T11:57:13.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.059+0000 7f241bb2ab80 1 Processor -- start 2023-10-09T11:57:13.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.059+0000 7f241bb2ab80 1 -- start start 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.059+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0290fdc0 0x559e0294e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02910f80 0x559e02955550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02939050 0x559e02911740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e0294f870 con 0x559e02910f80 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e0294edc0 con 0x559e0290fdc0 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e02954d70 con 0x559e02939050 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02910f80 0x559e02955550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02910f80 0x559e02955550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44034/0 (socket says 172.21.15.86:44034) 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 -- 172.21.15.86:0/2261968833 learned_addr learned my addr 172.21.15.86:0/2261968833 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f2406ffd700 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0290fdc0 0x559e0294e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f24077fe700 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02939050 0x559e02911740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 -- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02939050 msgr2=0x559e02911740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02939050 0x559e02911740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 -- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0290fdc0 msgr2=0x559e0294e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0290fdc0 0x559e0294e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 -- 172.21.15.86:0/2261968833 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e0282e780 con 0x559e02910f80 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fffff700 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02910f80 0x559e02955550 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f23f0055d30 tx=0x7f23f0015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d52179adc0a2ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fcff9700 1 -- 172.21.15.86:0/2261968833 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00535c0 con 0x559e02910f80 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.060+0000 7f23fcff9700 1 -- 172.21.15.86:0/2261968833 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f0082b80 con 0x559e02910f80 2023-10-09T11:57:13.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f23fcff9700 1 -- 172.21.15.86:0/2261968833 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00556e0 con 0x559e02910f80 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2261968833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02910f80 msgr2=0x559e02955550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02910f80 0x559e02955550 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f23f0055d30 tx=0x7f23f0015040 comp rx=0 tx=0).stop 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2261968833 shutdown_connections 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e02939050 0x559e02911740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0290fdc0 0x559e0294e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/2261968833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e02910f80 0x559e02955550 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2261968833 >> 172.21.15.86:0/2261968833 conn(0x559e02911370 msgr2=0x559e0293f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2261968833 shutdown_connections 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.061+0000 7f241bb2ab80 1 -- 172.21.15.86:0/2261968833 wait complete. 2023-10-09T11:57:13.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.062+0000 7f241bb2ab80 1 -- start start 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.062+0000 7f241bb2ab80 1 Processor -- start 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0293c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 0x559e02955930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f241bb2ab80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0294e860 0x559e02952d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e029b74f0 con 0x559e0290fdc0 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e029574f0 con 0x559e02939050 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f241bb2ab80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e029b8340 con 0x559e0294e860 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f241bb2ab80 10 client.0 _ll_register_callbacks cb 0x559e028d3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0293c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0293c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44046/0 (socket says 172.21.15.86:44046) 2023-10-09T11:57:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 -- 172.21.15.86:0/688174837 learned_addr learned my addr 172.21.15.86:0/688174837 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 -- 172.21.15.86:0/688174837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0294e860 msgr2=0x559e02952d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0294e860 0x559e02952d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 -- 172.21.15.86:0/688174837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 msgr2=0x559e02955930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 0x559e02955930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.063+0000 7f2406ffd700 1 -- 172.21.15.86:0/688174837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2408159860 con 0x559e0290fdc0 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f2406ffd700 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0293c160 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f23f801dff0 tx=0x7f23f803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ade3e869e42336 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f23e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f23e57fa700 1 -- 172.21.15.86:0/688174837 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8029ad0 con 0x559e0290fdc0 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f23e57fa700 1 -- 172.21.15.86:0/688174837 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f23f8029620 con 0x559e0290fdc0 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f240815aae0 con 0x559e0290fdc0 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f23e57fa700 1 -- 172.21.15.86:0/688174837 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23f8040a80 con 0x559e0290fdc0 2023-10-09T11:57:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 10 client.6870 fetch_fsmap learned FSMap version 39 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x559e02815470 con 0x559e0290fdc0 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f23e57fa700 1 -- 172.21.15.86:0/688174837 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240815aae0 con 0x559e0290fdc0 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f23e57fa700 1 -- 172.21.15.86:0/688174837 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f23f8040be0 con 0x559e0290fdc0 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 10 client.6870 fetch_fsmap finished waiting for FSMap version 39 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 10 client.6870 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 20 client.6870 populate_metadata read hostname 'smithi086' 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e029c3f40 0x559e029c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 4 client.6870 mds_command: new command op to 6708 tid=0[{"prefix": "status"}] 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.064+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 --> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f23f8023040 con 0x559e029c3f40 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f23fffff700 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e029c3f40 0x559e029c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f23fffff700 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e029c3f40 0x559e029c4310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eed27b14bdeb5c7 server_cookie=2ae1617f3a0adafe in_seq=0 out_seq=0 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f23e57fa700 10 client.6870 ms_handle_connect on v2:172.21.15.86:6833/1853170285 2023-10-09T11:57:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f23e57fa700 1 -- 172.21.15.86:0/688174837 <== mds.0 v2:172.21.15.86:6833/1853170285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7f23f8023040 con 0x559e029c3f40 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f23e57fa700 10 client.6870 handle_command_reply: tid=0 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 client.6870 shutdown 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 msgr2=0x559e0293c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0293c160 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f23f801dff0 tx=0x7f23f803b000 comp rx=0 tx=0).stop 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 shutdown_connections 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:6833/1853170285,v1:172.21.15.86:6835/1853170285] conn(0x559e029c3f40 0x559e029c4310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559e0290fdc0 0x559e0293c160 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e0294e860 0x559e02952d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 --2- 172.21.15.86:0/688174837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e02939050 0x559e02955930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f23e57fa700 0 client.6870 ms_handle_reset on v2:172.21.15.86:6833/1853170285 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.065+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 >> 172.21.15.86:0/688174837 conn(0x559e02911370 msgr2=0x559e0294c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 shutdown_connections 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f241bb2ab80 1 -- 172.21.15.86:0/688174837 wait complete. 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f241bb2ab80 20 client.6870 trim_cache size 0 max 16384 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 6708, 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T11:57:13.072 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T11:57:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.18030823, 2023-10-09T11:57:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 39, 2023-10-09T11:57:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 94, 2023-10-09T11:57:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 94, 2023-10-09T11:57:13.073 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 16.953028356000001 2023-10-09T11:57:13.073 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:57:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23e8066f30 msgr2=0x7f23e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23e8066f30 0x7f23e80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23f80093f0 tx=0x7f23f801a000 comp rx=0 tx=0).stop 2023-10-09T11:57:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2408152780 msgr2=0x7f24081693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2408152780 0x7f24081693c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f23f00073c0 tx=0x7f23f0001d40 comp rx=0 tx=0).stop 2023-10-09T11:57:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 shutdown_connections 2023-10-09T11:57:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24081521b0 0x7f2408167ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f4003c20 0x7f2408168e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23e8066f30 0x7f23e80693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 --2- 172.21.15.86:0/4212332898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2408152780 0x7f24081693c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.066+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 >> 172.21.15.86:0/4212332898 conn(0x7f240806a320 msgr2=0x7f2408153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.067+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 shutdown_connections 2023-10-09T11:57:13.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.067+0000 7f240d3ff700 1 -- 172.21.15.86:0/4212332898 wait complete. 2023-10-09T11:57:13.083 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:57:13.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.263+0000 7f00da5ff700 1 Processor -- start 2023-10-09T11:57:13.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.263+0000 7f00da5ff700 1 -- start start 2023-10-09T11:57:13.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00da5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f00d40b1420 0x7f00d40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00da5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00d40ccf90 0x7f00d40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00da5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d40cc300 con 0x7f00d40cbf30 2023-10-09T11:57:13.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00da5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d4156bf0 con 0x7f00d40ccf90 2023-10-09T11:57:13.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00da5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d40ae950 con 0x7f00d40b1420 2023-10-09T11:57:13.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00d3fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f00d40cbf30 0x7f00d40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55688/0 (socket says 172.21.15.86:55688) 2023-10-09T11:57:13.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00d3fff700 1 -- 172.21.15.86:0/2844480646 learned_addr learned my addr 172.21.15.86:0/2844480646 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:13.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00d8b9c700 1 --2- 172.21.15.86:0/2844480646 >> v2:172.21.15.86:3300/0 conn(0x7f00d40ccf90 0x7f00d40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.265+0000 7f00cbfff700 1 --2- 172.21.15.86:0/2844480646 >> v2:172.21.15.135:3300/0 conn(0x7f00d40b1420 0x7f00d40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d37fe700 1 -- 172.21.15.86:0/2844480646 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168128512 0 0) 0x7f00d40cc300 con 0x7f00d40cbf30 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d37fe700 1 -- 172.21.15.86:0/2844480646 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c0003570 con 0x7f00d40cbf30 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d8b9c700 1 -- 172.21.15.86:0/2844480646 >> v2:172.21.15.135:3300/0 conn(0x7f00d40b1420 msgr2=0x7f00d40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d8b9c700 1 --2- 172.21.15.86:0/2844480646 >> v2:172.21.15.135:3300/0 conn(0x7f00d40b1420 0x7f00d40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d8b9c700 1 -- 172.21.15.86:0/2844480646 >> v1:172.21.15.86:6789/0 conn(0x7f00d40cbf30 legacy=0x7f00d40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d8b9c700 1 -- 172.21.15.86:0/2844480646 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40ad370 con 0x7f00d40ccf90 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00cbfff700 1 --2- 172.21.15.86:0/2844480646 >> v2:172.21.15.135:3300/0 conn(0x7f00d40b1420 0x7f00d40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d8b9c700 1 --2- 172.21.15.86:0/2844480646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40ccf90 0x7f00d40c9740 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f00d40c9280 tx=0x7f00cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f1e6a82ef704c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d37fe700 1 -- 172.21.15.86:0/2844480646 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00e070 con 0x7f00d40ccf90 2023-10-09T11:57:13.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d37fe700 1 -- 172.21.15.86:0/2844480646 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00bb20 con 0x7f00d40ccf90 2023-10-09T11:57:13.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.266+0000 7f00d37fe700 1 -- 172.21.15.86:0/2844480646 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc012430 con 0x7f00d40ccf90 2023-10-09T11:57:13.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 -- 172.21.15.86:0/2844480646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40ccf90 msgr2=0x7f00d40c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 --2- 172.21.15.86:0/2844480646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40ccf90 0x7f00d40c9740 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f00d40c9280 tx=0x7f00cc009780 comp rx=0 tx=0).stop 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 -- 172.21.15.86:0/2844480646 shutdown_connections 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 --2- 172.21.15.86:0/2844480646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40ccf90 0x7f00d40c9740 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 --2- 172.21.15.86:0/2844480646 >> v2:172.21.15.135:3300/0 conn(0x7f00d40b1420 0x7f00d40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 -- 172.21.15.86:0/2844480646 >> 172.21.15.86:0/2844480646 conn(0x7f00d406a320 msgr2=0x7f00d40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 -- 172.21.15.86:0/2844480646 shutdown_connections 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.267+0000 7f00da5ff700 1 -- 172.21.15.86:0/2844480646 wait complete. 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.268+0000 7f00da5ff700 1 Processor -- start 2023-10-09T11:57:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.268+0000 7f00da5ff700 1 -- start start 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00da5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d40b1420 0x7f00d406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00da5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40cbf30 0x7f00d4147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00da5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00d40ccf90 0x7f00d40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00da5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d41553d0 con 0x7f00d40cbf30 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00da5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40c22a0 con 0x7f00d40b1420 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00da5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40c24f0 con 0x7f00d40ccf90 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00cbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40cbf30 0x7f00d4147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00cbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40cbf30 0x7f00d4147d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44060/0 (socket says 172.21.15.86:44060) 2023-10-09T11:57:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.269+0000 7f00cbfff700 1 -- 172.21.15.86:0/3097343649 learned_addr learned my addr 172.21.15.86:0/3097343649 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00cbfff700 1 -- 172.21.15.86:0/3097343649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00d40ccf90 msgr2=0x7f00d40ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00cbfff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00d40ccf90 0x7f00d40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00cbfff700 1 -- 172.21.15.86:0/3097343649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d40b1420 msgr2=0x7f00d406e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00cbfff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d40b1420 0x7f00d406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00cbfff700 1 -- 172.21.15.86:0/3097343649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc009a20 con 0x7f00d40cbf30 2023-10-09T11:57:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00cbfff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40cbf30 0x7f00d4147d70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00e870 tx=0x7f00bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00d0ff9700 1 -- 172.21.15.86:0/3097343649 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00c430 con 0x7f00d40cbf30 2023-10-09T11:57:13.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00d0ff9700 1 -- 172.21.15.86:0/3097343649 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc00c590 con 0x7f00d40cbf30 2023-10-09T11:57:13.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d40c27d0 con 0x7f00d40cbf30 2023-10-09T11:57:13.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00d0ff9700 1 -- 172.21.15.86:0/3097343649 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00c930 con 0x7f00d40cbf30 2023-10-09T11:57:13.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.270+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d40c2d90 con 0x7f00d40cbf30 2023-10-09T11:57:13.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.271+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d40ae600 con 0x7f00d40cbf30 2023-10-09T11:57:13.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.272+0000 7f00d0ff9700 1 -- 172.21.15.86:0/3097343649 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00bc00cce0 con 0x7f00d40cbf30 2023-10-09T11:57:13.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.273+0000 7f00d0ff9700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f00b4066f30 0x7f00b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:13.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.273+0000 7f00d0ff9700 1 -- 172.21.15.86:0/3097343649 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f00bc084560 con 0x7f00d40cbf30 2023-10-09T11:57:13.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.273+0000 7f00d3fff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f00b4066f30 0x7f00b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:13.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.274+0000 7f00d3fff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f00b4066f30 0x7f00b40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00c40058d0 tx=0x7f00c40079d0 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:13.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.277+0000 7f00d0ff9700 1 -- 172.21.15.86:0/3097343649 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00bc0515b0 con 0x7f00d40cbf30 2023-10-09T11:57:13.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.517+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f00d404c3c0 con 0x7f00d40cbf30 2023-10-09T11:57:13.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.518+0000 7f00d0ff9700 1 -- 172.21.15.86:0/3097343649 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f00bc054bd0 con 0x7f00d40cbf30 2023-10-09T11:57:13.518 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:57:13.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f00b4066f30 msgr2=0x7f00b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f00b4066f30 0x7f00b40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00c40058d0 tx=0x7f00c40079d0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40cbf30 msgr2=0x7f00d4147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40cbf30 0x7f00d4147d70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00e870 tx=0x7f00bc008040 comp rx=0 tx=0).stop 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 shutdown_connections 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00d40ccf90 0x7f00d40ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d40b1420 0x7f00d406e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f00b4066f30 0x7f00b40693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 --2- 172.21.15.86:0/3097343649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d40cbf30 0x7f00d4147d70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 >> 172.21.15.86:0/3097343649 conn(0x7f00d406a320 msgr2=0x7f00d40b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 shutdown_connections 2023-10-09T11:57:13.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:13.520+0000 7f00da5ff700 1 -- 172.21.15.86:0/3097343649 wait complete. 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:57:13.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:57:13.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:13.539 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:57:13.575 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:57:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:57:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:57:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:57:13.575 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:57:13.576 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41310sec preferred_lft 41310sec 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:57:13.577 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T11:57:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:13.578 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:57:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:57:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T11:57:13.578 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:13.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:13.578 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:57:13.673 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:57:13.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:13.676 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:57:13.714 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:57:13.714 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:57:13.714 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:57:13.714 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:57:13.714 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:57:13.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:13.715 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:57:13.715 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:57:13.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:57:13.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:57:13.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:57:13.716 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:57:13.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:13.910 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:57:13.946 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:57:13.946 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:57:13.946 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:57:13.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:13.946 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T11:57:14.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:57:14.046 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:14.082 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:57:14.082 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:57:14.082 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:14.157 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:57:14.157 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:57:14.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:57:14.288 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:57:14.288 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:57:14.317 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:57:14.317 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:57:14.317 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:57:14.318 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:57:14.318 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:57:14.322 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:57:14.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:14.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:14.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:57:14.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.566+0000 7faaaa59d700 1 Processor -- start 2023-10-09T11:57:14.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.566+0000 7faaaa59d700 1 -- start start 2023-10-09T11:57:14.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.567+0000 7faaaa59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faaa4156310 0x7faaa40c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.567+0000 7faaaa59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faaa40ae710 0x7faaa40c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.567+0000 7faaaa59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40ca860 con 0x7faaa41566e0 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.567+0000 7faaaa59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa40cab40 con 0x7faaa40ae710 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.567+0000 7faaaa59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa40cae20 con 0x7faaa4156310 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faaa40ae710 0x7faaa40c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faaa40ae710 0x7faaa40c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44068/0 (socket says 172.21.15.86:44068) 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 -- 172.21.15.86:0/1142411430 learned_addr learned my addr 172.21.15.86:0/1142411430 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa8d9a700 1 --1- 172.21.15.86:0/1142411430 >> v1:172.21.15.86:6789/0 conn(0x7faaa41566e0 0x7faaa40ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55696/0 (socket says 172.21.15.86:55696) 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa959b700 1 --2- 172.21.15.86:0/1142411430 >> v2:172.21.15.135:3300/0 conn(0x7faaa4156310 0x7faaa40c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:14.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 -- 172.21.15.86:0/1142411430 >> v2:172.21.15.135:3300/0 conn(0x7faaa4156310 msgr2=0x7faaa40c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 --2- 172.21.15.86:0/1142411430 >> v2:172.21.15.135:3300/0 conn(0x7faaa4156310 0x7faaa40c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 -- 172.21.15.86:0/1142411430 >> v1:172.21.15.86:6789/0 conn(0x7faaa41566e0 legacy=0x7faaa40ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 -- 172.21.15.86:0/1142411430 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40cb100 con 0x7faaa40ae710 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa959b700 1 --2- 172.21.15.86:0/1142411430 >> v2:172.21.15.135:3300/0 conn(0x7faaa4156310 0x7faaa40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faa9bfff700 1 -- 172.21.15.86:0/1142411430 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601268383 0 0) 0x7faaa40ca860 con 0x7faaa41566e0 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.568+0000 7faaa9d9c700 1 --2- 172.21.15.86:0/1142411430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ae710 0x7faaa40c6830 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7faaa40cce20 tx=0x7faa9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2754697590956a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faa9bfff700 1 -- 172.21.15.86:0/1142411430 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00e070 con 0x7faaa40ae710 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faa9bfff700 1 -- 172.21.15.86:0/1142411430 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c00ba50 con 0x7faaa40ae710 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faa9bfff700 1 -- 172.21.15.86:0/1142411430 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0092e0 con 0x7faaa40ae710 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 -- 172.21.15.86:0/1142411430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ae710 msgr2=0x7faaa40c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:14.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 --2- 172.21.15.86:0/1142411430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ae710 0x7faaa40c6830 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7faaa40cce20 tx=0x7faa9c009840 comp rx=0 tx=0).stop 2023-10-09T11:57:14.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 -- 172.21.15.86:0/1142411430 shutdown_connections 2023-10-09T11:57:14.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 --2- 172.21.15.86:0/1142411430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ae710 0x7faaa40c6830 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 --2- 172.21.15.86:0/1142411430 >> v2:172.21.15.135:3300/0 conn(0x7faaa4156310 0x7faaa40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 -- 172.21.15.86:0/1142411430 >> 172.21.15.86:0/1142411430 conn(0x7faaa40cc1f0 msgr2=0x7faaa40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:14.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 -- 172.21.15.86:0/1142411430 shutdown_connections 2023-10-09T11:57:14.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.569+0000 7faaaa59d700 1 -- 172.21.15.86:0/1142411430 wait complete. 2023-10-09T11:57:14.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.571+0000 7faaaa59d700 1 Processor -- start 2023-10-09T11:57:14.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.571+0000 7faaaa59d700 1 -- start start 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaaa59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa40ae710 0x7faaa4150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaaa59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa4156310 0x7faaa4157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaaa59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa41566e0 0x7faaa415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaaa59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415b7b0 con 0x7faaa4156310 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaaa59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415c5b0 con 0x7faaa40ae710 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaaa59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415b9a0 con 0x7faaa41566e0 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa4156310 0x7faaa4157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa4156310 0x7faaa4157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44082/0 (socket says 172.21.15.86:44082) 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 -- 172.21.15.86:0/189806271 learned_addr learned my addr 172.21.15.86:0/189806271 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa959b700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa40ae710 0x7faaa4150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa9d9c700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa41566e0 0x7faaa415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 -- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa41566e0 msgr2=0x7faaa415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa41566e0 0x7faaa415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 -- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa40ae710 msgr2=0x7faaa4150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa40ae710 0x7faaa4150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa8d9a700 1 -- 172.21.15.86:0/189806271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c009ae0 con 0x7faaa4156310 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.572+0000 7faaa959b700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa40ae710 0x7faaa4150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.573+0000 7faaa8d9a700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa4156310 0x7faaa4157c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c7e0 tx=0x7faa94007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.573+0000 7faa997fa700 1 -- 172.21.15.86:0/189806271 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940073d0 con 0x7faaa4156310 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.573+0000 7faa997fa700 1 -- 172.21.15.86:0/189806271 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94007530 con 0x7faaa4156310 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.573+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa415bc80 con 0x7faaa4156310 2023-10-09T11:57:14.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.573+0000 7faa997fa700 1 -- 172.21.15.86:0/189806271 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94004a80 con 0x7faaa4156310 2023-10-09T11:57:14.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.573+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa415c240 con 0x7faaa4156310 2023-10-09T11:57:14.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.574+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa415c720 con 0x7faaa4156310 2023-10-09T11:57:14.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.575+0000 7faa997fa700 1 -- 172.21.15.86:0/189806271 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa9401c3b0 con 0x7faaa4156310 2023-10-09T11:57:14.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.575+0000 7faa997fa700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa88066f30 0x7faa880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:14.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.576+0000 7faa997fa700 1 -- 172.21.15.86:0/189806271 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7faa94083c50 con 0x7faaa4156310 2023-10-09T11:57:14.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.576+0000 7faaa959b700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa88066f30 0x7faa880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:14.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.576+0000 7faaa959b700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa88066f30 0x7faa880693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faaa0006f00 tx=0x7faaa0008040 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:14.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.579+0000 7faa997fa700 1 -- 172.21.15.86:0/189806271 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa94050d20 con 0x7faaa4156310 2023-10-09T11:57:14.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.797+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faaa404c3c0 con 0x7faa88066f30 2023-10-09T11:57:14.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.799+0000 7faa997fa700 1 -- 172.21.15.86:0/189806271 <== mgr.6507 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7faaa404c3c0 con 0x7faa88066f30 2023-10-09T11:57:14.799 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:57:14.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:14.799 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T11:57:14.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:14.800 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:57:14.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa88066f30 msgr2=0x7faa880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:14.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa88066f30 0x7faa880693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faaa0006f00 tx=0x7faaa0008040 comp rx=0 tx=0).stop 2023-10-09T11:57:14.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa4156310 msgr2=0x7faaa4157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:14.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa4156310 0x7faaa4157c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c7e0 tx=0x7faa94007de0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 shutdown_connections 2023-10-09T11:57:14.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa41566e0 0x7faaa415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa40ae710 0x7faaa4150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa88066f30 0x7faa880693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 --2- 172.21.15.86:0/189806271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa4156310 0x7faaa4157c80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:14.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.801+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 >> 172.21.15.86:0/189806271 conn(0x7faaa40cc1f0 msgr2=0x7faaa406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:14.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.802+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 shutdown_connections 2023-10-09T11:57:14.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:14.802+0000 7faaaa59d700 1 -- 172.21.15.86:0/189806271 wait complete. 2023-10-09T11:57:14.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T11:57:15.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.003+0000 7f6b5e5ff700 1 Processor -- start 2023-10-09T11:57:15.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.003+0000 7f6b5e5ff700 1 -- start start 2023-10-09T11:57:15.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.004+0000 7f6b5e5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b58069e80 0x7f6b58160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.004+0000 7f6b5e5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5806e950 con 0x7f6b58155eb0 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.004+0000 7f6b5e5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5806eb90 con 0x7f6b580c70b0 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.004+0000 7f6b5e5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5806ee70 con 0x7f6b58069e80 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b5cb9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b58069e80 0x7f6b58160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b5cb9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b58069e80 0x7f6b58160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60514/0 (socket says 172.21.15.86:60514) 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3423539071 learned_addr learned my addr 172.21.15.86:0/3423539071 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b57fff700 1 --1- 172.21.15.86:0/3423539071 >> v1:172.21.15.86:6789/0 conn(0x7f6b58155eb0 0x7f6b5806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49770/0 (socket says 172.21.15.86:49770) 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3423539071 >> v1:172.21.15.135:6789/0 conn(0x7f6b580c70b0 legacy=0x7f6b58069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3423539071 >> v1:172.21.15.86:6789/0 conn(0x7f6b58155eb0 legacy=0x7f6b5806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3423539071 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5806f150 con 0x7f6b58069e80 2023-10-09T11:57:15.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.005+0000 7f6b5cb9c700 1 --2- 172.21.15.86:0/3423539071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58069e80 0x7f6b58160bf0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d1a0 tx=0x7f6b5000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a873872d4f93d3fc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:15.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b577fe700 1 -- 172.21.15.86:0/3423539071 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50010070 con 0x7f6b58069e80 2023-10-09T11:57:15.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b577fe700 1 -- 172.21.15.86:0/3423539071 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5000dcb0 con 0x7f6b58069e80 2023-10-09T11:57:15.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b577fe700 1 -- 172.21.15.86:0/3423539071 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50016630 con 0x7f6b58069e80 2023-10-09T11:57:15.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3423539071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58069e80 msgr2=0x7f6b58160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3423539071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58069e80 0x7f6b58160bf0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d1a0 tx=0x7f6b5000ba50 comp rx=0 tx=0).stop 2023-10-09T11:57:15.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3423539071 shutdown_connections 2023-10-09T11:57:15.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3423539071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58069e80 0x7f6b58160bf0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3423539071 >> 172.21.15.86:0/3423539071 conn(0x7f6b58068e10 msgr2=0x7f6b580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:15.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3423539071 shutdown_connections 2023-10-09T11:57:15.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.006+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3423539071 wait complete. 2023-10-09T11:57:15.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.008+0000 7f6b5e5ff700 1 Processor -- start 2023-10-09T11:57:15.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.008+0000 7f6b5e5ff700 1 -- start start 2023-10-09T11:57:15.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5e5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b58069e80 0x7f6b58152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5e5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b580c70b0 0x7f6b580c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5e5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58155eb0 0x7f6b580b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5e5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5816d790 con 0x7f6b58155eb0 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5e5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580c60a0 con 0x7f6b58069e80 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5e5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5816d140 con 0x7f6b580c70b0 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5cb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58155eb0 0x7f6b580b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5cb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58155eb0 0x7f6b580b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60516/0 (socket says 172.21.15.86:60516) 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3748211864 learned_addr learned my addr 172.21.15.86:0/3748211864 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b57fff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b58069e80 0x7f6b58152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.009+0000 7f6b4ffff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b580c70b0 0x7f6b580c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b580c70b0 msgr2=0x7f6b580c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5cb9c700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b580c70b0 0x7f6b580c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b58069e80 msgr2=0x7f6b58152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5cb9c700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b58069e80 0x7f6b58152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5cb9c700 1 -- 172.21.15.86:0/3748211864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5000bcf0 con 0x7f6b58155eb0 2023-10-09T11:57:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5cb9c700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58155eb0 0x7f6b580b12f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000bcc0 tx=0x7f6b5001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50008410 con 0x7f6b58155eb0 2023-10-09T11:57:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50008570 con 0x7f6b58155eb0 2023-10-09T11:57:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5816d420 con 0x7f6b58155eb0 2023-10-09T11:57:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50008930 con 0x7f6b58155eb0 2023-10-09T11:57:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.010+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b58152bc0 con 0x7f6b58155eb0 2023-10-09T11:57:15.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.011+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5816d940 con 0x7f6b58155eb0 2023-10-09T11:57:15.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.012+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b50003040 con 0x7f6b58155eb0 2023-10-09T11:57:15.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.013+0000 7f6b54ff9700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b38066f30 0x7f6b380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.013+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f6b50085e50 con 0x7f6b58155eb0 2023-10-09T11:57:15.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.013+0000 7f6b57fff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b38066f30 0x7f6b380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.014+0000 7f6b57fff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b38066f30 0x7f6b380693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b48004fd0 tx=0x7f6b48007eb0 comp rx=0 tx=0).ready entity=mgr.6507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:15.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.017+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b5816d940 con 0x7f6b58155eb0 2023-10-09T11:57:15.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.265+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f6b5804c3c0 con 0x7f6b58155eb0 2023-10-09T11:57:15.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.301+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6b50008d20 con 0x7f6b58155eb0 2023-10-09T11:57:15.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.302+0000 7f6b54ff9700 1 -- 172.21.15.86:0/3748211864 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v37) v1 ==== 92+0+0 (secure 0 0 0) 0x7f6b50052f40 con 0x7f6b58155eb0 2023-10-09T11:57:15.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b38066f30 msgr2=0x7f6b380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b38066f30 0x7f6b380693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b48004fd0 tx=0x7f6b48007eb0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58155eb0 msgr2=0x7f6b580b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58155eb0 0x7f6b580b12f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000bcc0 tx=0x7f6b5001b000 comp rx=0 tx=0).stop 2023-10-09T11:57:15.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 shutdown_connections 2023-10-09T11:57:15.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b38066f30 0x7f6b380693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b58155eb0 0x7f6b580b12f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b58069e80 0x7f6b58152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 --2- 172.21.15.86:0/3748211864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b580c70b0 0x7f6b580c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.305+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 >> 172.21.15.86:0/3748211864 conn(0x7f6b58068e10 msgr2=0x7f6b580c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:15.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.306+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 shutdown_connections 2023-10-09T11:57:15.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.306+0000 7f6b5e5ff700 1 -- 172.21.15.86:0/3748211864 wait complete. 2023-10-09T11:57:15.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T11:57:15.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.540+0000 7f3e2539d700 1 Processor -- start 2023-10-09T11:57:15.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.540+0000 7f3e2539d700 1 -- start start 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.541+0000 7f3e2539d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e200b4e70 0x7f3e200ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.541+0000 7f3e2539d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b1b40 0x7f3e2015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.541+0000 7f3e2539d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e200cfb00 con 0x7f3e200b16d0 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.541+0000 7f3e2539d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e200b5c40 con 0x7f3e200b4e70 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.541+0000 7f3e2539d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e200b5f20 con 0x7f3e200b1b40 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.541+0000 7f3e1f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3e200b16d0 0x7f3e2015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49794/0 (socket says 172.21.15.86:49794) 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e1f7fe700 1 -- 172.21.15.86:0/363513018 learned_addr learned my addr 172.21.15.86:0/363513018 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e1ffff700 1 --2- 172.21.15.86:0/363513018 >> v2:172.21.15.135:3300/0 conn(0x7f3e200b4e70 0x7f3e200ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e24b9c700 1 --2- 172.21.15.86:0/363513018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b1b40 0x7f3e2015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e1effd700 1 -- 172.21.15.86:0/363513018 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671336491 0 0) 0x7f3e200cfb00 con 0x7f3e200b16d0 2023-10-09T11:57:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e1effd700 1 -- 172.21.15.86:0/363513018 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e08003570 con 0x7f3e200b16d0 2023-10-09T11:57:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e24b9c700 1 -- 172.21.15.86:0/363513018 >> v2:172.21.15.135:3300/0 conn(0x7f3e200b4e70 msgr2=0x7f3e200ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e24b9c700 1 --2- 172.21.15.86:0/363513018 >> v2:172.21.15.135:3300/0 conn(0x7f3e200b4e70 0x7f3e200ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e24b9c700 1 -- 172.21.15.86:0/363513018 >> v1:172.21.15.86:6789/0 conn(0x7f3e200b16d0 legacy=0x7f3e2015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e24b9c700 1 -- 172.21.15.86:0/363513018 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e200b6200 con 0x7f3e200b1b40 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.542+0000 7f3e24b9c700 1 --2- 172.21.15.86:0/363513018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b1b40 0x7f3e2015d950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009e60 tx=0x7f3e18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b1d6488812c520 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e1effd700 1 -- 172.21.15.86:0/363513018 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800e070 con 0x7f3e200b1b40 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e1effd700 1 -- 172.21.15.86:0/363513018 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1800bab0 con 0x7f3e200b1b40 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e1effd700 1 -- 172.21.15.86:0/363513018 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800be70 con 0x7f3e200b1b40 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 -- 172.21.15.86:0/363513018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b1b40 msgr2=0x7f3e2015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 --2- 172.21.15.86:0/363513018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b1b40 0x7f3e2015d950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009e60 tx=0x7f3e18009780 comp rx=0 tx=0).stop 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 -- 172.21.15.86:0/363513018 shutdown_connections 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 --2- 172.21.15.86:0/363513018 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b1b40 0x7f3e2015d950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 --2- 172.21.15.86:0/363513018 >> v2:172.21.15.135:3300/0 conn(0x7f3e200b4e70 0x7f3e200ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 -- 172.21.15.86:0/363513018 >> 172.21.15.86:0/363513018 conn(0x7f3e200d10c0 msgr2=0x7f3e200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:15.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 -- 172.21.15.86:0/363513018 shutdown_connections 2023-10-09T11:57:15.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.543+0000 7f3e2539d700 1 -- 172.21.15.86:0/363513018 wait complete. 2023-10-09T11:57:15.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.545+0000 7f3e2539d700 1 Processor -- start 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.545+0000 7f3e2539d700 1 -- start start 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e2539d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b16d0 0x7f3e2016ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e2539d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e200b1b40 0x7f3e2016a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e2539d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e200b4e70 0x7f3e200c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e2539d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e200c93a0 con 0x7f3e200b4e70 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e2539d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e200cad80 con 0x7f3e200b1b40 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e2539d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e200cb060 con 0x7f3e200b16d0 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e24b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e200b4e70 0x7f3e200c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e1ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b16d0 0x7f3e2016ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e200b1b40 0x7f3e2016a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e1ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b16d0 0x7f3e2016ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:44884/0 (socket says 172.21.15.86:44884) 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e1ffff700 1 -- 172.21.15.86:0/3367930836 learned_addr learned my addr 172.21.15.86:0/3367930836 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.546+0000 7f3e24b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e200b4e70 0x7f3e200c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60524/0 (socket says 172.21.15.86:60524) 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e1ffff700 1 -- 172.21.15.86:0/3367930836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e200b1b40 msgr2=0x7f3e2016a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e1ffff700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e200b1b40 0x7f3e2016a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e1ffff700 1 -- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e200b4e70 msgr2=0x7f3e200c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e1ffff700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e200b4e70 0x7f3e200c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e1ffff700 1 -- 172.21.15.86:0/3367930836 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18009a20 con 0x7f3e200b16d0 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e24b9c700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e200b4e70 0x7f3e200c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e1ffff700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b16d0 0x7f3e2016ae50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000ec80 tx=0x7f3e100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e07fff700 1 -- 172.21.15.86:0/3367930836 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000c850 con 0x7f3e200b16d0 2023-10-09T11:57:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e07fff700 1 -- 172.21.15.86:0/3367930836 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1000c9b0 con 0x7f3e200b16d0 2023-10-09T11:57:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e200cb340 con 0x7f3e200b16d0 2023-10-09T11:57:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e07fff700 1 -- 172.21.15.86:0/3367930836 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000cd50 con 0x7f3e200b16d0 2023-10-09T11:57:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.547+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2016b390 con 0x7f3e200b16d0 2023-10-09T11:57:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.548+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e200caba0 con 0x7f3e200b16d0 2023-10-09T11:57:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.549+0000 7f3e07fff700 1 -- 172.21.15.86:0/3367930836 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3e10013680 con 0x7f3e200b16d0 2023-10-09T11:57:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.550+0000 7f3e07fff700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 0x7f3e0c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.550+0000 7f3e07fff700 1 -- 172.21.15.86:0/3367930836 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f3e100849a0 con 0x7f3e200b16d0 2023-10-09T11:57:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.550+0000 7f3e1f7fe700 1 -- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 msgr2=0x7f3e0c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.550+0000 7f3e1f7fe700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 0x7f3e0c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:15.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.559+0000 7f3e07fff700 1 -- 172.21.15.86:0/3367930836 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e100519f0 con 0x7f3e200b16d0 2023-10-09T11:57:15.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.751+0000 7f3e1f7fe700 1 -- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 msgr2=0x7f3e0c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:15.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.751+0000 7f3e1f7fe700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 0x7f3e0c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:15.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.759+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3e2004bb80 con 0x7f3e200b16d0 2023-10-09T11:57:15.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.765+0000 7f3e07fff700 1 -- 172.21.15.86:0/3367930836 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3e10055010 con 0x7f3e200b16d0 2023-10-09T11:57:15.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 msgr2=0x7f3e0c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:15.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 0x7f3e0c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b16d0 msgr2=0x7f3e2016ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b16d0 0x7f3e2016ae50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000ec80 tx=0x7f3e100091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 shutdown_connections 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3e0c066f80 0x7f3e0c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e200b4e70 0x7f3e200c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e200b16d0 0x7f3e2016ae50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 --2- 172.21.15.86:0/3367930836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e200b1b40 0x7f3e2016a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 >> 172.21.15.86:0/3367930836 conn(0x7f3e200d10c0 msgr2=0x7f3e20159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 shutdown_connections 2023-10-09T11:57:15.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.768+0000 7f3e2539d700 1 -- 172.21.15.86:0/3367930836 wait complete. 2023-10-09T11:57:15.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T11:57:15.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.975+0000 7f7dfe79d700 1 Processor -- start 2023-10-09T11:57:15.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.975+0000 7f7dfe79d700 1 -- start start 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.976+0000 7f7dfe79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df80b4e70 0x7f7df80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.976+0000 7f7dfe79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7df80b16d0 0x7f7df80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.976+0000 7f7dfe79d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7df815d240 0x7f7df815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.976+0000 7f7dfe79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80b2080 con 0x7f7df80b16d0 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.976+0000 7f7dfe79d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80cfb00 con 0x7f7df815d240 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.976+0000 7f7dfe79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80b5c40 con 0x7f7df80b4e70 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7df80b16d0 0x7f7df80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7df80b16d0 0x7f7df80b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60534/0 (socket says 172.21.15.86:60534) 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/4161412983 learned_addr learned my addr 172.21.15.86:0/4161412983 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfd79b700 1 --2- 172.21.15.86:0/4161412983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df80b4e70 0x7f7df80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfdf9c700 1 --2- 172.21.15.86:0/4161412983 >> v2:172.21.15.135:3300/0 conn(0x7f7df815d240 0x7f7df815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/4161412983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df80b4e70 msgr2=0x7f7df80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 --2- 172.21.15.86:0/4161412983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df80b4e70 0x7f7df80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/4161412983 >> v2:172.21.15.135:3300/0 conn(0x7f7df815d240 msgr2=0x7f7df815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 --2- 172.21.15.86:0/4161412983 >> v2:172.21.15.135:3300/0 conn(0x7f7df815d240 0x7f7df815d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/4161412983 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df80b5f20 con 0x7f7df80b16d0 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.977+0000 7f7dfcf9a700 1 --2- 172.21.15.86:0/4161412983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b16d0 0x7f7df80b1b40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7df815d180 tx=0x7f7de8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed4e3ae9a0e27ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7deffff700 1 -- 172.21.15.86:0/4161412983 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800b640 con 0x7f7df80b16d0 2023-10-09T11:57:15.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7deffff700 1 -- 172.21.15.86:0/4161412983 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de800b7a0 con 0x7f7df80b16d0 2023-10-09T11:57:15.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7deffff700 1 -- 172.21.15.86:0/4161412983 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800bb60 con 0x7f7df80b16d0 2023-10-09T11:57:15.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 -- 172.21.15.86:0/4161412983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b16d0 msgr2=0x7f7df80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/4161412983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b16d0 0x7f7df80b1b40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7df815d180 tx=0x7f7de8009250 comp rx=0 tx=0).stop 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 -- 172.21.15.86:0/4161412983 shutdown_connections 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/4161412983 >> v2:172.21.15.135:3300/0 conn(0x7f7df815d240 0x7f7df815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/4161412983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df80b4e70 0x7f7df80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/4161412983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b16d0 0x7f7df80b1b40 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 -- 172.21.15.86:0/4161412983 >> 172.21.15.86:0/4161412983 conn(0x7f7df80d10c0 msgr2=0x7f7df80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 -- 172.21.15.86:0/4161412983 shutdown_connections 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.978+0000 7f7dfe79d700 1 -- 172.21.15.86:0/4161412983 wait complete. 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.980+0000 7f7dfe79d700 1 Processor -- start 2023-10-09T11:57:15.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.980+0000 7f7dfe79d700 1 -- start start 2023-10-09T11:57:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfe79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df80b16d0 0x7f7df814b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfe79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b4e70 0x7f7df80cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfe79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df815d240 0x7f7df80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfe79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df815c3a0 con 0x7f7df80b4e70 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfe79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df815c680 con 0x7f7df80b16d0 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfe79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df815c960 con 0x7f7df815d240 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfcf9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b4e70 0x7f7df80cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfcf9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b4e70 0x7f7df80cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60548/0 (socket says 172.21.15.86:60548) 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/3734571701 learned_addr learned my addr 172.21.15.86:0/3734571701 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfd79b700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df80b16d0 0x7f7df814b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.981+0000 7f7dfdf9c700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df815d240 0x7f7df80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df815d240 msgr2=0x7f7df80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfcf9a700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df815d240 0x7f7df80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df80b16d0 msgr2=0x7f7df814b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfcf9a700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df80b16d0 0x7f7df814b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfcf9a700 1 -- 172.21.15.86:0/3734571701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80094f0 con 0x7f7df80b4e70 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfdf9c700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df815d240 0x7f7df80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfcf9a700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b4e70 0x7f7df80cbbc0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7df8070dd0 tx=0x7f7de8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7ded7fa700 1 -- 172.21.15.86:0/3734571701 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800b910 con 0x7f7df80b4e70 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7ded7fa700 1 -- 172.21.15.86:0/3734571701 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de800ba70 con 0x7f7df80b4e70 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7ded7fa700 1 -- 172.21.15.86:0/3734571701 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de8011630 con 0x7f7df80b4e70 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.982+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df815cc40 con 0x7f7df80b4e70 2023-10-09T11:57:15.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.983+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df80cc100 con 0x7f7df80b4e70 2023-10-09T11:57:15.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.984+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df8088990 con 0x7f7df80b4e70 2023-10-09T11:57:15.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.985+0000 7f7ded7fa700 1 -- 172.21.15.86:0/3734571701 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7de80119a0 con 0x7f7df80b4e70 2023-10-09T11:57:15.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.985+0000 7f7ded7fa700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 0x7f7ddc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:15.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.985+0000 7f7dfd79b700 1 -- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 msgr2=0x7f7ddc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:15.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.985+0000 7f7ded7fa700 1 -- 172.21.15.86:0/3734571701 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f7de8085ea0 con 0x7f7df80b4e70 2023-10-09T11:57:15.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.986+0000 7f7dfd79b700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 0x7f7ddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:15.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:15.993+0000 7f7ded7fa700 1 -- 172.21.15.86:0/3734571701 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7de8052ef0 con 0x7f7df80b4e70 2023-10-09T11:57:16.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.187+0000 7f7dfd79b700 1 -- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 msgr2=0x7f7ddc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:16.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.187+0000 7f7dfd79b700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 0x7f7ddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:16.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.194+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f7df815ce00 con 0x7f7df80b4e70 2023-10-09T11:57:16.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.199+0000 7f7ded7fa700 1 -- 172.21.15.86:0/3734571701 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7de8056510 con 0x7f7df80b4e70 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 msgr2=0x7f7ddc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 0x7f7ddc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b4e70 msgr2=0x7f7df80cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b4e70 0x7f7df80cbbc0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7df8070dd0 tx=0x7f7de8017000 comp rx=0 tx=0).stop 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 shutdown_connections 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7df815d240 0x7f7df80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df80b16d0 0x7f7df814b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ddc066f80 0x7f7ddc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 --2- 172.21.15.86:0/3734571701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7df80b4e70 0x7f7df80cbbc0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 >> 172.21.15.86:0/3734571701 conn(0x7f7df80d10c0 msgr2=0x7f7df81591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:16.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 shutdown_connections 2023-10-09T11:57:16.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.201+0000 7f7dfe79d700 1 -- 172.21.15.86:0/3734571701 wait complete. 2023-10-09T11:57:16.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-09T11:57:16.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.411+0000 7f09a339d700 1 Processor -- start 2023-10-09T11:57:16.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.411+0000 7f09a339d700 1 -- start start 2023-10-09T11:57:16.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.412+0000 7f09a339d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f099c0b0790 0x7f099c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:16.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.412+0000 7f09a339d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c0cfa00 con 0x7f099c0b03c0 2023-10-09T11:57:16.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.412+0000 7f09a339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c0cb580 con 0x7f099c1591e0 2023-10-09T11:57:16.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.412+0000 7f09a339d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c0cf160 con 0x7f099c0b0790 2023-10-09T11:57:16.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a239b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f099c0b03c0 0x7f099c0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49808/0 (socket says 172.21.15.86:49808) 2023-10-09T11:57:16.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a239b700 1 -- 172.21.15.86:0/1586593620 learned_addr learned my addr 172.21.15.86:0/1586593620 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:16.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a1b9a700 1 --2- 172.21.15.86:0/1586593620 >> v2:172.21.15.135:3300/0 conn(0x7f099c0b0790 0x7f099c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:16.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a1399700 1 -- 172.21.15.86:0/1586593620 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791143865 0 0) 0x7f099c0cfa00 con 0x7f099c0b03c0 2023-10-09T11:57:16.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a1399700 1 -- 172.21.15.86:0/1586593620 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0988003570 con 0x7f099c0b03c0 2023-10-09T11:57:16.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a1b9a700 1 -- 172.21.15.86:0/1586593620 >> v1:172.21.15.135:6789/0 conn(0x7f099c1591e0 legacy=0x7f099c159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:16.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a1b9a700 1 -- 172.21.15.86:0/1586593620 >> v1:172.21.15.86:6789/0 conn(0x7f099c0b03c0 legacy=0x7f099c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:16.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.413+0000 7f09a1b9a700 1 -- 172.21.15.86:0/1586593620 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0cf440 con 0x7f099c0b0790 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a1b9a700 1 --2- 172.21.15.86:0/1586593620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b0790 0x7f099c0cea70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f098c009910 tx=0x7f098c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f06d6af57fb5d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a1399700 1 -- 172.21.15.86:0/1586593620 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00b640 con 0x7f099c0b0790 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a1399700 1 -- 172.21.15.86:0/1586593620 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00b7a0 con 0x7f099c0b0790 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a1399700 1 -- 172.21.15.86:0/1586593620 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00bb20 con 0x7f099c0b0790 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a339d700 1 -- 172.21.15.86:0/1586593620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b0790 msgr2=0x7f099c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a339d700 1 --2- 172.21.15.86:0/1586593620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b0790 0x7f099c0cea70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f098c009910 tx=0x7f098c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a339d700 1 -- 172.21.15.86:0/1586593620 shutdown_connections 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a339d700 1 --2- 172.21.15.86:0/1586593620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b0790 0x7f099c0cea70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.414+0000 7f09a339d700 1 -- 172.21.15.86:0/1586593620 >> 172.21.15.86:0/1586593620 conn(0x7f099c063230 msgr2=0x7f099c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.415+0000 7f09a339d700 1 -- 172.21.15.86:0/1586593620 shutdown_connections 2023-10-09T11:57:16.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.415+0000 7f09a339d700 1 -- 172.21.15.86:0/1586593620 wait complete. 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.416+0000 7f09a339d700 1 Processor -- start 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.416+0000 7f09a339d700 1 -- start start 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b03c0 0x7f099c15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f099c0b0790 0x7f099c16ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a339d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f099c1591e0 0x7f099c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a339d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c7f70 con 0x7f099c1591e0 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c53d0 con 0x7f099c0b03c0 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c7640 con 0x7f099c0b0790 2023-10-09T11:57:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a2b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f099c1591e0 0x7f099c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a2b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f099c1591e0 0x7f099c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60556/0 (socket says 172.21.15.86:60556) 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a2b9c700 1 -- 172.21.15.86:0/2455533436 learned_addr learned my addr 172.21.15.86:0/2455533436 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.417+0000 7f09a239b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b03c0 0x7f099c15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a1b9a700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f099c0b0790 0x7f099c16ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a2b9c700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f099c0b0790 msgr2=0x7f099c16ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a2b9c700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f099c0b0790 0x7f099c16ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a2b9c700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b03c0 msgr2=0x7f099c15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a2b9c700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f099c0b03c0 0x7f099c15afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a2b9c700 1 -- 172.21.15.86:0/2455533436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009420 con 0x7f099c1591e0 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a2b9c700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f099c1591e0 0x7f099c0c4920 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f099400c840 tx=0x7f0994001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994012630 con 0x7f099c1591e0 2023-10-09T11:57:16.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09940127b0 con 0x7f099c1591e0 2023-10-09T11:57:16.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09a339d700 1 -- 172.21.15.86:0/2455533436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c0c7920 con 0x7f099c1591e0 2023-10-09T11:57:16.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.418+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994012b70 con 0x7f099c1591e0 2023-10-09T11:57:16.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.419+0000 7f09a339d700 1 -- 172.21.15.86:0/2455533436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c16d9c0 con 0x7f099c1591e0 2023-10-09T11:57:16.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.420+0000 7f09a339d700 1 -- 172.21.15.86:0/2455533436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c0c80e0 con 0x7f099c1591e0 2023-10-09T11:57:16.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.421+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f099401a3a0 con 0x7f099c1591e0 2023-10-09T11:57:16.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.421+0000 7f09927fc700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f09800694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:16.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.421+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f09940848e0 con 0x7f099c1591e0 2023-10-09T11:57:16.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.421+0000 7f09a239b700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 msgr2=0x7f09800694b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:16.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.422+0000 7f09a239b700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f09800694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:16.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.429+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0994051930 con 0x7f099c1591e0 2023-10-09T11:57:16.585 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:16.585+0000 7f2b36353180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:57:16.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.623+0000 7f09a239b700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 msgr2=0x7f09800694b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:16.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.623+0000 7f09a239b700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f09800694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:16.653+0000 7f09a339d700 1 -- 172.21.15.86:0/2455533436 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f099c04c3c0 con 0x7f0980067000 2023-10-09T11:57:16.664 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:16.664+0000 7f7a8088f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:57:16.748 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:16.748+0000 7f2b36353180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:16.828 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:16.827+0000 7f7a8088f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:16.835 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:16.834+0000 7f2b36353180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:57:16.914 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:16.914+0000 7f7a8088f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:57:17.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:17.024+0000 7f09a239b700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 msgr2=0x7f09800694b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:17.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:17.024+0000 7f09a239b700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f09800694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:57:17.061 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:17.061+0000 7f2b36353180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:17.137 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:17.137+0000 7f7a8088f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:17.239 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:17.239+0000 7f2b36353180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:57:17.315 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:17.315+0000 7f7a8088f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:57:17.331 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:17.331+0000 7f2b36353180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:57:17.406 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:17.406+0000 7f7a8088f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:57:17.492 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:17.492+0000 7f2b36353180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:57:17.569 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:17.569+0000 7f7a8088f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:57:17.592 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:17.592+0000 7f2b36353180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:17.669 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:17.669+0000 7f7a8088f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:17.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:17.825+0000 7f09a239b700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 msgr2=0x7f09800694b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:17.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:17.825+0000 7f09a239b700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f09800694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T11:57:18.078 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:18.077+0000 7f2b36353180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:57:18.153 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:18.153+0000 7f7a8088f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:57:18.171 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:18.171+0000 7f2b36353180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:57:18.246 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:18.246+0000 7f7a8088f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:57:18.261 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:18.261+0000 7f2b36353180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:57:18.336 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:18.336+0000 7f7a8088f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:57:18.881 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:18.881+0000 7f2b36353180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:57:18.954 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:18.954+0000 7f7a8088f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:57:19.052 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:19.052+0000 7f2b36353180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:19.126 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:19.126+0000 7f7a8088f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:19.147 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:19.147+0000 7f2b36353180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:57:19.221 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:19.221+0000 7f7a8088f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:57:19.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:19.427+0000 7f09a239b700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 msgr2=0x7f09800694b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:19.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:19.427+0000 7f09a239b700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f09800694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T11:57:19.440 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:19.440+0000 7f2b36353180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:57:19.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:19.513+0000 7f7a8088f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:57:19.537 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:19.537+0000 7f2b36353180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:57:19.609 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:19.609+0000 7f7a8088f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:57:20.236 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:20.236+0000 7f2b36353180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:57:20.310 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:20.310+0000 7f7a8088f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:57:20.524 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:20.524+0000 7f2b36353180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:57:20.595 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:20.595+0000 7f7a8088f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:57:20.617 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:20.616+0000 7f2b36353180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:57:20.689 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:20.689+0000 7f7a8088f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:57:20.770 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:20.770+0000 7f2b36353180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:57:20.843 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:20.843+0000 7f7a8088f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:57:20.873 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:20.873+0000 7f2b36353180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:57:20.949 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:20.949+0000 7f7a8088f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:57:21.062 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:21.062+0000 7f2b36353180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:57:21.138 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.138+0000 7f7a8088f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:57:21.154 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:21.153+0000 7f2b36353180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:57:21.231 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.231+0000 7f7a8088f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:57:21.246 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:21.245+0000 7f2b36353180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:57:21.323 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.323+0000 7f7a8088f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:57:21.338 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:21.338+0000 7f2b36353180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:57:21.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:21.398+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 38) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f0994051d00 con 0x7f099c1591e0 2023-10-09T11:57:21.421 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.421+0000 7f7a8088f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:57:21.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:21.430+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 39) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f0994049f00 con 0x7f099c1591e0 2023-10-09T11:57:21.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:21.430+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 msgr2=0x7f09800694b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:21.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:21.430+0000 7f09927fc700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f09800694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f23f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f23f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f23f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f23f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f23f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f5bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f5bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f5bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.551 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f5bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:21.552 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:21.550+0000 7f79f5bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:57:22.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.435+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mon.0 v2:172.21.15.86:3300/0 9 ==== mgrmap(e 40) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f09940525d0 con 0x7f099c1591e0 2023-10-09T11:57:22.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.436+0000 7f09927fc700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f0980069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:22.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.436+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f099c04c3c0 con 0x7f0980067000 2023-10-09T11:57:22.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.437+0000 7f09a239b700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f0980069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:22.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.439+0000 7f09a239b700 1 --2- 172.21.15.86:0/2455533436 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0980067000 0x7f0980069430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0998007fd0 tx=0x7f0998009040 comp rx=0 tx=0).ready entity=mgr.6906 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:22.450 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:22.450+0000 7f79fcc05700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-09T11:57:22.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.450+0000 7f09927fc700 1 -- 172.21.15.86:0/2455533436 <== mgr.6906 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f099c04c3c0 con 0x7f0980067000 2023-10-09T11:57:22.453 INFO:teuthology.orchestra.run.smithi086.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-09T11:57:22.461 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-09T11:57:22.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T11:57:22.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.648+0000 7f65f39ff700 1 Processor -- start 2023-10-09T11:57:22.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.648+0000 7f65f39ff700 1 -- start start 2023-10-09T11:57:22.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.649+0000 7f65f39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0c70b0 0x7f65ec155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f39ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f65ec0cd0b0 0x7f65ec069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f39ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec06e950 con 0x7f65ec0ccc40 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f39ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ec1563f0 con 0x7f65ec0cd0b0 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec06eb90 con 0x7f65ec0c70b0 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f1f9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f65ec0cd0b0 0x7f65ec069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f1f9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f65ec0cd0b0 0x7f65ec069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60672/0 (socket says 172.21.15.86:60672) 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f1f9c700 1 -- 172.21.15.86:0/4228811539 learned_addr learned my addr 172.21.15.86:0/4228811539 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f179b700 1 --2- 172.21.15.86:0/4228811539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0c70b0 0x7f65ec155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f1f9c700 1 -- 172.21.15.86:0/4228811539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0c70b0 msgr2=0x7f65ec155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f1f9c700 1 --2- 172.21.15.86:0/4228811539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0c70b0 0x7f65ec155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:22.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f1f9c700 1 -- 172.21.15.86:0/4228811539 >> v1:172.21.15.135:6789/0 conn(0x7f65ec0ccc40 legacy=0x7f65ec06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.650+0000 7f65f1f9c700 1 -- 172.21.15.86:0/4228811539 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec06ee70 con 0x7f65ec0cd0b0 2023-10-09T11:57:22.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f1f9c700 1 --2- 172.21.15.86:0/4228811539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0cd0b0 0x7f65ec069770 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f65e400d1a0 tx=0x7f65e400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed09d5288cef1c7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65e3fff700 1 -- 172.21.15.86:0/4228811539 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4010070 con 0x7f65ec0cd0b0 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65e3fff700 1 -- 172.21.15.86:0/4228811539 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e400b0d0 con 0x7f65ec0cd0b0 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65e3fff700 1 -- 172.21.15.86:0/4228811539 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400b490 con 0x7f65ec0cd0b0 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f39ff700 1 -- 172.21.15.86:0/4228811539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0cd0b0 msgr2=0x7f65ec069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f39ff700 1 --2- 172.21.15.86:0/4228811539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0cd0b0 0x7f65ec069770 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f65e400d1a0 tx=0x7f65e400ba50 comp rx=0 tx=0).stop 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f39ff700 1 -- 172.21.15.86:0/4228811539 shutdown_connections 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f39ff700 1 --2- 172.21.15.86:0/4228811539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0cd0b0 0x7f65ec069770 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:22.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f39ff700 1 --2- 172.21.15.86:0/4228811539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0c70b0 0x7f65ec155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f39ff700 1 -- 172.21.15.86:0/4228811539 >> 172.21.15.86:0/4228811539 conn(0x7f65ec068e10 msgr2=0x7f65ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.651+0000 7f65f39ff700 1 -- 172.21.15.86:0/4228811539 shutdown_connections 2023-10-09T11:57:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.652+0000 7f65f39ff700 1 -- 172.21.15.86:0/4228811539 wait complete. 2023-10-09T11:57:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.653+0000 7f65f39ff700 1 Processor -- start 2023-10-09T11:57:22.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.653+0000 7f65f39ff700 1 -- start start 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f39ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c70b0 0x7f65ec1662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f39ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65ec0ccc40 0x7f65ec0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0cd0b0 0x7f65ec162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f39ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec166a80 con 0x7f65ec0c70b0 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f39ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0b0cc0 con 0x7f65ec0ccc40 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0b0f00 con 0x7f65ec0cd0b0 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f179b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c70b0 0x7f65ec1662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f179b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c70b0 0x7f65ec1662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60674/0 (socket says 172.21.15.86:60674) 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f179b700 1 -- 172.21.15.86:0/784268115 learned_addr learned my addr 172.21.15.86:0/784268115 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f0f9a700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65ec0ccc40 0x7f65ec0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:22.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f1f9c700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0cd0b0 0x7f65ec162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.654+0000 7f65f179b700 1 -- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0cd0b0 msgr2=0x7f65ec162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f179b700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0cd0b0 0x7f65ec162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f179b700 1 -- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65ec0ccc40 msgr2=0x7f65ec0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f179b700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65ec0ccc40 0x7f65ec0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f179b700 1 -- 172.21.15.86:0/784268115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e400bcf0 con 0x7f65ec0c70b0 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f1f9c700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0cd0b0 0x7f65ec162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f179b700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c70b0 0x7f65ec1662d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f65e800d860 tx=0x7f65e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8009610 con 0x7f65ec0c70b0 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8009770 con 0x7f65ec0c70b0 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8009b30 con 0x7f65ec0c70b0 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec0b11e0 con 0x7f65ec0c70b0 2023-10-09T11:57:22.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.655+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec163150 con 0x7f65ec0c70b0 2023-10-09T11:57:22.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.656+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec166d20 con 0x7f65ec0c70b0 2023-10-09T11:57:22.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.657+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 40) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f65e801e460 con 0x7f65ec0c70b0 2023-10-09T11:57:22.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.658+0000 7f65e17fa700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65d0066dd0 0x7f65d0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.658+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f65e8084b30 con 0x7f65ec0c70b0 2023-10-09T11:57:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.658+0000 7f65f0f9a700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65d0066dd0 0x7f65d0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:22.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.659+0000 7f65f0f9a700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65d0066dd0 0x7f65d0069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0a62a0 tx=0x7f65dc009040 comp rx=0 tx=0).ready entity=mgr.6906 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:22.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.662+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65e8051dd0 con 0x7f65ec0c70b0 2023-10-09T11:57:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:22.908+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f65ec04c3c0 con 0x7f65ec0c70b0 2023-10-09T11:57:23.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.444+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f65e80521a0 con 0x7f65ec0c70b0 2023-10-09T11:57:23.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.445+0000 7f65e17fa700 1 -- 172.21.15.86:0/784268115 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v41) v1 ==== 93+0+0 (secure 0 0 0) 0x7f65e807d7c0 con 0x7f65ec0c70b0 2023-10-09T11:57:23.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65d0066dd0 msgr2=0x7f65d0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:23.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65d0066dd0 0x7f65d0069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0a62a0 tx=0x7f65dc009040 comp rx=0 tx=0).stop 2023-10-09T11:57:23.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c70b0 msgr2=0x7f65ec1662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c70b0 0x7f65ec1662d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f65e800d860 tx=0x7f65e8008040 comp rx=0 tx=0).stop 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 shutdown_connections 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65d0066dd0 0x7f65d0069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c70b0 0x7f65ec1662d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65ec0cd0b0 0x7f65ec162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 --2- 172.21.15.86:0/784268115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65ec0ccc40 0x7f65ec0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 >> 172.21.15.86:0/784268115 conn(0x7f65ec068e10 msgr2=0x7f65ec0c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 shutdown_connections 2023-10-09T11:57:23.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.448+0000 7f65f39ff700 1 -- 172.21.15.86:0/784268115 wait complete. 2023-10-09T11:57:23.468 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:57:23.468 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:57:23.553 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:57:23.633 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:57:23.633 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:57:23.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:57:23.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:23.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:57:23.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:23.724 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:57:23.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:23.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.987+0000 7f965639d700 1 Processor -- start 2023-10-09T11:57:23.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.987+0000 7f965639d700 1 -- start start 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965639d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9650159420 0x7f96500b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965639d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f965015d230 0x7f965015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965639d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96500b2980 con 0x7f96501597f0 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965639d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965015db70 con 0x7f9650159420 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965639d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96500b11d0 con 0x7f965015d230 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965539b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9650159420 0x7f96500b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965539b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9650159420 0x7f96500b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60708/0 (socket says 172.21.15.86:60708) 2023-10-09T11:57:23.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.988+0000 7f965539b700 1 -- 172.21.15.86:0/3617469057 learned_addr learned my addr 172.21.15.86:0/3617469057 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f9655b9c700 1 --2- 172.21.15.86:0/3617469057 >> v2:172.21.15.135:3300/0 conn(0x7f965015d230 0x7f965015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f965539b700 1 -- 172.21.15.86:0/3617469057 >> v2:172.21.15.135:3300/0 conn(0x7f965015d230 msgr2=0x7f965015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f965539b700 1 --2- 172.21.15.86:0/3617469057 >> v2:172.21.15.135:3300/0 conn(0x7f965015d230 0x7f965015d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f965539b700 1 -- 172.21.15.86:0/3617469057 >> v1:172.21.15.135:6789/0 conn(0x7f96501597f0 legacy=0x7f96500b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f965539b700 1 -- 172.21.15.86:0/3617469057 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500b14b0 con 0x7f9650159420 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f9655b9c700 1 --2- 172.21.15.86:0/3617469057 >> v2:172.21.15.135:3300/0 conn(0x7f965015d230 0x7f965015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f965539b700 1 --2- 172.21.15.86:0/3617469057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9650159420 0x7f96500b5f40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f965015d170 tx=0x7f964c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8de380fa6f0360a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f9647fff700 1 -- 172.21.15.86:0/3617469057 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00b860 con 0x7f9650159420 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f9647fff700 1 -- 172.21.15.86:0/3617469057 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c00b9c0 con 0x7f9650159420 2023-10-09T11:57:23.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.989+0000 7f9647fff700 1 -- 172.21.15.86:0/3617469057 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00bd60 con 0x7f9650159420 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 -- 172.21.15.86:0/3617469057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9650159420 msgr2=0x7f96500b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 --2- 172.21.15.86:0/3617469057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9650159420 0x7f96500b5f40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f965015d170 tx=0x7f964c009250 comp rx=0 tx=0).stop 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 -- 172.21.15.86:0/3617469057 shutdown_connections 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 --2- 172.21.15.86:0/3617469057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9650159420 0x7f96500b5f40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 --2- 172.21.15.86:0/3617469057 >> v2:172.21.15.135:3300/0 conn(0x7f965015d230 0x7f965015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 -- 172.21.15.86:0/3617469057 >> 172.21.15.86:0/3617469057 conn(0x7f96500d0660 msgr2=0x7f96500d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 -- 172.21.15.86:0/3617469057 shutdown_connections 2023-10-09T11:57:23.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.990+0000 7f965639d700 1 -- 172.21.15.86:0/3617469057 wait complete. 2023-10-09T11:57:23.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.992+0000 7f965639d700 1 Processor -- start 2023-10-09T11:57:23.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.992+0000 7f965639d700 1 -- start start 2023-10-09T11:57:23.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.992+0000 7f965639d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9650159420 0x7f96501552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:23.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.992+0000 7f965639d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96501597f0 0x7f96500c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:23.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f965639d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965015d230 0x7f96501581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:23.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f965639d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96500ca650 con 0x7f96501597f0 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f965639d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965016aa90 con 0x7f965015d230 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f965639d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500ca8d0 con 0x7f9650159420 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96501597f0 0x7f96500c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9655b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965015d230 0x7f96501581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f965539b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9650159420 0x7f96501552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96501597f0 0x7f96500c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60718/0 (socket says 172.21.15.86:60718) 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 -- 172.21.15.86:0/2695871227 learned_addr learned my addr 172.21.15.86:0/2695871227 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 -- 172.21.15.86:0/2695871227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9650159420 msgr2=0x7f96501552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:23.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9650159420 0x7f96501552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 -- 172.21.15.86:0/2695871227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965015d230 msgr2=0x7f96501581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965015d230 0x7f96501581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.993+0000 7f9654b9a700 1 -- 172.21.15.86:0/2695871227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0094f0 con 0x7f96501597f0 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.994+0000 7f9654b9a700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96501597f0 0x7f96500c65d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f964000c7c0 tx=0x7f9640007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.994+0000 7f96457fa700 1 -- 172.21.15.86:0/2695871227 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640011590 con 0x7f96501597f0 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.994+0000 7f96457fa700 1 -- 172.21.15.86:0/2695871227 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96400116f0 con 0x7f96501597f0 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.994+0000 7f96457fa700 1 -- 172.21.15.86:0/2695871227 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640011ab0 con 0x7f96501597f0 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.994+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96500cabb0 con 0x7f96501597f0 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.994+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9650155820 con 0x7f96501597f0 2023-10-09T11:57:23.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.995+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96500cb0d0 con 0x7f96501597f0 2023-10-09T11:57:23.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.996+0000 7f96457fa700 1 -- 172.21.15.86:0/2695871227 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f964001b3b0 con 0x7f96501597f0 2023-10-09T11:57:23.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.997+0000 7f96457fa700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 0x7f9634069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:23.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.997+0000 7f965539b700 1 -- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 msgr2=0x7f9634069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:24.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.997+0000 7f96457fa700 1 -- 172.21.15.86:0/2695871227 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f9640083f90 con 0x7f96501597f0 2023-10-09T11:57:24.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:23.997+0000 7f965539b700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 0x7f9634069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:24.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.001+0000 7f96457fa700 1 -- 172.21.15.86:0/2695871227 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96500cb0d0 con 0x7f96501597f0 2023-10-09T11:57:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.198+0000 7f965539b700 1 -- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 msgr2=0x7f9634069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.198+0000 7f965539b700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 0x7f9634069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:24.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.245+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96500cb0d0 con 0x7f96501597f0 2023-10-09T11:57:24.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.245+0000 7f96457fa700 1 -- 172.21.15.86:0/2695871227 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f96500cb0d0 con 0x7f96501597f0 2023-10-09T11:57:24.245 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:24.246 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/153919105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":153919105},{"type":"v1","addr":"172.21.15.135:6834","nonce":153919105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4109315239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4109315239},{"type":"v1","addr":"172.21.15.135:6835","nonce":4109315239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6702,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/567273052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":567273052},{"type":"v1","addr":"172.21.15.86:6834","nonce":567273052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:01.334172+0000","modified":"2023-10-09T11:57:04.892057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1853170285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":1853170285},{"type":"v1","addr":"172.21.15.86:6835","nonce":1853170285}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:57:24.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.247+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 msgr2=0x7f9634069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:24.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.247+0000 7f965639d700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 0x7f9634069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96501597f0 msgr2=0x7f96500c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96501597f0 0x7f96500c65d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f964000c7c0 tx=0x7f9640007f50 comp rx=0 tx=0).stop 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 shutdown_connections 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965015d230 0x7f96501581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9650159420 0x7f96501552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f96340670e0 0x7f9634069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 --2- 172.21.15.86:0/2695871227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96501597f0 0x7f96500c65d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 >> 172.21.15.86:0/2695871227 conn(0x7f96500d0660 msgr2=0x7f9650069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 shutdown_connections 2023-10-09T11:57:24.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.248+0000 7f965639d700 1 -- 172.21.15.86:0/2695871227 wait complete. 2023-10-09T11:57:24.250 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2023-10-09T11:57:24.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:24.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.453+0000 7f1bab59e700 1 Processor -- start 2023-10-09T11:57:24.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.453+0000 7f1bab59e700 1 -- start start 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.454+0000 7f1bab59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac0c6c60 0x7f1bac0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.454+0000 7f1bab59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac0b1410 con 0x7f1bac06e8c0 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.454+0000 7f1bab59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bac063230 con 0x7f1bac1595a0 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.454+0000 7f1bab59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0b2b90 con 0x7f1bac0c6c60 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1baad9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1bac06e8c0 0x7f1bac159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49826/0 (socket says 172.21.15.86:49826) 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1baad9d700 1 -- 172.21.15.86:0/3009205378 learned_addr learned my addr 172.21.15.86:0/3009205378 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba9d9b700 1 --2- 172.21.15.86:0/3009205378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac0c6c60 0x7f1bac0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba959a700 1 -- 172.21.15.86:0/3009205378 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174558125 0 0) 0x7f1bac0b1410 con 0x7f1bac06e8c0 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba959a700 1 -- 172.21.15.86:0/3009205378 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b94003570 con 0x7f1bac06e8c0 2023-10-09T11:57:24.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba959a700 1 -- 172.21.15.86:0/3009205378 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932207110 0 0) 0x7f1bac063230 con 0x7f1bac1595a0 2023-10-09T11:57:24.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba959a700 1 -- 172.21.15.86:0/3009205378 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bac0b1410 con 0x7f1bac1595a0 2023-10-09T11:57:24.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba9d9b700 1 -- 172.21.15.86:0/3009205378 >> v1:172.21.15.135:6789/0 conn(0x7f1bac1595a0 legacy=0x7f1bac0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba9d9b700 1 -- 172.21.15.86:0/3009205378 >> v1:172.21.15.86:6789/0 conn(0x7f1bac06e8c0 legacy=0x7f1bac159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.455+0000 7f1ba9d9b700 1 -- 172.21.15.86:0/3009205378 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0634f0 con 0x7f1bac0c6c60 2023-10-09T11:57:24.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.456+0000 7f1ba9d9b700 1 --2- 172.21.15.86:0/3009205378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac0c6c60 0x7f1bac0c8120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009910 tx=0x7f1ba00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3e1ca0c09ab512c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:24.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.456+0000 7f1ba959a700 1 -- 172.21.15.86:0/3009205378 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011630 con 0x7f1bac0c6c60 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.456+0000 7f1ba959a700 1 -- 172.21.15.86:0/3009205378 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba0011790 con 0x7f1bac0c6c60 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.456+0000 7f1ba959a700 1 -- 172.21.15.86:0/3009205378 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011b30 con 0x7f1bac0c6c60 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.457+0000 7f1bab59e700 1 -- 172.21.15.86:0/3009205378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac0c6c60 msgr2=0x7f1bac0c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.457+0000 7f1bab59e700 1 --2- 172.21.15.86:0/3009205378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac0c6c60 0x7f1bac0c8120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009910 tx=0x7f1ba00091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.457+0000 7f1bab59e700 1 -- 172.21.15.86:0/3009205378 shutdown_connections 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.457+0000 7f1bab59e700 1 --2- 172.21.15.86:0/3009205378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac0c6c60 0x7f1bac0c8120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.457+0000 7f1bab59e700 1 -- 172.21.15.86:0/3009205378 >> 172.21.15.86:0/3009205378 conn(0x7f1bac06ddb0 msgr2=0x7f1bac06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.457+0000 7f1bab59e700 1 -- 172.21.15.86:0/3009205378 shutdown_connections 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.457+0000 7f1bab59e700 1 -- 172.21.15.86:0/3009205378 wait complete. 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.458+0000 7f1bab59e700 1 Processor -- start 2023-10-09T11:57:24.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.458+0000 7f1bab59e700 1 -- start start 2023-10-09T11:57:24.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1bab59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac06e8c0 0x7f1bac15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1bab59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bac0c6c60 0x7f1bac169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1bab59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bac1595a0 0x7f1bac151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1bab59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0c5910 con 0x7f1bac0c6c60 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1bab59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac15bb70 con 0x7f1bac1595a0 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1bab59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac152500 con 0x7f1bac06e8c0 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1ba9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bac0c6c60 0x7f1bac169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1ba9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bac0c6c60 0x7f1bac169d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60720/0 (socket says 172.21.15.86:60720) 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1ba9d9b700 1 -- 172.21.15.86:0/1848203725 learned_addr learned my addr 172.21.15.86:0/1848203725 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1baad9d700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bac1595a0 0x7f1bac151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.459+0000 7f1baa59c700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac06e8c0 0x7f1bac15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1ba9d9b700 1 -- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac06e8c0 msgr2=0x7f1bac15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1ba9d9b700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac06e8c0 0x7f1bac15a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1ba9d9b700 1 -- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bac1595a0 msgr2=0x7f1bac151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1ba9d9b700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bac1595a0 0x7f1bac151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1ba9d9b700 1 -- 172.21.15.86:0/1848203725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009420 con 0x7f1bac0c6c60 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1ba9d9b700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bac0c6c60 0x7f1bac169d20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009f00 tx=0x7f1ba0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1b9a7fc700 1 -- 172.21.15.86:0/1848203725 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba001f070 con 0x7f1bac0c6c60 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1b9a7fc700 1 -- 172.21.15.86:0/1848203725 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba0002f70 con 0x7f1bac0c6c60 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1b9a7fc700 1 -- 172.21.15.86:0/1848203725 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0023410 con 0x7f1bac0c6c60 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.460+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac16a360 con 0x7f1bac0c6c60 2023-10-09T11:57:24.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.461+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac16a920 con 0x7f1bac0c6c60 2023-10-09T11:57:24.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.461+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bac0c56e0 con 0x7f1bac0c6c60 2023-10-09T11:57:24.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.462+0000 7f1b9a7fc700 1 -- 172.21.15.86:0/1848203725 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1ba0023840 con 0x7f1bac0c6c60 2023-10-09T11:57:24.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.463+0000 7f1b9a7fc700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 0x7f1b8c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.463+0000 7f1baa59c700 1 -- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 msgr2=0x7f1b8c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:24.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.463+0000 7f1b9a7fc700 1 -- 172.21.15.86:0/1848203725 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f1ba0085b70 con 0x7f1bac0c6c60 2023-10-09T11:57:24.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.463+0000 7f1baa59c700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 0x7f1b8c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:24.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.471+0000 7f1b9a7fc700 1 -- 172.21.15.86:0/1848203725 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bac0c56e0 con 0x7f1bac0c6c60 2023-10-09T11:57:24.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.664+0000 7f1baa59c700 1 -- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 msgr2=0x7f1b8c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:24.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.664+0000 7f1baa59c700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 0x7f1b8c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:24.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.674+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bac0c56e0 con 0x7f1bac0c6c60 2023-10-09T11:57:24.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.675+0000 7f1b9a7fc700 1 -- 172.21.15.86:0/1848203725 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16337 (secure 0 0 0) 0x7f1bac0c56e0 con 0x7f1bac0c6c60 2023-10-09T11:57:24.675 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:24.676 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":95,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:21.423345+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:59.439269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:00.315207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:57:21.423306+0000","172.21.15.86:6836/85490":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/1417041114":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/259108472":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/2573157997":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/3728854362":"2023-10-10T11:57:21.423306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:24.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 msgr2=0x7f1b8c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:24.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 0x7f1b8c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bac0c6c60 msgr2=0x7f1bac169d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bac0c6c60 0x7f1bac169d20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009f00 tx=0x7f1ba0017000 comp rx=0 tx=0).stop 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 shutdown_connections 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bac1595a0 0x7f1bac151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bac06e8c0 0x7f1bac15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b8c0670e0 0x7f1b8c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 --2- 172.21.15.86:0/1848203725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bac0c6c60 0x7f1bac169d20 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.677+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 >> 172.21.15.86:0/1848203725 conn(0x7f1bac06ddb0 msgr2=0x7f1bac153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.678+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 shutdown_connections 2023-10-09T11:57:24.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.678+0000 7f1bab59e700 1 -- 172.21.15.86:0/1848203725 wait complete. 2023-10-09T11:57:24.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:56:59.439269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:57:00.315207+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:57:24.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:57:24.720 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:24.720+0000 7fec576f4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:57:24.782 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:24.782+0000 7eff02adf180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:57:24.884 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:24.883+0000 7fec576f4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.886+0000 7f2570dff700 1 Processor -- start 2023-10-09T11:57:24.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.886+0000 7f2570dff700 1 -- start start 2023-10-09T11:57:24.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.887+0000 7f2570dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f256c159890 0x7f256c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.887+0000 7f2570dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c069560 0x7f256c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.887+0000 7f2570dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c069ee0 con 0x7f256c159c60 2023-10-09T11:57:24.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.887+0000 7f2570dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c15a160 con 0x7f256c159890 2023-10-09T11:57:24.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f2570dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0d13a0 con 0x7f256c069560 2023-10-09T11:57:24.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256a59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f256c159890 0x7f256c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256a59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f256c159890 0x7f256c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60730/0 (socket says 172.21.15.86:60730) 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256a59c700 1 -- 172.21.15.86:0/1352191898 learned_addr learned my addr 172.21.15.86:0/1352191898 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f2569d9b700 1 --1- 172.21.15.86:0/1352191898 >> v1:172.21.15.86:6789/0 conn(0x7f256c159c60 0x7f256c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49832/0 (socket says 172.21.15.86:49832) 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256ad9d700 1 --2- 172.21.15.86:0/1352191898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c069560 0x7f256c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256a59c700 1 -- 172.21.15.86:0/1352191898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c069560 msgr2=0x7f256c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256a59c700 1 --2- 172.21.15.86:0/1352191898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c069560 0x7f256c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256a59c700 1 -- 172.21.15.86:0/1352191898 >> v1:172.21.15.86:6789/0 conn(0x7f256c159c60 legacy=0x7f256c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256a59c700 1 -- 172.21.15.86:0/1352191898 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c15e140 con 0x7f256c159890 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.888+0000 7f256959a700 1 -- 172.21.15.86:0/1352191898 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627138221 0 0) 0x7f256c069ee0 con 0x7f256c159c60 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.889+0000 7f256a59c700 1 --2- 172.21.15.86:0/1352191898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c159890 0x7f256c15abd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f255c0099b0 tx=0x7f255c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cded6e3807ef8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.889+0000 7f256959a700 1 -- 172.21.15.86:0/1352191898 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c009ea0 con 0x7f256c159890 2023-10-09T11:57:24.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.889+0000 7f256959a700 1 -- 172.21.15.86:0/1352191898 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00b860 con 0x7f256c159890 2023-10-09T11:57:24.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.889+0000 7f256959a700 1 -- 172.21.15.86:0/1352191898 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00bc00 con 0x7f256c159890 2023-10-09T11:57:24.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.889+0000 7f2570dff700 1 -- 172.21.15.86:0/1352191898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c159890 msgr2=0x7f256c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.889+0000 7f2570dff700 1 --2- 172.21.15.86:0/1352191898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c159890 0x7f256c15abd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f255c0099b0 tx=0x7f255c009250 comp rx=0 tx=0).stop 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.890+0000 7f2570dff700 1 -- 172.21.15.86:0/1352191898 shutdown_connections 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.890+0000 7f2570dff700 1 --2- 172.21.15.86:0/1352191898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c069560 0x7f256c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.890+0000 7f2570dff700 1 --2- 172.21.15.86:0/1352191898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c159890 0x7f256c15abd0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.890+0000 7f2570dff700 1 -- 172.21.15.86:0/1352191898 >> 172.21.15.86:0/1352191898 conn(0x7f256c068e20 msgr2=0x7f256c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.890+0000 7f2570dff700 1 -- 172.21.15.86:0/1352191898 shutdown_connections 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.890+0000 7f2570dff700 1 -- 172.21.15.86:0/1352191898 wait complete. 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.891+0000 7f2570dff700 1 Processor -- start 2023-10-09T11:57:24.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.891+0000 7f2570dff700 1 -- start start 2023-10-09T11:57:24.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f2570dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c069560 0x7f256c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f2570dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c159890 0x7f256c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f2570dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f256c159c60 0x7f256c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f2570dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c169f30 con 0x7f256c069560 2023-10-09T11:57:24.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f2570dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0b4c20 con 0x7f256c159c60 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f2570dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0b4380 con 0x7f256c159890 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f256a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c069560 0x7f256c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f256a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c069560 0x7f256c14d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37420/0 (socket says 172.21.15.86:37420) 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.892+0000 7f256a59c700 1 -- 172.21.15.86:0/433255448 learned_addr learned my addr 172.21.15.86:0/433255448 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f2569d9b700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c159890 0x7f256c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f256ad9d700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f256c159c60 0x7f256c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f256a59c700 1 -- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c159890 msgr2=0x7f256c0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f256a59c700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c159890 0x7f256c0b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f256a59c700 1 -- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f256c159c60 msgr2=0x7f256c0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f256a59c700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f256c159c60 0x7f256c0b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:24.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f256a59c700 1 -- 172.21.15.86:0/433255448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0094f0 con 0x7f256c069560 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.893+0000 7f256a59c700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c069560 0x7f256c14d680 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f256c0899c0 tx=0x7f255c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.894+0000 7f255a7fc700 1 -- 172.21.15.86:0/433255448 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c000d10 con 0x7f256c069560 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.894+0000 7f255a7fc700 1 -- 172.21.15.86:0/433255448 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00bbe0 con 0x7f256c069560 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.894+0000 7f255a7fc700 1 -- 172.21.15.86:0/433255448 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c011690 con 0x7f256c069560 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.894+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c0b4660 con 0x7f256c069560 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.894+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c0ce410 con 0x7f256c069560 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.895+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c04c3c0 con 0x7f256c069560 2023-10-09T11:57:24.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.896+0000 7f255a7fc700 1 -- 172.21.15.86:0/433255448 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f255c011ac0 con 0x7f256c069560 2023-10-09T11:57:24.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.897+0000 7f255a7fc700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 0x7f254c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:24.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.897+0000 7f255a7fc700 1 -- 172.21.15.86:0/433255448 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f255c086360 con 0x7f256c069560 2023-10-09T11:57:24.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.897+0000 7f2569d9b700 1 -- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 msgr2=0x7f254c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:24.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.897+0000 7f2569d9b700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 0x7f254c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:24.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:24.902+0000 7f255a7fc700 1 -- 172.21.15.86:0/433255448 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f255c0530d0 con 0x7f256c069560 2023-10-09T11:57:24.956 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:24.956+0000 7eff02adf180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:24.972 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:24.971+0000 7fec576f4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:57:25.044 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:25.044+0000 7eff02adf180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:57:25.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.098+0000 7f2569d9b700 1 -- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 msgr2=0x7f254c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:25.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.098+0000 7f2569d9b700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 0x7f254c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:25.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.102+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f256c06a5b0 con 0x7f256c069560 2023-10-09T11:57:25.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.103+0000 7f255a7fc700 1 -- 172.21.15.86:0/433255448 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f255c0566f0 con 0x7f256c069560 2023-10-09T11:57:25.103 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 msgr2=0x7f254c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 0x7f254c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c069560 msgr2=0x7f256c14d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c069560 0x7f256c14d680 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f256c0899c0 tx=0x7f255c017000 comp rx=0 tx=0).stop 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 shutdown_connections 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f254c0670e0 0x7f254c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f256c069560 0x7f256c14d680 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f256c159c60 0x7f256c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 --2- 172.21.15.86:0/433255448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f256c159890 0x7f256c0b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.105+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 >> 172.21.15.86:0/433255448 conn(0x7f256c068e20 msgr2=0x7f256c0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:25.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.106+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 shutdown_connections 2023-10-09T11:57:25.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.106+0000 7f2570dff700 1 -- 172.21.15.86:0/433255448 wait complete. 2023-10-09T11:57:25.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:57:25.196 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:25.195+0000 7fec576f4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:25.282 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:25.282+0000 7eff02adf180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:25.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.317+0000 7f960339d700 1 Processor -- start 2023-10-09T11:57:25.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.317+0000 7f960339d700 1 -- start start 2023-10-09T11:57:25.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.318+0000 7f960339d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f95fc159a60 0x7f95fc0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.318+0000 7f960339d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0c9cb0 con 0x7f95fc0cb230 2023-10-09T11:57:25.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.318+0000 7f960339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0c9f30 con 0x7f95fc0ccc00 2023-10-09T11:57:25.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.318+0000 7f960339d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc06dfc0 con 0x7f95fc159a60 2023-10-09T11:57:25.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f9602b9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f95fc0cb230 0x7f95fc06d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55970/0 (socket says 172.21.15.86:55970) 2023-10-09T11:57:25.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f9602b9c700 1 -- 172.21.15.86:0/1613719386 learned_addr learned my addr 172.21.15.86:0/1613719386 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:25.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f960239b700 1 --2- 172.21.15.86:0/1613719386 >> v2:172.21.15.135:3300/0 conn(0x7f95fc159a60 0x7f95fc0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f9601399700 1 -- 172.21.15.86:0/1613719386 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261409904 0 0) 0x7f95fc0c9cb0 con 0x7f95fc0cb230 2023-10-09T11:57:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f9601399700 1 -- 172.21.15.86:0/1613719386 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e8003570 con 0x7f95fc0cb230 2023-10-09T11:57:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f9601399700 1 -- 172.21.15.86:0/1613719386 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904293076 0 0) 0x7f95fc0c9f30 con 0x7f95fc0ccc00 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f9601399700 1 -- 172.21.15.86:0/1613719386 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95fc0c9cb0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f960239b700 1 -- 172.21.15.86:0/1613719386 >> v1:172.21.15.135:6789/0 conn(0x7f95fc0ccc00 legacy=0x7f95fc069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.319+0000 7f960239b700 1 -- 172.21.15.86:0/1613719386 >> v1:172.21.15.86:6789/0 conn(0x7f95fc0cb230 legacy=0x7f95fc06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.320+0000 7f960239b700 1 -- 172.21.15.86:0/1613719386 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0ca470 con 0x7f95fc159a60 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.320+0000 7f960239b700 1 --2- 172.21.15.86:0/1613719386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 0x7f95fc0c9770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f95f80098e0 tx=0x7f95f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56c46e059952c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.320+0000 7f9601399700 1 -- 172.21.15.86:0/1613719386 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8011630 con 0x7f95fc159a60 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.320+0000 7f9601399700 1 -- 172.21.15.86:0/1613719386 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8011790 con 0x7f95fc159a60 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.320+0000 7f9601399700 1 -- 172.21.15.86:0/1613719386 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8011b30 con 0x7f95fc159a60 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.321+0000 7f960339d700 1 -- 172.21.15.86:0/1613719386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 msgr2=0x7f95fc0c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.321+0000 7f960339d700 1 --2- 172.21.15.86:0/1613719386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 0x7f95fc0c9770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f95f80098e0 tx=0x7f95f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.321+0000 7f960339d700 1 -- 172.21.15.86:0/1613719386 shutdown_connections 2023-10-09T11:57:25.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.321+0000 7f960339d700 1 --2- 172.21.15.86:0/1613719386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 0x7f95fc0c9770 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.321+0000 7f960339d700 1 -- 172.21.15.86:0/1613719386 >> 172.21.15.86:0/1613719386 conn(0x7f95fc06baa0 msgr2=0x7f95fc06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:25.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.321+0000 7f960339d700 1 -- 172.21.15.86:0/1613719386 shutdown_connections 2023-10-09T11:57:25.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.321+0000 7f960339d700 1 -- 172.21.15.86:0/1613719386 wait complete. 2023-10-09T11:57:25.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.322+0000 7f960339d700 1 Processor -- start 2023-10-09T11:57:25.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.322+0000 7f960339d700 1 -- start start 2023-10-09T11:57:25.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.323+0000 7f960339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cb230 0x7f95fc154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.323+0000 7f960339d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95fc0ccc00 0x7f95fc0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.323+0000 7f960339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 0x7f95fc0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.323+0000 7f960339d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0c6c20 con 0x7f95fc0ccc00 2023-10-09T11:57:25.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.323+0000 7f960339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0c6f00 con 0x7f95fc159a60 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.323+0000 7f960339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0c71e0 con 0x7f95fc0cb230 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.323+0000 7f9601b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95fc0ccc00 0x7f95fc0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95fc0ccc00 0x7f95fc0c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37430/0 (socket says 172.21.15.86:37430) 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 -- 172.21.15.86:0/647818375 learned_addr learned my addr 172.21.15.86:0/647818375 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f960239b700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cb230 0x7f95fc154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9602b9c700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 0x7f95fc0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 -- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cb230 msgr2=0x7f95fc154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cb230 0x7f95fc154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 -- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 msgr2=0x7f95fc0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 0x7f95fc0c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 -- 172.21.15.86:0/647818375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f8009420 con 0x7f95fc0ccc00 2023-10-09T11:57:25.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f9601b9a700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95fc0ccc00 0x7f95fc0c7cc0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c790 tx=0x7f95ec007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:25.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f95f27fc700 1 -- 172.21.15.86:0/647818375 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec010510 con 0x7f95fc0ccc00 2023-10-09T11:57:25.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f95f27fc700 1 -- 172.21.15.86:0/647818375 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec010670 con 0x7f95fc0ccc00 2023-10-09T11:57:25.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.324+0000 7f95f27fc700 1 -- 172.21.15.86:0/647818375 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec010a10 con 0x7f95fc0ccc00 2023-10-09T11:57:25.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.325+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc0c74c0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.325+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc1554c0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.326+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc0c79e0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.327+0000 7f95f27fc700 1 -- 172.21.15.86:0/647818375 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f95ec01b3b0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.327+0000 7f95f27fc700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 0x7f95e0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.327+0000 7f960239b700 1 -- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 msgr2=0x7f95e0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:25.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.327+0000 7f95f27fc700 1 -- 172.21.15.86:0/647818375 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f95ec0844a0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.328+0000 7f960239b700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 0x7f95e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:25.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.331+0000 7f95f27fc700 1 -- 172.21.15.86:0/647818375 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95fc0c79e0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.372 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:25.372+0000 7fec576f4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:57:25.464 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:25.464+0000 7fec576f4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:57:25.470 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:25.470+0000 7eff02adf180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:57:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.529+0000 7f960239b700 1 -- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 msgr2=0x7f95e0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.529+0000 7f960239b700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 0x7f95e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:25.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.529+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95fc0c79e0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.530+0000 7f95f27fc700 1 -- 172.21.15.86:0/647818375 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95fc0c79e0 con 0x7f95fc0ccc00 2023-10-09T11:57:25.531 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:57:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 msgr2=0x7f95e0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 0x7f95e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95fc0ccc00 msgr2=0x7f95fc0c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95fc0ccc00 0x7f95fc0c7cc0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c790 tx=0x7f95ec007e10 comp rx=0 tx=0).stop 2023-10-09T11:57:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 shutdown_connections 2023-10-09T11:57:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc159a60 0x7f95fc0c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cb230 0x7f95fc154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.532+0000 7f960339d700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f95e00670e0 0x7f95e0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.533+0000 7f960339d700 1 --2- 172.21.15.86:0/647818375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95fc0ccc00 0x7f95fc0c7cc0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.533+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 >> 172.21.15.86:0/647818375 conn(0x7f95fc06baa0 msgr2=0x7f95fc15a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.533+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 shutdown_connections 2023-10-09T11:57:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.533+0000 7f960339d700 1 -- 172.21.15.86:0/647818375 wait complete. 2023-10-09T11:57:25.551 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:57:25.568 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:25.568+0000 7eff02adf180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:57:25.627 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:25.626+0000 7fec576f4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:57:25.726 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:25.725+0000 7fec576f4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:25.738 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:25.737+0000 7eff02adf180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:57:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.743+0000 7fd03359d700 1 Processor -- start 2023-10-09T11:57:25.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.743+0000 7fd03359d700 1 -- start start 2023-10-09T11:57:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.744+0000 7fd03359d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd02c0b4e70 0x7fd02c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.744+0000 7fd03359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c0b16d0 0x7fd02c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.744+0000 7fd03359d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd02c15d240 0x7fd02c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.744+0000 7fd03359d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02c0b2080 con 0x7fd02c0b4e70 2023-10-09T11:57:25.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.744+0000 7fd03359d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02c0cfb00 con 0x7fd02c15d240 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.744+0000 7fd03359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0b5c40 con 0x7fd02c0b16d0 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd02c0b4e70 0x7fd02c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd02c0b4e70 0x7fd02c0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37446/0 (socket says 172.21.15.86:37446) 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 -- 172.21.15.86:0/742614887 learned_addr learned my addr 172.21.15.86:0/742614887 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd032d9c700 1 --2- 172.21.15.86:0/742614887 >> v2:172.21.15.135:3300/0 conn(0x7fd02c15d240 0x7fd02c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd031d9a700 1 --2- 172.21.15.86:0/742614887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c0b16d0 0x7fd02c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 -- 172.21.15.86:0/742614887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c0b16d0 msgr2=0x7fd02c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 --2- 172.21.15.86:0/742614887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c0b16d0 0x7fd02c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 -- 172.21.15.86:0/742614887 >> v2:172.21.15.135:3300/0 conn(0x7fd02c15d240 msgr2=0x7fd02c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 --2- 172.21.15.86:0/742614887 >> v2:172.21.15.135:3300/0 conn(0x7fd02c15d240 0x7fd02c15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 -- 172.21.15.86:0/742614887 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c0b5f20 con 0x7fd02c0b4e70 2023-10-09T11:57:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd031d9a700 1 --2- 172.21.15.86:0/742614887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c0b16d0 0x7fd02c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.745+0000 7fd03259b700 1 --2- 172.21.15.86:0/742614887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b4e70 0x7fd02c0ccff0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd02c15d180 tx=0x7fd028009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f962f635bcd527 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd031599700 1 -- 172.21.15.86:0/742614887 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd028009e70 con 0x7fd02c0b4e70 2023-10-09T11:57:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd031599700 1 -- 172.21.15.86:0/742614887 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02800b860 con 0x7fd02c0b4e70 2023-10-09T11:57:25.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd031599700 1 -- 172.21.15.86:0/742614887 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02800bc00 con 0x7fd02c0b4e70 2023-10-09T11:57:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd03359d700 1 -- 172.21.15.86:0/742614887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b4e70 msgr2=0x7fd02c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd03359d700 1 --2- 172.21.15.86:0/742614887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b4e70 0x7fd02c0ccff0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd02c15d180 tx=0x7fd028009250 comp rx=0 tx=0).stop 2023-10-09T11:57:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd03359d700 1 -- 172.21.15.86:0/742614887 shutdown_connections 2023-10-09T11:57:25.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd03359d700 1 --2- 172.21.15.86:0/742614887 >> v2:172.21.15.135:3300/0 conn(0x7fd02c15d240 0x7fd02c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd03359d700 1 --2- 172.21.15.86:0/742614887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b4e70 0x7fd02c0ccff0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd03359d700 1 --2- 172.21.15.86:0/742614887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c0b16d0 0x7fd02c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.746+0000 7fd03359d700 1 -- 172.21.15.86:0/742614887 >> 172.21.15.86:0/742614887 conn(0x7fd02c0d10c0 msgr2=0x7fd02c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.747+0000 7fd03359d700 1 -- 172.21.15.86:0/742614887 shutdown_connections 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.747+0000 7fd03359d700 1 -- 172.21.15.86:0/742614887 wait complete. 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.748+0000 7fd03359d700 1 Processor -- start 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.748+0000 7fd03359d700 1 -- start start 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03359d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b16d0 0x7fd02c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03359d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02c0b4e70 0x7fd02c14bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c15d240 0x7fd02c158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03359d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0c9ea0 con 0x7fd02c0b16d0 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03359d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0ca0f0 con 0x7fd02c0b4e70 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0ca3d0 con 0x7fd02c15d240 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03259b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b16d0 0x7fd02c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03259b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b16d0 0x7fd02c0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37456/0 (socket says 172.21.15.86:37456) 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd03259b700 1 -- 172.21.15.86:0/4041921001 learned_addr learned my addr 172.21.15.86:0/4041921001 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd032d9c700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c15d240 0x7fd02c158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.749+0000 7fd031d9a700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02c0b4e70 0x7fd02c14bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd03259b700 1 -- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c15d240 msgr2=0x7fd02c158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd03259b700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c15d240 0x7fd02c158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd03259b700 1 -- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02c0b4e70 msgr2=0x7fd02c14bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd03259b700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02c0b4e70 0x7fd02c14bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd03259b700 1 -- 172.21.15.86:0/4041921001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0280094f0 con 0x7fd02c0b16d0 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd03259b700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b16d0 0x7fd02c0c6d70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd028009290 tx=0x7fd028017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd0227fc700 1 -- 172.21.15.86:0/4041921001 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02800bbe0 con 0x7fd02c0b16d0 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd0227fc700 1 -- 172.21.15.86:0/4041921001 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd028000c90 con 0x7fd02c0b16d0 2023-10-09T11:57:25.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02c0ca6b0 con 0x7fd02c0b16d0 2023-10-09T11:57:25.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.750+0000 7fd0227fc700 1 -- 172.21.15.86:0/4041921001 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02801a680 con 0x7fd02c0b16d0 2023-10-09T11:57:25.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.751+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02c0c7e80 con 0x7fd02c0b16d0 2023-10-09T11:57:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.751+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02c0c8070 con 0x7fd02c0b16d0 2023-10-09T11:57:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.753+0000 7fd0227fc700 1 -- 172.21.15.86:0/4041921001 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd02801aa30 con 0x7fd02c0b16d0 2023-10-09T11:57:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.754+0000 7fd0227fc700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 0x7fd010069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.754+0000 7fd0227fc700 1 -- 172.21.15.86:0/4041921001 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fd028085fd0 con 0x7fd02c0b16d0 2023-10-09T11:57:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.754+0000 7fd031d9a700 1 -- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 msgr2=0x7fd010069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:25.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.754+0000 7fd031d9a700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 0x7fd010069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:25.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.758+0000 7fd0227fc700 1 -- 172.21.15.86:0/4041921001 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd028052d40 con 0x7fd02c0b16d0 2023-10-09T11:57:25.844 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:25.844+0000 7eff02adf180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:25.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.955+0000 7fd031d9a700 1 -- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 msgr2=0x7fd010069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:25.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.955+0000 7fd031d9a700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 0x7fd010069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:25.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.962+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd02c0b13f0 con 0x7fd02c0b16d0 2023-10-09T11:57:25.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.962+0000 7fd0227fc700 1 -- 172.21.15.86:0/4041921001 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd028056360 con 0x7fd02c0b16d0 2023-10-09T11:57:25.962 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:57:25.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 msgr2=0x7fd010069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:25.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 0x7fd010069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b16d0 msgr2=0x7fd02c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:25.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b16d0 0x7fd02c0c6d70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd028009290 tx=0x7fd028017000 comp rx=0 tx=0).stop 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 shutdown_connections 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd0100670e0 0x7fd010069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c0b16d0 0x7fd02c0c6d70 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd02c15d240 0x7fd02c158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 --2- 172.21.15.86:0/4041921001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02c0b4e70 0x7fd02c14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.964+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 >> 172.21.15.86:0/4041921001 conn(0x7fd02c0d10c0 msgr2=0x7fd02c15c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.965+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 shutdown_connections 2023-10-09T11:57:25.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:25.965+0000 7fd03359d700 1 -- 172.21.15.86:0/4041921001 wait complete. 2023-10-09T11:57:25.983 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.211+0000 7f9c1c99d700 1 Processor -- start 2023-10-09T11:57:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.211+0000 7f9c1c99d700 1 -- start start 2023-10-09T11:57:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.212+0000 7f9c1c99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c180b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.212+0000 7f9c1c99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c181597f0 0x7f9c180b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.212+0000 7f9c1c99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c180b11d0 con 0x7f9c1815d230 2023-10-09T11:57:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.212+0000 7f9c1c99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c180b14b0 con 0x7f9c181597f0 2023-10-09T11:57:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.212+0000 7f9c1c99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180b1790 con 0x7f9c18159420 2023-10-09T11:57:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c16ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c181597f0 0x7f9c180b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c177fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c180b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c16ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c181597f0 0x7f9c180b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:41032/0 (socket says 172.21.15.86:41032) 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c16ffd700 1 -- 172.21.15.86:0/1392441180 learned_addr learned my addr 172.21.15.86:0/1392441180 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c167fc700 1 -- 172.21.15.86:0/1392441180 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438489889 0 0) 0x7f9c180b11d0 con 0x7f9c1815d230 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c167fc700 1 -- 172.21.15.86:0/1392441180 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c00003570 con 0x7f9c1815d230 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c177fe700 1 -- 172.21.15.86:0/1392441180 >> v2:172.21.15.135:3300/0 conn(0x7f9c181597f0 msgr2=0x7f9c180b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c177fe700 1 --2- 172.21.15.86:0/1392441180 >> v2:172.21.15.135:3300/0 conn(0x7f9c181597f0 0x7f9c180b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c177fe700 1 -- 172.21.15.86:0/1392441180 >> v1:172.21.15.135:6789/0 conn(0x7f9c1815d230 legacy=0x7f9c180b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c177fe700 1 -- 172.21.15.86:0/1392441180 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180b1a70 con 0x7f9c18159420 2023-10-09T11:57:26.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.213+0000 7f9c16ffd700 1 --2- 172.21.15.86:0/1392441180 >> v2:172.21.15.135:3300/0 conn(0x7f9c181597f0 0x7f9c180b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:26.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c177fe700 1 --2- 172.21.15.86:0/1392441180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c180b5f40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc4bbbb3aef46e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:26.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c167fc700 1 -- 172.21.15.86:0/1392441180 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011630 con 0x7f9c18159420 2023-10-09T11:57:26.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c167fc700 1 -- 172.21.15.86:0/1392441180 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08011790 con 0x7f9c18159420 2023-10-09T11:57:26.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c167fc700 1 -- 172.21.15.86:0/1392441180 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011b10 con 0x7f9c18159420 2023-10-09T11:57:26.217 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:26.213+0000 7fec576f4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:57:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c1c99d700 1 -- 172.21.15.86:0/1392441180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 msgr2=0x7f9c180b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/1392441180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c180b5f40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c1c99d700 1 -- 172.21.15.86:0/1392441180 shutdown_connections 2023-10-09T11:57:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/1392441180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c180b5f40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/1392441180 >> v2:172.21.15.135:3300/0 conn(0x7f9c181597f0 0x7f9c180b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.214+0000 7f9c1c99d700 1 -- 172.21.15.86:0/1392441180 >> 172.21.15.86:0/1392441180 conn(0x7f9c180d0660 msgr2=0x7f9c180d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.215+0000 7f9c1c99d700 1 -- 172.21.15.86:0/1392441180 shutdown_connections 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.215+0000 7f9c1c99d700 1 -- 172.21.15.86:0/1392441180 wait complete. 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.216+0000 7f9c1c99d700 1 Processor -- start 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.216+0000 7f9c1c99d700 1 -- start start 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c1c99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c1815c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c1c99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c181597f0 0x7f9c180c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c1c99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c1815d230 0x7f9c18156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c1c99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180c5940 con 0x7f9c1815d230 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c1c99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180c6740 con 0x7f9c181597f0 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c1c99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180c5b30 con 0x7f9c18159420 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c177fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c1815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c1815d230 0x7f9c18156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c177fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c1815c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:58816/0 (socket says 172.21.15.86:58816) 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c177fe700 1 -- 172.21.15.86:0/3497527321 learned_addr learned my addr 172.21.15.86:0/3497527321 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.217+0000 7f9c16ffd700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c181597f0 0x7f9c180c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c177fe700 1 -- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c181597f0 msgr2=0x7f9c180c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c177fe700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c181597f0 0x7f9c180c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c177fe700 1 -- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c1815d230 msgr2=0x7f9c18156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c177fe700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c1815d230 0x7f9c18156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c177fe700 1 -- 172.21.15.86:0/3497527321 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0094f0 con 0x7f9c18159420 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c17fff700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c1815d230 0x7f9c18156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c16ffd700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c181597f0 0x7f9c180c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9c177fe700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c1815c740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b18d0 tx=0x7f9c08017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9bff7fe700 1 -- 172.21.15.86:0/3497527321 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011900 con 0x7f9c18159420 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9bff7fe700 1 -- 172.21.15.86:0/3497527321 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08011a80 con 0x7f9c18159420 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.218+0000 7f9bff7fe700 1 -- 172.21.15.86:0/3497527321 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0801a680 con 0x7f9c18159420 2023-10-09T11:57:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.219+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08009420 con 0x7f9c18159420 2023-10-09T11:57:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.219+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c180c60f0 con 0x7f9c18159420 2023-10-09T11:57:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.220+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1804c3c0 con 0x7f9c18159420 2023-10-09T11:57:26.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.220+0000 7f9bff7fe700 1 -- 172.21.15.86:0/3497527321 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9c0801aab0 con 0x7f9c18159420 2023-10-09T11:57:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.221+0000 7f9bff7fe700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 0x7f9c04069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.221+0000 7f9bff7fe700 1 -- 172.21.15.86:0/3497527321 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f9c08086710 con 0x7f9c18159420 2023-10-09T11:57:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.221+0000 7f9c16ffd700 1 -- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 msgr2=0x7f9c04069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.221+0000 7f9c16ffd700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 0x7f9c04069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.226+0000 7f9bff7fe700 1 -- 172.21.15.86:0/3497527321 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c080533e0 con 0x7f9c18159420 2023-10-09T11:57:26.309 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:26.308+0000 7fec576f4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:57:26.355 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:26.354+0000 7eff02adf180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:57:26.397 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:26.397+0000 7fec576f4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:57:26.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.422+0000 7f9c16ffd700 1 -- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 msgr2=0x7f9c04069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:26.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.422+0000 7f9c16ffd700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 0x7f9c04069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:26.452 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:26.452+0000 7eff02adf180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:57:26.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.471+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c180687f0 con 0x7f9c18159420 2023-10-09T11:57:26.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.471+0000 7f9bff7fe700 1 -- 172.21.15.86:0/3497527321 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9c08056a00 con 0x7f9c18159420 2023-10-09T11:57:26.472 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:26.472 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/153919105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":153919105},{"type":"v1","addr":"172.21.15.135:6834","nonce":153919105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4109315239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4109315239},{"type":"v1","addr":"172.21.15.135:6835","nonce":4109315239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6702,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/567273052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":567273052},{"type":"v1","addr":"172.21.15.86:6834","nonce":567273052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:01.334172+0000","modified":"2023-10-09T11:57:04.892057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1853170285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":1853170285},{"type":"v1","addr":"172.21.15.86:6835","nonce":1853170285}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:57:26.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 msgr2=0x7f9c04069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:26.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 0x7f9c04069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 msgr2=0x7f9c1815c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c1815c740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b18d0 tx=0x7f9c08017000 comp rx=0 tx=0).stop 2023-10-09T11:57:26.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 shutdown_connections 2023-10-09T11:57:26.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9c040670e0 0x7f9c04069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c1815d230 0x7f9c18156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c18159420 0x7f9c1815c740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 --2- 172.21.15.86:0/3497527321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c181597f0 0x7f9c180c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 >> 172.21.15.86:0/3497527321 conn(0x7f9c180d0660 msgr2=0x7f9c180cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:26.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 shutdown_connections 2023-10-09T11:57:26.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.474+0000 7f9c1c99d700 1 -- 172.21.15.86:0/3497527321 wait complete. 2023-10-09T11:57:26.477 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2023-10-09T11:57:26.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:26.550 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:26.550+0000 7eff02adf180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:57:26.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.678+0000 7fdc9139d700 1 Processor -- start 2023-10-09T11:57:26.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.678+0000 7fdc9139d700 1 -- start start 2023-10-09T11:57:26.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc9139d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdc8c159420 0x7fdc8c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc9139d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c1597f0 0x7fdc8c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc9139d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c0b11d0 con 0x7fdc8c15d230 2023-10-09T11:57:26.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc9139d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c0b14b0 con 0x7fdc8c159420 2023-10-09T11:57:26.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc9139d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c0b1790 con 0x7fdc8c1597f0 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc90b9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdc8c15d230 0x7fdc8c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55982/0 (socket says 172.21.15.86:55982) 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc90b9c700 1 -- 172.21.15.86:0/4174008685 learned_addr learned my addr 172.21.15.86:0/4174008685 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc8bfff700 1 --2- 172.21.15.86:0/4174008685 >> v2:172.21.15.135:3300/0 conn(0x7fdc8c159420 0x7fdc8c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc8b7fe700 1 --2- 172.21.15.86:0/4174008685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c1597f0 0x7fdc8c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc8affd700 1 -- 172.21.15.86:0/4174008685 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035370590 0 0) 0x7fdc8c0b11d0 con 0x7fdc8c15d230 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.680+0000 7fdc8affd700 1 -- 172.21.15.86:0/4174008685 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc74003570 con 0x7fdc8c15d230 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8b7fe700 1 -- 172.21.15.86:0/4174008685 >> v2:172.21.15.135:3300/0 conn(0x7fdc8c159420 msgr2=0x7fdc8c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8affd700 1 -- 172.21.15.86:0/4174008685 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3395250144 0 0) 0x7fdc74003570 con 0x7fdc8c15d230 2023-10-09T11:57:26.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8b7fe700 1 --2- 172.21.15.86:0/4174008685 >> v2:172.21.15.135:3300/0 conn(0x7fdc8c159420 0x7fdc8c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8b7fe700 1 -- 172.21.15.86:0/4174008685 >> v1:172.21.15.86:6789/0 conn(0x7fdc8c15d230 legacy=0x7fdc8c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8b7fe700 1 -- 172.21.15.86:0/4174008685 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0b1a70 con 0x7fdc8c1597f0 2023-10-09T11:57:26.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8bfff700 1 --2- 172.21.15.86:0/4174008685 >> v2:172.21.15.135:3300/0 conn(0x7fdc8c159420 0x7fdc8c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:26.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8b7fe700 1 --2- 172.21.15.86:0/4174008685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c1597f0 0x7fdc8c0b2270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc800098e0 tx=0x7fdc800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2900c16cbd331c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:26.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8affd700 1 -- 172.21.15.86:0/4174008685 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc840017f0 con 0x7fdc8c1597f0 2023-10-09T11:57:26.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8affd700 1 -- 172.21.15.86:0/4174008685 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc80011420 con 0x7fdc8c1597f0 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.681+0000 7fdc8affd700 1 -- 172.21.15.86:0/4174008685 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800117c0 con 0x7fdc8c1597f0 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 -- 172.21.15.86:0/4174008685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c1597f0 msgr2=0x7fdc8c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 --2- 172.21.15.86:0/4174008685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c1597f0 0x7fdc8c0b2270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc800098e0 tx=0x7fdc800091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 -- 172.21.15.86:0/4174008685 shutdown_connections 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 --2- 172.21.15.86:0/4174008685 >> v2:172.21.15.135:3300/0 conn(0x7fdc8c159420 0x7fdc8c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 --2- 172.21.15.86:0/4174008685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c1597f0 0x7fdc8c0b2270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 -- 172.21.15.86:0/4174008685 >> 172.21.15.86:0/4174008685 conn(0x7fdc8c0d0660 msgr2=0x7fdc8c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 -- 172.21.15.86:0/4174008685 shutdown_connections 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.682+0000 7fdc9139d700 1 -- 172.21.15.86:0/4174008685 wait complete. 2023-10-09T11:57:26.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.683+0000 7fdc9139d700 1 Processor -- start 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.684+0000 7fdc9139d700 1 -- start start 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc9139d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c159420 0x7fdc8c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc9139d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc8c1597f0 0x7fdc8c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc9139d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc8c15d230 0x7fdc8c0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc9139d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c0b5820 con 0x7fdc8c15d230 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc9139d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c0c5940 con 0x7fdc8c1597f0 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc9139d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c159d90 con 0x7fdc8c159420 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc8c15d230 0x7fdc8c0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc8bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c159420 0x7fdc8c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc8c15d230 0x7fdc8c0b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37466/0 (socket says 172.21.15.86:37466) 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 -- 172.21.15.86:0/540888140 learned_addr learned my addr 172.21.15.86:0/540888140 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc8b7fe700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc8c1597f0 0x7fdc8c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 -- 172.21.15.86:0/540888140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c159420 msgr2=0x7fdc8c0c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c159420 0x7fdc8c0c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 -- 172.21.15.86:0/540888140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc8c1597f0 msgr2=0x7fdc8c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc8c1597f0 0x7fdc8c0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.685+0000 7fdc90b9c700 1 -- 172.21.15.86:0/540888140 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c009420 con 0x7fdc8c15d230 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.686+0000 7fdc90b9c700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc8c15d230 0x7fdc8c0b4390 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400cbe0 tx=0x7fdc84001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:26.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.686+0000 7fdc73fff700 1 -- 172.21.15.86:0/540888140 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84004dc0 con 0x7fdc8c15d230 2023-10-09T11:57:26.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.686+0000 7fdc73fff700 1 -- 172.21.15.86:0/540888140 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400a590 con 0x7fdc8c15d230 2023-10-09T11:57:26.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.686+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc80009420 con 0x7fdc8c15d230 2023-10-09T11:57:26.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.686+0000 7fdc73fff700 1 -- 172.21.15.86:0/540888140 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400a950 con 0x7fdc8c15d230 2023-10-09T11:57:26.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.686+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c15a7a0 con 0x7fdc8c15d230 2023-10-09T11:57:26.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.687+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c04c3c0 con 0x7fdc8c15d230 2023-10-09T11:57:26.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.688+0000 7fdc73fff700 1 -- 172.21.15.86:0/540888140 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fdc8400acc0 con 0x7fdc8c15d230 2023-10-09T11:57:26.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.689+0000 7fdc73fff700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 0x7fdc78069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:26.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.689+0000 7fdc73fff700 1 -- 172.21.15.86:0/540888140 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fdc840843a0 con 0x7fdc8c15d230 2023-10-09T11:57:26.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.689+0000 7fdc8bfff700 1 -- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 msgr2=0x7fdc78069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:26.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.689+0000 7fdc8bfff700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 0x7fdc78069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:26.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.693+0000 7fdc73fff700 1 -- 172.21.15.86:0/540888140 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc84051190 con 0x7fdc8c15d230 2023-10-09T11:57:26.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.890+0000 7fdc8bfff700 1 -- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 msgr2=0x7fdc78069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:26.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.890+0000 7fdc8bfff700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 0x7fdc78069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:26.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.893+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc8c0b1d50 con 0x7fdc8c15d230 2023-10-09T11:57:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.894+0000 7fdc73fff700 1 -- 172.21.15.86:0/540888140 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16337 (secure 0 0 0) 0x7fdc840547b0 con 0x7fdc8c15d230 2023-10-09T11:57:26.894 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:26.895 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":95,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:21.423345+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:59.439269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:00.315207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:57:21.423306+0000","172.21.15.86:6836/85490":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/1417041114":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/259108472":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/2573157997":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/3728854362":"2023-10-10T11:57:21.423306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 msgr2=0x7fdc78069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 0x7fdc78069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc8c15d230 msgr2=0x7fdc8c0b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc8c15d230 0x7fdc8c0b4390 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400cbe0 tx=0x7fdc84001640 comp rx=0 tx=0).stop 2023-10-09T11:57:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 shutdown_connections 2023-10-09T11:57:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc780670e0 0x7fdc78069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc8c15d230 0x7fdc8c0b4390 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc8c159420 0x7fdc8c0c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 --2- 172.21.15.86:0/540888140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc8c1597f0 0x7fdc8c0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 >> 172.21.15.86:0/540888140 conn(0x7fdc8c0d0660 msgr2=0x7fdc8c068d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.896+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 shutdown_connections 2023-10-09T11:57:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:26.897+0000 7fdc9139d700 1 -- 172.21.15.86:0/540888140 wait complete. 2023-10-09T11:57:26.915 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:57:26.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:27.021 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:27.021+0000 7fec576f4180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:57:27.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.124+0000 7fd41b59e700 1 Processor -- start 2023-10-09T11:57:27.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.124+0000 7fd41b59e700 1 -- start start 2023-10-09T11:57:27.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.126+0000 7fd41b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15de70 0x7fd41c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.126+0000 7fd41b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd41c0696c0 0x7fd41c06ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.126+0000 7fd41b59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c06e8c0 con 0x7fd41c15daa0 2023-10-09T11:57:27.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.126+0000 7fd41b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c0ca740 con 0x7fd41c0696c0 2023-10-09T11:57:27.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.126+0000 7fd41b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c06e5e0 con 0x7fd41c15de70 2023-10-09T11:57:27.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.126+0000 7fd419d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15de70 0x7fd41c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.126+0000 7fd41a59c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd41c15daa0 0x7fd41c0c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:46868/0 (socket says 172.21.15.86:46868) 2023-10-09T11:57:27.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd41a59c700 1 -- 172.21.15.86:0/883234095 learned_addr learned my addr 172.21.15.86:0/883234095 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:27.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd41ad9d700 1 --2- 172.21.15.86:0/883234095 >> v2:172.21.15.135:3300/0 conn(0x7fd41c0696c0 0x7fd41c06ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd41959a700 1 -- 172.21.15.86:0/883234095 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791632224 0 0) 0x7fd41c06e8c0 con 0x7fd41c15daa0 2023-10-09T11:57:27.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd419d9b700 1 -- 172.21.15.86:0/883234095 >> v2:172.21.15.135:3300/0 conn(0x7fd41c0696c0 msgr2=0x7fd41c06ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:27.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd419d9b700 1 --2- 172.21.15.86:0/883234095 >> v2:172.21.15.135:3300/0 conn(0x7fd41c0696c0 0x7fd41c06ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd419d9b700 1 -- 172.21.15.86:0/883234095 >> v1:172.21.15.135:6789/0 conn(0x7fd41c15daa0 legacy=0x7fd41c0c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd419d9b700 1 -- 172.21.15.86:0/883234095 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0ca0f0 con 0x7fd41c15de70 2023-10-09T11:57:27.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.127+0000 7fd419d9b700 1 --2- 172.21.15.86:0/883234095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15de70 0x7fd41c06e000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd404009e60 tx=0x7fd404009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e7813ed6116204 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.128+0000 7fd41959a700 1 -- 172.21.15.86:0/883234095 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400e070 con 0x7fd41c15de70 2023-10-09T11:57:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.128+0000 7fd41959a700 1 -- 172.21.15.86:0/883234095 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400bb60 con 0x7fd41c15de70 2023-10-09T11:57:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.128+0000 7fd41959a700 1 -- 172.21.15.86:0/883234095 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404012430 con 0x7fd41c15de70 2023-10-09T11:57:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 -- 172.21.15.86:0/883234095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15de70 msgr2=0x7fd41c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 --2- 172.21.15.86:0/883234095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15de70 0x7fd41c06e000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd404009e60 tx=0x7fd404009780 comp rx=0 tx=0).stop 2023-10-09T11:57:27.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 -- 172.21.15.86:0/883234095 shutdown_connections 2023-10-09T11:57:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 --2- 172.21.15.86:0/883234095 >> v2:172.21.15.135:3300/0 conn(0x7fd41c0696c0 0x7fd41c06ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 --2- 172.21.15.86:0/883234095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15de70 0x7fd41c06e000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 -- 172.21.15.86:0/883234095 >> 172.21.15.86:0/883234095 conn(0x7fd41c0cc1f0 msgr2=0x7fd41c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 -- 172.21.15.86:0/883234095 shutdown_connections 2023-10-09T11:57:27.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.129+0000 7fd41b59e700 1 -- 172.21.15.86:0/883234095 wait complete. 2023-10-09T11:57:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.132+0000 7fd41b59e700 1 Processor -- start 2023-10-09T11:57:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.133+0000 7fd41b59e700 1 -- start start 2023-10-09T11:57:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41c0696c0 0x7fd41c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15daa0 0x7fd41c0a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd41c15de70 0x7fd41c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0acc30 con 0x7fd41c0696c0 2023-10-09T11:57:27.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0ac020 con 0x7fd41c15de70 2023-10-09T11:57:27.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41c0696c0 0x7fd41c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd41c15de70 0x7fd41c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd41c15de70 0x7fd41c0c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:41092/0 (socket says 172.21.15.86:41092) 2023-10-09T11:57:27.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.135+0000 7fd41ad9d700 1 -- 172.21.15.86:0/2513647362 learned_addr learned my addr 172.21.15.86:0/2513647362 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:27.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.136+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0ac300 con 0x7fd41c15daa0 2023-10-09T11:57:27.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.136+0000 7fd419d9b700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15daa0 0x7fd41c0a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.136+0000 7fd41ad9d700 1 -- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15daa0 msgr2=0x7fd41c0a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.137+0000 7fd41ad9d700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15daa0 0x7fd41c0a76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.137+0000 7fd41ad9d700 1 -- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41c0696c0 msgr2=0x7fd41c0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.137+0000 7fd41ad9d700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41c0696c0 0x7fd41c0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.137+0000 7fd41ad9d700 1 -- 172.21.15.86:0/2513647362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404009a20 con 0x7fd41c15de70 2023-10-09T11:57:27.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.137+0000 7fd41a59c700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41c0696c0 0x7fd41c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:27.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.137+0000 7fd419d9b700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15daa0 0x7fd41c0a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:27.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.137+0000 7fd41ad9d700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd41c15de70 0x7fd41c0c4d60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00e8d0 tx=0x7fd40c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:27.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.138+0000 7fd4127fc700 1 -- 172.21.15.86:0/2513647362 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c013680 con 0x7fd41c15de70 2023-10-09T11:57:27.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.138+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c0ac5e0 con 0x7fd41c15de70 2023-10-09T11:57:27.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.138+0000 7fd4127fc700 1 -- 172.21.15.86:0/2513647362 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c013800 con 0x7fd41c15de70 2023-10-09T11:57:27.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.138+0000 7fd4127fc700 1 -- 172.21.15.86:0/2513647362 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c013bc0 con 0x7fd41c15de70 2023-10-09T11:57:27.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.138+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c1481a0 con 0x7fd41c15de70 2023-10-09T11:57:27.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.140+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c0acda0 con 0x7fd41c15de70 2023-10-09T11:57:27.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.140+0000 7fd4127fc700 1 -- 172.21.15.86:0/2513647362 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd40c0123d0 con 0x7fd41c15de70 2023-10-09T11:57:27.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.141+0000 7fd4127fc700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 0x7fd3fc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.141+0000 7fd4127fc700 1 -- 172.21.15.86:0/2513647362 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fd40c084ff0 con 0x7fd41c15de70 2023-10-09T11:57:27.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.141+0000 7fd41a59c700 1 -- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 msgr2=0x7fd3fc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:27.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.141+0000 7fd41a59c700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 0x7fd3fc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:27.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.146+0000 7fd4127fc700 1 -- 172.21.15.86:0/2513647362 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd40c051cc0 con 0x7fd41c15de70 2023-10-09T11:57:27.196 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:27.195+0000 7fec576f4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:27.199 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:27.199+0000 7eff02adf180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:57:27.291 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:27.291+0000 7fec576f4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:57:27.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.342+0000 7fd41a59c700 1 -- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 msgr2=0x7fd3fc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:27.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.342+0000 7fd41a59c700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 0x7fd3fc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:27.378 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:27.378+0000 7eff02adf180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.392+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd41c04c3c0 con 0x7fd41c15de70 2023-10-09T11:57:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.393+0000 7fd4127fc700 1 -- 172.21.15.86:0/2513647362 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fd40c017090 con 0x7fd41c15de70 2023-10-09T11:57:27.393 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:27.393 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/153919105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":153919105},{"type":"v1","addr":"172.21.15.135:6834","nonce":153919105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4109315239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4109315239},{"type":"v1","addr":"172.21.15.135:6835","nonce":4109315239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6702,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/567273052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":567273052},{"type":"v1","addr":"172.21.15.86:6834","nonce":567273052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:01.334172+0000","modified":"2023-10-09T11:57:04.892057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1853170285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":1853170285},{"type":"v1","addr":"172.21.15.86:6835","nonce":1853170285}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:57:27.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.395+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 msgr2=0x7fd3fc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:27.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.395+0000 7fd41b59e700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 0x7fd3fc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.395+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd41c15de70 msgr2=0x7fd41c0c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.395+0000 7fd41b59e700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd41c15de70 0x7fd41c0c4d60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00e8d0 tx=0x7fd40c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 shutdown_connections 2023-10-09T11:57:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd3fc0670e0 0x7fd3fc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41c0696c0 0x7fd41c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd41c15de70 0x7fd41c0c4d60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 --2- 172.21.15.86:0/2513647362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd41c15daa0 0x7fd41c0a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 >> 172.21.15.86:0/2513647362 conn(0x7fd41c0cc1f0 msgr2=0x7fd41c0b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 shutdown_connections 2023-10-09T11:57:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.396+0000 7fd41b59e700 1 -- 172.21.15.86:0/2513647362 wait complete. 2023-10-09T11:57:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2023-10-09T11:57:27.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:27.493 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:27.493+0000 7eff02adf180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:57:27.587 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:27.587+0000 7fec576f4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:57:27.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.614+0000 7f433bbff700 1 Processor -- start 2023-10-09T11:57:27.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.614+0000 7f433bbff700 1 -- start start 2023-10-09T11:57:27.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433bbff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f433406bcd0 0x7f43340caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433bbff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f433406c0a0 0x7f433415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433bbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433415d7e0 con 0x7f433415df50 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433bbff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433415dac0 con 0x7f433406bcd0 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433bbff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433415aa30 con 0x7f433406c0a0 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433999b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f433406bcd0 0x7f43340caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433999b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f433406bcd0 0x7f43340caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37474/0 (socket says 172.21.15.86:37474) 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433999b700 1 -- 172.21.15.86:0/1817712113 learned_addr learned my addr 172.21.15.86:0/1817712113 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.615+0000 7f433919a700 1 --2- 172.21.15.86:0/1817712113 >> v2:172.21.15.135:3300/0 conn(0x7f433406c0a0 0x7f433415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f433919a700 1 -- 172.21.15.86:0/1817712113 >> v2:172.21.15.86:3300/0 conn(0x7f433406bcd0 msgr2=0x7f43340caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f433919a700 1 --2- 172.21.15.86:0/1817712113 >> v2:172.21.15.86:3300/0 conn(0x7f433406bcd0 0x7f43340caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f433919a700 1 -- 172.21.15.86:0/1817712113 >> v1:172.21.15.135:6789/0 conn(0x7f433415df50 legacy=0x7f43340c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f433919a700 1 -- 172.21.15.86:0/1817712113 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433415ad10 con 0x7f433406c0a0 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f433999b700 1 --2- 172.21.15.86:0/1817712113 >> v2:172.21.15.86:3300/0 conn(0x7f433406bcd0 0x7f43340caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f4338999700 1 -- 172.21.15.86:0/1817712113 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588723687 0 0) 0x7f433415d7e0 con 0x7f433415df50 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f433919a700 1 --2- 172.21.15.86:0/1817712113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406c0a0 0x7f433415a1e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f433406b4e0 tx=0x7f43240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd0dca4b3483eb70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f4338999700 1 -- 172.21.15.86:0/1817712113 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324011630 con 0x7f433406c0a0 2023-10-09T11:57:27.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f4338999700 1 -- 172.21.15.86:0/1817712113 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324011790 con 0x7f433406c0a0 2023-10-09T11:57:27.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.616+0000 7f4338999700 1 -- 172.21.15.86:0/1817712113 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324011b30 con 0x7f433406c0a0 2023-10-09T11:57:27.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 -- 172.21.15.86:0/1817712113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406c0a0 msgr2=0x7f433415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 --2- 172.21.15.86:0/1817712113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406c0a0 0x7f433415a1e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f433406b4e0 tx=0x7f43240091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 -- 172.21.15.86:0/1817712113 shutdown_connections 2023-10-09T11:57:27.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 --2- 172.21.15.86:0/1817712113 >> v2:172.21.15.86:3300/0 conn(0x7f433406bcd0 0x7f43340caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 --2- 172.21.15.86:0/1817712113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406c0a0 0x7f433415a1e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 -- 172.21.15.86:0/1817712113 >> 172.21.15.86:0/1817712113 conn(0x7f43340ce600 msgr2=0x7f43340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 -- 172.21.15.86:0/1817712113 shutdown_connections 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.617+0000 7f433bbff700 1 -- 172.21.15.86:0/1817712113 wait complete. 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.619+0000 7f433bbff700 1 Processor -- start 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.619+0000 7f433bbff700 1 -- start start 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433bbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406bcd0 0x7f4334169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433bbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433406c0a0 0x7f433414ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433bbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433415df50 0x7f43341537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433bbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433416a420 con 0x7f433415df50 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433bbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340b13a0 con 0x7f433406bcd0 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433bbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433416d290 con 0x7f433406c0a0 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406bcd0 0x7f4334169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433a19c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433415df50 0x7f43341537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433919a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433406c0a0 0x7f433414ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406bcd0 0x7f4334169ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:41108/0 (socket says 172.21.15.86:41108) 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.620+0000 7f433999b700 1 -- 172.21.15.86:0/3295020920 learned_addr learned my addr 172.21.15.86:0/3295020920 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433919a700 1 -- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406bcd0 msgr2=0x7f4334169ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433919a700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406bcd0 0x7f4334169ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433919a700 1 -- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433415df50 msgr2=0x7f43341537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433919a700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433415df50 0x7f43341537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433919a700 1 -- 172.21.15.86:0/3295020920 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330009ae0 con 0x7f433406c0a0 2023-10-09T11:57:27.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433999b700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406bcd0 0x7f4334169ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:27.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433919a700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433406c0a0 0x7f433414ba30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f433415d720 tx=0x7f4324017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:27.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f4329ffb700 1 -- 172.21.15.86:0/3295020920 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324006af0 con 0x7f433406c0a0 2023-10-09T11:57:27.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f4329ffb700 1 -- 172.21.15.86:0/3295020920 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324011900 con 0x7f433406c0a0 2023-10-09T11:57:27.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f4329ffb700 1 -- 172.21.15.86:0/3295020920 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240253f0 con 0x7f433406c0a0 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.621+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4324009420 con 0x7f433406c0a0 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.622+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43340b18d0 con 0x7f433406c0a0 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.623+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4334154230 con 0x7f433406c0a0 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.624+0000 7f4329ffb700 1 -- 172.21.15.86:0/3295020920 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4324025820 con 0x7f433406c0a0 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.624+0000 7f4329ffb700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 0x7f4318069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.624+0000 7f4329ffb700 1 -- 172.21.15.86:0/3295020920 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f43240860e0 con 0x7f433406c0a0 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.625+0000 7f433999b700 1 -- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 msgr2=0x7f4318069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:27.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.625+0000 7f433999b700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 0x7f4318069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:27.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.629+0000 7f4329ffb700 1 -- 172.21.15.86:0/3295020920 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4324052db0 con 0x7f433406c0a0 2023-10-09T11:57:27.684 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:27.683+0000 7fec576f4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:57:27.798 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:27.797+0000 7eff02adf180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:57:27.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.826+0000 7f433999b700 1 -- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 msgr2=0x7f4318069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:27.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.826+0000 7f433999b700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 0x7f4318069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:27.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.870+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f433404c3c0 con 0x7f433406c0a0 2023-10-09T11:57:27.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.871+0000 7f4329ffb700 1 -- 172.21.15.86:0/3295020920 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f4324015090 con 0x7f433406c0a0 2023-10-09T11:57:27.871 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:27.872 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/153919105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":153919105},{"type":"v1","addr":"172.21.15.135:6834","nonce":153919105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4109315239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4109315239},{"type":"v1","addr":"172.21.15.135:6835","nonce":4109315239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6702,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/567273052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":567273052},{"type":"v1","addr":"172.21.15.86:6834","nonce":567273052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:01.334172+0000","modified":"2023-10-09T11:57:04.892057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6708":{"gid":6708,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1853170285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":1853170285},{"type":"v1","addr":"172.21.15.86:6835","nonce":1853170285}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:57:27.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.873+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 msgr2=0x7f4318069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:27.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.873+0000 7f433bbff700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 0x7f4318069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.873+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433406c0a0 msgr2=0x7f433414ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:27.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.873+0000 7f433bbff700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433406c0a0 0x7f433414ba30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f433415d720 tx=0x7f4324017000 comp rx=0 tx=0).stop 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 shutdown_connections 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43180670e0 0x7f4318069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433415df50 0x7f43341537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433406bcd0 0x7f4334169ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 --2- 172.21.15.86:0/3295020920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433406c0a0 0x7f433414ba30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 >> 172.21.15.86:0/3295020920 conn(0x7f43340ce600 msgr2=0x7f4334156620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 shutdown_connections 2023-10-09T11:57:27.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:27.874+0000 7f433bbff700 1 -- 172.21.15.86:0/3295020920 wait complete. 2023-10-09T11:57:27.876 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 39 2023-10-09T11:57:27.892 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:27.902 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:27.902+0000 7eff02adf180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:57:28.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.081+0000 7f1b951ff700 1 Processor -- start 2023-10-09T11:57:28.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.082+0000 7f1b951ff700 1 -- start start 2023-10-09T11:57:28.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b951ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1b901599e0 0x7f1b90069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b951ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b90159db0 0x7f1b90069080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b951ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b900c96a0 con 0x7f1b9006a2b0 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b951ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b900cb9e0 con 0x7f1b90159db0 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b951ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b900cab60 con 0x7f1b901599e0 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b8e59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b90159db0 0x7f1b90069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b8e59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b90159db0 0x7f1b90069080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37490/0 (socket says 172.21.15.86:37490) 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b8e59c700 1 -- 172.21.15.86:0/1420481745 learned_addr learned my addr 172.21.15.86:0/1420481745 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.083+0000 7f1b8ed9d700 1 --2- 172.21.15.86:0/1420481745 >> v2:172.21.15.135:3300/0 conn(0x7f1b901599e0 0x7f1b90069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8e59c700 1 -- 172.21.15.86:0/1420481745 >> v2:172.21.15.135:3300/0 conn(0x7f1b901599e0 msgr2=0x7f1b90069ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:28.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8e59c700 1 --2- 172.21.15.86:0/1420481745 >> v2:172.21.15.135:3300/0 conn(0x7f1b901599e0 0x7f1b90069ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8e59c700 1 -- 172.21.15.86:0/1420481745 >> v1:172.21.15.135:6789/0 conn(0x7f1b9006a2b0 legacy=0x7f1b9006a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8e59c700 1 -- 172.21.15.86:0/1420481745 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900cb420 con 0x7f1b90159db0 2023-10-09T11:57:28.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8dd9b700 1 -- 172.21.15.86:0/1420481745 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147331143 0 0) 0x7f1b900c96a0 con 0x7f1b9006a2b0 2023-10-09T11:57:28.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8e59c700 1 --2- 172.21.15.86:0/1420481745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b90159db0 0x7f1b90069080 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1b900712e0 tx=0x7f1b84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a47e16f815002f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:28.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8dd9b700 1 -- 172.21.15.86:0/1420481745 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84009e70 con 0x7f1b90159db0 2023-10-09T11:57:28.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8dd9b700 1 -- 172.21.15.86:0/1420481745 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8400b860 con 0x7f1b90159db0 2023-10-09T11:57:28.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.084+0000 7f1b8dd9b700 1 -- 172.21.15.86:0/1420481745 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400bc00 con 0x7f1b90159db0 2023-10-09T11:57:28.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 -- 172.21.15.86:0/1420481745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b90159db0 msgr2=0x7f1b90069080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 --2- 172.21.15.86:0/1420481745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b90159db0 0x7f1b90069080 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1b900712e0 tx=0x7f1b84009250 comp rx=0 tx=0).stop 2023-10-09T11:57:28.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 -- 172.21.15.86:0/1420481745 shutdown_connections 2023-10-09T11:57:28.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 --2- 172.21.15.86:0/1420481745 >> v2:172.21.15.135:3300/0 conn(0x7f1b901599e0 0x7f1b90069ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 --2- 172.21.15.86:0/1420481745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b90159db0 0x7f1b90069080 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 -- 172.21.15.86:0/1420481745 >> 172.21.15.86:0/1420481745 conn(0x7f1b900c9860 msgr2=0x7f1b900c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:28.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 -- 172.21.15.86:0/1420481745 shutdown_connections 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.085+0000 7f1b951ff700 1 -- 172.21.15.86:0/1420481745 wait complete. 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.086+0000 7f1b951ff700 1 Processor -- start 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.086+0000 7f1b951ff700 1 -- start start 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.087+0000 7f1b951ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b9006a2b0 0x7f1b9014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.087+0000 7f1b951ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b901599e0 0x7f1b90157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.087+0000 7f1b951ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b90159db0 0x7f1b90158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.087+0000 7f1b951ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900afe60 con 0x7f1b9006a2b0 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.087+0000 7f1b951ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9014f2a0 con 0x7f1b901599e0 2023-10-09T11:57:28.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.087+0000 7f1b951ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9015b170 con 0x7f1b90159db0 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b9006a2b0 0x7f1b9014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b9006a2b0 0x7f1b9014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37494/0 (socket says 172.21.15.86:37494) 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 -- 172.21.15.86:0/2821043566 learned_addr learned my addr 172.21.15.86:0/2821043566 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8e59c700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b901599e0 0x7f1b90157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8f59e700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b90159db0 0x7f1b90158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 -- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b90159db0 msgr2=0x7f1b90158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b90159db0 0x7f1b90158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 -- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b901599e0 msgr2=0x7f1b90157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b901599e0 0x7f1b90157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 -- 172.21.15.86:0/2821043566 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b840094f0 con 0x7f1b9006a2b0 2023-10-09T11:57:28.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.088+0000 7f1b8ed9d700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b9006a2b0 0x7f1b9014ed60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000ec80 tx=0x7f1b800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:28.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.089+0000 7f1b76ffd700 1 -- 172.21.15.86:0/2821043566 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000c850 con 0x7f1b9006a2b0 2023-10-09T11:57:28.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.089+0000 7f1b76ffd700 1 -- 172.21.15.86:0/2821043566 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8000c9b0 con 0x7f1b9006a2b0 2023-10-09T11:57:28.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.089+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9015b450 con 0x7f1b9006a2b0 2023-10-09T11:57:28.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.089+0000 7f1b76ffd700 1 -- 172.21.15.86:0/2821043566 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000cd50 con 0x7f1b9006a2b0 2023-10-09T11:57:28.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.089+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9015b7e0 con 0x7f1b9006a2b0 2023-10-09T11:57:28.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.090+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9015b5e0 con 0x7f1b9006a2b0 2023-10-09T11:57:28.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.091+0000 7f1b76ffd700 1 -- 172.21.15.86:0/2821043566 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1b80013680 con 0x7f1b9006a2b0 2023-10-09T11:57:28.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.092+0000 7f1b76ffd700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 0x7f1b7c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.092+0000 7f1b76ffd700 1 -- 172.21.15.86:0/2821043566 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f1b80084d60 con 0x7f1b9006a2b0 2023-10-09T11:57:28.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.092+0000 7f1b8e59c700 1 -- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 msgr2=0x7f1b7c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:28.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.092+0000 7f1b8e59c700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 0x7f1b7c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:28.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.096+0000 7f1b76ffd700 1 -- 172.21.15.86:0/2821043566 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b80051a30 con 0x7f1b9006a2b0 2023-10-09T11:57:28.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.293+0000 7f1b8e59c700 1 -- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 msgr2=0x7f1b7c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:28.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.293+0000 7f1b8e59c700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 0x7f1b7c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:28.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.294+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b9004c3c0 con 0x7f1b9006a2b0 2023-10-09T11:57:28.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.295+0000 7f1b76ffd700 1 -- 172.21.15.86:0/2821043566 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16337 (secure 0 0 0) 0x7f1b80055050 con 0x7f1b9006a2b0 2023-10-09T11:57:28.296 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:28.296 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":95,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:21.423345+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:56:59.439269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:00.315207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:57:21.423306+0000","172.21.15.86:6836/85490":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/1417041114":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/259108472":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/2573157997":"2023-10-10T11:57:21.423306+0000","172.21.15.86:0/3728854362":"2023-10-10T11:57:21.423306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:28.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.297+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 msgr2=0x7f1b7c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:28.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.297+0000 7f1b951ff700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 0x7f1b7c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.297+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b9006a2b0 msgr2=0x7f1b9014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.297+0000 7f1b951ff700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b9006a2b0 0x7f1b9014ed60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000ec80 tx=0x7f1b800091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 shutdown_connections 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1b7c0670e0 0x7f1b7c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b9006a2b0 0x7f1b9014ed60 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b90159db0 0x7f1b90158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 --2- 172.21.15.86:0/2821043566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b901599e0 0x7f1b90157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 >> 172.21.15.86:0/2821043566 conn(0x7f1b900c9860 msgr2=0x7f1b900c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 shutdown_connections 2023-10-09T11:57:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.298+0000 7f1b951ff700 1 -- 172.21.15.86:0/2821043566 wait complete. 2023-10-09T11:57:28.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:57:28.386 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:28.386+0000 7fec576f4180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:57:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.548+0000 7f0e4d99d700 1 Processor -- start 2023-10-09T11:57:28.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.548+0000 7f0e4d99d700 1 -- start start 2023-10-09T11:57:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.549+0000 7f0e4d99d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e48159420 0x7f0e480b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.549+0000 7f0e4d99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e480b2980 con 0x7f0e4815d230 2023-10-09T11:57:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.549+0000 7f0e4d99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e480b11d0 con 0x7f0e481597f0 2023-10-09T11:57:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.549+0000 7f0e4d99d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e480b14b0 con 0x7f0e48159420 2023-10-09T11:57:28.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e4c99b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e48159420 0x7f0e480b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e4d19c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0e4815d230 0x7f0e4815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55984/0 (socket says 172.21.15.86:55984) 2023-10-09T11:57:28.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e4d19c700 1 -- 172.21.15.86:0/759519308 learned_addr learned my addr 172.21.15.86:0/759519308 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:28.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e4c99b700 1 -- 172.21.15.86:0/759519308 >> v1:172.21.15.135:6789/0 conn(0x7f0e481597f0 legacy=0x7f0e480b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e4c99b700 1 -- 172.21.15.86:0/759519308 >> v1:172.21.15.86:6789/0 conn(0x7f0e4815d230 legacy=0x7f0e4815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e4c99b700 1 -- 172.21.15.86:0/759519308 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480b1790 con 0x7f0e48159420 2023-10-09T11:57:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e477fe700 1 -- 172.21.15.86:0/759519308 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062223778 0 0) 0x7f0e480b2980 con 0x7f0e4815d230 2023-10-09T11:57:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.550+0000 7f0e4c99b700 1 --2- 172.21.15.86:0/759519308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e480b5f40 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0098e0 tx=0x7f0e3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf05a7951c81aff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e477fe700 1 -- 172.21.15.86:0/759519308 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c009e80 con 0x7f0e48159420 2023-10-09T11:57:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e477fe700 1 -- 172.21.15.86:0/759519308 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00b860 con 0x7f0e48159420 2023-10-09T11:57:28.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e477fe700 1 -- 172.21.15.86:0/759519308 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00bbe0 con 0x7f0e48159420 2023-10-09T11:57:28.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e4d99d700 1 -- 172.21.15.86:0/759519308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 msgr2=0x7f0e480b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/759519308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e480b5f40 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0098e0 tx=0x7f0e3c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e4d99d700 1 -- 172.21.15.86:0/759519308 shutdown_connections 2023-10-09T11:57:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/759519308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e480b5f40 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e4d99d700 1 -- 172.21.15.86:0/759519308 >> 172.21.15.86:0/759519308 conn(0x7f0e480d0660 msgr2=0x7f0e480d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:28.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e4d99d700 1 -- 172.21.15.86:0/759519308 shutdown_connections 2023-10-09T11:57:28.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.551+0000 7f0e4d99d700 1 -- 172.21.15.86:0/759519308 wait complete. 2023-10-09T11:57:28.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.553+0000 7f0e4d99d700 1 Processor -- start 2023-10-09T11:57:28.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.553+0000 7f0e4d99d700 1 -- start start 2023-10-09T11:57:28.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4d99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e4814a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4d99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e481597f0 0x7f0e48157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4d99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e4815d230 0x7f0e481577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4d99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480c5650 con 0x7f0e48159420 2023-10-09T11:57:28.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4d99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480c58f0 con 0x7f0e4815d230 2023-10-09T11:57:28.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4d99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480c5bd0 con 0x7f0e481597f0 2023-10-09T11:57:28.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4c99b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e4814a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4c99b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e4814a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37510/0 (socket says 172.21.15.86:37510) 2023-10-09T11:57:28.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4c99b700 1 -- 172.21.15.86:0/3986189577 learned_addr learned my addr 172.21.15.86:0/3986189577 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:28.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e4d19c700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e4815d230 0x7f0e481577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.554+0000 7f0e47fff700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e481597f0 0x7f0e48157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:28.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4c99b700 1 -- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e481597f0 msgr2=0x7f0e48157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4c99b700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e481597f0 0x7f0e48157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4c99b700 1 -- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e4815d230 msgr2=0x7f0e481577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4c99b700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e4815d230 0x7f0e481577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4c99b700 1 -- 172.21.15.86:0/3986189577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009420 con 0x7f0e48159420 2023-10-09T11:57:28.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4c99b700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e4814a1a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0e48089340 tx=0x7f0e3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:28.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e44ff9700 1 -- 172.21.15.86:0/3986189577 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00bbe0 con 0x7f0e48159420 2023-10-09T11:57:28.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e44ff9700 1 -- 172.21.15.86:0/3986189577 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c011420 con 0x7f0e48159420 2023-10-09T11:57:28.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e44ff9700 1 -- 172.21.15.86:0/3986189577 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0117e0 con 0x7f0e48159420 2023-10-09T11:57:28.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e480c5eb0 con 0x7f0e48159420 2023-10-09T11:57:28.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.555+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4814a6e0 con 0x7f0e48159420 2023-10-09T11:57:28.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.556+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4804c3c0 con 0x7f0e48159420 2023-10-09T11:57:28.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.557+0000 7f0e44ff9700 1 -- 172.21.15.86:0/3986189577 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0e3c011b90 con 0x7f0e48159420 2023-10-09T11:57:28.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.558+0000 7f0e44ff9700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 0x7f0e2c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:28.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.558+0000 7f0e44ff9700 1 -- 172.21.15.86:0/3986189577 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f0e3c0865b0 con 0x7f0e48159420 2023-10-09T11:57:28.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.558+0000 7f0e47fff700 1 -- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 msgr2=0x7f0e2c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:28.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.558+0000 7f0e47fff700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 0x7f0e2c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:28.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.562+0000 7f0e44ff9700 1 -- 172.21.15.86:0/3986189577 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e3c053280 con 0x7f0e48159420 2023-10-09T11:57:28.650 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:28.650+0000 7eff02adf180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:57:28.676 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:28.675+0000 7fec576f4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:57:28.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.759+0000 7f0e47fff700 1 -- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 msgr2=0x7f0e2c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:28.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.759+0000 7f0e47fff700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 0x7f0e2c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:28.767 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:28.767+0000 7fec576f4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:57:28.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.804+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0e480b1a70 con 0x7f0e48159420 2023-10-09T11:57:28.805 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T11:57:28.805+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:57:28.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.809+0000 7f0e44ff9700 1 -- 172.21.15.86:0/3986189577 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0e3c0568a0 con 0x7f0e48159420 2023-10-09T11:57:28.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.812+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 msgr2=0x7f0e2c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:28.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.812+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 0x7f0e2c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.812+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 msgr2=0x7f0e4814a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.812+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e4814a1a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0e48089340 tx=0x7f0e3c017000 comp rx=0 tx=0).stop 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 shutdown_connections 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e2c0670e0 0x7f0e2c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e48159420 0x7f0e4814a1a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e4815d230 0x7f0e481577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 --2- 172.21.15.86:0/3986189577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e481597f0 0x7f0e48157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 >> 172.21.15.86:0/3986189577 conn(0x7f0e480d0660 msgr2=0x7f0e48158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 shutdown_connections 2023-10-09T11:57:28.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:28.813+0000 7f0e4d99d700 1 -- 172.21.15.86:0/3986189577 wait complete. 2023-10-09T11:57:28.815 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:57:28.817 INFO:tasks.ceph.mds.a.smithi086.stderr: -1227> 2023-10-09T11:57:06.850+0000 7f6f01ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:57:28.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:57:28.859 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:57:28.924 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:28.924+0000 7fec576f4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:57:28.953 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:28.952+0000 7eff02adf180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:57:29.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.021+0000 7f085a39d700 1 Processor -- start 2023-10-09T11:57:29.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.021+0000 7f085a39d700 1 -- start start 2023-10-09T11:57:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.022+0000 7f085a39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08540b4e70 0x7f08540ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f085a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f085a39d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08540cfb00 con 0x7f08540b16d0 2023-10-09T11:57:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f085a39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08540b5c40 con 0x7f08540b4e70 2023-10-09T11:57:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f085a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540b5f20 con 0x7f08540b1b40 2023-10-09T11:57:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f0858b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f08540b16d0 0x7f085415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56000/0 (socket says 172.21.15.86:56000) 2023-10-09T11:57:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f0858b9a700 1 -- 172.21.15.86:0/1153404053 learned_addr learned my addr 172.21.15.86:0/1153404053 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f0859b9c700 1 --2- 172.21.15.86:0/1153404053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f085939b700 1 --2- 172.21.15.86:0/1153404053 >> v2:172.21.15.135:3300/0 conn(0x7f08540b4e70 0x7f08540ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f084bfff700 1 -- 172.21.15.86:0/1153404053 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138273711 0 0) 0x7f08540cfb00 con 0x7f08540b16d0 2023-10-09T11:57:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f084bfff700 1 -- 172.21.15.86:0/1153404053 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0840003570 con 0x7f08540b16d0 2023-10-09T11:57:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f0859b9c700 1 -- 172.21.15.86:0/1153404053 >> v2:172.21.15.135:3300/0 conn(0x7f08540b4e70 msgr2=0x7f08540ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.023+0000 7f0859b9c700 1 --2- 172.21.15.86:0/1153404053 >> v2:172.21.15.135:3300/0 conn(0x7f08540b4e70 0x7f08540ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.024+0000 7f0859b9c700 1 -- 172.21.15.86:0/1153404053 >> v1:172.21.15.86:6789/0 conn(0x7f08540b16d0 legacy=0x7f085415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.024+0000 7f0859b9c700 1 -- 172.21.15.86:0/1153404053 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08540b6200 con 0x7f08540b1b40 2023-10-09T11:57:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.024+0000 7f0859b9c700 1 --2- 172.21.15.86:0/1153404053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415d950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f084c009e60 tx=0x7f084c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1457b7d5c46dfc61 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.024+0000 7f084bfff700 1 -- 172.21.15.86:0/1153404053 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c00e070 con 0x7f08540b1b40 2023-10-09T11:57:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.024+0000 7f084bfff700 1 -- 172.21.15.86:0/1153404053 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c00bab0 con 0x7f08540b1b40 2023-10-09T11:57:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.024+0000 7f084bfff700 1 -- 172.21.15.86:0/1153404053 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c00be70 con 0x7f08540b1b40 2023-10-09T11:57:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 -- 172.21.15.86:0/1153404053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 msgr2=0x7f085415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 --2- 172.21.15.86:0/1153404053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415d950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f084c009e60 tx=0x7f084c009780 comp rx=0 tx=0).stop 2023-10-09T11:57:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 -- 172.21.15.86:0/1153404053 shutdown_connections 2023-10-09T11:57:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 --2- 172.21.15.86:0/1153404053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415d950 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 --2- 172.21.15.86:0/1153404053 >> v2:172.21.15.135:3300/0 conn(0x7f08540b4e70 0x7f08540ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 -- 172.21.15.86:0/1153404053 >> 172.21.15.86:0/1153404053 conn(0x7f08540d10c0 msgr2=0x7f08540affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:29.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 -- 172.21.15.86:0/1153404053 shutdown_connections 2023-10-09T11:57:29.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.025+0000 7f085a39d700 1 -- 172.21.15.86:0/1153404053 wait complete. 2023-10-09T11:57:29.029 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:29.028+0000 7fec576f4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:57:29.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.027+0000 7f085a39d700 1 Processor -- start 2023-10-09T11:57:29.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.027+0000 7f085a39d700 1 -- start start 2023-10-09T11:57:29.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f085a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b16d0 0x7f085414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:29.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f085a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:29.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f085a39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08540b4e70 0x7f085415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f085a39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085414b690 con 0x7f08540b4e70 2023-10-09T11:57:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f085a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540c8a30 con 0x7f08540b16d0 2023-10-09T11:57:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f085a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540c5390 con 0x7f08540b1b40 2023-10-09T11:57:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f0859b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08540b4e70 0x7f085415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f0859b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08540b4e70 0x7f085415baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37532/0 (socket says 172.21.15.86:37532) 2023-10-09T11:57:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.028+0000 7f0859b9c700 1 -- 172.21.15.86:0/3737063476 learned_addr learned my addr 172.21.15.86:0/3737063476 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f085939b700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b16d0 0x7f085414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:29.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f0858b9a700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:29.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f0859b9c700 1 -- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 msgr2=0x7f085415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:29.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f0859b9c700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f0859b9c700 1 -- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b16d0 msgr2=0x7f085414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:29.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f0859b9c700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b16d0 0x7f085414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f0859b9c700 1 -- 172.21.15.86:0/3737063476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c009a20 con 0x7f08540b4e70 2023-10-09T11:57:29.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f0859b9c700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08540b4e70 0x7f085415baf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f08540b6060 tx=0x7f084c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:29.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c012e10 con 0x7f08540b4e70 2023-10-09T11:57:29.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c027470 con 0x7f08540b4e70 2023-10-09T11:57:29.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c027830 con 0x7f08540b4e70 2023-10-09T11:57:29.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.029+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08540c8c80 con 0x7f08540b4e70 2023-10-09T11:57:29.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.030+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08540c9240 con 0x7f08540b4e70 2023-10-09T11:57:29.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.031+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08540c55b0 con 0x7f08540b4e70 2023-10-09T11:57:29.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.032+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 41) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f084c024070 con 0x7f08540b4e70 2023-10-09T11:57:29.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.032+0000 7f08497fa700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 0x7f0838069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:29.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.033+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6425+0+0 (secure 0 0 0) 0x7f084c0874a0 con 0x7f08540b4e70 2023-10-09T11:57:29.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.033+0000 7f085939b700 1 -- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 msgr2=0x7f0838069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:29.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.033+0000 7f085939b700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 0x7f0838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:29.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.037+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08540c55b0 con 0x7f08540b4e70 2023-10-09T11:57:29.049 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:29.049+0000 7eff02adf180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:57:29.208 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:29.208+0000 7eff02adf180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:57:29.220 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:29.220+0000 7fec576f4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:57:29.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.234+0000 7f085939b700 1 -- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 msgr2=0x7f0838069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:29.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.234+0000 7f085939b700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 0x7f0838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:29.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.278+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f08540c55b0 con 0x7f08540b4e70 2023-10-09T11:57:29.313 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:29.312+0000 7fec576f4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:57:29.314 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:29.314+0000 7eff02adf180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:57:29.406 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:29.405+0000 7fec576f4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:57:29.500 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:29.499+0000 7fec576f4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:57:29.507 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:29.507+0000 7eff02adf180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:57:29.601 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:29.600+0000 7eff02adf180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:57:29.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.635+0000 7f085939b700 1 -- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 msgr2=0x7f0838069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:29.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.635+0000 7f085939b700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 0x7f0838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:57:29.693 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:29.693+0000 7eff02adf180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:57:29.787 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:29.787+0000 7eff02adf180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:57:29.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.795+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 42) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f084c003040 con 0x7f08540b4e70 2023-10-09T11:57:29.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.795+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 msgr2=0x7f0838069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:29.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.795+0000 7f08497fa700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 0x7f0838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.811+0000 7f08497fa700 1 -- 172.21.15.86:0/3737063476 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f084c05a360 con 0x7f08540b4e70 2023-10-09T11:57:29.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08540b4e70 msgr2=0x7f085415baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:29.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08540b4e70 0x7f085415baf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f08540b6060 tx=0x7f084c019000 comp rx=0 tx=0).stop 2023-10-09T11:57:29.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 shutdown_connections 2023-10-09T11:57:29.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08380670e0 0x7f0838069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08540b4e70 0x7f085415baf0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540b16d0 0x7f085414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 --2- 172.21.15.86:0/3737063476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540b1b40 0x7f085415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:29.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.813+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 >> 172.21.15.86:0/3737063476 conn(0x7f08540d10c0 msgr2=0x7f0854159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:29.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.814+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 shutdown_connections 2023-10-09T11:57:29.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:29.814+0000 7f085a39d700 1 -- 172.21.15.86:0/3737063476 wait complete. 2023-10-09T11:57:29.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:57:30.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.060+0000 7febc85ff700 1 Processor -- start 2023-10-09T11:57:30.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.060+0000 7febc85ff700 1 -- start start 2023-10-09T11:57:30.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.061+0000 7febc85ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7febc0159ec0 0x7febc00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.061+0000 7febc85ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00b5b00 con 0x7febc00b53d0 2023-10-09T11:57:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.061+0000 7febc85ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00b5850 con 0x7febc00cf350 2023-10-09T11:57:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.061+0000 7febc85ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00b5da0 con 0x7febc0159ec0 2023-10-09T11:57:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.061+0000 7febc5b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7febc00b53d0 0x7febc00cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56010/0 (socket says 172.21.15.86:56010) 2023-10-09T11:57:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.061+0000 7febc5b9a700 1 -- 172.21.15.86:0/92822210 learned_addr learned my addr 172.21.15.86:0/92822210 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:30.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.061+0000 7febc639b700 1 --2- 172.21.15.86:0/92822210 >> v2:172.21.15.135:3300/0 conn(0x7febc0159ec0 0x7febc00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc5399700 1 -- 172.21.15.86:0/92822210 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750453062 0 0) 0x7febc00b5b00 con 0x7febc00b53d0 2023-10-09T11:57:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc5399700 1 -- 172.21.15.86:0/92822210 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febac003570 con 0x7febc00b53d0 2023-10-09T11:57:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc639b700 1 -- 172.21.15.86:0/92822210 >> v1:172.21.15.135:6789/0 conn(0x7febc00cf350 legacy=0x7febc00cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc639b700 1 -- 172.21.15.86:0/92822210 >> v1:172.21.15.86:6789/0 conn(0x7febc00b53d0 legacy=0x7febc00cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc639b700 1 -- 172.21.15.86:0/92822210 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00b6080 con 0x7febc0159ec0 2023-10-09T11:57:30.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc639b700 1 --2- 172.21.15.86:0/92822210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 0x7febc00b4e90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7febbc0098d0 tx=0x7febbc009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d9315ef70c2709 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc5399700 1 -- 172.21.15.86:0/92822210 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc005c10 con 0x7febc0159ec0 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc5399700 1 -- 172.21.15.86:0/92822210 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc005d70 con 0x7febc0159ec0 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.062+0000 7febc5399700 1 -- 172.21.15.86:0/92822210 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc006280 con 0x7febc0159ec0 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.063+0000 7febc85ff700 1 -- 172.21.15.86:0/92822210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 msgr2=0x7febc00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.063+0000 7febc85ff700 1 --2- 172.21.15.86:0/92822210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 0x7febc00b4e90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7febbc0098d0 tx=0x7febbc009120 comp rx=0 tx=0).stop 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.063+0000 7febc85ff700 1 -- 172.21.15.86:0/92822210 shutdown_connections 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.063+0000 7febc85ff700 1 --2- 172.21.15.86:0/92822210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 0x7febc00b4e90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.063+0000 7febc85ff700 1 -- 172.21.15.86:0/92822210 >> 172.21.15.86:0/92822210 conn(0x7febc00999f0 msgr2=0x7febc00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:30.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.063+0000 7febc85ff700 1 -- 172.21.15.86:0/92822210 shutdown_connections 2023-10-09T11:57:30.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.063+0000 7febc85ff700 1 -- 172.21.15.86:0/92822210 wait complete. 2023-10-09T11:57:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.065+0000 7febc85ff700 1 Processor -- start 2023-10-09T11:57:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.065+0000 7febc85ff700 1 -- start start 2023-10-09T11:57:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc85ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febc00b53d0 0x7febc006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc85ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc00cf350 0x7febc016a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc85ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 0x7febc016a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:30.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc85ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc006b350 con 0x7febc00b53d0 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc85ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00c87a0 con 0x7febc0159ec0 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc85ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00c8d60 con 0x7febc00cf350 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febc00b53d0 0x7febc006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febc00b53d0 0x7febc006ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37588/0 (socket says 172.21.15.86:37588) 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 -- 172.21.15.86:0/725531255 learned_addr learned my addr 172.21.15.86:0/725531255 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 -- 172.21.15.86:0/725531255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc00cf350 msgr2=0x7febc016a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 --2- 172.21.15.86:0/725531255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc00cf350 0x7febc016a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 -- 172.21.15.86:0/725531255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 msgr2=0x7febc016a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:30.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 --2- 172.21.15.86:0/725531255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 0x7febc016a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 -- 172.21.15.86:0/725531255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0093c0 con 0x7febc00b53d0 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.066+0000 7febc639b700 1 --2- 172.21.15.86:0/725531255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febc00b53d0 0x7febc006ae10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7febbc009f70 tx=0x7febbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.067+0000 7febb67fc700 1 -- 172.21.15.86:0/725531255 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc01d880 con 0x7febc00b53d0 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.067+0000 7febb67fc700 1 -- 172.21.15.86:0/725531255 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc01da00 con 0x7febc00b53d0 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.067+0000 7febb67fc700 1 -- 172.21.15.86:0/725531255 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc01ddc0 con 0x7febc00b53d0 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.067+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc016ac80 con 0x7febc00b53d0 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.067+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc00c89f0 con 0x7febc00b53d0 2023-10-09T11:57:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.068+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc00cf890 con 0x7febc00b53d0 2023-10-09T11:57:30.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.069+0000 7febb67fc700 1 -- 172.21.15.86:0/725531255 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 42) v1 ==== 84451+0+0 (secure 0 0 0) 0x7febbc01b690 con 0x7febc00b53d0 2023-10-09T11:57:30.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.070+0000 7febb67fc700 1 -- 172.21.15.86:0/725531255 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6726+0+0 (secure 0 0 0) 0x7febbc086230 con 0x7febc00b53d0 2023-10-09T11:57:30.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.074+0000 7febb67fc700 1 -- 172.21.15.86:0/725531255 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febbc053370 con 0x7febc00b53d0 2023-10-09T11:57:30.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.264+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7febc0063c90 con 0x7febc00b53d0 2023-10-09T11:57:30.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.818+0000 7febb67fc700 1 -- 172.21.15.86:0/725531255 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7febbc056990 con 0x7febc00b53d0 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febc00b53d0 msgr2=0x7febc006ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 --2- 172.21.15.86:0/725531255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febc00b53d0 0x7febc006ae10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7febbc009f70 tx=0x7febbc016000 comp rx=0 tx=0).stop 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 shutdown_connections 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 --2- 172.21.15.86:0/725531255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febc00b53d0 0x7febc006ae10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 --2- 172.21.15.86:0/725531255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0159ec0 0x7febc016a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 --2- 172.21.15.86:0/725531255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febc00cf350 0x7febc016a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 >> 172.21.15.86:0/725531255 conn(0x7febc00999f0 msgr2=0x7febc00b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:30.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 shutdown_connections 2023-10-09T11:57:30.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:30.823+0000 7febc85ff700 1 -- 172.21.15.86:0/725531255 wait complete. 2023-10-09T11:57:30.825 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:57:30.850 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:57:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.035+0000 7f3c74d9d700 1 Processor -- start 2023-10-09T11:57:31.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.035+0000 7f3c74d9d700 1 -- start start 2023-10-09T11:57:31.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.036+0000 7f3c74d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c700cca20 0x7f3c700cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.036+0000 7f3c74d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c700cfa00 con 0x7f3c700b0790 2023-10-09T11:57:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.036+0000 7f3c74d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c700cb580 con 0x7f3c700b03c0 2023-10-09T11:57:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.036+0000 7f3c74d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700cf160 con 0x7f3c700cca20 2023-10-09T11:57:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.036+0000 7f3c6effd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3c700b0790 0x7f3c701591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56026/0 (socket says 172.21.15.86:56026) 2023-10-09T11:57:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.036+0000 7f3c6effd700 1 -- 172.21.15.86:0/515901500 learned_addr learned my addr 172.21.15.86:0/515901500 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:31.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/515901500 >> v2:172.21.15.135:3300/0 conn(0x7f3c700cca20 0x7f3c700cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127345500 0 0) 0x7f3c700cfa00 con 0x7f3c700b0790 2023-10-09T11:57:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c58003570 con 0x7f3c700b0790 2023-10-09T11:57:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2593913184 0 0) 0x7f3c58003570 con 0x7f3c700b0790 2023-10-09T11:57:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 >> v2:172.21.15.135:3300/0 conn(0x7f3c700cca20 msgr2=0x7f3c700cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 --2- 172.21.15.86:0/515901500 >> v2:172.21.15.135:3300/0 conn(0x7f3c700cca20 0x7f3c700cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 >> v1:172.21.15.135:6789/0 conn(0x7f3c700b03c0 legacy=0x7f3c700b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:31.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700cf440 con 0x7f3c700b0790 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f3c64001470 con 0x7f3c700b0790 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/515901500 >> v2:172.21.15.135:3300/0 conn(0x7f3c700cca20 0x7f3c700cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 >> v1:172.21.15.86:6789/0 conn(0x7f3c700b0790 legacy=0x7f3c701591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58003a60 0x7f3c58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c58004810 0x7f3c58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c580051c0 0x7f3c5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700cf160 con 0x7f3c580051c0 2023-10-09T11:57:31.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5800c160 con 0x7f3c58003a60 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.037+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5800c320 con 0x7f3c58004810 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c580051c0 0x7f3c5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6f7fe700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58003a60 0x7f3c58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6effd700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c58004810 0x7f3c58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 -- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c58004810 msgr2=0x7f3c58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c58004810 0x7f3c58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 -- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58003a60 msgr2=0x7f3c58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:31.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c58003a60 0x7f3c58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 -- 172.21.15.86:0/515901500 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58003570 con 0x7f3c580051c0 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 -- 172.21.15.86:0/515901500 reap_dead start 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c580051c0 0x7f3c5800ba60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800e3c0 tx=0x7f3c6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f791d4f5b0254131 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68009c50 con 0x7f3c580051c0 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6800f040 con 0x7f3c580051c0 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.038+0000 7f3c6e7fc700 1 -- 172.21.15.86:0/515901500 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800eea0 con 0x7f3c580051c0 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.039+0000 7f3c74d9d700 1 -- 172.21.15.86:0/515901500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c580051c0 msgr2=0x7f3c5800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:31.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.039+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c580051c0 0x7f3c5800ba60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800e3c0 tx=0x7f3c6800b040 comp rx=0 tx=0).stop 2023-10-09T11:57:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.039+0000 7f3c74d9d700 1 -- 172.21.15.86:0/515901500 shutdown_connections 2023-10-09T11:57:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.039+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/515901500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c580051c0 0x7f3c5800ba60 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.039+0000 7f3c74d9d700 1 -- 172.21.15.86:0/515901500 >> 172.21.15.86:0/515901500 conn(0x7f3c70063230 msgr2=0x7f3c70063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.039+0000 7f3c74d9d700 1 -- 172.21.15.86:0/515901500 shutdown_connections 2023-10-09T11:57:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.039+0000 7f3c74d9d700 1 -- 172.21.15.86:0/515901500 wait complete. 2023-10-09T11:57:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.040+0000 7f3c74d9d700 1 Processor -- start 2023-10-09T11:57:31.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.041+0000 7f3c74d9d700 1 -- start start 2023-10-09T11:57:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.041+0000 7f3c74d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c580051c0 0x7f3c700ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.041+0000 7f3c74d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c700a6e40 0x7f3c7015bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c74d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c700af470 0x7f3c700af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c74d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700afe20 con 0x7f3c700af470 2023-10-09T11:57:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c74d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700a7650 con 0x7f3c700a6e40 2023-10-09T11:57:31.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c74d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700a7930 con 0x7f3c580051c0 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c700af470 0x7f3c700af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c700af470 0x7f3c700af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37602/0 (socket says 172.21.15.86:37602) 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 -- 172.21.15.86:0/3328441660 learned_addr learned my addr 172.21.15.86:0/3328441660 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6effd700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c700a6e40 0x7f3c7015bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6f7fe700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c580051c0 0x7f3c700ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 -- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c580051c0 msgr2=0x7f3c700ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c580051c0 0x7f3c700ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 -- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c700a6e40 msgr2=0x7f3c7015bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:31.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c700a6e40 0x7f3c7015bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 -- 172.21.15.86:0/3328441660 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700a7c10 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.042+0000 7f3c6ffff700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c700af470 0x7f3c700af8e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c680099f0 tx=0x7f3c6801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.043+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6801d660 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.043+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6801d7c0 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.043+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6801db80 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.043+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c700a7ef0 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.043+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c700a72b0 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.044+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c700c75a0 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.045+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 43) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f3c68028480 con 0x7f3c700af470 2023-10-09T11:57:31.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.045+0000 7f3c577fe700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c5c066db0 0x7f3c5c069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.045+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f3c680864d0 con 0x7f3c700af470 2023-10-09T11:57:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.046+0000 7f3c6f7fe700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c5c066db0 0x7f3c5c069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.046+0000 7f3c6f7fe700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c5c066db0 0x7f3c5c069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c60007e40 tx=0x7f3c60009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:31.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.050+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c700c75a0 con 0x7f3c700af470 2023-10-09T11:57:31.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.240+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c700c75a0 con 0x7f3c700af470 2023-10-09T11:57:31.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.830+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c68053b80 con 0x7f3c700af470 2023-10-09T11:57:31.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.837+0000 7f3c577fe700 1 -- 172.21.15.86:0/3328441660 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3c680537b0 con 0x7f3c700af470 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c5c066db0 msgr2=0x7f3c5c069260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c5c066db0 0x7f3c5c069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3c60007e40 tx=0x7f3c60009040 comp rx=0 tx=0).stop 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c700af470 msgr2=0x7f3c700af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c700af470 0x7f3c700af8e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c680099f0 tx=0x7f3c6801a000 comp rx=0 tx=0).stop 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 shutdown_connections 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c5c066db0 0x7f3c5c069260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c700af470 0x7f3c700af8e0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c580051c0 0x7f3c700ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 --2- 172.21.15.86:0/3328441660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c700a6e40 0x7f3c7015bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:31.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 >> 172.21.15.86:0/3328441660 conn(0x7f3c70063230 msgr2=0x7f3c7015ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:31.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 shutdown_connections 2023-10-09T11:57:31.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:31.842+0000 7f3c74d9d700 1 -- 172.21.15.86:0/3328441660 wait complete. 2023-10-09T11:57:31.844 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T11:57:31.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T11:57:32.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.045+0000 7f2f80bff700 1 Processor -- start 2023-10-09T11:57:32.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.045+0000 7f2f80bff700 1 -- start start 2023-10-09T11:57:32.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f80bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2f7c0c83f0 0x7f2f7c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f80bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 0x7f2f7c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f80bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c15b0d0 con 0x7f2f7c0ccee0 2023-10-09T11:57:32.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f80bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c7a60 con 0x7f2f7c0c83f0 2023-10-09T11:57:32.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f80bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c15a4c0 con 0x7f2f7c1568e0 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f73fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2f7c0ccee0 0x7f2f7c1561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56042/0 (socket says 172.21.15.86:56042) 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f73fff700 1 -- 172.21.15.86:0/1625045675 learned_addr learned my addr 172.21.15.86:0/1625045675 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f7ad9d700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 0x7f2f7c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f7a59c700 1 --2- 172.21.15.86:0/1625045675 >> v2:172.21.15.135:3300/0 conn(0x7f2f7c0c83f0 0x7f2f7c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014079560 0 0) 0x7f2f7c15b0d0 con 0x7f2f7c0ccee0 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.047+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f68003570 con 0x7f2f7c0ccee0 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 141360396 0 0) 0x7f2f68003570 con 0x7f2f7c0ccee0 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 msgr2=0x7f2f7c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 0x7f2f7c0ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 >> v2:172.21.15.135:3300/0 conn(0x7f2f7c0c83f0 msgr2=0x7f2f7c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 --2- 172.21.15.86:0/1625045675 >> v2:172.21.15.135:3300/0 conn(0x7f2f7c0c83f0 0x7f2f7c0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c15a7a0 con 0x7f2f7c0ccee0 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f2f64001470 con 0x7f2f7c0ccee0 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 >> v1:172.21.15.86:6789/0 conn(0x7f2f7c0ccee0 legacy=0x7f2f7c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 0x7f2f68003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68003fe0 0x7f2f68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c7a60 con 0x7f2f68004d50 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c15a4c0 con 0x7f2f68003fe0 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6800dca0 con 0x7f2f7c1568e0 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f7ad9d700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f7a59c700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 0x7f2f68003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f73fff700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68003fe0 0x7f2f68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f7ad9d700 1 -- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 msgr2=0x7f2f68003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f7ad9d700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7c1568e0 0x7f2f68003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f7ad9d700 1 -- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68003fe0 msgr2=0x7f2f68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f7ad9d700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68003fe0 0x7f2f68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.048+0000 7f2f7ad9d700 1 -- 172.21.15.86:0/1625045675 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68003570 con 0x7f2f68004d50 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f73fff700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68003fe0 0x7f2f68004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f7ad9d700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e210 tx=0x7f2f7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def58b5f994fdef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400ea60 con 0x7f2f68004d50 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7400f040 con 0x7f2f68004d50 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f79d9b700 1 -- 172.21.15.86:0/1625045675 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400ee10 con 0x7f2f68004d50 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f80bff700 1 -- 172.21.15.86:0/1625045675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68004d50 msgr2=0x7f2f680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f80bff700 1 --2- 172.21.15.86:0/1625045675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68004d50 0x7f2f680051c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e210 tx=0x7f2f7400b040 comp rx=0 tx=0).stop 2023-10-09T11:57:32.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.049+0000 7f2f7ad9d700 1 -- 172.21.15.86:0/1625045675 reap_dead start 2023-10-09T11:57:32.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.050+0000 7f2f80bff700 1 -- 172.21.15.86:0/1625045675 shutdown_connections 2023-10-09T11:57:32.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.050+0000 7f2f80bff700 1 -- 172.21.15.86:0/1625045675 >> 172.21.15.86:0/1625045675 conn(0x7f2f7c068e10 msgr2=0x7f2f7c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:32.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.050+0000 7f2f80bff700 1 -- 172.21.15.86:0/1625045675 shutdown_connections 2023-10-09T11:57:32.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.050+0000 7f2f80bff700 1 -- 172.21.15.86:0/1625045675 wait complete. 2023-10-09T11:57:32.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.051+0000 7f2f80bff700 1 Processor -- start 2023-10-09T11:57:32.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.051+0000 7f2f80bff700 1 -- start start 2023-10-09T11:57:32.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f80bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f68004d50 0x7f2f7c1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f80bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f7c14b600 0x7f2f7c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f80bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c0af2d0 0x7f2f7c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f80bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0afcb0 con 0x7f2f7c14b600 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f80bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c16e150 con 0x7f2f7c0af2d0 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f80bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c157910 con 0x7f2f68004d50 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f7c14b600 0x7f2f7c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f7c14b600 0x7f2f7c13fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37620/0 (socket says 172.21.15.86:37620) 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.052+0000 7f2f73fff700 1 -- 172.21.15.86:0/2709148864 learned_addr learned my addr 172.21.15.86:0/2709148864 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f7a59c700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f68004d50 0x7f2f7c1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f7ad9d700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c0af2d0 0x7f2f7c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f73fff700 1 -- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f68004d50 msgr2=0x7f2f7c1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f73fff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f68004d50 0x7f2f7c1573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f73fff700 1 -- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c0af2d0 msgr2=0x7f2f7c0af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f73fff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c0af2d0 0x7f2f7c0af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f73fff700 1 -- 172.21.15.86:0/2709148864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c16d260 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f73fff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f7c14b600 0x7f2f7c13fe60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400eb00 tx=0x7f2f64000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f727fc700 1 -- 172.21.15.86:0/2709148864 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64004b10 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f727fc700 1 -- 172.21.15.86:0/2709148864 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64010040 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f727fc700 1 -- 172.21.15.86:0/2709148864 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64004e80 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.053+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c16d540 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.054+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c16db00 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.054+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c04c3c0 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.055+0000 7f2f727fc700 1 -- 172.21.15.86:0/2709148864 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f64005260 con 0x7f2f7c14b600 2023-10-09T11:57:32.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.056+0000 7f2f727fc700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2f5c066f30 0x7f2f5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.056+0000 7f2f727fc700 1 -- 172.21.15.86:0/2709148864 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f2f640839b0 con 0x7f2f7c14b600 2023-10-09T11:57:32.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.056+0000 7f2f7a59c700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2f5c066f30 0x7f2f5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.057+0000 7f2f7a59c700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2f5c066f30 0x7f2f5c0693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c006f00 tx=0x7f2f6c0091a0 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.060+0000 7f2f727fc700 1 -- 172.21.15.86:0/2709148864 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f64050ad0 con 0x7f2f7c14b600 2023-10-09T11:57:32.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.252+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f2f7c15aa80 con 0x7f2f7c14b600 2023-10-09T11:57:32.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.256+0000 7f2f727fc700 1 -- 172.21.15.86:0/2709148864 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v31) v1 ==== 115+0+0 (secure 0 0 0) 0x7f2f6401a070 con 0x7f2f7c14b600 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2f5c066f30 msgr2=0x7f2f5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2f5c066f30 0x7f2f5c0693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c006f00 tx=0x7f2f6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f7c14b600 msgr2=0x7f2f7c13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f7c14b600 0x7f2f7c13fe60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400eb00 tx=0x7f2f64000c30 comp rx=0 tx=0).stop 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 shutdown_connections 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c0af2d0 0x7f2f7c0af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f68004d50 0x7f2f7c1573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2f5c066f30 0x7f2f5c0693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 --2- 172.21.15.86:0/2709148864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f7c14b600 0x7f2f7c13fe60 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 >> 172.21.15.86:0/2709148864 conn(0x7f2f7c068e10 msgr2=0x7f2f7c0c2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:32.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 shutdown_connections 2023-10-09T11:57:32.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.259+0000 7f2f80bff700 1 -- 172.21.15.86:0/2709148864 wait complete. 2023-10-09T11:57:32.278 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T11:57:32.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.460+0000 7fd3351ff700 1 Processor -- start 2023-10-09T11:57:32.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.460+0000 7fd3351ff700 1 -- start start 2023-10-09T11:57:32.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.461+0000 7fd3351ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3301568e0 0x7fd3301616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.461+0000 7fd3351ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33015b0d0 con 0x7fd3300ccee0 2023-10-09T11:57:32.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd3351ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33015a4c0 con 0x7fd3300c83f0 2023-10-09T11:57:32.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd3351ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33015a7a0 con 0x7fd3301568e0 2023-10-09T11:57:32.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32e59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd3300ccee0 0x7fd3301561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56054/0 (socket says 172.21.15.86:56054) 2023-10-09T11:57:32.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32e59c700 1 -- 172.21.15.86:0/3665218327 learned_addr learned my addr 172.21.15.86:0/3665218327 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:32.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32f59e700 1 --2- 172.21.15.86:0/3665218327 >> v2:172.21.15.86:3300/0 conn(0x7fd3301568e0 0x7fd3301616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32dd9b700 1 -- 172.21.15.86:0/3665218327 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567062628 0 0) 0x7fd33015b0d0 con 0x7fd3300ccee0 2023-10-09T11:57:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32dd9b700 1 -- 172.21.15.86:0/3665218327 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd318003570 con 0x7fd3300ccee0 2023-10-09T11:57:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32f59e700 1 -- 172.21.15.86:0/3665218327 >> v1:172.21.15.135:6789/0 conn(0x7fd3300c83f0 legacy=0x7fd3300c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32f59e700 1 -- 172.21.15.86:0/3665218327 >> v1:172.21.15.86:6789/0 conn(0x7fd3300ccee0 legacy=0x7fd3301561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.462+0000 7fd32f59e700 1 -- 172.21.15.86:0/3665218327 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33015aa80 con 0x7fd3301568e0 2023-10-09T11:57:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd32f59e700 1 --2- 172.21.15.86:0/3665218327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd3301616c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd328009e60 tx=0x7fd328009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49fe23e0700ecfb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd32dd9b700 1 -- 172.21.15.86:0/3665218327 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800e070 con 0x7fd3301568e0 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd32dd9b700 1 -- 172.21.15.86:0/3665218327 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800bb60 con 0x7fd3301568e0 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd32dd9b700 1 -- 172.21.15.86:0/3665218327 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328012430 con 0x7fd3301568e0 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd3351ff700 1 -- 172.21.15.86:0/3665218327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 msgr2=0x7fd3301616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd3351ff700 1 --2- 172.21.15.86:0/3665218327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd3301616c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd328009e60 tx=0x7fd328009780 comp rx=0 tx=0).stop 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd3351ff700 1 -- 172.21.15.86:0/3665218327 shutdown_connections 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd3351ff700 1 --2- 172.21.15.86:0/3665218327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd3301616c0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd3351ff700 1 -- 172.21.15.86:0/3665218327 >> 172.21.15.86:0/3665218327 conn(0x7fd330068e10 msgr2=0x7fd3300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd3351ff700 1 -- 172.21.15.86:0/3665218327 shutdown_connections 2023-10-09T11:57:32.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.463+0000 7fd3351ff700 1 -- 172.21.15.86:0/3665218327 wait complete. 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.465+0000 7fd3351ff700 1 Processor -- start 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.465+0000 7fd3351ff700 1 -- start start 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd3351ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3300c83f0 0x7fd3300b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd3351ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3300ccee0 0x7fd3300b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd3351ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd33014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd3351ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300af4a0 con 0x7fd3301568e0 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd3351ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300af780 con 0x7fd3300ccee0 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd3351ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300afa60 con 0x7fd3300c83f0 2023-10-09T11:57:32.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd32f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd33014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd32f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd33014de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37642/0 (socket says 172.21.15.86:37642) 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd32f59e700 1 -- 172.21.15.86:0/2956580345 learned_addr learned my addr 172.21.15.86:0/2956580345 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd32e59c700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3300ccee0 0x7fd3300b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.466+0000 7fd32ed9d700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3300c83f0 0x7fd3300b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd32f59e700 1 -- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3300c83f0 msgr2=0x7fd3300b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd32f59e700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3300c83f0 0x7fd3300b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd32f59e700 1 -- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3300ccee0 msgr2=0x7fd3300b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd32f59e700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3300ccee0 0x7fd3300b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd32f59e700 1 -- 172.21.15.86:0/2956580345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328009a20 con 0x7fd3301568e0 2023-10-09T11:57:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd32f59e700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd33014de40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd330063d40 tx=0x7fd328018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd316ffd700 1 -- 172.21.15.86:0/2956580345 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328009420 con 0x7fd3301568e0 2023-10-09T11:57:32.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd316ffd700 1 -- 172.21.15.86:0/2956580345 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328012e60 con 0x7fd3301568e0 2023-10-09T11:57:32.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd316ffd700 1 -- 172.21.15.86:0/2956580345 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32801e6a0 con 0x7fd3301568e0 2023-10-09T11:57:32.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3300afd40 con 0x7fd3301568e0 2023-10-09T11:57:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.467+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3300b1fd0 con 0x7fd3301568e0 2023-10-09T11:57:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.468+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3300b0260 con 0x7fd3301568e0 2023-10-09T11:57:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.469+0000 7fd316ffd700 1 -- 172.21.15.86:0/2956580345 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd32801ea50 con 0x7fd3301568e0 2023-10-09T11:57:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.470+0000 7fd316ffd700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd31c066f30 0x7fd31c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.470+0000 7fd316ffd700 1 -- 172.21.15.86:0/2956580345 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7fd328086cc0 con 0x7fd3301568e0 2023-10-09T11:57:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.470+0000 7fd32ed9d700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd31c066f30 0x7fd31c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.471+0000 7fd32ed9d700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd31c066f30 0x7fd31c0693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd320003a30 tx=0x7fd320007ea0 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.474+0000 7fd316ffd700 1 -- 172.21.15.86:0/2956580345 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3300b0260 con 0x7fd3301568e0 2023-10-09T11:57:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.666+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fd3300b0260 con 0x7fd3301568e0 2023-10-09T11:57:32.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.670+0000 7fd316ffd700 1 -- 172.21.15.86:0/2956580345 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7fd3300b0260 con 0x7fd3301568e0 2023-10-09T11:57:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd31c066f30 msgr2=0x7fd31c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd31c066f30 0x7fd31c0693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd320003a30 tx=0x7fd320007ea0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 msgr2=0x7fd33014de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd33014de40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd330063d40 tx=0x7fd328018000 comp rx=0 tx=0).stop 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 shutdown_connections 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd31c066f30 0x7fd31c0693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3301568e0 0x7fd33014de40 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3300c83f0 0x7fd3300b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 --2- 172.21.15.86:0/2956580345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3300ccee0 0x7fd3300b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 >> 172.21.15.86:0/2956580345 conn(0x7fd330068e10 msgr2=0x7fd3300caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 shutdown_connections 2023-10-09T11:57:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.673+0000 7fd3351ff700 1 -- 172.21.15.86:0/2956580345 wait complete. 2023-10-09T11:57:32.699 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:57:32.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.883+0000 7f181759e700 1 Processor -- start 2023-10-09T11:57:32.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.883+0000 7f181759e700 1 -- start start 2023-10-09T11:57:32.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.884+0000 7f181759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18180b4e70 0x7f18180ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.884+0000 7f181759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18180b16d0 0x7f18180b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.884+0000 7f181759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18180b2080 con 0x7f181815d240 2023-10-09T11:57:32.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.884+0000 7f181759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18180cfb00 con 0x7f18180b4e70 2023-10-09T11:57:32.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.884+0000 7f181759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18180b5c40 con 0x7f18180b16d0 2023-10-09T11:57:32.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.884+0000 7f181659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18180b4e70 0x7f18180ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.884+0000 7f1816d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f181815d240 0x7f181815d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56070/0 (socket says 172.21.15.86:56070) 2023-10-09T11:57:32.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f1816d9d700 1 -- 172.21.15.86:0/4119054738 learned_addr learned my addr 172.21.15.86:0/4119054738 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:32.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f1815d9b700 1 --2- 172.21.15.86:0/4119054738 >> v2:172.21.15.135:3300/0 conn(0x7f18180b16d0 0x7f18180b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f181659c700 1 -- 172.21.15.86:0/4119054738 >> v2:172.21.15.135:3300/0 conn(0x7f18180b16d0 msgr2=0x7f18180b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:32.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f181659c700 1 --2- 172.21.15.86:0/4119054738 >> v2:172.21.15.135:3300/0 conn(0x7f18180b16d0 0x7f18180b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f181659c700 1 -- 172.21.15.86:0/4119054738 >> v1:172.21.15.86:6789/0 conn(0x7f181815d240 legacy=0x7f181815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f181659c700 1 -- 172.21.15.86:0/4119054738 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180b5f20 con 0x7f18180b4e70 2023-10-09T11:57:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f181659c700 1 --2- 172.21.15.86:0/4119054738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b4e70 0x7f18180ccff0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1818089830 tx=0x7f18080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6650ea5f7b544f4d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.885+0000 7f181559a700 1 -- 172.21.15.86:0/4119054738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808011630 con 0x7f18180b4e70 2023-10-09T11:57:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181559a700 1 -- 172.21.15.86:0/4119054738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808011790 con 0x7f18180b4e70 2023-10-09T11:57:32.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181559a700 1 -- 172.21.15.86:0/4119054738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808011b30 con 0x7f18180b4e70 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 -- 172.21.15.86:0/4119054738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b4e70 msgr2=0x7f18180ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 --2- 172.21.15.86:0/4119054738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b4e70 0x7f18180ccff0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1818089830 tx=0x7f18080091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 -- 172.21.15.86:0/4119054738 shutdown_connections 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 --2- 172.21.15.86:0/4119054738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b4e70 0x7f18180ccff0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 --2- 172.21.15.86:0/4119054738 >> v2:172.21.15.135:3300/0 conn(0x7f18180b16d0 0x7f18180b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 -- 172.21.15.86:0/4119054738 >> 172.21.15.86:0/4119054738 conn(0x7f18180d10c0 msgr2=0x7f18180affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 -- 172.21.15.86:0/4119054738 shutdown_connections 2023-10-09T11:57:32.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.886+0000 7f181759e700 1 -- 172.21.15.86:0/4119054738 wait complete. 2023-10-09T11:57:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.888+0000 7f181759e700 1 Processor -- start 2023-10-09T11:57:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.888+0000 7f181759e700 1 -- start start 2023-10-09T11:57:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.888+0000 7f181759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b16d0 0x7f18180c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18180b4e70 0x7f1818157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181815d240 0x7f181815e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181816d420 con 0x7f18180b16d0 2023-10-09T11:57:32.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1818157cb0 con 0x7f181815d240 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181816d0f0 con 0x7f18180b4e70 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b16d0 0x7f18180c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b16d0 0x7f18180c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37656/0 (socket says 172.21.15.86:37656) 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 -- 172.21.15.86:0/1684477210 learned_addr learned my addr 172.21.15.86:0/1684477210 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 -- 172.21.15.86:0/1684477210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18180b4e70 msgr2=0x7f1818157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18180b4e70 0x7f1818157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 -- 172.21.15.86:0/1684477210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181815d240 msgr2=0x7f181815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181815d240 0x7f181815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 -- 172.21.15.86:0/1684477210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808009420 con 0x7f18180b16d0 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.889+0000 7f181659c700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b16d0 0x7f18180c9560 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1818070dd0 tx=0x7f1808017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.890+0000 7f18067fc700 1 -- 172.21.15.86:0/1684477210 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808011b10 con 0x7f18180b16d0 2023-10-09T11:57:32.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.890+0000 7f18067fc700 1 -- 172.21.15.86:0/1684477210 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18080233f0 con 0x7f18180b16d0 2023-10-09T11:57:32.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.890+0000 7f18067fc700 1 -- 172.21.15.86:0/1684477210 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18080237b0 con 0x7f18180b16d0 2023-10-09T11:57:32.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.890+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1818158720 con 0x7f18180b16d0 2023-10-09T11:57:32.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.890+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18180c9ed0 con 0x7f18180b16d0 2023-10-09T11:57:32.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.891+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1818088990 con 0x7f18180b16d0 2023-10-09T11:57:32.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.892+0000 7f18067fc700 1 -- 172.21.15.86:0/1684477210 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18080193b0 con 0x7f18180b16d0 2023-10-09T11:57:32.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.892+0000 7f18067fc700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:32.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.893+0000 7f18067fc700 1 -- 172.21.15.86:0/1684477210 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f1808085be0 con 0x7f18180b16d0 2023-10-09T11:57:32.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.893+0000 7f1815d9b700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:32.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.893+0000 7f1815d9b700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18180c8d00 tx=0x7f180c0091a0 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:32.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:32.897+0000 7f18067fc700 1 -- 172.21.15.86:0/1684477210 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1808052d80 con 0x7f18180b16d0 2023-10-09T11:57:33.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.087+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f181804bb80 con 0x7f18180b16d0 2023-10-09T11:57:33.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.092+0000 7f18067fc700 1 -- 172.21.15.86:0/1684477210 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f18080150a0 con 0x7f18180b16d0 2023-10-09T11:57:33.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 msgr2=0x7f17f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18180c8d00 tx=0x7f180c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b16d0 msgr2=0x7f18180c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b16d0 0x7f18180c9560 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1818070dd0 tx=0x7f1808017000 comp rx=0 tx=0).stop 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 shutdown_connections 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18180b16d0 0x7f18180c9560 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f181815d240 0x7f181815e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 --2- 172.21.15.86:0/1684477210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18180b4e70 0x7f1818157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 >> 172.21.15.86:0/1684477210 conn(0x7f18180d10c0 msgr2=0x7f1818158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:33.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 shutdown_connections 2023-10-09T11:57:33.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.094+0000 7f181759e700 1 -- 172.21.15.86:0/1684477210 wait complete. 2023-10-09T11:57:33.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-09T11:57:33.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.294+0000 7f1abffff700 1 Processor -- start 2023-10-09T11:57:33.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.294+0000 7f1abffff700 1 -- start start 2023-10-09T11:57:33.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.295+0000 7f1abffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1ac0159420 0x7f1ac00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:33.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.295+0000 7f1abffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac015d230 0x7f1ac015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:33.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.295+0000 7f1abffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac00b2980 con 0x7f1ac01597f0 2023-10-09T11:57:33.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.295+0000 7f1abffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac015dbb0 con 0x7f1ac0159420 2023-10-09T11:57:33.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.295+0000 7f1abffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00b11d0 con 0x7f1ac015d230 2023-10-09T11:57:33.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abf7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac015d230 0x7f1ac015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:33.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abeffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1ac0159420 0x7f1ac00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:33.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abeffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1ac0159420 0x7f1ac00b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:41334/0 (socket says 172.21.15.86:41334) 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abeffd700 1 -- 172.21.15.86:0/839898452 learned_addr learned my addr 172.21.15.86:0/839898452 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abdffb700 1 -- 172.21.15.86:0/839898452 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315247429 0 0) 0x7f1ac00b2980 con 0x7f1ac01597f0 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abdffb700 1 -- 172.21.15.86:0/839898452 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa8003570 con 0x7f1ac01597f0 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abeffd700 1 -- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac015d230 msgr2=0x7f1ac015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abeffd700 1 --2- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac015d230 0x7f1ac015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abeffd700 1 -- 172.21.15.86:0/839898452 >> v1:172.21.15.135:6789/0 conn(0x7f1ac01597f0 legacy=0x7f1ac00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abeffd700 1 -- 172.21.15.86:0/839898452 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac00b14b0 con 0x7f1ac0159420 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.296+0000 7f1abf7fe700 1 --2- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac015d230 0x7f1ac015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.297+0000 7f1abeffd700 1 --2- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac0159420 0x7f1ac00b5f40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00099b0 tx=0x7f1ab0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7b9e62fbc8aea1e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.297+0000 7f1abdffb700 1 -- 172.21.15.86:0/839898452 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000b680 con 0x7f1ac0159420 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.297+0000 7f1abdffb700 1 -- 172.21.15.86:0/839898452 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab000b7e0 con 0x7f1ac0159420 2023-10-09T11:57:33.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.297+0000 7f1abdffb700 1 -- 172.21.15.86:0/839898452 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000bb80 con 0x7f1ac0159420 2023-10-09T11:57:33.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 -- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac0159420 msgr2=0x7f1ac00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 --2- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac0159420 0x7f1ac00b5f40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00099b0 tx=0x7f1ab0009250 comp rx=0 tx=0).stop 2023-10-09T11:57:33.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 -- 172.21.15.86:0/839898452 shutdown_connections 2023-10-09T11:57:33.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 --2- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac015d230 0x7f1ac015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 --2- 172.21.15.86:0/839898452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac0159420 0x7f1ac00b5f40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 -- 172.21.15.86:0/839898452 >> 172.21.15.86:0/839898452 conn(0x7f1ac00d0660 msgr2=0x7f1ac00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:33.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 -- 172.21.15.86:0/839898452 shutdown_connections 2023-10-09T11:57:33.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.298+0000 7f1abffff700 1 -- 172.21.15.86:0/839898452 wait complete. 2023-10-09T11:57:33.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.299+0000 7f1abffff700 1 Processor -- start 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.300+0000 7f1abffff700 1 -- start start 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.300+0000 7f1abffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac0159420 0x7f1ac015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.300+0000 7f1abffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac01597f0 0x7f1ac00c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.300+0000 7f1abffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac015d230 0x7f1ac00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.300+0000 7f1abffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac015aa50 con 0x7f1ac0159420 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.300+0000 7f1abffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac0159e40 con 0x7f1ac015d230 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.300+0000 7f1abffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac015a120 con 0x7f1ac01597f0 2023-10-09T11:57:33.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac0159420 0x7f1ac015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac0159420 0x7f1ac015aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37668/0 (socket says 172.21.15.86:37668) 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 -- 172.21.15.86:0/4101864398 learned_addr learned my addr 172.21.15.86:0/4101864398 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abf7fe700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac015d230 0x7f1ac00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abe7fc700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac01597f0 0x7f1ac00c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 -- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac01597f0 msgr2=0x7f1ac00c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac01597f0 0x7f1ac00c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 -- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac015d230 msgr2=0x7f1ac00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac015d230 0x7f1ac00c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 -- 172.21.15.86:0/4101864398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8009a20 con 0x7f1ac0159420 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abf7fe700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac015d230 0x7f1ac00c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.301+0000 7f1abeffd700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac0159420 0x7f1ac015aee0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009290 tx=0x7f1ab0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:33.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.302+0000 7f1aa6ffd700 1 -- 172.21.15.86:0/4101864398 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000b950 con 0x7f1ac0159420 2023-10-09T11:57:33.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.302+0000 7f1aa6ffd700 1 -- 172.21.15.86:0/4101864398 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab000bab0 con 0x7f1ac0159420 2023-10-09T11:57:33.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.302+0000 7f1aa6ffd700 1 -- 172.21.15.86:0/4101864398 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab001a680 con 0x7f1ac0159420 2023-10-09T11:57:33.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.302+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab00094f0 con 0x7f1ac0159420 2023-10-09T11:57:33.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.302+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac015a6e0 con 0x7f1ac0159420 2023-10-09T11:57:33.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.303+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac004c3c0 con 0x7f1ac0159420 2023-10-09T11:57:33.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.304+0000 7f1aa6ffd700 1 -- 172.21.15.86:0/4101864398 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ab001aa30 con 0x7f1ac0159420 2023-10-09T11:57:33.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.305+0000 7f1aa6ffd700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1aac066f30 0x7f1aac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:33.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.305+0000 7f1aa6ffd700 1 -- 172.21.15.86:0/4101864398 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f1ab0086350 con 0x7f1ac0159420 2023-10-09T11:57:33.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.305+0000 7f1abe7fc700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1aac066f30 0x7f1aac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:33.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.306+0000 7f1abe7fc700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1aac066f30 0x7f1aac0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00cc420 tx=0x7f1ab4009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:33.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.309+0000 7f1aa6ffd700 1 -- 172.21.15.86:0/4101864398 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ab0053470 con 0x7f1ac0159420 2023-10-09T11:57:33.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.574+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f1ac00b1790 con 0x7f1ac0159420 2023-10-09T11:57:33.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.831+0000 7f1aa6ffd700 1 -- 172.21.15.86:0/4101864398 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v606) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1ab0056a90 con 0x7f1ac0159420 2023-10-09T11:57:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1aac066f30 msgr2=0x7f1aac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1aac066f30 0x7f1aac0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00cc420 tx=0x7f1ab4009040 comp rx=0 tx=0).stop 2023-10-09T11:57:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac0159420 msgr2=0x7f1ac015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac0159420 0x7f1ac015aee0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009290 tx=0x7f1ab0017000 comp rx=0 tx=0).stop 2023-10-09T11:57:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 shutdown_connections 2023-10-09T11:57:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1aac066f30 0x7f1aac0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac0159420 0x7f1ac015aee0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ac015d230 0x7f1ac00c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 --2- 172.21.15.86:0/4101864398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ac01597f0 0x7f1ac00c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.833+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 >> 172.21.15.86:0/4101864398 conn(0x7f1ac00d0660 msgr2=0x7f1ac0069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.834+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 shutdown_connections 2023-10-09T11:57:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:33.834+0000 7f1abffff700 1 -- 172.21.15.86:0/4101864398 wait complete. 2023-10-09T11:57:33.852 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-10-09T11:57:33.853 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-10-09T11:57:33.853 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T11:57:33.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-09T11:57:34.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.033+0000 7fdc71f9d700 1 Processor -- start 2023-10-09T11:57:34.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.033+0000 7fdc71f9d700 1 -- start start 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.034+0000 7fdc71f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.034+0000 7fdc71f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0c7410 0x7fdc6c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.034+0000 7fdc71f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c06e2a0 con 0x7fdc6c150180 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.034+0000 7fdc71f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c06b2e0 con 0x7fdc6c0c7410 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc71f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c78e0 con 0x7fdc6c150550 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0c7410 0x7fdc6c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0c7410 0x7fdc6c069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37684/0 (socket says 172.21.15.86:37684) 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 -- 172.21.15.86:0/1385899847 learned_addr learned my addr 172.21.15.86:0/1385899847 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:34.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc6bfff700 1 --2- 172.21.15.86:0/1385899847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 -- 172.21.15.86:0/1385899847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 msgr2=0x7fdc6c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 --2- 172.21.15.86:0/1385899847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 -- 172.21.15.86:0/1385899847 >> v1:172.21.15.135:6789/0 conn(0x7fdc6c150180 legacy=0x7fdc6c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 -- 172.21.15.86:0/1385899847 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0c7bc0 con 0x7fdc6c0c7410 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.035+0000 7fdc7179c700 1 --2- 172.21.15.86:0/1385899847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c069f50 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009f50 tx=0x7fdc64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac11d93cdf55c053 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc6b7fe700 1 -- 172.21.15.86:0/1385899847 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640092e0 con 0x7fdc6c0c7410 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc6b7fe700 1 -- 172.21.15.86:0/1385899847 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400ba70 con 0x7fdc6c0c7410 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc6b7fe700 1 -- 172.21.15.86:0/1385899847 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400be30 con 0x7fdc6c0c7410 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 -- 172.21.15.86:0/1385899847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c0c7410 msgr2=0x7fdc6c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/1385899847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c069f50 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009f50 tx=0x7fdc64009840 comp rx=0 tx=0).stop 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 -- 172.21.15.86:0/1385899847 shutdown_connections 2023-10-09T11:57:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/1385899847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c069f50 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/1385899847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 -- 172.21.15.86:0/1385899847 >> 172.21.15.86:0/1385899847 conn(0x7fdc6c0cc1f0 msgr2=0x7fdc6c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:34.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 -- 172.21.15.86:0/1385899847 shutdown_connections 2023-10-09T11:57:34.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.036+0000 7fdc71f9d700 1 -- 172.21.15.86:0/1385899847 wait complete. 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.038+0000 7fdc71f9d700 1 Processor -- start 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.038+0000 7fdc71f9d700 1 -- start start 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc71f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c168910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc71f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c150180 0x7fdc6c0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc71f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c16a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc71f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c5180 con 0x7fdc6c150180 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc71f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c5ac0 con 0x7fdc6c0c7410 2023-10-09T11:57:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc71f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0b0730 con 0x7fdc6c150550 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c150180 0x7fdc6c0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c150180 0x7fdc6c0c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37690/0 (socket says 172.21.15.86:37690) 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc6bfff700 1 -- 172.21.15.86:0/2385475765 learned_addr learned my addr 172.21.15.86:0/2385475765 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc7179c700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c16a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc6bfff700 1 -- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 msgr2=0x7fdc6c16a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc6bfff700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c16a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.039+0000 7fdc70f9b700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c168910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc6bfff700 1 -- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc6c0c7410 msgr2=0x7fdc6c168910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc6bfff700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c168910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc6bfff700 1 -- 172.21.15.86:0/2385475765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc64009ae0 con 0x7fdc6c150180 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc7179c700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c16a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc70f9b700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c168910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc6bfff700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c150180 0x7fdc6c0c4c40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800d890 tx=0x7fdc58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc68ff9700 1 -- 172.21.15.86:0/2385475765 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800b600 con 0x7fdc6c150180 2023-10-09T11:57:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc68ff9700 1 -- 172.21.15.86:0/2385475765 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5800b760 con 0x7fdc6c150180 2023-10-09T11:57:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6c167d60 con 0x7fdc6c150180 2023-10-09T11:57:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc68ff9700 1 -- 172.21.15.86:0/2385475765 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800bae0 con 0x7fdc6c150180 2023-10-09T11:57:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.040+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c1685a0 con 0x7fdc6c150180 2023-10-09T11:57:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.041+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c04c3c0 con 0x7fdc6c150180 2023-10-09T11:57:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.042+0000 7fdc68ff9700 1 -- 172.21.15.86:0/2385475765 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc5801e460 con 0x7fdc6c150180 2023-10-09T11:57:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.043+0000 7fdc68ff9700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc50066f30 0x7fdc500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.043+0000 7fdc68ff9700 1 -- 172.21.15.86:0/2385475765 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7fdc58084d30 con 0x7fdc6c150180 2023-10-09T11:57:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.043+0000 7fdc70f9b700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc50066f30 0x7fdc500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.043+0000 7fdc70f9b700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc50066f30 0x7fdc500693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc60001840 tx=0x7fdc60009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:34.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.047+0000 7fdc68ff9700 1 -- 172.21.15.86:0/2385475765 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc58051e50 con 0x7fdc6c150180 2023-10-09T11:57:34.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.311+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fdc6c156ed0 con 0x7fdc6c150180 2023-10-09T11:57:34.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.834+0000 7fdc68ff9700 1 -- 172.21.15.86:0/2385475765 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v607) v1 ==== 186+0+0 (secure 0 0 0) 0x7fdc58055470 con 0x7fdc6c150180 2023-10-09T11:57:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc50066f30 msgr2=0x7fdc500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc50066f30 0x7fdc500693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc60001840 tx=0x7fdc60009040 comp rx=0 tx=0).stop 2023-10-09T11:57:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c150180 msgr2=0x7fdc6c0c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c150180 0x7fdc6c0c4c40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800d890 tx=0x7fdc58008040 comp rx=0 tx=0).stop 2023-10-09T11:57:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 shutdown_connections 2023-10-09T11:57:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc6c150550 0x7fdc6c16a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc6c0c7410 0x7fdc6c168910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdc50066f30 0x7fdc500693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 --2- 172.21.15.86:0/2385475765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc6c150180 0x7fdc6c0c4c40 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:34.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 >> 172.21.15.86:0/2385475765 conn(0x7fdc6c0cc1f0 msgr2=0x7fdc6c159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:34.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 shutdown_connections 2023-10-09T11:57:34.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:34.837+0000 7fdc71f9d700 1 -- 172.21.15.86:0/2385475765 wait complete. 2023-10-09T11:57:34.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:57:35.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.040+0000 7fb8135ff700 1 Processor -- start 2023-10-09T11:57:35.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.040+0000 7fb8135ff700 1 -- start start 2023-10-09T11:57:35.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.041+0000 7fb8135ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c83f0 0x7fb80c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.041+0000 7fb8135ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb80c0ccee0 0x7fb80c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb8135ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c15b0d0 con 0x7fb80c0c87c0 2023-10-09T11:57:35.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb8135ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c0c7a60 con 0x7fb80c0ccee0 2023-10-09T11:57:35.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb8135ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c15a4c0 con 0x7fb80c0c83f0 2023-10-09T11:57:35.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb810b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb80c0ccee0 0x7fb80c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb810b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb80c0ccee0 0x7fb80c1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50062/0 (socket says 172.21.15.86:50062) 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb810b9a700 1 -- 172.21.15.86:0/1686402133 learned_addr learned my addr 172.21.15.86:0/1686402133 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb811b9c700 1 --1- 172.21.15.86:0/1686402133 >> v1:172.21.15.86:6789/0 conn(0x7fb80c0c87c0 0x7fb80c06eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38408/0 (socket says 172.21.15.86:38408) 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb81139b700 1 --2- 172.21.15.86:0/1686402133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c83f0 0x7fb80c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb803fff700 1 -- 172.21.15.86:0/1686402133 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502563101 0 0) 0x7fb80c15b0d0 con 0x7fb80c0c87c0 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb803fff700 1 -- 172.21.15.86:0/1686402133 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f8003570 con 0x7fb80c0c87c0 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb810b9a700 1 -- 172.21.15.86:0/1686402133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c83f0 msgr2=0x7fb80c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb810b9a700 1 --2- 172.21.15.86:0/1686402133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c83f0 0x7fb80c0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb810b9a700 1 -- 172.21.15.86:0/1686402133 >> v1:172.21.15.86:6789/0 conn(0x7fb80c0c87c0 legacy=0x7fb80c06eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb810b9a700 1 -- 172.21.15.86:0/1686402133 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c15a7a0 con 0x7fb80c0ccee0 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.042+0000 7fb81139b700 1 --2- 172.21.15.86:0/1686402133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c83f0 0x7fb80c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb810b9a700 1 --2- 172.21.15.86:0/1686402133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1561d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0099b0 tx=0x7fb7fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22433da8cffdb2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:35.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb803fff700 1 -- 172.21.15.86:0/1686402133 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc009ea0 con 0x7fb80c0ccee0 2023-10-09T11:57:35.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb803fff700 1 -- 172.21.15.86:0/1686402133 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00b860 con 0x7fb80c0ccee0 2023-10-09T11:57:35.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb803fff700 1 -- 172.21.15.86:0/1686402133 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00bc00 con 0x7fb80c0ccee0 2023-10-09T11:57:35.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb8135ff700 1 -- 172.21.15.86:0/1686402133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0ccee0 msgr2=0x7fb80c1561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb8135ff700 1 --2- 172.21.15.86:0/1686402133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1561d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0099b0 tx=0x7fb7fc009250 comp rx=0 tx=0).stop 2023-10-09T11:57:35.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb8135ff700 1 -- 172.21.15.86:0/1686402133 shutdown_connections 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb8135ff700 1 --2- 172.21.15.86:0/1686402133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c83f0 0x7fb80c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb8135ff700 1 --2- 172.21.15.86:0/1686402133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1561d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.043+0000 7fb8135ff700 1 -- 172.21.15.86:0/1686402133 >> 172.21.15.86:0/1686402133 conn(0x7fb80c068e10 msgr2=0x7fb80c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.044+0000 7fb8135ff700 1 -- 172.21.15.86:0/1686402133 shutdown_connections 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.044+0000 7fb8135ff700 1 -- 172.21.15.86:0/1686402133 wait complete. 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.045+0000 7fb8135ff700 1 Processor -- start 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.045+0000 7fb8135ff700 1 -- start start 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb8135ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0c83f0 0x7fb80c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb8135ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c87c0 0x7fb80c0c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb8135ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb8135ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c152290 con 0x7fb80c0c83f0 2023-10-09T11:57:35.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb8135ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c1511f0 con 0x7fb80c0ccee0 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb8135ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c1514d0 con 0x7fb80c0c87c0 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb81139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0c83f0 0x7fb80c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb81139b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0c83f0 0x7fb80c14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50074/0 (socket says 172.21.15.86:50074) 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb81139b700 1 -- 172.21.15.86:0/548485319 learned_addr learned my addr 172.21.15.86:0/548485319 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb811b9c700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.046+0000 7fb810b9a700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c87c0 0x7fb80c0c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb81139b700 1 -- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c87c0 msgr2=0x7fb80c0c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb81139b700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c87c0 0x7fb80c0c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb81139b700 1 -- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80c0ccee0 msgr2=0x7fb80c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb81139b700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb81139b700 1 -- 172.21.15.86:0/548485319 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0094f0 con 0x7fb80c0c83f0 2023-10-09T11:57:35.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb811b9c700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:35.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb81139b700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0c83f0 0x7fb80c14e3b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb80800e8d0 tx=0x7fb808008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:35.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb8017fa700 1 -- 172.21.15.86:0/548485319 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800ee70 con 0x7fb80c0c83f0 2023-10-09T11:57:35.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb8017fa700 1 -- 172.21.15.86:0/548485319 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800c5e0 con 0x7fb80c0c83f0 2023-10-09T11:57:35.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c1517b0 con 0x7fb80c0c83f0 2023-10-09T11:57:35.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb8017fa700 1 -- 172.21.15.86:0/548485319 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800c980 con 0x7fb80c0c83f0 2023-10-09T11:57:35.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.047+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c151d70 con 0x7fb80c0c83f0 2023-10-09T11:57:35.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.048+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c04c3c0 con 0x7fb80c0c83f0 2023-10-09T11:57:35.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.049+0000 7fb8017fa700 1 -- 172.21.15.86:0/548485319 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb80800cd30 con 0x7fb80c0c83f0 2023-10-09T11:57:35.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.050+0000 7fb8017fa700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb7f0066f30 0x7fb7f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.050+0000 7fb8017fa700 1 -- 172.21.15.86:0/548485319 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7fb808084430 con 0x7fb80c0c83f0 2023-10-09T11:57:35.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.050+0000 7fb810b9a700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb7f0066f30 0x7fb7f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.051+0000 7fb810b9a700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb7f0066f30 0x7fb7f00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0099b0 tx=0x7fb7fc017000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:35.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.054+0000 7fb8017fa700 1 -- 172.21.15.86:0/548485319 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8080515f0 con 0x7fb80c0c83f0 2023-10-09T11:57:35.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.244+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb80c15aa80 con 0x7fb80c0c83f0 2023-10-09T11:57:35.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.250+0000 7fb8017fa700 1 -- 172.21.15.86:0/548485319 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb808054c10 con 0x7fb80c0c83f0 2023-10-09T11:57:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb7f0066f30 msgr2=0x7fb7f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb7f0066f30 0x7fb7f00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0099b0 tx=0x7fb7fc017000 comp rx=0 tx=0).stop 2023-10-09T11:57:35.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0c83f0 msgr2=0x7fb80c14e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0c83f0 0x7fb80c14e3b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb80800e8d0 tx=0x7fb808008040 comp rx=0 tx=0).stop 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 shutdown_connections 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb7f0066f30 0x7fb7f00693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb80c0c83f0 0x7fb80c14e3b0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb80c0ccee0 0x7fb80c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 --2- 172.21.15.86:0/548485319 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb80c0c87c0 0x7fb80c0c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.252+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 >> 172.21.15.86:0/548485319 conn(0x7fb80c068e10 msgr2=0x7fb80c0c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.253+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 shutdown_connections 2023-10-09T11:57:35.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.253+0000 7fb8135ff700 1 -- 172.21.15.86:0/548485319 wait complete. 2023-10-09T11:57:35.271 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:57:35.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:57:35.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:57:35.443 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:57:35.443 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:57:35.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:35.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.621+0000 7f840b59e700 1 Processor -- start 2023-10-09T11:57:35.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.621+0000 7f840b59e700 1 -- start start 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.622+0000 7f840b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f840c150180 0x7f840c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f840b59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c06e2a0 con 0x7f840c0c7410 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f840b59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c06b2e0 con 0x7f840c150550 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f840b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c0c78e0 con 0x7f840c150180 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f840ad9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f840c0c7410 0x7f840c069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38414/0 (socket says 172.21.15.86:38414) 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f840ad9d700 1 -- 172.21.15.86:0/757797671 learned_addr learned my addr 172.21.15.86:0/757797671 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f840a59c700 1 --2- 172.21.15.86:0/757797671 >> v2:172.21.15.135:3300/0 conn(0x7f840c150180 0x7f840c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f8409d9b700 1 -- 172.21.15.86:0/757797671 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746137186 0 0) 0x7f840c06e2a0 con 0x7f840c0c7410 2023-10-09T11:57:35.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f8409d9b700 1 -- 172.21.15.86:0/757797671 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f8003570 con 0x7f840c0c7410 2023-10-09T11:57:35.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f8409d9b700 1 -- 172.21.15.86:0/757797671 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696902809 0 0) 0x7f840c06b2e0 con 0x7f840c150550 2023-10-09T11:57:35.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f8409d9b700 1 -- 172.21.15.86:0/757797671 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f840c06e2a0 con 0x7f840c150550 2023-10-09T11:57:35.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.623+0000 7f840a59c700 1 -- 172.21.15.86:0/757797671 >> v1:172.21.15.135:6789/0 conn(0x7f840c150550 legacy=0x7f840c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.624+0000 7f840a59c700 1 -- 172.21.15.86:0/757797671 >> v1:172.21.15.86:6789/0 conn(0x7f840c0c7410 legacy=0x7f840c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.624+0000 7f840a59c700 1 -- 172.21.15.86:0/757797671 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0c7bc0 con 0x7f840c150180 2023-10-09T11:57:35.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.624+0000 7f840a59c700 1 --2- 172.21.15.86:0/757797671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c150180 0x7f840c157770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00aa90 tx=0x7f83fc00a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368f93d2be266f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:35.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.624+0000 7f8409d9b700 1 -- 172.21.15.86:0/757797671 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00c970 con 0x7f840c150180 2023-10-09T11:57:35.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.624+0000 7f8409d9b700 1 -- 172.21.15.86:0/757797671 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc00cad0 con 0x7f840c150180 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.624+0000 7f8409d9b700 1 -- 172.21.15.86:0/757797671 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00ce70 con 0x7f840c150180 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.625+0000 7f840b59e700 1 -- 172.21.15.86:0/757797671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c150180 msgr2=0x7f840c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.625+0000 7f840b59e700 1 --2- 172.21.15.86:0/757797671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c150180 0x7f840c157770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00aa90 tx=0x7f83fc00a330 comp rx=0 tx=0).stop 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.625+0000 7f840b59e700 1 -- 172.21.15.86:0/757797671 shutdown_connections 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.625+0000 7f840b59e700 1 --2- 172.21.15.86:0/757797671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c150180 0x7f840c157770 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.625+0000 7f840b59e700 1 -- 172.21.15.86:0/757797671 >> 172.21.15.86:0/757797671 conn(0x7f840c0cc1f0 msgr2=0x7f840c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.625+0000 7f840b59e700 1 -- 172.21.15.86:0/757797671 shutdown_connections 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.625+0000 7f840b59e700 1 -- 172.21.15.86:0/757797671 wait complete. 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.626+0000 7f840b59e700 1 Processor -- start 2023-10-09T11:57:35.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.626+0000 7f840b59e700 1 -- start start 2023-10-09T11:57:35.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.627+0000 7f840b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c0c7410 0x7f840c14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.627+0000 7f840b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f840c150180 0x7f840c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.627+0000 7f840b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f840c150550 0x7f840c0adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.627+0000 7f840b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c14b5e0 con 0x7f840c150180 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.627+0000 7f840b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c168060 con 0x7f840c0c7410 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.627+0000 7f840b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0c3810 con 0x7f840c150550 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.627+0000 7f8403fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f840c150180 0x7f840c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f840c150180 0x7f840c0b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50084/0 (socket says 172.21.15.86:50084) 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 -- 172.21.15.86:0/3958650195 learned_addr learned my addr 172.21.15.86:0/3958650195 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f840a59c700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c0c7410 0x7f840c14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f840ad9d700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f840c150550 0x7f840c0adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 -- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f840c150550 msgr2=0x7f840c0adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f840c150550 0x7f840c0adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 -- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c0c7410 msgr2=0x7f840c14b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c0c7410 0x7f840c14b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 -- 172.21.15.86:0/3958650195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc00a5d0 con 0x7f840c150180 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f8403fff700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f840c150180 0x7f840c0b0dd0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f83f400c5b0 tx=0x7f83f4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f84027fc700 1 -- 172.21.15.86:0/3958650195 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4010510 con 0x7f840c150180 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f84027fc700 1 -- 172.21.15.86:0/3958650195 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4010670 con 0x7f840c150180 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c0c3af0 con 0x7f840c150180 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.628+0000 7f84027fc700 1 -- 172.21.15.86:0/3958650195 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4010a30 con 0x7f840c150180 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.629+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c0c40b0 con 0x7f840c150180 2023-10-09T11:57:35.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.629+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c1681f0 con 0x7f840c150180 2023-10-09T11:57:35.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.630+0000 7f84027fc700 1 -- 172.21.15.86:0/3958650195 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83f401b400 con 0x7f840c150180 2023-10-09T11:57:35.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.631+0000 7f84027fc700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f83ec066f30 0x7f83ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:35.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.631+0000 7f84027fc700 1 -- 172.21.15.86:0/3958650195 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f83f4084230 con 0x7f840c150180 2023-10-09T11:57:35.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.631+0000 7f840a59c700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f83ec066f30 0x7f83ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:35.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.632+0000 7f840a59c700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f83ec066f30 0x7f83ec0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00a5a0 tx=0x7f83fc01a000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:35.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.635+0000 7f84027fc700 1 -- 172.21.15.86:0/3958650195 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83f4051350 con 0x7f840c150180 2023-10-09T11:57:35.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.869+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f840c04c3c0 con 0x7f840c150180 2023-10-09T11:57:35.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.870+0000 7f84027fc700 1 -- 172.21.15.86:0/3958650195 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f83f4054970 con 0x7f840c150180 2023-10-09T11:57:35.871 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:35.871 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/153919105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":153919105},{"type":"v1","addr":"172.21.15.135:6834","nonce":153919105}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4109315239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4109315239},{"type":"v1","addr":"172.21.15.135:6835","nonce":4109315239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3614877595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":3614877595},{"type":"v1","addr":"172.21.15.86:6835","nonce":3614877595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6702,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/567273052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":567273052},{"type":"v1","addr":"172.21.15.86:6834","nonce":567273052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f83ec066f30 msgr2=0x7f83ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f83ec066f30 0x7f83ec0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00a5a0 tx=0x7f83fc01a000 comp rx=0 tx=0).stop 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f840c150180 msgr2=0x7f840c0b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f840c150180 0x7f840c0b0dd0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f83f400c5b0 tx=0x7f83f4007e10 comp rx=0 tx=0).stop 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 shutdown_connections 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f840c150550 0x7f840c0adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f840c0c7410 0x7f840c14b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f83ec066f30 0x7f83ec0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 --2- 172.21.15.86:0/3958650195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f840c150180 0x7f840c0b0dd0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:35.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 >> 172.21.15.86:0/3958650195 conn(0x7f840c0cc1f0 msgr2=0x7f840c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:35.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 shutdown_connections 2023-10-09T11:57:35.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:35.872+0000 7f840b59e700 1 -- 172.21.15.86:0/3958650195 wait complete. 2023-10-09T11:57:35.875 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 41 2023-10-09T11:57:35.891 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:57:35.892 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:57:35.892 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:57:35.892 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:57:35.892 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:57:35.892 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:57:35.892 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:57:35.892 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:57:35.893 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:57:35.893 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:57:35.893 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:57:35.893 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:57:35.893 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:57:35.893 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:57:35.894 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:57:35.894 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:57:35.905 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:57:35.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:57:35.906 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:57:35.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:57:35.912 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:57:35.913 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:57:35.914 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:57:35.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:57:35.950 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:57:35.950 DEBUG:teuthology.parallel:result is None 2023-10-09T11:57:35.952 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:57:35.953 DEBUG:teuthology.parallel:result is None 2023-10-09T11:57:35.958 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:57:35.958 DEBUG:teuthology.parallel:result is None 2023-10-09T11:57:35.961 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:57:35.961 DEBUG:teuthology.parallel:result is None 2023-10-09T11:57:35.961 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:57:36.083 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:57:36.085 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:57:36.099 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:57:36.100 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T11:57:36.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-09T11:57:36.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-09T11:57:36.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-09T11:57:36.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.152+0000 7f1f373ff700 1 Processor -- start 2023-10-09T11:57:36.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.152+0000 7f1f373ff700 1 -- start start 2023-10-09T11:57:36.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.153+0000 7f1f373ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1f300cbf30 0x7f1f300ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:36.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.153+0000 7f1f373ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300ccf90 0x7f1f300b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:36.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f373ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f3015a270 0x7f1f300b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:36.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f373ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f30156bf0 con 0x7f1f3015a270 2023-10-09T11:57:36.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f373ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f300ae950 con 0x7f1f300cbf30 2023-10-09T11:57:36.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f373ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300cc300 con 0x7f1f300ccf90 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f3015a270 0x7f1f300b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3499a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300ccf90 0x7f1f300b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1f3015a270 0x7f1f300b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50112/0 (socket says 172.21.15.86:50112) 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 -- 172.21.15.86:0/637358413 learned_addr learned my addr 172.21.15.86:0/637358413 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3519b700 1 --2- 172.21.15.86:0/637358413 >> v2:172.21.15.135:3300/0 conn(0x7f1f300cbf30 0x7f1f300ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 -- 172.21.15.86:0/637358413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300ccf90 msgr2=0x7f1f300b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 --2- 172.21.15.86:0/637358413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300ccf90 0x7f1f300b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 -- 172.21.15.86:0/637358413 >> v2:172.21.15.135:3300/0 conn(0x7f1f300cbf30 msgr2=0x7f1f300ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 --2- 172.21.15.86:0/637358413 >> v2:172.21.15.135:3300/0 conn(0x7f1f300cbf30 0x7f1f300ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.154+0000 7f1f3599c700 1 -- 172.21.15.86:0/637358413 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300ad370 con 0x7f1f3015a270 2023-10-09T11:57:36.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f3599c700 1 --2- 172.21.15.86:0/637358413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f300b1250 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1f30063d40 tx=0x7f1f2800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea04e30aa59bc2b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:36.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f27fff700 1 -- 172.21.15.86:0/637358413 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800db00 con 0x7f1f3015a270 2023-10-09T11:57:36.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f27fff700 1 -- 172.21.15.86:0/637358413 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2800dc60 con 0x7f1f3015a270 2023-10-09T11:57:36.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f27fff700 1 -- 172.21.15.86:0/637358413 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28019480 con 0x7f1f3015a270 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f373ff700 1 -- 172.21.15.86:0/637358413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 msgr2=0x7f1f300b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f373ff700 1 --2- 172.21.15.86:0/637358413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f300b1250 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1f30063d40 tx=0x7f1f2800b4f0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f373ff700 1 -- 172.21.15.86:0/637358413 shutdown_connections 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f373ff700 1 --2- 172.21.15.86:0/637358413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f300b1250 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.155+0000 7f1f373ff700 1 --2- 172.21.15.86:0/637358413 >> v2:172.21.15.135:3300/0 conn(0x7f1f300cbf30 0x7f1f300ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.156+0000 7f1f373ff700 1 --2- 172.21.15.86:0/637358413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300ccf90 0x7f1f300b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.156+0000 7f1f373ff700 1 -- 172.21.15.86:0/637358413 >> 172.21.15.86:0/637358413 conn(0x7f1f3006a320 msgr2=0x7f1f300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.156+0000 7f1f373ff700 1 -- 172.21.15.86:0/637358413 shutdown_connections 2023-10-09T11:57:36.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.156+0000 7f1f373ff700 1 -- 172.21.15.86:0/637358413 wait complete. 2023-10-09T11:57:36.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.157+0000 7f1f373ff700 1 Processor -- start 2023-10-09T11:57:36.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.157+0000 7f1f373ff700 1 -- start start 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f373ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300cbf30 0x7f1f3006f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f373ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f300ccf90 0x7f1f3006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f373ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f3006e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f373ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3006f5a0 con 0x7f1f3015a270 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f373ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3016a8e0 con 0x7f1f300ccf90 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f373ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30169cd0 con 0x7f1f300cbf30 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f3599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f3006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f3599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f3006e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50120/0 (socket says 172.21.15.86:50120) 2023-10-09T11:57:36.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.158+0000 7f1f3599c700 1 -- 172.21.15.86:0/971793982 learned_addr learned my addr 172.21.15.86:0/971793982 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3499a700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f300ccf90 0x7f1f3006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3519b700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300cbf30 0x7f1f3006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3599c700 1 -- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300cbf30 msgr2=0x7f1f3006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3599c700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300cbf30 0x7f1f3006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3599c700 1 -- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f300ccf90 msgr2=0x7f1f3006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3599c700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f300ccf90 0x7f1f3006dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3599c700 1 -- 172.21.15.86:0/971793982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2800b790 con 0x7f1f3015a270 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3499a700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f300ccf90 0x7f1f3006dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3519b700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300cbf30 0x7f1f3006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f3599c700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f3006e100 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800bc50 tx=0x7f1f2801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:36.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f257fa700 1 -- 172.21.15.86:0/971793982 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280107d0 con 0x7f1f3015a270 2023-10-09T11:57:36.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f257fa700 1 -- 172.21.15.86:0/971793982 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28010930 con 0x7f1f3015a270 2023-10-09T11:57:36.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f257fa700 1 -- 172.21.15.86:0/971793982 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28010cf0 con 0x7f1f3015a270 2023-10-09T11:57:36.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f30169fb0 con 0x7f1f3015a270 2023-10-09T11:57:36.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.159+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3016a570 con 0x7f1f3015a270 2023-10-09T11:57:36.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.160+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3016aaa0 con 0x7f1f3015a270 2023-10-09T11:57:36.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.161+0000 7f1f257fa700 1 -- 172.21.15.86:0/971793982 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f2802c430 con 0x7f1f3015a270 2023-10-09T11:57:36.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.162+0000 7f1f257fa700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:36.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.162+0000 7f1f257fa700 1 -- 172.21.15.86:0/971793982 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5874+0+0 (secure 0 0 0) 0x7f1f28014070 con 0x7f1f3015a270 2023-10-09T11:57:36.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.162+0000 7f1f3519b700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:36.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.163+0000 7f1f3519b700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f14066f30 0x7f1f140693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1f30153ca0 tx=0x7f1f2c00b040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:36.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.166+0000 7f1f257fa700 1 -- 172.21.15.86:0/971793982 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f28053820 con 0x7f1f3015a270 2023-10-09T11:57:36.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:36.374+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1f3004c3c0 con 0x7f1f3015a270 2023-10-09T11:57:37.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.276+0000 7f1f257fa700 1 -- 172.21.15.86:0/971793982 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v104) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1f28056e40 con 0x7f1f3015a270 2023-10-09T11:57:37.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f14066f30 msgr2=0x7f1f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f14066f30 0x7f1f140693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1f30153ca0 tx=0x7f1f2c00b040 comp rx=0 tx=0).stop 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 msgr2=0x7f1f3006e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f3006e100 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800bc50 tx=0x7f1f2801b000 comp rx=0 tx=0).stop 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 shutdown_connections 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f3015a270 0x7f1f3006e100 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f300cbf30 0x7f1f3006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 --2- 172.21.15.86:0/971793982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f300ccf90 0x7f1f3006dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 >> 172.21.15.86:0/971793982 conn(0x7f1f3006a320 msgr2=0x7f1f301554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:37.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 shutdown_connections 2023-10-09T11:57:37.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.279+0000 7f1f373ff700 1 -- 172.21.15.86:0/971793982 wait complete. 2023-10-09T11:57:37.282 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T11:57:37.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:57:37.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.482+0000 7f237f5ff700 1 Processor -- start 2023-10-09T11:57:37.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.482+0000 7f237f5ff700 1 -- start start 2023-10-09T11:57:37.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237f5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23781578b0 0x7f2378155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237f5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780af2f0 0x7f23780af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237f5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23780ad930 con 0x7f2378155c10 2023-10-09T11:57:37.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237f5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23780b0c80 con 0x7f23781578b0 2023-10-09T11:57:37.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237f5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780acd20 con 0x7f23780af2f0 2023-10-09T11:57:37.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237cb9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23781578b0 0x7f2378155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237db9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780af2f0 0x7f23780af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237db9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780af2f0 0x7f23780af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35774/0 (socket says 172.21.15.86:35774) 2023-10-09T11:57:37.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237d39b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f2378155c10 0x7f23780ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:41016/0 (socket says 172.21.15.86:41016) 2023-10-09T11:57:37.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237cb9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23781578b0 0x7f2378155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:37436/0 (socket says 172.21.15.86:37436) 2023-10-09T11:57:37.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.484+0000 7f237db9c700 1 -- 172.21.15.86:0/2616927566 learned_addr learned my addr 172.21.15.86:0/2616927566 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:37.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f236ffff700 1 -- 172.21.15.86:0/2616927566 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912913489 0 0) 0x7f23780ad930 con 0x7f2378155c10 2023-10-09T11:57:37.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f236ffff700 1 -- 172.21.15.86:0/2616927566 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2364003570 con 0x7f2378155c10 2023-10-09T11:57:37.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f237db9c700 1 -- 172.21.15.86:0/2616927566 >> v2:172.21.15.135:3300/0 conn(0x7f23781578b0 msgr2=0x7f2378155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:37.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f237db9c700 1 --2- 172.21.15.86:0/2616927566 >> v2:172.21.15.135:3300/0 conn(0x7f23781578b0 0x7f2378155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f237db9c700 1 -- 172.21.15.86:0/2616927566 >> v1:172.21.15.135:6789/0 conn(0x7f2378155c10 legacy=0x7f23780ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f237db9c700 1 -- 172.21.15.86:0/2616927566 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780ad000 con 0x7f23780af2f0 2023-10-09T11:57:37.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f237cb9a700 1 --2- 172.21.15.86:0/2616927566 >> v2:172.21.15.135:3300/0 conn(0x7f23781578b0 0x7f2378155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:37.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f237db9c700 1 --2- 172.21.15.86:0/2616927566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780af2f0 0x7f23780af730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23700099b0 tx=0x7f2370009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49beb19065fd9783 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:37.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f236ffff700 1 -- 172.21.15.86:0/2616927566 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000b680 con 0x7f23780af2f0 2023-10-09T11:57:37.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f236ffff700 1 -- 172.21.15.86:0/2616927566 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237000b7e0 con 0x7f23780af2f0 2023-10-09T11:57:37.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.485+0000 7f236ffff700 1 -- 172.21.15.86:0/2616927566 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000bb60 con 0x7f23780af2f0 2023-10-09T11:57:37.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 -- 172.21.15.86:0/2616927566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780af2f0 msgr2=0x7f23780af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 --2- 172.21.15.86:0/2616927566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780af2f0 0x7f23780af730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23700099b0 tx=0x7f2370009250 comp rx=0 tx=0).stop 2023-10-09T11:57:37.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 -- 172.21.15.86:0/2616927566 shutdown_connections 2023-10-09T11:57:37.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 --2- 172.21.15.86:0/2616927566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23780af2f0 0x7f23780af730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 --2- 172.21.15.86:0/2616927566 >> v2:172.21.15.135:3300/0 conn(0x7f23781578b0 0x7f2378155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 -- 172.21.15.86:0/2616927566 >> 172.21.15.86:0/2616927566 conn(0x7f237806a320 msgr2=0x7f23780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:37.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 -- 172.21.15.86:0/2616927566 shutdown_connections 2023-10-09T11:57:37.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.486+0000 7f237f5ff700 1 -- 172.21.15.86:0/2616927566 wait complete. 2023-10-09T11:57:37.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.487+0000 7f237f5ff700 1 Processor -- start 2023-10-09T11:57:37.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.488+0000 7f237f5ff700 1 -- start start 2023-10-09T11:57:37.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237f5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23780af2f0 0x7f2378159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237f5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2378155c10 0x7f237814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237f5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23781578b0 0x7f237806e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237f5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237814e070 con 0x7f23780af2f0 2023-10-09T11:57:37.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237f5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780aa200 con 0x7f2378155c10 2023-10-09T11:57:37.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237f5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780aa690 con 0x7f23781578b0 2023-10-09T11:57:37.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23780af2f0 0x7f2378159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23780af2f0 0x7f2378159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50128/0 (socket says 172.21.15.86:50128) 2023-10-09T11:57:37.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 -- 172.21.15.86:0/3981571221 learned_addr learned my addr 172.21.15.86:0/3981571221 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:37.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 -- 172.21.15.86:0/3981571221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23781578b0 msgr2=0x7f237806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23781578b0 0x7f237806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 -- 172.21.15.86:0/3981571221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2378155c10 msgr2=0x7f237814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2378155c10 0x7f237814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 -- 172.21.15.86:0/3981571221 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236800a5d0 con 0x7f23780af2f0 2023-10-09T11:57:37.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.489+0000 7f237d39b700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23780af2f0 0x7f2378159410 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f237400cdb0 tx=0x7f2374001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:37.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.490+0000 7f236d7fa700 1 -- 172.21.15.86:0/3981571221 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374005df0 con 0x7f23780af2f0 2023-10-09T11:57:37.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.490+0000 7f236d7fa700 1 -- 172.21.15.86:0/3981571221 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237400a900 con 0x7f23780af2f0 2023-10-09T11:57:37.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.490+0000 7f236d7fa700 1 -- 172.21.15.86:0/3981571221 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237400acc0 con 0x7f23780af2f0 2023-10-09T11:57:37.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.490+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23700094f0 con 0x7f23780af2f0 2023-10-09T11:57:37.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.490+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23780a98d0 con 0x7f23780af2f0 2023-10-09T11:57:37.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.491+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237804c3c0 con 0x7f23780af2f0 2023-10-09T11:57:37.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.492+0000 7f236d7fa700 1 -- 172.21.15.86:0/3981571221 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2374007300 con 0x7f23780af2f0 2023-10-09T11:57:37.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.492+0000 7f236d7fa700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f235c066f30 0x7f235c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.492+0000 7f236d7fa700 1 -- 172.21.15.86:0/3981571221 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f2374084570 con 0x7f23780af2f0 2023-10-09T11:57:37.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.493+0000 7f237cb9a700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f235c066f30 0x7f235c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.493+0000 7f237cb9a700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f235c066f30 0x7f235c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23780aa910 tx=0x7f236800a330 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:37.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.497+0000 7f236d7fa700 1 -- 172.21.15.86:0/3981571221 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2374051a40 con 0x7f23780af2f0 2023-10-09T11:57:37.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.762+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f23780ad2e0 con 0x7f23780af2f0 2023-10-09T11:57:37.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.763+0000 7f236d7fa700 1 -- 172.21.15.86:0/3981571221 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2374055060 con 0x7f23780af2f0 2023-10-09T11:57:37.764 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:37.764 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:57:37.764 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T11:57:37.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:57:37.767 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:57:37.768 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.769 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.770 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.771 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.776 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:37.782 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T11:57:37.783 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:57:37.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f235c066f30 msgr2=0x7f235c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f235c066f30 0x7f235c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23780aa910 tx=0x7f236800a330 comp rx=0 tx=0).stop 2023-10-09T11:57:37.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23780af2f0 msgr2=0x7f2378159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23780af2f0 0x7f2378159410 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f237400cdb0 tx=0x7f2374001b90 comp rx=0 tx=0).stop 2023-10-09T11:57:37.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 shutdown_connections 2023-10-09T11:57:37.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f235c066f30 0x7f235c0693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23780af2f0 0x7f2378159410 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23781578b0 0x7f237806e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 --2- 172.21.15.86:0/3981571221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2378155c10 0x7f237814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 >> 172.21.15.86:0/3981571221 conn(0x7f237806a320 msgr2=0x7f237806f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:37.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 shutdown_connections 2023-10-09T11:57:37.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.765+0000 7f237f5ff700 1 -- 172.21.15.86:0/3981571221 wait complete. 2023-10-09T11:57:37.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:37.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.969+0000 7f41a7dff700 1 Processor -- start 2023-10-09T11:57:37.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.969+0000 7f41a7dff700 1 -- start start 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.970+0000 7f41a7dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41a00b1850 0x7f41a00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.970+0000 7f41a7dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a00abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.970+0000 7f41a7dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a00cb300 con 0x7f41a00ae680 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.970+0000 7f41a7dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a006fc30 con 0x7f41a00b1850 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.970+0000 7f41a7dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00cc260 con 0x7f41a01579f0 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.970+0000 7f41a5b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41a00b1850 0x7f41a00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.970+0000 7f41a539a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f41a00ae680 0x7f41a01572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38458/0 (socket says 172.21.15.86:38458) 2023-10-09T11:57:37.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a539a700 1 -- 172.21.15.86:0/788439150 learned_addr learned my addr 172.21.15.86:0/788439150 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a4b99700 1 -- 172.21.15.86:0/788439150 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725488346 0 0) 0x7f41a00cb300 con 0x7f41a00ae680 2023-10-09T11:57:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a639c700 1 --2- 172.21.15.86:0/788439150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a00abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a4b99700 1 -- 172.21.15.86:0/788439150 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f418c003570 con 0x7f41a00ae680 2023-10-09T11:57:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a5b9b700 1 -- 172.21.15.86:0/788439150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 msgr2=0x7f41a00abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a5b9b700 1 --2- 172.21.15.86:0/788439150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a00abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a5b9b700 1 -- 172.21.15.86:0/788439150 >> v1:172.21.15.86:6789/0 conn(0x7f41a00ae680 legacy=0x7f41a01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a5b9b700 1 -- 172.21.15.86:0/788439150 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a00cb5e0 con 0x7f41a00b1850 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a639c700 1 --2- 172.21.15.86:0/788439150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a00abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a5b9b700 1 --2- 172.21.15.86:0/788439150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a00b1c20 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f419c009910 tx=0x7f419c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810a271efef67bde server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a4b99700 1 -- 172.21.15.86:0/788439150 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00b640 con 0x7f41a00b1850 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a4b99700 1 -- 172.21.15.86:0/788439150 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00b7a0 con 0x7f41a00b1850 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.971+0000 7f41a4b99700 1 -- 172.21.15.86:0/788439150 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00bb60 con 0x7f41a00b1850 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 -- 172.21.15.86:0/788439150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 msgr2=0x7f41a00b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 --2- 172.21.15.86:0/788439150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a00b1c20 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f419c009910 tx=0x7f419c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 -- 172.21.15.86:0/788439150 shutdown_connections 2023-10-09T11:57:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 --2- 172.21.15.86:0/788439150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a00abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 --2- 172.21.15.86:0/788439150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a00b1c20 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 -- 172.21.15.86:0/788439150 >> 172.21.15.86:0/788439150 conn(0x7f41a006a320 msgr2=0x7f41a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 -- 172.21.15.86:0/788439150 shutdown_connections 2023-10-09T11:57:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.972+0000 7f41a7dff700 1 -- 172.21.15.86:0/788439150 wait complete. 2023-10-09T11:57:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.973+0000 7f41a7dff700 1 Processor -- start 2023-10-09T11:57:37.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.974+0000 7f41a7dff700 1 -- start start 2023-10-09T11:57:37.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a7dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00ae680 0x7f41a0151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a7dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a016a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a7dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a01597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a7dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0156370 con 0x7f41a00b1850 2023-10-09T11:57:37.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a7dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0157f30 con 0x7f41a00ae680 2023-10-09T11:57:37.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a7dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0158210 con 0x7f41a01579f0 2023-10-09T11:57:37.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a016a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a016a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50154/0 (socket says 172.21.15.86:50154) 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 -- 172.21.15.86:0/3506515027 learned_addr learned my addr 172.21.15.86:0/3506515027 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a5b9b700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00ae680 0x7f41a0151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a639c700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a01597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 -- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 msgr2=0x7f41a01597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a01597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 -- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00ae680 msgr2=0x7f41a0151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00ae680 0x7f41a0151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:37.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 -- 172.21.15.86:0/3506515027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c009420 con 0x7f41a00b1850 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.975+0000 7f41a539a700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a016a510 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f419000c7c0 tx=0x7f4190007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.976+0000 7f4195ffb700 1 -- 172.21.15.86:0/3506515027 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190005b30 con 0x7f41a00b1850 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.976+0000 7f4195ffb700 1 -- 172.21.15.86:0/3506515027 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190005c90 con 0x7f41a00b1850 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.976+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a01584f0 con 0x7f41a00b1850 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.976+0000 7f4195ffb700 1 -- 172.21.15.86:0/3506515027 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190007340 con 0x7f41a00b1850 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.976+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a016aa50 con 0x7f41a00b1850 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.977+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a01589f0 con 0x7f41a00b1850 2023-10-09T11:57:37.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.978+0000 7f4195ffb700 1 -- 172.21.15.86:0/3506515027 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f419001b400 con 0x7f41a00b1850 2023-10-09T11:57:37.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.979+0000 7f4195ffb700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4184066f30 0x7f41840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:37.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.979+0000 7f4195ffb700 1 -- 172.21.15.86:0/3506515027 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f4190083ee0 con 0x7f41a00b1850 2023-10-09T11:57:37.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.979+0000 7f41a5b9b700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4184066f30 0x7f41840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:37.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.979+0000 7f41a5b9b700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4184066f30 0x7f41840693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41a006f500 tx=0x7f419c017000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:37.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:37.983+0000 7f4195ffb700 1 -- 172.21.15.86:0/3506515027 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4190051310 con 0x7f41a00b1850 2023-10-09T11:57:38.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.175+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41a004c3c0 con 0x7f41a00b1850 2023-10-09T11:57:38.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.176+0000 7f4195ffb700 1 -- 172.21.15.86:0/3506515027 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+12754 (secure 0 0 0) 0x7f4190054930 con 0x7f41a00b1850 2023-10-09T11:57:38.178 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:38.178 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":104,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:37.274604+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:38.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4184066f30 msgr2=0x7f41840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4184066f30 0x7f41840693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f41a006f500 tx=0x7f419c017000 comp rx=0 tx=0).stop 2023-10-09T11:57:38.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 msgr2=0x7f41a016a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a016a510 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f419000c7c0 tx=0x7f4190007e00 comp rx=0 tx=0).stop 2023-10-09T11:57:38.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 shutdown_connections 2023-10-09T11:57:38.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a01579f0 0x7f41a01597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00ae680 0x7f41a0151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4184066f30 0x7f41840693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 --2- 172.21.15.86:0/3506515027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41a00b1850 0x7f41a016a510 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 >> 172.21.15.86:0/3506515027 conn(0x7f41a006a320 msgr2=0x7f41a0152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:38.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 shutdown_connections 2023-10-09T11:57:38.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.179+0000 7f41a7dff700 1 -- 172.21.15.86:0/3506515027 wait complete. 2023-10-09T11:57:38.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:57:38.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:57:38.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.381+0000 7f52e9d9d700 1 Processor -- start 2023-10-09T11:57:38.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.381+0000 7f52e9d9d700 1 -- start start 2023-10-09T11:57:38.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.382+0000 7f52e9d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e40ae7e0 0x7f52e40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.382+0000 7f52e9d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e406ebd0 con 0x7f52e406f060 2023-10-09T11:57:38.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.382+0000 7f52e9d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e415aa70 con 0x7f52e40cb1a0 2023-10-09T11:57:38.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.382+0000 7f52e9d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e415b2e0 con 0x7f52e40ae7e0 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.382+0000 7f52e3fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f52e406f060 0x7f52e40ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38468/0 (socket says 172.21.15.86:38468) 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.382+0000 7f52e3fff700 1 -- 172.21.15.86:0/3714295316 learned_addr learned my addr 172.21.15.86:0/3714295316 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e959c700 1 --2- 172.21.15.86:0/3714295316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e40ae7e0 0x7f52e40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e37fe700 1 -- 172.21.15.86:0/3714295316 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188327030 0 0) 0x7f52e406ebd0 con 0x7f52e406f060 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e37fe700 1 -- 172.21.15.86:0/3714295316 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d4003570 con 0x7f52e406f060 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e37fe700 1 -- 172.21.15.86:0/3714295316 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330466909 0 0) 0x7f52e415aa70 con 0x7f52e40cb1a0 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e37fe700 1 -- 172.21.15.86:0/3714295316 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e406ebd0 con 0x7f52e40cb1a0 2023-10-09T11:57:38.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e959c700 1 -- 172.21.15.86:0/3714295316 >> v1:172.21.15.135:6789/0 conn(0x7f52e40cb1a0 legacy=0x7f52e415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e959c700 1 -- 172.21.15.86:0/3714295316 >> v1:172.21.15.86:6789/0 conn(0x7f52e406f060 legacy=0x7f52e40ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e959c700 1 -- 172.21.15.86:0/3714295316 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e415ad20 con 0x7f52e40ae7e0 2023-10-09T11:57:38.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.383+0000 7f52e959c700 1 --2- 172.21.15.86:0/3714295316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e40ae7e0 0x7f52e40c9db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e90 tx=0x7f52dc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d54181a42a5495e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:38.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e37fe700 1 -- 172.21.15.86:0/3714295316 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00e070 con 0x7f52e40ae7e0 2023-10-09T11:57:38.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e37fe700 1 -- 172.21.15.86:0/3714295316 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc00bc10 con 0x7f52e40ae7e0 2023-10-09T11:57:38.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e37fe700 1 -- 172.21.15.86:0/3714295316 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc012430 con 0x7f52e40ae7e0 2023-10-09T11:57:38.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e9d9d700 1 -- 172.21.15.86:0/3714295316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e40ae7e0 msgr2=0x7f52e40c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/3714295316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e40ae7e0 0x7f52e40c9db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e90 tx=0x7f52dc009780 comp rx=0 tx=0).stop 2023-10-09T11:57:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e9d9d700 1 -- 172.21.15.86:0/3714295316 shutdown_connections 2023-10-09T11:57:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/3714295316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e40ae7e0 0x7f52e40c9db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e9d9d700 1 -- 172.21.15.86:0/3714295316 >> 172.21.15.86:0/3714295316 conn(0x7f52e40cc1e0 msgr2=0x7f52e40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e9d9d700 1 -- 172.21.15.86:0/3714295316 shutdown_connections 2023-10-09T11:57:38.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.384+0000 7f52e9d9d700 1 -- 172.21.15.86:0/3714295316 wait complete. 2023-10-09T11:57:38.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.386+0000 7f52e9d9d700 1 Processor -- start 2023-10-09T11:57:38.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.386+0000 7f52e9d9d700 1 -- start start 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e9d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e406f060 0x7f52e4143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e9d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e40ae7e0 0x7f52e40c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e9d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52e40cb1a0 0x7f52e40b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e9d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4144460 con 0x7f52e40cb1a0 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e9d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40c6520 con 0x7f52e40ae7e0 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e9d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4157730 con 0x7f52e406f060 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52e40cb1a0 0x7f52e40b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e959c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52e40cb1a0 0x7f52e40b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50168/0 (socket says 172.21.15.86:50168) 2023-10-09T11:57:38.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e959c700 1 -- 172.21.15.86:0/993151299 learned_addr learned my addr 172.21.15.86:0/993151299 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:38.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e8d9b700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e406f060 0x7f52e4143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.387+0000 7f52e3fff700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e40ae7e0 0x7f52e40c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e959c700 1 -- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e406f060 msgr2=0x7f52e4143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e959c700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e406f060 0x7f52e4143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e959c700 1 -- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e40ae7e0 msgr2=0x7f52e40c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e959c700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e40ae7e0 0x7f52e40c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e959c700 1 -- 172.21.15.86:0/993151299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc009a20 con 0x7f52e40cb1a0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e959c700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52e40cb1a0 0x7f52e40b0620 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f52e406ce80 tx=0x7f52dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e0ff9700 1 -- 172.21.15.86:0/993151299 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc012e20 con 0x7f52e40cb1a0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e0ff9700 1 -- 172.21.15.86:0/993151299 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc01d630 con 0x7f52e40cb1a0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e40c3800 con 0x7f52e40cb1a0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e0ff9700 1 -- 172.21.15.86:0/993151299 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc01d9f0 con 0x7f52e40cb1a0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.388+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e41570e0 con 0x7f52e40cb1a0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.389+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e406c450 con 0x7f52e40cb1a0 2023-10-09T11:57:38.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.390+0000 7f52e0ff9700 1 -- 172.21.15.86:0/993151299 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52dc024070 con 0x7f52e40cb1a0 2023-10-09T11:57:38.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.391+0000 7f52e0ff9700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c8066f30 0x7f52c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.392+0000 7f52e0ff9700 1 -- 172.21.15.86:0/993151299 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f52dc086c10 con 0x7f52e40cb1a0 2023-10-09T11:57:38.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.392+0000 7f52e8d9b700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c8066f30 0x7f52c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.392+0000 7f52e8d9b700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c8066f30 0x7f52c80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f52d8007fd0 tx=0x7f52d8007d10 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:38.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.396+0000 7f52e0ff9700 1 -- 172.21.15.86:0/993151299 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52dc053fc0 con 0x7f52e40cb1a0 2023-10-09T11:57:38.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.587+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52e404bb80 con 0x7f52e40cb1a0 2023-10-09T11:57:38.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.588+0000 7f52e0ff9700 1 -- 172.21.15.86:0/993151299 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52dc02c0a0 con 0x7f52e40cb1a0 2023-10-09T11:57:38.589 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c8066f30 msgr2=0x7f52c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c8066f30 0x7f52c80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f52d8007fd0 tx=0x7f52d8007d10 comp rx=0 tx=0).stop 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52e40cb1a0 msgr2=0x7f52e40b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52e40cb1a0 0x7f52e40b0620 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f52e406ce80 tx=0x7f52dc019000 comp rx=0 tx=0).stop 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 shutdown_connections 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c8066f30 0x7f52c80693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52e40cb1a0 0x7f52e40b0620 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52e406f060 0x7f52e4143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 --2- 172.21.15.86:0/993151299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e40ae7e0 0x7f52e40c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 >> 172.21.15.86:0/993151299 conn(0x7f52e40cc1e0 msgr2=0x7f52e40c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:38.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 shutdown_connections 2023-10-09T11:57:38.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.590+0000 7f52e9d9d700 1 -- 172.21.15.86:0/993151299 wait complete. 2023-10-09T11:57:38.609 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:57:38.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.787+0000 7ff35759e700 1 Processor -- start 2023-10-09T11:57:38.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.787+0000 7ff35759e700 1 -- start start 2023-10-09T11:57:38.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff358157770 0x7ff358150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff3580c6d00 0x7ff3580c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35806e2a0 con 0x7ff35806e730 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff358157b40 con 0x7ff358157770 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3580c7690 con 0x7ff3580c6d00 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff358157770 0x7ff358150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff358157770 0x7ff358150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50178/0 (socket says 172.21.15.86:50178) 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.788+0000 7ff35659c700 1 -- 172.21.15.86:0/2081134971 learned_addr learned my addr 172.21.15.86:0/2081134971 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35659c700 1 -- 172.21.15.86:0/2081134971 >> v2:172.21.15.135:3300/0 conn(0x7ff3580c6d00 msgr2=0x7ff3580c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff355d9b700 1 --2- 172.21.15.86:0/2081134971 >> v2:172.21.15.135:3300/0 conn(0x7ff3580c6d00 0x7ff3580c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35659c700 1 --2- 172.21.15.86:0/2081134971 >> v2:172.21.15.135:3300/0 conn(0x7ff3580c6d00 0x7ff3580c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35659c700 1 -- 172.21.15.86:0/2081134971 >> v1:172.21.15.135:6789/0 conn(0x7ff35806e730 legacy=0x7ff35806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35659c700 1 -- 172.21.15.86:0/2081134971 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35806b2e0 con 0x7ff358157770 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35659c700 1 --2- 172.21.15.86:0/2081134971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff358157770 0x7ff358150180 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff35806d1e0 tx=0x7ff348009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566be5c231c61c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35559a700 1 -- 172.21.15.86:0/2081134971 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800b820 con 0x7ff358157770 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35559a700 1 -- 172.21.15.86:0/2081134971 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34800b980 con 0x7ff358157770 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.789+0000 7ff35559a700 1 -- 172.21.15.86:0/2081134971 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800bd20 con 0x7ff358157770 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 -- 172.21.15.86:0/2081134971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff358157770 msgr2=0x7ff358150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 --2- 172.21.15.86:0/2081134971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff358157770 0x7ff358150180 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff35806d1e0 tx=0x7ff348009250 comp rx=0 tx=0).stop 2023-10-09T11:57:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 -- 172.21.15.86:0/2081134971 shutdown_connections 2023-10-09T11:57:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 --2- 172.21.15.86:0/2081134971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff358157770 0x7ff358150180 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 --2- 172.21.15.86:0/2081134971 >> v2:172.21.15.135:3300/0 conn(0x7ff3580c6d00 0x7ff3580c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 -- 172.21.15.86:0/2081134971 >> 172.21.15.86:0/2081134971 conn(0x7ff3580cc1f0 msgr2=0x7ff3580cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 -- 172.21.15.86:0/2081134971 shutdown_connections 2023-10-09T11:57:38.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.790+0000 7ff35759e700 1 -- 172.21.15.86:0/2081134971 wait complete. 2023-10-09T11:57:38.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.791+0000 7ff35759e700 1 Processor -- start 2023-10-09T11:57:38.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.792+0000 7ff35759e700 1 -- start start 2023-10-09T11:57:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.792+0000 7ff35759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35806e730 0x7ff3580afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.792+0000 7ff35759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3580c6d00 0x7ff3580b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff35759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff358157770 0x7ff35814e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff35759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580ad760 con 0x7ff3580c6d00 2023-10-09T11:57:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff35759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580ae2a0 con 0x7ff358157770 2023-10-09T11:57:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff35759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580cb880 con 0x7ff35806e730 2023-10-09T11:57:38.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3580c6d00 0x7ff3580b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3580c6d00 0x7ff3580b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50184/0 (socket says 172.21.15.86:50184) 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 -- 172.21.15.86:0/3828094673 learned_addr learned my addr 172.21.15.86:0/3828094673 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 -- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35806e730 msgr2=0x7ff3580afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35806e730 0x7ff3580afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff356d9d700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff358157770 0x7ff35814e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 -- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff358157770 msgr2=0x7ff35814e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff358157770 0x7ff35814e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 -- 172.21.15.86:0/3828094673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3480094f0 con 0x7ff3580c6d00 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff356d9d700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff358157770 0x7ff35814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.793+0000 7ff355d9b700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3580c6d00 0x7ff3580b0010 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c880 tx=0x7ff34c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.794+0000 7ff3467fc700 1 -- 172.21.15.86:0/3828094673 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011600 con 0x7ff3580c6d00 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.794+0000 7ff3467fc700 1 -- 172.21.15.86:0/3828094673 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c0117a0 con 0x7ff3580c6d00 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.794+0000 7ff3467fc700 1 -- 172.21.15.86:0/3828094673 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011b60 con 0x7ff3580c6d00 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.794+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3580ad970 con 0x7ff3580c6d00 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.794+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3580adf30 con 0x7ff3580c6d00 2023-10-09T11:57:38.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.795+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35804c3c0 con 0x7ff3580c6d00 2023-10-09T11:57:38.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.796+0000 7ff3467fc700 1 -- 172.21.15.86:0/3828094673 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff34c018360 con 0x7ff3580c6d00 2023-10-09T11:57:38.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.797+0000 7ff3467fc700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff338066f30 0x7ff3380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:38.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.797+0000 7ff3467fc700 1 -- 172.21.15.86:0/3828094673 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5229+0+0 (secure 0 0 0) 0x7ff34c084190 con 0x7ff3580c6d00 2023-10-09T11:57:38.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.797+0000 7ff35659c700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff338066f30 0x7ff3380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:38.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.798+0000 7ff35659c700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff338066f30 0x7ff3380693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff35806d1e0 tx=0x7ff348018000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:38.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.801+0000 7ff3467fc700 1 -- 172.21.15.86:0/3828094673 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff34c0515e0 con 0x7ff3580c6d00 2023-10-09T11:57:38.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.994+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff3580ae410 con 0x7ff3580c6d00 2023-10-09T11:57:38.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.994+0000 7ff3467fc700 1 -- 172.21.15.86:0/3828094673 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v104) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff34c054c00 con 0x7ff3580c6d00 2023-10-09T11:57:38.996 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:38.997 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:57:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T11:57:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T11:57:38.997 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:38.997 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:57:38.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff338066f30 msgr2=0x7ff3380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff338066f30 0x7ff3380693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff35806d1e0 tx=0x7ff348018000 comp rx=0 tx=0).stop 2023-10-09T11:57:38.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3580c6d00 msgr2=0x7ff3580b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:38.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3580c6d00 0x7ff3580b0010 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00c880 tx=0x7ff34c008040 comp rx=0 tx=0).stop 2023-10-09T11:57:38.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 shutdown_connections 2023-10-09T11:57:38.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff358157770 0x7ff35814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:38.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35806e730 0x7ff3580afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff338066f30 0x7ff3380693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 --2- 172.21.15.86:0/3828094673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3580c6d00 0x7ff3580b0010 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 >> 172.21.15.86:0/3828094673 conn(0x7ff3580cc1f0 msgr2=0x7ff358158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:39.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 shutdown_connections 2023-10-09T11:57:39.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:38.997+0000 7ff35759e700 1 -- 172.21.15.86:0/3828094673 wait complete. 2023-10-09T11:57:39.016 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:57:39.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:57:39.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.200+0000 7fac9b59e700 1 Processor -- start 2023-10-09T11:57:39.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.201+0000 7fac9b59e700 1 -- start start 2023-10-09T11:57:39.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac9b59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fac9c0cc8d0 0x7fac9c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:39.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac9b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac9c0ccd70 0x7fac9c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:39.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac9b59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c15a480 con 0x7fac9c0ae750 2023-10-09T11:57:39.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac9b59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c153b90 con 0x7fac9c0cc8d0 2023-10-09T11:57:39.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac9b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c0afb40 con 0x7fac9c0ccd70 2023-10-09T11:57:39.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac99d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fac9c0cc8d0 0x7fac9c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:39.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac99d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fac9c0cc8d0 0x7fac9c1596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50186/0 (socket says 172.21.15.86:50186) 2023-10-09T11:57:39.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac99d9b700 1 -- 172.21.15.86:0/1862040574 learned_addr learned my addr 172.21.15.86:0/1862040574 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:39.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.202+0000 7fac9ad9d700 1 --2- 172.21.15.86:0/1862040574 >> v2:172.21.15.135:3300/0 conn(0x7fac9c0ccd70 0x7fac9c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:39.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac99d9b700 1 -- 172.21.15.86:0/1862040574 >> v2:172.21.15.135:3300/0 conn(0x7fac9c0ccd70 msgr2=0x7fac9c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:39.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac99d9b700 1 --2- 172.21.15.86:0/1862040574 >> v2:172.21.15.135:3300/0 conn(0x7fac9c0ccd70 0x7fac9c159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac9959a700 1 -- 172.21.15.86:0/1862040574 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147968798 0 0) 0x7fac9c15a480 con 0x7fac9c0ae750 2023-10-09T11:57:39.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac99d9b700 1 -- 172.21.15.86:0/1862040574 >> v1:172.21.15.135:6789/0 conn(0x7fac9c0ae750 legacy=0x7fac9c153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:39.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac99d9b700 1 -- 172.21.15.86:0/1862040574 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0afe20 con 0x7fac9c0cc8d0 2023-10-09T11:57:39.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac9ad9d700 1 --2- 172.21.15.86:0/1862040574 >> v2:172.21.15.135:3300/0 conn(0x7fac9c0ccd70 0x7fac9c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:39.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac99d9b700 1 --2- 172.21.15.86:0/1862040574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0cc8d0 0x7fac9c1596b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fac9c157210 tx=0x7fac90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfadb8314da3a77 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac9959a700 1 -- 172.21.15.86:0/1862040574 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000b860 con 0x7fac9c0cc8d0 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac9959a700 1 -- 172.21.15.86:0/1862040574 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000b9c0 con 0x7fac9c0cc8d0 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.203+0000 7fac9959a700 1 -- 172.21.15.86:0/1862040574 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000bd60 con 0x7fac9c0cc8d0 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 -- 172.21.15.86:0/1862040574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0cc8d0 msgr2=0x7fac9c1596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1862040574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0cc8d0 0x7fac9c1596b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fac9c157210 tx=0x7fac90009250 comp rx=0 tx=0).stop 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 -- 172.21.15.86:0/1862040574 shutdown_connections 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1862040574 >> v2:172.21.15.135:3300/0 conn(0x7fac9c0ccd70 0x7fac9c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1862040574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0cc8d0 0x7fac9c1596b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 -- 172.21.15.86:0/1862040574 >> 172.21.15.86:0/1862040574 conn(0x7fac9c068e20 msgr2=0x7fac9c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:39.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 -- 172.21.15.86:0/1862040574 shutdown_connections 2023-10-09T11:57:39.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.204+0000 7fac9b59e700 1 -- 172.21.15.86:0/1862040574 wait complete. 2023-10-09T11:57:39.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.205+0000 7fac9b59e700 1 Processor -- start 2023-10-09T11:57:39.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.205+0000 7fac9b59e700 1 -- start start 2023-10-09T11:57:39.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.206+0000 7fac9b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0ae750 0x7fac9c15e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:39.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.206+0000 7fac9b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac9c0cc8d0 0x7fac9c169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.206+0000 7fac9b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9c0ccd70 0x7fac9c16c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.206+0000 7fac9b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c15c190 con 0x7fac9c0ae750 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.206+0000 7fac9b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c15ace0 con 0x7fac9c0ccd70 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.206+0000 7fac9b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c15afc0 con 0x7fac9c0cc8d0 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0ae750 0x7fac9c15e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0ae750 0x7fac9c15e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50192/0 (socket says 172.21.15.86:50192) 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 -- 172.21.15.86:0/1124024685 learned_addr learned my addr 172.21.15.86:0/1124024685 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:39.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9ad9d700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9c0ccd70 0x7fac9c16c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac99d9b700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac9c0cc8d0 0x7fac9c169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 -- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac9c0cc8d0 msgr2=0x7fac9c169750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac9c0cc8d0 0x7fac9c169750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 -- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9c0ccd70 msgr2=0x7fac9c16c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9c0ccd70 0x7fac9c16c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 -- 172.21.15.86:0/1124024685 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900094f0 con 0x7fac9c0ae750 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac99d9b700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac9c0cc8d0 0x7fac9c169750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:39.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9a59c700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0ae750 0x7fac9c15e9f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c7e0 tx=0x7fac8c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac8a7fc700 1 -- 172.21.15.86:0/1124024685 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c012630 con 0x7fac9c0ae750 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac8a7fc700 1 -- 172.21.15.86:0/1124024685 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c0127b0 con 0x7fac9c0ae750 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c15b2a0 con 0x7fac9c0ae750 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.207+0000 7fac8a7fc700 1 -- 172.21.15.86:0/1124024685 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c012b70 con 0x7fac9c0ae750 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.208+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c15bba0 con 0x7fac9c0ae750 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.209+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c15c300 con 0x7fac9c0ae750 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.209+0000 7fac8a7fc700 1 -- 172.21.15.86:0/1124024685 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac8c01b400 con 0x7fac9c0ae750 2023-10-09T11:57:39.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.211+0000 7fac8a7fc700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fac7c066f30 0x7fac7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:39.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.211+0000 7fac8a7fc700 1 -- 172.21.15.86:0/1124024685 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5229+0+0 (secure 0 0 0) 0x7fac8c083f70 con 0x7fac9c0ae750 2023-10-09T11:57:39.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.211+0000 7fac99d9b700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fac7c066f30 0x7fac7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:39.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.211+0000 7fac99d9b700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fac7c066f30 0x7fac7c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fac9c157210 tx=0x7fac90017000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:39.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.214+0000 7fac8a7fc700 1 -- 172.21.15.86:0/1124024685 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac8c051320 con 0x7fac9c0ae750 2023-10-09T11:57:39.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.403+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fac9c04c3c0 con 0x7fac9c0ae750 2023-10-09T11:57:39.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.853+0000 7fac8a7fc700 1 -- 172.21.15.86:0/1124024685 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v105) v1 ==== 138+0+0 (secure 0 0 0) 0x7fac8c054940 con 0x7fac9c0ae750 2023-10-09T11:57:39.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.859+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fac7c066f30 msgr2=0x7fac7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:39.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fac7c066f30 0x7fac7c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fac9c157210 tx=0x7fac90017000 comp rx=0 tx=0).stop 2023-10-09T11:57:39.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0ae750 msgr2=0x7fac9c15e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:39.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0ae750 0x7fac9c15e9f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c7e0 tx=0x7fac8c007df0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 shutdown_connections 2023-10-09T11:57:39.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fac7c066f30 0x7fac7c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac9c0ae750 0x7fac9c15e9f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9c0ccd70 0x7fac9c16c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 --2- 172.21.15.86:0/1124024685 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac9c0cc8d0 0x7fac9c169750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:39.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.860+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 >> 172.21.15.86:0/1124024685 conn(0x7fac9c068e20 msgr2=0x7fac9c06df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:39.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.861+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 shutdown_connections 2023-10-09T11:57:39.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:39.861+0000 7fac9b59e700 1 -- 172.21.15.86:0/1124024685 wait complete. 2023-10-09T11:57:39.864 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T11:57:39.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:57:40.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.069+0000 7f5ee4fff700 1 Processor -- start 2023-10-09T11:57:40.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.069+0000 7f5ee4fff700 1 -- start start 2023-10-09T11:57:40.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.070+0000 7f5ee4fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee0069fa0 0x7f5ee006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:40.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.070+0000 7f5ee4fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5ee0156ee0 0x7f5ee00c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:40.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.070+0000 7f5ee4fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee0156340 con 0x7f5ee00c85c0 2023-10-09T11:57:40.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.070+0000 7f5ee4fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00c8990 con 0x7f5ee0156ee0 2023-10-09T11:57:40.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.070+0000 7f5ee4fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee006ee20 con 0x7f5ee0069fa0 2023-10-09T11:57:40.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.071+0000 7f5eded9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5ee0156ee0 0x7f5ee00c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:40.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.071+0000 7f5ed7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee0069fa0 0x7f5ee006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:40.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.071+0000 7f5eded9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5ee0156ee0 0x7f5ee00c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:37494/0 (socket says 172.21.15.86:37494) 2023-10-09T11:57:40.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.071+0000 7f5eded9d700 1 -- 172.21.15.86:0/2439717545 learned_addr learned my addr 172.21.15.86:0/2439717545 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:40.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.071+0000 7f5ede59c700 1 --1- 172.21.15.86:0/2439717545 >> v1:172.21.15.135:6789/0 conn(0x7f5ee00c85c0 0x7f5ee0069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:41050/0 (socket says 172.21.15.86:41050) 2023-10-09T11:57:40.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.071+0000 7f5eded9d700 1 -- 172.21.15.86:0/2439717545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee0069fa0 msgr2=0x7f5ee006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:40.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.071+0000 7f5eded9d700 1 --2- 172.21.15.86:0/2439717545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee0069fa0 0x7f5ee006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.072+0000 7f5eded9d700 1 -- 172.21.15.86:0/2439717545 >> v1:172.21.15.135:6789/0 conn(0x7f5ee00c85c0 legacy=0x7f5ee0069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:40.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.072+0000 7f5eded9d700 1 -- 172.21.15.86:0/2439717545 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee006dd80 con 0x7f5ee0156ee0 2023-10-09T11:57:40.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.072+0000 7f5eddd9b700 1 -- 172.21.15.86:0/2439717545 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533175261 0 0) 0x7f5ee0156340 con 0x7f5ee00c85c0 2023-10-09T11:57:40.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.072+0000 7f5eded9d700 1 --2- 172.21.15.86:0/2439717545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0156ee0 0x7f5ee00c6ae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800afb0 tx=0x7f5ed800c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1d2cf8ba7271401 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:40.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.072+0000 7f5eddd9b700 1 -- 172.21.15.86:0/2439717545 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800a2e0 con 0x7f5ee0156ee0 2023-10-09T11:57:40.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.072+0000 7f5eddd9b700 1 -- 172.21.15.86:0/2439717545 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800ba70 con 0x7f5ee0156ee0 2023-10-09T11:57:40.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.072+0000 7f5eddd9b700 1 -- 172.21.15.86:0/2439717545 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800be10 con 0x7f5ee0156ee0 2023-10-09T11:57:40.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 -- 172.21.15.86:0/2439717545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0156ee0 msgr2=0x7f5ee00c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:40.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/2439717545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0156ee0 0x7f5ee00c6ae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800afb0 tx=0x7f5ed800c040 comp rx=0 tx=0).stop 2023-10-09T11:57:40.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 -- 172.21.15.86:0/2439717545 shutdown_connections 2023-10-09T11:57:40.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/2439717545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0156ee0 0x7f5ee00c6ae0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/2439717545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee0069fa0 0x7f5ee006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 -- 172.21.15.86:0/2439717545 >> 172.21.15.86:0/2439717545 conn(0x7f5ee00cc540 msgr2=0x7f5ee00cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:40.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 -- 172.21.15.86:0/2439717545 shutdown_connections 2023-10-09T11:57:40.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.073+0000 7f5ee4fff700 1 -- 172.21.15.86:0/2439717545 wait complete. 2023-10-09T11:57:40.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.074+0000 7f5ee4fff700 1 Processor -- start 2023-10-09T11:57:40.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.074+0000 7f5ee4fff700 1 -- start start 2023-10-09T11:57:40.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.075+0000 7f5ee4fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0069fa0 0x7f5ee00c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:40.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.075+0000 7f5ee4fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee00c85c0 0x7f5ee0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:40.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.075+0000 7f5ee4fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee0156ee0 0x7f5ee0169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:40.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.075+0000 7f5ee4fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c3710 con 0x7f5ee0156ee0 2023-10-09T11:57:40.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.075+0000 7f5ee4fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c1760 con 0x7f5ee0069fa0 2023-10-09T11:57:40.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.075+0000 7f5ee4fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c2e40 con 0x7f5ee00c85c0 2023-10-09T11:57:40.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee0156ee0 0x7f5ee0169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:40.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee0156ee0 0x7f5ee0169100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50200/0 (socket says 172.21.15.86:50200) 2023-10-09T11:57:40.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 -- 172.21.15.86:0/688312853 learned_addr learned my addr 172.21.15.86:0/688312853 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:40.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5ede59c700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0069fa0 0x7f5ee00c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:40.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5ed7fff700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee00c85c0 0x7f5ee0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:40.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 -- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee00c85c0 msgr2=0x7f5ee0155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:40.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee00c85c0 0x7f5ee0155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 -- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0069fa0 msgr2=0x7f5ee00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:40.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0069fa0 0x7f5ee00c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 -- 172.21.15.86:0/688312853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed800aaf0 con 0x7f5ee0156ee0 2023-10-09T11:57:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.076+0000 7f5eded9d700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee0156ee0 0x7f5ee0169100 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5ee006bc30 tx=0x7f5ed8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.077+0000 7f5ed67fc700 1 -- 172.21.15.86:0/688312853 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8013690 con 0x7f5ee0156ee0 2023-10-09T11:57:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.077+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee00c0ec0 con 0x7f5ee0156ee0 2023-10-09T11:57:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.077+0000 7f5ed67fc700 1 -- 172.21.15.86:0/688312853 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed80137f0 con 0x7f5ee0156ee0 2023-10-09T11:57:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.077+0000 7f5ed67fc700 1 -- 172.21.15.86:0/688312853 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8013bb0 con 0x7f5ee0156ee0 2023-10-09T11:57:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.077+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee00c1480 con 0x7f5ee0156ee0 2023-10-09T11:57:40.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.078+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee00c3880 con 0x7f5ee0156ee0 2023-10-09T11:57:40.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.079+0000 7f5ed67fc700 1 -- 172.21.15.86:0/688312853 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ed8003040 con 0x7f5ee0156ee0 2023-10-09T11:57:40.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.080+0000 7f5ed67fc700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ec0066f30 0x7f5ec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:40.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.080+0000 7f5ed67fc700 1 -- 172.21.15.86:0/688312853 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5599+0+0 (secure 0 0 0) 0x7f5ed8086990 con 0x7f5ee0156ee0 2023-10-09T11:57:40.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.080+0000 7f5ede59c700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ec0066f30 0x7f5ec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:40.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.080+0000 7f5ede59c700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ec0066f30 0x7f5ec00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009fd0 tx=0x7f5ed0009f60 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:40.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.084+0000 7f5ed67fc700 1 -- 172.21.15.86:0/688312853 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ee00c3880 con 0x7f5ee0156ee0 2023-10-09T11:57:40.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.276+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5ee00c3850 con 0x7f5ee0156ee0 2023-10-09T11:57:40.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.858+0000 7f5ed67fc700 1 -- 172.21.15.86:0/688312853 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v106) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5ed802b020 con 0x7f5ee0156ee0 2023-10-09T11:57:40.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.864+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ec0066f30 msgr2=0x7f5ec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:40.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.865+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ec0066f30 0x7f5ec00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009fd0 tx=0x7f5ed0009f60 comp rx=0 tx=0).stop 2023-10-09T11:57:40.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.865+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee0156ee0 msgr2=0x7f5ee0169100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:40.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.865+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee0156ee0 0x7f5ee0169100 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5ee006bc30 tx=0x7f5ed8015000 comp rx=0 tx=0).stop 2023-10-09T11:57:40.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.866+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 shutdown_connections 2023-10-09T11:57:40.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.866+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ec0066f30 0x7f5ec00693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.866+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee0156ee0 0x7f5ee0169100 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.866+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee0069fa0 0x7f5ee00c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.867+0000 7f5ee4fff700 1 --2- 172.21.15.86:0/688312853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ee00c85c0 0x7f5ee0155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:40.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.867+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 >> 172.21.15.86:0/688312853 conn(0x7f5ee00cc540 msgr2=0x7f5ee01572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:40.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.869+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 shutdown_connections 2023-10-09T11:57:40.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:40.870+0000 7f5ee4fff700 1 -- 172.21.15.86:0/688312853 wait complete. 2023-10-09T11:57:40.881 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T11:57:40.898 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:57:40.942 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:57:40.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:57:41.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.085+0000 7ff56e59d700 1 Processor -- start 2023-10-09T11:57:41.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.085+0000 7ff56e59d700 1 -- start start 2023-10-09T11:57:41.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.086+0000 7ff56e59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff568159a60 0x7ff5680c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:41.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.086+0000 7ff56e59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680c9cb0 con 0x7ff5680ccc00 2023-10-09T11:57:41.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.086+0000 7ff56e59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680c9f30 con 0x7ff5680cb230 2023-10-09T11:57:41.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.086+0000 7ff56e59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56806dfc0 con 0x7ff568159a60 2023-10-09T11:57:41.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff56cd9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff5680ccc00 0x7ff568069ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38482/0 (socket says 172.21.15.86:38482) 2023-10-09T11:57:41.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff56cd9a700 1 -- 172.21.15.86:0/3533110395 learned_addr learned my addr 172.21.15.86:0/3533110395 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:41.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff56d59b700 1 --2- 172.21.15.86:0/3533110395 >> v2:172.21.15.135:3300/0 conn(0x7ff568159a60 0x7ff5680c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:41.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff55ffff700 1 -- 172.21.15.86:0/3533110395 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797880423 0 0) 0x7ff5680c9cb0 con 0x7ff5680ccc00 2023-10-09T11:57:41.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff55ffff700 1 -- 172.21.15.86:0/3533110395 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff554003570 con 0x7ff5680ccc00 2023-10-09T11:57:41.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff55ffff700 1 -- 172.21.15.86:0/3533110395 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118440793 0 0) 0x7ff5680c9f30 con 0x7ff5680cb230 2023-10-09T11:57:41.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff55ffff700 1 -- 172.21.15.86:0/3533110395 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5680c9cb0 con 0x7ff5680cb230 2023-10-09T11:57:41.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff56d59b700 1 -- 172.21.15.86:0/3533110395 >> v1:172.21.15.135:6789/0 conn(0x7ff5680cb230 legacy=0x7ff56806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:41.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff56d59b700 1 -- 172.21.15.86:0/3533110395 >> v1:172.21.15.86:6789/0 conn(0x7ff5680ccc00 legacy=0x7ff568069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.087+0000 7ff56d59b700 1 -- 172.21.15.86:0/3533110395 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680ca470 con 0x7ff568159a60 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff56d59b700 1 --2- 172.21.15.86:0/3533110395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff568159a60 0x7ff5680c9770 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098e0 tx=0x7ff5640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a623fedc71d4f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff55ffff700 1 -- 172.21.15.86:0/3533110395 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011630 con 0x7ff568159a60 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff55ffff700 1 -- 172.21.15.86:0/3533110395 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564011790 con 0x7ff568159a60 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff55ffff700 1 -- 172.21.15.86:0/3533110395 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011b30 con 0x7ff568159a60 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff56e59d700 1 -- 172.21.15.86:0/3533110395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff568159a60 msgr2=0x7ff5680c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff56e59d700 1 --2- 172.21.15.86:0/3533110395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff568159a60 0x7ff5680c9770 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098e0 tx=0x7ff5640091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff56e59d700 1 -- 172.21.15.86:0/3533110395 shutdown_connections 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff56e59d700 1 --2- 172.21.15.86:0/3533110395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff568159a60 0x7ff5680c9770 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.088+0000 7ff56e59d700 1 -- 172.21.15.86:0/3533110395 >> 172.21.15.86:0/3533110395 conn(0x7ff56806baa0 msgr2=0x7ff56806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.089+0000 7ff56e59d700 1 -- 172.21.15.86:0/3533110395 shutdown_connections 2023-10-09T11:57:41.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.089+0000 7ff56e59d700 1 -- 172.21.15.86:0/3533110395 wait complete. 2023-10-09T11:57:41.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.090+0000 7ff56e59d700 1 Processor -- start 2023-10-09T11:57:41.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.090+0000 7ff56e59d700 1 -- start start 2023-10-09T11:57:41.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56e59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5680cb230 0x7ff56816a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:41.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56e59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5680ccc00 0x7ff568153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:41.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56e59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff568159a60 0x7ff5680c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:41.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56e59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b3790 con 0x7ff568159a60 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56e59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56816ae50 con 0x7ff5680cb230 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56e59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b0be0 con 0x7ff5680ccc00 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56dd9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff568159a60 0x7ff5680c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56dd9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff568159a60 0x7ff5680c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50202/0 (socket says 172.21.15.86:50202) 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56dd9c700 1 -- 172.21.15.86:0/901437505 learned_addr learned my addr 172.21.15.86:0/901437505 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56d59b700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5680cb230 0x7ff56816a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.091+0000 7ff56cd9a700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5680ccc00 0x7ff568153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56dd9c700 1 -- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5680ccc00 msgr2=0x7ff568153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56dd9c700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5680ccc00 0x7ff568153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56dd9c700 1 -- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5680cb230 msgr2=0x7ff56816a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:41.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56dd9c700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5680cb230 0x7ff56816a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56dd9c700 1 -- 172.21.15.86:0/901437505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009420 con 0x7ff568159a60 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56cd9a700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5680ccc00 0x7ff568153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56dd9c700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff568159a60 0x7ff5680c6d40 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff56000c940 tx=0x7ff5600027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff55d7fa700 1 -- 172.21.15.86:0/901437505 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560012630 con 0x7ff568159a60 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff55d7fa700 1 -- 172.21.15.86:0/901437505 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5600127b0 con 0x7ff568159a60 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5680b3db0 con 0x7ff568159a60 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff55d7fa700 1 -- 172.21.15.86:0/901437505 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560012b70 con 0x7ff568159a60 2023-10-09T11:57:41.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.092+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5680b34b0 con 0x7ff568159a60 2023-10-09T11:57:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.093+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5680b3030 con 0x7ff568159a60 2023-10-09T11:57:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.095+0000 7ff55d7fa700 1 -- 172.21.15.86:0/901437505 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff56001b400 con 0x7ff568159a60 2023-10-09T11:57:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.095+0000 7ff55d7fa700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff54c066f30 0x7ff54c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.096+0000 7ff55d7fa700 1 -- 172.21.15.86:0/901437505 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5981+0+0 (secure 0 0 0) 0x7ff560084eb0 con 0x7ff568159a60 2023-10-09T11:57:41.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.096+0000 7ff56d59b700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff54c066f30 0x7ff54c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:41.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.096+0000 7ff56d59b700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff54c066f30 0x7ff54c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff5640093f0 tx=0x7ff564017000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:41.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.099+0000 7ff55d7fa700 1 -- 172.21.15.86:0/901437505 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff560051f70 con 0x7ff568159a60 2023-10-09T11:57:41.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.333+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff5680b3030 con 0x7ff568159a60 2023-10-09T11:57:41.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.881+0000 7ff55d7fa700 1 -- 172.21.15.86:0/901437505 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff5680b3030 con 0x7ff568159a60 2023-10-09T11:57:41.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff54c066f30 msgr2=0x7ff54c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:41.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff54c066f30 0x7ff54c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff5640093f0 tx=0x7ff564017000 comp rx=0 tx=0).stop 2023-10-09T11:57:41.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff568159a60 msgr2=0x7ff5680c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:41.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff568159a60 0x7ff5680c6d40 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff56000c940 tx=0x7ff5600027a0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 shutdown_connections 2023-10-09T11:57:41.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff54c066f30 0x7ff54c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff568159a60 0x7ff5680c6d40 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5680cb230 0x7ff56816a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 --2- 172.21.15.86:0/901437505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5680ccc00 0x7ff568153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:41.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.893+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 >> 172.21.15.86:0/901437505 conn(0x7ff56806baa0 msgr2=0x7ff56806abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:41.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.894+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 shutdown_connections 2023-10-09T11:57:41.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:41.894+0000 7ff56e59d700 1 -- 172.21.15.86:0/901437505 wait complete. 2023-10-09T11:57:41.899 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 12 and data pool 13 2023-10-09T11:57:41.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:42.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.138+0000 7f7ad0f9d700 1 Processor -- start 2023-10-09T11:57:42.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.138+0000 7f7ad0f9d700 1 -- start start 2023-10-09T11:57:42.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7ad0f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7acc156310 0x7f7acc0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7ad0f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7acc1566e0 0x7f7acc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7ad0f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc0ca860 con 0x7f7acc0ca300 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7ad0f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc0cab40 con 0x7f7acc1566e0 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7ad0f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc0cae20 con 0x7f7acc156310 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7acbfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7acc0ca300 0x7f7acc0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38486/0 (socket says 172.21.15.86:38486) 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7acaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7acc1566e0 0x7f7acc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7acbfff700 1 -- 172.21.15.86:0/2533029914 learned_addr learned my addr 172.21.15.86:0/2533029914 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:42.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.139+0000 7f7acb7fe700 1 --2- 172.21.15.86:0/2533029914 >> v2:172.21.15.135:3300/0 conn(0x7f7acc156310 0x7f7acc0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7aca7fc700 1 -- 172.21.15.86:0/2533029914 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198946143 0 0) 0x7f7acc0ca860 con 0x7f7acc0ca300 2023-10-09T11:57:42.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7aca7fc700 1 -- 172.21.15.86:0/2533029914 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab4005780 con 0x7f7acc0ca300 2023-10-09T11:57:42.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7acaffd700 1 -- 172.21.15.86:0/2533029914 >> v2:172.21.15.135:3300/0 conn(0x7f7acc156310 msgr2=0x7f7acc0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:42.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7acaffd700 1 --2- 172.21.15.86:0/2533029914 >> v2:172.21.15.135:3300/0 conn(0x7f7acc156310 0x7f7acc0c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7acaffd700 1 -- 172.21.15.86:0/2533029914 >> v1:172.21.15.86:6789/0 conn(0x7f7acc0ca300 legacy=0x7f7acc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7acaffd700 1 -- 172.21.15.86:0/2533029914 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc0cb100 con 0x7f7acc1566e0 2023-10-09T11:57:42.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7acaffd700 1 --2- 172.21.15.86:0/2533029914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc1566e0 0x7f7acc0ae000 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0cce20 tx=0x7f7ac00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3aff625dbd50c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7aca7fc700 1 -- 172.21.15.86:0/2533029914 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0011630 con 0x7f7acc1566e0 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7aca7fc700 1 -- 172.21.15.86:0/2533029914 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac00117b0 con 0x7f7acc1566e0 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.140+0000 7f7aca7fc700 1 -- 172.21.15.86:0/2533029914 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0011b70 con 0x7f7acc1566e0 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2533029914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc1566e0 msgr2=0x7f7acc0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2533029914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc1566e0 0x7f7acc0ae000 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0cce20 tx=0x7f7ac00091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2533029914 shutdown_connections 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2533029914 >> v2:172.21.15.135:3300/0 conn(0x7f7acc156310 0x7f7acc0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2533029914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc1566e0 0x7f7acc0ae000 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2533029914 >> 172.21.15.86:0/2533029914 conn(0x7f7acc0cc1f0 msgr2=0x7f7acc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:42.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2533029914 shutdown_connections 2023-10-09T11:57:42.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.141+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2533029914 wait complete. 2023-10-09T11:57:42.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.142+0000 7f7ad0f9d700 1 Processor -- start 2023-10-09T11:57:42.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.142+0000 7f7ad0f9d700 1 -- start start 2023-10-09T11:57:42.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.143+0000 7f7ad0f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7acc0ca300 0x7f7acc150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.143+0000 7f7ad0f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc156310 0x7f7acc0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.143+0000 7f7ad0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7acc1566e0 0x7f7acc0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.143+0000 7f7ad0f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc15ea10 con 0x7f7acc156310 2023-10-09T11:57:42.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.143+0000 7f7ad0f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc15de00 con 0x7f7acc0ca300 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.143+0000 7f7ad0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc15e0e0 con 0x7f7acc1566e0 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc156310 0x7f7acc0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc156310 0x7f7acc0c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50220/0 (socket says 172.21.15.86:50220) 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 -- 172.21.15.86:0/2642185379 learned_addr learned my addr 172.21.15.86:0/2642185379 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acb7fe700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7acc0ca300 0x7f7acc150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acbfff700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7acc1566e0 0x7f7acc0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 -- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7acc1566e0 msgr2=0x7f7acc0c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7acc1566e0 0x7f7acc0c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 -- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7acc0ca300 msgr2=0x7f7acc150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7acc0ca300 0x7f7acc150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 -- 172.21.15.86:0/2642185379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0009420 con 0x7f7acc156310 2023-10-09T11:57:42.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.144+0000 7f7acaffd700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc156310 0x7f7acc0c1460 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0013000 tx=0x7f7ac0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.145+0000 7f7ab37fe700 1 -- 172.21.15.86:0/2642185379 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0000d10 con 0x7f7acc156310 2023-10-09T11:57:42.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.145+0000 7f7ab37fe700 1 -- 172.21.15.86:0/2642185379 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac0011b30 con 0x7f7acc156310 2023-10-09T11:57:42.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.145+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc15e3c0 con 0x7f7acc156310 2023-10-09T11:57:42.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.145+0000 7f7ab37fe700 1 -- 172.21.15.86:0/2642185379 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac001a6a0 con 0x7f7acc156310 2023-10-09T11:57:42.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.145+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc151440 con 0x7f7acc156310 2023-10-09T11:57:42.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.146+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc15eb80 con 0x7f7acc156310 2023-10-09T11:57:42.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.147+0000 7f7ab37fe700 1 -- 172.21.15.86:0/2642185379 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ac001aa50 con 0x7f7acc156310 2023-10-09T11:57:42.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.147+0000 7f7ab37fe700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ab8066f60 0x7f7ab8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.147+0000 7f7ab37fe700 1 -- 172.21.15.86:0/2642185379 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f7ac0086320 con 0x7f7acc156310 2023-10-09T11:57:42.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.148+0000 7f7acb7fe700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ab8066f60 0x7f7ab8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.148+0000 7f7acb7fe700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ab8066f60 0x7f7ab8069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009db0 tx=0x7f7abc0091a0 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.151+0000 7f7ab37fe700 1 -- 172.21.15.86:0/2642185379 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ac0053370 con 0x7f7acc156310 2023-10-09T11:57:42.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.347+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7acc04c3c0 con 0x7f7acc156310 2023-10-09T11:57:42.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.347+0000 7f7ab37fe700 1 -- 172.21.15.86:0/2642185379 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+15995 (secure 0 0 0) 0x7f7ac0056990 con 0x7f7acc156310 2023-10-09T11:57:42.349 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:42.349 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":107,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:41.335260+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:57:39.443249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:40.316252+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:42.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ab8066f60 msgr2=0x7f7ab8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ab8066f60 0x7f7ab8069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009db0 tx=0x7f7abc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc156310 msgr2=0x7f7acc0c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc156310 0x7f7acc0c1460 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0013000 tx=0x7f7ac0017000 comp rx=0 tx=0).stop 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 shutdown_connections 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7acc1566e0 0x7f7acc0c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7acc0ca300 0x7f7acc150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7ab8066f60 0x7f7ab8069410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 --2- 172.21.15.86:0/2642185379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7acc156310 0x7f7acc0c1460 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 >> 172.21.15.86:0/2642185379 conn(0x7f7acc0cc1f0 msgr2=0x7f7acc0c2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:42.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 shutdown_connections 2023-10-09T11:57:42.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.350+0000 7f7ad0f9d700 1 -- 172.21.15.86:0/2642185379 wait complete. 2023-10-09T11:57:42.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:42.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.548+0000 7f6b741ff700 1 Processor -- start 2023-10-09T11:57:42.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.548+0000 7f6b741ff700 1 -- start start 2023-10-09T11:57:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b741ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b6c0cbf30 0x7f6b6c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b741ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6b6c0ccf90 0x7f6b6c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b741ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c0cc300 con 0x7f6b6c15a270 2023-10-09T11:57:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b741ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c156bf0 con 0x7f6b6c0cbf30 2023-10-09T11:57:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b741ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0ae950 con 0x7f6b6c0ccf90 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b71f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b6c0cbf30 0x7f6b6c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b7279c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6b6c15a270 0x7f6b6c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38488/0 (socket says 172.21.15.86:38488) 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b7279c700 1 -- 172.21.15.86:0/1305699193 learned_addr learned my addr 172.21.15.86:0/1305699193 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b7179a700 1 --2- 172.21.15.86:0/1305699193 >> v2:172.21.15.135:3300/0 conn(0x7f6b6c0ccf90 0x7f6b6c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b71f9b700 1 -- 172.21.15.86:0/1305699193 >> v2:172.21.15.135:3300/0 conn(0x7f6b6c0ccf90 msgr2=0x7f6b6c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b71f9b700 1 --2- 172.21.15.86:0/1305699193 >> v2:172.21.15.135:3300/0 conn(0x7f6b6c0ccf90 0x7f6b6c0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b71f9b700 1 -- 172.21.15.86:0/1305699193 >> v1:172.21.15.86:6789/0 conn(0x7f6b6c15a270 legacy=0x7f6b6c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b71f9b700 1 -- 172.21.15.86:0/1305699193 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0ad370 con 0x7f6b6c0cbf30 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.550+0000 7f6b70f99700 1 -- 172.21.15.86:0/1305699193 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456566763 0 0) 0x7f6b6c0cc300 con 0x7f6b6c15a270 2023-10-09T11:57:42.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.551+0000 7f6b71f9b700 1 --2- 172.21.15.86:0/1305699193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c0cbf30 0x7f6b6c0ae410 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c06d670 tx=0x7f6b680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522a80778007a3ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.551+0000 7f6b70f99700 1 -- 172.21.15.86:0/1305699193 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68009e80 con 0x7f6b6c0cbf30 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.551+0000 7f6b70f99700 1 -- 172.21.15.86:0/1305699193 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6800b820 con 0x7f6b6c0cbf30 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.551+0000 7f6b70f99700 1 -- 172.21.15.86:0/1305699193 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800bba0 con 0x7f6b6c0cbf30 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.551+0000 7f6b741ff700 1 -- 172.21.15.86:0/1305699193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c0cbf30 msgr2=0x7f6b6c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.551+0000 7f6b741ff700 1 --2- 172.21.15.86:0/1305699193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c0cbf30 0x7f6b6c0ae410 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c06d670 tx=0x7f6b680091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.552+0000 7f6b741ff700 1 -- 172.21.15.86:0/1305699193 shutdown_connections 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.552+0000 7f6b741ff700 1 --2- 172.21.15.86:0/1305699193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c0cbf30 0x7f6b6c0ae410 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.552+0000 7f6b741ff700 1 --2- 172.21.15.86:0/1305699193 >> v2:172.21.15.135:3300/0 conn(0x7f6b6c0ccf90 0x7f6b6c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.552+0000 7f6b741ff700 1 -- 172.21.15.86:0/1305699193 >> 172.21.15.86:0/1305699193 conn(0x7f6b6c06a320 msgr2=0x7f6b6c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:42.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.552+0000 7f6b741ff700 1 -- 172.21.15.86:0/1305699193 shutdown_connections 2023-10-09T11:57:42.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.552+0000 7f6b741ff700 1 -- 172.21.15.86:0/1305699193 wait complete. 2023-10-09T11:57:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.553+0000 7f6b741ff700 1 Processor -- start 2023-10-09T11:57:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.553+0000 7f6b741ff700 1 -- start start 2023-10-09T11:57:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b741ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b6c0cbf30 0x7f6b6c0ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b741ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b6c0ccf90 0x7f6b6c16b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b741ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c15a270 0x7f6b6c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b741ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0ac130 con 0x7f6b6c15a270 2023-10-09T11:57:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b741ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c16bfb0 con 0x7f6b6c0ccf90 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b741ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c167cb0 con 0x7f6b6c0cbf30 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b7279c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c15a270 0x7f6b6c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b7279c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c15a270 0x7f6b6c15e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50242/0 (socket says 172.21.15.86:50242) 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b7279c700 1 -- 172.21.15.86:0/3193667756 learned_addr learned my addr 172.21.15.86:0/3193667756 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.554+0000 7f6b71f9b700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b6c0cbf30 0x7f6b6c0ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b7179a700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b6c0ccf90 0x7f6b6c16b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b7279c700 1 -- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b6c0cbf30 msgr2=0x7f6b6c0ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b7279c700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b6c0cbf30 0x7f6b6c0ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b7279c700 1 -- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b6c0ccf90 msgr2=0x7f6b6c16b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b7279c700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b6c0ccf90 0x7f6b6c16b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b7279c700 1 -- 172.21.15.86:0/3193667756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009420 con 0x7f6b6c15a270 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b7279c700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c15a270 0x7f6b6c15e070 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400cc90 tx=0x7f6b64001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b61ffb700 1 -- 172.21.15.86:0/3193667756 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400a960 con 0x7f6b6c15a270 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b61ffb700 1 -- 172.21.15.86:0/3193667756 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6400aac0 con 0x7f6b6c15a270 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c16b710 con 0x7f6b6c15a270 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b61ffb700 1 -- 172.21.15.86:0/3193667756 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400ae80 con 0x7f6b6c15a270 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.555+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c16bcd0 con 0x7f6b6c15a270 2023-10-09T11:57:42.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.556+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c167e60 con 0x7f6b6c15a270 2023-10-09T11:57:42.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.557+0000 7f6b61ffb700 1 -- 172.21.15.86:0/3193667756 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b64007300 con 0x7f6b6c15a270 2023-10-09T11:57:42.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.558+0000 7f6b61ffb700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b50066f30 0x7f6b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.558+0000 7f6b61ffb700 1 -- 172.21.15.86:0/3193667756 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f6b64084a50 con 0x7f6b6c15a270 2023-10-09T11:57:42.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.558+0000 7f6b71f9b700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b50066f30 0x7f6b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.559+0000 7f6b71f9b700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b50066f30 0x7f6b500693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b680093f0 tx=0x7f6b68017000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.562+0000 7f6b61ffb700 1 -- 172.21.15.86:0/3193667756 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b6c167e60 con 0x7f6b6c15a270 2023-10-09T11:57:42.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.753+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b6c167e20 con 0x7f6b6c15a270 2023-10-09T11:57:42.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.754+0000 7f6b61ffb700 1 -- 172.21.15.86:0/3193667756 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+15995 (secure 0 0 0) 0x7f6b64084030 con 0x7f6b6c15a270 2023-10-09T11:57:42.756 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:42.756 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":107,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:41.335260+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:57:39.443249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:40.316252+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:42.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.756+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b50066f30 msgr2=0x7f6b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b50066f30 0x7f6b500693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b680093f0 tx=0x7f6b68017000 comp rx=0 tx=0).stop 2023-10-09T11:57:42.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c15a270 msgr2=0x7f6b6c15e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c15a270 0x7f6b6c15e070 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400cc90 tx=0x7f6b64001a80 comp rx=0 tx=0).stop 2023-10-09T11:57:42.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 shutdown_connections 2023-10-09T11:57:42.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6b50066f30 0x7f6b500693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6c15a270 0x7f6b6c15e070 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b6c0cbf30 0x7f6b6c0ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 --2- 172.21.15.86:0/3193667756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b6c0ccf90 0x7f6b6c16b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 >> 172.21.15.86:0/3193667756 conn(0x7f6b6c06a320 msgr2=0x7f6b6c158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:42.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 shutdown_connections 2023-10-09T11:57:42.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.757+0000 7f6b741ff700 1 -- 172.21.15.86:0/3193667756 wait complete. 2023-10-09T11:57:42.775 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:57:42.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-09T11:57:42.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-09T11:57:42.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-09T11:57:42.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.962+0000 7fb5849ff700 1 Processor -- start 2023-10-09T11:57:42.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.962+0000 7fb5849ff700 1 -- start start 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.963+0000 7fb5849ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb580159890 0x7fb58015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.963+0000 7fb5849ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580069560 0x7fb5800699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.963+0000 7fb5849ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb580069ee0 con 0x7fb580159c60 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.963+0000 7fb5849ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58015a160 con 0x7fb580159890 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.963+0000 7fb5849ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800d13a0 con 0x7fb580069560 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57e59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb580159890 0x7fb58015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57dd9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb580159c60 0x7fb58015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:38490/0 (socket says 172.21.15.86:38490) 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57dd9b700 1 -- 172.21.15.86:0/2399256659 learned_addr learned my addr 172.21.15.86:0/2399256659 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:42.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57e59c700 1 -- 172.21.15.86:0/2399256659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580069560 msgr2=0x7fb5800699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57ed9d700 1 --2- 172.21.15.86:0/2399256659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580069560 0x7fb5800699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57d59a700 1 -- 172.21.15.86:0/2399256659 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198034065 0 0) 0x7fb580069ee0 con 0x7fb580159c60 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57e59c700 1 --2- 172.21.15.86:0/2399256659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580069560 0x7fb5800699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57e59c700 1 -- 172.21.15.86:0/2399256659 >> v1:172.21.15.86:6789/0 conn(0x7fb580159c60 legacy=0x7fb58015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57e59c700 1 -- 172.21.15.86:0/2399256659 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58015e140 con 0x7fb580159890 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57ed9d700 1 --2- 172.21.15.86:0/2399256659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580069560 0x7fb5800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.964+0000 7fb57e59c700 1 --2- 172.21.15.86:0/2399256659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580159890 0x7fb58015abd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb5700098e0 tx=0x7fb5700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c04d4c192642bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb57d59a700 1 -- 172.21.15.86:0/2399256659 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570009e80 con 0x7fb580159890 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb57d59a700 1 -- 172.21.15.86:0/2399256659 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57000b860 con 0x7fb580159890 2023-10-09T11:57:42.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb57d59a700 1 -- 172.21.15.86:0/2399256659 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57000bbe0 con 0x7fb580159890 2023-10-09T11:57:42.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 -- 172.21.15.86:0/2399256659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580159890 msgr2=0x7fb58015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2399256659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580159890 0x7fb58015abd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb5700098e0 tx=0x7fb5700091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 -- 172.21.15.86:0/2399256659 shutdown_connections 2023-10-09T11:57:42.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2399256659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580069560 0x7fb5800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2399256659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580159890 0x7fb58015abd0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 -- 172.21.15.86:0/2399256659 >> 172.21.15.86:0/2399256659 conn(0x7fb580068e20 msgr2=0x7fb5800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:42.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 -- 172.21.15.86:0/2399256659 shutdown_connections 2023-10-09T11:57:42.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.965+0000 7fb5849ff700 1 -- 172.21.15.86:0/2399256659 wait complete. 2023-10-09T11:57:42.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.967+0000 7fb5849ff700 1 Processor -- start 2023-10-09T11:57:42.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.967+0000 7fb5849ff700 1 -- start start 2023-10-09T11:57:42.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb5849ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580069560 0x7fb5800c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb5849ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580159890 0x7fb5800b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb5849ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb580159c60 0x7fb5801518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb5849ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800b1860 con 0x7fb580069560 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb5849ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800b3590 con 0x7fb580159c60 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb5849ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb580169a90 con 0x7fb580159890 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580069560 0x7fb5800c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580069560 0x7fb5800c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50260/0 (socket says 172.21.15.86:50260) 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 -- 172.21.15.86:0/2831762219 learned_addr learned my addr 172.21.15.86:0/2831762219 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 -- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580159890 msgr2=0x7fb5800b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57dd9b700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580159890 0x7fb5800b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580159890 0x7fb5800b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 -- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb580159c60 msgr2=0x7fb5801518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb580159c60 0x7fb5801518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57e59c700 1 -- 172.21.15.86:0/2831762219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570009420 con 0x7fb580069560 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.968+0000 7fb57dd9b700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580159890 0x7fb5800b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.969+0000 7fb57e59c700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580069560 0x7fb5800c82f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb5800899c0 tx=0x7fb570017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.969+0000 7fb56e7fc700 1 -- 172.21.15.86:0/2831762219 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57000bbe0 con 0x7fb580069560 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.969+0000 7fb56e7fc700 1 -- 172.21.15.86:0/2831762219 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570011420 con 0x7fb580069560 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.969+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb580169d70 con 0x7fb580069560 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.969+0000 7fb56e7fc700 1 -- 172.21.15.86:0/2831762219 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700117c0 con 0x7fb580069560 2023-10-09T11:57:42.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.969+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58016a330 con 0x7fb580069560 2023-10-09T11:57:42.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.970+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58004c3c0 con 0x7fb580069560 2023-10-09T11:57:42.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.971+0000 7fb56e7fc700 1 -- 172.21.15.86:0/2831762219 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb570011bb0 con 0x7fb580069560 2023-10-09T11:57:42.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.972+0000 7fb56e7fc700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb560066f30 0x7fb5600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:42.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.972+0000 7fb56e7fc700 1 -- 172.21.15.86:0/2831762219 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb570085e90 con 0x7fb580069560 2023-10-09T11:57:42.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.972+0000 7fb57dd9b700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb560066f30 0x7fb5600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:42.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.973+0000 7fb57dd9b700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb560066f30 0x7fb5600693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb574001840 tx=0x7fb574009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:42.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:42.976+0000 7fb56e7fc700 1 -- 172.21.15.86:0/2831762219 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb570052f80 con 0x7fb580069560 2023-10-09T11:57:43.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.212+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb58006a5b0 con 0x7fb580069560 2023-10-09T11:57:43.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.882+0000 7fb56e7fc700 1 -- 172.21.15.86:0/2831762219 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb570011e60 con 0x7fb580069560 2023-10-09T11:57:43.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb560066f30 msgr2=0x7fb5600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:43.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb560066f30 0x7fb5600693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb574001840 tx=0x7fb574009040 comp rx=0 tx=0).stop 2023-10-09T11:57:43.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580069560 msgr2=0x7fb5800c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580069560 0x7fb5800c82f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb5800899c0 tx=0x7fb570017000 comp rx=0 tx=0).stop 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 shutdown_connections 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb560066f30 0x7fb5600693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb580069560 0x7fb5800c82f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb580159c60 0x7fb5801518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 --2- 172.21.15.86:0/2831762219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb580159890 0x7fb5800b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 >> 172.21.15.86:0/2831762219 conn(0x7fb580068e20 msgr2=0x7fb5800b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 shutdown_connections 2023-10-09T11:57:43.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:43.885+0000 7fb5849ff700 1 -- 172.21.15.86:0/2831762219 wait complete. 2023-10-09T11:57:43.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:57:44.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.088+0000 7f3b3d39d700 1 Processor -- start 2023-10-09T11:57:44.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.088+0000 7f3b3d39d700 1 -- start start 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.089+0000 7f3b3d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b38157130 0x7f3b380c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.089+0000 7f3b3d39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b3806e5e0 0x7f3b3806ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.089+0000 7f3b3d39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3806e150 con 0x7f3b380c9db0 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.089+0000 7f3b3d39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b380c7800 con 0x7f3b3806e5e0 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.089+0000 7f3b3d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380c7ae0 con 0x7f3b38157130 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b377fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b38157130 0x7f3b380c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b3806e5e0 0x7f3b3806ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b3806e5e0 0x7f3b3806ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:37576/0 (socket says 172.21.15.86:37576) 2023-10-09T11:57:44.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 -- 172.21.15.86:0/4221902878 learned_addr learned my addr 172.21.15.86:0/4221902878 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:44.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b37fff700 1 --1- 172.21.15.86:0/4221902878 >> v1:172.21.15.135:6789/0 conn(0x7f3b380c9db0 0x7f3b38153900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:41068/0 (socket says 172.21.15.86:41068) 2023-10-09T11:57:44.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 -- 172.21.15.86:0/4221902878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b38157130 msgr2=0x7f3b380c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:44.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 --2- 172.21.15.86:0/4221902878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b38157130 0x7f3b380c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 -- 172.21.15.86:0/4221902878 >> v1:172.21.15.135:6789/0 conn(0x7f3b380c9db0 legacy=0x7f3b38153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:44.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 -- 172.21.15.86:0/4221902878 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b380c7dc0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.090+0000 7f3b3cb9c700 1 --2- 172.21.15.86:0/4221902878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3806e5e0 0x7f3b3806ea60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009f20 tx=0x7f3b30009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9097c2bd74b33b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:44.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b36ffd700 1 -- 172.21.15.86:0/4221902878 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000e070 con 0x7f3b3806e5e0 2023-10-09T11:57:44.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b36ffd700 1 -- 172.21.15.86:0/4221902878 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3000b9d0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b36ffd700 1 -- 172.21.15.86:0/4221902878 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300092e0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 -- 172.21.15.86:0/4221902878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3806e5e0 msgr2=0x7f3b3806ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/4221902878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3806e5e0 0x7f3b3806ea60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009f20 tx=0x7f3b30009840 comp rx=0 tx=0).stop 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 -- 172.21.15.86:0/4221902878 shutdown_connections 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/4221902878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b3806e5e0 0x7f3b3806ea60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/4221902878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b38157130 0x7f3b380c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 -- 172.21.15.86:0/4221902878 >> 172.21.15.86:0/4221902878 conn(0x7f3b380cc1e0 msgr2=0x7f3b380cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 -- 172.21.15.86:0/4221902878 shutdown_connections 2023-10-09T11:57:44.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.091+0000 7f3b3d39d700 1 -- 172.21.15.86:0/4221902878 wait complete. 2023-10-09T11:57:44.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.093+0000 7f3b3d39d700 1 Processor -- start 2023-10-09T11:57:44.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.093+0000 7f3b3d39d700 1 -- start start 2023-10-09T11:57:44.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b3d39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b3806e5e0 0x7f3b38141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:44.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b3d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b380c9db0 0x7f3b380ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:44.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b3d39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38157130 0x7f3b38154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b3d39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38153dd0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b3d39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380ac380 con 0x7f3b38157130 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b3d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38154f30 con 0x7f3b380c9db0 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b37fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b3806e5e0 0x7f3b38141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b37fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b3806e5e0 0x7f3b38141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50270/0 (socket says 172.21.15.86:50270) 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b37fff700 1 -- 172.21.15.86:0/2925915298 learned_addr learned my addr 172.21.15.86:0/2925915298 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b377fe700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b380c9db0 0x7f3b380ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.094+0000 7f3b3cb9c700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38157130 0x7f3b38154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b37fff700 1 -- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b380c9db0 msgr2=0x7f3b380ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b37fff700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b380c9db0 0x7f3b380ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b37fff700 1 -- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38157130 msgr2=0x7f3b38154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:44.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b37fff700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38157130 0x7f3b38154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b37fff700 1 -- 172.21.15.86:0/2925915298 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30009ae0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b37fff700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b3806e5e0 0x7f3b38141e00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800c560 tx=0x7f3b28007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:44.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b1ffff700 1 -- 172.21.15.86:0/2925915298 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28005a70 con 0x7f3b3806e5e0 2023-10-09T11:57:44.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b1ffff700 1 -- 172.21.15.86:0/2925915298 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28005bd0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b38153a80 con 0x7f3b3806e5e0 2023-10-09T11:57:44.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b1ffff700 1 -- 172.21.15.86:0/2925915298 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b280070d0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.095+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b380abdc0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.096+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b381540b0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.097+0000 7f3b1ffff700 1 -- 172.21.15.86:0/2925915298 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b28007480 con 0x7f3b3806e5e0 2023-10-09T11:57:44.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.098+0000 7f3b1ffff700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b24066f30 0x7f3b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:44.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.098+0000 7f3b1ffff700 1 -- 172.21.15.86:0/2925915298 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f3b28083ac0 con 0x7f3b3806e5e0 2023-10-09T11:57:44.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.098+0000 7f3b377fe700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b24066f30 0x7f3b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:44.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.099+0000 7f3b377fe700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b24066f30 0x7f3b240693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b38153280 tx=0x7f3b2c0091a0 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:44.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.102+0000 7f3b1ffff700 1 -- 172.21.15.86:0/2925915298 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b28050b10 con 0x7f3b3806e5e0 2023-10-09T11:57:44.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.337+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3b3806dd20 con 0x7f3b3806e5e0 2023-10-09T11:57:44.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.884+0000 7f3b1ffff700 1 -- 172.21.15.86:0/2925915298 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3b28017020 con 0x7f3b3806e5e0 2023-10-09T11:57:44.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b24066f30 msgr2=0x7f3b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:44.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b24066f30 0x7f3b240693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b38153280 tx=0x7f3b2c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b3806e5e0 msgr2=0x7f3b38141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:44.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b3806e5e0 0x7f3b38141e00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800c560 tx=0x7f3b28007f70 comp rx=0 tx=0).stop 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 shutdown_connections 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3b24066f30 0x7f3b240693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b3806e5e0 0x7f3b38141e00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b38157130 0x7f3b38154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 --2- 172.21.15.86:0/2925915298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b380c9db0 0x7f3b380ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.886+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 >> 172.21.15.86:0/2925915298 conn(0x7f3b380cc1e0 msgr2=0x7f3b38069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.887+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 shutdown_connections 2023-10-09T11:57:44.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:44.887+0000 7f3b3d39d700 1 -- 172.21.15.86:0/2925915298 wait complete. 2023-10-09T11:57:44.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:45.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.088+0000 7f281ffff700 1 Processor -- start 2023-10-09T11:57:45.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.088+0000 7f281ffff700 1 -- start start 2023-10-09T11:57:45.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.089+0000 7f281ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2818159890 0x7f281815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.089+0000 7f281ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2818159c60 0x7f281815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.089+0000 7f281ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281815a160 con 0x7f281815db10 2023-10-09T11:57:45.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.089+0000 7f281ffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281815df50 con 0x7f2818159c60 2023-10-09T11:57:45.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.089+0000 7f281ffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180d13a0 con 0x7f2818159890 2023-10-09T11:57:45.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2818159c60 0x7f281815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2818159c60 0x7f281815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43496/0 (socket says 172.21.15.86:43496) 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 -- 172.21.15.86:0/1493639042 learned_addr learned my addr 172.21.15.86:0/1493639042 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281dd9b700 1 --2- 172.21.15.86:0/1493639042 >> v2:172.21.15.135:3300/0 conn(0x7f2818159890 0x7f281815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 -- 172.21.15.86:0/1493639042 >> v2:172.21.15.135:3300/0 conn(0x7f2818159890 msgr2=0x7f281815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 --2- 172.21.15.86:0/1493639042 >> v2:172.21.15.135:3300/0 conn(0x7f2818159890 0x7f281815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 -- 172.21.15.86:0/1493639042 >> v1:172.21.15.135:6789/0 conn(0x7f281815db10 legacy=0x7f2818069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 -- 172.21.15.86:0/1493639042 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281815e140 con 0x7f2818159c60 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.090+0000 7f281d59a700 1 --2- 172.21.15.86:0/1493639042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159c60 0x7f281815d5d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f28180d1090 tx=0x7f2808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bd0de29cc23814 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281cd99700 1 -- 172.21.15.86:0/1493639042 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808009e70 con 0x7f2818159c60 2023-10-09T11:57:45.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281cd99700 1 -- 172.21.15.86:0/1493639042 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280800b860 con 0x7f2818159c60 2023-10-09T11:57:45.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281cd99700 1 -- 172.21.15.86:0/1493639042 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280800bc00 con 0x7f2818159c60 2023-10-09T11:57:45.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 -- 172.21.15.86:0/1493639042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159c60 msgr2=0x7f281815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 --2- 172.21.15.86:0/1493639042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159c60 0x7f281815d5d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f28180d1090 tx=0x7f2808009250 comp rx=0 tx=0).stop 2023-10-09T11:57:45.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 -- 172.21.15.86:0/1493639042 shutdown_connections 2023-10-09T11:57:45.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 --2- 172.21.15.86:0/1493639042 >> v2:172.21.15.135:3300/0 conn(0x7f2818159890 0x7f281815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 --2- 172.21.15.86:0/1493639042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159c60 0x7f281815d5d0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 -- 172.21.15.86:0/1493639042 >> 172.21.15.86:0/1493639042 conn(0x7f2818068e20 msgr2=0x7f28180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:45.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 -- 172.21.15.86:0/1493639042 shutdown_connections 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.091+0000 7f281ffff700 1 -- 172.21.15.86:0/1493639042 wait complete. 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.093+0000 7f281ffff700 1 Processor -- start 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.093+0000 7f281ffff700 1 -- start start 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159890 0x7f2818145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818159c60 0x7f2818153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281815db10 0x7f28180c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180b4480 con 0x7f2818159890 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2818153970 con 0x7f281815db10 2023-10-09T11:57:45.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180b3590 con 0x7f2818159c60 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159890 0x7f2818145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159890 0x7f2818145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43506/0 (socket says 172.21.15.86:43506) 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 -- 172.21.15.86:0/610429776 learned_addr learned my addr 172.21.15.86:0/610429776 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281d59a700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818159c60 0x7f2818153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281e59c700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281815db10 0x7f28180c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 -- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818159c60 msgr2=0x7f2818153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818159c60 0x7f2818153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 -- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281815db10 msgr2=0x7f28180c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281815db10 0x7f28180c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281dd9b700 1 -- 172.21.15.86:0/610429776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080094f0 con 0x7f2818159890 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281d59a700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818159c60 0x7f2818153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.094+0000 7f281e59c700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281815db10 0x7f28180c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.095+0000 7f281dd9b700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159890 0x7f2818145a90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f281400ec80 tx=0x7f28140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.095+0000 7f280dffb700 1 -- 172.21.15.86:0/610429776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400c9d0 con 0x7f2818159890 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.095+0000 7f280dffb700 1 -- 172.21.15.86:0/610429776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281400cb30 con 0x7f2818159890 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.095+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28180b3870 con 0x7f2818159890 2023-10-09T11:57:45.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.095+0000 7f280dffb700 1 -- 172.21.15.86:0/610429776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814013470 con 0x7f2818159890 2023-10-09T11:57:45.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.095+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28180b3e30 con 0x7f2818159890 2023-10-09T11:57:45.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.096+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281804c3c0 con 0x7f2818159890 2023-10-09T11:57:45.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.097+0000 7f280dffb700 1 -- 172.21.15.86:0/610429776 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2814013820 con 0x7f2818159890 2023-10-09T11:57:45.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.098+0000 7f280dffb700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27fc066f30 0x7f27fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.098+0000 7f280dffb700 1 -- 172.21.15.86:0/610429776 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f2814084a40 con 0x7f2818159890 2023-10-09T11:57:45.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.098+0000 7f281d59a700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27fc066f30 0x7f27fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.099+0000 7f281d59a700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27fc066f30 0x7f27fc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28180d1090 tx=0x7f2808017000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.102+0000 7f280dffb700 1 -- 172.21.15.86:0/610429776 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2814051b30 con 0x7f2818159890 2023-10-09T11:57:45.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.333+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f281815ccc0 con 0x7f2818159890 2023-10-09T11:57:45.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.334+0000 7f280dffb700 1 -- 172.21.15.86:0/610429776 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f2814055150 con 0x7f2818159890 2023-10-09T11:57:45.335 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:45.335 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4115138334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4115138334},{"type":"v1","addr":"172.21.15.135:6834","nonce":4115138334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6763,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/34078262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":34078262},{"type":"v1","addr":"172.21.15.135:6835","nonce":34078262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/161428317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":161428317},{"type":"v1","addr":"172.21.15.86:6833","nonce":161428317}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:41.335680+0000","modified":"2023-10-09T11:57:44.882360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3360740992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3360740992},{"type":"v1","addr":"172.21.15.86:6835","nonce":3360740992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:57:45.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27fc066f30 msgr2=0x7f27fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27fc066f30 0x7f27fc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28180d1090 tx=0x7f2808017000 comp rx=0 tx=0).stop 2023-10-09T11:57:45.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159890 msgr2=0x7f2818145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159890 0x7f2818145a90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f281400ec80 tx=0x7f28140091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 shutdown_connections 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27fc066f30 0x7f27fc0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818159890 0x7f2818145a90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281815db10 0x7f28180c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 --2- 172.21.15.86:0/610429776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818159c60 0x7f2818153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 >> 172.21.15.86:0/610429776 conn(0x7f2818068e20 msgr2=0x7f28181543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 shutdown_connections 2023-10-09T11:57:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.336+0000 7f281ffff700 1 -- 172.21.15.86:0/610429776 wait complete. 2023-10-09T11:57:45.339 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 46 2023-10-09T11:57:45.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:57:45.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.535+0000 7f47fc9ff700 1 Processor -- start 2023-10-09T11:57:45.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.535+0000 7f47fc9ff700 1 -- start start 2023-10-09T11:57:45.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.536+0000 7f47fc9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f47f80cd010 0x7f47f80ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.536+0000 7f47fc9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f80ad930 con 0x7f47f80ac770 2023-10-09T11:57:45.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.536+0000 7f47fc9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f80acd20 con 0x7f47f80ccc40 2023-10-09T11:57:45.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.536+0000 7f47fc9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f80ad000 con 0x7f47f80cd010 2023-10-09T11:57:45.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f6d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f47f80ac770 0x7f47f80b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33202/0 (socket says 172.21.15.86:33202) 2023-10-09T11:57:45.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f6d9d700 1 -- 172.21.15.86:0/3904059576 learned_addr learned my addr 172.21.15.86:0/3904059576 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f5d9b700 1 --2- 172.21.15.86:0/3904059576 >> v2:172.21.15.135:3300/0 conn(0x7f47f80cd010 0x7f47f80ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f559a700 1 -- 172.21.15.86:0/3904059576 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676431710 0 0) 0x7f47f80ad930 con 0x7f47f80ac770 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f559a700 1 -- 172.21.15.86:0/3904059576 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e0003570 con 0x7f47f80ac770 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f5d9b700 1 -- 172.21.15.86:0/3904059576 >> v1:172.21.15.135:6789/0 conn(0x7f47f80ccc40 legacy=0x7f47f8155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f5d9b700 1 -- 172.21.15.86:0/3904059576 >> v1:172.21.15.86:6789/0 conn(0x7f47f80ac770 legacy=0x7f47f80b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.537+0000 7f47f5d9b700 1 -- 172.21.15.86:0/3904059576 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f80ad2e0 con 0x7f47f80cd010 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47f5d9b700 1 --2- 172.21.15.86:0/3904059576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 0x7f47f80ac230 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0098e0 tx=0x7f47ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15369cb51432ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47f559a700 1 -- 172.21.15.86:0/3904059576 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00b640 con 0x7f47f80cd010 2023-10-09T11:57:45.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47f559a700 1 -- 172.21.15.86:0/3904059576 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00b7a0 con 0x7f47f80cd010 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47f559a700 1 -- 172.21.15.86:0/3904059576 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00bb40 con 0x7f47f80cd010 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47fc9ff700 1 -- 172.21.15.86:0/3904059576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 msgr2=0x7f47f80ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/3904059576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 0x7f47f80ac230 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0098e0 tx=0x7f47ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47fc9ff700 1 -- 172.21.15.86:0/3904059576 shutdown_connections 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/3904059576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 0x7f47f80ac230 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47fc9ff700 1 -- 172.21.15.86:0/3904059576 >> 172.21.15.86:0/3904059576 conn(0x7f47f806a320 msgr2=0x7f47f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47fc9ff700 1 -- 172.21.15.86:0/3904059576 shutdown_connections 2023-10-09T11:57:45.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.538+0000 7f47fc9ff700 1 -- 172.21.15.86:0/3904059576 wait complete. 2023-10-09T11:57:45.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.540+0000 7f47fc9ff700 1 Processor -- start 2023-10-09T11:57:45.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.540+0000 7f47fc9ff700 1 -- start start 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47fc9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47f80ac770 0x7f47f80cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47fc9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47f80ccc40 0x7f47f815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47fc9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 0x7f47f815ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47fc9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8150c20 con 0x7f47f80ccc40 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47fc9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f815aa50 con 0x7f47f80cd010 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47fc9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f815ad30 con 0x7f47f80ac770 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47f5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47f80ccc40 0x7f47f815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47f5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47f80ccc40 0x7f47f815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43514/0 (socket says 172.21.15.86:43514) 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47f5d9b700 1 -- 172.21.15.86:0/295504689 learned_addr learned my addr 172.21.15.86:0/295504689 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:45.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47f6d9d700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 0x7f47f815ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.541+0000 7f47f659c700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47f80ac770 0x7f47f80cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47f5d9b700 1 -- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47f80ac770 msgr2=0x7f47f80cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47f5d9b700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47f80ac770 0x7f47f80cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47f5d9b700 1 -- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 msgr2=0x7f47f815ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47f5d9b700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 0x7f47f815ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47f5d9b700 1 -- 172.21.15.86:0/295504689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009420 con 0x7f47f80ccc40 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47f659c700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47f80ac770 0x7f47f80cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47f5d9b700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47f80ccc40 0x7f47f815a420 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f47f8064290 tx=0x7f47ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47e67fc700 1 -- 172.21.15.86:0/295504689 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec000d10 con 0x7f47f80ccc40 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47e67fc700 1 -- 172.21.15.86:0/295504689 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00bb20 con 0x7f47f80ccc40 2023-10-09T11:57:45.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f815b010 con 0x7f47f80ccc40 2023-10-09T11:57:45.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47e67fc700 1 -- 172.21.15.86:0/295504689 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec011630 con 0x7f47f80ccc40 2023-10-09T11:57:45.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.542+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f80c9280 con 0x7f47f80ccc40 2023-10-09T11:57:45.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.543+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f80c90e0 con 0x7f47f80ccc40 2023-10-09T11:57:45.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.544+0000 7f47e67fc700 1 -- 172.21.15.86:0/295504689 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47ec0119e0 con 0x7f47f80ccc40 2023-10-09T11:57:45.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.545+0000 7f47e67fc700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f47d8066f30 0x7f47d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.545+0000 7f47e67fc700 1 -- 172.21.15.86:0/295504689 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f47ec085fe0 con 0x7f47f80ccc40 2023-10-09T11:57:45.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.545+0000 7f47f659c700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f47d8066f30 0x7f47d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.546+0000 7f47f659c700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f47d8066f30 0x7f47d80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007fd0 tx=0x7f47e8009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.549+0000 7f47e67fc700 1 -- 172.21.15.86:0/295504689 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47f80c90e0 con 0x7f47f80ccc40 2023-10-09T11:57:45.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.743+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f80c90e0 con 0x7f47f80ccc40 2023-10-09T11:57:45.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.744+0000 7f47e67fc700 1 -- 172.21.15.86:0/295504689 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+15982 (secure 0 0 0) 0x7f47f80c90e0 con 0x7f47f80ccc40 2023-10-09T11:57:45.746 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:45.746 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":108,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:57:42.860078+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:57:39.443249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:40.316252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:57:45.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.746+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f47d8066f30 msgr2=0x7f47d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.746+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f47d8066f30 0x7f47d80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007fd0 tx=0x7f47e8009040 comp rx=0 tx=0).stop 2023-10-09T11:57:45.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.746+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47f80ccc40 msgr2=0x7f47f815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.746+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47f80ccc40 0x7f47f815a420 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f47f8064290 tx=0x7f47ec017000 comp rx=0 tx=0).stop 2023-10-09T11:57:45.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 shutdown_connections 2023-10-09T11:57:45.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f80cd010 0x7f47f815ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47f80ac770 0x7f47f80cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f47d8066f30 0x7f47d80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 --2- 172.21.15.86:0/295504689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47f80ccc40 0x7f47f815a420 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 >> 172.21.15.86:0/295504689 conn(0x7f47f806a320 msgr2=0x7f47f8068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:45.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 shutdown_connections 2023-10-09T11:57:45.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.747+0000 7f47fc9ff700 1 -- 172.21.15.86:0/295504689 wait complete. 2023-10-09T11:57:45.765 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:57:45.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:45.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.947+0000 7f458619d700 1 Processor -- start 2023-10-09T11:57:45.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.947+0000 7f458619d700 1 -- start start 2023-10-09T11:57:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.948+0000 7f458619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.948+0000 7f458619d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45800c6c60 0x7f45800c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.948+0000 7f458619d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800b1410 con 0x7f45800b1de0 2023-10-09T11:57:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.948+0000 7f458619d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800b2b90 con 0x7f45800c6c60 2023-10-09T11:57:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.948+0000 7f458619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4580063230 con 0x7f45801595a0 2023-10-09T11:57:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.948+0000 7f458499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45800c6c60 0x7f45800c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45800c6c60 0x7f45800c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43518/0 (socket says 172.21.15.86:43518) 2023-10-09T11:57:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458499a700 1 -- 172.21.15.86:0/1319011590 learned_addr learned my addr 172.21.15.86:0/1319011590 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458519b700 1 --2- 172.21.15.86:0/1319011590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458499a700 1 -- 172.21.15.86:0/1319011590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 msgr2=0x7f45800b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458499a700 1 --2- 172.21.15.86:0/1319011590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458499a700 1 -- 172.21.15.86:0/1319011590 >> v1:172.21.15.135:6789/0 conn(0x7f45800b1de0 legacy=0x7f458015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458499a700 1 -- 172.21.15.86:0/1319011590 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800634f0 con 0x7f45800c6c60 2023-10-09T11:57:45.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458519b700 1 --2- 172.21.15.86:0/1319011590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:45.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f458499a700 1 --2- 172.21.15.86:0/1319011590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f45800c8120 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f45700099b0 tx=0x7f4570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45c97d5647c712 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f4577fff700 1 -- 172.21.15.86:0/1319011590 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000b860 con 0x7f45800c6c60 2023-10-09T11:57:45.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f4577fff700 1 -- 172.21.15.86:0/1319011590 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000b9c0 con 0x7f45800c6c60 2023-10-09T11:57:45.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.949+0000 7f4577fff700 1 -- 172.21.15.86:0/1319011590 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000bd60 con 0x7f45800c6c60 2023-10-09T11:57:45.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 -- 172.21.15.86:0/1319011590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 msgr2=0x7f45800c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 --2- 172.21.15.86:0/1319011590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f45800c8120 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f45700099b0 tx=0x7f4570009250 comp rx=0 tx=0).stop 2023-10-09T11:57:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 -- 172.21.15.86:0/1319011590 shutdown_connections 2023-10-09T11:57:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 --2- 172.21.15.86:0/1319011590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 --2- 172.21.15.86:0/1319011590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f45800c8120 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 -- 172.21.15.86:0/1319011590 >> 172.21.15.86:0/1319011590 conn(0x7f458006ddb0 msgr2=0x7f458006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:45.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 -- 172.21.15.86:0/1319011590 shutdown_connections 2023-10-09T11:57:45.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.950+0000 7f458619d700 1 -- 172.21.15.86:0/1319011590 wait complete. 2023-10-09T11:57:45.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.951+0000 7f458619d700 1 Processor -- start 2023-10-09T11:57:45.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.952+0000 7f458619d700 1 -- start start 2023-10-09T11:57:45.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.952+0000 7f458619d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45800b1de0 0x7f45800c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.952+0000 7f458619d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f4580151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.952+0000 7f458619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.952+0000 7f458619d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580169e20 con 0x7f45800c6c60 2023-10-09T11:57:45.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.952+0000 7f458619d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c39a0 con 0x7f45800b1de0 2023-10-09T11:57:45.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c3c80 con 0x7f45801595a0 2023-10-09T11:57:45.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f4580151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f4580151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43526/0 (socket says 172.21.15.86:43526) 2023-10-09T11:57:45.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 -- 172.21.15.86:0/3357725911 learned_addr learned my addr 172.21.15.86:0/3357725911 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:45.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458519b700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45800b1de0 0x7f45800c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458599c700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 -- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 msgr2=0x7f45800c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 -- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45800b1de0 msgr2=0x7f45800c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:45.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45800b1de0 0x7f45800c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:45.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 -- 172.21.15.86:0/3357725911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700094f0 con 0x7f45800c6c60 2023-10-09T11:57:45.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458519b700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45800b1de0 0x7f45800c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:45.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458599c700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:45.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.953+0000 7f458499a700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f4580151d70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f4570009290 tx=0x7f4570017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.954+0000 7f45757fa700 1 -- 172.21.15.86:0/3357725911 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570026480 con 0x7f45800c6c60 2023-10-09T11:57:45.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.954+0000 7f45757fa700 1 -- 172.21.15.86:0/3357725911 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457001f070 con 0x7f45800c6c60 2023-10-09T11:57:45.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.954+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45800c3f60 con 0x7f45800c6c60 2023-10-09T11:57:45.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.954+0000 7f45757fa700 1 -- 172.21.15.86:0/3357725911 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570026830 con 0x7f45800c6c60 2023-10-09T11:57:45.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.954+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45801522b0 con 0x7f45800c6c60 2023-10-09T11:57:45.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.955+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45800c4480 con 0x7f45800c6c60 2023-10-09T11:57:45.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.956+0000 7f45757fa700 1 -- 172.21.15.86:0/3357725911 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4570026ba0 con 0x7f45800c6c60 2023-10-09T11:57:45.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.956+0000 7f45757fa700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4564066f30 0x7f45640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:45.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.957+0000 7f45757fa700 1 -- 172.21.15.86:0/3357725911 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f4570021070 con 0x7f45800c6c60 2023-10-09T11:57:45.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.957+0000 7f458519b700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4564066f30 0x7f45640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:45.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.957+0000 7f458519b700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4564066f30 0x7f45640693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f457c009fd0 tx=0x7f457c00b040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:45.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:45.961+0000 7f45757fa700 1 -- 172.21.15.86:0/3357725911 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4570053670 con 0x7f45800c6c60 2023-10-09T11:57:46.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.147+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f458004c3c0 con 0x7f4564066f30 2023-10-09T11:57:46.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.157+0000 7f45757fa700 1 -- 172.21.15.86:0/3357725911 <== mgr.6990 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278477 (secure 0 0 0) 0x7f458004c3c0 con 0x7f4564066f30 2023-10-09T11:57:46.161 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4564066f30 msgr2=0x7f45640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4564066f30 0x7f45640693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f457c009fd0 tx=0x7f457c00b040 comp rx=0 tx=0).stop 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 msgr2=0x7f4580151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f4580151d70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f4570009290 tx=0x7f4570017000 comp rx=0 tx=0).stop 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 shutdown_connections 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45801595a0 0x7f45800c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45800b1de0 0x7f45800c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4564066f30 0x7f45640693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 --2- 172.21.15.86:0/3357725911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45800c6c60 0x7f4580151d70 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 >> 172.21.15.86:0/3357725911 conn(0x7f458006ddb0 msgr2=0x7f4580157210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:46.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.161+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 shutdown_connections 2023-10-09T11:57:46.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.162+0000 7f458619d700 1 -- 172.21.15.86:0/3357725911 wait complete. 2023-10-09T11:57:46.165 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:46.180 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:57:45.808286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434492,"kb_used_data":11132,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540228,"statfs":{"total":773094113280,"available":770601193472,"internally_reserved":0,"allocated":11399168,"data_stored":6100995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.955374"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859255+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:41.420679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854508+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:14.831883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861070+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:05.212122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861630+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:33.143346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854685+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:58.998014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855479+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:57.383921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860769+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:46.646895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857275+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:20.374410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858468+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:11.367485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857462+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:05.400405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858507+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:49.606232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854577+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:31.466927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857546+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:45.757785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857330+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:10.498948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854271+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:49.797057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860052+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:09.798161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857501+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:40.331619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861020+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:28.959485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860963+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:08.270685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859597+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:40.537829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855993+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:32.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855963+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:46.732281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857474+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:09.133250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857805+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:23.709112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857959+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:36.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857629+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:28.781460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858102+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:13.495899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860977+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:38.580083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854622+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:09.574038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857514+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:28.842297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854486+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:03.391843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859917+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"97'205","reported_seq":543,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-09T11:57:37.383421+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:57:37.383421+0000","last_peered":"2023-10-09T11:57:37.383421+0000","last_clean":"2023-10-09T11:57:37.383421+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:57:37.383421+0000","last_undegraded":"2023-10-09T11:57:37.383421+0000","last_fullsized":"2023-10-09T11:57:37.383421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":1206173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.70699999999999996},"min":{"1min":0.52500000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80500000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70199999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.93500000000000005,"5min":1.0209999999999999,"15min":1.048},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.81200000000000006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.073},"last":0.76100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.78900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.92300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.84799999999999998,"5min":1.083,"15min":1.083},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57699999999999996,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":1.014,"5min":1.111,"15min":1.111},"last":0.73599999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":609624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.72999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68500000000000005,"15min":0.73599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81999999999999995,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.71299999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.98999999999999999,"15min":1.121},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":1.0049999999999999,"15min":1.216},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71099999999999997,"15min":0.752},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.008,"15min":1.139},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.70599999999999996,"15min":0.73999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89700000000000002,"5min":1.0009999999999999,"15min":1.278},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83099999999999996,"5min":1.042,"15min":1.1040000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70299999999999996,"15min":0.73699999999999999},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77500000000000002,"5min":0.98999999999999999,"15min":1.244},"last":0.66500000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.1060000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.39500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.78500000000000003,"5min":0.93600000000000005,"15min":1.143},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79400000000000004,"5min":1.03,"15min":1.327},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.68200000000000005,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.54400000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.435,"15min":0.46100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58599999999999997,"5min":0.69999999999999996,"15min":1.0580000000000001},"last":0.374},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.69499999999999995,"5min":1.079,"15min":1.079},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":1.099},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.54400000000000004},"min":{"1min":0.45700000000000002,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":1.044,"15min":1.1779999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":0.78000000000000003,"15min":1.046},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93500000000000005,"5min":1.143,"15min":1.7210000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.86299999999999999,"5min":1.1220000000000001,"15min":1.552},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.78800000000000003},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88200000000000001,"5min":1.202,"15min":1.677},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.89900000000000002,"5min":1.103,"15min":1.778},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.79900000000000004},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0760000000000001,"15min":1.623},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.81999999999999995},"min":{"1min":0.58299999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89100000000000001,"5min":1.042,"15min":1.708},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93999999999999995,"5min":1.222,"15min":1.659},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95199999999999996,"5min":1.1419999999999999,"15min":1.736},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129542340,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299116,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072724,"statfs":{"total":96636764160,"available":96330469376,"internally_reserved":0,"allocated":1871872,"data_stored":1206173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61399999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.59999999999999998,"5min":0.89400000000000002,"15min":1.0740000000000001},"last":0.34699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56999999999999995,"5min":2.097,"15min":2.097},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.66300000000000003,"5min":0.93899999999999995,"15min":1.131},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34200000000000003},"max":{"1min":0.55500000000000005,"5min":1.0089999999999999,"15min":1.1699999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.58799999999999997,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":0.997,"5min":1.587,"15min":1.587},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.997,"5min":1.389,"15min":1.389},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76100000000000001,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94899999999999995,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0109999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.80300000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.48299999999999998},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":0.879,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0229999999999999,"5min":1.552,"15min":1.552},"last":1.1060000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542340,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306728,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065112,"statfs":{"total":96636764160,"available":96322674688,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61899999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.75,"15min":0.83799999999999997},"last":0.33200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.436},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.97299999999999998},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.79900000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.59099999999999997,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99099999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.216,"15min":1.216},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.204},"last":0.86199999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.89000000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.753},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.627,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0409999999999999,"5min":1.155,"15min":1.155},"last":0.90200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306728,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065112,"statfs":{"total":96636764160,"available":96322674688,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.55500000000000005,"5min":0.91300000000000003,"15min":1.208},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.48699999999999999,"15min":0.51800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54600000000000004,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51400000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.505}]},{"osd":4,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"max":{"1min":0.98299999999999998,"5min":1.208,"15min":1.327},"last":1.137},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58499999999999996},"max":{"1min":1.077,"5min":1.252,"15min":1.2689999999999999},"last":1.1679999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.246,"15min":1.252},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.3660000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.504,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":0.83699999999999997,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":1.0429999999999999,"5min":1.1240000000000001,"15min":1.218},"last":0.79300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.80500000000000005},"min":{"1min":0.62,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.25,"15min":1.333},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79000000000000004,"15min":0.81499999999999995},"min":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.3560000000000001},"last":1.0640000000000001}]}]},{"osd":4,"up_from":16,"seq":68719476932,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310824,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061016,"statfs":{"total":96636764160,"available":96318480384,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.374},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83699999999999997,"5min":0.95199999999999996,"15min":1.091},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.876},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.747},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65500000000000003}]}]},{"osd":5,"up_from":16,"seq":68719476932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68000000000000005,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65600000000000003,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86699999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.71799999999999997,"5min":1.909,"15min":1.909},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.627}]},{"osd":3,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":2.105,"15min":2.105},"last":0.746},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.878,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67100000000000004,"15min":0.68600000000000005},"min":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.86399999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:46.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:46.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.398+0000 7fc1b4dff700 1 Processor -- start 2023-10-09T11:57:46.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.398+0000 7fc1b4dff700 1 -- start start 2023-10-09T11:57:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.399+0000 7fc1b4dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc1b0159c60 0x7fc1b015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.399+0000 7fc1b4dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b015a160 con 0x7fc1b015db10 2023-10-09T11:57:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.399+0000 7fc1b4dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00d13a0 con 0x7fc1b0159890 2023-10-09T11:57:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.399+0000 7fc1b4dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b015df50 con 0x7fc1b0159c60 2023-10-09T11:57:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.399+0000 7fc1add9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc1b0159c60 0x7fc1b015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1aed9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc1b015db10 0x7fc1b0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33218/0 (socket says 172.21.15.86:33218) 2023-10-09T11:57:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1aed9d700 1 -- 172.21.15.86:0/1507658084 learned_addr learned my addr 172.21.15.86:0/1507658084 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1add9b700 1 -- 172.21.15.86:0/1507658084 >> v1:172.21.15.135:6789/0 conn(0x7fc1b0159890 legacy=0x7fc1b015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1add9b700 1 -- 172.21.15.86:0/1507658084 >> v1:172.21.15.86:6789/0 conn(0x7fc1b015db10 legacy=0x7fc1b0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1add9b700 1 -- 172.21.15.86:0/1507658084 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b015e140 con 0x7fc1b0159c60 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1ad59a700 1 -- 172.21.15.86:0/1507658084 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650798943 0 0) 0x7fc1b015a160 con 0x7fc1b015db10 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1add9b700 1 --2- 172.21.15.86:0/1507658084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0159c60 0x7fc1b015d5d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40098e0 tx=0x7fc1a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c50326f58fe537c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1ad59a700 1 -- 172.21.15.86:0/1507658084 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4009e80 con 0x7fc1b0159c60 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.400+0000 7fc1ad59a700 1 -- 172.21.15.86:0/1507658084 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a400b860 con 0x7fc1b0159c60 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1ad59a700 1 -- 172.21.15.86:0/1507658084 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400bbe0 con 0x7fc1b0159c60 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1b4dff700 1 -- 172.21.15.86:0/1507658084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0159c60 msgr2=0x7fc1b015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/1507658084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0159c60 0x7fc1b015d5d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40098e0 tx=0x7fc1a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1b4dff700 1 -- 172.21.15.86:0/1507658084 shutdown_connections 2023-10-09T11:57:46.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/1507658084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b0159c60 0x7fc1b015d5d0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1b4dff700 1 -- 172.21.15.86:0/1507658084 >> 172.21.15.86:0/1507658084 conn(0x7fc1b0068e20 msgr2=0x7fc1b00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:46.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1b4dff700 1 -- 172.21.15.86:0/1507658084 shutdown_connections 2023-10-09T11:57:46.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.401+0000 7fc1b4dff700 1 -- 172.21.15.86:0/1507658084 wait complete. 2023-10-09T11:57:46.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.403+0000 7fc1b4dff700 1 Processor -- start 2023-10-09T11:57:46.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.403+0000 7fc1b4dff700 1 -- start start 2023-10-09T11:57:46.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1b4dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1b0159890 0x7fc1b016ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1b4dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b0159c60 0x7fc1b016b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1b4dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b015db10 0x7fc1b0169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1b4dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b016aea0 con 0x7fc1b015db10 2023-10-09T11:57:46.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1b4dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b016a8e0 con 0x7fc1b0159c60 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1b4dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b016abc0 con 0x7fc1b0159890 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b015db10 0x7fc1b0169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b015db10 0x7fc1b0169ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43550/0 (socket says 172.21.15.86:43550) 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 -- 172.21.15.86:0/3361157977 learned_addr learned my addr 172.21.15.86:0/3361157977 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1add9b700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b0159c60 0x7fc1b016b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1ae59c700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1b0159890 0x7fc1b016ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 -- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1b0159890 msgr2=0x7fc1b016ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1b0159890 0x7fc1b016ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 -- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b0159c60 msgr2=0x7fc1b016b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b0159c60 0x7fc1b016b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1aed9d700 1 -- 172.21.15.86:0/3361157977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4009420 con 0x7fc1b015db10 2023-10-09T11:57:46.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.404+0000 7fc1add9b700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b0159c60 0x7fc1b016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:46.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.405+0000 7fc1aed9d700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b015db10 0x7fc1b0169ed0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800cbf0 tx=0x7fc1a80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:46.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.405+0000 7fc19e7fc700 1 -- 172.21.15.86:0/3361157977 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800a9c0 con 0x7fc1b015db10 2023-10-09T11:57:46.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.405+0000 7fc19e7fc700 1 -- 172.21.15.86:0/3361157977 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a800ab20 con 0x7fc1b015db10 2023-10-09T11:57:46.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.405+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b00b36c0 con 0x7fc1b015db10 2023-10-09T11:57:46.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.405+0000 7fc19e7fc700 1 -- 172.21.15.86:0/3361157977 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80070f0 con 0x7fc1b015db10 2023-10-09T11:57:46.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.405+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b00b5330 con 0x7fc1b015db10 2023-10-09T11:57:46.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.406+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b004c3c0 con 0x7fc1b015db10 2023-10-09T11:57:46.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.407+0000 7fc19e7fc700 1 -- 172.21.15.86:0/3361157977 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1a8007520 con 0x7fc1b015db10 2023-10-09T11:57:46.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.408+0000 7fc19e7fc700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc190066f30 0x7fc1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.408+0000 7fc19e7fc700 1 -- 172.21.15.86:0/3361157977 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc1a8084a90 con 0x7fc1b015db10 2023-10-09T11:57:46.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.408+0000 7fc1ae59c700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc190066f30 0x7fc1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.409+0000 7fc1ae59c700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc190066f30 0x7fc1900693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0003860 tx=0x7fc1a0009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:46.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.412+0000 7fc19e7fc700 1 -- 172.21.15.86:0/3361157977 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1a8051c00 con 0x7fc1b015db10 2023-10-09T11:57:46.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.598+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1b00b5550 con 0x7fc190066f30 2023-10-09T11:57:46.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.606+0000 7fc19e7fc700 1 -- 172.21.15.86:0/3361157977 <== mgr.6990 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278477 (secure 0 0 0) 0x7fc1b00b5550 con 0x7fc190066f30 2023-10-09T11:57:46.611 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:46.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc190066f30 msgr2=0x7fc1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc190066f30 0x7fc1900693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0003860 tx=0x7fc1a0009040 comp rx=0 tx=0).stop 2023-10-09T11:57:46.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b015db10 msgr2=0x7fc1b0169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b015db10 0x7fc1b0169ed0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800cbf0 tx=0x7fc1a80019b0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 shutdown_connections 2023-10-09T11:57:46.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc190066f30 0x7fc1900693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b015db10 0x7fc1b0169ed0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1b0159890 0x7fc1b016ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 --2- 172.21.15.86:0/3361157977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1b0159c60 0x7fc1b016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 >> 172.21.15.86:0/3361157977 conn(0x7fc1b0068e20 msgr2=0x7fc1b00c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:46.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 shutdown_connections 2023-10-09T11:57:46.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.610+0000 7fc1b4dff700 1 -- 172.21.15.86:0/3361157977 wait complete. 2023-10-09T11:57:46.614 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:46.628 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:57:45.808286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434492,"kb_used_data":11132,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540228,"statfs":{"total":773094113280,"available":770601193472,"internally_reserved":0,"allocated":11399168,"data_stored":6100995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.955374"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859255+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:41.420679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854508+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:14.831883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861070+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:05.212122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861630+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:33.143346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854685+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:58.998014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855479+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:57.383921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860769+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:46.646895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857275+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:20.374410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858468+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:11.367485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857462+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:05.400405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858507+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:49.606232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854577+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:31.466927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857546+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:45.757785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857330+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:10.498948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854271+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:49.797057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860052+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:09.798161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857501+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:40.331619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861020+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:28.959485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860963+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:08.270685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859597+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:40.537829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855993+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:32.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855963+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:46.732281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857474+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:09.133250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857805+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:23.709112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857959+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:36.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857629+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:28.781460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858102+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:13.495899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860977+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:38.580083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854622+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:09.574038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857514+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:28.842297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854486+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:03.391843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859917+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"97'205","reported_seq":543,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-09T11:57:37.383421+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:57:37.383421+0000","last_peered":"2023-10-09T11:57:37.383421+0000","last_clean":"2023-10-09T11:57:37.383421+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:57:37.383421+0000","last_undegraded":"2023-10-09T11:57:37.383421+0000","last_fullsized":"2023-10-09T11:57:37.383421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":1206173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.70699999999999996},"min":{"1min":0.52500000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80500000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70199999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.93500000000000005,"5min":1.0209999999999999,"15min":1.048},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.81200000000000006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.073},"last":0.76100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.78900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.92300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.84799999999999998,"5min":1.083,"15min":1.083},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57699999999999996,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":1.014,"5min":1.111,"15min":1.111},"last":0.73599999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":609624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.72999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68500000000000005,"15min":0.73599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81999999999999995,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.71299999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.98999999999999999,"15min":1.121},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":1.0049999999999999,"15min":1.216},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71099999999999997,"15min":0.752},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.008,"15min":1.139},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.70599999999999996,"15min":0.73999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89700000000000002,"5min":1.0009999999999999,"15min":1.278},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83099999999999996,"5min":1.042,"15min":1.1040000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70299999999999996,"15min":0.73699999999999999},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77500000000000002,"5min":0.98999999999999999,"15min":1.244},"last":0.66500000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.1060000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.39500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.78500000000000003,"5min":0.93600000000000005,"15min":1.143},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79400000000000004,"5min":1.03,"15min":1.327},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.68200000000000005,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.54400000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.435,"15min":0.46100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58599999999999997,"5min":0.69999999999999996,"15min":1.0580000000000001},"last":0.374},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.69499999999999995,"5min":1.079,"15min":1.079},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":1.099},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.54400000000000004},"min":{"1min":0.45700000000000002,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":1.044,"15min":1.1779999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":0.78000000000000003,"15min":1.046},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93500000000000005,"5min":1.143,"15min":1.7210000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.86299999999999999,"5min":1.1220000000000001,"15min":1.552},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.78800000000000003},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88200000000000001,"5min":1.202,"15min":1.677},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.89900000000000002,"5min":1.103,"15min":1.778},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.79900000000000004},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0760000000000001,"15min":1.623},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.81999999999999995},"min":{"1min":0.58299999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89100000000000001,"5min":1.042,"15min":1.708},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93999999999999995,"5min":1.222,"15min":1.659},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95199999999999996,"5min":1.1419999999999999,"15min":1.736},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129542340,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299116,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072724,"statfs":{"total":96636764160,"available":96330469376,"internally_reserved":0,"allocated":1871872,"data_stored":1206173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61399999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.59999999999999998,"5min":0.89400000000000002,"15min":1.0740000000000001},"last":0.34699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56999999999999995,"5min":2.097,"15min":2.097},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.66300000000000003,"5min":0.93899999999999995,"15min":1.131},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34200000000000003},"max":{"1min":0.55500000000000005,"5min":1.0089999999999999,"15min":1.1699999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.58799999999999997,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":0.997,"5min":1.587,"15min":1.587},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.997,"5min":1.389,"15min":1.389},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76100000000000001,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94899999999999995,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0109999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.80300000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.48299999999999998},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":0.879,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0229999999999999,"5min":1.552,"15min":1.552},"last":1.1060000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542340,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306728,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065112,"statfs":{"total":96636764160,"available":96322674688,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61899999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.75,"15min":0.83799999999999997},"last":0.33200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.436},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.97299999999999998},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.79900000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.59099999999999997,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99099999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.216,"15min":1.216},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.204},"last":0.86199999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.89000000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.753},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.627,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0409999999999999,"5min":1.155,"15min":1.155},"last":0.90200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306728,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065112,"statfs":{"total":96636764160,"available":96322674688,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.55500000000000005,"5min":0.91300000000000003,"15min":1.208},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.48699999999999999,"15min":0.51800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54600000000000004,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51400000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.505}]},{"osd":4,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"max":{"1min":0.98299999999999998,"5min":1.208,"15min":1.327},"last":1.137},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58499999999999996},"max":{"1min":1.077,"5min":1.252,"15min":1.2689999999999999},"last":1.1679999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.246,"15min":1.252},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.3660000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.504,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":0.83699999999999997,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":1.0429999999999999,"5min":1.1240000000000001,"15min":1.218},"last":0.79300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.80500000000000005},"min":{"1min":0.62,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.25,"15min":1.333},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79000000000000004,"15min":0.81499999999999995},"min":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.3560000000000001},"last":1.0640000000000001}]}]},{"osd":4,"up_from":16,"seq":68719476932,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310824,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061016,"statfs":{"total":96636764160,"available":96318480384,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.374},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83699999999999997,"5min":0.95199999999999996,"15min":1.091},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.876},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.747},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65500000000000003}]}]},{"osd":5,"up_from":16,"seq":68719476932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68000000000000005,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65600000000000003,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86699999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.71799999999999997,"5min":1.909,"15min":1.909},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.627}]},{"osd":3,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":2.105,"15min":2.105},"last":0.746},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.878,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67100000000000004,"15min":0.68600000000000005},"min":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.86399999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:46.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:46.843 INFO:tasks.ceph.mds.a.smithi086.stderr:2023-10-09T11:57:46.842+0000 7fecb4ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:57:46.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.850+0000 7f9898f9d700 1 Processor -- start 2023-10-09T11:57:46.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.850+0000 7f9898f9d700 1 -- start start 2023-10-09T11:57:46.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.851+0000 7f9898f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98940c6d00 0x7f98940c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.851+0000 7f9898f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989406e2a0 con 0x7f9894157770 2023-10-09T11:57:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.851+0000 7f9898f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9894157b40 con 0x7f989406e730 2023-10-09T11:57:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.851+0000 7f9898f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98940c7690 con 0x7f98940c6d00 2023-10-09T11:57:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.851+0000 7f9892ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98940c6d00 0x7f98940c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.851+0000 7f98937fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9894157770 0x7f9894150180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33226/0 (socket says 172.21.15.86:33226) 2023-10-09T11:57:46.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.851+0000 7f98937fe700 1 -- 172.21.15.86:0/1277075240 learned_addr learned my addr 172.21.15.86:0/1277075240 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f98927fc700 1 -- 172.21.15.86:0/1277075240 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785406632 0 0) 0x7f989406e2a0 con 0x7f9894157770 2023-10-09T11:57:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f98927fc700 1 -- 172.21.15.86:0/1277075240 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f987c003570 con 0x7f9894157770 2023-10-09T11:57:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f9892ffd700 1 -- 172.21.15.86:0/1277075240 >> v1:172.21.15.135:6789/0 conn(0x7f989406e730 legacy=0x7f989406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f9892ffd700 1 -- 172.21.15.86:0/1277075240 >> v1:172.21.15.86:6789/0 conn(0x7f9894157770 legacy=0x7f9894150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f9892ffd700 1 -- 172.21.15.86:0/1277075240 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989406b2e0 con 0x7f98940c6d00 2023-10-09T11:57:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f9892ffd700 1 --2- 172.21.15.86:0/1277075240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98940c6d00 0x7f98940c7150 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f98880098e0 tx=0x7f98880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae844d6a2605597 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:46.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f98927fc700 1 -- 172.21.15.86:0/1277075240 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988800b640 con 0x7f98940c6d00 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f98927fc700 1 -- 172.21.15.86:0/1277075240 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988800b7a0 con 0x7f98940c6d00 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.852+0000 7f98927fc700 1 -- 172.21.15.86:0/1277075240 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988800bb40 con 0x7f98940c6d00 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.853+0000 7f9898f9d700 1 -- 172.21.15.86:0/1277075240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98940c6d00 msgr2=0x7f98940c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.853+0000 7f9898f9d700 1 --2- 172.21.15.86:0/1277075240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98940c6d00 0x7f98940c7150 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f98880098e0 tx=0x7f98880091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.853+0000 7f9898f9d700 1 -- 172.21.15.86:0/1277075240 shutdown_connections 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.853+0000 7f9898f9d700 1 --2- 172.21.15.86:0/1277075240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98940c6d00 0x7f98940c7150 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.853+0000 7f9898f9d700 1 -- 172.21.15.86:0/1277075240 >> 172.21.15.86:0/1277075240 conn(0x7f98940cc1f0 msgr2=0x7f98940cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.853+0000 7f9898f9d700 1 -- 172.21.15.86:0/1277075240 shutdown_connections 2023-10-09T11:57:46.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.853+0000 7f9898f9d700 1 -- 172.21.15.86:0/1277075240 wait complete. 2023-10-09T11:57:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.854+0000 7f9898f9d700 1 Processor -- start 2023-10-09T11:57:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.855+0000 7f9898f9d700 1 -- start start 2023-10-09T11:57:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.855+0000 7f9898f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f989406e730 0x7f98940c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.855+0000 7f9898f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98940c6d00 0x7f98940b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.855+0000 7f9898f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9894157770 0x7f989414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.855+0000 7f9898f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989416d5a0 con 0x7f989406e730 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.855+0000 7f9898f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989416d880 con 0x7f9894157770 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.855+0000 7f9898f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989416db60 con 0x7f98940c6d00 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f989406e730 0x7f98940c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f989406e730 0x7f98940c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43580/0 (socket says 172.21.15.86:43580) 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 -- 172.21.15.86:0/4260567357 learned_addr learned my addr 172.21.15.86:0/4260567357 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f9892ffd700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98940c6d00 0x7f98940b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f9893fff700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9894157770 0x7f989414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 -- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98940c6d00 msgr2=0x7f98940b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98940c6d00 0x7f98940b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 -- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9894157770 msgr2=0x7f989414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9894157770 0x7f989414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 -- 172.21.15.86:0/4260567357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9888009420 con 0x7f989406e730 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f9893fff700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9894157770 0x7f989414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f98937fe700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f989406e730 0x7f98940c1ec0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f988400c590 tx=0x7f9884007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.856+0000 7f987b7fe700 1 -- 172.21.15.86:0/4260567357 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884005b30 con 0x7f989406e730 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.857+0000 7f987b7fe700 1 -- 172.21.15.86:0/4260567357 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9884005cb0 con 0x7f989406e730 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.857+0000 7f987b7fe700 1 -- 172.21.15.86:0/4260567357 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884007320 con 0x7f989406e730 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.857+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989416de40 con 0x7f989406e730 2023-10-09T11:57:46.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.857+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98940b0850 con 0x7f989406e730 2023-10-09T11:57:46.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.858+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989404c3c0 con 0x7f989406e730 2023-10-09T11:57:46.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.859+0000 7f987b7fe700 1 -- 172.21.15.86:0/4260567357 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f988401b3b0 con 0x7f989406e730 2023-10-09T11:57:46.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.860+0000 7f987b7fe700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9880066f30 0x7f98800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:46.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.860+0000 7f987b7fe700 1 -- 172.21.15.86:0/4260567357 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f9884083d10 con 0x7f989406e730 2023-10-09T11:57:46.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.860+0000 7f9892ffd700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9880066f30 0x7f98800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:46.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.860+0000 7f9892ffd700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9880066f30 0x7f98800693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f98880093f0 tx=0x7f9888017000 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:46.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:46.864+0000 7f987b7fe700 1 -- 172.21.15.86:0/4260567357 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9884089020 con 0x7f989406e730 2023-10-09T11:57:47.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.052+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98940aef90 con 0x7f9880066f30 2023-10-09T11:57:47.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.060+0000 7f987b7fe700 1 -- 172.21.15.86:0/4260567357 <== mgr.6990 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278477 (secure 0 0 0) 0x7f98940aef90 con 0x7f9880066f30 2023-10-09T11:57:47.065 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9880066f30 msgr2=0x7f98800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9880066f30 0x7f98800693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f98880093f0 tx=0x7f9888017000 comp rx=0 tx=0).stop 2023-10-09T11:57:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f989406e730 msgr2=0x7f98940c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f989406e730 0x7f98940c1ec0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f988400c590 tx=0x7f9884007e00 comp rx=0 tx=0).stop 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 shutdown_connections 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9880066f30 0x7f98800693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f989406e730 0x7f98940c1ec0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9894157770 0x7f989414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 --2- 172.21.15.86:0/4260567357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98940c6d00 0x7f98940b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 >> 172.21.15.86:0/4260567357 conn(0x7f98940cc1f0 msgr2=0x7f989406a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 shutdown_connections 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.065+0000 7f9898f9d700 1 -- 172.21.15.86:0/4260567357 wait complete. 2023-10-09T11:57:47.068 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:47.083 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:57:45.808286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434492,"kb_used_data":11132,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752540228,"statfs":{"total":773094113280,"available":770601193472,"internally_reserved":0,"allocated":11399168,"data_stored":6100995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.955374"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859255+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:41.420679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854508+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:14.831883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861070+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:05.212122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861630+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:33.143346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854685+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:58.998014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855479+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:57.383921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860769+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:46.646895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857275+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:20.374410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858468+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:11.367485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857462+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:05.400405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858507+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:49.606232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854577+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:31.466927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857546+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:45.757785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857330+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:10.498948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854271+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:49.797057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860052+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:09.798161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857501+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:40.331619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.861020+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:28.959485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860963+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:08.270685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859597+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:40.537829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855993+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:32.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.855963+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:46.732281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857474+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:09.133250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857805+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:23.709112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857959+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:52:36.215806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857629+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:28.781460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.858102+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:13.495899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.860977+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:38.580083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854622+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:09.574038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.857514+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:28.842297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.854486+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:03.391843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:57:40.851117+0000","last_change":"2023-10-09T11:57:40.851117+0000","last_active":"2023-10-09T11:57:40.851117+0000","last_peered":"2023-10-09T11:57:40.851117+0000","last_clean":"2023-10-09T11:57:40.851117+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:40.851117+0000","last_undegraded":"2023-10-09T11:57:40.851117+0000","last_fullsized":"2023-10-09T11:57:40.851117+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:57:39.842898+0000","last_change":"2023-10-09T11:57:39.859917+0000","last_active":"2023-10-09T11:57:39.842898+0000","last_peered":"2023-10-09T11:57:39.842898+0000","last_clean":"2023-10-09T11:57:39.842898+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:57:39.842898+0000","last_undegraded":"2023-10-09T11:57:39.842898+0000","last_fullsized":"2023-10-09T11:57:39.842898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"97'205","reported_seq":543,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-09T11:57:37.383421+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:57:37.383421+0000","last_peered":"2023-10-09T11:57:37.383421+0000","last_clean":"2023-10-09T11:57:37.383421+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:57:37.383421+0000","last_undegraded":"2023-10-09T11:57:37.383421+0000","last_fullsized":"2023-10-09T11:57:37.383421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":1206173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.70699999999999996},"min":{"1min":0.52500000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80500000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70199999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.93500000000000005,"5min":1.0209999999999999,"15min":1.048},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.81200000000000006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.073},"last":0.76100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.78900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.92300000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.84799999999999998,"5min":1.083,"15min":1.083},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57699999999999996,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":1.014,"5min":1.111,"15min":1.111},"last":0.73599999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":609624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.72999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68500000000000005,"15min":0.73599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81999999999999995,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.71299999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.98999999999999999,"15min":1.121},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":1.0049999999999999,"15min":1.216},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71099999999999997,"15min":0.752},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.008,"15min":1.139},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.70599999999999996,"15min":0.73999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89700000000000002,"5min":1.0009999999999999,"15min":1.278},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83099999999999996,"5min":1.042,"15min":1.1040000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70299999999999996,"15min":0.73699999999999999},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77500000000000002,"5min":0.98999999999999999,"15min":1.244},"last":0.66500000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.1060000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.39500000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.78500000000000003,"5min":0.93600000000000005,"15min":1.143},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79400000000000004,"5min":1.03,"15min":1.327},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.68200000000000005,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.54400000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.435,"15min":0.46100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58599999999999997,"5min":0.69999999999999996,"15min":1.0580000000000001},"last":0.374},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.69499999999999995,"5min":1.079,"15min":1.079},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":1.099},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.54400000000000004},"min":{"1min":0.45700000000000002,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":1.044,"15min":1.1779999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":0.78000000000000003,"15min":1.046},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93500000000000005,"5min":1.143,"15min":1.7210000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.86299999999999999,"5min":1.1220000000000001,"15min":1.552},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.78800000000000003},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88200000000000001,"5min":1.202,"15min":1.677},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.89900000000000002,"5min":1.103,"15min":1.778},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.79900000000000004},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0760000000000001,"15min":1.623},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.81999999999999995},"min":{"1min":0.58299999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89100000000000001,"5min":1.042,"15min":1.708},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93999999999999995,"5min":1.222,"15min":1.659},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95199999999999996,"5min":1.1419999999999999,"15min":1.736},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129542340,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299116,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072724,"statfs":{"total":96636764160,"available":96330469376,"internally_reserved":0,"allocated":1871872,"data_stored":1206173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61399999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.59999999999999998,"5min":0.89400000000000002,"15min":1.0740000000000001},"last":0.34699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56999999999999995,"5min":2.097,"15min":2.097},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.66300000000000003,"5min":0.93899999999999995,"15min":1.131},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34200000000000003},"max":{"1min":0.55500000000000005,"5min":1.0089999999999999,"15min":1.1699999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.58799999999999997,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":0.997,"5min":1.587,"15min":1.587},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.997,"5min":1.389,"15min":1.389},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76100000000000001,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94899999999999995,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0109999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.80300000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.48299999999999998},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":0.879,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0229999999999999,"5min":1.552,"15min":1.552},"last":1.1060000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542340,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306728,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065112,"statfs":{"total":96636764160,"available":96322674688,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61899999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.75,"15min":0.83799999999999997},"last":0.33200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.436},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.97299999999999998},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.79900000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.59099999999999997,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99099999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.216,"15min":1.216},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.204},"last":0.86199999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.89000000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.753},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.627,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0409999999999999,"5min":1.155,"15min":1.155},"last":0.90200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306728,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065112,"statfs":{"total":96636764160,"available":96322674688,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.55500000000000005,"5min":0.91300000000000003,"15min":1.208},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.48699999999999999,"15min":0.51800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54600000000000004,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51400000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.505}]},{"osd":4,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"max":{"1min":0.98299999999999998,"5min":1.208,"15min":1.327},"last":1.137},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58499999999999996},"max":{"1min":1.077,"5min":1.252,"15min":1.2689999999999999},"last":1.1679999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.246,"15min":1.252},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.3660000000000001},"last":1.0780000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.504,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":0.83699999999999997,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":1.0429999999999999,"5min":1.1240000000000001,"15min":1.218},"last":0.79300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.80500000000000005},"min":{"1min":0.62,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.25,"15min":1.333},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79000000000000004,"15min":0.81499999999999995},"min":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.3560000000000001},"last":1.0640000000000001}]}]},{"osd":4,"up_from":16,"seq":68719476932,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310824,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061016,"statfs":{"total":96636764160,"available":96318480384,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.374},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83699999999999997,"5min":0.95199999999999996,"15min":1.091},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.876},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.747},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.65500000000000003}]}]},{"osd":5,"up_from":16,"seq":68719476932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302632,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069208,"statfs":{"total":96636764160,"available":96326868992,"internally_reserved":0,"allocated":1277952,"data_stored":615805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68000000000000005,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65600000000000003,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86699999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.71799999999999997,"5min":1.909,"15min":1.909},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.627}]},{"osd":3,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":2.105,"15min":2.105},"last":0.746},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.878,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67100000000000004,"15min":0.68600000000000005},"min":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.86399999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:47.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-09T11:57:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-10-09T11:57:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-09T11:57:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-09T11:57:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-09T11:57:47.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.859255+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:28:41.420679+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-10-09T11:57:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.854508+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:51:14.831883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.861070+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:54:05.212122+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.861630+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:33:33.143346+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-10-09T11:57:47.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.854685+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:43:58.998014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.855479+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:08:57.383921+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-09T11:57:47.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.860769+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:56:46.646895+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857275+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:01:20.374410+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.858468+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:27:11.367485+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857462+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:33:05.400405+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.858507+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:18:49.606232+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-10-09T11:57:47.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.854577+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:35:31.466927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857546+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:20:45.757785+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857330+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:55:10.498948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.854271+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:19:49.797057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.860052+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:47:09.798161+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:57:47.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857501+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:01:40.331619+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.861020+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:22:28.959485+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-10-09T11:57:47.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.860963+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:30:08.270685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.859597+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:10:40.537829+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-10-09T11:57:47.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.855993+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:43:32.640217+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.855963+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:29:46.732281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857474+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:12:09.133250+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:57:47.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857805+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:43:23.709112+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857959+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:52:36.215806+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857629+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:13:28.781460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.858102+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:13.495899+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-09T11:57:47.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.860977+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:24:38.580083+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.854622+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:01:09.574038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.857514+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:31:28.842297+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-09T11:57:47.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-10-09T11:57:47.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.854486+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:05:03.391843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:57:47.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-10-09T11:57:47.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:57:40.851117+0000', 'last_change': '2023-10-09T11:57:40.851117+0000', 'last_active': '2023-10-09T11:57:40.851117+0000', 'last_peered': '2023-10-09T11:57:40.851117+0000', 'last_clean': '2023-10-09T11:57:40.851117+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:40.851117+0000', 'last_undegraded': '2023-10-09T11:57:40.851117+0000', 'last_fullsized': '2023-10-09T11:57:40.851117+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:40.851117+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:57:47.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-09T11:57:47.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:57:39.842898+0000', 'last_change': '2023-10-09T11:57:39.859917+0000', 'last_active': '2023-10-09T11:57:39.842898+0000', 'last_peered': '2023-10-09T11:57:39.842898+0000', 'last_clean': '2023-10-09T11:57:39.842898+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:57:39.842898+0000', 'last_undegraded': '2023-10-09T11:57:39.842898+0000', 'last_fullsized': '2023-10-09T11:57:39.842898+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'last_clean_scrub_stamp': '2023-10-09T11:57:39.842898+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:20:41.268511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:57:47.111 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:57:47.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.303+0000 7fa5bfdff700 1 Processor -- start 2023-10-09T11:57:47.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.304+0000 7fa5bfdff700 1 -- start start 2023-10-09T11:57:47.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5bfdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 0x7fa5b80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5bfdff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5b80b0300 0x7fa5b80b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5bfdff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b80c9810 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5bfdff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b80c9680 con 0x7fa5b80b0300 2023-10-09T11:57:47.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5bfdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80adf80 con 0x7fa5b8156770 2023-10-09T11:57:47.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5be39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5b80b0300 0x7fa5b80b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5be39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5b80b0300 0x7fa5b80b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43586/0 (socket says 172.21.15.86:43586) 2023-10-09T11:57:47.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5be39c700 1 -- 172.21.15.86:0/3309613560 learned_addr learned my addr 172.21.15.86:0/3309613560 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:47.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.305+0000 7fa5bdb9b700 1 --2- 172.21.15.86:0/3309613560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 0x7fa5b80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5be39c700 1 -- 172.21.15.86:0/3309613560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 msgr2=0x7fa5b80b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:47.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5be39c700 1 --2- 172.21.15.86:0/3309613560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 0x7fa5b80b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5be39c700 1 -- 172.21.15.86:0/3309613560 >> v1:172.21.15.135:6789/0 conn(0x7fa5b80ad9b0 legacy=0x7fa5b80c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5be39c700 1 -- 172.21.15.86:0/3309613560 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80ae260 con 0x7fa5b80b0300 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5be39c700 1 --2- 172.21.15.86:0/3309613560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80b0300 0x7fa5b80b1110 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009f20 tx=0x7fa5b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4496772cd27b8550 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5bcb99700 1 -- 172.21.15.86:0/3309613560 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000e070 con 0x7fa5b80b0300 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5bcb99700 1 -- 172.21.15.86:0/3309613560 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000b9d0 con 0x7fa5b80b0300 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.306+0000 7fa5bcb99700 1 -- 172.21.15.86:0/3309613560 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00092e0 con 0x7fa5b80b0300 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 -- 172.21.15.86:0/3309613560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80b0300 msgr2=0x7fa5b80b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/3309613560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80b0300 0x7fa5b80b1110 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009f20 tx=0x7fa5b0009840 comp rx=0 tx=0).stop 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 -- 172.21.15.86:0/3309613560 shutdown_connections 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/3309613560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80b0300 0x7fa5b80b1110 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/3309613560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 0x7fa5b80b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 -- 172.21.15.86:0/3309613560 >> 172.21.15.86:0/3309613560 conn(0x7fa5b806a310 msgr2=0x7fa5b80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:47.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 -- 172.21.15.86:0/3309613560 shutdown_connections 2023-10-09T11:57:47.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.307+0000 7fa5bfdff700 1 -- 172.21.15.86:0/3309613560 wait complete. 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.308+0000 7fa5bfdff700 1 Processor -- start 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.308+0000 7fa5bfdff700 1 -- start start 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.309+0000 7fa5bfdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80ad9b0 0x7fa5b8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.309+0000 7fa5bfdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5b80b0300 0x7fa5b815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.309+0000 7fa5bfdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 0x7fa5b806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.309+0000 7fa5bfdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b815eda0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.309+0000 7fa5bfdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8150890 con 0x7fa5b80b0300 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.309+0000 7fa5bfdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b815f230 con 0x7fa5b8156770 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.309+0000 7fa5bdb9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80ad9b0 0x7fa5b8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80ad9b0 0x7fa5b8150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43588/0 (socket says 172.21.15.86:43588) 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 -- 172.21.15.86:0/1790228895 learned_addr learned my addr 172.21.15.86:0/1790228895 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 -- 172.21.15.86:0/1790228895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 msgr2=0x7fa5b806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 0x7fa5b806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 -- 172.21.15.86:0/1790228895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5b80b0300 msgr2=0x7fa5b815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5b80b0300 0x7fa5b815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 -- 172.21.15.86:0/1790228895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0009ae0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bdb9b700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80ad9b0 0x7fa5b8150350 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400e960 tx=0x7fa5b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5adffb700 1 -- 172.21.15.86:0/1790228895 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400c850 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5adffb700 1 -- 172.21.15.86:0/1790228895 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b400c9b0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b815e4f0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5adffb700 1 -- 172.21.15.86:0/1790228895 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400cd50 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.310+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b815d0d0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.311+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b804c3c0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.312+0000 7fa5adffb700 1 -- 172.21.15.86:0/1790228895 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5b4013680 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.313+0000 7fa5adffb700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa59c066f30 0x7fa59c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.313+0000 7fa5adffb700 1 -- 172.21.15.86:0/1790228895 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fa5b4084700 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.313+0000 7fa5bd39a700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa59c066f30 0x7fa59c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.314+0000 7fa5bd39a700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa59c066f30 0x7fa59c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81553e0 tx=0x7fa5a8007b40 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:47.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.317+0000 7fa5adffb700 1 -- 172.21.15.86:0/1790228895 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5b40517f0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.582+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa5b815d0d0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.583+0000 7fa5adffb700 1 -- 172.21.15.86:0/1790228895 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1113 (secure 0 0 0) 0x7fa5b815d0d0 con 0x7fa5b80ad9b0 2023-10-09T11:57:47.584 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:47.584 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1020,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2492919808,"bytes_avail":770601193472,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":46,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7167}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-09T11:55:28.374067+0000","services":{}},"progress_events":{}} 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa59c066f30 msgr2=0x7fa59c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa59c066f30 0x7fa59c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81553e0 tx=0x7fa5a8007b40 comp rx=0 tx=0).stop 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80ad9b0 msgr2=0x7fa5b8150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80ad9b0 0x7fa5b8150350 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400e960 tx=0x7fa5b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 shutdown_connections 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa59c066f30 0x7fa59c0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5b80ad9b0 0x7fa5b8150350 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5b8156770 0x7fa5b806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 --2- 172.21.15.86:0/1790228895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5b80b0300 0x7fa5b815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 >> 172.21.15.86:0/1790228895 conn(0x7fa5b806a310 msgr2=0x7fa5b815f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:47.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 shutdown_connections 2023-10-09T11:57:47.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.585+0000 7fa5bfdff700 1 -- 172.21.15.86:0/1790228895 wait complete. 2023-10-09T11:57:47.603 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:57:47.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:47.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.784+0000 7f6979f9d700 1 Processor -- start 2023-10-09T11:57:47.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.784+0000 7f6979f9d700 1 -- start start 2023-10-09T11:57:47.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.785+0000 7f6979f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6974159420 0x7f69740b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.785+0000 7f6979f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f697415d230 0x7f697415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.785+0000 7f6979f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740b2980 con 0x7f69741597f0 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.785+0000 7f6979f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697415db70 con 0x7f6974159420 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.785+0000 7f6979f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740b11d0 con 0x7f697415d230 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.785+0000 7f6978f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6974159420 0x7f69740b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f6978f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6974159420 0x7f69740b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43604/0 (socket says 172.21.15.86:43604) 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f6978f9b700 1 -- 172.21.15.86:0/887338430 learned_addr learned my addr 172.21.15.86:0/887338430 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f697979c700 1 --2- 172.21.15.86:0/887338430 >> v2:172.21.15.135:3300/0 conn(0x7f697415d230 0x7f697415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f6978f9b700 1 -- 172.21.15.86:0/887338430 >> v2:172.21.15.135:3300/0 conn(0x7f697415d230 msgr2=0x7f697415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f6978f9b700 1 --2- 172.21.15.86:0/887338430 >> v2:172.21.15.135:3300/0 conn(0x7f697415d230 0x7f697415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f6978f9b700 1 -- 172.21.15.86:0/887338430 >> v1:172.21.15.135:6789/0 conn(0x7f69741597f0 legacy=0x7f69740b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f6978f9b700 1 -- 172.21.15.86:0/887338430 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740b14b0 con 0x7f6974159420 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f697979c700 1 --2- 172.21.15.86:0/887338430 >> v2:172.21.15.135:3300/0 conn(0x7f697415d230 0x7f697415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f6978f9b700 1 --2- 172.21.15.86:0/887338430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69740b5f40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f697415d170 tx=0x7f6968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530e01cbacf9031d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f69737fe700 1 -- 172.21.15.86:0/887338430 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696800b860 con 0x7f6974159420 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f69737fe700 1 -- 172.21.15.86:0/887338430 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696800b9c0 con 0x7f6974159420 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.786+0000 7f69737fe700 1 -- 172.21.15.86:0/887338430 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696800bd60 con 0x7f6974159420 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 -- 172.21.15.86:0/887338430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 msgr2=0x7f69740b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 --2- 172.21.15.86:0/887338430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69740b5f40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f697415d170 tx=0x7f6968009250 comp rx=0 tx=0).stop 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 -- 172.21.15.86:0/887338430 shutdown_connections 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 --2- 172.21.15.86:0/887338430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69740b5f40 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 --2- 172.21.15.86:0/887338430 >> v2:172.21.15.135:3300/0 conn(0x7f697415d230 0x7f697415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 -- 172.21.15.86:0/887338430 >> 172.21.15.86:0/887338430 conn(0x7f69740d0660 msgr2=0x7f69740d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:47.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 -- 172.21.15.86:0/887338430 shutdown_connections 2023-10-09T11:57:47.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.787+0000 7f6979f9d700 1 -- 172.21.15.86:0/887338430 wait complete. 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.789+0000 7f6979f9d700 1 Processor -- start 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.789+0000 7f6979f9d700 1 -- start start 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.789+0000 7f6979f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69741552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6979f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69741597f0 0x7f69740c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6979f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697415d230 0x7f69741581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6979f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740ca650 con 0x7f6974159420 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6979f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697416aa90 con 0x7f697415d230 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6979f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740ca8d0 con 0x7f69741597f0 2023-10-09T11:57:47.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69741552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69741552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43608/0 (socket says 172.21.15.86:43608) 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 -- 172.21.15.86:0/1112736538 learned_addr learned my addr 172.21.15.86:0/1112736538 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f697979c700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697415d230 0x7f69741581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 -- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69741597f0 msgr2=0x7f69740c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6973fff700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69741597f0 0x7f69740c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69741597f0 0x7f69740c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 -- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697415d230 msgr2=0x7f69741581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697415d230 0x7f69741581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 -- 172.21.15.86:0/1112736538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680094f0 con 0x7f6974159420 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f697979c700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697415d230 0x7f69741581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:47.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6973fff700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69741597f0 0x7f69740c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:47.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.790+0000 7f6978f9b700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69741552e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6968009290 tx=0x7f6968017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:47.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.791+0000 7f6970ff9700 1 -- 172.21.15.86:0/1112736538 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011e60 con 0x7f6974159420 2023-10-09T11:57:47.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.791+0000 7f6970ff9700 1 -- 172.21.15.86:0/1112736538 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696801f070 con 0x7f6974159420 2023-10-09T11:57:47.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.791+0000 7f6970ff9700 1 -- 172.21.15.86:0/1112736538 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696801a870 con 0x7f6974159420 2023-10-09T11:57:47.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.791+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69740cabb0 con 0x7f6974159420 2023-10-09T11:57:47.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.791+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6974155820 con 0x7f6974159420 2023-10-09T11:57:47.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.792+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69740cb0d0 con 0x7f6974159420 2023-10-09T11:57:47.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.793+0000 7f6970ff9700 1 -- 172.21.15.86:0/1112736538 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f696801abe0 con 0x7f6974159420 2023-10-09T11:57:47.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.794+0000 7f6970ff9700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6958066f30 0x7f69580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:47.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.794+0000 7f6970ff9700 1 -- 172.21.15.86:0/1112736538 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f6968021070 con 0x7f6974159420 2023-10-09T11:57:47.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.795+0000 7f6973fff700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6958066f30 0x7f69580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:47.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.795+0000 7f6973fff700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6958066f30 0x7f69580693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6974159c70 tx=0x7f6960009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:47.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.799+0000 7f6970ff9700 1 -- 172.21.15.86:0/1112736538 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69740cb0d0 con 0x7f6974159420 2023-10-09T11:57:47.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.988+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69740cb0d0 con 0x7f6958066f30 2023-10-09T11:57:47.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:47.996+0000 7f6970ff9700 1 -- 172.21.15.86:0/1112736538 <== mgr.6990 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289527 (secure 0 0 0) 0x7f69740cb0d0 con 0x7f6958066f30 2023-10-09T11:57:48.001 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:48.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6958066f30 msgr2=0x7f69580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:48.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6958066f30 0x7f69580693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6974159c70 tx=0x7f6960009040 comp rx=0 tx=0).stop 2023-10-09T11:57:48.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 msgr2=0x7f69741552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69741552e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6968009290 tx=0x7f6968017000 comp rx=0 tx=0).stop 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 shutdown_connections 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6958066f30 0x7f69580693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974159420 0x7f69741552e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f697415d230 0x7f69741581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 --2- 172.21.15.86:0/1112736538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f69741597f0 0x7f69740c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 >> 172.21.15.86:0/1112736538 conn(0x7f69740d0660 msgr2=0x7f6974069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 shutdown_connections 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:48.000+0000 7f6979f9d700 1 -- 172.21.15.86:0/1112736538 wait complete. 2023-10-09T11:57:48.004 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:48.020 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:57:47.808608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434856,"kb_used_data":11496,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752539864,"statfs":{"total":773094113280,"available":770600820736,"internally_reserved":0,"allocated":11771904,"data_stored":6275324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.950266"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894352+0000","last_change":"2023-10-09T11:57:41.887555+0000","last_active":"2023-10-09T11:57:41.894352+0000","last_peered":"2023-10-09T11:57:41.894352+0000","last_clean":"2023-10-09T11:57:41.894352+0000","last_became_active":"2023-10-09T11:57:41.887281+0000","last_became_peered":"2023-10-09T11:57:41.887281+0000","last_unstale":"2023-10-09T11:57:41.894352+0000","last_undegraded":"2023-10-09T11:57:41.894352+0000","last_fullsized":"2023-10-09T11:57:41.894352+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.836439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886876+0000","last_change":"2023-10-09T11:57:41.885708+0000","last_active":"2023-10-09T11:57:41.886876+0000","last_peered":"2023-10-09T11:57:41.886876+0000","last_clean":"2023-10-09T11:57:41.886876+0000","last_became_active":"2023-10-09T11:57:41.885454+0000","last_became_peered":"2023-10-09T11:57:41.885454+0000","last_unstale":"2023-10-09T11:57:41.886876+0000","last_undegraded":"2023-10-09T11:57:41.886876+0000","last_fullsized":"2023-10-09T11:57:41.886876+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:50.805277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893561+0000","last_change":"2023-10-09T11:57:41.890632+0000","last_active":"2023-10-09T11:57:41.893561+0000","last_peered":"2023-10-09T11:57:41.893561+0000","last_clean":"2023-10-09T11:57:41.893561+0000","last_became_active":"2023-10-09T11:57:41.890372+0000","last_became_peered":"2023-10-09T11:57:41.890372+0000","last_unstale":"2023-10-09T11:57:41.893561+0000","last_undegraded":"2023-10-09T11:57:41.893561+0000","last_fullsized":"2023-10-09T11:57:41.893561+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:57.559364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878020+0000","last_change":"2023-10-09T11:57:41.874442+0000","last_active":"2023-10-09T11:57:41.878020+0000","last_peered":"2023-10-09T11:57:41.878020+0000","last_clean":"2023-10-09T11:57:41.878020+0000","last_became_active":"2023-10-09T11:57:41.874107+0000","last_became_peered":"2023-10-09T11:57:41.874107+0000","last_unstale":"2023-10-09T11:57:41.878020+0000","last_undegraded":"2023-10-09T11:57:41.878020+0000","last_fullsized":"2023-10-09T11:57:41.878020+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:11.042520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.887134+0000","last_change":"2023-10-09T11:57:41.877378+0000","last_active":"2023-10-09T11:57:41.887134+0000","last_peered":"2023-10-09T11:57:41.887134+0000","last_clean":"2023-10-09T11:57:41.887134+0000","last_became_active":"2023-10-09T11:57:41.876905+0000","last_became_peered":"2023-10-09T11:57:41.876905+0000","last_unstale":"2023-10-09T11:57:41.887134+0000","last_undegraded":"2023-10-09T11:57:41.887134+0000","last_fullsized":"2023-10-09T11:57:41.887134+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:12.375704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883545+0000","last_change":"2023-10-09T11:57:41.881302+0000","last_active":"2023-10-09T11:57:41.883545+0000","last_peered":"2023-10-09T11:57:41.883545+0000","last_clean":"2023-10-09T11:57:41.883545+0000","last_became_active":"2023-10-09T11:57:41.881036+0000","last_became_peered":"2023-10-09T11:57:41.881036+0000","last_unstale":"2023-10-09T11:57:41.883545+0000","last_undegraded":"2023-10-09T11:57:41.883545+0000","last_fullsized":"2023-10-09T11:57:41.883545+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:29.850516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891909+0000","last_change":"2023-10-09T11:57:41.881658+0000","last_active":"2023-10-09T11:57:41.891909+0000","last_peered":"2023-10-09T11:57:41.891909+0000","last_clean":"2023-10-09T11:57:41.891909+0000","last_became_active":"2023-10-09T11:57:41.881373+0000","last_became_peered":"2023-10-09T11:57:41.881373+0000","last_unstale":"2023-10-09T11:57:41.891909+0000","last_undegraded":"2023-10-09T11:57:41.891909+0000","last_fullsized":"2023-10-09T11:57:41.891909+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:05.907761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.896092+0000","last_change":"2023-10-09T11:57:41.890567+0000","last_active":"2023-10-09T11:57:41.896092+0000","last_peered":"2023-10-09T11:57:41.896092+0000","last_clean":"2023-10-09T11:57:41.896092+0000","last_became_active":"2023-10-09T11:57:41.890306+0000","last_became_peered":"2023-10-09T11:57:41.890306+0000","last_unstale":"2023-10-09T11:57:41.896092+0000","last_undegraded":"2023-10-09T11:57:41.896092+0000","last_fullsized":"2023-10-09T11:57:41.896092+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:31.433849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891149+0000","last_change":"2023-10-09T11:57:41.885498+0000","last_active":"2023-10-09T11:57:41.891149+0000","last_peered":"2023-10-09T11:57:41.891149+0000","last_clean":"2023-10-09T11:57:41.891149+0000","last_became_active":"2023-10-09T11:57:41.885230+0000","last_became_peered":"2023-10-09T11:57:41.885230+0000","last_unstale":"2023-10-09T11:57:41.891149+0000","last_undegraded":"2023-10-09T11:57:41.891149+0000","last_fullsized":"2023-10-09T11:57:41.891149+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:42.428899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894265+0000","last_change":"2023-10-09T11:57:41.885700+0000","last_active":"2023-10-09T11:57:41.894265+0000","last_peered":"2023-10-09T11:57:41.894265+0000","last_clean":"2023-10-09T11:57:41.894265+0000","last_became_active":"2023-10-09T11:57:41.885369+0000","last_became_peered":"2023-10-09T11:57:41.885369+0000","last_unstale":"2023-10-09T11:57:41.894265+0000","last_undegraded":"2023-10-09T11:57:41.894265+0000","last_fullsized":"2023-10-09T11:57:41.894265+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:57.559364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886220+0000","last_change":"2023-10-09T11:57:41.883253+0000","last_active":"2023-10-09T11:57:41.886220+0000","last_peered":"2023-10-09T11:57:41.886220+0000","last_clean":"2023-10-09T11:57:41.886220+0000","last_became_active":"2023-10-09T11:57:41.882983+0000","last_became_peered":"2023-10-09T11:57:41.882983+0000","last_unstale":"2023-10-09T11:57:41.886220+0000","last_undegraded":"2023-10-09T11:57:41.886220+0000","last_fullsized":"2023-10-09T11:57:41.886220+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:20.381741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894490+0000","last_change":"2023-10-09T11:57:41.891017+0000","last_active":"2023-10-09T11:57:41.894490+0000","last_peered":"2023-10-09T11:57:41.894490+0000","last_clean":"2023-10-09T11:57:41.894490+0000","last_became_active":"2023-10-09T11:57:41.890649+0000","last_became_peered":"2023-10-09T11:57:41.890649+0000","last_unstale":"2023-10-09T11:57:41.894490+0000","last_undegraded":"2023-10-09T11:57:41.894490+0000","last_fullsized":"2023-10-09T11:57:41.894490+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:03.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893606+0000","last_change":"2023-10-09T11:57:41.888945+0000","last_active":"2023-10-09T11:57:41.893606+0000","last_peered":"2023-10-09T11:57:41.893606+0000","last_clean":"2023-10-09T11:57:41.893606+0000","last_became_active":"2023-10-09T11:57:41.888658+0000","last_became_peered":"2023-10-09T11:57:41.888658+0000","last_unstale":"2023-10-09T11:57:41.893606+0000","last_undegraded":"2023-10-09T11:57:41.893606+0000","last_fullsized":"2023-10-09T11:57:41.893606+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:34:29.865867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878565+0000","last_change":"2023-10-09T11:57:41.875002+0000","last_active":"2023-10-09T11:57:41.878565+0000","last_peered":"2023-10-09T11:57:41.878565+0000","last_clean":"2023-10-09T11:57:41.878565+0000","last_became_active":"2023-10-09T11:57:41.874764+0000","last_became_peered":"2023-10-09T11:57:41.874764+0000","last_unstale":"2023-10-09T11:57:41.878565+0000","last_undegraded":"2023-10-09T11:57:41.878565+0000","last_fullsized":"2023-10-09T11:57:41.878565+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:40.297011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883585+0000","last_change":"2023-10-09T11:57:41.880800+0000","last_active":"2023-10-09T11:57:41.883585+0000","last_peered":"2023-10-09T11:57:41.883585+0000","last_clean":"2023-10-09T11:57:41.883585+0000","last_became_active":"2023-10-09T11:57:41.880431+0000","last_became_peered":"2023-10-09T11:57:41.880431+0000","last_unstale":"2023-10-09T11:57:41.883585+0000","last_undegraded":"2023-10-09T11:57:41.883585+0000","last_fullsized":"2023-10-09T11:57:41.883585+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:38.935486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.888706+0000","last_change":"2023-10-09T11:57:41.880743+0000","last_active":"2023-10-09T11:57:41.888706+0000","last_peered":"2023-10-09T11:57:41.888706+0000","last_clean":"2023-10-09T11:57:41.888706+0000","last_became_active":"2023-10-09T11:57:41.880503+0000","last_became_peered":"2023-10-09T11:57:41.880503+0000","last_unstale":"2023-10-09T11:57:41.888706+0000","last_undegraded":"2023-10-09T11:57:41.888706+0000","last_fullsized":"2023-10-09T11:57:41.888706+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:50.436790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879037+0000","last_change":"2023-10-09T11:57:41.871949+0000","last_active":"2023-10-09T11:57:41.879037+0000","last_peered":"2023-10-09T11:57:41.879037+0000","last_clean":"2023-10-09T11:57:41.879037+0000","last_became_active":"2023-10-09T11:57:41.871707+0000","last_became_peered":"2023-10-09T11:57:41.871707+0000","last_unstale":"2023-10-09T11:57:41.879037+0000","last_undegraded":"2023-10-09T11:57:41.879037+0000","last_fullsized":"2023-10-09T11:57:41.879037+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:13.985735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.895609+0000","last_change":"2023-10-09T11:57:41.892271+0000","last_active":"2023-10-09T11:57:41.895609+0000","last_peered":"2023-10-09T11:57:41.895609+0000","last_clean":"2023-10-09T11:57:41.895609+0000","last_became_active":"2023-10-09T11:57:41.886374+0000","last_became_peered":"2023-10-09T11:57:41.886374+0000","last_unstale":"2023-10-09T11:57:41.895609+0000","last_undegraded":"2023-10-09T11:57:41.895609+0000","last_fullsized":"2023-10-09T11:57:41.895609+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:18.521565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.873998+0000","last_change":"2023-10-09T11:57:41.870500+0000","last_active":"2023-10-09T11:57:41.873998+0000","last_peered":"2023-10-09T11:57:41.873998+0000","last_clean":"2023-10-09T11:57:41.873998+0000","last_became_active":"2023-10-09T11:57:41.869756+0000","last_became_peered":"2023-10-09T11:57:41.869756+0000","last_unstale":"2023-10-09T11:57:41.873998+0000","last_undegraded":"2023-10-09T11:57:41.873998+0000","last_fullsized":"2023-10-09T11:57:41.873998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:35.611975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.895187+0000","last_change":"2023-10-09T11:57:41.891627+0000","last_active":"2023-10-09T11:57:41.895187+0000","last_peered":"2023-10-09T11:57:41.895187+0000","last_clean":"2023-10-09T11:57:41.895187+0000","last_became_active":"2023-10-09T11:57:41.891246+0000","last_became_peered":"2023-10-09T11:57:41.891246+0000","last_unstale":"2023-10-09T11:57:41.895187+0000","last_undegraded":"2023-10-09T11:57:41.895187+0000","last_fullsized":"2023-10-09T11:57:41.895187+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:41.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881074+0000","last_change":"2023-10-09T11:57:41.877918+0000","last_active":"2023-10-09T11:57:41.881074+0000","last_peered":"2023-10-09T11:57:41.881074+0000","last_clean":"2023-10-09T11:57:41.881074+0000","last_became_active":"2023-10-09T11:57:41.877594+0000","last_became_peered":"2023-10-09T11:57:41.877594+0000","last_unstale":"2023-10-09T11:57:41.881074+0000","last_undegraded":"2023-10-09T11:57:41.881074+0000","last_fullsized":"2023-10-09T11:57:41.881074+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:53.150095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881694+0000","last_change":"2023-10-09T11:57:41.873125+0000","last_active":"2023-10-09T11:57:41.881694+0000","last_peered":"2023-10-09T11:57:41.881694+0000","last_clean":"2023-10-09T11:57:41.881694+0000","last_became_active":"2023-10-09T11:57:41.871758+0000","last_became_peered":"2023-10-09T11:57:41.871758+0000","last_unstale":"2023-10-09T11:57:41.881694+0000","last_undegraded":"2023-10-09T11:57:41.881694+0000","last_fullsized":"2023-10-09T11:57:41.881694+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:32.475146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894437+0000","last_change":"2023-10-09T11:57:41.889919+0000","last_active":"2023-10-09T11:57:41.894437+0000","last_peered":"2023-10-09T11:57:41.894437+0000","last_clean":"2023-10-09T11:57:41.894437+0000","last_became_active":"2023-10-09T11:57:41.889645+0000","last_became_peered":"2023-10-09T11:57:41.889645+0000","last_unstale":"2023-10-09T11:57:41.894437+0000","last_undegraded":"2023-10-09T11:57:41.894437+0000","last_fullsized":"2023-10-09T11:57:41.894437+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:02.599753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879895+0000","last_change":"2023-10-09T11:57:41.878742+0000","last_active":"2023-10-09T11:57:41.879895+0000","last_peered":"2023-10-09T11:57:41.879895+0000","last_clean":"2023-10-09T11:57:41.879895+0000","last_became_active":"2023-10-09T11:57:41.878460+0000","last_became_peered":"2023-10-09T11:57:41.878460+0000","last_unstale":"2023-10-09T11:57:41.879895+0000","last_undegraded":"2023-10-09T11:57:41.879895+0000","last_fullsized":"2023-10-09T11:57:41.879895+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:22.503415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890238+0000","last_change":"2023-10-09T11:57:41.889328+0000","last_active":"2023-10-09T11:57:41.890238+0000","last_peered":"2023-10-09T11:57:41.890238+0000","last_clean":"2023-10-09T11:57:41.890238+0000","last_became_active":"2023-10-09T11:57:41.889066+0000","last_became_peered":"2023-10-09T11:57:41.889066+0000","last_unstale":"2023-10-09T11:57:41.890238+0000","last_undegraded":"2023-10-09T11:57:41.890238+0000","last_fullsized":"2023-10-09T11:57:41.890238+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:30.424978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.889371+0000","last_change":"2023-10-09T11:57:41.884419+0000","last_active":"2023-10-09T11:57:41.889371+0000","last_peered":"2023-10-09T11:57:41.889371+0000","last_clean":"2023-10-09T11:57:41.889371+0000","last_became_active":"2023-10-09T11:57:41.883960+0000","last_became_peered":"2023-10-09T11:57:41.883960+0000","last_unstale":"2023-10-09T11:57:41.889371+0000","last_undegraded":"2023-10-09T11:57:41.889371+0000","last_fullsized":"2023-10-09T11:57:41.889371+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:58.847597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878954+0000","last_change":"2023-10-09T11:57:41.871946+0000","last_active":"2023-10-09T11:57:41.878954+0000","last_peered":"2023-10-09T11:57:41.878954+0000","last_clean":"2023-10-09T11:57:41.878954+0000","last_became_active":"2023-10-09T11:57:41.871666+0000","last_became_peered":"2023-10-09T11:57:41.871666+0000","last_unstale":"2023-10-09T11:57:41.878954+0000","last_undegraded":"2023-10-09T11:57:41.878954+0000","last_fullsized":"2023-10-09T11:57:41.878954+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:42.428899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894475+0000","last_change":"2023-10-09T11:57:41.887641+0000","last_active":"2023-10-09T11:57:41.894475+0000","last_peered":"2023-10-09T11:57:41.894475+0000","last_clean":"2023-10-09T11:57:41.894475+0000","last_became_active":"2023-10-09T11:57:41.887389+0000","last_became_peered":"2023-10-09T11:57:41.887389+0000","last_unstale":"2023-10-09T11:57:41.894475+0000","last_undegraded":"2023-10-09T11:57:41.894475+0000","last_fullsized":"2023-10-09T11:57:41.894475+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:58.847597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.873734+0000","last_change":"2023-10-09T11:57:41.870382+0000","last_active":"2023-10-09T11:57:41.873734+0000","last_peered":"2023-10-09T11:57:41.873734+0000","last_clean":"2023-10-09T11:57:41.873734+0000","last_became_active":"2023-10-09T11:57:41.870100+0000","last_became_peered":"2023-10-09T11:57:41.870100+0000","last_unstale":"2023-10-09T11:57:41.873734+0000","last_undegraded":"2023-10-09T11:57:41.873734+0000","last_fullsized":"2023-10-09T11:57:41.873734+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:58.392140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881676+0000","last_change":"2023-10-09T11:57:41.872384+0000","last_active":"2023-10-09T11:57:41.881676+0000","last_peered":"2023-10-09T11:57:41.881676+0000","last_clean":"2023-10-09T11:57:41.881676+0000","last_became_active":"2023-10-09T11:57:41.872141+0000","last_became_peered":"2023-10-09T11:57:41.872141+0000","last_unstale":"2023-10-09T11:57:41.881676+0000","last_undegraded":"2023-10-09T11:57:41.881676+0000","last_fullsized":"2023-10-09T11:57:41.881676+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:27.067691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879811+0000","last_change":"2023-10-09T11:57:41.878199+0000","last_active":"2023-10-09T11:57:41.879811+0000","last_peered":"2023-10-09T11:57:41.879811+0000","last_clean":"2023-10-09T11:57:41.879811+0000","last_became_active":"2023-10-09T11:57:41.877845+0000","last_became_peered":"2023-10-09T11:57:41.877845+0000","last_unstale":"2023-10-09T11:57:41.879811+0000","last_undegraded":"2023-10-09T11:57:41.879811+0000","last_fullsized":"2023-10-09T11:57:41.879811+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:37.556625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894060+0000","last_change":"2023-10-09T11:57:41.885065+0000","last_active":"2023-10-09T11:57:41.894060+0000","last_peered":"2023-10-09T11:57:41.894060+0000","last_clean":"2023-10-09T11:57:41.894060+0000","last_became_active":"2023-10-09T11:57:41.884726+0000","last_became_peered":"2023-10-09T11:57:41.884726+0000","last_unstale":"2023-10-09T11:57:41.894060+0000","last_undegraded":"2023-10-09T11:57:41.894060+0000","last_fullsized":"2023-10-09T11:57:41.894060+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:57.070663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893589+0000","last_change":"2023-10-09T11:57:41.884448+0000","last_active":"2023-10-09T11:57:41.893589+0000","last_peered":"2023-10-09T11:57:41.893589+0000","last_clean":"2023-10-09T11:57:41.893589+0000","last_became_active":"2023-10-09T11:57:41.884139+0000","last_became_peered":"2023-10-09T11:57:41.884139+0000","last_unstale":"2023-10-09T11:57:41.893589+0000","last_undegraded":"2023-10-09T11:57:41.893589+0000","last_fullsized":"2023-10-09T11:57:41.893589+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:12.545611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.902899+0000","last_change":"2023-10-09T11:57:40.879259+0000","last_active":"2023-10-09T11:57:41.902899+0000","last_peered":"2023-10-09T11:57:41.902899+0000","last_clean":"2023-10-09T11:57:41.902899+0000","last_became_active":"2023-10-09T11:57:40.878794+0000","last_became_peered":"2023-10-09T11:57:40.878794+0000","last_unstale":"2023-10-09T11:57:41.902899+0000","last_undegraded":"2023-10-09T11:57:41.902899+0000","last_fullsized":"2023-10-09T11:57:41.902899+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:11.537391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894370+0000","last_change":"2023-10-09T11:57:41.888721+0000","last_active":"2023-10-09T11:57:41.894370+0000","last_peered":"2023-10-09T11:57:41.894370+0000","last_clean":"2023-10-09T11:57:41.894370+0000","last_became_active":"2023-10-09T11:57:41.887916+0000","last_became_peered":"2023-10-09T11:57:41.887916+0000","last_unstale":"2023-10-09T11:57:41.894370+0000","last_undegraded":"2023-10-09T11:57:41.894370+0000","last_fullsized":"2023-10-09T11:57:41.894370+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:21.795097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.898375+0000","last_change":"2023-10-09T11:57:40.873871+0000","last_active":"2023-10-09T11:57:41.898375+0000","last_peered":"2023-10-09T11:57:41.898375+0000","last_clean":"2023-10-09T11:57:41.898375+0000","last_became_active":"2023-10-09T11:57:40.873532+0000","last_became_peered":"2023-10-09T11:57:40.873532+0000","last_unstale":"2023-10-09T11:57:41.898375+0000","last_undegraded":"2023-10-09T11:57:41.898375+0000","last_fullsized":"2023-10-09T11:57:41.898375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:26.059471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891547+0000","last_change":"2023-10-09T11:57:41.882693+0000","last_active":"2023-10-09T11:57:41.891547+0000","last_peered":"2023-10-09T11:57:41.891547+0000","last_clean":"2023-10-09T11:57:41.891547+0000","last_became_active":"2023-10-09T11:57:41.882347+0000","last_became_peered":"2023-10-09T11:57:41.882347+0000","last_unstale":"2023-10-09T11:57:41.891547+0000","last_undegraded":"2023-10-09T11:57:41.891547+0000","last_fullsized":"2023-10-09T11:57:41.891547+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:09.848218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.902699+0000","last_change":"2023-10-09T11:57:40.877381+0000","last_active":"2023-10-09T11:57:41.902699+0000","last_peered":"2023-10-09T11:57:41.902699+0000","last_clean":"2023-10-09T11:57:41.902699+0000","last_became_active":"2023-10-09T11:57:40.877127+0000","last_became_peered":"2023-10-09T11:57:40.877127+0000","last_unstale":"2023-10-09T11:57:41.902699+0000","last_undegraded":"2023-10-09T11:57:41.902699+0000","last_fullsized":"2023-10-09T11:57:41.902699+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:23.131750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.882338+0000","last_change":"2023-10-09T11:57:41.880978+0000","last_active":"2023-10-09T11:57:41.882338+0000","last_peered":"2023-10-09T11:57:41.882338+0000","last_clean":"2023-10-09T11:57:41.882338+0000","last_became_active":"2023-10-09T11:57:41.880679+0000","last_became_peered":"2023-10-09T11:57:41.880679+0000","last_unstale":"2023-10-09T11:57:41.882338+0000","last_undegraded":"2023-10-09T11:57:41.882338+0000","last_fullsized":"2023-10-09T11:57:41.882338+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:21.107209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.903918+0000","last_change":"2023-10-09T11:57:40.876854+0000","last_active":"2023-10-09T11:57:41.903918+0000","last_peered":"2023-10-09T11:57:41.903918+0000","last_clean":"2023-10-09T11:57:41.903918+0000","last_became_active":"2023-10-09T11:57:40.876426+0000","last_became_peered":"2023-10-09T11:57:40.876426+0000","last_unstale":"2023-10-09T11:57:41.903918+0000","last_undegraded":"2023-10-09T11:57:41.903918+0000","last_fullsized":"2023-10-09T11:57:41.903918+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:10.498948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881652+0000","last_change":"2023-10-09T11:57:41.871765+0000","last_active":"2023-10-09T11:57:41.881652+0000","last_peered":"2023-10-09T11:57:41.881652+0000","last_clean":"2023-10-09T11:57:41.881652+0000","last_became_active":"2023-10-09T11:57:41.871300+0000","last_became_peered":"2023-10-09T11:57:41.871300+0000","last_unstale":"2023-10-09T11:57:41.881652+0000","last_undegraded":"2023-10-09T11:57:41.881652+0000","last_fullsized":"2023-10-09T11:57:41.881652+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:42.440603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.899435+0000","last_change":"2023-10-09T11:57:40.872121+0000","last_active":"2023-10-09T11:57:41.899435+0000","last_peered":"2023-10-09T11:57:41.899435+0000","last_clean":"2023-10-09T11:57:41.899435+0000","last_became_active":"2023-10-09T11:57:40.871764+0000","last_became_peered":"2023-10-09T11:57:40.871764+0000","last_unstale":"2023-10-09T11:57:41.899435+0000","last_undegraded":"2023-10-09T11:57:41.899435+0000","last_fullsized":"2023-10-09T11:57:41.899435+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:41.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.887112+0000","last_change":"2023-10-09T11:57:41.877193+0000","last_active":"2023-10-09T11:57:41.887112+0000","last_peered":"2023-10-09T11:57:41.887112+0000","last_clean":"2023-10-09T11:57:41.887112+0000","last_became_active":"2023-10-09T11:57:41.876501+0000","last_became_peered":"2023-10-09T11:57:41.876501+0000","last_unstale":"2023-10-09T11:57:41.887112+0000","last_undegraded":"2023-10-09T11:57:41.887112+0000","last_fullsized":"2023-10-09T11:57:41.887112+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:31.924625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.898421+0000","last_change":"2023-10-09T11:57:40.874931+0000","last_active":"2023-10-09T11:57:41.898421+0000","last_peered":"2023-10-09T11:57:41.898421+0000","last_clean":"2023-10-09T11:57:41.898421+0000","last_became_active":"2023-10-09T11:57:40.874634+0000","last_became_peered":"2023-10-09T11:57:40.874634+0000","last_unstale":"2023-10-09T11:57:41.898421+0000","last_undegraded":"2023-10-09T11:57:41.898421+0000","last_fullsized":"2023-10-09T11:57:41.898421+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:49.797057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891385+0000","last_change":"2023-10-09T11:57:41.887766+0000","last_active":"2023-10-09T11:57:41.891385+0000","last_peered":"2023-10-09T11:57:41.891385+0000","last_clean":"2023-10-09T11:57:41.891385+0000","last_became_active":"2023-10-09T11:57:41.887499+0000","last_became_peered":"2023-10-09T11:57:41.887499+0000","last_unstale":"2023-10-09T11:57:41.891385+0000","last_undegraded":"2023-10-09T11:57:41.891385+0000","last_fullsized":"2023-10-09T11:57:41.891385+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.836439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867162+0000","last_change":"2023-10-09T11:57:40.872747+0000","last_active":"2023-10-09T11:57:41.867162+0000","last_peered":"2023-10-09T11:57:41.867162+0000","last_clean":"2023-10-09T11:57:41.867162+0000","last_became_active":"2023-10-09T11:57:40.872487+0000","last_became_peered":"2023-10-09T11:57:40.872487+0000","last_unstale":"2023-10-09T11:57:41.867162+0000","last_undegraded":"2023-10-09T11:57:41.867162+0000","last_fullsized":"2023-10-09T11:57:41.867162+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:26.622415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883566+0000","last_change":"2023-10-09T11:57:41.880665+0000","last_active":"2023-10-09T11:57:41.883566+0000","last_peered":"2023-10-09T11:57:41.883566+0000","last_clean":"2023-10-09T11:57:41.883566+0000","last_became_active":"2023-10-09T11:57:41.880095+0000","last_became_peered":"2023-10-09T11:57:41.880095+0000","last_unstale":"2023-10-09T11:57:41.883566+0000","last_undegraded":"2023-10-09T11:57:41.883566+0000","last_fullsized":"2023-10-09T11:57:41.883566+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:46.776746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.862396+0000","last_change":"2023-10-09T11:57:40.873947+0000","last_active":"2023-10-09T11:57:41.862396+0000","last_peered":"2023-10-09T11:57:41.862396+0000","last_clean":"2023-10-09T11:57:41.862396+0000","last_became_active":"2023-10-09T11:57:40.873700+0000","last_became_peered":"2023-10-09T11:57:40.873700+0000","last_unstale":"2023-10-09T11:57:41.862396+0000","last_undegraded":"2023-10-09T11:57:41.862396+0000","last_fullsized":"2023-10-09T11:57:41.862396+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:56.925882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881050+0000","last_change":"2023-10-09T11:57:41.874683+0000","last_active":"2023-10-09T11:57:41.881050+0000","last_peered":"2023-10-09T11:57:41.881050+0000","last_clean":"2023-10-09T11:57:41.881050+0000","last_became_active":"2023-10-09T11:57:41.874403+0000","last_became_peered":"2023-10-09T11:57:41.874403+0000","last_unstale":"2023-10-09T11:57:41.881050+0000","last_undegraded":"2023-10-09T11:57:41.881050+0000","last_fullsized":"2023-10-09T11:57:41.881050+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:57.140347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.875729+0000","last_change":"2023-10-09T11:57:40.880398+0000","last_active":"2023-10-09T11:57:41.875729+0000","last_peered":"2023-10-09T11:57:41.875729+0000","last_clean":"2023-10-09T11:57:41.875729+0000","last_became_active":"2023-10-09T11:57:40.880053+0000","last_became_peered":"2023-10-09T11:57:40.880053+0000","last_unstale":"2023-10-09T11:57:41.875729+0000","last_undegraded":"2023-10-09T11:57:41.875729+0000","last_fullsized":"2023-10-09T11:57:41.875729+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886358+0000","last_change":"2023-10-09T11:57:41.881877+0000","last_active":"2023-10-09T11:57:41.886358+0000","last_peered":"2023-10-09T11:57:41.886358+0000","last_clean":"2023-10-09T11:57:41.886358+0000","last_became_active":"2023-10-09T11:57:41.881599+0000","last_became_peered":"2023-10-09T11:57:41.881599+0000","last_unstale":"2023-10-09T11:57:41.886358+0000","last_undegraded":"2023-10-09T11:57:41.886358+0000","last_fullsized":"2023-10-09T11:57:41.886358+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:14.504118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.875837+0000","last_change":"2023-10-09T11:57:40.882401+0000","last_active":"2023-10-09T11:57:41.875837+0000","last_peered":"2023-10-09T11:57:41.875837+0000","last_clean":"2023-10-09T11:57:41.875837+0000","last_became_active":"2023-10-09T11:57:40.882109+0000","last_became_peered":"2023-10-09T11:57:40.882109+0000","last_unstale":"2023-10-09T11:57:41.875837+0000","last_undegraded":"2023-10-09T11:57:41.875837+0000","last_fullsized":"2023-10-09T11:57:41.875837+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:49.428570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.892900+0000","last_change":"2023-10-09T11:57:41.889460+0000","last_active":"2023-10-09T11:57:41.892900+0000","last_peered":"2023-10-09T11:57:41.892900+0000","last_clean":"2023-10-09T11:57:41.892900+0000","last_became_active":"2023-10-09T11:57:41.889198+0000","last_became_peered":"2023-10-09T11:57:41.889198+0000","last_unstale":"2023-10-09T11:57:41.892900+0000","last_undegraded":"2023-10-09T11:57:41.892900+0000","last_fullsized":"2023-10-09T11:57:41.892900+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:05.428067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.899447+0000","last_change":"2023-10-09T11:57:40.873029+0000","last_active":"2023-10-09T11:57:41.899447+0000","last_peered":"2023-10-09T11:57:41.899447+0000","last_clean":"2023-10-09T11:57:41.899447+0000","last_became_active":"2023-10-09T11:57:40.872737+0000","last_became_peered":"2023-10-09T11:57:40.872737+0000","last_unstale":"2023-10-09T11:57:41.899447+0000","last_undegraded":"2023-10-09T11:57:41.899447+0000","last_fullsized":"2023-10-09T11:57:41.899447+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:36.548406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878972+0000","last_change":"2023-10-09T11:57:41.872143+0000","last_active":"2023-10-09T11:57:41.878972+0000","last_peered":"2023-10-09T11:57:41.878972+0000","last_clean":"2023-10-09T11:57:41.878972+0000","last_became_active":"2023-10-09T11:57:41.871335+0000","last_became_peered":"2023-10-09T11:57:41.871335+0000","last_unstale":"2023-10-09T11:57:41.878972+0000","last_undegraded":"2023-10-09T11:57:41.878972+0000","last_fullsized":"2023-10-09T11:57:41.878972+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:31.433849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"107'6","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.904543+0000","last_change":"2023-10-09T11:57:40.875005+0000","last_active":"2023-10-09T11:57:41.904543+0000","last_peered":"2023-10-09T11:57:41.904543+0000","last_clean":"2023-10-09T11:57:41.904543+0000","last_became_active":"2023-10-09T11:57:40.874724+0000","last_became_peered":"2023-10-09T11:57:40.874724+0000","last_unstale":"2023-10-09T11:57:41.904543+0000","last_undegraded":"2023-10-09T11:57:41.904543+0000","last_fullsized":"2023-10-09T11:57:41.904543+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:19.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.885342+0000","last_change":"2023-10-09T11:57:41.878277+0000","last_active":"2023-10-09T11:57:41.885342+0000","last_peered":"2023-10-09T11:57:41.885342+0000","last_clean":"2023-10-09T11:57:41.885342+0000","last_became_active":"2023-10-09T11:57:41.878018+0000","last_became_peered":"2023-10-09T11:57:41.878018+0000","last_unstale":"2023-10-09T11:57:41.885342+0000","last_undegraded":"2023-10-09T11:57:41.885342+0000","last_fullsized":"2023-10-09T11:57:41.885342+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:47.790422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.901981+0000","last_change":"2023-10-09T11:57:40.876394+0000","last_active":"2023-10-09T11:57:41.901981+0000","last_peered":"2023-10-09T11:57:41.901981+0000","last_clean":"2023-10-09T11:57:41.901981+0000","last_became_active":"2023-10-09T11:57:40.876109+0000","last_became_peered":"2023-10-09T11:57:40.876109+0000","last_unstale":"2023-10-09T11:57:41.901981+0000","last_undegraded":"2023-10-09T11:57:41.901981+0000","last_fullsized":"2023-10-09T11:57:41.901981+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:12.407213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.889303+0000","last_change":"2023-10-09T11:57:41.886700+0000","last_active":"2023-10-09T11:57:41.889303+0000","last_peered":"2023-10-09T11:57:41.889303+0000","last_clean":"2023-10-09T11:57:41.889303+0000","last_became_active":"2023-10-09T11:57:41.886457+0000","last_became_peered":"2023-10-09T11:57:41.886457+0000","last_unstale":"2023-10-09T11:57:41.889303+0000","last_undegraded":"2023-10-09T11:57:41.889303+0000","last_fullsized":"2023-10-09T11:57:41.889303+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:57.070663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867037+0000","last_change":"2023-10-09T11:57:40.876062+0000","last_active":"2023-10-09T11:57:41.867037+0000","last_peered":"2023-10-09T11:57:41.867037+0000","last_clean":"2023-10-09T11:57:41.867037+0000","last_became_active":"2023-10-09T11:57:40.875748+0000","last_became_peered":"2023-10-09T11:57:40.875748+0000","last_unstale":"2023-10-09T11:57:41.867037+0000","last_undegraded":"2023-10-09T11:57:41.867037+0000","last_fullsized":"2023-10-09T11:57:41.867037+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:09.944822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.872980+0000","last_change":"2023-10-09T11:57:41.871568+0000","last_active":"2023-10-09T11:57:41.872980+0000","last_peered":"2023-10-09T11:57:41.872980+0000","last_clean":"2023-10-09T11:57:41.872980+0000","last_became_active":"2023-10-09T11:57:41.871268+0000","last_became_peered":"2023-10-09T11:57:41.871268+0000","last_unstale":"2023-10-09T11:57:41.872980+0000","last_undegraded":"2023-10-09T11:57:41.872980+0000","last_fullsized":"2023-10-09T11:57:41.872980+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:52.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.874453+0000","last_change":"2023-10-09T11:57:40.881849+0000","last_active":"2023-10-09T11:57:41.874453+0000","last_peered":"2023-10-09T11:57:41.874453+0000","last_clean":"2023-10-09T11:57:41.874453+0000","last_became_active":"2023-10-09T11:57:40.881544+0000","last_became_peered":"2023-10-09T11:57:40.881544+0000","last_unstale":"2023-10-09T11:57:41.874453+0000","last_undegraded":"2023-10-09T11:57:41.874453+0000","last_fullsized":"2023-10-09T11:57:41.874453+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:29.416759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886156+0000","last_change":"2023-10-09T11:57:41.881699+0000","last_active":"2023-10-09T11:57:41.886156+0000","last_peered":"2023-10-09T11:57:41.886156+0000","last_clean":"2023-10-09T11:57:41.886156+0000","last_became_active":"2023-10-09T11:57:41.881159+0000","last_became_peered":"2023-10-09T11:57:41.881159+0000","last_unstale":"2023-10-09T11:57:41.886156+0000","last_undegraded":"2023-10-09T11:57:41.886156+0000","last_fullsized":"2023-10-09T11:57:41.886156+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:10.582257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"107'8","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.902046+0000","last_change":"2023-10-09T11:57:40.879724+0000","last_active":"2023-10-09T11:57:41.902046+0000","last_peered":"2023-10-09T11:57:41.902046+0000","last_clean":"2023-10-09T11:57:41.902046+0000","last_became_active":"2023-10-09T11:57:40.879411+0000","last_became_peered":"2023-10-09T11:57:40.879411+0000","last_unstale":"2023-10-09T11:57:41.902046+0000","last_undegraded":"2023-10-09T11:57:41.902046+0000","last_fullsized":"2023-10-09T11:57:41.902046+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:12.138976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.889351+0000","last_change":"2023-10-09T11:57:41.884240+0000","last_active":"2023-10-09T11:57:41.889351+0000","last_peered":"2023-10-09T11:57:41.889351+0000","last_clean":"2023-10-09T11:57:41.889351+0000","last_became_active":"2023-10-09T11:57:41.883407+0000","last_became_peered":"2023-10-09T11:57:41.883407+0000","last_unstale":"2023-10-09T11:57:41.889351+0000","last_undegraded":"2023-10-09T11:57:41.889351+0000","last_fullsized":"2023-10-09T11:57:41.889351+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:53.413174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.901319+0000","last_change":"2023-10-09T11:57:40.879069+0000","last_active":"2023-10-09T11:57:41.901319+0000","last_peered":"2023-10-09T11:57:41.901319+0000","last_clean":"2023-10-09T11:57:41.901319+0000","last_became_active":"2023-10-09T11:57:40.878430+0000","last_became_peered":"2023-10-09T11:57:40.878430+0000","last_unstale":"2023-10-09T11:57:41.901319+0000","last_undegraded":"2023-10-09T11:57:41.901319+0000","last_fullsized":"2023-10-09T11:57:41.901319+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:11.761290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894139+0000","last_change":"2023-10-09T11:57:41.885240+0000","last_active":"2023-10-09T11:57:41.894139+0000","last_peered":"2023-10-09T11:57:41.894139+0000","last_clean":"2023-10-09T11:57:41.894139+0000","last_became_active":"2023-10-09T11:57:41.884855+0000","last_became_peered":"2023-10-09T11:57:41.884855+0000","last_unstale":"2023-10-09T11:57:41.894139+0000","last_undegraded":"2023-10-09T11:57:41.894139+0000","last_fullsized":"2023-10-09T11:57:41.894139+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:30.372184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.901741+0000","last_change":"2023-10-09T11:57:40.873432+0000","last_active":"2023-10-09T11:57:41.901741+0000","last_peered":"2023-10-09T11:57:41.901741+0000","last_clean":"2023-10-09T11:57:41.901741+0000","last_became_active":"2023-10-09T11:57:40.873188+0000","last_became_peered":"2023-10-09T11:57:40.873188+0000","last_unstale":"2023-10-09T11:57:41.901741+0000","last_undegraded":"2023-10-09T11:57:41.901741+0000","last_fullsized":"2023-10-09T11:57:41.901741+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:58.199970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.880257+0000","last_change":"2023-10-09T11:57:41.877337+0000","last_active":"2023-10-09T11:57:41.880257+0000","last_peered":"2023-10-09T11:57:41.880257+0000","last_clean":"2023-10-09T11:57:41.880257+0000","last_became_active":"2023-10-09T11:57:41.877003+0000","last_became_peered":"2023-10-09T11:57:41.877003+0000","last_unstale":"2023-10-09T11:57:41.880257+0000","last_undegraded":"2023-10-09T11:57:41.880257+0000","last_fullsized":"2023-10-09T11:57:41.880257+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:12.769509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867614+0000","last_change":"2023-10-09T11:57:40.876677+0000","last_active":"2023-10-09T11:57:41.867614+0000","last_peered":"2023-10-09T11:57:41.867614+0000","last_clean":"2023-10-09T11:57:41.867614+0000","last_became_active":"2023-10-09T11:57:40.876099+0000","last_became_peered":"2023-10-09T11:57:40.876099+0000","last_unstale":"2023-10-09T11:57:41.867614+0000","last_undegraded":"2023-10-09T11:57:41.867614+0000","last_fullsized":"2023-10-09T11:57:41.867614+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:52.940368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878545+0000","last_change":"2023-10-09T11:57:41.874586+0000","last_active":"2023-10-09T11:57:41.878545+0000","last_peered":"2023-10-09T11:57:41.878545+0000","last_clean":"2023-10-09T11:57:41.878545+0000","last_became_active":"2023-10-09T11:57:41.874297+0000","last_became_peered":"2023-10-09T11:57:41.874297+0000","last_unstale":"2023-10-09T11:57:41.878545+0000","last_undegraded":"2023-10-09T11:57:41.878545+0000","last_fullsized":"2023-10-09T11:57:41.878545+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:52:58.257216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.898712+0000","last_change":"2023-10-09T11:57:40.875806+0000","last_active":"2023-10-09T11:57:41.898712+0000","last_peered":"2023-10-09T11:57:41.898712+0000","last_clean":"2023-10-09T11:57:41.898712+0000","last_became_active":"2023-10-09T11:57:40.875467+0000","last_became_peered":"2023-10-09T11:57:40.875467+0000","last_unstale":"2023-10-09T11:57:41.898712+0000","last_undegraded":"2023-10-09T11:57:41.898712+0000","last_fullsized":"2023-10-09T11:57:41.898712+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:00.759742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893447+0000","last_change":"2023-10-09T11:57:41.889139+0000","last_active":"2023-10-09T11:57:41.893447+0000","last_peered":"2023-10-09T11:57:41.893447+0000","last_clean":"2023-10-09T11:57:41.893447+0000","last_became_active":"2023-10-09T11:57:41.888723+0000","last_became_peered":"2023-10-09T11:57:41.888723+0000","last_unstale":"2023-10-09T11:57:41.893447+0000","last_undegraded":"2023-10-09T11:57:41.893447+0000","last_fullsized":"2023-10-09T11:57:41.893447+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:29.789679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.870878+0000","last_change":"2023-10-09T11:57:40.878569+0000","last_active":"2023-10-09T11:57:41.870878+0000","last_peered":"2023-10-09T11:57:41.870878+0000","last_clean":"2023-10-09T11:57:41.870878+0000","last_became_active":"2023-10-09T11:57:40.878224+0000","last_became_peered":"2023-10-09T11:57:40.878224+0000","last_unstale":"2023-10-09T11:57:41.870878+0000","last_undegraded":"2023-10-09T11:57:41.870878+0000","last_fullsized":"2023-10-09T11:57:41.870878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:54.104585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894605+0000","last_change":"2023-10-09T11:57:41.884664+0000","last_active":"2023-10-09T11:57:41.894605+0000","last_peered":"2023-10-09T11:57:41.894605+0000","last_clean":"2023-10-09T11:57:41.894605+0000","last_became_active":"2023-10-09T11:57:41.883997+0000","last_became_peered":"2023-10-09T11:57:41.883997+0000","last_unstale":"2023-10-09T11:57:41.894605+0000","last_undegraded":"2023-10-09T11:57:41.894605+0000","last_fullsized":"2023-10-09T11:57:41.894605+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:02.261390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.870874+0000","last_change":"2023-10-09T11:57:40.874359+0000","last_active":"2023-10-09T11:57:41.870874+0000","last_peered":"2023-10-09T11:57:41.870874+0000","last_clean":"2023-10-09T11:57:41.870874+0000","last_became_active":"2023-10-09T11:57:40.874104+0000","last_became_peered":"2023-10-09T11:57:40.874104+0000","last_unstale":"2023-10-09T11:57:41.870874+0000","last_undegraded":"2023-10-09T11:57:41.870874+0000","last_fullsized":"2023-10-09T11:57:41.870874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:54.121823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890065+0000","last_change":"2023-10-09T11:57:41.886653+0000","last_active":"2023-10-09T11:57:41.890065+0000","last_peered":"2023-10-09T11:57:41.890065+0000","last_clean":"2023-10-09T11:57:41.890065+0000","last_became_active":"2023-10-09T11:57:41.886115+0000","last_became_peered":"2023-10-09T11:57:41.886115+0000","last_unstale":"2023-10-09T11:57:41.890065+0000","last_undegraded":"2023-10-09T11:57:41.890065+0000","last_fullsized":"2023-10-09T11:57:41.890065+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:50.614451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.866859+0000","last_change":"2023-10-09T11:57:40.875278+0000","last_active":"2023-10-09T11:57:41.866859+0000","last_peered":"2023-10-09T11:57:41.866859+0000","last_clean":"2023-10-09T11:57:41.866859+0000","last_became_active":"2023-10-09T11:57:40.874989+0000","last_became_peered":"2023-10-09T11:57:40.874989+0000","last_unstale":"2023-10-09T11:57:41.866859+0000","last_undegraded":"2023-10-09T11:57:41.866859+0000","last_fullsized":"2023-10-09T11:57:41.866859+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:46.803677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.888673+0000","last_change":"2023-10-09T11:57:41.882445+0000","last_active":"2023-10-09T11:57:41.888673+0000","last_peered":"2023-10-09T11:57:41.888673+0000","last_clean":"2023-10-09T11:57:41.888673+0000","last_became_active":"2023-10-09T11:57:41.882196+0000","last_became_peered":"2023-10-09T11:57:41.882196+0000","last_unstale":"2023-10-09T11:57:41.888673+0000","last_undegraded":"2023-10-09T11:57:41.888673+0000","last_fullsized":"2023-10-09T11:57:41.888673+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:14.504118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.897115+0000","last_change":"2023-10-09T11:57:40.878383+0000","last_active":"2023-10-09T11:57:41.897115+0000","last_peered":"2023-10-09T11:57:41.897115+0000","last_clean":"2023-10-09T11:57:41.897115+0000","last_became_active":"2023-10-09T11:57:40.877868+0000","last_became_peered":"2023-10-09T11:57:40.877868+0000","last_unstale":"2023-10-09T11:57:41.897115+0000","last_undegraded":"2023-10-09T11:57:41.897115+0000","last_fullsized":"2023-10-09T11:57:41.897115+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:04.368165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893687+0000","last_change":"2023-10-09T11:57:41.889795+0000","last_active":"2023-10-09T11:57:41.893687+0000","last_peered":"2023-10-09T11:57:41.893687+0000","last_clean":"2023-10-09T11:57:41.893687+0000","last_became_active":"2023-10-09T11:57:41.889428+0000","last_became_peered":"2023-10-09T11:57:41.889428+0000","last_unstale":"2023-10-09T11:57:41.893687+0000","last_undegraded":"2023-10-09T11:57:41.893687+0000","last_fullsized":"2023-10-09T11:57:41.893687+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:03.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.863273+0000","last_change":"2023-10-09T11:57:40.875052+0000","last_active":"2023-10-09T11:57:41.863273+0000","last_peered":"2023-10-09T11:57:41.863273+0000","last_clean":"2023-10-09T11:57:41.863273+0000","last_became_active":"2023-10-09T11:57:40.874800+0000","last_became_peered":"2023-10-09T11:57:40.874800+0000","last_unstale":"2023-10-09T11:57:41.863273+0000","last_undegraded":"2023-10-09T11:57:41.863273+0000","last_fullsized":"2023-10-09T11:57:41.863273+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:03.223952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883852+0000","last_change":"2023-10-09T11:57:41.879827+0000","last_active":"2023-10-09T11:57:41.883852+0000","last_peered":"2023-10-09T11:57:41.883852+0000","last_clean":"2023-10-09T11:57:41.883852+0000","last_became_active":"2023-10-09T11:57:41.879540+0000","last_became_peered":"2023-10-09T11:57:41.879540+0000","last_unstale":"2023-10-09T11:57:41.883852+0000","last_undegraded":"2023-10-09T11:57:41.883852+0000","last_fullsized":"2023-10-09T11:57:41.883852+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:38.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.873119+0000","last_change":"2023-10-09T11:57:40.877529+0000","last_active":"2023-10-09T11:57:41.873119+0000","last_peered":"2023-10-09T11:57:41.873119+0000","last_clean":"2023-10-09T11:57:41.873119+0000","last_became_active":"2023-10-09T11:57:40.877252+0000","last_became_peered":"2023-10-09T11:57:40.877252+0000","last_unstale":"2023-10-09T11:57:41.873119+0000","last_undegraded":"2023-10-09T11:57:41.873119+0000","last_fullsized":"2023-10-09T11:57:41.873119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:30.425629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.877213+0000","last_change":"2023-10-09T11:57:41.870208+0000","last_active":"2023-10-09T11:57:41.877213+0000","last_peered":"2023-10-09T11:57:41.877213+0000","last_clean":"2023-10-09T11:57:41.877213+0000","last_became_active":"2023-10-09T11:57:41.869979+0000","last_became_peered":"2023-10-09T11:57:41.869979+0000","last_unstale":"2023-10-09T11:57:41.877213+0000","last_undegraded":"2023-10-09T11:57:41.877213+0000","last_fullsized":"2023-10-09T11:57:41.877213+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:50.614451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879108+0000","last_change":"2023-10-09T11:57:40.875497+0000","last_active":"2023-10-09T11:57:41.879108+0000","last_peered":"2023-10-09T11:57:41.879108+0000","last_clean":"2023-10-09T11:57:41.879108+0000","last_became_active":"2023-10-09T11:57:40.874931+0000","last_became_peered":"2023-10-09T11:57:40.874931+0000","last_unstale":"2023-10-09T11:57:41.879108+0000","last_undegraded":"2023-10-09T11:57:41.879108+0000","last_fullsized":"2023-10-09T11:57:41.879108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:12.977516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890031+0000","last_change":"2023-10-09T11:57:41.885532+0000","last_active":"2023-10-09T11:57:41.890031+0000","last_peered":"2023-10-09T11:57:41.890031+0000","last_clean":"2023-10-09T11:57:41.890031+0000","last_became_active":"2023-10-09T11:57:41.885030+0000","last_became_peered":"2023-10-09T11:57:41.885030+0000","last_unstale":"2023-10-09T11:57:41.890031+0000","last_undegraded":"2023-10-09T11:57:41.890031+0000","last_fullsized":"2023-10-09T11:57:41.890031+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:12.375704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867467+0000","last_change":"2023-10-09T11:57:40.875275+0000","last_active":"2023-10-09T11:57:41.867467+0000","last_peered":"2023-10-09T11:57:41.867467+0000","last_clean":"2023-10-09T11:57:41.867467+0000","last_became_active":"2023-10-09T11:57:40.875035+0000","last_became_peered":"2023-10-09T11:57:40.875035+0000","last_unstale":"2023-10-09T11:57:41.867467+0000","last_undegraded":"2023-10-09T11:57:41.867467+0000","last_fullsized":"2023-10-09T11:57:41.867467+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:08.274693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.885402+0000","last_change":"2023-10-09T11:57:41.882172+0000","last_active":"2023-10-09T11:57:41.885402+0000","last_peered":"2023-10-09T11:57:41.885402+0000","last_clean":"2023-10-09T11:57:41.885402+0000","last_became_active":"2023-10-09T11:57:41.881928+0000","last_became_peered":"2023-10-09T11:57:41.881928+0000","last_unstale":"2023-10-09T11:57:41.885402+0000","last_undegraded":"2023-10-09T11:57:41.885402+0000","last_fullsized":"2023-10-09T11:57:41.885402+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:20.605170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.865611+0000","last_change":"2023-10-09T11:57:40.874375+0000","last_active":"2023-10-09T11:57:41.865611+0000","last_peered":"2023-10-09T11:57:41.865611+0000","last_clean":"2023-10-09T11:57:41.865611+0000","last_became_active":"2023-10-09T11:57:40.872456+0000","last_became_peered":"2023-10-09T11:57:40.872456+0000","last_unstale":"2023-10-09T11:57:41.865611+0000","last_undegraded":"2023-10-09T11:57:41.865611+0000","last_fullsized":"2023-10-09T11:57:41.865611+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:53.226728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890024+0000","last_change":"2023-10-09T11:57:41.885615+0000","last_active":"2023-10-09T11:57:41.890024+0000","last_peered":"2023-10-09T11:57:41.890024+0000","last_clean":"2023-10-09T11:57:41.890024+0000","last_became_active":"2023-10-09T11:57:41.885369+0000","last_became_peered":"2023-10-09T11:57:41.885369+0000","last_unstale":"2023-10-09T11:57:41.890024+0000","last_undegraded":"2023-10-09T11:57:41.890024+0000","last_fullsized":"2023-10-09T11:57:41.890024+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:31.212386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.874036+0000","last_change":"2023-10-09T11:57:40.875470+0000","last_active":"2023-10-09T11:57:41.874036+0000","last_peered":"2023-10-09T11:57:41.874036+0000","last_clean":"2023-10-09T11:57:41.874036+0000","last_became_active":"2023-10-09T11:57:40.875199+0000","last_became_peered":"2023-10-09T11:57:40.875199+0000","last_unstale":"2023-10-09T11:57:41.874036+0000","last_undegraded":"2023-10-09T11:57:41.874036+0000","last_fullsized":"2023-10-09T11:57:41.874036+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:30.916405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.888141+0000","last_change":"2023-10-09T11:57:41.880582+0000","last_active":"2023-10-09T11:57:41.888141+0000","last_peered":"2023-10-09T11:57:41.888141+0000","last_clean":"2023-10-09T11:57:41.888141+0000","last_became_active":"2023-10-09T11:57:41.880306+0000","last_became_peered":"2023-10-09T11:57:41.880306+0000","last_unstale":"2023-10-09T11:57:41.888141+0000","last_undegraded":"2023-10-09T11:57:41.888141+0000","last_fullsized":"2023-10-09T11:57:41.888141+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:29.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.865242+0000","last_change":"2023-10-09T11:57:40.880697+0000","last_active":"2023-10-09T11:57:41.865242+0000","last_peered":"2023-10-09T11:57:41.865242+0000","last_clean":"2023-10-09T11:57:41.865242+0000","last_became_active":"2023-10-09T11:57:40.880387+0000","last_became_peered":"2023-10-09T11:57:40.880387+0000","last_unstale":"2023-10-09T11:57:41.865242+0000","last_undegraded":"2023-10-09T11:57:41.865242+0000","last_fullsized":"2023-10-09T11:57:41.865242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:51.909420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886201+0000","last_change":"2023-10-09T11:57:41.882927+0000","last_active":"2023-10-09T11:57:41.886201+0000","last_peered":"2023-10-09T11:57:41.886201+0000","last_clean":"2023-10-09T11:57:41.886201+0000","last_became_active":"2023-10-09T11:57:41.882300+0000","last_became_peered":"2023-10-09T11:57:41.882300+0000","last_unstale":"2023-10-09T11:57:41.886201+0000","last_undegraded":"2023-10-09T11:57:41.886201+0000","last_fullsized":"2023-10-09T11:57:41.886201+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:54.234947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.899508+0000","last_change":"2023-10-09T11:57:40.882772+0000","last_active":"2023-10-09T11:57:41.899508+0000","last_peered":"2023-10-09T11:57:41.899508+0000","last_clean":"2023-10-09T11:57:41.899508+0000","last_became_active":"2023-10-09T11:57:40.882480+0000","last_became_peered":"2023-10-09T11:57:40.882480+0000","last_unstale":"2023-10-09T11:57:41.899508+0000","last_undegraded":"2023-10-09T11:57:41.899508+0000","last_fullsized":"2023-10-09T11:57:41.899508+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:48.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"97'205","reported_seq":546,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.874506+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:57:41.874506+0000","last_peered":"2023-10-09T11:57:41.874506+0000","last_clean":"2023-10-09T11:57:41.874506+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:57:41.874506+0000","last_undegraded":"2023-10-09T11:57:41.874506+0000","last_fullsized":"2023-10-09T11:57:41.874506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":1226685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.70699999999999996},"min":{"1min":0.52500000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80500000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70199999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.93500000000000005,"5min":1.0209999999999999,"15min":1.048},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.81200000000000006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.073},"last":0.79900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.78900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.752}]},{"osd":6,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.84799999999999998,"5min":1.083,"15min":1.083},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57699999999999996,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":1.014,"5min":1.111,"15min":1.111},"last":0.61299999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476934,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":636913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.72999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68500000000000005,"15min":0.73599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81999999999999995,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.754}]},{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.71299999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.98999999999999999,"15min":1.121},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":1.0049999999999999,"15min":1.216},"last":0.77700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71099999999999997,"15min":0.752},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.008,"15min":1.139},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.70599999999999996,"15min":0.73999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89700000000000002,"5min":1.0009999999999999,"15min":1.278},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83099999999999996,"5min":1.042,"15min":1.1040000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70299999999999996,"15min":0.73699999999999999},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77500000000000002,"5min":0.98999999999999999,"15min":1.244},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.1060000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.78500000000000003,"5min":0.93600000000000005,"15min":1.143},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.80300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79400000000000004,"5min":1.03,"15min":1.327},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.68200000000000005,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.72699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":636441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.435,"15min":0.46100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58599999999999997,"5min":0.69999999999999996,"15min":1.0580000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.69499999999999995,"5min":1.079,"15min":1.079},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":1.099},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.54400000000000004},"min":{"1min":0.45700000000000002,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":1.044,"15min":1.1779999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":0.78000000000000003,"15min":1.046},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93500000000000005,"5min":1.143,"15min":1.7210000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.86299999999999999,"5min":1.1220000000000001,"15min":1.552},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.78800000000000003},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88200000000000001,"5min":1.202,"15min":1.677},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.89900000000000002,"5min":1.103,"15min":1.778},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.79900000000000004},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0760000000000001,"15min":1.623},"last":1.464},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.81999999999999995},"min":{"1min":0.58299999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89100000000000001,"5min":1.042,"15min":1.708},"last":0.78500000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93999999999999995,"5min":1.222,"15min":1.659},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95199999999999996,"5min":1.1419999999999999,"15min":1.736},"last":0.88200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542341,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072684,"statfs":{"total":96636764160,"available":96330428416,"internally_reserved":0,"allocated":1912832,"data_stored":1226649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61399999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.59999999999999998,"5min":0.89400000000000002,"15min":1.0740000000000001},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56999999999999995,"5min":2.097,"15min":2.097},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.66300000000000003,"5min":0.93899999999999995,"15min":1.131},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34200000000000003},"max":{"1min":0.55500000000000005,"5min":1.0089999999999999,"15min":1.1699999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.58799999999999997,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.432}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":0.997,"5min":1.587,"15min":1.587},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.997,"5min":1.389,"15min":1.389},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76100000000000001,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94899999999999995,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0109999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.80300000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.48299999999999998},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":0.879,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0229999999999999,"5min":1.552,"15min":1.552},"last":0.749}]}]},{"osd":2,"up_from":14,"seq":60129542341,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306768,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065072,"statfs":{"total":96636764160,"available":96322633728,"internally_reserved":0,"allocated":1318912,"data_stored":636801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61899999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.75,"15min":0.83799999999999997},"last":0.439}]},{"osd":1,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.97299999999999998},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.79900000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.59099999999999997,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99099999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.216,"15min":1.216},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.204},"last":0.78700000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.89000000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.627,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0409999999999999,"5min":1.155,"15min":1.155},"last":0.748}]}]},{"osd":3,"up_from":15,"seq":64424509638,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306776,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065064,"statfs":{"total":96636764160,"available":96322625536,"internally_reserved":0,"allocated":1327104,"data_stored":637783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.55500000000000005,"5min":0.91300000000000003,"15min":1.208},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.48699999999999999,"15min":0.51800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.44},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54600000000000004,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51400000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"max":{"1min":0.98299999999999998,"5min":1.208,"15min":1.327},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58499999999999996},"max":{"1min":1.077,"5min":1.252,"15min":1.2689999999999999},"last":0.622}]},{"osd":5,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.246,"15min":1.252},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.3660000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.504,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":0.83699999999999997,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":1.0429999999999999,"5min":1.1240000000000001,"15min":1.218},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.80500000000000005},"min":{"1min":0.62,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.25,"15min":1.333},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79000000000000004,"15min":0.81499999999999995},"min":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.3560000000000001},"last":0.64400000000000002}]}]},{"osd":4,"up_from":16,"seq":68719476933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310860,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060980,"statfs":{"total":96636764160,"available":96318443520,"internally_reserved":0,"allocated":1314816,"data_stored":636247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.374},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83699999999999997,"5min":0.95199999999999996,"15min":1.091},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.65500000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.753}]}]},{"osd":5,"up_from":16,"seq":68719476933,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":1331200,"data_stored":637805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68000000000000005,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.84999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65600000000000003,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86699999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.71799999999999997,"5min":1.909,"15min":1.909},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":2.105,"15min":2.105},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.80700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.878,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67100000000000004,"15min":0.68600000000000005},"min":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.86399999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:51.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:57:51.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.217+0000 7fc01119d700 1 Processor -- start 2023-10-09T11:57:51.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.217+0000 7fc01119d700 1 -- start start 2023-10-09T11:57:51.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc01119d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc00c150550 0x7fc00c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc01119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc01119d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c06e2a0 con 0x7fc00c150180 2023-10-09T11:57:51.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc01119d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c06b2e0 con 0x7fc00c150550 2023-10-09T11:57:51.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc01119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0c78e0 con 0x7fc00c0c7410 2023-10-09T11:57:51.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc00b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc00c150550 0x7fc00c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc00b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc00c150550 0x7fc00c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43624/0 (socket says 172.21.15.86:43624) 2023-10-09T11:57:51.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.218+0000 7fc00b7fe700 1 -- 172.21.15.86:0/635587272 learned_addr learned my addr 172.21.15.86:0/635587272 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:51.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc01099c700 1 --2- 172.21.15.86:0/635587272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00b7fe700 1 -- 172.21.15.86:0/635587272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 msgr2=0x7fc00c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00b7fe700 1 --2- 172.21.15.86:0/635587272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00b7fe700 1 -- 172.21.15.86:0/635587272 >> v1:172.21.15.135:6789/0 conn(0x7fc00c150180 legacy=0x7fc00c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00b7fe700 1 -- 172.21.15.86:0/635587272 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0c7bc0 con 0x7fc00c150550 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc01099c700 1 --2- 172.21.15.86:0/635587272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00b7fe700 1 --2- 172.21.15.86:0/635587272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c157770 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc0000099b0 tx=0x7fc000009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d8624d92db653f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00affd700 1 -- 172.21.15.86:0/635587272 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00000b820 con 0x7fc00c150550 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00affd700 1 -- 172.21.15.86:0/635587272 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00000b980 con 0x7fc00c150550 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.219+0000 7fc00affd700 1 -- 172.21.15.86:0/635587272 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00000bd20 con 0x7fc00c150550 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 -- 172.21.15.86:0/635587272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 msgr2=0x7fc00c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 --2- 172.21.15.86:0/635587272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c157770 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc0000099b0 tx=0x7fc000009250 comp rx=0 tx=0).stop 2023-10-09T11:57:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 -- 172.21.15.86:0/635587272 shutdown_connections 2023-10-09T11:57:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 --2- 172.21.15.86:0/635587272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 --2- 172.21.15.86:0/635587272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c157770 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 -- 172.21.15.86:0/635587272 >> 172.21.15.86:0/635587272 conn(0x7fc00c0cc1f0 msgr2=0x7fc00c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 -- 172.21.15.86:0/635587272 shutdown_connections 2023-10-09T11:57:51.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.220+0000 7fc01119d700 1 -- 172.21.15.86:0/635587272 wait complete. 2023-10-09T11:57:51.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.222+0000 7fc01119d700 1 Processor -- start 2023-10-09T11:57:51.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.222+0000 7fc01119d700 1 -- start start 2023-10-09T11:57:51.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01119d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc00c150180 0x7fc00c0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01119d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01119d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0ad3f0 con 0x7fc00c150550 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01119d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c14b600 con 0x7fc00c150180 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0acac0 con 0x7fc00c0c7410 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c0af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43636/0 (socket says 172.21.15.86:43636) 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 -- 172.21.15.86:0/2000191135 learned_addr learned my addr 172.21.15.86:0/2000191135 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc00b7fe700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc00c150180 0x7fc00c0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc00bfff700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 -- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 msgr2=0x7fc00c14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c14b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 -- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc00c150180 msgr2=0x7fc00c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc00c150180 0x7fc00c0aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.223+0000 7fc01099c700 1 -- 172.21.15.86:0/2000191135 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000094f0 con 0x7fc00c150550 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.224+0000 7fc01099c700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c0af4d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc00400cf90 tx=0x7fc0040078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.224+0000 7fbff3fff700 1 -- 172.21.15.86:0/2000191135 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400ae60 con 0x7fc00c150550 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.224+0000 7fbff3fff700 1 -- 172.21.15.86:0/2000191135 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004015440 con 0x7fc00c150550 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.224+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c0acda0 con 0x7fc00c150550 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.224+0000 7fbff3fff700 1 -- 172.21.15.86:0/2000191135 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004015800 con 0x7fc00c150550 2023-10-09T11:57:51.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.224+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c0b1b20 con 0x7fc00c150550 2023-10-09T11:57:51.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.225+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c04c3c0 con 0x7fc00c150550 2023-10-09T11:57:51.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.226+0000 7fbff3fff700 1 -- 172.21.15.86:0/2000191135 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc00400d440 con 0x7fc00c150550 2023-10-09T11:57:51.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.227+0000 7fbff3fff700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbff8066f30 0x7fbff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.228+0000 7fbff3fff700 1 -- 172.21.15.86:0/2000191135 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc0040852c0 con 0x7fc00c150550 2023-10-09T11:57:51.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.228+0000 7fc00bfff700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbff8066f30 0x7fbff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.228+0000 7fc00bfff700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbff8066f30 0x7fbff80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbffc003a30 tx=0x7fbffc007ea0 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:51.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.231+0000 7fbff3fff700 1 -- 172.21.15.86:0/2000191135 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0040523b0 con 0x7fc00c150550 2023-10-09T11:57:51.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.418+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc00c06ada0 con 0x7fbff8066f30 2023-10-09T11:57:51.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.426+0000 7fbff3fff700 1 -- 172.21.15.86:0/2000191135 <== mgr.6990 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289527 (secure 0 0 0) 0x7fc00c06ada0 con 0x7fbff8066f30 2023-10-09T11:57:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:51.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.430+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbff8066f30 msgr2=0x7fbff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.430+0000 7fc01119d700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbff8066f30 0x7fbff80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbffc003a30 tx=0x7fbffc007ea0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.430+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 msgr2=0x7fc00c0af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.430+0000 7fc01119d700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c0af4d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc00400cf90 tx=0x7fc0040078a0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 shutdown_connections 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbff8066f30 0x7fbff80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc00c150550 0x7fc00c0af4d0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc00c0c7410 0x7fc00c14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 --2- 172.21.15.86:0/2000191135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc00c150180 0x7fc00c0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 >> 172.21.15.86:0/2000191135 conn(0x7fc00c0cc1f0 msgr2=0x7fc00c157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 shutdown_connections 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.431+0000 7fc01119d700 1 -- 172.21.15.86:0/2000191135 wait complete. 2023-10-09T11:57:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:57:51.449 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T11:57:49.809215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434856,"kb_used_data":11496,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752539864,"statfs":{"total":773094113280,"available":770600820736,"internally_reserved":0,"allocated":11771904,"data_stored":6275324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001892"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894352+0000","last_change":"2023-10-09T11:57:41.887555+0000","last_active":"2023-10-09T11:57:41.894352+0000","last_peered":"2023-10-09T11:57:41.894352+0000","last_clean":"2023-10-09T11:57:41.894352+0000","last_became_active":"2023-10-09T11:57:41.887281+0000","last_became_peered":"2023-10-09T11:57:41.887281+0000","last_unstale":"2023-10-09T11:57:41.894352+0000","last_undegraded":"2023-10-09T11:57:41.894352+0000","last_fullsized":"2023-10-09T11:57:41.894352+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.836439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886876+0000","last_change":"2023-10-09T11:57:41.885708+0000","last_active":"2023-10-09T11:57:41.886876+0000","last_peered":"2023-10-09T11:57:41.886876+0000","last_clean":"2023-10-09T11:57:41.886876+0000","last_became_active":"2023-10-09T11:57:41.885454+0000","last_became_peered":"2023-10-09T11:57:41.885454+0000","last_unstale":"2023-10-09T11:57:41.886876+0000","last_undegraded":"2023-10-09T11:57:41.886876+0000","last_fullsized":"2023-10-09T11:57:41.886876+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:50.805277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893561+0000","last_change":"2023-10-09T11:57:41.890632+0000","last_active":"2023-10-09T11:57:41.893561+0000","last_peered":"2023-10-09T11:57:41.893561+0000","last_clean":"2023-10-09T11:57:41.893561+0000","last_became_active":"2023-10-09T11:57:41.890372+0000","last_became_peered":"2023-10-09T11:57:41.890372+0000","last_unstale":"2023-10-09T11:57:41.893561+0000","last_undegraded":"2023-10-09T11:57:41.893561+0000","last_fullsized":"2023-10-09T11:57:41.893561+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:57.559364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878020+0000","last_change":"2023-10-09T11:57:41.874442+0000","last_active":"2023-10-09T11:57:41.878020+0000","last_peered":"2023-10-09T11:57:41.878020+0000","last_clean":"2023-10-09T11:57:41.878020+0000","last_became_active":"2023-10-09T11:57:41.874107+0000","last_became_peered":"2023-10-09T11:57:41.874107+0000","last_unstale":"2023-10-09T11:57:41.878020+0000","last_undegraded":"2023-10-09T11:57:41.878020+0000","last_fullsized":"2023-10-09T11:57:41.878020+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:11.042520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.887134+0000","last_change":"2023-10-09T11:57:41.877378+0000","last_active":"2023-10-09T11:57:41.887134+0000","last_peered":"2023-10-09T11:57:41.887134+0000","last_clean":"2023-10-09T11:57:41.887134+0000","last_became_active":"2023-10-09T11:57:41.876905+0000","last_became_peered":"2023-10-09T11:57:41.876905+0000","last_unstale":"2023-10-09T11:57:41.887134+0000","last_undegraded":"2023-10-09T11:57:41.887134+0000","last_fullsized":"2023-10-09T11:57:41.887134+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:12.375704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883545+0000","last_change":"2023-10-09T11:57:41.881302+0000","last_active":"2023-10-09T11:57:41.883545+0000","last_peered":"2023-10-09T11:57:41.883545+0000","last_clean":"2023-10-09T11:57:41.883545+0000","last_became_active":"2023-10-09T11:57:41.881036+0000","last_became_peered":"2023-10-09T11:57:41.881036+0000","last_unstale":"2023-10-09T11:57:41.883545+0000","last_undegraded":"2023-10-09T11:57:41.883545+0000","last_fullsized":"2023-10-09T11:57:41.883545+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:29.850516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891909+0000","last_change":"2023-10-09T11:57:41.881658+0000","last_active":"2023-10-09T11:57:41.891909+0000","last_peered":"2023-10-09T11:57:41.891909+0000","last_clean":"2023-10-09T11:57:41.891909+0000","last_became_active":"2023-10-09T11:57:41.881373+0000","last_became_peered":"2023-10-09T11:57:41.881373+0000","last_unstale":"2023-10-09T11:57:41.891909+0000","last_undegraded":"2023-10-09T11:57:41.891909+0000","last_fullsized":"2023-10-09T11:57:41.891909+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:05.907761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.896092+0000","last_change":"2023-10-09T11:57:41.890567+0000","last_active":"2023-10-09T11:57:41.896092+0000","last_peered":"2023-10-09T11:57:41.896092+0000","last_clean":"2023-10-09T11:57:41.896092+0000","last_became_active":"2023-10-09T11:57:41.890306+0000","last_became_peered":"2023-10-09T11:57:41.890306+0000","last_unstale":"2023-10-09T11:57:41.896092+0000","last_undegraded":"2023-10-09T11:57:41.896092+0000","last_fullsized":"2023-10-09T11:57:41.896092+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:31.433849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891149+0000","last_change":"2023-10-09T11:57:41.885498+0000","last_active":"2023-10-09T11:57:41.891149+0000","last_peered":"2023-10-09T11:57:41.891149+0000","last_clean":"2023-10-09T11:57:41.891149+0000","last_became_active":"2023-10-09T11:57:41.885230+0000","last_became_peered":"2023-10-09T11:57:41.885230+0000","last_unstale":"2023-10-09T11:57:41.891149+0000","last_undegraded":"2023-10-09T11:57:41.891149+0000","last_fullsized":"2023-10-09T11:57:41.891149+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:42.428899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894265+0000","last_change":"2023-10-09T11:57:41.885700+0000","last_active":"2023-10-09T11:57:41.894265+0000","last_peered":"2023-10-09T11:57:41.894265+0000","last_clean":"2023-10-09T11:57:41.894265+0000","last_became_active":"2023-10-09T11:57:41.885369+0000","last_became_peered":"2023-10-09T11:57:41.885369+0000","last_unstale":"2023-10-09T11:57:41.894265+0000","last_undegraded":"2023-10-09T11:57:41.894265+0000","last_fullsized":"2023-10-09T11:57:41.894265+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:17:57.559364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886220+0000","last_change":"2023-10-09T11:57:41.883253+0000","last_active":"2023-10-09T11:57:41.886220+0000","last_peered":"2023-10-09T11:57:41.886220+0000","last_clean":"2023-10-09T11:57:41.886220+0000","last_became_active":"2023-10-09T11:57:41.882983+0000","last_became_peered":"2023-10-09T11:57:41.882983+0000","last_unstale":"2023-10-09T11:57:41.886220+0000","last_undegraded":"2023-10-09T11:57:41.886220+0000","last_fullsized":"2023-10-09T11:57:41.886220+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:20.381741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894490+0000","last_change":"2023-10-09T11:57:41.891017+0000","last_active":"2023-10-09T11:57:41.894490+0000","last_peered":"2023-10-09T11:57:41.894490+0000","last_clean":"2023-10-09T11:57:41.894490+0000","last_became_active":"2023-10-09T11:57:41.890649+0000","last_became_peered":"2023-10-09T11:57:41.890649+0000","last_unstale":"2023-10-09T11:57:41.894490+0000","last_undegraded":"2023-10-09T11:57:41.894490+0000","last_fullsized":"2023-10-09T11:57:41.894490+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:03.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893606+0000","last_change":"2023-10-09T11:57:41.888945+0000","last_active":"2023-10-09T11:57:41.893606+0000","last_peered":"2023-10-09T11:57:41.893606+0000","last_clean":"2023-10-09T11:57:41.893606+0000","last_became_active":"2023-10-09T11:57:41.888658+0000","last_became_peered":"2023-10-09T11:57:41.888658+0000","last_unstale":"2023-10-09T11:57:41.893606+0000","last_undegraded":"2023-10-09T11:57:41.893606+0000","last_fullsized":"2023-10-09T11:57:41.893606+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:34:29.865867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878565+0000","last_change":"2023-10-09T11:57:41.875002+0000","last_active":"2023-10-09T11:57:41.878565+0000","last_peered":"2023-10-09T11:57:41.878565+0000","last_clean":"2023-10-09T11:57:41.878565+0000","last_became_active":"2023-10-09T11:57:41.874764+0000","last_became_peered":"2023-10-09T11:57:41.874764+0000","last_unstale":"2023-10-09T11:57:41.878565+0000","last_undegraded":"2023-10-09T11:57:41.878565+0000","last_fullsized":"2023-10-09T11:57:41.878565+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:40.297011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883585+0000","last_change":"2023-10-09T11:57:41.880800+0000","last_active":"2023-10-09T11:57:41.883585+0000","last_peered":"2023-10-09T11:57:41.883585+0000","last_clean":"2023-10-09T11:57:41.883585+0000","last_became_active":"2023-10-09T11:57:41.880431+0000","last_became_peered":"2023-10-09T11:57:41.880431+0000","last_unstale":"2023-10-09T11:57:41.883585+0000","last_undegraded":"2023-10-09T11:57:41.883585+0000","last_fullsized":"2023-10-09T11:57:41.883585+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:38.935486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.888706+0000","last_change":"2023-10-09T11:57:41.880743+0000","last_active":"2023-10-09T11:57:41.888706+0000","last_peered":"2023-10-09T11:57:41.888706+0000","last_clean":"2023-10-09T11:57:41.888706+0000","last_became_active":"2023-10-09T11:57:41.880503+0000","last_became_peered":"2023-10-09T11:57:41.880503+0000","last_unstale":"2023-10-09T11:57:41.888706+0000","last_undegraded":"2023-10-09T11:57:41.888706+0000","last_fullsized":"2023-10-09T11:57:41.888706+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:50.436790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879037+0000","last_change":"2023-10-09T11:57:41.871949+0000","last_active":"2023-10-09T11:57:41.879037+0000","last_peered":"2023-10-09T11:57:41.879037+0000","last_clean":"2023-10-09T11:57:41.879037+0000","last_became_active":"2023-10-09T11:57:41.871707+0000","last_became_peered":"2023-10-09T11:57:41.871707+0000","last_unstale":"2023-10-09T11:57:41.879037+0000","last_undegraded":"2023-10-09T11:57:41.879037+0000","last_fullsized":"2023-10-09T11:57:41.879037+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:13.985735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.895609+0000","last_change":"2023-10-09T11:57:41.892271+0000","last_active":"2023-10-09T11:57:41.895609+0000","last_peered":"2023-10-09T11:57:41.895609+0000","last_clean":"2023-10-09T11:57:41.895609+0000","last_became_active":"2023-10-09T11:57:41.886374+0000","last_became_peered":"2023-10-09T11:57:41.886374+0000","last_unstale":"2023-10-09T11:57:41.895609+0000","last_undegraded":"2023-10-09T11:57:41.895609+0000","last_fullsized":"2023-10-09T11:57:41.895609+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:18.521565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.873998+0000","last_change":"2023-10-09T11:57:41.870500+0000","last_active":"2023-10-09T11:57:41.873998+0000","last_peered":"2023-10-09T11:57:41.873998+0000","last_clean":"2023-10-09T11:57:41.873998+0000","last_became_active":"2023-10-09T11:57:41.869756+0000","last_became_peered":"2023-10-09T11:57:41.869756+0000","last_unstale":"2023-10-09T11:57:41.873998+0000","last_undegraded":"2023-10-09T11:57:41.873998+0000","last_fullsized":"2023-10-09T11:57:41.873998+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:35.611975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.895187+0000","last_change":"2023-10-09T11:57:41.891627+0000","last_active":"2023-10-09T11:57:41.895187+0000","last_peered":"2023-10-09T11:57:41.895187+0000","last_clean":"2023-10-09T11:57:41.895187+0000","last_became_active":"2023-10-09T11:57:41.891246+0000","last_became_peered":"2023-10-09T11:57:41.891246+0000","last_unstale":"2023-10-09T11:57:41.895187+0000","last_undegraded":"2023-10-09T11:57:41.895187+0000","last_fullsized":"2023-10-09T11:57:41.895187+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:41.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881074+0000","last_change":"2023-10-09T11:57:41.877918+0000","last_active":"2023-10-09T11:57:41.881074+0000","last_peered":"2023-10-09T11:57:41.881074+0000","last_clean":"2023-10-09T11:57:41.881074+0000","last_became_active":"2023-10-09T11:57:41.877594+0000","last_became_peered":"2023-10-09T11:57:41.877594+0000","last_unstale":"2023-10-09T11:57:41.881074+0000","last_undegraded":"2023-10-09T11:57:41.881074+0000","last_fullsized":"2023-10-09T11:57:41.881074+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:53.150095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881694+0000","last_change":"2023-10-09T11:57:41.873125+0000","last_active":"2023-10-09T11:57:41.881694+0000","last_peered":"2023-10-09T11:57:41.881694+0000","last_clean":"2023-10-09T11:57:41.881694+0000","last_became_active":"2023-10-09T11:57:41.871758+0000","last_became_peered":"2023-10-09T11:57:41.871758+0000","last_unstale":"2023-10-09T11:57:41.881694+0000","last_undegraded":"2023-10-09T11:57:41.881694+0000","last_fullsized":"2023-10-09T11:57:41.881694+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:32.475146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894437+0000","last_change":"2023-10-09T11:57:41.889919+0000","last_active":"2023-10-09T11:57:41.894437+0000","last_peered":"2023-10-09T11:57:41.894437+0000","last_clean":"2023-10-09T11:57:41.894437+0000","last_became_active":"2023-10-09T11:57:41.889645+0000","last_became_peered":"2023-10-09T11:57:41.889645+0000","last_unstale":"2023-10-09T11:57:41.894437+0000","last_undegraded":"2023-10-09T11:57:41.894437+0000","last_fullsized":"2023-10-09T11:57:41.894437+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:02.599753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879895+0000","last_change":"2023-10-09T11:57:41.878742+0000","last_active":"2023-10-09T11:57:41.879895+0000","last_peered":"2023-10-09T11:57:41.879895+0000","last_clean":"2023-10-09T11:57:41.879895+0000","last_became_active":"2023-10-09T11:57:41.878460+0000","last_became_peered":"2023-10-09T11:57:41.878460+0000","last_unstale":"2023-10-09T11:57:41.879895+0000","last_undegraded":"2023-10-09T11:57:41.879895+0000","last_fullsized":"2023-10-09T11:57:41.879895+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:22.503415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890238+0000","last_change":"2023-10-09T11:57:41.889328+0000","last_active":"2023-10-09T11:57:41.890238+0000","last_peered":"2023-10-09T11:57:41.890238+0000","last_clean":"2023-10-09T11:57:41.890238+0000","last_became_active":"2023-10-09T11:57:41.889066+0000","last_became_peered":"2023-10-09T11:57:41.889066+0000","last_unstale":"2023-10-09T11:57:41.890238+0000","last_undegraded":"2023-10-09T11:57:41.890238+0000","last_fullsized":"2023-10-09T11:57:41.890238+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:30.424978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.889371+0000","last_change":"2023-10-09T11:57:41.884419+0000","last_active":"2023-10-09T11:57:41.889371+0000","last_peered":"2023-10-09T11:57:41.889371+0000","last_clean":"2023-10-09T11:57:41.889371+0000","last_became_active":"2023-10-09T11:57:41.883960+0000","last_became_peered":"2023-10-09T11:57:41.883960+0000","last_unstale":"2023-10-09T11:57:41.889371+0000","last_undegraded":"2023-10-09T11:57:41.889371+0000","last_fullsized":"2023-10-09T11:57:41.889371+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:58.847597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878954+0000","last_change":"2023-10-09T11:57:41.871946+0000","last_active":"2023-10-09T11:57:41.878954+0000","last_peered":"2023-10-09T11:57:41.878954+0000","last_clean":"2023-10-09T11:57:41.878954+0000","last_became_active":"2023-10-09T11:57:41.871666+0000","last_became_peered":"2023-10-09T11:57:41.871666+0000","last_unstale":"2023-10-09T11:57:41.878954+0000","last_undegraded":"2023-10-09T11:57:41.878954+0000","last_fullsized":"2023-10-09T11:57:41.878954+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:42.428899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894475+0000","last_change":"2023-10-09T11:57:41.887641+0000","last_active":"2023-10-09T11:57:41.894475+0000","last_peered":"2023-10-09T11:57:41.894475+0000","last_clean":"2023-10-09T11:57:41.894475+0000","last_became_active":"2023-10-09T11:57:41.887389+0000","last_became_peered":"2023-10-09T11:57:41.887389+0000","last_unstale":"2023-10-09T11:57:41.894475+0000","last_undegraded":"2023-10-09T11:57:41.894475+0000","last_fullsized":"2023-10-09T11:57:41.894475+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:21:58.847597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.873734+0000","last_change":"2023-10-09T11:57:41.870382+0000","last_active":"2023-10-09T11:57:41.873734+0000","last_peered":"2023-10-09T11:57:41.873734+0000","last_clean":"2023-10-09T11:57:41.873734+0000","last_became_active":"2023-10-09T11:57:41.870100+0000","last_became_peered":"2023-10-09T11:57:41.870100+0000","last_unstale":"2023-10-09T11:57:41.873734+0000","last_undegraded":"2023-10-09T11:57:41.873734+0000","last_fullsized":"2023-10-09T11:57:41.873734+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:58.392140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881676+0000","last_change":"2023-10-09T11:57:41.872384+0000","last_active":"2023-10-09T11:57:41.881676+0000","last_peered":"2023-10-09T11:57:41.881676+0000","last_clean":"2023-10-09T11:57:41.881676+0000","last_became_active":"2023-10-09T11:57:41.872141+0000","last_became_peered":"2023-10-09T11:57:41.872141+0000","last_unstale":"2023-10-09T11:57:41.881676+0000","last_undegraded":"2023-10-09T11:57:41.881676+0000","last_fullsized":"2023-10-09T11:57:41.881676+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:27.067691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879811+0000","last_change":"2023-10-09T11:57:41.878199+0000","last_active":"2023-10-09T11:57:41.879811+0000","last_peered":"2023-10-09T11:57:41.879811+0000","last_clean":"2023-10-09T11:57:41.879811+0000","last_became_active":"2023-10-09T11:57:41.877845+0000","last_became_peered":"2023-10-09T11:57:41.877845+0000","last_unstale":"2023-10-09T11:57:41.879811+0000","last_undegraded":"2023-10-09T11:57:41.879811+0000","last_fullsized":"2023-10-09T11:57:41.879811+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:37.556625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894060+0000","last_change":"2023-10-09T11:57:41.885065+0000","last_active":"2023-10-09T11:57:41.894060+0000","last_peered":"2023-10-09T11:57:41.894060+0000","last_clean":"2023-10-09T11:57:41.894060+0000","last_became_active":"2023-10-09T11:57:41.884726+0000","last_became_peered":"2023-10-09T11:57:41.884726+0000","last_unstale":"2023-10-09T11:57:41.894060+0000","last_undegraded":"2023-10-09T11:57:41.894060+0000","last_fullsized":"2023-10-09T11:57:41.894060+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:57.070663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893589+0000","last_change":"2023-10-09T11:57:41.884448+0000","last_active":"2023-10-09T11:57:41.893589+0000","last_peered":"2023-10-09T11:57:41.893589+0000","last_clean":"2023-10-09T11:57:41.893589+0000","last_became_active":"2023-10-09T11:57:41.884139+0000","last_became_peered":"2023-10-09T11:57:41.884139+0000","last_unstale":"2023-10-09T11:57:41.893589+0000","last_undegraded":"2023-10-09T11:57:41.893589+0000","last_fullsized":"2023-10-09T11:57:41.893589+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:12.545611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.902899+0000","last_change":"2023-10-09T11:57:40.879259+0000","last_active":"2023-10-09T11:57:41.902899+0000","last_peered":"2023-10-09T11:57:41.902899+0000","last_clean":"2023-10-09T11:57:41.902899+0000","last_became_active":"2023-10-09T11:57:40.878794+0000","last_became_peered":"2023-10-09T11:57:40.878794+0000","last_unstale":"2023-10-09T11:57:41.902899+0000","last_undegraded":"2023-10-09T11:57:41.902899+0000","last_fullsized":"2023-10-09T11:57:41.902899+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:11.537391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894370+0000","last_change":"2023-10-09T11:57:41.888721+0000","last_active":"2023-10-09T11:57:41.894370+0000","last_peered":"2023-10-09T11:57:41.894370+0000","last_clean":"2023-10-09T11:57:41.894370+0000","last_became_active":"2023-10-09T11:57:41.887916+0000","last_became_peered":"2023-10-09T11:57:41.887916+0000","last_unstale":"2023-10-09T11:57:41.894370+0000","last_undegraded":"2023-10-09T11:57:41.894370+0000","last_fullsized":"2023-10-09T11:57:41.894370+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:21.795097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.898375+0000","last_change":"2023-10-09T11:57:40.873871+0000","last_active":"2023-10-09T11:57:41.898375+0000","last_peered":"2023-10-09T11:57:41.898375+0000","last_clean":"2023-10-09T11:57:41.898375+0000","last_became_active":"2023-10-09T11:57:40.873532+0000","last_became_peered":"2023-10-09T11:57:40.873532+0000","last_unstale":"2023-10-09T11:57:41.898375+0000","last_undegraded":"2023-10-09T11:57:41.898375+0000","last_fullsized":"2023-10-09T11:57:41.898375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:26.059471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891547+0000","last_change":"2023-10-09T11:57:41.882693+0000","last_active":"2023-10-09T11:57:41.891547+0000","last_peered":"2023-10-09T11:57:41.891547+0000","last_clean":"2023-10-09T11:57:41.891547+0000","last_became_active":"2023-10-09T11:57:41.882347+0000","last_became_peered":"2023-10-09T11:57:41.882347+0000","last_unstale":"2023-10-09T11:57:41.891547+0000","last_undegraded":"2023-10-09T11:57:41.891547+0000","last_fullsized":"2023-10-09T11:57:41.891547+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:09.848218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.902699+0000","last_change":"2023-10-09T11:57:40.877381+0000","last_active":"2023-10-09T11:57:41.902699+0000","last_peered":"2023-10-09T11:57:41.902699+0000","last_clean":"2023-10-09T11:57:41.902699+0000","last_became_active":"2023-10-09T11:57:40.877127+0000","last_became_peered":"2023-10-09T11:57:40.877127+0000","last_unstale":"2023-10-09T11:57:41.902699+0000","last_undegraded":"2023-10-09T11:57:41.902699+0000","last_fullsized":"2023-10-09T11:57:41.902699+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:23.131750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.882338+0000","last_change":"2023-10-09T11:57:41.880978+0000","last_active":"2023-10-09T11:57:41.882338+0000","last_peered":"2023-10-09T11:57:41.882338+0000","last_clean":"2023-10-09T11:57:41.882338+0000","last_became_active":"2023-10-09T11:57:41.880679+0000","last_became_peered":"2023-10-09T11:57:41.880679+0000","last_unstale":"2023-10-09T11:57:41.882338+0000","last_undegraded":"2023-10-09T11:57:41.882338+0000","last_fullsized":"2023-10-09T11:57:41.882338+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:21.107209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.903918+0000","last_change":"2023-10-09T11:57:40.876854+0000","last_active":"2023-10-09T11:57:41.903918+0000","last_peered":"2023-10-09T11:57:41.903918+0000","last_clean":"2023-10-09T11:57:41.903918+0000","last_became_active":"2023-10-09T11:57:40.876426+0000","last_became_peered":"2023-10-09T11:57:40.876426+0000","last_unstale":"2023-10-09T11:57:41.903918+0000","last_undegraded":"2023-10-09T11:57:41.903918+0000","last_fullsized":"2023-10-09T11:57:41.903918+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:10.498948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881652+0000","last_change":"2023-10-09T11:57:41.871765+0000","last_active":"2023-10-09T11:57:41.881652+0000","last_peered":"2023-10-09T11:57:41.881652+0000","last_clean":"2023-10-09T11:57:41.881652+0000","last_became_active":"2023-10-09T11:57:41.871300+0000","last_became_peered":"2023-10-09T11:57:41.871300+0000","last_unstale":"2023-10-09T11:57:41.881652+0000","last_undegraded":"2023-10-09T11:57:41.881652+0000","last_fullsized":"2023-10-09T11:57:41.881652+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:42.440603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.899435+0000","last_change":"2023-10-09T11:57:40.872121+0000","last_active":"2023-10-09T11:57:41.899435+0000","last_peered":"2023-10-09T11:57:41.899435+0000","last_clean":"2023-10-09T11:57:41.899435+0000","last_became_active":"2023-10-09T11:57:40.871764+0000","last_became_peered":"2023-10-09T11:57:40.871764+0000","last_unstale":"2023-10-09T11:57:41.899435+0000","last_undegraded":"2023-10-09T11:57:41.899435+0000","last_fullsized":"2023-10-09T11:57:41.899435+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:41.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.887112+0000","last_change":"2023-10-09T11:57:41.877193+0000","last_active":"2023-10-09T11:57:41.887112+0000","last_peered":"2023-10-09T11:57:41.887112+0000","last_clean":"2023-10-09T11:57:41.887112+0000","last_became_active":"2023-10-09T11:57:41.876501+0000","last_became_peered":"2023-10-09T11:57:41.876501+0000","last_unstale":"2023-10-09T11:57:41.887112+0000","last_undegraded":"2023-10-09T11:57:41.887112+0000","last_fullsized":"2023-10-09T11:57:41.887112+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:31.924625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.898421+0000","last_change":"2023-10-09T11:57:40.874931+0000","last_active":"2023-10-09T11:57:41.898421+0000","last_peered":"2023-10-09T11:57:41.898421+0000","last_clean":"2023-10-09T11:57:41.898421+0000","last_became_active":"2023-10-09T11:57:40.874634+0000","last_became_peered":"2023-10-09T11:57:40.874634+0000","last_unstale":"2023-10-09T11:57:41.898421+0000","last_undegraded":"2023-10-09T11:57:41.898421+0000","last_fullsized":"2023-10-09T11:57:41.898421+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:49.797057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.891385+0000","last_change":"2023-10-09T11:57:41.887766+0000","last_active":"2023-10-09T11:57:41.891385+0000","last_peered":"2023-10-09T11:57:41.891385+0000","last_clean":"2023-10-09T11:57:41.891385+0000","last_became_active":"2023-10-09T11:57:41.887499+0000","last_became_peered":"2023-10-09T11:57:41.887499+0000","last_unstale":"2023-10-09T11:57:41.891385+0000","last_undegraded":"2023-10-09T11:57:41.891385+0000","last_fullsized":"2023-10-09T11:57:41.891385+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:52.836439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867162+0000","last_change":"2023-10-09T11:57:40.872747+0000","last_active":"2023-10-09T11:57:41.867162+0000","last_peered":"2023-10-09T11:57:41.867162+0000","last_clean":"2023-10-09T11:57:41.867162+0000","last_became_active":"2023-10-09T11:57:40.872487+0000","last_became_peered":"2023-10-09T11:57:40.872487+0000","last_unstale":"2023-10-09T11:57:41.867162+0000","last_undegraded":"2023-10-09T11:57:41.867162+0000","last_fullsized":"2023-10-09T11:57:41.867162+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:26.622415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883566+0000","last_change":"2023-10-09T11:57:41.880665+0000","last_active":"2023-10-09T11:57:41.883566+0000","last_peered":"2023-10-09T11:57:41.883566+0000","last_clean":"2023-10-09T11:57:41.883566+0000","last_became_active":"2023-10-09T11:57:41.880095+0000","last_became_peered":"2023-10-09T11:57:41.880095+0000","last_unstale":"2023-10-09T11:57:41.883566+0000","last_undegraded":"2023-10-09T11:57:41.883566+0000","last_fullsized":"2023-10-09T11:57:41.883566+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:46.776746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.862396+0000","last_change":"2023-10-09T11:57:40.873947+0000","last_active":"2023-10-09T11:57:41.862396+0000","last_peered":"2023-10-09T11:57:41.862396+0000","last_clean":"2023-10-09T11:57:41.862396+0000","last_became_active":"2023-10-09T11:57:40.873700+0000","last_became_peered":"2023-10-09T11:57:40.873700+0000","last_unstale":"2023-10-09T11:57:41.862396+0000","last_undegraded":"2023-10-09T11:57:41.862396+0000","last_fullsized":"2023-10-09T11:57:41.862396+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:56.925882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.881050+0000","last_change":"2023-10-09T11:57:41.874683+0000","last_active":"2023-10-09T11:57:41.881050+0000","last_peered":"2023-10-09T11:57:41.881050+0000","last_clean":"2023-10-09T11:57:41.881050+0000","last_became_active":"2023-10-09T11:57:41.874403+0000","last_became_peered":"2023-10-09T11:57:41.874403+0000","last_unstale":"2023-10-09T11:57:41.881050+0000","last_undegraded":"2023-10-09T11:57:41.881050+0000","last_fullsized":"2023-10-09T11:57:41.881050+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:57.140347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.875729+0000","last_change":"2023-10-09T11:57:40.880398+0000","last_active":"2023-10-09T11:57:41.875729+0000","last_peered":"2023-10-09T11:57:41.875729+0000","last_clean":"2023-10-09T11:57:41.875729+0000","last_became_active":"2023-10-09T11:57:40.880053+0000","last_became_peered":"2023-10-09T11:57:40.880053+0000","last_unstale":"2023-10-09T11:57:41.875729+0000","last_undegraded":"2023-10-09T11:57:41.875729+0000","last_fullsized":"2023-10-09T11:57:41.875729+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:41.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886358+0000","last_change":"2023-10-09T11:57:41.881877+0000","last_active":"2023-10-09T11:57:41.886358+0000","last_peered":"2023-10-09T11:57:41.886358+0000","last_clean":"2023-10-09T11:57:41.886358+0000","last_became_active":"2023-10-09T11:57:41.881599+0000","last_became_peered":"2023-10-09T11:57:41.881599+0000","last_unstale":"2023-10-09T11:57:41.886358+0000","last_undegraded":"2023-10-09T11:57:41.886358+0000","last_fullsized":"2023-10-09T11:57:41.886358+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:14.504118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.875837+0000","last_change":"2023-10-09T11:57:40.882401+0000","last_active":"2023-10-09T11:57:41.875837+0000","last_peered":"2023-10-09T11:57:41.875837+0000","last_clean":"2023-10-09T11:57:41.875837+0000","last_became_active":"2023-10-09T11:57:40.882109+0000","last_became_peered":"2023-10-09T11:57:40.882109+0000","last_unstale":"2023-10-09T11:57:41.875837+0000","last_undegraded":"2023-10-09T11:57:41.875837+0000","last_fullsized":"2023-10-09T11:57:41.875837+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:49.428570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.892900+0000","last_change":"2023-10-09T11:57:41.889460+0000","last_active":"2023-10-09T11:57:41.892900+0000","last_peered":"2023-10-09T11:57:41.892900+0000","last_clean":"2023-10-09T11:57:41.892900+0000","last_became_active":"2023-10-09T11:57:41.889198+0000","last_became_peered":"2023-10-09T11:57:41.889198+0000","last_unstale":"2023-10-09T11:57:41.892900+0000","last_undegraded":"2023-10-09T11:57:41.892900+0000","last_fullsized":"2023-10-09T11:57:41.892900+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:05.428067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.899447+0000","last_change":"2023-10-09T11:57:40.873029+0000","last_active":"2023-10-09T11:57:41.899447+0000","last_peered":"2023-10-09T11:57:41.899447+0000","last_clean":"2023-10-09T11:57:41.899447+0000","last_became_active":"2023-10-09T11:57:40.872737+0000","last_became_peered":"2023-10-09T11:57:40.872737+0000","last_unstale":"2023-10-09T11:57:41.899447+0000","last_undegraded":"2023-10-09T11:57:41.899447+0000","last_fullsized":"2023-10-09T11:57:41.899447+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:36.548406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878972+0000","last_change":"2023-10-09T11:57:41.872143+0000","last_active":"2023-10-09T11:57:41.878972+0000","last_peered":"2023-10-09T11:57:41.878972+0000","last_clean":"2023-10-09T11:57:41.878972+0000","last_became_active":"2023-10-09T11:57:41.871335+0000","last_became_peered":"2023-10-09T11:57:41.871335+0000","last_unstale":"2023-10-09T11:57:41.878972+0000","last_undegraded":"2023-10-09T11:57:41.878972+0000","last_fullsized":"2023-10-09T11:57:41.878972+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:31.433849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"107'6","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.904543+0000","last_change":"2023-10-09T11:57:40.875005+0000","last_active":"2023-10-09T11:57:41.904543+0000","last_peered":"2023-10-09T11:57:41.904543+0000","last_clean":"2023-10-09T11:57:41.904543+0000","last_became_active":"2023-10-09T11:57:40.874724+0000","last_became_peered":"2023-10-09T11:57:40.874724+0000","last_unstale":"2023-10-09T11:57:41.904543+0000","last_undegraded":"2023-10-09T11:57:41.904543+0000","last_fullsized":"2023-10-09T11:57:41.904543+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:19.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.885342+0000","last_change":"2023-10-09T11:57:41.878277+0000","last_active":"2023-10-09T11:57:41.885342+0000","last_peered":"2023-10-09T11:57:41.885342+0000","last_clean":"2023-10-09T11:57:41.885342+0000","last_became_active":"2023-10-09T11:57:41.878018+0000","last_became_peered":"2023-10-09T11:57:41.878018+0000","last_unstale":"2023-10-09T11:57:41.885342+0000","last_undegraded":"2023-10-09T11:57:41.885342+0000","last_fullsized":"2023-10-09T11:57:41.885342+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:47.790422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.901981+0000","last_change":"2023-10-09T11:57:40.876394+0000","last_active":"2023-10-09T11:57:41.901981+0000","last_peered":"2023-10-09T11:57:41.901981+0000","last_clean":"2023-10-09T11:57:41.901981+0000","last_became_active":"2023-10-09T11:57:40.876109+0000","last_became_peered":"2023-10-09T11:57:40.876109+0000","last_unstale":"2023-10-09T11:57:41.901981+0000","last_undegraded":"2023-10-09T11:57:41.901981+0000","last_fullsized":"2023-10-09T11:57:41.901981+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:12.407213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.889303+0000","last_change":"2023-10-09T11:57:41.886700+0000","last_active":"2023-10-09T11:57:41.889303+0000","last_peered":"2023-10-09T11:57:41.889303+0000","last_clean":"2023-10-09T11:57:41.889303+0000","last_became_active":"2023-10-09T11:57:41.886457+0000","last_became_peered":"2023-10-09T11:57:41.886457+0000","last_unstale":"2023-10-09T11:57:41.889303+0000","last_undegraded":"2023-10-09T11:57:41.889303+0000","last_fullsized":"2023-10-09T11:57:41.889303+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:57.070663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867037+0000","last_change":"2023-10-09T11:57:40.876062+0000","last_active":"2023-10-09T11:57:41.867037+0000","last_peered":"2023-10-09T11:57:41.867037+0000","last_clean":"2023-10-09T11:57:41.867037+0000","last_became_active":"2023-10-09T11:57:40.875748+0000","last_became_peered":"2023-10-09T11:57:40.875748+0000","last_unstale":"2023-10-09T11:57:41.867037+0000","last_undegraded":"2023-10-09T11:57:41.867037+0000","last_fullsized":"2023-10-09T11:57:41.867037+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:09.944822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.872980+0000","last_change":"2023-10-09T11:57:41.871568+0000","last_active":"2023-10-09T11:57:41.872980+0000","last_peered":"2023-10-09T11:57:41.872980+0000","last_clean":"2023-10-09T11:57:41.872980+0000","last_became_active":"2023-10-09T11:57:41.871268+0000","last_became_peered":"2023-10-09T11:57:41.871268+0000","last_unstale":"2023-10-09T11:57:41.872980+0000","last_undegraded":"2023-10-09T11:57:41.872980+0000","last_fullsized":"2023-10-09T11:57:41.872980+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:52.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.874453+0000","last_change":"2023-10-09T11:57:40.881849+0000","last_active":"2023-10-09T11:57:41.874453+0000","last_peered":"2023-10-09T11:57:41.874453+0000","last_clean":"2023-10-09T11:57:41.874453+0000","last_became_active":"2023-10-09T11:57:40.881544+0000","last_became_peered":"2023-10-09T11:57:40.881544+0000","last_unstale":"2023-10-09T11:57:41.874453+0000","last_undegraded":"2023-10-09T11:57:41.874453+0000","last_fullsized":"2023-10-09T11:57:41.874453+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:29.416759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886156+0000","last_change":"2023-10-09T11:57:41.881699+0000","last_active":"2023-10-09T11:57:41.886156+0000","last_peered":"2023-10-09T11:57:41.886156+0000","last_clean":"2023-10-09T11:57:41.886156+0000","last_became_active":"2023-10-09T11:57:41.881159+0000","last_became_peered":"2023-10-09T11:57:41.881159+0000","last_unstale":"2023-10-09T11:57:41.886156+0000","last_undegraded":"2023-10-09T11:57:41.886156+0000","last_fullsized":"2023-10-09T11:57:41.886156+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:10.582257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"107'8","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.902046+0000","last_change":"2023-10-09T11:57:40.879724+0000","last_active":"2023-10-09T11:57:41.902046+0000","last_peered":"2023-10-09T11:57:41.902046+0000","last_clean":"2023-10-09T11:57:41.902046+0000","last_became_active":"2023-10-09T11:57:40.879411+0000","last_became_peered":"2023-10-09T11:57:40.879411+0000","last_unstale":"2023-10-09T11:57:41.902046+0000","last_undegraded":"2023-10-09T11:57:41.902046+0000","last_fullsized":"2023-10-09T11:57:41.902046+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:12.138976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.889351+0000","last_change":"2023-10-09T11:57:41.884240+0000","last_active":"2023-10-09T11:57:41.889351+0000","last_peered":"2023-10-09T11:57:41.889351+0000","last_clean":"2023-10-09T11:57:41.889351+0000","last_became_active":"2023-10-09T11:57:41.883407+0000","last_became_peered":"2023-10-09T11:57:41.883407+0000","last_unstale":"2023-10-09T11:57:41.889351+0000","last_undegraded":"2023-10-09T11:57:41.889351+0000","last_fullsized":"2023-10-09T11:57:41.889351+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:53.413174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.901319+0000","last_change":"2023-10-09T11:57:40.879069+0000","last_active":"2023-10-09T11:57:41.901319+0000","last_peered":"2023-10-09T11:57:41.901319+0000","last_clean":"2023-10-09T11:57:41.901319+0000","last_became_active":"2023-10-09T11:57:40.878430+0000","last_became_peered":"2023-10-09T11:57:40.878430+0000","last_unstale":"2023-10-09T11:57:41.901319+0000","last_undegraded":"2023-10-09T11:57:41.901319+0000","last_fullsized":"2023-10-09T11:57:41.901319+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:11.761290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894139+0000","last_change":"2023-10-09T11:57:41.885240+0000","last_active":"2023-10-09T11:57:41.894139+0000","last_peered":"2023-10-09T11:57:41.894139+0000","last_clean":"2023-10-09T11:57:41.894139+0000","last_became_active":"2023-10-09T11:57:41.884855+0000","last_became_peered":"2023-10-09T11:57:41.884855+0000","last_unstale":"2023-10-09T11:57:41.894139+0000","last_undegraded":"2023-10-09T11:57:41.894139+0000","last_fullsized":"2023-10-09T11:57:41.894139+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:30.372184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.901741+0000","last_change":"2023-10-09T11:57:40.873432+0000","last_active":"2023-10-09T11:57:41.901741+0000","last_peered":"2023-10-09T11:57:41.901741+0000","last_clean":"2023-10-09T11:57:41.901741+0000","last_became_active":"2023-10-09T11:57:40.873188+0000","last_became_peered":"2023-10-09T11:57:40.873188+0000","last_unstale":"2023-10-09T11:57:41.901741+0000","last_undegraded":"2023-10-09T11:57:41.901741+0000","last_fullsized":"2023-10-09T11:57:41.901741+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:58.199970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.880257+0000","last_change":"2023-10-09T11:57:41.877337+0000","last_active":"2023-10-09T11:57:41.880257+0000","last_peered":"2023-10-09T11:57:41.880257+0000","last_clean":"2023-10-09T11:57:41.880257+0000","last_became_active":"2023-10-09T11:57:41.877003+0000","last_became_peered":"2023-10-09T11:57:41.877003+0000","last_unstale":"2023-10-09T11:57:41.880257+0000","last_undegraded":"2023-10-09T11:57:41.880257+0000","last_fullsized":"2023-10-09T11:57:41.880257+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:12.769509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867614+0000","last_change":"2023-10-09T11:57:40.876677+0000","last_active":"2023-10-09T11:57:41.867614+0000","last_peered":"2023-10-09T11:57:41.867614+0000","last_clean":"2023-10-09T11:57:41.867614+0000","last_became_active":"2023-10-09T11:57:40.876099+0000","last_became_peered":"2023-10-09T11:57:40.876099+0000","last_unstale":"2023-10-09T11:57:41.867614+0000","last_undegraded":"2023-10-09T11:57:41.867614+0000","last_fullsized":"2023-10-09T11:57:41.867614+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:52.940368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.878545+0000","last_change":"2023-10-09T11:57:41.874586+0000","last_active":"2023-10-09T11:57:41.878545+0000","last_peered":"2023-10-09T11:57:41.878545+0000","last_clean":"2023-10-09T11:57:41.878545+0000","last_became_active":"2023-10-09T11:57:41.874297+0000","last_became_peered":"2023-10-09T11:57:41.874297+0000","last_unstale":"2023-10-09T11:57:41.878545+0000","last_undegraded":"2023-10-09T11:57:41.878545+0000","last_fullsized":"2023-10-09T11:57:41.878545+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:52:58.257216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.898712+0000","last_change":"2023-10-09T11:57:40.875806+0000","last_active":"2023-10-09T11:57:41.898712+0000","last_peered":"2023-10-09T11:57:41.898712+0000","last_clean":"2023-10-09T11:57:41.898712+0000","last_became_active":"2023-10-09T11:57:40.875467+0000","last_became_peered":"2023-10-09T11:57:40.875467+0000","last_unstale":"2023-10-09T11:57:41.898712+0000","last_undegraded":"2023-10-09T11:57:41.898712+0000","last_fullsized":"2023-10-09T11:57:41.898712+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:00.759742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893447+0000","last_change":"2023-10-09T11:57:41.889139+0000","last_active":"2023-10-09T11:57:41.893447+0000","last_peered":"2023-10-09T11:57:41.893447+0000","last_clean":"2023-10-09T11:57:41.893447+0000","last_became_active":"2023-10-09T11:57:41.888723+0000","last_became_peered":"2023-10-09T11:57:41.888723+0000","last_unstale":"2023-10-09T11:57:41.893447+0000","last_undegraded":"2023-10-09T11:57:41.893447+0000","last_fullsized":"2023-10-09T11:57:41.893447+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:29.789679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.870878+0000","last_change":"2023-10-09T11:57:40.878569+0000","last_active":"2023-10-09T11:57:41.870878+0000","last_peered":"2023-10-09T11:57:41.870878+0000","last_clean":"2023-10-09T11:57:41.870878+0000","last_became_active":"2023-10-09T11:57:40.878224+0000","last_became_peered":"2023-10-09T11:57:40.878224+0000","last_unstale":"2023-10-09T11:57:41.870878+0000","last_undegraded":"2023-10-09T11:57:41.870878+0000","last_fullsized":"2023-10-09T11:57:41.870878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:54.104585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.894605+0000","last_change":"2023-10-09T11:57:41.884664+0000","last_active":"2023-10-09T11:57:41.894605+0000","last_peered":"2023-10-09T11:57:41.894605+0000","last_clean":"2023-10-09T11:57:41.894605+0000","last_became_active":"2023-10-09T11:57:41.883997+0000","last_became_peered":"2023-10-09T11:57:41.883997+0000","last_unstale":"2023-10-09T11:57:41.894605+0000","last_undegraded":"2023-10-09T11:57:41.894605+0000","last_fullsized":"2023-10-09T11:57:41.894605+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:02.261390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.870874+0000","last_change":"2023-10-09T11:57:40.874359+0000","last_active":"2023-10-09T11:57:41.870874+0000","last_peered":"2023-10-09T11:57:41.870874+0000","last_clean":"2023-10-09T11:57:41.870874+0000","last_became_active":"2023-10-09T11:57:40.874104+0000","last_became_peered":"2023-10-09T11:57:40.874104+0000","last_unstale":"2023-10-09T11:57:41.870874+0000","last_undegraded":"2023-10-09T11:57:41.870874+0000","last_fullsized":"2023-10-09T11:57:41.870874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:54.121823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890065+0000","last_change":"2023-10-09T11:57:41.886653+0000","last_active":"2023-10-09T11:57:41.890065+0000","last_peered":"2023-10-09T11:57:41.890065+0000","last_clean":"2023-10-09T11:57:41.890065+0000","last_became_active":"2023-10-09T11:57:41.886115+0000","last_became_peered":"2023-10-09T11:57:41.886115+0000","last_unstale":"2023-10-09T11:57:41.890065+0000","last_undegraded":"2023-10-09T11:57:41.890065+0000","last_fullsized":"2023-10-09T11:57:41.890065+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:50.614451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.866859+0000","last_change":"2023-10-09T11:57:40.875278+0000","last_active":"2023-10-09T11:57:41.866859+0000","last_peered":"2023-10-09T11:57:41.866859+0000","last_clean":"2023-10-09T11:57:41.866859+0000","last_became_active":"2023-10-09T11:57:40.874989+0000","last_became_peered":"2023-10-09T11:57:40.874989+0000","last_unstale":"2023-10-09T11:57:41.866859+0000","last_undegraded":"2023-10-09T11:57:41.866859+0000","last_fullsized":"2023-10-09T11:57:41.866859+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:46.803677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.888673+0000","last_change":"2023-10-09T11:57:41.882445+0000","last_active":"2023-10-09T11:57:41.888673+0000","last_peered":"2023-10-09T11:57:41.888673+0000","last_clean":"2023-10-09T11:57:41.888673+0000","last_became_active":"2023-10-09T11:57:41.882196+0000","last_became_peered":"2023-10-09T11:57:41.882196+0000","last_unstale":"2023-10-09T11:57:41.888673+0000","last_undegraded":"2023-10-09T11:57:41.888673+0000","last_fullsized":"2023-10-09T11:57:41.888673+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:14.504118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.897115+0000","last_change":"2023-10-09T11:57:40.878383+0000","last_active":"2023-10-09T11:57:41.897115+0000","last_peered":"2023-10-09T11:57:41.897115+0000","last_clean":"2023-10-09T11:57:41.897115+0000","last_became_active":"2023-10-09T11:57:40.877868+0000","last_became_peered":"2023-10-09T11:57:40.877868+0000","last_unstale":"2023-10-09T11:57:41.897115+0000","last_undegraded":"2023-10-09T11:57:41.897115+0000","last_fullsized":"2023-10-09T11:57:41.897115+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:04.368165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.893687+0000","last_change":"2023-10-09T11:57:41.889795+0000","last_active":"2023-10-09T11:57:41.893687+0000","last_peered":"2023-10-09T11:57:41.893687+0000","last_clean":"2023-10-09T11:57:41.893687+0000","last_became_active":"2023-10-09T11:57:41.889428+0000","last_became_peered":"2023-10-09T11:57:41.889428+0000","last_unstale":"2023-10-09T11:57:41.893687+0000","last_undegraded":"2023-10-09T11:57:41.893687+0000","last_fullsized":"2023-10-09T11:57:41.893687+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:03.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.863273+0000","last_change":"2023-10-09T11:57:40.875052+0000","last_active":"2023-10-09T11:57:41.863273+0000","last_peered":"2023-10-09T11:57:41.863273+0000","last_clean":"2023-10-09T11:57:41.863273+0000","last_became_active":"2023-10-09T11:57:40.874800+0000","last_became_peered":"2023-10-09T11:57:40.874800+0000","last_unstale":"2023-10-09T11:57:41.863273+0000","last_undegraded":"2023-10-09T11:57:41.863273+0000","last_fullsized":"2023-10-09T11:57:41.863273+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:03.223952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.883852+0000","last_change":"2023-10-09T11:57:41.879827+0000","last_active":"2023-10-09T11:57:41.883852+0000","last_peered":"2023-10-09T11:57:41.883852+0000","last_clean":"2023-10-09T11:57:41.883852+0000","last_became_active":"2023-10-09T11:57:41.879540+0000","last_became_peered":"2023-10-09T11:57:41.879540+0000","last_unstale":"2023-10-09T11:57:41.883852+0000","last_undegraded":"2023-10-09T11:57:41.883852+0000","last_fullsized":"2023-10-09T11:57:41.883852+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:15:38.340370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.873119+0000","last_change":"2023-10-09T11:57:40.877529+0000","last_active":"2023-10-09T11:57:41.873119+0000","last_peered":"2023-10-09T11:57:41.873119+0000","last_clean":"2023-10-09T11:57:41.873119+0000","last_became_active":"2023-10-09T11:57:40.877252+0000","last_became_peered":"2023-10-09T11:57:40.877252+0000","last_unstale":"2023-10-09T11:57:41.873119+0000","last_undegraded":"2023-10-09T11:57:41.873119+0000","last_fullsized":"2023-10-09T11:57:41.873119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:30.425629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.877213+0000","last_change":"2023-10-09T11:57:41.870208+0000","last_active":"2023-10-09T11:57:41.877213+0000","last_peered":"2023-10-09T11:57:41.877213+0000","last_clean":"2023-10-09T11:57:41.877213+0000","last_became_active":"2023-10-09T11:57:41.869979+0000","last_became_peered":"2023-10-09T11:57:41.869979+0000","last_unstale":"2023-10-09T11:57:41.877213+0000","last_undegraded":"2023-10-09T11:57:41.877213+0000","last_fullsized":"2023-10-09T11:57:41.877213+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:50.614451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.879108+0000","last_change":"2023-10-09T11:57:40.875497+0000","last_active":"2023-10-09T11:57:41.879108+0000","last_peered":"2023-10-09T11:57:41.879108+0000","last_clean":"2023-10-09T11:57:41.879108+0000","last_became_active":"2023-10-09T11:57:40.874931+0000","last_became_peered":"2023-10-09T11:57:40.874931+0000","last_unstale":"2023-10-09T11:57:41.879108+0000","last_undegraded":"2023-10-09T11:57:41.879108+0000","last_fullsized":"2023-10-09T11:57:41.879108+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:12.977516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890031+0000","last_change":"2023-10-09T11:57:41.885532+0000","last_active":"2023-10-09T11:57:41.890031+0000","last_peered":"2023-10-09T11:57:41.890031+0000","last_clean":"2023-10-09T11:57:41.890031+0000","last_became_active":"2023-10-09T11:57:41.885030+0000","last_became_peered":"2023-10-09T11:57:41.885030+0000","last_unstale":"2023-10-09T11:57:41.890031+0000","last_undegraded":"2023-10-09T11:57:41.890031+0000","last_fullsized":"2023-10-09T11:57:41.890031+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:12.375704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.867467+0000","last_change":"2023-10-09T11:57:40.875275+0000","last_active":"2023-10-09T11:57:41.867467+0000","last_peered":"2023-10-09T11:57:41.867467+0000","last_clean":"2023-10-09T11:57:41.867467+0000","last_became_active":"2023-10-09T11:57:40.875035+0000","last_became_peered":"2023-10-09T11:57:40.875035+0000","last_unstale":"2023-10-09T11:57:41.867467+0000","last_undegraded":"2023-10-09T11:57:41.867467+0000","last_fullsized":"2023-10-09T11:57:41.867467+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:08.274693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.885402+0000","last_change":"2023-10-09T11:57:41.882172+0000","last_active":"2023-10-09T11:57:41.885402+0000","last_peered":"2023-10-09T11:57:41.885402+0000","last_clean":"2023-10-09T11:57:41.885402+0000","last_became_active":"2023-10-09T11:57:41.881928+0000","last_became_peered":"2023-10-09T11:57:41.881928+0000","last_unstale":"2023-10-09T11:57:41.885402+0000","last_undegraded":"2023-10-09T11:57:41.885402+0000","last_fullsized":"2023-10-09T11:57:41.885402+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:20.605170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.865611+0000","last_change":"2023-10-09T11:57:40.874375+0000","last_active":"2023-10-09T11:57:41.865611+0000","last_peered":"2023-10-09T11:57:41.865611+0000","last_clean":"2023-10-09T11:57:41.865611+0000","last_became_active":"2023-10-09T11:57:40.872456+0000","last_became_peered":"2023-10-09T11:57:40.872456+0000","last_unstale":"2023-10-09T11:57:41.865611+0000","last_undegraded":"2023-10-09T11:57:41.865611+0000","last_fullsized":"2023-10-09T11:57:41.865611+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:53.226728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.890024+0000","last_change":"2023-10-09T11:57:41.885615+0000","last_active":"2023-10-09T11:57:41.890024+0000","last_peered":"2023-10-09T11:57:41.890024+0000","last_clean":"2023-10-09T11:57:41.890024+0000","last_became_active":"2023-10-09T11:57:41.885369+0000","last_became_peered":"2023-10-09T11:57:41.885369+0000","last_unstale":"2023-10-09T11:57:41.890024+0000","last_undegraded":"2023-10-09T11:57:41.890024+0000","last_fullsized":"2023-10-09T11:57:41.890024+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:31.212386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.874036+0000","last_change":"2023-10-09T11:57:40.875470+0000","last_active":"2023-10-09T11:57:41.874036+0000","last_peered":"2023-10-09T11:57:41.874036+0000","last_clean":"2023-10-09T11:57:41.874036+0000","last_became_active":"2023-10-09T11:57:40.875199+0000","last_became_peered":"2023-10-09T11:57:40.875199+0000","last_unstale":"2023-10-09T11:57:41.874036+0000","last_undegraded":"2023-10-09T11:57:41.874036+0000","last_fullsized":"2023-10-09T11:57:41.874036+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:30.916405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.888141+0000","last_change":"2023-10-09T11:57:41.880582+0000","last_active":"2023-10-09T11:57:41.888141+0000","last_peered":"2023-10-09T11:57:41.888141+0000","last_clean":"2023-10-09T11:57:41.888141+0000","last_became_active":"2023-10-09T11:57:41.880306+0000","last_became_peered":"2023-10-09T11:57:41.880306+0000","last_unstale":"2023-10-09T11:57:41.888141+0000","last_undegraded":"2023-10-09T11:57:41.888141+0000","last_fullsized":"2023-10-09T11:57:41.888141+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:29.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.865242+0000","last_change":"2023-10-09T11:57:40.880697+0000","last_active":"2023-10-09T11:57:41.865242+0000","last_peered":"2023-10-09T11:57:41.865242+0000","last_clean":"2023-10-09T11:57:41.865242+0000","last_became_active":"2023-10-09T11:57:40.880387+0000","last_became_peered":"2023-10-09T11:57:40.880387+0000","last_unstale":"2023-10-09T11:57:41.865242+0000","last_undegraded":"2023-10-09T11:57:41.865242+0000","last_fullsized":"2023-10-09T11:57:41.865242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:51.909420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.886201+0000","last_change":"2023-10-09T11:57:41.882927+0000","last_active":"2023-10-09T11:57:41.886201+0000","last_peered":"2023-10-09T11:57:41.886201+0000","last_clean":"2023-10-09T11:57:41.886201+0000","last_became_active":"2023-10-09T11:57:41.882300+0000","last_became_peered":"2023-10-09T11:57:41.882300+0000","last_unstale":"2023-10-09T11:57:41.886201+0000","last_undegraded":"2023-10-09T11:57:41.886201+0000","last_fullsized":"2023-10-09T11:57:41.886201+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:40.851117+0000","last_clean_scrub_stamp":"2023-10-09T11:57:40.851117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:54.234947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.899508+0000","last_change":"2023-10-09T11:57:40.882772+0000","last_active":"2023-10-09T11:57:41.899508+0000","last_peered":"2023-10-09T11:57:41.899508+0000","last_clean":"2023-10-09T11:57:41.899508+0000","last_became_active":"2023-10-09T11:57:40.882480+0000","last_became_peered":"2023-10-09T11:57:40.882480+0000","last_unstale":"2023-10-09T11:57:41.899508+0000","last_undegraded":"2023-10-09T11:57:41.899508+0000","last_fullsized":"2023-10-09T11:57:41.899508+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:57:39.842898+0000","last_clean_scrub_stamp":"2023-10-09T11:57:39.842898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:48.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"97'205","reported_seq":546,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-09T11:57:41.874506+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:57:41.874506+0000","last_peered":"2023-10-09T11:57:41.874506+0000","last_clean":"2023-10-09T11:57:41.874506+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:57:41.874506+0000","last_undegraded":"2023-10-09T11:57:41.874506+0000","last_fullsized":"2023-10-09T11:57:41.874506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476933,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":1226685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.67000000000000004,"15min":0.70699999999999996},"min":{"1min":0.52500000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":0.98199999999999998,"15min":0.98399999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.753},"min":{"1min":0.56200000000000006,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80500000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71499999999999997,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.47899999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70199999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.73699999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.93500000000000005,"5min":1.0209999999999999,"15min":1.048},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.81200000000000006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.073},"last":0.79900000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.78900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86299999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.752}]},{"osd":6,"last update":"Mon Oct 9 11:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.84799999999999998,"5min":1.083,"15min":1.083},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57699999999999996,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":1.014,"5min":1.111,"15min":1.111},"last":0.61299999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476934,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":636913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.68700000000000006,"15min":0.72999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84899999999999998,"5min":1.0549999999999999,"15min":1.0629999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68500000000000005,"15min":0.73599999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81999999999999995,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.754}]},{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66100000000000003,"15min":0.71299999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.98999999999999999,"15min":1.121},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":1.0049999999999999,"15min":1.216},"last":0.77700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71099999999999997,"15min":0.752},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79500000000000004,"5min":1.008,"15min":1.139},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.70599999999999996,"15min":0.73999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89700000000000002,"5min":1.0009999999999999,"15min":1.278},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83099999999999996,"5min":1.042,"15min":1.1040000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70299999999999996,"15min":0.73699999999999999},"min":{"1min":0.47799999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77500000000000002,"5min":0.98999999999999999,"15min":1.244},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.1060000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.623,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.40600000000000003},"max":{"1min":0.78500000000000003,"5min":0.93600000000000005,"15min":1.143},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.80300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79400000000000004,"5min":1.03,"15min":1.327},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.68200000000000005,"15min":0.69999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.72699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302680,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069160,"statfs":{"total":96636764160,"available":96326819840,"internally_reserved":0,"allocated":1327104,"data_stored":636441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.435,"15min":0.46100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.58599999999999997,"5min":0.69999999999999996,"15min":1.0580000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.69499999999999995,"5min":1.079,"15min":1.079},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.77800000000000002,"15min":1.099},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.54400000000000004},"min":{"1min":0.45700000000000002,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":1.044,"15min":1.1779999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":0.78000000000000003,"15min":1.046},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93500000000000005,"5min":1.143,"15min":1.7210000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.86299999999999999,"5min":1.1220000000000001,"15min":1.552},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.75,"15min":0.78800000000000003},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88200000000000001,"5min":1.202,"15min":1.677},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.89900000000000002,"5min":1.103,"15min":1.778},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75900000000000001,"15min":0.79900000000000004},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92100000000000004,"5min":1.0760000000000001,"15min":1.623},"last":1.464},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.81999999999999995},"min":{"1min":0.58299999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89100000000000001,"5min":1.042,"15min":1.708},"last":0.78500000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.59999999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93999999999999995,"5min":1.222,"15min":1.659},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.79100000000000004,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95199999999999996,"5min":1.1419999999999999,"15min":1.736},"last":0.88200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542341,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072684,"statfs":{"total":96636764160,"available":96330428416,"internally_reserved":0,"allocated":1912832,"data_stored":1226649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61399999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.59999999999999998,"5min":0.89400000000000002,"15min":1.0740000000000001},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56999999999999995,"5min":2.097,"15min":2.097},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.32500000000000001},"max":{"1min":0.66300000000000003,"5min":0.93899999999999995,"15min":1.131},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34200000000000003},"max":{"1min":0.55500000000000005,"5min":1.0089999999999999,"15min":1.1699999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.42199999999999999,"5min":0.40699999999999997,"15min":0.38},"max":{"1min":0.58799999999999997,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.432}]},{"osd":4,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.53200000000000003},"max":{"1min":0.997,"5min":1.587,"15min":1.587},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.997,"5min":1.389,"15min":1.389},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76100000000000001,"15min":0.78600000000000003},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94899999999999995,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0109999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.80300000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.48299999999999998},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.52500000000000002},"max":{"1min":0.879,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0229999999999999,"5min":1.552,"15min":1.552},"last":0.749}]}]},{"osd":2,"up_from":14,"seq":60129542341,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306768,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065072,"statfs":{"total":96636764160,"available":96322633728,"internally_reserved":0,"allocated":1318912,"data_stored":636801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61899999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.75,"15min":0.83799999999999997},"last":0.439}]},{"osd":1,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.97299999999999998},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53000000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.79200000000000004},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78200000000000003,"15min":0.79900000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.59099999999999997,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.99099999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.216,"15min":1.216},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78700000000000003,"15min":0.81399999999999995},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.204},"last":0.78700000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.82599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":0.89000000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.627,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0409999999999999,"5min":1.155,"15min":1.155},"last":0.748}]}]},{"osd":3,"up_from":15,"seq":64424509638,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306776,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065064,"statfs":{"total":96636764160,"available":96322625536,"internally_reserved":0,"allocated":1327104,"data_stored":637783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.55500000000000005,"5min":0.91300000000000003,"15min":1.208},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.48699999999999999,"15min":0.51800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.44},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.33700000000000002,"5min":0.317,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.81599999999999995,"15min":0.94699999999999995},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54600000000000004,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51400000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.52100000000000002},"max":{"1min":0.98299999999999998,"5min":1.208,"15min":1.327},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58499999999999996},"max":{"1min":1.077,"5min":1.252,"15min":1.2689999999999999},"last":0.622}]},{"osd":5,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.246,"15min":1.252},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.58199999999999996,"5min":0.52300000000000002,"15min":0.41299999999999998},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.3660000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.504,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":0.83699999999999997,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":1.0429999999999999,"5min":1.1240000000000001,"15min":1.218},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77400000000000002,"15min":0.80500000000000005},"min":{"1min":0.62,"5min":0.54900000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.25,"15min":1.333},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79000000000000004,"15min":0.81499999999999995},"min":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.3560000000000001},"last":0.64400000000000002}]}]},{"osd":4,"up_from":16,"seq":68719476933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310860,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060980,"statfs":{"total":96636764160,"available":96318443520,"internally_reserved":0,"allocated":1314816,"data_stored":636247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.374},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83699999999999997,"5min":0.95199999999999996,"15min":1.091},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.65500000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.82499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:57:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.753}]}]},{"osd":5,"up_from":16,"seq":68719476933,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":1331200,"data_stored":637805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68000000000000005,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.84999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65600000000000003,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":1.0840000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86699999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69299999999999995,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.71799999999999997,"5min":1.909,"15min":1.909},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79400000000000004,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79800000000000004,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.81899999999999995,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":2.105,"15min":2.105},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.80700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65000000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.878,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.67100000000000004,"15min":0.68600000000000005},"min":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.39900000000000002},"max":{"1min":0.86399999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:57:51.456 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:57:51.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:57:51.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.676+0000 7fe9e35ff700 1 Processor -- start 2023-10-09T11:57:51.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.676+0000 7fe9e35ff700 1 -- start start 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.677+0000 7fe9e35ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc1569f0 0x7fe9dc0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.677+0000 7fe9e35ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9dc068390 0x7fe9dc068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.677+0000 7fe9e35ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc15a6f0 con 0x7fe9dc156620 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.677+0000 7fe9e35ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c8d30 con 0x7fe9dc068390 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.677+0000 7fe9e35ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc068d50 con 0x7fe9dc1569f0 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9dc068390 0x7fe9dc068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9dc068390 0x7fe9dc068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43648/0 (socket says 172.21.15.86:43648) 2023-10-09T11:57:51.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 -- 172.21.15.86:0/155139942 learned_addr learned my addr 172.21.15.86:0/155139942 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:51.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e0b9a700 1 --2- 172.21.15.86:0/155139942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc1569f0 0x7fe9dc0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 -- 172.21.15.86:0/155139942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc1569f0 msgr2=0x7fe9dc0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 --2- 172.21.15.86:0/155139942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc1569f0 0x7fe9dc0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 -- 172.21.15.86:0/155139942 >> v1:172.21.15.135:6789/0 conn(0x7fe9dc156620 legacy=0x7fe9dc0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 -- 172.21.15.86:0/155139942 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc15a9d0 con 0x7fe9dc068390 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.678+0000 7fe9e1b9c700 1 --2- 172.21.15.86:0/155139942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc068390 0x7fe9dc068810 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009f50 tx=0x7fe9d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3059a084570ce8b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9d3fff700 1 -- 172.21.15.86:0/155139942 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400e070 con 0x7fe9dc068390 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9d3fff700 1 -- 172.21.15.86:0/155139942 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d400b9c0 con 0x7fe9dc068390 2023-10-09T11:57:51.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9d3fff700 1 -- 172.21.15.86:0/155139942 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40092e0 con 0x7fe9dc068390 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 -- 172.21.15.86:0/155139942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc068390 msgr2=0x7fe9dc068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/155139942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc068390 0x7fe9dc068810 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009f50 tx=0x7fe9d4009840 comp rx=0 tx=0).stop 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 -- 172.21.15.86:0/155139942 shutdown_connections 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/155139942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc068390 0x7fe9dc068810 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/155139942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc1569f0 0x7fe9dc0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 -- 172.21.15.86:0/155139942 >> 172.21.15.86:0/155139942 conn(0x7fe9dc0cc540 msgr2=0x7fe9dc0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 -- 172.21.15.86:0/155139942 shutdown_connections 2023-10-09T11:57:51.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.679+0000 7fe9e35ff700 1 -- 172.21.15.86:0/155139942 wait complete. 2023-10-09T11:57:51.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.681+0000 7fe9e35ff700 1 Processor -- start 2023-10-09T11:57:51.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.681+0000 7fe9e35ff700 1 -- start start 2023-10-09T11:57:51.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e35ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc068390 0x7fe9dc0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e35ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc156620 0x7fe9dc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e35ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9dc1569f0 0x7fe9dc06df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e35ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c3c10 con 0x7fe9dc156620 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e35ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc16db40 con 0x7fe9dc1569f0 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e35ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc16de20 con 0x7fe9dc068390 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc156620 0x7fe9dc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc156620 0x7fe9dc06da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43654/0 (socket says 172.21.15.86:43654) 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 -- 172.21.15.86:0/2113020391 learned_addr learned my addr 172.21.15.86:0/2113020391 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e1b9c700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9dc1569f0 0x7fe9dc06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e139b700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc068390 0x7fe9dc0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 -- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc068390 msgr2=0x7fe9dc0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc068390 0x7fe9dc0c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 -- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9dc1569f0 msgr2=0x7fe9dc06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9dc1569f0 0x7fe9dc06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.682+0000 7fe9e0b9a700 1 -- 172.21.15.86:0/2113020391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4009ae0 con 0x7fe9dc156620 2023-10-09T11:57:51.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.683+0000 7fe9e0b9a700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc156620 0x7fe9dc06da30 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00ec50 tx=0x7fe9cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:51.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.683+0000 7fe9d17fa700 1 -- 172.21.15.86:0/2113020391 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00c850 con 0x7fe9dc156620 2023-10-09T11:57:51.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.683+0000 7fe9d17fa700 1 -- 172.21.15.86:0/2113020391 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00c9b0 con 0x7fe9dc156620 2023-10-09T11:57:51.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.683+0000 7fe9d17fa700 1 -- 172.21.15.86:0/2113020391 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00cd70 con 0x7fe9dc156620 2023-10-09T11:57:51.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.683+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc16e100 con 0x7fe9dc156620 2023-10-09T11:57:51.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.683+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc16a910 con 0x7fe9dc156620 2023-10-09T11:57:51.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.684+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc0718b0 con 0x7fe9dc156620 2023-10-09T11:57:51.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.685+0000 7fe9d17fa700 1 -- 172.21.15.86:0/2113020391 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9cc013680 con 0x7fe9dc156620 2023-10-09T11:57:51.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.686+0000 7fe9d17fa700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe9c0066f30 0x7fe9c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:51.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.686+0000 7fe9d17fa700 1 -- 172.21.15.86:0/2113020391 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fe9cc084a20 con 0x7fe9dc156620 2023-10-09T11:57:51.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.686+0000 7fe9e139b700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe9c0066f30 0x7fe9c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:51.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.687+0000 7fe9e139b700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe9c0066f30 0x7fe9c00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80037c0 tx=0x7fe9d8009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:51.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.690+0000 7fe9d17fa700 1 -- 172.21.15.86:0/2113020391 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9cc051a70 con 0x7fe9dc156620 2023-10-09T11:57:51.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.958+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe9dc0c7bc0 con 0x7fe9dc156620 2023-10-09T11:57:51.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.963+0000 7fe9d17fa700 1 -- 172.21.15.86:0/2113020391 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe9cc055090 con 0x7fe9dc156620 2023-10-09T11:57:51.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe9c0066f30 msgr2=0x7fe9c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe9c0066f30 0x7fe9c00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80037c0 tx=0x7fe9d8009040 comp rx=0 tx=0).stop 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc156620 msgr2=0x7fe9dc06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc156620 0x7fe9dc06da30 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00ec50 tx=0x7fe9cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 shutdown_connections 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9dc1569f0 0x7fe9dc06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9dc068390 0x7fe9dc0c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe9c0066f30 0x7fe9c00693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 --2- 172.21.15.86:0/2113020391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc156620 0x7fe9dc06da30 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 >> 172.21.15.86:0/2113020391 conn(0x7fe9dc0cc540 msgr2=0x7fe9dc0ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 shutdown_connections 2023-10-09T11:57:51.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:51.965+0000 7fe9e35ff700 1 -- 172.21.15.86:0/2113020391 wait complete. 2023-10-09T11:57:51.968 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T11:57:51.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:57:52.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.163+0000 7fe1a73ff700 1 Processor -- start 2023-10-09T11:57:52.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.163+0000 7fe1a73ff700 1 -- start start 2023-10-09T11:57:52.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.164+0000 7fe1a73ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1a0155c10 0x7fe1a0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:52.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.164+0000 7fe1a73ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a00ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:52.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.164+0000 7fe1a73ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a00ad930 con 0x7fe1a01568a0 2023-10-09T11:57:52.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.164+0000 7fe1a73ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a00acd20 con 0x7fe1a0155c10 2023-10-09T11:57:52.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.164+0000 7fe1a73ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00ad000 con 0x7fe1a00ac230 2023-10-09T11:57:52.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a599c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe1a01568a0 0x7fe1a0156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33240/0 (socket says 172.21.15.86:33240) 2023-10-09T11:57:52.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a599c700 1 -- 172.21.15.86:0/603677692 learned_addr learned my addr 172.21.15.86:0/603677692 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:52.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a499a700 1 --2- 172.21.15.86:0/603677692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a00ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:52.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a519b700 1 --2- 172.21.15.86:0/603677692 >> v2:172.21.15.135:3300/0 conn(0x7fe1a0155c10 0x7fe1a0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:52.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe197fff700 1 -- 172.21.15.86:0/603677692 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392023172 0 0) 0x7fe1a00ad930 con 0x7fe1a01568a0 2023-10-09T11:57:52.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe197fff700 1 -- 172.21.15.86:0/603677692 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c003570 con 0x7fe1a01568a0 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a499a700 1 -- 172.21.15.86:0/603677692 >> v2:172.21.15.135:3300/0 conn(0x7fe1a0155c10 msgr2=0x7fe1a0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a499a700 1 --2- 172.21.15.86:0/603677692 >> v2:172.21.15.135:3300/0 conn(0x7fe1a0155c10 0x7fe1a0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a499a700 1 -- 172.21.15.86:0/603677692 >> v1:172.21.15.86:6789/0 conn(0x7fe1a01568a0 legacy=0x7fe1a0156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.165+0000 7fe1a499a700 1 -- 172.21.15.86:0/603677692 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00ad2e0 con 0x7fe1a00ac230 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.166+0000 7fe1a499a700 1 --2- 172.21.15.86:0/603677692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a00ac6a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098e0 tx=0x7fe1900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d0024e5f514bd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.166+0000 7fe197fff700 1 -- 172.21.15.86:0/603677692 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000f6b0 con 0x7fe1a00ac230 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.166+0000 7fe197fff700 1 -- 172.21.15.86:0/603677692 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000f810 con 0x7fe1a00ac230 2023-10-09T11:57:52.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.166+0000 7fe197fff700 1 -- 172.21.15.86:0/603677692 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000fbb0 con 0x7fe1a00ac230 2023-10-09T11:57:52.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 -- 172.21.15.86:0/603677692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 msgr2=0x7fe1a00ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:52.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/603677692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a00ac6a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098e0 tx=0x7fe1900091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 -- 172.21.15.86:0/603677692 shutdown_connections 2023-10-09T11:57:52.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/603677692 >> v2:172.21.15.135:3300/0 conn(0x7fe1a0155c10 0x7fe1a0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/603677692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a00ac6a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 -- 172.21.15.86:0/603677692 >> 172.21.15.86:0/603677692 conn(0x7fe1a006a320 msgr2=0x7fe1a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 -- 172.21.15.86:0/603677692 shutdown_connections 2023-10-09T11:57:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.167+0000 7fe1a73ff700 1 -- 172.21.15.86:0/603677692 wait complete. 2023-10-09T11:57:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.168+0000 7fe1a73ff700 1 Processor -- start 2023-10-09T11:57:52.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.168+0000 7fe1a73ff700 1 -- start start 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a73ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a0151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a73ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a0155c10 0x7fe1a016a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a73ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a01568a0 0x7fe1a015e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a73ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a015af50 con 0x7fe1a01568a0 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a73ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a015a340 con 0x7fe1a0155c10 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a73ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a015a620 con 0x7fe1a00ac230 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a01568a0 0x7fe1a015e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:52.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a01568a0 0x7fe1a015e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43666/0 (socket says 172.21.15.86:43666) 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.169+0000 7fe1a599c700 1 -- 172.21.15.86:0/3075158144 learned_addr learned my addr 172.21.15.86:0/3075158144 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a499a700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a0155c10 0x7fe1a016a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a519b700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a0151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a599c700 1 -- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 msgr2=0x7fe1a0151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a599c700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a0151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a599c700 1 -- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a0155c10 msgr2=0x7fe1a016a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a599c700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a0155c10 0x7fe1a016a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a599c700 1 -- 172.21.15.86:0/3075158144 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190009420 con 0x7fe1a01568a0 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a499a700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a0155c10 0x7fe1a016a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a519b700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a0151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a599c700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a01568a0 0x7fe1a015e4f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe198001460 tx=0x7fe198001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:52.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1957fa700 1 -- 172.21.15.86:0/3075158144 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800a950 con 0x7fe1a01568a0 2023-10-09T11:57:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1957fa700 1 -- 172.21.15.86:0/3075158144 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19800aab0 con 0x7fe1a01568a0 2023-10-09T11:57:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a015a900 con 0x7fe1a01568a0 2023-10-09T11:57:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.170+0000 7fe1957fa700 1 -- 172.21.15.86:0/3075158144 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800ae30 con 0x7fe1a01568a0 2023-10-09T11:57:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.171+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a0151f70 con 0x7fe1a01568a0 2023-10-09T11:57:52.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.171+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a006bb10 con 0x7fe1a01568a0 2023-10-09T11:57:52.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.172+0000 7fe1957fa700 1 -- 172.21.15.86:0/3075158144 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe198007300 con 0x7fe1a01568a0 2023-10-09T11:57:52.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.173+0000 7fe1957fa700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe184066f30 0x7fe1840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:52.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.173+0000 7fe1957fa700 1 -- 172.21.15.86:0/3075158144 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fe198084c90 con 0x7fe1a01568a0 2023-10-09T11:57:52.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.174+0000 7fe1a519b700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe184066f30 0x7fe1840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:52.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.174+0000 7fe1a519b700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe184066f30 0x7fe1840693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00ae00 tx=0x7fe19c008040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:52.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.177+0000 7fe1957fa700 1 -- 172.21.15.86:0/3075158144 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe198051c50 con 0x7fe1a01568a0 2023-10-09T11:57:52.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.413+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1a004c3c0 con 0x7fe1a01568a0 2023-10-09T11:57:52.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.414+0000 7fe1957fa700 1 -- 172.21.15.86:0/3075158144 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe198055270 con 0x7fe1a01568a0 2023-10-09T11:57:52.415 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:57:52.415 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4115138334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4115138334},{"type":"v1","addr":"172.21.15.135:6834","nonce":4115138334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6763,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/34078262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":34078262},{"type":"v1","addr":"172.21.15.135:6835","nonce":34078262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/161428317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":161428317},{"type":"v1","addr":"172.21.15.86:6833","nonce":161428317}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:41.335680+0000","modified":"2023-10-09T11:57:44.882360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3360740992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3360740992},{"type":"v1","addr":"172.21.15.86:6835","nonce":3360740992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:57:52.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe184066f30 msgr2=0x7fe1840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe184066f30 0x7fe1840693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00ae00 tx=0x7fe19c008040 comp rx=0 tx=0).stop 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a01568a0 msgr2=0x7fe1a015e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a01568a0 0x7fe1a015e4f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe198001460 tx=0x7fe198001a40 comp rx=0 tx=0).stop 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 shutdown_connections 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe184066f30 0x7fe1840693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a01568a0 0x7fe1a015e4f0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00ac230 0x7fe1a0151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 --2- 172.21.15.86:0/3075158144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a0155c10 0x7fe1a016a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 >> 172.21.15.86:0/3075158144 conn(0x7fe1a006a320 msgr2=0x7fe1a01548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:52.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 shutdown_connections 2023-10-09T11:57:52.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:52.416+0000 7fe1a73ff700 1 -- 172.21.15.86:0/3075158144 wait complete. 2023-10-09T11:57:52.419 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 46 2023-10-09T11:57:52.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:57:41.335680+0000', 'modified': '2023-10-09T11:57:44.882360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7167': {'gid': 7167, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/3360740992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 3360740992}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 3360740992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:57:52.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:57:52.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T11:57:53.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.019+0000 7feae5dff700 1 Processor -- start 2023-10-09T11:57:53.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.019+0000 7feae5dff700 1 -- start start 2023-10-09T11:57:53.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.020+0000 7feae5dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feae00ccf90 0x7feae00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.020+0000 7feae5dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae00cc300 con 0x7feae00cbf30 2023-10-09T11:57:53.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feae5dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae00ad370 con 0x7feae00b1420 2023-10-09T11:57:53.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feae5dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae0156bf0 con 0x7feae00ccf90 2023-10-09T11:57:53.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feadf7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7feae00cbf30 0x7feae00b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33256/0 (socket says 172.21.15.86:33256) 2023-10-09T11:57:53.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feadf7fe700 1 -- 172.21.15.86:0/1714895815 learned_addr learned my addr 172.21.15.86:0/1714895815 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feadffff700 1 --2- 172.21.15.86:0/1714895815 >> v2:172.21.15.135:3300/0 conn(0x7feae00ccf90 0x7feae00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896862812 0 0) 0x7feae00cc300 con 0x7feae00cbf30 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac8003570 con 0x7feae00cbf30 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949014291 0 0) 0x7feac8003570 con 0x7feae00cbf30 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 >> v2:172.21.15.135:3300/0 conn(0x7feae00ccf90 msgr2=0x7feae00ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 --2- 172.21.15.86:0/1714895815 >> v2:172.21.15.135:3300/0 conn(0x7feae00ccf90 0x7feae00ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 >> v1:172.21.15.135:6789/0 conn(0x7feae00b1420 legacy=0x7feae00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00ad650 con 0x7feae00cbf30 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.021+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fead0001470 con 0x7feae00cbf30 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 >> v1:172.21.15.86:6789/0 conn(0x7feae00cbf30 legacy=0x7feae00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feade7fc700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8003ab0 0x7feac8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feade7fc700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac8004810 0x7feac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feade7fc700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80051c0 0x7feac8010070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0156bf0 con 0x7feac8004810 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac80105b0 con 0x7feac8003ab0 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac8010720 con 0x7feac80051c0 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadeffd700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac8004810 0x7feac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadf7fe700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8003ab0 0x7feac8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadffff700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80051c0 0x7feac8010070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadeffd700 1 -- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80051c0 msgr2=0x7feac8010070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadeffd700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80051c0 0x7feac8010070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadeffd700 1 -- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8003ab0 msgr2=0x7feac8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadeffd700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8003ab0 0x7feac8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadeffd700 1 -- 172.21.15.86:0/1714895815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8003570 con 0x7feac8004810 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadf7fe700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8003ab0 0x7feac8003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadffff700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feac80051c0 0x7feac8010070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.022+0000 7feadffff700 1 -- 172.21.15.86:0/1714895815 reap_dead start 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feadeffd700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac8004810 0x7feac8004c80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7feae00aecd0 tx=0x7fead4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1827f17b6c2067e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4012420 con 0x7feac8004810 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead40125a0 con 0x7feac8004810 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feade7fc700 1 -- 172.21.15.86:0/1714895815 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4012960 con 0x7feac8004810 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feae5dff700 1 -- 172.21.15.86:0/1714895815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac8004810 msgr2=0x7feac8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feae5dff700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac8004810 0x7feac8004c80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7feae00aecd0 tx=0x7fead4007d30 comp rx=0 tx=0).stop 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feae5dff700 1 -- 172.21.15.86:0/1714895815 shutdown_connections 2023-10-09T11:57:53.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feae5dff700 1 --2- 172.21.15.86:0/1714895815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feac8004810 0x7feac8004c80 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feae5dff700 1 -- 172.21.15.86:0/1714895815 >> 172.21.15.86:0/1714895815 conn(0x7feae006a320 msgr2=0x7feae00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feae5dff700 1 -- 172.21.15.86:0/1714895815 shutdown_connections 2023-10-09T11:57:53.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.023+0000 7feae5dff700 1 -- 172.21.15.86:0/1714895815 wait complete. 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.025+0000 7feae5dff700 1 Processor -- start 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.025+0000 7feae5dff700 1 -- start start 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feae5dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8004810 0x7feae0154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feae5dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae00a8b30 0x7feae00a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feae5dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae00a54c0 0x7feae00a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feae5dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0153360 con 0x7feae00a8b30 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feae5dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0153890 con 0x7feac8004810 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feae5dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae0153b70 con 0x7feae00a54c0 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae00a8b30 0x7feae00a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8004810 0x7feae0154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae00a8b30 0x7feae00a8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43690/0 (socket says 172.21.15.86:43690) 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 -- 172.21.15.86:0/3247705131 learned_addr learned my addr 172.21.15.86:0/3247705131 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadffff700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae00a54c0 0x7feae00a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 -- 172.21.15.86:0/3247705131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae00a54c0 msgr2=0x7feae00a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae00a54c0 0x7feae00a5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 -- 172.21.15.86:0/3247705131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8004810 msgr2=0x7feae0154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8004810 0x7feae0154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.026+0000 7feadeffd700 1 -- 172.21.15.86:0/3247705131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0153e50 con 0x7feae00a8b30 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.027+0000 7feadeffd700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae00a8b30 0x7feae00a8fa0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7feae00b1820 tx=0x7fead4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.027+0000 7feac77fe700 1 -- 172.21.15.86:0/3247705131 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead401e610 con 0x7feae00a8b30 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.027+0000 7feac77fe700 1 -- 172.21.15.86:0/3247705131 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead401e770 con 0x7feae00a8b30 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.027+0000 7feac77fe700 1 -- 172.21.15.86:0/3247705131 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead401eb30 con 0x7feae00a8b30 2023-10-09T11:57:53.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.027+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae0153360 con 0x7feae00a8b30 2023-10-09T11:57:53.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.027+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae0154410 con 0x7feae00a8b30 2023-10-09T11:57:53.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.030+0000 7feac77fe700 1 -- 172.21.15.86:0/3247705131 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fead4019030 con 0x7feae00a8b30 2023-10-09T11:57:53.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.031+0000 7feac77fe700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feacc066f30 0x7feacc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.031+0000 7feac77fe700 1 -- 172.21.15.86:0/3247705131 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fead4085730 con 0x7feae00a8b30 2023-10-09T11:57:53.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.031+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feacc066f30 0x7feacc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.032+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feacc066f30 0x7feacc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fead0000fd0 tx=0x7fead0007040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.032+0000 7feaf454eb80 1 Processor -- start 2023-10-09T11:57:53.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.033+0000 7feaf454eb80 1 -- start start 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.033+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f11119e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.033+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11142a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.033+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.033+0000 7feaf454eb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f11070a70 con 0x561f11142f60 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.033+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f1106e270 con 0x561f11119a50 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.033+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f1106a060 con 0x561f11163d00 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43696/0 (socket says 172.21.15.86:43696) 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 -- 172.21.15.86:0/2172363342 learned_addr learned my addr 172.21.15.86:0/2172363342 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadf7fe700 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f11119e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadeffd700 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 -- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 msgr2=0x561f11142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 -- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 msgr2=0x561f11119e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f11119e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 -- 172.21.15.86:0/2172363342 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f10f04270 con 0x561f11142f60 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.034+0000 7feadffff700 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11115cf0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fead8007400 tx=0x7fead800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd6db90467b381 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feac57fa700 1 -- 172.21.15.86:0/2172363342 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800e070 con 0x561f11142f60 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feac57fa700 1 -- 172.21.15.86:0/2172363342 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead800f040 con 0x561f11142f60 2023-10-09T11:57:53.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feac57fa700 1 -- 172.21.15.86:0/2172363342 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8016430 con 0x561f11142f60 2023-10-09T11:57:53.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 -- 172.21.15.86:0/2172363342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 msgr2=0x561f11115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11115cf0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fead8007400 tx=0x7fead800b040 comp rx=0 tx=0).stop 2023-10-09T11:57:53.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 -- 172.21.15.86:0/2172363342 shutdown_connections 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11115cf0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f11119e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 --2- 172.21.15.86:0/2172363342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 -- 172.21.15.86:0/2172363342 >> 172.21.15.86:0/2172363342 conn(0x561f1111b370 msgr2=0x561f1111b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 -- 172.21.15.86:0/2172363342 shutdown_connections 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.035+0000 7feaf454eb80 1 -- 172.21.15.86:0/2172363342 wait complete. 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.036+0000 7feaf454eb80 1 -- start start 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.036+0000 7feaf454eb80 1 Processor -- start 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.037+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11119a50 0x561f11172dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.037+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f111630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.037+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11163d00 0x561f11159e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.037+0000 7feaf454eb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f11015890 con 0x561f11163d00 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.037+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f11030ea0 con 0x561f11142f60 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.037+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f10eece30 con 0x561f11119a50 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.037+0000 7feaf454eb80 10 client.0 _ll_register_callbacks cb 0x561f110dd110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11163d00 0x561f11159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11163d00 0x561f11159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43702/0 (socket says 172.21.15.86:43702) 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 -- 172.21.15.86:0/3103926724 learned_addr learned my addr 172.21.15.86:0/3103926724 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadeffd700 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f111630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11119a50 0x561f11172dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 -- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11119a50 msgr2=0x561f11172dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11119a50 0x561f11172dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 -- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 msgr2=0x561f111630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f111630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 -- 172.21.15.86:0/3103926724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead8009e00 con 0x561f11163d00 2023-10-09T11:57:53.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feadffff700 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11163d00 0x561f11159e70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fead8017f30 tx=0x7fead801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650eed69d9cf4ce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.038+0000 7feabdffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:57:53.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feabdffb700 1 -- 172.21.15.86:0/3103926724 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8007e80 con 0x561f11163d00 2023-10-09T11:57:53.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feabdffb700 1 -- 172.21.15.86:0/3103926724 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fead801f410 con 0x561f11163d00 2023-10-09T11:57:53.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f1110eb70 con 0x561f11163d00 2023-10-09T11:57:53.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feabdffb700 1 -- 172.21.15.86:0/3103926724 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead801f7e0 con 0x561f11163d00 2023-10-09T11:57:53.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 10 client.7332 fetch_fsmap learned FSMap version 46 2023-10-09T11:57:53.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x561f10ea6fe0 con 0x561f11163d00 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feabdffb700 1 -- 172.21.15.86:0/3103926724 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f1110eb70 con 0x561f11163d00 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feabdffb700 1 -- 172.21.15.86:0/3103926724 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fead801f940 con 0x561f11163d00 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 10 client.7332 fetch_fsmap finished waiting for FSMap version 46 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 10 client.7332 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 20 client.7332 populate_metadata read hostname 'smithi086' 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111737f0 0x561f11173bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 4 client.7332 mds_command: new command op to 7167 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.039+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 --> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f110ebaa0 con 0x561f111737f0 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.040+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111737f0 0x561f11173bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.040+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111737f0 0x561f11173bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460a7a041b789f99 server_cookie=803e13b4d6095ed in_seq=0 out_seq=0 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.040+0000 7feabdffb700 10 client.7332 ms_handle_connect on v2:172.21.15.86:6834/3360740992 2023-10-09T11:57:53.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feabdffb700 1 -- 172.21.15.86:0/3103926724 <== mds.0 v2:172.21.15.86:6834/3360740992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561f110ebaa0 con 0x561f111737f0 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feabdffb700 10 client.7332 handle_command_reply: tid=0 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 client.7332 shutdown 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11163d00 msgr2=0x561f11159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11163d00 0x561f11159e70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fead8017f30 tx=0x7fead801b000 comp rx=0 tx=0).stop 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 shutdown_connections 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111737f0 0x561f11173bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11163d00 0x561f11159e70 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11119a50 0x561f11172dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feabdffb700 0 client.7332 ms_handle_reset on v2:172.21.15.86:6834/3360740992 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3103926724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f111630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 >> 172.21.15.86:0/3103926724 conn(0x561f1111b370 msgr2=0x561f1115f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 shutdown_connections 2023-10-09T11:57:53.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.041+0000 7feaf454eb80 1 -- 172.21.15.86:0/3103926724 wait complete. 2023-10-09T11:57:53.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.042+0000 7feaf454eb80 20 client.7332 trim_cache size 0 max 16384 2023-10-09T11:57:53.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.058+0000 7feaf454eb80 1 Processor -- start 2023-10-09T11:57:53.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.058+0000 7feaf454eb80 1 -- start start 2023-10-09T11:57:53.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.059+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f1111c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.059+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11149360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.059+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f111498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.059+0000 7feaf454eb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f110f95b0 con 0x561f11142f60 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.059+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f11119e90 con 0x561f11119a50 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.059+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f11114c20 con 0x561f11163d00 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43708/0 (socket says 172.21.15.86:43708) 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 -- 172.21.15.86:0/3745674692 learned_addr learned my addr 172.21.15.86:0/3745674692 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f1111c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadffff700 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f111498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 -- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 msgr2=0x561f111498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f111498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 -- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 msgr2=0x561f1111c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f1111c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 -- 172.21.15.86:0/3745674692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f11038780 con 0x561f11142f60 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f1111c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feadeffd700 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11149360 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fead4083b00 tx=0x7fead4083a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d465b65771cc21d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feac5ffb700 1 -- 172.21.15.86:0/3745674692 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4052820 con 0x561f11142f60 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feac5ffb700 1 -- 172.21.15.86:0/3745674692 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4056be0 con 0x561f11142f60 2023-10-09T11:57:53.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.060+0000 7feac5ffb700 1 -- 172.21.15.86:0/3745674692 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead40564e0 con 0x561f11142f60 2023-10-09T11:57:53.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 -- 172.21.15.86:0/3745674692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 msgr2=0x561f11149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11149360 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fead4083b00 tx=0x7fead4083a30 comp rx=0 tx=0).stop 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 -- 172.21.15.86:0/3745674692 shutdown_connections 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f111498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11119a50 0x561f1111c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3745674692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11142f60 0x561f11149360 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 -- 172.21.15.86:0/3745674692 >> 172.21.15.86:0/3745674692 conn(0x561f1111b370 msgr2=0x561f11160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 -- 172.21.15.86:0/3745674692 shutdown_connections 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.061+0000 7feaf454eb80 1 -- 172.21.15.86:0/3745674692 wait complete. 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.062+0000 7feaf454eb80 1 -- start start 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.062+0000 7feaf454eb80 1 Processor -- start 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11119a50 0x561f111812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f1117f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feaf454eb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11115420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feaf454eb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f1117fae0 con 0x561f11119a50 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f1117ff40 con 0x561f11142f60 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feaf454eb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f11162a90 con 0x561f11163d00 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feaf454eb80 10 client.0 _ll_register_callbacks cb 0x561f110dd110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11119a50 0x561f111812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11119a50 0x561f111812a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43724/0 (socket says 172.21.15.86:43724) 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 -- 172.21.15.86:0/3661275796 learned_addr learned my addr 172.21.15.86:0/3661275796 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadffff700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadeffd700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f1117f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 -- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 msgr2=0x561f11115420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11115420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 -- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 msgr2=0x561f1117f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f1117f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 -- 172.21.15.86:0/3661275796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae0154410 con 0x561f11119a50 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadeffd700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f1117f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feadf7fe700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11119a50 0x561f111812a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x561f111639e0 tx=0x7fead002a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6096c0418ff6c2c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.063+0000 7feabdffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feabdffb700 1 -- 172.21.15.86:0/3661275796 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0028e20 con 0x561f11119a50 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feabdffb700 1 -- 172.21.15.86:0/3661275796 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fead001d040 con 0x561f11119a50 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feae0158f40 con 0x561f11119a50 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feabdffb700 1 -- 172.21.15.86:0/3661275796 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead0004a40 con 0x561f11119a50 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 10 client.7338 fetch_fsmap learned FSMap version 46 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x561f1101f470 con 0x561f11119a50 2023-10-09T11:57:53.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feabdffb700 1 -- 172.21.15.86:0/3661275796 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae0158f40 con 0x561f11119a50 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feabdffb700 1 -- 172.21.15.86:0/3661275796 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 46) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fead0004ba0 con 0x561f11119a50 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 10 client.7338 fetch_fsmap finished waiting for FSMap version 46 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 10 client.7338 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 20 client.7338 populate_metadata read hostname 'smithi086' 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111c85f0 0x561f111c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 4 client.7338 mds_command: new command op to 7167 tid=0[{"prefix": "status"}] 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.064+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 --> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fead800f040 con 0x561f111c85f0 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feadeffd700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111c85f0 0x561f111c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feabdffb700 10 client.7338 ms_handle_connect on v2:172.21.15.86:6834/3360740992 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feadeffd700 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111c85f0 0x561f111c89c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38421cea181ca3b server_cookie=fe34ceb3810d7146 in_seq=0 out_seq=0 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feabdffb700 1 -- 172.21.15.86:0/3661275796 <== mds.0 v2:172.21.15.86:6834/3360740992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fead800f040 con 0x561f111c85f0 2023-10-09T11:57:53.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feabdffb700 10 client.7338 handle_command_reply: tid=0 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 client.7338 shutdown 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11119a50 msgr2=0x561f111812a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11119a50 0x561f111812a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x561f111639e0 tx=0x7fead002a040 comp rx=0 tx=0).stop 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 shutdown_connections 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:6834/3360740992,v1:172.21.15.86:6835/3360740992] conn(0x561f111c85f0 0x561f111c89c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f11119a50 0x561f111812a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561f11163d00 0x561f11115420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 --2- 172.21.15.86:0/3661275796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f11142f60 0x561f1117f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feabdffb700 0 client.7338 ms_handle_reset on v2:172.21.15.86:6834/3360740992 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 >> 172.21.15.86:0/3661275796 conn(0x561f1111b370 msgr2=0x561f11160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.065+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 shutdown_connections 2023-10-09T11:57:53.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feaf454eb80 1 -- 172.21.15.86:0/3661275796 wait complete. 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feaf454eb80 20 client.7338 trim_cache size 0 max 16384 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 7167, 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T11:57:53.073 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.190165132000001, 2023-10-09T11:57:53.074 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 46, 2023-10-09T11:57:53.074 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 108, 2023-10-09T11:57:53.074 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 108, 2023-10-09T11:57:53.074 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 16.976927642 2023-10-09T11:57:53.074 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feacc066f30 msgr2=0x7feacc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feacc066f30 0x7feacc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fead0000fd0 tx=0x7fead0007040 comp rx=0 tx=0).stop 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae00a8b30 msgr2=0x7feae00a8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae00a8b30 0x7feae00a8fa0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7feae00b1820 tx=0x7fead4015000 comp rx=0 tx=0).stop 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 shutdown_connections 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae00a54c0 0x7feae00a5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac8004810 0x7feae0154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feacc066f30 0x7feacc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 --2- 172.21.15.86:0/3247705131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feae00a8b30 0x7feae00a8fa0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 >> 172.21.15.86:0/3247705131 conn(0x7feae006a320 msgr2=0x7feae00ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 shutdown_connections 2023-10-09T11:57:53.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.066+0000 7feae5dff700 1 -- 172.21.15.86:0/3247705131 wait complete. 2023-10-09T11:57:53.085 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:57:53.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.265+0000 7fe6a359e700 1 Processor -- start 2023-10-09T11:57:53.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.265+0000 7fe6a359e700 1 -- start start 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a4157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6a40c7410 0x7fe6a4069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a406e2a0 con 0x7fe6a4150180 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a406b2e0 con 0x7fe6a40c7410 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c78e0 con 0x7fe6a4150550 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a2d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6a40c7410 0x7fe6a4069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe6a4150180 0x7fe6a40c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33270/0 (socket says 172.21.15.86:33270) 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.266+0000 7fe6a259c700 1 -- 172.21.15.86:0/3724926219 learned_addr learned my addr 172.21.15.86:0/3724926219 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe69bfff700 1 --2- 172.21.15.86:0/3724926219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a2d9d700 1 -- 172.21.15.86:0/3724926219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 msgr2=0x7fe6a4157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:53.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a2d9d700 1 --2- 172.21.15.86:0/3724926219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a4157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a2d9d700 1 -- 172.21.15.86:0/3724926219 >> v1:172.21.15.86:6789/0 conn(0x7fe6a4150180 legacy=0x7fe6a40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a2d9d700 1 -- 172.21.15.86:0/3724926219 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40c7bc0 con 0x7fe6a40c7410 2023-10-09T11:57:53.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a1d9b700 1 -- 172.21.15.86:0/3724926219 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755075965 0 0) 0x7fe6a406e2a0 con 0x7fe6a4150180 2023-10-09T11:57:53.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a2d9d700 1 --2- 172.21.15.86:0/3724926219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a40c7410 0x7fe6a4069f50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009e90 tx=0x7fe69c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c89229d4c5bad7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a1d9b700 1 -- 172.21.15.86:0/3724926219 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00bbf0 con 0x7fe6a40c7410 2023-10-09T11:57:53.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a1d9b700 1 -- 172.21.15.86:0/3724926219 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c00bd50 con 0x7fe6a40c7410 2023-10-09T11:57:53.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.267+0000 7fe6a1d9b700 1 -- 172.21.15.86:0/3724926219 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c011650 con 0x7fe6a40c7410 2023-10-09T11:57:53.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 -- 172.21.15.86:0/3724926219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a40c7410 msgr2=0x7fe6a4069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 --2- 172.21.15.86:0/3724926219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a40c7410 0x7fe6a4069f50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009e90 tx=0x7fe69c009780 comp rx=0 tx=0).stop 2023-10-09T11:57:53.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 -- 172.21.15.86:0/3724926219 shutdown_connections 2023-10-09T11:57:53.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 --2- 172.21.15.86:0/3724926219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a40c7410 0x7fe6a4069f50 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 --2- 172.21.15.86:0/3724926219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a4157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 -- 172.21.15.86:0/3724926219 >> 172.21.15.86:0/3724926219 conn(0x7fe6a40cc1f0 msgr2=0x7fe6a40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 -- 172.21.15.86:0/3724926219 shutdown_connections 2023-10-09T11:57:53.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.268+0000 7fe6a359e700 1 -- 172.21.15.86:0/3724926219 wait complete. 2023-10-09T11:57:53.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.270+0000 7fe6a359e700 1 Processor -- start 2023-10-09T11:57:53.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.270+0000 7fe6a359e700 1 -- start start 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a40c7410 0x7fe6a4169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a4150180 0x7fe6a40ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a416a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4169c50 con 0x7fe6a4150180 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4169940 con 0x7fe6a40c7410 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40af510 con 0x7fe6a4150550 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a4150180 0x7fe6a40ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a4150180 0x7fe6a40ad0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43734/0 (socket says 172.21.15.86:43734) 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 -- 172.21.15.86:0/1226180200 learned_addr learned my addr 172.21.15.86:0/1226180200 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a259c700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a40c7410 0x7fe6a4169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a2d9d700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a416a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 -- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 msgr2=0x7fe6a416a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a416a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 -- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a40c7410 msgr2=0x7fe6a4169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a40c7410 0x7fe6a4169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe69bfff700 1 -- 172.21.15.86:0/1226180200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c009a20 con 0x7fe6a4150180 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a259c700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a40c7410 0x7fe6a4169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.271+0000 7fe6a2d9d700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a416a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.272+0000 7fe69bfff700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a4150180 0x7fe6a40ad0a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00d890 tx=0x7fe68c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.272+0000 7fe69a7fc700 1 -- 172.21.15.86:0/1226180200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c009610 con 0x7fe6a4150180 2023-10-09T11:57:53.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.272+0000 7fe69a7fc700 1 -- 172.21.15.86:0/1226180200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c009770 con 0x7fe6a4150180 2023-10-09T11:57:53.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.272+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a40af7f0 con 0x7fe6a4150180 2023-10-09T11:57:53.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.272+0000 7fe69a7fc700 1 -- 172.21.15.86:0/1226180200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c009b30 con 0x7fe6a4150180 2023-10-09T11:57:53.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.272+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a40ad5e0 con 0x7fe6a4150180 2023-10-09T11:57:53.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.273+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a4169e00 con 0x7fe6a4150180 2023-10-09T11:57:53.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.274+0000 7fe69a7fc700 1 -- 172.21.15.86:0/1226180200 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe68c01e460 con 0x7fe6a4150180 2023-10-09T11:57:53.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.275+0000 7fe69a7fc700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe684066f30 0x7fe6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:53.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.275+0000 7fe69a7fc700 1 -- 172.21.15.86:0/1226180200 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fe68c084cb0 con 0x7fe6a4150180 2023-10-09T11:57:53.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.275+0000 7fe6a259c700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe684066f30 0x7fe6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:53.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.275+0000 7fe6a259c700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe684066f30 0x7fe6840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe694007fd0 tx=0x7fe694009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:53.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.279+0000 7fe69a7fc700 1 -- 172.21.15.86:0/1226180200 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6a4169e00 con 0x7fe6a4150180 2023-10-09T11:57:53.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.513+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6a40b1e30 con 0x7fe6a4150180 2023-10-09T11:57:53.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.513+0000 7fe69a7fc700 1 -- 172.21.15.86:0/1226180200 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe68c051da0 con 0x7fe6a4150180 2023-10-09T11:57:53.515 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:57:53.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe684066f30 msgr2=0x7fe6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe684066f30 0x7fe6840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe694007fd0 tx=0x7fe694009040 comp rx=0 tx=0).stop 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a4150180 msgr2=0x7fe6a40ad0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a4150180 0x7fe6a40ad0a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00d890 tx=0x7fe68c008040 comp rx=0 tx=0).stop 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 shutdown_connections 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a4150550 0x7fe6a416a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a40c7410 0x7fe6a4169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe684066f30 0x7fe6840693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 --2- 172.21.15.86:0/1226180200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a4150180 0x7fe6a40ad0a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 >> 172.21.15.86:0/1226180200 conn(0x7fe6a40cc1f0 msgr2=0x7fe6a40696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 shutdown_connections 2023-10-09T11:57:53.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:53.516+0000 7fe6a359e700 1 -- 172.21.15.86:0/1226180200 wait complete. 2023-10-09T11:57:53.534 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:57:53.535 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:57:53.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:53.535 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:57:53.572 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:57:53.572 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:57:53.572 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:57:53.572 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:53.573 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41270sec preferred_lft 41270sec 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:53.574 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:57:53.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:53.575 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:57:53.671 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:57:53.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:53.674 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:57:53.711 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:57:53.712 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:57:53.712 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:57:53.712 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:57:53.712 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:57:53.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:53.713 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:57:53.713 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:57:53.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:57:53.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:57:53.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:57:53.714 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:57:53.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:53.907 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:57:53.943 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:57:53.943 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:57:53.943 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:57:53.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:53.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T11:57:54.044 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:57:54.044 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:54.080 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:57:54.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:57:54.080 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:54.155 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:57:54.155 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:57:54.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:57:54.285 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:57:54.285 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:57:54.317 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:57:54.317 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:57:54.317 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:57:54.317 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:57:54.317 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:57:54.322 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:57:54.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:57:54.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:57:54.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:57:54.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.564+0000 7f37e33ff700 1 Processor -- start 2023-10-09T11:57:54.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.564+0000 7f37e33ff700 1 -- start start 2023-10-09T11:57:54.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.565+0000 7f37e33ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37dc1578b0 0x7f37dc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.565+0000 7f37e33ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0ad930 con 0x7f37dc155c10 2023-10-09T11:57:54.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.565+0000 7f37e33ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0acd20 con 0x7f37dc0af2f0 2023-10-09T11:57:54.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.565+0000 7f37e33ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc0ad000 con 0x7f37dc1578b0 2023-10-09T11:57:54.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.565+0000 7f37e119b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f37dc155c10 0x7f37dc0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33282/0 (socket says 172.21.15.86:33282) 2023-10-09T11:57:54.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.565+0000 7f37e119b700 1 -- 172.21.15.86:0/3104962339 learned_addr learned my addr 172.21.15.86:0/3104962339 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74480557 0 0) 0x7f37dc0ad930 con 0x7f37dc155c10 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c8003570 con 0x7f37dc155c10 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37e099a700 1 --2- 172.21.15.86:0/3104962339 >> v2:172.21.15.135:3300/0 conn(0x7f37dc1578b0 0x7f37dc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391265398 0 0) 0x7f37c8003570 con 0x7f37dc155c10 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 >> v2:172.21.15.135:3300/0 conn(0x7f37dc1578b0 msgr2=0x7f37dc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 --2- 172.21.15.86:0/3104962339 >> v2:172.21.15.135:3300/0 conn(0x7f37dc1578b0 0x7f37dc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 >> v1:172.21.15.135:6789/0 conn(0x7f37dc0af2f0 legacy=0x7f37dc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0ad2e0 con 0x7f37dc155c10 2023-10-09T11:57:54.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f37d8001470 con 0x7f37dc155c10 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 >> v1:172.21.15.86:6789/0 conn(0x7f37dc155c10 legacy=0x7f37dc0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c8003a60 0x7f37c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c8004810 0x7f37c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37c80051c0 0x7f37c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0ad000 con 0x7f37c80051c0 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c800c050 con 0x7f37c8003a60 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.566+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c800c210 con 0x7f37c8004810 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37c80051c0 0x7f37c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e119b700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c8003a60 0x7f37c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e099a700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c8004810 0x7f37c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 -- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c8004810 msgr2=0x7f37c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c8004810 0x7f37c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 -- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c8003a60 msgr2=0x7f37c8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c8003a60 0x7f37c8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 -- 172.21.15.86:0/3104962339 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8003570 con 0x7f37c80051c0 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e099a700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c8004810 0x7f37c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 -- 172.21.15.86:0/3104962339 reap_dead start 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37e199c700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37c80051c0 0x7f37c800ba60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f37d40020a0 tx=0x7f37d40016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c234cb8329c661 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.567+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40019e0 con 0x7f37c80051c0 2023-10-09T11:57:54.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d400c8b0 con 0x7f37c80051c0 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37d3fff700 1 -- 172.21.15.86:0/3104962339 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400cc50 con 0x7f37c80051c0 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37e33ff700 1 -- 172.21.15.86:0/3104962339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37c80051c0 msgr2=0x7f37c800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37e33ff700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37c80051c0 0x7f37c800ba60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f37d40020a0 tx=0x7f37d40016d0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37e33ff700 1 -- 172.21.15.86:0/3104962339 shutdown_connections 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37e33ff700 1 --2- 172.21.15.86:0/3104962339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37c80051c0 0x7f37c800ba60 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37e33ff700 1 -- 172.21.15.86:0/3104962339 >> 172.21.15.86:0/3104962339 conn(0x7f37dc06a320 msgr2=0x7f37dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37e33ff700 1 -- 172.21.15.86:0/3104962339 shutdown_connections 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.568+0000 7f37e33ff700 1 -- 172.21.15.86:0/3104962339 wait complete. 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.570+0000 7f37e33ff700 1 Processor -- start 2023-10-09T11:57:54.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.570+0000 7f37e33ff700 1 -- start start 2023-10-09T11:57:54.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.570+0000 7f37e33ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80051c0 0x7f37dc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e33ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc151ef0 0x7f37dc152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e33ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37dc0c9970 0x7f37dc0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e33ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0cb240 con 0x7f37dc0c9970 2023-10-09T11:57:54.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e33ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0ca6c0 con 0x7f37dc151ef0 2023-10-09T11:57:54.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e33ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0ca9a0 con 0x7f37c80051c0 2023-10-09T11:57:54.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37dc0c9970 0x7f37dc0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37dc0c9970 0x7f37dc0c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43752/0 (socket says 172.21.15.86:43752) 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 -- 172.21.15.86:0/492759775 learned_addr learned my addr 172.21.15.86:0/492759775 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e119b700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80051c0 0x7f37dc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e099a700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc151ef0 0x7f37dc152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 -- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80051c0 msgr2=0x7f37dc06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80051c0 0x7f37dc06e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 -- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc151ef0 msgr2=0x7f37dc152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc151ef0 0x7f37dc152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 -- 172.21.15.86:0/492759775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0cac80 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.571+0000 7f37e199c700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37dc0c9970 0x7f37dc0c9df0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06a980 tx=0x7f37d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.572+0000 7f37d17fa700 1 -- 172.21.15.86:0/492759775 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40019e0 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.572+0000 7f37d17fa700 1 -- 172.21.15.86:0/492759775 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d40078e0 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.572+0000 7f37d17fa700 1 -- 172.21.15.86:0/492759775 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4007e70 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.572+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc0caf60 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.572+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0ca330 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.573+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc04c3c0 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.574+0000 7f37d17fa700 1 -- 172.21.15.86:0/492759775 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37d401d900 con 0x7f37dc0c9970 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.575+0000 7f37d17fa700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f37c0066f30 0x7f37c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:54.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.575+0000 7f37d17fa700 1 -- 172.21.15.86:0/492759775 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f37d40863f0 con 0x7f37dc0c9970 2023-10-09T11:57:54.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.575+0000 7f37e119b700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f37c0066f30 0x7f37c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:54.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.575+0000 7f37e119b700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f37c0066f30 0x7f37c00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f37d8001d00 tx=0x7f37d8009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:54.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.579+0000 7f37d17fa700 1 -- 172.21.15.86:0/492759775 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37d4053440 con 0x7f37dc0c9970 2023-10-09T11:57:54.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.797+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f37dc0ad5c0 con 0x7f37c0066f30 2023-10-09T11:57:54.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.798+0000 7f37d17fa700 1 -- 172.21.15.86:0/492759775 <== mgr.6990 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f37dc0ad5c0 con 0x7f37c0066f30 2023-10-09T11:57:54.800 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:57:54.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:57:54.800 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T11:57:54.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:57:54.800 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:57:54.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f37c0066f30 msgr2=0x7f37c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:54.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f37c0066f30 0x7f37c00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f37d8001d00 tx=0x7f37d8009040 comp rx=0 tx=0).stop 2023-10-09T11:57:54.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37dc0c9970 msgr2=0x7f37dc0c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:54.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37dc0c9970 0x7f37dc0c9df0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06a980 tx=0x7f37d4016000 comp rx=0 tx=0).stop 2023-10-09T11:57:54.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 shutdown_connections 2023-10-09T11:57:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f37c0066f30 0x7f37c00693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37dc0c9970 0x7f37dc0c9df0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37c80051c0 0x7f37dc06e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 --2- 172.21.15.86:0/492759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37dc151ef0 0x7f37dc152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 >> 172.21.15.86:0/492759775 conn(0x7f37dc06a320 msgr2=0x7f37dc0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 shutdown_connections 2023-10-09T11:57:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:54.801+0000 7f37e33ff700 1 -- 172.21.15.86:0/492759775 wait complete. 2023-10-09T11:57:54.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T11:57:55.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.002+0000 7fa9fa5ff700 1 Processor -- start 2023-10-09T11:57:55.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.002+0000 7fa9fa5ff700 1 -- start start 2023-10-09T11:57:55.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.003+0000 7fa9fa5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9f40c83f0 0x7fa9f40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.003+0000 7fa9fa5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f415b0d0 con 0x7fa9f41568e0 2023-10-09T11:57:55.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.003+0000 7fa9fa5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f40c7a60 con 0x7fa9f40ccee0 2023-10-09T11:57:55.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.003+0000 7fa9fa5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f415a4c0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f8b9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa9f41568e0 0x7fa9f40ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:50962/0 (socket says 172.21.15.86:50962) 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9f40c83f0 0x7fa9f40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f8b9c700 1 -- 172.21.15.86:0/1086034308 learned_addr learned my addr 172.21.15.86:0/1086034308 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f3fff700 1 -- 172.21.15.86:0/1086034308 >> v1:172.21.15.135:6789/0 conn(0x7fa9f40ccee0 legacy=0x7fa9f41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f2ffd700 1 -- 172.21.15.86:0/1086034308 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577250368 0 0) 0x7fa9f415b0d0 con 0x7fa9f41568e0 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f3fff700 1 -- 172.21.15.86:0/1086034308 >> v1:172.21.15.86:6789/0 conn(0x7fa9f41568e0 legacy=0x7fa9f40ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f3fff700 1 -- 172.21.15.86:0/1086034308 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f415a7a0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.004+0000 7fa9f3fff700 1 --2- 172.21.15.86:0/1086034308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f40c7520 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40098e0 tx=0x7fa9e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b4d75698783095 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:55.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9f2ffd700 1 -- 172.21.15.86:0/1086034308 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4009e80 con 0x7fa9f40c83f0 2023-10-09T11:57:55.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9f2ffd700 1 -- 172.21.15.86:0/1086034308 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e400b860 con 0x7fa9f40c83f0 2023-10-09T11:57:55.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9f2ffd700 1 -- 172.21.15.86:0/1086034308 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e400bbe0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/1086034308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 msgr2=0x7fa9f40c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/1086034308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f40c7520 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40098e0 tx=0x7fa9e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/1086034308 shutdown_connections 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/1086034308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f40c7520 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/1086034308 >> 172.21.15.86:0/1086034308 conn(0x7fa9f4068e10 msgr2=0x7fa9f40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/1086034308 shutdown_connections 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.005+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/1086034308 wait complete. 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.007+0000 7fa9fa5ff700 1 Processor -- start 2023-10-09T11:57:55.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.007+0000 7fa9fa5ff700 1 -- start start 2023-10-09T11:57:55.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9fa5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f416b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9fa5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40ccee0 0x7fa9f4153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9fa5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f41568e0 0x7fa9f40b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9fa5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40af2d0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9fa5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f40b0130 con 0x7fa9f40ccee0 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9fa5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f416b540 con 0x7fa9f41568e0 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f416b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f416b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56122/0 (socket says 172.21.15.86:56122) 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 -- 172.21.15.86:0/3029566973 learned_addr learned my addr 172.21.15.86:0/3029566973 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f8b9c700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f41568e0 0x7fa9f40b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f37fe700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40ccee0 0x7fa9f4153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 -- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f41568e0 msgr2=0x7fa9f40b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f41568e0 0x7fa9f40b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 -- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40ccee0 msgr2=0x7fa9f4153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40ccee0 0x7fa9f4153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f3fff700 1 -- 172.21.15.86:0/3029566973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e4009420 con 0x7fa9f40c83f0 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f37fe700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40ccee0 0x7fa9f4153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.008+0000 7fa9f8b9c700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f41568e0 0x7fa9f40b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.009+0000 7fa9f3fff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f416b000 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4006f50 tx=0x7fa9e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.009+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e400b9d0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.009+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e400bb50 con 0x7fa9f40c83f0 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.009+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f40af520 con 0x7fa9f40c83f0 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.009+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e40106c0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.009+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f40afae0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.010+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f404c3c0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.011+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 44) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9e4022070 con 0x7fa9f40c83f0 2023-10-09T11:57:55.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.012+0000 7fa9dbfff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa9e0066f30 0x7fa9e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.012+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fa9e4014070 con 0x7fa9f40c83f0 2023-10-09T11:57:55.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.012+0000 7fa9f37fe700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa9e0066f30 0x7fa9e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.012+0000 7fa9f37fe700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa9e0066f30 0x7fa9e00693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40af050 tx=0x7fa9e8009040 comp rx=0 tx=0).ready entity=mgr.6990 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:55.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.016+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9e4052b40 con 0x7fa9f40c83f0 2023-10-09T11:57:55.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.258+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa9f40cbd90 con 0x7fa9f40c83f0 2023-10-09T11:57:55.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.309+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fa9e4052f10 con 0x7fa9f40c83f0 2023-10-09T11:57:55.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.311+0000 7fa9dbfff700 1 -- 172.21.15.86:0/3029566973 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v45) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa9e40565d0 con 0x7fa9f40c83f0 2023-10-09T11:57:55.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa9e0066f30 msgr2=0x7fa9e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa9e0066f30 0x7fa9e00693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40af050 tx=0x7fa9e8009040 comp rx=0 tx=0).stop 2023-10-09T11:57:55.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 msgr2=0x7fa9f416b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f416b000 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4006f50 tx=0x7fa9e4019000 comp rx=0 tx=0).stop 2023-10-09T11:57:55.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 shutdown_connections 2023-10-09T11:57:55.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa9e0066f30 0x7fa9e00693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f40c83f0 0x7fa9f416b000 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f41568e0 0x7fa9f40b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 --2- 172.21.15.86:0/3029566973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f40ccee0 0x7fa9f4153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 >> 172.21.15.86:0/3029566973 conn(0x7fa9f4068e10 msgr2=0x7fa9f40c1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:55.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 shutdown_connections 2023-10-09T11:57:55.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.314+0000 7fa9fa5ff700 1 -- 172.21.15.86:0/3029566973 wait complete. 2023-10-09T11:57:55.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T11:57:55.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.521+0000 7fd9e7fff700 1 Processor -- start 2023-10-09T11:57:55.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.521+0000 7fd9e7fff700 1 -- start start 2023-10-09T11:57:55.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b16d0 0x7fd9e80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e7fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80b2080 con 0x7fd9e80b33b0 2023-10-09T11:57:55.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e7fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80cfb00 con 0x7fd9e80b4e70 2023-10-09T11:57:55.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80b5c40 con 0x7fd9e80b16d0 2023-10-09T11:57:55.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e77fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd9e80b33b0 0x7fd9e80b3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:50980/0 (socket says 172.21.15.86:50980) 2023-10-09T11:57:55.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e77fe700 1 -- 172.21.15.86:0/3936871493 learned_addr learned my addr 172.21.15.86:0/3936871493 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:57:55.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e67fc700 1 --2- 172.21.15.86:0/3936871493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b16d0 0x7fd9e80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e5ffb700 1 -- 172.21.15.86:0/3936871493 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212340032 0 0) 0x7fd9e80cfb00 con 0x7fd9e80b4e70 2023-10-09T11:57:55.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e5ffb700 1 -- 172.21.15.86:0/3936871493 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d0003570 con 0x7fd9e80b4e70 2023-10-09T11:57:55.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e5ffb700 1 -- 172.21.15.86:0/3936871493 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231707893 0 0) 0x7fd9e80b2080 con 0x7fd9e80b33b0 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e67fc700 1 -- 172.21.15.86:0/3936871493 >> v1:172.21.15.135:6789/0 conn(0x7fd9e80b4e70 legacy=0x7fd9e80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e67fc700 1 -- 172.21.15.86:0/3936871493 >> v1:172.21.15.86:6789/0 conn(0x7fd9e80b33b0 legacy=0x7fd9e80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e67fc700 1 -- 172.21.15.86:0/3936871493 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80b5f20 con 0x7fd9e80b16d0 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e67fc700 1 --2- 172.21.15.86:0/3936871493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b16d0 0x7fd9e80b1b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009910 tx=0x7fd9dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f12f18fad4bfa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e5ffb700 1 -- 172.21.15.86:0/3936871493 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00b680 con 0x7fd9e80b16d0 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e5ffb700 1 -- 172.21.15.86:0/3936871493 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00b7e0 con 0x7fd9e80b16d0 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.524+0000 7fd9e5ffb700 1 -- 172.21.15.86:0/3936871493 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00bba0 con 0x7fd9e80b16d0 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.525+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3936871493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b16d0 msgr2=0x7fd9e80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.525+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3936871493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b16d0 0x7fd9e80b1b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009910 tx=0x7fd9dc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.525+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3936871493 shutdown_connections 2023-10-09T11:57:55.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.525+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3936871493 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b16d0 0x7fd9e80b1b40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.525+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3936871493 >> 172.21.15.86:0/3936871493 conn(0x7fd9e80d10c0 msgr2=0x7fd9e80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:55.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.525+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3936871493 shutdown_connections 2023-10-09T11:57:55.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.525+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3936871493 wait complete. 2023-10-09T11:57:55.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.526+0000 7fd9e7fff700 1 Processor -- start 2023-10-09T11:57:55.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.527+0000 7fd9e7fff700 1 -- start start 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.527+0000 7fd9e7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e80b16d0 0x7fd9e80cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.527+0000 7fd9e7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b33b0 0x7fd9e80c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e80b4e70 0x7fd9e8069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e7fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c5390 con 0x7fd9e80b4e70 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c55e0 con 0x7fd9e80b16d0 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c58c0 con 0x7fd9e80b33b0 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e80b4e70 0x7fd9e8069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e80b4e70 0x7fd9e8069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56144/0 (socket says 172.21.15.86:56144) 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 -- 172.21.15.86:0/3381485025 learned_addr learned my addr 172.21.15.86:0/3381485025 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:55.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e6ffd700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e80b16d0 0x7fd9e80cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e67fc700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b33b0 0x7fd9e80c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 -- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b33b0 msgr2=0x7fd9e80c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b33b0 0x7fd9e80c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 -- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e80b16d0 msgr2=0x7fd9e80cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e80b16d0 0x7fd9e80cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e77fe700 1 -- 172.21.15.86:0/3381485025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc009420 con 0x7fd9e80b4e70 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.528+0000 7fd9e6ffd700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e80b16d0 0x7fd9e80cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:55.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.529+0000 7fd9e77fe700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e80b4e70 0x7fd9e8069360 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000cc90 tx=0x7fd9e0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.529+0000 7fd9ceffd700 1 -- 172.21.15.86:0/3381485025 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000a8b0 con 0x7fd9e80b4e70 2023-10-09T11:57:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.529+0000 7fd9ceffd700 1 -- 172.21.15.86:0/3381485025 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000aa10 con 0x7fd9e80b4e70 2023-10-09T11:57:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.529+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e80c5ba0 con 0x7fd9e80b4e70 2023-10-09T11:57:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.529+0000 7fd9ceffd700 1 -- 172.21.15.86:0/3381485025 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000add0 con 0x7fd9e80b4e70 2023-10-09T11:57:55.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.529+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e80c6160 con 0x7fd9e80b4e70 2023-10-09T11:57:55.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.530+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e80c6350 con 0x7fd9e80b4e70 2023-10-09T11:57:55.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.531+0000 7fd9ceffd700 1 -- 172.21.15.86:0/3381485025 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fd9e0007300 con 0x7fd9e80b4e70 2023-10-09T11:57:55.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.532+0000 7fd9ceffd700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 0x7fd9d4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.532+0000 7fd9ceffd700 1 -- 172.21.15.86:0/3381485025 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fd9e0084ad0 con 0x7fd9e80b4e70 2023-10-09T11:57:55.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.532+0000 7fd9e6ffd700 1 -- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 msgr2=0x7fd9d4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:55.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.532+0000 7fd9e6ffd700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 0x7fd9d4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:55.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.536+0000 7fd9ceffd700 1 -- 172.21.15.86:0/3381485025 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9e0051ba0 con 0x7fd9e80b4e70 2023-10-09T11:57:55.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.733+0000 7fd9e6ffd700 1 -- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 msgr2=0x7fd9d4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:55.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.733+0000 7fd9e6ffd700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 0x7fd9d4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:55.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.748+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd9e804bb80 con 0x7fd9e80b4e70 2023-10-09T11:57:55.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.752+0000 7fd9ceffd700 1 -- 172.21.15.86:0/3381485025 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd9e00551c0 con 0x7fd9e80b4e70 2023-10-09T11:57:55.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.754+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 msgr2=0x7fd9d4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:55.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.754+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 0x7fd9d4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.754+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e80b4e70 msgr2=0x7fd9e8069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.754+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e80b4e70 0x7fd9e8069360 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000cc90 tx=0x7fd9e0001a80 comp rx=0 tx=0).stop 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 shutdown_connections 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd9d4066f80 0x7fd9d4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e80b4e70 0x7fd9e8069360 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e80b16d0 0x7fd9e80cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 --2- 172.21.15.86:0/3381485025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e80b33b0 0x7fd9e80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 >> 172.21.15.86:0/3381485025 conn(0x7fd9e80d10c0 msgr2=0x7fd9e815c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:55.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 shutdown_connections 2023-10-09T11:57:55.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.755+0000 7fd9e7fff700 1 -- 172.21.15.86:0/3381485025 wait complete. 2023-10-09T11:57:55.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T11:57:55.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.960+0000 7fabcf39d700 1 Processor -- start 2023-10-09T11:57:55.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.960+0000 7fabcf39d700 1 -- start start 2023-10-09T11:57:55.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.961+0000 7fabcf39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.961+0000 7fabcf39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fabc80b16d0 0x7fabc80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.961+0000 7fabcf39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80b2080 con 0x7fabc815d240 2023-10-09T11:57:55.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.961+0000 7fabcf39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80cfb00 con 0x7fabc80b16d0 2023-10-09T11:57:55.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.961+0000 7fabcf39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b5c40 con 0x7fabc80b4e70 2023-10-09T11:57:55.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fabc80b16d0 0x7fabc80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fabc80b16d0 0x7fabc80b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56154/0 (socket says 172.21.15.86:56154) 2023-10-09T11:57:55.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 -- 172.21.15.86:0/1511301916 learned_addr learned my addr 172.21.15.86:0/1511301916 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:55.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabce39b700 1 --2- 172.21.15.86:0/1511301916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 -- 172.21.15.86:0/1511301916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b4e70 msgr2=0x7fabc80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:55.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 --2- 172.21.15.86:0/1511301916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 -- 172.21.15.86:0/1511301916 >> v1:172.21.15.135:6789/0 conn(0x7fabc815d240 legacy=0x7fabc815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 -- 172.21.15.86:0/1511301916 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80b5f20 con 0x7fabc80b16d0 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcd399700 1 -- 172.21.15.86:0/1511301916 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183606802 0 0) 0x7fabc80b2080 con 0x7fabc815d240 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.962+0000 7fabcdb9a700 1 --2- 172.21.15.86:0/1511301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc80b16d0 0x7fabc80b1b40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fabb80099b0 tx=0x7fabb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1529e3150d4fba6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcd399700 1 -- 172.21.15.86:0/1511301916 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8009ea0 con 0x7fabc80b16d0 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcd399700 1 -- 172.21.15.86:0/1511301916 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800b860 con 0x7fabc80b16d0 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcd399700 1 -- 172.21.15.86:0/1511301916 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800bc00 con 0x7fabc80b16d0 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 -- 172.21.15.86:0/1511301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc80b16d0 msgr2=0x7fabc80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 --2- 172.21.15.86:0/1511301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc80b16d0 0x7fabc80b1b40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fabb80099b0 tx=0x7fabb8009250 comp rx=0 tx=0).stop 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 -- 172.21.15.86:0/1511301916 shutdown_connections 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 --2- 172.21.15.86:0/1511301916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b4e70 0x7fabc80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 --2- 172.21.15.86:0/1511301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc80b16d0 0x7fabc80b1b40 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 -- 172.21.15.86:0/1511301916 >> 172.21.15.86:0/1511301916 conn(0x7fabc80d10c0 msgr2=0x7fabc80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:55.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 -- 172.21.15.86:0/1511301916 shutdown_connections 2023-10-09T11:57:55.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.963+0000 7fabcf39d700 1 -- 172.21.15.86:0/1511301916 wait complete. 2023-10-09T11:57:55.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.965+0000 7fabcf39d700 1 Processor -- start 2023-10-09T11:57:55.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.965+0000 7fabcf39d700 1 -- start start 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabcf39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b16d0 0x7fabc8145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabcf39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc80b4e70 0x7fabc815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabcf39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc815d240 0x7fabc815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabcf39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80c8480 con 0x7fabc815d240 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabcf39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80c7370 con 0x7fabc80b4e70 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabcf39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80c7b50 con 0x7fabc80b16d0 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabce39b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b16d0 0x7fabc8145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabceb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc815d240 0x7fabc815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabce39b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b16d0 0x7fabc8145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:56370/0 (socket says 172.21.15.86:56370) 2023-10-09T11:57:55.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabce39b700 1 -- 172.21.15.86:0/2910626014 learned_addr learned my addr 172.21.15.86:0/2910626014 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.966+0000 7fabcdb9a700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc80b4e70 0x7fabc815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabce39b700 1 -- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc80b4e70 msgr2=0x7fabc815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabce39b700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc80b4e70 0x7fabc815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabce39b700 1 -- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc815d240 msgr2=0x7fabc815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabce39b700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc815d240 0x7fabc815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabce39b700 1 -- 172.21.15.86:0/2910626014 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80094f0 con 0x7fabc80b16d0 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabce39b700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b16d0 0x7fabc8145790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabc400ec80 tx=0x7fabc40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabbe7fc700 1 -- 172.21.15.86:0/2910626014 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4009690 con 0x7fabc80b16d0 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabbe7fc700 1 -- 172.21.15.86:0/2910626014 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc400c850 con 0x7fabc80b16d0 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabbe7fc700 1 -- 172.21.15.86:0/2910626014 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400cc10 con 0x7fabc80b16d0 2023-10-09T11:57:55.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc80c7e30 con 0x7fabc80b16d0 2023-10-09T11:57:55.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.967+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc8145cd0 con 0x7fabc80b16d0 2023-10-09T11:57:55.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.968+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc80c8760 con 0x7fabc80b16d0 2023-10-09T11:57:55.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.969+0000 7fabbe7fc700 1 -- 172.21.15.86:0/2910626014 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fabc4013470 con 0x7fabc80b16d0 2023-10-09T11:57:55.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.970+0000 7fabbe7fc700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 0x7fabac069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:55.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.970+0000 7fabbe7fc700 1 -- 172.21.15.86:0/2910626014 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fabc4084910 con 0x7fabc80b16d0 2023-10-09T11:57:55.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.970+0000 7fabcdb9a700 1 -- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 msgr2=0x7fabac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:55.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.970+0000 7fabcdb9a700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 0x7fabac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:55.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:55.975+0000 7fabbe7fc700 1 -- 172.21.15.86:0/2910626014 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabc4051960 con 0x7fabc80b16d0 2023-10-09T11:57:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.171+0000 7fabcdb9a700 1 -- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 msgr2=0x7fabac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:56.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.171+0000 7fabcdb9a700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 0x7fabac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:56.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.172+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fabc804bb80 con 0x7fabc80b16d0 2023-10-09T11:57:56.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.177+0000 7fabbe7fc700 1 -- 172.21.15.86:0/2910626014 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7fabc4054f80 con 0x7fabc80b16d0 2023-10-09T11:57:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 msgr2=0x7fabac069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:57:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 0x7fabac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b16d0 msgr2=0x7fabc8145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b16d0 0x7fabc8145790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabc400ec80 tx=0x7fabc40091a0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 shutdown_connections 2023-10-09T11:57:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fabac066f80 0x7fabac069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabc815d240 0x7fabc815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fabc80b16d0 0x7fabc8145790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 --2- 172.21.15.86:0/2910626014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc80b4e70 0x7fabc815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 >> 172.21.15.86:0/2910626014 conn(0x7fabc80d10c0 msgr2=0x7fabc80ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 shutdown_connections 2023-10-09T11:57:56.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.180+0000 7fabcf39d700 1 -- 172.21.15.86:0/2910626014 wait complete. 2023-10-09T11:57:56.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-10-09T11:57:56.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.389+0000 7f53ca19d700 1 Processor -- start 2023-10-09T11:57:56.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.389+0000 7f53ca19d700 1 -- start start 2023-10-09T11:57:56.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53ca19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f53c41597d0 0x7f53c40afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:56.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53ca19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53c406f0b0 0x7f53c415d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:56.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53ca19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c406e510 con 0x7f53c40ac0e0 2023-10-09T11:57:56.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53ca19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c4069180 con 0x7f53c406f0b0 2023-10-09T11:57:56.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53ca19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c406dec0 con 0x7f53c41597d0 2023-10-09T11:57:56.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53c999c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53c406f0b0 0x7f53c415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:56.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53c999c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53c406f0b0 0x7f53c415d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56172/0 (socket says 172.21.15.86:56172) 2023-10-09T11:57:56.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53c999c700 1 -- 172.21.15.86:0/1873529575 learned_addr learned my addr 172.21.15.86:0/1873529575 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:56.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.391+0000 7f53c919b700 1 --2- 172.21.15.86:0/1873529575 >> v2:172.21.15.135:3300/0 conn(0x7f53c41597d0 0x7f53c40afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:56.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53c999c700 1 -- 172.21.15.86:0/1873529575 >> v2:172.21.15.135:3300/0 conn(0x7f53c41597d0 msgr2=0x7f53c40afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:57:56.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53c999c700 1 --2- 172.21.15.86:0/1873529575 >> v2:172.21.15.135:3300/0 conn(0x7f53c41597d0 0x7f53c40afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53c999c700 1 -- 172.21.15.86:0/1873529575 >> v1:172.21.15.135:6789/0 conn(0x7f53c40ac0e0 legacy=0x7f53c406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:56.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53c999c700 1 -- 172.21.15.86:0/1873529575 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c406e1a0 con 0x7f53c406f0b0 2023-10-09T11:57:56.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53c999c700 1 --2- 172.21.15.86:0/1873529575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c406f0b0 0x7f53c415d440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f53c406d510 tx=0x7f53bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dccd6b8ef1929e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:56.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53bbfff700 1 -- 172.21.15.86:0/1873529575 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00e070 con 0x7f53c406f0b0 2023-10-09T11:57:56.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53bbfff700 1 -- 172.21.15.86:0/1873529575 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00ba20 con 0x7f53c406f0b0 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.392+0000 7f53bbfff700 1 -- 172.21.15.86:0/1873529575 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0092e0 con 0x7f53c406f0b0 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 -- 172.21.15.86:0/1873529575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c406f0b0 msgr2=0x7f53c415d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1873529575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c406f0b0 0x7f53c415d440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f53c406d510 tx=0x7f53bc009840 comp rx=0 tx=0).stop 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 -- 172.21.15.86:0/1873529575 shutdown_connections 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1873529575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c406f0b0 0x7f53c415d440 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1873529575 >> v2:172.21.15.135:3300/0 conn(0x7f53c41597d0 0x7f53c40afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 -- 172.21.15.86:0/1873529575 >> 172.21.15.86:0/1873529575 conn(0x7f53c406adf0 msgr2=0x7f53c40ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 -- 172.21.15.86:0/1873529575 shutdown_connections 2023-10-09T11:57:56.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.393+0000 7f53ca19d700 1 -- 172.21.15.86:0/1873529575 wait complete. 2023-10-09T11:57:56.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.394+0000 7f53ca19d700 1 Processor -- start 2023-10-09T11:57:56.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.394+0000 7f53ca19d700 1 -- start start 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.395+0000 7f53ca19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53c406f0b0 0x7f53c415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.395+0000 7f53ca19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c41597d0 0x7f53c41434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.395+0000 7f53ca19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c4155b90 0x7f53c40ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.395+0000 7f53ca19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c416e010 con 0x7f53c4155b90 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.395+0000 7f53ca19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c416d400 con 0x7f53c41597d0 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.395+0000 7f53ca19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c416d6e0 con 0x7f53c406f0b0 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c4155b90 0x7f53c40ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c4155b90 0x7f53c40ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56178/0 (socket says 172.21.15.86:56178) 2023-10-09T11:57:56.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 -- 172.21.15.86:0/1248384130 learned_addr learned my addr 172.21.15.86:0/1248384130 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53c406f0b0 0x7f53c415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c899a700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c41597d0 0x7f53c41434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53c406f0b0 msgr2=0x7f53c415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53c406f0b0 0x7f53c415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c41597d0 msgr2=0x7f53c41434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c41597d0 0x7f53c41434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 -- 172.21.15.86:0/1248384130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc009ae0 con 0x7f53c4155b90 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53c406f0b0 0x7f53c415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:57:56.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.396+0000 7f53c999c700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c4155b90 0x7f53c40ae820 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009880 tx=0x7f53bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:57:56.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.397+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc008a80 con 0x7f53c4155b90 2023-10-09T11:57:56.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.397+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc008c00 con 0x7f53c4155b90 2023-10-09T11:57:56.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.397+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c416d9c0 con 0x7f53c4155b90 2023-10-09T11:57:56.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.397+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc026460 con 0x7f53c4155b90 2023-10-09T11:57:56.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.397+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c415c2e0 con 0x7f53c4155b90 2023-10-09T11:57:56.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.398+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c40aa7c0 con 0x7f53c4155b90 2023-10-09T11:57:56.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.399+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 45) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f53bc003040 con 0x7f53c4155b90 2023-10-09T11:57:56.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.400+0000 7f53b97fa700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:57:56.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.400+0000 7f53c919b700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 msgr2=0x7f53a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:56.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.400+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f53bc085ff0 con 0x7f53c4155b90 2023-10-09T11:57:56.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.400+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:57:56.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.405+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53bc0530e0 con 0x7f53c4155b90 2023-10-09T11:57:56.597 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:56.597+0000 7fbc46067180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:57:56.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.601+0000 7f53c919b700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 msgr2=0x7f53a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:56.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.601+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:57:56.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:56.625+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f53c416e150 con 0x7f53a8066f80 2023-10-09T11:57:56.648 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:56.648+0000 7ffa0d256180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:57:56.760 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:56.759+0000 7fbc46067180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:56.810 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:56.810+0000 7ffa0d256180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:56.847 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:56.846+0000 7fbc46067180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:57:56.896 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:56.896+0000 7ffa0d256180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:57:57.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:57.002+0000 7f53c919b700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 msgr2=0x7f53a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:57.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:57.002+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:57:57.073 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:57.073+0000 7fbc46067180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:57.121 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:57.121+0000 7ffa0d256180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:57.250 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:57.250+0000 7fbc46067180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:57:57.297 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:57.297+0000 7ffa0d256180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:57:57.344 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:57.344+0000 7fbc46067180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:57:57.388 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:57.388+0000 7ffa0d256180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:57:57.507 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:57.507+0000 7fbc46067180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:57:57.549 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:57.548+0000 7ffa0d256180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:57:57.609 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:57.609+0000 7fbc46067180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:57.648 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:57.647+0000 7ffa0d256180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:57:57.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:57.803+0000 7f53c919b700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 msgr2=0x7f53a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:57.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:57.803+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T11:57:58.093 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:58.093+0000 7fbc46067180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:57:58.132 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:58.132+0000 7ffa0d256180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:57:58.188 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:58.188+0000 7fbc46067180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:57:58.225 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:58.225+0000 7ffa0d256180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:57:58.278 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:58.278+0000 7fbc46067180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:57:58.314 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:58.314+0000 7ffa0d256180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:57:58.900 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:58.900+0000 7fbc46067180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:57:58.931 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:58.931+0000 7ffa0d256180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:57:59.071 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:59.071+0000 7fbc46067180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:59.102 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:59.102+0000 7ffa0d256180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:57:59.168 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:59.167+0000 7fbc46067180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:57:59.198 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:59.197+0000 7ffa0d256180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:57:59.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:59.405+0000 7f53c919b700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 msgr2=0x7f53a8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:57:59.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:57:59.405+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T11:57:59.461 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:59.461+0000 7fbc46067180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:57:59.488 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:59.488+0000 7ffa0d256180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:57:59.558 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:57:59.557+0000 7fbc46067180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:57:59.583 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:57:59.583+0000 7ffa0d256180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:58:00.254 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:00.254+0000 7fbc46067180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:58:00.279 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:00.279+0000 7ffa0d256180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:58:00.541 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:00.541+0000 7fbc46067180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:58:00.560 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:00.560+0000 7ffa0d256180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:58:00.634 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:00.634+0000 7fbc46067180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:58:00.652 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:00.652+0000 7ffa0d256180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:58:00.787 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:00.786+0000 7fbc46067180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:58:00.805 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:00.805+0000 7ffa0d256180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:58:00.891 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:00.891+0000 7fbc46067180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:58:00.908 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:00.908+0000 7ffa0d256180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:58:01.081 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:01.080+0000 7fbc46067180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:58:01.097 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.097+0000 7ffa0d256180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:58:01.173 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:01.173+0000 7fbc46067180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:58:01.189 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.189+0000 7ffa0d256180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:58:01.265 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:01.264+0000 7fbc46067180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:58:01.280 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.280+0000 7ffa0d256180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:58:01.359 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:58:01.358+0000 7fbc46067180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:58:01.372 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.372+0000 7ffa0d256180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:58:01.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:01.381+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 46) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f53bc0534b0 con 0x7f53c4155b90 2023-10-09T11:58:01.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:01.382+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 msgr2=0x7f53a8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:58:01.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:01.382+0000 7f53b97fa700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:01.500 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.499+0000 7ff9825b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.500 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.499+0000 7ff9825b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.500 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.499+0000 7ff9825b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.500 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.499+0000 7ff9825b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.501 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.499+0000 7ff9825b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.501 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.500+0000 7ff97e5af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.502 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.500+0000 7ff97e5af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.502 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.500+0000 7ff97e5af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.502 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.500+0000 7ff97e5af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:01.502 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:58:01.500+0000 7ff97e5af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:58:02.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.387+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 47) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f53bc05d8b0 con 0x7f53c4155b90 2023-10-09T11:58:02.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.388+0000 7f53b97fa700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.388+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f53c416e150 con 0x7f53a8066f80 2023-10-09T11:58:02.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.393+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.396+0000 7f53c919b700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009a50 tx=0x7f53c00091a0 comp rx=0 tx=0).ready entity=mgr.7380 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:58:02.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.456+0000 7f53b97fa700 1 -- 172.21.15.86:0/1248384130 <== mgr.7380 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f53c416e150 con 0x7f53a8066f80 2023-10-09T11:58:02.457 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /bad-path 2023-10-09T11:58:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 msgr2=0x7f53a8069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009a50 tx=0x7f53c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c4155b90 msgr2=0x7f53c40ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c4155b90 0x7f53c40ae820 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009880 tx=0x7f53bc018000 comp rx=0 tx=0).stop 2023-10-09T11:58:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 shutdown_connections 2023-10-09T11:58:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f53a8066f80 0x7f53a8069430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53c4155b90 0x7f53c40ae820 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53c406f0b0 0x7f53c415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 --2- 172.21.15.86:0/1248384130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c41597d0 0x7f53c41434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 >> 172.21.15.86:0/1248384130 conn(0x7f53c406adf0 msgr2=0x7f53c41589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:58:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 shutdown_connections 2023-10-09T11:58:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.459+0000 7f53ca19d700 1 -- 172.21.15.86:0/1248384130 wait complete. 2023-10-09T11:58:02.479 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-10-09T11:58:02.479 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-09T11:58:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.664+0000 7fa0471ff700 1 Processor -- start 2023-10-09T11:58:02.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.665+0000 7fa0471ff700 1 -- start start 2023-10-09T11:58:02.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa0471ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa040068890 0x7fa0400c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa0471ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04015a9b0 con 0x7fa0401563b0 2023-10-09T11:58:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa0471ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04015ac90 con 0x7fa04015a440 2023-10-09T11:58:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa0471ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04015af70 con 0x7fa040068890 2023-10-09T11:58:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa044f9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa0401563b0 0x7fa040156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:50994/0 (socket says 172.21.15.86:50994) 2023-10-09T11:58:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa044f9b700 1 -- 172.21.15.86:0/2183754306 learned_addr learned my addr 172.21.15.86:0/2183754306 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:58:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa04579c700 1 --2- 172.21.15.86:0/2183754306 >> v2:172.21.15.135:3300/0 conn(0x7fa040068890 0x7fa0400c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026883901 0 0) 0x7fa04015a9b0 con 0x7fa0401563b0 2023-10-09T11:58:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.666+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa030003570 con 0x7fa0401563b0 2023-10-09T11:58:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486320982 0 0) 0x7fa04015ac90 con 0x7fa04015a440 2023-10-09T11:58:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04015a9b0 con 0x7fa04015a440 2023-10-09T11:58:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3328390631 0 0) 0x7fa030003570 con 0x7fa0401563b0 2023-10-09T11:58:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 >> v2:172.21.15.135:3300/0 conn(0x7fa040068890 msgr2=0x7fa0400c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:58:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 --2- 172.21.15.86:0/2183754306 >> v2:172.21.15.135:3300/0 conn(0x7fa040068890 0x7fa0400c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 >> v1:172.21.15.135:6789/0 conn(0x7fa04015a440 legacy=0x7fa0400acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04015b250 con 0x7fa0401563b0 2023-10-09T11:58:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa034001470 con 0x7fa0401563b0 2023-10-09T11:58:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 >> v1:172.21.15.86:6789/0 conn(0x7fa0401563b0 legacy=0x7fa040156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa030003c40 0x7fa030004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa030005210 0x7fa03000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04015af70 con 0x7fa030004810 2023-10-09T11:58:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03000c130 con 0x7fa030005210 2023-10-09T11:58:02.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03000c2c0 con 0x7fa030003c40 2023-10-09T11:58:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03ffff700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa044f9b700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa030003c40 0x7fa030004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa04579c700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa030005210 0x7fa03000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03ffff700 1 -- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa030003c40 msgr2=0x7fa030004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:58:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.667+0000 7fa03ffff700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa030003c40 0x7fa030004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa03ffff700 1 -- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa030005210 msgr2=0x7fa03000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:58:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa03ffff700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa030005210 0x7fa03000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa03ffff700 1 -- 172.21.15.86:0/2183754306 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030003570 con 0x7fa030004810 2023-10-09T11:58:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa04579c700 1 -- 172.21.15.86:0/2183754306 reap_dead start 2023-10-09T11:58:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa03ffff700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa030004c80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fa02c001a40 tx=0x7fa02c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaf71fe1e0c9c81 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:58:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c00c550 con 0x7fa030004810 2023-10-09T11:58:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c00c6b0 con 0x7fa030004810 2023-10-09T11:58:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa03f7fe700 1 -- 172.21.15.86:0/2183754306 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c00ca50 con 0x7fa030004810 2023-10-09T11:58:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa0471ff700 1 -- 172.21.15.86:0/2183754306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 msgr2=0x7fa030004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.668+0000 7fa0471ff700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa030004c80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fa02c001a40 tx=0x7fa02c007d30 comp rx=0 tx=0).stop 2023-10-09T11:58:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.669+0000 7fa0471ff700 1 -- 172.21.15.86:0/2183754306 shutdown_connections 2023-10-09T11:58:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.669+0000 7fa0471ff700 1 --2- 172.21.15.86:0/2183754306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa030004c80 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.669+0000 7fa0471ff700 1 -- 172.21.15.86:0/2183754306 >> 172.21.15.86:0/2183754306 conn(0x7fa0400c8f90 msgr2=0x7fa0400c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:58:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.669+0000 7fa0471ff700 1 -- 172.21.15.86:0/2183754306 shutdown_connections 2023-10-09T11:58:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.669+0000 7fa0471ff700 1 -- 172.21.15.86:0/2183754306 wait complete. 2023-10-09T11:58:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.670+0000 7fa0471ff700 1 Processor -- start 2023-10-09T11:58:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.670+0000 7fa0471ff700 1 -- start start 2023-10-09T11:58:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa0471ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa0401502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa0471ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa040152ad0 0x7fa0400c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa0471ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0400ca610 0x7fa0400caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa0471ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400cafc0 con 0x7fa030004810 2023-10-09T11:58:02.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa0471ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa040150830 con 0x7fa040152ad0 2023-10-09T11:58:02.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa0471ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa040153020 con 0x7fa0400ca610 2023-10-09T11:58:02.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa044f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa0401502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa044f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa0401502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56308/0 (socket says 172.21.15.86:56308) 2023-10-09T11:58:02.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.671+0000 7fa044f9b700 1 -- 172.21.15.86:0/3009583811 learned_addr learned my addr 172.21.15.86:0/3009583811 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:58:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa04579c700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0400ca610 0x7fa0400caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa03ffff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa040152ad0 0x7fa0400c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa044f9b700 1 -- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0400ca610 msgr2=0x7fa0400caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa044f9b700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0400ca610 0x7fa0400caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa044f9b700 1 -- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa040152ad0 msgr2=0x7fa0400c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa044f9b700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa040152ad0 0x7fa0400c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa044f9b700 1 -- 172.21.15.86:0/3009583811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040153300 con 0x7fa030004810 2023-10-09T11:58:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa03ffff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa040152ad0 0x7fa0400c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:58:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa044f9b700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa0401502f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa034006fa0 tx=0x7fa034001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:58:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa03cff9700 1 -- 172.21.15.86:0/3009583811 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034011720 con 0x7fa030004810 2023-10-09T11:58:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa03cff9700 1 -- 172.21.15.86:0/3009583811 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa034011880 con 0x7fa030004810 2023-10-09T11:58:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0401535e0 con 0x7fa030004810 2023-10-09T11:58:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa03cff9700 1 -- 172.21.15.86:0/3009583811 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034011c40 con 0x7fa030004810 2023-10-09T11:58:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.672+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa040153ba0 con 0x7fa030004810 2023-10-09T11:58:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.673+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0400718b0 con 0x7fa030004810 2023-10-09T11:58:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.674+0000 7fa03cff9700 1 -- 172.21.15.86:0/3009583811 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 47) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fa0340103d0 con 0x7fa030004810 2023-10-09T11:58:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.675+0000 7fa03cff9700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa024066dd0 0x7fa024069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:58:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.675+0000 7fa03cff9700 1 -- 172.21.15.86:0/3009583811 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fa034084ca0 con 0x7fa030004810 2023-10-09T11:58:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.675+0000 7fa03ffff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa024066dd0 0x7fa024069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:58:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.676+0000 7fa03ffff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa024066dd0 0x7fa024069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0019e0 tx=0x7fa02c015000 comp rx=0 tx=0).ready entity=mgr.7380 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:58:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.679+0000 7fa03cff9700 1 -- 172.21.15.86:0/3009583811 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa034051f40 con 0x7fa030004810 2023-10-09T11:58:02.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.892+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa04006d6a0 con 0x7fa024066dd0 2023-10-09T11:58:02.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.900+0000 7fa03cff9700 1 -- 172.21.15.86:0/3009583811 <== mgr.7380 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7fa04006d6a0 con 0x7fa024066dd0 2023-10-09T11:58:02.901 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:58:02.901 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:58:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-09T11:58:02.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa024066dd0 msgr2=0x7fa024069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa024066dd0 0x7fa024069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0019e0 tx=0x7fa02c015000 comp rx=0 tx=0).stop 2023-10-09T11:58:02.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 msgr2=0x7fa0401502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:58:02.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa0401502f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa034006fa0 tx=0x7fa034001db0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 shutdown_connections 2023-10-09T11:58:02.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa024066dd0 0x7fa024069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa030004810 0x7fa0401502f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0400ca610 0x7fa0400caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 --2- 172.21.15.86:0/3009583811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa040152ad0 0x7fa0400c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:58:02.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 >> 172.21.15.86:0/3009583811 conn(0x7fa0400c8f90 msgr2=0x7fa0401520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:58:02.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 shutdown_connections 2023-10-09T11:58:02.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:58:02.902+0000 7fa0471ff700 1 -- 172.21.15.86:0/3009583811 wait complete. 2023-10-09T11:58:02.920 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:58:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-09T11:58:11.083 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:58:11.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:58:41.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:58:41.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:59:00.469 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:00.468+0000 7ff971d96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:00.469 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:00.468+0000 7ff971d96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:00.469 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:00.468+0000 7ff971d96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:00.470 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:00.468+0000 7ff971d96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:00.470 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:00.468+0000 7ff971d96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:02.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-09T11:59:03.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.117+0000 7f64699ff700 1 Processor -- start 2023-10-09T11:59:03.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.118+0000 7f64699ff700 1 -- start start 2023-10-09T11:59:03.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f64699ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64641563b0 0x7f6464156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f64699ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64640acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f64699ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646415a9b0 con 0x7f6464068890 2023-10-09T11:59:03.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f64699ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646415ac90 con 0x7f64641563b0 2023-10-09T11:59:03.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f64699ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646415af70 con 0x7f646415a440 2023-10-09T11:59:03.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f6462ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64641563b0 0x7f6464156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f6462ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64641563b0 0x7f6464156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42498/0 (socket says 172.21.15.86:42498) 2023-10-09T11:59:03.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f6462ffd700 1 -- 172.21.15.86:0/1689752472 learned_addr learned my addr 172.21.15.86:0/1689752472 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:03.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f6462ffd700 1 -- 172.21.15.86:0/1689752472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 msgr2=0x7f64640acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:03.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f6462ffd700 1 --2- 172.21.15.86:0/1689752472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64640acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f6462ffd700 1 -- 172.21.15.86:0/1689752472 >> v1:172.21.15.135:6789/0 conn(0x7f6464068890 legacy=0x7f64640c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:03.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.119+0000 7f6462ffd700 1 -- 172.21.15.86:0/1689752472 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646415b250 con 0x7f64641563b0 2023-10-09T11:59:03.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f6462ffd700 1 --2- 172.21.15.86:0/1689752472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64641563b0 0x7f6464156780 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f64540099b0 tx=0x7f6454009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee751b3a5acc9525 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:03.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f6461ffb700 1 -- 172.21.15.86:0/1689752472 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400b820 con 0x7f64641563b0 2023-10-09T11:59:03.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f6461ffb700 1 -- 172.21.15.86:0/1689752472 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400b980 con 0x7f64641563b0 2023-10-09T11:59:03.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f6461ffb700 1 -- 172.21.15.86:0/1689752472 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400bd20 con 0x7f64641563b0 2023-10-09T11:59:03.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f64699ff700 1 -- 172.21.15.86:0/1689752472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64641563b0 msgr2=0x7f6464156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f64699ff700 1 --2- 172.21.15.86:0/1689752472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64641563b0 0x7f6464156780 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f64540099b0 tx=0x7f6454009250 comp rx=0 tx=0).stop 2023-10-09T11:59:03.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f64699ff700 1 -- 172.21.15.86:0/1689752472 shutdown_connections 2023-10-09T11:59:03.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f64699ff700 1 --2- 172.21.15.86:0/1689752472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64641563b0 0x7f6464156780 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f64699ff700 1 --2- 172.21.15.86:0/1689752472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64640acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.120+0000 7f64699ff700 1 -- 172.21.15.86:0/1689752472 >> 172.21.15.86:0/1689752472 conn(0x7f64640c8f90 msgr2=0x7f64640c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:03.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.121+0000 7f64699ff700 1 -- 172.21.15.86:0/1689752472 shutdown_connections 2023-10-09T11:59:03.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.121+0000 7f64699ff700 1 -- 172.21.15.86:0/1689752472 wait complete. 2023-10-09T11:59:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.122+0000 7f64699ff700 1 Processor -- start 2023-10-09T11:59:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.122+0000 7f64699ff700 1 -- start start 2023-10-09T11:59:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f64699ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6464068890 0x7f6464165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f64699ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64641563b0 0x7f6464157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f64699ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64641512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f64699ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64641586e0 con 0x7f6464068890 2023-10-09T11:59:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f64699ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64641589c0 con 0x7f64641563b0 2023-10-09T11:59:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f64699ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6464158ca0 con 0x7f646415a440 2023-10-09T11:59:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f6462ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6464068890 0x7f6464165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f6462ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6464068890 0x7f6464165ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42508/0 (socket says 172.21.15.86:42508) 2023-10-09T11:59:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.123+0000 7f6462ffd700 1 -- 172.21.15.86:0/3225052145 learned_addr learned my addr 172.21.15.86:0/3225052145 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f6462ffd700 1 -- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 msgr2=0x7f64641512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f64627fc700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64641563b0 0x7f6464157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f64637fe700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64641512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f6462ffd700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64641512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f6462ffd700 1 -- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64641563b0 msgr2=0x7f6464157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f6462ffd700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64641563b0 0x7f6464157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f6462ffd700 1 -- 172.21.15.86:0/3225052145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540094f0 con 0x7f6464068890 2023-10-09T11:59:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f64627fc700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64641563b0 0x7f6464157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f64637fe700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64641512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f6462ffd700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6464068890 0x7f6464165ea0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6454009290 tx=0x7f6454018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f644affd700 1 -- 172.21.15.86:0/3225052145 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645401d070 con 0x7f6464068890 2023-10-09T11:59:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f644affd700 1 -- 172.21.15.86:0/3225052145 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454018420 con 0x7f6464068890 2023-10-09T11:59:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464158f80 con 0x7f6464068890 2023-10-09T11:59:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f644affd700 1 -- 172.21.15.86:0/3225052145 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540187e0 con 0x7f6464068890 2023-10-09T11:59:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.124+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64641583d0 con 0x7f6464068890 2023-10-09T11:59:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.125+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64640718b0 con 0x7f6464068890 2023-10-09T11:59:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.126+0000 7f644affd700 1 -- 172.21.15.86:0/3225052145 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 49) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f6454018b90 con 0x7f6464068890 2023-10-09T11:59:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.127+0000 7f644affd700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f64500671c0 0x7f6450069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.127+0000 7f644affd700 1 -- 172.21.15.86:0/3225052145 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f6454014070 con 0x7f6464068890 2023-10-09T11:59:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.127+0000 7f64627fc700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f64500671c0 0x7f6450069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.128+0000 7f64627fc700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f64500671c0 0x7f6450069670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6458006fd0 tx=0x7f6458008040 comp rx=0 tx=0).ready entity=mgr.7380 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:03.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.132+0000 7f644affd700 1 -- 172.21.15.86:0/3225052145 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6454054a70 con 0x7f6464068890 2023-10-09T11:59:03.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.346+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6464158b30 con 0x7f64500671c0 2023-10-09T11:59:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.354+0000 7f644affd700 1 -- 172.21.15.86:0/3225052145 <== mgr.7380 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f6464158b30 con 0x7f64500671c0 2023-10-09T11:59:03.355 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:03.355 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:58:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-09T11:59:03.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f64500671c0 msgr2=0x7f6450069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f64500671c0 0x7f6450069670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6458006fd0 tx=0x7f6458008040 comp rx=0 tx=0).stop 2023-10-09T11:59:03.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6464068890 msgr2=0x7f6464165ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6464068890 0x7f6464165ea0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6454009290 tx=0x7f6454018000 comp rx=0 tx=0).stop 2023-10-09T11:59:03.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 shutdown_connections 2023-10-09T11:59:03.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f64500671c0 0x7f6450069670 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6464068890 0x7f6464165ea0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f646415a440 0x7f64641512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 --2- 172.21.15.86:0/3225052145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64641563b0 0x7f6464157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.356+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 >> 172.21.15.86:0/3225052145 conn(0x7f64640c8f90 msgr2=0x7f646406e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:03.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.357+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 shutdown_connections 2023-10-09T11:59:03.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.357+0000 7f64699ff700 1 -- 172.21.15.86:0/3225052145 wait complete. 2023-10-09T11:59:03.375 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T11:58:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-09T11:59:03.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-10-09T11:59:03.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.563+0000 7fd5017ff700 1 Processor -- start 2023-10-09T11:59:03.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.563+0000 7fd5017ff700 1 -- start start 2023-10-09T11:59:03.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.564+0000 7fd5017ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4fc15a440 0x7fd4fc0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.564+0000 7fd5017ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.564+0000 7fd5017ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc15a9b0 con 0x7fd4fc1563b0 2023-10-09T11:59:03.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.564+0000 7fd5017ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc15ac90 con 0x7fd4fc15a440 2023-10-09T11:59:03.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.564+0000 7fd5017ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15af70 con 0x7fd4fc068890 2023-10-09T11:59:03.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4fa7fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4fc15a440 0x7fd4fc0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4fb7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4fb7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc0c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:45408/0 (socket says 172.21.15.86:45408) 2023-10-09T11:59:03.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4faffd700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd4fc1563b0 0x7fd4fc156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:33810/0 (socket says 172.21.15.86:33810) 2023-10-09T11:59:03.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4fa7fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4fc15a440 0x7fd4fc0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:46126/0 (socket says 172.21.15.86:46126) 2023-10-09T11:59:03.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/3122609924 learned_addr learned my addr 172.21.15.86:0/3122609924 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:03.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4f9ffb700 1 -- 172.21.15.86:0/3122609924 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805067552 0 0) 0x7fd4fc15a9b0 con 0x7fd4fc1563b0 2023-10-09T11:59:03.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4f9ffb700 1 -- 172.21.15.86:0/3122609924 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e4003570 con 0x7fd4fc1563b0 2023-10-09T11:59:03.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/3122609924 >> v2:172.21.15.135:3300/0 conn(0x7fd4fc15a440 msgr2=0x7fd4fc0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:03.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.565+0000 7fd4fb7fe700 1 --2- 172.21.15.86:0/3122609924 >> v2:172.21.15.135:3300/0 conn(0x7fd4fc15a440 0x7fd4fc0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.566+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/3122609924 >> v1:172.21.15.135:6789/0 conn(0x7fd4fc1563b0 legacy=0x7fd4fc156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.566+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/3122609924 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc15b250 con 0x7fd4fc068890 2023-10-09T11:59:03.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.566+0000 7fd4fa7fc700 1 --2- 172.21.15.86:0/3122609924 >> v2:172.21.15.135:3300/0 conn(0x7fd4fc15a440 0x7fd4fc0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:03.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.566+0000 7fd4fb7fe700 1 --2- 172.21.15.86:0/3122609924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc0c8230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009f20 tx=0x7fd4f4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa288ed1f0d17a6f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:03.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.566+0000 7fd4f9ffb700 1 -- 172.21.15.86:0/3122609924 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400e070 con 0x7fd4fc068890 2023-10-09T11:59:03.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.566+0000 7fd4f9ffb700 1 -- 172.21.15.86:0/3122609924 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400b970 con 0x7fd4fc068890 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.566+0000 7fd4f9ffb700 1 -- 172.21.15.86:0/3122609924 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40092e0 con 0x7fd4fc068890 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 -- 172.21.15.86:0/3122609924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 msgr2=0x7fd4fc0c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 --2- 172.21.15.86:0/3122609924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc0c8230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009f20 tx=0x7fd4f4009840 comp rx=0 tx=0).stop 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 -- 172.21.15.86:0/3122609924 shutdown_connections 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 --2- 172.21.15.86:0/3122609924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc0c8230 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 --2- 172.21.15.86:0/3122609924 >> v2:172.21.15.135:3300/0 conn(0x7fd4fc15a440 0x7fd4fc0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 -- 172.21.15.86:0/3122609924 >> 172.21.15.86:0/3122609924 conn(0x7fd4fc0c8f90 msgr2=0x7fd4fc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:03.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 -- 172.21.15.86:0/3122609924 shutdown_connections 2023-10-09T11:59:03.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.567+0000 7fd5017ff700 1 -- 172.21.15.86:0/3122609924 wait complete. 2023-10-09T11:59:03.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.568+0000 7fd5017ff700 1 Processor -- start 2023-10-09T11:59:03.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.568+0000 7fd5017ff700 1 -- start start 2023-10-09T11:59:03.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd5017ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc16a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd5017ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4fc1563b0 0x7fd4fc0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd5017ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc15a440 0x7fd4fc144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd5017ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0cb0c0 con 0x7fd4fc15a440 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd5017ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0cb3a0 con 0x7fd4fc1563b0 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd5017ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0cb680 con 0x7fd4fc068890 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd4fb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc15a440 0x7fd4fc144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd4fb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc15a440 0x7fd4fc144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42524/0 (socket says 172.21.15.86:42524) 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.569+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/1387627391 learned_addr learned my addr 172.21.15.86:0/1387627391 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4faffd700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc16a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fa7fc700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4fc1563b0 0x7fd4fc0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 msgr2=0x7fd4fc16a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fb7fe700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc16a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4fc1563b0 msgr2=0x7fd4fc0af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fb7fe700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4fc1563b0 0x7fd4fc0af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fb7fe700 1 -- 172.21.15.86:0/1387627391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f0009420 con 0x7fd4fc15a440 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fa7fc700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4fc1563b0 0x7fd4fc0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4fb7fe700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc15a440 0x7fd4fc144460 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400b610 tx=0x7fd4f4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4e2ffd700 1 -- 172.21.15.86:0/1387627391 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4008b80 con 0x7fd4fc15a440 2023-10-09T11:59:03.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4e2ffd700 1 -- 172.21.15.86:0/1387627391 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f4008ce0 con 0x7fd4fc15a440 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f4009ae0 con 0x7fd4fc15a440 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd4e2ffd700 1 -- 172.21.15.86:0/1387627391 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f401c640 con 0x7fd4fc15a440 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.570+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc16adf0 con 0x7fd4fc15a440 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.571+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0718b0 con 0x7fd4fc15a440 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.572+0000 7fd4e2ffd700 1 -- 172.21.15.86:0/1387627391 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 49) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fd4f4003040 con 0x7fd4fc15a440 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.573+0000 7fd4e2ffd700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd4e80671c0 0x7fd4e8069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.573+0000 7fd4e2ffd700 1 -- 172.21.15.86:0/1387627391 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7fd4f4086490 con 0x7fd4fc15a440 2023-10-09T11:59:03.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.573+0000 7fd4faffd700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd4e80671c0 0x7fd4e8069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:03.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.574+0000 7fd4faffd700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd4e80671c0 0x7fd4e8069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0c8d90 tx=0x7fd4ec007d40 comp rx=0 tx=0).ready entity=mgr.7380 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:03.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.578+0000 7fd4e2ffd700 1 -- 172.21.15.86:0/1387627391 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4f4053050 con 0x7fd4fc15a440 2023-10-09T11:59:03.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.792+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4fc06d6a0 con 0x7fd4e80671c0 2023-10-09T11:59:03.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.854+0000 7fd4e2ffd700 1 -- 172.21.15.86:0/1387627391 <== mgr.7380 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7fd4fc06d6a0 con 0x7fd4e80671c0 2023-10-09T11:59:03.855 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /bad-path 2023-10-09T11:59:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.856+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd4e80671c0 msgr2=0x7fd4e8069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.856+0000 7fd5017ff700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd4e80671c0 0x7fd4e8069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0c8d90 tx=0x7fd4ec007d40 comp rx=0 tx=0).stop 2023-10-09T11:59:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.856+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc15a440 msgr2=0x7fd4fc144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.856+0000 7fd5017ff700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc15a440 0x7fd4fc144460 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400b610 tx=0x7fd4f4018000 comp rx=0 tx=0).stop 2023-10-09T11:59:03.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 shutdown_connections 2023-10-09T11:59:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd4e80671c0 0x7fd4e8069670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc15a440 0x7fd4fc144460 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4fc068890 0x7fd4fc16a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 --2- 172.21.15.86:0/1387627391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4fc1563b0 0x7fd4fc0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 >> 172.21.15.86:0/1387627391 conn(0x7fd4fc0c8f90 msgr2=0x7fd4fc06db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 shutdown_connections 2023-10-09T11:59:03.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:03.857+0000 7fd5017ff700 1 -- 172.21.15.86:0/1387627391 wait complete. 2023-10-09T11:59:03.874 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-10-09T11:59:03.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T11:59:04.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.056+0000 7f1aed19d700 1 Processor -- start 2023-10-09T11:59:04.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.056+0000 7f1aed19d700 1 -- start start 2023-10-09T11:59:04.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1aed19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ae80cb1a0 0x7f1ae815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1aed19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1ae815a8a0 0x7f1ae806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1aed19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae806f5a0 0x7f1ae80ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1aed19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae815b2e0 con 0x7f1ae80cb1a0 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1aed19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae806ebd0 con 0x7f1ae815a8a0 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1aed19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae815ad20 con 0x7f1ae806f5a0 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1ae7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ae80cb1a0 0x7f1ae815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1ae7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ae80cb1a0 0x7f1ae815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42526/0 (socket says 172.21.15.86:42526) 2023-10-09T11:59:04.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2505808670 learned_addr learned my addr 172.21.15.86:0/2505808670 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1aec99c700 1 --2- 172.21.15.86:0/2505808670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae806f5a0 0x7f1ae80ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.057+0000 7f1ae77fe700 1 --2- 172.21.15.86:0/2505808670 >> v2:172.21.15.135:3300/0 conn(0x7f1ae815a8a0 0x7f1ae806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2505808670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae806f5a0 msgr2=0x7f1ae80ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae7fff700 1 --2- 172.21.15.86:0/2505808670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae806f5a0 0x7f1ae80ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2505808670 >> v2:172.21.15.135:3300/0 conn(0x7f1ae815a8a0 msgr2=0x7f1ae806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae7fff700 1 --2- 172.21.15.86:0/2505808670 >> v2:172.21.15.135:3300/0 conn(0x7f1ae815a8a0 0x7f1ae806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2505808670 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae815b000 con 0x7f1ae80cb1a0 2023-10-09T11:59:04.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae7fff700 1 --2- 172.21.15.86:0/2505808670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae80cb1a0 0x7f1ae815a360 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8070d30 tx=0x7f1ad800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b7657ad3f3be22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae6ffd700 1 -- 172.21.15.86:0/2505808670 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800dce0 con 0x7f1ae80cb1a0 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae6ffd700 1 -- 172.21.15.86:0/2505808670 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800de40 con 0x7f1ae80cb1a0 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.058+0000 7f1ae6ffd700 1 -- 172.21.15.86:0/2505808670 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80196d0 con 0x7f1ae80cb1a0 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 -- 172.21.15.86:0/2505808670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae80cb1a0 msgr2=0x7f1ae815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2505808670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae80cb1a0 0x7f1ae815a360 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8070d30 tx=0x7f1ad800b4f0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 -- 172.21.15.86:0/2505808670 shutdown_connections 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2505808670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae806f5a0 0x7f1ae80ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2505808670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae80cb1a0 0x7f1ae815a360 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2505808670 >> v2:172.21.15.135:3300/0 conn(0x7f1ae815a8a0 0x7f1ae806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 -- 172.21.15.86:0/2505808670 >> 172.21.15.86:0/2505808670 conn(0x7f1ae80cc1e0 msgr2=0x7f1ae80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:04.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 -- 172.21.15.86:0/2505808670 shutdown_connections 2023-10-09T11:59:04.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.059+0000 7f1aed19d700 1 -- 172.21.15.86:0/2505808670 wait complete. 2023-10-09T11:59:04.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.060+0000 7f1aed19d700 1 Processor -- start 2023-10-09T11:59:04.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.060+0000 7f1aed19d700 1 -- start start 2023-10-09T11:59:04.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1aed19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae806f5a0 0x7f1ae8150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:04.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1aed19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae80cb1a0 0x7f1ae814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:04.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1aed19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ae814dfc0 0x7f1ae814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:04.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1aed19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8151fe0 con 0x7f1ae806f5a0 2023-10-09T11:59:04.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1aed19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81513d0 con 0x7f1ae814dfc0 2023-10-09T11:59:04.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1aed19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81516b0 con 0x7f1ae80cb1a0 2023-10-09T11:59:04.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1ae7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae806f5a0 0x7f1ae8150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:04.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1ae7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae806f5a0 0x7f1ae8150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42536/0 (socket says 172.21.15.86:42536) 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.061+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2454142484 learned_addr learned my addr 172.21.15.86:0/2454142484 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2454142484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae80cb1a0 msgr2=0x7f1ae814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1ae7fff700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae80cb1a0 0x7f1ae814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2454142484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ae814dfc0 msgr2=0x7f1ae814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1ae7fff700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ae814dfc0 0x7f1ae814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1ae7fff700 1 -- 172.21.15.86:0/2454142484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad800b790 con 0x7f1ae806f5a0 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1ae7fff700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae806f5a0 0x7f1ae8150df0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1ae806ce80 tx=0x7f1ad801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:04.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80105c0 con 0x7f1ae806f5a0 2023-10-09T11:59:04.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8010720 con 0x7f1ae806f5a0 2023-10-09T11:59:04.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae8151990 con 0x7f1ae806f5a0 2023-10-09T11:59:04.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8010ae0 con 0x7f1ae806f5a0 2023-10-09T11:59:04.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.062+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae80b0070 con 0x7f1ae806f5a0 2023-10-09T11:59:04.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.063+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae806c450 con 0x7f1ae806f5a0 2023-10-09T11:59:04.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.064+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 49) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f1ad8022030 con 0x7f1ae806f5a0 2023-10-09T11:59:04.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.065+0000 7f1acffff700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ad40671c0 0x7f1ad4069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:04.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.066+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f1ad8014070 con 0x7f1ae806f5a0 2023-10-09T11:59:04.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.066+0000 7f1ae77fe700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ad40671c0 0x7f1ad4069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:04.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.066+0000 7f1ae77fe700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ad40671c0 0x7f1ad4069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ae815c120 tx=0x7f1adc008040 comp rx=0 tx=0).ready entity=mgr.7380 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:04.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.070+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad8055a90 con 0x7f1ae806f5a0 2023-10-09T11:59:04.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.311+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1ae806e860 con 0x7f1ae806f5a0 2023-10-09T11:59:04.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.496+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f1ad8055e60 con 0x7f1ae806f5a0 2023-10-09T11:59:04.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.496+0000 7f1acffff700 1 -- 172.21.15.86:0/2454142484 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v50) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1ad8051f70 con 0x7f1ae806f5a0 2023-10-09T11:59:04.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ad40671c0 msgr2=0x7f1ad4069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:04.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ad40671c0 0x7f1ad4069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ae815c120 tx=0x7f1adc008040 comp rx=0 tx=0).stop 2023-10-09T11:59:04.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae806f5a0 msgr2=0x7f1ae8150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae806f5a0 0x7f1ae8150df0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1ae806ce80 tx=0x7f1ad801b000 comp rx=0 tx=0).stop 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 shutdown_connections 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ad40671c0 0x7f1ad4069670 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ae806f5a0 0x7f1ae8150df0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ae814dfc0 0x7f1ae814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 --2- 172.21.15.86:0/2454142484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ae80cb1a0 0x7f1ae814e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 >> 172.21.15.86:0/2454142484 conn(0x7f1ae80cc1e0 msgr2=0x7f1ae8069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 shutdown_connections 2023-10-09T11:59:04.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:04.499+0000 7f1aed19d700 1 -- 172.21.15.86:0/2454142484 wait complete. 2023-10-09T11:59:04.518 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:59:04.518 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:59:04.598 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:59:04.682 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:59:04.683 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:59:04.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:04.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:59:04.767 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T11:59:04.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:04.768 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:59:04.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:59:05.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.033+0000 7f345979d700 1 Processor -- start 2023-10-09T11:59:05.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.033+0000 7f345979d700 1 -- start start 2023-10-09T11:59:05.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f345979d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34541597f0 0x7f34540b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f345979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f345415d230 0x7f345415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f345979d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345415dbb0 con 0x7f3454159420 2023-10-09T11:59:05.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f345979d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34540b11d0 con 0x7f34541597f0 2023-10-09T11:59:05.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f345979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34540b14b0 con 0x7f345415d230 2023-10-09T11:59:05.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f34537fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34541597f0 0x7f34540b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f34537fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34541597f0 0x7f34540b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43026/0 (socket says 172.21.15.86:43026) 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f34537fe700 1 -- 172.21.15.86:0/1150747662 learned_addr learned my addr 172.21.15.86:0/1150747662 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f3458f9c700 1 --2- 172.21.15.86:0/1150747662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f345415d230 0x7f345415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f34537fe700 1 -- 172.21.15.86:0/1150747662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f345415d230 msgr2=0x7f345415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f34537fe700 1 --2- 172.21.15.86:0/1150747662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f345415d230 0x7f345415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f34537fe700 1 -- 172.21.15.86:0/1150747662 >> v1:172.21.15.135:6789/0 conn(0x7f3454159420 legacy=0x7f34540b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f34537fe700 1 -- 172.21.15.86:0/1150747662 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540b1790 con 0x7f34541597f0 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.035+0000 7f3452ffd700 1 -- 172.21.15.86:0/1150747662 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494147005 0 0) 0x7f345415dbb0 con 0x7f3454159420 2023-10-09T11:59:05.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.036+0000 7f34537fe700 1 --2- 172.21.15.86:0/1150747662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540b2270 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f34480099b0 tx=0x7f3448009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf1ec063fb8ad6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.036+0000 7f3452ffd700 1 -- 172.21.15.86:0/1150747662 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448009ea0 con 0x7f34541597f0 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.036+0000 7f3452ffd700 1 -- 172.21.15.86:0/1150747662 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344800b860 con 0x7f34541597f0 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.036+0000 7f3452ffd700 1 -- 172.21.15.86:0/1150747662 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800bc00 con 0x7f34541597f0 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 -- 172.21.15.86:0/1150747662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 msgr2=0x7f34540b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 --2- 172.21.15.86:0/1150747662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540b2270 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f34480099b0 tx=0x7f3448009250 comp rx=0 tx=0).stop 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 -- 172.21.15.86:0/1150747662 shutdown_connections 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 --2- 172.21.15.86:0/1150747662 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f345415d230 0x7f345415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 --2- 172.21.15.86:0/1150747662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540b2270 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 -- 172.21.15.86:0/1150747662 >> 172.21.15.86:0/1150747662 conn(0x7f34540d0660 msgr2=0x7f34540d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 -- 172.21.15.86:0/1150747662 shutdown_connections 2023-10-09T11:59:05.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.037+0000 7f345979d700 1 -- 172.21.15.86:0/1150747662 wait complete. 2023-10-09T11:59:05.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.038+0000 7f345979d700 1 Processor -- start 2023-10-09T11:59:05.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.038+0000 7f345979d700 1 -- start start 2023-10-09T11:59:05.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.039+0000 7f345979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3454159420 0x7f34540c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.039+0000 7f345979d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.039+0000 7f345979d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f345415d230 0x7f34540c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.039+0000 7f345979d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34540c86f0 con 0x7f34541597f0 2023-10-09T11:59:05.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.039+0000 7f345979d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34540c7e00 con 0x7f345415d230 2023-10-09T11:59:05.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.039+0000 7f345979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34540c8b80 con 0x7f3454159420 2023-10-09T11:59:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.039+0000 7f34537fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43028/0 (socket says 172.21.15.86:43028) 2023-10-09T11:59:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 -- 172.21.15.86:0/236745682 learned_addr learned my addr 172.21.15.86:0/236745682 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f3458f9c700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f345415d230 0x7f34540c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f3453fff700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3454159420 0x7f34540c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 -- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3454159420 msgr2=0x7f34540c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3454159420 0x7f34540c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 -- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f345415d230 msgr2=0x7f34540c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f345415d230 0x7f34540c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 -- 172.21.15.86:0/236745682 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480094f0 con 0x7f34541597f0 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f3453fff700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3454159420 0x7f34540c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f34537fe700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540c60d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3454089340 tx=0x7f3448017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f343bfff700 1 -- 172.21.15.86:0/236745682 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800bbe0 con 0x7f34541597f0 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f343bfff700 1 -- 172.21.15.86:0/236745682 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448011420 con 0x7f34541597f0 2023-10-09T11:59:05.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f343bfff700 1 -- 172.21.15.86:0/236745682 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34480117e0 con 0x7f34541597f0 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.040+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34540c80a0 con 0x7f34541597f0 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.041+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34540cb960 con 0x7f34541597f0 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.042+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345404c3c0 con 0x7f34541597f0 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.043+0000 7f343bfff700 1 -- 172.21.15.86:0/236745682 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f3448011bd0 con 0x7f34541597f0 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.044+0000 7f343bfff700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 0x7f3440069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.044+0000 7f343bfff700 1 -- 172.21.15.86:0/236745682 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f3448086d20 con 0x7f34541597f0 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.044+0000 7f3453fff700 1 -- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 msgr2=0x7f3440069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:05.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.044+0000 7f3453fff700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 0x7f3440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:05.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.047+0000 7f343bfff700 1 -- 172.21.15.86:0/236745682 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3448053ab0 con 0x7f34541597f0 2023-10-09T11:59:05.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.245+0000 7f3453fff700 1 -- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 msgr2=0x7f3440069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:05.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.245+0000 7f3453fff700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 0x7f3440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:05.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.292+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34540b1a70 con 0x7f34541597f0 2023-10-09T11:59:05.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.292+0000 7f343bfff700 1 -- 172.21.15.86:0/236745682 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f3448015090 con 0x7f34541597f0 2023-10-09T11:59:05.293 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:05.293 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4115138334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4115138334},{"type":"v1","addr":"172.21.15.135:6834","nonce":4115138334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6763,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/34078262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":34078262},{"type":"v1","addr":"172.21.15.135:6835","nonce":34078262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/161428317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":161428317},{"type":"v1","addr":"172.21.15.86:6833","nonce":161428317}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:41.335680+0000","modified":"2023-10-09T11:57:44.882360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3360740992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3360740992},{"type":"v1","addr":"172.21.15.86:6835","nonce":3360740992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:59:05.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 msgr2=0x7f3440069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:05.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 0x7f3440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 msgr2=0x7f34540c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540c60d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3454089340 tx=0x7f3448017000 comp rx=0 tx=0).stop 2023-10-09T11:59:05.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 shutdown_connections 2023-10-09T11:59:05.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f345415d230 0x7f34540c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3454159420 0x7f34540c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3440067170 0x7f3440069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 --2- 172.21.15.86:0/236745682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34541597f0 0x7f34540c60d0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 >> 172.21.15.86:0/236745682 conn(0x7f34540d0660 msgr2=0x7f3454156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:05.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 shutdown_connections 2023-10-09T11:59:05.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.295+0000 7f345979d700 1 -- 172.21.15.86:0/236745682 wait complete. 2023-10-09T11:59:05.298 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 46 2023-10-09T11:59:05.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:59:05.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.500+0000 7f2fbbfff700 1 Processor -- start 2023-10-09T11:59:05.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.500+0000 7f2fbbfff700 1 -- start start 2023-10-09T11:59:05.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2fbc159420 0x7f2fbc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbbfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2fbc1597f0 0x7f2fbc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbbfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0b11d0 con 0x7f2fbc15d230 2023-10-09T11:59:05.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbbfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b14b0 con 0x7f2fbc159420 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbbfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b1790 con 0x7f2fbc1597f0 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2fbc159420 0x7f2fbc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbb7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2fbc15d230 0x7f2fbc15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60518/0 (socket says 172.21.15.86:60518) 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbb7fe700 1 -- 172.21.15.86:0/3846284691 learned_addr learned my addr 172.21.15.86:0/3846284691 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fba7fc700 1 --2- 172.21.15.86:0/3846284691 >> v2:172.21.15.135:3300/0 conn(0x7f2fbc1597f0 0x7f2fbc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fb9ffb700 1 -- 172.21.15.86:0/3846284691 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608578653 0 0) 0x7f2fbc0b11d0 con 0x7f2fbc15d230 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fb9ffb700 1 -- 172.21.15.86:0/3846284691 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa4003570 con 0x7f2fbc15d230 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbaffd700 1 -- 172.21.15.86:0/3846284691 >> v2:172.21.15.135:3300/0 conn(0x7f2fbc1597f0 msgr2=0x7f2fbc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:05.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbaffd700 1 --2- 172.21.15.86:0/3846284691 >> v2:172.21.15.135:3300/0 conn(0x7f2fbc1597f0 0x7f2fbc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbaffd700 1 -- 172.21.15.86:0/3846284691 >> v1:172.21.15.86:6789/0 conn(0x7f2fbc15d230 legacy=0x7f2fbc15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.502+0000 7f2fbaffd700 1 -- 172.21.15.86:0/3846284691 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0b1a70 con 0x7f2fbc159420 2023-10-09T11:59:05.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.503+0000 7f2fbaffd700 1 --2- 172.21.15.86:0/3846284691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc159420 0x7f2fbc0b5f40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc089750 tx=0x7f2fac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef526b62daca7b3d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:05.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.503+0000 7f2fb9ffb700 1 -- 172.21.15.86:0/3846284691 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac011630 con 0x7f2fbc159420 2023-10-09T11:59:05.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.503+0000 7f2fb9ffb700 1 -- 172.21.15.86:0/3846284691 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0117b0 con 0x7f2fbc159420 2023-10-09T11:59:05.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.503+0000 7f2fb9ffb700 1 -- 172.21.15.86:0/3846284691 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac011b70 con 0x7f2fbc159420 2023-10-09T11:59:05.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 -- 172.21.15.86:0/3846284691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc159420 msgr2=0x7f2fbc0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/3846284691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc159420 0x7f2fbc0b5f40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc089750 tx=0x7f2fac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 -- 172.21.15.86:0/3846284691 shutdown_connections 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/3846284691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc159420 0x7f2fbc0b5f40 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/3846284691 >> v2:172.21.15.135:3300/0 conn(0x7f2fbc1597f0 0x7f2fbc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 -- 172.21.15.86:0/3846284691 >> 172.21.15.86:0/3846284691 conn(0x7f2fbc0d0660 msgr2=0x7f2fbc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 -- 172.21.15.86:0/3846284691 shutdown_connections 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.504+0000 7f2fbbfff700 1 -- 172.21.15.86:0/3846284691 wait complete. 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.505+0000 7f2fbbfff700 1 Processor -- start 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.505+0000 7f2fbbfff700 1 -- start start 2023-10-09T11:59:05.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.506+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fbc159420 0x7f2fbc1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.506+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2fbc1597f0 0x7f2fbc0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.506+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc15d230 0x7f2fbc0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.506+0000 7f2fbbfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c7220 con 0x7f2fbc15d230 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.506+0000 7f2fbbfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc169600 con 0x7f2fbc159420 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.506+0000 7f2fbbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b54f0 con 0x7f2fbc1597f0 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fbc159420 0x7f2fbc1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc15d230 0x7f2fbc0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fbc159420 0x7f2fbc1552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:56962/0 (socket says 172.21.15.86:56962) 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fba7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2fbc1597f0 0x7f2fbc0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 -- 172.21.15.86:0/1997294775 learned_addr learned my addr 172.21.15.86:0/1997294775 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:05.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 -- 172.21.15.86:0/1997294775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2fbc1597f0 msgr2=0x7f2fbc0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2fbc1597f0 0x7f2fbc0c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 -- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc15d230 msgr2=0x7f2fbc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc15d230 0x7f2fbc0c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 -- 172.21.15.86:0/1997294775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac009420 con 0x7f2fbc159420 2023-10-09T11:59:05.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbb7fe700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc15d230 0x7f2fbc0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:05.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.507+0000 7f2fbaffd700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fbc159420 0x7f2fbc1552d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc089340 tx=0x7f2fac017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:05.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.508+0000 7f2fa2ffd700 1 -- 172.21.15.86:0/1997294775 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac01f070 con 0x7f2fbc159420 2023-10-09T11:59:05.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.508+0000 7f2fa2ffd700 1 -- 172.21.15.86:0/1997294775 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac011920 con 0x7f2fbc159420 2023-10-09T11:59:05.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.508+0000 7f2fa2ffd700 1 -- 172.21.15.86:0/1997294775 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac023410 con 0x7f2fbc159420 2023-10-09T11:59:05.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.508+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0c6980 con 0x7f2fbc159420 2023-10-09T11:59:05.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.508+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0c6f40 con 0x7f2fbc159420 2023-10-09T11:59:05.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.509+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc04c3c0 con 0x7f2fbc159420 2023-10-09T11:59:05.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.510+0000 7f2fa2ffd700 1 -- 172.21.15.86:0/1997294775 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2fac02c440 con 0x7f2fbc159420 2023-10-09T11:59:05.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.511+0000 7f2fa2ffd700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 0x7f2fa8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.512+0000 7f2fa2ffd700 1 -- 172.21.15.86:0/1997294775 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f2fac085d40 con 0x7f2fbc159420 2023-10-09T11:59:05.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.512+0000 7f2fba7fc700 1 -- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 msgr2=0x7f2fa8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:05.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.512+0000 7f2fba7fc700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 0x7f2fa8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:05.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.516+0000 7f2fa2ffd700 1 -- 172.21.15.86:0/1997294775 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fac052a90 con 0x7f2fbc159420 2023-10-09T11:59:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.713+0000 7f2fba7fc700 1 -- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 msgr2=0x7f2fa8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.713+0000 7f2fba7fc700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 0x7f2fa8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:05.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.717+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fbc0b1d50 con 0x7f2fbc159420 2023-10-09T11:59:05.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.718+0000 7f2fa2ffd700 1 -- 172.21.15.86:0/1997294775 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16396 (secure 0 0 0) 0x7f2fac0560b0 con 0x7f2fbc159420 2023-10-09T11:59:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:05.720 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":111,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:02.470198+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:57:39.443249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:40.316252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:58:01.374359+0000","172.21.15.86:6836/85490":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/716407408":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/901115197":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/2478132006":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/519798548":"2023-10-10T11:58:01.374359+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:59:05.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.720+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 msgr2=0x7f2fa8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:05.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.720+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 0x7f2fa8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.720+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fbc159420 msgr2=0x7f2fbc1552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.720+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fbc159420 0x7f2fbc1552d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc089340 tx=0x7f2fac017000 comp rx=0 tx=0).stop 2023-10-09T11:59:05.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 shutdown_connections 2023-10-09T11:59:05.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2fa8067170 0x7f2fa8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fbc15d230 0x7f2fbc0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fbc159420 0x7f2fbc1552d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 --2- 172.21.15.86:0/1997294775 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2fbc1597f0 0x7f2fbc0c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 >> 172.21.15.86:0/1997294775 conn(0x7f2fbc0d0660 msgr2=0x7f2fbc068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:05.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 shutdown_connections 2023-10-09T11:59:05.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.721+0000 7f2fbbfff700 1 -- 172.21.15.86:0/1997294775 wait complete. 2023-10-09T11:59:05.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:57:39.443249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:57:40.316252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:59:05.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:59:05.765 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:05.765+0000 7fea6f2a3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:59:05.831 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:05.830+0000 7f3f5164d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:59:05.927 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:05.926+0000 7fea6f2a3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:05.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.929+0000 7fb7a3fff700 1 Processor -- start 2023-10-09T11:59:05.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.930+0000 7fb7a3fff700 1 -- start start 2023-10-09T11:59:05.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.931+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a406e470 0x7fb7a406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.931+0000 7fb7a3fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a40aea70 con 0x7fb7a415a3b0 2023-10-09T11:59:05.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.931+0000 7fb7a3fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a415dad0 con 0x7fb7a40aef00 2023-10-09T11:59:05.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.931+0000 7fb7a3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a406ee30 con 0x7fb7a406e470 2023-10-09T11:59:05.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.931+0000 7fb7a2ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb7a415a3b0 0x7fb7a415a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60520/0 (socket says 172.21.15.86:60520) 2023-10-09T11:59:05.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.931+0000 7fb7a2ffd700 1 -- 172.21.15.86:0/4228562557 learned_addr learned my addr 172.21.15.86:0/4228562557 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:05.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.931+0000 7fb7a37fe700 1 --2- 172.21.15.86:0/4228562557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a406e470 0x7fb7a406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a1ffb700 1 -- 172.21.15.86:0/4228562557 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680049000 0 0) 0x7fb7a40aea70 con 0x7fb7a415a3b0 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a1ffb700 1 -- 172.21.15.86:0/4228562557 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb78c003570 con 0x7fb7a415a3b0 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a1ffb700 1 -- 172.21.15.86:0/4228562557 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98610041 0 0) 0x7fb7a415dad0 con 0x7fb7a40aef00 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a1ffb700 1 -- 172.21.15.86:0/4228562557 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7a40aea70 con 0x7fb7a40aef00 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a37fe700 1 -- 172.21.15.86:0/4228562557 >> v1:172.21.15.135:6789/0 conn(0x7fb7a40aef00 legacy=0x7fb7a415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a37fe700 1 -- 172.21.15.86:0/4228562557 >> v1:172.21.15.86:6789/0 conn(0x7fb7a415a3b0 legacy=0x7fb7a415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a37fe700 1 -- 172.21.15.86:0/4228562557 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a40ae480 con 0x7fb7a406e470 2023-10-09T11:59:05.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a37fe700 1 --2- 172.21.15.86:0/4228562557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a406e470 0x7fb7a406e8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7a415dc60 tx=0x7fb79c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a6be6415a08cc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a1ffb700 1 -- 172.21.15.86:0/4228562557 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c016070 con 0x7fb7a406e470 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a1ffb700 1 -- 172.21.15.86:0/4228562557 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c00bab0 con 0x7fb7a406e470 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.932+0000 7fb7a1ffb700 1 -- 172.21.15.86:0/4228562557 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c00e070 con 0x7fb7a406e470 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.933+0000 7fb7a3fff700 1 -- 172.21.15.86:0/4228562557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a406e470 msgr2=0x7fb7a406e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.933+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/4228562557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a406e470 0x7fb7a406e8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7a415dc60 tx=0x7fb79c009780 comp rx=0 tx=0).stop 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.933+0000 7fb7a3fff700 1 -- 172.21.15.86:0/4228562557 shutdown_connections 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.933+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/4228562557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a406e470 0x7fb7a406e8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.933+0000 7fb7a3fff700 1 -- 172.21.15.86:0/4228562557 >> 172.21.15.86:0/4228562557 conn(0x7fb7a40c9f70 msgr2=0x7fb7a406dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.933+0000 7fb7a3fff700 1 -- 172.21.15.86:0/4228562557 shutdown_connections 2023-10-09T11:59:05.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.933+0000 7fb7a3fff700 1 -- 172.21.15.86:0/4228562557 wait complete. 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.935+0000 7fb7a3fff700 1 Processor -- start 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.935+0000 7fb7a3fff700 1 -- start start 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7a406e470 0x7fb7a416d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7a40aef00 0x7fb7a4154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a415a3b0 0x7fb7a40c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a3fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a416d790 con 0x7fb7a40aef00 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a416da70 con 0x7fb7a406e470 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a416dd50 con 0x7fb7a415a3b0 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7a40aef00 0x7fb7a4154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7a406e470 0x7fb7a416d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7a40aef00 0x7fb7a4154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43064/0 (socket says 172.21.15.86:43064) 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a37fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a415a3b0 0x7fb7a40c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 -- 172.21.15.86:0/2751822628 learned_addr learned my addr 172.21.15.86:0/2751822628 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 -- 172.21.15.86:0/2751822628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a415a3b0 msgr2=0x7fb7a40c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a415a3b0 0x7fb7a40c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 -- 172.21.15.86:0/2751822628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7a406e470 msgr2=0x7fb7a416d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7a406e470 0x7fb7a416d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a27fc700 1 -- 172.21.15.86:0/2751822628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c009a20 con 0x7fb7a40aef00 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.936+0000 7fb7a2ffd700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7a406e470 0x7fb7a416d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.937+0000 7fb7a27fc700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7a40aef00 0x7fb7a4154610 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c790 tx=0x7fb798007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:05.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.937+0000 7fb78affd700 1 -- 172.21.15.86:0/2751822628 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798010510 con 0x7fb7a40aef00 2023-10-09T11:59:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.937+0000 7fb78affd700 1 -- 172.21.15.86:0/2751822628 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb798010670 con 0x7fb7a40aef00 2023-10-09T11:59:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.937+0000 7fb78affd700 1 -- 172.21.15.86:0/2751822628 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798010a10 con 0x7fb7a40aef00 2023-10-09T11:59:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.937+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a40af980 con 0x7fb7a40aef00 2023-10-09T11:59:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.937+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a40c6580 con 0x7fb7a40aef00 2023-10-09T11:59:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.938+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a406cfa0 con 0x7fb7a40aef00 2023-10-09T11:59:05.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.940+0000 7fb78affd700 1 -- 172.21.15.86:0/2751822628 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fb79801b3b0 con 0x7fb7a40aef00 2023-10-09T11:59:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.941+0000 7fb78affd700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 0x7fb790069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.941+0000 7fb7a2ffd700 1 -- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 msgr2=0x7fb790069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.941+0000 7fb78affd700 1 -- 172.21.15.86:0/2751822628 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7fb7980843c0 con 0x7fb7a40aef00 2023-10-09T11:59:05.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.942+0000 7fb7a2ffd700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 0x7fb790069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:05.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:05.946+0000 7fb78affd700 1 -- 172.21.15.86:0/2751822628 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb798051110 con 0x7fb7a40aef00 2023-10-09T11:59:06.005 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:06.004+0000 7f3f5164d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:06.014 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:06.013+0000 7fea6f2a3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:59:06.093 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:06.092+0000 7f3f5164d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:59:06.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.143+0000 7fb7a2ffd700 1 -- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 msgr2=0x7fb790069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:06.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.143+0000 7fb7a2ffd700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 0x7fb790069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:06.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.144+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7a415dd30 con 0x7fb7a40aef00 2023-10-09T11:59:06.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.144+0000 7fb78affd700 1 -- 172.21.15.86:0/2751822628 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb798017020 con 0x7fb7a40aef00 2023-10-09T11:59:06.145 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:59:06.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 msgr2=0x7fb790069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:06.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 0x7fb790069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7a40aef00 msgr2=0x7fb7a4154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7a40aef00 0x7fb7a4154610 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c790 tx=0x7fb798007e10 comp rx=0 tx=0).stop 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 shutdown_connections 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7a415a3b0 0x7fb7a40c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7a406e470 0x7fb7a416d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb790067170 0x7fb790069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 --2- 172.21.15.86:0/2751822628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7a40aef00 0x7fb7a4154610 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 >> 172.21.15.86:0/2751822628 conn(0x7fb7a40c9f70 msgr2=0x7fb7a415b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 shutdown_connections 2023-10-09T11:59:06.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.147+0000 7fb7a3fff700 1 -- 172.21.15.86:0/2751822628 wait complete. 2023-10-09T11:59:06.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:59:06.236 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:06.236+0000 7fea6f2a3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:06.327 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:06.326+0000 7f3f5164d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:06.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.355+0000 7fbf7b59e700 1 Processor -- start 2023-10-09T11:59:06.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.355+0000 7fbf7b59e700 1 -- start start 2023-10-09T11:59:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cc600 0x7fbf7c0b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf7c0cc9d0 0x7fbf7c15d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7b59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c150b50 con 0x7fbf7c0cd0f0 2023-10-09T11:59:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c0cede0 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0b2260 con 0x7fbf7c0cc600 2023-10-09T11:59:06.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7ad9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbf7c0cd0f0 0x7fbf7c159c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60536/0 (socket says 172.21.15.86:60536) 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7ad9d700 1 -- 172.21.15.86:0/1965574857 learned_addr learned my addr 172.21.15.86:0/1965574857 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf79d9b700 1 --2- 172.21.15.86:0/1965574857 >> v2:172.21.15.135:3300/0 conn(0x7fbf7c0cc9d0 0x7fbf7c15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7a59c700 1 --2- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cc600 0x7fbf7c0b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.357+0000 7fbf7959a700 1 -- 172.21.15.86:0/1965574857 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964542896 0 0) 0x7fbf7c150b50 con 0x7fbf7c0cd0f0 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf7959a700 1 -- 172.21.15.86:0/1965574857 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf64003570 con 0x7fbf7c0cd0f0 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf79d9b700 1 -- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cc600 msgr2=0x7fbf7c0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf79d9b700 1 --2- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cc600 0x7fbf7c0b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf79d9b700 1 -- 172.21.15.86:0/1965574857 >> v1:172.21.15.86:6789/0 conn(0x7fbf7c0cd0f0 legacy=0x7fbf7c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf79d9b700 1 -- 172.21.15.86:0/1965574857 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c0b2540 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf7a59c700 1 --2- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cc600 0x7fbf7c0b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:06.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf79d9b700 1 --2- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c15d280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbf700098e0 tx=0x7fbf700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c05b843e6f3643c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:06.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf7959a700 1 -- 172.21.15.86:0/1965574857 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70011630 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf7959a700 1 -- 172.21.15.86:0/1965574857 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf70011790 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.358+0000 7fbf7959a700 1 -- 172.21.15.86:0/1965574857 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70011b30 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc9d0 msgr2=0x7fbf7c15d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c15d280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbf700098e0 tx=0x7fbf700091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1965574857 shutdown_connections 2023-10-09T11:59:06.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cc600 0x7fbf7c0b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1965574857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c15d280 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1965574857 >> 172.21.15.86:0/1965574857 conn(0x7fbf7c0d0630 msgr2=0x7fbf7c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:06.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1965574857 shutdown_connections 2023-10-09T11:59:06.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.359+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1965574857 wait complete. 2023-10-09T11:59:06.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.361+0000 7fbf7b59e700 1 Processor -- start 2023-10-09T11:59:06.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.361+0000 7fbf7b59e700 1 -- start start 2023-10-09T11:59:06.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc600 0x7fbf7c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cd0f0 0x7fbf7c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c146980 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c153170 con 0x7fbf7c0cc600 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0b3de0 con 0x7fbf7c0cd0f0 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c14d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43072/0 (socket says 172.21.15.86:43072) 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 -- 172.21.15.86:0/1740069110 learned_addr learned my addr 172.21.15.86:0/1740069110 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7a59c700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc600 0x7fbf7c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7ad9d700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cd0f0 0x7fbf7c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 -- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cd0f0 msgr2=0x7fbf7c0b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cd0f0 0x7fbf7c0b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 -- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc600 msgr2=0x7fbf7c150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc600 0x7fbf7c150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf79d9b700 1 -- 172.21.15.86:0/1740069110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c009420 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.362+0000 7fbf7a59c700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc600 0x7fbf7c150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.363+0000 7fbf79d9b700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c14d9b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c071390 tx=0x7fbf70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.363+0000 7fbf6a7fc700 1 -- 172.21.15.86:0/1740069110 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70011b10 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.363+0000 7fbf6a7fc700 1 -- 172.21.15.86:0/1740069110 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf700253f0 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.363+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf70009420 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.363+0000 7fbf6a7fc700 1 -- 172.21.15.86:0/1740069110 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70025790 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.363+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c0b4960 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.364+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c0b4af0 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.365+0000 7fbf6a7fc700 1 -- 172.21.15.86:0/1740069110 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fbf70025b80 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.366+0000 7fbf6a7fc700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 0x7fbf5c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.366+0000 7fbf6a7fc700 1 -- 172.21.15.86:0/1740069110 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7fbf700863f0 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.366+0000 7fbf7a59c700 1 -- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 msgr2=0x7fbf5c0696a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:06.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.366+0000 7fbf7a59c700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 0x7fbf5c0696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:06.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.370+0000 7fbf6a7fc700 1 -- 172.21.15.86:0/1740069110 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf700530c0 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.413 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:06.413+0000 7fea6f2a3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:59:06.506 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:06.506+0000 7fea6f2a3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:59:06.512 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:06.511+0000 7f3f5164d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:59:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.567+0000 7fbf7a59c700 1 -- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 msgr2=0x7fbf5c0696a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:06.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.567+0000 7fbf7a59c700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 0x7fbf5c0696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:06.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.569+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf7c088a70 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.570+0000 7fbf6a7fc700 1 -- 172.21.15.86:0/1740069110 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf7c088a70 con 0x7fbf7c0cc9d0 2023-10-09T11:59:06.571 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T11:59:06.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 msgr2=0x7fbf5c0696a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:06.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 0x7fbf5c0696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf7c0cc9d0 msgr2=0x7fbf7c14d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c14d9b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c071390 tx=0x7fbf70017000 comp rx=0 tx=0).stop 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 shutdown_connections 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf7c0cd0f0 0x7fbf7c0b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf7c0cc600 0x7fbf7c150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbf5c0671f0 0x7fbf5c0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 --2- 172.21.15.86:0/1740069110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf7c0cc9d0 0x7fbf7c14d9b0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.572+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 >> 172.21.15.86:0/1740069110 conn(0x7fbf7c0d0630 msgr2=0x7fbf7c15ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.573+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 shutdown_connections 2023-10-09T11:59:06.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.573+0000 7fbf7b59e700 1 -- 172.21.15.86:0/1740069110 wait complete. 2023-10-09T11:59:06.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:59:06.610 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:06.609+0000 7f3f5164d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:59:06.667 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:06.667+0000 7fea6f2a3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:59:06.767 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:06.766+0000 7fea6f2a3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:06.778 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:06.777+0000 7f3f5164d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:59:06.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.784+0000 7f2da2f9d700 1 Processor -- start 2023-10-09T11:59:06.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.784+0000 7f2da2f9d700 1 -- start start 2023-10-09T11:59:06.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da2f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d9c0b4e70 0x7f2d9c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da2f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2d9c0b16d0 0x7f2d9c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da2f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c0b2080 con 0x7f2d9c15d240 2023-10-09T11:59:06.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da2f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c0cfb00 con 0x7f2d9c0b16d0 2023-10-09T11:59:06.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da2f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c0b5c40 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da179a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2d9c0b16d0 0x7f2d9c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da279c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2d9c15d240 0x7f2d9c15d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60544/0 (socket says 172.21.15.86:60544) 2023-10-09T11:59:06.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da279c700 1 -- 172.21.15.86:0/2637233121 learned_addr learned my addr 172.21.15.86:0/2637233121 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:06.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.786+0000 7f2da1f9b700 1 --2- 172.21.15.86:0/2637233121 >> v2:172.21.15.135:3300/0 conn(0x7f2d9c0b4e70 0x7f2d9c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da179a700 1 -- 172.21.15.86:0/2637233121 >> v2:172.21.15.135:3300/0 conn(0x7f2d9c0b4e70 msgr2=0x7f2d9c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:06.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da179a700 1 --2- 172.21.15.86:0/2637233121 >> v2:172.21.15.135:3300/0 conn(0x7f2d9c0b4e70 0x7f2d9c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da179a700 1 -- 172.21.15.86:0/2637233121 >> v1:172.21.15.86:6789/0 conn(0x7f2d9c15d240 legacy=0x7f2d9c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da0f99700 1 -- 172.21.15.86:0/2637233121 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916853864 0 0) 0x7f2d9c0b2080 con 0x7f2d9c15d240 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da179a700 1 -- 172.21.15.86:0/2637233121 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c0b5f20 con 0x7f2d9c0b16d0 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da179a700 1 --2- 172.21.15.86:0/2637233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b16d0 0x7f2d9c0b1b40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c064910 tx=0x7f2d8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0e6273cc8ca1ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da0f99700 1 -- 172.21.15.86:0/2637233121 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011630 con 0x7f2d9c0b16d0 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da0f99700 1 -- 172.21.15.86:0/2637233121 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c011790 con 0x7f2d9c0b16d0 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.787+0000 7f2da0f99700 1 -- 172.21.15.86:0/2637233121 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011b30 con 0x7f2d9c0b16d0 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 -- 172.21.15.86:0/2637233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b16d0 msgr2=0x7f2d9c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/2637233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b16d0 0x7f2d9c0b1b40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c064910 tx=0x7f2d8c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 -- 172.21.15.86:0/2637233121 shutdown_connections 2023-10-09T11:59:06.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/2637233121 >> v2:172.21.15.135:3300/0 conn(0x7f2d9c0b4e70 0x7f2d9c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/2637233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b16d0 0x7f2d9c0b1b40 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 -- 172.21.15.86:0/2637233121 >> 172.21.15.86:0/2637233121 conn(0x7f2d9c0d10c0 msgr2=0x7f2d9c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:06.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 -- 172.21.15.86:0/2637233121 shutdown_connections 2023-10-09T11:59:06.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.788+0000 7f2da2f9d700 1 -- 172.21.15.86:0/2637233121 wait complete. 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.789+0000 7f2da2f9d700 1 Processor -- start 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.789+0000 7f2da2f9d700 1 -- start start 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da2f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c0b16d0 0x7f2d9c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da2f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b4e70 0x7f2d9c169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da2f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c15d240 0x7f2d9c15e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da2f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c16ac80 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da2f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c16d750 con 0x7f2d9c15d240 2023-10-09T11:59:06.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da2f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c16a6c0 con 0x7f2d9c0b16d0 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da179a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b4e70 0x7f2d9c169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da179a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b4e70 0x7f2d9c169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43088/0 (socket says 172.21.15.86:43088) 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.790+0000 7f2da179a700 1 -- 172.21.15.86:0/3404636482 learned_addr learned my addr 172.21.15.86:0/3404636482 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da1f9b700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c0b16d0 0x7f2d9c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da279c700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c15d240 0x7f2d9c15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da179a700 1 -- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c0b16d0 msgr2=0x7f2d9c0c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da179a700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c0b16d0 0x7f2d9c0c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da179a700 1 -- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c15d240 msgr2=0x7f2d9c15e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da179a700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c15d240 0x7f2d9c15e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da179a700 1 -- 172.21.15.86:0/3404636482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c009420 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2da179a700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b4e70 0x7f2d9c169ca0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c070dd0 tx=0x7f2d8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:06.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.791+0000 7f2d91ffb700 1 -- 172.21.15.86:0/3404636482 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c000d10 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.792+0000 7f2d91ffb700 1 -- 172.21.15.86:0/3404636482 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c011b10 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.792+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c16a9a0 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.792+0000 7f2d91ffb700 1 -- 172.21.15.86:0/3404636482 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c025640 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.792+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0c86f0 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.793+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c16d240 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.793+0000 7f2d91ffb700 1 -- 172.21.15.86:0/3404636482 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2d8c025a30 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.795+0000 7f2d91ffb700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 0x7f2d80069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.795+0000 7f2da1f9b700 1 -- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 msgr2=0x7f2d80069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.795+0000 7f2d91ffb700 1 -- 172.21.15.86:0/3404636482 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f2d8c086350 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.795+0000 7f2da1f9b700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 0x7f2d80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:06.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.798+0000 7f2d91ffb700 1 -- 172.21.15.86:0/3404636482 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d9c16d240 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.885 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:06.884+0000 7f3f5164d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:06.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.996+0000 7f2da1f9b700 1 -- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 msgr2=0x7f2d80069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:06.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.996+0000 7f2da1f9b700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 0x7f2d80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:06.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.997+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d9c16d240 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:06.997+0000 7f2d91ffb700 1 -- 172.21.15.86:0/3404636482 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d9c16d240 con 0x7f2d9c0b4e70 2023-10-09T11:59:06.999 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T11:59:07.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 msgr2=0x7f2d80069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:07.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 0x7f2d80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b4e70 msgr2=0x7f2d9c169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b4e70 0x7f2d9c169ca0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c070dd0 tx=0x7f2d8c017000 comp rx=0 tx=0).stop 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 shutdown_connections 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d9c15d240 0x7f2d9c15e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d9c0b16d0 0x7f2d9c0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2d80067170 0x7f2d80069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 --2- 172.21.15.86:0/3404636482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d9c0b4e70 0x7f2d9c169ca0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 >> 172.21.15.86:0/3404636482 conn(0x7f2d9c0d10c0 msgr2=0x7f2d9c0b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 shutdown_connections 2023-10-09T11:59:07.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.000+0000 7f2da2f9d700 1 -- 172.21.15.86:0/3404636482 wait complete. 2023-10-09T11:59:07.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:59:07.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.245+0000 7f441519d700 1 Processor -- start 2023-10-09T11:59:07.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.245+0000 7f441519d700 1 -- start start 2023-10-09T11:59:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.246+0000 7f441519d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f44101595a0 0x7f44100b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.246+0000 7f441519d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44100b1410 con 0x7f44100c6c60 2023-10-09T11:59:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.246+0000 7f441519d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4410063230 con 0x7f44100c8830 2023-10-09T11:59:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.246+0000 7f441519d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44100b2b90 con 0x7f44101595a0 2023-10-09T11:59:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f44100c6c60 0x7f44100c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60560/0 (socket says 172.21.15.86:60560) 2023-10-09T11:59:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440f7fe700 1 -- 172.21.15.86:0/1977670222 learned_addr learned my addr 172.21.15.86:0/1977670222 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:07.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440ffff700 1 --2- 172.21.15.86:0/1977670222 >> v2:172.21.15.135:3300/0 conn(0x7f44101595a0 0x7f44100b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.249 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:07.248+0000 7fea6f2a3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:59:07.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440effd700 1 -- 172.21.15.86:0/1977670222 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037122251 0 0) 0x7f44100b1410 con 0x7f44100c6c60 2023-10-09T11:59:07.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440effd700 1 -- 172.21.15.86:0/1977670222 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f8003570 con 0x7f44100c6c60 2023-10-09T11:59:07.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440ffff700 1 -- 172.21.15.86:0/1977670222 >> v1:172.21.15.135:6789/0 conn(0x7f44100c8830 legacy=0x7f4410159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440ffff700 1 -- 172.21.15.86:0/1977670222 >> v1:172.21.15.86:6789/0 conn(0x7f44100c6c60 legacy=0x7f44100c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.247+0000 7f440ffff700 1 -- 172.21.15.86:0/1977670222 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100634f0 con 0x7f44101595a0 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.248+0000 7f440ffff700 1 --2- 172.21.15.86:0/1977670222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44101595a0 0x7f44100b18a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f44000098e0 tx=0x7f44000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed52cc5af88568e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.248+0000 7f440effd700 1 -- 172.21.15.86:0/1977670222 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000b640 con 0x7f44101595a0 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.248+0000 7f440effd700 1 -- 172.21.15.86:0/1977670222 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000b7a0 con 0x7f44101595a0 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.248+0000 7f440effd700 1 -- 172.21.15.86:0/1977670222 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000bb40 con 0x7f44101595a0 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.248+0000 7f441519d700 1 -- 172.21.15.86:0/1977670222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44101595a0 msgr2=0x7f44100b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.248+0000 7f441519d700 1 --2- 172.21.15.86:0/1977670222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44101595a0 0x7f44100b18a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f44000098e0 tx=0x7f44000091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.249+0000 7f441519d700 1 -- 172.21.15.86:0/1977670222 shutdown_connections 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.249+0000 7f441519d700 1 --2- 172.21.15.86:0/1977670222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44101595a0 0x7f44100b18a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.249+0000 7f441519d700 1 -- 172.21.15.86:0/1977670222 >> 172.21.15.86:0/1977670222 conn(0x7f441006ddb0 msgr2=0x7f441006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:07.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.249+0000 7f441519d700 1 -- 172.21.15.86:0/1977670222 shutdown_connections 2023-10-09T11:59:07.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.249+0000 7f441519d700 1 -- 172.21.15.86:0/1977670222 wait complete. 2023-10-09T11:59:07.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.250+0000 7f441519d700 1 Processor -- start 2023-10-09T11:59:07.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.250+0000 7f441519d700 1 -- start start 2023-10-09T11:59:07.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f441519d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44100c6c60 0x7f441015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f441519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44100c8830 0x7f4410144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f441519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44101595a0 0x7f44100c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f441519d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441015cb90 con 0x7f44100c6c60 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f441519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441015bcb0 con 0x7f44100c8830 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f441519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441015bf80 con 0x7f44101595a0 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f440ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44100c6c60 0x7f441015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f440ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44100c6c60 0x7f441015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43092/0 (socket says 172.21.15.86:43092) 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f440ffff700 1 -- 172.21.15.86:0/2738713538 learned_addr learned my addr 172.21.15.86:0/2738713538 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f441499c700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44101595a0 0x7f44100c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.251+0000 7f440f7fe700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44100c8830 0x7f4410144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f440ffff700 1 -- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44101595a0 msgr2=0x7f44100c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f440ffff700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44101595a0 0x7f44100c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f440ffff700 1 -- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44100c8830 msgr2=0x7f4410144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f440ffff700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44100c8830 0x7f4410144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f440ffff700 1 -- 172.21.15.86:0/2738713538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400009420 con 0x7f44100c6c60 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f440f7fe700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44100c8830 0x7f4410144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f440ffff700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44100c6c60 0x7f441015b770 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f4410064340 tx=0x7f4400017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f43f7fff700 1 -- 172.21.15.86:0/2738713538 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400000d10 con 0x7f44100c6c60 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f43f7fff700 1 -- 172.21.15.86:0/2738713538 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000bb20 con 0x7f44100c6c60 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f43f7fff700 1 -- 172.21.15.86:0/2738713538 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400011650 con 0x7f44100c6c60 2023-10-09T11:59:07.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f441519d700 1 -- 172.21.15.86:0/2738713538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441015c260 con 0x7f44100c6c60 2023-10-09T11:59:07.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.252+0000 7f441519d700 1 -- 172.21.15.86:0/2738713538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441015c820 con 0x7f44100c6c60 2023-10-09T11:59:07.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.254+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e80052b0 con 0x7f44100c6c60 2023-10-09T11:59:07.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.255+0000 7f43f7fff700 1 -- 172.21.15.86:0/2738713538 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f4400011a00 con 0x7f44100c6c60 2023-10-09T11:59:07.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.256+0000 7f43f7fff700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 0x7f43fc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.256+0000 7f43f7fff700 1 -- 172.21.15.86:0/2738713538 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f44000860f0 con 0x7f44100c6c60 2023-10-09T11:59:07.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.256+0000 7f440f7fe700 1 -- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 msgr2=0x7f43fc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:07.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.256+0000 7f440f7fe700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 0x7f43fc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:07.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.260+0000 7f43f7fff700 1 -- 172.21.15.86:0/2738713538 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4400052f70 con 0x7f44100c6c60 2023-10-09T11:59:07.343 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:07.343+0000 7fea6f2a3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:59:07.387 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:07.387+0000 7f3f5164d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:59:07.432 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:07.432+0000 7fea6f2a3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:59:07.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.457+0000 7f440f7fe700 1 -- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 msgr2=0x7f43fc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:07.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.457+0000 7f440f7fe700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 0x7f43fc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:07.485 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:07.484+0000 7f3f5164d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:59:07.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.504+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43e8005560 con 0x7f44100c6c60 2023-10-09T11:59:07.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.505+0000 7f43f7fff700 1 -- 172.21.15.86:0/2738713538 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f4400056590 con 0x7f44100c6c60 2023-10-09T11:59:07.506 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:07.506 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4115138334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4115138334},{"type":"v1","addr":"172.21.15.135:6834","nonce":4115138334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6763,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/34078262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":34078262},{"type":"v1","addr":"172.21.15.135:6835","nonce":34078262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/161428317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":161428317},{"type":"v1","addr":"172.21.15.86:6833","nonce":161428317}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:41.335680+0000","modified":"2023-10-09T11:57:44.882360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3360740992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3360740992},{"type":"v1","addr":"172.21.15.86:6835","nonce":3360740992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:59:07.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 msgr2=0x7f43fc069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:07.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 0x7f43fc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44100c6c60 msgr2=0x7f441015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44100c6c60 0x7f441015b770 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f4410064340 tx=0x7f4400017000 comp rx=0 tx=0).stop 2023-10-09T11:59:07.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 shutdown_connections 2023-10-09T11:59:07.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43fc067170 0x7f43fc069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44100c6c60 0x7f441015b770 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44101595a0 0x7f44100c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 --2- 172.21.15.86:0/2738713538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44100c8830 0x7f4410144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 >> 172.21.15.86:0/2738713538 conn(0x7f441006ddb0 msgr2=0x7f44100c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:07.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 shutdown_connections 2023-10-09T11:59:07.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.507+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2738713538 wait complete. 2023-10-09T11:59:07.510 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 46 2023-10-09T11:59:07.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:59:07.581 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:07.580+0000 7f3f5164d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:59:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.711+0000 7f735919d700 1 Processor -- start 2023-10-09T11:59:07.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.711+0000 7f735919d700 1 -- start start 2023-10-09T11:59:07.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.712+0000 7f735919d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7354159420 0x7f73540b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f735919d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540b2980 con 0x7f73541597f0 2023-10-09T11:59:07.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f735919d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540b11d0 con 0x7f735415d230 2023-10-09T11:59:07.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f735919d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540b14b0 con 0x7f7354159420 2023-10-09T11:59:07.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f73537fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f73541597f0 0x7f73540b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60562/0 (socket says 172.21.15.86:60562) 2023-10-09T11:59:07.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f73537fe700 1 -- 172.21.15.86:0/1350185120 learned_addr learned my addr 172.21.15.86:0/1350185120 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:07.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f7353fff700 1 --2- 172.21.15.86:0/1350185120 >> v2:172.21.15.135:3300/0 conn(0x7f7354159420 0x7f73540b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f7352ffd700 1 -- 172.21.15.86:0/1350185120 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221291129 0 0) 0x7f73540b2980 con 0x7f73541597f0 2023-10-09T11:59:07.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f7352ffd700 1 -- 172.21.15.86:0/1350185120 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f733c003570 con 0x7f73541597f0 2023-10-09T11:59:07.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.713+0000 7f7353fff700 1 -- 172.21.15.86:0/1350185120 >> v1:172.21.15.135:6789/0 conn(0x7f735415d230 legacy=0x7f735415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.714+0000 7f7353fff700 1 -- 172.21.15.86:0/1350185120 >> v1:172.21.15.86:6789/0 conn(0x7f73541597f0 legacy=0x7f73540b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.714+0000 7f7353fff700 1 -- 172.21.15.86:0/1350185120 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540b1790 con 0x7f7354159420 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.714+0000 7f7353fff700 1 --2- 172.21.15.86:0/1350185120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7354159420 0x7f73540b5f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f73440098e0 tx=0x7f73440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0830d5cf5bbeaaa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.714+0000 7f7352ffd700 1 -- 172.21.15.86:0/1350185120 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400b640 con 0x7f7354159420 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.714+0000 7f7352ffd700 1 -- 172.21.15.86:0/1350185120 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734400b7a0 con 0x7f7354159420 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.714+0000 7f7352ffd700 1 -- 172.21.15.86:0/1350185120 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400bb40 con 0x7f7354159420 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.715+0000 7f735919d700 1 -- 172.21.15.86:0/1350185120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7354159420 msgr2=0x7f73540b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.715+0000 7f735919d700 1 --2- 172.21.15.86:0/1350185120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7354159420 0x7f73540b5f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f73440098e0 tx=0x7f73440091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.715+0000 7f735919d700 1 -- 172.21.15.86:0/1350185120 shutdown_connections 2023-10-09T11:59:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.715+0000 7f735919d700 1 --2- 172.21.15.86:0/1350185120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7354159420 0x7f73540b5f40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.715+0000 7f735919d700 1 -- 172.21.15.86:0/1350185120 >> 172.21.15.86:0/1350185120 conn(0x7f73540d0660 msgr2=0x7f73540d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:07.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.715+0000 7f735919d700 1 -- 172.21.15.86:0/1350185120 shutdown_connections 2023-10-09T11:59:07.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.715+0000 7f735919d700 1 -- 172.21.15.86:0/1350185120 wait complete. 2023-10-09T11:59:07.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.716+0000 7f735919d700 1 Processor -- start 2023-10-09T11:59:07.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.717+0000 7f735919d700 1 -- start start 2023-10-09T11:59:07.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.717+0000 7f735919d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7354159420 0x7f735414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.717+0000 7f735919d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73541597f0 0x7f73541538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.717+0000 7f735919d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735415d230 0x7f7354155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.717+0000 7f735919d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73541543a0 con 0x7f73541597f0 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.717+0000 7f735919d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735415a670 con 0x7f735415d230 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.717+0000 7f735919d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7354159d40 con 0x7f7354159420 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73541597f0 0x7f73541538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73541597f0 0x7f73541538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43102/0 (socket says 172.21.15.86:43102) 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 -- 172.21.15.86:0/2334116446 learned_addr learned my addr 172.21.15.86:0/2334116446 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f7353fff700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7354159420 0x7f735414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f735899c700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735415d230 0x7f7354155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:07.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 -- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7354159420 msgr2=0x7f735414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7354159420 0x7f735414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 -- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735415d230 msgr2=0x7f7354155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735415d230 0x7f7354155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 -- 172.21.15.86:0/2334116446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009420 con 0x7f73541597f0 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.718+0000 7f73537fe700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73541597f0 0x7f73541538e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f734800c7c0 tx=0x7f7348007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.719+0000 7f733bfff700 1 -- 172.21.15.86:0/2334116446 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348005c00 con 0x7f73541597f0 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.719+0000 7f733bfff700 1 -- 172.21.15.86:0/2334116446 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348005d60 con 0x7f73541597f0 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.719+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735415a020 con 0x7f73541597f0 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.719+0000 7f733bfff700 1 -- 172.21.15.86:0/2334116446 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348007320 con 0x7f73541597f0 2023-10-09T11:59:07.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.719+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735414e960 con 0x7f73541597f0 2023-10-09T11:59:07.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.720+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735415a7e0 con 0x7f73541597f0 2023-10-09T11:59:07.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.721+0000 7f733bfff700 1 -- 172.21.15.86:0/2334116446 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f734801b3b0 con 0x7f73541597f0 2023-10-09T11:59:07.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.722+0000 7f733bfff700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 0x7f7340069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:07.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.722+0000 7f733bfff700 1 -- 172.21.15.86:0/2334116446 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f7348083ff0 con 0x7f73541597f0 2023-10-09T11:59:07.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.722+0000 7f7353fff700 1 -- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 msgr2=0x7f7340069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:07.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.722+0000 7f7353fff700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 0x7f7340069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:07.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.727+0000 7f733bfff700 1 -- 172.21.15.86:0/2334116446 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7348050d40 con 0x7f73541597f0 2023-10-09T11:59:07.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.923+0000 7f7353fff700 1 -- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 msgr2=0x7f7340069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:07.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.923+0000 7f7353fff700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 0x7f7340069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:07.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.928+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f735404c3c0 con 0x7f73541597f0 2023-10-09T11:59:07.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.929+0000 7f733bfff700 1 -- 172.21.15.86:0/2334116446 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16396 (secure 0 0 0) 0x7f7348017020 con 0x7f73541597f0 2023-10-09T11:59:07.931 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:07.931 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":111,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:02.470198+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:57:39.443249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:40.316252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:58:01.374359+0000","172.21.15.86:6836/85490":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/716407408":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/901115197":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/2478132006":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/519798548":"2023-10-10T11:58:01.374359+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:59:07.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 msgr2=0x7f7340069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:07.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 0x7f7340069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73541597f0 msgr2=0x7f73541538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73541597f0 0x7f73541538e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f734800c7c0 tx=0x7f7348007dd0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 shutdown_connections 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735415d230 0x7f7354155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7354159420 0x7f735414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7340067170 0x7f7340069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 --2- 172.21.15.86:0/2334116446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73541597f0 0x7f73541538e0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 >> 172.21.15.86:0/2334116446 conn(0x7f73540d0660 msgr2=0x7f735415d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 shutdown_connections 2023-10-09T11:59:07.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:07.932+0000 7f735919d700 1 -- 172.21.15.86:0/2334116446 wait complete. 2023-10-09T11:59:07.951 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:59:07.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:59:08.052 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:08.052+0000 7fea6f2a3180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:59:08.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.165+0000 7f12f259d700 1 Processor -- start 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.165+0000 7f12f259d700 1 -- start start 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087720 0x7f12ec068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f259d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f12ec0c7ee0 0x7f12ec0af060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f259d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec06eec0 con 0x7f12ec087af0 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f259d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec06a330 con 0x7f12ec0c7ee0 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec06a610 con 0x7f12ec087720 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f159b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087720 0x7f12ec068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f159b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087720 0x7f12ec068d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:44152/0 (socket says 172.21.15.86:44152) 2023-10-09T11:59:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f159b700 1 -- 172.21.15.86:0/3341643412 learned_addr learned my addr 172.21.15.86:0/3341643412 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.167+0000 7f12f1d9c700 1 --2- 172.21.15.86:0/3341643412 >> v2:172.21.15.135:3300/0 conn(0x7f12ec0c7ee0 0x7f12ec0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.168+0000 7f12f159b700 1 -- 172.21.15.86:0/3341643412 >> v2:172.21.15.135:3300/0 conn(0x7f12ec0c7ee0 msgr2=0x7f12ec0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.168+0000 7f12f159b700 1 --2- 172.21.15.86:0/3341643412 >> v2:172.21.15.135:3300/0 conn(0x7f12ec0c7ee0 0x7f12ec0af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.168+0000 7f12f159b700 1 -- 172.21.15.86:0/3341643412 >> v1:172.21.15.135:6789/0 conn(0x7f12ec087af0 legacy=0x7f12ec0c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.168+0000 7f12f159b700 1 -- 172.21.15.86:0/3341643412 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec06f160 con 0x7f12ec087720 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.168+0000 7f12f159b700 1 --2- 172.21.15.86:0/3341643412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087720 0x7f12ec068d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12e4007750 tx=0x7f12e400e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d78a56c61867d4d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.168+0000 7f12ebfff700 1 -- 172.21.15.86:0/3341643412 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400cd80 con 0x7f12ec087720 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12ebfff700 1 -- 172.21.15.86:0/3341643412 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e400c030 con 0x7f12ec087720 2023-10-09T11:59:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12ebfff700 1 -- 172.21.15.86:0/3341643412 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400c3d0 con 0x7f12ec087720 2023-10-09T11:59:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 -- 172.21.15.86:0/3341643412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087720 msgr2=0x7f12ec068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 --2- 172.21.15.86:0/3341643412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087720 0x7f12ec068d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12e4007750 tx=0x7f12e400e040 comp rx=0 tx=0).stop 2023-10-09T11:59:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 -- 172.21.15.86:0/3341643412 shutdown_connections 2023-10-09T11:59:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 --2- 172.21.15.86:0/3341643412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087720 0x7f12ec068d60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 --2- 172.21.15.86:0/3341643412 >> v2:172.21.15.135:3300/0 conn(0x7f12ec0c7ee0 0x7f12ec0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 -- 172.21.15.86:0/3341643412 >> 172.21.15.86:0/3341643412 conn(0x7f12ec0c96c0 msgr2=0x7f12ec068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 -- 172.21.15.86:0/3341643412 shutdown_connections 2023-10-09T11:59:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.169+0000 7f12f259d700 1 -- 172.21.15.86:0/3341643412 wait complete. 2023-10-09T11:59:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.171+0000 7f12f259d700 1 Processor -- start 2023-10-09T11:59:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.171+0000 7f12f259d700 1 -- start start 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f259d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12ec087720 0x7f12ec169090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087af0 0x7f12ec0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f259d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12ec0c7ee0 0x7f12ec179c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f259d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec1695d0 con 0x7f12ec0c7ee0 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f259d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec177900 con 0x7f12ec087720 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0c2440 con 0x7f12ec087af0 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f159b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12ec087720 0x7f12ec169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f1d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12ec0c7ee0 0x7f12ec179c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f0d9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087af0 0x7f12ec0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f159b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12ec087720 0x7f12ec169090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:57054/0 (socket says 172.21.15.86:57054) 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.172+0000 7f12f159b700 1 -- 172.21.15.86:0/4214971114 learned_addr learned my addr 172.21.15.86:0/4214971114 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f0d9a700 1 -- 172.21.15.86:0/4214971114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12ec087720 msgr2=0x7f12ec169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f0d9a700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12ec087720 0x7f12ec169090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f0d9a700 1 -- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12ec0c7ee0 msgr2=0x7f12ec179c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f0d9a700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12ec0c7ee0 0x7f12ec179c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f0d9a700 1 -- 172.21.15.86:0/4214971114 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e4006020 con 0x7f12ec087af0 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f1d9c700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12ec0c7ee0 0x7f12ec179c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f0d9a700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087af0 0x7f12ec0c19a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c5c0 tx=0x7f12e0007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:08.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12e97fa700 1 -- 172.21.15.86:0/4214971114 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0011590 con 0x7f12ec087af0 2023-10-09T11:59:08.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12e97fa700 1 -- 172.21.15.86:0/4214971114 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0011710 con 0x7f12ec087af0 2023-10-09T11:59:08.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12e97fa700 1 -- 172.21.15.86:0/4214971114 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0011ad0 con 0x7f12ec087af0 2023-10-09T11:59:08.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec0c2720 con 0x7f12ec087af0 2023-10-09T11:59:08.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.173+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec0c2ce0 con 0x7f12ec087af0 2023-10-09T11:59:08.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.174+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec177ab0 con 0x7f12ec087af0 2023-10-09T11:59:08.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.175+0000 7f12e97fa700 1 -- 172.21.15.86:0/4214971114 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f12e001b3b0 con 0x7f12ec087af0 2023-10-09T11:59:08.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.176+0000 7f12e97fa700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 0x7f12d80696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.176+0000 7f12e97fa700 1 -- 172.21.15.86:0/4214971114 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f12e0083f00 con 0x7f12ec087af0 2023-10-09T11:59:08.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.176+0000 7f12f159b700 1 -- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 msgr2=0x7f12d80696a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:08.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.176+0000 7f12f159b700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 0x7f12d80696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:08.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.181+0000 7f12e97fa700 1 -- 172.21.15.86:0/4214971114 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12ec177ab0 con 0x7f12ec087af0 2023-10-09T11:59:08.225 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:08.225+0000 7fea6f2a3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:08.231 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:08.230+0000 7f3f5164d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:59:08.319 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:08.319+0000 7fea6f2a3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:59:08.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.377+0000 7f12f159b700 1 -- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 msgr2=0x7f12d80696a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:08.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.377+0000 7f12f159b700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 0x7f12d80696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:08.408 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:08.407+0000 7f3f5164d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:08.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.423+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12ec177a70 con 0x7f12ec087af0 2023-10-09T11:59:08.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.424+0000 7f12e97fa700 1 -- 172.21.15.86:0/4214971114 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f12e0017070 con 0x7f12ec087af0 2023-10-09T11:59:08.425 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:08.426 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4115138334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4115138334},{"type":"v1","addr":"172.21.15.135:6834","nonce":4115138334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6763,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/34078262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":34078262},{"type":"v1","addr":"172.21.15.135:6835","nonce":34078262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/161428317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":161428317},{"type":"v1","addr":"172.21.15.86:6833","nonce":161428317}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:41.335680+0000","modified":"2023-10-09T11:57:44.882360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3360740992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3360740992},{"type":"v1","addr":"172.21.15.86:6835","nonce":3360740992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:59:08.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 msgr2=0x7f12d80696a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:08.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 0x7f12d80696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087af0 msgr2=0x7f12ec0c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087af0 0x7f12ec0c19a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c5c0 tx=0x7f12e0007ec0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 shutdown_connections 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f12d80671f0 0x7f12d80696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12ec0c7ee0 0x7f12ec179c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12ec087720 0x7f12ec169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 --2- 172.21.15.86:0/4214971114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12ec087af0 0x7f12ec0c19a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 >> 172.21.15.86:0/4214971114 conn(0x7f12ec0c96c0 msgr2=0x7f12ec0c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 shutdown_connections 2023-10-09T11:59:08.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.427+0000 7f12f259d700 1 -- 172.21.15.86:0/4214971114 wait complete. 2023-10-09T11:59:08.430 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 46 2023-10-09T11:59:08.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:59:08.512 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:08.511+0000 7f3f5164d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:59:08.612 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:08.612+0000 7fea6f2a3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:59:08.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.633+0000 7fc03f59d700 1 Processor -- start 2023-10-09T11:59:08.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.633+0000 7fc03f59d700 1 -- start start 2023-10-09T11:59:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.634+0000 7fc03f59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0380b1e50 0x7fc038159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03f59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380cfe20 con 0x7fc0380ceaa0 2023-10-09T11:59:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03f59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380cf210 con 0x7fc0381593b0 2023-10-09T11:59:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03f59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0380cf4f0 con 0x7fc0380b1e50 2023-10-09T11:59:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03dd9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0380b1e50 0x7fc038159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03ed9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc0380ceaa0 0x7fc0380b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60566/0 (socket says 172.21.15.86:60566) 2023-10-09T11:59:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03ed9c700 1 -- 172.21.15.86:0/89389152 learned_addr learned my addr 172.21.15.86:0/89389152 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03dd9a700 1 -- 172.21.15.86:0/89389152 >> v1:172.21.15.135:6789/0 conn(0x7fc0381593b0 legacy=0x7fc0380b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03d599700 1 -- 172.21.15.86:0/89389152 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448025180 0 0) 0x7fc0380cfe20 con 0x7fc0380ceaa0 2023-10-09T11:59:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03dd9a700 1 -- 172.21.15.86:0/89389152 >> v1:172.21.15.86:6789/0 conn(0x7fc0380ceaa0 legacy=0x7fc0380b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.635+0000 7fc03dd9a700 1 -- 172.21.15.86:0/89389152 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380cf7d0 con 0x7fc0380b1e50 2023-10-09T11:59:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.636+0000 7fc03dd9a700 1 --2- 172.21.15.86:0/89389152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038159780 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098e0 tx=0x7fc0280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e46e217a66b50e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.636+0000 7fc03d599700 1 -- 172.21.15.86:0/89389152 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028009e80 con 0x7fc0380b1e50 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.636+0000 7fc03d599700 1 -- 172.21.15.86:0/89389152 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800b860 con 0x7fc0380b1e50 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.636+0000 7fc03d599700 1 -- 172.21.15.86:0/89389152 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800bbe0 con 0x7fc0380b1e50 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.637+0000 7fc03f59d700 1 -- 172.21.15.86:0/89389152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 msgr2=0x7fc038159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.637+0000 7fc03f59d700 1 --2- 172.21.15.86:0/89389152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038159780 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098e0 tx=0x7fc0280091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.637+0000 7fc03f59d700 1 -- 172.21.15.86:0/89389152 shutdown_connections 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.637+0000 7fc03f59d700 1 --2- 172.21.15.86:0/89389152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038159780 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.637+0000 7fc03f59d700 1 -- 172.21.15.86:0/89389152 >> 172.21.15.86:0/89389152 conn(0x7fc0380d1130 msgr2=0x7fc0380b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.637+0000 7fc03f59d700 1 -- 172.21.15.86:0/89389152 shutdown_connections 2023-10-09T11:59:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.637+0000 7fc03f59d700 1 -- 172.21.15.86:0/89389152 wait complete. 2023-10-09T11:59:08.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.638+0000 7fc03f59d700 1 Processor -- start 2023-10-09T11:59:08.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.639+0000 7fc03f59d700 1 -- start start 2023-10-09T11:59:08.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.639+0000 7fc03f59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.639+0000 7fc03f59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0380ceaa0 0x7fc0380b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.639+0000 7fc03f59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0381593b0 0x7fc0380b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.639+0000 7fc03f59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03816ad00 con 0x7fc0380b1e50 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.639+0000 7fc03f59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03816a3b0 con 0x7fc0381593b0 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.639+0000 7fc03f59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03816a690 con 0x7fc0380ceaa0 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43142/0 (socket says 172.21.15.86:43142) 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 -- 172.21.15.86:0/3620748184 learned_addr learned my addr 172.21.15.86:0/3620748184 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03dd9a700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0380ceaa0 0x7fc0380b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03ed9c700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0381593b0 0x7fc0380b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 -- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0380ceaa0 msgr2=0x7fc0380b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0380ceaa0 0x7fc0380b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 -- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0381593b0 msgr2=0x7fc0380b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0381593b0 0x7fc0380b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 -- 172.21.15.86:0/3620748184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009420 con 0x7fc0380b1e50 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.640+0000 7fc03e59b700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038169b30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c4e0 tx=0x7fc03400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.641+0000 7fc02e7fc700 1 -- 172.21.15.86:0/3620748184 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034011590 con 0x7fc0380b1e50 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.641+0000 7fc02e7fc700 1 -- 172.21.15.86:0/3620748184 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc034011710 con 0x7fc0380b1e50 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.641+0000 7fc02e7fc700 1 -- 172.21.15.86:0/3620748184 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034011ad0 con 0x7fc0380b1e50 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.641+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03816a970 con 0x7fc0380b1e50 2023-10-09T11:59:08.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.641+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03816a070 con 0x7fc0380b1e50 2023-10-09T11:59:08.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.642+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03804c3c0 con 0x7fc0380b1e50 2023-10-09T11:59:08.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.643+0000 7fc02e7fc700 1 -- 172.21.15.86:0/3620748184 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fc03401b3b0 con 0x7fc0380b1e50 2023-10-09T11:59:08.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.643+0000 7fc02e7fc700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 0x7fc01c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:08.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.644+0000 7fc02e7fc700 1 -- 172.21.15.86:0/3620748184 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7fc034083f30 con 0x7fc0380b1e50 2023-10-09T11:59:08.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.644+0000 7fc03dd9a700 1 -- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 msgr2=0x7fc01c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:08.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.644+0000 7fc03dd9a700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 0x7fc01c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:08.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.648+0000 7fc02e7fc700 1 -- 172.21.15.86:0/3620748184 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc034050c00 con 0x7fc0380b1e50 2023-10-09T11:59:08.709 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:08.708+0000 7fea6f2a3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:59:08.828 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:08.826+0000 7f3f5164d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:59:08.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.845+0000 7fc03dd9a700 1 -- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 msgr2=0x7fc01c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:08.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.845+0000 7fc03dd9a700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 0x7fc01c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:08.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.908+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0380cfab0 con 0x7fc0380b1e50 2023-10-09T11:59:08.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.908+0000 7fc02e7fc700 1 -- 172.21.15.86:0/3620748184 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fc034017070 con 0x7fc0380b1e50 2023-10-09T11:59:08.910 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:08.910 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4115138334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4115138334},{"type":"v1","addr":"172.21.15.135:6834","nonce":4115138334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6763,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/34078262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":34078262},{"type":"v1","addr":"172.21.15.135:6835","nonce":34078262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/161428317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":161428317},{"type":"v1","addr":"172.21.15.86:6833","nonce":161428317}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:57:41.335680+0000","modified":"2023-10-09T11:57:44.882360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7167":{"gid":7167,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3360740992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3360740992},{"type":"v1","addr":"172.21.15.86:6835","nonce":3360740992}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:59:08.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 msgr2=0x7fc01c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:08.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 0x7fc01c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 msgr2=0x7fc038169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038169b30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c4e0 tx=0x7fc03400c7f0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 shutdown_connections 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc01c067170 0x7fc01c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0380b1e50 0x7fc038169b30 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0381593b0 0x7fc0380b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 --2- 172.21.15.86:0/3620748184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0380ceaa0 0x7fc0380b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:08.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 >> 172.21.15.86:0/3620748184 conn(0x7fc0380d1130 msgr2=0x7fc03815ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:08.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 shutdown_connections 2023-10-09T11:59:08.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:08.911+0000 7fc03f59d700 1 -- 172.21.15.86:0/3620748184 wait complete. 2023-10-09T11:59:08.914 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 46 2023-10-09T11:59:08.928 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:08.927+0000 7f3f5164d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:59:08.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:59:09.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.114+0000 7f3df6f9d700 1 Processor -- start 2023-10-09T11:59:09.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.114+0000 7f3df6f9d700 1 -- start start 2023-10-09T11:59:09.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.115+0000 7f3df6f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3df0159420 0x7f3df00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.115+0000 7f3df6f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df015d230 0x7f3df015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.115+0000 7f3df6f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00b2980 con 0x7f3df01597f0 2023-10-09T11:59:09.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.115+0000 7f3df6f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df015dbb0 con 0x7f3df0159420 2023-10-09T11:59:09.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.115+0000 7f3df6f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00b11d0 con 0x7f3df015d230 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df5f9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3df0159420 0x7f3df00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df015d230 0x7f3df015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df015d230 0x7f3df015d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:44176/0 (socket says 172.21.15.86:44176) 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 -- 172.21.15.86:0/2677594090 learned_addr learned my addr 172.21.15.86:0/2677594090 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df579a700 1 --1- 172.21.15.86:0/2677594090 >> v1:172.21.15.135:6789/0 conn(0x7f3df01597f0 0x7f3df00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:43544/0 (socket says 172.21.15.86:43544) 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 -- 172.21.15.86:0/2677594090 >> v2:172.21.15.135:3300/0 conn(0x7f3df0159420 msgr2=0x7f3df00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 --2- 172.21.15.86:0/2677594090 >> v2:172.21.15.135:3300/0 conn(0x7f3df0159420 0x7f3df00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 -- 172.21.15.86:0/2677594090 >> v1:172.21.15.135:6789/0 conn(0x7f3df01597f0 legacy=0x7f3df00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 -- 172.21.15.86:0/2677594090 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00b14b0 con 0x7f3df015d230 2023-10-09T11:59:09.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df5f9b700 1 --2- 172.21.15.86:0/2677594090 >> v2:172.21.15.135:3300/0 conn(0x7f3df0159420 0x7f3df00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:09.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.116+0000 7f3df679c700 1 --2- 172.21.15.86:0/2677594090 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df015d230 0x7f3df015d670 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009f20 tx=0x7f3de8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ec870bd77a3fdb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:09.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df4f99700 1 -- 172.21.15.86:0/2677594090 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800e070 con 0x7f3df015d230 2023-10-09T11:59:09.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df4f99700 1 -- 172.21.15.86:0/2677594090 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800b9d0 con 0x7f3df015d230 2023-10-09T11:59:09.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df4f99700 1 -- 172.21.15.86:0/2677594090 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de80092e0 con 0x7f3df015d230 2023-10-09T11:59:09.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 -- 172.21.15.86:0/2677594090 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df015d230 msgr2=0x7f3df015d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/2677594090 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df015d230 0x7f3df015d670 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009f20 tx=0x7f3de8009840 comp rx=0 tx=0).stop 2023-10-09T11:59:09.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 -- 172.21.15.86:0/2677594090 shutdown_connections 2023-10-09T11:59:09.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/2677594090 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df015d230 0x7f3df015d670 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/2677594090 >> v2:172.21.15.135:3300/0 conn(0x7f3df0159420 0x7f3df00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 -- 172.21.15.86:0/2677594090 >> 172.21.15.86:0/2677594090 conn(0x7f3df00d0660 msgr2=0x7f3df00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:09.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 -- 172.21.15.86:0/2677594090 shutdown_connections 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.117+0000 7f3df6f9d700 1 -- 172.21.15.86:0/2677594090 wait complete. 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.119+0000 7f3df6f9d700 1 Processor -- start 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.119+0000 7f3df6f9d700 1 -- start start 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df6f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3df0159420 0x7f3df015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df6f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df01597f0 0x7f3df00c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df6f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df015d230 0x7f3df01552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df6f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0155810 con 0x7f3df015d230 2023-10-09T11:59:09.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df6f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c7290 con 0x7f3df0159420 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df6f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c7570 con 0x7f3df01597f0 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df015d230 0x7f3df01552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df015d230 0x7f3df01552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43150/0 (socket says 172.21.15.86:43150) 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df679c700 1 -- 172.21.15.86:0/1654224381 learned_addr learned my addr 172.21.15.86:0/1654224381 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df5f9b700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3df0159420 0x7f3df015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df579a700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df01597f0 0x7f3df00c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df5f9b700 1 -- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df01597f0 msgr2=0x7f3df00c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df5f9b700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df01597f0 0x7f3df00c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df5f9b700 1 -- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df015d230 msgr2=0x7f3df01552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.120+0000 7f3df5f9b700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df015d230 0x7f3df01552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3df5f9b700 1 -- 172.21.15.86:0/1654224381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec009420 con 0x7f3df0159420 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3df679c700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df015d230 0x7f3df01552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3df5f9b700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3df0159420 0x7f3df015b620 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00ec80 tx=0x7f3dec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3de5ffb700 1 -- 172.21.15.86:0/1654224381 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00c850 con 0x7f3df0159420 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3de5ffb700 1 -- 172.21.15.86:0/1654224381 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec00c9b0 con 0x7f3df0159420 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de8009ae0 con 0x7f3df0159420 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3de5ffb700 1 -- 172.21.15.86:0/1654224381 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00cd70 con 0x7f3df0159420 2023-10-09T11:59:09.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.121+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df00c7b30 con 0x7f3df0159420 2023-10-09T11:59:09.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.122+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df004c3c0 con 0x7f3df0159420 2023-10-09T11:59:09.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.123+0000 7f3de5ffb700 1 -- 172.21.15.86:0/1654224381 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f3dec013680 con 0x7f3df0159420 2023-10-09T11:59:09.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.124+0000 7f3de5ffb700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 0x7f3dd4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.124+0000 7f3de5ffb700 1 -- 172.21.15.86:0/1654224381 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f3dec084e40 con 0x7f3df0159420 2023-10-09T11:59:09.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.124+0000 7f3df579a700 1 -- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 msgr2=0x7f3dd4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:09.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.124+0000 7f3df579a700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 0x7f3dd4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:09.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.132+0000 7f3de5ffb700 1 -- 172.21.15.86:0/1654224381 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dec051a40 con 0x7f3df0159420 2023-10-09T11:59:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.325+0000 7f3df579a700 1 -- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 msgr2=0x7f3dd4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:09.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.325+0000 7f3df579a700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 0x7f3dd4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:09.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.331+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3df00b1790 con 0x7f3df0159420 2023-10-09T11:59:09.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.332+0000 7f3de5ffb700 1 -- 172.21.15.86:0/1654224381 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16396 (secure 0 0 0) 0x7f3dec055060 con 0x7f3df0159420 2023-10-09T11:59:09.334 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:09.334 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":111,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:02.470198+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:57:39.443249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:57:40.316252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.2a","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:58:01.374359+0000","172.21.15.86:6836/85490":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/716407408":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/901115197":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/2478132006":"2023-10-10T11:58:01.374359+0000","172.21.15.86:0/519798548":"2023-10-10T11:58:01.374359+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:59:09.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 msgr2=0x7f3dd4069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:09.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 0x7f3dd4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3df0159420 msgr2=0x7f3df015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3df0159420 0x7f3df015b620 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00ec80 tx=0x7f3dec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 shutdown_connections 2023-10-09T11:59:09.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3dd4067170 0x7f3dd4069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df015d230 0x7f3df01552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3df0159420 0x7f3df015b620 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 --2- 172.21.15.86:0/1654224381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3df01597f0 0x7f3df00c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 >> 172.21.15.86:0/1654224381 conn(0x7f3df00d0660 msgr2=0x7f3df00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:09.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 shutdown_connections 2023-10-09T11:59:09.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.336+0000 7f3df6f9d700 1 -- 172.21.15.86:0/1654224381 wait complete. 2023-10-09T11:59:09.360 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:59:09.411 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:09.411+0000 7fea6f2a3180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:59:09.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.549+0000 7fb3cf59e700 1 Processor -- start 2023-10-09T11:59:09.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.549+0000 7fb3cf59e700 1 -- start start 2023-10-09T11:59:09.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cf59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3d01597f0 0x7fb3d00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cf59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d015dbb0 con 0x7fb3d0159420 2023-10-09T11:59:09.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cf59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d00b11d0 con 0x7fb3d01597f0 2023-10-09T11:59:09.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00b14b0 con 0x7fb3d015d230 2023-10-09T11:59:09.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cdd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3d01597f0 0x7fb3d00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cdd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3d01597f0 0x7fb3d00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43156/0 (socket says 172.21.15.86:43156) 2023-10-09T11:59:09.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/554436361 learned_addr learned my addr 172.21.15.86:0/554436361 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:09.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.550+0000 7fb3ced9d700 1 --2- 172.21.15.86:0/554436361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/554436361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 msgr2=0x7fb3d015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:09.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cdd9b700 1 --2- 172.21.15.86:0/554436361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/554436361 >> v1:172.21.15.135:6789/0 conn(0x7fb3d0159420 legacy=0x7fb3d00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/554436361 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00b1790 con 0x7fb3d01597f0 2023-10-09T11:59:09.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3ced9d700 1 --2- 172.21.15.86:0/554436361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cdd9b700 1 --2- 172.21.15.86:0/554436361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d00b2270 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40099b0 tx=0x7fb3c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3026f775ddaf9f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cd59a700 1 -- 172.21.15.86:0/554436361 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400b860 con 0x7fb3d01597f0 2023-10-09T11:59:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cd59a700 1 -- 172.21.15.86:0/554436361 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c400b9c0 con 0x7fb3d01597f0 2023-10-09T11:59:09.555 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.551+0000 7fb3cd59a700 1 -- 172.21.15.86:0/554436361 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400bd60 con 0x7fb3d01597f0 2023-10-09T11:59:09.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 -- 172.21.15.86:0/554436361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 msgr2=0x7fb3d00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/554436361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d00b2270 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40099b0 tx=0x7fb3c4009250 comp rx=0 tx=0).stop 2023-10-09T11:59:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 -- 172.21.15.86:0/554436361 shutdown_connections 2023-10-09T11:59:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/554436361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/554436361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d00b2270 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 -- 172.21.15.86:0/554436361 >> 172.21.15.86:0/554436361 conn(0x7fb3d00d0660 msgr2=0x7fb3d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 -- 172.21.15.86:0/554436361 shutdown_connections 2023-10-09T11:59:09.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.552+0000 7fb3cf59e700 1 -- 172.21.15.86:0/554436361 wait complete. 2023-10-09T11:59:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.553+0000 7fb3cf59e700 1 Processor -- start 2023-10-09T11:59:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.554+0000 7fb3cf59e700 1 -- start start 2023-10-09T11:59:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.554+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3d0159420 0x7fb3d0153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.554+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.554+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d0068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.554+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d016a720 con 0x7fb3d01597f0 2023-10-09T11:59:09.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.554+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0169b10 con 0x7fb3d0159420 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.554+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0169df0 con 0x7fb3d015d230 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d015c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43168/0 (socket says 172.21.15.86:43168) 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/3299251255 learned_addr learned my addr 172.21.15.86:0/3299251255 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3ced9d700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3ce59c700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3d0159420 0x7fb3d0153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 msgr2=0x7fb3d0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3d0159420 msgr2=0x7fb3d0153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3d0159420 0x7fb3d0153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 -- 172.21.15.86:0/3299251255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40094f0 con 0x7fb3d01597f0 2023-10-09T11:59:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3ce59c700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3d0159420 0x7fb3d0153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.555+0000 7fb3cdd9b700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d015c2e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009290 tx=0x7fb3c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.556+0000 7fb3be7fc700 1 -- 172.21.15.86:0/3299251255 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4026480 con 0x7fb3d01597f0 2023-10-09T11:59:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.556+0000 7fb3be7fc700 1 -- 172.21.15.86:0/3299251255 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c401f070 con 0x7fb3d01597f0 2023-10-09T11:59:09.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.556+0000 7fb3be7fc700 1 -- 172.21.15.86:0/3299251255 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4026830 con 0x7fb3d01597f0 2023-10-09T11:59:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.556+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d016a0d0 con 0x7fb3d01597f0 2023-10-09T11:59:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.556+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d00c66c0 con 0x7fb3d01597f0 2023-10-09T11:59:09.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.557+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d016a570 con 0x7fb3d01597f0 2023-10-09T11:59:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.558+0000 7fb3be7fc700 1 -- 172.21.15.86:0/3299251255 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fb3c4026ba0 con 0x7fb3d01597f0 2023-10-09T11:59:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.559+0000 7fb3be7fc700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 0x7fb3b0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.560+0000 7fb3be7fc700 1 -- 172.21.15.86:0/3299251255 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6368+0+0 (secure 0 0 0) 0x7fb3c4021070 con 0x7fb3d01597f0 2023-10-09T11:59:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.560+0000 7fb3ce59c700 1 -- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 msgr2=0x7fb3b0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:09.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.560+0000 7fb3ce59c700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 0x7fb3b0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:09.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.566+0000 7fb3be7fc700 1 -- 172.21.15.86:0/3299251255 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3c40536b0 con 0x7fb3d01597f0 2023-10-09T11:59:09.679 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:09.677+0000 7f3f5164d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:59:09.697 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:09.696+0000 7fea6f2a3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:59:09.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.761+0000 7fb3ce59c700 1 -- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 msgr2=0x7fb3b0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:09.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.761+0000 7fb3ce59c700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 0x7fb3b0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:09.788 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:09.788+0000 7fea6f2a3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:59:09.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.809+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3d004c3c0 con 0x7fb3d01597f0 2023-10-09T11:59:09.811 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T11:59:09.809+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:59:09.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.814+0000 7fb3be7fc700 1 -- 172.21.15.86:0/3299251255 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb3c4056cd0 con 0x7fb3d01597f0 2023-10-09T11:59:09.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 msgr2=0x7fb3b0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:09.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 0x7fb3b0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 msgr2=0x7fb3d015c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:09.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d015c2e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009290 tx=0x7fb3c4017000 comp rx=0 tx=0).stop 2023-10-09T11:59:09.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 shutdown_connections 2023-10-09T11:59:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3d015d230 0x7fb3d0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3d0159420 0x7fb3d0153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb3b0067170 0x7fb3b0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 --2- 172.21.15.86:0/3299251255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3d01597f0 0x7fb3d015c2e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 >> 172.21.15.86:0/3299251255 conn(0x7fb3d00d0660 msgr2=0x7fb3d00b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 shutdown_connections 2023-10-09T11:59:09.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:09.817+0000 7fb3cf59e700 1 -- 172.21.15.86:0/3299251255 wait complete. 2023-10-09T11:59:09.821 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:59:09.826 INFO:tasks.ceph.mds.a.smithi086.stderr: -5287> 2023-10-09T11:57:46.842+0000 7fecb4ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:59:09.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:59:09.871 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:59:09.949 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:09.948+0000 7fea6f2a3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:59:09.981 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:09.979+0000 7f3f5164d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:59:10.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.031+0000 7f160259d700 1 Processor -- start 2023-10-09T11:59:10.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.031+0000 7f160259d700 1 -- start start 2023-10-09T11:59:10.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.032+0000 7f160259d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15fc0b16d0 0x7f15fc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:10.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.032+0000 7f160259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b33b0 0x7f15fc0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:10.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.032+0000 7f160259d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15fc0b2080 con 0x7f15fc0b4e70 2023-10-09T11:59:10.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.032+0000 7f160259d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15fc0cfb00 con 0x7f15fc0b16d0 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.032+0000 7f160259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc0b5c40 con 0x7f15fc0b33b0 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15fc0b16d0 0x7f15fc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15fc0b16d0 0x7f15fc0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43194/0 (socket says 172.21.15.86:43194) 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 -- 172.21.15.86:0/1736480576 learned_addr learned my addr 172.21.15.86:0/1736480576 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1601d9c700 1 --2- 172.21.15.86:0/1736480576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b33b0 0x7f15fc0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 -- 172.21.15.86:0/1736480576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b33b0 msgr2=0x7f15fc0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 --2- 172.21.15.86:0/1736480576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b33b0 0x7f15fc0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 -- 172.21.15.86:0/1736480576 >> v1:172.21.15.86:6789/0 conn(0x7f15fc0b4e70 legacy=0x7f15fc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:10.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 -- 172.21.15.86:0/1736480576 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0b5f20 con 0x7f15fc0b16d0 2023-10-09T11:59:10.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f15f3fff700 1 -- 172.21.15.86:0/1736480576 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750947826 0 0) 0x7f15fc0b2080 con 0x7f15fc0b4e70 2023-10-09T11:59:10.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.033+0000 7f1600d9a700 1 --2- 172.21.15.86:0/1736480576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b16d0 0x7f15fc0b1b40 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0099b0 tx=0x7f15ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639e8799eb386d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:10.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f15f3fff700 1 -- 172.21.15.86:0/1736480576 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec009ea0 con 0x7f15fc0b16d0 2023-10-09T11:59:10.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f15f3fff700 1 -- 172.21.15.86:0/1736480576 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec00b860 con 0x7f15fc0b16d0 2023-10-09T11:59:10.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f15f3fff700 1 -- 172.21.15.86:0/1736480576 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00bc20 con 0x7f15fc0b16d0 2023-10-09T11:59:10.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f160259d700 1 -- 172.21.15.86:0/1736480576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b16d0 msgr2=0x7f15fc0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:10.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f160259d700 1 --2- 172.21.15.86:0/1736480576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b16d0 0x7f15fc0b1b40 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0099b0 tx=0x7f15ec009250 comp rx=0 tx=0).stop 2023-10-09T11:59:10.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f160259d700 1 -- 172.21.15.86:0/1736480576 shutdown_connections 2023-10-09T11:59:10.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f160259d700 1 --2- 172.21.15.86:0/1736480576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b33b0 0x7f15fc0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f160259d700 1 --2- 172.21.15.86:0/1736480576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b16d0 0x7f15fc0b1b40 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f160259d700 1 -- 172.21.15.86:0/1736480576 >> 172.21.15.86:0/1736480576 conn(0x7f15fc0d10c0 msgr2=0x7f15fc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:10.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.034+0000 7f160259d700 1 -- 172.21.15.86:0/1736480576 shutdown_connections 2023-10-09T11:59:10.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.035+0000 7f160259d700 1 -- 172.21.15.86:0/1736480576 wait complete. 2023-10-09T11:59:10.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.036+0000 7f160259d700 1 Processor -- start 2023-10-09T11:59:10.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.036+0000 7f160259d700 1 -- start start 2023-10-09T11:59:10.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f160259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b16d0 0x7f15fc14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:10.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f160259d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc0b33b0 0x7f15fc0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:10.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f160259d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b4e70 0x7f15fc169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:10.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f160259d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc16cec0 con 0x7f15fc0b4e70 2023-10-09T11:59:10.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f160259d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc16a100 con 0x7f15fc0b33b0 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f160259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc16a3e0 con 0x7f15fc0b16d0 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f1601d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b4e70 0x7f15fc169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f1601d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b4e70 0x7f15fc169870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43202/0 (socket says 172.21.15.86:43202) 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f1601d9c700 1 -- 172.21.15.86:0/1722793719 learned_addr learned my addr 172.21.15.86:0/1722793719 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f160159b700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b16d0 0x7f15fc14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.037+0000 7f1600d9a700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc0b33b0 0x7f15fc0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f1601d9c700 1 -- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b16d0 msgr2=0x7f15fc14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:10.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f1601d9c700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b16d0 0x7f15fc14a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f1601d9c700 1 -- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc0b33b0 msgr2=0x7f15fc0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f1601d9c700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc0b33b0 0x7f15fc0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f1601d9c700 1 -- 172.21.15.86:0/1722793719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0094f0 con 0x7f15fc0b4e70 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f1601d9c700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b4e70 0x7f15fc169870 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009e90 tx=0x7f15f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f15f17fa700 1 -- 172.21.15.86:0/1722793719 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400cb70 con 0x7f15fc0b4e70 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f15f17fa700 1 -- 172.21.15.86:0/1722793719 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f400f040 con 0x7f15fc0b4e70 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc16a6c0 con 0x7f15fc0b4e70 2023-10-09T11:59:10.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f15f17fa700 1 -- 172.21.15.86:0/1722793719 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4014480 con 0x7f15fc0b4e70 2023-10-09T11:59:10.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.038+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc169db0 con 0x7f15fc0b4e70 2023-10-09T11:59:10.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.039+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc16d310 con 0x7f15fc0b4e70 2023-10-09T11:59:10.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.040+0000 7f15f17fa700 1 -- 172.21.15.86:0/1722793719 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 50) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f15f4014830 con 0x7f15fc0b4e70 2023-10-09T11:59:10.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.041+0000 7f15f17fa700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 0x7f15e0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:10.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.041+0000 7f15f17fa700 1 -- 172.21.15.86:0/1722793719 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f15f4085660 con 0x7f15fc0b4e70 2023-10-09T11:59:10.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.041+0000 7f160159b700 1 -- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 msgr2=0x7f15e0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:10.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.041+0000 7f160159b700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 0x7f15e0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:10.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.048+0000 7f15f17fa700 1 -- 172.21.15.86:0/1722793719 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15f4052240 con 0x7f15fc0b4e70 2023-10-09T11:59:10.052 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:10.052+0000 7fea6f2a3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:59:10.082 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:10.081+0000 7f3f5164d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:59:10.240 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:10.238+0000 7f3f5164d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:59:10.242 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:10.242+0000 7fea6f2a3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:59:10.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.242+0000 7f160159b700 1 -- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 msgr2=0x7f15e0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:10.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.242+0000 7f160159b700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 0x7f15e0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:10.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.290+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f15fc16a850 con 0x7f15fc0b4e70 2023-10-09T11:59:10.335 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:10.334+0000 7fea6f2a3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:59:10.346 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:10.345+0000 7f3f5164d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:59:10.428 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:10.427+0000 7fea6f2a3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:59:10.524 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:10.523+0000 7fea6f2a3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:59:10.536 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:10.535+0000 7f3f5164d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:59:10.629 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:10.628+0000 7f3f5164d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:59:10.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.643+0000 7f160159b700 1 -- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 msgr2=0x7f15e0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:10.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.643+0000 7f160159b700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 0x7f15e0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:59:10.722 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:10.721+0000 7f3f5164d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:59:10.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.815+0000 7f15f17fa700 1 -- 172.21.15.86:0/1722793719 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15f4055860 con 0x7f15fc0b4e70 2023-10-09T11:59:10.817 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:10.816+0000 7f3f5164d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:59:10.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.817+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 msgr2=0x7f15e0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:10.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.817+0000 7f160259d700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 0x7f15e0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.817+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b4e70 msgr2=0x7f15fc169870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.817+0000 7f160259d700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b4e70 0x7f15fc169870 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009e90 tx=0x7f15f400b040 comp rx=0 tx=0).stop 2023-10-09T11:59:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.817+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 shutdown_connections 2023-10-09T11:59:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.818+0000 7f160259d700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f15e0067170 0x7f15e0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.818+0000 7f160259d700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15fc0b4e70 0x7f15fc169870 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.818+0000 7f160259d700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15fc0b16d0 0x7f15fc14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.818+0000 7f160259d700 1 --2- 172.21.15.86:0/1722793719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15fc0b33b0 0x7f15fc0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.818+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 >> 172.21.15.86:0/1722793719 conn(0x7f15fc0d10c0 msgr2=0x7f15fc15c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.818+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 shutdown_connections 2023-10-09T11:59:10.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:10.818+0000 7f160259d700 1 -- 172.21.15.86:0/1722793719 wait complete. 2023-10-09T11:59:10.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:59:11.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.068+0000 7fe54b7ff700 1 Processor -- start 2023-10-09T11:59:11.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.068+0000 7fe54b7ff700 1 -- start start 2023-10-09T11:59:11.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.069+0000 7fe54b7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe544156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:11.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.069+0000 7fe54b7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe54415a440 0x7fe5440acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:11.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.069+0000 7fe54b7ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54415a9b0 con 0x7fe544068890 2023-10-09T11:59:11.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.069+0000 7fe54b7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54415ac90 con 0x7fe54415a440 2023-10-09T11:59:11.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.069+0000 7fe54b7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54415af70 con 0x7fe5441563b0 2023-10-09T11:59:11.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe548d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe54415a440 0x7fe5440acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:11.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe549d9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe544068890 0x7fe5440c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60576/0 (socket says 172.21.15.86:60576) 2023-10-09T11:59:11.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe549d9c700 1 -- 172.21.15.86:0/611915062 learned_addr learned my addr 172.21.15.86:0/611915062 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:11.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe54959b700 1 --2- 172.21.15.86:0/611915062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe544156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:11.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe53bfff700 1 -- 172.21.15.86:0/611915062 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781574805 0 0) 0x7fe54415a9b0 con 0x7fe544068890 2023-10-09T11:59:11.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe53bfff700 1 -- 172.21.15.86:0/611915062 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe530003570 con 0x7fe544068890 2023-10-09T11:59:11.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe548d9a700 1 -- 172.21.15.86:0/611915062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 msgr2=0x7fe544156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe548d9a700 1 --2- 172.21.15.86:0/611915062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe544156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe548d9a700 1 -- 172.21.15.86:0/611915062 >> v1:172.21.15.86:6789/0 conn(0x7fe544068890 legacy=0x7fe5440c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe548d9a700 1 -- 172.21.15.86:0/611915062 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54415b250 con 0x7fe54415a440 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe54959b700 1 --2- 172.21.15.86:0/611915062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe544156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.070+0000 7fe548d9a700 1 --2- 172.21.15.86:0/611915062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe54415a440 0x7fe5440acf30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe5340098e0 tx=0x7fe5340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af40c012cb03ff73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe53bfff700 1 -- 172.21.15.86:0/611915062 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400b640 con 0x7fe54415a440 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe53bfff700 1 -- 172.21.15.86:0/611915062 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53400b7a0 con 0x7fe54415a440 2023-10-09T11:59:11.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe53bfff700 1 -- 172.21.15.86:0/611915062 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400bb40 con 0x7fe54415a440 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 -- 172.21.15.86:0/611915062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe54415a440 msgr2=0x7fe5440acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 --2- 172.21.15.86:0/611915062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe54415a440 0x7fe5440acf30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe5340098e0 tx=0x7fe5340091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 -- 172.21.15.86:0/611915062 shutdown_connections 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 --2- 172.21.15.86:0/611915062 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe544156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 --2- 172.21.15.86:0/611915062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe54415a440 0x7fe5440acf30 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 -- 172.21.15.86:0/611915062 >> 172.21.15.86:0/611915062 conn(0x7fe5440c8f90 msgr2=0x7fe5440c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 -- 172.21.15.86:0/611915062 shutdown_connections 2023-10-09T11:59:11.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.071+0000 7fe54b7ff700 1 -- 172.21.15.86:0/611915062 wait complete. 2023-10-09T11:59:11.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.073+0000 7fe54b7ff700 1 Processor -- start 2023-10-09T11:59:11.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.073+0000 7fe54b7ff700 1 -- start start 2023-10-09T11:59:11.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54b7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe544068890 0x7fe544157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:11.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54b7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe5441487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:11.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54b7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54415a440 0x7fe54406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:11.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54b7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440aa860 con 0x7fe544068890 2023-10-09T11:59:11.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54b7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440a9c50 con 0x7fe54415a440 2023-10-09T11:59:11.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54b7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440a9f30 con 0x7fe5441563b0 2023-10-09T11:59:11.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe544068890 0x7fe544157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe544068890 0x7fe544157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43306/0 (socket says 172.21.15.86:43306) 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 -- 172.21.15.86:0/2829806025 learned_addr learned my addr 172.21.15.86:0/2829806025 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe548d9a700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe5441487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe549d9c700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54415a440 0x7fe54406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 -- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 msgr2=0x7fe5441487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe5441487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 -- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54415a440 msgr2=0x7fe54406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:11.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54415a440 0x7fe54406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe54959b700 1 -- 172.21.15.86:0/2829806025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534009420 con 0x7fe544068890 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.074+0000 7fe549d9c700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54415a440 0x7fe54406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.075+0000 7fe54959b700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe544068890 0x7fe544157d70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fe54000e8d0 tx=0x7fe540008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.075+0000 7fe5397fa700 1 -- 172.21.15.86:0/2829806025 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540013410 con 0x7fe544068890 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.075+0000 7fe5397fa700 1 -- 172.21.15.86:0/2829806025 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540013570 con 0x7fe544068890 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.075+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5440aa210 con 0x7fe544068890 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.075+0000 7fe5397fa700 1 -- 172.21.15.86:0/2829806025 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540013910 con 0x7fe544068890 2023-10-09T11:59:11.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.075+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5441582b0 con 0x7fe544068890 2023-10-09T11:59:11.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.076+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5440718b0 con 0x7fe544068890 2023-10-09T11:59:11.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.077+0000 7fe5397fa700 1 -- 172.21.15.86:0/2829806025 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 51) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fe540013d40 con 0x7fe544068890 2023-10-09T11:59:11.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.078+0000 7fe5397fa700 1 -- 172.21.15.86:0/2829806025 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6798+0+0 (secure 0 0 0) 0x7fe540084180 con 0x7fe544068890 2023-10-09T11:59:11.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.082+0000 7fe5397fa700 1 -- 172.21.15.86:0/2829806025 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe540051370 con 0x7fe544068890 2023-10-09T11:59:11.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.273+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe54406d6a0 con 0x7fe544068890 2023-10-09T11:59:11.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:59:11.300 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:59:11.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.828+0000 7fe5397fa700 1 -- 172.21.15.86:0/2829806025 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v114) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe540054990 con 0x7fe544068890 2023-10-09T11:59:11.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.833+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe544068890 msgr2=0x7fe544157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:11.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.833+0000 7fe54b7ff700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe544068890 0x7fe544157d70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fe54000e8d0 tx=0x7fe540008040 comp rx=0 tx=0).stop 2023-10-09T11:59:11.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.834+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 shutdown_connections 2023-10-09T11:59:11.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.834+0000 7fe54b7ff700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe544068890 0x7fe544157d70 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.834+0000 7fe54b7ff700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe54415a440 0x7fe54406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.834+0000 7fe54b7ff700 1 --2- 172.21.15.86:0/2829806025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5441563b0 0x7fe5441487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:11.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.834+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 >> 172.21.15.86:0/2829806025 conn(0x7fe5440c8f90 msgr2=0x7fe54414c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:11.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.834+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 shutdown_connections 2023-10-09T11:59:11.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:11.834+0000 7fe54b7ff700 1 -- 172.21.15.86:0/2829806025 wait complete. 2023-10-09T11:59:11.837 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:59:11.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:59:12.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.047+0000 7facfc7ff700 1 Processor -- start 2023-10-09T11:59:12.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.048+0000 7facfc7ff700 1 -- start start 2023-10-09T11:59:12.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facfc7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 0x7facf4156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facfc7ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf415a9b0 con 0x7facf4068890 2023-10-09T11:59:12.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facfc7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf415ac90 con 0x7facf415a440 2023-10-09T11:59:12.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facfc7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf415af70 con 0x7facf41563b0 2023-10-09T11:59:12.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facfad9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7facf4068890 0x7facf40c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60584/0 (socket says 172.21.15.86:60584) 2023-10-09T11:59:12.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facfad9c700 1 -- 172.21.15.86:0/1524629505 learned_addr learned my addr 172.21.15.86:0/1524629505 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:12.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facfa59b700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 0x7facf4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227637750 0 0) 0x7facf415a9b0 con 0x7facf4068890 2023-10-09T11:59:12.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.049+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face0003570 con 0x7facf4068890 2023-10-09T11:59:12.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463965292 0 0) 0x7facf415ac90 con 0x7facf415a440 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf415a9b0 con 0x7facf415a440 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378914743 0 0) 0x7face0003570 con 0x7facf4068890 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 msgr2=0x7facf4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 0x7facf4156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 >> v1:172.21.15.135:6789/0 conn(0x7facf415a440 legacy=0x7facf40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf415b250 con 0x7facf4068890 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7facec0017f0 con 0x7facf4068890 2023-10-09T11:59:12.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 >> v1:172.21.15.86:6789/0 conn(0x7facf4068890 legacy=0x7facf40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face0003c20 0x7face0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0004810 0x7face0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 0x7face00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf415af70 con 0x7face0004810 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face000bb40 con 0x7face0003c20 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face000bd00 con 0x7facf41563b0 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facf9d9a700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0004810 0x7face0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facfa59b700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face0003c20 0x7face0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.050+0000 7facfad9c700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 0x7face00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9d9a700 1 -- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 msgr2=0x7face00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9d9a700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf41563b0 0x7face00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9d9a700 1 -- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face0003c20 msgr2=0x7face0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9d9a700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face0003c20 0x7face0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9d9a700 1 -- 172.21.15.86:0/1524629505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0003570 con 0x7face0004810 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9d9a700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0004810 0x7face0004c80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7face4001a10 tx=0x7face4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacf2aa162b6fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:12.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400c5d0 con 0x7face0004810 2023-10-09T11:59:12.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400c730 con 0x7face0004810 2023-10-09T11:59:12.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.051+0000 7facf9599700 1 -- 172.21.15.86:0/1524629505 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400cad0 con 0x7face0004810 2023-10-09T11:59:12.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.052+0000 7facfc7ff700 1 -- 172.21.15.86:0/1524629505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0004810 msgr2=0x7face0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:12.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.052+0000 7facfc7ff700 1 --2- 172.21.15.86:0/1524629505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face0004810 0x7face0004c80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7face4001a10 tx=0x7face4007d30 comp rx=0 tx=0).stop 2023-10-09T11:59:12.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.052+0000 7facfad9c700 1 -- 172.21.15.86:0/1524629505 reap_dead start 2023-10-09T11:59:12.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.052+0000 7facfc7ff700 1 -- 172.21.15.86:0/1524629505 shutdown_connections 2023-10-09T11:59:12.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.052+0000 7facfc7ff700 1 -- 172.21.15.86:0/1524629505 >> 172.21.15.86:0/1524629505 conn(0x7facf40c8f90 msgr2=0x7facf40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:12.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.052+0000 7facfc7ff700 1 -- 172.21.15.86:0/1524629505 shutdown_connections 2023-10-09T11:59:12.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.052+0000 7facfc7ff700 1 -- 172.21.15.86:0/1524629505 wait complete. 2023-10-09T11:59:12.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.053+0000 7facfc7ff700 1 Processor -- start 2023-10-09T11:59:12.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.053+0000 7facfc7ff700 1 -- start start 2023-10-09T11:59:12.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfc7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face0004810 0x7facf4164f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfc7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf4158a70 0x7facf40c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfc7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf40c1cc0 0x7facf4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfc7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf40c0490 con 0x7facf4158a70 2023-10-09T11:59:12.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfc7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf40c12f0 con 0x7facf40c1cc0 2023-10-09T11:59:12.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfc7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40c06e0 con 0x7face0004810 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facf9d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf4158a70 0x7facf40c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facf9d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf4158a70 0x7facf40c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43312/0 (socket says 172.21.15.86:43312) 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facf9d9a700 1 -- 172.21.15.86:0/1760822976 learned_addr learned my addr 172.21.15.86:0/1760822976 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfad9c700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf40c1cc0 0x7facf4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.054+0000 7facfa59b700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face0004810 0x7facf4164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facf9d9a700 1 -- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face0004810 msgr2=0x7facf4164f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facf9d9a700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face0004810 0x7facf4164f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facf9d9a700 1 -- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf40c1cc0 msgr2=0x7facf4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facf9d9a700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf40c1cc0 0x7facf4152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facf9d9a700 1 -- 172.21.15.86:0/1760822976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40c09c0 con 0x7facf4158a70 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facf9d9a700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf4158a70 0x7facf40c1780 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7face000bb10 tx=0x7face4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facea7fc700 1 -- 172.21.15.86:0/1760822976 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400c3f0 con 0x7facf4158a70 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facea7fc700 1 -- 172.21.15.86:0/1760822976 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400cab0 con 0x7facf4158a70 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facea7fc700 1 -- 172.21.15.86:0/1760822976 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4006a70 con 0x7facf4158a70 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf40c0ca0 con 0x7facf4158a70 2023-10-09T11:59:12.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.055+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf4157dc0 con 0x7facf4158a70 2023-10-09T11:59:12.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.056+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf40c1460 con 0x7facf4158a70 2023-10-09T11:59:12.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.057+0000 7facea7fc700 1 -- 172.21.15.86:0/1760822976 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 52) v1 ==== 84578+0+0 (secure 0 0 0) 0x7face4019070 con 0x7facf4158a70 2023-10-09T11:59:12.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.058+0000 7facea7fc700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facd8066d80 0x7facd8069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:12.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.059+0000 7facea7fc700 1 -- 172.21.15.86:0/1760822976 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6360+0+0 (secure 0 0 0) 0x7face4085d10 con 0x7facf4158a70 2023-10-09T11:59:12.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.059+0000 7facfa59b700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facd8066d80 0x7facd8069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:12.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.059+0000 7facfa59b700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facd8066d80 0x7facd8069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7facf0006f00 tx=0x7facf00091a0 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:12.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.063+0000 7facea7fc700 1 -- 172.21.15.86:0/1760822976 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face408b020 con 0x7facf4158a70 2023-10-09T11:59:12.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.261+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7facf40718b0 con 0x7facf4158a70 2023-10-09T11:59:12.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.845+0000 7facea7fc700 1 -- 172.21.15.86:0/1760822976 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v115) v1 ==== 169+0+0 (secure 0 0 0) 0x7face40170d0 con 0x7facf4158a70 2023-10-09T11:59:12.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facd8066d80 msgr2=0x7facd8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:12.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facd8066d80 0x7facd8069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7facf0006f00 tx=0x7facf00091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf4158a70 msgr2=0x7facf40c1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:12.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf4158a70 0x7facf40c1780 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7face000bb10 tx=0x7face4015000 comp rx=0 tx=0).stop 2023-10-09T11:59:12.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 shutdown_connections 2023-10-09T11:59:12.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf40c1cc0 0x7facf4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face0004810 0x7facf4164f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facd8066d80 0x7facd8069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 --2- 172.21.15.86:0/1760822976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facf4158a70 0x7facf40c1780 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:12.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 >> 172.21.15.86:0/1760822976 conn(0x7facf40c8f90 msgr2=0x7facf40ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:12.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 shutdown_connections 2023-10-09T11:59:12.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:12.850+0000 7facfc7ff700 1 -- 172.21.15.86:0/1760822976 wait complete. 2023-10-09T11:59:12.854 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T11:59:12.871 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T11:59:13.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.059+0000 7f275d1ff700 1 Processor -- start 2023-10-09T11:59:13.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.059+0000 7f275d1ff700 1 -- start start 2023-10-09T11:59:13.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.060+0000 7f275d1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27580c83f0 0x7f27580c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.060+0000 7f275d1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580ccee0 0x7f27581561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f275d1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275815b0d0 con 0x7f27580c87c0 2023-10-09T11:59:13.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f275d1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580c7a60 con 0x7f27580c83f0 2023-10-09T11:59:13.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f275d1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275815a4c0 con 0x7f27580ccee0 2023-10-09T11:59:13.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27580c83f0 0x7f27580c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27580c83f0 0x7f27580c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43328/0 (socket says 172.21.15.86:43328) 2023-10-09T11:59:13.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 -- 172.21.15.86:0/2086098695 learned_addr learned my addr 172.21.15.86:0/2086098695 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:13.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 -- 172.21.15.86:0/2086098695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580ccee0 msgr2=0x7f27581561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:13.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 --2- 172.21.15.86:0/2086098695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580ccee0 0x7f27581561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 -- 172.21.15.86:0/2086098695 >> v1:172.21.15.135:6789/0 conn(0x7f27580c87c0 legacy=0x7f275806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:13.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 -- 172.21.15.86:0/2086098695 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275815a7a0 con 0x7f27580c83f0 2023-10-09T11:59:13.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.061+0000 7f2756d9d700 1 --2- 172.21.15.86:0/2086098695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f27580c7520 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f27480099b0 tx=0x7f2748009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffedf0e4bd2a0d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f2755d9b700 1 -- 172.21.15.86:0/2086098695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800b820 con 0x7f27580c83f0 2023-10-09T11:59:13.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f2755d9b700 1 -- 172.21.15.86:0/2086098695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800b980 con 0x7f27580c83f0 2023-10-09T11:59:13.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f2755d9b700 1 -- 172.21.15.86:0/2086098695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800bd20 con 0x7f27580c83f0 2023-10-09T11:59:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 -- 172.21.15.86:0/2086098695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 msgr2=0x7f27580c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 --2- 172.21.15.86:0/2086098695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f27580c7520 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f27480099b0 tx=0x7f2748009250 comp rx=0 tx=0).stop 2023-10-09T11:59:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 -- 172.21.15.86:0/2086098695 shutdown_connections 2023-10-09T11:59:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 --2- 172.21.15.86:0/2086098695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f27580c7520 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 --2- 172.21.15.86:0/2086098695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580ccee0 0x7f27581561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 -- 172.21.15.86:0/2086098695 >> 172.21.15.86:0/2086098695 conn(0x7f2758068e10 msgr2=0x7f27580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 -- 172.21.15.86:0/2086098695 shutdown_connections 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.062+0000 7f275d1ff700 1 -- 172.21.15.86:0/2086098695 wait complete. 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.064+0000 7f275d1ff700 1 Processor -- start 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.064+0000 7f275d1ff700 1 -- start start 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275d1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f2758152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275d1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580c87c0 0x7f2758154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275d1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27580ccee0 0x7f2758158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275d1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275816d430 con 0x7f27580c83f0 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275d1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275816b210 con 0x7f27580ccee0 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275d1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27581512d0 con 0x7f27580c87c0 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f2756d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f2758152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f2756d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f2758152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43338/0 (socket says 172.21.15.86:43338) 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f2756d9d700 1 -- 172.21.15.86:0/21603972 learned_addr learned my addr 172.21.15.86:0/21603972 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f2756d9d700 1 -- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580c87c0 msgr2=0x7f2758154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275759e700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27580ccee0 0x7f2758158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.065+0000 7f275659c700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580c87c0 0x7f2758154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f2756d9d700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580c87c0 0x7f2758154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f2756d9d700 1 -- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27580ccee0 msgr2=0x7f2758158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f2756d9d700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27580ccee0 0x7f2758158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f2756d9d700 1 -- 172.21.15.86:0/21603972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480094f0 con 0x7f27580c83f0 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f275759e700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27580ccee0 0x7f2758158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f275659c700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580c87c0 0x7f2758154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f2756d9d700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f2758152e30 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2748009290 tx=0x7f2748016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f273effd700 1 -- 172.21.15.86:0/21603972 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748026480 con 0x7f27580c83f0 2023-10-09T11:59:13.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f273effd700 1 -- 172.21.15.86:0/21603972 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274801f070 con 0x7f27580c83f0 2023-10-09T11:59:13.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27581515b0 con 0x7f27580c83f0 2023-10-09T11:59:13.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f273effd700 1 -- 172.21.15.86:0/21603972 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748026870 con 0x7f27580c83f0 2023-10-09T11:59:13.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.066+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2758151bf0 con 0x7f27580c83f0 2023-10-09T11:59:13.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.067+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804c3c0 con 0x7f27580c83f0 2023-10-09T11:59:13.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.068+0000 7f273effd700 1 -- 172.21.15.86:0/21603972 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 52) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f274801a440 con 0x7f27580c83f0 2023-10-09T11:59:13.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.069+0000 7f273effd700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744066d80 0x7f2744069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.069+0000 7f273effd700 1 -- 172.21.15.86:0/21603972 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7f2748021070 con 0x7f27580c83f0 2023-10-09T11:59:13.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.069+0000 7f275659c700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744066d80 0x7f2744069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.070+0000 7f275659c700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744066d80 0x7f2744069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2758151f00 tx=0x7f274c008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.073+0000 7f273effd700 1 -- 172.21.15.86:0/21603972 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27480538c0 con 0x7f27580c83f0 2023-10-09T11:59:13.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.264+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f275815aa80 con 0x7f27580c83f0 2023-10-09T11:59:13.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.268+0000 7f273effd700 1 -- 172.21.15.86:0/21603972 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v37) v1 ==== 115+0+0 (secure 0 0 0) 0x7f2748056ee0 con 0x7f27580c83f0 2023-10-09T11:59:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744066d80 msgr2=0x7f2744069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744066d80 0x7f2744069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2758151f00 tx=0x7f274c008040 comp rx=0 tx=0).stop 2023-10-09T11:59:13.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 msgr2=0x7f2758152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f2758152e30 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2748009290 tx=0x7f2748016000 comp rx=0 tx=0).stop 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 shutdown_connections 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744066d80 0x7f2744069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27580c83f0 0x7f2758152e30 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27580ccee0 0x7f2758158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 --2- 172.21.15.86:0/21603972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27580c87c0 0x7f2758154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 >> 172.21.15.86:0/21603972 conn(0x7f2758068e10 msgr2=0x7f275814ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:13.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 shutdown_connections 2023-10-09T11:59:13.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.271+0000 7f275d1ff700 1 -- 172.21.15.86:0/21603972 wait complete. 2023-10-09T11:59:13.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T11:59:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.474+0000 7f7b4559d700 1 Processor -- start 2023-10-09T11:59:13.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.474+0000 7f7b4559d700 1 -- start start 2023-10-09T11:59:13.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.475+0000 7f7b4559d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7b40153900 0x7f7b400c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.475+0000 7f7b4559d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b400c9db0 0x7f7b4006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.475+0000 7f7b4559d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4006e150 con 0x7f7b40157130 2023-10-09T11:59:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.475+0000 7f7b4559d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400c7800 con 0x7f7b400c9db0 2023-10-09T11:59:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.475+0000 7f7b4559d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400c7ae0 con 0x7f7b40153900 2023-10-09T11:59:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.475+0000 7f7b37fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b400c9db0 0x7f7b4006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b37fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b400c9db0 0x7f7b4006a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43352/0 (socket says 172.21.15.86:43352) 2023-10-09T11:59:13.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b37fff700 1 -- 172.21.15.86:0/449060423 learned_addr learned my addr 172.21.15.86:0/449060423 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b37fff700 1 -- 172.21.15.86:0/449060423 >> v2:172.21.15.135:3300/0 conn(0x7f7b40153900 msgr2=0x7f7b400c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b37fff700 1 --2- 172.21.15.86:0/449060423 >> v2:172.21.15.135:3300/0 conn(0x7f7b40153900 0x7f7b400c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b37fff700 1 -- 172.21.15.86:0/449060423 >> v1:172.21.15.86:6789/0 conn(0x7f7b40157130 legacy=0x7f7b40159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b37fff700 1 -- 172.21.15.86:0/449060423 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400c7dc0 con 0x7f7b400c9db0 2023-10-09T11:59:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b37fff700 1 --2- 172.21.15.86:0/449060423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b4006a000 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7b4006aed0 tx=0x7f7b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be36211bae99b665 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b3f7fe700 1 -- 172.21.15.86:0/449060423 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800b860 con 0x7f7b400c9db0 2023-10-09T11:59:13.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b3f7fe700 1 -- 172.21.15.86:0/449060423 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2800b9c0 con 0x7f7b400c9db0 2023-10-09T11:59:13.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.476+0000 7f7b3f7fe700 1 -- 172.21.15.86:0/449060423 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800bd60 con 0x7f7b400c9db0 2023-10-09T11:59:13.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 -- 172.21.15.86:0/449060423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 msgr2=0x7f7b4006a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 --2- 172.21.15.86:0/449060423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b4006a000 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7b4006aed0 tx=0x7f7b28009250 comp rx=0 tx=0).stop 2023-10-09T11:59:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 -- 172.21.15.86:0/449060423 shutdown_connections 2023-10-09T11:59:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 --2- 172.21.15.86:0/449060423 >> v2:172.21.15.135:3300/0 conn(0x7f7b40153900 0x7f7b400c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 --2- 172.21.15.86:0/449060423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b4006a000 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 -- 172.21.15.86:0/449060423 >> 172.21.15.86:0/449060423 conn(0x7f7b400cc1e0 msgr2=0x7f7b400cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:13.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 -- 172.21.15.86:0/449060423 shutdown_connections 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.477+0000 7f7b4559d700 1 -- 172.21.15.86:0/449060423 wait complete. 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.478+0000 7f7b4559d700 1 Processor -- start 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.479+0000 7f7b4559d700 1 -- start start 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.479+0000 7f7b4559d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b40154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b4559d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b40153900 0x7f7b40155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b4559d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b40157130 0x7f7b4015de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b4559d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c2ff0 con 0x7f7b400c9db0 2023-10-09T11:59:13.484 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b4559d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c2b60 con 0x7f7b40157130 2023-10-09T11:59:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b4559d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4016b920 con 0x7f7b40153900 2023-10-09T11:59:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b40154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b40154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43354/0 (socket says 172.21.15.86:43354) 2023-10-09T11:59:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 -- 172.21.15.86:0/3294473598 learned_addr learned my addr 172.21.15.86:0/3294473598 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b37fff700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b40153900 0x7f7b40155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b44d9c700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b40157130 0x7f7b4015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 -- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b40153900 msgr2=0x7f7b40155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b40153900 0x7f7b40155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 -- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b40157130 msgr2=0x7f7b4015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b40157130 0x7f7b4015de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 -- 172.21.15.86:0/3294473598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280094f0 con 0x7f7b400c9db0 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.480+0000 7f7b3ffff700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b40154bd0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000b810 tx=0x7f7b300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.481+0000 7f7b3cff9700 1 -- 172.21.15.86:0/3294473598 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000f570 con 0x7f7b400c9db0 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.481+0000 7f7b3cff9700 1 -- 172.21.15.86:0/3294473598 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3000f6d0 con 0x7f7b400c9db0 2023-10-09T11:59:13.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.481+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b400c19d0 con 0x7f7b400c9db0 2023-10-09T11:59:13.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.481+0000 7f7b3cff9700 1 -- 172.21.15.86:0/3294473598 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000fa90 con 0x7f7b400c9db0 2023-10-09T11:59:13.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.481+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b400c2510 con 0x7f7b400c9db0 2023-10-09T11:59:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.482+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400c2e40 con 0x7f7b400c9db0 2023-10-09T11:59:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.483+0000 7f7b3cff9700 1 -- 172.21.15.86:0/3294473598 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b3001a460 con 0x7f7b400c9db0 2023-10-09T11:59:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.484+0000 7f7b3cff9700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7b20066f30 0x7f7b200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.484+0000 7f7b3cff9700 1 -- 172.21.15.86:0/3294473598 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7f7b30084380 con 0x7f7b400c9db0 2023-10-09T11:59:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.484+0000 7f7b37fff700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7b20066f30 0x7f7b200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.484+0000 7f7b37fff700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7b20066f30 0x7f7b200693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b4006aed0 tx=0x7f7b28018000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.487+0000 7f7b3cff9700 1 -- 172.21.15.86:0/3294473598 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b30051500 con 0x7f7b400c9db0 2023-10-09T11:59:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.677+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7b4006dd20 con 0x7f7b400c9db0 2023-10-09T11:59:13.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.682+0000 7f7b3cff9700 1 -- 172.21.15.86:0/3294473598 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v38) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7b30054b20 con 0x7f7b400c9db0 2023-10-09T11:59:13.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7b20066f30 msgr2=0x7f7b200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7b20066f30 0x7f7b200693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b4006aed0 tx=0x7f7b28018000 comp rx=0 tx=0).stop 2023-10-09T11:59:13.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 msgr2=0x7f7b40154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b40154bd0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000b810 tx=0x7f7b300091d0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 shutdown_connections 2023-10-09T11:59:13.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7b20066f30 0x7f7b200693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b400c9db0 0x7f7b40154bd0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b40157130 0x7f7b4015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 --2- 172.21.15.86:0/3294473598 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b40153900 0x7f7b40155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 >> 172.21.15.86:0/3294473598 conn(0x7f7b400cc1e0 msgr2=0x7f7b4014a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:13.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 shutdown_connections 2023-10-09T11:59:13.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.684+0000 7f7b4559d700 1 -- 172.21.15.86:0/3294473598 wait complete. 2023-10-09T11:59:13.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:59:13.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.884+0000 7f3c7b5ff700 1 Processor -- start 2023-10-09T11:59:13.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.884+0000 7f3c7b5ff700 1 -- start start 2023-10-09T11:59:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c7b5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c740ccee0 0x7f3c741561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c7b5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 0x7f3c74156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c7b5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7415b0d0 con 0x7f3c740c83f0 2023-10-09T11:59:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c7b5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c74156c50 con 0x7f3c740ccee0 2023-10-09T11:59:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c7b5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7415a4c0 con 0x7f3c740c87c0 2023-10-09T11:59:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c7939b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3c740c83f0 0x7f3c740c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60604/0 (socket says 172.21.15.86:60604) 2023-10-09T11:59:13.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c7939b700 1 -- 172.21.15.86:0/2887275206 learned_addr learned my addr 172.21.15.86:0/2887275206 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:13.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c79b9c700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 0x7f3c74156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c78b9a700 1 --2- 172.21.15.86:0/2887275206 >> v2:172.21.15.135:3300/0 conn(0x7f3c740ccee0 0x7f3c741561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638367608 0 0) 0x7f3c7415b0d0 con 0x7f3c740c83f0 2023-10-09T11:59:13.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.886+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c60003570 con 0x7f3c740c83f0 2023-10-09T11:59:13.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1497769506 0 0) 0x7f3c60003570 con 0x7f3c740c83f0 2023-10-09T11:59:13.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 msgr2=0x7f3c74156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:13.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 0x7f3c74156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 >> v2:172.21.15.135:3300/0 conn(0x7f3c740ccee0 msgr2=0x7f3c741561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 --2- 172.21.15.86:0/2887275206 >> v2:172.21.15.135:3300/0 conn(0x7f3c740ccee0 0x7f3c741561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7415a7a0 con 0x7f3c740c83f0 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f3c70001470 con 0x7f3c740c83f0 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 >> v1:172.21.15.86:6789/0 conn(0x7f3c740c83f0 legacy=0x7f3c740c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 0x7f3c60003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c600040b0 0x7f3c60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c60004d50 0x7f3c600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c74156c50 con 0x7f3c600040b0 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7415a4c0 con 0x7f3c60004d50 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6000dd70 con 0x7f3c740c87c0 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c78b9a700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c600040b0 0x7f3c60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c7939b700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 0x7f3c60003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c79b9c700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c60004d50 0x7f3c600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c78b9a700 1 -- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 msgr2=0x7f3c60003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c78b9a700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 0x7f3c60003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c78b9a700 1 -- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c60004d50 msgr2=0x7f3c600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c78b9a700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c60004d50 0x7f3c600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c78b9a700 1 -- 172.21.15.86:0/2887275206 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60003570 con 0x7f3c600040b0 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c7939b700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c87c0 0x7f3c60003ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.887+0000 7f3c79b9c700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c60004d50 0x7f3c600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c78b9a700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c600040b0 0x7f3c60004810 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3c64006f00 tx=0x7f3c640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678a81d54e7b3905 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400e710 con 0x7f3c600040b0 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400e870 con 0x7f3c600040b0 2023-10-09T11:59:13.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c6bfff700 1 -- 172.21.15.86:0/2887275206 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400ec30 con 0x7f3c600040b0 2023-10-09T11:59:13.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/2887275206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c600040b0 msgr2=0x7f3c60004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c7b5ff700 1 --2- 172.21.15.86:0/2887275206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c600040b0 0x7f3c60004810 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3c64006f00 tx=0x7f3c640091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c79b9c700 1 -- 172.21.15.86:0/2887275206 reap_dead start 2023-10-09T11:59:13.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/2887275206 shutdown_connections 2023-10-09T11:59:13.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.888+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/2887275206 >> 172.21.15.86:0/2887275206 conn(0x7f3c74068e10 msgr2=0x7f3c740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:13.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.889+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/2887275206 shutdown_connections 2023-10-09T11:59:13.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.889+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/2887275206 wait complete. 2023-10-09T11:59:13.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.890+0000 7f3c7b5ff700 1 Processor -- start 2023-10-09T11:59:13.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.890+0000 7f3c7b5ff700 1 -- start start 2023-10-09T11:59:13.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c7b5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c600040b0 0x7f3c740c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c7b5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c35e0 0x7f3c74143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c7b5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c740ca100 0x7f3c740ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c7b5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7416a000 con 0x7f3c740ca100 2023-10-09T11:59:13.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c7b5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7416e3d0 con 0x7f3c600040b0 2023-10-09T11:59:13.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c7b5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740caa70 con 0x7f3c740c35e0 2023-10-09T11:59:13.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c79b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c740ca100 0x7f3c740ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c79b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c740ca100 0x7f3c740ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43374/0 (socket says 172.21.15.86:43374) 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c79b9c700 1 -- 172.21.15.86:0/3733123755 learned_addr learned my addr 172.21.15.86:0/3733123755 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c7939b700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c600040b0 0x7f3c740c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.891+0000 7f3c78b9a700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c35e0 0x7f3c74143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c79b9c700 1 -- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c35e0 msgr2=0x7f3c74143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c79b9c700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c35e0 0x7f3c74143e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c79b9c700 1 -- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c600040b0 msgr2=0x7f3c740c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:13.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c79b9c700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c600040b0 0x7f3c740c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c79b9c700 1 -- 172.21.15.86:0/3733123755 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7416d7c0 con 0x7f3c740ca100 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c79b9c700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c740ca100 0x7f3c740ca530 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3c7406fdc0 tx=0x7f3c6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c697fa700 1 -- 172.21.15.86:0/3733123755 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c01b070 con 0x7f3c740ca100 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c697fa700 1 -- 172.21.15.86:0/3733123755 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00f040 con 0x7f3c740ca100 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7416daa0 con 0x7f3c740ca100 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c697fa700 1 -- 172.21.15.86:0/3733123755 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00e050 con 0x7f3c740ca100 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.892+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7416e060 con 0x7f3c740ca100 2023-10-09T11:59:13.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.893+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7416e540 con 0x7f3c740ca100 2023-10-09T11:59:13.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.894+0000 7f3c697fa700 1 -- 172.21.15.86:0/3733123755 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c6c003020 con 0x7f3c740ca100 2023-10-09T11:59:13.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.895+0000 7f3c697fa700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c58066f30 0x7f3c580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:13.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.895+0000 7f3c697fa700 1 -- 172.21.15.86:0/3733123755 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7f3c6c0849b0 con 0x7f3c740ca100 2023-10-09T11:59:13.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.895+0000 7f3c7939b700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c58066f30 0x7f3c580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:13.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.896+0000 7f3c7939b700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c58066f30 0x7f3c580693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c70005e20 tx=0x7f3c70007040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:13.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:13.900+0000 7f3c697fa700 1 -- 172.21.15.86:0/3733123755 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c6c051ab0 con 0x7f3c740ca100 2023-10-09T11:59:14.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.088+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3c7404c3c0 con 0x7f3c740ca100 2023-10-09T11:59:14.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.093+0000 7f3c697fa700 1 -- 172.21.15.86:0/3733123755 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3c6c0550d0 con 0x7f3c740ca100 2023-10-09T11:59:14.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c58066f30 msgr2=0x7f3c580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c58066f30 0x7f3c580693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c70005e20 tx=0x7f3c70007040 comp rx=0 tx=0).stop 2023-10-09T11:59:14.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c740ca100 msgr2=0x7f3c740ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c740ca100 0x7f3c740ca530 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3c7406fdc0 tx=0x7f3c6c00b040 comp rx=0 tx=0).stop 2023-10-09T11:59:14.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 shutdown_connections 2023-10-09T11:59:14.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c58066f30 0x7f3c580693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c740ca100 0x7f3c740ca530 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c600040b0 0x7f3c740c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 --2- 172.21.15.86:0/3733123755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c740c35e0 0x7f3c74143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 >> 172.21.15.86:0/3733123755 conn(0x7f3c74068e10 msgr2=0x7f3c74151cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:14.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 shutdown_connections 2023-10-09T11:59:14.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.096+0000 7f3c7b5ff700 1 -- 172.21.15.86:0/3733123755 wait complete. 2023-10-09T11:59:14.115 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-09T11:59:14.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.295+0000 7f1e1a9ff700 1 Processor -- start 2023-10-09T11:59:14.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.296+0000 7f1e1a9ff700 1 -- start start 2023-10-09T11:59:14.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e1a9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e140b1850 0x7f1e140b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:14.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e1a9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1e141579f0 0x7f1e140abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:14.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e1a9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140cb300 con 0x7f1e140ae680 2023-10-09T11:59:14.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e1a9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1406fc30 con 0x7f1e140b1850 2023-10-09T11:59:14.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e1a9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140cc260 con 0x7f1e141579f0 2023-10-09T11:59:14.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e13fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e140b1850 0x7f1e140b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:14.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e13fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e140b1850 0x7f1e140b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43376/0 (socket says 172.21.15.86:43376) 2023-10-09T11:59:14.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e13fff700 1 -- 172.21.15.86:0/2137684022 learned_addr learned my addr 172.21.15.86:0/2137684022 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.297+0000 7f1e0bfff700 1 --1- 172.21.15.86:0/2137684022 >> v1:172.21.15.86:6789/0 conn(0x7f1e140ae680 0x7f1e141572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60608/0 (socket says 172.21.15.86:60608) 2023-10-09T11:59:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e18f9c700 1 --2- 172.21.15.86:0/2137684022 >> v2:172.21.15.135:3300/0 conn(0x7f1e141579f0 0x7f1e140abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e13fff700 1 -- 172.21.15.86:0/2137684022 >> v2:172.21.15.135:3300/0 conn(0x7f1e141579f0 msgr2=0x7f1e140abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e13fff700 1 --2- 172.21.15.86:0/2137684022 >> v2:172.21.15.135:3300/0 conn(0x7f1e141579f0 0x7f1e140abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e13fff700 1 -- 172.21.15.86:0/2137684022 >> v1:172.21.15.86:6789/0 conn(0x7f1e140ae680 legacy=0x7f1e141572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e13fff700 1 -- 172.21.15.86:0/2137684022 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140cb5e0 con 0x7f1e140b1850 2023-10-09T11:59:14.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e18f9c700 1 --2- 172.21.15.86:0/2137684022 >> v2:172.21.15.135:3300/0 conn(0x7f1e141579f0 0x7f1e140abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e13fff700 1 --2- 172.21.15.86:0/2137684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e140b1850 0x7f1e140b1c20 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f1e140cc160 tx=0x7f1e04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b446b3bc4df6b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e137fe700 1 -- 172.21.15.86:0/2137684022 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400b860 con 0x7f1e140b1850 2023-10-09T11:59:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e137fe700 1 -- 172.21.15.86:0/2137684022 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0400b9c0 con 0x7f1e140b1850 2023-10-09T11:59:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.298+0000 7f1e137fe700 1 -- 172.21.15.86:0/2137684022 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400bd60 con 0x7f1e140b1850 2023-10-09T11:59:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/2137684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e140b1850 msgr2=0x7f1e140b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/2137684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e140b1850 0x7f1e140b1c20 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f1e140cc160 tx=0x7f1e04009250 comp rx=0 tx=0).stop 2023-10-09T11:59:14.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/2137684022 shutdown_connections 2023-10-09T11:59:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/2137684022 >> v2:172.21.15.135:3300/0 conn(0x7f1e141579f0 0x7f1e140abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/2137684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e140b1850 0x7f1e140b1c20 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/2137684022 >> 172.21.15.86:0/2137684022 conn(0x7f1e1406a320 msgr2=0x7f1e140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/2137684022 shutdown_connections 2023-10-09T11:59:14.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.299+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/2137684022 wait complete. 2023-10-09T11:59:14.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.300+0000 7f1e1a9ff700 1 Processor -- start 2023-10-09T11:59:14.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.301+0000 7f1e1a9ff700 1 -- start start 2023-10-09T11:59:14.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.301+0000 7f1e1a9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e140ae680 0x7f1e14144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:14.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.301+0000 7f1e1a9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e140b1850 0x7f1e1406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:14.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.301+0000 7f1e1a9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e141579f0 0x7f1e1406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:14.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.301+0000 7f1e1a9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415b2e0 con 0x7f1e141579f0 2023-10-09T11:59:14.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.301+0000 7f1e1a9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415a450 con 0x7f1e140ae680 2023-10-09T11:59:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.301+0000 7f1e1a9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415a730 con 0x7f1e140b1850 2023-10-09T11:59:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e141579f0 0x7f1e1406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e141579f0 0x7f1e1406f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43388/0 (socket says 172.21.15.86:43388) 2023-10-09T11:59:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 -- 172.21.15.86:0/3614803085 learned_addr learned my addr 172.21.15.86:0/3614803085 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e0bfff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e140b1850 0x7f1e1406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e13fff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e140ae680 0x7f1e14144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:14.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 -- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e140b1850 msgr2=0x7f1e1406eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e140b1850 0x7f1e1406eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 -- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e140ae680 msgr2=0x7f1e14144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e140ae680 0x7f1e14144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 -- 172.21.15.86:0/3614803085 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040094f0 con 0x7f1e141579f0 2023-10-09T11:59:14.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.302+0000 7f1e18f9c700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e141579f0 0x7f1e1406f3f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00cef0 tx=0x7f1e0c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:14.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.303+0000 7f1e10ff9700 1 -- 172.21.15.86:0/3614803085 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00ad20 con 0x7f1e141579f0 2023-10-09T11:59:14.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.303+0000 7f1e10ff9700 1 -- 172.21.15.86:0/3614803085 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c016420 con 0x7f1e141579f0 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.303+0000 7f1e10ff9700 1 -- 172.21.15.86:0/3614803085 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00aea0 con 0x7f1e141579f0 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.303+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1415aa10 con 0x7f1e141579f0 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.303+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e14145280 con 0x7f1e141579f0 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.304+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1404c3c0 con 0x7f1e141579f0 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.305+0000 7f1e10ff9700 1 -- 172.21.15.86:0/3614803085 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e0c016a70 con 0x7f1e141579f0 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.305+0000 7f1e10ff9700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1df4066f30 0x7f1df40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.305+0000 7f1e10ff9700 1 -- 172.21.15.86:0/3614803085 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7f1e0c012070 con 0x7f1e141579f0 2023-10-09T11:59:14.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.306+0000 7f1e13fff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1df4066f30 0x7f1df40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:14.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.306+0000 7f1e13fff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1df4066f30 0x7f1df40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e140cc160 tx=0x7f1e04017000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:14.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.310+0000 7f1e10ff9700 1 -- 172.21.15.86:0/3614803085 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e0c04e5a0 con 0x7f1e141579f0 2023-10-09T11:59:14.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.577+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f1e140cb8c0 con 0x7f1e141579f0 2023-10-09T11:59:14.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.849+0000 7f1e10ff9700 1 -- 172.21.15.86:0/3614803085 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v672) v1 ==== 183+0+0 (secure 0 0 0) 0x7f1e0c055a50 con 0x7f1e141579f0 2023-10-09T11:59:14.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1df4066f30 msgr2=0x7f1df40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1df4066f30 0x7f1df40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e140cc160 tx=0x7f1e04017000 comp rx=0 tx=0).stop 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e141579f0 msgr2=0x7f1e1406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e141579f0 0x7f1e1406f3f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00cef0 tx=0x7f1e0c007860 comp rx=0 tx=0).stop 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 shutdown_connections 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1df4066f30 0x7f1df40693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e141579f0 0x7f1e1406f3f0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e140ae680 0x7f1e14144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 --2- 172.21.15.86:0/3614803085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e140b1850 0x7f1e1406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 >> 172.21.15.86:0/3614803085 conn(0x7f1e1406a320 msgr2=0x7f1e14153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:14.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 shutdown_connections 2023-10-09T11:59:14.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:14.852+0000 7f1e1a9ff700 1 -- 172.21.15.86:0/3614803085 wait complete. 2023-10-09T11:59:14.871 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-10-09T11:59:14.871 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-10-09T11:59:14.871 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T11:59:14.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-09T11:59:15.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.052+0000 7fb29e19d700 1 Processor -- start 2023-10-09T11:59:15.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.052+0000 7fb29e19d700 1 -- start start 2023-10-09T11:59:15.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29e19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb298150180 0x7fb298157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:15.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29e19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb298069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:15.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29e19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29806e2a0 con 0x7fb298150550 2023-10-09T11:59:15.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29e19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29806b2e0 con 0x7fb298150180 2023-10-09T11:59:15.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29e19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980c78e0 con 0x7fb2980c7410 2023-10-09T11:59:15.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d19b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb298150180 0x7fb298157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:15.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d19b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb298150180 0x7fb298157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42254/0 (socket says 172.21.15.86:42254) 2023-10-09T11:59:15.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d19b700 1 -- 172.21.15.86:0/701809821 learned_addr learned my addr 172.21.15.86:0/701809821 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:15.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d19b700 1 -- 172.21.15.86:0/701809821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 msgr2=0x7fb298069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:15.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d99c700 1 --2- 172.21.15.86:0/701809821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb298069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:15.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d19b700 1 --2- 172.21.15.86:0/701809821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb298069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d19b700 1 -- 172.21.15.86:0/701809821 >> v1:172.21.15.135:6789/0 conn(0x7fb298150550 legacy=0x7fb2980c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d19b700 1 -- 172.21.15.86:0/701809821 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2980c7bc0 con 0x7fb298150180 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.054+0000 7fb29d99c700 1 --2- 172.21.15.86:0/701809821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb298069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb29d19b700 1 --2- 172.21.15.86:0/701809821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb298157770 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb2940099b0 tx=0x7fb294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c36352c44e9a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb28ffff700 1 -- 172.21.15.86:0/701809821 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400b820 con 0x7fb298150180 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb28ffff700 1 -- 172.21.15.86:0/701809821 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400b980 con 0x7fb298150180 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb28ffff700 1 -- 172.21.15.86:0/701809821 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400bd20 con 0x7fb298150180 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb29e19d700 1 -- 172.21.15.86:0/701809821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 msgr2=0x7fb298157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:15.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb29e19d700 1 --2- 172.21.15.86:0/701809821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb298157770 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb2940099b0 tx=0x7fb294009250 comp rx=0 tx=0).stop 2023-10-09T11:59:15.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb29e19d700 1 -- 172.21.15.86:0/701809821 shutdown_connections 2023-10-09T11:59:15.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb29e19d700 1 --2- 172.21.15.86:0/701809821 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb298069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb29e19d700 1 --2- 172.21.15.86:0/701809821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb298157770 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.055+0000 7fb29e19d700 1 -- 172.21.15.86:0/701809821 >> 172.21.15.86:0/701809821 conn(0x7fb2980cc1f0 msgr2=0x7fb2980cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:15.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.056+0000 7fb29e19d700 1 -- 172.21.15.86:0/701809821 shutdown_connections 2023-10-09T11:59:15.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.056+0000 7fb29e19d700 1 -- 172.21.15.86:0/701809821 wait complete. 2023-10-09T11:59:15.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.057+0000 7fb29e19d700 1 Processor -- start 2023-10-09T11:59:15.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.057+0000 7fb29e19d700 1 -- start start 2023-10-09T11:59:15.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29e19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb29814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:15.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29e19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb2980aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29e19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb298150550 0x7fb298160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29e19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980ada30 con 0x7fb298150180 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29e19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29814f260 con 0x7fb298150550 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29e19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980b1760 con 0x7fb2980c7410 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29c99a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb2980aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29c99a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb2980aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42256/0 (socket says 172.21.15.86:42256) 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.058+0000 7fb29c99a700 1 -- 172.21.15.86:0/4133041184 learned_addr learned my addr 172.21.15.86:0/4133041184 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29c99a700 1 -- 172.21.15.86:0/4133041184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 msgr2=0x7fb29814b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29c99a700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb29814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29c99a700 1 -- 172.21.15.86:0/4133041184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb298150550 msgr2=0x7fb298160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29c99a700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb298150550 0x7fb298160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29c99a700 1 -- 172.21.15.86:0/4133041184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940094f0 con 0x7fb298150180 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29c99a700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb2980aef90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb28800b5e0 tx=0x7fb288009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb28d7fa700 1 -- 172.21.15.86:0/4133041184 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800f510 con 0x7fb298150180 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb28d7fa700 1 -- 172.21.15.86:0/4133041184 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800f670 con 0x7fb298150180 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2980b1a40 con 0x7fb298150180 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb28d7fa700 1 -- 172.21.15.86:0/4133041184 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800fa30 con 0x7fb298150180 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.059+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2980ad6c0 con 0x7fb298150180 2023-10-09T11:59:15.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.060+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29804c3c0 con 0x7fb298150180 2023-10-09T11:59:15.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.061+0000 7fb28d7fa700 1 -- 172.21.15.86:0/4133041184 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb28801a400 con 0x7fb298150180 2023-10-09T11:59:15.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.062+0000 7fb28d7fa700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:15.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.062+0000 7fb28d7fa700 1 -- 172.21.15.86:0/4133041184 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7fb2880841d0 con 0x7fb298150180 2023-10-09T11:59:15.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.062+0000 7fb29d19b700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:15.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.063+0000 7fb29d19b700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2940099b0 tx=0x7fb294016000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:15.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.066+0000 7fb28d7fa700 1 -- 172.21.15.86:0/4133041184 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb288051350 con 0x7fb298150180 2023-10-09T11:59:15.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.333+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fb29806ada0 con 0x7fb298150180 2023-10-09T11:59:15.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.854+0000 7fb28d7fa700 1 -- 172.21.15.86:0/4133041184 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v673) v1 ==== 151+0+0 (secure 0 0 0) 0x7fb288054970 con 0x7fb298150180 2023-10-09T11:59:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.856+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 msgr2=0x7fb27c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:15.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.856+0000 7fb29e19d700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2940099b0 tx=0x7fb294016000 comp rx=0 tx=0).stop 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.856+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 msgr2=0x7fb2980aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.856+0000 7fb29e19d700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb2980aef90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb28800b5e0 tx=0x7fb288009120 comp rx=0 tx=0).stop 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 shutdown_connections 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb298150550 0x7fb298160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2980c7410 0x7fb29814b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 --2- 172.21.15.86:0/4133041184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb298150180 0x7fb2980aef90 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 >> 172.21.15.86:0/4133041184 conn(0x7fb2980cc1f0 msgr2=0x7fb298157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:15.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 shutdown_connections 2023-10-09T11:59:15.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:15.857+0000 7fb29e19d700 1 -- 172.21.15.86:0/4133041184 wait complete. 2023-10-09T11:59:15.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:59:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.061+0000 7f3aad59d700 1 Processor -- start 2023-10-09T11:59:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.062+0000 7f3aad59d700 1 -- start start 2023-10-09T11:59:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aad59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3aa806f060 0x7f3aa80ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aad59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3aa806f4b0 0x7f3aa80ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aad59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa806ebd0 con 0x7f3aa80cb1a0 2023-10-09T11:59:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aad59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa815b2e0 con 0x7f3aa806f4b0 2023-10-09T11:59:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aad59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa815aa70 con 0x7f3aa806f060 2023-10-09T11:59:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aacd9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3aa806f4b0 0x7f3aa80ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aacd9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3aa806f4b0 0x7f3aa80ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42258/0 (socket says 172.21.15.86:42258) 2023-10-09T11:59:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.063+0000 7f3aacd9c700 1 -- 172.21.15.86:0/447578483 learned_addr learned my addr 172.21.15.86:0/447578483 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aa77fe700 1 --2- 172.21.15.86:0/447578483 >> v2:172.21.15.135:3300/0 conn(0x7f3aa806f060 0x7f3aa80ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aacd9c700 1 -- 172.21.15.86:0/447578483 >> v2:172.21.15.135:3300/0 conn(0x7f3aa806f060 msgr2=0x7f3aa80ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aacd9c700 1 --2- 172.21.15.86:0/447578483 >> v2:172.21.15.135:3300/0 conn(0x7f3aa806f060 0x7f3aa80ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aacd9c700 1 -- 172.21.15.86:0/447578483 >> v1:172.21.15.135:6789/0 conn(0x7f3aa80cb1a0 legacy=0x7f3aa815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aacd9c700 1 -- 172.21.15.86:0/447578483 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa815ad20 con 0x7f3aa806f4b0 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aacd9c700 1 --2- 172.21.15.86:0/447578483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f4b0 0x7f3aa80ae610 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8070d30 tx=0x7f3aa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677587a58c6498b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aa6ffd700 1 -- 172.21.15.86:0/447578483 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000e070 con 0x7f3aa806f4b0 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aa6ffd700 1 -- 172.21.15.86:0/447578483 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa000baa0 con 0x7f3aa806f4b0 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.064+0000 7f3aa6ffd700 1 -- 172.21.15.86:0/447578483 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00092e0 con 0x7f3aa806f4b0 2023-10-09T11:59:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 -- 172.21.15.86:0/447578483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f4b0 msgr2=0x7f3aa80ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 --2- 172.21.15.86:0/447578483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f4b0 0x7f3aa80ae610 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8070d30 tx=0x7f3aa0009840 comp rx=0 tx=0).stop 2023-10-09T11:59:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 -- 172.21.15.86:0/447578483 shutdown_connections 2023-10-09T11:59:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 --2- 172.21.15.86:0/447578483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f4b0 0x7f3aa80ae610 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 --2- 172.21.15.86:0/447578483 >> v2:172.21.15.135:3300/0 conn(0x7f3aa806f060 0x7f3aa80ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 -- 172.21.15.86:0/447578483 >> 172.21.15.86:0/447578483 conn(0x7f3aa80cc1e0 msgr2=0x7f3aa80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 -- 172.21.15.86:0/447578483 shutdown_connections 2023-10-09T11:59:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.065+0000 7f3aad59d700 1 -- 172.21.15.86:0/447578483 wait complete. 2023-10-09T11:59:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.066+0000 7f3aad59d700 1 Processor -- start 2023-10-09T11:59:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.066+0000 7f3aad59d700 1 -- start start 2023-10-09T11:59:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.067+0000 7f3aad59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f060 0x7f3aa8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.067+0000 7f3aad59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa806f4b0 0x7f3aa81572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.067+0000 7f3aad59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa80cb1a0 0x7f3aa81577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.067+0000 7f3aad59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80c7ca0 con 0x7f3aa806f060 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.067+0000 7f3aad59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80c7f80 con 0x7f3aa806f4b0 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.067+0000 7f3aad59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80c3290 con 0x7f3aa80cb1a0 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f060 0x7f3aa8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f060 0x7f3aa8156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42272/0 (socket says 172.21.15.86:42272) 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 -- 172.21.15.86:0/3410125083 learned_addr learned my addr 172.21.15.86:0/3410125083 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa77fe700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa806f4b0 0x7f3aa81572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aacd9c700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa80cb1a0 0x7f3aa81577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 -- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa80cb1a0 msgr2=0x7f3aa81577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa80cb1a0 0x7f3aa81577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 -- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa806f4b0 msgr2=0x7f3aa81572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa806f4b0 0x7f3aa81572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 -- 172.21.15.86:0/3410125083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0009ae0 con 0x7f3aa806f060 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aacd9c700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa80cb1a0 0x7f3aa81577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa77fe700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa806f4b0 0x7f3aa81572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aa7fff700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f060 0x7f3aa8156d60 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800b5e0 tx=0x7f3a98009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:16.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3a8ffff700 1 -- 172.21.15.86:0/3410125083 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800f510 con 0x7f3aa806f060 2023-10-09T11:59:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3a8ffff700 1 -- 172.21.15.86:0/3410125083 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800f670 con 0x7f3aa806f060 2023-10-09T11:59:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.068+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa80c3570 con 0x7f3aa806f060 2023-10-09T11:59:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.069+0000 7f3a8ffff700 1 -- 172.21.15.86:0/3410125083 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800fa30 con 0x7f3aa806f060 2023-10-09T11:59:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.069+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa8158390 con 0x7f3aa806f060 2023-10-09T11:59:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.070+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa80c3a90 con 0x7f3aa806f060 2023-10-09T11:59:16.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.070+0000 7f3a8ffff700 1 -- 172.21.15.86:0/3410125083 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a9801a400 con 0x7f3aa806f060 2023-10-09T11:59:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.071+0000 7f3a8ffff700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a94066f30 0x7f3a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.071+0000 7f3a8ffff700 1 -- 172.21.15.86:0/3410125083 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7f3a980841b0 con 0x7f3aa806f060 2023-10-09T11:59:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.071+0000 7f3aa77fe700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a94066f30 0x7f3a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.072+0000 7f3aa77fe700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a94066f30 0x7f3a940693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3aa815a280 tx=0x7f3a9c008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:16.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.075+0000 7f3a8ffff700 1 -- 172.21.15.86:0/3410125083 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aa80c3a90 con 0x7f3aa806f060 2023-10-09T11:59:16.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.264+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3aa80c3a90 con 0x7f3aa806f060 2023-10-09T11:59:16.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.270+0000 7f3a8ffff700 1 -- 172.21.15.86:0/3410125083 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3a98051330 con 0x7f3aa806f060 2023-10-09T11:59:16.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a94066f30 msgr2=0x7f3a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a94066f30 0x7f3a940693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3aa815a280 tx=0x7f3a9c008040 comp rx=0 tx=0).stop 2023-10-09T11:59:16.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f060 msgr2=0x7f3aa8156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f060 0x7f3aa8156d60 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800b5e0 tx=0x7f3a98009120 comp rx=0 tx=0).stop 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 shutdown_connections 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a94066f30 0x7f3a940693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa806f060 0x7f3aa8156d60 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa80cb1a0 0x7f3aa81577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 --2- 172.21.15.86:0/3410125083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa806f4b0 0x7f3aa81572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 >> 172.21.15.86:0/3410125083 conn(0x7f3aa80cc1e0 msgr2=0x7f3aa8155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.272+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 shutdown_connections 2023-10-09T11:59:16.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.273+0000 7f3aad59d700 1 -- 172.21.15.86:0/3410125083 wait complete. 2023-10-09T11:59:16.291 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:59:16.292 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:59:16.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:59:16.458 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:59:16.458 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:59:16.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:59:16.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.639+0000 7f5ec4fff700 1 Processor -- start 2023-10-09T11:59:16.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.639+0000 7f5ec4fff700 1 -- start start 2023-10-09T11:59:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.640+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 0x7f5ec00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.640+0000 7f5ec4fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec015d7e0 con 0x7f5ec006bcd0 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.640+0000 7f5ec4fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec015dac0 con 0x7f5ec006c0a0 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.640+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00caf30 con 0x7f5ec00caa90 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.640+0000 7f5ebe59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5ec006bcd0 0x7f5ec015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43522/0 (socket says 172.21.15.86:43522) 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebe59c700 1 -- 172.21.15.86:0/2055123270 learned_addr learned my addr 172.21.15.86:0/2055123270 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebed9d700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 0x7f5ec00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221109156 0 0) 0x7f5ec015d7e0 con 0x7f5ec006bcd0 2023-10-09T11:59:16.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea8003570 con 0x7f5ec006bcd0 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223650431 0 0) 0x7f5ec015dac0 con 0x7f5ec006c0a0 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec015d7e0 con 0x7f5ec006c0a0 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3231625425 0 0) 0x7f5ea8003570 con 0x7f5ec006bcd0 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 msgr2=0x7f5ec00c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 0x7f5ec00c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 >> v1:172.21.15.135:6789/0 conn(0x7f5ec006c0a0 legacy=0x7f5ec015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec015aa30 con 0x7f5ec006bcd0 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f5eb0001470 con 0x7f5ec006bcd0 2023-10-09T11:59:16.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 >> v1:172.21.15.86:6789/0 conn(0x7f5ec006bcd0 legacy=0x7f5ec015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 0x7f5ea8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ea8004180 0x7f5ea8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.641+0000 7f5ebd59a700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea8004d50 0x7f5ea80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00caf30 con 0x7f5ea8004180 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea800bc50 con 0x7f5ea8004d50 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea800be10 con 0x7f5ec00caa90 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebdd9b700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ea8004180 0x7f5ea8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebed9d700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea8004d50 0x7f5ea80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebe59c700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 0x7f5ea8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebdd9b700 1 -- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 msgr2=0x7f5ea8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebdd9b700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ec00caa90 0x7f5ea8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebdd9b700 1 -- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea8004d50 msgr2=0x7f5ea80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebdd9b700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea8004d50 0x7f5ea80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebdd9b700 1 -- 172.21.15.86:0/2055123270 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea8003570 con 0x7f5ea8004180 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.642+0000 7f5ebdd9b700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ea8004180 0x7f5ea8004810 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4001a20 tx=0x7f5eb4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614a097e0243e476 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400c5d0 con 0x7f5ea8004180 2023-10-09T11:59:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400c730 con 0x7f5ea8004180 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ebd59a700 1 -- 172.21.15.86:0/2055123270 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400cad0 con 0x7f5ea8004180 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ec4fff700 1 -- 172.21.15.86:0/2055123270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ea8004180 msgr2=0x7f5ea8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ec4fff700 1 --2- 172.21.15.86:0/2055123270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ea8004180 0x7f5ea8004810 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4001a20 tx=0x7f5eb4007d30 comp rx=0 tx=0).stop 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ebed9d700 1 -- 172.21.15.86:0/2055123270 reap_dead start 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ec4fff700 1 -- 172.21.15.86:0/2055123270 shutdown_connections 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ec4fff700 1 -- 172.21.15.86:0/2055123270 >> 172.21.15.86:0/2055123270 conn(0x7f5ec00ce600 msgr2=0x7f5ec00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ec4fff700 1 -- 172.21.15.86:0/2055123270 shutdown_connections 2023-10-09T11:59:16.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.643+0000 7f5ec4fff700 1 -- 172.21.15.86:0/2055123270 wait complete. 2023-10-09T11:59:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.645+0000 7f5ec4fff700 1 Processor -- start 2023-10-09T11:59:16.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.645+0000 7f5ec4fff700 1 -- start start 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ea8004180 0x7f5ec00c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec00b2d30 0x7f5ec014b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ec00c6ec0 0x7f5ec0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c5bf0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c5e20 con 0x7f5ec00c6ec0 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00c6100 con 0x7f5ea8004180 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebdd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec00b2d30 0x7f5ec014b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebe59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ea8004180 0x7f5ec00c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebdd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec00b2d30 0x7f5ec014b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42284/0 (socket says 172.21.15.86:42284) 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebdd9b700 1 -- 172.21.15.86:0/621960688 learned_addr learned my addr 172.21.15.86:0/621960688 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebed9d700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ec00c6ec0 0x7f5ec0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebdd9b700 1 -- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ea8004180 msgr2=0x7f5ec00c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebdd9b700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ea8004180 0x7f5ec00c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebdd9b700 1 -- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ec00c6ec0 msgr2=0x7f5ec0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.646+0000 7f5ebdd9b700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ec00c6ec0 0x7f5ec0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5ebdd9b700 1 -- 172.21.15.86:0/621960688 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00c63e0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5ebed9d700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ec00c6ec0 0x7f5ec0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5ebdd9b700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec00b2d30 0x7f5ec014b1d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800bc20 tx=0x7f5eb4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5eae7fc700 1 -- 172.21.15.86:0/621960688 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400cab0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5eae7fc700 1 -- 172.21.15.86:0/621960688 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb40013a0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec00c66c0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5eae7fc700 1 -- 172.21.15.86:0/621960688 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb401e630 con 0x7f5ec00b2d30 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.647+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec014b710 con 0x7f5ec00b2d30 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.648+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec004c3c0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.649+0000 7f5eae7fc700 1 -- 172.21.15.86:0/621960688 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eb4019070 con 0x7f5ec00b2d30 2023-10-09T11:59:16.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.650+0000 7f5eae7fc700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ea0066f30 0x7f5ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:16.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.650+0000 7f5eae7fc700 1 -- 172.21.15.86:0/621960688 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7f5eb4085f00 con 0x7f5ec00b2d30 2023-10-09T11:59:16.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.651+0000 7f5ebe59c700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ea0066f30 0x7f5ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:16.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.651+0000 7f5ebe59c700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ea0066f30 0x7f5ea00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0001200 tx=0x7f5eb0001df0 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:16.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.655+0000 7f5eae7fc700 1 -- 172.21.15.86:0/621960688 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb4053000 con 0x7f5ec00b2d30 2023-10-09T11:59:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.888+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ec00c5bf0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.889+0000 7f5eae7fc700 1 -- 172.21.15.86:0/621960688 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f5eb4017de0 con 0x7f5ec00b2d30 2023-10-09T11:59:16.890 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:16.890 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4115138334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4115138334},{"type":"v1","addr":"172.21.15.135:6834","nonce":4115138334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6763,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/34078262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":34078262},{"type":"v1","addr":"172.21.15.135:6835","nonce":34078262}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7164,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/161428317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":161428317},{"type":"v1","addr":"172.21.15.86:6833","nonce":161428317}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4215290394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4215290394},{"type":"v1","addr":"172.21.15.86:6835","nonce":4215290394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[]} 2023-10-09T11:59:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ea0066f30 msgr2=0x7f5ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ea0066f30 0x7f5ea00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0001200 tx=0x7f5eb0001df0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec00b2d30 msgr2=0x7f5ec014b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec00b2d30 0x7f5ec014b1d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800bc20 tx=0x7f5eb4015000 comp rx=0 tx=0).stop 2023-10-09T11:59:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 shutdown_connections 2023-10-09T11:59:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ec00c6ec0 0x7f5ec0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ea8004180 0x7f5ec00c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ea0066f30 0x7f5ea00693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 --2- 172.21.15.86:0/621960688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ec00b2d30 0x7f5ec014b1d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 >> 172.21.15.86:0/621960688 conn(0x7f5ec00ce600 msgr2=0x7f5ec0159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 shutdown_connections 2023-10-09T11:59:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:16.891+0000 7f5ec4fff700 1 -- 172.21.15.86:0/621960688 wait complete. 2023-10-09T11:59:16.894 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 48 2023-10-09T11:59:16.910 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:59:16.910 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:59:16.911 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:59:16.911 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:59:16.911 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:59:16.911 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:59:16.911 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:59:16.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:59:16.912 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:59:16.912 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:59:16.912 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:59:16.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:59:16.912 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:59:16.913 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:59:16.913 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:59:16.913 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:59:16.924 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:59:16.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:59:16.926 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:59:16.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:59:16.933 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:59:16.933 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:59:16.934 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:59:16.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:59:16.970 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:59:16.970 DEBUG:teuthology.parallel:result is None 2023-10-09T11:59:16.973 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:59:16.974 DEBUG:teuthology.parallel:result is None 2023-10-09T11:59:16.978 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:59:16.978 DEBUG:teuthology.parallel:result is None 2023-10-09T11:59:16.981 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:59:16.981 DEBUG:teuthology.parallel:result is None 2023-10-09T11:59:16.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:59:17.103 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T11:59:17.105 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T11:59:17.117 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T11:59:17.117 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T11:59:17.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.171+0000 7f1d6a59d700 1 Processor -- start 2023-10-09T11:59:17.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.171+0000 7f1d6a59d700 1 -- start start 2023-10-09T11:59:17.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6a59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d64156310 0x7f1d640c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6a59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d640ae710 0x7f1d640c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6a59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640ca860 con 0x7f1d641566e0 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6a59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640cab40 con 0x7f1d64156310 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6a59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640cae20 con 0x7f1d640ae710 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6959b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d64156310 0x7f1d640c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6959b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d64156310 0x7f1d640c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42322/0 (socket says 172.21.15.86:42322) 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.172+0000 7f1d6959b700 1 -- 172.21.15.86:0/202768520 learned_addr learned my addr 172.21.15.86:0/202768520 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d6959b700 1 -- 172.21.15.86:0/202768520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d640ae710 msgr2=0x7f1d640c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:17.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d69d9c700 1 --2- 172.21.15.86:0/202768520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d640ae710 0x7f1d640c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d6959b700 1 --2- 172.21.15.86:0/202768520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d640ae710 0x7f1d640c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d6959b700 1 -- 172.21.15.86:0/202768520 >> v1:172.21.15.135:6789/0 conn(0x7f1d641566e0 legacy=0x7f1d640ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d6959b700 1 -- 172.21.15.86:0/202768520 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640cb100 con 0x7f1d64156310 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d69d9c700 1 --2- 172.21.15.86:0/202768520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d640ae710 0x7f1d640c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d6959b700 1 --2- 172.21.15.86:0/202768520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d64156310 0x7f1d640c9dc0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1d600099b0 tx=0x7f1d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f26ac08ab376bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d5bfff700 1 -- 172.21.15.86:0/202768520 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000b820 con 0x7f1d64156310 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d5bfff700 1 -- 172.21.15.86:0/202768520 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000b980 con 0x7f1d64156310 2023-10-09T11:59:17.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.173+0000 7f1d5bfff700 1 -- 172.21.15.86:0/202768520 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000bd20 con 0x7f1d64156310 2023-10-09T11:59:17.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 -- 172.21.15.86:0/202768520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d64156310 msgr2=0x7f1d640c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:17.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/202768520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d64156310 0x7f1d640c9dc0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1d600099b0 tx=0x7f1d60009250 comp rx=0 tx=0).stop 2023-10-09T11:59:17.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 -- 172.21.15.86:0/202768520 shutdown_connections 2023-10-09T11:59:17.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/202768520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d640ae710 0x7f1d640c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:17.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/202768520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d64156310 0x7f1d640c9dc0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 -- 172.21.15.86:0/202768520 >> 172.21.15.86:0/202768520 conn(0x7f1d640cc1f0 msgr2=0x7f1d640cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 -- 172.21.15.86:0/202768520 shutdown_connections 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.174+0000 7f1d6a59d700 1 -- 172.21.15.86:0/202768520 wait complete. 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.176+0000 7f1d6a59d700 1 Processor -- start 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.176+0000 7f1d6a59d700 1 -- start start 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6a59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d640ae710 0x7f1d640a7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6a59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d64156310 0x7f1d64156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6a59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d641566e0 0x7f1d6406ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:17.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6a59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6416dc50 con 0x7f1d640ae710 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6a59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6416df30 con 0x7f1d64156310 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6a59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6416e210 con 0x7f1d641566e0 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d640ae710 0x7f1d640a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d640ae710 0x7f1d640a7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42326/0 (socket says 172.21.15.86:42326) 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 -- 172.21.15.86:0/2426666653 learned_addr learned my addr 172.21.15.86:0/2426666653 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d68d9a700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d64156310 0x7f1d64156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d69d9c700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d641566e0 0x7f1d6406ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 -- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d641566e0 msgr2=0x7f1d6406ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d641566e0 0x7f1d6406ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:17.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 -- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d64156310 msgr2=0x7f1d64156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d64156310 0x7f1d64156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.177+0000 7f1d6959b700 1 -- 172.21.15.86:0/2426666653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d600094f0 con 0x7f1d640ae710 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.178+0000 7f1d6959b700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d640ae710 0x7f1d640a7670 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009290 tx=0x7f1d60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.178+0000 7f1d597fa700 1 -- 172.21.15.86:0/2426666653 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60011c10 con 0x7f1d640ae710 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.178+0000 7f1d597fa700 1 -- 172.21.15.86:0/2426666653 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60020070 con 0x7f1d640ae710 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.178+0000 7f1d597fa700 1 -- 172.21.15.86:0/2426666653 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6001b450 con 0x7f1d640ae710 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.178+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6416e4f0 con 0x7f1d640ae710 2023-10-09T11:59:17.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.178+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d64158860 con 0x7f1d640ae710 2023-10-09T11:59:17.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.179+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6404c3c0 con 0x7f1d640ae710 2023-10-09T11:59:17.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.180+0000 7f1d597fa700 1 -- 172.21.15.86:0/2426666653 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d60022030 con 0x7f1d640ae710 2023-10-09T11:59:17.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.181+0000 7f1d597fa700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d48066f30 0x7f1d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:17.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.181+0000 7f1d597fa700 1 -- 172.21.15.86:0/2426666653 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5917+0+0 (secure 0 0 0) 0x7f1d600864e0 con 0x7f1d640ae710 2023-10-09T11:59:17.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.181+0000 7f1d68d9a700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d48066f30 0x7f1d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:17.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.182+0000 7f1d68d9a700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d48066f30 0x7f1d480693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d640a6ba0 tx=0x7f1d54009060 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:17.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.185+0000 7f1d597fa700 1 -- 172.21.15.86:0/2426666653 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d600535e0 con 0x7f1d640ae710 2023-10-09T11:59:17.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:17.396+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1d6404c3c0 con 0x7f1d640ae710 2023-10-09T11:59:18.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.308+0000 7f1d597fa700 1 -- 172.21.15.86:0/2426666653 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v120) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1d60056c00 con 0x7f1d640ae710 2023-10-09T11:59:18.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d48066f30 msgr2=0x7f1d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d48066f30 0x7f1d480693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d640a6ba0 tx=0x7f1d54009060 comp rx=0 tx=0).stop 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d640ae710 msgr2=0x7f1d640a7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d640ae710 0x7f1d640a7670 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009290 tx=0x7f1d60016000 comp rx=0 tx=0).stop 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 shutdown_connections 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1d48066f30 0x7f1d480693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d640ae710 0x7f1d640a7670 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d641566e0 0x7f1d6406ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 --2- 172.21.15.86:0/2426666653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d64156310 0x7f1d64156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 >> 172.21.15.86:0/2426666653 conn(0x7f1d640cc1f0 msgr2=0x7f1d640c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 shutdown_connections 2023-10-09T11:59:18.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.311+0000 7f1d6a59d700 1 -- 172.21.15.86:0/2426666653 wait complete. 2023-10-09T11:59:18.314 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T11:59:18.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:59:18.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.513+0000 7f1b075ff700 1 Processor -- start 2023-10-09T11:59:18.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.513+0000 7f1b075ff700 1 -- start start 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.514+0000 7f1b075ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b00159890 0x7f1b0015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.514+0000 7f1b075ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1b00069560 0x7f1b000699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.514+0000 7f1b075ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b00069ee0 con 0x7f1b00159c60 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.514+0000 7f1b075ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0015a160 con 0x7f1b00159890 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.514+0000 7f1b075ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000d13a0 con 0x7f1b00069560 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b0539b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b00159890 0x7f1b0015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b04b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1b00159c60 0x7f1b0015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43534/0 (socket says 172.21.15.86:43534) 2023-10-09T11:59:18.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b04b9a700 1 -- 172.21.15.86:0/3583054203 learned_addr learned my addr 172.21.15.86:0/3583054203 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b05b9c700 1 --2- 172.21.15.86:0/3583054203 >> v2:172.21.15.135:3300/0 conn(0x7f1b00069560 0x7f1b000699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b0539b700 1 -- 172.21.15.86:0/3583054203 >> v2:172.21.15.135:3300/0 conn(0x7f1b00069560 msgr2=0x7f1b000699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b0539b700 1 --2- 172.21.15.86:0/3583054203 >> v2:172.21.15.135:3300/0 conn(0x7f1b00069560 0x7f1b000699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1af7fff700 1 -- 172.21.15.86:0/3583054203 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970995136 0 0) 0x7f1b00069ee0 con 0x7f1b00159c60 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b0539b700 1 -- 172.21.15.86:0/3583054203 >> v1:172.21.15.86:6789/0 conn(0x7f1b00159c60 legacy=0x7f1b0015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b0539b700 1 -- 172.21.15.86:0/3583054203 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0015e140 con 0x7f1b00159890 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b05b9c700 1 --2- 172.21.15.86:0/3583054203 >> v2:172.21.15.135:3300/0 conn(0x7f1b00069560 0x7f1b000699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1b0539b700 1 --2- 172.21.15.86:0/3583054203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00159890 0x7f1b0015abd0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1b0006a890 tx=0x7f1afc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b170327fb7ddf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:18.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.515+0000 7f1af7fff700 1 -- 172.21.15.86:0/3583054203 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00b6b0 con 0x7f1b00159890 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1af7fff700 1 -- 172.21.15.86:0/3583054203 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc00b810 con 0x7f1b00159890 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1af7fff700 1 -- 172.21.15.86:0/3583054203 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00bbb0 con 0x7f1b00159890 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 -- 172.21.15.86:0/3583054203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00159890 msgr2=0x7f1b0015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 --2- 172.21.15.86:0/3583054203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00159890 0x7f1b0015abd0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1b0006a890 tx=0x7f1afc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 -- 172.21.15.86:0/3583054203 shutdown_connections 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 --2- 172.21.15.86:0/3583054203 >> v2:172.21.15.135:3300/0 conn(0x7f1b00069560 0x7f1b000699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 --2- 172.21.15.86:0/3583054203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00159890 0x7f1b0015abd0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 -- 172.21.15.86:0/3583054203 >> 172.21.15.86:0/3583054203 conn(0x7f1b00068e20 msgr2=0x7f1b000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 -- 172.21.15.86:0/3583054203 shutdown_connections 2023-10-09T11:59:18.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.516+0000 7f1b075ff700 1 -- 172.21.15.86:0/3583054203 wait complete. 2023-10-09T11:59:18.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.518+0000 7f1b075ff700 1 Processor -- start 2023-10-09T11:59:18.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.518+0000 7f1b075ff700 1 -- start start 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b075ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00069560 0x7f1b000cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b075ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b00159890 0x7f1b0014b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b075ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b00159c60 0x7f1b00151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b075ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000cd1e0 con 0x7f1b00069560 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b075ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000cda40 con 0x7f1b00159c60 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b075ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000b6230 con 0x7f1b00159890 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00069560 0x7f1b000cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:18.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00069560 0x7f1b000cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42344/0 (socket says 172.21.15.86:42344) 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 -- 172.21.15.86:0/404638431 learned_addr learned my addr 172.21.15.86:0/404638431 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 -- 172.21.15.86:0/404638431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b00159890 msgr2=0x7f1b0014b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b00159890 0x7f1b0014b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 -- 172.21.15.86:0/404638431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b00159c60 msgr2=0x7f1b00151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b00159c60 0x7f1b00151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 -- 172.21.15.86:0/404638431 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc009420 con 0x7f1b00069560 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.519+0000 7f1b0539b700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00069560 0x7f1b000cf910 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1b00070e20 tx=0x7f1afc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.520+0000 7f1af57fa700 1 -- 172.21.15.86:0/404638431 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc011420 con 0x7f1b00069560 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.520+0000 7f1af57fa700 1 -- 172.21.15.86:0/404638431 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc011580 con 0x7f1b00069560 2023-10-09T11:59:18.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.520+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b000cd3f0 con 0x7f1b00069560 2023-10-09T11:59:18.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.520+0000 7f1af57fa700 1 -- 172.21.15.86:0/404638431 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc011920 con 0x7f1b00069560 2023-10-09T11:59:18.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.520+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b000cfe50 con 0x7f1b00069560 2023-10-09T11:59:18.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.521+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0004c3c0 con 0x7f1b00069560 2023-10-09T11:59:18.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.522+0000 7f1af57fa700 1 -- 172.21.15.86:0/404638431 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1afc011d10 con 0x7f1b00069560 2023-10-09T11:59:18.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.522+0000 7f1af57fa700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae4066f30 0x7f1ae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.523+0000 7f1af57fa700 1 -- 172.21.15.86:0/404638431 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f1afc085f50 con 0x7f1b00069560 2023-10-09T11:59:18.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.523+0000 7f1b04b9a700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae4066f30 0x7f1ae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:18.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.523+0000 7f1b04b9a700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae4066f30 0x7f1ae40693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b000cf770 tx=0x7f1af0007b60 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:18.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.527+0000 7f1af57fa700 1 -- 172.21.15.86:0/404638431 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1afc053380 con 0x7f1b00069560 2023-10-09T11:59:18.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.791+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1b0006a5b0 con 0x7f1b00069560 2023-10-09T11:59:18.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.792+0000 7f1af57fa700 1 -- 172.21.15.86:0/404638431 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1afc0569a0 con 0x7f1b00069560 2023-10-09T11:59:18.793 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:18.793 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:59:18.794 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:59:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:59:18.796 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:59:18.797 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.798 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.804 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T11:59:18.805 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T11:59:18.806 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T11:59:18.807 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T11:59:18.808 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T11:59:18.809 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T11:59:18.810 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T11:59:18.811 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T11:59:18.812 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T11:59:18.812 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T11:59:18.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:18.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T11:59:18.812 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae4066f30 msgr2=0x7f1ae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae4066f30 0x7f1ae40693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b000cf770 tx=0x7f1af0007b60 comp rx=0 tx=0).stop 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00069560 msgr2=0x7f1b000cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00069560 0x7f1b000cf910 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1b00070e20 tx=0x7f1afc017000 comp rx=0 tx=0).stop 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 shutdown_connections 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae4066f30 0x7f1ae40693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b00069560 0x7f1b000cf910 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b00159c60 0x7f1b00151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 --2- 172.21.15.86:0/404638431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b00159890 0x7f1b0014b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:18.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 >> 172.21.15.86:0/404638431 conn(0x7f1b00068e20 msgr2=0x7f1b000b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:18.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 shutdown_connections 2023-10-09T11:59:18.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.794+0000 7f1b075ff700 1 -- 172.21.15.86:0/404638431 wait complete. 2023-10-09T11:59:18.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:59:18.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.996+0000 7f31db5ff700 1 Processor -- start 2023-10-09T11:59:18.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.996+0000 7f31db5ff700 1 -- start start 2023-10-09T11:59:18.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.997+0000 7f31db5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f31d40b1420 0x7f31d40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.997+0000 7f31db5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 0x7f31d40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:18.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.997+0000 7f31db5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40cc300 con 0x7f31d40cbf30 2023-10-09T11:59:18.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.997+0000 7f31db5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d4156bf0 con 0x7f31d40b1420 2023-10-09T11:59:18.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.997+0000 7f31db5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40ae950 con 0x7f31d40ccf90 2023-10-09T11:59:18.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31d939b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f31d40cbf30 0x7f31d40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43550/0 (socket says 172.21.15.86:43550) 2023-10-09T11:59:18.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31d939b700 1 -- 172.21.15.86:0/1941382663 learned_addr learned my addr 172.21.15.86:0/1941382663 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:19.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31d8b9a700 1 --2- 172.21.15.86:0/1941382663 >> v2:172.21.15.135:3300/0 conn(0x7f31d40b1420 0x7f31d40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31d9b9c700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 0x7f31d40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596705453 0 0) 0x7f31d40cc300 con 0x7f31d40cbf30 2023-10-09T11:59:19.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c0003570 con 0x7f31d40cbf30 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3950017856 0 0) 0x7f31c0003570 con 0x7f31d40cbf30 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 msgr2=0x7f31d40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 0x7f31d40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 >> v2:172.21.15.135:3300/0 conn(0x7f31d40b1420 msgr2=0x7f31d40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 --2- 172.21.15.86:0/1941382663 >> v2:172.21.15.135:3300/0 conn(0x7f31d40b1420 0x7f31d40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40ad370 con 0x7f31d40cbf30 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f31d0001470 con 0x7f31d40cbf30 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 >> v1:172.21.15.86:6789/0 conn(0x7f31d40cbf30 legacy=0x7f31d40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.998+0000 7f31cbfff700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c0003b10 0x7f31c0003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31cbfff700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31c0004810 0x7f31c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31cbfff700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 0x7f31c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4156bf0 con 0x7f31c0004810 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40ae950 con 0x7f31c0003b10 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c000bb40 con 0x7f31d40ccf90 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d8b9a700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31c0004810 0x7f31c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d939b700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c0003b10 0x7f31c0003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d9b9c700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 0x7f31c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d8b9a700 1 -- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 msgr2=0x7f31c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d8b9a700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 0x7f31c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d8b9a700 1 -- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c0003b10 msgr2=0x7f31c0003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d8b9a700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c0003b10 0x7f31c0003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d8b9a700 1 -- 172.21.15.86:0/1941382663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0003570 con 0x7f31c0004810 2023-10-09T11:59:19.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d9b9c700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d40ccf90 0x7f31c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:18.999+0000 7f31d8b9a700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31c0004810 0x7f31c0004c80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f31d40aecd0 tx=0x7f31c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521416c081746fef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400e6e0 con 0x7f31c0004810 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c400e840 con 0x7f31c0004810 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31cbfff700 1 -- 172.21.15.86:0/1941382663 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400ec00 con 0x7f31c0004810 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31db5ff700 1 -- 172.21.15.86:0/1941382663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31c0004810 msgr2=0x7f31c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31db5ff700 1 --2- 172.21.15.86:0/1941382663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31c0004810 0x7f31c0004c80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f31d40aecd0 tx=0x7f31c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31d9b9c700 1 -- 172.21.15.86:0/1941382663 reap_dead start 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31db5ff700 1 -- 172.21.15.86:0/1941382663 shutdown_connections 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31db5ff700 1 -- 172.21.15.86:0/1941382663 >> 172.21.15.86:0/1941382663 conn(0x7f31d406a320 msgr2=0x7f31d40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31db5ff700 1 -- 172.21.15.86:0/1941382663 shutdown_connections 2023-10-09T11:59:19.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.000+0000 7f31db5ff700 1 -- 172.21.15.86:0/1941382663 wait complete. 2023-10-09T11:59:19.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.002+0000 7f31db5ff700 1 Processor -- start 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.002+0000 7f31db5ff700 1 -- start start 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31db5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c0004810 0x7f31d41503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31db5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d4154a30 0x7f31d4154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31db5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31d40aae70 0x7f31d40ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31db5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41553e0 con 0x7f31d40aae70 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31db5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40ac390 con 0x7f31d4154a30 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31db5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d416a650 con 0x7f31c0004810 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31d9b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31d40aae70 0x7f31d40ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31d9b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31d40aae70 0x7f31d40ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42364/0 (socket says 172.21.15.86:42364) 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31d9b9c700 1 -- 172.21.15.86:0/2771820197 learned_addr learned my addr 172.21.15.86:0/2771820197 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:19.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31d939b700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c0004810 0x7f31d41503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.003+0000 7f31d8b9a700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d4154a30 0x7f31d4154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d9b9c700 1 -- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c0004810 msgr2=0x7f31d41503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d9b9c700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c0004810 0x7f31d41503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d9b9c700 1 -- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d4154a30 msgr2=0x7f31d4154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d9b9c700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d4154a30 0x7f31d4154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d9b9c700 1 -- 172.21.15.86:0/2771820197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d41508e0 con 0x7f31d40aae70 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d939b700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c0004810 0x7f31d41503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d8b9a700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d4154a30 0x7f31d4154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31d9b9c700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31d40aae70 0x7f31d40ab2e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f31d406d670 tx=0x7f31cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31c97fa700 1 -- 172.21.15.86:0/2771820197 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc01b070 con 0x7f31d40aae70 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31c97fa700 1 -- 172.21.15.86:0/2771820197 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00f040 con 0x7f31d40aae70 2023-10-09T11:59:19.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d40ab820 con 0x7f31d40aae70 2023-10-09T11:59:19.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31c97fa700 1 -- 172.21.15.86:0/2771820197 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00e050 con 0x7f31d40aae70 2023-10-09T11:59:19.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.004+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d40abdd0 con 0x7f31d40aae70 2023-10-09T11:59:19.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.005+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d415aab0 con 0x7f31d40aae70 2023-10-09T11:59:19.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.006+0000 7f31c97fa700 1 -- 172.21.15.86:0/2771820197 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31cc003020 con 0x7f31d40aae70 2023-10-09T11:59:19.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.007+0000 7f31c97fa700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f31b8066f30 0x7f31b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.007+0000 7f31c97fa700 1 -- 172.21.15.86:0/2771820197 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f31cc0848a0 con 0x7f31d40aae70 2023-10-09T11:59:19.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.007+0000 7f31d939b700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f31b8066f30 0x7f31b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.007+0000 7f31d939b700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f31b8066f30 0x7f31b80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31d00015a0 tx=0x7f31d0009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.011+0000 7f31c97fa700 1 -- 172.21.15.86:0/2771820197 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31cc051c50 con 0x7f31d40aae70 2023-10-09T11:59:19.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.201+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31d404c3c0 con 0x7f31d40aae70 2023-10-09T11:59:19.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.202+0000 7f31c97fa700 1 -- 172.21.15.86:0/2771820197 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+12762 (secure 0 0 0) 0x7f31cc055270 con 0x7f31d40aae70 2023-10-09T11:59:19.203 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:19.204 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":120,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:18.302437+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:59:19.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f31b8066f30 msgr2=0x7f31b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f31b8066f30 0x7f31b80693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31d00015a0 tx=0x7f31d0009040 comp rx=0 tx=0).stop 2023-10-09T11:59:19.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31d40aae70 msgr2=0x7f31d40ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31d40aae70 0x7f31d40ab2e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f31d406d670 tx=0x7f31cc00b040 comp rx=0 tx=0).stop 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 shutdown_connections 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f31b8066f30 0x7f31b80693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31d40aae70 0x7f31d40ab2e0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31c0004810 0x7f31d41503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 --2- 172.21.15.86:0/2771820197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d4154a30 0x7f31d4154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 >> 172.21.15.86:0/2771820197 conn(0x7f31d406a320 msgr2=0x7f31d406eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 shutdown_connections 2023-10-09T11:59:19.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.205+0000 7f31db5ff700 1 -- 172.21.15.86:0/2771820197 wait complete. 2023-10-09T11:59:19.224 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:59:19.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:59:19.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.406+0000 7fe4b69ff700 1 Processor -- start 2023-10-09T11:59:19.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.406+0000 7fe4b69ff700 1 -- start start 2023-10-09T11:59:19.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.407+0000 7fe4b69ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 0x7fe4b01625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.407+0000 7fe4b69ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b00af2f0 con 0x7fe4b0069e80 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.407+0000 7fe4b69ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b00af5d0 con 0x7fe4b015ac80 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.407+0000 7fe4b69ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00c8660 con 0x7fe4b00b0a70 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4af7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe4b0069e80 0x7fe4b00c6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43560/0 (socket says 172.21.15.86:43560) 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4af7fe700 1 -- 172.21.15.86:0/794532467 learned_addr learned my addr 172.21.15.86:0/794532467 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4b4f9c700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 0x7fe4b01625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350829506 0 0) 0x7fe4b00af2f0 con 0x7fe4b0069e80 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe498003570 con 0x7fe4b0069e80 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1040230350 0 0) 0x7fe498003570 con 0x7fe4b0069e80 2023-10-09T11:59:19.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 msgr2=0x7fe4b01625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4aeffd700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 0x7fe4b01625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 >> v1:172.21.15.135:6789/0 conn(0x7fe4b015ac80 legacy=0x7fe4b0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.408+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00c8940 con 0x7fe4b0069e80 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fe4a4001470 con 0x7fe4b0069e80 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4b4f9c700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 0x7fe4b01625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 >> v1:172.21.15.86:6789/0 conn(0x7fe4b0069e80 legacy=0x7fe4b00c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe498003a90 0x7fe498003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498004810 0x7fe498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 0x7fe4980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00c8660 con 0x7fe498003a90 2023-10-09T11:59:19.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49800bb10 con 0x7fe498004810 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49800bca0 con 0x7fe4b00b0a70 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4affff700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe498003a90 0x7fe498003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4b4f9c700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 0x7fe4980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4af7fe700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498004810 0x7fe498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4affff700 1 -- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 msgr2=0x7fe4980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4affff700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b00b0a70 0x7fe4980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4affff700 1 -- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498004810 msgr2=0x7fe498004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4affff700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498004810 0x7fe498004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.409+0000 7fe4affff700 1 -- 172.21.15.86:0/794532467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009a20 con 0x7fe498003a90 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4affff700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe498003a90 0x7fe498003e60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00019a0 tx=0x7fe4a0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2f9b76d651987c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000c5d0 con 0x7fe498003a90 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000c730 con 0x7fe498003a90 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4aeffd700 1 -- 172.21.15.86:0/794532467 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000cad0 con 0x7fe498003a90 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4b69ff700 1 -- 172.21.15.86:0/794532467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe498003a90 msgr2=0x7fe498003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4b69ff700 1 --2- 172.21.15.86:0/794532467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe498003a90 0x7fe498003e60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00019a0 tx=0x7fe4a0007d10 comp rx=0 tx=0).stop 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4b4f9c700 1 -- 172.21.15.86:0/794532467 reap_dead start 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4b69ff700 1 -- 172.21.15.86:0/794532467 shutdown_connections 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4b69ff700 1 -- 172.21.15.86:0/794532467 >> 172.21.15.86:0/794532467 conn(0x7fe4b0068e10 msgr2=0x7fe4b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4b69ff700 1 -- 172.21.15.86:0/794532467 shutdown_connections 2023-10-09T11:59:19.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.410+0000 7fe4b69ff700 1 -- 172.21.15.86:0/794532467 wait complete. 2023-10-09T11:59:19.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.412+0000 7fe4b69ff700 1 Processor -- start 2023-10-09T11:59:19.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.412+0000 7fe4b69ff700 1 -- start start 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4b69ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498003a90 0x7fe4b00c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4b69ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b0154980 0x7fe4b0164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4b69ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b01555a0 0x7fe4b0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4b69ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0155f50 con 0x7fe4b0154980 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4b69ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b01550d0 con 0x7fe498003a90 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4b69ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0165940 con 0x7fe4b01555a0 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b0154980 0x7fe4b0164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b0154980 0x7fe4b0164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42378/0 (socket says 172.21.15.86:42378) 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 -- 172.21.15.86:0/2600042121 learned_addr learned my addr 172.21.15.86:0/2600042121 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:19.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4affff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498003a90 0x7fe4b00c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4b4f9c700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b01555a0 0x7fe4b0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 -- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b01555a0 msgr2=0x7fe4b0155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b01555a0 0x7fe4b0155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 -- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498003a90 msgr2=0x7fe4b00c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498003a90 0x7fe4b00c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.413+0000 7fe4af7fe700 1 -- 172.21.15.86:0/2600042121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b0165dd0 con 0x7fe4b0154980 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.414+0000 7fe4af7fe700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b0154980 0x7fe4b0164710 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400ebc0 tx=0x7fe4b00c8f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.414+0000 7fe497fff700 1 -- 172.21.15.86:0/2600042121 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4005e70 con 0x7fe4b0154980 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.414+0000 7fe497fff700 1 -- 172.21.15.86:0/2600042121 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a400c4f0 con 0x7fe4b0154980 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.414+0000 7fe497fff700 1 -- 172.21.15.86:0/2600042121 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400c8d0 con 0x7fe4b0154980 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.414+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b0165010 con 0x7fe4b0154980 2023-10-09T11:59:19.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.414+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b01655d0 con 0x7fe4b0154980 2023-10-09T11:59:19.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.415+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b004c3c0 con 0x7fe4b0154980 2023-10-09T11:59:19.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.416+0000 7fe497fff700 1 -- 172.21.15.86:0/2600042121 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4a400cc40 con 0x7fe4b0154980 2023-10-09T11:59:19.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.417+0000 7fe497fff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe49c066f60 0x7fe49c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.417+0000 7fe497fff700 1 -- 172.21.15.86:0/2600042121 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5229+0+0 (secure 0 0 0) 0x7fe4a40840c0 con 0x7fe4b0154980 2023-10-09T11:59:19.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.417+0000 7fe4affff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe49c066f60 0x7fe49c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.418+0000 7fe4affff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe49c066f60 0x7fe49c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0008fd0 tx=0x7fe4a0015000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.421+0000 7fe497fff700 1 -- 172.21.15.86:0/2600042121 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4a4051470 con 0x7fe4b0154980 2023-10-09T11:59:19.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.611+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4b0165a80 con 0x7fe4b0154980 2023-10-09T11:59:19.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.611+0000 7fe497fff700 1 -- 172.21.15.86:0/2600042121 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4a4054a90 con 0x7fe4b0154980 2023-10-09T11:59:19.613 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T11:59:19.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe49c066f60 msgr2=0x7fe49c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe49c066f60 0x7fe49c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0008fd0 tx=0x7fe4a0015000 comp rx=0 tx=0).stop 2023-10-09T11:59:19.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b0154980 msgr2=0x7fe4b0164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b0154980 0x7fe4b0164710 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400ebc0 tx=0x7fe4b00c8f00 comp rx=0 tx=0).stop 2023-10-09T11:59:19.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 shutdown_connections 2023-10-09T11:59:19.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4b01555a0 0x7fe4b0155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe498003a90 0x7fe4b00c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe49c066f60 0x7fe49c069410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 --2- 172.21.15.86:0/2600042121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b0154980 0x7fe4b0164710 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.613+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 >> 172.21.15.86:0/2600042121 conn(0x7fe4b0068e10 msgr2=0x7fe4b00c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:19.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.614+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 shutdown_connections 2023-10-09T11:59:19.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.614+0000 7fe4b69ff700 1 -- 172.21.15.86:0/2600042121 wait complete. 2023-10-09T11:59:19.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:59:19.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.812+0000 7f6bdd99d700 1 Processor -- start 2023-10-09T11:59:19.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.812+0000 7f6bdd99d700 1 -- start start 2023-10-09T11:59:19.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.813+0000 7f6bdd99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd806a660 0x7f6bd8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.813+0000 7f6bdd99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd806e2a0 con 0x7f6bd8150180 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.813+0000 7f6bdd99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd806b2e0 con 0x7f6bd8150550 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.813+0000 7f6bdd99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80c78e0 con 0x7f6bd806a660 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.813+0000 7f6bdc99b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6bd8150180 0x7f6bd80c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43562/0 (socket says 172.21.15.86:43562) 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.813+0000 7f6bdc99b700 1 -- 172.21.15.86:0/1376711182 learned_addr learned my addr 172.21.15.86:0/1376711182 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bdd19c700 1 --2- 172.21.15.86:0/1376711182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd806a660 0x7f6bd8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130345367 0 0) 0x7f6bd806e2a0 con 0x7f6bd8150180 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc0004680 con 0x7f6bd8150180 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299521096 0 0) 0x7f6bd806b2e0 con 0x7f6bd8150550 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd806e2a0 con 0x7f6bd8150550 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bdd19c700 1 -- 172.21.15.86:0/1376711182 >> v1:172.21.15.135:6789/0 conn(0x7f6bd8150550 legacy=0x7f6bd8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1406791869 0 0) 0x7f6bc0004680 con 0x7f6bd8150180 2023-10-09T11:59:19.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bdd19c700 1 -- 172.21.15.86:0/1376711182 >> v1:172.21.15.86:6789/0 conn(0x7f6bd8150180 legacy=0x7f6bd80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bdd19c700 1 -- 172.21.15.86:0/1376711182 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80c7bc0 con 0x7f6bd806a660 2023-10-09T11:59:19.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.814+0000 7f6bdd19c700 1 --2- 172.21.15.86:0/1376711182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd806a660 0x7f6bd8157770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009e90 tx=0x7f6bd0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61bf344619069abe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000e070 con 0x7f6bd806a660 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000b870 con 0x7f6bd806a660 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bcf7fe700 1 -- 172.21.15.86:0/1376711182 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4001470 con 0x7f6bd806a660 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bdd99d700 1 -- 172.21.15.86:0/1376711182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd806a660 msgr2=0x7f6bd8157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/1376711182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd806a660 0x7f6bd8157770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009e90 tx=0x7f6bd0009780 comp rx=0 tx=0).stop 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bdd99d700 1 -- 172.21.15.86:0/1376711182 shutdown_connections 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/1376711182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd806a660 0x7f6bd8157770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bdd99d700 1 -- 172.21.15.86:0/1376711182 >> 172.21.15.86:0/1376711182 conn(0x7f6bd80cc1f0 msgr2=0x7f6bd80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:19.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bdd99d700 1 -- 172.21.15.86:0/1376711182 shutdown_connections 2023-10-09T11:59:19.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.815+0000 7f6bdd99d700 1 -- 172.21.15.86:0/1376711182 wait complete. 2023-10-09T11:59:19.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.817+0000 7f6bdd99d700 1 Processor -- start 2023-10-09T11:59:19.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.817+0000 7f6bdd99d700 1 -- start start 2023-10-09T11:59:19.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdd99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd806a660 0x7f6bd816db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdd99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bd8150180 0x7f6bd80c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdd99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd8150550 0x7f6bd814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdd99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd816e0a0 con 0x7f6bd8150180 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdd99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80c37e0 con 0x7f6bd806a660 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdd99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80c1370 con 0x7f6bd8150550 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bd8150180 0x7f6bd80c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bd8150180 0x7f6bd80c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42386/0 (socket says 172.21.15.86:42386) 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 -- 172.21.15.86:0/4150992457 learned_addr learned my addr 172.21.15.86:0/4150992457 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdd19c700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd8150550 0x7f6bd814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bdc99b700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd806a660 0x7f6bd816db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 -- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd8150550 msgr2=0x7f6bd814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd8150550 0x7f6bd814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 -- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd806a660 msgr2=0x7f6bd816db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd806a660 0x7f6bd816db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.818+0000 7f6bcffff700 1 -- 172.21.15.86:0/4150992457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009a20 con 0x7f6bd8150180 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.819+0000 7f6bcffff700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bd8150180 0x7f6bd80c32a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c580 tx=0x7f6bc8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.819+0000 7f6bccff9700 1 -- 172.21.15.86:0/4150992457 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8010510 con 0x7f6bd8150180 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.819+0000 7f6bccff9700 1 -- 172.21.15.86:0/4150992457 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc8010670 con 0x7f6bd8150180 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.819+0000 7f6bccff9700 1 -- 172.21.15.86:0/4150992457 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8010a30 con 0x7f6bd8150180 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.819+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd80c1650 con 0x7f6bd8150180 2023-10-09T11:59:19.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.819+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd80c1c10 con 0x7f6bd8150180 2023-10-09T11:59:19.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.820+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd804c3c0 con 0x7f6bd8150180 2023-10-09T11:59:19.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.821+0000 7f6bccff9700 1 -- 172.21.15.86:0/4150992457 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bc801b400 con 0x7f6bd8150180 2023-10-09T11:59:19.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.822+0000 7f6bccff9700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6bc4066f30 0x7f6bc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:19.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.822+0000 7f6bccff9700 1 -- 172.21.15.86:0/4150992457 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5229+0+0 (secure 0 0 0) 0x7f6bc8084080 con 0x7f6bd8150180 2023-10-09T11:59:19.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.822+0000 7f6bdc99b700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6bc4066f30 0x7f6bc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:19.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.823+0000 7f6bdc99b700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6bc4066f30 0x7f6bc40693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40015a0 tx=0x7f6bd4000bc0 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:19.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:19.826+0000 7f6bccff9700 1 -- 172.21.15.86:0/4150992457 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bc8051430 con 0x7f6bd8150180 2023-10-09T11:59:20.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.022+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6bd8157770 con 0x7f6bd8150180 2023-10-09T11:59:20.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.022+0000 7f6bccff9700 1 -- 172.21.15.86:0/4150992457 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v120) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6bc8054a50 con 0x7f6bd8150180 2023-10-09T11:59:20.024 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:20.024 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:59:20.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:20.024 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T11:59:20.024 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T11:59:20.024 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:20.024 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6bc4066f30 msgr2=0x7f6bc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6bc4066f30 0x7f6bc40693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40015a0 tx=0x7f6bd4000bc0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bd8150180 msgr2=0x7f6bd80c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bd8150180 0x7f6bd80c32a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c580 tx=0x7f6bc8007e10 comp rx=0 tx=0).stop 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 shutdown_connections 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bd8150550 0x7f6bd814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd806a660 0x7f6bd816db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6bc4066f30 0x7f6bc40693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 --2- 172.21.15.86:0/4150992457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bd8150180 0x7f6bd80c32a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 >> 172.21.15.86:0/4150992457 conn(0x7f6bd80cc1f0 msgr2=0x7f6bd80696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:20.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 shutdown_connections 2023-10-09T11:59:20.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.025+0000 7f6bdd99d700 1 -- 172.21.15.86:0/4150992457 wait complete. 2023-10-09T11:59:20.043 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:59:20.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:59:20.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.225+0000 7ff17adff700 1 Processor -- start 2023-10-09T11:59:20.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.225+0000 7ff17adff700 1 -- start start 2023-10-09T11:59:20.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.226+0000 7ff17adff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff174069a50 0x7ff1740c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:20.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17adff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1740c8490 0x7ff17415a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:20.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17adff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff174069e20 0x7ff17406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:20.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17adff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1740ac030 con 0x7ff174069e20 2023-10-09T11:59:20.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17adff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1740ab820 con 0x7ff174069a50 2023-10-09T11:59:20.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17adff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17406dbb0 con 0x7ff1740c8490 2023-10-09T11:59:20.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff174069e20 0x7ff17406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff174069e20 0x7ff17406e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42402/0 (socket says 172.21.15.86:42402) 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 -- 172.21.15.86:0/3836925513 learned_addr learned my addr 172.21.15.86:0/3836925513 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff178b9b700 1 --2- 172.21.15.86:0/3836925513 >> v2:172.21.15.135:3300/0 conn(0x7ff174069a50 0x7ff1740c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff173fff700 1 --2- 172.21.15.86:0/3836925513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1740c8490 0x7ff17415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 -- 172.21.15.86:0/3836925513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1740c8490 msgr2=0x7ff17415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 --2- 172.21.15.86:0/3836925513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1740c8490 0x7ff17415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 -- 172.21.15.86:0/3836925513 >> v2:172.21.15.135:3300/0 conn(0x7ff174069a50 msgr2=0x7ff1740c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 --2- 172.21.15.86:0/3836925513 >> v2:172.21.15.135:3300/0 conn(0x7ff174069a50 0x7ff1740c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.227+0000 7ff17939c700 1 -- 172.21.15.86:0/3836925513 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17415a9d0 con 0x7ff174069e20 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17939c700 1 --2- 172.21.15.86:0/3836925513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff174069e20 0x7ff17406e040 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009f20 tx=0x7ff16c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9572fee30bae3b75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:20.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff1737fe700 1 -- 172.21.15.86:0/3836925513 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00e070 con 0x7ff174069e20 2023-10-09T11:59:20.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff1737fe700 1 -- 172.21.15.86:0/3836925513 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c00b930 con 0x7ff174069e20 2023-10-09T11:59:20.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff1737fe700 1 -- 172.21.15.86:0/3836925513 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0092e0 con 0x7ff174069e20 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17adff700 1 -- 172.21.15.86:0/3836925513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff174069e20 msgr2=0x7ff17406e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17adff700 1 --2- 172.21.15.86:0/3836925513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff174069e20 0x7ff17406e040 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009f20 tx=0x7ff16c009840 comp rx=0 tx=0).stop 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17adff700 1 -- 172.21.15.86:0/3836925513 shutdown_connections 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17adff700 1 --2- 172.21.15.86:0/3836925513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff174069e20 0x7ff17406e040 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17adff700 1 --2- 172.21.15.86:0/3836925513 >> v2:172.21.15.135:3300/0 conn(0x7ff174069a50 0x7ff1740c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17adff700 1 --2- 172.21.15.86:0/3836925513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1740c8490 0x7ff17415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.228+0000 7ff17adff700 1 -- 172.21.15.86:0/3836925513 >> 172.21.15.86:0/3836925513 conn(0x7ff1740c8f90 msgr2=0x7ff1740c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.229+0000 7ff17adff700 1 -- 172.21.15.86:0/3836925513 shutdown_connections 2023-10-09T11:59:20.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.229+0000 7ff17adff700 1 -- 172.21.15.86:0/3836925513 wait complete. 2023-10-09T11:59:20.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.230+0000 7ff17adff700 1 Processor -- start 2023-10-09T11:59:20.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.230+0000 7ff17adff700 1 -- start start 2023-10-09T11:59:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17adff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff174069a50 0x7ff174154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174069e20 0x7ff174169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:20.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17adff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1740c8490 0x7ff1740c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17adff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17416a5e0 con 0x7ff1740c8490 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17416a8c0 con 0x7ff174069e20 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17adff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17416ae90 con 0x7ff174069a50 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17939c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1740c8490 0x7ff1740c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17939c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1740c8490 0x7ff1740c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42408/0 (socket says 172.21.15.86:42408) 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.231+0000 7ff17939c700 1 -- 172.21.15.86:0/1001343422 learned_addr learned my addr 172.21.15.86:0/1001343422 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff178b9b700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff174069a50 0x7ff174154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff173fff700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174069e20 0x7ff174169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17939c700 1 -- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff174069a50 msgr2=0x7ff174154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17939c700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff174069a50 0x7ff174154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17939c700 1 -- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174069e20 msgr2=0x7ff174169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:20.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17939c700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174069e20 0x7ff174169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17939c700 1 -- 172.21.15.86:0/1001343422 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009ae0 con 0x7ff1740c8490 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17939c700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1740c8490 0x7ff1740c2660 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009ab0 tx=0x7ff16c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff170ff9700 1 -- 172.21.15.86:0/1001343422 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c008ad0 con 0x7ff1740c8490 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff170ff9700 1 -- 172.21.15.86:0/1001343422 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c008c30 con 0x7ff1740c8490 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff170ff9700 1 -- 172.21.15.86:0/1001343422 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c026460 con 0x7ff1740c8490 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17416b170 con 0x7ff1740c8490 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.232+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1740aac40 con 0x7ff1740c8490 2023-10-09T11:59:20.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.233+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17416acf0 con 0x7ff1740c8490 2023-10-09T11:59:20.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.234+0000 7ff170ff9700 1 -- 172.21.15.86:0/1001343422 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff16c003040 con 0x7ff1740c8490 2023-10-09T11:59:20.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.235+0000 7ff170ff9700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff158066f30 0x7ff1580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:20.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.235+0000 7ff170ff9700 1 -- 172.21.15.86:0/1001343422 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5229+0+0 (secure 0 0 0) 0x7ff16c086170 con 0x7ff1740c8490 2023-10-09T11:59:20.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.235+0000 7ff178b9b700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff158066f30 0x7ff1580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:20.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.236+0000 7ff178b9b700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff158066f30 0x7ff1580693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1740ae1f0 tx=0x7ff1680091a0 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:20.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.239+0000 7ff170ff9700 1 -- 172.21.15.86:0/1001343422 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff17416acf0 con 0x7ff1740c8490 2023-10-09T11:59:20.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.428+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff17416acf0 con 0x7ff1740c8490 2023-10-09T11:59:20.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.873+0000 7ff170ff9700 1 -- 172.21.15.86:0/1001343422 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v121) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff17416acf0 con 0x7ff1740c8490 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.880+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff158066f30 msgr2=0x7ff1580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.880+0000 7ff17adff700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff158066f30 0x7ff1580693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1740ae1f0 tx=0x7ff1680091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.880+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1740c8490 msgr2=0x7ff1740c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.880+0000 7ff17adff700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1740c8490 0x7ff1740c2660 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009ab0 tx=0x7ff16c018000 comp rx=0 tx=0).stop 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 shutdown_connections 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff158066f30 0x7ff1580693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1740c8490 0x7ff1740c2660 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff174069a50 0x7ff174154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 --2- 172.21.15.86:0/1001343422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff174069e20 0x7ff174169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:20.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 >> 172.21.15.86:0/1001343422 conn(0x7ff1740c8f90 msgr2=0x7ff1740ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:20.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 shutdown_connections 2023-10-09T11:59:20.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:20.881+0000 7ff17adff700 1 -- 172.21.15.86:0/1001343422 wait complete. 2023-10-09T11:59:20.884 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T11:59:20.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:59:21.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.087+0000 7f790b59e700 1 Processor -- start 2023-10-09T11:59:21.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.088+0000 7f790b59e700 1 -- start start 2023-10-09T11:59:21.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790b59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f790c1563b0 0x7f790c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:21.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f790c156780 0x7f790c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:21.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c0ae2b0 0x7f790c0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:21.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790b59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c0cbe50 con 0x7f790c1563b0 2023-10-09T11:59:21.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c0aec30 con 0x7f790c156780 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0cb370 con 0x7f790c0ae2b0 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f790c1563b0 0x7f790c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f790c1563b0 0x7f790c0ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42416/0 (socket says 172.21.15.86:42416) 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 -- 172.21.15.86:0/2127397962 learned_addr learned my addr 172.21.15.86:0/2127397962 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790ad9d700 1 --2- 172.21.15.86:0/2127397962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c0ae2b0 0x7f790c0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f7909d9b700 1 --2- 172.21.15.86:0/2127397962 >> v2:172.21.15.135:3300/0 conn(0x7f790c156780 0x7f790c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 -- 172.21.15.86:0/2127397962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c0ae2b0 msgr2=0x7f790c0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 --2- 172.21.15.86:0/2127397962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c0ae2b0 0x7f790c0ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 -- 172.21.15.86:0/2127397962 >> v2:172.21.15.135:3300/0 conn(0x7f790c156780 msgr2=0x7f790c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:21.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 --2- 172.21.15.86:0/2127397962 >> v2:172.21.15.135:3300/0 conn(0x7f790c156780 0x7f790c0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f790a59c700 1 -- 172.21.15.86:0/2127397962 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0cb650 con 0x7f790c1563b0 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.089+0000 7f7909d9b700 1 --2- 172.21.15.86:0/2127397962 >> v2:172.21.15.135:3300/0 conn(0x7f790c156780 0x7f790c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.090+0000 7f790a59c700 1 --2- 172.21.15.86:0/2127397962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c1563b0 0x7f790c0ca7d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f790c065950 tx=0x7f78fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750ce690efb89939 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.090+0000 7f790959a700 1 -- 172.21.15.86:0/2127397962 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00b860 con 0x7f790c1563b0 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.090+0000 7f790959a700 1 -- 172.21.15.86:0/2127397962 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc00b9c0 con 0x7f790c1563b0 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.090+0000 7f790959a700 1 -- 172.21.15.86:0/2127397962 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00bd60 con 0x7f790c1563b0 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.090+0000 7f790b59e700 1 -- 172.21.15.86:0/2127397962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c1563b0 msgr2=0x7f790c0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.090+0000 7f790b59e700 1 --2- 172.21.15.86:0/2127397962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c1563b0 0x7f790c0ca7d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f790c065950 tx=0x7f78fc009250 comp rx=0 tx=0).stop 2023-10-09T11:59:21.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.091+0000 7f790b59e700 1 -- 172.21.15.86:0/2127397962 shutdown_connections 2023-10-09T11:59:21.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.091+0000 7f790b59e700 1 --2- 172.21.15.86:0/2127397962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c0ae2b0 0x7f790c0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.091+0000 7f790b59e700 1 --2- 172.21.15.86:0/2127397962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c1563b0 0x7f790c0ca7d0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.091+0000 7f790b59e700 1 --2- 172.21.15.86:0/2127397962 >> v2:172.21.15.135:3300/0 conn(0x7f790c156780 0x7f790c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.091+0000 7f790b59e700 1 -- 172.21.15.86:0/2127397962 >> 172.21.15.86:0/2127397962 conn(0x7f790c068e20 msgr2=0x7f790c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:21.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.091+0000 7f790b59e700 1 -- 172.21.15.86:0/2127397962 shutdown_connections 2023-10-09T11:59:21.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.091+0000 7f790b59e700 1 -- 172.21.15.86:0/2127397962 wait complete. 2023-10-09T11:59:21.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.092+0000 7f790b59e700 1 Processor -- start 2023-10-09T11:59:21.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.092+0000 7f790b59e700 1 -- start start 2023-10-09T11:59:21.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c0ae2b0 0x7f790c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:21.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c1563b0 0x7f790c0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c156780 0x7f790c0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c1516f0 con 0x7f790c0ae2b0 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0aff00 con 0x7f790c1563b0 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0b01e0 con 0x7f790c156780 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c0ae2b0 0x7f790c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790a59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c0ae2b0 0x7f790c1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42422/0 (socket says 172.21.15.86:42422) 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.093+0000 7f790a59c700 1 -- 172.21.15.86:0/4252952052 learned_addr learned my addr 172.21.15.86:0/4252952052 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790a59c700 1 -- 172.21.15.86:0/4252952052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c156780 msgr2=0x7f790c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f7909d9b700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c1563b0 0x7f790c0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:21.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790a59c700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c156780 0x7f790c0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790a59c700 1 -- 172.21.15.86:0/4252952052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c1563b0 msgr2=0x7f790c0b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790a59c700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c1563b0 0x7f790c0b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790a59c700 1 -- 172.21.15.86:0/4252952052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0094f0 con 0x7f790c0ae2b0 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790a59c700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c0ae2b0 0x7f790c1598c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009290 tx=0x7f78fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f78fa7fc700 1 -- 172.21.15.86:0/4252952052 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc026480 con 0x7f790c0ae2b0 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f78fa7fc700 1 -- 172.21.15.86:0/4252952052 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc01f070 con 0x7f790c0ae2b0 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c0b04c0 con 0x7f790c0ae2b0 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f78fa7fc700 1 -- 172.21.15.86:0/4252952052 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc026830 con 0x7f790c0ae2b0 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.094+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c0b0a80 con 0x7f790c0ae2b0 2023-10-09T11:59:21.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.095+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c04c3c0 con 0x7f790c0ae2b0 2023-10-09T11:59:21.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.096+0000 7f78fa7fc700 1 -- 172.21.15.86:0/4252952052 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78fc026ba0 con 0x7f790c0ae2b0 2023-10-09T11:59:21.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.098+0000 7f78fa7fc700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f78ec066f30 0x7f78ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:21.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.098+0000 7f78fa7fc700 1 -- 172.21.15.86:0/4252952052 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5599+0+0 (secure 0 0 0) 0x7f78fc021070 con 0x7f790c0ae2b0 2023-10-09T11:59:21.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.099+0000 7f7909d9b700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f78ec066f30 0x7f78ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:21.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.099+0000 7f7909d9b700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f78ec066f30 0x7f78ec0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7900006f00 tx=0x7f7900008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:21.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.102+0000 7f78fa7fc700 1 -- 172.21.15.86:0/4252952052 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78fc053d90 con 0x7f790c0ae2b0 2023-10-09T11:59:21.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.293+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f790c0c6860 con 0x7f790c0ae2b0 2023-10-09T11:59:21.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.882+0000 7f78fa7fc700 1 -- 172.21.15.86:0/4252952052 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v122) v1 ==== 170+0+0 (secure 0 0 0) 0x7f78fc0150d0 con 0x7f790c0ae2b0 2023-10-09T11:59:21.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.892+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f78ec066f30 msgr2=0x7f78ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:21.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.892+0000 7f790b59e700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f78ec066f30 0x7f78ec0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7900006f00 tx=0x7f7900008040 comp rx=0 tx=0).stop 2023-10-09T11:59:21.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.893+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c0ae2b0 msgr2=0x7f790c1598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.893+0000 7f790b59e700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c0ae2b0 0x7f790c1598c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009290 tx=0x7f78fc017000 comp rx=0 tx=0).stop 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.895+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 shutdown_connections 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.895+0000 7f790b59e700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f78ec066f30 0x7f78ec0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.895+0000 7f790b59e700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f790c0ae2b0 0x7f790c1598c0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.895+0000 7f790b59e700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f790c156780 0x7f790c0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.896+0000 7f790b59e700 1 --2- 172.21.15.86:0/4252952052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c1563b0 0x7f790c0b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.896+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 >> 172.21.15.86:0/4252952052 conn(0x7f790c068e20 msgr2=0x7f790c153130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.897+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 shutdown_connections 2023-10-09T11:59:21.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:21.897+0000 7f790b59e700 1 -- 172.21.15.86:0/4252952052 wait complete. 2023-10-09T11:59:21.903 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T11:59:21.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:59:22.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.104+0000 7fe063fff700 1 Processor -- start 2023-10-09T11:59:22.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.104+0000 7fe063fff700 1 -- start start 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.105+0000 7fe063fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe05c15ac80 0x7fe05c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.105+0000 7fe063fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe063fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c0af2f0 con 0x7fe05c0afa60 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe063fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c0af5d0 con 0x7fe05c15ac80 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe063fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0c8660 con 0x7fe05c15b050 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe06259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe05c0afa60 0x7fe05c0aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43576/0 (socket says 172.21.15.86:43576) 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe06259c700 1 -- 172.21.15.86:0/2375197956 learned_addr learned my addr 172.21.15.86:0/2375197956 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe061d9b700 1 --2- 172.21.15.86:0/2375197956 >> v2:172.21.15.135:3300/0 conn(0x7fe05c15ac80 0x7fe05c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe06159a700 1 --2- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:22.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe060d99700 1 -- 172.21.15.86:0/2375197956 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161918446 0 0) 0x7fe05c0af2f0 con 0x7fe05c0afa60 2023-10-09T11:59:22.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.106+0000 7fe060d99700 1 -- 172.21.15.86:0/2375197956 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe048003570 con 0x7fe05c0afa60 2023-10-09T11:59:22.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe061d9b700 1 -- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 msgr2=0x7fe05c069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:22.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe061d9b700 1 --2- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:22.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe061d9b700 1 -- 172.21.15.86:0/2375197956 >> v1:172.21.15.86:6789/0 conn(0x7fe05c0afa60 legacy=0x7fe05c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:22.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe061d9b700 1 -- 172.21.15.86:0/2375197956 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0c8940 con 0x7fe05c15ac80 2023-10-09T11:59:22.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe06159a700 1 --2- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:22.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe061d9b700 1 --2- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c15ac80 0x7fe05c069770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098e0 tx=0x7fe0580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e07e0f0b687e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:22.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe060d99700 1 -- 172.21.15.86:0/2375197956 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058011630 con 0x7fe05c15ac80 2023-10-09T11:59:22.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe060d99700 1 -- 172.21.15.86:0/2375197956 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058011790 con 0x7fe05c15ac80 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.107+0000 7fe060d99700 1 -- 172.21.15.86:0/2375197956 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058011b10 con 0x7fe05c15ac80 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 -- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c15ac80 msgr2=0x7fe05c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 --2- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c15ac80 0x7fe05c069770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098e0 tx=0x7fe0580091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 -- 172.21.15.86:0/2375197956 shutdown_connections 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 --2- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c15ac80 0x7fe05c069770 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 --2- 172.21.15.86:0/2375197956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 -- 172.21.15.86:0/2375197956 >> 172.21.15.86:0/2375197956 conn(0x7fe05c068e10 msgr2=0x7fe05c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 -- 172.21.15.86:0/2375197956 shutdown_connections 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.108+0000 7fe063fff700 1 -- 172.21.15.86:0/2375197956 wait complete. 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.109+0000 7fe063fff700 1 Processor -- start 2023-10-09T11:59:22.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.109+0000 7fe063fff700 1 -- start start 2023-10-09T11:59:22.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.110+0000 7fe063fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c0afa60 0x7fe05c0b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:22.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.110+0000 7fe063fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15ac80 0x7fe05c144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:22.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.110+0000 7fe063fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:22.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.110+0000 7fe063fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c155d60 con 0x7fe05c15ac80 2023-10-09T11:59:22.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.110+0000 7fe063fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c148010 con 0x7fe05c0afa60 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.110+0000 7fe063fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c147400 con 0x7fe05c15b050 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15ac80 0x7fe05c144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15ac80 0x7fe05c144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42432/0 (socket says 172.21.15.86:42432) 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 -- 172.21.15.86:0/663902544 learned_addr learned my addr 172.21.15.86:0/663902544 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe061d9b700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c0afa60 0x7fe05c0b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06259c700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 -- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 msgr2=0x7fe05c145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 -- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c0afa60 msgr2=0x7fe05c0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c0afa60 0x7fe05c0b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 -- 172.21.15.86:0/663902544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c009420 con 0x7fe05c15ac80 2023-10-09T11:59:22.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe061d9b700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c0afa60 0x7fe05c0b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:22.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe06159a700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15ac80 0x7fe05c144bd0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00ec80 tx=0x7fe04c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:22.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.111+0000 7fe051ffb700 1 -- 172.21.15.86:0/663902544 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00c9d0 con 0x7fe05c15ac80 2023-10-09T11:59:22.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.112+0000 7fe051ffb700 1 -- 172.21.15.86:0/663902544 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c00cb30 con 0x7fe05c15ac80 2023-10-09T11:59:22.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.112+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe058009420 con 0x7fe05c15ac80 2023-10-09T11:59:22.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.112+0000 7fe051ffb700 1 -- 172.21.15.86:0/663902544 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00ceb0 con 0x7fe05c15ac80 2023-10-09T11:59:22.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.112+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c1479c0 con 0x7fe05c15ac80 2023-10-09T11:59:22.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.113+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c1481a0 con 0x7fe05c15ac80 2023-10-09T11:59:22.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.115+0000 7fe051ffb700 1 -- 172.21.15.86:0/663902544 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe04c013680 con 0x7fe05c15ac80 2023-10-09T11:59:22.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.115+0000 7fe051ffb700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:22.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.116+0000 7fe051ffb700 1 -- 172.21.15.86:0/663902544 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5981+0+0 (secure 0 0 0) 0x7fe04c085200 con 0x7fe05c15ac80 2023-10-09T11:59:22.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.116+0000 7fe061d9b700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:22.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.116+0000 7fe061d9b700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe040066f30 0x7fe0400693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0580091e0 tx=0x7fe058017000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:22.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.119+0000 7fe051ffb700 1 -- 172.21.15.86:0/663902544 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe04c052340 con 0x7fe05c15ac80 2023-10-09T11:59:22.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:22.353+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe05c0c8c20 con 0x7fe05c15ac80 2023-10-09T11:59:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.302+0000 7fe051ffb700 1 -- 172.21.15.86:0/663902544 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe04c055960 con 0x7fe05c15ac80 2023-10-09T11:59:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe040066f30 msgr2=0x7fe0400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe040066f30 0x7fe0400693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0580091e0 tx=0x7fe058017000 comp rx=0 tx=0).stop 2023-10-09T11:59:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15ac80 msgr2=0x7fe05c144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15ac80 0x7fe05c144bd0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00ec80 tx=0x7fe04c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 shutdown_connections 2023-10-09T11:59:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05c15b050 0x7fe05c145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05c0afa60 0x7fe05c0b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 --2- 172.21.15.86:0/663902544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15ac80 0x7fe05c144bd0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 >> 172.21.15.86:0/663902544 conn(0x7fe05c068e10 msgr2=0x7fe05c0c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 shutdown_connections 2023-10-09T11:59:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.305+0000 7fe063fff700 1 -- 172.21.15.86:0/663902544 wait complete. 2023-10-09T11:59:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 14 and data pool 15 2023-10-09T11:59:23.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:59:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.514+0000 7f43f7fff700 1 Processor -- start 2023-10-09T11:59:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.514+0000 7f43f7fff700 1 -- start start 2023-10-09T11:59:23.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f43f8156310 0x7f43f80c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f81566e0 0x7f43f80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43f80ca300 0x7f43f80ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f7fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f80ca860 con 0x7f43f80ca300 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f7fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f80cab40 con 0x7f43f8156310 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80cae20 con 0x7f43f81566e0 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43f80ca300 0x7f43f80ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43f80ca300 0x7f43f80ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42434/0 (socket says 172.21.15.86:42434) 2023-10-09T11:59:23.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.515+0000 7f43f77fe700 1 -- 172.21.15.86:0/2438508807 learned_addr learned my addr 172.21.15.86:0/2438508807 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f67fc700 1 --2- 172.21.15.86:0/2438508807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f81566e0 0x7f43f80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f6ffd700 1 --2- 172.21.15.86:0/2438508807 >> v2:172.21.15.135:3300/0 conn(0x7f43f8156310 0x7f43f80c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f77fe700 1 -- 172.21.15.86:0/2438508807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f81566e0 msgr2=0x7f43f80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f77fe700 1 --2- 172.21.15.86:0/2438508807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f81566e0 0x7f43f80ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f77fe700 1 -- 172.21.15.86:0/2438508807 >> v2:172.21.15.135:3300/0 conn(0x7f43f8156310 msgr2=0x7f43f80c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f77fe700 1 --2- 172.21.15.86:0/2438508807 >> v2:172.21.15.135:3300/0 conn(0x7f43f8156310 0x7f43f80c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f77fe700 1 -- 172.21.15.86:0/2438508807 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f80cb100 con 0x7f43f80ca300 2023-10-09T11:59:23.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f77fe700 1 --2- 172.21.15.86:0/2438508807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f80ca300 0x7f43f80ae540 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f43f80cce20 tx=0x7f43f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9ccfcfedae4166 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2438508807 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000e070 con 0x7f43f80ca300 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2438508807 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f000ba50 con 0x7f43f80ca300 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.516+0000 7f43f5ffb700 1 -- 172.21.15.86:0/2438508807 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00092e0 con 0x7f43f80ca300 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 -- 172.21.15.86:0/2438508807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f80ca300 msgr2=0x7f43f80ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 --2- 172.21.15.86:0/2438508807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f80ca300 0x7f43f80ae540 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f43f80cce20 tx=0x7f43f0009840 comp rx=0 tx=0).stop 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 -- 172.21.15.86:0/2438508807 shutdown_connections 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 --2- 172.21.15.86:0/2438508807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f80ca300 0x7f43f80ae540 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 --2- 172.21.15.86:0/2438508807 >> v2:172.21.15.135:3300/0 conn(0x7f43f8156310 0x7f43f80c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 --2- 172.21.15.86:0/2438508807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f81566e0 0x7f43f80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 -- 172.21.15.86:0/2438508807 >> 172.21.15.86:0/2438508807 conn(0x7f43f80cc1f0 msgr2=0x7f43f80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:23.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 -- 172.21.15.86:0/2438508807 shutdown_connections 2023-10-09T11:59:23.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.517+0000 7f43f7fff700 1 -- 172.21.15.86:0/2438508807 wait complete. 2023-10-09T11:59:23.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.518+0000 7f43f7fff700 1 Processor -- start 2023-10-09T11:59:23.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.519+0000 7f43f7fff700 1 -- start start 2023-10-09T11:59:23.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.519+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f80ca300 0x7f43f8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.519+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8156310 0x7f43f8153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43f81566e0 0x7f43f81543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f7fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8155440 con 0x7f43f8156310 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8154930 con 0x7f43f81566e0 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8154ba0 con 0x7f43f80ca300 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8156310 0x7f43f8153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8156310 0x7f43f8153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42450/0 (socket says 172.21.15.86:42450) 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 -- 172.21.15.86:0/1072504537 learned_addr learned my addr 172.21.15.86:0/1072504537 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f6ffd700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f80ca300 0x7f43f8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f77fe700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43f81566e0 0x7f43f81543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 -- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f80ca300 msgr2=0x7f43f8151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f80ca300 0x7f43f8151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 -- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43f81566e0 msgr2=0x7f43f81543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43f81566e0 0x7f43f81543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 -- 172.21.15.86:0/1072504537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009ae0 con 0x7f43f8156310 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.520+0000 7f43f67fc700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8156310 0x7f43f8153eb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00d890 tx=0x7f43ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.521+0000 7f43deffd700 1 -- 172.21.15.86:0/1072504537 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec018070 con 0x7f43f8156310 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.521+0000 7f43deffd700 1 -- 172.21.15.86:0/1072504537 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec00b600 con 0x7f43f8156310 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.521+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f8154e80 con 0x7f43f8156310 2023-10-09T11:59:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.521+0000 7f43deffd700 1 -- 172.21.15.86:0/1072504537 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00b9a0 con 0x7f43f8156310 2023-10-09T11:59:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.521+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f8169ac0 con 0x7f43f8156310 2023-10-09T11:59:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.522+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f8169cb0 con 0x7f43f8156310 2023-10-09T11:59:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.523+0000 7f43deffd700 1 -- 172.21.15.86:0/1072504537 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43ec00bd50 con 0x7f43f8156310 2023-10-09T11:59:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.523+0000 7f43deffd700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43e4066f30 0x7f43e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.523+0000 7f43deffd700 1 -- 172.21.15.86:0/1072504537 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f43ec084a20 con 0x7f43f8156310 2023-10-09T11:59:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.524+0000 7f43f6ffd700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43e4066f30 0x7f43e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.524+0000 7f43f6ffd700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43e4066f30 0x7f43e40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43e8006fd0 tx=0x7f43e8008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:23.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.528+0000 7f43deffd700 1 -- 172.21.15.86:0/1072504537 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43ec051a70 con 0x7f43f8156310 2023-10-09T11:59:23.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.719+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43f804c3c0 con 0x7f43f8156310 2023-10-09T11:59:23.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.720+0000 7f43deffd700 1 -- 172.21.15.86:0/1072504537 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+15995 (secure 0 0 0) 0x7f43ec055090 con 0x7f43f8156310 2023-10-09T11:59:23.721 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:23.722 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":123,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:22.355526+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:59:20.468724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:59:21.333069+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:59:23.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43e4066f30 msgr2=0x7f43e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43e4066f30 0x7f43e40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43e8006fd0 tx=0x7f43e8008040 comp rx=0 tx=0).stop 2023-10-09T11:59:23.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8156310 msgr2=0x7f43f8153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8156310 0x7f43f8153eb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00d890 tx=0x7f43ec008040 comp rx=0 tx=0).stop 2023-10-09T11:59:23.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 shutdown_connections 2023-10-09T11:59:23.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43f81566e0 0x7f43f81543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43f80ca300 0x7f43f8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f43e4066f30 0x7f43e40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 --2- 172.21.15.86:0/1072504537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8156310 0x7f43f8153eb0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 >> 172.21.15.86:0/1072504537 conn(0x7f43f80cc1f0 msgr2=0x7f43f80c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:23.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.722+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 shutdown_connections 2023-10-09T11:59:23.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.723+0000 7f43f7fff700 1 -- 172.21.15.86:0/1072504537 wait complete. 2023-10-09T11:59:23.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:59:23.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.927+0000 7fc9721ff700 1 Processor -- start 2023-10-09T11:59:23.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.927+0000 7fc9721ff700 1 -- start start 2023-10-09T11:59:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc9721ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc9721ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc96c0b1420 0x7fc96c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc9721ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c0cc300 con 0x7fc96c0ccf90 2023-10-09T11:59:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc9721ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c156bf0 con 0x7fc96c0b1420 2023-10-09T11:59:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc9721ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0ae950 con 0x7fc96c0cbf30 2023-10-09T11:59:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc96bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc96c0b1420 0x7fc96c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc96bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc96c0b1420 0x7fc96c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42456/0 (socket says 172.21.15.86:42456) 2023-10-09T11:59:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc96bfff700 1 -- 172.21.15.86:0/854597064 learned_addr learned my addr 172.21.15.86:0/854597064 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc96b7fe700 1 --2- 172.21.15.86:0/854597064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc96bfff700 1 -- 172.21.15.86:0/854597064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 msgr2=0x7fc96c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc96bfff700 1 --2- 172.21.15.86:0/854597064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.929+0000 7fc96bfff700 1 -- 172.21.15.86:0/854597064 >> v1:172.21.15.135:6789/0 conn(0x7fc96c0ccf90 legacy=0x7fc96c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.930+0000 7fc96bfff700 1 -- 172.21.15.86:0/854597064 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0ad370 con 0x7fc96c0b1420 2023-10-09T11:59:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.930+0000 7fc96bfff700 1 --2- 172.21.15.86:0/854597064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c0c9740 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc964009f50 tx=0x7fc964009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9622436cee9683f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.930+0000 7fc96affd700 1 -- 172.21.15.86:0/854597064 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400e070 con 0x7fc96c0b1420 2023-10-09T11:59:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.930+0000 7fc96affd700 1 -- 172.21.15.86:0/854597064 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400b9c0 con 0x7fc96c0b1420 2023-10-09T11:59:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.930+0000 7fc96affd700 1 -- 172.21.15.86:0/854597064 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640092e0 con 0x7fc96c0b1420 2023-10-09T11:59:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.930+0000 7fc9721ff700 1 -- 172.21.15.86:0/854597064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 msgr2=0x7fc96c0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.930+0000 7fc9721ff700 1 --2- 172.21.15.86:0/854597064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c0c9740 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc964009f50 tx=0x7fc964009840 comp rx=0 tx=0).stop 2023-10-09T11:59:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.931+0000 7fc9721ff700 1 -- 172.21.15.86:0/854597064 shutdown_connections 2023-10-09T11:59:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.931+0000 7fc9721ff700 1 --2- 172.21.15.86:0/854597064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c0c9740 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.931+0000 7fc9721ff700 1 --2- 172.21.15.86:0/854597064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.931+0000 7fc9721ff700 1 -- 172.21.15.86:0/854597064 >> 172.21.15.86:0/854597064 conn(0x7fc96c06a320 msgr2=0x7fc96c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:23.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.931+0000 7fc9721ff700 1 -- 172.21.15.86:0/854597064 shutdown_connections 2023-10-09T11:59:23.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.931+0000 7fc9721ff700 1 -- 172.21.15.86:0/854597064 wait complete. 2023-10-09T11:59:23.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.932+0000 7fc9721ff700 1 Processor -- start 2023-10-09T11:59:23.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.932+0000 7fc9721ff700 1 -- start start 2023-10-09T11:59:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc9721ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c14b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc9721ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc9721ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96c0ccf90 0x7fc96c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc9721ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0aae60 con 0x7fc96c0b1420 2023-10-09T11:59:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc9721ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0ab140 con 0x7fc96c0ccf90 2023-10-09T11:59:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc9721ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0ab420 con 0x7fc96c0cbf30 2023-10-09T11:59:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc96b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c14b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc96b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c14b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42472/0 (socket says 172.21.15.86:42472) 2023-10-09T11:59:23.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.933+0000 7fc96b7fe700 1 -- 172.21.15.86:0/670390543 learned_addr learned my addr 172.21.15.86:0/670390543 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:23.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96bfff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96c0ccf90 0x7fc96c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc963fff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96b7fe700 1 -- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 msgr2=0x7fc96c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96b7fe700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96b7fe700 1 -- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96c0ccf90 msgr2=0x7fc96c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:23.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96b7fe700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96c0ccf90 0x7fc96c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:23.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96b7fe700 1 -- 172.21.15.86:0/670390543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009ae0 con 0x7fc96c0b1420 2023-10-09T11:59:23.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96bfff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96c0ccf90 0x7fc96c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:23.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc963fff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:23.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc96b7fe700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c14b0b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00ec80 tx=0x7fc95c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:23.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc9637fe700 1 -- 172.21.15.86:0/670390543 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00c9d0 con 0x7fc96c0b1420 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc9637fe700 1 -- 172.21.15.86:0/670390543 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00cb30 con 0x7fc96c0b1420 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c0ab700 con 0x7fc96c0b1420 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc9637fe700 1 -- 172.21.15.86:0/670390543 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c013470 con 0x7fc96c0b1420 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.934+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c14b5f0 con 0x7fc96c0b1420 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.935+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c0ab940 con 0x7fc96c0b1420 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.936+0000 7fc9637fe700 1 -- 172.21.15.86:0/670390543 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc95c013820 con 0x7fc96c0b1420 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.937+0000 7fc9637fe700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc94c066f30 0x7fc94c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:23.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.937+0000 7fc9637fe700 1 -- 172.21.15.86:0/670390543 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc95c084ae0 con 0x7fc96c0b1420 2023-10-09T11:59:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.937+0000 7fc963fff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc94c066f30 0x7fc94c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.938+0000 7fc963fff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc94c066f30 0x7fc94c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9540017a0 tx=0x7fc954009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:23.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:23.941+0000 7fc9637fe700 1 -- 172.21.15.86:0/670390543 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc96c0ab940 con 0x7fc96c0b1420 2023-10-09T11:59:24.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.130+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc96c06c150 con 0x7fc96c0b1420 2023-10-09T11:59:24.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.131+0000 7fc9637fe700 1 -- 172.21.15.86:0/670390543 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+15982 (secure 0 0 0) 0x7fc95c051b30 con 0x7fc96c0b1420 2023-10-09T11:59:24.133 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:24.133 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":124,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:23.881580+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:59:20.468724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:59:21.333069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:59:24.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.133+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc94c066f30 msgr2=0x7fc94c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:24.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.133+0000 7fc9721ff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc94c066f30 0x7fc94c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9540017a0 tx=0x7fc954009040 comp rx=0 tx=0).stop 2023-10-09T11:59:24.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.133+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 msgr2=0x7fc96c14b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:24.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.133+0000 7fc9721ff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c14b0b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00ec80 tx=0x7fc95c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 shutdown_connections 2023-10-09T11:59:24.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc94c066f30 0x7fc94c0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc96c0b1420 0x7fc96c14b0b0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc96c0ccf90 0x7fc96c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 --2- 172.21.15.86:0/670390543 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc96c0cbf30 0x7fc96c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 >> 172.21.15.86:0/670390543 conn(0x7fc96c06a320 msgr2=0x7fc96c0ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:24.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 shutdown_connections 2023-10-09T11:59:24.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.134+0000 7fc9721ff700 1 -- 172.21.15.86:0/670390543 wait complete. 2023-10-09T11:59:24.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:59:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.339+0000 7f6960bff700 1 Processor -- start 2023-10-09T11:59:24.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.339+0000 7f6960bff700 1 -- start start 2023-10-09T11:59:24.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.340+0000 7f6960bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f695c0c70b0 0x7f695c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:24.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.340+0000 7f6960bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0cd0b0 0x7f695c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.340+0000 7f6960bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c06e950 con 0x7f695c0ccc40 2023-10-09T11:59:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f6960bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c1563f0 con 0x7f695c0c70b0 2023-10-09T11:59:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f6960bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c06eb90 con 0x7f695c0cd0b0 2023-10-09T11:59:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f695a59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f695c0c70b0 0x7f695c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f695ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0cd0b0 0x7f695c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f695a59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f695c0c70b0 0x7f695c155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:60058/0 (socket says 172.21.15.86:60058) 2023-10-09T11:59:24.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f695ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0cd0b0 0x7f695c069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:59554/0 (socket says 172.21.15.86:59554) 2023-10-09T11:59:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f695a59c700 1 -- 172.21.15.86:0/2872857290 learned_addr learned my addr 172.21.15.86:0/2872857290 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.341+0000 7f6953fff700 1 --1- 172.21.15.86:0/2872857290 >> v1:172.21.15.135:6789/0 conn(0x7f695c0ccc40 0x7f695c06e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:53852/0 (socket says 172.21.15.86:53852) 2023-10-09T11:59:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f695a59c700 1 -- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0cd0b0 msgr2=0x7f695c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f695a59c700 1 --2- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0cd0b0 0x7f695c069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f695a59c700 1 -- 172.21.15.86:0/2872857290 >> v1:172.21.15.135:6789/0 conn(0x7f695c0ccc40 legacy=0x7f695c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f695a59c700 1 -- 172.21.15.86:0/2872857290 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c06ee70 con 0x7f695c0c70b0 2023-10-09T11:59:24.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f695ad9d700 1 --2- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0cd0b0 0x7f695c069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f6959d9b700 1 -- 172.21.15.86:0/2872857290 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378544595 0 0) 0x7f6944001110 con 0x7f695c0ccc40 2023-10-09T11:59:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f695a59c700 1 --2- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 0x7f695c155eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f694c0099b0 tx=0x7f694c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5a1d8a312a773bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f6959d9b700 1 -- 172.21.15.86:0/2872857290 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c009ea0 con 0x7f695c0c70b0 2023-10-09T11:59:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f6959d9b700 1 -- 172.21.15.86:0/2872857290 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00b860 con 0x7f695c0c70b0 2023-10-09T11:59:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.342+0000 7f6959d9b700 1 -- 172.21.15.86:0/2872857290 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00bc00 con 0x7f695c0c70b0 2023-10-09T11:59:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 -- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 msgr2=0x7f695c155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:24.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 --2- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 0x7f695c155eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f694c0099b0 tx=0x7f694c009250 comp rx=0 tx=0).stop 2023-10-09T11:59:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 -- 172.21.15.86:0/2872857290 shutdown_connections 2023-10-09T11:59:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 --2- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0cd0b0 0x7f695c069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 --2- 172.21.15.86:0/2872857290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 0x7f695c155eb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 -- 172.21.15.86:0/2872857290 >> 172.21.15.86:0/2872857290 conn(0x7f695c068e10 msgr2=0x7f695c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 -- 172.21.15.86:0/2872857290 shutdown_connections 2023-10-09T11:59:24.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.343+0000 7f6960bff700 1 -- 172.21.15.86:0/2872857290 wait complete. 2023-10-09T11:59:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.344+0000 7f6960bff700 1 Processor -- start 2023-10-09T11:59:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.344+0000 7f6960bff700 1 -- start start 2023-10-09T11:59:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.345+0000 7f6960bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 0x7f695c0a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.345+0000 7f6960bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0ccc40 0x7f695c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.345+0000 7f6960bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0cd0b0 0x7f695c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.345+0000 7f6960bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0a87d0 con 0x7f695c0cd0b0 2023-10-09T11:59:24.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.345+0000 7f6960bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0a6720 con 0x7f695c0c70b0 2023-10-09T11:59:24.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.345+0000 7f6960bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0a6a00 con 0x7f695c0ccc40 2023-10-09T11:59:24.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0cd0b0 0x7f695c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:24.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0cd0b0 0x7f695c154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42478/0 (socket says 172.21.15.86:42478) 2023-10-09T11:59:24.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 -- 172.21.15.86:0/3334933531 learned_addr learned my addr 172.21.15.86:0/3334933531 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:24.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f6953fff700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0ccc40 0x7f695c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:24.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695a59c700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 0x7f695c0a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:24.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 -- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0ccc40 msgr2=0x7f695c0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0ccc40 0x7f695c0c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 -- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 msgr2=0x7f695c0a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 0x7f695c0a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 -- 172.21.15.86:0/3334933531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695400de30 con 0x7f695c0cd0b0 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.346+0000 7f695ad9d700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0cd0b0 0x7f695c154ae0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f69540124f0 tx=0x7f695400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.347+0000 7f69527fc700 1 -- 172.21.15.86:0/3334933531 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954012e50 con 0x7f695c0cd0b0 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.347+0000 7f69527fc700 1 -- 172.21.15.86:0/3334933531 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954013040 con 0x7f695c0cd0b0 2023-10-09T11:59:24.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.347+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c0094f0 con 0x7f695c0cd0b0 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.347+0000 7f69527fc700 1 -- 172.21.15.86:0/3334933531 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954019830 con 0x7f695c0cd0b0 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.347+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c0a6fc0 con 0x7f695c0cd0b0 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.348+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c0a8960 con 0x7f695c0cd0b0 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.349+0000 7f69527fc700 1 -- 172.21.15.86:0/3334933531 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6954019be0 con 0x7f695c0cd0b0 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.349+0000 7f69527fc700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f693c066f30 0x7f693c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.350+0000 7f69527fc700 1 -- 172.21.15.86:0/3334933531 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f6954089830 con 0x7f695c0cd0b0 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.350+0000 7f695a59c700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f693c066f30 0x7f693c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:24.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.350+0000 7f695a59c700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f693c066f30 0x7f693c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f694c0099b0 tx=0x7f694c017000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:24.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.353+0000 7f69527fc700 1 -- 172.21.15.86:0/3334933531 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f695c0a8960 con 0x7f695c0cd0b0 2023-10-09T11:59:24.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:24.587+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f695c0a8960 con 0x7f695c0cd0b0 2023-10-09T11:59:25.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.316+0000 7f69527fc700 1 -- 172.21.15.86:0/3334933531 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f695c0a8960 con 0x7f695c0cd0b0 2023-10-09T11:59:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f693c066f30 msgr2=0x7f693c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f693c066f30 0x7f693c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f694c0099b0 tx=0x7f694c017000 comp rx=0 tx=0).stop 2023-10-09T11:59:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0cd0b0 msgr2=0x7f695c154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0cd0b0 0x7f695c154ae0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f69540124f0 tx=0x7f695400db90 comp rx=0 tx=0).stop 2023-10-09T11:59:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 shutdown_connections 2023-10-09T11:59:25.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f693c066f30 0x7f693c0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0cd0b0 0x7f695c154ae0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f695c0c70b0 0x7f695c0a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 --2- 172.21.15.86:0/3334933531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f695c0ccc40 0x7f695c0c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 >> 172.21.15.86:0/3334933531 conn(0x7f695c068e10 msgr2=0x7f695c069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 shutdown_connections 2023-10-09T11:59:25.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.319+0000 7f6960bff700 1 -- 172.21.15.86:0/3334933531 wait complete. 2023-10-09T11:59:25.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:59:25.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.521+0000 7f1f0359d700 1 Processor -- start 2023-10-09T11:59:25.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.521+0000 7f1f0359d700 1 -- start start 2023-10-09T11:59:25.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.522+0000 7f1f0359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc15a3b0 0x7f1efc15a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:25.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.522+0000 7f1f0359d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1efc0aef00 0x7f1efc15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:25.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.522+0000 7f1f0359d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0aea70 con 0x7f1efc06e470 2023-10-09T11:59:25.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.522+0000 7f1f0359d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc0ae480 con 0x7f1efc0aef00 2023-10-09T11:59:25.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.522+0000 7f1f0359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc15acc0 con 0x7f1efc15a3b0 2023-10-09T11:59:25.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f02d9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1efc06e470 0x7f1efc0c7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54518/0 (socket says 172.21.15.86:54518) 2023-10-09T11:59:25.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f02d9c700 1 -- 172.21.15.86:0/4226077108 learned_addr learned my addr 172.21.15.86:0/4226077108 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:25.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f01d9a700 1 --2- 172.21.15.86:0/4226077108 >> v2:172.21.15.86:3300/0 conn(0x7f1efc0aef00 0x7f1efc15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:25.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f0259b700 1 --2- 172.21.15.86:0/4226077108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc15a3b0 0x7f1efc15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:25.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f01599700 1 -- 172.21.15.86:0/4226077108 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474499940 0 0) 0x7f1efc0aea70 con 0x7f1efc06e470 2023-10-09T11:59:25.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f01d9a700 1 -- 172.21.15.86:0/4226077108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc15a3b0 msgr2=0x7f1efc15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:25.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f01d9a700 1 --2- 172.21.15.86:0/4226077108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc15a3b0 0x7f1efc15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f01d9a700 1 -- 172.21.15.86:0/4226077108 >> v1:172.21.15.86:6789/0 conn(0x7f1efc06e470 legacy=0x7f1efc0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f01d9a700 1 -- 172.21.15.86:0/4226077108 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc15dd30 con 0x7f1efc0aef00 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.523+0000 7f1f01d9a700 1 --2- 172.21.15.86:0/4226077108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc15d3c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0098e0 tx=0x7f1eec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9477f1544b2c63c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f01599700 1 -- 172.21.15.86:0/4226077108 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00b640 con 0x7f1efc0aef00 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f01599700 1 -- 172.21.15.86:0/4226077108 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec00b7a0 con 0x7f1efc0aef00 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f01599700 1 -- 172.21.15.86:0/4226077108 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00bb40 con 0x7f1efc0aef00 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 -- 172.21.15.86:0/4226077108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 msgr2=0x7f1efc15d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:25.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 --2- 172.21.15.86:0/4226077108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc15d3c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0098e0 tx=0x7f1eec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 -- 172.21.15.86:0/4226077108 shutdown_connections 2023-10-09T11:59:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 --2- 172.21.15.86:0/4226077108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc15a3b0 0x7f1efc15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 --2- 172.21.15.86:0/4226077108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc15d3c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 -- 172.21.15.86:0/4226077108 >> 172.21.15.86:0/4226077108 conn(0x7f1efc0c9f70 msgr2=0x7f1efc06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 -- 172.21.15.86:0/4226077108 shutdown_connections 2023-10-09T11:59:25.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.524+0000 7f1f0359d700 1 -- 172.21.15.86:0/4226077108 wait complete. 2023-10-09T11:59:25.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.526+0000 7f1f0359d700 1 Processor -- start 2023-10-09T11:59:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.526+0000 7f1f0359d700 1 -- start start 2023-10-09T11:59:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f0359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc06e470 0x7f1efc159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f0359d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f0359d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc15a3b0 0x7f1efc140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f0359d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc158e80 con 0x7f1efc0aef00 2023-10-09T11:59:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f0359d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc158270 con 0x7f1efc15a3b0 2023-10-09T11:59:25.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f0359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc158550 con 0x7f1efc06e470 2023-10-09T11:59:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38980/0 (socket says 172.21.15.86:38980) 2023-10-09T11:59:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 -- 172.21.15.86:0/3172508523 learned_addr learned my addr 172.21.15.86:0/3172508523 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f0259b700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc06e470 0x7f1efc159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f02d9c700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc15a3b0 0x7f1efc140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 -- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc06e470 msgr2=0x7f1efc159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:25.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc06e470 0x7f1efc159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 -- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc15a3b0 msgr2=0x7f1efc140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:25.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc15a3b0 0x7f1efc140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:25.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f01d9a700 1 -- 172.21.15.86:0/3172508523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec009420 con 0x7f1efc0aef00 2023-10-09T11:59:25.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.527+0000 7f1f02d9c700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc15a3b0 0x7f1efc140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:25.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.528+0000 7f1f01d9a700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc1555d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f1efc064280 tx=0x7f1eec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:25.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.528+0000 7f1ef27fc700 1 -- 172.21.15.86:0/3172508523 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00bb20 con 0x7f1efc0aef00 2023-10-09T11:59:25.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.528+0000 7f1ef27fc700 1 -- 172.21.15.86:0/3172508523 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec011420 con 0x7f1efc0aef00 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.528+0000 7f1ef27fc700 1 -- 172.21.15.86:0/3172508523 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec0117a0 con 0x7f1efc0aef00 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.528+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc158830 con 0x7f1efc0aef00 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.528+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc159850 con 0x7f1efc0aef00 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.529+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc158ff0 con 0x7f1efc0aef00 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.530+0000 7f1ef27fc700 1 -- 172.21.15.86:0/3172508523 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eec011b50 con 0x7f1efc0aef00 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.531+0000 7f1ef27fc700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ee0066f30 0x7f1ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.531+0000 7f1ef27fc700 1 -- 172.21.15.86:0/3172508523 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f1eec085e80 con 0x7f1efc0aef00 2023-10-09T11:59:25.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.531+0000 7f1f0259b700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ee0066f30 0x7f1ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:25.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.531+0000 7f1f0259b700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ee0066f30 0x7f1ee00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009ca0 tx=0x7f1ef8008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:25.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.535+0000 7f1ef27fc700 1 -- 172.21.15.86:0/3172508523 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eec052ed0 con 0x7f1efc0aef00 2023-10-09T11:59:25.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:25.770+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1efc159a40 con 0x7f1efc0aef00 2023-10-09T11:59:26.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.318+0000 7f1ef27fc700 1 -- 172.21.15.86:0/3172508523 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1eec0564f0 con 0x7f1efc0aef00 2023-10-09T11:59:26.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ee0066f30 msgr2=0x7f1ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ee0066f30 0x7f1ee00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009ca0 tx=0x7f1ef8008040 comp rx=0 tx=0).stop 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 msgr2=0x7f1efc1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc1555d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f1efc064280 tx=0x7f1eec017000 comp rx=0 tx=0).stop 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 shutdown_connections 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc15a3b0 0x7f1efc140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1efc06e470 0x7f1efc159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ee0066f30 0x7f1ee00693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 --2- 172.21.15.86:0/3172508523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc0aef00 0x7f1efc1555d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 >> 172.21.15.86:0/3172508523 conn(0x7f1efc0c9f70 msgr2=0x7f1efc152690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 shutdown_connections 2023-10-09T11:59:26.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.321+0000 7f1f0359d700 1 -- 172.21.15.86:0/3172508523 wait complete. 2023-10-09T11:59:26.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:59:26.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.522+0000 7f315edff700 1 Processor -- start 2023-10-09T11:59:26.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.522+0000 7f315edff700 1 -- start start 2023-10-09T11:59:26.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.523+0000 7f315edff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3158159890 0x7f315815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.523+0000 7f315edff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3158069560 0x7f31580699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.523+0000 7f315edff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3158069ee0 con 0x7f3158159c60 2023-10-09T11:59:26.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.523+0000 7f315edff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315815a160 con 0x7f3158069560 2023-10-09T11:59:26.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.523+0000 7f315edff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580d13a0 con 0x7f3158159890 2023-10-09T11:59:26.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.523+0000 7f315d39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3158069560 0x7f31580699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315d39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3158069560 0x7f31580699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38994/0 (socket says 172.21.15.86:38994) 2023-10-09T11:59:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315d39c700 1 -- 172.21.15.86:0/3636212656 learned_addr learned my addr 172.21.15.86:0/3636212656 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315cb9b700 1 --2- 172.21.15.86:0/3636212656 >> v2:172.21.15.135:3300/0 conn(0x7f3158159890 0x7f315815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315d39c700 1 -- 172.21.15.86:0/3636212656 >> v2:172.21.15.135:3300/0 conn(0x7f3158159890 msgr2=0x7f315815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315d39c700 1 --2- 172.21.15.86:0/3636212656 >> v2:172.21.15.135:3300/0 conn(0x7f3158159890 0x7f315815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315d39c700 1 -- 172.21.15.86:0/3636212656 >> v1:172.21.15.135:6789/0 conn(0x7f3158159c60 legacy=0x7f315815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:26.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315d39c700 1 -- 172.21.15.86:0/3636212656 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315815e140 con 0x7f3158069560 2023-10-09T11:59:26.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f315d39c700 1 --2- 172.21.15.86:0/3636212656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158069560 0x7f31580699a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f31580d1090 tx=0x7f3150009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7daf1dd8f12027d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:26.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f31577fe700 1 -- 172.21.15.86:0/3636212656 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000e070 con 0x7f3158069560 2023-10-09T11:59:26.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f31577fe700 1 -- 172.21.15.86:0/3636212656 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000ba10 con 0x7f3158069560 2023-10-09T11:59:26.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.524+0000 7f31577fe700 1 -- 172.21.15.86:0/3636212656 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500092e0 con 0x7f3158069560 2023-10-09T11:59:26.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 -- 172.21.15.86:0/3636212656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158069560 msgr2=0x7f31580699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 --2- 172.21.15.86:0/3636212656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158069560 0x7f31580699a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f31580d1090 tx=0x7f3150009840 comp rx=0 tx=0).stop 2023-10-09T11:59:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 -- 172.21.15.86:0/3636212656 shutdown_connections 2023-10-09T11:59:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 --2- 172.21.15.86:0/3636212656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158069560 0x7f31580699a0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 --2- 172.21.15.86:0/3636212656 >> v2:172.21.15.135:3300/0 conn(0x7f3158159890 0x7f315815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 -- 172.21.15.86:0/3636212656 >> 172.21.15.86:0/3636212656 conn(0x7f3158068e20 msgr2=0x7f31580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 -- 172.21.15.86:0/3636212656 shutdown_connections 2023-10-09T11:59:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.525+0000 7f315edff700 1 -- 172.21.15.86:0/3636212656 wait complete. 2023-10-09T11:59:26.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.527+0000 7f315edff700 1 Processor -- start 2023-10-09T11:59:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.527+0000 7f315edff700 1 -- start start 2023-10-09T11:59:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.527+0000 7f315edff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3158069560 0x7f315815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.527+0000 7f315edff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158159890 0x7f31581523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f315edff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3158159c60 0x7f31580cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f315edff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580cf1f0 con 0x7f3158159890 2023-10-09T11:59:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f315edff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315815ced0 con 0x7f3158159c60 2023-10-09T11:59:26.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f315edff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b3e20 con 0x7f3158069560 2023-10-09T11:59:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158159890 0x7f31581523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158159890 0x7f31581523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39002/0 (socket says 172.21.15.86:39002) 2023-10-09T11:59:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 -- 172.21.15.86:0/2517833719 learned_addr learned my addr 172.21.15.86:0/2517833719 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f315cb9b700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3158069560 0x7f315815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f315d39c700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3158159c60 0x7f31580cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 -- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3158069560 msgr2=0x7f315815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3158069560 0x7f315815beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 -- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3158159c60 msgr2=0x7f31580cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3158159c60 0x7f31580cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 -- 172.21.15.86:0/2517833719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009ae0 con 0x7f3158159890 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.528+0000 7f3157fff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158159890 0x7f31581523b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f314400b5e0 tx=0x7f3144009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.529+0000 7f3154ff9700 1 -- 172.21.15.86:0/2517833719 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400f510 con 0x7f3158159890 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.529+0000 7f3154ff9700 1 -- 172.21.15.86:0/2517833719 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314400f670 con 0x7f3158159890 2023-10-09T11:59:26.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.529+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315815c3f0 con 0x7f3158159890 2023-10-09T11:59:26.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.529+0000 7f3154ff9700 1 -- 172.21.15.86:0/2517833719 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400fa30 con 0x7f3158159890 2023-10-09T11:59:26.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.529+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315815c630 con 0x7f3158159890 2023-10-09T11:59:26.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.530+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31580b4d00 con 0x7f3158159890 2023-10-09T11:59:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.531+0000 7f3154ff9700 1 -- 172.21.15.86:0/2517833719 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f314401a400 con 0x7f3158159890 2023-10-09T11:59:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.532+0000 7f3154ff9700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f313c066f30 0x7f313c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.532+0000 7f3154ff9700 1 -- 172.21.15.86:0/2517833719 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f3144084110 con 0x7f3158159890 2023-10-09T11:59:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.532+0000 7f315cb9b700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f313c066f30 0x7f313c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.533+0000 7f315cb9b700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f313c066f30 0x7f313c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f314c006fd0 tx=0x7f314c008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:26.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.536+0000 7f3154ff9700 1 -- 172.21.15.86:0/2517833719 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31440511e0 con 0x7f3158159890 2023-10-09T11:59:26.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.766+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f315815c3f0 con 0x7f3158159890 2023-10-09T11:59:26.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.767+0000 7f3154ff9700 1 -- 172.21.15.86:0/2517833719 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f315815c3f0 con 0x7f3158159890 2023-10-09T11:59:26.768 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:26.769 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/2850632798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2850632798},{"type":"v1","addr":"172.21.15.86:6833","nonce":2850632798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/244252313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":244252313},{"type":"v1","addr":"172.21.15.135:6834","nonce":244252313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4164357513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4164357513},{"type":"v1","addr":"172.21.15.135:6835","nonce":4164357513}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:59:22.355864+0000","modified":"2023-10-09T11:59:26.316887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7183":{"gid":7183,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1465588551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1465588551},{"type":"v1","addr":"172.21.15.86:6835","nonce":1465588551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:59:26.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f313c066f30 msgr2=0x7f313c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f313c066f30 0x7f313c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f314c006fd0 tx=0x7f314c008040 comp rx=0 tx=0).stop 2023-10-09T11:59:26.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158159890 msgr2=0x7f31581523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158159890 0x7f31581523b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f314400b5e0 tx=0x7f3144009120 comp rx=0 tx=0).stop 2023-10-09T11:59:26.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 shutdown_connections 2023-10-09T11:59:26.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3158159c60 0x7f31580cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3158069560 0x7f315815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f313c066f30 0x7f313c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 --2- 172.21.15.86:0/2517833719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3158159890 0x7f31581523b0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 >> 172.21.15.86:0/2517833719 conn(0x7f3158068e20 msgr2=0x7f3158153180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:26.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 shutdown_connections 2023-10-09T11:59:26.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.769+0000 7f315edff700 1 -- 172.21.15.86:0/2517833719 wait complete. 2023-10-09T11:59:26.773 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 54 2023-10-09T11:59:26.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:59:26.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.969+0000 7fb295dff700 1 Processor -- start 2023-10-09T11:59:26.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.969+0000 7fb295dff700 1 -- start start 2023-10-09T11:59:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.970+0000 7fb295dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb2901578b0 0x7fb290155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.970+0000 7fb295dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2900af2f0 0x7fb2900af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.970+0000 7fb295dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2900ad930 con 0x7fb290155c10 2023-10-09T11:59:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.970+0000 7fb295dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2900b0c80 con 0x7fb2900af2f0 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.970+0000 7fb295dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2900acd20 con 0x7fb2901578b0 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb290155c10 0x7fb2900ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54524/0 (socket says 172.21.15.86:54524) 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28f7fe700 1 -- 172.21.15.86:0/3700170792 learned_addr learned my addr 172.21.15.86:0/3700170792 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28ffff700 1 --2- 172.21.15.86:0/3700170792 >> v2:172.21.15.86:3300/0 conn(0x7fb2900af2f0 0x7fb2900af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28effd700 1 --2- 172.21.15.86:0/3700170792 >> v2:172.21.15.135:3300/0 conn(0x7fb2901578b0 0x7fb290155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28e7fc700 1 -- 172.21.15.86:0/3700170792 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053306478 0 0) 0x7fb2900ad930 con 0x7fb290155c10 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28e7fc700 1 -- 172.21.15.86:0/3700170792 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb278003570 con 0x7fb290155c10 2023-10-09T11:59:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28ffff700 1 -- 172.21.15.86:0/3700170792 >> v2:172.21.15.135:3300/0 conn(0x7fb2901578b0 msgr2=0x7fb290155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28ffff700 1 --2- 172.21.15.86:0/3700170792 >> v2:172.21.15.135:3300/0 conn(0x7fb2901578b0 0x7fb290155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28ffff700 1 -- 172.21.15.86:0/3700170792 >> v1:172.21.15.86:6789/0 conn(0x7fb290155c10 legacy=0x7fb2900ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28ffff700 1 -- 172.21.15.86:0/3700170792 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2900ad000 con 0x7fb2900af2f0 2023-10-09T11:59:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.971+0000 7fb28ffff700 1 --2- 172.21.15.86:0/3700170792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2900af2f0 0x7fb2900af730 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb2900c8c60 tx=0x7fb288009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8baa169e68eb151 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb28e7fc700 1 -- 172.21.15.86:0/3700170792 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800e070 con 0x7fb2900af2f0 2023-10-09T11:59:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb28e7fc700 1 -- 172.21.15.86:0/3700170792 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800bab0 con 0x7fb2900af2f0 2023-10-09T11:59:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb28e7fc700 1 -- 172.21.15.86:0/3700170792 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800be70 con 0x7fb2900af2f0 2023-10-09T11:59:26.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 -- 172.21.15.86:0/3700170792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2900af2f0 msgr2=0x7fb2900af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 --2- 172.21.15.86:0/3700170792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2900af2f0 0x7fb2900af730 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb2900c8c60 tx=0x7fb288009780 comp rx=0 tx=0).stop 2023-10-09T11:59:26.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 -- 172.21.15.86:0/3700170792 shutdown_connections 2023-10-09T11:59:26.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 --2- 172.21.15.86:0/3700170792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2900af2f0 0x7fb2900af730 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 --2- 172.21.15.86:0/3700170792 >> v2:172.21.15.135:3300/0 conn(0x7fb2901578b0 0x7fb290155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 -- 172.21.15.86:0/3700170792 >> 172.21.15.86:0/3700170792 conn(0x7fb29006a320 msgr2=0x7fb2900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:26.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 -- 172.21.15.86:0/3700170792 shutdown_connections 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.972+0000 7fb295dff700 1 -- 172.21.15.86:0/3700170792 wait complete. 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.974+0000 7fb295dff700 1 Processor -- start 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.974+0000 7fb295dff700 1 -- start start 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb295dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2900af2f0 0x7fb29015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb295dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb290155c10 0x7fb2901471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb295dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2901578b0 0x7fb290153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb295dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb290159b10 con 0x7fb2901578b0 2023-10-09T11:59:26.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb295dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2901582a0 con 0x7fb2900af2f0 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb295dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb290158580 con 0x7fb290155c10 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb28ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2901578b0 0x7fb290153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb28ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2901578b0 0x7fb290153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39028/0 (socket says 172.21.15.86:39028) 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb28ffff700 1 -- 172.21.15.86:0/331040482 learned_addr learned my addr 172.21.15.86:0/331040482 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb28f7fe700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2900af2f0 0x7fb29015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.975+0000 7fb28effd700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb290155c10 0x7fb2901471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb28ffff700 1 -- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb290155c10 msgr2=0x7fb2901471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb28ffff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb290155c10 0x7fb2901471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb28ffff700 1 -- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2900af2f0 msgr2=0x7fb29015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb28ffff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2900af2f0 0x7fb29015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb28ffff700 1 -- 172.21.15.86:0/331040482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288009a20 con 0x7fb2901578b0 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb28effd700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb290155c10 0x7fb2901471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb28ffff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2901578b0 0x7fb290153cd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fb290064290 tx=0x7fb288019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb2777fe700 1 -- 172.21.15.86:0/331040482 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288012e80 con 0x7fb2901578b0 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb2777fe700 1 -- 172.21.15.86:0/331040482 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb288027470 con 0x7fb2901578b0 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb2777fe700 1 -- 172.21.15.86:0/331040482 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288027810 con 0x7fb2901578b0 2023-10-09T11:59:26.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb290158860 con 0x7fb2901578b0 2023-10-09T11:59:26.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.976+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb290158e20 con 0x7fb2901578b0 2023-10-09T11:59:26.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.977+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29004c3c0 con 0x7fb2901578b0 2023-10-09T11:59:26.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.978+0000 7fb2777fe700 1 -- 172.21.15.86:0/331040482 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb288024070 con 0x7fb2901578b0 2023-10-09T11:59:26.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.979+0000 7fb2777fe700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:26.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.979+0000 7fb2777fe700 1 -- 172.21.15.86:0/331040482 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb288086df0 con 0x7fb2901578b0 2023-10-09T11:59:26.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.980+0000 7fb28f7fe700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:26.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.980+0000 7fb28f7fe700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb280007fd0 tx=0x7fb280009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:26.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:26.984+0000 7fb2777fe700 1 -- 172.21.15.86:0/331040482 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb288053e40 con 0x7fb2901578b0 2023-10-09T11:59:27.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.176+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2900ad2e0 con 0x7fb2901578b0 2023-10-09T11:59:27.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.177+0000 7fb2777fe700 1 -- 172.21.15.86:0/331040482 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+15982 (secure 0 0 0) 0x7fb28802c020 con 0x7fb2901578b0 2023-10-09T11:59:27.179 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:27.179 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":124,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:23.881580+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:59:20.468724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:59:21.333069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:59:27.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.179+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 msgr2=0x7fb27c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.179+0000 7fb295dff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb280007fd0 tx=0x7fb280009040 comp rx=0 tx=0).stop 2023-10-09T11:59:27.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.179+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2901578b0 msgr2=0x7fb290153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.179+0000 7fb295dff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2901578b0 0x7fb290153cd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fb290064290 tx=0x7fb288019000 comp rx=0 tx=0).stop 2023-10-09T11:59:27.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.179+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 shutdown_connections 2023-10-09T11:59:27.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.180+0000 7fb295dff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb27c066f30 0x7fb27c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.180+0000 7fb295dff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2901578b0 0x7fb290153cd0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.180+0000 7fb295dff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2900af2f0 0x7fb29015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.180+0000 7fb295dff700 1 --2- 172.21.15.86:0/331040482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb290155c10 0x7fb2901471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.180+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 >> 172.21.15.86:0/331040482 conn(0x7fb29006a320 msgr2=0x7fb29006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:27.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.180+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 shutdown_connections 2023-10-09T11:59:27.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.180+0000 7fb295dff700 1 -- 172.21.15.86:0/331040482 wait complete. 2023-10-09T11:59:27.199 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:59:27.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:59:27.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 Processor -- start 2023-10-09T11:59:27.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 -- start start 2023-10-09T11:59:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb480155c10 0x7fb480155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb4800ac230 0x7fb4800ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4801568a0 0x7fb480156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800ad930 con 0x7fb480155c10 2023-10-09T11:59:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800acd20 con 0x7fb4800ac230 2023-10-09T11:59:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb4861ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800ad000 con 0x7fb4801568a0 2023-10-09T11:59:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb47f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb480155c10 0x7fb480155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb47f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb480155c10 0x7fb480155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39034/0 (socket says 172.21.15.86:39034) 2023-10-09T11:59:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.386+0000 7fb47f7fe700 1 -- 172.21.15.86:0/1696542555 learned_addr learned my addr 172.21.15.86:0/1696542555 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:27.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47effd700 1 --2- 172.21.15.86:0/1696542555 >> v2:172.21.15.135:3300/0 conn(0x7fb4800ac230 0x7fb4800ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47ffff700 1 --2- 172.21.15.86:0/1696542555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4801568a0 0x7fb480156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47f7fe700 1 -- 172.21.15.86:0/1696542555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4801568a0 msgr2=0x7fb480156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47f7fe700 1 --2- 172.21.15.86:0/1696542555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4801568a0 0x7fb480156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47f7fe700 1 -- 172.21.15.86:0/1696542555 >> v2:172.21.15.135:3300/0 conn(0x7fb4800ac230 msgr2=0x7fb4800ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47f7fe700 1 --2- 172.21.15.86:0/1696542555 >> v2:172.21.15.135:3300/0 conn(0x7fb4800ac230 0x7fb4800ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47f7fe700 1 -- 172.21.15.86:0/1696542555 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800ad2e0 con 0x7fb480155c10 2023-10-09T11:59:27.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47effd700 1 --2- 172.21.15.86:0/1696542555 >> v2:172.21.15.135:3300/0 conn(0x7fb4800ac230 0x7fb4800ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47f7fe700 1 --2- 172.21.15.86:0/1696542555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480155c10 0x7fb480155fe0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb480065bb0 tx=0x7fb470009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9826e0165feab19e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47e7fc700 1 -- 172.21.15.86:0/1696542555 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000b860 con 0x7fb480155c10 2023-10-09T11:59:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47e7fc700 1 -- 172.21.15.86:0/1696542555 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47000b9c0 con 0x7fb480155c10 2023-10-09T11:59:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.387+0000 7fb47e7fc700 1 -- 172.21.15.86:0/1696542555 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000bd60 con 0x7fb480155c10 2023-10-09T11:59:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 -- 172.21.15.86:0/1696542555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480155c10 msgr2=0x7fb480155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 --2- 172.21.15.86:0/1696542555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480155c10 0x7fb480155fe0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb480065bb0 tx=0x7fb470009250 comp rx=0 tx=0).stop 2023-10-09T11:59:27.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 -- 172.21.15.86:0/1696542555 shutdown_connections 2023-10-09T11:59:27.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 --2- 172.21.15.86:0/1696542555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4801568a0 0x7fb480156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 --2- 172.21.15.86:0/1696542555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480155c10 0x7fb480155fe0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 --2- 172.21.15.86:0/1696542555 >> v2:172.21.15.135:3300/0 conn(0x7fb4800ac230 0x7fb4800ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 -- 172.21.15.86:0/1696542555 >> 172.21.15.86:0/1696542555 conn(0x7fb48006a320 msgr2=0x7fb4800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:27.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 -- 172.21.15.86:0/1696542555 shutdown_connections 2023-10-09T11:59:27.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.388+0000 7fb4861ff700 1 -- 172.21.15.86:0/1696542555 wait complete. 2023-10-09T11:59:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.389+0000 7fb4861ff700 1 Processor -- start 2023-10-09T11:59:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.390+0000 7fb4861ff700 1 -- start start 2023-10-09T11:59:27.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.390+0000 7fb4861ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4800ac230 0x7fb48015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.390+0000 7fb4861ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480155c10 0x7fb48015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.390+0000 7fb4861ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801568a0 0x7fb4800cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.390+0000 7fb4861ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480156f30 con 0x7fb4801568a0 2023-10-09T11:59:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.390+0000 7fb4861ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4801574f0 con 0x7fb480155c10 2023-10-09T11:59:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb4861ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48015cbe0 con 0x7fb4800ac230 2023-10-09T11:59:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801568a0 0x7fb4800cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801568a0 0x7fb4800cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39038/0 (socket says 172.21.15.86:39038) 2023-10-09T11:59:27.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 -- 172.21.15.86:0/2909256114 learned_addr learned my addr 172.21.15.86:0/2909256114 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:27.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47f7fe700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4800ac230 0x7fb48015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47effd700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480155c10 0x7fb48015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 -- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4800ac230 msgr2=0x7fb48015c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4800ac230 0x7fb48015c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 -- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480155c10 msgr2=0x7fb48015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480155c10 0x7fb48015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 -- 172.21.15.86:0/2909256114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4700094f0 con 0x7fb4801568a0 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47effd700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480155c10 0x7fb48015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47f7fe700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4800ac230 0x7fb48015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.391+0000 7fb47ffff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801568a0 0x7fb4800cc3b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb478007f20 tx=0x7fb478009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.392+0000 7fb4677fe700 1 -- 172.21.15.86:0/2909256114 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800eca0 con 0x7fb4801568a0 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.392+0000 7fb4677fe700 1 -- 172.21.15.86:0/2909256114 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800ee20 con 0x7fb4801568a0 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.392+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48015cec0 con 0x7fb4801568a0 2023-10-09T11:59:27.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.392+0000 7fb4677fe700 1 -- 172.21.15.86:0/2909256114 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478014670 con 0x7fb4801568a0 2023-10-09T11:59:27.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.392+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48015a540 con 0x7fb4801568a0 2023-10-09T11:59:27.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.393+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb480157660 con 0x7fb4801568a0 2023-10-09T11:59:27.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.394+0000 7fb4677fe700 1 -- 172.21.15.86:0/2909256114 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4780149e0 con 0x7fb4801568a0 2023-10-09T11:59:27.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.395+0000 7fb4677fe700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.395+0000 7fb4677fe700 1 -- 172.21.15.86:0/2909256114 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb478084df0 con 0x7fb4801568a0 2023-10-09T11:59:27.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.395+0000 7fb47f7fe700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.396+0000 7fb47f7fe700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb480065bb0 tx=0x7fb470018000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:27.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.399+0000 7fb4677fe700 1 -- 172.21.15.86:0/2909256114 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb478051e40 con 0x7fb4801568a0 2023-10-09T11:59:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.588+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb48004c3c0 con 0x7fb46c066f30 2023-10-09T11:59:27.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.598+0000 7fb4677fe700 1 -- 172.21.15.86:0/2909256114 <== mgr.7479 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278428 (secure 0 0 0) 0x7fb48004c3c0 con 0x7fb46c066f30 2023-10-09T11:59:27.603 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 msgr2=0x7fb46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb480065bb0 tx=0x7fb470018000 comp rx=0 tx=0).stop 2023-10-09T11:59:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801568a0 msgr2=0x7fb4800cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801568a0 0x7fb4800cc3b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb478007f20 tx=0x7fb478009860 comp rx=0 tx=0).stop 2023-10-09T11:59:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 shutdown_connections 2023-10-09T11:59:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801568a0 0x7fb4800cc3b0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4800ac230 0x7fb48015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 --2- 172.21.15.86:0/2909256114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb480155c10 0x7fb48015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 >> 172.21.15.86:0/2909256114 conn(0x7fb48006a320 msgr2=0x7fb4800c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 shutdown_connections 2023-10-09T11:59:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.603+0000 7fb4861ff700 1 -- 172.21.15.86:0/2909256114 wait complete. 2023-10-09T11:59:27.608 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:59:27.621 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:59:26.847092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440200,"kb_used_data":12744,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534520,"statfs":{"total":773094113280,"available":770595348480,"internally_reserved":0,"allocated":13049856,"data_stored":6944648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.974300"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878520+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:45.263340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880339+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:37.573159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877761+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:37.428050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877714+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:16.896802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.881090+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:14.363907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877135+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:44.715609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877373+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.213975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.881313+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:09.418256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877880+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:17.414858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878283+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880445+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:34.795132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874371+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:25.610552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879084+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:26.943737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879707+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:16.864113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874791+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:27.299815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877773+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.061106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874845+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:12.308822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877526+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:28.015454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877100+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:35.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876596+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874118+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:52.983630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874051+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:56.740961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876594+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874428+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:16.664473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876549+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:08.932867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876572+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:45.754764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877513+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:27.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876001+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:56.315133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877499+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:50:48.718549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878396+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879252+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:40.741374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880270+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:58.155274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"113'227","reported_seq":634,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T11:59:18.668719+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:59:18.668719+0000","last_peered":"2023-10-09T11:59:18.668719+0000","last_clean":"2023-10-09T11:59:18.668719+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:59:18.668719+0000","last_undegraded":"2023-10-09T11:59:18.668719+0000","last_fullsized":"2023-10-09T11:59:18.668719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2076672,"data_stored":1310857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":0.98399999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.754},"min":{"1min":0.63500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66400000000000003,"15min":0.70299999999999996},"min":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79800000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89100000000000001,"5min":1.0209999999999999,"15min":1.048},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68999999999999995,"15min":0.72399999999999998},"min":{"1min":0.59399999999999997,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.82299999999999995,"5min":0.98899999999999999,"15min":1.073},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.85999999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.55300000000000005,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.111,"15min":1.111},"last":0.71399999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67500000000000004,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.0629999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67700000000000005,"15min":0.73499999999999999},"min":{"1min":0.47599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.71299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90100000000000002,"5min":0.98999999999999999,"15min":1.121},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":1.0049999999999999,"15min":1.216},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.92800000000000005,"5min":0.98799999999999999,"15min":1.139},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.73699999999999999},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":1.0009999999999999,"15min":1.278},"last":0.66500000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.749},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":1.042,"15min":1.1040000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.875,"5min":0.94699999999999995,"15min":1.244},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.1060000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88900000000000001,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":1.143},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86699999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98999999999999999,"5min":1.03,"15min":1.327},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.58699999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509655,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.46300000000000002},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":1.0580000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.61399999999999999,"5min":1.079,"15min":1.079},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.504},"min":{"1min":0.32700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57499999999999996,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.76800000000000002,"15min":1.099},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.65400000000000003,"5min":1.044,"15min":1.1779999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":1.046},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73099999999999998,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0029999999999999,"5min":1.143,"15min":1.7210000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93899999999999995,"5min":1.0660000000000001,"15min":1.552},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74399999999999999,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0740000000000001,"5min":1.202,"15min":1.677},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76500000000000001,"15min":0.81000000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.103,"15min":1.778},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.80400000000000005},"min":{"1min":0.64500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.623},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.708},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.659},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.83399999999999996},"min":{"1min":0.60399999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.736},"last":0.59999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542358,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2076672,"data_stored":1310857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.219},"max":{"1min":1.012,"5min":1.012,"15min":1.0740000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":2.097,"15min":2.097},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32500000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.1699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1699999999999999,"5min":1.587,"15min":1.587},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78000000000000003,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0860000000000001,"5min":1.389,"15min":1.389},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1739999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76700000000000002,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1339999999999999,"5min":1.1899999999999999,"15min":1.2709999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.113,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306928,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064912,"statfs":{"total":96636764160,"available":96322469888,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.46400000000000002},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78000000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.499,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.60099999999999998,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.876,"15min":0.876},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":1.095,"15min":1.1839999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.014,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.1850000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.79700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":1.0649999999999999,"15min":1.2629999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0449999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.98199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.216},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.204},"last":0.94999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.153,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.135},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79200000000000004,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.111,"5min":1.111,"15min":1.155},"last":1.079}]}]},{"osd":3,"up_from":15,"seq":64424509655,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306928,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064912,"statfs":{"total":96636764160,"available":96322469888,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68100000000000005,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.33000000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.876},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.68500000000000005,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.60499999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.34699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.57199999999999995,"5min":0.55800000000000005,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":1.208,"15min":1.327},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":0.83699999999999997},"min":{"1min":0.622,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1679999999999999,"5min":1.252,"15min":1.2689999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.246,"15min":1.252},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.41299999999999998},"max":{"1min":1.0780000000000001,"5min":1.234,"15min":1.3660000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.97499999999999998,"5min":1.1240000000000001,"15min":1.218},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46999999999999997},"max":{"1min":0.996,"5min":1.25,"15min":1.333},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0640000000000001,"5min":1.194,"15min":1.3560000000000001},"last":0.75}]}]},{"osd":4,"up_from":16,"seq":68719476950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311024,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060816,"statfs":{"total":96636764160,"available":96318275584,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69299999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.38,"15min":0.38},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.71999999999999997},"min":{"1min":0.57699999999999996,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.98199999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":1.091},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.629,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.014,"5min":1.587,"15min":1.587},"last":0.89000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.97099999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.59699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.91700000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.367,"15min":1.367},"last":0.751},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.93600000000000005,"5min":1.613,"15min":1.613},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80300000000000005,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.93999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.484,"15min":1.484},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95999999999999996,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":16,"seq":68719476950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.71199999999999997},"min":{"1min":0.52800000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.52000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":1.014,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65400000000000003,"15min":0.69799999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.0840000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69099999999999995,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.909,"15min":1.909},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.046,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71599999999999997,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99199999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.83099999999999996,"5min":2.105,"15min":2.105},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.92900000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:59:27.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:59:27.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.840+0000 7fbacdf9d700 1 Processor -- start 2023-10-09T11:59:27.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.841+0000 7fbacdf9d700 1 -- start start 2023-10-09T11:59:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbacdf9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbac8150180 0x7fbac8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbacdf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac80c7410 0x7fbac8069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbacdf9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac806e2a0 con 0x7fbac8150550 2023-10-09T11:59:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbacdf9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac806b2e0 con 0x7fbac8150180 2023-10-09T11:59:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbacdf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c78e0 con 0x7fbac80c7410 2023-10-09T11:59:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbaccf9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbac8150180 0x7fbac8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbaccf9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbac8150180 0x7fbac8157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39046/0 (socket says 172.21.15.86:39046) 2023-10-09T11:59:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbaccf9b700 1 -- 172.21.15.86:0/2298583044 learned_addr learned my addr 172.21.15.86:0/2298583044 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.842+0000 7fbacd79c700 1 --2- 172.21.15.86:0/2298583044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac80c7410 0x7fbac8069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbaccf9b700 1 -- 172.21.15.86:0/2298583044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac80c7410 msgr2=0x7fbac8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbaccf9b700 1 --2- 172.21.15.86:0/2298583044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac80c7410 0x7fbac8069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbaccf9b700 1 -- 172.21.15.86:0/2298583044 >> v1:172.21.15.86:6789/0 conn(0x7fbac8150550 legacy=0x7fbac80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbaccf9b700 1 -- 172.21.15.86:0/2298583044 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80c7bc0 con 0x7fbac8150180 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbacd79c700 1 --2- 172.21.15.86:0/2298583044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac80c7410 0x7fbac8069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbac77fe700 1 -- 172.21.15.86:0/2298583044 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400405558 0 0) 0x7fbac806e2a0 con 0x7fbac8150550 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbaccf9b700 1 --2- 172.21.15.86:0/2298583044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac8150180 0x7fbac8157770 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0099b0 tx=0x7fbabc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c860a6f1616d41d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbac77fe700 1 -- 172.21.15.86:0/2298583044 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00b860 con 0x7fbac8150180 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbac77fe700 1 -- 172.21.15.86:0/2298583044 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00b9c0 con 0x7fbac8150180 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.843+0000 7fbac77fe700 1 -- 172.21.15.86:0/2298583044 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00bd60 con 0x7fbac8150180 2023-10-09T11:59:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 -- 172.21.15.86:0/2298583044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac8150180 msgr2=0x7fbac8157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/2298583044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac8150180 0x7fbac8157770 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0099b0 tx=0x7fbabc009250 comp rx=0 tx=0).stop 2023-10-09T11:59:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 -- 172.21.15.86:0/2298583044 shutdown_connections 2023-10-09T11:59:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/2298583044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac80c7410 0x7fbac8069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/2298583044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac8150180 0x7fbac8157770 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 -- 172.21.15.86:0/2298583044 >> 172.21.15.86:0/2298583044 conn(0x7fbac80cc1f0 msgr2=0x7fbac80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 -- 172.21.15.86:0/2298583044 shutdown_connections 2023-10-09T11:59:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.844+0000 7fbacdf9d700 1 -- 172.21.15.86:0/2298583044 wait complete. 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.845+0000 7fbacdf9d700 1 Processor -- start 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.845+0000 7fbacdf9d700 1 -- start start 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.846+0000 7fbacdf9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac80c7410 0x7fbac80ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.846+0000 7fbacdf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac8150180 0x7fbac80abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.846+0000 7fbacdf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8150550 0x7fbac816de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.846+0000 7fbacdf9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80acd30 con 0x7fbac80c7410 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.846+0000 7fbacdf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac816e350 con 0x7fbac8150550 2023-10-09T11:59:27.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.846+0000 7fbacdf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80ac120 con 0x7fbac8150180 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.846+0000 7fbaccf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac80c7410 0x7fbac80ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac80c7410 0x7fbac80ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39056/0 (socket says 172.21.15.86:39056) 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 -- 172.21.15.86:0/996378915 learned_addr learned my addr 172.21.15.86:0/996378915 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbacd79c700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8150550 0x7fbac816de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbac7fff700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac8150180 0x7fbac80abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 -- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac8150180 msgr2=0x7fbac80abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac8150180 0x7fbac80abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 -- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8150550 msgr2=0x7fbac816de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8150550 0x7fbac816de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 -- 172.21.15.86:0/996378915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc0094f0 con 0x7fbac80c7410 2023-10-09T11:59:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbaccf9b700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac80c7410 0x7fbac80ad1c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009290 tx=0x7fbabc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbac4ff9700 1 -- 172.21.15.86:0/996378915 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc024440 con 0x7fbac80c7410 2023-10-09T11:59:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbac4ff9700 1 -- 172.21.15.86:0/996378915 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc0245c0 con 0x7fbac80c7410 2023-10-09T11:59:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac80ac400 con 0x7fbac80c7410 2023-10-09T11:59:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.847+0000 7fbac4ff9700 1 -- 172.21.15.86:0/996378915 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc024980 con 0x7fbac80c7410 2023-10-09T11:59:27.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.848+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac80ac9c0 con 0x7fbac80c7410 2023-10-09T11:59:27.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.848+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac80ad010 con 0x7fbac80c7410 2023-10-09T11:59:27.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.849+0000 7fbac4ff9700 1 -- 172.21.15.86:0/996378915 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbabc01a420 con 0x7fbac80c7410 2023-10-09T11:59:27.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.850+0000 7fbac4ff9700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbaac066f30 0x7fbaac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:27.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.850+0000 7fbac4ff9700 1 -- 172.21.15.86:0/996378915 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fbabc086720 con 0x7fbac80c7410 2023-10-09T11:59:27.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.850+0000 7fbac7fff700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbaac066f30 0x7fbaac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:27.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.851+0000 7fbac7fff700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbaac066f30 0x7fbaac0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbac816d320 tx=0x7fbab4009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:27.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:27.854+0000 7fbac4ff9700 1 -- 172.21.15.86:0/996378915 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbabc053770 con 0x7fbac80c7410 2023-10-09T11:59:27.866 INFO:tasks.ceph.mds.c.smithi086.stderr:2023-10-09T11:59:27.865+0000 7f25faff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:59:28.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.042+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbac8159650 con 0x7fbaac066f30 2023-10-09T11:59:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.050+0000 7fbac4ff9700 1 -- 172.21.15.86:0/996378915 <== mgr.7479 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278428 (secure 0 0 0) 0x7fbac8159650 con 0x7fbaac066f30 2023-10-09T11:59:28.054 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbaac066f30 msgr2=0x7fbaac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbaac066f30 0x7fbaac0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbac816d320 tx=0x7fbab4009040 comp rx=0 tx=0).stop 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac80c7410 msgr2=0x7fbac80ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac80c7410 0x7fbac80ad1c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009290 tx=0x7fbabc017000 comp rx=0 tx=0).stop 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 shutdown_connections 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbaac066f30 0x7fbaac0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbac80c7410 0x7fbac80ad1c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8150550 0x7fbac816de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 --2- 172.21.15.86:0/996378915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbac8150180 0x7fbac80abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 >> 172.21.15.86:0/996378915 conn(0x7fbac80cc1f0 msgr2=0x7fbac806a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 shutdown_connections 2023-10-09T11:59:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.054+0000 7fbacdf9d700 1 -- 172.21.15.86:0/996378915 wait complete. 2023-10-09T11:59:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:59:28.073 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:59:26.847092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440200,"kb_used_data":12744,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534520,"statfs":{"total":773094113280,"available":770595348480,"internally_reserved":0,"allocated":13049856,"data_stored":6944648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.974300"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878520+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:45.263340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880339+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:37.573159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877761+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:37.428050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877714+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:16.896802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.881090+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:14.363907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877135+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:44.715609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877373+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.213975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.881313+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:09.418256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877880+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:17.414858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878283+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880445+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:34.795132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874371+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:25.610552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879084+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:26.943737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879707+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:16.864113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874791+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:27.299815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877773+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.061106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874845+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:12.308822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877526+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:28.015454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877100+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:35.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876596+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874118+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:52.983630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874051+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:56.740961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876594+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874428+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:16.664473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876549+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:08.932867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876572+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:45.754764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877513+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:27.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876001+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:56.315133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877499+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:50:48.718549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878396+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879252+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:40.741374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880270+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:58.155274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"113'227","reported_seq":634,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T11:59:18.668719+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:59:18.668719+0000","last_peered":"2023-10-09T11:59:18.668719+0000","last_clean":"2023-10-09T11:59:18.668719+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:59:18.668719+0000","last_undegraded":"2023-10-09T11:59:18.668719+0000","last_fullsized":"2023-10-09T11:59:18.668719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2076672,"data_stored":1310857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":0.98399999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.754},"min":{"1min":0.63500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66400000000000003,"15min":0.70299999999999996},"min":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79800000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89100000000000001,"5min":1.0209999999999999,"15min":1.048},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68999999999999995,"15min":0.72399999999999998},"min":{"1min":0.59399999999999997,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.82299999999999995,"5min":0.98899999999999999,"15min":1.073},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.85999999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.55300000000000005,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.111,"15min":1.111},"last":0.71399999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67500000000000004,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.0629999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67700000000000005,"15min":0.73499999999999999},"min":{"1min":0.47599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.71299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90100000000000002,"5min":0.98999999999999999,"15min":1.121},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":1.0049999999999999,"15min":1.216},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.92800000000000005,"5min":0.98799999999999999,"15min":1.139},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.73699999999999999},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":1.0009999999999999,"15min":1.278},"last":0.66500000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.749},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":1.042,"15min":1.1040000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.875,"5min":0.94699999999999995,"15min":1.244},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.1060000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88900000000000001,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":1.143},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86699999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98999999999999999,"5min":1.03,"15min":1.327},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.58699999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509655,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.46300000000000002},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":1.0580000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.61399999999999999,"5min":1.079,"15min":1.079},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.504},"min":{"1min":0.32700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57499999999999996,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.76800000000000002,"15min":1.099},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.65400000000000003,"5min":1.044,"15min":1.1779999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":1.046},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73099999999999998,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0029999999999999,"5min":1.143,"15min":1.7210000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93899999999999995,"5min":1.0660000000000001,"15min":1.552},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74399999999999999,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0740000000000001,"5min":1.202,"15min":1.677},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76500000000000001,"15min":0.81000000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.103,"15min":1.778},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.80400000000000005},"min":{"1min":0.64500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.623},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.708},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.659},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.83399999999999996},"min":{"1min":0.60399999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.736},"last":0.59999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542358,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2076672,"data_stored":1310857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.219},"max":{"1min":1.012,"5min":1.012,"15min":1.0740000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":2.097,"15min":2.097},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32500000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.1699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1699999999999999,"5min":1.587,"15min":1.587},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78000000000000003,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0860000000000001,"5min":1.389,"15min":1.389},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1739999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76700000000000002,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1339999999999999,"5min":1.1899999999999999,"15min":1.2709999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.113,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306928,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064912,"statfs":{"total":96636764160,"available":96322469888,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.46400000000000002},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78000000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.499,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.60099999999999998,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.876,"15min":0.876},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":1.095,"15min":1.1839999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.014,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.1850000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.79700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":1.0649999999999999,"15min":1.2629999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0449999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.98199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.216},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.204},"last":0.94999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.153,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.135},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79200000000000004,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.111,"5min":1.111,"15min":1.155},"last":1.079}]}]},{"osd":3,"up_from":15,"seq":64424509655,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306928,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064912,"statfs":{"total":96636764160,"available":96322469888,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68100000000000005,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.33000000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.876},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.68500000000000005,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.60499999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.34699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.57199999999999995,"5min":0.55800000000000005,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":1.208,"15min":1.327},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":0.83699999999999997},"min":{"1min":0.622,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1679999999999999,"5min":1.252,"15min":1.2689999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.246,"15min":1.252},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.41299999999999998},"max":{"1min":1.0780000000000001,"5min":1.234,"15min":1.3660000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.97499999999999998,"5min":1.1240000000000001,"15min":1.218},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46999999999999997},"max":{"1min":0.996,"5min":1.25,"15min":1.333},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0640000000000001,"5min":1.194,"15min":1.3560000000000001},"last":0.75}]}]},{"osd":4,"up_from":16,"seq":68719476950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311024,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060816,"statfs":{"total":96636764160,"available":96318275584,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69299999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.38,"15min":0.38},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.71999999999999997},"min":{"1min":0.57699999999999996,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.98199999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":1.091},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.629,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.014,"5min":1.587,"15min":1.587},"last":0.89000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.97099999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.59699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.91700000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.367,"15min":1.367},"last":0.751},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.93600000000000005,"5min":1.613,"15min":1.613},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80300000000000005,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.93999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.484,"15min":1.484},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95999999999999996,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":16,"seq":68719476950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.71199999999999997},"min":{"1min":0.52800000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.52000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":1.014,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65400000000000003,"15min":0.69799999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.0840000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69099999999999995,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.909,"15min":1.909},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.046,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71599999999999997,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99199999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.83099999999999996,"5min":2.105,"15min":2.105},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.92900000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:59:28.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:59:28.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.294+0000 7fb6125ff700 1 Processor -- start 2023-10-09T11:59:28.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.294+0000 7fb6125ff700 1 -- start start 2023-10-09T11:59:28.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.295+0000 7fb6125ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb60c159c60 0x7fb60c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.295+0000 7fb6125ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb60c15db10 0x7fb60c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.295+0000 7fb6125ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c15a160 con 0x7fb60c159890 2023-10-09T11:59:28.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.295+0000 7fb6125ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c15df50 con 0x7fb60c15db10 2023-10-09T11:59:28.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.295+0000 7fb6125ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c0d13a0 con 0x7fb60c159c60 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.295+0000 7fb610b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb60c15db10 0x7fb60c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb610b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb60c15db10 0x7fb60c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39058/0 (socket says 172.21.15.86:39058) 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb610b9c700 1 -- 172.21.15.86:0/2040109901 learned_addr learned my addr 172.21.15.86:0/2040109901 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb60b7fe700 1 --2- 172.21.15.86:0/2040109901 >> v2:172.21.15.135:3300/0 conn(0x7fb60c159c60 0x7fb60c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb610b9c700 1 -- 172.21.15.86:0/2040109901 >> v2:172.21.15.135:3300/0 conn(0x7fb60c159c60 msgr2=0x7fb60c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb610b9c700 1 --2- 172.21.15.86:0/2040109901 >> v2:172.21.15.135:3300/0 conn(0x7fb60c159c60 0x7fb60c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb610b9c700 1 -- 172.21.15.86:0/2040109901 >> v1:172.21.15.135:6789/0 conn(0x7fb60c159890 legacy=0x7fb60c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb610b9c700 1 -- 172.21.15.86:0/2040109901 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c15e140 con 0x7fb60c15db10 2023-10-09T11:59:28.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb610b9c700 1 --2- 172.21.15.86:0/2040109901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c15db10 0x7fb60c069560 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0b67f0 tx=0x7fb604009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b923e59762dfaf64 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb60affd700 1 -- 172.21.15.86:0/2040109901 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60400e070 con 0x7fb60c15db10 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb60affd700 1 -- 172.21.15.86:0/2040109901 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60400ba20 con 0x7fb60c15db10 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.296+0000 7fb60affd700 1 -- 172.21.15.86:0/2040109901 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040092e0 con 0x7fb60c15db10 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 -- 172.21.15.86:0/2040109901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c15db10 msgr2=0x7fb60c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 --2- 172.21.15.86:0/2040109901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c15db10 0x7fb60c069560 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0b67f0 tx=0x7fb604009840 comp rx=0 tx=0).stop 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 -- 172.21.15.86:0/2040109901 shutdown_connections 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 --2- 172.21.15.86:0/2040109901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c15db10 0x7fb60c069560 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 --2- 172.21.15.86:0/2040109901 >> v2:172.21.15.135:3300/0 conn(0x7fb60c159c60 0x7fb60c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 -- 172.21.15.86:0/2040109901 >> 172.21.15.86:0/2040109901 conn(0x7fb60c068e20 msgr2=0x7fb60c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:28.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 -- 172.21.15.86:0/2040109901 shutdown_connections 2023-10-09T11:59:28.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.297+0000 7fb6125ff700 1 -- 172.21.15.86:0/2040109901 wait complete. 2023-10-09T11:59:28.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.298+0000 7fb6125ff700 1 Processor -- start 2023-10-09T11:59:28.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.299+0000 7fb6125ff700 1 -- start start 2023-10-09T11:59:28.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.299+0000 7fb6125ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c159890 0x7fb60c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.299+0000 7fb6125ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c159c60 0x7fb60c0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.299+0000 7fb6125ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb60c15db10 0x7fb60c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb6125ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0cf730 con 0x7fb60c159890 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb6125ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0cd560 con 0x7fb60c159c60 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb6125ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0cf170 con 0x7fb60c15db10 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c159890 0x7fb60c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c159890 0x7fb60c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39064/0 (socket says 172.21.15.86:39064) 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 -- 172.21.15.86:0/1078743576 learned_addr learned my addr 172.21.15.86:0/1078743576 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60b7fe700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c159c60 0x7fb60c0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb610b9c700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb60c15db10 0x7fb60c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 -- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb60c15db10 msgr2=0x7fb60c15c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb60c15db10 0x7fb60c15c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 -- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c159c60 msgr2=0x7fb60c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c159c60 0x7fb60c0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 -- 172.21.15.86:0/1078743576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb604009ae0 con 0x7fb60c159890 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.300+0000 7fb60bfff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c159890 0x7fb60c152560 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c590 tx=0x7fb5fc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.301+0000 7fb5f3fff700 1 -- 172.21.15.86:0/1078743576 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc011590 con 0x7fb60c159890 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.301+0000 7fb5f3fff700 1 -- 172.21.15.86:0/1078743576 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0116f0 con 0x7fb60c159890 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.301+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c0cf450 con 0x7fb60c159890 2023-10-09T11:59:28.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.301+0000 7fb5f3fff700 1 -- 172.21.15.86:0/1078743576 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc011ab0 con 0x7fb60c159890 2023-10-09T11:59:28.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.301+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c0cd9f0 con 0x7fb60c159890 2023-10-09T11:59:28.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.302+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c0cd3b0 con 0x7fb60c159890 2023-10-09T11:59:28.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.302+0000 7fb5f3fff700 1 -- 172.21.15.86:0/1078743576 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5fc01b3b0 con 0x7fb60c159890 2023-10-09T11:59:28.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.303+0000 7fb5f3fff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5f8066f30 0x7fb5f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.303+0000 7fb5f3fff700 1 -- 172.21.15.86:0/1078743576 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb5fc083ce0 con 0x7fb60c159890 2023-10-09T11:59:28.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.304+0000 7fb60b7fe700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5f8066f30 0x7fb5f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.304+0000 7fb60b7fe700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5f8066f30 0x7fb5f80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0b5640 tx=0x7fb600008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:28.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.307+0000 7fb5f3fff700 1 -- 172.21.15.86:0/1078743576 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5fc050d30 con 0x7fb60c159890 2023-10-09T11:59:28.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.496+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb60c04c3c0 con 0x7fb5f8066f30 2023-10-09T11:59:28.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.504+0000 7fb5f3fff700 1 -- 172.21.15.86:0/1078743576 <== mgr.7479 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278428 (secure 0 0 0) 0x7fb60c04c3c0 con 0x7fb5f8066f30 2023-10-09T11:59:28.508 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:28.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5f8066f30 msgr2=0x7fb5f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5f8066f30 0x7fb5f80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0b5640 tx=0x7fb600008040 comp rx=0 tx=0).stop 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c159890 msgr2=0x7fb60c152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c159890 0x7fb60c152560 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c590 tx=0x7fb5fc00c950 comp rx=0 tx=0).stop 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 shutdown_connections 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb5f8066f30 0x7fb5f80693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb60c159890 0x7fb60c152560 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb60c15db10 0x7fb60c15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 --2- 172.21.15.86:0/1078743576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60c159c60 0x7fb60c0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 >> 172.21.15.86:0/1078743576 conn(0x7fb60c068e20 msgr2=0x7fb60c1583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:28.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.508+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 shutdown_connections 2023-10-09T11:59:28.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.509+0000 7fb6125ff700 1 -- 172.21.15.86:0/1078743576 wait complete. 2023-10-09T11:59:28.512 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:59:28.526 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T11:59:26.847092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440200,"kb_used_data":12744,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534520,"statfs":{"total":773094113280,"available":770595348480,"internally_reserved":0,"allocated":13049856,"data_stored":6944648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.974300"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878520+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:45.263340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880339+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:37.573159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877761+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:37.428050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877714+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:16.896802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.881090+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:14.363907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877135+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:44.715609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877373+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.213975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.881313+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:13:09.418256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877880+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:17.414858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878283+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880445+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:34.795132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874371+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:25.610552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879084+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:26.943737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879707+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:16.864113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874791+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:27.299815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877773+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.061106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874845+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:12.308822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877526+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:28.015454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877100+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:35.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876596+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874118+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:26:52.983630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874051+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:56.740961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876594+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.874428+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:16.664473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876549+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:08.932867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876572+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:45.754764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877513+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:27.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.876001+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:56.315133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.877499+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:50:48.718549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.878396+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.879252+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:40.741374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T11:59:21.870737+0000","last_change":"2023-10-09T11:59:21.870737+0000","last_active":"2023-10-09T11:59:21.870737+0000","last_peered":"2023-10-09T11:59:21.870737+0000","last_clean":"2023-10-09T11:59:21.870737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:21.870737+0000","last_undegraded":"2023-10-09T11:59:21.870737+0000","last_fullsized":"2023-10-09T11:59:21.870737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:59:20.863014+0000","last_change":"2023-10-09T11:59:20.880270+0000","last_active":"2023-10-09T11:59:20.863014+0000","last_peered":"2023-10-09T11:59:20.863014+0000","last_clean":"2023-10-09T11:59:20.863014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:59:20.863014+0000","last_undegraded":"2023-10-09T11:59:20.863014+0000","last_fullsized":"2023-10-09T11:59:20.863014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:58.155274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"113'227","reported_seq":634,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-10-09T11:59:18.668719+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:59:18.668719+0000","last_peered":"2023-10-09T11:59:18.668719+0000","last_clean":"2023-10-09T11:59:18.668719+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:59:18.668719+0000","last_undegraded":"2023-10-09T11:59:18.668719+0000","last_fullsized":"2023-10-09T11:59:18.668719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2076672,"data_stored":1310857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":0.98399999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.754},"min":{"1min":0.63500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66400000000000003,"15min":0.70299999999999996},"min":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79800000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89100000000000001,"5min":1.0209999999999999,"15min":1.048},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68999999999999995,"15min":0.72399999999999998},"min":{"1min":0.59399999999999997,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.82299999999999995,"5min":0.98899999999999999,"15min":1.073},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.85999999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.55300000000000005,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.111,"15min":1.111},"last":0.71399999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67500000000000004,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.0629999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67700000000000005,"15min":0.73499999999999999},"min":{"1min":0.47599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.71299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90100000000000002,"5min":0.98999999999999999,"15min":1.121},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":1.0049999999999999,"15min":1.216},"last":0.55200000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.92800000000000005,"5min":0.98799999999999999,"15min":1.139},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.73699999999999999},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":1.0009999999999999,"15min":1.278},"last":0.66500000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.749},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":1.042,"15min":1.1040000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.875,"5min":0.94699999999999995,"15min":1.244},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.1060000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88900000000000001,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":1.143},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86699999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98999999999999999,"5min":1.03,"15min":1.327},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.58699999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509655,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.46300000000000002},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":1.0580000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.61399999999999999,"5min":1.079,"15min":1.079},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.504},"min":{"1min":0.32700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57499999999999996,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.76800000000000002,"15min":1.099},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.65400000000000003,"5min":1.044,"15min":1.1779999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":1.046},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73099999999999998,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0029999999999999,"5min":1.143,"15min":1.7210000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93899999999999995,"5min":1.0660000000000001,"15min":1.552},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74399999999999999,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0740000000000001,"5min":1.202,"15min":1.677},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76500000000000001,"15min":0.81000000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.103,"15min":1.778},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.80400000000000005},"min":{"1min":0.64500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.623},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.708},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.659},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.83399999999999996},"min":{"1min":0.60399999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.736},"last":0.59999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542358,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303412,"kb_used_data":2028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068428,"statfs":{"total":96636764160,"available":96326070272,"internally_reserved":0,"allocated":2076672,"data_stored":1310857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.219},"max":{"1min":1.012,"5min":1.012,"15min":1.0740000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":2.097,"15min":2.097},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32500000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.1699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1699999999999999,"5min":1.587,"15min":1.587},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78000000000000003,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0860000000000001,"5min":1.389,"15min":1.389},"last":0.63}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1739999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76700000000000002,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1339999999999999,"5min":1.1899999999999999,"15min":1.2709999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.113,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306928,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064912,"statfs":{"total":96636764160,"available":96322469888,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.46400000000000002},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78000000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.499,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.60099999999999998,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.876,"15min":0.876},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":1.095,"15min":1.1839999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.014,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.1850000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.79700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":1.0649999999999999,"15min":1.2629999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0449999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.98199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.216},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.204},"last":0.94999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.153,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.135},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79200000000000004,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.111,"5min":1.111,"15min":1.155},"last":1.079}]}]},{"osd":3,"up_from":15,"seq":64424509655,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306928,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064912,"statfs":{"total":96636764160,"available":96322469888,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68100000000000005,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.33000000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.876},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.68500000000000005,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.60499999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.34699999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.57199999999999995,"5min":0.55800000000000005,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":1.208,"15min":1.327},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":0.83699999999999997},"min":{"1min":0.622,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1679999999999999,"5min":1.252,"15min":1.2689999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.246,"15min":1.252},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.41299999999999998},"max":{"1min":1.0780000000000001,"5min":1.234,"15min":1.3660000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.97499999999999998,"5min":1.1240000000000001,"15min":1.218},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46999999999999997},"max":{"1min":0.996,"5min":1.25,"15min":1.333},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0640000000000001,"5min":1.194,"15min":1.3560000000000001},"last":0.75}]}]},{"osd":4,"up_from":16,"seq":68719476950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311024,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060816,"statfs":{"total":96636764160,"available":96318275584,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69299999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.38,"15min":0.38},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.71999999999999997},"min":{"1min":0.57699999999999996,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.98199999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":1.091},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.629,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.014,"5min":1.587,"15min":1.587},"last":0.89000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.97099999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.59699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.91700000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.367,"15min":1.367},"last":0.751},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.93600000000000005,"5min":1.613,"15min":1.613},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80300000000000005,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.93999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.484,"15min":1.484},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95999999999999996,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":16,"seq":68719476950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":720489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.71199999999999997},"min":{"1min":0.52800000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.52000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":1.014,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65400000000000003,"15min":0.69799999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.0840000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69099999999999995,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.909,"15min":1.909},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.046,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71599999999999997,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99199999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.83099999999999996,"5min":2.105,"15min":2.105},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.92900000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:59:28.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-09T11:59:28.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-09T11:59:28.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-09T11:59:28.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-09T11:59:28.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.878520+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:27:45.263340+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.880339+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:32:37.573159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-09T11:59:28.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877761+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:40:37.428050+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877714+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:52:16.896802+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.881090+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:07:14.363907+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877135+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:55:44.715609+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-10-09T11:59:28.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877373+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:16:32.213975+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.881313+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:13:09.418256+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877880+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:41:17.414858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-09T11:59:28.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.878283+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.880445+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:23:34.795132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-10-09T11:59:28.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.874371+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:09:25.610552+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.879084+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:34:26.943737+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-10-09T11:59:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.879707+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:10:16.864113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.874791+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:11:27.299815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877773+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:15:36.061106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-09T11:59:28.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.874845+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:53:12.308822+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877526+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:15:28.015454+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877100+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:06:35.394505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.876596+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-10-09T11:59:28.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.874118+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:26:52.983630+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.874051+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:59:56.740961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.876594+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:50:23.261722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-09T11:59:28.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.874428+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:58:16.664473+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.876549+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:23:08.932867+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.876572+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:10:45.754764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877513+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:04:27.749790+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.876001+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:16:56.315133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:59:28.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.877499+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:50:48.718549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.878396+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:37:40.688673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-09T11:59:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-10-09T11:59:28.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.879252+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:19:40.741374+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:59:28.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-09T11:59:28.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T11:59:21.870737+0000', 'last_change': '2023-10-09T11:59:21.870737+0000', 'last_active': '2023-10-09T11:59:21.870737+0000', 'last_peered': '2023-10-09T11:59:21.870737+0000', 'last_clean': '2023-10-09T11:59:21.870737+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:21.870737+0000', 'last_undegraded': '2023-10-09T11:59:21.870737+0000', 'last_fullsized': '2023-10-09T11:59:21.870737+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:21.870737+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T11:59:28.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-10-09T11:59:28.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:59:20.863014+0000', 'last_change': '2023-10-09T11:59:20.880270+0000', 'last_active': '2023-10-09T11:59:20.863014+0000', 'last_peered': '2023-10-09T11:59:20.863014+0000', 'last_clean': '2023-10-09T11:59:20.863014+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:59:20.863014+0000', 'last_undegraded': '2023-10-09T11:59:20.863014+0000', 'last_fullsized': '2023-10-09T11:59:20.863014+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'last_clean_scrub_stamp': '2023-10-09T11:59:20.863014+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:18:58.155274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:59:28.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:59:28.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.744+0000 7fbefc5ff700 1 Processor -- start 2023-10-09T11:59:28.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.744+0000 7fbefc5ff700 1 -- start start 2023-10-09T11:59:28.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.745+0000 7fbefc5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 0x7fbef4157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.745+0000 7fbefc5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef40acdd0 con 0x7fbef40abd30 2023-10-09T11:59:28.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.745+0000 7fbefc5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef40ac1c0 con 0x7fbef40b1600 2023-10-09T11:59:28.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.745+0000 7fbefc5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef40ac4a0 con 0x7fbef4157770 2023-10-09T11:59:28.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbef40abd30 0x7fbef40cce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54532/0 (socket says 172.21.15.86:54532) 2023-10-09T11:59:28.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9b9a700 1 -- 172.21.15.86:0/4137330203 learned_addr learned my addr 172.21.15.86:0/4137330203 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbefa39b700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 0x7fbef4157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239184082 0 0) 0x7fbef40acdd0 con 0x7fbef40abd30 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee0003570 con 0x7fbef40abd30 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 635519193 0 0) 0x7fbee0003570 con 0x7fbef40abd30 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 msgr2=0x7fbef4157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 0x7fbef4157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 >> v1:172.21.15.135:6789/0 conn(0x7fbef40b1600 legacy=0x7fbef40ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40ac780 con 0x7fbef40abd30 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fbee4001470 con 0x7fbef40abd30 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.746+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 >> v1:172.21.15.86:6789/0 conn(0x7fbef40abd30 legacy=0x7fbef40cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbef9399700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0003a90 0x7fbee0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbef9399700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 0x7fbee0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbef9399700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef40ac4a0 con 0x7fbee0004d50 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee000bbf0 con 0x7fbee0003a90 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee000bd80 con 0x7fbef4157770 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefab9c700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbef9b9a700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 0x7fbee0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefa39b700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0003a90 0x7fbee0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefab9c700 1 -- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 msgr2=0x7fbee0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefab9c700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef4157770 0x7fbee0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefab9c700 1 -- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0003a90 msgr2=0x7fbee0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefab9c700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0003a90 0x7fbee0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefab9c700 1 -- 172.21.15.86:0/4137330203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0003570 con 0x7fbee0004d50 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.747+0000 7fbefab9c700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbeec001fc0 tx=0x7fbeec001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e30ba786982536c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec001950 con 0x7fbee0004d50 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00c8b0 con 0x7fbee0004d50 2023-10-09T11:59:28.751 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbef9399700 1 -- 172.21.15.86:0/4137330203 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00cc50 con 0x7fbee0004d50 2023-10-09T11:59:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbefc5ff700 1 -- 172.21.15.86:0/4137330203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbee0004d50 msgr2=0x7fbee00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbefc5ff700 1 --2- 172.21.15.86:0/4137330203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbee0004d50 0x7fbee00051c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbeec001fc0 tx=0x7fbeec001640 comp rx=0 tx=0).stop 2023-10-09T11:59:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbefab9c700 1 -- 172.21.15.86:0/4137330203 reap_dead start 2023-10-09T11:59:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbefc5ff700 1 -- 172.21.15.86:0/4137330203 shutdown_connections 2023-10-09T11:59:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbefc5ff700 1 -- 172.21.15.86:0/4137330203 >> 172.21.15.86:0/4137330203 conn(0x7fbef406a310 msgr2=0x7fbef40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbefc5ff700 1 -- 172.21.15.86:0/4137330203 shutdown_connections 2023-10-09T11:59:28.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.748+0000 7fbefc5ff700 1 -- 172.21.15.86:0/4137330203 wait complete. 2023-10-09T11:59:28.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.750+0000 7fbefc5ff700 1 Processor -- start 2023-10-09T11:59:28.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.750+0000 7fbefc5ff700 1 -- start start 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefc5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0004d50 0x7fbef4158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefc5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbef41515c0 0x7fbef4151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefc5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef40aa7e0 0x7fbef40aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefc5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef4154840 con 0x7fbef41515c0 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefc5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef4168cb0 con 0x7fbee0004d50 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefc5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef4168f90 con 0x7fbef40aa7e0 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbef9b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbef41515c0 0x7fbef4151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbef9b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbef41515c0 0x7fbef4151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39074/0 (socket says 172.21.15.86:39074) 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbef9b9a700 1 -- 172.21.15.86:0/1666060717 learned_addr learned my addr 172.21.15.86:0/1666060717 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefa39b700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0004d50 0x7fbef4158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbefab9c700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef40aa7e0 0x7fbef40aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbef9b9a700 1 -- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef40aa7e0 msgr2=0x7fbef40aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.751+0000 7fbef9b9a700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef40aa7e0 0x7fbef40aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbef9b9a700 1 -- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0004d50 msgr2=0x7fbef4158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbef9b9a700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0004d50 0x7fbef4158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbef9b9a700 1 -- 172.21.15.86:0/1666060717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4169270 con 0x7fbef41515c0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbef9b9a700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbef41515c0 0x7fbef4151a30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbee4007390 tx=0x7fbef40acd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbeea7fc700 1 -- 172.21.15.86:0/1666060717 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4018030 con 0x7fbef41515c0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbeea7fc700 1 -- 172.21.15.86:0/1666060717 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee400f6c0 con 0x7fbef41515c0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef4169550 con 0x7fbef41515c0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbeea7fc700 1 -- 172.21.15.86:0/1666060717 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee400fac0 con 0x7fbef41515c0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.752+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef40ab180 con 0x7fbef41515c0 2023-10-09T11:59:28.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.753+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef4169a70 con 0x7fbef41515c0 2023-10-09T11:59:28.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.754+0000 7fbeea7fc700 1 -- 172.21.15.86:0/1666060717 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbee401b070 con 0x7fbef41515c0 2023-10-09T11:59:28.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.755+0000 7fbeea7fc700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbed8066f30 0x7fbed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:28.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.755+0000 7fbeea7fc700 1 -- 172.21.15.86:0/1666060717 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fbee4019070 con 0x7fbef41515c0 2023-10-09T11:59:28.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.755+0000 7fbefa39b700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbed8066f30 0x7fbed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:28.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.756+0000 7fbefa39b700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbed8066f30 0x7fbed80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbef0006f00 tx=0x7fbef00091a0 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:28.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:28.759+0000 7fbeea7fc700 1 -- 172.21.15.86:0/1666060717 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbef4169a70 con 0x7fbef41515c0 2023-10-09T11:59:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.023+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbef4169a70 con 0x7fbef41515c0 2023-10-09T11:59:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.024+0000 7fbeea7fc700 1 -- 172.21.15.86:0/1666060717 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1113 (secure 0 0 0) 0x7fbef4169a70 con 0x7fbef41515c0 2023-10-09T11:59:29.024 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:29.024 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1121,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":124,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2498764800,"bytes_avail":770595348480,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":54,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7183}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-09T11:59:03.409440+0000","services":{}},"progress_events":{}} 2023-10-09T11:59:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbed8066f30 msgr2=0x7fbed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbed8066f30 0x7fbed80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbef0006f00 tx=0x7fbef00091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbef41515c0 msgr2=0x7fbef4151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbef41515c0 0x7fbef4151a30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbee4007390 tx=0x7fbef40acd40 comp rx=0 tx=0).stop 2023-10-09T11:59:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 shutdown_connections 2023-10-09T11:59:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbef40aa7e0 0x7fbef40aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbee0004d50 0x7fbef4158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbed8066f30 0x7fbed80693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 --2- 172.21.15.86:0/1666060717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbef41515c0 0x7fbef4151a30 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.026+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 >> 172.21.15.86:0/1666060717 conn(0x7fbef406a310 msgr2=0x7fbef40ad760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.027+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 shutdown_connections 2023-10-09T11:59:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.027+0000 7fbefc5ff700 1 -- 172.21.15.86:0/1666060717 wait complete. 2023-10-09T11:59:29.044 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:59:29.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:59:29.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.226+0000 7fe5ec1ff700 1 Processor -- start 2023-10-09T11:59:29.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.226+0000 7fe5ec1ff700 1 -- start start 2023-10-09T11:59:29.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.227+0000 7fe5ec1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe5e40b1420 0x7fe5e40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:29.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.227+0000 7fe5ec1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40ccf90 0x7fe5e40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.227+0000 7fe5ec1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e40cc300 con 0x7fe5e40cbf30 2023-10-09T11:59:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.227+0000 7fe5ec1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e4156bf0 con 0x7fe5e40b1420 2023-10-09T11:59:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.227+0000 7fe5ec1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40ae950 con 0x7fe5e40ccf90 2023-10-09T11:59:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5e979a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe5e40b1420 0x7fe5e40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5ea79c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40ccf90 0x7fe5e40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5e979a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe5e40b1420 0x7fe5e40ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:35898/0 (socket says 172.21.15.86:35898) 2023-10-09T11:59:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5e979a700 1 -- 172.21.15.86:0/2842643156 learned_addr learned my addr 172.21.15.86:0/2842643156 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5e979a700 1 -- 172.21.15.86:0/2842643156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40ccf90 msgr2=0x7fe5e40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5e979a700 1 --2- 172.21.15.86:0/2842643156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40ccf90 0x7fe5e40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5e979a700 1 -- 172.21.15.86:0/2842643156 >> v1:172.21.15.135:6789/0 conn(0x7fe5e40cbf30 legacy=0x7fe5e40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.228+0000 7fe5e979a700 1 -- 172.21.15.86:0/2842643156 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40ad370 con 0x7fe5e40b1420 2023-10-09T11:59:29.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.229+0000 7fe5e979a700 1 --2- 172.21.15.86:0/2842643156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 0x7fe5e40ae410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40099e0 tx=0x7fe5d4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84a9de8f45ffd5f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:29.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.229+0000 7fe5e8f99700 1 -- 172.21.15.86:0/2842643156 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d400b820 con 0x7fe5e40b1420 2023-10-09T11:59:29.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.229+0000 7fe5e8f99700 1 -- 172.21.15.86:0/2842643156 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d400b980 con 0x7fe5e40b1420 2023-10-09T11:59:29.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.229+0000 7fe5e8f99700 1 -- 172.21.15.86:0/2842643156 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d400bd20 con 0x7fe5e40b1420 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.229+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/2842643156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 msgr2=0x7fe5e40ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.229+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/2842643156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 0x7fe5e40ae410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40099e0 tx=0x7fe5d4009250 comp rx=0 tx=0).stop 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.230+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/2842643156 shutdown_connections 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.230+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/2842643156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40ccf90 0x7fe5e40c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.230+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/2842643156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 0x7fe5e40ae410 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.230+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/2842643156 >> 172.21.15.86:0/2842643156 conn(0x7fe5e406a320 msgr2=0x7fe5e40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.230+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/2842643156 shutdown_connections 2023-10-09T11:59:29.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.230+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/2842643156 wait complete. 2023-10-09T11:59:29.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.231+0000 7fe5ec1ff700 1 Processor -- start 2023-10-09T11:59:29.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.231+0000 7fe5ec1ff700 1 -- start start 2023-10-09T11:59:29.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.232+0000 7fe5ec1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 0x7fe5e416dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:29.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.232+0000 7fe5ec1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40cbf30 0x7fe5e41559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:29.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.232+0000 7fe5ec1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5e40ccf90 0x7fe5e40a9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:29.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.232+0000 7fe5ec1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e416e110 con 0x7fe5e40ccf90 2023-10-09T11:59:29.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.232+0000 7fe5ec1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c6850 con 0x7fe5e40b1420 2023-10-09T11:59:29.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.232+0000 7fe5ec1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40c6b30 con 0x7fe5e40cbf30 2023-10-09T11:59:29.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5e40ccf90 0x7fe5e40a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:29.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5e40ccf90 0x7fe5e40a9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39090/0 (socket says 172.21.15.86:39090) 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 -- 172.21.15.86:0/946624260 learned_addr learned my addr 172.21.15.86:0/946624260 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5e979a700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40cbf30 0x7fe5e41559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5e9f9b700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 0x7fe5e416dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 -- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40cbf30 msgr2=0x7fe5e41559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40cbf30 0x7fe5e41559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 -- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 msgr2=0x7fe5e416dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 0x7fe5e416dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 -- 172.21.15.86:0/946624260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40094f0 con 0x7fe5e40ccf90 2023-10-09T11:59:29.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5ea79c700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5e40ccf90 0x7fe5e40a9590 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009df0 tx=0x7fe5dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:29.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5d9ffb700 1 -- 172.21.15.86:0/946624260 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc00cb50 con 0x7fe5e40ccf90 2023-10-09T11:59:29.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5d9ffb700 1 -- 172.21.15.86:0/946624260 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc00f040 con 0x7fe5e40ccf90 2023-10-09T11:59:29.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.233+0000 7fe5d9ffb700 1 -- 172.21.15.86:0/946624260 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc014480 con 0x7fe5e40ccf90 2023-10-09T11:59:29.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.234+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e40c6e10 con 0x7fe5e40ccf90 2023-10-09T11:59:29.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.234+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e40c73d0 con 0x7fe5e40ccf90 2023-10-09T11:59:29.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.235+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e40c75c0 con 0x7fe5e40ccf90 2023-10-09T11:59:29.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.235+0000 7fe5d9ffb700 1 -- 172.21.15.86:0/946624260 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5dc014830 con 0x7fe5e40ccf90 2023-10-09T11:59:29.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.236+0000 7fe5d9ffb700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe5c8066f30 0x7fe5c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:29.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.236+0000 7fe5d9ffb700 1 -- 172.21.15.86:0/946624260 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fe5dc0850d0 con 0x7fe5e40ccf90 2023-10-09T11:59:29.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.237+0000 7fe5e9f9b700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe5c8066f30 0x7fe5c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:29.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.237+0000 7fe5e9f9b700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe5c8066f30 0x7fe5c80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0003860 tx=0x7fe5e0009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:29.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.241+0000 7fe5d9ffb700 1 -- 172.21.15.86:0/946624260 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5dc052120 con 0x7fe5e40ccf90 2023-10-09T11:59:29.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.429+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5e40c6ca0 con 0x7fe5c8066f30 2023-10-09T11:59:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.437+0000 7fe5d9ffb700 1 -- 172.21.15.86:0/946624260 <== mgr.7479 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289346 (secure 0 0 0) 0x7fe5e40c6ca0 con 0x7fe5c8066f30 2023-10-09T11:59:29.442 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:29.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.441+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe5c8066f30 msgr2=0x7fe5c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.441+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe5c8066f30 0x7fe5c80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0003860 tx=0x7fe5e0009040 comp rx=0 tx=0).stop 2023-10-09T11:59:29.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.441+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5e40ccf90 msgr2=0x7fe5e40a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:29.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.441+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5e40ccf90 0x7fe5e40a9590 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009df0 tx=0x7fe5dc00b040 comp rx=0 tx=0).stop 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 shutdown_connections 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe5c8066f30 0x7fe5c80693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5e40ccf90 0x7fe5e40a9590 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5e40b1420 0x7fe5e416dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 --2- 172.21.15.86:0/946624260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5e40cbf30 0x7fe5e41559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 >> 172.21.15.86:0/946624260 conn(0x7fe5e406a320 msgr2=0x7fe5e40b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 shutdown_connections 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:29.442+0000 7fe5ec1ff700 1 -- 172.21.15.86:0/946624260 wait complete. 2023-10-09T11:59:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:59:29.459 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:59:28.847430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440552,"kb_used_data":13096,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534168,"statfs":{"total":773094113280,"available":770594988032,"internally_reserved":0,"allocated":13410304,"data_stored":7112796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.966267"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.899416+0000","last_change":"2023-10-09T11:59:22.891013+0000","last_active":"2023-10-09T11:59:22.899416+0000","last_peered":"2023-10-09T11:59:22.899416+0000","last_clean":"2023-10-09T11:59:22.899416+0000","last_became_active":"2023-10-09T11:59:22.890710+0000","last_became_peered":"2023-10-09T11:59:22.890710+0000","last_unstale":"2023-10-09T11:59:22.899416+0000","last_undegraded":"2023-10-09T11:59:22.899416+0000","last_fullsized":"2023-10-09T11:59:22.899416+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:26.618275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909088+0000","last_change":"2023-10-09T11:59:22.901596+0000","last_active":"2023-10-09T11:59:22.909088+0000","last_peered":"2023-10-09T11:59:22.909088+0000","last_clean":"2023-10-09T11:59:22.909088+0000","last_became_active":"2023-10-09T11:59:22.901326+0000","last_became_peered":"2023-10-09T11:59:22.901326+0000","last_unstale":"2023-10-09T11:59:22.909088+0000","last_undegraded":"2023-10-09T11:59:22.909088+0000","last_fullsized":"2023-10-09T11:59:22.909088+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:37.453580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.899548+0000","last_change":"2023-10-09T11:59:22.891080+0000","last_active":"2023-10-09T11:59:22.899548+0000","last_peered":"2023-10-09T11:59:22.899548+0000","last_clean":"2023-10-09T11:59:22.899548+0000","last_became_active":"2023-10-09T11:59:22.890489+0000","last_became_peered":"2023-10-09T11:59:22.890489+0000","last_unstale":"2023-10-09T11:59:22.899548+0000","last_undegraded":"2023-10-09T11:59:22.899548+0000","last_fullsized":"2023-10-09T11:59:22.899548+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:49.812769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907326+0000","last_change":"2023-10-09T11:59:22.904619+0000","last_active":"2023-10-09T11:59:22.907326+0000","last_peered":"2023-10-09T11:59:22.907326+0000","last_clean":"2023-10-09T11:59:22.907326+0000","last_became_active":"2023-10-09T11:59:22.903794+0000","last_became_peered":"2023-10-09T11:59:22.903794+0000","last_unstale":"2023-10-09T11:59:22.907326+0000","last_undegraded":"2023-10-09T11:59:22.907326+0000","last_fullsized":"2023-10-09T11:59:22.907326+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:04.557214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905804+0000","last_change":"2023-10-09T11:59:22.898687+0000","last_active":"2023-10-09T11:59:22.905804+0000","last_peered":"2023-10-09T11:59:22.905804+0000","last_clean":"2023-10-09T11:59:22.905804+0000","last_became_active":"2023-10-09T11:59:22.898380+0000","last_became_peered":"2023-10-09T11:59:22.898380+0000","last_unstale":"2023-10-09T11:59:22.905804+0000","last_undegraded":"2023-10-09T11:59:22.905804+0000","last_fullsized":"2023-10-09T11:59:22.905804+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:00.962431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908101+0000","last_change":"2023-10-09T11:59:22.903620+0000","last_active":"2023-10-09T11:59:22.908101+0000","last_peered":"2023-10-09T11:59:22.908101+0000","last_clean":"2023-10-09T11:59:22.908101+0000","last_became_active":"2023-10-09T11:59:22.903353+0000","last_became_peered":"2023-10-09T11:59:22.903353+0000","last_unstale":"2023-10-09T11:59:22.908101+0000","last_undegraded":"2023-10-09T11:59:22.908101+0000","last_fullsized":"2023-10-09T11:59:22.908101+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:08:33.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907789+0000","last_change":"2023-10-09T11:59:22.900913+0000","last_active":"2023-10-09T11:59:22.907789+0000","last_peered":"2023-10-09T11:59:22.907789+0000","last_clean":"2023-10-09T11:59:22.907789+0000","last_became_active":"2023-10-09T11:59:22.900640+0000","last_became_peered":"2023-10-09T11:59:22.900640+0000","last_unstale":"2023-10-09T11:59:22.907789+0000","last_undegraded":"2023-10-09T11:59:22.907789+0000","last_fullsized":"2023-10-09T11:59:22.907789+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:21.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909005+0000","last_change":"2023-10-09T11:59:22.900591+0000","last_active":"2023-10-09T11:59:22.909005+0000","last_peered":"2023-10-09T11:59:22.909005+0000","last_clean":"2023-10-09T11:59:22.909005+0000","last_became_active":"2023-10-09T11:59:22.900312+0000","last_became_peered":"2023-10-09T11:59:22.900312+0000","last_unstale":"2023-10-09T11:59:22.909005+0000","last_undegraded":"2023-10-09T11:59:22.909005+0000","last_fullsized":"2023-10-09T11:59:22.909005+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:23.918094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902027+0000","last_change":"2023-10-09T11:59:22.899154+0000","last_active":"2023-10-09T11:59:22.902027+0000","last_peered":"2023-10-09T11:59:22.902027+0000","last_clean":"2023-10-09T11:59:22.902027+0000","last_became_active":"2023-10-09T11:59:22.898908+0000","last_became_peered":"2023-10-09T11:59:22.898908+0000","last_unstale":"2023-10-09T11:59:22.902027+0000","last_undegraded":"2023-10-09T11:59:22.902027+0000","last_fullsized":"2023-10-09T11:59:22.902027+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:59.162997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905889+0000","last_change":"2023-10-09T11:59:22.901554+0000","last_active":"2023-10-09T11:59:22.905889+0000","last_peered":"2023-10-09T11:59:22.905889+0000","last_clean":"2023-10-09T11:59:22.905889+0000","last_became_active":"2023-10-09T11:59:22.901098+0000","last_became_peered":"2023-10-09T11:59:22.901098+0000","last_unstale":"2023-10-09T11:59:22.905889+0000","last_undegraded":"2023-10-09T11:59:22.905889+0000","last_fullsized":"2023-10-09T11:59:22.905889+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:02.886945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907025+0000","last_change":"2023-10-09T11:59:22.904184+0000","last_active":"2023-10-09T11:59:22.907025+0000","last_peered":"2023-10-09T11:59:22.907025+0000","last_clean":"2023-10-09T11:59:22.907025+0000","last_became_active":"2023-10-09T11:59:22.903873+0000","last_became_peered":"2023-10-09T11:59:22.903873+0000","last_unstale":"2023-10-09T11:59:22.907025+0000","last_undegraded":"2023-10-09T11:59:22.907025+0000","last_fullsized":"2023-10-09T11:59:22.907025+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:32.674601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901302+0000","last_change":"2023-10-09T11:59:22.895153+0000","last_active":"2023-10-09T11:59:22.901302+0000","last_peered":"2023-10-09T11:59:22.901302+0000","last_clean":"2023-10-09T11:59:22.901302+0000","last_became_active":"2023-10-09T11:59:22.894854+0000","last_became_peered":"2023-10-09T11:59:22.894854+0000","last_unstale":"2023-10-09T11:59:22.901302+0000","last_undegraded":"2023-10-09T11:59:22.901302+0000","last_fullsized":"2023-10-09T11:59:22.901302+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:35.802855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908605+0000","last_change":"2023-10-09T11:59:22.906020+0000","last_active":"2023-10-09T11:59:22.908605+0000","last_peered":"2023-10-09T11:59:22.908605+0000","last_clean":"2023-10-09T11:59:22.908605+0000","last_became_active":"2023-10-09T11:59:22.905769+0000","last_became_peered":"2023-10-09T11:59:22.905769+0000","last_unstale":"2023-10-09T11:59:22.908605+0000","last_undegraded":"2023-10-09T11:59:22.908605+0000","last_fullsized":"2023-10-09T11:59:22.908605+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:28.774074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898954+0000","last_change":"2023-10-09T11:59:22.897637+0000","last_active":"2023-10-09T11:59:22.898954+0000","last_peered":"2023-10-09T11:59:22.898954+0000","last_clean":"2023-10-09T11:59:22.898954+0000","last_became_active":"2023-10-09T11:59:22.896845+0000","last_became_peered":"2023-10-09T11:59:22.896845+0000","last_unstale":"2023-10-09T11:59:22.898954+0000","last_undegraded":"2023-10-09T11:59:22.898954+0000","last_fullsized":"2023-10-09T11:59:22.898954+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:43.324604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906946+0000","last_change":"2023-10-09T11:59:22.903317+0000","last_active":"2023-10-09T11:59:22.906946+0000","last_peered":"2023-10-09T11:59:22.906946+0000","last_clean":"2023-10-09T11:59:22.906946+0000","last_became_active":"2023-10-09T11:59:22.903011+0000","last_became_peered":"2023-10-09T11:59:22.903011+0000","last_unstale":"2023-10-09T11:59:22.906946+0000","last_undegraded":"2023-10-09T11:59:22.906946+0000","last_fullsized":"2023-10-09T11:59:22.906946+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:33.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907010+0000","last_change":"2023-10-09T11:59:22.899760+0000","last_active":"2023-10-09T11:59:22.907010+0000","last_peered":"2023-10-09T11:59:22.907010+0000","last_clean":"2023-10-09T11:59:22.907010+0000","last_became_active":"2023-10-09T11:59:22.899376+0000","last_became_peered":"2023-10-09T11:59:22.899376+0000","last_unstale":"2023-10-09T11:59:22.907010+0000","last_undegraded":"2023-10-09T11:59:22.907010+0000","last_fullsized":"2023-10-09T11:59:22.907010+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:02.886945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908950+0000","last_change":"2023-10-09T11:59:22.899270+0000","last_active":"2023-10-09T11:59:22.908950+0000","last_peered":"2023-10-09T11:59:22.908950+0000","last_clean":"2023-10-09T11:59:22.908950+0000","last_became_active":"2023-10-09T11:59:22.899025+0000","last_became_peered":"2023-10-09T11:59:22.899025+0000","last_unstale":"2023-10-09T11:59:22.908950+0000","last_undegraded":"2023-10-09T11:59:22.908950+0000","last_fullsized":"2023-10-09T11:59:22.908950+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:54.039518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906793+0000","last_change":"2023-10-09T11:59:22.902015+0000","last_active":"2023-10-09T11:59:22.906793+0000","last_peered":"2023-10-09T11:59:22.906793+0000","last_clean":"2023-10-09T11:59:22.906793+0000","last_became_active":"2023-10-09T11:59:22.901763+0000","last_became_peered":"2023-10-09T11:59:22.901763+0000","last_unstale":"2023-10-09T11:59:22.906793+0000","last_undegraded":"2023-10-09T11:59:22.906793+0000","last_fullsized":"2023-10-09T11:59:22.906793+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:17.603222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897638+0000","last_change":"2023-10-09T11:59:22.895751+0000","last_active":"2023-10-09T11:59:22.897638+0000","last_peered":"2023-10-09T11:59:22.897638+0000","last_clean":"2023-10-09T11:59:22.897638+0000","last_became_active":"2023-10-09T11:59:22.895448+0000","last_became_peered":"2023-10-09T11:59:22.895448+0000","last_unstale":"2023-10-09T11:59:22.897638+0000","last_undegraded":"2023-10-09T11:59:22.897638+0000","last_fullsized":"2023-10-09T11:59:22.897638+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:10:01.652778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901323+0000","last_change":"2023-10-09T11:59:22.898463+0000","last_active":"2023-10-09T11:59:22.901323+0000","last_peered":"2023-10-09T11:59:22.901323+0000","last_clean":"2023-10-09T11:59:22.901323+0000","last_became_active":"2023-10-09T11:59:22.898133+0000","last_became_peered":"2023-10-09T11:59:22.898133+0000","last_unstale":"2023-10-09T11:59:22.901323+0000","last_undegraded":"2023-10-09T11:59:22.901323+0000","last_fullsized":"2023-10-09T11:59:22.901323+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:13.848325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906404+0000","last_change":"2023-10-09T11:59:22.901657+0000","last_active":"2023-10-09T11:59:22.906404+0000","last_peered":"2023-10-09T11:59:22.906404+0000","last_clean":"2023-10-09T11:59:22.906404+0000","last_became_active":"2023-10-09T11:59:22.901368+0000","last_became_peered":"2023-10-09T11:59:22.901368+0000","last_unstale":"2023-10-09T11:59:22.906404+0000","last_undegraded":"2023-10-09T11:59:22.906404+0000","last_fullsized":"2023-10-09T11:59:22.906404+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:10.785426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908981+0000","last_change":"2023-10-09T11:59:22.900149+0000","last_active":"2023-10-09T11:59:22.908981+0000","last_peered":"2023-10-09T11:59:22.908981+0000","last_clean":"2023-10-09T11:59:22.908981+0000","last_became_active":"2023-10-09T11:59:22.899896+0000","last_became_peered":"2023-10-09T11:59:22.899896+0000","last_unstale":"2023-10-09T11:59:22.908981+0000","last_undegraded":"2023-10-09T11:59:22.908981+0000","last_fullsized":"2023-10-09T11:59:22.908981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:22.922109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909048+0000","last_change":"2023-10-09T11:59:22.900789+0000","last_active":"2023-10-09T11:59:22.909048+0000","last_peered":"2023-10-09T11:59:22.909048+0000","last_clean":"2023-10-09T11:59:22.909048+0000","last_became_active":"2023-10-09T11:59:22.900517+0000","last_became_peered":"2023-10-09T11:59:22.900517+0000","last_unstale":"2023-10-09T11:59:22.909048+0000","last_undegraded":"2023-10-09T11:59:22.909048+0000","last_fullsized":"2023-10-09T11:59:22.909048+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:51.640810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908376+0000","last_change":"2023-10-09T11:59:22.906652+0000","last_active":"2023-10-09T11:59:22.908376+0000","last_peered":"2023-10-09T11:59:22.908376+0000","last_clean":"2023-10-09T11:59:22.908376+0000","last_became_active":"2023-10-09T11:59:22.906407+0000","last_became_peered":"2023-10-09T11:59:22.906407+0000","last_unstale":"2023-10-09T11:59:22.908376+0000","last_undegraded":"2023-10-09T11:59:22.908376+0000","last_fullsized":"2023-10-09T11:59:22.908376+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:47.317346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906095+0000","last_change":"2023-10-09T11:59:22.899296+0000","last_active":"2023-10-09T11:59:22.906095+0000","last_peered":"2023-10-09T11:59:22.906095+0000","last_clean":"2023-10-09T11:59:22.906095+0000","last_became_active":"2023-10-09T11:59:22.899033+0000","last_became_peered":"2023-10-09T11:59:22.899033+0000","last_unstale":"2023-10-09T11:59:22.906095+0000","last_undegraded":"2023-10-09T11:59:22.906095+0000","last_fullsized":"2023-10-09T11:59:22.906095+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:19.886451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909105+0000","last_change":"2023-10-09T11:59:22.901865+0000","last_active":"2023-10-09T11:59:22.909105+0000","last_peered":"2023-10-09T11:59:22.909105+0000","last_clean":"2023-10-09T11:59:22.909105+0000","last_became_active":"2023-10-09T11:59:22.900468+0000","last_became_peered":"2023-10-09T11:59:22.900468+0000","last_unstale":"2023-10-09T11:59:22.909105+0000","last_undegraded":"2023-10-09T11:59:22.909105+0000","last_fullsized":"2023-10-09T11:59:22.909105+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:33.487369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906888+0000","last_change":"2023-10-09T11:59:22.900009+0000","last_active":"2023-10-09T11:59:22.906888+0000","last_peered":"2023-10-09T11:59:22.906888+0000","last_clean":"2023-10-09T11:59:22.906888+0000","last_became_active":"2023-10-09T11:59:22.899667+0000","last_became_peered":"2023-10-09T11:59:22.899667+0000","last_unstale":"2023-10-09T11:59:22.906888+0000","last_undegraded":"2023-10-09T11:59:22.906888+0000","last_fullsized":"2023-10-09T11:59:22.906888+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:19.886451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905637+0000","last_change":"2023-10-09T11:59:22.901955+0000","last_active":"2023-10-09T11:59:22.905637+0000","last_peered":"2023-10-09T11:59:22.905637+0000","last_clean":"2023-10-09T11:59:22.905637+0000","last_became_active":"2023-10-09T11:59:22.900532+0000","last_became_peered":"2023-10-09T11:59:22.900532+0000","last_unstale":"2023-10-09T11:59:22.905637+0000","last_undegraded":"2023-10-09T11:59:22.905637+0000","last_fullsized":"2023-10-09T11:59:22.905637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:38.254692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909010+0000","last_change":"2023-10-09T11:59:22.898859+0000","last_active":"2023-10-09T11:59:22.909010+0000","last_peered":"2023-10-09T11:59:22.909010+0000","last_clean":"2023-10-09T11:59:22.909010+0000","last_became_active":"2023-10-09T11:59:22.898603+0000","last_became_peered":"2023-10-09T11:59:22.898603+0000","last_unstale":"2023-10-09T11:59:22.909010+0000","last_undegraded":"2023-10-09T11:59:22.909010+0000","last_fullsized":"2023-10-09T11:59:22.909010+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:45.631499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897677+0000","last_change":"2023-10-09T11:59:22.896333+0000","last_active":"2023-10-09T11:59:22.897677+0000","last_peered":"2023-10-09T11:59:22.897677+0000","last_clean":"2023-10-09T11:59:22.897677+0000","last_became_active":"2023-10-09T11:59:22.896090+0000","last_became_peered":"2023-10-09T11:59:22.896090+0000","last_unstale":"2023-10-09T11:59:22.897677+0000","last_undegraded":"2023-10-09T11:59:22.897677+0000","last_fullsized":"2023-10-09T11:59:22.897677+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:47.493048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907209+0000","last_change":"2023-10-09T11:59:22.905321+0000","last_active":"2023-10-09T11:59:22.907209+0000","last_peered":"2023-10-09T11:59:22.907209+0000","last_clean":"2023-10-09T11:59:22.907209+0000","last_became_active":"2023-10-09T11:59:22.905072+0000","last_became_peered":"2023-10-09T11:59:22.905072+0000","last_unstale":"2023-10-09T11:59:22.907209+0000","last_undegraded":"2023-10-09T11:59:22.907209+0000","last_fullsized":"2023-10-09T11:59:22.907209+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:18.566828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902624+0000","last_change":"2023-10-09T11:59:22.896651+0000","last_active":"2023-10-09T11:59:22.902624+0000","last_peered":"2023-10-09T11:59:22.902624+0000","last_clean":"2023-10-09T11:59:22.902624+0000","last_became_active":"2023-10-09T11:59:22.895837+0000","last_became_peered":"2023-10-09T11:59:22.895837+0000","last_unstale":"2023-10-09T11:59:22.902624+0000","last_undegraded":"2023-10-09T11:59:22.902624+0000","last_fullsized":"2023-10-09T11:59:22.902624+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:36.443202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901753+0000","last_change":"2023-10-09T11:59:22.898410+0000","last_active":"2023-10-09T11:59:22.901753+0000","last_peered":"2023-10-09T11:59:22.901753+0000","last_clean":"2023-10-09T11:59:22.901753+0000","last_became_active":"2023-10-09T11:59:22.898170+0000","last_became_peered":"2023-10-09T11:59:22.898170+0000","last_unstale":"2023-10-09T11:59:22.901753+0000","last_undegraded":"2023-10-09T11:59:22.901753+0000","last_fullsized":"2023-10-09T11:59:22.901753+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:43.043540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318961+0000","last_change":"2023-10-09T11:59:21.895946+0000","last_active":"2023-10-09T11:59:23.318961+0000","last_peered":"2023-10-09T11:59:23.318961+0000","last_clean":"2023-10-09T11:59:23.318961+0000","last_became_active":"2023-10-09T11:59:21.895693+0000","last_became_peered":"2023-10-09T11:59:21.895693+0000","last_unstale":"2023-10-09T11:59:23.318961+0000","last_undegraded":"2023-10-09T11:59:23.318961+0000","last_fullsized":"2023-10-09T11:59:23.318961+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:35.119233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908632+0000","last_change":"2023-10-09T11:59:22.905862+0000","last_active":"2023-10-09T11:59:22.908632+0000","last_peered":"2023-10-09T11:59:22.908632+0000","last_clean":"2023-10-09T11:59:22.908632+0000","last_became_active":"2023-10-09T11:59:22.905608+0000","last_became_peered":"2023-10-09T11:59:22.905608+0000","last_unstale":"2023-10-09T11:59:22.908632+0000","last_undegraded":"2023-10-09T11:59:22.908632+0000","last_fullsized":"2023-10-09T11:59:22.908632+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:52.836467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.315355+0000","last_change":"2023-10-09T11:59:21.904525+0000","last_active":"2023-10-09T11:59:23.315355+0000","last_peered":"2023-10-09T11:59:23.315355+0000","last_clean":"2023-10-09T11:59:23.315355+0000","last_became_active":"2023-10-09T11:59:21.904230+0000","last_became_peered":"2023-10-09T11:59:21.904230+0000","last_unstale":"2023-10-09T11:59:23.315355+0000","last_undegraded":"2023-10-09T11:59:23.315355+0000","last_fullsized":"2023-10-09T11:59:23.315355+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.213975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898033+0000","last_change":"2023-10-09T11:59:22.889950+0000","last_active":"2023-10-09T11:59:22.898033+0000","last_peered":"2023-10-09T11:59:22.898033+0000","last_clean":"2023-10-09T11:59:22.898033+0000","last_became_active":"2023-10-09T11:59:22.889661+0000","last_became_peered":"2023-10-09T11:59:22.889661+0000","last_unstale":"2023-10-09T11:59:22.898033+0000","last_undegraded":"2023-10-09T11:59:22.898033+0000","last_fullsized":"2023-10-09T11:59:22.898033+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:27.657805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317015+0000","last_change":"2023-10-09T11:59:21.901287+0000","last_active":"2023-10-09T11:59:23.317015+0000","last_peered":"2023-10-09T11:59:23.317015+0000","last_clean":"2023-10-09T11:59:23.317015+0000","last_became_active":"2023-10-09T11:59:21.901039+0000","last_became_peered":"2023-10-09T11:59:21.901039+0000","last_unstale":"2023-10-09T11:59:23.317015+0000","last_undegraded":"2023-10-09T11:59:23.317015+0000","last_fullsized":"2023-10-09T11:59:23.317015+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:40.433627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902127+0000","last_change":"2023-10-09T11:59:22.900616+0000","last_active":"2023-10-09T11:59:22.902127+0000","last_peered":"2023-10-09T11:59:22.902127+0000","last_clean":"2023-10-09T11:59:22.902127+0000","last_became_active":"2023-10-09T11:59:22.900326+0000","last_became_peered":"2023-10-09T11:59:22.900326+0000","last_unstale":"2023-10-09T11:59:22.902127+0000","last_undegraded":"2023-10-09T11:59:22.902127+0000","last_fullsized":"2023-10-09T11:59:22.902127+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:19.946244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318693+0000","last_change":"2023-10-09T11:59:21.905670+0000","last_active":"2023-10-09T11:59:23.318693+0000","last_peered":"2023-10-09T11:59:23.318693+0000","last_clean":"2023-10-09T11:59:23.318693+0000","last_became_active":"2023-10-09T11:59:21.900408+0000","last_became_peered":"2023-10-09T11:59:21.900408+0000","last_unstale":"2023-10-09T11:59:23.318693+0000","last_undegraded":"2023-10-09T11:59:23.318693+0000","last_fullsized":"2023-10-09T11:59:23.318693+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:06.436123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897296+0000","last_change":"2023-10-09T11:59:22.891944+0000","last_active":"2023-10-09T11:59:22.897296+0000","last_peered":"2023-10-09T11:59:22.897296+0000","last_clean":"2023-10-09T11:59:22.897296+0000","last_became_active":"2023-10-09T11:59:22.891481+0000","last_became_peered":"2023-10-09T11:59:22.891481+0000","last_unstale":"2023-10-09T11:59:22.897296+0000","last_undegraded":"2023-10-09T11:59:22.897296+0000","last_fullsized":"2023-10-09T11:59:22.897296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:36.443202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317550+0000","last_change":"2023-10-09T11:59:21.898872+0000","last_active":"2023-10-09T11:59:23.317550+0000","last_peered":"2023-10-09T11:59:23.317550+0000","last_clean":"2023-10-09T11:59:23.317550+0000","last_became_active":"2023-10-09T11:59:21.898315+0000","last_became_peered":"2023-10-09T11:59:21.898315+0000","last_unstale":"2023-10-09T11:59:23.317550+0000","last_undegraded":"2023-10-09T11:59:23.317550+0000","last_fullsized":"2023-10-09T11:59:23.317550+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:28.008292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.904661+0000","last_change":"2023-10-09T11:59:22.898412+0000","last_active":"2023-10-09T11:59:22.904661+0000","last_peered":"2023-10-09T11:59:22.904661+0000","last_clean":"2023-10-09T11:59:22.904661+0000","last_became_active":"2023-10-09T11:59:22.898159+0000","last_became_peered":"2023-10-09T11:59:22.898159+0000","last_unstale":"2023-10-09T11:59:22.904661+0000","last_undegraded":"2023-10-09T11:59:22.904661+0000","last_fullsized":"2023-10-09T11:59:22.904661+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:16.343281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318991+0000","last_change":"2023-10-09T11:59:21.906491+0000","last_active":"2023-10-09T11:59:23.318991+0000","last_peered":"2023-10-09T11:59:23.318991+0000","last_clean":"2023-10-09T11:59:23.318991+0000","last_became_active":"2023-10-09T11:59:21.906179+0000","last_became_peered":"2023-10-09T11:59:21.906179+0000","last_unstale":"2023-10-09T11:59:23.318991+0000","last_undegraded":"2023-10-09T11:59:23.318991+0000","last_fullsized":"2023-10-09T11:59:23.318991+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:51.828744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906978+0000","last_change":"2023-10-09T11:59:22.902722+0000","last_active":"2023-10-09T11:59:22.906978+0000","last_peered":"2023-10-09T11:59:22.906978+0000","last_clean":"2023-10-09T11:59:22.906978+0000","last_became_active":"2023-10-09T11:59:22.902475+0000","last_became_peered":"2023-10-09T11:59:22.902475+0000","last_unstale":"2023-10-09T11:59:22.906978+0000","last_undegraded":"2023-10-09T11:59:22.906978+0000","last_fullsized":"2023-10-09T11:59:22.906978+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:07.443846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.890100+0000","last_change":"2023-10-09T11:59:21.899625+0000","last_active":"2023-10-09T11:59:22.890100+0000","last_peered":"2023-10-09T11:59:22.890100+0000","last_clean":"2023-10-09T11:59:22.890100+0000","last_became_active":"2023-10-09T11:59:21.899349+0000","last_became_peered":"2023-10-09T11:59:21.899349+0000","last_unstale":"2023-10-09T11:59:22.890100+0000","last_undegraded":"2023-10-09T11:59:22.890100+0000","last_fullsized":"2023-10-09T11:59:22.890100+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:33.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902057+0000","last_change":"2023-10-09T11:59:22.899926+0000","last_active":"2023-10-09T11:59:22.902057+0000","last_peered":"2023-10-09T11:59:22.902057+0000","last_clean":"2023-10-09T11:59:22.902057+0000","last_became_active":"2023-10-09T11:59:22.899620+0000","last_became_peered":"2023-10-09T11:59:22.899620+0000","last_unstale":"2023-10-09T11:59:22.902057+0000","last_undegraded":"2023-10-09T11:59:22.902057+0000","last_fullsized":"2023-10-09T11:59:22.902057+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:27.538047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.883415+0000","last_change":"2023-10-09T11:59:21.899285+0000","last_active":"2023-10-09T11:59:22.883415+0000","last_peered":"2023-10-09T11:59:22.883415+0000","last_clean":"2023-10-09T11:59:22.883415+0000","last_became_active":"2023-10-09T11:59:21.898978+0000","last_became_peered":"2023-10-09T11:59:21.898978+0000","last_unstale":"2023-10-09T11:59:22.883415+0000","last_undegraded":"2023-10-09T11:59:22.883415+0000","last_fullsized":"2023-10-09T11:59:22.883415+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:46:31.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898331+0000","last_change":"2023-10-09T11:59:22.897438+0000","last_active":"2023-10-09T11:59:22.898331+0000","last_peered":"2023-10-09T11:59:22.898331+0000","last_clean":"2023-10-09T11:59:22.898331+0000","last_became_active":"2023-10-09T11:59:22.897151+0000","last_became_peered":"2023-10-09T11:59:22.897151+0000","last_unstale":"2023-10-09T11:59:22.898331+0000","last_undegraded":"2023-10-09T11:59:22.898331+0000","last_fullsized":"2023-10-09T11:59:22.898331+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:17.892093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.884054+0000","last_change":"2023-10-09T11:59:21.897895+0000","last_active":"2023-10-09T11:59:22.884054+0000","last_peered":"2023-10-09T11:59:22.884054+0000","last_clean":"2023-10-09T11:59:22.884054+0000","last_became_active":"2023-10-09T11:59:21.897647+0000","last_became_peered":"2023-10-09T11:59:21.897647+0000","last_unstale":"2023-10-09T11:59:22.884054+0000","last_undegraded":"2023-10-09T11:59:22.884054+0000","last_fullsized":"2023-10-09T11:59:22.884054+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:20.186681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902698+0000","last_change":"2023-10-09T11:59:22.901609+0000","last_active":"2023-10-09T11:59:22.902698+0000","last_peered":"2023-10-09T11:59:22.902698+0000","last_clean":"2023-10-09T11:59:22.902698+0000","last_became_active":"2023-10-09T11:59:22.901324+0000","last_became_peered":"2023-10-09T11:59:22.901324+0000","last_unstale":"2023-10-09T11:59:22.902698+0000","last_undegraded":"2023-10-09T11:59:22.902698+0000","last_fullsized":"2023-10-09T11:59:22.902698+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:22.028891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.894672+0000","last_change":"2023-10-09T11:59:21.896965+0000","last_active":"2023-10-09T11:59:22.894672+0000","last_peered":"2023-10-09T11:59:22.894672+0000","last_clean":"2023-10-09T11:59:22.894672+0000","last_became_active":"2023-10-09T11:59:21.896679+0000","last_became_peered":"2023-10-09T11:59:21.896679+0000","last_unstale":"2023-10-09T11:59:22.894672+0000","last_undegraded":"2023-10-09T11:59:22.894672+0000","last_fullsized":"2023-10-09T11:59:22.894672+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:35.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905770+0000","last_change":"2023-10-09T11:59:22.900874+0000","last_active":"2023-10-09T11:59:22.905770+0000","last_peered":"2023-10-09T11:59:22.905770+0000","last_clean":"2023-10-09T11:59:22.905770+0000","last_became_active":"2023-10-09T11:59:22.900080+0000","last_became_peered":"2023-10-09T11:59:22.900080+0000","last_unstale":"2023-10-09T11:59:22.905770+0000","last_undegraded":"2023-10-09T11:59:22.905770+0000","last_fullsized":"2023-10-09T11:59:22.905770+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:21.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"123'3","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317731+0000","last_change":"2023-10-09T11:59:21.895706+0000","last_active":"2023-10-09T11:59:23.317731+0000","last_peered":"2023-10-09T11:59:23.317731+0000","last_clean":"2023-10-09T11:59:23.317731+0000","last_became_active":"2023-10-09T11:59:21.895430+0000","last_became_peered":"2023-10-09T11:59:21.895430+0000","last_unstale":"2023-10-09T11:59:23.317731+0000","last_undegraded":"2023-10-09T11:59:23.317731+0000","last_fullsized":"2023-10-09T11:59:23.317731+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:36:55.629194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906910+0000","last_change":"2023-10-09T11:59:22.900145+0000","last_active":"2023-10-09T11:59:22.906910+0000","last_peered":"2023-10-09T11:59:22.906910+0000","last_clean":"2023-10-09T11:59:22.906910+0000","last_became_active":"2023-10-09T11:59:22.899502+0000","last_became_peered":"2023-10-09T11:59:22.899502+0000","last_unstale":"2023-10-09T11:59:22.906910+0000","last_undegraded":"2023-10-09T11:59:22.906910+0000","last_fullsized":"2023-10-09T11:59:22.906910+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:04.135105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"123'6","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.323695+0000","last_change":"2023-10-09T11:59:21.896611+0000","last_active":"2023-10-09T11:59:23.323695+0000","last_peered":"2023-10-09T11:59:23.323695+0000","last_clean":"2023-10-09T11:59:23.323695+0000","last_became_active":"2023-10-09T11:59:21.896354+0000","last_became_peered":"2023-10-09T11:59:21.896354+0000","last_unstale":"2023-10-09T11:59:23.323695+0000","last_undegraded":"2023-10-09T11:59:23.323695+0000","last_fullsized":"2023-10-09T11:59:23.323695+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:48.769456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909149+0000","last_change":"2023-10-09T11:59:22.906811+0000","last_active":"2023-10-09T11:59:22.909149+0000","last_peered":"2023-10-09T11:59:22.909149+0000","last_clean":"2023-10-09T11:59:22.909149+0000","last_became_active":"2023-10-09T11:59:22.906542+0000","last_became_peered":"2023-10-09T11:59:22.906542+0000","last_unstale":"2023-10-09T11:59:22.909149+0000","last_undegraded":"2023-10-09T11:59:22.909149+0000","last_fullsized":"2023-10-09T11:59:22.909149+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:58.847065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.320969+0000","last_change":"2023-10-09T11:59:21.898356+0000","last_active":"2023-10-09T11:59:23.320969+0000","last_peered":"2023-10-09T11:59:23.320969+0000","last_clean":"2023-10-09T11:59:23.320969+0000","last_became_active":"2023-10-09T11:59:21.898085+0000","last_became_peered":"2023-10-09T11:59:21.898085+0000","last_unstale":"2023-10-09T11:59:23.320969+0000","last_undegraded":"2023-10-09T11:59:23.320969+0000","last_fullsized":"2023-10-09T11:59:23.320969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:34.234671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.899441+0000","last_change":"2023-10-09T11:59:22.892400+0000","last_active":"2023-10-09T11:59:22.899441+0000","last_peered":"2023-10-09T11:59:22.899441+0000","last_clean":"2023-10-09T11:59:22.899441+0000","last_became_active":"2023-10-09T11:59:22.892147+0000","last_became_peered":"2023-10-09T11:59:22.892147+0000","last_unstale":"2023-10-09T11:59:22.899441+0000","last_undegraded":"2023-10-09T11:59:22.899441+0000","last_fullsized":"2023-10-09T11:59:22.899441+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:13.316545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.888112+0000","last_change":"2023-10-09T11:59:21.904933+0000","last_active":"2023-10-09T11:59:22.888112+0000","last_peered":"2023-10-09T11:59:22.888112+0000","last_clean":"2023-10-09T11:59:22.888112+0000","last_became_active":"2023-10-09T11:59:21.904685+0000","last_became_peered":"2023-10-09T11:59:21.904685+0000","last_unstale":"2023-10-09T11:59:22.888112+0000","last_undegraded":"2023-10-09T11:59:22.888112+0000","last_fullsized":"2023-10-09T11:59:22.888112+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:25.800611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901357+0000","last_change":"2023-10-09T11:59:22.893710+0000","last_active":"2023-10-09T11:59:22.901357+0000","last_peered":"2023-10-09T11:59:22.901357+0000","last_clean":"2023-10-09T11:59:22.901357+0000","last_became_active":"2023-10-09T11:59:22.892676+0000","last_became_peered":"2023-10-09T11:59:22.892676+0000","last_unstale":"2023-10-09T11:59:22.901357+0000","last_undegraded":"2023-10-09T11:59:22.901357+0000","last_fullsized":"2023-10-09T11:59:22.901357+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:10.981347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886051+0000","last_change":"2023-10-09T11:59:21.895867+0000","last_active":"2023-10-09T11:59:22.886051+0000","last_peered":"2023-10-09T11:59:22.886051+0000","last_clean":"2023-10-09T11:59:22.886051+0000","last_became_active":"2023-10-09T11:59:21.895594+0000","last_became_peered":"2023-10-09T11:59:21.895594+0000","last_unstale":"2023-10-09T11:59:22.886051+0000","last_undegraded":"2023-10-09T11:59:22.886051+0000","last_fullsized":"2023-10-09T11:59:22.886051+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:35.435479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898583+0000","last_change":"2023-10-09T11:59:22.897433+0000","last_active":"2023-10-09T11:59:22.898583+0000","last_peered":"2023-10-09T11:59:22.898583+0000","last_clean":"2023-10-09T11:59:22.898583+0000","last_became_active":"2023-10-09T11:59:22.897194+0000","last_became_peered":"2023-10-09T11:59:22.897194+0000","last_unstale":"2023-10-09T11:59:22.898583+0000","last_undegraded":"2023-10-09T11:59:22.898583+0000","last_fullsized":"2023-10-09T11:59:22.898583+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:50.237275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"123'8","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.321169+0000","last_change":"2023-10-09T11:59:21.897245+0000","last_active":"2023-10-09T11:59:23.321169+0000","last_peered":"2023-10-09T11:59:23.321169+0000","last_clean":"2023-10-09T11:59:23.321169+0000","last_became_active":"2023-10-09T11:59:21.896974+0000","last_became_peered":"2023-10-09T11:59:21.896974+0000","last_unstale":"2023-10-09T11:59:23.321169+0000","last_undegraded":"2023-10-09T11:59:23.321169+0000","last_fullsized":"2023-10-09T11:59:23.321169+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:00.079787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906998+0000","last_change":"2023-10-09T11:59:22.903729+0000","last_active":"2023-10-09T11:59:22.906998+0000","last_peered":"2023-10-09T11:59:22.906998+0000","last_clean":"2023-10-09T11:59:22.906998+0000","last_became_active":"2023-10-09T11:59:22.902914+0000","last_became_peered":"2023-10-09T11:59:22.902914+0000","last_unstale":"2023-10-09T11:59:22.906998+0000","last_undegraded":"2023-10-09T11:59:22.906998+0000","last_fullsized":"2023-10-09T11:59:22.906998+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:22.340560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.316706+0000","last_change":"2023-10-09T11:59:21.898564+0000","last_active":"2023-10-09T11:59:23.316706+0000","last_peered":"2023-10-09T11:59:23.316706+0000","last_clean":"2023-10-09T11:59:23.316706+0000","last_became_active":"2023-10-09T11:59:21.898305+0000","last_became_peered":"2023-10-09T11:59:21.898305+0000","last_unstale":"2023-10-09T11:59:23.316706+0000","last_undegraded":"2023-10-09T11:59:23.316706+0000","last_fullsized":"2023-10-09T11:59:23.316706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:32.939900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897932+0000","last_change":"2023-10-09T11:59:22.895319+0000","last_active":"2023-10-09T11:59:22.897932+0000","last_peered":"2023-10-09T11:59:22.897932+0000","last_clean":"2023-10-09T11:59:22.897932+0000","last_became_active":"2023-10-09T11:59:22.894533+0000","last_became_peered":"2023-10-09T11:59:22.894533+0000","last_unstale":"2023-10-09T11:59:22.897932+0000","last_undegraded":"2023-10-09T11:59:22.897932+0000","last_fullsized":"2023-10-09T11:59:22.897932+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:49.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317284+0000","last_change":"2023-10-09T11:59:21.895156+0000","last_active":"2023-10-09T11:59:23.317284+0000","last_peered":"2023-10-09T11:59:23.317284+0000","last_clean":"2023-10-09T11:59:23.317284+0000","last_became_active":"2023-10-09T11:59:21.894743+0000","last_became_peered":"2023-10-09T11:59:21.894743+0000","last_unstale":"2023-10-09T11:59:23.317284+0000","last_undegraded":"2023-10-09T11:59:23.317284+0000","last_fullsized":"2023-10-09T11:59:23.317284+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:23.087450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907042+0000","last_change":"2023-10-09T11:59:22.904354+0000","last_active":"2023-10-09T11:59:22.907042+0000","last_peered":"2023-10-09T11:59:22.907042+0000","last_clean":"2023-10-09T11:59:22.907042+0000","last_became_active":"2023-10-09T11:59:22.903594+0000","last_became_peered":"2023-10-09T11:59:22.903594+0000","last_unstale":"2023-10-09T11:59:22.907042+0000","last_undegraded":"2023-10-09T11:59:22.907042+0000","last_fullsized":"2023-10-09T11:59:22.907042+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:01.935110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886796+0000","last_change":"2023-10-09T11:59:21.900553+0000","last_active":"2023-10-09T11:59:22.886796+0000","last_peered":"2023-10-09T11:59:22.886796+0000","last_clean":"2023-10-09T11:59:22.886796+0000","last_became_active":"2023-10-09T11:59:21.900078+0000","last_became_peered":"2023-10-09T11:59:21.900078+0000","last_unstale":"2023-10-09T11:59:22.886796+0000","last_undegraded":"2023-10-09T11:59:22.886796+0000","last_fullsized":"2023-10-09T11:59:22.886796+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:12.088577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.904718+0000","last_change":"2023-10-09T11:59:22.900058+0000","last_active":"2023-10-09T11:59:22.904718+0000","last_peered":"2023-10-09T11:59:22.904718+0000","last_clean":"2023-10-09T11:59:22.904718+0000","last_became_active":"2023-10-09T11:59:22.899817+0000","last_became_peered":"2023-10-09T11:59:22.899817+0000","last_unstale":"2023-10-09T11:59:22.904718+0000","last_undegraded":"2023-10-09T11:59:22.904718+0000","last_fullsized":"2023-10-09T11:59:22.904718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:44.901393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318798+0000","last_change":"2023-10-09T11:59:21.901883+0000","last_active":"2023-10-09T11:59:23.318798+0000","last_peered":"2023-10-09T11:59:23.318798+0000","last_clean":"2023-10-09T11:59:23.318798+0000","last_became_active":"2023-10-09T11:59:21.901642+0000","last_became_peered":"2023-10-09T11:59:21.901642+0000","last_unstale":"2023-10-09T11:59:23.318798+0000","last_undegraded":"2023-10-09T11:59:23.318798+0000","last_fullsized":"2023-10-09T11:59:23.318798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:32.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905056+0000","last_change":"2023-10-09T11:59:22.901037+0000","last_active":"2023-10-09T11:59:22.905056+0000","last_peered":"2023-10-09T11:59:22.905056+0000","last_clean":"2023-10-09T11:59:22.905056+0000","last_became_active":"2023-10-09T11:59:22.900594+0000","last_became_peered":"2023-10-09T11:59:22.900594+0000","last_unstale":"2023-10-09T11:59:22.905056+0000","last_undegraded":"2023-10-09T11:59:22.905056+0000","last_fullsized":"2023-10-09T11:59:22.905056+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:33.265874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886285+0000","last_change":"2023-10-09T11:59:21.904396+0000","last_active":"2023-10-09T11:59:22.886285+0000","last_peered":"2023-10-09T11:59:22.886285+0000","last_clean":"2023-10-09T11:59:22.886285+0000","last_became_active":"2023-10-09T11:59:21.904061+0000","last_became_peered":"2023-10-09T11:59:21.904061+0000","last_unstale":"2023-10-09T11:59:22.886285+0000","last_undegraded":"2023-10-09T11:59:22.886285+0000","last_fullsized":"2023-10-09T11:59:22.886285+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:48.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907163+0000","last_change":"2023-10-09T11:59:22.899430+0000","last_active":"2023-10-09T11:59:22.907163+0000","last_peered":"2023-10-09T11:59:22.907163+0000","last_clean":"2023-10-09T11:59:22.907163+0000","last_became_active":"2023-10-09T11:59:22.899176+0000","last_became_peered":"2023-10-09T11:59:22.899176+0000","last_unstale":"2023-10-09T11:59:22.907163+0000","last_undegraded":"2023-10-09T11:59:22.907163+0000","last_fullsized":"2023-10-09T11:59:22.907163+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:43.512347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.885554+0000","last_change":"2023-10-09T11:59:21.898011+0000","last_active":"2023-10-09T11:59:22.885554+0000","last_peered":"2023-10-09T11:59:22.885554+0000","last_clean":"2023-10-09T11:59:22.885554+0000","last_became_active":"2023-10-09T11:59:21.897265+0000","last_became_peered":"2023-10-09T11:59:21.897265+0000","last_unstale":"2023-10-09T11:59:22.885554+0000","last_undegraded":"2023-10-09T11:59:22.885554+0000","last_fullsized":"2023-10-09T11:59:22.885554+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:26.650081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905690+0000","last_change":"2023-10-09T11:59:22.901887+0000","last_active":"2023-10-09T11:59:22.905690+0000","last_peered":"2023-10-09T11:59:22.905690+0000","last_clean":"2023-10-09T11:59:22.905690+0000","last_became_active":"2023-10-09T11:59:22.901188+0000","last_became_peered":"2023-10-09T11:59:22.901188+0000","last_unstale":"2023-10-09T11:59:22.905690+0000","last_undegraded":"2023-10-09T11:59:22.905690+0000","last_fullsized":"2023-10-09T11:59:22.905690+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:08:33.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.887661+0000","last_change":"2023-10-09T11:59:21.894457+0000","last_active":"2023-10-09T11:59:22.887661+0000","last_peered":"2023-10-09T11:59:22.887661+0000","last_clean":"2023-10-09T11:59:22.887661+0000","last_became_active":"2023-10-09T11:59:21.894153+0000","last_became_peered":"2023-10-09T11:59:21.894153+0000","last_unstale":"2023-10-09T11:59:22.887661+0000","last_undegraded":"2023-10-09T11:59:22.887661+0000","last_fullsized":"2023-10-09T11:59:22.887661+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:27.766350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909059+0000","last_change":"2023-10-09T11:59:22.901059+0000","last_active":"2023-10-09T11:59:22.909059+0000","last_peered":"2023-10-09T11:59:22.909059+0000","last_clean":"2023-10-09T11:59:22.909059+0000","last_became_active":"2023-10-09T11:59:22.900776+0000","last_became_peered":"2023-10-09T11:59:22.900776+0000","last_unstale":"2023-10-09T11:59:22.909059+0000","last_undegraded":"2023-10-09T11:59:22.909059+0000","last_fullsized":"2023-10-09T11:59:22.909059+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:51.451677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318199+0000","last_change":"2023-10-09T11:59:21.891771+0000","last_active":"2023-10-09T11:59:23.318199+0000","last_peered":"2023-10-09T11:59:23.318199+0000","last_clean":"2023-10-09T11:59:23.318199+0000","last_became_active":"2023-10-09T11:59:21.891481+0000","last_became_peered":"2023-10-09T11:59:21.891481+0000","last_unstale":"2023-10-09T11:59:23.318199+0000","last_undegraded":"2023-10-09T11:59:23.318199+0000","last_fullsized":"2023-10-09T11:59:23.318199+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.231914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898702+0000","last_change":"2023-10-09T11:59:22.890792+0000","last_active":"2023-10-09T11:59:22.898702+0000","last_peered":"2023-10-09T11:59:22.898702+0000","last_clean":"2023-10-09T11:59:22.898702+0000","last_became_active":"2023-10-09T11:59:22.890537+0000","last_became_peered":"2023-10-09T11:59:22.890537+0000","last_unstale":"2023-10-09T11:59:22.898702+0000","last_undegraded":"2023-10-09T11:59:22.898702+0000","last_fullsized":"2023-10-09T11:59:22.898702+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:49.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.889833+0000","last_change":"2023-10-09T11:59:21.901277+0000","last_active":"2023-10-09T11:59:22.889833+0000","last_peered":"2023-10-09T11:59:22.889833+0000","last_clean":"2023-10-09T11:59:22.889833+0000","last_became_active":"2023-10-09T11:59:21.900998+0000","last_became_peered":"2023-10-09T11:59:21.900998+0000","last_unstale":"2023-10-09T11:59:22.889833+0000","last_undegraded":"2023-10-09T11:59:22.889833+0000","last_fullsized":"2023-10-09T11:59:22.889833+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:47.984329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901569+0000","last_change":"2023-10-09T11:59:22.895330+0000","last_active":"2023-10-09T11:59:22.901569+0000","last_peered":"2023-10-09T11:59:22.901569+0000","last_clean":"2023-10-09T11:59:22.901569+0000","last_became_active":"2023-10-09T11:59:22.895086+0000","last_became_peered":"2023-10-09T11:59:22.895086+0000","last_unstale":"2023-10-09T11:59:22.901569+0000","last_undegraded":"2023-10-09T11:59:22.901569+0000","last_fullsized":"2023-10-09T11:59:22.901569+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:28.307538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.887977+0000","last_change":"2023-10-09T11:59:21.899820+0000","last_active":"2023-10-09T11:59:22.887977+0000","last_peered":"2023-10-09T11:59:22.887977+0000","last_clean":"2023-10-09T11:59:22.887977+0000","last_became_active":"2023-10-09T11:59:21.896766+0000","last_became_peered":"2023-10-09T11:59:21.896766+0000","last_unstale":"2023-10-09T11:59:22.887977+0000","last_undegraded":"2023-10-09T11:59:22.887977+0000","last_fullsized":"2023-10-09T11:59:22.887977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:53.329451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905837+0000","last_change":"2023-10-09T11:59:22.900232+0000","last_active":"2023-10-09T11:59:22.905837+0000","last_peered":"2023-10-09T11:59:22.905837+0000","last_clean":"2023-10-09T11:59:22.905837+0000","last_became_active":"2023-10-09T11:59:22.899833+0000","last_became_peered":"2023-10-09T11:59:22.899833+0000","last_unstale":"2023-10-09T11:59:22.905837+0000","last_undegraded":"2023-10-09T11:59:22.905837+0000","last_fullsized":"2023-10-09T11:59:22.905837+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:25.553741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.891825+0000","last_change":"2023-10-09T11:59:21.895773+0000","last_active":"2023-10-09T11:59:22.891825+0000","last_peered":"2023-10-09T11:59:22.891825+0000","last_clean":"2023-10-09T11:59:22.891825+0000","last_became_active":"2023-10-09T11:59:21.895495+0000","last_became_peered":"2023-10-09T11:59:21.895495+0000","last_unstale":"2023-10-09T11:59:22.891825+0000","last_undegraded":"2023-10-09T11:59:22.891825+0000","last_fullsized":"2023-10-09T11:59:22.891825+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:55.957466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906526+0000","last_change":"2023-10-09T11:59:22.904444+0000","last_active":"2023-10-09T11:59:22.906526+0000","last_peered":"2023-10-09T11:59:22.906526+0000","last_clean":"2023-10-09T11:59:22.906526+0000","last_became_active":"2023-10-09T11:59:22.903873+0000","last_became_peered":"2023-10-09T11:59:22.903873+0000","last_unstale":"2023-10-09T11:59:22.906526+0000","last_undegraded":"2023-10-09T11:59:22.906526+0000","last_fullsized":"2023-10-09T11:59:22.906526+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:34.511535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.890168+0000","last_change":"2023-10-09T11:59:21.899633+0000","last_active":"2023-10-09T11:59:22.890168+0000","last_peered":"2023-10-09T11:59:22.890168+0000","last_clean":"2023-10-09T11:59:22.890168+0000","last_became_active":"2023-10-09T11:59:21.899358+0000","last_became_peered":"2023-10-09T11:59:21.899358+0000","last_unstale":"2023-10-09T11:59:22.890168+0000","last_undegraded":"2023-10-09T11:59:22.890168+0000","last_fullsized":"2023-10-09T11:59:22.890168+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:59.069640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.903506+0000","last_change":"2023-10-09T11:59:22.897551+0000","last_active":"2023-10-09T11:59:22.903506+0000","last_peered":"2023-10-09T11:59:22.903506+0000","last_clean":"2023-10-09T11:59:22.903506+0000","last_became_active":"2023-10-09T11:59:22.896912+0000","last_became_peered":"2023-10-09T11:59:22.896912+0000","last_unstale":"2023-10-09T11:59:22.903506+0000","last_undegraded":"2023-10-09T11:59:22.903506+0000","last_fullsized":"2023-10-09T11:59:22.903506+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:38.580883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.892130+0000","last_change":"2023-10-09T11:59:21.904361+0000","last_active":"2023-10-09T11:59:22.892130+0000","last_peered":"2023-10-09T11:59:22.892130+0000","last_clean":"2023-10-09T11:59:22.892130+0000","last_became_active":"2023-10-09T11:59:21.904060+0000","last_became_peered":"2023-10-09T11:59:21.904060+0000","last_unstale":"2023-10-09T11:59:22.892130+0000","last_undegraded":"2023-10-09T11:59:22.892130+0000","last_fullsized":"2023-10-09T11:59:22.892130+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:27.834968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898445+0000","last_change":"2023-10-09T11:59:22.896851+0000","last_active":"2023-10-09T11:59:22.898445+0000","last_peered":"2023-10-09T11:59:22.898445+0000","last_clean":"2023-10-09T11:59:22.898445+0000","last_became_active":"2023-10-09T11:59:22.896582+0000","last_became_peered":"2023-10-09T11:59:22.896582+0000","last_unstale":"2023-10-09T11:59:22.898445+0000","last_undegraded":"2023-10-09T11:59:22.898445+0000","last_fullsized":"2023-10-09T11:59:22.898445+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:40.629884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.892919+0000","last_change":"2023-10-09T11:59:21.904306+0000","last_active":"2023-10-09T11:59:22.892919+0000","last_peered":"2023-10-09T11:59:22.892919+0000","last_clean":"2023-10-09T11:59:22.892919+0000","last_became_active":"2023-10-09T11:59:21.903989+0000","last_became_peered":"2023-10-09T11:59:21.903989+0000","last_unstale":"2023-10-09T11:59:22.892919+0000","last_undegraded":"2023-10-09T11:59:22.892919+0000","last_fullsized":"2023-10-09T11:59:22.892919+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:44.715609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905673+0000","last_change":"2023-10-09T11:59:22.899459+0000","last_active":"2023-10-09T11:59:22.905673+0000","last_peered":"2023-10-09T11:59:22.905673+0000","last_clean":"2023-10-09T11:59:22.905673+0000","last_became_active":"2023-10-09T11:59:22.899200+0000","last_became_peered":"2023-10-09T11:59:22.899200+0000","last_unstale":"2023-10-09T11:59:22.905673+0000","last_undegraded":"2023-10-09T11:59:22.905673+0000","last_fullsized":"2023-10-09T11:59:22.905673+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:22.498734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886737+0000","last_change":"2023-10-09T11:59:21.902851+0000","last_active":"2023-10-09T11:59:22.886737+0000","last_peered":"2023-10-09T11:59:22.886737+0000","last_clean":"2023-10-09T11:59:22.886737+0000","last_became_active":"2023-10-09T11:59:21.902603+0000","last_became_peered":"2023-10-09T11:59:21.902603+0000","last_unstale":"2023-10-09T11:59:22.886737+0000","last_undegraded":"2023-10-09T11:59:22.886737+0000","last_fullsized":"2023-10-09T11:59:22.886737+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:15.642619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905148+0000","last_change":"2023-10-09T11:59:22.899440+0000","last_active":"2023-10-09T11:59:22.905148+0000","last_peered":"2023-10-09T11:59:22.905148+0000","last_clean":"2023-10-09T11:59:22.905148+0000","last_became_active":"2023-10-09T11:59:22.899189+0000","last_became_peered":"2023-10-09T11:59:22.899189+0000","last_unstale":"2023-10-09T11:59:22.905148+0000","last_undegraded":"2023-10-09T11:59:22.905148+0000","last_fullsized":"2023-10-09T11:59:22.905148+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:27.185151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.315874+0000","last_change":"2023-10-09T11:59:21.898827+0000","last_active":"2023-10-09T11:59:23.315874+0000","last_peered":"2023-10-09T11:59:23.315874+0000","last_clean":"2023-10-09T11:59:23.315874+0000","last_became_active":"2023-10-09T11:59:21.898448+0000","last_became_peered":"2023-10-09T11:59:21.898448+0000","last_unstale":"2023-10-09T11:59:23.315874+0000","last_undegraded":"2023-10-09T11:59:23.315874+0000","last_fullsized":"2023-10-09T11:59:23.315874+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:12.840602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"113'227","reported_seq":637,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.894256+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:59:22.894256+0000","last_peered":"2023-10-09T11:59:22.894256+0000","last_clean":"2023-10-09T11:59:22.894256+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:59:22.894256+0000","last_undegraded":"2023-10-09T11:59:22.894256+0000","last_fullsized":"2023-10-09T11:59:22.894256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476951,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303456,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068384,"statfs":{"total":96636764160,"available":96326025216,"internally_reserved":0,"allocated":2121728,"data_stored":1331411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":0.98399999999999999},"last":0.498}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.754},"min":{"1min":0.63500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.56999999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66400000000000003,"15min":0.70299999999999996},"min":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79800000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89100000000000001,"5min":1.0209999999999999,"15min":1.048},"last":0.58199999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68999999999999995,"15min":0.72399999999999998},"min":{"1min":0.59399999999999997,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.82299999999999995,"5min":0.98899999999999999,"15min":1.073},"last":0.70399999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.85999999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.625},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.55300000000000005,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.111,"15min":1.111},"last":0.64200000000000002}]}]},{"osd":6,"up_from":16,"seq":68719476952,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302876,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068964,"statfs":{"total":96636764160,"available":96326619136,"internally_reserved":0,"allocated":1527808,"data_stored":741555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67500000000000004,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.0629999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67700000000000005,"15min":0.73499999999999999},"min":{"1min":0.47599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.71299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90100000000000002,"5min":0.98999999999999999,"15min":1.121},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":1.0049999999999999,"15min":1.216},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.92800000000000005,"5min":0.98799999999999999,"15min":1.139},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.73699999999999999},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":1.0009999999999999,"15min":1.278},"last":0.70499999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.749},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":1.042,"15min":1.1040000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.875,"5min":0.94699999999999995,"15min":1.244},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.1060000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88900000000000001,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":1.143},"last":0.621},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86699999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98999999999999999,"5min":1.03,"15min":1.327},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.72299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509656,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302868,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068972,"statfs":{"total":96636764160,"available":96326627328,"internally_reserved":0,"allocated":1519616,"data_stored":740931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.46300000000000002},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":1.0580000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.61399999999999999,"5min":1.079,"15min":1.079},"last":0.49399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.504},"min":{"1min":0.32700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57499999999999996,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.76800000000000002,"15min":1.099},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.65400000000000003,"5min":1.044,"15min":1.1779999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":1.046},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73099999999999998,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0029999999999999,"5min":1.143,"15min":1.7210000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93899999999999995,"5min":1.0660000000000001,"15min":1.552},"last":0.69999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74399999999999999,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0740000000000001,"5min":1.202,"15min":1.677},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76500000000000001,"15min":0.81000000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.103,"15min":1.778},"last":0.91600000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.80400000000000005},"min":{"1min":0.64500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.623},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.708},"last":0.80100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.659},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.83399999999999996},"min":{"1min":0.60399999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.736},"last":0.83799999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542359,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":1331853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.219},"max":{"1min":1.012,"5min":1.012,"15min":1.0740000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":2.097,"15min":2.097},"last":0.441},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32500000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.45700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.1699999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1699999999999999,"5min":1.587,"15min":1.587},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78000000000000003,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0860000000000001,"5min":1.389,"15min":1.389},"last":0.72799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1739999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.749},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76700000000000002,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1339999999999999,"5min":1.1899999999999999,"15min":1.2709999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.113,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.71399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542359,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306968,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064872,"statfs":{"total":96636764160,"available":96322428928,"internally_reserved":0,"allocated":1523712,"data_stored":740965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.46400000000000002},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78000000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.499,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.60099999999999998,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.876,"15min":0.876},"last":0.44400000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":1.095,"15min":1.1839999999999999},"last":0.871},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.014,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.79700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":1.0649999999999999,"15min":1.2629999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0449999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.216},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.204},"last":0.88900000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.153,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79200000000000004,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.111,"5min":1.111,"15min":1.155},"last":0.83699999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509656,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306980,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064860,"statfs":{"total":96636764160,"available":96322416640,"internally_reserved":0,"allocated":1536000,"data_stored":742489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68100000000000005,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.47199999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.876},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.68500000000000005,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.60499999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.435}]},{"osd":4,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.57199999999999995,"5min":0.55800000000000005,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":1.208,"15min":1.327},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":0.83699999999999997},"min":{"1min":0.622,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1679999999999999,"5min":1.252,"15min":1.2689999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.246,"15min":1.252},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.41299999999999998},"max":{"1min":1.0780000000000001,"5min":1.234,"15min":1.3660000000000001},"last":0.879}]},{"osd":6,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.97499999999999998,"5min":1.1240000000000001,"15min":1.218},"last":0.81200000000000006}]},{"osd":7,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46999999999999997},"max":{"1min":0.996,"5min":1.25,"15min":1.333},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0640000000000001,"5min":1.194,"15min":1.3560000000000001},"last":0.84699999999999998}]}]},{"osd":4,"up_from":16,"seq":68719476951,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311080,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060760,"statfs":{"total":96636764160,"available":96318218240,"internally_reserved":0,"allocated":1540096,"data_stored":742591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69299999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.38,"15min":0.38},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.71999999999999997},"min":{"1min":0.57699999999999996,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.98199999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.501}]},{"osd":1,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":1.091},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.629,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.014,"5min":1.587,"15min":1.587},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.97099999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.59699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.54400000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.367,"15min":1.367},"last":0.754},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.93600000000000005,"5min":1.613,"15min":1.613},"last":0.80700000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80300000000000005,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.484,"15min":1.484},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95999999999999996,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":16,"seq":68719476951,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1523712,"data_stored":741001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.71199999999999997},"min":{"1min":0.52800000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.52000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":1.014,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.83699999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65400000000000003,"15min":0.69799999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.0840000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69099999999999995,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.909,"15min":1.909},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.046,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.876}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71599999999999997,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99199999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.86399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.83099999999999996,"5min":2.105,"15min":2.105},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.92900000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.82199999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.753},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.76800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:59:32.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:59:32.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.658+0000 7fa9967ff700 1 Processor -- start 2023-10-09T11:59:32.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.658+0000 7fa9967ff700 1 -- start start 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.659+0000 7fa9967ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa990159c10 0x7fa99015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.659+0000 7fa9967ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9900b5ea0 0x7fa990068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.659+0000 7fa9967ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99015c480 con 0x7fa990068bb0 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.659+0000 7fa9967ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9900b2a40 con 0x7fa9900b5ea0 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.659+0000 7fa9967ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99015b5d0 con 0x7fa990159c10 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.659+0000 7fa98f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9900b5ea0 0x7fa990068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9900b5ea0 0x7fa990068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39106/0 (socket says 172.21.15.86:39106) 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98f7fe700 1 -- 172.21.15.86:0/748139262 learned_addr learned my addr 172.21.15.86:0/748139262 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98ffff700 1 --2- 172.21.15.86:0/748139262 >> v2:172.21.15.135:3300/0 conn(0x7fa990159c10 0x7fa99015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98f7fe700 1 -- 172.21.15.86:0/748139262 >> v2:172.21.15.135:3300/0 conn(0x7fa990159c10 msgr2=0x7fa99015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98f7fe700 1 --2- 172.21.15.86:0/748139262 >> v2:172.21.15.135:3300/0 conn(0x7fa990159c10 0x7fa99015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98f7fe700 1 -- 172.21.15.86:0/748139262 >> v1:172.21.15.135:6789/0 conn(0x7fa990068bb0 legacy=0x7fa99015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98f7fe700 1 -- 172.21.15.86:0/748139262 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99015b870 con 0x7fa9900b5ea0 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.660+0000 7fa98f7fe700 1 --2- 172.21.15.86:0/748139262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9900b5ea0 0x7fa990068670 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fa990099f10 tx=0x7fa984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a08d90b8da2095e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa98effd700 1 -- 172.21.15.86:0/748139262 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400b860 con 0x7fa9900b5ea0 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa98effd700 1 -- 172.21.15.86:0/748139262 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400b9c0 con 0x7fa9900b5ea0 2023-10-09T11:59:32.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa98effd700 1 -- 172.21.15.86:0/748139262 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400bd60 con 0x7fa9900b5ea0 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 -- 172.21.15.86:0/748139262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9900b5ea0 msgr2=0x7fa990068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 --2- 172.21.15.86:0/748139262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9900b5ea0 0x7fa990068670 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fa990099f10 tx=0x7fa984009250 comp rx=0 tx=0).stop 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 -- 172.21.15.86:0/748139262 shutdown_connections 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 --2- 172.21.15.86:0/748139262 >> v2:172.21.15.135:3300/0 conn(0x7fa990159c10 0x7fa99015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 --2- 172.21.15.86:0/748139262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9900b5ea0 0x7fa990068670 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 -- 172.21.15.86:0/748139262 >> 172.21.15.86:0/748139262 conn(0x7fa990099a20 msgr2=0x7fa9900af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 -- 172.21.15.86:0/748139262 shutdown_connections 2023-10-09T11:59:32.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.661+0000 7fa9967ff700 1 -- 172.21.15.86:0/748139262 wait complete. 2023-10-09T11:59:32.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.663+0000 7fa9967ff700 1 Processor -- start 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.663+0000 7fa9967ff700 1 -- start start 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa9967ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990068bb0 0x7fa9900aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa9967ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b5ea0 0x7fa9900c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa9967ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa990159c10 0x7fa990158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa9967ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900af420 con 0x7fa990159c10 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa9967ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99016ac00 con 0x7fa990068bb0 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa9967ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99016a770 con 0x7fa9900b5ea0 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa994d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa990159c10 0x7fa990158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa98ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990068bb0 0x7fa9900aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:32.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa994d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa990159c10 0x7fa990158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39118/0 (socket says 172.21.15.86:39118) 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa98ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990068bb0 0x7fa9900aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:35938/0 (socket says 172.21.15.86:35938) 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa994d9c700 1 -- 172.21.15.86:0/1238308761 learned_addr learned my addr 172.21.15.86:0/1238308761 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.664+0000 7fa98f7fe700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b5ea0 0x7fa9900c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa994d9c700 1 -- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b5ea0 msgr2=0x7fa9900c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa994d9c700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b5ea0 0x7fa9900c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa994d9c700 1 -- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990068bb0 msgr2=0x7fa9900aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa994d9c700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990068bb0 0x7fa9900aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa994d9c700 1 -- 172.21.15.86:0/1238308761 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840094f0 con 0x7fa990159c10 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa98ffff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990068bb0 0x7fa9900aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:32.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa994d9c700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa990159c10 0x7fa990158760 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c910 tx=0x7fa988001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa977fff700 1 -- 172.21.15.86:0/1238308761 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988012630 con 0x7fa990159c10 2023-10-09T11:59:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa977fff700 1 -- 172.21.15.86:0/1238308761 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988012790 con 0x7fa990159c10 2023-10-09T11:59:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa990169bd0 con 0x7fa990159c10 2023-10-09T11:59:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa977fff700 1 -- 172.21.15.86:0/1238308761 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988012b50 con 0x7fa990159c10 2023-10-09T11:59:32.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.665+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa990169e40 con 0x7fa990159c10 2023-10-09T11:59:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.666+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99004c3c0 con 0x7fa990159c10 2023-10-09T11:59:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.667+0000 7fa977fff700 1 -- 172.21.15.86:0/1238308761 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa98801a3a0 con 0x7fa990159c10 2023-10-09T11:59:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.668+0000 7fa977fff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa97c066f30 0x7fa97c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.668+0000 7fa977fff700 1 -- 172.21.15.86:0/1238308761 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fa988084940 con 0x7fa990159c10 2023-10-09T11:59:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.668+0000 7fa98ffff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa97c066f30 0x7fa97c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:32.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.669+0000 7fa98ffff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa97c066f30 0x7fa97c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa980006fd0 tx=0x7fa980008040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:32.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.672+0000 7fa977fff700 1 -- 172.21.15.86:0/1238308761 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa988051990 con 0x7fa990159c10 2023-10-09T11:59:32.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.858+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa99016a8b0 con 0x7fa97c066f30 2023-10-09T11:59:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.866+0000 7fa977fff700 1 -- 172.21.15.86:0/1238308761 <== mgr.7479 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289208 (secure 0 0 0) 0x7fa99016a8b0 con 0x7fa97c066f30 2023-10-09T11:59:32.870 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa97c066f30 msgr2=0x7fa97c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa97c066f30 0x7fa97c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa980006fd0 tx=0x7fa980008040 comp rx=0 tx=0).stop 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa990159c10 msgr2=0x7fa990158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa990159c10 0x7fa990158760 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c910 tx=0x7fa988001710 comp rx=0 tx=0).stop 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 shutdown_connections 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa97c066f30 0x7fa97c0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa990159c10 0x7fa990158760 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa990068bb0 0x7fa9900aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 --2- 172.21.15.86:0/1238308761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9900b5ea0 0x7fa9900c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:32.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 >> 172.21.15.86:0/1238308761 conn(0x7fa990099a20 msgr2=0x7fa99009b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:32.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 shutdown_connections 2023-10-09T11:59:32.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:32.870+0000 7fa9967ff700 1 -- 172.21.15.86:0/1238308761 wait complete. 2023-10-09T11:59:32.874 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T11:59:32.888 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T11:59:32.848402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":404,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440552,"kb_used_data":13096,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752534168,"statfs":{"total":773094113280,"available":770594988032,"internally_reserved":0,"allocated":13410304,"data_stored":7112796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.966647"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.899416+0000","last_change":"2023-10-09T11:59:22.891013+0000","last_active":"2023-10-09T11:59:22.899416+0000","last_peered":"2023-10-09T11:59:22.899416+0000","last_clean":"2023-10-09T11:59:22.899416+0000","last_became_active":"2023-10-09T11:59:22.890710+0000","last_became_peered":"2023-10-09T11:59:22.890710+0000","last_unstale":"2023-10-09T11:59:22.899416+0000","last_undegraded":"2023-10-09T11:59:22.899416+0000","last_fullsized":"2023-10-09T11:59:22.899416+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:26.618275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909088+0000","last_change":"2023-10-09T11:59:22.901596+0000","last_active":"2023-10-09T11:59:22.909088+0000","last_peered":"2023-10-09T11:59:22.909088+0000","last_clean":"2023-10-09T11:59:22.909088+0000","last_became_active":"2023-10-09T11:59:22.901326+0000","last_became_peered":"2023-10-09T11:59:22.901326+0000","last_unstale":"2023-10-09T11:59:22.909088+0000","last_undegraded":"2023-10-09T11:59:22.909088+0000","last_fullsized":"2023-10-09T11:59:22.909088+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:37.453580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.899548+0000","last_change":"2023-10-09T11:59:22.891080+0000","last_active":"2023-10-09T11:59:22.899548+0000","last_peered":"2023-10-09T11:59:22.899548+0000","last_clean":"2023-10-09T11:59:22.899548+0000","last_became_active":"2023-10-09T11:59:22.890489+0000","last_became_peered":"2023-10-09T11:59:22.890489+0000","last_unstale":"2023-10-09T11:59:22.899548+0000","last_undegraded":"2023-10-09T11:59:22.899548+0000","last_fullsized":"2023-10-09T11:59:22.899548+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:49.812769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907326+0000","last_change":"2023-10-09T11:59:22.904619+0000","last_active":"2023-10-09T11:59:22.907326+0000","last_peered":"2023-10-09T11:59:22.907326+0000","last_clean":"2023-10-09T11:59:22.907326+0000","last_became_active":"2023-10-09T11:59:22.903794+0000","last_became_peered":"2023-10-09T11:59:22.903794+0000","last_unstale":"2023-10-09T11:59:22.907326+0000","last_undegraded":"2023-10-09T11:59:22.907326+0000","last_fullsized":"2023-10-09T11:59:22.907326+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:04.557214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905804+0000","last_change":"2023-10-09T11:59:22.898687+0000","last_active":"2023-10-09T11:59:22.905804+0000","last_peered":"2023-10-09T11:59:22.905804+0000","last_clean":"2023-10-09T11:59:22.905804+0000","last_became_active":"2023-10-09T11:59:22.898380+0000","last_became_peered":"2023-10-09T11:59:22.898380+0000","last_unstale":"2023-10-09T11:59:22.905804+0000","last_undegraded":"2023-10-09T11:59:22.905804+0000","last_fullsized":"2023-10-09T11:59:22.905804+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:00.962431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908101+0000","last_change":"2023-10-09T11:59:22.903620+0000","last_active":"2023-10-09T11:59:22.908101+0000","last_peered":"2023-10-09T11:59:22.908101+0000","last_clean":"2023-10-09T11:59:22.908101+0000","last_became_active":"2023-10-09T11:59:22.903353+0000","last_became_peered":"2023-10-09T11:59:22.903353+0000","last_unstale":"2023-10-09T11:59:22.908101+0000","last_undegraded":"2023-10-09T11:59:22.908101+0000","last_fullsized":"2023-10-09T11:59:22.908101+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:08:33.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907789+0000","last_change":"2023-10-09T11:59:22.900913+0000","last_active":"2023-10-09T11:59:22.907789+0000","last_peered":"2023-10-09T11:59:22.907789+0000","last_clean":"2023-10-09T11:59:22.907789+0000","last_became_active":"2023-10-09T11:59:22.900640+0000","last_became_peered":"2023-10-09T11:59:22.900640+0000","last_unstale":"2023-10-09T11:59:22.907789+0000","last_undegraded":"2023-10-09T11:59:22.907789+0000","last_fullsized":"2023-10-09T11:59:22.907789+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:21.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909005+0000","last_change":"2023-10-09T11:59:22.900591+0000","last_active":"2023-10-09T11:59:22.909005+0000","last_peered":"2023-10-09T11:59:22.909005+0000","last_clean":"2023-10-09T11:59:22.909005+0000","last_became_active":"2023-10-09T11:59:22.900312+0000","last_became_peered":"2023-10-09T11:59:22.900312+0000","last_unstale":"2023-10-09T11:59:22.909005+0000","last_undegraded":"2023-10-09T11:59:22.909005+0000","last_fullsized":"2023-10-09T11:59:22.909005+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:23.918094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902027+0000","last_change":"2023-10-09T11:59:22.899154+0000","last_active":"2023-10-09T11:59:22.902027+0000","last_peered":"2023-10-09T11:59:22.902027+0000","last_clean":"2023-10-09T11:59:22.902027+0000","last_became_active":"2023-10-09T11:59:22.898908+0000","last_became_peered":"2023-10-09T11:59:22.898908+0000","last_unstale":"2023-10-09T11:59:22.902027+0000","last_undegraded":"2023-10-09T11:59:22.902027+0000","last_fullsized":"2023-10-09T11:59:22.902027+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:59.162997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905889+0000","last_change":"2023-10-09T11:59:22.901554+0000","last_active":"2023-10-09T11:59:22.905889+0000","last_peered":"2023-10-09T11:59:22.905889+0000","last_clean":"2023-10-09T11:59:22.905889+0000","last_became_active":"2023-10-09T11:59:22.901098+0000","last_became_peered":"2023-10-09T11:59:22.901098+0000","last_unstale":"2023-10-09T11:59:22.905889+0000","last_undegraded":"2023-10-09T11:59:22.905889+0000","last_fullsized":"2023-10-09T11:59:22.905889+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:02.886945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907025+0000","last_change":"2023-10-09T11:59:22.904184+0000","last_active":"2023-10-09T11:59:22.907025+0000","last_peered":"2023-10-09T11:59:22.907025+0000","last_clean":"2023-10-09T11:59:22.907025+0000","last_became_active":"2023-10-09T11:59:22.903873+0000","last_became_peered":"2023-10-09T11:59:22.903873+0000","last_unstale":"2023-10-09T11:59:22.907025+0000","last_undegraded":"2023-10-09T11:59:22.907025+0000","last_fullsized":"2023-10-09T11:59:22.907025+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:32.674601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901302+0000","last_change":"2023-10-09T11:59:22.895153+0000","last_active":"2023-10-09T11:59:22.901302+0000","last_peered":"2023-10-09T11:59:22.901302+0000","last_clean":"2023-10-09T11:59:22.901302+0000","last_became_active":"2023-10-09T11:59:22.894854+0000","last_became_peered":"2023-10-09T11:59:22.894854+0000","last_unstale":"2023-10-09T11:59:22.901302+0000","last_undegraded":"2023-10-09T11:59:22.901302+0000","last_fullsized":"2023-10-09T11:59:22.901302+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:35.802855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908605+0000","last_change":"2023-10-09T11:59:22.906020+0000","last_active":"2023-10-09T11:59:22.908605+0000","last_peered":"2023-10-09T11:59:22.908605+0000","last_clean":"2023-10-09T11:59:22.908605+0000","last_became_active":"2023-10-09T11:59:22.905769+0000","last_became_peered":"2023-10-09T11:59:22.905769+0000","last_unstale":"2023-10-09T11:59:22.908605+0000","last_undegraded":"2023-10-09T11:59:22.908605+0000","last_fullsized":"2023-10-09T11:59:22.908605+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:28.774074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898954+0000","last_change":"2023-10-09T11:59:22.897637+0000","last_active":"2023-10-09T11:59:22.898954+0000","last_peered":"2023-10-09T11:59:22.898954+0000","last_clean":"2023-10-09T11:59:22.898954+0000","last_became_active":"2023-10-09T11:59:22.896845+0000","last_became_peered":"2023-10-09T11:59:22.896845+0000","last_unstale":"2023-10-09T11:59:22.898954+0000","last_undegraded":"2023-10-09T11:59:22.898954+0000","last_fullsized":"2023-10-09T11:59:22.898954+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:43.324604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906946+0000","last_change":"2023-10-09T11:59:22.903317+0000","last_active":"2023-10-09T11:59:22.906946+0000","last_peered":"2023-10-09T11:59:22.906946+0000","last_clean":"2023-10-09T11:59:22.906946+0000","last_became_active":"2023-10-09T11:59:22.903011+0000","last_became_peered":"2023-10-09T11:59:22.903011+0000","last_unstale":"2023-10-09T11:59:22.906946+0000","last_undegraded":"2023-10-09T11:59:22.906946+0000","last_fullsized":"2023-10-09T11:59:22.906946+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:33.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907010+0000","last_change":"2023-10-09T11:59:22.899760+0000","last_active":"2023-10-09T11:59:22.907010+0000","last_peered":"2023-10-09T11:59:22.907010+0000","last_clean":"2023-10-09T11:59:22.907010+0000","last_became_active":"2023-10-09T11:59:22.899376+0000","last_became_peered":"2023-10-09T11:59:22.899376+0000","last_unstale":"2023-10-09T11:59:22.907010+0000","last_undegraded":"2023-10-09T11:59:22.907010+0000","last_fullsized":"2023-10-09T11:59:22.907010+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:02.886945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908950+0000","last_change":"2023-10-09T11:59:22.899270+0000","last_active":"2023-10-09T11:59:22.908950+0000","last_peered":"2023-10-09T11:59:22.908950+0000","last_clean":"2023-10-09T11:59:22.908950+0000","last_became_active":"2023-10-09T11:59:22.899025+0000","last_became_peered":"2023-10-09T11:59:22.899025+0000","last_unstale":"2023-10-09T11:59:22.908950+0000","last_undegraded":"2023-10-09T11:59:22.908950+0000","last_fullsized":"2023-10-09T11:59:22.908950+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:54.039518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906793+0000","last_change":"2023-10-09T11:59:22.902015+0000","last_active":"2023-10-09T11:59:22.906793+0000","last_peered":"2023-10-09T11:59:22.906793+0000","last_clean":"2023-10-09T11:59:22.906793+0000","last_became_active":"2023-10-09T11:59:22.901763+0000","last_became_peered":"2023-10-09T11:59:22.901763+0000","last_unstale":"2023-10-09T11:59:22.906793+0000","last_undegraded":"2023-10-09T11:59:22.906793+0000","last_fullsized":"2023-10-09T11:59:22.906793+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:17.603222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897638+0000","last_change":"2023-10-09T11:59:22.895751+0000","last_active":"2023-10-09T11:59:22.897638+0000","last_peered":"2023-10-09T11:59:22.897638+0000","last_clean":"2023-10-09T11:59:22.897638+0000","last_became_active":"2023-10-09T11:59:22.895448+0000","last_became_peered":"2023-10-09T11:59:22.895448+0000","last_unstale":"2023-10-09T11:59:22.897638+0000","last_undegraded":"2023-10-09T11:59:22.897638+0000","last_fullsized":"2023-10-09T11:59:22.897638+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:10:01.652778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901323+0000","last_change":"2023-10-09T11:59:22.898463+0000","last_active":"2023-10-09T11:59:22.901323+0000","last_peered":"2023-10-09T11:59:22.901323+0000","last_clean":"2023-10-09T11:59:22.901323+0000","last_became_active":"2023-10-09T11:59:22.898133+0000","last_became_peered":"2023-10-09T11:59:22.898133+0000","last_unstale":"2023-10-09T11:59:22.901323+0000","last_undegraded":"2023-10-09T11:59:22.901323+0000","last_fullsized":"2023-10-09T11:59:22.901323+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:13.848325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906404+0000","last_change":"2023-10-09T11:59:22.901657+0000","last_active":"2023-10-09T11:59:22.906404+0000","last_peered":"2023-10-09T11:59:22.906404+0000","last_clean":"2023-10-09T11:59:22.906404+0000","last_became_active":"2023-10-09T11:59:22.901368+0000","last_became_peered":"2023-10-09T11:59:22.901368+0000","last_unstale":"2023-10-09T11:59:22.906404+0000","last_undegraded":"2023-10-09T11:59:22.906404+0000","last_fullsized":"2023-10-09T11:59:22.906404+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:10.785426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908981+0000","last_change":"2023-10-09T11:59:22.900149+0000","last_active":"2023-10-09T11:59:22.908981+0000","last_peered":"2023-10-09T11:59:22.908981+0000","last_clean":"2023-10-09T11:59:22.908981+0000","last_became_active":"2023-10-09T11:59:22.899896+0000","last_became_peered":"2023-10-09T11:59:22.899896+0000","last_unstale":"2023-10-09T11:59:22.908981+0000","last_undegraded":"2023-10-09T11:59:22.908981+0000","last_fullsized":"2023-10-09T11:59:22.908981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:22.922109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909048+0000","last_change":"2023-10-09T11:59:22.900789+0000","last_active":"2023-10-09T11:59:22.909048+0000","last_peered":"2023-10-09T11:59:22.909048+0000","last_clean":"2023-10-09T11:59:22.909048+0000","last_became_active":"2023-10-09T11:59:22.900517+0000","last_became_peered":"2023-10-09T11:59:22.900517+0000","last_unstale":"2023-10-09T11:59:22.909048+0000","last_undegraded":"2023-10-09T11:59:22.909048+0000","last_fullsized":"2023-10-09T11:59:22.909048+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:51.640810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908376+0000","last_change":"2023-10-09T11:59:22.906652+0000","last_active":"2023-10-09T11:59:22.908376+0000","last_peered":"2023-10-09T11:59:22.908376+0000","last_clean":"2023-10-09T11:59:22.908376+0000","last_became_active":"2023-10-09T11:59:22.906407+0000","last_became_peered":"2023-10-09T11:59:22.906407+0000","last_unstale":"2023-10-09T11:59:22.908376+0000","last_undegraded":"2023-10-09T11:59:22.908376+0000","last_fullsized":"2023-10-09T11:59:22.908376+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:47.317346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906095+0000","last_change":"2023-10-09T11:59:22.899296+0000","last_active":"2023-10-09T11:59:22.906095+0000","last_peered":"2023-10-09T11:59:22.906095+0000","last_clean":"2023-10-09T11:59:22.906095+0000","last_became_active":"2023-10-09T11:59:22.899033+0000","last_became_peered":"2023-10-09T11:59:22.899033+0000","last_unstale":"2023-10-09T11:59:22.906095+0000","last_undegraded":"2023-10-09T11:59:22.906095+0000","last_fullsized":"2023-10-09T11:59:22.906095+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:19.886451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909105+0000","last_change":"2023-10-09T11:59:22.901865+0000","last_active":"2023-10-09T11:59:22.909105+0000","last_peered":"2023-10-09T11:59:22.909105+0000","last_clean":"2023-10-09T11:59:22.909105+0000","last_became_active":"2023-10-09T11:59:22.900468+0000","last_became_peered":"2023-10-09T11:59:22.900468+0000","last_unstale":"2023-10-09T11:59:22.909105+0000","last_undegraded":"2023-10-09T11:59:22.909105+0000","last_fullsized":"2023-10-09T11:59:22.909105+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:33.487369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906888+0000","last_change":"2023-10-09T11:59:22.900009+0000","last_active":"2023-10-09T11:59:22.906888+0000","last_peered":"2023-10-09T11:59:22.906888+0000","last_clean":"2023-10-09T11:59:22.906888+0000","last_became_active":"2023-10-09T11:59:22.899667+0000","last_became_peered":"2023-10-09T11:59:22.899667+0000","last_unstale":"2023-10-09T11:59:22.906888+0000","last_undegraded":"2023-10-09T11:59:22.906888+0000","last_fullsized":"2023-10-09T11:59:22.906888+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:19.886451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905637+0000","last_change":"2023-10-09T11:59:22.901955+0000","last_active":"2023-10-09T11:59:22.905637+0000","last_peered":"2023-10-09T11:59:22.905637+0000","last_clean":"2023-10-09T11:59:22.905637+0000","last_became_active":"2023-10-09T11:59:22.900532+0000","last_became_peered":"2023-10-09T11:59:22.900532+0000","last_unstale":"2023-10-09T11:59:22.905637+0000","last_undegraded":"2023-10-09T11:59:22.905637+0000","last_fullsized":"2023-10-09T11:59:22.905637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:38.254692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909010+0000","last_change":"2023-10-09T11:59:22.898859+0000","last_active":"2023-10-09T11:59:22.909010+0000","last_peered":"2023-10-09T11:59:22.909010+0000","last_clean":"2023-10-09T11:59:22.909010+0000","last_became_active":"2023-10-09T11:59:22.898603+0000","last_became_peered":"2023-10-09T11:59:22.898603+0000","last_unstale":"2023-10-09T11:59:22.909010+0000","last_undegraded":"2023-10-09T11:59:22.909010+0000","last_fullsized":"2023-10-09T11:59:22.909010+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:45.631499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897677+0000","last_change":"2023-10-09T11:59:22.896333+0000","last_active":"2023-10-09T11:59:22.897677+0000","last_peered":"2023-10-09T11:59:22.897677+0000","last_clean":"2023-10-09T11:59:22.897677+0000","last_became_active":"2023-10-09T11:59:22.896090+0000","last_became_peered":"2023-10-09T11:59:22.896090+0000","last_unstale":"2023-10-09T11:59:22.897677+0000","last_undegraded":"2023-10-09T11:59:22.897677+0000","last_fullsized":"2023-10-09T11:59:22.897677+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:47.493048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907209+0000","last_change":"2023-10-09T11:59:22.905321+0000","last_active":"2023-10-09T11:59:22.907209+0000","last_peered":"2023-10-09T11:59:22.907209+0000","last_clean":"2023-10-09T11:59:22.907209+0000","last_became_active":"2023-10-09T11:59:22.905072+0000","last_became_peered":"2023-10-09T11:59:22.905072+0000","last_unstale":"2023-10-09T11:59:22.907209+0000","last_undegraded":"2023-10-09T11:59:22.907209+0000","last_fullsized":"2023-10-09T11:59:22.907209+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:18.566828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902624+0000","last_change":"2023-10-09T11:59:22.896651+0000","last_active":"2023-10-09T11:59:22.902624+0000","last_peered":"2023-10-09T11:59:22.902624+0000","last_clean":"2023-10-09T11:59:22.902624+0000","last_became_active":"2023-10-09T11:59:22.895837+0000","last_became_peered":"2023-10-09T11:59:22.895837+0000","last_unstale":"2023-10-09T11:59:22.902624+0000","last_undegraded":"2023-10-09T11:59:22.902624+0000","last_fullsized":"2023-10-09T11:59:22.902624+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:36.443202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901753+0000","last_change":"2023-10-09T11:59:22.898410+0000","last_active":"2023-10-09T11:59:22.901753+0000","last_peered":"2023-10-09T11:59:22.901753+0000","last_clean":"2023-10-09T11:59:22.901753+0000","last_became_active":"2023-10-09T11:59:22.898170+0000","last_became_peered":"2023-10-09T11:59:22.898170+0000","last_unstale":"2023-10-09T11:59:22.901753+0000","last_undegraded":"2023-10-09T11:59:22.901753+0000","last_fullsized":"2023-10-09T11:59:22.901753+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:43.043540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318961+0000","last_change":"2023-10-09T11:59:21.895946+0000","last_active":"2023-10-09T11:59:23.318961+0000","last_peered":"2023-10-09T11:59:23.318961+0000","last_clean":"2023-10-09T11:59:23.318961+0000","last_became_active":"2023-10-09T11:59:21.895693+0000","last_became_peered":"2023-10-09T11:59:21.895693+0000","last_unstale":"2023-10-09T11:59:23.318961+0000","last_undegraded":"2023-10-09T11:59:23.318961+0000","last_fullsized":"2023-10-09T11:59:23.318961+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:35.119233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.908632+0000","last_change":"2023-10-09T11:59:22.905862+0000","last_active":"2023-10-09T11:59:22.908632+0000","last_peered":"2023-10-09T11:59:22.908632+0000","last_clean":"2023-10-09T11:59:22.908632+0000","last_became_active":"2023-10-09T11:59:22.905608+0000","last_became_peered":"2023-10-09T11:59:22.905608+0000","last_unstale":"2023-10-09T11:59:22.908632+0000","last_undegraded":"2023-10-09T11:59:22.908632+0000","last_fullsized":"2023-10-09T11:59:22.908632+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:52.836467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.315355+0000","last_change":"2023-10-09T11:59:21.904525+0000","last_active":"2023-10-09T11:59:23.315355+0000","last_peered":"2023-10-09T11:59:23.315355+0000","last_clean":"2023-10-09T11:59:23.315355+0000","last_became_active":"2023-10-09T11:59:21.904230+0000","last_became_peered":"2023-10-09T11:59:21.904230+0000","last_unstale":"2023-10-09T11:59:23.315355+0000","last_undegraded":"2023-10-09T11:59:23.315355+0000","last_fullsized":"2023-10-09T11:59:23.315355+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.213975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898033+0000","last_change":"2023-10-09T11:59:22.889950+0000","last_active":"2023-10-09T11:59:22.898033+0000","last_peered":"2023-10-09T11:59:22.898033+0000","last_clean":"2023-10-09T11:59:22.898033+0000","last_became_active":"2023-10-09T11:59:22.889661+0000","last_became_peered":"2023-10-09T11:59:22.889661+0000","last_unstale":"2023-10-09T11:59:22.898033+0000","last_undegraded":"2023-10-09T11:59:22.898033+0000","last_fullsized":"2023-10-09T11:59:22.898033+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:27.657805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317015+0000","last_change":"2023-10-09T11:59:21.901287+0000","last_active":"2023-10-09T11:59:23.317015+0000","last_peered":"2023-10-09T11:59:23.317015+0000","last_clean":"2023-10-09T11:59:23.317015+0000","last_became_active":"2023-10-09T11:59:21.901039+0000","last_became_peered":"2023-10-09T11:59:21.901039+0000","last_unstale":"2023-10-09T11:59:23.317015+0000","last_undegraded":"2023-10-09T11:59:23.317015+0000","last_fullsized":"2023-10-09T11:59:23.317015+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:40.433627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902127+0000","last_change":"2023-10-09T11:59:22.900616+0000","last_active":"2023-10-09T11:59:22.902127+0000","last_peered":"2023-10-09T11:59:22.902127+0000","last_clean":"2023-10-09T11:59:22.902127+0000","last_became_active":"2023-10-09T11:59:22.900326+0000","last_became_peered":"2023-10-09T11:59:22.900326+0000","last_unstale":"2023-10-09T11:59:22.902127+0000","last_undegraded":"2023-10-09T11:59:22.902127+0000","last_fullsized":"2023-10-09T11:59:22.902127+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:19.946244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318693+0000","last_change":"2023-10-09T11:59:21.905670+0000","last_active":"2023-10-09T11:59:23.318693+0000","last_peered":"2023-10-09T11:59:23.318693+0000","last_clean":"2023-10-09T11:59:23.318693+0000","last_became_active":"2023-10-09T11:59:21.900408+0000","last_became_peered":"2023-10-09T11:59:21.900408+0000","last_unstale":"2023-10-09T11:59:23.318693+0000","last_undegraded":"2023-10-09T11:59:23.318693+0000","last_fullsized":"2023-10-09T11:59:23.318693+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:06.436123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897296+0000","last_change":"2023-10-09T11:59:22.891944+0000","last_active":"2023-10-09T11:59:22.897296+0000","last_peered":"2023-10-09T11:59:22.897296+0000","last_clean":"2023-10-09T11:59:22.897296+0000","last_became_active":"2023-10-09T11:59:22.891481+0000","last_became_peered":"2023-10-09T11:59:22.891481+0000","last_unstale":"2023-10-09T11:59:22.897296+0000","last_undegraded":"2023-10-09T11:59:22.897296+0000","last_fullsized":"2023-10-09T11:59:22.897296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:36.443202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317550+0000","last_change":"2023-10-09T11:59:21.898872+0000","last_active":"2023-10-09T11:59:23.317550+0000","last_peered":"2023-10-09T11:59:23.317550+0000","last_clean":"2023-10-09T11:59:23.317550+0000","last_became_active":"2023-10-09T11:59:21.898315+0000","last_became_peered":"2023-10-09T11:59:21.898315+0000","last_unstale":"2023-10-09T11:59:23.317550+0000","last_undegraded":"2023-10-09T11:59:23.317550+0000","last_fullsized":"2023-10-09T11:59:23.317550+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:28.008292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.904661+0000","last_change":"2023-10-09T11:59:22.898412+0000","last_active":"2023-10-09T11:59:22.904661+0000","last_peered":"2023-10-09T11:59:22.904661+0000","last_clean":"2023-10-09T11:59:22.904661+0000","last_became_active":"2023-10-09T11:59:22.898159+0000","last_became_peered":"2023-10-09T11:59:22.898159+0000","last_unstale":"2023-10-09T11:59:22.904661+0000","last_undegraded":"2023-10-09T11:59:22.904661+0000","last_fullsized":"2023-10-09T11:59:22.904661+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:16.343281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318991+0000","last_change":"2023-10-09T11:59:21.906491+0000","last_active":"2023-10-09T11:59:23.318991+0000","last_peered":"2023-10-09T11:59:23.318991+0000","last_clean":"2023-10-09T11:59:23.318991+0000","last_became_active":"2023-10-09T11:59:21.906179+0000","last_became_peered":"2023-10-09T11:59:21.906179+0000","last_unstale":"2023-10-09T11:59:23.318991+0000","last_undegraded":"2023-10-09T11:59:23.318991+0000","last_fullsized":"2023-10-09T11:59:23.318991+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:51.828744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906978+0000","last_change":"2023-10-09T11:59:22.902722+0000","last_active":"2023-10-09T11:59:22.906978+0000","last_peered":"2023-10-09T11:59:22.906978+0000","last_clean":"2023-10-09T11:59:22.906978+0000","last_became_active":"2023-10-09T11:59:22.902475+0000","last_became_peered":"2023-10-09T11:59:22.902475+0000","last_unstale":"2023-10-09T11:59:22.906978+0000","last_undegraded":"2023-10-09T11:59:22.906978+0000","last_fullsized":"2023-10-09T11:59:22.906978+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:07.443846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.890100+0000","last_change":"2023-10-09T11:59:21.899625+0000","last_active":"2023-10-09T11:59:22.890100+0000","last_peered":"2023-10-09T11:59:22.890100+0000","last_clean":"2023-10-09T11:59:22.890100+0000","last_became_active":"2023-10-09T11:59:21.899349+0000","last_became_peered":"2023-10-09T11:59:21.899349+0000","last_unstale":"2023-10-09T11:59:22.890100+0000","last_undegraded":"2023-10-09T11:59:22.890100+0000","last_fullsized":"2023-10-09T11:59:22.890100+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:33.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902057+0000","last_change":"2023-10-09T11:59:22.899926+0000","last_active":"2023-10-09T11:59:22.902057+0000","last_peered":"2023-10-09T11:59:22.902057+0000","last_clean":"2023-10-09T11:59:22.902057+0000","last_became_active":"2023-10-09T11:59:22.899620+0000","last_became_peered":"2023-10-09T11:59:22.899620+0000","last_unstale":"2023-10-09T11:59:22.902057+0000","last_undegraded":"2023-10-09T11:59:22.902057+0000","last_fullsized":"2023-10-09T11:59:22.902057+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:27.538047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.883415+0000","last_change":"2023-10-09T11:59:21.899285+0000","last_active":"2023-10-09T11:59:22.883415+0000","last_peered":"2023-10-09T11:59:22.883415+0000","last_clean":"2023-10-09T11:59:22.883415+0000","last_became_active":"2023-10-09T11:59:21.898978+0000","last_became_peered":"2023-10-09T11:59:21.898978+0000","last_unstale":"2023-10-09T11:59:22.883415+0000","last_undegraded":"2023-10-09T11:59:22.883415+0000","last_fullsized":"2023-10-09T11:59:22.883415+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:46:31.910577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898331+0000","last_change":"2023-10-09T11:59:22.897438+0000","last_active":"2023-10-09T11:59:22.898331+0000","last_peered":"2023-10-09T11:59:22.898331+0000","last_clean":"2023-10-09T11:59:22.898331+0000","last_became_active":"2023-10-09T11:59:22.897151+0000","last_became_peered":"2023-10-09T11:59:22.897151+0000","last_unstale":"2023-10-09T11:59:22.898331+0000","last_undegraded":"2023-10-09T11:59:22.898331+0000","last_fullsized":"2023-10-09T11:59:22.898331+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:17.892093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.884054+0000","last_change":"2023-10-09T11:59:21.897895+0000","last_active":"2023-10-09T11:59:22.884054+0000","last_peered":"2023-10-09T11:59:22.884054+0000","last_clean":"2023-10-09T11:59:22.884054+0000","last_became_active":"2023-10-09T11:59:21.897647+0000","last_became_peered":"2023-10-09T11:59:21.897647+0000","last_unstale":"2023-10-09T11:59:22.884054+0000","last_undegraded":"2023-10-09T11:59:22.884054+0000","last_fullsized":"2023-10-09T11:59:22.884054+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:20.186681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.902698+0000","last_change":"2023-10-09T11:59:22.901609+0000","last_active":"2023-10-09T11:59:22.902698+0000","last_peered":"2023-10-09T11:59:22.902698+0000","last_clean":"2023-10-09T11:59:22.902698+0000","last_became_active":"2023-10-09T11:59:22.901324+0000","last_became_peered":"2023-10-09T11:59:22.901324+0000","last_unstale":"2023-10-09T11:59:22.902698+0000","last_undegraded":"2023-10-09T11:59:22.902698+0000","last_fullsized":"2023-10-09T11:59:22.902698+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:22.028891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.894672+0000","last_change":"2023-10-09T11:59:21.896965+0000","last_active":"2023-10-09T11:59:22.894672+0000","last_peered":"2023-10-09T11:59:22.894672+0000","last_clean":"2023-10-09T11:59:22.894672+0000","last_became_active":"2023-10-09T11:59:21.896679+0000","last_became_peered":"2023-10-09T11:59:21.896679+0000","last_unstale":"2023-10-09T11:59:22.894672+0000","last_undegraded":"2023-10-09T11:59:22.894672+0000","last_fullsized":"2023-10-09T11:59:22.894672+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:35.394505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905770+0000","last_change":"2023-10-09T11:59:22.900874+0000","last_active":"2023-10-09T11:59:22.905770+0000","last_peered":"2023-10-09T11:59:22.905770+0000","last_clean":"2023-10-09T11:59:22.905770+0000","last_became_active":"2023-10-09T11:59:22.900080+0000","last_became_peered":"2023-10-09T11:59:22.900080+0000","last_unstale":"2023-10-09T11:59:22.905770+0000","last_undegraded":"2023-10-09T11:59:22.905770+0000","last_fullsized":"2023-10-09T11:59:22.905770+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:21.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"123'3","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317731+0000","last_change":"2023-10-09T11:59:21.895706+0000","last_active":"2023-10-09T11:59:23.317731+0000","last_peered":"2023-10-09T11:59:23.317731+0000","last_clean":"2023-10-09T11:59:23.317731+0000","last_became_active":"2023-10-09T11:59:21.895430+0000","last_became_peered":"2023-10-09T11:59:21.895430+0000","last_unstale":"2023-10-09T11:59:23.317731+0000","last_undegraded":"2023-10-09T11:59:23.317731+0000","last_fullsized":"2023-10-09T11:59:23.317731+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:36:55.629194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906910+0000","last_change":"2023-10-09T11:59:22.900145+0000","last_active":"2023-10-09T11:59:22.906910+0000","last_peered":"2023-10-09T11:59:22.906910+0000","last_clean":"2023-10-09T11:59:22.906910+0000","last_became_active":"2023-10-09T11:59:22.899502+0000","last_became_peered":"2023-10-09T11:59:22.899502+0000","last_unstale":"2023-10-09T11:59:22.906910+0000","last_undegraded":"2023-10-09T11:59:22.906910+0000","last_fullsized":"2023-10-09T11:59:22.906910+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:04.135105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"123'6","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.323695+0000","last_change":"2023-10-09T11:59:21.896611+0000","last_active":"2023-10-09T11:59:23.323695+0000","last_peered":"2023-10-09T11:59:23.323695+0000","last_clean":"2023-10-09T11:59:23.323695+0000","last_became_active":"2023-10-09T11:59:21.896354+0000","last_became_peered":"2023-10-09T11:59:21.896354+0000","last_unstale":"2023-10-09T11:59:23.323695+0000","last_undegraded":"2023-10-09T11:59:23.323695+0000","last_fullsized":"2023-10-09T11:59:23.323695+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:48.769456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909149+0000","last_change":"2023-10-09T11:59:22.906811+0000","last_active":"2023-10-09T11:59:22.909149+0000","last_peered":"2023-10-09T11:59:22.909149+0000","last_clean":"2023-10-09T11:59:22.909149+0000","last_became_active":"2023-10-09T11:59:22.906542+0000","last_became_peered":"2023-10-09T11:59:22.906542+0000","last_unstale":"2023-10-09T11:59:22.909149+0000","last_undegraded":"2023-10-09T11:59:22.909149+0000","last_fullsized":"2023-10-09T11:59:22.909149+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:58.847065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.320969+0000","last_change":"2023-10-09T11:59:21.898356+0000","last_active":"2023-10-09T11:59:23.320969+0000","last_peered":"2023-10-09T11:59:23.320969+0000","last_clean":"2023-10-09T11:59:23.320969+0000","last_became_active":"2023-10-09T11:59:21.898085+0000","last_became_peered":"2023-10-09T11:59:21.898085+0000","last_unstale":"2023-10-09T11:59:23.320969+0000","last_undegraded":"2023-10-09T11:59:23.320969+0000","last_fullsized":"2023-10-09T11:59:23.320969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:34.234671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.899441+0000","last_change":"2023-10-09T11:59:22.892400+0000","last_active":"2023-10-09T11:59:22.899441+0000","last_peered":"2023-10-09T11:59:22.899441+0000","last_clean":"2023-10-09T11:59:22.899441+0000","last_became_active":"2023-10-09T11:59:22.892147+0000","last_became_peered":"2023-10-09T11:59:22.892147+0000","last_unstale":"2023-10-09T11:59:22.899441+0000","last_undegraded":"2023-10-09T11:59:22.899441+0000","last_fullsized":"2023-10-09T11:59:22.899441+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:13.316545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.888112+0000","last_change":"2023-10-09T11:59:21.904933+0000","last_active":"2023-10-09T11:59:22.888112+0000","last_peered":"2023-10-09T11:59:22.888112+0000","last_clean":"2023-10-09T11:59:22.888112+0000","last_became_active":"2023-10-09T11:59:21.904685+0000","last_became_peered":"2023-10-09T11:59:21.904685+0000","last_unstale":"2023-10-09T11:59:22.888112+0000","last_undegraded":"2023-10-09T11:59:22.888112+0000","last_fullsized":"2023-10-09T11:59:22.888112+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:25.800611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901357+0000","last_change":"2023-10-09T11:59:22.893710+0000","last_active":"2023-10-09T11:59:22.901357+0000","last_peered":"2023-10-09T11:59:22.901357+0000","last_clean":"2023-10-09T11:59:22.901357+0000","last_became_active":"2023-10-09T11:59:22.892676+0000","last_became_peered":"2023-10-09T11:59:22.892676+0000","last_unstale":"2023-10-09T11:59:22.901357+0000","last_undegraded":"2023-10-09T11:59:22.901357+0000","last_fullsized":"2023-10-09T11:59:22.901357+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:10.981347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886051+0000","last_change":"2023-10-09T11:59:21.895867+0000","last_active":"2023-10-09T11:59:22.886051+0000","last_peered":"2023-10-09T11:59:22.886051+0000","last_clean":"2023-10-09T11:59:22.886051+0000","last_became_active":"2023-10-09T11:59:21.895594+0000","last_became_peered":"2023-10-09T11:59:21.895594+0000","last_unstale":"2023-10-09T11:59:22.886051+0000","last_undegraded":"2023-10-09T11:59:22.886051+0000","last_fullsized":"2023-10-09T11:59:22.886051+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:35.435479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898583+0000","last_change":"2023-10-09T11:59:22.897433+0000","last_active":"2023-10-09T11:59:22.898583+0000","last_peered":"2023-10-09T11:59:22.898583+0000","last_clean":"2023-10-09T11:59:22.898583+0000","last_became_active":"2023-10-09T11:59:22.897194+0000","last_became_peered":"2023-10-09T11:59:22.897194+0000","last_unstale":"2023-10-09T11:59:22.898583+0000","last_undegraded":"2023-10-09T11:59:22.898583+0000","last_fullsized":"2023-10-09T11:59:22.898583+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:50.237275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"123'8","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.321169+0000","last_change":"2023-10-09T11:59:21.897245+0000","last_active":"2023-10-09T11:59:23.321169+0000","last_peered":"2023-10-09T11:59:23.321169+0000","last_clean":"2023-10-09T11:59:23.321169+0000","last_became_active":"2023-10-09T11:59:21.896974+0000","last_became_peered":"2023-10-09T11:59:21.896974+0000","last_unstale":"2023-10-09T11:59:23.321169+0000","last_undegraded":"2023-10-09T11:59:23.321169+0000","last_fullsized":"2023-10-09T11:59:23.321169+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:00.079787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906998+0000","last_change":"2023-10-09T11:59:22.903729+0000","last_active":"2023-10-09T11:59:22.906998+0000","last_peered":"2023-10-09T11:59:22.906998+0000","last_clean":"2023-10-09T11:59:22.906998+0000","last_became_active":"2023-10-09T11:59:22.902914+0000","last_became_peered":"2023-10-09T11:59:22.902914+0000","last_unstale":"2023-10-09T11:59:22.906998+0000","last_undegraded":"2023-10-09T11:59:22.906998+0000","last_fullsized":"2023-10-09T11:59:22.906998+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:22.340560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.316706+0000","last_change":"2023-10-09T11:59:21.898564+0000","last_active":"2023-10-09T11:59:23.316706+0000","last_peered":"2023-10-09T11:59:23.316706+0000","last_clean":"2023-10-09T11:59:23.316706+0000","last_became_active":"2023-10-09T11:59:21.898305+0000","last_became_peered":"2023-10-09T11:59:21.898305+0000","last_unstale":"2023-10-09T11:59:23.316706+0000","last_undegraded":"2023-10-09T11:59:23.316706+0000","last_fullsized":"2023-10-09T11:59:23.316706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:32.939900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.897932+0000","last_change":"2023-10-09T11:59:22.895319+0000","last_active":"2023-10-09T11:59:22.897932+0000","last_peered":"2023-10-09T11:59:22.897932+0000","last_clean":"2023-10-09T11:59:22.897932+0000","last_became_active":"2023-10-09T11:59:22.894533+0000","last_became_peered":"2023-10-09T11:59:22.894533+0000","last_unstale":"2023-10-09T11:59:22.897932+0000","last_undegraded":"2023-10-09T11:59:22.897932+0000","last_fullsized":"2023-10-09T11:59:22.897932+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:49.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.317284+0000","last_change":"2023-10-09T11:59:21.895156+0000","last_active":"2023-10-09T11:59:23.317284+0000","last_peered":"2023-10-09T11:59:23.317284+0000","last_clean":"2023-10-09T11:59:23.317284+0000","last_became_active":"2023-10-09T11:59:21.894743+0000","last_became_peered":"2023-10-09T11:59:21.894743+0000","last_unstale":"2023-10-09T11:59:23.317284+0000","last_undegraded":"2023-10-09T11:59:23.317284+0000","last_fullsized":"2023-10-09T11:59:23.317284+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:23.087450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907042+0000","last_change":"2023-10-09T11:59:22.904354+0000","last_active":"2023-10-09T11:59:22.907042+0000","last_peered":"2023-10-09T11:59:22.907042+0000","last_clean":"2023-10-09T11:59:22.907042+0000","last_became_active":"2023-10-09T11:59:22.903594+0000","last_became_peered":"2023-10-09T11:59:22.903594+0000","last_unstale":"2023-10-09T11:59:22.907042+0000","last_undegraded":"2023-10-09T11:59:22.907042+0000","last_fullsized":"2023-10-09T11:59:22.907042+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:01.935110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886796+0000","last_change":"2023-10-09T11:59:21.900553+0000","last_active":"2023-10-09T11:59:22.886796+0000","last_peered":"2023-10-09T11:59:22.886796+0000","last_clean":"2023-10-09T11:59:22.886796+0000","last_became_active":"2023-10-09T11:59:21.900078+0000","last_became_peered":"2023-10-09T11:59:21.900078+0000","last_unstale":"2023-10-09T11:59:22.886796+0000","last_undegraded":"2023-10-09T11:59:22.886796+0000","last_fullsized":"2023-10-09T11:59:22.886796+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:12.088577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.904718+0000","last_change":"2023-10-09T11:59:22.900058+0000","last_active":"2023-10-09T11:59:22.904718+0000","last_peered":"2023-10-09T11:59:22.904718+0000","last_clean":"2023-10-09T11:59:22.904718+0000","last_became_active":"2023-10-09T11:59:22.899817+0000","last_became_peered":"2023-10-09T11:59:22.899817+0000","last_unstale":"2023-10-09T11:59:22.904718+0000","last_undegraded":"2023-10-09T11:59:22.904718+0000","last_fullsized":"2023-10-09T11:59:22.904718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:44.901393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318798+0000","last_change":"2023-10-09T11:59:21.901883+0000","last_active":"2023-10-09T11:59:23.318798+0000","last_peered":"2023-10-09T11:59:23.318798+0000","last_clean":"2023-10-09T11:59:23.318798+0000","last_became_active":"2023-10-09T11:59:21.901642+0000","last_became_peered":"2023-10-09T11:59:21.901642+0000","last_unstale":"2023-10-09T11:59:23.318798+0000","last_undegraded":"2023-10-09T11:59:23.318798+0000","last_fullsized":"2023-10-09T11:59:23.318798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:32.058434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905056+0000","last_change":"2023-10-09T11:59:22.901037+0000","last_active":"2023-10-09T11:59:22.905056+0000","last_peered":"2023-10-09T11:59:22.905056+0000","last_clean":"2023-10-09T11:59:22.905056+0000","last_became_active":"2023-10-09T11:59:22.900594+0000","last_became_peered":"2023-10-09T11:59:22.900594+0000","last_unstale":"2023-10-09T11:59:22.905056+0000","last_undegraded":"2023-10-09T11:59:22.905056+0000","last_fullsized":"2023-10-09T11:59:22.905056+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:33.265874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886285+0000","last_change":"2023-10-09T11:59:21.904396+0000","last_active":"2023-10-09T11:59:22.886285+0000","last_peered":"2023-10-09T11:59:22.886285+0000","last_clean":"2023-10-09T11:59:22.886285+0000","last_became_active":"2023-10-09T11:59:21.904061+0000","last_became_peered":"2023-10-09T11:59:21.904061+0000","last_unstale":"2023-10-09T11:59:22.886285+0000","last_undegraded":"2023-10-09T11:59:22.886285+0000","last_fullsized":"2023-10-09T11:59:22.886285+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:48.805046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.907163+0000","last_change":"2023-10-09T11:59:22.899430+0000","last_active":"2023-10-09T11:59:22.907163+0000","last_peered":"2023-10-09T11:59:22.907163+0000","last_clean":"2023-10-09T11:59:22.907163+0000","last_became_active":"2023-10-09T11:59:22.899176+0000","last_became_peered":"2023-10-09T11:59:22.899176+0000","last_unstale":"2023-10-09T11:59:22.907163+0000","last_undegraded":"2023-10-09T11:59:22.907163+0000","last_fullsized":"2023-10-09T11:59:22.907163+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:43.512347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.885554+0000","last_change":"2023-10-09T11:59:21.898011+0000","last_active":"2023-10-09T11:59:22.885554+0000","last_peered":"2023-10-09T11:59:22.885554+0000","last_clean":"2023-10-09T11:59:22.885554+0000","last_became_active":"2023-10-09T11:59:21.897265+0000","last_became_peered":"2023-10-09T11:59:21.897265+0000","last_unstale":"2023-10-09T11:59:22.885554+0000","last_undegraded":"2023-10-09T11:59:22.885554+0000","last_fullsized":"2023-10-09T11:59:22.885554+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:14:26.650081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905690+0000","last_change":"2023-10-09T11:59:22.901887+0000","last_active":"2023-10-09T11:59:22.905690+0000","last_peered":"2023-10-09T11:59:22.905690+0000","last_clean":"2023-10-09T11:59:22.905690+0000","last_became_active":"2023-10-09T11:59:22.901188+0000","last_became_peered":"2023-10-09T11:59:22.901188+0000","last_unstale":"2023-10-09T11:59:22.905690+0000","last_undegraded":"2023-10-09T11:59:22.905690+0000","last_fullsized":"2023-10-09T11:59:22.905690+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:08:33.229969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.887661+0000","last_change":"2023-10-09T11:59:21.894457+0000","last_active":"2023-10-09T11:59:22.887661+0000","last_peered":"2023-10-09T11:59:22.887661+0000","last_clean":"2023-10-09T11:59:22.887661+0000","last_became_active":"2023-10-09T11:59:21.894153+0000","last_became_peered":"2023-10-09T11:59:21.894153+0000","last_unstale":"2023-10-09T11:59:22.887661+0000","last_undegraded":"2023-10-09T11:59:22.887661+0000","last_fullsized":"2023-10-09T11:59:22.887661+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:27.766350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.909059+0000","last_change":"2023-10-09T11:59:22.901059+0000","last_active":"2023-10-09T11:59:22.909059+0000","last_peered":"2023-10-09T11:59:22.909059+0000","last_clean":"2023-10-09T11:59:22.909059+0000","last_became_active":"2023-10-09T11:59:22.900776+0000","last_became_peered":"2023-10-09T11:59:22.900776+0000","last_unstale":"2023-10-09T11:59:22.909059+0000","last_undegraded":"2023-10-09T11:59:22.909059+0000","last_fullsized":"2023-10-09T11:59:22.909059+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:51.451677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.318199+0000","last_change":"2023-10-09T11:59:21.891771+0000","last_active":"2023-10-09T11:59:23.318199+0000","last_peered":"2023-10-09T11:59:23.318199+0000","last_clean":"2023-10-09T11:59:23.318199+0000","last_became_active":"2023-10-09T11:59:21.891481+0000","last_became_peered":"2023-10-09T11:59:21.891481+0000","last_unstale":"2023-10-09T11:59:23.318199+0000","last_undegraded":"2023-10-09T11:59:23.318199+0000","last_fullsized":"2023-10-09T11:59:23.318199+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.231914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898702+0000","last_change":"2023-10-09T11:59:22.890792+0000","last_active":"2023-10-09T11:59:22.898702+0000","last_peered":"2023-10-09T11:59:22.898702+0000","last_clean":"2023-10-09T11:59:22.898702+0000","last_became_active":"2023-10-09T11:59:22.890537+0000","last_became_peered":"2023-10-09T11:59:22.890537+0000","last_unstale":"2023-10-09T11:59:22.898702+0000","last_undegraded":"2023-10-09T11:59:22.898702+0000","last_fullsized":"2023-10-09T11:59:22.898702+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:49.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-09T11:59:24.602878+0000","last_change":"2023-10-09T11:59:21.901277+0000","last_active":"2023-10-09T11:59:24.602878+0000","last_peered":"2023-10-09T11:59:24.602878+0000","last_clean":"2023-10-09T11:59:24.602878+0000","last_became_active":"2023-10-09T11:59:21.900998+0000","last_became_peered":"2023-10-09T11:59:21.900998+0000","last_unstale":"2023-10-09T11:59:24.602878+0000","last_undegraded":"2023-10-09T11:59:24.602878+0000","last_fullsized":"2023-10-09T11:59:24.602878+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:47.984329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.901569+0000","last_change":"2023-10-09T11:59:22.895330+0000","last_active":"2023-10-09T11:59:22.901569+0000","last_peered":"2023-10-09T11:59:22.901569+0000","last_clean":"2023-10-09T11:59:22.901569+0000","last_became_active":"2023-10-09T11:59:22.895086+0000","last_became_peered":"2023-10-09T11:59:22.895086+0000","last_unstale":"2023-10-09T11:59:22.901569+0000","last_undegraded":"2023-10-09T11:59:22.901569+0000","last_fullsized":"2023-10-09T11:59:22.901569+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:28.307538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.887977+0000","last_change":"2023-10-09T11:59:21.899820+0000","last_active":"2023-10-09T11:59:22.887977+0000","last_peered":"2023-10-09T11:59:22.887977+0000","last_clean":"2023-10-09T11:59:22.887977+0000","last_became_active":"2023-10-09T11:59:21.896766+0000","last_became_peered":"2023-10-09T11:59:21.896766+0000","last_unstale":"2023-10-09T11:59:22.887977+0000","last_undegraded":"2023-10-09T11:59:22.887977+0000","last_fullsized":"2023-10-09T11:59:22.887977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:53.329451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905837+0000","last_change":"2023-10-09T11:59:22.900232+0000","last_active":"2023-10-09T11:59:22.905837+0000","last_peered":"2023-10-09T11:59:22.905837+0000","last_clean":"2023-10-09T11:59:22.905837+0000","last_became_active":"2023-10-09T11:59:22.899833+0000","last_became_peered":"2023-10-09T11:59:22.899833+0000","last_unstale":"2023-10-09T11:59:22.905837+0000","last_undegraded":"2023-10-09T11:59:22.905837+0000","last_fullsized":"2023-10-09T11:59:22.905837+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:25.553741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.891825+0000","last_change":"2023-10-09T11:59:21.895773+0000","last_active":"2023-10-09T11:59:22.891825+0000","last_peered":"2023-10-09T11:59:22.891825+0000","last_clean":"2023-10-09T11:59:22.891825+0000","last_became_active":"2023-10-09T11:59:21.895495+0000","last_became_peered":"2023-10-09T11:59:21.895495+0000","last_unstale":"2023-10-09T11:59:22.891825+0000","last_undegraded":"2023-10-09T11:59:22.891825+0000","last_fullsized":"2023-10-09T11:59:22.891825+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:12:55.957466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.906526+0000","last_change":"2023-10-09T11:59:22.904444+0000","last_active":"2023-10-09T11:59:22.906526+0000","last_peered":"2023-10-09T11:59:22.906526+0000","last_clean":"2023-10-09T11:59:22.906526+0000","last_became_active":"2023-10-09T11:59:22.903873+0000","last_became_peered":"2023-10-09T11:59:22.903873+0000","last_unstale":"2023-10-09T11:59:22.906526+0000","last_undegraded":"2023-10-09T11:59:22.906526+0000","last_fullsized":"2023-10-09T11:59:22.906526+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:34.511535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.890168+0000","last_change":"2023-10-09T11:59:21.899633+0000","last_active":"2023-10-09T11:59:22.890168+0000","last_peered":"2023-10-09T11:59:22.890168+0000","last_clean":"2023-10-09T11:59:22.890168+0000","last_became_active":"2023-10-09T11:59:21.899358+0000","last_became_peered":"2023-10-09T11:59:21.899358+0000","last_unstale":"2023-10-09T11:59:22.890168+0000","last_undegraded":"2023-10-09T11:59:22.890168+0000","last_fullsized":"2023-10-09T11:59:22.890168+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:59.069640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.903506+0000","last_change":"2023-10-09T11:59:22.897551+0000","last_active":"2023-10-09T11:59:22.903506+0000","last_peered":"2023-10-09T11:59:22.903506+0000","last_clean":"2023-10-09T11:59:22.903506+0000","last_became_active":"2023-10-09T11:59:22.896912+0000","last_became_peered":"2023-10-09T11:59:22.896912+0000","last_unstale":"2023-10-09T11:59:22.903506+0000","last_undegraded":"2023-10-09T11:59:22.903506+0000","last_fullsized":"2023-10-09T11:59:22.903506+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:38.580883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.892130+0000","last_change":"2023-10-09T11:59:21.904361+0000","last_active":"2023-10-09T11:59:22.892130+0000","last_peered":"2023-10-09T11:59:22.892130+0000","last_clean":"2023-10-09T11:59:22.892130+0000","last_became_active":"2023-10-09T11:59:21.904060+0000","last_became_peered":"2023-10-09T11:59:21.904060+0000","last_unstale":"2023-10-09T11:59:22.892130+0000","last_undegraded":"2023-10-09T11:59:22.892130+0000","last_fullsized":"2023-10-09T11:59:22.892130+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:27.834968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.898445+0000","last_change":"2023-10-09T11:59:22.896851+0000","last_active":"2023-10-09T11:59:22.898445+0000","last_peered":"2023-10-09T11:59:22.898445+0000","last_clean":"2023-10-09T11:59:22.898445+0000","last_became_active":"2023-10-09T11:59:22.896582+0000","last_became_peered":"2023-10-09T11:59:22.896582+0000","last_unstale":"2023-10-09T11:59:22.898445+0000","last_undegraded":"2023-10-09T11:59:22.898445+0000","last_fullsized":"2023-10-09T11:59:22.898445+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:40.629884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.892919+0000","last_change":"2023-10-09T11:59:21.904306+0000","last_active":"2023-10-09T11:59:22.892919+0000","last_peered":"2023-10-09T11:59:22.892919+0000","last_clean":"2023-10-09T11:59:22.892919+0000","last_became_active":"2023-10-09T11:59:21.903989+0000","last_became_peered":"2023-10-09T11:59:21.903989+0000","last_unstale":"2023-10-09T11:59:22.892919+0000","last_undegraded":"2023-10-09T11:59:22.892919+0000","last_fullsized":"2023-10-09T11:59:22.892919+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:44.715609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905673+0000","last_change":"2023-10-09T11:59:22.899459+0000","last_active":"2023-10-09T11:59:22.905673+0000","last_peered":"2023-10-09T11:59:22.905673+0000","last_clean":"2023-10-09T11:59:22.905673+0000","last_became_active":"2023-10-09T11:59:22.899200+0000","last_became_peered":"2023-10-09T11:59:22.899200+0000","last_unstale":"2023-10-09T11:59:22.905673+0000","last_undegraded":"2023-10-09T11:59:22.905673+0000","last_fullsized":"2023-10-09T11:59:22.905673+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:22.498734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.886737+0000","last_change":"2023-10-09T11:59:21.902851+0000","last_active":"2023-10-09T11:59:22.886737+0000","last_peered":"2023-10-09T11:59:22.886737+0000","last_clean":"2023-10-09T11:59:22.886737+0000","last_became_active":"2023-10-09T11:59:21.902603+0000","last_became_peered":"2023-10-09T11:59:21.902603+0000","last_unstale":"2023-10-09T11:59:22.886737+0000","last_undegraded":"2023-10-09T11:59:22.886737+0000","last_fullsized":"2023-10-09T11:59:22.886737+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:15.642619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.905148+0000","last_change":"2023-10-09T11:59:22.899440+0000","last_active":"2023-10-09T11:59:22.905148+0000","last_peered":"2023-10-09T11:59:22.905148+0000","last_clean":"2023-10-09T11:59:22.905148+0000","last_became_active":"2023-10-09T11:59:22.899189+0000","last_became_peered":"2023-10-09T11:59:22.899189+0000","last_unstale":"2023-10-09T11:59:22.905148+0000","last_undegraded":"2023-10-09T11:59:22.905148+0000","last_fullsized":"2023-10-09T11:59:22.905148+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:21.870737+0000","last_clean_scrub_stamp":"2023-10-09T11:59:21.870737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:27.185151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:23.315874+0000","last_change":"2023-10-09T11:59:21.898827+0000","last_active":"2023-10-09T11:59:23.315874+0000","last_peered":"2023-10-09T11:59:23.315874+0000","last_clean":"2023-10-09T11:59:23.315874+0000","last_became_active":"2023-10-09T11:59:21.898448+0000","last_became_peered":"2023-10-09T11:59:21.898448+0000","last_unstale":"2023-10-09T11:59:23.315874+0000","last_undegraded":"2023-10-09T11:59:23.315874+0000","last_fullsized":"2023-10-09T11:59:23.315874+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:59:20.863014+0000","last_clean_scrub_stamp":"2023-10-09T11:59:20.863014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:12.840602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"113'227","reported_seq":637,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-09T11:59:22.894256+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T11:59:22.894256+0000","last_peered":"2023-10-09T11:59:22.894256+0000","last_clean":"2023-10-09T11:59:22.894256+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T11:59:22.894256+0000","last_undegraded":"2023-10-09T11:59:22.894256+0000","last_fullsized":"2023-10-09T11:59:22.894256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476952,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303456,"kb_used_data":2072,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068384,"statfs":{"total":96636764160,"available":96326025216,"internally_reserved":0,"allocated":2121728,"data_stored":1331411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.70999999999999996},"min":{"1min":0.54400000000000004,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":0.98399999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.75700000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.874},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.754},"min":{"1min":0.63500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.78500000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66400000000000003,"15min":0.70299999999999996},"min":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79800000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89100000000000001,"5min":1.0209999999999999,"15min":1.048},"last":0.84499999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68999999999999995,"15min":0.72399999999999998},"min":{"1min":0.59399999999999997,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.51600000000000001},"max":{"1min":0.82299999999999995,"5min":0.98899999999999999,"15min":1.073},"last":0.81299999999999994}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.34200000000000003},"max":{"1min":0.85999999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.41699999999999998,"15min":0.38800000000000001},"max":{"1min":0.82199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.496},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.46500000000000002,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.55300000000000005,"5min":0.47499999999999998,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.111,"15min":1.111},"last":0.45300000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476953,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302876,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068964,"statfs":{"total":96636764160,"available":96326619136,"internally_reserved":0,"allocated":1527808,"data_stored":741555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67500000000000004,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.0629999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67700000000000005,"15min":0.73499999999999999},"min":{"1min":0.47599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.71299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90100000000000002,"5min":0.98999999999999999,"15min":1.121},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":1.0049999999999999,"15min":1.216},"last":0.73399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70499999999999996,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.92800000000000005,"5min":0.98799999999999999,"15min":1.139},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.73699999999999999},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":1.0009999999999999,"15min":1.278},"last":0.83099999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69699999999999995,"15min":0.749},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":0.94299999999999995,"5min":1.042,"15min":1.1040000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.875,"5min":0.94699999999999995,"15min":1.244},"last":0.85799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.1060000000000001},"last":0.496},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.64800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88900000000000001,"5min":0.96699999999999997,"15min":1.4750000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":1.143},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86699999999999999,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98999999999999999,"5min":1.03,"15min":1.327},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.81299999999999994}]}]},{"osd":1,"up_from":15,"seq":64424509657,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302868,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068972,"statfs":{"total":96636764160,"available":96326627328,"internally_reserved":0,"allocated":1519616,"data_stored":740931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.46300000000000002},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":1.0580000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.61399999999999999,"5min":1.079,"15min":1.079},"last":0.377}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.504},"min":{"1min":0.32700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57499999999999996,"5min":0.80000000000000004,"15min":0.99099999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.76800000000000002,"15min":1.099},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52000000000000002,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.65400000000000003,"5min":1.044,"15min":1.1779999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.78000000000000003,"15min":1.046},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73099999999999998,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0029999999999999,"5min":1.143,"15min":1.7210000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93899999999999995,"5min":1.0660000000000001,"15min":1.552},"last":0.66400000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74399999999999999,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0740000000000001,"5min":1.202,"15min":1.677},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76500000000000001,"15min":0.81000000000000005},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.103,"15min":1.778},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.80400000000000005},"min":{"1min":0.64500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.623},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.708},"last":0.72299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.659},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.83399999999999996},"min":{"1min":0.60399999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.99199999999999999,"5min":1.1419999999999999,"15min":1.736},"last":0.57699999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542360,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":1331853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.91500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.219},"max":{"1min":1.012,"5min":1.012,"15min":1.0740000000000001},"last":0.439}]},{"osd":2,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.628,"5min":2.097,"15min":2.097},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32500000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.495}]},{"osd":3,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.1699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80000000000000004,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1699999999999999,"5min":1.587,"15min":1.587},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78000000000000003,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0860000000000001,"5min":1.389,"15min":1.389},"last":0.89800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77000000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1739999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.874}]},{"osd":6,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76700000000000002,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1339999999999999,"5min":1.1899999999999999,"15min":1.2709999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:58:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.113,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.93300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542360,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306968,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064872,"statfs":{"total":96636764160,"available":96322428928,"internally_reserved":0,"allocated":1523712,"data_stored":740965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.46400000000000002},"min":{"1min":0.35199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.78000000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.499,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.60099999999999998,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.876,"15min":0.876},"last":0.51300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.63600000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.95199999999999996},"last":0.59399999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":1.095,"15min":1.1839999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.014,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75800000000000001,"15min":0.79700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":1.0649999999999999,"15min":1.2629999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.0449999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81499999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.216},"last":0.878},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.81699999999999995},"min":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.204},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78400000000000003,"15min":0.82599999999999996},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.153,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79200000000000004,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.111,"5min":1.111,"15min":1.155},"last":0.86199999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509657,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306980,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064860,"statfs":{"total":96636764160,"available":96322416640,"internally_reserved":0,"allocated":1536000,"data_stored":742489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.78700000000000003,"5min":0.91300000000000003,"15min":1.208},"last":0.502},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68100000000000005,"5min":0.89500000000000002,"15min":1.1970000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.44,"5min":0.371,"15min":0.32300000000000001},"max":{"1min":0.73299999999999998,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.502,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.876},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.36099999999999999},"max":{"1min":0.68500000000000005,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.35299999999999998,"15min":0.308},"max":{"1min":0.60499999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.57199999999999995,"5min":0.55800000000000005,"15min":0.53800000000000003},"max":{"1min":1.137,"5min":1.208,"15min":1.327},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":0.83699999999999997},"min":{"1min":0.622,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1679999999999999,"5min":1.252,"15min":1.2689999999999999},"last":0.879}]},{"osd":5,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":1.0960000000000001,"5min":1.246,"15min":1.252},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.41299999999999998},"max":{"1min":1.0780000000000001,"5min":1.234,"15min":1.3660000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2989999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.97499999999999998,"5min":1.1240000000000001,"15min":1.218},"last":0.88700000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:58:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46999999999999997},"max":{"1min":0.996,"5min":1.25,"15min":1.333},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0640000000000001,"5min":1.194,"15min":1.3560000000000001},"last":0.74099999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476952,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311080,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060760,"statfs":{"total":96636764160,"available":96318218240,"internally_reserved":0,"allocated":1540096,"data_stored":742591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69299999999999995,"15min":0.72099999999999997},"min":{"1min":0.497,"5min":0.38,"15min":0.38},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.071},"last":0.628},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.69299999999999995,"15min":0.71999999999999997},"min":{"1min":0.57699999999999996,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.98199999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.54700000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":1.091},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.629,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.014,"5min":1.587,"15min":1.587},"last":0.75600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.97099999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.59699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.419,"15min":1.419},"last":0.70999999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69499999999999995,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.367,"15min":1.367},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.93600000000000005,"5min":1.613,"15min":1.613},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80300000000000005,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:58:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.484,"15min":1.484},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95999999999999996,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.81499999999999995}]}]},{"osd":5,"up_from":16,"seq":68719476952,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1523712,"data_stored":741001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.71199999999999997},"min":{"1min":0.52800000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89300000000000002,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.52000000000000002,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":1.014,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.58699999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65400000000000003,"15min":0.69799999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.0840000000000001},"last":0.434},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69099999999999995,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.42599999999999999,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.909,"15min":1.909},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.046,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.53300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71599999999999997,"15min":0.75800000000000001},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99199999999999999,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.439},"max":{"1min":1.048,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.83099999999999996,"5min":2.105,"15min":2.105},"last":0.372},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.92900000000000005,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.48299999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.627},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T11:59:32.894 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:59:32.895 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:59:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.113+0000 7fb0ecdff700 1 Processor -- start 2023-10-09T11:59:33.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.114+0000 7fb0ecdff700 1 -- start start 2023-10-09T11:59:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0ecdff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb0e8156620 0x7fb0e80c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0ecdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e8068390 0x7fb0e8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0ecdff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e815a6f0 con 0x7fb0e81569f0 2023-10-09T11:59:33.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0ecdff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80c8d30 con 0x7fb0e8156620 2023-10-09T11:59:33.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0ecdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8068d70 con 0x7fb0e8068390 2023-10-09T11:59:33.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0e5d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb0e81569f0 0x7fb0e80ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54540/0 (socket says 172.21.15.86:54540) 2023-10-09T11:59:33.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0e5d9b700 1 -- 172.21.15.86:0/3128225204 learned_addr learned my addr 172.21.15.86:0/3128225204 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:33.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0e6d9d700 1 --2- 172.21.15.86:0/3128225204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e8068390 0x7fb0e8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0e659c700 1 --2- 172.21.15.86:0/3128225204 >> v2:172.21.15.135:3300/0 conn(0x7fb0e8156620 0x7fb0e80c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.115+0000 7fb0e559a700 1 -- 172.21.15.86:0/3128225204 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846497657 0 0) 0x7fb0e815a6f0 con 0x7fb0e81569f0 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e559a700 1 -- 172.21.15.86:0/3128225204 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d0003570 con 0x7fb0e81569f0 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e6d9d700 1 -- 172.21.15.86:0/3128225204 >> v2:172.21.15.135:3300/0 conn(0x7fb0e8156620 msgr2=0x7fb0e80c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e6d9d700 1 --2- 172.21.15.86:0/3128225204 >> v2:172.21.15.135:3300/0 conn(0x7fb0e8156620 0x7fb0e80c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e6d9d700 1 -- 172.21.15.86:0/3128225204 >> v1:172.21.15.86:6789/0 conn(0x7fb0e81569f0 legacy=0x7fb0e80ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e6d9d700 1 -- 172.21.15.86:0/3128225204 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e815a9d0 con 0x7fb0e8068390 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e6d9d700 1 --2- 172.21.15.86:0/3128225204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e8068390 0x7fb0e8068830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009e60 tx=0x7fb0e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5af6ebe8a67392 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e559a700 1 -- 172.21.15.86:0/3128225204 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000e070 con 0x7fb0e8068390 2023-10-09T11:59:33.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e559a700 1 -- 172.21.15.86:0/3128225204 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e000bab0 con 0x7fb0e8068390 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.116+0000 7fb0e559a700 1 -- 172.21.15.86:0/3128225204 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000be70 con 0x7fb0e8068390 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 -- 172.21.15.86:0/3128225204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e8068390 msgr2=0x7fb0e8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/3128225204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e8068390 0x7fb0e8068830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009e60 tx=0x7fb0e0009780 comp rx=0 tx=0).stop 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 -- 172.21.15.86:0/3128225204 shutdown_connections 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/3128225204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e8068390 0x7fb0e8068830 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/3128225204 >> v2:172.21.15.135:3300/0 conn(0x7fb0e8156620 0x7fb0e80c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 -- 172.21.15.86:0/3128225204 >> 172.21.15.86:0/3128225204 conn(0x7fb0e80cc540 msgr2=0x7fb0e80cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 -- 172.21.15.86:0/3128225204 shutdown_connections 2023-10-09T11:59:33.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.117+0000 7fb0ecdff700 1 -- 172.21.15.86:0/3128225204 wait complete. 2023-10-09T11:59:33.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.118+0000 7fb0ecdff700 1 Processor -- start 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.118+0000 7fb0ecdff700 1 -- start start 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.119+0000 7fb0ecdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0e8068390 0x7fb0e816adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.119+0000 7fb0ecdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0e8156620 0x7fb0e816d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.119+0000 7fb0ecdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e81569f0 0x7fb0e816d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.119+0000 7fb0ecdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80bff70 con 0x7fb0e8068390 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.119+0000 7fb0ecdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80c0ab0 con 0x7fb0e8156620 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.119+0000 7fb0ecdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80c0180 con 0x7fb0e81569f0 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0e8068390 0x7fb0e816adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0e8068390 0x7fb0e816adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39124/0 (socket says 172.21.15.86:39124) 2023-10-09T11:59:33.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 -- 172.21.15.86:0/214275230 learned_addr learned my addr 172.21.15.86:0/214275230 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e6d9d700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e81569f0 0x7fb0e816d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 -- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e81569f0 msgr2=0x7fb0e816d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e5d9b700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0e8156620 0x7fb0e816d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e81569f0 0x7fb0e816d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 -- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0e8156620 msgr2=0x7fb0e816d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0e8156620 0x7fb0e816d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 -- 172.21.15.86:0/214275230 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0009a20 con 0x7fb0e8068390 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e6d9d700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e81569f0 0x7fb0e816d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e5d9b700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0e8156620 0x7fb0e816d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0e659c700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0e8068390 0x7fb0e816adb0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800ec80 tx=0x7fb0d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:33.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.120+0000 7fb0d67fc700 1 -- 172.21.15.86:0/214275230 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800c9d0 con 0x7fb0e8068390 2023-10-09T11:59:33.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.121+0000 7fb0d67fc700 1 -- 172.21.15.86:0/214275230 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800cb30 con 0x7fb0e8068390 2023-10-09T11:59:33.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.121+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e80c0460 con 0x7fb0e8068390 2023-10-09T11:59:33.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.121+0000 7fb0d67fc700 1 -- 172.21.15.86:0/214275230 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8013470 con 0x7fb0e8068390 2023-10-09T11:59:33.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.121+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e816cd00 con 0x7fb0e8068390 2023-10-09T11:59:33.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.122+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e816cfe0 con 0x7fb0e8068390 2023-10-09T11:59:33.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.122+0000 7fb0d67fc700 1 -- 172.21.15.86:0/214275230 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0d8013820 con 0x7fb0e8068390 2023-10-09T11:59:33.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.124+0000 7fb0d67fc700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0c8066f30 0x7fb0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.124+0000 7fb0d67fc700 1 -- 172.21.15.86:0/214275230 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fb0d8084ae0 con 0x7fb0e8068390 2023-10-09T11:59:33.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.125+0000 7fb0e5d9b700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0c8066f30 0x7fb0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.125+0000 7fb0e5d9b700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0c8066f30 0x7fb0c80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc007fd0 tx=0x7fb0dc009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:33.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.128+0000 7fb0d67fc700 1 -- 172.21.15.86:0/214275230 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0d8051b30 con 0x7fb0e8068390 2023-10-09T11:59:33.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.392+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb0e80718b0 con 0x7fb0e8068390 2023-10-09T11:59:33.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.396+0000 7fb0d67fc700 1 -- 172.21.15.86:0/214275230 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb0d8055150 con 0x7fb0e8068390 2023-10-09T11:59:33.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0c8066f30 msgr2=0x7fb0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0c8066f30 0x7fb0c80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc007fd0 tx=0x7fb0dc009040 comp rx=0 tx=0).stop 2023-10-09T11:59:33.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0e8068390 msgr2=0x7fb0e816adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0e8068390 0x7fb0e816adb0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800ec80 tx=0x7fb0d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 shutdown_connections 2023-10-09T11:59:33.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0c8066f30 0x7fb0c80693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0e8068390 0x7fb0e816adb0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0e81569f0 0x7fb0e816d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 --2- 172.21.15.86:0/214275230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0e8156620 0x7fb0e816d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.398+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 >> 172.21.15.86:0/214275230 conn(0x7fb0e80cc540 msgr2=0x7fb0e80c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:33.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.399+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 shutdown_connections 2023-10-09T11:59:33.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.399+0000 7fb0ecdff700 1 -- 172.21.15.86:0/214275230 wait complete. 2023-10-09T11:59:33.400 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T11:59:33.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:59:33.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.598+0000 7f0f1f59e700 1 Processor -- start 2023-10-09T11:59:33.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.599+0000 7f0f1f59e700 1 -- start start 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f200ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1f59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f200cb900 0x7f0f200ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1f59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200ca860 con 0x7f0f20156310 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1f59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200cab40 con 0x7f0f200cb900 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200cae20 con 0x7f0f201566e0 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f200cb900 0x7f0f200ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f200cb900 0x7f0f200ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39132/0 (socket says 172.21.15.86:39132) 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1ed9d700 1 -- 172.21.15.86:0/511474185 learned_addr learned my addr 172.21.15.86:0/511474185 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f17fff700 1 --2- 172.21.15.86:0/511474185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f200ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1ed9d700 1 -- 172.21.15.86:0/511474185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 msgr2=0x7f0f200ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.600+0000 7f0f1ed9d700 1 --2- 172.21.15.86:0/511474185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f200ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1ed9d700 1 -- 172.21.15.86:0/511474185 >> v1:172.21.15.135:6789/0 conn(0x7f0f20156310 legacy=0x7f0f200c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1ed9d700 1 -- 172.21.15.86:0/511474185 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200cb100 con 0x7f0f200cb900 2023-10-09T11:59:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f17fff700 1 --2- 172.21.15.86:0/511474185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f200ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1ed9d700 1 --2- 172.21.15.86:0/511474185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f200cb900 0x7f0f200ae540 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009f20 tx=0x7f0f18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bd7fcd292fe59e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:33.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1dd9b700 1 -- 172.21.15.86:0/511474185 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800e070 con 0x7f0f200cb900 2023-10-09T11:59:33.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1dd9b700 1 -- 172.21.15.86:0/511474185 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1800ba80 con 0x7f0f200cb900 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1dd9b700 1 -- 172.21.15.86:0/511474185 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f180092e0 con 0x7f0f200cb900 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1f59e700 1 -- 172.21.15.86:0/511474185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f200cb900 msgr2=0x7f0f200ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.601+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/511474185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f200cb900 0x7f0f200ae540 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009f20 tx=0x7f0f18009840 comp rx=0 tx=0).stop 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.602+0000 7f0f1f59e700 1 -- 172.21.15.86:0/511474185 shutdown_connections 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.602+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/511474185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f200cb900 0x7f0f200ae540 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.602+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/511474185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f200ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.602+0000 7f0f1f59e700 1 -- 172.21.15.86:0/511474185 >> 172.21.15.86:0/511474185 conn(0x7f0f200cc1f0 msgr2=0x7f0f200cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.602+0000 7f0f1f59e700 1 -- 172.21.15.86:0/511474185 shutdown_connections 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.602+0000 7f0f1f59e700 1 -- 172.21.15.86:0/511474185 wait complete. 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.603+0000 7f0f1f59e700 1 Processor -- start 2023-10-09T11:59:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.603+0000 7f0f1f59e700 1 -- start start 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f200cb900 0x7f0f2014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f20156310 0x7f0f2014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f2014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1f59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20167c00 con 0x7f0f20156310 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1f59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2014cc30 con 0x7f0f200cb900 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2014cee0 con 0x7f0f201566e0 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f17fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f20156310 0x7f0f2014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f17fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f20156310 0x7f0f2014c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39142/0 (socket says 172.21.15.86:39142) 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f17fff700 1 -- 172.21.15.86:0/2232756980 learned_addr learned my addr 172.21.15.86:0/2232756980 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1e59c700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f200cb900 0x7f0f2014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.604+0000 7f0f1ed9d700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f2014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f17fff700 1 -- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 msgr2=0x7f0f2014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f17fff700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f2014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f17fff700 1 -- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f200cb900 msgr2=0x7f0f2014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f17fff700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f200cb900 0x7f0f2014ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f17fff700 1 -- 172.21.15.86:0/2232756980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18009ae0 con 0x7f0f20156310 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f1e59c700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f200cb900 0x7f0f2014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f17fff700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f20156310 0x7f0f2014c1b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800d7e0 tx=0x7f0f08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f167fc700 1 -- 172.21.15.86:0/2232756980 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080125f0 con 0x7f0f20156310 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f167fc700 1 -- 172.21.15.86:0/2232756980 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08012750 con 0x7f0f20156310 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2014d1c0 con 0x7f0f20156310 2023-10-09T11:59:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f167fc700 1 -- 172.21.15.86:0/2232756980 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08012b10 con 0x7f0f20156310 2023-10-09T11:59:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.605+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2014b340 con 0x7f0f20156310 2023-10-09T11:59:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.606+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f20167d70 con 0x7f0f20156310 2023-10-09T11:59:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.607+0000 7f0f167fc700 1 -- 172.21.15.86:0/2232756980 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f0801e460 con 0x7f0f20156310 2023-10-09T11:59:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.608+0000 7f0f167fc700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f00066f30 0x7f0f000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.608+0000 7f0f167fc700 1 -- 172.21.15.86:0/2232756980 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f0f08084da0 con 0x7f0f20156310 2023-10-09T11:59:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.608+0000 7f0f1e59c700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f00066f30 0x7f0f000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.609+0000 7f0f1e59c700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f00066f30 0x7f0f000693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007fd0 tx=0x7f0f10009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:33.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.612+0000 7f0f167fc700 1 -- 172.21.15.86:0/2232756980 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f08051df0 con 0x7f0f20156310 2023-10-09T11:59:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.845+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f2004c3c0 con 0x7f0f20156310 2023-10-09T11:59:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.846+0000 7f0f167fc700 1 -- 172.21.15.86:0/2232756980 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0f08055410 con 0x7f0f20156310 2023-10-09T11:59:33.847 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:33.847 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/2850632798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2850632798},{"type":"v1","addr":"172.21.15.86:6833","nonce":2850632798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/244252313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":244252313},{"type":"v1","addr":"172.21.15.135:6834","nonce":244252313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4164357513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4164357513},{"type":"v1","addr":"172.21.15.135:6835","nonce":4164357513}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:59:22.355864+0000","modified":"2023-10-09T11:59:26.316887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7183":{"gid":7183,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1465588551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1465588551},{"type":"v1","addr":"172.21.15.86:6835","nonce":1465588551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:59:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.848+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f00066f30 msgr2=0x7f0f000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.848+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f00066f30 0x7f0f000693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007fd0 tx=0x7f0f10009040 comp rx=0 tx=0).stop 2023-10-09T11:59:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.848+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f20156310 msgr2=0x7f0f2014c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.848+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f20156310 0x7f0f2014c1b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800d7e0 tx=0x7f0f08008040 comp rx=0 tx=0).stop 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 shutdown_connections 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f201566e0 0x7f0f2014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f200cb900 0x7f0f2014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f00066f30 0x7f0f000693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 --2- 172.21.15.86:0/2232756980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f20156310 0x7f0f2014c1b0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 >> 172.21.15.86:0/2232756980 conn(0x7f0f200cc1f0 msgr2=0x7f0f200af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 shutdown_connections 2023-10-09T11:59:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:33.849+0000 7f0f1f59e700 1 -- 172.21.15.86:0/2232756980 wait complete. 2023-10-09T11:59:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 54 2023-10-09T11:59:34.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:59:22.355864+0000', 'modified': '2023-10-09T11:59:26.316887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7183}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7183': {'gid': 7183, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/1465588551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 1465588551}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 1465588551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:59:34.269 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:59:34.269 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:59:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.451+0000 7f448efff700 1 Processor -- start 2023-10-09T11:59:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.451+0000 7f448efff700 1 -- start start 2023-10-09T11:59:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.452+0000 7f448efff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44880cbf30 0x7f44880ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.452+0000 7f448efff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880ccf90 0x7f44880b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448efff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f448815a270 0x7f44880b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448efff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4488156bf0 con 0x7f44880cbf30 2023-10-09T11:59:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448efff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44880ae950 con 0x7f448815a270 2023-10-09T11:59:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448efff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44880cc300 con 0x7f44880ccf90 2023-10-09T11:59:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44880cbf30 0x7f44880ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44880cbf30 0x7f44880ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39146/0 (socket says 172.21.15.86:39146) 2023-10-09T11:59:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 -- 172.21.15.86:0/3603326398 learned_addr learned my addr 172.21.15.86:0/3603326398 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448d59c700 1 --2- 172.21.15.86:0/3603326398 >> v2:172.21.15.135:3300/0 conn(0x7f448815a270 0x7f44880b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f4487fff700 1 --2- 172.21.15.86:0/3603326398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880ccf90 0x7f44880b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 -- 172.21.15.86:0/3603326398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880ccf90 msgr2=0x7f44880b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 --2- 172.21.15.86:0/3603326398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880ccf90 0x7f44880b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 -- 172.21.15.86:0/3603326398 >> v2:172.21.15.135:3300/0 conn(0x7f448815a270 msgr2=0x7f44880b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 --2- 172.21.15.86:0/3603326398 >> v2:172.21.15.135:3300/0 conn(0x7f448815a270 0x7f44880b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.453+0000 7f448cd9b700 1 -- 172.21.15.86:0/3603326398 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44880ad370 con 0x7f44880cbf30 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448cd9b700 1 --2- 172.21.15.86:0/3603326398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880cbf30 0x7f44880ae410 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f44880b25e0 tx=0x7f447c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0da96399a4951e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f44877fe700 1 -- 172.21.15.86:0/3603326398 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00b820 con 0x7f44880cbf30 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f44877fe700 1 -- 172.21.15.86:0/3603326398 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00b980 con 0x7f44880cbf30 2023-10-09T11:59:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f44877fe700 1 -- 172.21.15.86:0/3603326398 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00bd20 con 0x7f44880cbf30 2023-10-09T11:59:34.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448efff700 1 -- 172.21.15.86:0/3603326398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880cbf30 msgr2=0x7f44880ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448efff700 1 --2- 172.21.15.86:0/3603326398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880cbf30 0x7f44880ae410 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f44880b25e0 tx=0x7f447c009250 comp rx=0 tx=0).stop 2023-10-09T11:59:34.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448efff700 1 -- 172.21.15.86:0/3603326398 shutdown_connections 2023-10-09T11:59:34.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448efff700 1 --2- 172.21.15.86:0/3603326398 >> v2:172.21.15.135:3300/0 conn(0x7f448815a270 0x7f44880b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448efff700 1 --2- 172.21.15.86:0/3603326398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880cbf30 0x7f44880ae410 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448efff700 1 --2- 172.21.15.86:0/3603326398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880ccf90 0x7f44880b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.454+0000 7f448efff700 1 -- 172.21.15.86:0/3603326398 >> 172.21.15.86:0/3603326398 conn(0x7f448806a320 msgr2=0x7f44880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.455+0000 7f448efff700 1 -- 172.21.15.86:0/3603326398 shutdown_connections 2023-10-09T11:59:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.455+0000 7f448efff700 1 -- 172.21.15.86:0/3603326398 wait complete. 2023-10-09T11:59:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.456+0000 7f448efff700 1 Processor -- start 2023-10-09T11:59:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.456+0000 7f448efff700 1 -- start start 2023-10-09T11:59:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f448efff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880cbf30 0x7f448815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f448efff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880ccf90 0x7f4488159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f448efff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f448815a270 0x7f4488153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f448efff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4488160490 con 0x7f44880ccf90 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f448efff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448815f5e0 con 0x7f448815a270 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f448efff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448815f880 con 0x7f44880cbf30 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f4487fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880ccf90 0x7f4488159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f4487fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880ccf90 0x7f4488159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39156/0 (socket says 172.21.15.86:39156) 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f4487fff700 1 -- 172.21.15.86:0/1910865218 learned_addr learned my addr 172.21.15.86:0/1910865218 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.457+0000 7f448cd9b700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880cbf30 0x7f448815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f448d59c700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f448815a270 0x7f4488153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4487fff700 1 -- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880cbf30 msgr2=0x7f448815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4487fff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880cbf30 0x7f448815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4487fff700 1 -- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f448815a270 msgr2=0x7f4488153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4487fff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f448815a270 0x7f4488153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4487fff700 1 -- 172.21.15.86:0/1910865218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0094f0 con 0x7f44880ccf90 2023-10-09T11:59:34.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4487fff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880ccf90 0x7f4488159420 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f447400d890 tx=0x7f4474008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4484ff9700 1 -- 172.21.15.86:0/1910865218 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44740125f0 con 0x7f44880ccf90 2023-10-09T11:59:34.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4484ff9700 1 -- 172.21.15.86:0/1910865218 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4474012770 con 0x7f44880ccf90 2023-10-09T11:59:34.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f4484ff9700 1 -- 172.21.15.86:0/1910865218 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474012b30 con 0x7f44880ccf90 2023-10-09T11:59:34.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.458+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448815fb60 con 0x7f44880ccf90 2023-10-09T11:59:34.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.459+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4488160120 con 0x7f44880ccf90 2023-10-09T11:59:34.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.460+0000 7f4484ff9700 1 -- 172.21.15.86:0/1910865218 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f447401e460 con 0x7f44880ccf90 2023-10-09T11:59:34.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.461+0000 7f4484ff9700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f446c066f30 0x7f446c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.461+0000 7f4484ff9700 1 -- 172.21.15.86:0/1910865218 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f4474084d20 con 0x7f44880ccf90 2023-10-09T11:59:34.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.461+0000 7f448cd9b700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f446c066f30 0x7f446c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.462+0000 7f448cd9b700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f446c066f30 0x7f446c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f44880b25e0 tx=0x7f447c017000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.463+0000 7f449d786b80 1 Processor -- start 2023-10-09T11:59:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.463+0000 7f449d786b80 1 -- start start 2023-10-09T11:59:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.464+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 0x55a033dfce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.464+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033e25a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.464+0000 7f449d786b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.464+0000 7f449d786b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033d53a70 con 0x55a033e25f60 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.464+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033d51270 con 0x55a033e46d00 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.464+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a033d4d060 con 0x55a033dfca50 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39168/0 (socket says 172.21.15.86:39168) 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 -- 172.21.15.86:0/1659553782 learned_addr learned my addr 172.21.15.86:0/1659553782 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448cd9b700 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 0x55a033dfce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f4487fff700 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033e25a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 -- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 msgr2=0x55a033dfce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 0x55a033dfce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 -- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 msgr2=0x55a033e25a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033e25a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 -- 172.21.15.86:0/1659553782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a033be7270 con 0x55a033e25f60 2023-10-09T11:59:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f448d59c700 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df8cf0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4480007370 tx=0x7f4480009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92421afd9aede758 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f4471ffb700 1 -- 172.21.15.86:0/1659553782 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480007e00 con 0x55a033e25f60 2023-10-09T11:59:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f4471ffb700 1 -- 172.21.15.86:0/1659553782 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480014590 con 0x55a033e25f60 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.465+0000 7f4471ffb700 1 -- 172.21.15.86:0/1659553782 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480014910 con 0x55a033e25f60 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 -- 172.21.15.86:0/1659553782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 msgr2=0x55a033df8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df8cf0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4480007370 tx=0x7f4480009850 comp rx=0 tx=0).stop 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 -- 172.21.15.86:0/1659553782 shutdown_connections 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df8cf0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 0x55a033dfce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 --2- 172.21.15.86:0/1659553782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033e25a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 -- 172.21.15.86:0/1659553782 >> 172.21.15.86:0/1659553782 conn(0x55a033dfe370 msgr2=0x55a033dfe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 -- 172.21.15.86:0/1659553782 shutdown_connections 2023-10-09T11:59:34.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.466+0000 7f449d786b80 1 -- 172.21.15.86:0/1659553782 wait complete. 2023-10-09T11:59:34.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.467+0000 7f449d786b80 1 -- start start 2023-10-09T11:59:34.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.467+0000 7f449d786b80 1 Processor -- start 2023-10-09T11:59:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 0x55a033e43ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f449d786b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033df8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f449d786b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033cf8890 con 0x55a033e25f60 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033d13ea0 con 0x55a033e46d00 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a033bcfe30 con 0x55a033dfca50 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f449d786b80 10 client.0 _ll_register_callbacks cb 0x55a033dc0110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f4487fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f4487fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39170/0 (socket says 172.21.15.86:39170) 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.468+0000 7f4487fff700 1 -- 172.21.15.86:0/3467035050 learned_addr learned my addr 172.21.15.86:0/3467035050 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4487fff700 1 -- 172.21.15.86:0/3467035050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 msgr2=0x55a033e43ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f448d59c700 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033df8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4487fff700 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 0x55a033e43ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4487fff700 1 -- 172.21.15.86:0/3467035050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 msgr2=0x55a033df8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4487fff700 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033df8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4487fff700 1 -- 172.21.15.86:0/3467035050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4480011040 con 0x55a033e25f60 2023-10-09T11:59:34.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4487fff700 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df7f10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f44740559c0 tx=0x7f4474082f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ae2945c17821cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4466ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:59:34.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4466ffd700 1 -- 172.21.15.86:0/3467035050 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474055570 con 0x55a033e25f60 2023-10-09T11:59:34.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4466ffd700 1 -- 172.21.15.86:0/3467035050 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f4474058c80 con 0x55a033e25f60 2023-10-09T11:59:34.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a033df1b70 con 0x55a033e25f60 2023-10-09T11:59:34.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4466ffd700 1 -- 172.21.15.86:0/3467035050 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f447405c9d0 con 0x55a033e25f60 2023-10-09T11:59:34.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f449d786b80 10 client.7821 fetch_fsmap learned FSMap version 54 2023-10-09T11:59:34.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55a033b89fe0 con 0x55a033e25f60 2023-10-09T11:59:34.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4466ffd700 1 -- 172.21.15.86:0/3467035050 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4474060030 con 0x55a033e25f60 2023-10-09T11:59:34.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.469+0000 7f4466ffd700 1 -- 172.21.15.86:0/3467035050 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f447405c540 con 0x55a033e25f60 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f449d786b80 10 client.7821 fetch_fsmap finished waiting for FSMap version 54 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f449d786b80 10 client.7821 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f449d786b80 20 client.7821 populate_metadata read hostname 'smithi086' 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f449d786b80 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e3d490 0x55a033e3d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f449d786b80 4 client.7821 mds_command: new command op to 7183 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 --> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a033dceaa0 con 0x55a033e3d490 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f448cd9b700 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e3d490 0x55a033e3d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f448cd9b700 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e3d490 0x55a033e3d860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=319489d8d77a99e2 server_cookie=ae4543025152662c in_seq=0 out_seq=0 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.470+0000 7f4466ffd700 10 client.7821 ms_handle_connect on v2:172.21.15.86:6834/1465588551 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f4466ffd700 1 -- 172.21.15.86:0/3467035050 <== mds.0 v2:172.21.15.86:6834/1465588551 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a033dceaa0 con 0x55a033e3d490 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f4466ffd700 10 client.7821 handle_command_reply: tid=0 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 client.7821 shutdown 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 msgr2=0x55a033df7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df7f10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f44740559c0 tx=0x7f4474082f80 comp rx=0 tx=0).stop 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 shutdown_connections 2023-10-09T11:59:34.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e3d490 0x55a033e3d860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033df8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033dfca50 0x55a033e43ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f4466ffd700 0 client.7821 ms_handle_reset on v2:172.21.15.86:6834/1465588551 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 --2- 172.21.15.86:0/3467035050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033df7f10 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.471+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 >> 172.21.15.86:0/3467035050 conn(0x55a033dfe370 msgr2=0x55a033df9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.472+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 shutdown_connections 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.472+0000 7f449d786b80 1 -- 172.21.15.86:0/3467035050 wait complete. 2023-10-09T11:59:34.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.472+0000 7f449d786b80 20 client.7821 trim_cache size 0 max 16384 2023-10-09T11:59:34.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.489+0000 7f449d786b80 1 Processor -- start 2023-10-09T11:59:34.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.489+0000 7f449d786b80 1 -- start start 2023-10-09T11:59:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033dfca50 0x55a033dfe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f449d786b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033e250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e46d00 0x55a033e255f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f449d786b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033df75a0 con 0x55a033e25f60 2023-10-09T11:59:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033ddc510 con 0x55a033dfca50 2023-10-09T11:59:34.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a033dd5410 con 0x55a033e46d00 2023-10-09T11:59:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f4487fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033e250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f4487fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033e250b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39174/0 (socket says 172.21.15.86:39174) 2023-10-09T11:59:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f4487fff700 1 -- 172.21.15.86:0/3136764765 learned_addr learned my addr 172.21.15.86:0/3136764765 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f448cd9b700 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033dfca50 0x55a033dfe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.490+0000 7f448d59c700 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e46d00 0x55a033e255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f4487fff700 1 -- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e46d00 msgr2=0x55a033e255f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f4487fff700 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e46d00 0x55a033e255f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f4487fff700 1 -- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033dfca50 msgr2=0x55a033dfe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f4487fff700 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033dfca50 0x55a033dfe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f4487fff700 1 -- 172.21.15.86:0/3136764765 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a033d1b780 con 0x55a033e25f60 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f448cd9b700 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033dfca50 0x55a033dfe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f4487fff700 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033e250b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f44740075e0 tx=0x7f447406f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dc2fa73e0c4b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f44727fc700 1 -- 172.21.15.86:0/3136764765 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474055570 con 0x55a033e25f60 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f44727fc700 1 -- 172.21.15.86:0/3136764765 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4474060030 con 0x55a033e25f60 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f44727fc700 1 -- 172.21.15.86:0/3136764765 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474058c80 con 0x55a033e25f60 2023-10-09T11:59:34.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f449d786b80 1 -- 172.21.15.86:0/3136764765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 msgr2=0x55a033e250b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.491+0000 7f449d786b80 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033e250b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f44740075e0 tx=0x7f447406f000 comp rx=0 tx=0).stop 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 -- 172.21.15.86:0/3136764765 shutdown_connections 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e46d00 0x55a033e255f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033dfca50 0x55a033dfe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 --2- 172.21.15.86:0/3136764765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033e25f60 0x55a033e250b0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 -- 172.21.15.86:0/3136764765 >> 172.21.15.86:0/3136764765 conn(0x55a033dfe370 msgr2=0x55a033df54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 -- 172.21.15.86:0/3136764765 shutdown_connections 2023-10-09T11:59:34.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 -- 172.21.15.86:0/3136764765 wait complete. 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 -- start start 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.492+0000 7f449d786b80 1 Processor -- start 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.493+0000 7f449d786b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033dfca50 0x55a033eb1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.493+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e25f60 0x55a033e250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.493+0000 7f449d786b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033e255f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.493+0000 7f449d786b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033eb3030 con 0x55a033dfca50 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.493+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a033e21650 con 0x55a033e46d00 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.493+0000 7f449d786b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a033eb1a40 con 0x55a033e25f60 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.493+0000 7f449d786b80 10 client.0 _ll_register_callbacks cb 0x55a033dc0110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:59:34.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033dfca50 0x55a033eb1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033dfca50 0x55a033eb1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39186/0 (socket says 172.21.15.86:39186) 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 -- 172.21.15.86:0/2854817901 learned_addr learned my addr 172.21.15.86:0/2854817901 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 -- 172.21.15.86:0/2854817901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e25f60 msgr2=0x55a033e250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e25f60 0x55a033e250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 -- 172.21.15.86:0/2854817901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 msgr2=0x55a033e255f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033e255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 -- 172.21.15.86:0/2854817901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a033b89fe0 con 0x55a033dfca50 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f448cd9b700 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033dfca50 0x55a033eb1500 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f4488064290 tx=0x7f447c02a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e3f4878e065fd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.494+0000 7f4466ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f4466ffd700 1 -- 172.21.15.86:0/2854817901 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c021070 con 0x55a033dfca50 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f4466ffd700 1 -- 172.21.15.86:0/2854817901 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f447c011e20 con 0x55a033dfca50 2023-10-09T11:59:34.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f448816daa0 con 0x55a033dfca50 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f4466ffd700 1 -- 172.21.15.86:0/2854817901 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f447c03de90 con 0x55a033dfca50 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 10 client.7827 fetch_fsmap learned FSMap version 54 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55a033d02470 con 0x55a033dfca50 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f4466ffd700 1 -- 172.21.15.86:0/2854817901 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448816daa0 con 0x55a033dfca50 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f4466ffd700 1 -- 172.21.15.86:0/2854817901 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f447c03c440 con 0x55a033dfca50 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 10 client.7827 fetch_fsmap finished waiting for FSMap version 54 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 10 client.7827 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 20 client.7827 populate_metadata read hostname 'smithi086' 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e475d0 0x55a033e479c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 4 client.7827 mds_command: new command op to 7183 tid=0[{"prefix": "status"}] 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 --> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f4480014590 con 0x55a033e475d0 2023-10-09T11:59:34.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.495+0000 7f4487fff700 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e475d0 0x55a033e479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f4487fff700 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e475d0 0x55a033e479c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=861d9630686a90a2 server_cookie=1f11b32189c88f5a in_seq=0 out_seq=0 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f4466ffd700 10 client.7827 ms_handle_connect on v2:172.21.15.86:6834/1465588551 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f4466ffd700 1 -- 172.21.15.86:0/2854817901 <== mds.0 v2:172.21.15.86:6834/1465588551 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f4480014590 con 0x55a033e475d0 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f4466ffd700 10 client.7827 handle_command_reply: tid=0 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 client.7827 shutdown 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033dfca50 msgr2=0x55a033eb1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033dfca50 0x55a033eb1500 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f4488064290 tx=0x7f447c02a040 comp rx=0 tx=0).stop 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 shutdown_connections 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:6834/1465588551,v1:172.21.15.86:6835/1465588551] conn(0x55a033e475d0 0x55a033e479c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a033dfca50 0x55a033eb1500 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a033e46d00 0x55a033e255f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f4466ffd700 0 client.7827 ms_handle_reset on v2:172.21.15.86:6834/1465588551 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 --2- 172.21.15.86:0/2854817901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55a033e25f60 0x55a033e250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 >> 172.21.15.86:0/2854817901 conn(0x55a033dfe370 msgr2=0x55a033df54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 shutdown_connections 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.496+0000 7f449d786b80 1 -- 172.21.15.86:0/2854817901 wait complete. 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f449d786b80 20 client.7827 trim_cache size 0 max 16384 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T11:59:34.503 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 7183, 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.190882050000001, 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 54, 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 124, 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 124, 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 17.387008473000002 2023-10-09T11:59:34.504 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T11:59:34.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f446c066f30 msgr2=0x7f446c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f446c066f30 0x7f446c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f44880b25e0 tx=0x7f447c017000 comp rx=0 tx=0).stop 2023-10-09T11:59:34.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880ccf90 msgr2=0x7f4488159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880ccf90 0x7f4488159420 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f447400d890 tx=0x7f4474008040 comp rx=0 tx=0).stop 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 shutdown_connections 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f448815a270 0x7f4488153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44880cbf30 0x7f448815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f446c066f30 0x7f446c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 --2- 172.21.15.86:0/1910865218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44880ccf90 0x7f4488159420 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 >> 172.21.15.86:0/1910865218 conn(0x7f448806a320 msgr2=0x7f4488068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 shutdown_connections 2023-10-09T11:59:34.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.497+0000 7f448efff700 1 -- 172.21.15.86:0/1910865218 wait complete. 2023-10-09T11:59:34.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:59:34.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.693+0000 7ff694dff700 1 Processor -- start 2023-10-09T11:59:34.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.693+0000 7ff694dff700 1 -- start start 2023-10-09T11:59:34.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.694+0000 7ff694dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6901578b0 0x7ff690155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.694+0000 7ff694dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6900af2f0 0x7ff6900af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff694dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6900ad930 con 0x7ff690155c10 2023-10-09T11:59:34.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff694dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6900acd20 con 0x7ff6900af2f0 2023-10-09T11:59:34.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff694dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6900ad000 con 0x7ff6901578b0 2023-10-09T11:59:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff68ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6900af2f0 0x7ff6900af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff68ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6900af2f0 0x7ff6900af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39194/0 (socket says 172.21.15.86:39194) 2023-10-09T11:59:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff68ed9d700 1 -- 172.21.15.86:0/1511455487 learned_addr learned my addr 172.21.15.86:0/1511455487 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff687fff700 1 --2- 172.21.15.86:0/1511455487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6901578b0 0x7ff690155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff68ed9d700 1 -- 172.21.15.86:0/1511455487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6901578b0 msgr2=0x7ff690155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:34.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff68ed9d700 1 --2- 172.21.15.86:0/1511455487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6901578b0 0x7ff690155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff68ed9d700 1 -- 172.21.15.86:0/1511455487 >> v1:172.21.15.135:6789/0 conn(0x7ff690155c10 legacy=0x7ff6900ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.695+0000 7ff68ed9d700 1 -- 172.21.15.86:0/1511455487 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900ad2e0 con 0x7ff6900af2f0 2023-10-09T11:59:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff68ed9d700 1 --2- 172.21.15.86:0/1511455487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6900af2f0 0x7ff6900af710 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff688009f20 tx=0x7ff688009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3461db21b76c76dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff68dd9b700 1 -- 172.21.15.86:0/1511455487 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68800e070 con 0x7ff6900af2f0 2023-10-09T11:59:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff68dd9b700 1 -- 172.21.15.86:0/1511455487 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68800ba80 con 0x7ff6900af2f0 2023-10-09T11:59:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff68dd9b700 1 -- 172.21.15.86:0/1511455487 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6880092e0 con 0x7ff6900af2f0 2023-10-09T11:59:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 -- 172.21.15.86:0/1511455487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6900af2f0 msgr2=0x7ff6900af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 --2- 172.21.15.86:0/1511455487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6900af2f0 0x7ff6900af710 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff688009f20 tx=0x7ff688009840 comp rx=0 tx=0).stop 2023-10-09T11:59:34.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 -- 172.21.15.86:0/1511455487 shutdown_connections 2023-10-09T11:59:34.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 --2- 172.21.15.86:0/1511455487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6900af2f0 0x7ff6900af710 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 --2- 172.21.15.86:0/1511455487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6901578b0 0x7ff690155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 -- 172.21.15.86:0/1511455487 >> 172.21.15.86:0/1511455487 conn(0x7ff69006a320 msgr2=0x7ff6900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 -- 172.21.15.86:0/1511455487 shutdown_connections 2023-10-09T11:59:34.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.696+0000 7ff694dff700 1 -- 172.21.15.86:0/1511455487 wait complete. 2023-10-09T11:59:34.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.698+0000 7ff694dff700 1 Processor -- start 2023-10-09T11:59:34.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.698+0000 7ff694dff700 1 -- start start 2023-10-09T11:59:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff694dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6900af2f0 0x7ff69016a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff694dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff690155c10 0x7ff690152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff694dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6901578b0 0x7ff6900a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff694dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69016af10 con 0x7ff6901578b0 2023-10-09T11:59:34.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff694dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69015afe0 con 0x7ff6900af2f0 2023-10-09T11:59:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff694dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69016d550 con 0x7ff690155c10 2023-10-09T11:59:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff68ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6901578b0 0x7ff6900a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff68ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6901578b0 0x7ff6900a6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39204/0 (socket says 172.21.15.86:39204) 2023-10-09T11:59:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff68ed9d700 1 -- 172.21.15.86:0/901975861 learned_addr learned my addr 172.21.15.86:0/901975861 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff687fff700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff690155c10 0x7ff690152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.699+0000 7ff68e59c700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6900af2f0 0x7ff69016a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff68ed9d700 1 -- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff690155c10 msgr2=0x7ff690152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff68ed9d700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff690155c10 0x7ff690152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff68ed9d700 1 -- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6900af2f0 msgr2=0x7ff69016a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff68ed9d700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6900af2f0 0x7ff69016a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff68ed9d700 1 -- 172.21.15.86:0/901975861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688009ae0 con 0x7ff6901578b0 2023-10-09T11:59:34.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff68ed9d700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6901578b0 0x7ff6900a6f60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff68800b6c0 tx=0x7ff688018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff6867fc700 1 -- 172.21.15.86:0/901975861 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6880032f0 con 0x7ff6901578b0 2023-10-09T11:59:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff6867fc700 1 -- 172.21.15.86:0/901975861 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff688008d20 con 0x7ff6901578b0 2023-10-09T11:59:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff6867fc700 1 -- 172.21.15.86:0/901975861 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff688026670 con 0x7ff6901578b0 2023-10-09T11:59:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69015b230 con 0x7ff6901578b0 2023-10-09T11:59:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.700+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69016d7a0 con 0x7ff6901578b0 2023-10-09T11:59:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.701+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6900b18c0 con 0x7ff6901578b0 2023-10-09T11:59:34.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.702+0000 7ff6867fc700 1 -- 172.21.15.86:0/901975861 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff688003040 con 0x7ff6901578b0 2023-10-09T11:59:34.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.703+0000 7ff6867fc700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff670066f30 0x7ff6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:34.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.704+0000 7ff6867fc700 1 -- 172.21.15.86:0/901975861 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7ff6880863a0 con 0x7ff6901578b0 2023-10-09T11:59:34.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.704+0000 7ff68e59c700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff670066f30 0x7ff6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:34.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.704+0000 7ff68e59c700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff670066f30 0x7ff6700693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff69015ea30 tx=0x7ff680009040 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:34.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.708+0000 7ff6867fc700 1 -- 172.21.15.86:0/901975861 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6880534a0 con 0x7ff6901578b0 2023-10-09T11:59:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.941+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6900b1d60 con 0x7ff6901578b0 2023-10-09T11:59:34.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.941+0000 7ff6867fc700 1 -- 172.21.15.86:0/901975861 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff688056ac0 con 0x7ff6901578b0 2023-10-09T11:59:34.942 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:59:34.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.943+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff670066f30 msgr2=0x7ff6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.943+0000 7ff694dff700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff670066f30 0x7ff6700693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff69015ea30 tx=0x7ff680009040 comp rx=0 tx=0).stop 2023-10-09T11:59:34.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.943+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6901578b0 msgr2=0x7ff6900a6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:34.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.943+0000 7ff694dff700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6901578b0 0x7ff6900a6f60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff68800b6c0 tx=0x7ff688018000 comp rx=0 tx=0).stop 2023-10-09T11:59:34.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 shutdown_connections 2023-10-09T11:59:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff670066f30 0x7ff6700693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6901578b0 0x7ff6900a6f60 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6900af2f0 0x7ff69016a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 --2- 172.21.15.86:0/901975861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff690155c10 0x7ff690152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 >> 172.21.15.86:0/901975861 conn(0x7ff69006a320 msgr2=0x7ff690154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 shutdown_connections 2023-10-09T11:59:34.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:34.944+0000 7ff694dff700 1 -- 172.21.15.86:0/901975861 wait complete. 2023-10-09T11:59:34.961 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:59:34.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:59:34.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T11:59:34.961 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:59:34.962 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:59:34.962 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:59:34.962 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:59:34.962 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:59:34.962 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:59:34.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:34.963 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T11:59:34.999 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:59:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:59:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:59:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:59:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T11:59:34.999 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:59:35.000 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:59:35.001 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:59:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:59:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:59:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41168sec preferred_lft 41168sec 2023-10-09T11:59:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T11:59:35.001 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:59:35.001 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:59:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:59:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:59:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:59:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T11:59:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:59:35.002 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:59:35.002 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:59:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T11:59:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:59:35.003 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:59:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:59:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T11:59:35.003 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:59:35.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:35.003 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:59:35.097 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T11:59:35.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:35.100 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T11:59:35.138 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T11:59:35.138 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:59:35.138 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:59:35.138 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:59:35.138 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:59:35.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:35.139 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T11:59:35.140 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T11:59:35.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:59:35.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:59:35.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:59:35.140 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T11:59:35.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:35.334 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T11:59:35.370 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:59:35.371 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:59:35.371 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:59:35.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:35.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T11:59:35.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:59:35.472 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:59:35.508 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:59:35.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:59:35.509 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:59:35.584 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:59:35.584 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:59:35.585 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:59:35.715 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:59:35.716 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:59:35.744 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:59:35.744 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:59:35.744 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T11:59:35.744 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T11:59:35.745 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T11:59:35.748 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:59:35.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:59:35.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:59:35.809 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T11:59:35.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.991+0000 7faa8359e700 1 Processor -- start 2023-10-09T11:59:35.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.991+0000 7faa8359e700 1 -- start start 2023-10-09T11:59:35.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faa84159420 0x7faa840b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:35.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faa8415d230 0x7faa8415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:35.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa840b2980 con 0x7faa841597f0 2023-10-09T11:59:35.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8415db70 con 0x7faa84159420 2023-10-09T11:59:35.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa840b11d0 con 0x7faa8415d230 2023-10-09T11:59:35.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faa84159420 0x7faa840b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:35.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faa84159420 0x7faa840b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58988/0 (socket says 172.21.15.86:58988) 2023-10-09T11:59:35.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.992+0000 7faa8259c700 1 -- 172.21.15.86:0/2563740277 learned_addr learned my addr 172.21.15.86:0/2563740277 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:35.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa82d9d700 1 --2- 172.21.15.86:0/2563740277 >> v2:172.21.15.135:3300/0 conn(0x7faa8415d230 0x7faa8415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:35.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8259c700 1 -- 172.21.15.86:0/2563740277 >> v2:172.21.15.135:3300/0 conn(0x7faa8415d230 msgr2=0x7faa8415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8259c700 1 --2- 172.21.15.86:0/2563740277 >> v2:172.21.15.135:3300/0 conn(0x7faa8415d230 0x7faa8415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8259c700 1 -- 172.21.15.86:0/2563740277 >> v1:172.21.15.135:6789/0 conn(0x7faa841597f0 legacy=0x7faa840b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8259c700 1 -- 172.21.15.86:0/2563740277 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840b14b0 con 0x7faa84159420 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa82d9d700 1 --2- 172.21.15.86:0/2563740277 >> v2:172.21.15.135:3300/0 conn(0x7faa8415d230 0x7faa8415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8259c700 1 --2- 172.21.15.86:0/2563740277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa84159420 0x7faa840b5f40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7faa8415d170 tx=0x7faa74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad3608bcb84ab5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8159a700 1 -- 172.21.15.86:0/2563740277 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400b820 con 0x7faa84159420 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8159a700 1 -- 172.21.15.86:0/2563740277 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400b980 con 0x7faa84159420 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.993+0000 7faa8159a700 1 -- 172.21.15.86:0/2563740277 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400bd20 con 0x7faa84159420 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 -- 172.21.15.86:0/2563740277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa84159420 msgr2=0x7faa840b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 --2- 172.21.15.86:0/2563740277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa84159420 0x7faa840b5f40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7faa8415d170 tx=0x7faa74009250 comp rx=0 tx=0).stop 2023-10-09T11:59:35.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 -- 172.21.15.86:0/2563740277 shutdown_connections 2023-10-09T11:59:35.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 --2- 172.21.15.86:0/2563740277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa84159420 0x7faa840b5f40 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:35.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 --2- 172.21.15.86:0/2563740277 >> v2:172.21.15.135:3300/0 conn(0x7faa8415d230 0x7faa8415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:35.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 -- 172.21.15.86:0/2563740277 >> 172.21.15.86:0/2563740277 conn(0x7faa840d0660 msgr2=0x7faa840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:35.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 -- 172.21.15.86:0/2563740277 shutdown_connections 2023-10-09T11:59:35.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.994+0000 7faa8359e700 1 -- 172.21.15.86:0/2563740277 wait complete. 2023-10-09T11:59:35.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.995+0000 7faa8359e700 1 Processor -- start 2023-10-09T11:59:35.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.996+0000 7faa8359e700 1 -- start start 2023-10-09T11:59:35.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.996+0000 7faa8359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa84159420 0x7faa840cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:35.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.996+0000 7faa8359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa841597f0 0x7faa8415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.996+0000 7faa8359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa8415d230 0x7faa84169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.996+0000 7faa8359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8415b1b0 con 0x7faa8415d230 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa8359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8415b450 con 0x7faa841597f0 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa8359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8415b730 con 0x7faa84159420 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa8415d230 0x7faa84169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa8415d230 0x7faa84169d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58996/0 (socket says 172.21.15.86:58996) 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 -- 172.21.15.86:0/3731749941 learned_addr learned my addr 172.21.15.86:0/3731749941 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa81d9b700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa841597f0 0x7faa8415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa8259c700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa84159420 0x7faa840cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:35.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 -- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa84159420 msgr2=0x7faa840cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:35.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa84159420 0x7faa840cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:35.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 -- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa841597f0 msgr2=0x7faa8415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:35.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa841597f0 0x7faa8415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:35.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 -- 172.21.15.86:0/3731749941 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa740094f0 con 0x7faa8415d230 2023-10-09T11:59:35.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.997+0000 7faa82d9d700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa8415d230 0x7faa84169d00 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00cef0 tx=0x7faa7c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:36.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.998+0000 7faa727fc700 1 -- 172.21.15.86:0/3731749941 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c00ae00 con 0x7faa8415d230 2023-10-09T11:59:36.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.998+0000 7faa727fc700 1 -- 172.21.15.86:0/3731749941 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c016420 con 0x7faa8415d230 2023-10-09T11:59:36.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.998+0000 7faa727fc700 1 -- 172.21.15.86:0/3731749941 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c0167e0 con 0x7faa8415d230 2023-10-09T11:59:36.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.998+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8415ba10 con 0x7faa8415d230 2023-10-09T11:59:36.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.998+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8415bfd0 con 0x7faa8415d230 2023-10-09T11:59:36.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:35.999+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8404c3c0 con 0x7faa8415d230 2023-10-09T11:59:36.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.000+0000 7faa727fc700 1 -- 172.21.15.86:0/3731749941 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa7c016bd0 con 0x7faa8415d230 2023-10-09T11:59:36.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.000+0000 7faa727fc700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:36.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.001+0000 7faa727fc700 1 -- 172.21.15.86:0/3731749941 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7faa7c012070 con 0x7faa8415d230 2023-10-09T11:59:36.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.001+0000 7faa8259c700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:36.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.001+0000 7faa8259c700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa64066f30 0x7faa640693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa8415d170 tx=0x7faa74016000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:36.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.004+0000 7faa727fc700 1 -- 172.21.15.86:0/3731749941 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa7c04e5a0 con 0x7faa8415d230 2023-10-09T11:59:36.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.229+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faa840b1790 con 0x7faa64066f30 2023-10-09T11:59:36.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.230+0000 7faa727fc700 1 -- 172.21.15.86:0/3731749941 <== mgr.7479 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7faa840b1790 con 0x7faa64066f30 2023-10-09T11:59:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T11:59:36.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T11:59:36.231 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T11:59:36.231 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T11:59:36.231 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T11:59:36.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa64066f30 msgr2=0x7faa640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa64066f30 0x7faa640693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa8415d170 tx=0x7faa74016000 comp rx=0 tx=0).stop 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa8415d230 msgr2=0x7faa84169d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa8415d230 0x7faa84169d00 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00cef0 tx=0x7faa7c007860 comp rx=0 tx=0).stop 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 shutdown_connections 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa8415d230 0x7faa84169d00 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa84159420 0x7faa840cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 --2- 172.21.15.86:0/3731749941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa841597f0 0x7faa8415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 >> 172.21.15.86:0/3731749941 conn(0x7faa840d0660 msgr2=0x7faa840ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:36.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 shutdown_connections 2023-10-09T11:59:36.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.233+0000 7faa8359e700 1 -- 172.21.15.86:0/3731749941 wait complete. 2023-10-09T11:59:36.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T11:59:36.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.435+0000 7f5ce2f9d700 1 Processor -- start 2023-10-09T11:59:36.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.435+0000 7f5ce2f9d700 1 -- start start 2023-10-09T11:59:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.436+0000 7f5ce2f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5cdc0cb1a0 0x7f5cdc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.436+0000 7f5ce2f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15a8a0 0x7f5cdc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.436+0000 7f5ce2f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc06ebd0 con 0x7f5cdc06f5a0 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.436+0000 7f5ce2f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc15b2e0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.436+0000 7f5ce2f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc15ad20 con 0x7f5cdc15a8a0 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5cdc0cb1a0 0x7f5cdc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5cdc0cb1a0 0x7f5cdc15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59008/0 (socket says 172.21.15.86:59008) 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 -- 172.21.15.86:0/484766859 learned_addr learned my addr 172.21.15.86:0/484766859 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce179a700 1 --2- 172.21.15.86:0/484766859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15a8a0 0x7f5cdc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 -- 172.21.15.86:0/484766859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15a8a0 msgr2=0x7f5cdc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 --2- 172.21.15.86:0/484766859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15a8a0 0x7f5cdc06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 -- 172.21.15.86:0/484766859 >> v1:172.21.15.135:6789/0 conn(0x7f5cdc06f5a0 legacy=0x7f5cdc0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 -- 172.21.15.86:0/484766859 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc15b000 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.437+0000 7f5ce1f9b700 1 --2- 172.21.15.86:0/484766859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15a360 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80099b0 tx=0x7f5cd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bc1b8d567b706d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce0f99700 1 -- 172.21.15.86:0/484766859 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800b8f0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce0f99700 1 -- 172.21.15.86:0/484766859 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd800ba50 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce0f99700 1 -- 172.21.15.86:0/484766859 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800bdf0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/484766859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 msgr2=0x7f5cdc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/484766859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15a360 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80099b0 tx=0x7f5cd8009250 comp rx=0 tx=0).stop 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/484766859 shutdown_connections 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/484766859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15a360 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/484766859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15a8a0 0x7f5cdc06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/484766859 >> 172.21.15.86:0/484766859 conn(0x7f5cdc0cc1e0 msgr2=0x7f5cdc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/484766859 shutdown_connections 2023-10-09T11:59:36.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.438+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/484766859 wait complete. 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.440+0000 7f5ce2f9d700 1 Processor -- start 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.440+0000 7f5ce2f9d700 1 -- start start 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce2f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cdc06f5a0 0x7f5cdc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce2f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce2f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15c0b0 0x7f5cdc16a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce2f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0a59b0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce2f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc15d240 con 0x7f5cdc06f5a0 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce2f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc15c630 con 0x7f5cdc15c0b0 2023-10-09T11:59:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce179a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce179a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59024/0 (socket says 172.21.15.86:59024) 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce179a700 1 -- 172.21.15.86:0/371425776 learned_addr learned my addr 172.21.15.86:0/371425776 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce1f9b700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cdc06f5a0 0x7f5cdc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.441+0000 7f5ce279c700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15c0b0 0x7f5cdc16a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce179a700 1 -- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15c0b0 msgr2=0x7f5cdc16a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce179a700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15c0b0 0x7f5cdc16a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce179a700 1 -- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cdc06f5a0 msgr2=0x7f5cdc15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce179a700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cdc06f5a0 0x7f5cdc15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce179a700 1 -- 172.21.15.86:0/371425776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd80094f0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce1f9b700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cdc06f5a0 0x7f5cdc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce179a700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15bb70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00d860 tx=0x7f5ccc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:36.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0125f0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc012750 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc012b10 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc15c910 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.442+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc15ced0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.443+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc15d3f0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.444+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 53) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ccc01e460 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.445+0000 7f5cd1ffb700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5cc0066fb0 0x7f5cc0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.445+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f5ccc084de0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.445+0000 7f5ce1f9b700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5cc0066fb0 0x7f5cc0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:36.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.446+0000 7f5ce1f9b700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5cc0066fb0 0x7f5cc0069460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80099b0 tx=0x7f5cd8017000 comp rx=0 tx=0).ready entity=mgr.7479 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:36.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.448+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cdc15d3f0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:36.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:36.689+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f5cdc15d3b0 con 0x7f5cdc0cb1a0 2023-10-09T11:59:37.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.362+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f5ccc052200 con 0x7f5cdc0cb1a0 2023-10-09T11:59:37.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.363+0000 7f5cd1ffb700 1 -- 172.21.15.86:0/371425776 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v54) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5ccc055630 con 0x7f5cdc0cb1a0 2023-10-09T11:59:37.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5cc0066fb0 msgr2=0x7f5cc0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5cc0066fb0 0x7f5cc0069460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80099b0 tx=0x7f5cd8017000 comp rx=0 tx=0).stop 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 msgr2=0x7f5cdc15bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15bb70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00d860 tx=0x7f5ccc008040 comp rx=0 tx=0).stop 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 shutdown_connections 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cdc15c0b0 0x7f5cdc16a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cdc06f5a0 0x7f5cdc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5cc0066fb0 0x7f5cc0069460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 --2- 172.21.15.86:0/371425776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cdc0cb1a0 0x7f5cdc15bb70 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 >> 172.21.15.86:0/371425776 conn(0x7f5cdc0cc1e0 msgr2=0x7f5cdc0cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:37.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 shutdown_connections 2023-10-09T11:59:37.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.366+0000 7f5ce2f9d700 1 -- 172.21.15.86:0/371425776 wait complete. 2023-10-09T11:59:37.385 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T11:59:37.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.576+0000 7fad1619d700 1 Processor -- start 2023-10-09T11:59:37.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.577+0000 7fad1619d700 1 -- start start 2023-10-09T11:59:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad1015a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1619d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fad100aef00 0x7fad1015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1619d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fad1006e470 0x7fad1006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1619d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1006ee30 con 0x7fad100aef00 2023-10-09T11:59:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1619d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad100aea70 con 0x7fad1006e470 2023-10-09T11:59:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad100ae480 con 0x7fad1015a3b0 2023-10-09T11:59:37.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fad100aef00 0x7fad1015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fad100aef00 0x7fad1015d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59048/0 (socket says 172.21.15.86:59048) 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1499a700 1 -- 172.21.15.86:0/4256934759 learned_addr learned my addr 172.21.15.86:0/4256934759 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1599c700 1 --2- 172.21.15.86:0/4256934759 >> v2:172.21.15.135:3300/0 conn(0x7fad1006e470 0x7fad1006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.578+0000 7fad1519b700 1 --2- 172.21.15.86:0/4256934759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad1015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad1499a700 1 -- 172.21.15.86:0/4256934759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 msgr2=0x7fad1015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad1499a700 1 --2- 172.21.15.86:0/4256934759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad1015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad1499a700 1 -- 172.21.15.86:0/4256934759 >> v2:172.21.15.135:3300/0 conn(0x7fad1006e470 msgr2=0x7fad1006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad1499a700 1 --2- 172.21.15.86:0/4256934759 >> v2:172.21.15.135:3300/0 conn(0x7fad1006e470 0x7fad1006e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad1499a700 1 -- 172.21.15.86:0/4256934759 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1015acc0 con 0x7fad100aef00 2023-10-09T11:59:37.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad1599c700 1 --2- 172.21.15.86:0/4256934759 >> v2:172.21.15.135:3300/0 conn(0x7fad1006e470 0x7fad1006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad1499a700 1 --2- 172.21.15.86:0/4256934759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad1015d3c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fad100c9470 tx=0x7fad00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece1473740938003 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad07fff700 1 -- 172.21.15.86:0/4256934759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000b640 con 0x7fad100aef00 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad07fff700 1 -- 172.21.15.86:0/4256934759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000b7a0 con 0x7fad100aef00 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.579+0000 7fad07fff700 1 -- 172.21.15.86:0/4256934759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000bb60 con 0x7fad100aef00 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 -- 172.21.15.86:0/4256934759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 msgr2=0x7fad1015d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 --2- 172.21.15.86:0/4256934759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad1015d3c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fad100c9470 tx=0x7fad00009250 comp rx=0 tx=0).stop 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 -- 172.21.15.86:0/4256934759 shutdown_connections 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 --2- 172.21.15.86:0/4256934759 >> v2:172.21.15.135:3300/0 conn(0x7fad1006e470 0x7fad1006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 --2- 172.21.15.86:0/4256934759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad1015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 --2- 172.21.15.86:0/4256934759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad1015d3c0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 -- 172.21.15.86:0/4256934759 >> 172.21.15.86:0/4256934759 conn(0x7fad100c9f70 msgr2=0x7fad1006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:37.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 -- 172.21.15.86:0/4256934759 shutdown_connections 2023-10-09T11:59:37.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.580+0000 7fad1619d700 1 -- 172.21.15.86:0/4256934759 wait complete. 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.582+0000 7fad1619d700 1 Processor -- start 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.582+0000 7fad1619d700 1 -- start start 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1619d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad1006e470 0x7fad10152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1619d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad10157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad100c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1619d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad10158c60 con 0x7fad100aef00 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1619d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad101580e0 con 0x7fad1006e470 2023-10-09T11:59:37.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad101583c0 con 0x7fad1015a3b0 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad10157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad10157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59056/0 (socket says 172.21.15.86:59056) 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1499a700 1 -- 172.21.15.86:0/2394465397 learned_addr learned my addr 172.21.15.86:0/2394465397 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1519b700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad1006e470 0x7fad10152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.583+0000 7fad1599c700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad100c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1519b700 1 -- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 msgr2=0x7fad100c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1519b700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad100c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1519b700 1 -- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 msgr2=0x7fad10157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1519b700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad10157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1519b700 1 -- 172.21.15.86:0/2394465397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08009a20 con 0x7fad1006e470 2023-10-09T11:59:37.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1499a700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad10157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:37.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1519b700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad1006e470 0x7fad10152750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00e900 tx=0x7fad0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:37.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad057fa700 1 -- 172.21.15.86:0/2394465397 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c013680 con 0x7fad1006e470 2023-10-09T11:59:37.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad057fa700 1 -- 172.21.15.86:0/2394465397 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c0137e0 con 0x7fad1006e470 2023-10-09T11:59:37.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad057fa700 1 -- 172.21.15.86:0/2394465397 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c013b80 con 0x7fad1006e470 2023-10-09T11:59:37.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.584+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad000094f0 con 0x7fad1006e470 2023-10-09T11:59:37.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.585+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad10158980 con 0x7fad1006e470 2023-10-09T11:59:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.586+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad10154560 con 0x7fad1006e470 2023-10-09T11:59:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.587+0000 7fad057fa700 1 -- 172.21.15.86:0/2394465397 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fad0c00c3e0 con 0x7fad1006e470 2023-10-09T11:59:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.587+0000 7fad057fa700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 0x7facf4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.587+0000 7fad057fa700 1 -- 172.21.15.86:0/2394465397 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fad0c0847a0 con 0x7fad1006e470 2023-10-09T11:59:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.587+0000 7fad1499a700 1 -- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 msgr2=0x7facf4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:37.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.587+0000 7fad1499a700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 0x7facf4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:37.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.592+0000 7fad057fa700 1 -- 172.21.15.86:0/2394465397 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad0c0518b0 con 0x7fad1006e470 2023-10-09T11:59:37.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.788+0000 7fad1499a700 1 -- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 msgr2=0x7facf4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:37.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.788+0000 7fad1499a700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 0x7facf4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:37.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.793+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fad1015dd30 con 0x7fad1006e470 2023-10-09T11:59:37.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.800+0000 7fad057fa700 1 -- 172.21.15.86:0/2394465397 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7fad0c054ed0 con 0x7fad1006e470 2023-10-09T11:59:37.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 msgr2=0x7facf4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 0x7facf4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad1006e470 msgr2=0x7fad10152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad1006e470 0x7fad10152750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00e900 tx=0x7fad0c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 shutdown_connections 2023-10-09T11:59:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fad1015a3b0 0x7fad100c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad1006e470 0x7fad10152750 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7facf4066f80 0x7facf4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 --2- 172.21.15.86:0/2394465397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad100aef00 0x7fad10157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 >> 172.21.15.86:0/2394465397 conn(0x7fad100c9f70 msgr2=0x7fad10153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 shutdown_connections 2023-10-09T11:59:37.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:37.803+0000 7fad1619d700 1 -- 172.21.15.86:0/2394465397 wait complete. 2023-10-09T11:59:37.821 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T11:59:38.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.011+0000 7fc56f19d700 1 Processor -- start 2023-10-09T11:59:38.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.011+0000 7fc56f19d700 1 -- start start 2023-10-09T11:59:38.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56f19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5680ccc00 0x7fc568069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56f19d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680c9f30 con 0x7fc56806a020 2023-10-09T11:59:38.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56f19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680ca470 con 0x7fc568159a60 2023-10-09T11:59:38.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56f19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56806dfc0 con 0x7fc5680ccc00 2023-10-09T11:59:38.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56e99c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc56806a020 0x7fc5680cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:50744/0 (socket says 172.21.15.86:50744) 2023-10-09T11:59:38.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56e99c700 1 -- 172.21.15.86:0/2402645165 learned_addr learned my addr 172.21.15.86:0/2402645165 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:38.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56d99a700 1 --2- 172.21.15.86:0/2402645165 >> v2:172.21.15.135:3300/0 conn(0x7fc5680ccc00 0x7fc568069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56d199700 1 -- 172.21.15.86:0/2402645165 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528753490 0 0) 0x7fc5680c9f30 con 0x7fc56806a020 2023-10-09T11:59:38.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56d199700 1 -- 172.21.15.86:0/2402645165 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc554003570 con 0x7fc56806a020 2023-10-09T11:59:38.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56d199700 1 -- 172.21.15.86:0/2402645165 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290135072 0 0) 0x7fc5680ca470 con 0x7fc568159a60 2023-10-09T11:59:38.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56d199700 1 -- 172.21.15.86:0/2402645165 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5680c9f30 con 0x7fc568159a60 2023-10-09T11:59:38.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.013+0000 7fc56d99a700 1 -- 172.21.15.86:0/2402645165 >> v1:172.21.15.135:6789/0 conn(0x7fc568159a60 legacy=0x7fc5680c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.014+0000 7fc56d99a700 1 -- 172.21.15.86:0/2402645165 >> v1:172.21.15.86:6789/0 conn(0x7fc56806a020 legacy=0x7fc5680cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.014+0000 7fc56d99a700 1 -- 172.21.15.86:0/2402645165 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680ca750 con 0x7fc5680ccc00 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.014+0000 7fc56d99a700 1 --2- 172.21.15.86:0/2402645165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5680ccc00 0x7fc568069ae0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc5580098e0 tx=0x7fc5580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f26d90062465d40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.014+0000 7fc56d199700 1 -- 172.21.15.86:0/2402645165 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011630 con 0x7fc5680ccc00 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.014+0000 7fc56d199700 1 -- 172.21.15.86:0/2402645165 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558011790 con 0x7fc5680ccc00 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.014+0000 7fc56d199700 1 -- 172.21.15.86:0/2402645165 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011b30 con 0x7fc5680ccc00 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.015+0000 7fc56f19d700 1 -- 172.21.15.86:0/2402645165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5680ccc00 msgr2=0x7fc568069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.015+0000 7fc56f19d700 1 --2- 172.21.15.86:0/2402645165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5680ccc00 0x7fc568069ae0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc5580098e0 tx=0x7fc5580091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.015+0000 7fc56f19d700 1 -- 172.21.15.86:0/2402645165 shutdown_connections 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.015+0000 7fc56f19d700 1 --2- 172.21.15.86:0/2402645165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5680ccc00 0x7fc568069ae0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.015+0000 7fc56f19d700 1 -- 172.21.15.86:0/2402645165 >> 172.21.15.86:0/2402645165 conn(0x7fc56806baa0 msgr2=0x7fc56806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:38.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.015+0000 7fc56f19d700 1 -- 172.21.15.86:0/2402645165 shutdown_connections 2023-10-09T11:59:38.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.015+0000 7fc56f19d700 1 -- 172.21.15.86:0/2402645165 wait complete. 2023-10-09T11:59:38.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.016+0000 7fc56f19d700 1 Processor -- start 2023-10-09T11:59:38.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.017+0000 7fc56f19d700 1 -- start start 2023-10-09T11:59:38.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.017+0000 7fc56f19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56806a020 0x7fc56814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.017+0000 7fc56f19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5680ccc00 0x7fc5680b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.017+0000 7fc56f19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc568159a60 0x7fc56816d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.017+0000 7fc56f19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56814cbf0 con 0x7fc5680ccc00 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.017+0000 7fc56f19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680c63f0 con 0x7fc56806a020 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.017+0000 7fc56f19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680c57e0 con 0x7fc568159a60 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5680ccc00 0x7fc5680b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5680ccc00 0x7fc5680b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59060/0 (socket says 172.21.15.86:59060) 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56e19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56806a020 0x7fc56814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 -- 172.21.15.86:0/3717136397 learned_addr learned my addr 172.21.15.86:0/3717136397 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56e99c700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc568159a60 0x7fc56816d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 -- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc568159a60 msgr2=0x7fc56816d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc568159a60 0x7fc56816d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 -- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56806a020 msgr2=0x7fc56814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56806a020 0x7fc56814fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56d99a700 1 -- 172.21.15.86:0/3717136397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558009420 con 0x7fc5680ccc00 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.018+0000 7fc56e19b700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56806a020 0x7fc56814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.019+0000 7fc56d99a700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5680ccc00 0x7fc5680b3030 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc56806cdc0 tx=0x7fc558017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.019+0000 7fc55e7fc700 1 -- 172.21.15.86:0/3717136397 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55801f070 con 0x7fc5680ccc00 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.019+0000 7fc55e7fc700 1 -- 172.21.15.86:0/3717136397 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558000bc0 con 0x7fc5680ccc00 2023-10-09T11:59:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.019+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5680c5ac0 con 0x7fc5680ccc00 2023-10-09T11:59:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.019+0000 7fc55e7fc700 1 -- 172.21.15.86:0/3717136397 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558025420 con 0x7fc5680ccc00 2023-10-09T11:59:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.019+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5680c6080 con 0x7fc5680ccc00 2023-10-09T11:59:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.020+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680c6560 con 0x7fc5680ccc00 2023-10-09T11:59:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.022+0000 7fc55e7fc700 1 -- 172.21.15.86:0/3717136397 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fc558023070 con 0x7fc5680ccc00 2023-10-09T11:59:38.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.023+0000 7fc55e7fc700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 0x7fc54c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.023+0000 7fc55e7fc700 1 -- 172.21.15.86:0/3717136397 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7fc558085a70 con 0x7fc5680ccc00 2023-10-09T11:59:38.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.023+0000 7fc56e19b700 1 -- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 msgr2=0x7fc54c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:38.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.023+0000 7fc56e19b700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 0x7fc54c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.028+0000 7fc55e7fc700 1 -- 172.21.15.86:0/3717136397 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc558052b60 con 0x7fc5680ccc00 2023-10-09T11:59:38.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.224+0000 7fc56e19b700 1 -- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 msgr2=0x7fc54c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:38.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.224+0000 7fc56e19b700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 0x7fc54c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:38.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.230+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fc5680caa30 con 0x7fc5680ccc00 2023-10-09T11:59:38.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.236+0000 7fc55e7fc700 1 -- 172.21.15.86:0/3717136397 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc5580150c0 con 0x7fc5680ccc00 2023-10-09T11:59:38.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 msgr2=0x7fc54c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:38.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 0x7fc54c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5680ccc00 msgr2=0x7fc5680b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5680ccc00 0x7fc5680b3030 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc56806cdc0 tx=0x7fc558017000 comp rx=0 tx=0).stop 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 shutdown_connections 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc568159a60 0x7fc56816d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56806a020 0x7fc56814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc54c066f80 0x7fc54c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 --2- 172.21.15.86:0/3717136397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5680ccc00 0x7fc5680b3030 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 >> 172.21.15.86:0/3717136397 conn(0x7fc56806baa0 msgr2=0x7fc56806a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.238+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 shutdown_connections 2023-10-09T11:59:38.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.239+0000 7fc56f19d700 1 -- 172.21.15.86:0/3717136397 wait complete. 2023-10-09T11:59:38.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:38.257 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T11:59:38.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T11:59:38.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.529+0000 7f07cdb9d700 1 Processor -- start 2023-10-09T11:59:38.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.530+0000 7f07cdb9d700 1 -- start start 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07cdb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07cdb9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07c80b0790 0x7f07c80b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07cdb9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c80cfa00 con 0x7f07c81591e0 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07cdb9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c80cb580 con 0x7f07c80b0790 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07cdb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80b2de0 con 0x7f07c80b03c0 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07c7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07c80b0790 0x7f07c80b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07cd39c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f07c81591e0 0x7f07c8159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:50750/0 (socket says 172.21.15.86:50750) 2023-10-09T11:59:38.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07c7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07c80b0790 0x7f07c80b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59072/0 (socket says 172.21.15.86:59072) 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07cd39c700 1 -- 172.21.15.86:0/2851580557 learned_addr learned my addr 172.21.15.86:0/2851580557 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/2851580557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07c7fff700 1 -- 172.21.15.86:0/2851580557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 msgr2=0x7f07c80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07c7fff700 1 --2- 172.21.15.86:0/2851580557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07c7fff700 1 -- 172.21.15.86:0/2851580557 >> v1:172.21.15.86:6789/0 conn(0x7f07c81591e0 legacy=0x7f07c8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07c7fff700 1 -- 172.21.15.86:0/2851580557 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c80cf160 con 0x7f07c80b0790 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.531+0000 7f07c77fe700 1 -- 172.21.15.86:0/2851580557 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421324294 0 0) 0x7f07c80cfa00 con 0x7f07c81591e0 2023-10-09T11:59:38.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.532+0000 7f07c7fff700 1 --2- 172.21.15.86:0/2851580557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c80b28a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f07b40098e0 tx=0x7f07b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91cd143416cd315 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:38.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.532+0000 7f07c77fe700 1 -- 172.21.15.86:0/2851580557 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400b640 con 0x7f07c80b0790 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.532+0000 7f07c77fe700 1 -- 172.21.15.86:0/2851580557 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b400b7a0 con 0x7f07c80b0790 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.532+0000 7f07c77fe700 1 -- 172.21.15.86:0/2851580557 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400bb40 con 0x7f07c80b0790 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 -- 172.21.15.86:0/2851580557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 msgr2=0x7f07c80b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/2851580557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c80b28a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f07b40098e0 tx=0x7f07b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 -- 172.21.15.86:0/2851580557 shutdown_connections 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/2851580557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c80cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/2851580557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c80b28a0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 -- 172.21.15.86:0/2851580557 >> 172.21.15.86:0/2851580557 conn(0x7f07c8063230 msgr2=0x7f07c8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:38.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 -- 172.21.15.86:0/2851580557 shutdown_connections 2023-10-09T11:59:38.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.533+0000 7f07cdb9d700 1 -- 172.21.15.86:0/2851580557 wait complete. 2023-10-09T11:59:38.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.534+0000 7f07cdb9d700 1 Processor -- start 2023-10-09T11:59:38.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.534+0000 7f07cdb9d700 1 -- start start 2023-10-09T11:59:38.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07cdb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07cdb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c815d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07cdb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81591e0 0x7f07c815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07cdb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c815b0e0 con 0x7f07c80b0790 2023-10-09T11:59:38.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07cdb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80c4490 con 0x7f07c81591e0 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07cdb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c815ab20 con 0x7f07c80b03c0 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07c7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07c7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c815d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59082/0 (socket says 172.21.15.86:59082) 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.535+0000 7f07c7fff700 1 -- 172.21.15.86:0/4206067499 learned_addr learned my addr 172.21.15.86:0/4206067499 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07cd39c700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81591e0 0x7f07c815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c7fff700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 msgr2=0x7f07c81577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c7fff700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c81577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c7fff700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81591e0 msgr2=0x7f07c815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c7fff700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81591e0 0x7f07c815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:38.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c7fff700 1 -- 172.21.15.86:0/4206067499 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4009420 con 0x7f07c80b0790 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07cd39c700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81591e0 0x7f07c815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c7fff700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c815d490 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f07c80cfe40 tx=0x7f07b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4000d10 con 0x7f07c80b0790 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b400bb20 con 0x7f07c80b0790 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4011650 con 0x7f07c80b0790 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.536+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c815ae00 con 0x7f07c80b0790 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.537+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c815a780 con 0x7f07c80b0790 2023-10-09T11:59:38.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.538+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c80c4600 con 0x7f07c80b0790 2023-10-09T11:59:38.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.539+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 54) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f07b40119c0 con 0x7f07c80b0790 2023-10-09T11:59:38.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.539+0000 7f07c4ff9700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:38.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.540+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f07b4085af0 con 0x7f07c80b0790 2023-10-09T11:59:38.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.540+0000 7f07ccb9b700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 msgr2=0x7f07ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:38.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.540+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:59:38.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.544+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07b4052c00 con 0x7f07c80b0790 2023-10-09T11:59:38.644 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:38.643+0000 7f7e498fa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:59:38.700 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:38.700+0000 7f4dc5637180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:59:38.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.741+0000 7f07ccb9b700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 msgr2=0x7f07ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:38.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.741+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T11:59:38.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:38.764+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c804c3c0 con 0x7f07ac066f80 2023-10-09T11:59:38.807 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:38.806+0000 7f7e498fa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:38.866 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:38.866+0000 7f4dc5637180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:38.893 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:38.893+0000 7f7e498fa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:59:38.955 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:38.955+0000 7f4dc5637180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:59:39.121 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:39.121+0000 7f7e498fa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:39.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:39.142+0000 7f07ccb9b700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 msgr2=0x7f07ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:39.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:39.142+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T11:59:39.180 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:39.180+0000 7f4dc5637180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:39.299 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:39.299+0000 7f7e498fa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:59:39.357 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:39.357+0000 7f4dc5637180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:59:39.391 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:39.391+0000 7f7e498fa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:59:39.448 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:39.448+0000 7f4dc5637180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:59:39.554 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:39.553+0000 7f7e498fa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:59:39.610 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:39.610+0000 7f4dc5637180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:59:39.655 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:39.655+0000 7f7e498fa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:39.711 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:39.711+0000 7f4dc5637180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:59:39.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:39.943+0000 7f07ccb9b700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 msgr2=0x7f07ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:39.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:39.943+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T11:59:40.140 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:40.139+0000 7f7e498fa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:59:40.195 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:40.195+0000 7f4dc5637180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:59:40.233 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:40.232+0000 7f7e498fa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:59:40.289 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:40.289+0000 7f4dc5637180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:59:40.322 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:40.322+0000 7f7e498fa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:59:40.380 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:40.380+0000 7f4dc5637180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:59:40.942 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:40.941+0000 7f7e498fa180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:59:41.001 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:41.000+0000 7f4dc5637180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:59:41.113 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:41.113+0000 7f7e498fa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:41.175 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:41.174+0000 7f4dc5637180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:59:41.208 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:41.208+0000 7f7e498fa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:59:41.270 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:41.270+0000 7f4dc5637180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:59:41.396 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:59:41.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:59:41.506 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:41.506+0000 7f7e498fa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:59:41.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:41.545+0000 7f07ccb9b700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 msgr2=0x7f07ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T11:59:41.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:41.545+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T11:59:41.569 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:41.569+0000 7f4dc5637180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:59:41.603 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:41.603+0000 7f7e498fa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:59:41.665 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:41.665+0000 7f4dc5637180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:59:42.305 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:42.305+0000 7f7e498fa180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:59:42.371 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:42.371+0000 7f4dc5637180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:59:42.593 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:42.592+0000 7f7e498fa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:59:42.656 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:42.656+0000 7f4dc5637180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:59:42.686 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:42.686+0000 7f7e498fa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:59:42.749 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:42.749+0000 7f4dc5637180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:59:42.838 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:42.838+0000 7f7e498fa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:59:42.903 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:42.903+0000 7f4dc5637180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:59:42.942 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:42.942+0000 7f7e498fa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:59:43.007 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.007+0000 7f4dc5637180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:59:43.130 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:43.130+0000 7f7e498fa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:59:43.197 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.197+0000 7f4dc5637180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:59:43.223 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:43.223+0000 7f7e498fa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:59:43.288 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.288+0000 7f4dc5637180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:59:43.314 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:43.314+0000 7f7e498fa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:59:43.382 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.382+0000 7f4dc5637180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:59:43.408 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T11:59:43.407+0000 7f7e498fa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:59:43.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:43.467+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 55) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f07b4052fd0 con 0x7f07c80b0790 2023-10-09T11:59:43.480 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.480+0000 7f4dc5637180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:59:43.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:43.489+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 56) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f07b4056ae0 con 0x7f07c80b0790 2023-10-09T11:59:43.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:43.489+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 msgr2=0x7f07ac069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:59:43.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:43.489+0000 7f07c4ff9700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:43.612 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3a937700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.612 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3a937700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.612 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3a937700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.612 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3a937700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.612 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3a937700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.612 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3692f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.613 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3692f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.613 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3692f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.613 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3692f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:43.613 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T11:59:43.611+0000 7f4d3692f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T11:59:44.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.494+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mon.0 v2:172.21.15.86:3300/0 9 ==== mgrmap(e 57) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f07b40538a0 con 0x7f07c80b0790 2023-10-09T11:59:44.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.494+0000 7f07c4ff9700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:44.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.494+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c804c3c0 con 0x7f07ac066f80 2023-10-09T11:59:44.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.495+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:44.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.496+0000 7f07ccb9b700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac0693b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f07c80c6a20 tx=0x7f07bc0091a0 comp rx=0 tx=0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:44.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.560+0000 7f07c4ff9700 1 -- 172.21.15.86:0/4206067499 <== mgr.7857 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f07c804c3c0 con 0x7f07ac066f80 2023-10-09T11:59:44.561 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path snap_test_dir1 2023-10-09T11:59:44.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 msgr2=0x7f07ac0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:44.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac0693b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f07c80c6a20 tx=0x7f07bc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 msgr2=0x7f07c815d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:44.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c815d490 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f07c80cfe40 tx=0x7f07b4017000 comp rx=0 tx=0).stop 2023-10-09T11:59:44.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 shutdown_connections 2023-10-09T11:59:44.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81591e0 0x7f07c815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07c80b03c0 0x7f07c81577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07ac066f80 0x7f07ac0693b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 --2- 172.21.15.86:0/4206067499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b0790 0x7f07c815d490 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 >> 172.21.15.86:0/4206067499 conn(0x7f07c8063230 msgr2=0x7f07c8069180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:44.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 shutdown_connections 2023-10-09T11:59:44.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.563+0000 7f07cdb9d700 1 -- 172.21.15.86:0/4206067499 wait complete. 2023-10-09T11:59:44.582 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T11:59:44.582 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-12_00_00 in ~16s... 2023-10-09T11:59:44.582 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-09T11:59:44.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T11:59:44.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.768+0000 7f74575ff700 1 Processor -- start 2023-10-09T11:59:44.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.768+0000 7f74575ff700 1 -- start start 2023-10-09T11:59:44.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.769+0000 7f74575ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:44.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.769+0000 7f74575ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7450068890 0x7f74500c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:44.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.769+0000 7f74575ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745015a9b0 con 0x7f745015a440 2023-10-09T11:59:44.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.769+0000 7f74575ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745015ac90 con 0x7f7450068890 2023-10-09T11:59:44.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.769+0000 7f74575ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745015af70 con 0x7f74501563b0 2023-10-09T11:59:44.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.770+0000 7f7455b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7450068890 0x7f74500c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:44.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.770+0000 7f745539b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:44.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.770+0000 7f745539b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:56828/0 (socket says 172.21.15.86:56828) 2023-10-09T11:59:44.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.770+0000 7f745539b700 1 -- 172.21.15.86:0/1534042951 learned_addr learned my addr 172.21.15.86:0/1534042951 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:44.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.770+0000 7f7455b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7450068890 0x7f74500c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:54306/0 (socket says 172.21.15.86:54306) 2023-10-09T11:59:44.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.770+0000 7f745539b700 1 -- 172.21.15.86:0/1534042951 >> v2:172.21.15.135:3300/0 conn(0x7f7450068890 msgr2=0x7f74500c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:59:44.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.770+0000 7f745539b700 1 --2- 172.21.15.86:0/1534042951 >> v2:172.21.15.135:3300/0 conn(0x7f7450068890 0x7f74500c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.771+0000 7f745539b700 1 -- 172.21.15.86:0/1534042951 >> v1:172.21.15.135:6789/0 conn(0x7f745015a440 legacy=0x7f74500acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:44.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.771+0000 7f745539b700 1 -- 172.21.15.86:0/1534042951 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745015b250 con 0x7f74501563b0 2023-10-09T11:59:44.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.771+0000 7f7455b9c700 1 --2- 172.21.15.86:0/1534042951 >> v2:172.21.15.135:3300/0 conn(0x7f7450068890 0x7f74500c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.771+0000 7f745539b700 1 --2- 172.21.15.86:0/1534042951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450156780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f744c0099b0 tx=0x7f744c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a95e76a64f48e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.771+0000 7f7447fff700 1 -- 172.21.15.86:0/1534042951 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c009ea0 con 0x7f74501563b0 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.771+0000 7f7447fff700 1 -- 172.21.15.86:0/1534042951 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00b860 con 0x7f74501563b0 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.771+0000 7f7447fff700 1 -- 172.21.15.86:0/1534042951 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00bc00 con 0x7f74501563b0 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 -- 172.21.15.86:0/1534042951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 msgr2=0x7f7450156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 --2- 172.21.15.86:0/1534042951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450156780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f744c0099b0 tx=0x7f744c009250 comp rx=0 tx=0).stop 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 -- 172.21.15.86:0/1534042951 shutdown_connections 2023-10-09T11:59:44.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 --2- 172.21.15.86:0/1534042951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450156780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 --2- 172.21.15.86:0/1534042951 >> v2:172.21.15.135:3300/0 conn(0x7f7450068890 0x7f74500c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 -- 172.21.15.86:0/1534042951 >> 172.21.15.86:0/1534042951 conn(0x7f74500c8f90 msgr2=0x7f74500c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:44.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 -- 172.21.15.86:0/1534042951 shutdown_connections 2023-10-09T11:59:44.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.772+0000 7f74575ff700 1 -- 172.21.15.86:0/1534042951 wait complete. 2023-10-09T11:59:44.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.773+0000 7f74575ff700 1 Processor -- start 2023-10-09T11:59:44.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.773+0000 7f74575ff700 1 -- start start 2023-10-09T11:59:44.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.774+0000 7f74575ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7450068890 0x7f74500b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:44.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.774+0000 7f74575ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450166670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:44.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.774+0000 7f74575ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f745015a440 0x7f745014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:44.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.774+0000 7f74575ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450169020 con 0x7f745015a440 2023-10-09T11:59:44.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.774+0000 7f74575ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500b13f0 con 0x7f7450068890 2023-10-09T11:59:44.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.774+0000 7f74575ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500b2230 con 0x7f74501563b0 2023-10-09T11:59:44.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f745015a440 0x7f745014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:44.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f745015a440 0x7f745014ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59190/0 (socket says 172.21.15.86:59190) 2023-10-09T11:59:44.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 -- 172.21.15.86:0/3640674881 learned_addr learned my addr 172.21.15.86:0/3640674881 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T11:59:44.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f745539b700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7450068890 0x7f74500b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:44.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7454b9a700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:44.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 -- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 msgr2=0x7f7450166670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450166670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 -- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7450068890 msgr2=0x7f74500b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7450068890 0x7f74500b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 -- 172.21.15.86:0/3640674881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744800de30 con 0x7f745015a440 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f7455b9c700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f745015a440 0x7f745014ba20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7448012520 tx=0x7f744800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f74457fa700 1 -- 172.21.15.86:0/3640674881 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448017610 con 0x7f745015a440 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f74457fa700 1 -- 172.21.15.86:0/3640674881 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7448013040 con 0x7f745015a440 2023-10-09T11:59:44.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.775+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c0094f0 con 0x7f745015a440 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.776+0000 7f74457fa700 1 -- 172.21.15.86:0/3640674881 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480179a0 con 0x7f745015a440 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.776+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7450166c00 con 0x7f745015a440 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.776+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74500718b0 con 0x7f745015a440 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.777+0000 7f74457fa700 1 -- 172.21.15.86:0/3640674881 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 57) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f7448017d10 con 0x7f745015a440 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.778+0000 7f74457fa700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7434066dd0 0x7f7434069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.778+0000 7f74457fa700 1 -- 172.21.15.86:0/3640674881 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f7448088fd0 con 0x7f745015a440 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.778+0000 7f745539b700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7434066dd0 0x7f7434069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:59:44.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.779+0000 7f745539b700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7434066dd0 0x7f7434069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f744c0099b0 tx=0x7f744c017000 comp rx=0 tx=0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:59:44.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.782+0000 7f74457fa700 1 -- 172.21.15.86:0/3640674881 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7448056260 con 0x7f745015a440 2023-10-09T11:59:44.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:44.994+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f745006d700 con 0x7f7434066dd0 2023-10-09T11:59:45.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.001+0000 7f74457fa700 1 -- 172.21.15.86:0/3640674881 <== mgr.7857 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f745006d700 con 0x7f7434066dd0 2023-10-09T11:59:45.002 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T11:59:45.002 INFO:teuthology.orchestra.run.smithi086.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-09T11:59:45.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.003+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7434066dd0 msgr2=0x7f7434069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:45.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.003+0000 7f74575ff700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7434066dd0 0x7f7434069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f744c0099b0 tx=0x7f744c017000 comp rx=0 tx=0).stop 2023-10-09T11:59:45.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f745015a440 msgr2=0x7f745014ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:59:45.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f745015a440 0x7f745014ba20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7448012520 tx=0x7f744800db90 comp rx=0 tx=0).stop 2023-10-09T11:59:45.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 shutdown_connections 2023-10-09T11:59:45.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7434066dd0 0x7f7434069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:45.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f745015a440 0x7f745014ba20 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:45.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7450068890 0x7f74500b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:45.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 --2- 172.21.15.86:0/3640674881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74501563b0 0x7f7450166670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:59:45.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 >> 172.21.15.86:0/3640674881 conn(0x7f74500c8f90 msgr2=0x7f7450153690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:59:45.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 shutdown_connections 2023-10-09T11:59:45.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T11:59:45.004+0000 7f74575ff700 1 -- 172.21.15.86:0/3640674881 wait complete. 2023-10-09T11:59:45.022 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-09T11:59:45.023 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-10-09T11:59:45.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:45.023 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:45.062 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:45.062 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:45.062 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:46.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:46.064 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:46.107 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:46.107 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:46.107 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:47.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:47.108 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:47.151 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:47.151 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:47.151 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:48.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:48.153 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:48.196 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:48.197 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:48.197 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:49.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:49.199 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:49.242 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:49.242 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:49.242 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:50.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:50.243 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:50.286 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:50.286 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:50.286 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:51.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:51.287 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:51.330 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:51.330 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:51.330 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:52.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:52.331 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:52.374 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:52.374 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:52.374 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:53.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:53.375 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:53.418 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:53.418 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:53.418 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:54.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:54.419 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:54.462 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:54.462 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:54.462 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:55.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:55.464 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:55.507 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:55.507 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:55.508 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:56.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:56.509 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:56.552 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:56.552 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:56.553 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:57.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:57.554 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:57.597 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:57.597 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:57.597 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:58.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:58.598 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:58.641 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:58.641 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:58.641 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T11:59:59.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:59:59.642 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T11:59:59.684 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T11:59:59.684 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T11:59:59.684 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T12:00:00.573 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:00.572+0000 7f4d2a116700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:00.573 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:00.572+0000 7f4d2a116700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:00.574 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:00.572+0000 7f4d2a116700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:00.574 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:00.572+0000 7f4d2a116700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:00.574 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:00.572+0000 7f4d2a116700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:00.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:00:00.686 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T12:00:00.724 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_00_00_UTC 2023-10-09T12:00:00.726 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-12_00_00_UTC'} 2023-10-09T12:00:00.726 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-12_00_00_UTC'} 2023-10-09T12:00:00.726 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T12:00:00.726 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-12_00_00_UTC'] 2023-10-09T12:00:00.726 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696852784.5824893, now = 1696852800.726349, timo = 16 2023-10-09T12:00:01.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T12:00:01.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.928+0000 7f908b9ff700 1 Processor -- start 2023-10-09T12:00:01.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.929+0000 7f908b9ff700 1 -- start start 2023-10-09T12:00:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f908b9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90841563b0 0x7f9084156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f908b9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9084068890 0x7f90840c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f908b9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908415a9b0 con 0x7f908415a440 2023-10-09T12:00:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f908b9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908415ac90 con 0x7f9084068890 2023-10-09T12:00:01.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f908b9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908415af70 con 0x7f90841563b0 2023-10-09T12:00:01.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f9089f9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9084068890 0x7f90840c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:01.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f9089f9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9084068890 0x7f90840c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45740/0 (socket says 172.21.15.86:45740) 2023-10-09T12:00:01.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f9089f9c700 1 -- 172.21.15.86:0/1181502540 learned_addr learned my addr 172.21.15.86:0/1181502540 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:01.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f908979b700 1 --2- 172.21.15.86:0/1181502540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90841563b0 0x7f9084156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f9089f9c700 1 -- 172.21.15.86:0/1181502540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90841563b0 msgr2=0x7f9084156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.930+0000 7f9089f9c700 1 --2- 172.21.15.86:0/1181502540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90841563b0 0x7f9084156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f9089f9c700 1 -- 172.21.15.86:0/1181502540 >> v1:172.21.15.86:6789/0 conn(0x7f908415a440 legacy=0x7f90840acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f9089f9c700 1 -- 172.21.15.86:0/1181502540 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908415b250 con 0x7f9084068890 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f907bfff700 1 -- 172.21.15.86:0/1181502540 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588360113 0 0) 0x7f908415a9b0 con 0x7f908415a440 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f9089f9c700 1 --2- 172.21.15.86:0/1181502540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9084068890 0x7f90840c8230 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f907c009f20 tx=0x7f907c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daca2092ad275cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f907bfff700 1 -- 172.21.15.86:0/1181502540 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00e070 con 0x7f9084068890 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f907bfff700 1 -- 172.21.15.86:0/1181502540 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00b9d0 con 0x7f9084068890 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f907bfff700 1 -- 172.21.15.86:0/1181502540 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0092e0 con 0x7f9084068890 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f908b9ff700 1 -- 172.21.15.86:0/1181502540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9084068890 msgr2=0x7f90840c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.931+0000 7f908b9ff700 1 --2- 172.21.15.86:0/1181502540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9084068890 0x7f90840c8230 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f907c009f20 tx=0x7f907c009840 comp rx=0 tx=0).stop 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.932+0000 7f908b9ff700 1 -- 172.21.15.86:0/1181502540 shutdown_connections 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.932+0000 7f908b9ff700 1 --2- 172.21.15.86:0/1181502540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9084068890 0x7f90840c8230 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.932+0000 7f908b9ff700 1 --2- 172.21.15.86:0/1181502540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90841563b0 0x7f9084156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.932+0000 7f908b9ff700 1 -- 172.21.15.86:0/1181502540 >> 172.21.15.86:0/1181502540 conn(0x7f90840c8f90 msgr2=0x7f90840c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.932+0000 7f908b9ff700 1 -- 172.21.15.86:0/1181502540 shutdown_connections 2023-10-09T12:00:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.932+0000 7f908b9ff700 1 -- 172.21.15.86:0/1181502540 wait complete. 2023-10-09T12:00:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.933+0000 7f908b9ff700 1 Processor -- start 2023-10-09T12:00:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.934+0000 7f908b9ff700 1 -- start start 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.934+0000 7f908b9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9084068890 0x7f90840cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f908b9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90841563b0 0x7f9084154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f908b9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908415a440 0x7f90840c0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f908b9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084158440 con 0x7f90841563b0 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f908b9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840cb920 con 0x7f9084068890 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f908b9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840cbc00 con 0x7f908415a440 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90841563b0 0x7f9084154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90841563b0 0x7f9084154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45754/0 (socket says 172.21.15.86:45754) 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 -- 172.21.15.86:0/2457009416 learned_addr learned my addr 172.21.15.86:0/2457009416 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 -- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908415a440 msgr2=0x7f90840c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:01.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f908979b700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9084068890 0x7f90840cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:01.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908415a440 0x7f90840c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:01.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 -- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9084068890 msgr2=0x7f90840cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:01.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9084068890 0x7f90840cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:01.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 -- 172.21.15.86:0/2457009416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c009ae0 con 0x7f90841563b0 2023-10-09T12:00:01.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f908979b700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9084068890 0x7f90840cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:01.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.935+0000 7f9088f9a700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90841563b0 0x7f9084154ab0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f907400c7e0 tx=0x7f9074007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.936+0000 7f90797fa700 1 -- 172.21.15.86:0/2457009416 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074012700 con 0x7f90841563b0 2023-10-09T12:00:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.936+0000 7f90797fa700 1 -- 172.21.15.86:0/2457009416 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9074012880 con 0x7f90841563b0 2023-10-09T12:00:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.936+0000 7f90797fa700 1 -- 172.21.15.86:0/2457009416 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074012c40 con 0x7f90841563b0 2023-10-09T12:00:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.936+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90840cbee0 con 0x7f90841563b0 2023-10-09T12:00:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.936+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9084154ff0 con 0x7f90841563b0 2023-10-09T12:00:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.937+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90840718b0 con 0x7f90841563b0 2023-10-09T12:00:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.938+0000 7f90797fa700 1 -- 172.21.15.86:0/2457009416 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 58) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f907401b400 con 0x7f90841563b0 2023-10-09T12:00:01.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.938+0000 7f90797fa700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9068067130 0x7f90680695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:01.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.939+0000 7f90797fa700 1 -- 172.21.15.86:0/2457009416 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f90740847a0 con 0x7f90841563b0 2023-10-09T12:00:01.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.939+0000 7f908979b700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9068067130 0x7f90680695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:01.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.939+0000 7f908979b700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9068067130 0x7f90680695e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9080006f00 tx=0x7f9080008040 comp rx=0 tx=0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:01.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:01.943+0000 7f90797fa700 1 -- 172.21.15.86:0/2457009416 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9074051470 con 0x7f90841563b0 2023-10-09T12:00:02.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.159+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9084155210 con 0x7f9068067130 2023-10-09T12:00:02.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.220+0000 7f90797fa700 1 -- 172.21.15.86:0/2457009416 <== mgr.7857 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9080009e40 con 0x7f9068067130 2023-10-09T12:00:02.221 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path snap_test_dir1 2023-10-09T12:00:02.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.222+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9068067130 msgr2=0x7f90680695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:02.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.222+0000 7f908b9ff700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9068067130 0x7f90680695e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9080006f00 tx=0x7f9080008040 comp rx=0 tx=0).stop 2023-10-09T12:00:02.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.222+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90841563b0 msgr2=0x7f9084154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:02.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.222+0000 7f908b9ff700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90841563b0 0x7f9084154ab0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f907400c7e0 tx=0x7f9074007df0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 shutdown_connections 2023-10-09T12:00:02.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f908415a440 0x7f90840c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9084068890 0x7f90840cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9068067130 0x7f90680695e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 --2- 172.21.15.86:0/2457009416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90841563b0 0x7f9084154ab0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 >> 172.21.15.86:0/2457009416 conn(0x7f90840c8f90 msgr2=0x7f908406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:02.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 shutdown_connections 2023-10-09T12:00:02.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.223+0000 7f908b9ff700 1 -- 172.21.15.86:0/2457009416 wait complete. 2023-10-09T12:00:02.242 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T12:00:02.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:00:02.242 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T12:00:02.279 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_00_00_UTC 2023-10-09T12:00:02.280 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_00_00_UTC 2023-10-09T12:00:02.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:00:02.280 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_00_00_UTC) 2023-10-09T12:00:02.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:00:02.364 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T12:00:02.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T12:00:02.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.666+0000 7f66a979d700 1 Processor -- start 2023-10-09T12:00:02.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.667+0000 7f66a979d700 1 -- start start 2023-10-09T12:00:02.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a979d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a40cb1a0 0x7f66a415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:02.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40ae0d0 0x7f66a40ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:02.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a979d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a406ebd0 con 0x7f66a415a8a0 2023-10-09T12:00:02.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a979d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a415b2e0 con 0x7f66a40cb1a0 2023-10-09T12:00:02.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40aea30 con 0x7f66a40ae0d0 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a8f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40ae0d0 0x7f66a40ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a8f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40ae0d0 0x7f66a40ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:58962/0 (socket says 172.21.15.86:58962) 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a40cb1a0 0x7f66a415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.669+0000 7f66a8f9c700 1 -- 172.21.15.86:0/1933393380 learned_addr learned my addr 172.21.15.86:0/1933393380 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.668+0000 7f66a37fe700 1 --1- 172.21.15.86:0/1933393380 >> v1:172.21.15.135:6789/0 conn(0x7f66a415a8a0 0x7f66a406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:45842/0 (socket says 172.21.15.86:45842) 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.669+0000 7f66a3fff700 1 -- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40ae0d0 msgr2=0x7f66a40ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.669+0000 7f66a3fff700 1 --2- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40ae0d0 0x7f66a40ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.669+0000 7f66a3fff700 1 -- 172.21.15.86:0/1933393380 >> v1:172.21.15.135:6789/0 conn(0x7f66a415a8a0 legacy=0x7f66a406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.669+0000 7f66a3fff700 1 -- 172.21.15.86:0/1933393380 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a415ad20 con 0x7f66a40cb1a0 2023-10-09T12:00:02.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.669+0000 7f66a8f9c700 1 --2- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40ae0d0 0x7f66a40ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.669+0000 7f66a3fff700 1 --2- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 0x7f66a415a360 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f66940098e0 tx=0x7f66940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6984e0b27f65ff94 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a2ffd700 1 -- 172.21.15.86:0/1933393380 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400b6d0 con 0x7f66a40cb1a0 2023-10-09T12:00:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a2ffd700 1 -- 172.21.15.86:0/1933393380 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b830 con 0x7f66a40cb1a0 2023-10-09T12:00:02.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a2ffd700 1 -- 172.21.15.86:0/1933393380 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bbd0 con 0x7f66a40cb1a0 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 -- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 msgr2=0x7f66a415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 --2- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 0x7f66a415a360 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f66940098e0 tx=0x7f66940091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 -- 172.21.15.86:0/1933393380 shutdown_connections 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 --2- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40ae0d0 0x7f66a40ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 --2- 172.21.15.86:0/1933393380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 0x7f66a415a360 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 -- 172.21.15.86:0/1933393380 >> 172.21.15.86:0/1933393380 conn(0x7f66a40cc1e0 msgr2=0x7f66a40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 -- 172.21.15.86:0/1933393380 shutdown_connections 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.670+0000 7f66a979d700 1 -- 172.21.15.86:0/1933393380 wait complete. 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.672+0000 7f66a979d700 1 Processor -- start 2023-10-09T12:00:02.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.672+0000 7f66a979d700 1 -- start start 2023-10-09T12:00:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a979d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a40ae0d0 0x7f66a41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a979d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 0x7f66a40c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40aef80 0x7f66a40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a979d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40b0100 con 0x7f66a40ae0d0 2023-10-09T12:00:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a979d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4159bf0 con 0x7f66a40cb1a0 2023-10-09T12:00:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40af4f0 con 0x7f66a40aef80 2023-10-09T12:00:02.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a40ae0d0 0x7f66a41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a40ae0d0 0x7f66a41596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45770/0 (socket says 172.21.15.86:45770) 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 -- 172.21.15.86:0/624944334 learned_addr learned my addr 172.21.15.86:0/624944334 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a8f9c700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40aef80 0x7f66a40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 -- 172.21.15.86:0/624944334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40aef80 msgr2=0x7f66a40b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40aef80 0x7f66a40b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 -- 172.21.15.86:0/624944334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 msgr2=0x7f66a40c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 0x7f66a40c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.673+0000 7f66a3fff700 1 -- 172.21.15.86:0/624944334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c00bcf0 con 0x7f66a40ae0d0 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.674+0000 7f66a3fff700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a40ae0d0 0x7f66a41596b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f6694009f80 tx=0x7f6694017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.674+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669401bde0 con 0x7f66a40ae0d0 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.674+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694011420 con 0x7f66a40ae0d0 2023-10-09T12:00:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.674+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694009420 con 0x7f66a40ae0d0 2023-10-09T12:00:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.674+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940117e0 con 0x7f66a40ae0d0 2023-10-09T12:00:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.674+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a40afab0 con 0x7f66a40ae0d0 2023-10-09T12:00:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.675+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a406c450 con 0x7f66a40ae0d0 2023-10-09T12:00:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.676+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 59) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f6694011b50 con 0x7f66a40ae0d0 2023-10-09T12:00:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.676+0000 7f668bfff700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f66900671c0 0x7f6690069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.677+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f66940862a0 con 0x7f66a40ae0d0 2023-10-09T12:00:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.677+0000 7f66a37fe700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f66900671c0 0x7f6690069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.677+0000 7f66a37fe700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f66900671c0 0x7f6690069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66a40c6230 tx=0x7f6698007b30 comp rx=0 tx=0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:02.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.681+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6694052f60 con 0x7f66a40ae0d0 2023-10-09T12:00:02.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:02.930+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f66a415b000 con 0x7f66a40ae0d0 2023-10-09T12:00:03.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.348+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f6694053330 con 0x7f66a40ae0d0 2023-10-09T12:00:03.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.349+0000 7f668bfff700 1 -- 172.21.15.86:0/624944334 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v60) v1 ==== 93+0+0 (secure 0 0 0) 0x7f66940569f0 con 0x7f66a40ae0d0 2023-10-09T12:00:03.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f66900671c0 msgr2=0x7f6690069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:03.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f66900671c0 0x7f6690069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66a40c6230 tx=0x7f6698007b30 comp rx=0 tx=0).stop 2023-10-09T12:00:03.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a40ae0d0 msgr2=0x7f66a41596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a40ae0d0 0x7f66a41596b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f6694009f80 tx=0x7f6694017000 comp rx=0 tx=0).stop 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 shutdown_connections 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f66900671c0 0x7f6690069670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a40ae0d0 0x7f66a41596b0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66a40aef80 0x7f66a40b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 --2- 172.21.15.86:0/624944334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a40cb1a0 0x7f66a40c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 >> 172.21.15.86:0/624944334 conn(0x7f66a40cc1e0 msgr2=0x7f66a406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 shutdown_connections 2023-10-09T12:00:03.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.352+0000 7f66a979d700 1 -- 172.21.15.86:0/624944334 wait complete. 2023-10-09T12:00:03.374 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T12:00:03.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:00:03.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:00:03.544 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T12:00:03.544 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T12:00:03.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:00:03.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T12:00:03.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T12:00:03.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:03.630 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T12:00:03.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:00:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.894+0000 7f05d27ff700 1 Processor -- start 2023-10-09T12:00:03.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.894+0000 7f05d27ff700 1 -- start start 2023-10-09T12:00:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.895+0000 7f05d27ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f05cc06bcd0 0x7f05cc0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.895+0000 7f05d27ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc15d7e0 con 0x7f05cc06c0a0 2023-10-09T12:00:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.895+0000 7f05d27ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc15dac0 con 0x7f05cc15df50 2023-10-09T12:00:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.895+0000 7f05d27ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc15aa30 con 0x7f05cc06bcd0 2023-10-09T12:00:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05cb7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f05cc06c0a0 0x7f05cc15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33340/0 (socket says 172.21.15.86:33340) 2023-10-09T12:00:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05cb7fe700 1 -- 172.21.15.86:0/3530722542 learned_addr learned my addr 172.21.15.86:0/3530722542 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:03.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05cbfff700 1 --2- 172.21.15.86:0/3530722542 >> v2:172.21.15.135:3300/0 conn(0x7f05cc06bcd0 0x7f05cc0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:03.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05caffd700 1 -- 172.21.15.86:0/3530722542 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049245901 0 0) 0x7f05cc15d7e0 con 0x7f05cc06c0a0 2023-10-09T12:00:03.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05caffd700 1 -- 172.21.15.86:0/3530722542 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b4003570 con 0x7f05cc06c0a0 2023-10-09T12:00:03.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05cbfff700 1 -- 172.21.15.86:0/3530722542 >> v1:172.21.15.135:6789/0 conn(0x7f05cc15df50 legacy=0x7f05cc0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:03.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05cbfff700 1 -- 172.21.15.86:0/3530722542 >> v1:172.21.15.86:6789/0 conn(0x7f05cc06c0a0 legacy=0x7f05cc15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:03.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.896+0000 7f05cbfff700 1 -- 172.21.15.86:0/3530722542 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc15ad10 con 0x7f05cc06bcd0 2023-10-09T12:00:03.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.897+0000 7f05cbfff700 1 --2- 172.21.15.86:0/3530722542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc06bcd0 0x7f05cc0caa90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0098e0 tx=0x7f05bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3020672e7e549e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:03.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.897+0000 7f05caffd700 1 -- 172.21.15.86:0/3530722542 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00b640 con 0x7f05cc06bcd0 2023-10-09T12:00:03.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.897+0000 7f05caffd700 1 -- 172.21.15.86:0/3530722542 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00b7a0 con 0x7f05cc06bcd0 2023-10-09T12:00:03.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.897+0000 7f05caffd700 1 -- 172.21.15.86:0/3530722542 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00bb40 con 0x7f05cc06bcd0 2023-10-09T12:00:03.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.898+0000 7f05d27ff700 1 -- 172.21.15.86:0/3530722542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc06bcd0 msgr2=0x7f05cc0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:03.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.898+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3530722542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc06bcd0 0x7f05cc0caa90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0098e0 tx=0x7f05bc0091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.898+0000 7f05d27ff700 1 -- 172.21.15.86:0/3530722542 shutdown_connections 2023-10-09T12:00:03.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.898+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3530722542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc06bcd0 0x7f05cc0caa90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.898+0000 7f05d27ff700 1 -- 172.21.15.86:0/3530722542 >> 172.21.15.86:0/3530722542 conn(0x7f05cc0ce600 msgr2=0x7f05cc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:03.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.898+0000 7f05d27ff700 1 -- 172.21.15.86:0/3530722542 shutdown_connections 2023-10-09T12:00:03.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.898+0000 7f05d27ff700 1 -- 172.21.15.86:0/3530722542 wait complete. 2023-10-09T12:00:03.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.900+0000 7f05d27ff700 1 Processor -- start 2023-10-09T12:00:03.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.900+0000 7f05d27ff700 1 -- start start 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05d27ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05cc06bcd0 0x7f05cc1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05d27ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05cc06c0a0 0x7f05cc0c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05d27ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc15df50 0x7f05cc0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05d27ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0c6370 con 0x7f05cc06c0a0 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05d27ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0c6650 con 0x7f05cc15df50 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05d27ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0c6930 con 0x7f05cc06bcd0 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05cc06c0a0 0x7f05cc0c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:03.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05cb7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05cc06c0a0 0x7f05cc0c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45782/0 (socket says 172.21.15.86:45782) 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05cb7fe700 1 -- 172.21.15.86:0/3950278100 learned_addr learned my addr 172.21.15.86:0/3950278100 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05d0d9c700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc15df50 0x7f05cc0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.902+0000 7f05cbfff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05cc06bcd0 0x7f05cc1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05cb7fe700 1 -- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05cc06bcd0 msgr2=0x7f05cc1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05cb7fe700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05cc06bcd0 0x7f05cc1469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05cb7fe700 1 -- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc15df50 msgr2=0x7f05cc0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05cb7fe700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc15df50 0x7f05cc0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05cb7fe700 1 -- 172.21.15.86:0/3950278100 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc009420 con 0x7f05cc06c0a0 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05d0d9c700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc15df50 0x7f05cc0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:03.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05cb7fe700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05cc06c0a0 0x7f05cc0c3d80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c590 tx=0x7f05c0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:03.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05b3fff700 1 -- 172.21.15.86:0/3950278100 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0005b30 con 0x7f05cc06c0a0 2023-10-09T12:00:03.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05b3fff700 1 -- 172.21.15.86:0/3950278100 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0005cb0 con 0x7f05cc06c0a0 2023-10-09T12:00:03.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc0c6c10 con 0x7f05cc06c0a0 2023-10-09T12:00:03.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05b3fff700 1 -- 172.21.15.86:0/3950278100 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0007320 con 0x7f05cc06c0a0 2023-10-09T12:00:03.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.903+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc146f20 con 0x7f05cc06c0a0 2023-10-09T12:00:03.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.904+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc04c3c0 con 0x7f05cc06c0a0 2023-10-09T12:00:03.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.906+0000 7f05b3fff700 1 -- 172.21.15.86:0/3950278100 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f05c001b3b0 con 0x7f05cc06c0a0 2023-10-09T12:00:03.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.906+0000 7f05b3fff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 0x7f05b8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:03.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.906+0000 7f05b3fff700 1 -- 172.21.15.86:0/3950278100 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f05c00845d0 con 0x7f05cc06c0a0 2023-10-09T12:00:03.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.907+0000 7f05cbfff700 1 -- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 msgr2=0x7f05b8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:03.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.907+0000 7f05cbfff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 0x7f05b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:03.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:03.909+0000 7f05b3fff700 1 -- 172.21.15.86:0/3950278100 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c00511c0 con 0x7f05cc06c0a0 2023-10-09T12:00:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.108+0000 7f05cbfff700 1 -- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 msgr2=0x7f05b8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:04.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.108+0000 7f05cbfff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 0x7f05b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:04.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.150+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05cc15aff0 con 0x7f05cc06c0a0 2023-10-09T12:00:04.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.151+0000 7f05b3fff700 1 -- 172.21.15.86:0/3950278100 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f05c00547e0 con 0x7f05cc06c0a0 2023-10-09T12:00:04.152 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:04.152 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/2850632798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2850632798},{"type":"v1","addr":"172.21.15.86:6833","nonce":2850632798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/244252313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":244252313},{"type":"v1","addr":"172.21.15.135:6834","nonce":244252313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4164357513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4164357513},{"type":"v1","addr":"172.21.15.135:6835","nonce":4164357513}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:59:22.355864+0000","modified":"2023-10-09T11:59:26.316887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7183":{"gid":7183,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1465588551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1465588551},{"type":"v1","addr":"172.21.15.86:6835","nonce":1465588551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T12:00:04.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 msgr2=0x7f05b8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:04.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 0x7f05b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05cc06c0a0 msgr2=0x7f05cc0c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05cc06c0a0 0x7f05cc0c3d80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c590 tx=0x7f05c0007e00 comp rx=0 tx=0).stop 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 shutdown_connections 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05cc15df50 0x7f05cc0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05cc06bcd0 0x7f05cc1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f05b8067170 0x7f05b8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 --2- 172.21.15.86:0/3950278100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05cc06c0a0 0x7f05cc0c3d80 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 >> 172.21.15.86:0/3950278100 conn(0x7f05cc0ce600 msgr2=0x7f05cc0cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 shutdown_connections 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.153+0000 7f05d27ff700 1 -- 172.21.15.86:0/3950278100 wait complete. 2023-10-09T12:00:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 54 2023-10-09T12:00:04.173 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:00:04.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.356+0000 7fe8e759d700 1 Processor -- start 2023-10-09T12:00:04.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.356+0000 7fe8e759d700 1 -- start start 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.357+0000 7fe8e759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.357+0000 7fe8e759d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8e015d230 0x7fe8e015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.357+0000 7fe8e759d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e015dbd0 con 0x7fe8e0159420 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.357+0000 7fe8e759d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00b11d0 con 0x7fe8e015d230 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.357+0000 7fe8e759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00b14b0 con 0x7fe8e01597f0 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e659b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe8e0159420 0x7fe8e00b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:45862/0 (socket says 172.21.15.86:45862) 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e659b700 1 -- 172.21.15.86:0/2011574565 learned_addr learned my addr 172.21.15.86:0/2011574565 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e6d9c700 1 --2- 172.21.15.86:0/2011574565 >> v2:172.21.15.135:3300/0 conn(0x7fe8e015d230 0x7fe8e015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e5d9a700 1 --2- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e5599700 1 -- 172.21.15.86:0/2011574565 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869007663 0 0) 0x7fe8dc001110 con 0x7fe8e0159420 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e5599700 1 -- 172.21.15.86:0/2011574565 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8cc003570 con 0x7fe8e0159420 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e6d9c700 1 -- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 msgr2=0x7fe8e00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e6d9c700 1 --2- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e6d9c700 1 -- 172.21.15.86:0/2011574565 >> v1:172.21.15.135:6789/0 conn(0x7fe8e0159420 legacy=0x7fe8e00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e6d9c700 1 -- 172.21.15.86:0/2011574565 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00b1790 con 0x7fe8e015d230 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.358+0000 7fe8e6d9c700 1 --2- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e015d230 0x7fe8e015d690 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009e60 tx=0x7fe8d8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a1274b41b1b9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e5599700 1 -- 172.21.15.86:0/2011574565 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800e070 con 0x7fe8e015d230 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e5599700 1 -- 172.21.15.86:0/2011574565 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800bab0 con 0x7fe8e015d230 2023-10-09T12:00:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e5599700 1 -- 172.21.15.86:0/2011574565 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800be70 con 0x7fe8e015d230 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 -- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e015d230 msgr2=0x7fe8e015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 --2- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e015d230 0x7fe8e015d690 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009e60 tx=0x7fe8d8009780 comp rx=0 tx=0).stop 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 -- 172.21.15.86:0/2011574565 shutdown_connections 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 --2- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e015d230 0x7fe8e015d690 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 --2- 172.21.15.86:0/2011574565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 -- 172.21.15.86:0/2011574565 >> 172.21.15.86:0/2011574565 conn(0x7fe8e00d0660 msgr2=0x7fe8e00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 -- 172.21.15.86:0/2011574565 shutdown_connections 2023-10-09T12:00:04.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.359+0000 7fe8e759d700 1 -- 172.21.15.86:0/2011574565 wait complete. 2023-10-09T12:00:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.361+0000 7fe8e759d700 1 Processor -- start 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.361+0000 7fe8e759d700 1 -- start start 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e0159420 0x7fe8e0156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e759d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8e015d230 0x7fe8e00b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e759d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c6350 con 0x7fe8e015d230 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c6630 con 0x7fe8e0159420 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c6910 con 0x7fe8e01597f0 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e6d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8e015d230 0x7fe8e00b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e6d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8e015d230 0x7fe8e00b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45798/0 (socket says 172.21.15.86:45798) 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e6d9c700 1 -- 172.21.15.86:0/1658988840 learned_addr learned my addr 172.21.15.86:0/1658988840 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e5d9a700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.362+0000 7fe8e659b700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e0159420 0x7fe8e0156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e6d9c700 1 -- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 msgr2=0x7fe8e00c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e6d9c700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e6d9c700 1 -- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e0159420 msgr2=0x7fe8e0156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e6d9c700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e0159420 0x7fe8e0156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e6d9c700 1 -- 172.21.15.86:0/1658988840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8009a20 con 0x7fe8e015d230 2023-10-09T12:00:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e6d9c700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8e015d230 0x7fe8e00b1f90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0089340 tx=0x7fe8d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8d67fc700 1 -- 172.21.15.86:0/1658988840 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8012e10 con 0x7fe8e015d230 2023-10-09T12:00:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8d67fc700 1 -- 172.21.15.86:0/1658988840 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8027470 con 0x7fe8e015d230 2023-10-09T12:00:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e00c9b10 con 0x7fe8e015d230 2023-10-09T12:00:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8d67fc700 1 -- 172.21.15.86:0/1658988840 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8027830 con 0x7fe8e015d230 2023-10-09T12:00:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.363+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e00c9730 con 0x7fe8e015d230 2023-10-09T12:00:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.364+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e00d01f0 con 0x7fe8e015d230 2023-10-09T12:00:04.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.366+0000 7fe8d67fc700 1 -- 172.21.15.86:0/1658988840 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fe8d8024070 con 0x7fe8e015d230 2023-10-09T12:00:04.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.366+0000 7fe8d67fc700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 0x7fe8c4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.367+0000 7fe8d67fc700 1 -- 172.21.15.86:0/1658988840 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fe8d8087940 con 0x7fe8e015d230 2023-10-09T12:00:04.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.367+0000 7fe8e659b700 1 -- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 msgr2=0x7fe8c4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:04.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.367+0000 7fe8e659b700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 0x7fe8c4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:04.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.374+0000 7fe8d67fc700 1 -- 172.21.15.86:0/1658988840 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d8054680 con 0x7fe8e015d230 2023-10-09T12:00:04.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.568+0000 7fe8e659b700 1 -- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 msgr2=0x7fe8c4069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:04.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.568+0000 7fe8e659b700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 0x7fe8c4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:04.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.570+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8e004c3c0 con 0x7fe8e015d230 2023-10-09T12:00:04.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.571+0000 7fe8d67fc700 1 -- 172.21.15.86:0/1658988840 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16348 (secure 0 0 0) 0x7fe8d8057ca0 con 0x7fe8e015d230 2023-10-09T12:00:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:04.573 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":125,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:43.482653+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:59:20.468724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:59:21.333069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:59:43.482619+0000","172.21.15.86:6836/85490":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/1884490929":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/1717191324":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/2752811597":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/373428236":"2023-10-10T11:59:43.482619+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:00:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 msgr2=0x7fe8c4069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 0x7fe8c4069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8e015d230 msgr2=0x7fe8e00b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8e015d230 0x7fe8e00b1f90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0089340 tx=0x7fe8d8019000 comp rx=0 tx=0).stop 2023-10-09T12:00:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 shutdown_connections 2023-10-09T12:00:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe8c4067170 0x7fe8c4069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8e015d230 0x7fe8e00b1f90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8e0159420 0x7fe8e0156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 --2- 172.21.15.86:0/1658988840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8e01597f0 0x7fe8e00c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 >> 172.21.15.86:0/1658988840 conn(0x7fe8e00d0660 msgr2=0x7fe8e0069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 shutdown_connections 2023-10-09T12:00:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.574+0000 7fe8e759d700 1 -- 172.21.15.86:0/1658988840 wait complete. 2023-10-09T12:00:04.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:59:20.468724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:59:21.333069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T12:00:04.593 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T12:00:04.644 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:04.642+0000 7f663009b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:00:04.691 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:04.690+0000 7f2ce50b6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:00:04.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.781+0000 7f01fa79d700 1 Processor -- start 2023-10-09T12:00:04.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.781+0000 7f01fa79d700 1 -- start start 2023-10-09T12:00:04.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01fa79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f01f4159a60 0x7f01f40c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01fa79d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f01f40ccc00 0x7f01f4069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01fa79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40c9cb0 con 0x7f01f406a020 2023-10-09T12:00:04.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01fa79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f406dfc0 con 0x7f01f4159a60 2023-10-09T12:00:04.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01fa79d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40c9f30 con 0x7f01f40ccc00 2023-10-09T12:00:04.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01f979b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f01f4159a60 0x7f01f40c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01f9f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f01f406a020 0x7f01f40cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33344/0 (socket says 172.21.15.86:33344) 2023-10-09T12:00:04.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01f9f9c700 1 -- 172.21.15.86:0/602122166 learned_addr learned my addr 172.21.15.86:0/602122166 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:04.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.783+0000 7f01f8f9a700 1 --2- 172.21.15.86:0/602122166 >> v2:172.21.15.135:3300/0 conn(0x7f01f40ccc00 0x7f01f4069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01f979b700 1 -- 172.21.15.86:0/602122166 >> v2:172.21.15.135:3300/0 conn(0x7f01f40ccc00 msgr2=0x7f01f4069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:04.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01f979b700 1 --2- 172.21.15.86:0/602122166 >> v2:172.21.15.135:3300/0 conn(0x7f01f40ccc00 0x7f01f4069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01f979b700 1 -- 172.21.15.86:0/602122166 >> v1:172.21.15.86:6789/0 conn(0x7f01f406a020 legacy=0x7f01f40cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01f979b700 1 -- 172.21.15.86:0/602122166 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40ca470 con 0x7f01f4159a60 2023-10-09T12:00:04.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01f979b700 1 --2- 172.21.15.86:0/602122166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f4159a60 0x7f01f40c9770 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f01f40cf6a0 tx=0x7f01f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4963e24653aa8c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01ebfff700 1 -- 172.21.15.86:0/602122166 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000b690 con 0x7f01f4159a60 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01ebfff700 1 -- 172.21.15.86:0/602122166 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f000b7f0 con 0x7f01f4159a60 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.784+0000 7f01ebfff700 1 -- 172.21.15.86:0/602122166 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000bb90 con 0x7f01f4159a60 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 -- 172.21.15.86:0/602122166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f4159a60 msgr2=0x7f01f40c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 --2- 172.21.15.86:0/602122166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f4159a60 0x7f01f40c9770 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f01f40cf6a0 tx=0x7f01f00091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 -- 172.21.15.86:0/602122166 shutdown_connections 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 --2- 172.21.15.86:0/602122166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f4159a60 0x7f01f40c9770 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 --2- 172.21.15.86:0/602122166 >> v2:172.21.15.135:3300/0 conn(0x7f01f40ccc00 0x7f01f4069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 -- 172.21.15.86:0/602122166 >> 172.21.15.86:0/602122166 conn(0x7f01f406baa0 msgr2=0x7f01f406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 -- 172.21.15.86:0/602122166 shutdown_connections 2023-10-09T12:00:04.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.785+0000 7f01fa79d700 1 -- 172.21.15.86:0/602122166 wait complete. 2023-10-09T12:00:04.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.786+0000 7f01fa79d700 1 Processor -- start 2023-10-09T12:00:04.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.786+0000 7f01fa79d700 1 -- start start 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.787+0000 7f01fa79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f406a020 0x7f01f40a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.787+0000 7f01fa79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f40ccc00 0x7f01f40b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.787+0000 7f01fa79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01f4159a60 0x7f01f41553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.787+0000 7f01fa79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40c75e0 con 0x7f01f406a020 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.787+0000 7f01fa79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f416aea0 con 0x7f01f40ccc00 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.787+0000 7f01fa79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40c7860 con 0x7f01f4159a60 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.787+0000 7f01f979b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f406a020 0x7f01f40a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f406a020 0x7f01f40a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45818/0 (socket says 172.21.15.86:45818) 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 -- 172.21.15.86:0/645566615 learned_addr learned my addr 172.21.15.86:0/645566615 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f8f9a700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f40ccc00 0x7f01f40b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f9f9c700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01f4159a60 0x7f01f41553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 -- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01f4159a60 msgr2=0x7f01f41553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01f4159a60 0x7f01f41553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 -- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f40ccc00 msgr2=0x7f01f40b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f40ccc00 0x7f01f40b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 -- 172.21.15.86:0/645566615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0009420 con 0x7f01f406a020 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01f979b700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f406a020 0x7f01f40a98d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f01f406cdc0 tx=0x7f01f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.788+0000 7f01e97fa700 1 -- 172.21.15.86:0/645566615 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000bb70 con 0x7f01f406a020 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.789+0000 7f01e97fa700 1 -- 172.21.15.86:0/645566615 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0011420 con 0x7f01f406a020 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.789+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f4155900 con 0x7f01f406a020 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.789+0000 7f01e97fa700 1 -- 172.21.15.86:0/645566615 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f00117c0 con 0x7f01f406a020 2023-10-09T12:00:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.789+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f40aa850 con 0x7f01f406a020 2023-10-09T12:00:04.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.790+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f406eba0 con 0x7f01f406a020 2023-10-09T12:00:04.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.790+0000 7f01e97fa700 1 -- 172.21.15.86:0/645566615 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f01f0011bb0 con 0x7f01f406a020 2023-10-09T12:00:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.791+0000 7f01e97fa700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 0x7f01d8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.791+0000 7f01e97fa700 1 -- 172.21.15.86:0/645566615 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f01f00863f0 con 0x7f01f406a020 2023-10-09T12:00:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.791+0000 7f01f8f9a700 1 -- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 msgr2=0x7f01d8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.791+0000 7f01f8f9a700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 0x7f01d8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:04.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.795+0000 7f01e97fa700 1 -- 172.21.15.86:0/645566615 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01f00530b0 con 0x7f01f406a020 2023-10-09T12:00:04.806 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:04.805+0000 7f663009b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:04.892 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:04.891+0000 7f663009b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:00:04.903 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:04.902+0000 7f2ce50b6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:04.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.992+0000 7f01f8f9a700 1 -- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 msgr2=0x7f01d8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:04.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:04.992+0000 7f01f8f9a700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 0x7f01d8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:05.011 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:05.010+0000 7f2ce50b6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:00:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.070+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01f40ca750 con 0x7f01f406a020 2023-10-09T12:00:05.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.070+0000 7f01e97fa700 1 -- 172.21.15.86:0/645566615 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01f0011e60 con 0x7f01f406a020 2023-10-09T12:00:05.072 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 msgr2=0x7f01d8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 0x7f01d8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f406a020 msgr2=0x7f01f40a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f406a020 0x7f01f40a98d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f01f406cdc0 tx=0x7f01f0017000 comp rx=0 tx=0).stop 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 shutdown_connections 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f01d8067170 0x7f01d8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f406a020 0x7f01f40a98d0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01f4159a60 0x7f01f41553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 --2- 172.21.15.86:0/645566615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f40ccc00 0x7f01f40b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 >> 172.21.15.86:0/645566615 conn(0x7f01f406baa0 msgr2=0x7f01f40ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:05.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 shutdown_connections 2023-10-09T12:00:05.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.073+0000 7f01fa79d700 1 -- 172.21.15.86:0/645566615 wait complete. 2023-10-09T12:00:05.094 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T12:00:05.119 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:05.118+0000 7f663009b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:05.244 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:05.243+0000 7f2ce50b6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:05.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.280+0000 7f4612b9d700 1 Processor -- start 2023-10-09T12:00:05.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.280+0000 7f4612b9d700 1 -- start start 2023-10-09T12:00:05.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f4612b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f460c159a60 0x7f460c0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f4612b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f460c0ccc00 0x7f460c069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f4612b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0c9cb0 con 0x7f460c06a020 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f4612b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c06dfc0 con 0x7f460c0ccc00 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f4612b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c0c9f30 con 0x7f460c159a60 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f461139a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f460c0ccc00 0x7f460c069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f461139a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f460c0ccc00 0x7f460c069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48816/0 (socket says 172.21.15.86:48816) 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f461139a700 1 -- 172.21.15.86:0/3812479425 learned_addr learned my addr 172.21.15.86:0/3812479425 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f4611b9b700 1 --2- 172.21.15.86:0/3812479425 >> v2:172.21.15.135:3300/0 conn(0x7f460c159a60 0x7f460c0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f461139a700 1 -- 172.21.15.86:0/3812479425 >> v2:172.21.15.135:3300/0 conn(0x7f460c159a60 msgr2=0x7f460c0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:05.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f461139a700 1 --2- 172.21.15.86:0/3812479425 >> v2:172.21.15.135:3300/0 conn(0x7f460c159a60 0x7f460c0c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f461139a700 1 -- 172.21.15.86:0/3812479425 >> v1:172.21.15.135:6789/0 conn(0x7f460c06a020 legacy=0x7f460c0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.282+0000 7f461139a700 1 -- 172.21.15.86:0/3812479425 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c0ca470 con 0x7f460c0ccc00 2023-10-09T12:00:05.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.283+0000 7f461139a700 1 --2- 172.21.15.86:0/3812479425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c069ae0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f460c06e510 tx=0x7f45fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d5c9eba22243c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.283+0000 7f4610b99700 1 -- 172.21.15.86:0/3812479425 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc009e70 con 0x7f460c0ccc00 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.283+0000 7f4610b99700 1 -- 172.21.15.86:0/3812479425 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc00b8f0 con 0x7f460c0ccc00 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.283+0000 7f4610b99700 1 -- 172.21.15.86:0/3812479425 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00bc90 con 0x7f460c0ccc00 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 -- 172.21.15.86:0/3812479425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 msgr2=0x7f460c069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 --2- 172.21.15.86:0/3812479425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c069ae0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f460c06e510 tx=0x7f45fc009250 comp rx=0 tx=0).stop 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 -- 172.21.15.86:0/3812479425 shutdown_connections 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 --2- 172.21.15.86:0/3812479425 >> v2:172.21.15.135:3300/0 conn(0x7f460c159a60 0x7f460c0c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 --2- 172.21.15.86:0/3812479425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c069ae0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 -- 172.21.15.86:0/3812479425 >> 172.21.15.86:0/3812479425 conn(0x7f460c06baa0 msgr2=0x7f460c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:05.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 -- 172.21.15.86:0/3812479425 shutdown_connections 2023-10-09T12:00:05.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.284+0000 7f4612b9d700 1 -- 172.21.15.86:0/3812479425 wait complete. 2023-10-09T12:00:05.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.285+0000 7f4612b9d700 1 Processor -- start 2023-10-09T12:00:05.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.285+0000 7f4612b9d700 1 -- start start 2023-10-09T12:00:05.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.286+0000 7f4612b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f460c06a020 0x7f460c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.286+0000 7f4612b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.286+0000 7f4612b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c159a60 0x7f460c14c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.286+0000 7f4612b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0c8590 con 0x7f460c0ccc00 2023-10-09T12:00:05.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.286+0000 7f4612b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0c5bc0 con 0x7f460c159a60 2023-10-09T12:00:05.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.286+0000 7f4612b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0b2a90 con 0x7f460c06a020 2023-10-09T12:00:05.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c159a60 0x7f460c14c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f4611b9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f460c06a020 0x7f460c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c0c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48824/0 (socket says 172.21.15.86:48824) 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 -- 172.21.15.86:0/2623787253 learned_addr learned my addr 172.21.15.86:0/2623787253 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 -- 172.21.15.86:0/2623787253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f460c06a020 msgr2=0x7f460c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f460c06a020 0x7f460c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 -- 172.21.15.86:0/2623787253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c159a60 msgr2=0x7f460c14c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c159a60 0x7f460c14c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 -- 172.21.15.86:0/2623787253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0094f0 con 0x7f460c0ccc00 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.287+0000 7f461139a700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c0c8050 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f45fc006fd0 tx=0x7f45fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.288+0000 7f4601ffb700 1 -- 172.21.15.86:0/2623787253 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00bc70 con 0x7f460c0ccc00 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.288+0000 7f4601ffb700 1 -- 172.21.15.86:0/2623787253 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc024440 con 0x7f460c0ccc00 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.288+0000 7f4601ffb700 1 -- 172.21.15.86:0/2623787253 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0247c0 con 0x7f460c0ccc00 2023-10-09T12:00:05.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.288+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c0b24d0 con 0x7f460c0ccc00 2023-10-09T12:00:05.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.288+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c0c5850 con 0x7f460c0ccc00 2023-10-09T12:00:05.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.289+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c0c5d70 con 0x7f460c0ccc00 2023-10-09T12:00:05.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.290+0000 7f4601ffb700 1 -- 172.21.15.86:0/2623787253 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f45fc01a420 con 0x7f460c0ccc00 2023-10-09T12:00:05.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.291+0000 7f4601ffb700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 0x7f45f0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.291+0000 7f4601ffb700 1 -- 172.21.15.86:0/2623787253 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f45fc0867c0 con 0x7f460c0ccc00 2023-10-09T12:00:05.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.291+0000 7f4611b9b700 1 -- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 msgr2=0x7f45f0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:05.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.291+0000 7f4611b9b700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 0x7f45f0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:05.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.295+0000 7f4601ffb700 1 -- 172.21.15.86:0/2623787253 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f460c0c5d70 con 0x7f460c0ccc00 2023-10-09T12:00:05.297 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:05.295+0000 7f663009b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:00:05.390 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:05.389+0000 7f663009b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:00:05.428 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:05.427+0000 7f2ce50b6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:00:05.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.492+0000 7f4611b9b700 1 -- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 msgr2=0x7f45f0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:05.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.492+0000 7f4611b9b700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 0x7f45f0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:05.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.493+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f460c0c5d70 con 0x7f460c0ccc00 2023-10-09T12:00:05.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.493+0000 7f4601ffb700 1 -- 172.21.15.86:0/2623787253 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7f460c0c5d70 con 0x7f460c0ccc00 2023-10-09T12:00:05.495 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T12:00:05.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 msgr2=0x7f45f0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:05.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 0x7f45f0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 msgr2=0x7f460c0c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c0c8050 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f45fc006fd0 tx=0x7f45fc017000 comp rx=0 tx=0).stop 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 shutdown_connections 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c159a60 0x7f460c14c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f460c06a020 0x7f460c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f45f0067170 0x7f45f0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 --2- 172.21.15.86:0/2623787253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460c0ccc00 0x7f460c0c8050 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 >> 172.21.15.86:0/2623787253 conn(0x7f460c06baa0 msgr2=0x7f460c156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 shutdown_connections 2023-10-09T12:00:05.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.496+0000 7f4612b9d700 1 -- 172.21.15.86:0/2623787253 wait complete. 2023-10-09T12:00:05.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T12:00:05.523 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:05.522+0000 7f2ce50b6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:00:05.554 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:05.553+0000 7f663009b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:00:05.654 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:05.653+0000 7f663009b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:05.693 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:05.692+0000 7f2ce50b6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:00:05.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.705+0000 7f5164d9d700 1 Processor -- start 2023-10-09T12:00:05.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.706+0000 7f5164d9d700 1 -- start start 2023-10-09T12:00:05.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.707+0000 7f5164d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f51600b16d0 0x7f51600b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.707+0000 7f5164d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600b2080 con 0x7f51600b4e70 2023-10-09T12:00:05.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.707+0000 7f5164d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600cfb00 con 0x7f51600b33b0 2023-10-09T12:00:05.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.707+0000 7f5164d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51600b5c40 con 0x7f51600b16d0 2023-10-09T12:00:05.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.707+0000 7f515f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f51600b4e70 0x7f51600ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35210/0 (socket says 172.21.15.86:35210) 2023-10-09T12:00:05.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.707+0000 7f515f7fe700 1 -- 172.21.15.86:0/1863793374 learned_addr learned my addr 172.21.15.86:0/1863793374 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:05.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.707+0000 7f515effd700 1 --2- 172.21.15.86:0/1863793374 >> v2:172.21.15.86:3300/0 conn(0x7f51600b16d0 0x7f51600b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515e7fc700 1 -- 172.21.15.86:0/1863793374 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355752920 0 0) 0x7f51600b2080 con 0x7f51600b4e70 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515e7fc700 1 -- 172.21.15.86:0/1863793374 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5148003570 con 0x7f51600b4e70 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515effd700 1 -- 172.21.15.86:0/1863793374 >> v1:172.21.15.135:6789/0 conn(0x7f51600b33b0 legacy=0x7f51600b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515e7fc700 1 -- 172.21.15.86:0/1863793374 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523970225 0 0) 0x7f51600cfb00 con 0x7f51600b33b0 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515effd700 1 -- 172.21.15.86:0/1863793374 >> v1:172.21.15.86:6789/0 conn(0x7f51600b4e70 legacy=0x7f51600ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515effd700 1 -- 172.21.15.86:0/1863793374 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600b5f20 con 0x7f51600b16d0 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515effd700 1 --2- 172.21.15.86:0/1863793374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b16d0 0x7f51600b1b40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f51540098e0 tx=0x7f51540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da912838758dfa84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515e7fc700 1 -- 172.21.15.86:0/1863793374 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400b640 con 0x7f51600b16d0 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515e7fc700 1 -- 172.21.15.86:0/1863793374 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515400b7a0 con 0x7f51600b16d0 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.708+0000 7f515e7fc700 1 -- 172.21.15.86:0/1863793374 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400bb40 con 0x7f51600b16d0 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.709+0000 7f5164d9d700 1 -- 172.21.15.86:0/1863793374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b16d0 msgr2=0x7f51600b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.709+0000 7f5164d9d700 1 --2- 172.21.15.86:0/1863793374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b16d0 0x7f51600b1b40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f51540098e0 tx=0x7f51540091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.709+0000 7f5164d9d700 1 -- 172.21.15.86:0/1863793374 shutdown_connections 2023-10-09T12:00:05.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.709+0000 7f5164d9d700 1 --2- 172.21.15.86:0/1863793374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b16d0 0x7f51600b1b40 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.709+0000 7f5164d9d700 1 -- 172.21.15.86:0/1863793374 >> 172.21.15.86:0/1863793374 conn(0x7f51600d10c0 msgr2=0x7f51600affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:05.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.709+0000 7f5164d9d700 1 -- 172.21.15.86:0/1863793374 shutdown_connections 2023-10-09T12:00:05.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.709+0000 7f5164d9d700 1 -- 172.21.15.86:0/1863793374 wait complete. 2023-10-09T12:00:05.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.710+0000 7f5164d9d700 1 Processor -- start 2023-10-09T12:00:05.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.711+0000 7f5164d9d700 1 -- start start 2023-10-09T12:00:05.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.711+0000 7f5164d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51600b16d0 0x7f51601459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f5164d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b33b0 0x7f516015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f5164d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51600b4e70 0x7f516015e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f5164d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51600c7370 con 0x7f51600b33b0 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f5164d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51600c8130 con 0x7f51600b16d0 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f5164d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51600c7090 con 0x7f51600b4e70 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b33b0 0x7f516015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b33b0 0x7f516015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48842/0 (socket says 172.21.15.86:48842) 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 -- 172.21.15.86:0/4255404939 learned_addr learned my addr 172.21.15.86:0/4255404939 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515f7fe700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51600b16d0 0x7f51601459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515ffff700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51600b4e70 0x7f516015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 -- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51600b4e70 msgr2=0x7f516015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51600b4e70 0x7f516015e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 -- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51600b16d0 msgr2=0x7f51601459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51600b16d0 0x7f51601459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.712+0000 7f515effd700 1 -- 172.21.15.86:0/4255404939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5154009420 con 0x7f51600b33b0 2023-10-09T12:00:05.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.713+0000 7f515effd700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b33b0 0x7f516015e420 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5160070dd0 tx=0x7f5154017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:05.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.713+0000 7f51477fe700 1 -- 172.21.15.86:0/4255404939 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515401f070 con 0x7f51600b33b0 2023-10-09T12:00:05.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.713+0000 7f51477fe700 1 -- 172.21.15.86:0/4255404939 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154002f70 con 0x7f51600b33b0 2023-10-09T12:00:05.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.713+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51600c7ae0 con 0x7f51600b33b0 2023-10-09T12:00:05.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.713+0000 7f51477fe700 1 -- 172.21.15.86:0/4255404939 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400b910 con 0x7f51600b33b0 2023-10-09T12:00:05.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.713+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5160145f00 con 0x7f51600b33b0 2023-10-09T12:00:05.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.714+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51600c82c0 con 0x7f51600b33b0 2023-10-09T12:00:05.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.715+0000 7f51477fe700 1 -- 172.21.15.86:0/4255404939 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f5154023070 con 0x7f51600b33b0 2023-10-09T12:00:05.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.716+0000 7f51477fe700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 0x7f514c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:05.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.716+0000 7f51477fe700 1 -- 172.21.15.86:0/4255404939 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f5154085e50 con 0x7f51600b33b0 2023-10-09T12:00:05.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.716+0000 7f515f7fe700 1 -- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 msgr2=0x7f514c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:05.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.716+0000 7f515f7fe700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 0x7f514c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:05.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.724+0000 7f51477fe700 1 -- 172.21.15.86:0/4255404939 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5154052ae0 con 0x7f51600b33b0 2023-10-09T12:00:05.803 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:05.802+0000 7f2ce50b6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:05.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.917+0000 7f515f7fe700 1 -- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 msgr2=0x7f514c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:05.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.917+0000 7f515f7fe700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 0x7f514c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:05.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.922+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f516015f3a0 con 0x7f51600b33b0 2023-10-09T12:00:05.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.922+0000 7f51477fe700 1 -- 172.21.15.86:0/4255404939 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5154015020 con 0x7f51600b33b0 2023-10-09T12:00:05.924 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 msgr2=0x7f514c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 0x7f514c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b33b0 msgr2=0x7f516015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b33b0 0x7f516015e420 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5160070dd0 tx=0x7f5154017000 comp rx=0 tx=0).stop 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 shutdown_connections 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51600b4e70 0x7f516015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51600b16d0 0x7f51601459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f514c067170 0x7f514c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 --2- 172.21.15.86:0/4255404939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51600b33b0 0x7f516015e420 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:05.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 >> 172.21.15.86:0/4255404939 conn(0x7f51600d10c0 msgr2=0x7f516015c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:05.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 shutdown_connections 2023-10-09T12:00:05.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:05.925+0000 7f5164d9d700 1 -- 172.21.15.86:0/4255404939 wait complete. 2023-10-09T12:00:05.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:00:06.140 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:06.138+0000 7f663009b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:00:06.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.170+0000 7feb9bfff700 1 Processor -- start 2023-10-09T12:00:06.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.170+0000 7feb9bfff700 1 -- start start 2023-10-09T12:00:06.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.171+0000 7feb9bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb9c06d950 0x7feb9c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.171+0000 7feb9bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c06ae70 con 0x7feb9c06dd20 2023-10-09T12:00:06.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.171+0000 7feb9bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0c7a30 con 0x7feb9c06a0a0 2023-10-09T12:00:06.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.171+0000 7feb9bfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c06a540 con 0x7feb9c06d950 2023-10-09T12:00:06.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.172+0000 7feb9b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7feb9c06dd20 0x7feb9c0c7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35226/0 (socket says 172.21.15.86:35226) 2023-10-09T12:00:06.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.172+0000 7feb9b7fe700 1 -- 172.21.15.86:0/677286576 learned_addr learned my addr 172.21.15.86:0/677286576 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:06.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.172+0000 7feb9affd700 1 --2- 172.21.15.86:0/677286576 >> v2:172.21.15.86:3300/0 conn(0x7feb9c06d950 0x7feb9c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.172+0000 7feb9affd700 1 -- 172.21.15.86:0/677286576 >> v1:172.21.15.135:6789/0 conn(0x7feb9c06a0a0 legacy=0x7feb9c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.172+0000 7feb9affd700 1 -- 172.21.15.86:0/677286576 >> v1:172.21.15.86:6789/0 conn(0x7feb9c06dd20 legacy=0x7feb9c0c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.172+0000 7feb9affd700 1 -- 172.21.15.86:0/677286576 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c06a820 con 0x7feb9c06d950 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.172+0000 7feb9affd700 1 --2- 172.21.15.86:0/677286576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06d950 0x7feb9c0c8350 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098e0 tx=0x7feb8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0bfdff2873a767 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb99ffb700 1 -- 172.21.15.86:0/677286576 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c009e80 con 0x7feb9c06d950 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb99ffb700 1 -- 172.21.15.86:0/677286576 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c00b860 con 0x7feb9c06d950 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb99ffb700 1 -- 172.21.15.86:0/677286576 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00bbe0 con 0x7feb9c06d950 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb9bfff700 1 -- 172.21.15.86:0/677286576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06d950 msgr2=0x7feb9c0c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb9bfff700 1 --2- 172.21.15.86:0/677286576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06d950 0x7feb9c0c8350 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098e0 tx=0x7feb8c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb9bfff700 1 -- 172.21.15.86:0/677286576 shutdown_connections 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb9bfff700 1 --2- 172.21.15.86:0/677286576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06d950 0x7feb9c0c8350 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb9bfff700 1 -- 172.21.15.86:0/677286576 >> 172.21.15.86:0/677286576 conn(0x7feb9c0cc1f0 msgr2=0x7feb9c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:06.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb9bfff700 1 -- 172.21.15.86:0/677286576 shutdown_connections 2023-10-09T12:00:06.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.173+0000 7feb9bfff700 1 -- 172.21.15.86:0/677286576 wait complete. 2023-10-09T12:00:06.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.175+0000 7feb9bfff700 1 Processor -- start 2023-10-09T12:00:06.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.175+0000 7feb9bfff700 1 -- start start 2023-10-09T12:00:06.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06a0a0 0x7feb9c0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb9c06d950 0x7feb9c0afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb9c06dd20 0x7feb9c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c54b0 con 0x7feb9c06a0a0 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0cbca0 con 0x7feb9c06d950 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c4e60 con 0x7feb9c06dd20 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06a0a0 0x7feb9c0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06a0a0 0x7feb9c0c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48864/0 (socket says 172.21.15.86:48864) 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9affd700 1 -- 172.21.15.86:0/3659730510 learned_addr learned my addr 172.21.15.86:0/3659730510 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9a7fc700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb9c06d950 0x7feb9c0afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.176+0000 7feb9b7fe700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb9c06dd20 0x7feb9c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9affd700 1 -- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb9c06dd20 msgr2=0x7feb9c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9affd700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb9c06dd20 0x7feb9c0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9affd700 1 -- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb9c06d950 msgr2=0x7feb9c0afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9affd700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb9c06d950 0x7feb9c0afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9affd700 1 -- 172.21.15.86:0/3659730510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009420 con 0x7feb9c06a0a0 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9affd700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06a0a0 0x7feb9c0c5940 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7feb9c06fe40 tx=0x7feb8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb82ffd700 1 -- 172.21.15.86:0/3659730510 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00baa0 con 0x7feb9c06a0a0 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb82ffd700 1 -- 172.21.15.86:0/3659730510 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c025420 con 0x7feb9c06a0a0 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb82ffd700 1 -- 172.21.15.86:0/3659730510 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0257c0 con 0x7feb9c06a0a0 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0c5140 con 0x7feb9c06a0a0 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.177+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0c4a80 con 0x7feb9c06a0a0 2023-10-09T12:00:06.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.178+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c0c5790 con 0x7feb9c06a0a0 2023-10-09T12:00:06.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.179+0000 7feb82ffd700 1 -- 172.21.15.86:0/3659730510 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7feb8c023070 con 0x7feb9c06a0a0 2023-10-09T12:00:06.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.180+0000 7feb82ffd700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 0x7feb88069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.180+0000 7feb82ffd700 1 -- 172.21.15.86:0/3659730510 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7feb8c0861c0 con 0x7feb9c06a0a0 2023-10-09T12:00:06.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.180+0000 7feb9a7fc700 1 -- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 msgr2=0x7feb88069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:06.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.180+0000 7feb9a7fc700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 0x7feb88069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:06.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.184+0000 7feb82ffd700 1 -- 172.21.15.86:0/3659730510 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb8c052f20 con 0x7feb9c06a0a0 2023-10-09T12:00:06.236 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:06.234+0000 7f663009b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:00:06.303 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:06.302+0000 7f2ce50b6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:00:06.324 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:06.323+0000 7f663009b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:00:06.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.381+0000 7feb9a7fc700 1 -- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 msgr2=0x7feb88069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:06.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.381+0000 7feb9a7fc700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 0x7feb88069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:06.399 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:06.399+0000 7f2ce50b6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:00:06.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.424+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb9c04c3c0 con 0x7feb9c06a0a0 2023-10-09T12:00:06.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.425+0000 7feb82ffd700 1 -- 172.21.15.86:0/3659730510 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4602 (secure 0 0 0) 0x7feb8c056540 con 0x7feb9c06a0a0 2023-10-09T12:00:06.426 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:06.426 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/2850632798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2850632798},{"type":"v1","addr":"172.21.15.86:6833","nonce":2850632798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/244252313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":244252313},{"type":"v1","addr":"172.21.15.135:6834","nonce":244252313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4164357513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4164357513},{"type":"v1","addr":"172.21.15.135:6835","nonce":4164357513}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:59:22.355864+0000","modified":"2023-10-09T11:59:26.316887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7183":{"gid":7183,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1465588551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1465588551},{"type":"v1","addr":"172.21.15.86:6835","nonce":1465588551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 msgr2=0x7feb88069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 0x7feb88069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06a0a0 msgr2=0x7feb9c0c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06a0a0 0x7feb9c0c5940 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7feb9c06fe40 tx=0x7feb8c017000 comp rx=0 tx=0).stop 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 shutdown_connections 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7feb88067170 0x7feb88069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb9c06a0a0 0x7feb9c0c5940 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb9c06dd20 0x7feb9c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 --2- 172.21.15.86:0/3659730510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb9c06d950 0x7feb9c0afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 >> 172.21.15.86:0/3659730510 conn(0x7feb9c0cc1f0 msgr2=0x7feb9c0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:06.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 shutdown_connections 2023-10-09T12:00:06.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.427+0000 7feb9bfff700 1 -- 172.21.15.86:0/3659730510 wait complete. 2023-10-09T12:00:06.430 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 54 2023-10-09T12:00:06.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:00:06.500 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:06.499+0000 7f2ce50b6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:00:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.634+0000 7faa4bfff700 1 Processor -- start 2023-10-09T12:00:06.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.634+0000 7faa4bfff700 1 -- start start 2023-10-09T12:00:06.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.635+0000 7faa4bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faa4c1597f0 0x7faa4c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.635+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c15d230 0x7faa4c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.635+0000 7faa4bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c15dbb0 con 0x7faa4c159420 2023-10-09T12:00:06.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.635+0000 7faa4bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0b11d0 con 0x7faa4c1597f0 2023-10-09T12:00:06.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.635+0000 7faa4bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0b14b0 con 0x7faa4c15d230 2023-10-09T12:00:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4b7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c15d230 0x7faa4c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4a7fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faa4c1597f0 0x7faa4c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4b7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c15d230 0x7faa4c15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35784/0 (socket says 172.21.15.86:35784) 2023-10-09T12:00:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4b7fe700 1 -- 172.21.15.86:0/520729681 learned_addr learned my addr 172.21.15.86:0/520729681 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4b7fe700 1 -- 172.21.15.86:0/520729681 >> v2:172.21.15.135:3300/0 conn(0x7faa4c1597f0 msgr2=0x7faa4c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:06.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4b7fe700 1 --2- 172.21.15.86:0/520729681 >> v2:172.21.15.135:3300/0 conn(0x7faa4c1597f0 0x7faa4c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4b7fe700 1 -- 172.21.15.86:0/520729681 >> v1:172.21.15.135:6789/0 conn(0x7faa4c159420 legacy=0x7faa4c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.636+0000 7faa4b7fe700 1 -- 172.21.15.86:0/520729681 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0b1790 con 0x7faa4c15d230 2023-10-09T12:00:06.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4b7fe700 1 --2- 172.21.15.86:0/520729681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c15d230 0x7faa4c15d670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa44009f20 tx=0x7faa44009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79f8c4218e70a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:06.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa49ffb700 1 -- 172.21.15.86:0/520729681 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400e070 con 0x7faa4c15d230 2023-10-09T12:00:06.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa49ffb700 1 -- 172.21.15.86:0/520729681 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4400b9d0 con 0x7faa4c15d230 2023-10-09T12:00:06.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa49ffb700 1 -- 172.21.15.86:0/520729681 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440092e0 con 0x7faa4c15d230 2023-10-09T12:00:06.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4bfff700 1 -- 172.21.15.86:0/520729681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c15d230 msgr2=0x7faa4c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4bfff700 1 --2- 172.21.15.86:0/520729681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c15d230 0x7faa4c15d670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa44009f20 tx=0x7faa44009840 comp rx=0 tx=0).stop 2023-10-09T12:00:06.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4bfff700 1 -- 172.21.15.86:0/520729681 shutdown_connections 2023-10-09T12:00:06.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4bfff700 1 --2- 172.21.15.86:0/520729681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c15d230 0x7faa4c15d670 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4bfff700 1 --2- 172.21.15.86:0/520729681 >> v2:172.21.15.135:3300/0 conn(0x7faa4c1597f0 0x7faa4c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4bfff700 1 -- 172.21.15.86:0/520729681 >> 172.21.15.86:0/520729681 conn(0x7faa4c0d0660 msgr2=0x7faa4c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:06.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.637+0000 7faa4bfff700 1 -- 172.21.15.86:0/520729681 shutdown_connections 2023-10-09T12:00:06.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.638+0000 7faa4bfff700 1 -- 172.21.15.86:0/520729681 wait complete. 2023-10-09T12:00:06.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.639+0000 7faa4bfff700 1 Processor -- start 2023-10-09T12:00:06.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.639+0000 7faa4bfff700 1 -- start start 2023-10-09T12:00:06.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c159420 0x7faa4c168eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa4c1597f0 0x7faa4c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa4c15d230 0x7faa4c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15a050 con 0x7faa4c15d230 2023-10-09T12:00:06.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c14fc70 con 0x7faa4c1597f0 2023-10-09T12:00:06.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0b3e50 con 0x7faa4c159420 2023-10-09T12:00:06.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa4c15d230 0x7faa4c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa4c15d230 0x7faa4c1548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48878/0 (socket says 172.21.15.86:48878) 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4b7fe700 1 -- 172.21.15.86:0/1262879246 learned_addr learned my addr 172.21.15.86:0/1262879246 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4affd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c159420 0x7faa4c168eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.640+0000 7faa4a7fc700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa4c1597f0 0x7faa4c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4b7fe700 1 -- 172.21.15.86:0/1262879246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c159420 msgr2=0x7faa4c168eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4b7fe700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c159420 0x7faa4c168eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4b7fe700 1 -- 172.21.15.86:0/1262879246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa4c1597f0 msgr2=0x7faa4c154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4b7fe700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa4c1597f0 0x7faa4c154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4b7fe700 1 -- 172.21.15.86:0/1262879246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009ae0 con 0x7faa4c15d230 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4b7fe700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa4c15d230 0x7faa4c1548a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7faa4400b610 tx=0x7faa44018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa32ffd700 1 -- 172.21.15.86:0/1262879246 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44008ad0 con 0x7faa4c15d230 2023-10-09T12:00:06.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa32ffd700 1 -- 172.21.15.86:0/1262879246 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44008c30 con 0x7faa4c15d230 2023-10-09T12:00:06.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa32ffd700 1 -- 172.21.15.86:0/1262879246 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44025460 con 0x7faa4c15d230 2023-10-09T12:00:06.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c15b7d0 con 0x7faa4c15d230 2023-10-09T12:00:06.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.641+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c0b4380 con 0x7faa4c15d230 2023-10-09T12:00:06.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.642+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c04c3c0 con 0x7faa4c15d230 2023-10-09T12:00:06.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.643+0000 7faa32ffd700 1 -- 172.21.15.86:0/1262879246 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7faa44003040 con 0x7faa4c15d230 2023-10-09T12:00:06.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.645+0000 7faa32ffd700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 0x7faa38069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:06.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.645+0000 7faa4affd700 1 -- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 msgr2=0x7faa38069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:06.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.645+0000 7faa32ffd700 1 -- 172.21.15.86:0/1262879246 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7faa44086420 con 0x7faa4c15d230 2023-10-09T12:00:06.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.645+0000 7faa4affd700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 0x7faa38069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:06.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.649+0000 7faa32ffd700 1 -- 172.21.15.86:0/1262879246 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa44053070 con 0x7faa4c15d230 2023-10-09T12:00:06.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.846+0000 7faa4affd700 1 -- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 msgr2=0x7faa38069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:06.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.846+0000 7faa4affd700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 0x7faa38069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:06.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.849+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa4c0b1a70 con 0x7faa4c15d230 2023-10-09T12:00:06.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.850+0000 7faa32ffd700 1 -- 172.21.15.86:0/1262879246 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16348 (secure 0 0 0) 0x7faa44056690 con 0x7faa4c15d230 2023-10-09T12:00:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:06.852 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":125,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T11:59:43.482653+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:59:20.468724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:59:21.333069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:59:43.482619+0000","172.21.15.86:6836/85490":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/1884490929":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/1717191324":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/2752811597":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/373428236":"2023-10-10T11:59:43.482619+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:00:06.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 msgr2=0x7faa38069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:06.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 0x7faa38069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa4c15d230 msgr2=0x7faa4c1548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa4c15d230 0x7faa4c1548a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7faa4400b610 tx=0x7faa44018000 comp rx=0 tx=0).stop 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 shutdown_connections 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faa38067170 0x7faa38069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa4c15d230 0x7faa4c1548a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa4c159420 0x7faa4c168eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 --2- 172.21.15.86:0/1262879246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa4c1597f0 0x7faa4c154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 >> 172.21.15.86:0/1262879246 conn(0x7faa4c0d0660 msgr2=0x7faa4c069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 shutdown_connections 2023-10-09T12:00:06.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:06.853+0000 7faa4bfff700 1 -- 172.21.15.86:0/1262879246 wait complete. 2023-10-09T12:00:06.873 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T12:00:06.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:00:06.948 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:06.947+0000 7f663009b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:00:07.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.086+0000 7f86da59d700 1 Processor -- start 2023-10-09T12:00:07.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.086+0000 7f86da59d700 1 -- start start 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86da59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86d415daa0 0x7f86d406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86da59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415de70 0x7f86d40c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86da59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d406e8c0 con 0x7f86d40696c0 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86da59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d40ca740 con 0x7f86d415daa0 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86da59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d406e5e0 con 0x7f86d415de70 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86d959b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86d415daa0 0x7f86d406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86d8d9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415de70 0x7f86d40c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86d8d9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415de70 0x7f86d40c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35800/0 (socket says 172.21.15.86:35800) 2023-10-09T12:00:07.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86d959b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f86d415daa0 0x7f86d406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:48316/0 (socket says 172.21.15.86:48316) 2023-10-09T12:00:07.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86d9d9c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f86d40696c0 0x7f86d406ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:54030/0 (socket says 172.21.15.86:54030) 2023-10-09T12:00:07.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.089+0000 7f86d8d9a700 1 -- 172.21.15.86:0/1232447186 learned_addr learned my addr 172.21.15.86:0/1232447186 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:07.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.090+0000 7f86d8d9a700 1 -- 172.21.15.86:0/1232447186 >> v2:172.21.15.135:3300/0 conn(0x7f86d415daa0 msgr2=0x7f86d406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:07.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.090+0000 7f86d8d9a700 1 --2- 172.21.15.86:0/1232447186 >> v2:172.21.15.135:3300/0 conn(0x7f86d415daa0 0x7f86d406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.090+0000 7f86d8d9a700 1 -- 172.21.15.86:0/1232447186 >> v1:172.21.15.135:6789/0 conn(0x7f86d40696c0 legacy=0x7f86d406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.090+0000 7f86d8d9a700 1 -- 172.21.15.86:0/1232447186 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40ca0f0 con 0x7f86d415de70 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.090+0000 7f86d959b700 1 --2- 172.21.15.86:0/1232447186 >> v2:172.21.15.135:3300/0 conn(0x7f86d415daa0 0x7f86d406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.090+0000 7f86d8d9a700 1 --2- 172.21.15.86:0/1232447186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415de70 0x7f86d40c7110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f86c80099b0 tx=0x7f86c8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4bcb4c22f0e3c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.090+0000 7f86d3fff700 1 -- 172.21.15.86:0/1232447186 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8009ea0 con 0x7f86d415de70 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86d3fff700 1 -- 172.21.15.86:0/1232447186 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c800b860 con 0x7f86d415de70 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86d3fff700 1 -- 172.21.15.86:0/1232447186 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800bc20 con 0x7f86d415de70 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 -- 172.21.15.86:0/1232447186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415de70 msgr2=0x7f86d40c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 --2- 172.21.15.86:0/1232447186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415de70 0x7f86d40c7110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f86c80099b0 tx=0x7f86c8009250 comp rx=0 tx=0).stop 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 -- 172.21.15.86:0/1232447186 shutdown_connections 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 --2- 172.21.15.86:0/1232447186 >> v2:172.21.15.135:3300/0 conn(0x7f86d415daa0 0x7f86d406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 --2- 172.21.15.86:0/1232447186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415de70 0x7f86d40c7110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 -- 172.21.15.86:0/1232447186 >> 172.21.15.86:0/1232447186 conn(0x7f86d40cc1f0 msgr2=0x7f86d40cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:07.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 -- 172.21.15.86:0/1232447186 shutdown_connections 2023-10-09T12:00:07.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.091+0000 7f86da59d700 1 -- 172.21.15.86:0/1232447186 wait complete. 2023-10-09T12:00:07.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.093+0000 7f86da59d700 1 Processor -- start 2023-10-09T12:00:07.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.093+0000 7f86da59d700 1 -- start start 2023-10-09T12:00:07.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86da59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d40696c0 0x7f86d4149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86da59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415daa0 0x7f86d40c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86da59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d415de70 0x7f86d4145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86da59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40b0350 con 0x7f86d40696c0 2023-10-09T12:00:07.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86da59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d414a4c0 con 0x7f86d415de70 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86da59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40c4b90 con 0x7f86d415daa0 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86d959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d40696c0 0x7f86d4149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86d959b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d40696c0 0x7f86d4149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48888/0 (socket says 172.21.15.86:48888) 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86d8d9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415daa0 0x7f86d40c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86d9d9c700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d415de70 0x7f86d4145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.094+0000 7f86d959b700 1 -- 172.21.15.86:0/3815337108 learned_addr learned my addr 172.21.15.86:0/3815337108 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.095+0000 7f86d9d9c700 1 -- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415daa0 msgr2=0x7f86d40c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.095+0000 7f86d9d9c700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415daa0 0x7f86d40c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.095+0000 7f86d9d9c700 1 -- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d40696c0 msgr2=0x7f86d4149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.095+0000 7f86d9d9c700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d40696c0 0x7f86d4149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.095+0000 7f86d9d9c700 1 -- 172.21.15.86:0/3815337108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc009a20 con 0x7f86d415de70 2023-10-09T12:00:07.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.095+0000 7f86d9d9c700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d415de70 0x7f86d4145af0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c490 tx=0x7f86c4007e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:07.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.095+0000 7f86d17fa700 1 -- 172.21.15.86:0/3815337108 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4004830 con 0x7f86d415de70 2023-10-09T12:00:07.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.096+0000 7f86d17fa700 1 -- 172.21.15.86:0/3815337108 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c40049d0 con 0x7f86d415de70 2023-10-09T12:00:07.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.096+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80094f0 con 0x7f86d415de70 2023-10-09T12:00:07.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.096+0000 7f86d17fa700 1 -- 172.21.15.86:0/3815337108 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4004d90 con 0x7f86d415de70 2023-10-09T12:00:07.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.096+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d40af730 con 0x7f86d415de70 2023-10-09T12:00:07.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.097+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d40b04c0 con 0x7f86d415de70 2023-10-09T12:00:07.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.097+0000 7f86d17fa700 1 -- 172.21.15.86:0/3815337108 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f86c40074f0 con 0x7f86d415de70 2023-10-09T12:00:07.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.098+0000 7f86d17fa700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 0x7f86c00696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.098+0000 7f86d17fa700 1 -- 172.21.15.86:0/3815337108 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f86c40843b0 con 0x7f86d415de70 2023-10-09T12:00:07.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.099+0000 7f86d959b700 1 -- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 msgr2=0x7f86c00696f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:07.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.099+0000 7f86d959b700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 0x7f86c00696f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:07.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.103+0000 7f86d17fa700 1 -- 172.21.15.86:0/3815337108 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86d40b04c0 con 0x7f86d415de70 2023-10-09T12:00:07.121 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:07.120+0000 7f663009b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:07.152 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:07.151+0000 7f2ce50b6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:00:07.218 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:07.216+0000 7f663009b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:00:07.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.300+0000 7f86d959b700 1 -- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 msgr2=0x7f86c00696f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:07.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.300+0000 7f86d959b700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 0x7f86c00696f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:07.332 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:07.331+0000 7f2ce50b6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:07.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.349+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d40b04c0 con 0x7f86d415de70 2023-10-09T12:00:07.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.350+0000 7f86d17fa700 1 -- 172.21.15.86:0/3815337108 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f86d40b04c0 con 0x7f86d415de70 2023-10-09T12:00:07.351 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:07.351 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/2850632798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2850632798},{"type":"v1","addr":"172.21.15.86:6833","nonce":2850632798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/244252313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":244252313},{"type":"v1","addr":"172.21.15.135:6834","nonce":244252313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4164357513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4164357513},{"type":"v1","addr":"172.21.15.135:6835","nonce":4164357513}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:59:22.355864+0000","modified":"2023-10-09T11:59:26.316887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7183":{"gid":7183,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1465588551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1465588551},{"type":"v1","addr":"172.21.15.86:6835","nonce":1465588551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 msgr2=0x7f86c00696f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 0x7f86c00696f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d415de70 msgr2=0x7f86d4145af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d415de70 0x7f86d4145af0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c490 tx=0x7f86c4007e90 comp rx=0 tx=0).stop 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 shutdown_connections 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f86c0067240 0x7f86c00696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86d40696c0 0x7f86d4149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d415de70 0x7f86d4145af0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 --2- 172.21.15.86:0/3815337108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86d415daa0 0x7f86d40c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 >> 172.21.15.86:0/3815337108 conn(0x7f86d40cc1f0 msgr2=0x7f86d4168a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:07.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 shutdown_connections 2023-10-09T12:00:07.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.352+0000 7f86da59d700 1 -- 172.21.15.86:0/3815337108 wait complete. 2023-10-09T12:00:07.355 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 54 2023-10-09T12:00:07.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:00:07.439 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:07.438+0000 7f2ce50b6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:00:07.525 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:07.524+0000 7f663009b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:00:07.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.567+0000 7fc397dff700 1 Processor -- start 2023-10-09T12:00:07.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.567+0000 7fc397dff700 1 -- start start 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.568+0000 7fc397dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc390155c10 0x7fc390155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.568+0000 7fc397dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3900ac6a0 0x7fc3900b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.568+0000 7fc397dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3900acac0 con 0x7fc3900ac230 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.568+0000 7fc397dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3900ad930 con 0x7fc3900ac6a0 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.568+0000 7fc397dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900acd20 con 0x7fc390155c10 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3900ac6a0 0x7fc3900b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3900ac6a0 0x7fc3900b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48890/0 (socket says 172.21.15.86:48890) 2023-10-09T12:00:07.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 -- 172.21.15.86:0/1075692357 learned_addr learned my addr 172.21.15.86:0/1075692357 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39539a700 1 --1- 172.21.15.86:0/1075692357 >> v1:172.21.15.135:6789/0 conn(0x7fc3900ac230 0x7fc3901568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:54034/0 (socket says 172.21.15.86:54034) 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc395b9b700 1 --2- 172.21.15.86:0/1075692357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc390155c10 0x7fc390155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 -- 172.21.15.86:0/1075692357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc390155c10 msgr2=0x7fc390155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 --2- 172.21.15.86:0/1075692357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc390155c10 0x7fc390155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 -- 172.21.15.86:0/1075692357 >> v1:172.21.15.135:6789/0 conn(0x7fc3900ac230 legacy=0x7fc3901568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 -- 172.21.15.86:0/1075692357 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900ad000 con 0x7fc3900ac6a0 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc394b99700 1 -- 172.21.15.86:0/1075692357 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168792327 0 0) 0x7fc3900acac0 con 0x7fc3900ac230 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.569+0000 7fc39639c700 1 --2- 172.21.15.86:0/1075692357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac6a0 0x7fc3900b0300 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc38800d1a0 tx=0x7fc38800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd71c4fc9ac32e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc394b99700 1 -- 172.21.15.86:0/1075692357 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388010070 con 0x7fc3900ac6a0 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc394b99700 1 -- 172.21.15.86:0/1075692357 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38800de10 con 0x7fc3900ac6a0 2023-10-09T12:00:07.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc394b99700 1 -- 172.21.15.86:0/1075692357 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800b320 con 0x7fc3900ac6a0 2023-10-09T12:00:07.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc397dff700 1 -- 172.21.15.86:0/1075692357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac6a0 msgr2=0x7fc3900b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc397dff700 1 --2- 172.21.15.86:0/1075692357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac6a0 0x7fc3900b0300 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc38800d1a0 tx=0x7fc38800ba50 comp rx=0 tx=0).stop 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc397dff700 1 -- 172.21.15.86:0/1075692357 shutdown_connections 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc397dff700 1 --2- 172.21.15.86:0/1075692357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac6a0 0x7fc3900b0300 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.570+0000 7fc397dff700 1 --2- 172.21.15.86:0/1075692357 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc390155c10 0x7fc390155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.571+0000 7fc397dff700 1 -- 172.21.15.86:0/1075692357 >> 172.21.15.86:0/1075692357 conn(0x7fc39006a320 msgr2=0x7fc3900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.571+0000 7fc397dff700 1 -- 172.21.15.86:0/1075692357 shutdown_connections 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.571+0000 7fc397dff700 1 -- 172.21.15.86:0/1075692357 wait complete. 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.572+0000 7fc397dff700 1 Processor -- start 2023-10-09T12:00:07.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.572+0000 7fc397dff700 1 -- start start 2023-10-09T12:00:07.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc397dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac230 0x7fc3901517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc397dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900ac6a0 0x7fc3900c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc397dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc390155c10 0x7fc39006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc397dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc390169db0 con 0x7fc3900ac230 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc397dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc390151d10 con 0x7fc390155c10 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc397dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900cb7a0 con 0x7fc3900ac6a0 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc395b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac230 0x7fc3901517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc395b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac230 0x7fc3901517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48892/0 (socket says 172.21.15.86:48892) 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.573+0000 7fc395b9b700 1 -- 172.21.15.86:0/3600298111 learned_addr learned my addr 172.21.15.86:0/3600298111 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc39639c700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc390155c10 0x7fc39006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc39539a700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900ac6a0 0x7fc3900c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc395b9b700 1 -- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900ac6a0 msgr2=0x7fc3900c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc395b9b700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900ac6a0 0x7fc3900c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc395b9b700 1 -- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc390155c10 msgr2=0x7fc39006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc395b9b700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc390155c10 0x7fc39006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc395b9b700 1 -- 172.21.15.86:0/3600298111 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38800bcf0 con 0x7fc3900ac230 2023-10-09T12:00:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc395b9b700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac230 0x7fc3901517d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00e960 tx=0x7fc38c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.574+0000 7fc385ffb700 1 -- 172.21.15.86:0/3600298111 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c013680 con 0x7fc3900ac230 2023-10-09T12:00:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.575+0000 7fc385ffb700 1 -- 172.21.15.86:0/3600298111 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c0137e0 con 0x7fc3900ac230 2023-10-09T12:00:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.575+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3900cba80 con 0x7fc3900ac230 2023-10-09T12:00:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.575+0000 7fc385ffb700 1 -- 172.21.15.86:0/3600298111 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c013b80 con 0x7fc3900ac230 2023-10-09T12:00:07.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.575+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3900cc040 con 0x7fc3900ac230 2023-10-09T12:00:07.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.576+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc390169b80 con 0x7fc3900ac230 2023-10-09T12:00:07.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.577+0000 7fc385ffb700 1 -- 172.21.15.86:0/3600298111 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fc38c0123d0 con 0x7fc3900ac230 2023-10-09T12:00:07.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.578+0000 7fc385ffb700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 0x7fc374069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:07.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.578+0000 7fc385ffb700 1 -- 172.21.15.86:0/3600298111 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6395+0+0 (secure 0 0 0) 0x7fc38c084ca0 con 0x7fc3900ac230 2023-10-09T12:00:07.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.578+0000 7fc39539a700 1 -- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 msgr2=0x7fc374069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:07.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.578+0000 7fc39539a700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 0x7fc374069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:07.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.583+0000 7fc385ffb700 1 -- 172.21.15.86:0/3600298111 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc390169b80 con 0x7fc3900ac230 2023-10-09T12:00:07.621 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:07.620+0000 7f663009b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:00:07.746 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:07.745+0000 7f2ce50b6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:00:07.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.779+0000 7fc39539a700 1 -- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 msgr2=0x7fc374069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:07.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.779+0000 7fc39539a700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 0x7fc374069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:07.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.822+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc39004c3c0 con 0x7fc3900ac230 2023-10-09T12:00:07.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.823+0000 7fc385ffb700 1 -- 172.21.15.86:0/3600298111 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc38c051930 con 0x7fc3900ac230 2023-10-09T12:00:07.824 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:07.824 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/2850632798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2850632798},{"type":"v1","addr":"172.21.15.86:6833","nonce":2850632798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/244252313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":244252313},{"type":"v1","addr":"172.21.15.135:6834","nonce":244252313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4164357513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4164357513},{"type":"v1","addr":"172.21.15.135:6835","nonce":4164357513}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:59:22.355864+0000","modified":"2023-10-09T11:59:26.316887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7183":{"gid":7183,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/1465588551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1465588551},{"type":"v1","addr":"172.21.15.86:6835","nonce":1465588551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T12:00:07.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 msgr2=0x7fc374069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:07.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 0x7fc374069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac230 msgr2=0x7fc3901517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:07.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac230 0x7fc3901517d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00e960 tx=0x7fc38c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 shutdown_connections 2023-10-09T12:00:07.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc374067170 0x7fc374069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900ac230 0x7fc3901517d0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc390155c10 0x7fc39006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 --2- 172.21.15.86:0/3600298111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900ac6a0 0x7fc3900c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:07.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 >> 172.21.15.86:0/3600298111 conn(0x7fc39006a320 msgr2=0x7fc390153560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:07.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.825+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 shutdown_connections 2023-10-09T12:00:07.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:07.826+0000 7fc397dff700 1 -- 172.21.15.86:0/3600298111 wait complete. 2023-10-09T12:00:07.828 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 54 2023-10-09T12:00:07.845 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:00:07.845 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:07.844+0000 7f2ce50b6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:00:08.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.028+0000 7f04649ff700 1 Processor -- start 2023-10-09T12:00:08.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.028+0000 7f04649ff700 1 -- start start 2023-10-09T12:00:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f04649ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f04600ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f04649ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04600ccf90 0x7f04600c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f04649ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04600cc300 con 0x7f04600cbf30 2023-10-09T12:00:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f04649ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0460156bf0 con 0x7f04600ccf90 2023-10-09T12:00:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f04649ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04600ae950 con 0x7f04600b1420 2023-10-09T12:00:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f045ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04600ccf90 0x7f04600c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f045ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04600ccf90 0x7f04600c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48908/0 (socket says 172.21.15.86:48908) 2023-10-09T12:00:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f045ed9d700 1 -- 172.21.15.86:0/4022794986 learned_addr learned my addr 172.21.15.86:0/4022794986 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:08.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.030+0000 7f045dd9b700 1 --2- 172.21.15.86:0/4022794986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f04600ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045ed9d700 1 -- 172.21.15.86:0/4022794986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 msgr2=0x7f04600ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045d59a700 1 -- 172.21.15.86:0/4022794986 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775275381 0 0) 0x7f04600cc300 con 0x7f04600cbf30 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045ed9d700 1 --2- 172.21.15.86:0/4022794986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f04600ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045ed9d700 1 -- 172.21.15.86:0/4022794986 >> v1:172.21.15.135:6789/0 conn(0x7f04600cbf30 legacy=0x7f04600b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045ed9d700 1 -- 172.21.15.86:0/4022794986 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600ad370 con 0x7f04600ccf90 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045ed9d700 1 --2- 172.21.15.86:0/4022794986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600ccf90 0x7f04600c9740 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0458009f50 tx=0x7f0458009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9dc1525389ea10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045d59a700 1 -- 172.21.15.86:0/4022794986 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04580092e0 con 0x7f04600ccf90 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045d59a700 1 -- 172.21.15.86:0/4022794986 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045800b9c0 con 0x7f04600ccf90 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.031+0000 7f045d59a700 1 -- 172.21.15.86:0/4022794986 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800bd80 con 0x7f04600ccf90 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 -- 172.21.15.86:0/4022794986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600ccf90 msgr2=0x7f04600c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 --2- 172.21.15.86:0/4022794986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600ccf90 0x7f04600c9740 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0458009f50 tx=0x7f0458009840 comp rx=0 tx=0).stop 2023-10-09T12:00:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 -- 172.21.15.86:0/4022794986 shutdown_connections 2023-10-09T12:00:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 --2- 172.21.15.86:0/4022794986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600ccf90 0x7f04600c9740 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 --2- 172.21.15.86:0/4022794986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f04600ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 -- 172.21.15.86:0/4022794986 >> 172.21.15.86:0/4022794986 conn(0x7f046006a320 msgr2=0x7f04600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 -- 172.21.15.86:0/4022794986 shutdown_connections 2023-10-09T12:00:08.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.032+0000 7f04649ff700 1 -- 172.21.15.86:0/4022794986 wait complete. 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.033+0000 7f04649ff700 1 Processor -- start 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.033+0000 7f04649ff700 1 -- start start 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.034+0000 7f04649ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f0460169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.034+0000 7f04649ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600cbf30 0x7f0460152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.034+0000 7f04649ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04600ccf90 0x7f0460159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.034+0000 7f04649ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460158140 con 0x7f04600cbf30 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.034+0000 7f04649ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460157530 con 0x7f04600ccf90 2023-10-09T12:00:08.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.034+0000 7f04649ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0460157810 con 0x7f04600b1420 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600cbf30 0x7f0460152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600cbf30 0x7f0460152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48914/0 (socket says 172.21.15.86:48914) 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045e59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f0460169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 -- 172.21.15.86:0/805816171 learned_addr learned my addr 172.21.15.86:0/805816171 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045ed9d700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04600ccf90 0x7f0460159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 -- 172.21.15.86:0/805816171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 msgr2=0x7f0460169e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f0460169e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 -- 172.21.15.86:0/805816171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04600ccf90 msgr2=0x7f0460159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04600ccf90 0x7f0460159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 -- 172.21.15.86:0/805816171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458009ae0 con 0x7f04600cbf30 2023-10-09T12:00:08.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.035+0000 7f045dd9b700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600cbf30 0x7f0460152120 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f045400ec80 tx=0x7f04540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.036+0000 7f044e7fc700 1 -- 172.21.15.86:0/805816171 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400c850 con 0x7f04600cbf30 2023-10-09T12:00:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.036+0000 7f044e7fc700 1 -- 172.21.15.86:0/805816171 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045400c9b0 con 0x7f04600cbf30 2023-10-09T12:00:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.036+0000 7f044e7fc700 1 -- 172.21.15.86:0/805816171 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400cd50 con 0x7f04600cbf30 2023-10-09T12:00:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.036+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0460157af0 con 0x7f04600cbf30 2023-10-09T12:00:08.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.036+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0460152660 con 0x7f04600cbf30 2023-10-09T12:00:08.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.037+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046004c3c0 con 0x7f04600cbf30 2023-10-09T12:00:08.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.038+0000 7f044e7fc700 1 -- 172.21.15.86:0/805816171 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f0454013680 con 0x7f04600cbf30 2023-10-09T12:00:08.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.038+0000 7f044e7fc700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 0x7f0440069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.039+0000 7f044e7fc700 1 -- 172.21.15.86:0/805816171 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6395+0+0 (secure 0 0 0) 0x7f0454084dc0 con 0x7f04600cbf30 2023-10-09T12:00:08.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.039+0000 7f045e59c700 1 -- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 msgr2=0x7f0440069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:08.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.039+0000 7f045e59c700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 0x7f0440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:08.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.046+0000 7f044e7fc700 1 -- 172.21.15.86:0/805816171 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0454051af0 con 0x7f04600cbf30 2023-10-09T12:00:08.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.240+0000 7f045e59c700 1 -- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 msgr2=0x7f0440069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:08.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.240+0000 7f045e59c700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 0x7f0440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:08.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.246+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0460158280 con 0x7f04600cbf30 2023-10-09T12:00:08.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.247+0000 7f044e7fc700 1 -- 172.21.15.86:0/805816171 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16460 (secure 0 0 0) 0x7f0454055110 con 0x7f04600cbf30 2023-10-09T12:00:08.248 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:08.249 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":126,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:00:07.358708+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:59:20.468724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:59:21.333069+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":126,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T11:59:43.482619+0000","172.21.15.86:6836/85490":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/1884490929":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/1717191324":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/2752811597":"2023-10-10T11:59:43.482619+0000","172.21.15.86:0/373428236":"2023-10-10T11:59:43.482619+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 msgr2=0x7f0440069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 0x7f0440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600cbf30 msgr2=0x7f0460152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600cbf30 0x7f0460152120 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f045400ec80 tx=0x7f04540091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 shutdown_connections 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04600ccf90 0x7f0460159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04600b1420 0x7f0460169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0440067170 0x7f0440069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 --2- 172.21.15.86:0/805816171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04600cbf30 0x7f0460152120 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 >> 172.21.15.86:0/805816171 conn(0x7f046006a320 msgr2=0x7f04600afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:08.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 shutdown_connections 2023-10-09T12:00:08.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.249+0000 7f04649ff700 1 -- 172.21.15.86:0/805816171 wait complete. 2023-10-09T12:00:08.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T12:00:08.321 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:08.320+0000 7f663009b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:00:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.454+0000 7f7d61f9d700 1 Processor -- start 2023-10-09T12:00:08.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.454+0000 7f7d61f9d700 1 -- start start 2023-10-09T12:00:08.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.455+0000 7f7d61f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d5c1595a0 0x7f7d5c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.455+0000 7f7d61f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d5c0c6c60 0x7f7d5c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.455+0000 7f7d61f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c0b1410 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.455+0000 7f7d61f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0b2b90 con 0x7f7d5c1595a0 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.455+0000 7f7d61f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c063230 con 0x7f7d5c0c6c60 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.455+0000 7f7d60f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d5c1595a0 0x7f7d5c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d60f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d5c1595a0 0x7f7d5c0b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48922/0 (socket says 172.21.15.86:48922) 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2757478716 learned_addr learned my addr 172.21.15.86:0/2757478716 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d5bfff700 1 --2- 172.21.15.86:0/2757478716 >> v2:172.21.15.135:3300/0 conn(0x7f7d5c0c6c60 0x7f7d5c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2757478716 >> v2:172.21.15.135:3300/0 conn(0x7f7d5c0c6c60 msgr2=0x7f7d5c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d60f9b700 1 --2- 172.21.15.86:0/2757478716 >> v2:172.21.15.135:3300/0 conn(0x7f7d5c0c6c60 0x7f7d5c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2757478716 >> v1:172.21.15.135:6789/0 conn(0x7f7d5c0b1de0 legacy=0x7f7d5c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2757478716 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0634f0 con 0x7f7d5c1595a0 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d5bfff700 1 --2- 172.21.15.86:0/2757478716 >> v2:172.21.15.135:3300/0 conn(0x7f7d5c0c6c60 0x7f7d5c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d60f9b700 1 --2- 172.21.15.86:0/2757478716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c0b18a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b07d0 tx=0x7f7d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4267f3bc64faae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.456+0000 7f7d5b7fe700 1 -- 172.21.15.86:0/2757478716 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000b860 con 0x7f7d5c1595a0 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d5b7fe700 1 -- 172.21.15.86:0/2757478716 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5000b9c0 con 0x7f7d5c1595a0 2023-10-09T12:00:08.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d5b7fe700 1 -- 172.21.15.86:0/2757478716 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000bd60 con 0x7f7d5c1595a0 2023-10-09T12:00:08.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2757478716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c1595a0 msgr2=0x7f7d5c0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2757478716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c0b18a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b07d0 tx=0x7f7d50009250 comp rx=0 tx=0).stop 2023-10-09T12:00:08.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2757478716 shutdown_connections 2023-10-09T12:00:08.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2757478716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c0b18a0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2757478716 >> v2:172.21.15.135:3300/0 conn(0x7f7d5c0c6c60 0x7f7d5c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2757478716 >> 172.21.15.86:0/2757478716 conn(0x7f7d5c06ddb0 msgr2=0x7f7d5c06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:08.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2757478716 shutdown_connections 2023-10-09T12:00:08.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.457+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2757478716 wait complete. 2023-10-09T12:00:08.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.459+0000 7f7d61f9d700 1 Processor -- start 2023-10-09T12:00:08.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.459+0000 7f7d61f9d700 1 -- start start 2023-10-09T12:00:08.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d61f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c0b1de0 0x7f7d5c141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d61f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5c0c6c60 0x7f7d5c169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d61f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c1410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d61f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0c2450 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d61f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c16aec0 con 0x7f7d5c1595a0 2023-10-09T12:00:08.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d61f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c16a620 con 0x7f7d5c0c6c60 2023-10-09T12:00:08.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d60f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c0b1de0 0x7f7d5c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d60f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c0b1de0 0x7f7d5c141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48928/0 (socket says 172.21.15.86:48928) 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2443655759 learned_addr learned my addr 172.21.15.86:0/2443655759 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d5bfff700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5c0c6c60 0x7f7d5c169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.460+0000 7f7d6179c700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c1410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5c0c6c60 msgr2=0x7f7d5c169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d60f9b700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5c0c6c60 0x7f7d5c169f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5c1595a0 msgr2=0x7f7d5c1410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d60f9b700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c1410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d60f9b700 1 -- 172.21.15.86:0/2443655759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500094f0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d6179c700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c1410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:08.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d60f9b700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c0b1de0 0x7f7d5c141fa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f7d500090b0 tx=0x7f7d50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:08.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d58ff9700 1 -- 172.21.15.86:0/2443655759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5001a450 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d58ff9700 1 -- 172.21.15.86:0/2443655759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5001a5b0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d58ff9700 1 -- 172.21.15.86:0/2443655759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5001a970 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c16a900 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.461+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c159aa0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.462+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c04c3c0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.463+0000 7f7d58ff9700 1 -- 172.21.15.86:0/2443655759 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f7d5001ace0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.464+0000 7f7d58ff9700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 0x7f7d40069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.464+0000 7f7d58ff9700 1 -- 172.21.15.86:0/2443655759 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6395+0+0 (secure 0 0 0) 0x7f7d50086190 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.464+0000 7f7d5bfff700 1 -- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 msgr2=0x7f7d40069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:08.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.464+0000 7f7d5bfff700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 0x7f7d40069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:08.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.468+0000 7f7d58ff9700 1 -- 172.21.15.86:0/2443655759 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d50052ec0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.588 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:08.587+0000 7f2ce50b6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:00:08.609 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:08.608+0000 7f663009b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:00:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.665+0000 7f7d5bfff700 1 -- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 msgr2=0x7f7d40069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:08.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.665+0000 7f7d5bfff700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 0x7f7d40069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:08.702 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:08.701+0000 7f663009b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:00:08.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.713+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7d5c0637d0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.715 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T12:00:08.714+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T12:00:08.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.719+0000 7f7d58ff9700 1 -- 172.21.15.86:0/2443655759 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7d500564e0 con 0x7f7d5c0b1de0 2023-10-09T12:00:08.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 msgr2=0x7f7d40069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:08.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 0x7f7d40069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c0b1de0 msgr2=0x7f7d5c141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c0b1de0 0x7f7d5c141fa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f7d500090b0 tx=0x7f7d50017000 comp rx=0 tx=0).stop 2023-10-09T12:00:08.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 shutdown_connections 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d40067170 0x7f7d40069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d5c0b1de0 0x7f7d5c141fa0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5c1595a0 0x7f7d5c1410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 --2- 172.21.15.86:0/2443655759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d5c0c6c60 0x7f7d5c169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 >> 172.21.15.86:0/2443655759 conn(0x7f7d5c06ddb0 msgr2=0x7f7d5c15c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 shutdown_connections 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.722+0000 7f7d61f9d700 1 -- 172.21.15.86:0/2443655759 wait complete. 2023-10-09T12:00:08.724 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T12:00:08.729 INFO:tasks.ceph.mds.c.smithi086.stderr: -5076> 2023-10-09T11:59:27.865+0000 7f25faff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T12:00:08.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T12:00:08.776 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T12:00:08.860 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:08.859+0000 7f663009b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:00:08.889 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:08.888+0000 7f2ce50b6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:00:08.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.936+0000 7f7be9d9d700 1 Processor -- start 2023-10-09T12:00:08.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.936+0000 7f7be9d9d700 1 -- start start 2023-10-09T12:00:08.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.937+0000 7f7be9d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7be40b4e70 0x7f7be40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.937+0000 7f7be9d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7be40b16d0 0x7f7be40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.937+0000 7f7be9d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40b2080 con 0x7f7be415d240 2023-10-09T12:00:08.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.937+0000 7f7be9d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be40cfb00 con 0x7f7be40b16d0 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.937+0000 7f7be9d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be40b5c40 con 0x7f7be40b4e70 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7be40b16d0 0x7f7be40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7be40b16d0 0x7f7be40b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48944/0 (socket says 172.21.15.86:48944) 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be3fff700 1 -- 172.21.15.86:0/2948081124 learned_addr learned my addr 172.21.15.86:0/2948081124 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be8d9b700 1 --2- 172.21.15.86:0/2948081124 >> v2:172.21.15.135:3300/0 conn(0x7f7be40b4e70 0x7f7be40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be3fff700 1 -- 172.21.15.86:0/2948081124 >> v2:172.21.15.135:3300/0 conn(0x7f7be40b4e70 msgr2=0x7f7be40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be3fff700 1 --2- 172.21.15.86:0/2948081124 >> v2:172.21.15.135:3300/0 conn(0x7f7be40b4e70 0x7f7be40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be3fff700 1 -- 172.21.15.86:0/2948081124 >> v1:172.21.15.135:6789/0 conn(0x7f7be415d240 legacy=0x7f7be415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:08.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.938+0000 7f7be3fff700 1 -- 172.21.15.86:0/2948081124 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40b5f20 con 0x7f7be40b16d0 2023-10-09T12:00:08.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be3fff700 1 --2- 172.21.15.86:0/2948081124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be40b1b40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7be4064910 tx=0x7f7bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac945c86ce3e923d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:08.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be37fe700 1 -- 172.21.15.86:0/2948081124 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000b860 con 0x7f7be40b16d0 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be37fe700 1 -- 172.21.15.86:0/2948081124 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000b9c0 con 0x7f7be40b16d0 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be37fe700 1 -- 172.21.15.86:0/2948081124 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000bd60 con 0x7f7be40b16d0 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2948081124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 msgr2=0x7f7be40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2948081124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be40b1b40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7be4064910 tx=0x7f7bd0009250 comp rx=0 tx=0).stop 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2948081124 shutdown_connections 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2948081124 >> v2:172.21.15.135:3300/0 conn(0x7f7be40b4e70 0x7f7be40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2948081124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be40b1b40 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.939+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2948081124 >> 172.21.15.86:0/2948081124 conn(0x7f7be40d10c0 msgr2=0x7f7be40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.940+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2948081124 shutdown_connections 2023-10-09T12:00:08.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.940+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2948081124 wait complete. 2023-10-09T12:00:08.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.941+0000 7f7be9d9d700 1 Processor -- start 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.941+0000 7f7be9d9d700 1 -- start start 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be9d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be9d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7be40b4e70 0x7f7be415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be9d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7be415d240 0x7f7be415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be9d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c6280 con 0x7f7be40b16d0 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be9d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be414b690 con 0x7f7be415d240 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be9d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be415c1c0 con 0x7f7be40b4e70 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be8d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be8d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be414b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:48954/0 (socket says 172.21.15.86:48954) 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be8d9b700 1 -- 172.21.15.86:0/2101615973 learned_addr learned my addr 172.21.15.86:0/2101615973 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:08.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be3fff700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7be40b4e70 0x7f7be415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.942+0000 7f7be959c700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7be415d240 0x7f7be415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be8d9b700 1 -- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7be40b4e70 msgr2=0x7f7be415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be8d9b700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7be40b4e70 0x7f7be415c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be8d9b700 1 -- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7be415d240 msgr2=0x7f7be415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be8d9b700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7be415d240 0x7f7be415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be8d9b700 1 -- 172.21.15.86:0/2101615973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd00094f0 con 0x7f7be40b16d0 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be8d9b700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be414b150 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800d8c0 tx=0x7f7bd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be0ff9700 1 -- 172.21.15.86:0/2101615973 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80125f0 con 0x7f7be40b16d0 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be0ff9700 1 -- 172.21.15.86:0/2101615973 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8012750 con 0x7f7be40b16d0 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be415b5b0 con 0x7f7be40b16d0 2023-10-09T12:00:08.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.943+0000 7f7be0ff9700 1 -- 172.21.15.86:0/2101615973 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8012af0 con 0x7f7be40b16d0 2023-10-09T12:00:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.944+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be415b940 con 0x7f7be40b16d0 2023-10-09T12:00:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.945+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be415c4a0 con 0x7f7be40b16d0 2023-10-09T12:00:08.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.945+0000 7f7be0ff9700 1 -- 172.21.15.86:0/2101615973 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 60) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f7bd801e460 con 0x7f7be40b16d0 2023-10-09T12:00:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.946+0000 7f7be0ff9700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 0x7f7bc8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.946+0000 7f7be3fff700 1 -- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 msgr2=0x7f7bc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.946+0000 7f7be0ff9700 1 -- 172.21.15.86:0/2101615973 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f7bd8085120 con 0x7f7be40b16d0 2023-10-09T12:00:08.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.946+0000 7f7be3fff700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 0x7f7bc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:08.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:08.950+0000 7f7be0ff9700 1 -- 172.21.15.86:0/2101615973 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bd8055800 con 0x7f7be40b16d0 2023-10-09T12:00:08.965 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:08.964+0000 7f663009b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:00:08.989 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:08.988+0000 7f2ce50b6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:00:09.148 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:09.147+0000 7f2ce50b6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:00:09.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.147+0000 7f7be3fff700 1 -- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 msgr2=0x7f7bc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:09.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.147+0000 7f7be3fff700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 0x7f7bc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:09.155 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:09.154+0000 7f663009b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:00:09.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.197+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7be40cf780 con 0x7f7be40b16d0 2023-10-09T12:00:09.247 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:09.246+0000 7f663009b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:00:09.255 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:09.254+0000 7f2ce50b6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:00:09.339 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:09.338+0000 7f663009b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:00:09.437 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:09.435+0000 7f663009b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:00:09.447 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:09.446+0000 7f2ce50b6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:00:09.540 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:09.539+0000 7f2ce50b6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:00:09.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.548+0000 7f7be3fff700 1 -- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 msgr2=0x7f7bc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:09.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.548+0000 7f7be3fff700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 0x7f7bc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T12:00:09.633 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:09.632+0000 7f2ce50b6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:00:09.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.719+0000 7f7be0ff9700 1 -- 172.21.15.86:0/2101615973 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7bd8055390 con 0x7f7be40b16d0 2023-10-09T12:00:09.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 msgr2=0x7f7bc8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:09.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 0x7f7bc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 msgr2=0x7f7be414b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:09.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be414b150 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800d8c0 tx=0x7f7bd8008040 comp rx=0 tx=0).stop 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 shutdown_connections 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7bc8067170 0x7f7bc8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7be40b16d0 0x7f7be414b150 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7be415d240 0x7f7be415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 --2- 172.21.15.86:0/2101615973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7be40b4e70 0x7f7be415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.722+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 >> 172.21.15.86:0/2101615973 conn(0x7f7be40d10c0 msgr2=0x7f7be4158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.723+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 shutdown_connections 2023-10-09T12:00:09.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.723+0000 7f7be9d9d700 1 -- 172.21.15.86:0/2101615973 wait complete. 2023-10-09T12:00:09.728 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:09.727+0000 7f2ce50b6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:00:09.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T12:00:09.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.976+0000 7f1c81f9d700 1 Processor -- start 2023-10-09T12:00:09.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.976+0000 7f1c81f9d700 1 -- start start 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.977+0000 7f1c81f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c15b050 0x7f1c7c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.977+0000 7f1c81f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1c7c15bb30 0x7f1c7c0ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.977+0000 7f1c81f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c157a50 con 0x7f1c7c0cc8d0 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.977+0000 7f1c81f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c158f10 con 0x7f1c7c15bb30 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.977+0000 7f1c81f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1591b0 con 0x7f1c7c15b050 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c80f9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c15b050 0x7f1c7c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c8179c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1c7c15bb30 0x7f1c7c0ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c7bfff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1c7c0cc8d0 0x7f1c7c15b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:54080/0 (socket says 172.21.15.86:54080) 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c8179c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1c7c15bb30 0x7f1c7c0ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:48484/0 (socket says 172.21.15.86:48484) 2023-10-09T12:00:09.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c80f9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c15b050 0x7f1c7c0ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35960/0 (socket says 172.21.15.86:35960) 2023-10-09T12:00:09.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c7bfff700 1 -- 172.21.15.86:0/3276059579 learned_addr learned my addr 172.21.15.86:0/3276059579 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:09.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c7b7fe700 1 -- 172.21.15.86:0/3276059579 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412783612 0 0) 0x7f1c7c157a50 con 0x7f1c7c0cc8d0 2023-10-09T12:00:09.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c80f9b700 1 -- 172.21.15.86:0/3276059579 >> v2:172.21.15.135:3300/0 conn(0x7f1c7c15bb30 msgr2=0x7f1c7c0ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:09.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c80f9b700 1 --2- 172.21.15.86:0/3276059579 >> v2:172.21.15.135:3300/0 conn(0x7f1c7c15bb30 0x7f1c7c0ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c80f9b700 1 -- 172.21.15.86:0/3276059579 >> v1:172.21.15.135:6789/0 conn(0x7f1c7c0cc8d0 legacy=0x7f1c7c15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:09.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c80f9b700 1 -- 172.21.15.86:0/3276059579 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0ca9e0 con 0x7f1c7c15b050 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c8179c700 1 --2- 172.21.15.86:0/3276059579 >> v2:172.21.15.135:3300/0 conn(0x7f1c7c15bb30 0x7f1c7c0ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.978+0000 7f1c80f9b700 1 --2- 172.21.15.86:0/3276059579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c15b050 0x7f1c7c0ca100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c700098e0 tx=0x7f1c700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893d0790e685bb3b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c7b7fe700 1 -- 172.21.15.86:0/3276059579 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000b640 con 0x7f1c7c15b050 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c7b7fe700 1 -- 172.21.15.86:0/3276059579 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7000b7a0 con 0x7f1c7c15b050 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c7b7fe700 1 -- 172.21.15.86:0/3276059579 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000bb40 con 0x7f1c7c15b050 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 -- 172.21.15.86:0/3276059579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c15b050 msgr2=0x7f1c7c0ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 --2- 172.21.15.86:0/3276059579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c15b050 0x7f1c7c0ca100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c700098e0 tx=0x7f1c700091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 -- 172.21.15.86:0/3276059579 shutdown_connections 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 --2- 172.21.15.86:0/3276059579 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c15b050 0x7f1c7c0ca100 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 --2- 172.21.15.86:0/3276059579 >> v2:172.21.15.135:3300/0 conn(0x7f1c7c15bb30 0x7f1c7c0ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 -- 172.21.15.86:0/3276059579 >> 172.21.15.86:0/3276059579 conn(0x7f1c7c068e20 msgr2=0x7f1c7c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 -- 172.21.15.86:0/3276059579 shutdown_connections 2023-10-09T12:00:09.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.979+0000 7f1c81f9d700 1 -- 172.21.15.86:0/3276059579 wait complete. 2023-10-09T12:00:09.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.981+0000 7f1c81f9d700 1 Processor -- start 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.981+0000 7f1c81f9d700 1 -- start start 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c81f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c0cc8d0 0x7f1c7c0ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c81f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c15b050 0x7f1c7c0b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c81f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c7c15bb30 0x7f1c7c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c81f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0b1230 con 0x7f1c7c15bb30 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c81f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0ae3b0 con 0x7f1c7c15b050 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c81f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0b0f50 con 0x7f1c7c0cc8d0 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c7c15bb30 0x7f1c7c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c7c15bb30 0x7f1c7c06e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49032/0 (socket says 172.21.15.86:49032) 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 -- 172.21.15.86:0/352974780 learned_addr learned my addr 172.21.15.86:0/352974780 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:09.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c80f9b700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c0cc8d0 0x7f1c7c0ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c7bfff700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c15b050 0x7f1c7c0b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 -- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c0cc8d0 msgr2=0x7f1c7c0ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c0cc8d0 0x7f1c7c0ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 -- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c15b050 msgr2=0x7f1c7c0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c15b050 0x7f1c7c0b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.982+0000 7f1c8179c700 1 -- 172.21.15.86:0/352974780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009a20 con 0x7f1c7c15bb30 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.983+0000 7f1c8179c700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c7c15bb30 0x7f1c7c06e9f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009fc0 tx=0x7f1c7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.983+0000 7f1c78ff9700 1 -- 172.21.15.86:0/352974780 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400cbd0 con 0x7f1c7c15bb30 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.983+0000 7f1c78ff9700 1 -- 172.21.15.86:0/352974780 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7400f040 con 0x7f1c7c15bb30 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.983+0000 7f1c78ff9700 1 -- 172.21.15.86:0/352974780 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74014480 con 0x7f1c7c15bb30 2023-10-09T12:00:09.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.983+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c70009420 con 0x7f1c7c15bb30 2023-10-09T12:00:09.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.983+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c0a58b0 con 0x7f1c7c15bb30 2023-10-09T12:00:09.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.984+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c04c3c0 con 0x7f1c7c15bb30 2023-10-09T12:00:09.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.985+0000 7f1c78ff9700 1 -- 172.21.15.86:0/352974780 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 61) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f1c74003020 con 0x7f1c7c15bb30 2023-10-09T12:00:09.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.986+0000 7f1c78ff9700 1 -- 172.21.15.86:0/352974780 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6797+0+0 (secure 0 0 0) 0x7f1c74084e90 con 0x7f1c7c15bb30 2023-10-09T12:00:09.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:09.990+0000 7f1c78ff9700 1 -- 172.21.15.86:0/352974780 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c74051f90 con 0x7f1c7c15bb30 2023-10-09T12:00:10.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.180+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c7c0cacc0 con 0x7f1c7c15bb30 2023-10-09T12:00:10.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.738+0000 7f1c78ff9700 1 -- 172.21.15.86:0/352974780 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1c740555b0 con 0x7f1c7c15bb30 2023-10-09T12:00:10.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.745+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c7c15bb30 msgr2=0x7f1c7c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:10.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.745+0000 7f1c81f9d700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c7c15bb30 0x7f1c7c06e9f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009fc0 tx=0x7f1c7400b040 comp rx=0 tx=0).stop 2023-10-09T12:00:10.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.746+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 shutdown_connections 2023-10-09T12:00:10.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.746+0000 7f1c81f9d700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c7c15bb30 0x7f1c7c06e9f0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.746+0000 7f1c81f9d700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c7c0cc8d0 0x7f1c7c0ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.746+0000 7f1c81f9d700 1 --2- 172.21.15.86:0/352974780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c15b050 0x7f1c7c0b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.746+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 >> 172.21.15.86:0/352974780 conn(0x7f1c7c068e20 msgr2=0x7f1c7c154640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:10.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.748+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 shutdown_connections 2023-10-09T12:00:10.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.749+0000 7f1c81f9d700 1 -- 172.21.15.86:0/352974780 wait complete. 2023-10-09T12:00:10.753 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T12:00:10.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T12:00:10.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.965+0000 7f65dc9ff700 1 Processor -- start 2023-10-09T12:00:10.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.966+0000 7f65dc9ff700 1 -- start start 2023-10-09T12:00:10.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65dc9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d8156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:10.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65dc9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f65d815a440 0x7f65d80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:10.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65dc9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65d8068890 0x7f65d80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:10.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65dc9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d815a9b0 con 0x7f65d815a440 2023-10-09T12:00:10.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65dc9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d815ac90 con 0x7f65d8068890 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65dc9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d815af70 con 0x7f65d81563b0 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f65d815a440 0x7f65d80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f65d815a440 0x7f65d80acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49034/0 (socket says 172.21.15.86:49034) 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 -- 172.21.15.86:0/3899617533 learned_addr learned my addr 172.21.15.86:0/3899617533 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65d659c700 1 --2- 172.21.15.86:0/3899617533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65d6d9d700 1 --2- 172.21.15.86:0/3899617533 >> v2:172.21.15.135:3300/0 conn(0x7f65d8068890 0x7f65d80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 -- 172.21.15.86:0/3899617533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 msgr2=0x7f65d8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:10.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 --2- 172.21.15.86:0/3899617533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 -- 172.21.15.86:0/3899617533 >> v2:172.21.15.135:3300/0 conn(0x7f65d8068890 msgr2=0x7f65d80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:10.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 --2- 172.21.15.86:0/3899617533 >> v2:172.21.15.135:3300/0 conn(0x7f65d8068890 0x7f65d80c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.967+0000 7f65cffff700 1 -- 172.21.15.86:0/3899617533 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d815b250 con 0x7f65d815a440 2023-10-09T12:00:10.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.968+0000 7f65cffff700 1 --2- 172.21.15.86:0/3899617533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d80acf30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f65d806fb10 tx=0x7f65c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795d382cc8b308be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:10.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.968+0000 7f65d5d9b700 1 -- 172.21.15.86:0/3899617533 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000b860 con 0x7f65d815a440 2023-10-09T12:00:10.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.968+0000 7f65d5d9b700 1 -- 172.21.15.86:0/3899617533 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c000b9c0 con 0x7f65d815a440 2023-10-09T12:00:10.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.968+0000 7f65d5d9b700 1 -- 172.21.15.86:0/3899617533 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000bd60 con 0x7f65d815a440 2023-10-09T12:00:10.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.968+0000 7f65dc9ff700 1 -- 172.21.15.86:0/3899617533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 msgr2=0x7f65d80acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:10.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.968+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/3899617533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d80acf30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f65d806fb10 tx=0x7f65c0009250 comp rx=0 tx=0).stop 2023-10-09T12:00:10.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.969+0000 7f65dc9ff700 1 -- 172.21.15.86:0/3899617533 shutdown_connections 2023-10-09T12:00:10.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.969+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/3899617533 >> v2:172.21.15.135:3300/0 conn(0x7f65d8068890 0x7f65d80c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.969+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/3899617533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.969+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/3899617533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d80acf30 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.969+0000 7f65dc9ff700 1 -- 172.21.15.86:0/3899617533 >> 172.21.15.86:0/3899617533 conn(0x7f65d80c8f90 msgr2=0x7f65d80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.969+0000 7f65dc9ff700 1 -- 172.21.15.86:0/3899617533 shutdown_connections 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.969+0000 7f65dc9ff700 1 -- 172.21.15.86:0/3899617533 wait complete. 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.970+0000 7f65dc9ff700 1 Processor -- start 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.970+0000 7f65dc9ff700 1 -- start start 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65dc9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d8068890 0x7f65d8153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:10.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65dc9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65dc9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65dc9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d816c620 con 0x7f65d815a440 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65dc9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8169510 con 0x7f65d8068890 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65dc9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d816cab0 con 0x7f65d81563b0 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65d6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65d6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49046/0 (socket says 172.21.15.86:49046) 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65d6d9d700 1 -- 172.21.15.86:0/891255194 learned_addr learned my addr 172.21.15.86:0/891255194 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65d659c700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d8068890 0x7f65d8153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.971+0000 7f65cffff700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65d6d9d700 1 -- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 msgr2=0x7f65d815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65d6d9d700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65d6d9d700 1 -- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d8068890 msgr2=0x7f65d8153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65d6d9d700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d8068890 0x7f65d8153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65d6d9d700 1 -- 172.21.15.86:0/891255194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00094f0 con 0x7f65d815a440 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65d6d9d700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d815cf70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009fa0 tx=0x7f65d0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d000ebc0 con 0x7f65d815a440 2023-10-09T12:00:10.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d000ed20 con 0x7f65d815a440 2023-10-09T12:00:10.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d816bcf0 con 0x7f65d815a440 2023-10-09T12:00:10.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0014670 con 0x7f65d815a440 2023-10-09T12:00:10.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.972+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d816c2b0 con 0x7f65d815a440 2023-10-09T12:00:10.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.973+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d8156e60 con 0x7f65d815a440 2023-10-09T12:00:10.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.974+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 62) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f65d00149e0 con 0x7f65d815a440 2023-10-09T12:00:10.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.975+0000 7f65ce7fc700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65b8066d80 0x7f65b8069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:10.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.975+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f65d0084b80 con 0x7f65d815a440 2023-10-09T12:00:10.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.975+0000 7f65d659c700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65b8066d80 0x7f65b8069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:10.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.976+0000 7f65d659c700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65b8066d80 0x7f65b8069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006fd0 tx=0x7f65c8008040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:10.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:10.979+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65d0051e10 con 0x7f65d815a440 2023-10-09T12:00:11.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.167+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65d80aebc0 con 0x7f65d815a440 2023-10-09T12:00:11.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:00:11.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:00:11.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.759+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65d0012dc0 con 0x7f65d815a440 2023-10-09T12:00:11.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.759+0000 7f65ce7fc700 1 -- 172.21.15.86:0/891255194 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v130) v1 ==== 169+0+0 (secure 0 0 0) 0x7f65d004e690 con 0x7f65d815a440 2023-10-09T12:00:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.763+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65b8066d80 msgr2=0x7f65b8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.763+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65b8066d80 0x7f65b8069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006fd0 tx=0x7f65c8008040 comp rx=0 tx=0).stop 2023-10-09T12:00:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.763+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 msgr2=0x7f65d815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.763+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d815cf70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009fa0 tx=0x7f65d0009900 comp rx=0 tx=0).stop 2023-10-09T12:00:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 shutdown_connections 2023-10-09T12:00:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65b8066d80 0x7f65b8069230 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006fd0 tx=0x7f65c8008040 comp rx=0 tx=0).stop 2023-10-09T12:00:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d815a440 0x7f65d815cf70 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d8068890 0x7f65d8153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 --2- 172.21.15.86:0/891255194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d81563b0 0x7f65d815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 >> 172.21.15.86:0/891255194 conn(0x7f65d80c8f90 msgr2=0x7f65d8155a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 shutdown_connections 2023-10-09T12:00:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.764+0000 7f65dc9ff700 1 -- 172.21.15.86:0/891255194 wait complete. 2023-10-09T12:00:11.767 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T12:00:11.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T12:00:11.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.972+0000 7f9e3f59e700 1 Processor -- start 2023-10-09T12:00:11.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.972+0000 7f9e3f59e700 1 -- start start 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.973+0000 7f9e3f59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9e40157680 0x7f9e400cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.973+0000 7f9e3f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e400b1450 0x7f9e400c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.973+0000 7f9e3f59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e400cd240 con 0x7f9e40157a50 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.973+0000 7f9e3f59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e400cc700 con 0x7f9e40157680 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.973+0000 7f9e3f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e400c9a20 con 0x7f9e400b1450 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3ed9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e400b1450 0x7f9e400c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3e59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9e40157680 0x7f9e400cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:11.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3ed9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e400b1450 0x7f9e400c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:36018/0 (socket says 172.21.15.86:36018) 2023-10-09T12:00:11.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3ed9d700 1 -- 172.21.15.86:0/3736729190 learned_addr learned my addr 172.21.15.86:0/3736729190 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3e59c700 1 -- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e400b1450 msgr2=0x7f9e400c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3e59c700 1 --2- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e400b1450 0x7f9e400c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3e59c700 1 -- 172.21.15.86:0/3736729190 >> v1:172.21.15.135:6789/0 conn(0x7f9e40157a50 legacy=0x7f9e400c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:11.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3e59c700 1 -- 172.21.15.86:0/3736729190 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400cc910 con 0x7f9e40157680 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3ed9d700 1 --2- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e400b1450 0x7f9e400c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.974+0000 7f9e3d59a700 1 -- 172.21.15.86:0/3736729190 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058402325 0 0) 0x7f9e400cd240 con 0x7f9e40157a50 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.975+0000 7f9e3e59c700 1 --2- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e40157680 0x7f9e400cae80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098e0 tx=0x7f9e300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5884e0c2956de11e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.975+0000 7f9e3d59a700 1 -- 172.21.15.86:0/3736729190 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000b640 con 0x7f9e40157680 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.975+0000 7f9e3d59a700 1 -- 172.21.15.86:0/3736729190 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000b7a0 con 0x7f9e40157680 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.975+0000 7f9e3d59a700 1 -- 172.21.15.86:0/3736729190 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000bb40 con 0x7f9e40157680 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 -- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e40157680 msgr2=0x7f9e400cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e40157680 0x7f9e400cae80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9e300098e0 tx=0x7f9e300091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 -- 172.21.15.86:0/3736729190 shutdown_connections 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e400b1450 0x7f9e400c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/3736729190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e40157680 0x7f9e400cae80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 -- 172.21.15.86:0/3736729190 >> 172.21.15.86:0/3736729190 conn(0x7f9e4006baa0 msgr2=0x7f9e4006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 -- 172.21.15.86:0/3736729190 shutdown_connections 2023-10-09T12:00:11.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.976+0000 7f9e3f59e700 1 -- 172.21.15.86:0/3736729190 wait complete. 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.977+0000 7f9e3f59e700 1 Processor -- start 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.978+0000 7f9e3f59e700 1 -- start start 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.978+0000 7f9e3f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e400b1450 0x7f9e4015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.978+0000 7f9e3f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e40157680 0x7f9e40158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e40157a50 0x7f9e40159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3f59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4015cbc0 con 0x7f9e40157a50 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3f59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4015d050 con 0x7f9e400b1450 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4015bfb0 con 0x7f9e40157680 2023-10-09T12:00:11.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e40157a50 0x7f9e40159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:11.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e40157a50 0x7f9e40159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49052/0 (socket says 172.21.15.86:49052) 2023-10-09T12:00:11.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 -- 172.21.15.86:0/2788979038 learned_addr learned my addr 172.21.15.86:0/2788979038 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3e59c700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e400b1450 0x7f9e4015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3dd9b700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e40157680 0x7f9e40158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 -- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e40157680 msgr2=0x7f9e40158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e40157680 0x7f9e40158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 -- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e400b1450 msgr2=0x7f9e4015b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e400b1450 0x7f9e4015b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 -- 172.21.15.86:0/2788979038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38009ae0 con 0x7f9e40157a50 2023-10-09T12:00:11.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.979+0000 7f9e3ed9d700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e40157a50 0x7f9e40159490 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009fd0 tx=0x7f9e3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.980+0000 7f9e2e7fc700 1 -- 172.21.15.86:0/2788979038 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38018070 con 0x7f9e40157a50 2023-10-09T12:00:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.980+0000 7f9e2e7fc700 1 -- 172.21.15.86:0/2788979038 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3800f040 con 0x7f9e40157a50 2023-10-09T12:00:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.980+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e30009420 con 0x7f9e40157a50 2023-10-09T12:00:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.980+0000 7f9e2e7fc700 1 -- 172.21.15.86:0/2788979038 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800cd30 con 0x7f9e40157a50 2023-10-09T12:00:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.980+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4015c570 con 0x7f9e40157a50 2023-10-09T12:00:11.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.981+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4015cd30 con 0x7f9e40157a50 2023-10-09T12:00:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.982+0000 7f9e2e7fc700 1 -- 172.21.15.86:0/2788979038 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e38003020 con 0x7f9e40157a50 2023-10-09T12:00:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.982+0000 7f9e2e7fc700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9e20066f30 0x7f9e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.982+0000 7f9e2e7fc700 1 -- 172.21.15.86:0/2788979038 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f9e380845e0 con 0x7f9e40157a50 2023-10-09T12:00:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.983+0000 7f9e3e59c700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9e20066f30 0x7f9e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:11.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.983+0000 7f9e3e59c700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9e20066f30 0x7f9e200693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e300093f0 tx=0x7f9e30017000 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:11.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:11.986+0000 7f9e2e7fc700 1 -- 172.21.15.86:0/2788979038 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e3804d5a0 con 0x7f9e40157a50 2023-10-09T12:00:12.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.179+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f9e400ccbf0 con 0x7f9e40157a50 2023-10-09T12:00:12.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.183+0000 7f9e2e7fc700 1 -- 172.21.15.86:0/2788979038 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v43) v1 ==== 115+0+0 (secure 0 0 0) 0x7f9e38051760 con 0x7f9e40157a50 2023-10-09T12:00:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.185+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9e20066f30 msgr2=0x7f9e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.185+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9e20066f30 0x7f9e200693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e300093f0 tx=0x7f9e30017000 comp rx=0 tx=0).stop 2023-10-09T12:00:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.185+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e40157a50 msgr2=0x7f9e40159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.185+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e40157a50 0x7f9e40159490 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009fd0 tx=0x7f9e3800b040 comp rx=0 tx=0).stop 2023-10-09T12:00:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 shutdown_connections 2023-10-09T12:00:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9e20066f30 0x7f9e200693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e40157a50 0x7f9e40159490 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e400b1450 0x7f9e4015b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 --2- 172.21.15.86:0/2788979038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e40157680 0x7f9e40158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 >> 172.21.15.86:0/2788979038 conn(0x7f9e4006baa0 msgr2=0x7f9e401566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:12.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 shutdown_connections 2023-10-09T12:00:12.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.186+0000 7f9e3f59e700 1 -- 172.21.15.86:0/2788979038 wait complete. 2023-10-09T12:00:12.204 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T12:00:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.387+0000 7f3cb8bff700 1 Processor -- start 2023-10-09T12:00:12.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.387+0000 7f3cb8bff700 1 -- start start 2023-10-09T12:00:12.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.388+0000 7f3cb8bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3cb406b160 0x7f3cb406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.388+0000 7f3cb8bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3cb40637d0 0x7f3cb4068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.388+0000 7f3cb8bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40ac450 con 0x7f3cb406a2b0 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.388+0000 7f3cb8bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb406adc0 con 0x7f3cb406b160 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.388+0000 7f3cb8bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb4069d00 con 0x7f3cb40637d0 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.388+0000 7f3cb259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3cb406b160 0x7f3cb406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3cb406b160 0x7f3cb406b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49056/0 (socket says 172.21.15.86:49056) 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb259c700 1 -- 172.21.15.86:0/2478373038 learned_addr learned my addr 172.21.15.86:0/2478373038 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb1d9b700 1 --2- 172.21.15.86:0/2478373038 >> v2:172.21.15.135:3300/0 conn(0x7f3cb40637d0 0x7f3cb4068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb259c700 1 -- 172.21.15.86:0/2478373038 >> v2:172.21.15.135:3300/0 conn(0x7f3cb40637d0 msgr2=0x7f3cb4068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:12.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb259c700 1 --2- 172.21.15.86:0/2478373038 >> v2:172.21.15.135:3300/0 conn(0x7f3cb40637d0 0x7f3cb4068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb259c700 1 -- 172.21.15.86:0/2478373038 >> v1:172.21.15.135:6789/0 conn(0x7f3cb406a2b0 legacy=0x7f3cb406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb259c700 1 -- 172.21.15.86:0/2478373038 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4068830 con 0x7f3cb406b160 2023-10-09T12:00:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb259c700 1 --2- 172.21.15.86:0/2478373038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb406b530 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40af860 tx=0x7f3ca4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f428f4930901b813 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb159a700 1 -- 172.21.15.86:0/2478373038 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400b820 con 0x7f3cb406b160 2023-10-09T12:00:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb159a700 1 -- 172.21.15.86:0/2478373038 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400b980 con 0x7f3cb406b160 2023-10-09T12:00:12.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.389+0000 7f3cb159a700 1 -- 172.21.15.86:0/2478373038 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400bd40 con 0x7f3cb406b160 2023-10-09T12:00:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2478373038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 msgr2=0x7f3cb406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2478373038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb406b530 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40af860 tx=0x7f3ca4009250 comp rx=0 tx=0).stop 2023-10-09T12:00:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2478373038 shutdown_connections 2023-10-09T12:00:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2478373038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb406b530 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2478373038 >> v2:172.21.15.135:3300/0 conn(0x7f3cb40637d0 0x7f3cb4068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2478373038 >> 172.21.15.86:0/2478373038 conn(0x7f3cb406ded0 msgr2=0x7f3cb406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2478373038 shutdown_connections 2023-10-09T12:00:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.390+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2478373038 wait complete. 2023-10-09T12:00:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.391+0000 7f3cb8bff700 1 Processor -- start 2023-10-09T12:00:12.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.392+0000 7f3cb8bff700 1 -- start start 2023-10-09T12:00:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.392+0000 7f3cb8bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb40637d0 0x7f3cb415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.392+0000 7f3cb8bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cb406a2b0 0x7f3cb41561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb8bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb41566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb8bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41558e0 con 0x7f3cb406b160 2023-10-09T12:00:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb8bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4157f90 con 0x7f3cb40637d0 2023-10-09T12:00:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb8bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb414ed00 con 0x7f3cb406a2b0 2023-10-09T12:00:12.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb41566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb41566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49064/0 (socket says 172.21.15.86:49064) 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 -- 172.21.15.86:0/2593707754 learned_addr learned my addr 172.21.15.86:0/2593707754 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb259c700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb40637d0 0x7f3cb415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb1d9b700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cb406a2b0 0x7f3cb41561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 -- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cb406a2b0 msgr2=0x7f3cb41561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cb406a2b0 0x7f3cb41561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 -- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb40637d0 msgr2=0x7f3cb415a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb40637d0 0x7f3cb415a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 -- 172.21.15.86:0/2593707754 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40094f0 con 0x7f3cb406b160 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb259c700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb40637d0 0x7f3cb415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:12.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.393+0000 7f3cb2d9d700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb41566e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00c930 tx=0x7f3cac0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:12.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.394+0000 7f3ca27fc700 1 -- 172.21.15.86:0/2593707754 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00ce70 con 0x7f3cb406b160 2023-10-09T12:00:12.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.394+0000 7f3ca27fc700 1 -- 172.21.15.86:0/2593707754 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00a7e0 con 0x7f3cb406b160 2023-10-09T12:00:12.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.394+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb4155320 con 0x7f3cb406b160 2023-10-09T12:00:12.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.394+0000 7f3ca27fc700 1 -- 172.21.15.86:0/2593707754 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00aba0 con 0x7f3cb406b160 2023-10-09T12:00:12.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.394+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4157c20 con 0x7f3cb406b160 2023-10-09T12:00:12.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.395+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb40ac290 con 0x7f3cb406b160 2023-10-09T12:00:12.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.396+0000 7f3ca27fc700 1 -- 172.21.15.86:0/2593707754 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cac012420 con 0x7f3cb406b160 2023-10-09T12:00:12.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.396+0000 7f3ca27fc700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c94066f30 0x7f3c940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.396+0000 7f3ca27fc700 1 -- 172.21.15.86:0/2593707754 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f3cac084a60 con 0x7f3cb406b160 2023-10-09T12:00:12.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.397+0000 7f3cb259c700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c94066f30 0x7f3c940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.397+0000 7f3cb259c700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c94066f30 0x7f3c940693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40af860 tx=0x7f3ca4016000 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:12.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.401+0000 7f3ca27fc700 1 -- 172.21.15.86:0/2593707754 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cac051c90 con 0x7f3cb406b160 2023-10-09T12:00:12.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.591+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3cb4158100 con 0x7f3cb406b160 2023-10-09T12:00:12.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.595+0000 7f3ca27fc700 1 -- 172.21.15.86:0/2593707754 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v44) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3cac0552b0 con 0x7f3cb406b160 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c94066f30 msgr2=0x7f3c940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c94066f30 0x7f3c940693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40af860 tx=0x7f3ca4016000 comp rx=0 tx=0).stop 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 msgr2=0x7f3cb41566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb41566e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00c930 tx=0x7f3cac0026e0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 shutdown_connections 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3c94066f30 0x7f3c940693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb406b160 0x7f3cb41566e0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb40637d0 0x7f3cb415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 --2- 172.21.15.86:0/2593707754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3cb406a2b0 0x7f3cb41561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 >> 172.21.15.86:0/2593707754 conn(0x7f3cb406ded0 msgr2=0x7f3cb40ad350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.598+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 shutdown_connections 2023-10-09T12:00:12.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.599+0000 7f3cb8bff700 1 -- 172.21.15.86:0/2593707754 wait complete. 2023-10-09T12:00:12.617 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T12:00:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.801+0000 7f83b4bff700 1 Processor -- start 2023-10-09T12:00:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.801+0000 7f83b4bff700 1 -- start start 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.802+0000 7f83b4bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b00c83f0 0x7f83b00c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.802+0000 7f83b4bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83b01568e0 0x7f83b00ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.802+0000 7f83b4bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b015b0d0 con 0x7f83b00ccee0 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.802+0000 7f83b4bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b00c7a60 con 0x7f83b01568e0 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.802+0000 7f83b4bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b015a4c0 con 0x7f83b00c83f0 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83b01568e0 0x7f83b00ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83b01568e0 0x7f83b00ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49078/0 (socket says 172.21.15.86:49078) 2023-10-09T12:00:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 -- 172.21.15.86:0/3235338013 learned_addr learned my addr 172.21.15.86:0/3235338013 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 -- 172.21.15.86:0/3235338013 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b00c83f0 msgr2=0x7f83b00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 --2- 172.21.15.86:0/3235338013 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b00c83f0 0x7f83b00c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 -- 172.21.15.86:0/3235338013 >> v1:172.21.15.135:6789/0 conn(0x7f83b00ccee0 legacy=0x7f83b01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 -- 172.21.15.86:0/3235338013 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b015a7a0 con 0x7f83b01568e0 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83aed9d700 1 --2- 172.21.15.86:0/3235338013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b01568e0 0x7f83b00ca1e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009f20 tx=0x7f83a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88131b2b9c6f7432 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.803+0000 7f83ad59a700 1 -- 172.21.15.86:0/3235338013 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800e070 con 0x7f83b01568e0 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83ad59a700 1 -- 172.21.15.86:0/3235338013 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a800ba40 con 0x7f83b01568e0 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83ad59a700 1 -- 172.21.15.86:0/3235338013 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a80092e0 con 0x7f83b01568e0 2023-10-09T12:00:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 -- 172.21.15.86:0/3235338013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b01568e0 msgr2=0x7f83b00ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 --2- 172.21.15.86:0/3235338013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b01568e0 0x7f83b00ca1e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009f20 tx=0x7f83a8009840 comp rx=0 tx=0).stop 2023-10-09T12:00:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 -- 172.21.15.86:0/3235338013 shutdown_connections 2023-10-09T12:00:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 --2- 172.21.15.86:0/3235338013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b01568e0 0x7f83b00ca1e0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 --2- 172.21.15.86:0/3235338013 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b00c83f0 0x7f83b00c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 -- 172.21.15.86:0/3235338013 >> 172.21.15.86:0/3235338013 conn(0x7f83b0068e10 msgr2=0x7f83b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 -- 172.21.15.86:0/3235338013 shutdown_connections 2023-10-09T12:00:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.804+0000 7f83b4bff700 1 -- 172.21.15.86:0/3235338013 wait complete. 2023-10-09T12:00:12.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.806+0000 7f83b4bff700 1 Processor -- start 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.806+0000 7f83b4bff700 1 -- start start 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83b4bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b00c83f0 0x7f83b014d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83b4bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b00ccee0 0x7f83b01509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83b4bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b01568e0 0x7f83b0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83b4bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b014e090 con 0x7f83b00ccee0 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83b4bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0158fe0 con 0x7f83b00c83f0 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83b4bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0159800 con 0x7f83b01568e0 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b00ccee0 0x7f83b01509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b00ccee0 0x7f83b01509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49088/0 (socket says 172.21.15.86:49088) 2023-10-09T12:00:12.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 -- 172.21.15.86:0/930861893 learned_addr learned my addr 172.21.15.86:0/930861893 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83ae59c700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b00c83f0 0x7f83b014d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83aed9d700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b01568e0 0x7f83b0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 -- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b01568e0 msgr2=0x7f83b0158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b01568e0 0x7f83b0158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 -- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b00c83f0 msgr2=0x7f83b014d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b00c83f0 0x7f83b014d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.807+0000 7f83add9b700 1 -- 172.21.15.86:0/930861893 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8009ae0 con 0x7f83b00ccee0 2023-10-09T12:00:12.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.808+0000 7f83add9b700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b00ccee0 0x7f83b01509e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b600 tx=0x7f83a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:12.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.808+0000 7f839e7fc700 1 -- 172.21.15.86:0/930861893 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a400f510 con 0x7f83b00ccee0 2023-10-09T12:00:12.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.808+0000 7f839e7fc700 1 -- 172.21.15.86:0/930861893 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a400f690 con 0x7f83b00ccee0 2023-10-09T12:00:12.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.808+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0159240 con 0x7f83b00ccee0 2023-10-09T12:00:12.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.808+0000 7f839e7fc700 1 -- 172.21.15.86:0/930861893 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a400fa50 con 0x7f83b00ccee0 2023-10-09T12:00:12.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.808+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b014dd20 con 0x7f83b00ccee0 2023-10-09T12:00:12.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.809+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b014db80 con 0x7f83b00ccee0 2023-10-09T12:00:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.810+0000 7f839e7fc700 1 -- 172.21.15.86:0/930861893 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83a401a400 con 0x7f83b00ccee0 2023-10-09T12:00:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.811+0000 7f839e7fc700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8390066f60 0x7f8390069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.811+0000 7f839e7fc700 1 -- 172.21.15.86:0/930861893 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f83a4083fc0 con 0x7f83b00ccee0 2023-10-09T12:00:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.811+0000 7f83ae59c700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8390066f60 0x7f8390069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:12.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.811+0000 7f83ae59c700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8390066f60 0x7f8390069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009bf0 tx=0x7f83a00091a0 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:12.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:12.815+0000 7f839e7fc700 1 -- 172.21.15.86:0/930861893 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83b014db80 con 0x7f83b00ccee0 2023-10-09T12:00:13.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.004+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f83b014db80 con 0x7f83b00ccee0 2023-10-09T12:00:13.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.008+0000 7f839e7fc700 1 -- 172.21.15.86:0/930861893 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f83b014db80 con 0x7f83b00ccee0 2023-10-09T12:00:13.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8390066f60 msgr2=0x7f8390069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8390066f60 0x7f8390069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009bf0 tx=0x7f83a00091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b00ccee0 msgr2=0x7f83b01509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b00ccee0 0x7f83b01509e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b600 tx=0x7f83a40091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 shutdown_connections 2023-10-09T12:00:13.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b01568e0 0x7f83b0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b00c83f0 0x7f83b014d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8390066f60 0x7f8390069410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 --2- 172.21.15.86:0/930861893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83b00ccee0 0x7f83b01509e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 >> 172.21.15.86:0/930861893 conn(0x7f83b0068e10 msgr2=0x7f83b00c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:13.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 shutdown_connections 2023-10-09T12:00:13.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.010+0000 7f83b4bff700 1 -- 172.21.15.86:0/930861893 wait complete. 2023-10-09T12:00:13.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-09T12:00:13.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.210+0000 7efd7bfff700 1 Processor -- start 2023-10-09T12:00:13.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.210+0000 7efd7bfff700 1 -- start start 2023-10-09T12:00:13.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd7bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 0x7efd7c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd7bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c06e2a0 con 0x7efd7c150550 2023-10-09T12:00:13.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd7bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c06b2e0 con 0x7efd7c0c7410 2023-10-09T12:00:13.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd7bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c78e0 con 0x7efd7c150180 2023-10-09T12:00:13.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd7a7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7efd7c150550 0x7efd7c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35232/0 (socket says 172.21.15.86:35232) 2023-10-09T12:00:13.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd7a7fc700 1 -- 172.21.15.86:0/3132198796 learned_addr learned my addr 172.21.15.86:0/3132198796 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd7affd700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 0x7efd7c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275788788 0 0) 0x7efd7c06e2a0 con 0x7efd7c150550 2023-10-09T12:00:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.212+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd64003570 con 0x7efd7c150550 2023-10-09T12:00:13.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310675496 0 0) 0x7efd7c06b2e0 con 0x7efd7c0c7410 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd7c06e2a0 con 0x7efd7c0c7410 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 774577628 0 0) 0x7efd64003570 con 0x7efd7c150550 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 msgr2=0x7efd7c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 0x7efd7c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 >> v1:172.21.15.135:6789/0 conn(0x7efd7c0c7410 legacy=0x7efd7c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0c7bc0 con 0x7efd7c150550 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7efd70001470 con 0x7efd7c150550 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 >> v1:172.21.15.86:6789/0 conn(0x7efd7c150550 legacy=0x7efd7c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd64003c20 0x7efd64004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 0x7efd64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd64004d50 0x7efd640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c78e0 con 0x7efd64004d50 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6400de00 con 0x7efd64003c20 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6400df70 con 0x7efd7c150180 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd7b7fe700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd64004d50 0x7efd640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd7a7fc700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 0x7efd64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.213+0000 7efd7affd700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd64003c20 0x7efd64004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7b7fe700 1 -- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 msgr2=0x7efd64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7b7fe700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd7c150180 0x7efd64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7b7fe700 1 -- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd64003c20 msgr2=0x7efd64004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7b7fe700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd64003c20 0x7efd64004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7b7fe700 1 -- 172.21.15.86:0/3132198796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64003570 con 0x7efd64004d50 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7b7fe700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd64004d50 0x7efd640051c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0c67e0 tx=0x7efd740017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaaa678b884213ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74001ab0 con 0x7efd64004d50 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400c880 con 0x7efd64004d50 2023-10-09T12:00:13.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd79ffb700 1 -- 172.21.15.86:0/3132198796 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400cc40 con 0x7efd64004d50 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7bfff700 1 -- 172.21.15.86:0/3132198796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd64004d50 msgr2=0x7efd640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7bfff700 1 --2- 172.21.15.86:0/3132198796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd64004d50 0x7efd640051c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0c67e0 tx=0x7efd740017a0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7b7fe700 1 -- 172.21.15.86:0/3132198796 reap_dead start 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.214+0000 7efd7bfff700 1 -- 172.21.15.86:0/3132198796 shutdown_connections 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.215+0000 7efd7bfff700 1 -- 172.21.15.86:0/3132198796 >> 172.21.15.86:0/3132198796 conn(0x7efd7c0cc1f0 msgr2=0x7efd7c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.215+0000 7efd7bfff700 1 -- 172.21.15.86:0/3132198796 shutdown_connections 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.215+0000 7efd7bfff700 1 -- 172.21.15.86:0/3132198796 wait complete. 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.216+0000 7efd7bfff700 1 Processor -- start 2023-10-09T12:00:13.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.216+0000 7efd7bfff700 1 -- start start 2023-10-09T12:00:13.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd64004d50 0x7efd7c16b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7c0abab0 0x7efd7c163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd7c14aa80 0x7efd7c14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c14b430 con 0x7efd7c14aa80 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c3c40 con 0x7efd7c0abab0 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0ac270 con 0x7efd64004d50 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd7c14aa80 0x7efd7c14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd7c14aa80 0x7efd7c14aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49092/0 (socket says 172.21.15.86:49092) 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7b7fe700 1 -- 172.21.15.86:0/2927473954 learned_addr learned my addr 172.21.15.86:0/2927473954 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7affd700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd64004d50 0x7efd7c16b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.217+0000 7efd7a7fc700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7c0abab0 0x7efd7c163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7b7fe700 1 -- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd64004d50 msgr2=0x7efd7c16b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7b7fe700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd64004d50 0x7efd7c16b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7b7fe700 1 -- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7c0abab0 msgr2=0x7efd7c163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7b7fe700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7c0abab0 0x7efd7c163e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7b7fe700 1 -- 172.21.15.86:0/2927473954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0ac550 con 0x7efd7c14aa80 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7b7fe700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd7c14aa80 0x7efd7c14aef0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7efd640057a0 tx=0x7efd74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd62ffd700 1 -- 172.21.15.86:0/2927473954 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400c6a0 con 0x7efd7c14aa80 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd62ffd700 1 -- 172.21.15.86:0/2927473954 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400c9f0 con 0x7efd7c14aa80 2023-10-09T12:00:13.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0ac830 con 0x7efd7c14aa80 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd62ffd700 1 -- 172.21.15.86:0/2927473954 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400cb80 con 0x7efd7c14aa80 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.218+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c164350 con 0x7efd7c14aa80 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.219+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c04c3c0 con 0x7efd7c14aa80 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.220+0000 7efd62ffd700 1 -- 172.21.15.86:0/2927473954 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd74025020 con 0x7efd7c14aa80 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.221+0000 7efd62ffd700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.221+0000 7efd62ffd700 1 -- 172.21.15.86:0/2927473954 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5945+0+0 (secure 0 0 0) 0x7efd74086390 con 0x7efd7c14aa80 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.221+0000 7efd7affd700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.222+0000 7efd7affd700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efd68066f30 0x7efd680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd6c006f00 tx=0x7efd6c0091a0 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:13.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.225+0000 7efd62ffd700 1 -- 172.21.15.86:0/2927473954 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd74053470 con 0x7efd7c14aa80 2023-10-09T12:00:13.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.491+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7efd7c0c3a10 con 0x7efd7c14aa80 2023-10-09T12:00:13.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.757+0000 7efd62ffd700 1 -- 172.21.15.86:0/2927473954 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v716) v1 ==== 148+0+0 (secure 0 0 0) 0x7efd7402d0d0 con 0x7efd7c14aa80 2023-10-09T12:00:13.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efd68066f30 msgr2=0x7efd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efd68066f30 0x7efd680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd6c006f00 tx=0x7efd6c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd7c14aa80 msgr2=0x7efd7c14aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd7c14aa80 0x7efd7c14aef0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7efd640057a0 tx=0x7efd74016000 comp rx=0 tx=0).stop 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 shutdown_connections 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd7c14aa80 0x7efd7c14aef0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd64004d50 0x7efd7c16b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 --2- 172.21.15.86:0/2927473954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd7c0abab0 0x7efd7c163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 >> 172.21.15.86:0/2927473954 conn(0x7efd7c0cc1f0 msgr2=0x7efd7c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:13.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 shutdown_connections 2023-10-09T12:00:13.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.760+0000 7efd7bfff700 1 -- 172.21.15.86:0/2927473954 wait complete. 2023-10-09T12:00:13.779 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-10-09T12:00:13.779 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-10-09T12:00:13.780 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T12:00:13.780 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-09T12:00:13.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.959+0000 7fafdd3ff700 1 Processor -- start 2023-10-09T12:00:13.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.959+0000 7fafdd3ff700 1 -- start start 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.960+0000 7fafdd3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fafd8159890 0x7fafd815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.960+0000 7fafdd3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fafd8069560 0x7fafd80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.960+0000 7fafdd3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd8069ee0 con 0x7fafd8159c60 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.960+0000 7fafdd3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd815a160 con 0x7fafd8159890 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.960+0000 7fafdd3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80d13a0 con 0x7fafd8069560 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd6ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fafd8159890 0x7fafd815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd67fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fafd8159c60 0x7fafd815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:35246/0 (socket says 172.21.15.86:35246) 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd67fc700 1 -- 172.21.15.86:0/784178666 learned_addr learned my addr 172.21.15.86:0/784178666 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:13.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd77fe700 1 --2- 172.21.15.86:0/784178666 >> v2:172.21.15.135:3300/0 conn(0x7fafd8069560 0x7fafd80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd6ffd700 1 -- 172.21.15.86:0/784178666 >> v2:172.21.15.135:3300/0 conn(0x7fafd8069560 msgr2=0x7fafd80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd6ffd700 1 --2- 172.21.15.86:0/784178666 >> v2:172.21.15.135:3300/0 conn(0x7fafd8069560 0x7fafd80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd6ffd700 1 -- 172.21.15.86:0/784178666 >> v1:172.21.15.86:6789/0 conn(0x7fafd8159c60 legacy=0x7fafd815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd6ffd700 1 -- 172.21.15.86:0/784178666 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd815e140 con 0x7fafd8159890 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd5ffb700 1 -- 172.21.15.86:0/784178666 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080167016 0 0) 0x7fafd8069ee0 con 0x7fafd8159c60 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd6ffd700 1 --2- 172.21.15.86:0/784178666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8159890 0x7fafd815abd0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fafd806a890 tx=0x7fafc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a1cf5955e22f52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.961+0000 7fafd5ffb700 1 -- 172.21.15.86:0/784178666 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800b6b0 con 0x7fafd8159890 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafd5ffb700 1 -- 172.21.15.86:0/784178666 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc800b810 con 0x7fafd8159890 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafd5ffb700 1 -- 172.21.15.86:0/784178666 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800bbb0 con 0x7fafd8159890 2023-10-09T12:00:13.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 -- 172.21.15.86:0/784178666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8159890 msgr2=0x7fafd815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/784178666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8159890 0x7fafd815abd0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fafd806a890 tx=0x7fafc80091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 -- 172.21.15.86:0/784178666 shutdown_connections 2023-10-09T12:00:13.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/784178666 >> v2:172.21.15.135:3300/0 conn(0x7fafd8069560 0x7fafd80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/784178666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8159890 0x7fafd815abd0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 -- 172.21.15.86:0/784178666 >> 172.21.15.86:0/784178666 conn(0x7fafd8068e20 msgr2=0x7fafd80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:13.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 -- 172.21.15.86:0/784178666 shutdown_connections 2023-10-09T12:00:13.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.962+0000 7fafdd3ff700 1 -- 172.21.15.86:0/784178666 wait complete. 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.964+0000 7fafdd3ff700 1 Processor -- start 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.964+0000 7fafdd3ff700 1 -- start start 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafdd3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8069560 0x7fafd8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafdd3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd8159890 0x7fafd80b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafdd3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd8159c60 0x7fafd8157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafdd3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8155c90 con 0x7fafd8069560 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafdd3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8156810 con 0x7fafd8159c60 2023-10-09T12:00:13.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafdd3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8154430 con 0x7fafd8159890 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8069560 0x7fafd8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8069560 0x7fafd8153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49112/0 (socket says 172.21.15.86:49112) 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 -- 172.21.15.86:0/6285349 learned_addr learned my addr 172.21.15.86:0/6285349 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd77fe700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd8159c60 0x7fafd8157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd67fc700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd8159890 0x7fafd80b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 -- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd8159890 msgr2=0x7fafd80b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd8159890 0x7fafd80b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 -- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd8159c60 msgr2=0x7fafd8157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:13.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd8159c60 0x7fafd8157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 -- 172.21.15.86:0/6285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc8009420 con 0x7fafd8069560 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd67fc700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd8159890 0x7fafd80b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.965+0000 7fafd6ffd700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8069560 0x7fafd8153ef0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fafd8070e20 tx=0x7fafc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.966+0000 7fafbeffd700 1 -- 172.21.15.86:0/6285349 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011420 con 0x7fafd8069560 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.966+0000 7fafbeffd700 1 -- 172.21.15.86:0/6285349 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8011580 con 0x7fafd8069560 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.966+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd8155ee0 con 0x7fafd8069560 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.966+0000 7fafbeffd700 1 -- 172.21.15.86:0/6285349 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011940 con 0x7fafd8069560 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.966+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd81564a0 con 0x7fafd8069560 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.967+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd804c3c0 con 0x7fafd8069560 2023-10-09T12:00:13.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.968+0000 7fafbeffd700 1 -- 172.21.15.86:0/6285349 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafc8011d30 con 0x7fafd8069560 2023-10-09T12:00:13.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.968+0000 7fafbeffd700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fafc4066f30 0x7fafc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:13.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.969+0000 7fafbeffd700 1 -- 172.21.15.86:0/6285349 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5945+0+0 (secure 0 0 0) 0x7fafc8086120 con 0x7fafd8069560 2023-10-09T12:00:13.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.969+0000 7fafd67fc700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fafc4066f30 0x7fafc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:13.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.969+0000 7fafd67fc700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fafc4066f30 0x7fafc40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fafd80cad40 tx=0x7fafcc009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:13.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:13.973+0000 7fafbeffd700 1 -- 172.21.15.86:0/6285349 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafc8053200 con 0x7fafd8069560 2023-10-09T12:00:14.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.238+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fafd806a5b0 con 0x7fafd8069560 2023-10-09T12:00:14.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.760+0000 7fafbeffd700 1 -- 172.21.15.86:0/6285349 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v717) v1 ==== 181+0+0 (secure 0 0 0) 0x7fafc8056820 con 0x7fafd8069560 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.762+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fafc4066f30 msgr2=0x7fafc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.762+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fafc4066f30 0x7fafc40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fafd80cad40 tx=0x7fafcc009040 comp rx=0 tx=0).stop 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.762+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8069560 msgr2=0x7fafd8153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.762+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8069560 0x7fafd8153ef0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fafd8070e20 tx=0x7fafc8017000 comp rx=0 tx=0).stop 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.762+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 shutdown_connections 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.762+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fafc4066f30 0x7fafc40693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.763+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafd8069560 0x7fafd8153ef0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.763+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd8159c60 0x7fafd8157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.763+0000 7fafdd3ff700 1 --2- 172.21.15.86:0/6285349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd8159890 0x7fafd80b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.763+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 >> 172.21.15.86:0/6285349 conn(0x7fafd8068e20 msgr2=0x7fafd80b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:14.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.763+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 shutdown_connections 2023-10-09T12:00:14.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.763+0000 7fafdd3ff700 1 -- 172.21.15.86:0/6285349 wait complete. 2023-10-09T12:00:14.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T12:00:14.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.965+0000 7f84a759d700 1 Processor -- start 2023-10-09T12:00:14.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.966+0000 7f84a759d700 1 -- start start 2023-10-09T12:00:14.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a759d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f84a0153900 0x7f84a00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a759d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84a006a710 0x7f84a006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a759d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a006e150 con 0x7f84a00c9db0 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a759d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a00c7800 con 0x7f84a0153900 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a759d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a00c7ae0 con 0x7f84a006a710 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a5d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f84a00c9db0 0x7f84a006a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37288/0 (socket says 172.21.15.86:37288) 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a5d9a700 1 -- 172.21.15.86:0/657660418 learned_addr learned my addr 172.21.15.86:0/657660418 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.967+0000 7f84a659b700 1 --2- 172.21.15.86:0/657660418 >> v2:172.21.15.86:3300/0 conn(0x7f84a0153900 0x7f84a00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a6d9c700 1 --2- 172.21.15.86:0/657660418 >> v2:172.21.15.135:3300/0 conn(0x7f84a006a710 0x7f84a006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a5599700 1 -- 172.21.15.86:0/657660418 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937755690 0 0) 0x7f84a006e150 con 0x7f84a00c9db0 2023-10-09T12:00:14.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a659b700 1 -- 172.21.15.86:0/657660418 >> v2:172.21.15.135:3300/0 conn(0x7f84a006a710 msgr2=0x7f84a006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:14.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a659b700 1 --2- 172.21.15.86:0/657660418 >> v2:172.21.15.135:3300/0 conn(0x7f84a006a710 0x7f84a006e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a659b700 1 -- 172.21.15.86:0/657660418 >> v1:172.21.15.86:6789/0 conn(0x7f84a00c9db0 legacy=0x7f84a006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:14.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a659b700 1 -- 172.21.15.86:0/657660418 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a00c7dc0 con 0x7f84a0153900 2023-10-09T12:00:14.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a659b700 1 --2- 172.21.15.86:0/657660418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a0153900 0x7f84a00c6f00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f84a00cd2d0 tx=0x7f849c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fb7f2d14c92316 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:14.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a5599700 1 -- 172.21.15.86:0/657660418 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00b6b0 con 0x7f84a0153900 2023-10-09T12:00:14.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a5599700 1 -- 172.21.15.86:0/657660418 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c00b810 con 0x7f84a0153900 2023-10-09T12:00:14.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.968+0000 7f84a5599700 1 -- 172.21.15.86:0/657660418 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00bbb0 con 0x7f84a0153900 2023-10-09T12:00:14.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 -- 172.21.15.86:0/657660418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a0153900 msgr2=0x7f84a00c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:14.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 --2- 172.21.15.86:0/657660418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a0153900 0x7f84a00c6f00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f84a00cd2d0 tx=0x7f849c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 -- 172.21.15.86:0/657660418 shutdown_connections 2023-10-09T12:00:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 --2- 172.21.15.86:0/657660418 >> v2:172.21.15.135:3300/0 conn(0x7f84a006a710 0x7f84a006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 --2- 172.21.15.86:0/657660418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a0153900 0x7f84a00c6f00 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 -- 172.21.15.86:0/657660418 >> 172.21.15.86:0/657660418 conn(0x7f84a00cc1e0 msgr2=0x7f84a00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 -- 172.21.15.86:0/657660418 shutdown_connections 2023-10-09T12:00:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.969+0000 7f84a759d700 1 -- 172.21.15.86:0/657660418 wait complete. 2023-10-09T12:00:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.970+0000 7f84a759d700 1 Processor -- start 2023-10-09T12:00:14.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.971+0000 7f84a759d700 1 -- start start 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.971+0000 7f84a759d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a006a710 0x7f84a00c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84a00c9db0 0x7f84a00ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84a0153900 0x7f84a00aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a759d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00adc50 con 0x7f84a006a710 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00b17f0 con 0x7f84a00c9db0 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00c1b90 con 0x7f84a0153900 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a006a710 0x7f84a00c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:14.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a006a710 0x7f84a00c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38322/0 (socket says 172.21.15.86:38322) 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 -- 172.21.15.86:0/2705364727 learned_addr learned my addr 172.21.15.86:0/2705364727 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 -- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84a0153900 msgr2=0x7f84a00aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84a0153900 0x7f84a00aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 -- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84a00c9db0 msgr2=0x7f84a00ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a5d9a700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84a00c9db0 0x7f84a00ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84a00c9db0 0x7f84a00ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 -- 172.21.15.86:0/2705364727 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c009420 con 0x7f84a006a710 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a5d9a700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84a00c9db0 0x7f84a00ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.972+0000 7f84a659b700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a006a710 0x7f84a00c2710 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f84a006ce80 tx=0x7f849c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.973+0000 7f84967fc700 1 -- 172.21.15.86:0/2705364727 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00bb90 con 0x7f84a006a710 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.973+0000 7f84967fc700 1 -- 172.21.15.86:0/2705364727 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c0233f0 con 0x7f84a006a710 2023-10-09T12:00:14.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.973+0000 7f84967fc700 1 -- 172.21.15.86:0/2705364727 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c023790 con 0x7f84a006a710 2023-10-09T12:00:14.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.973+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a00c1e70 con 0x7f84a006a710 2023-10-09T12:00:14.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.973+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a00c2c50 con 0x7f84a006a710 2023-10-09T12:00:14.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.974+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a00ad6d0 con 0x7f84a006a710 2023-10-09T12:00:14.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.975+0000 7f84967fc700 1 -- 172.21.15.86:0/2705364727 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f849c023b40 con 0x7f84a006a710 2023-10-09T12:00:14.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.975+0000 7f84967fc700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8484066f30 0x7f84840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:14.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.975+0000 7f84967fc700 1 -- 172.21.15.86:0/2705364727 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f849c085ca0 con 0x7f84a006a710 2023-10-09T12:00:14.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.976+0000 7f84a5d9a700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8484066f30 0x7f84840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:14.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.976+0000 7f84a5d9a700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8484066f30 0x7f84840693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84a00b2200 tx=0x7f8490009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:14.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:14.980+0000 7f84967fc700 1 -- 172.21.15.86:0/2705364727 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84a00ad6d0 con 0x7f84a006a710 2023-10-09T12:00:15.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.169+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f84a00ad6d0 con 0x7f84a006a710 2023-10-09T12:00:15.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.174+0000 7f84967fc700 1 -- 172.21.15.86:0/2705364727 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84a00ad6d0 con 0x7f84a006a710 2023-10-09T12:00:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8484066f30 msgr2=0x7f84840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8484066f30 0x7f84840693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84a00b2200 tx=0x7f8490009040 comp rx=0 tx=0).stop 2023-10-09T12:00:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a006a710 msgr2=0x7f84a00c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a006a710 0x7f84a00c2710 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f84a006ce80 tx=0x7f849c018000 comp rx=0 tx=0).stop 2023-10-09T12:00:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 shutdown_connections 2023-10-09T12:00:15.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8484066f30 0x7f84840693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84a006a710 0x7f84a00c2710 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84a0153900 0x7f84a00aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 --2- 172.21.15.86:0/2705364727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84a00c9db0 0x7f84a00ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 >> 172.21.15.86:0/2705364727 conn(0x7f84a00cc1e0 msgr2=0x7f84a01543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 shutdown_connections 2023-10-09T12:00:15.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.176+0000 7f84a759d700 1 -- 172.21.15.86:0/2705364727 wait complete. 2023-10-09T12:00:15.194 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T12:00:15.194 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:00:15.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:00:15.359 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T12:00:15.359 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T12:00:15.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:00:15.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.540+0000 7f0f61bff700 1 Processor -- start 2023-10-09T12:00:15.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.540+0000 7f0f61bff700 1 -- start start 2023-10-09T12:00:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.541+0000 7f0f61bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f5c1578b0 0x7f0f5c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.541+0000 7f0f61bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0f5c0af2f0 0x7f0f5c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:15.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.541+0000 7f0f61bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c0ad930 con 0x7f0f5c155c10 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.541+0000 7f0f61bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c0b0c80 con 0x7f0f5c1578b0 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.541+0000 7f0f61bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c0acd20 con 0x7f0f5c0af2f0 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f5c1578b0 0x7f0f5c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0f5c155c10 0x7f0f5c0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37292/0 (socket says 172.21.15.86:37292) 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5b7fe700 1 -- 172.21.15.86:0/3624103432 learned_addr learned my addr 172.21.15.86:0/3624103432 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5bfff700 1 --2- 172.21.15.86:0/3624103432 >> v2:172.21.15.135:3300/0 conn(0x7f0f5c0af2f0 0x7f0f5c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5affd700 1 -- 172.21.15.86:0/3624103432 >> v2:172.21.15.135:3300/0 conn(0x7f0f5c0af2f0 msgr2=0x7f0f5c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5affd700 1 --2- 172.21.15.86:0/3624103432 >> v2:172.21.15.135:3300/0 conn(0x7f0f5c0af2f0 0x7f0f5c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5affd700 1 -- 172.21.15.86:0/3624103432 >> v1:172.21.15.86:6789/0 conn(0x7f0f5c155c10 legacy=0x7f0f5c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5affd700 1 -- 172.21.15.86:0/3624103432 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0ad000 con 0x7f0f5c1578b0 2023-10-09T12:00:15.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5bfff700 1 --2- 172.21.15.86:0/3624103432 >> v2:172.21.15.135:3300/0 conn(0x7f0f5c0af2f0 0x7f0f5c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5affd700 1 --2- 172.21.15.86:0/3624103432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c155fe0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c065be0 tx=0x7f0f500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28f197ed76c200f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5a7fc700 1 -- 172.21.15.86:0/3624103432 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000b6b0 con 0x7f0f5c1578b0 2023-10-09T12:00:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5a7fc700 1 -- 172.21.15.86:0/3624103432 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5000b810 con 0x7f0f5c1578b0 2023-10-09T12:00:15.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.542+0000 7f0f5a7fc700 1 -- 172.21.15.86:0/3624103432 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000bbb0 con 0x7f0f5c1578b0 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 -- 172.21.15.86:0/3624103432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 msgr2=0x7f0f5c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 --2- 172.21.15.86:0/3624103432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c155fe0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c065be0 tx=0x7f0f500091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 -- 172.21.15.86:0/3624103432 shutdown_connections 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 --2- 172.21.15.86:0/3624103432 >> v2:172.21.15.135:3300/0 conn(0x7f0f5c0af2f0 0x7f0f5c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 --2- 172.21.15.86:0/3624103432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c155fe0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 -- 172.21.15.86:0/3624103432 >> 172.21.15.86:0/3624103432 conn(0x7f0f5c06a320 msgr2=0x7f0f5c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 -- 172.21.15.86:0/3624103432 shutdown_connections 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.543+0000 7f0f61bff700 1 -- 172.21.15.86:0/3624103432 wait complete. 2023-10-09T12:00:15.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.544+0000 7f0f61bff700 1 Processor -- start 2023-10-09T12:00:15.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.545+0000 7f0f61bff700 1 -- start start 2023-10-09T12:00:15.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.545+0000 7f0f61bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f5c0af2f0 0x7f0f5c145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:15.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.545+0000 7f0f61bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c155c10 0x7f0f5c14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:15.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f61bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f61bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c14c6b0 con 0x7f0f5c1578b0 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f61bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c14baa0 con 0x7f0f5c155c10 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f61bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c14bd80 con 0x7f0f5c0af2f0 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c0c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38344/0 (socket says 172.21.15.86:38344) 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 -- 172.21.15.86:0/2919811362 learned_addr learned my addr 172.21.15.86:0/2919811362 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5affd700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c155c10 0x7f0f5c14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 -- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f5c0af2f0 msgr2=0x7f0f5c145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f5c0af2f0 0x7f0f5c145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 -- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c155c10 msgr2=0x7f0f5c14b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c155c10 0x7f0f5c14b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 -- 172.21.15.86:0/2919811362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50009420 con 0x7f0f5c1578b0 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5affd700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c155c10 0x7f0f5c14b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.546+0000 7f0f5bfff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c0c9030 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a380 tx=0x7f0f54007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.547+0000 7f0f437fe700 1 -- 172.21.15.86:0/2919811362 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400aea0 con 0x7f0f5c1578b0 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.547+0000 7f0f437fe700 1 -- 172.21.15.86:0/2919811362 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400d650 con 0x7f0f5c1578b0 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.547+0000 7f0f437fe700 1 -- 172.21.15.86:0/2919811362 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400da10 con 0x7f0f5c1578b0 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.547+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c14c060 con 0x7f0f5c1578b0 2023-10-09T12:00:15.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.547+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c146280 con 0x7f0f5c1578b0 2023-10-09T12:00:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.548+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c04c3c0 con 0x7f0f5c1578b0 2023-10-09T12:00:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.549+0000 7f0f437fe700 1 -- 172.21.15.86:0/2919811362 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f5401e3b0 con 0x7f0f5c1578b0 2023-10-09T12:00:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.549+0000 7f0f437fe700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f48066f30 0x7f0f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.549+0000 7f0f437fe700 1 -- 172.21.15.86:0/2919811362 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f0f54085190 con 0x7f0f5c1578b0 2023-10-09T12:00:15.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.550+0000 7f0f5b7fe700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f48066f30 0x7f0f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:15.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.550+0000 7f0f5b7fe700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f48066f30 0x7f0f480693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0016a0 tx=0x7f0f4c007b30 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:15.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.553+0000 7f0f437fe700 1 -- 172.21.15.86:0/2919811362 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f54052270 con 0x7f0f5c1578b0 2023-10-09T12:00:15.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.789+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f5c14c860 con 0x7f0f5c1578b0 2023-10-09T12:00:15.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.790+0000 7f0f437fe700 1 -- 172.21.15.86:0/2919811362 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f0f5401ade0 con 0x7f0f5c1578b0 2023-10-09T12:00:15.790 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:15.790 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/2850632798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2850632798},{"type":"v1","addr":"172.21.15.86:6833","nonce":2850632798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/244252313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":244252313},{"type":"v1","addr":"172.21.15.135:6834","nonce":244252313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6380,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4164357513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":4164357513},{"type":"v1","addr":"172.21.15.135:6835","nonce":4164357513}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7537,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3649107735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3649107735},{"type":"v1","addr":"172.21.15.86:6835","nonce":3649107735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[]} 2023-10-09T12:00:15.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f48066f30 msgr2=0x7f0f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f48066f30 0x7f0f480693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0016a0 tx=0x7f0f4c007b30 comp rx=0 tx=0).stop 2023-10-09T12:00:15.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 msgr2=0x7f0f5c0c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:15.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c0c9030 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a380 tx=0x7f0f54007900 comp rx=0 tx=0).stop 2023-10-09T12:00:15.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 shutdown_connections 2023-10-09T12:00:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0f48066f30 0x7f0f480693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f5c1578b0 0x7f0f5c0c9030 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f5c0af2f0 0x7f0f5c145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 --2- 172.21.15.86:0/2919811362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c155c10 0x7f0f5c14b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 >> 172.21.15.86:0/2919811362 conn(0x7f0f5c06a320 msgr2=0x7f0f5c06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.792+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 shutdown_connections 2023-10-09T12:00:15.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:15.793+0000 7f0f61bff700 1 -- 172.21.15.86:0/2919811362 wait complete. 2023-10-09T12:00:15.795 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 56 2023-10-09T12:00:15.810 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T12:00:15.810 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T12:00:15.811 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T12:00:15.811 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:00:15.811 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T12:00:15.811 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T12:00:15.811 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T12:00:15.812 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:00:15.812 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T12:00:15.812 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T12:00:15.812 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T12:00:15.812 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:00:15.812 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T12:00:15.813 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T12:00:15.813 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T12:00:15.813 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:00:15.826 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T12:00:15.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T12:00:15.828 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T12:00:15.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T12:00:15.829 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T12:00:15.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T12:00:15.870 INFO:tasks.ceph.mds.c:Started 2023-10-09T12:00:15.871 DEBUG:teuthology.parallel:result is None 2023-10-09T12:00:15.873 INFO:tasks.ceph.mds.b:Started 2023-10-09T12:00:15.873 DEBUG:teuthology.parallel:result is None 2023-10-09T12:00:15.875 INFO:tasks.ceph.mds.d:Started 2023-10-09T12:00:15.876 DEBUG:teuthology.parallel:result is None 2023-10-09T12:00:15.996 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T12:00:16.010 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T12:00:16.011 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T12:00:17.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-09T12:00:21.827 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T12:00:21.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T12:00:21.832 INFO:tasks.ceph.mds.a:Started 2023-10-09T12:00:21.833 DEBUG:teuthology.parallel:result is None 2023-10-09T12:00:21.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T12:00:21.973 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T12:00:22.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.029+0000 7f3aa359e700 1 Processor -- start 2023-10-09T12:00:22.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.030+0000 7f3aa359e700 1 -- start start 2023-10-09T12:00:22.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.031+0000 7f3aa359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa40b0bd0 0x7f3aa41646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:22.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.031+0000 7f3aa359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa415a980 con 0x7f3aa4068aa0 2023-10-09T12:00:22.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.031+0000 7f3aa359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa415a050 con 0x7f3aa4157270 2023-10-09T12:00:22.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.031+0000 7f3aa359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa415e310 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.031+0000 7f3a9bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3aa4068aa0 0x7f3aa40b04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37300/0 (socket says 172.21.15.86:37300) 2023-10-09T12:00:22.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.031+0000 7f3a9bfff700 1 -- 172.21.15.86:0/2517069802 learned_addr learned my addr 172.21.15.86:0/2517069802 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:22.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa2d9d700 1 --2- 172.21.15.86:0/2517069802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa40b0bd0 0x7f3aa41646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:22.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504056711 0 0) 0x7f3aa415a980 con 0x7f3aa4068aa0 2023-10-09T12:00:22.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a90003570 con 0x7f3aa4068aa0 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653491461 0 0) 0x7f3aa415a050 con 0x7f3aa4157270 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa415a980 con 0x7f3aa4157270 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1123534079 0 0) 0x7f3a90003570 con 0x7f3aa4068aa0 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa2d9d700 1 -- 172.21.15.86:0/2517069802 >> v1:172.21.15.135:6789/0 conn(0x7f3aa4157270 legacy=0x7f3aa4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa2d9d700 1 -- 172.21.15.86:0/2517069802 >> v1:172.21.15.86:6789/0 conn(0x7f3aa4068aa0 legacy=0x7f3aa40b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa2d9d700 1 -- 172.21.15.86:0/2517069802 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa415a330 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.032+0000 7f3aa2d9d700 1 --2- 172.21.15.86:0/2517069802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa40b0bd0 0x7f3aa41646a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009e90 tx=0x7f3a9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd796b3c6727e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00e070 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00b870 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa1d9b700 1 -- 172.21.15.86:0/2517069802 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c001470 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa359e700 1 -- 172.21.15.86:0/2517069802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa40b0bd0 msgr2=0x7f3aa41646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2517069802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa40b0bd0 0x7f3aa41646a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009e90 tx=0x7f3a9c009780 comp rx=0 tx=0).stop 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa359e700 1 -- 172.21.15.86:0/2517069802 shutdown_connections 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2517069802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa40b0bd0 0x7f3aa41646a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa359e700 1 -- 172.21.15.86:0/2517069802 >> 172.21.15.86:0/2517069802 conn(0x7f3aa40cd310 msgr2=0x7f3aa40cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa359e700 1 -- 172.21.15.86:0/2517069802 shutdown_connections 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.033+0000 7f3aa359e700 1 -- 172.21.15.86:0/2517069802 wait complete. 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.035+0000 7f3aa359e700 1 Processor -- start 2023-10-09T12:00:22.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.035+0000 7f3aa359e700 1 -- start start 2023-10-09T12:00:22.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa4068aa0 0x7f3aa416d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:22.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa40b0bd0 0x7f3aa4154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:22.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa4157270 0x7f3aa4150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:22.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40ae1c0 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa415b980 con 0x7f3aa4157270 2023-10-09T12:00:22.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa416de20 con 0x7f3aa4068aa0 2023-10-09T12:00:22.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa40b0bd0 0x7f3aa4154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa40b0bd0 0x7f3aa4154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38376/0 (socket says 172.21.15.86:38376) 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 -- 172.21.15.86:0/2612173010 learned_addr learned my addr 172.21.15.86:0/2612173010 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa259c700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa4068aa0 0x7f3aa416d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3aa2d9d700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa4157270 0x7f3aa4150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 -- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa4068aa0 msgr2=0x7f3aa416d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa4068aa0 0x7f3aa416d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 -- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa4157270 msgr2=0x7f3aa4150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa4157270 0x7f3aa4150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.036+0000 7f3a9bfff700 1 -- 172.21.15.86:0/2612173010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c009a20 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.037+0000 7f3aa259c700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa4068aa0 0x7f3aa416d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:22.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.037+0000 7f3a9bfff700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa40b0bd0 0x7f3aa4154b70 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c910 tx=0x7f3a8c0019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:22.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.037+0000 7f3a9a7fc700 1 -- 172.21.15.86:0/2612173010 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c005b30 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.037+0000 7f3a9a7fc700 1 -- 172.21.15.86:0/2612173010 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c005c90 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.037+0000 7f3a9a7fc700 1 -- 172.21.15.86:0/2612173010 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c007320 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.037+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa415b050 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.037+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa415b610 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.038+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa415baf0 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.039+0000 7f3a9a7fc700 1 -- 172.21.15.86:0/2612173010 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a8c01b400 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.040+0000 7f3a9a7fc700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a84066f30 0x7f3a840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:22.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.040+0000 7f3a9a7fc700 1 -- 172.21.15.86:0/2612173010 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5945+0+0 (secure 0 0 0) 0x7f3a8c084390 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.040+0000 7f3aa259c700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a84066f30 0x7f3a840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:22.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.041+0000 7f3aa259c700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a84066f30 0x7f3a840693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a940038f0 tx=0x7f3a94009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:22.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.045+0000 7f3a9a7fc700 1 -- 172.21.15.86:0/2612173010 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a8c0514f0 con 0x7f3aa40b0bd0 2023-10-09T12:00:22.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:22.251+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3aa404c3f0 con 0x7f3aa40b0bd0 2023-10-09T12:00:23.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.318+0000 7f3a9a7fc700 1 -- 172.21.15.86:0/2612173010 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v135) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3a8c054b10 con 0x7f3aa40b0bd0 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a84066f30 msgr2=0x7f3a840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a84066f30 0x7f3a840693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a940038f0 tx=0x7f3a94009040 comp rx=0 tx=0).stop 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa40b0bd0 msgr2=0x7f3aa4154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa40b0bd0 0x7f3aa4154b70 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c910 tx=0x7f3a8c0019d0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 shutdown_connections 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3aa4157270 0x7f3aa4150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3aa4068aa0 0x7f3aa416d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3a84066f30 0x7f3a840693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 --2- 172.21.15.86:0/2612173010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aa40b0bd0 0x7f3aa4154b70 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 >> 172.21.15.86:0/2612173010 conn(0x7f3aa40cd310 msgr2=0x7f3aa40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:23.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 shutdown_connections 2023-10-09T12:00:23.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.321+0000 7f3aa359e700 1 -- 172.21.15.86:0/2612173010 wait complete. 2023-10-09T12:00:23.323 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T12:00:23.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T12:00:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.526+0000 7fd42f7ff700 1 Processor -- start 2023-10-09T12:00:23.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.526+0000 7fd42f7ff700 1 -- start start 2023-10-09T12:00:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42f7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 0x7fd428155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42f7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4280af2f0 0x7fd4280af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42f7ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280ad930 con 0x7fd428155c10 2023-10-09T12:00:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42f7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4280b0c60 con 0x7fd4280af2f0 2023-10-09T12:00:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42f7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280acd20 con 0x7fd4281578b0 2023-10-09T12:00:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42d59b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd428155c10 0x7fd4280ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37306/0 (socket says 172.21.15.86:37306) 2023-10-09T12:00:23.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42d59b700 1 -- 172.21.15.86:0/3435200639 learned_addr learned my addr 172.21.15.86:0/3435200639 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:23.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163585892 0 0) 0x7fd4280ad930 con 0x7fd428155c10 2023-10-09T12:00:23.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd414003570 con 0x7fd428155c10 2023-10-09T12:00:23.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 0x7fd428155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.528+0000 7fd42dd9c700 1 --2- 172.21.15.86:0/3435200639 >> v2:172.21.15.135:3300/0 conn(0x7fd4280af2f0 0x7fd4280af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196958027 0 0) 0x7fd414003570 con 0x7fd428155c10 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 msgr2=0x7fd428155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 0x7fd428155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 >> v2:172.21.15.135:3300/0 conn(0x7fd4280af2f0 msgr2=0x7fd4280af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 --2- 172.21.15.86:0/3435200639 >> v2:172.21.15.135:3300/0 conn(0x7fd4280af2f0 0x7fd4280af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4280ad000 con 0x7fd428155c10 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fd424001470 con 0x7fd428155c10 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42dd9c700 1 --2- 172.21.15.86:0/3435200639 >> v2:172.21.15.135:3300/0 conn(0x7fd4280af2f0 0x7fd4280af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 >> v1:172.21.15.86:6789/0 conn(0x7fd428155c10 legacy=0x7fd4280ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd414003ae0 0x7fd414003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd414004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 0x7fd4140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280b0c60 con 0x7fd414004810 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280acd20 con 0x7fd414003ae0 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41400bbf0 con 0x7fd4281578b0 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd414004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42dd9c700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 0x7fd4140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42d59b700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd414003ae0 0x7fd414003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42cd9a700 1 -- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 msgr2=0x7fd4140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 0x7fd4140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42cd9a700 1 -- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd414003ae0 msgr2=0x7fd414003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd414003ae0 0x7fd414003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42cd9a700 1 -- 172.21.15.86:0/3435200639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414003570 con 0x7fd414004810 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.529+0000 7fd42dd9c700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4281578b0 0x7fd4140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.530+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd414004c80 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd418009c00 tx=0x7fd4180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439b66b2907a530b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.530+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800e710 con 0x7fd414004810 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.530+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800e870 con 0x7fd414004810 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.530+0000 7fd41ffff700 1 -- 172.21.15.86:0/3435200639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800ec30 con 0x7fd414004810 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.530+0000 7fd42f7ff700 1 -- 172.21.15.86:0/3435200639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 msgr2=0x7fd414004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.530+0000 7fd42f7ff700 1 --2- 172.21.15.86:0/3435200639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd414004c80 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd418009c00 tx=0x7fd4180091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.530+0000 7fd42dd9c700 1 -- 172.21.15.86:0/3435200639 reap_dead start 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.531+0000 7fd42f7ff700 1 -- 172.21.15.86:0/3435200639 shutdown_connections 2023-10-09T12:00:23.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.531+0000 7fd42f7ff700 1 -- 172.21.15.86:0/3435200639 >> 172.21.15.86:0/3435200639 conn(0x7fd42806a320 msgr2=0x7fd4280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:23.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.531+0000 7fd42f7ff700 1 -- 172.21.15.86:0/3435200639 shutdown_connections 2023-10-09T12:00:23.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.531+0000 7fd42f7ff700 1 -- 172.21.15.86:0/3435200639 wait complete. 2023-10-09T12:00:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.532+0000 7fd42f7ff700 1 Processor -- start 2023-10-09T12:00:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.532+0000 7fd42f7ff700 1 -- start start 2023-10-09T12:00:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42f7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd42815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42f7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42815a520 0x7fd4281520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42f7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd428157d40 0x7fd4281581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42f7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42815aa90 con 0x7fd414004810 2023-10-09T12:00:23.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42f7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42815ad70 con 0x7fd42815a520 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42f7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42815b050 con 0x7fd428157d40 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42d59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd42815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42d59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd42815bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38398/0 (socket says 172.21.15.86:38398) 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42d59b700 1 -- 172.21.15.86:0/1318034703 learned_addr learned my addr 172.21.15.86:0/1318034703 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.533+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42815a520 0x7fd4281520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42d59b700 1 -- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd428157d40 msgr2=0x7fd4281581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42dd9c700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd428157d40 0x7fd4281581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42d59b700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd428157d40 0x7fd4281581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42d59b700 1 -- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42815a520 msgr2=0x7fd4281520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42d59b700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42815a520 0x7fd4281520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42d59b700 1 -- 172.21.15.86:0/1318034703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42815b330 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42815a520 0x7fd4281520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42dd9c700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd428157d40 0x7fd4281581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42d59b700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd42815bb30 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd42400eb90 tx=0x7fd424000d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd41d7fa700 1 -- 172.21.15.86:0/1318034703 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400c5d0 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd41d7fa700 1 -- 172.21.15.86:0/1318034703 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400c750 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42815b610 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd41d7fa700 1 -- 172.21.15.86:0/1318034703 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400cb10 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.534+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd428152630 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.535+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42815b850 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.536+0000 7fd41d7fa700 1 -- 172.21.15.86:0/1318034703 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd42401d460 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.537+0000 7fd41d7fa700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd40c066f30 0x7fd40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.537+0000 7fd41d7fa700 1 -- 172.21.15.86:0/1318034703 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5257+0+0 (secure 0 0 0) 0x7fd424084410 con 0x7fd414004810 2023-10-09T12:00:23.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.537+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd40c066f30 0x7fd40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:23.540 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.538+0000 7fd42cd9a700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd40c066f30 0x7fd40c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd428068d00 tx=0x7fd41801a000 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:23.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.541+0000 7fd41d7fa700 1 -- 172.21.15.86:0/1318034703 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd42815b850 con 0x7fd414004810 2023-10-09T12:00:23.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-09T12:00:23.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.805+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd42815b850 con 0x7fd414004810 2023-10-09T12:00:23.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.805+0000 7fd41d7fa700 1 -- 172.21.15.86:0/1318034703 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd42815b850 con 0x7fd414004810 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.806 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:00:23.807 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.809 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T12:00:23.810 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.811 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T12:00:23.813 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.814 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:00:23.815 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.817 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T12:00:23.818 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.819 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T12:00:23.820 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T12:00:23.822 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd40c066f30 msgr2=0x7fd40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd40c066f30 0x7fd40c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd428068d00 tx=0x7fd41801a000 comp rx=0 tx=0).stop 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 msgr2=0x7fd42815bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd42815bb30 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd42400eb90 tx=0x7fd424000d00 comp rx=0 tx=0).stop 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 shutdown_connections 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd40c066f30 0x7fd40c0693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd414004810 0x7fd42815bb30 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd428157d40 0x7fd4281581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 --2- 172.21.15.86:0/1318034703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42815a520 0x7fd4281520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:23.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 >> 172.21.15.86:0/1318034703 conn(0x7fd42806a320 msgr2=0x7fd42806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:23.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 shutdown_connections 2023-10-09T12:00:23.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:23.808+0000 7fd42f7ff700 1 -- 172.21.15.86:0/1318034703 wait complete. 2023-10-09T12:00:23.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:00:24.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.006+0000 7fd0b739d700 1 Processor -- start 2023-10-09T12:00:24.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.006+0000 7fd0b739d700 1 -- start start 2023-10-09T12:00:24.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b739d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0b0150550 0x7fd0b0157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b739d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b006e2a0 con 0x7fd0b0150180 2023-10-09T12:00:24.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b739d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b006b2e0 con 0x7fd0b00c7410 2023-10-09T12:00:24.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b739d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00c78e0 con 0x7fd0b0150550 2023-10-09T12:00:24.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b639b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd0b0150180 0x7fd0b00c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37320/0 (socket says 172.21.15.86:37320) 2023-10-09T12:00:24.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b639b700 1 -- 172.21.15.86:0/1912766827 learned_addr learned my addr 172.21.15.86:0/1912766827 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:24.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b5b9a700 1 --2- 172.21.15.86:0/1912766827 >> v2:172.21.15.135:3300/0 conn(0x7fd0b0150550 0x7fd0b0157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338242013 0 0) 0x7fd0b006e2a0 con 0x7fd0b0150180 2023-10-09T12:00:24.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.008+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd09c003570 con 0x7fd0b0150180 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 965724199 0 0) 0x7fd09c003570 con 0x7fd0b0150180 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 >> v2:172.21.15.135:3300/0 conn(0x7fd0b0150550 msgr2=0x7fd0b0157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 --2- 172.21.15.86:0/1912766827 >> v2:172.21.15.135:3300/0 conn(0x7fd0b0150550 0x7fd0b0157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 >> v1:172.21.15.135:6789/0 conn(0x7fd0b00c7410 legacy=0x7fd0b0069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00c7bc0 con 0x7fd0b0150180 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fd0ac001470 con 0x7fd0b0150180 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 >> v1:172.21.15.86:6789/0 conn(0x7fd0b0150180 legacy=0x7fd0b00c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd09c003a60 0x7fd09c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd09c004810 0x7fd09c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c0051c0 0x7fd09c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00c78e0 con 0x7fd09c003a60 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c00c0d0 con 0x7fd09c0051c0 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c00c290 con 0x7fd09c004810 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b639b700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd09c003a60 0x7fd09c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b6b9c700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c0051c0 0x7fd09c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b5b9a700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd09c004810 0x7fd09c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b639b700 1 -- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd09c004810 msgr2=0x7fd09c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b639b700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd09c004810 0x7fd09c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b639b700 1 -- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c0051c0 msgr2=0x7fd09c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b639b700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c0051c0 0x7fd09c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b639b700 1 -- 172.21.15.86:0/1912766827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c003570 con 0x7fd09c003a60 2023-10-09T12:00:24.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b6b9c700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c0051c0 0x7fd09c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.009+0000 7fd0b6b9c700 1 -- 172.21.15.86:0/1912766827 reap_dead start 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b639b700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd09c003a60 0x7fd09c003e70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c3c0 tx=0x7fd0ac001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99648649c7c91847 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00cc90 con 0x7fd09c003a60 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac00cdf0 con 0x7fd09c003a60 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b5399700 1 -- 172.21.15.86:0/1912766827 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac005b50 con 0x7fd09c003a60 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b739d700 1 -- 172.21.15.86:0/1912766827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd09c003a60 msgr2=0x7fd09c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b739d700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd09c003a60 0x7fd09c003e70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c3c0 tx=0x7fd0ac001e50 comp rx=0 tx=0).stop 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b739d700 1 -- 172.21.15.86:0/1912766827 shutdown_connections 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b739d700 1 --2- 172.21.15.86:0/1912766827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd09c003a60 0x7fd09c003e70 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b739d700 1 -- 172.21.15.86:0/1912766827 >> 172.21.15.86:0/1912766827 conn(0x7fd0b00cc1f0 msgr2=0x7fd0b00cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b739d700 1 -- 172.21.15.86:0/1912766827 shutdown_connections 2023-10-09T12:00:24.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.010+0000 7fd0b739d700 1 -- 172.21.15.86:0/1912766827 wait complete. 2023-10-09T12:00:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.012+0000 7fd0b739d700 1 Processor -- start 2023-10-09T12:00:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.012+0000 7fd0b739d700 1 -- start start 2023-10-09T12:00:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b739d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c003a60 0x7fd0b015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b739d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b00afeb0 0x7fd0b00b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b739d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b00b0bc0 0x7fd0b00b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b739d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00c32a0 con 0x7fd0b00afeb0 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b739d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0158ae0 con 0x7fd09c003a60 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b739d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0158520 con 0x7fd0b00b0bc0 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b5b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b00afeb0 0x7fd0b00b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b5b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b00afeb0 0x7fd0b00b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38402/0 (socket says 172.21.15.86:38402) 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b5b9a700 1 -- 172.21.15.86:0/943873776 learned_addr learned my addr 172.21.15.86:0/943873776 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b639b700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c003a60 0x7fd0b015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.013+0000 7fd0b6b9c700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b00b0bc0 0x7fd0b00b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b5b9a700 1 -- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b00b0bc0 msgr2=0x7fd0b00b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b5b9a700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b00b0bc0 0x7fd0b00b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b5b9a700 1 -- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c003a60 msgr2=0x7fd0b015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b5b9a700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c003a60 0x7fd0b015a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b5b9a700 1 -- 172.21.15.86:0/943873776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0158800 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b639b700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c003a60 0x7fd0b015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b5b9a700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b00afeb0 0x7fd0b00b0680 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00109a0 tx=0x7fd0a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0a67fc700 1 -- 172.21.15.86:0/943873776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0010ee0 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0a67fc700 1 -- 172.21.15.86:0/943873776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a000e970 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b00ad030 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0a67fc700 1 -- 172.21.15.86:0/943873776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000ecf0 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.014+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b00c5ca0 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.015+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b00ad550 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.016+0000 7fd0a67fc700 1 -- 172.21.15.86:0/943873776 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0a0013680 con 0x7fd0b00afeb0 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.017+0000 7fd0a67fc700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f60 0x7fd094069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.017+0000 7fd0a67fc700 1 -- 172.21.15.86:0/943873776 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5257+0+0 (secure 0 0 0) 0x7fd0a0084520 con 0x7fd0b00afeb0 2023-10-09T12:00:24.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.017+0000 7fd0b639b700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f60 0x7fd094069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.018+0000 7fd0b639b700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f60 0x7fd094069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac007cd0 tx=0x7fd0ac015000 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.021+0000 7fd0a67fc700 1 -- 172.21.15.86:0/943873776 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0b00ad550 con 0x7fd0b00afeb0 2023-10-09T12:00:24.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.215+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0b00ad550 con 0x7fd0b00afeb0 2023-10-09T12:00:24.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.216+0000 7fd0a67fc700 1 -- 172.21.15.86:0/943873776 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+12807 (secure 0 0 0) 0x7fd0b00ad550 con 0x7fd0b00afeb0 2023-10-09T12:00:24.216 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:24.216 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":135,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:00:23.311850+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:00:24.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.218+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f60 msgr2=0x7fd094069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.218+0000 7fd0b739d700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f60 0x7fd094069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac007cd0 tx=0x7fd0ac015000 comp rx=0 tx=0).stop 2023-10-09T12:00:24.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.218+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b00afeb0 msgr2=0x7fd0b00b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.218+0000 7fd0b739d700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b00afeb0 0x7fd0b00b0680 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00109a0 tx=0x7fd0a0008040 comp rx=0 tx=0).stop 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.218+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 shutdown_connections 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.219+0000 7fd0b739d700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b00b0bc0 0x7fd0b00b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.219+0000 7fd0b739d700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd09c003a60 0x7fd0b015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.219+0000 7fd0b739d700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f60 0x7fd094069410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.219+0000 7fd0b739d700 1 --2- 172.21.15.86:0/943873776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b00afeb0 0x7fd0b00b0680 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.219+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 >> 172.21.15.86:0/943873776 conn(0x7fd0b00cc1f0 msgr2=0x7fd0b00c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.219+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 shutdown_connections 2023-10-09T12:00:24.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.219+0000 7fd0b739d700 1 -- 172.21.15.86:0/943873776 wait complete. 2023-10-09T12:00:24.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T12:00:24.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T12:00:24.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.422+0000 7f62f359d700 1 Processor -- start 2023-10-09T12:00:24.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.422+0000 7f62f359d700 1 -- start start 2023-10-09T12:00:24.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.423+0000 7f62f359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 0x7f62ec0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.423+0000 7f62f359d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ec06e150 con 0x7f62ec06a710 2023-10-09T12:00:24.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.423+0000 7f62f359d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ec0c7800 con 0x7f62ec0c9db0 2023-10-09T12:00:24.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.423+0000 7f62f359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0c7ae0 con 0x7f62ec153900 2023-10-09T12:00:24.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.423+0000 7f62f2d9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f62ec06a710 0x7f62ec06e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37336/0 (socket says 172.21.15.86:37336) 2023-10-09T12:00:24.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.423+0000 7f62f2d9c700 1 -- 172.21.15.86:0/211199957 learned_addr learned my addr 172.21.15.86:0/211199957 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:24.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606775965 0 0) 0x7f62ec06e150 con 0x7f62ec06a710 2023-10-09T12:00:24.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d8003570 con 0x7f62ec06a710 2023-10-09T12:00:24.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f259b700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 0x7f62ec0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124025596 0 0) 0x7f62d8003570 con 0x7f62ec06a710 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 msgr2=0x7f62ec0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 0x7f62ec0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 >> v1:172.21.15.135:6789/0 conn(0x7f62ec0c9db0 legacy=0x7f62ec06a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0c7dc0 con 0x7f62ec06a710 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f62e40017f0 con 0x7f62ec06a710 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 >> v1:172.21.15.86:6789/0 conn(0x7f62ec06a710 legacy=0x7f62ec06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 0x7f62d8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d8004060 0x7f62d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8004d50 0x7f62d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0c7ae0 con 0x7f62d8004060 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d800bc20 con 0x7f62d8004d50 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.424+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d800dff0 con 0x7f62ec153900 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f259b700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 0x7f62d8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f1d9a700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d8004060 0x7f62d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f2d9c700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8004d50 0x7f62d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f1d9a700 1 -- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 msgr2=0x7f62d8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f1d9a700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 0x7f62d8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f1d9a700 1 -- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8004d50 msgr2=0x7f62d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f1d9a700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8004d50 0x7f62d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f1d9a700 1 -- 172.21.15.86:0/211199957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8003570 con 0x7f62d8004060 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f259b700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62ec153900 0x7f62d8003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.425+0000 7f62f1d9a700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d8004060 0x7f62d8004810 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0018b0 tx=0x7f62dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f100156bb4fffcea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc012420 con 0x7f62d8004060 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc012580 con 0x7f62d8004060 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f1599700 1 -- 172.21.15.86:0/211199957 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc012920 con 0x7f62d8004060 2023-10-09T12:00:24.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f359d700 1 -- 172.21.15.86:0/211199957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d8004060 msgr2=0x7f62d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f359d700 1 --2- 172.21.15.86:0/211199957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d8004060 0x7f62d8004810 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0018b0 tx=0x7f62dc007d30 comp rx=0 tx=0).stop 2023-10-09T12:00:24.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f2d9c700 1 -- 172.21.15.86:0/211199957 reap_dead start 2023-10-09T12:00:24.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f359d700 1 -- 172.21.15.86:0/211199957 shutdown_connections 2023-10-09T12:00:24.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f359d700 1 -- 172.21.15.86:0/211199957 >> 172.21.15.86:0/211199957 conn(0x7f62ec0cc1e0 msgr2=0x7f62ec0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:24.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f359d700 1 -- 172.21.15.86:0/211199957 shutdown_connections 2023-10-09T12:00:24.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.426+0000 7f62f359d700 1 -- 172.21.15.86:0/211199957 wait complete. 2023-10-09T12:00:24.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.428+0000 7f62f359d700 1 Processor -- start 2023-10-09T12:00:24.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.428+0000 7f62f359d700 1 -- start start 2023-10-09T12:00:24.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.428+0000 7f62f359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d8004060 0x7f62ec0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f359d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62ec0ae740 0x7f62ec0ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f359d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ec1508e0 0x7f62ec150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f359d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0ae2b0 con 0x7f62ec1508e0 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f359d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0ad6c0 con 0x7f62ec0ae740 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec166d60 con 0x7f62d8004060 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ec1508e0 0x7f62ec150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ec1508e0 0x7f62ec150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38414/0 (socket says 172.21.15.86:38414) 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 -- 172.21.15.86:0/3771226678 learned_addr learned my addr 172.21.15.86:0/3771226678 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f259b700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d8004060 0x7f62ec0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f1d9a700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62ec0ae740 0x7f62ec0ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 -- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d8004060 msgr2=0x7f62ec0aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d8004060 0x7f62ec0aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 -- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62ec0ae740 msgr2=0x7f62ec0ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62ec0ae740 0x7f62ec0ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 -- 172.21.15.86:0/3771226678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0afa30 con 0x7f62ec1508e0 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.429+0000 7f62f2d9c700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ec1508e0 0x7f62ec150030 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f62ec06b9d0 tx=0x7f62e4002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.430+0000 7f62e27fc700 1 -- 172.21.15.86:0/3771226678 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e400ad60 con 0x7f62ec1508e0 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.430+0000 7f62e27fc700 1 -- 172.21.15.86:0/3771226678 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40133f0 con 0x7f62ec1508e0 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.430+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec0afd10 con 0x7f62ec1508e0 2023-10-09T12:00:24.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.430+0000 7f62e27fc700 1 -- 172.21.15.86:0/3771226678 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40137b0 con 0x7f62ec1508e0 2023-10-09T12:00:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.430+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec150570 con 0x7f62ec1508e0 2023-10-09T12:00:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.431+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec06c450 con 0x7f62ec1508e0 2023-10-09T12:00:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.432+0000 7f62e27fc700 1 -- 172.21.15.86:0/3771226678 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62e4013b60 con 0x7f62ec1508e0 2023-10-09T12:00:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.432+0000 7f62e27fc700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.432+0000 7f62e27fc700 1 -- 172.21.15.86:0/3771226678 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5257+0+0 (secure 0 0 0) 0x7f62e4084e00 con 0x7f62ec1508e0 2023-10-09T12:00:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.433+0000 7f62f259b700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.433+0000 7f62f259b700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62d0066f30 0x7f62d00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f62e8006f00 tx=0x7f62e8008040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.437+0000 7f62e27fc700 1 -- 172.21.15.86:0/3771226678 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62e4052190 con 0x7f62ec1508e0 2023-10-09T12:00:24.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.627+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62ec06dd20 con 0x7f62ec1508e0 2023-10-09T12:00:24.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.627+0000 7f62e27fc700 1 -- 172.21.15.86:0/3771226678 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62e40557b0 con 0x7f62ec1508e0 2023-10-09T12:00:24.628 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T12:00:24.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62d0066f30 msgr2=0x7f62d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62d0066f30 0x7f62d00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f62e8006f00 tx=0x7f62e8008040 comp rx=0 tx=0).stop 2023-10-09T12:00:24.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ec1508e0 msgr2=0x7f62ec150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ec1508e0 0x7f62ec150030 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f62ec06b9d0 tx=0x7f62e4002100 comp rx=0 tx=0).stop 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 shutdown_connections 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ec1508e0 0x7f62ec150030 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62d8004060 0x7f62ec0aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 --2- 172.21.15.86:0/3771226678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62ec0ae740 0x7f62ec0ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 >> 172.21.15.86:0/3771226678 conn(0x7f62ec0cc1e0 msgr2=0x7f62ec0cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 shutdown_connections 2023-10-09T12:00:24.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.630+0000 7f62f359d700 1 -- 172.21.15.86:0/3771226678 wait complete. 2023-10-09T12:00:24.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T12:00:24.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.828+0000 7fe83d7ff700 1 Processor -- start 2023-10-09T12:00:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.829+0000 7fe83d7ff700 1 -- start start 2023-10-09T12:00:24.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe83d7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8380cbf30 0x7fe8380ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe83d7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8380b1420 0x7fe8380c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe83d7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8380cc300 con 0x7fe8380ccf90 2023-10-09T12:00:24.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe83d7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe838156bf0 con 0x7fe8380b1420 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe83d7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8380ae950 con 0x7fe8380cbf30 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe8377fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8380b1420 0x7fe8380c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe8377fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8380b1420 0x7fe8380c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38418/0 (socket says 172.21.15.86:38418) 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe8377fe700 1 -- 172.21.15.86:0/321741022 learned_addr learned my addr 172.21.15.86:0/321741022 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.830+0000 7fe836ffd700 1 --2- 172.21.15.86:0/321741022 >> v2:172.21.15.135:3300/0 conn(0x7fe8380cbf30 0x7fe8380ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8377fe700 1 -- 172.21.15.86:0/321741022 >> v2:172.21.15.135:3300/0 conn(0x7fe8380cbf30 msgr2=0x7fe8380ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8377fe700 1 --2- 172.21.15.86:0/321741022 >> v2:172.21.15.135:3300/0 conn(0x7fe8380cbf30 0x7fe8380ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8377fe700 1 -- 172.21.15.86:0/321741022 >> v1:172.21.15.135:6789/0 conn(0x7fe8380ccf90 legacy=0x7fe8380b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8377fe700 1 -- 172.21.15.86:0/321741022 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380ad370 con 0x7fe8380b1420 2023-10-09T12:00:24.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8377fe700 1 --2- 172.21.15.86:0/321741022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380b1420 0x7fe8380c9740 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe838063d40 tx=0x7fe830009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770f5896c4c6a305 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8367fc700 1 -- 172.21.15.86:0/321741022 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000e070 con 0x7fe8380b1420 2023-10-09T12:00:24.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8367fc700 1 -- 172.21.15.86:0/321741022 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83000b990 con 0x7fe8380b1420 2023-10-09T12:00:24.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe8367fc700 1 -- 172.21.15.86:0/321741022 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8300092e0 con 0x7fe8380b1420 2023-10-09T12:00:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe83d7ff700 1 -- 172.21.15.86:0/321741022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380b1420 msgr2=0x7fe8380c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.831+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/321741022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380b1420 0x7fe8380c9740 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe838063d40 tx=0x7fe830009840 comp rx=0 tx=0).stop 2023-10-09T12:00:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.832+0000 7fe83d7ff700 1 -- 172.21.15.86:0/321741022 shutdown_connections 2023-10-09T12:00:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.832+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/321741022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380b1420 0x7fe8380c9740 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.832+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/321741022 >> v2:172.21.15.135:3300/0 conn(0x7fe8380cbf30 0x7fe8380ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.832+0000 7fe83d7ff700 1 -- 172.21.15.86:0/321741022 >> 172.21.15.86:0/321741022 conn(0x7fe83806a320 msgr2=0x7fe8380cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.832+0000 7fe83d7ff700 1 -- 172.21.15.86:0/321741022 shutdown_connections 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.832+0000 7fe83d7ff700 1 -- 172.21.15.86:0/321741022 wait complete. 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.833+0000 7fe83d7ff700 1 Processor -- start 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.833+0000 7fe83d7ff700 1 -- start start 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe83d7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8380b1420 0x7fe83816a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe83d7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380cbf30 0x7fe838156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe83d7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8380ccf90 0x7fe8380ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe83d7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838157270 con 0x7fe8380cbf30 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe83d7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8381580b0 con 0x7fe8380ccf90 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe83d7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8381574a0 con 0x7fe8380b1420 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe82ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380cbf30 0x7fe838156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe82ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380cbf30 0x7fe838156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38428/0 (socket says 172.21.15.86:38428) 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe82ffff700 1 -- 172.21.15.86:0/2272117890 learned_addr learned my addr 172.21.15.86:0/2272117890 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.834+0000 7fe836ffd700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8380b1420 0x7fe83816a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe8377fe700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8380ccf90 0x7fe8380ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82ffff700 1 -- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8380b1420 msgr2=0x7fe83816a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82ffff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8380b1420 0x7fe83816a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82ffff700 1 -- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8380ccf90 msgr2=0x7fe8380ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82ffff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8380ccf90 0x7fe8380ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82ffff700 1 -- 172.21.15.86:0/2272117890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830009ae0 con 0x7fe8380cbf30 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82ffff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380cbf30 0x7fe838156d30 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe82000c4e0 tx=0x7fe82000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82effd700 1 -- 172.21.15.86:0/2272117890 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820011590 con 0x7fe8380cbf30 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82effd700 1 -- 172.21.15.86:0/2272117890 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820011710 con 0x7fe8380cbf30 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe838157780 con 0x7fe8380cbf30 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe82effd700 1 -- 172.21.15.86:0/2272117890 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820011ad0 con 0x7fe8380cbf30 2023-10-09T12:00:24.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.835+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe838157d40 con 0x7fe8380cbf30 2023-10-09T12:00:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.836+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe838158220 con 0x7fe8380cbf30 2023-10-09T12:00:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.837+0000 7fe82effd700 1 -- 172.21.15.86:0/2272117890 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe82001b3b0 con 0x7fe8380cbf30 2023-10-09T12:00:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.839+0000 7fe82effd700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe818066f30 0x7fe8180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.839+0000 7fe82effd700 1 -- 172.21.15.86:0/2272117890 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5257+0+0 (secure 0 0 0) 0x7fe820083810 con 0x7fe8380cbf30 2023-10-09T12:00:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.839+0000 7fe836ffd700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe818066f30 0x7fe8180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.839+0000 7fe836ffd700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe818066f30 0x7fe8180693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8380c49b0 tx=0x7fe8280091a0 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:24.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:24.843+0000 7fe82effd700 1 -- 172.21.15.86:0/2272117890 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe820050ba0 con 0x7fe8380cbf30 2023-10-09T12:00:25.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.038+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe83804c3c0 con 0x7fe8380cbf30 2023-10-09T12:00:25.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.039+0000 7fe82effd700 1 -- 172.21.15.86:0/2272117890 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe820017020 con 0x7fe8380cbf30 2023-10-09T12:00:25.039 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:25.039 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T12:00:25.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:25.039 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T12:00:25.039 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T12:00:25.039 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:25.040 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T12:00:25.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe818066f30 msgr2=0x7fe8180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:25.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe818066f30 0x7fe8180693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8380c49b0 tx=0x7fe8280091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380cbf30 msgr2=0x7fe838156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380cbf30 0x7fe838156d30 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe82000c4e0 tx=0x7fe82000c7f0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 shutdown_connections 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8380ccf90 0x7fe8380ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8380b1420 0x7fe83816a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe818066f30 0x7fe8180693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 --2- 172.21.15.86:0/2272117890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380cbf30 0x7fe838156d30 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 >> 172.21.15.86:0/2272117890 conn(0x7fe83806a320 msgr2=0x7fe8380cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 shutdown_connections 2023-10-09T12:00:25.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.041+0000 7fe83d7ff700 1 -- 172.21.15.86:0/2272117890 wait complete. 2023-10-09T12:00:25.058 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T12:00:25.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T12:00:25.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.242+0000 7f0eae5ff700 1 Processor -- start 2023-10-09T12:00:25.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.242+0000 7f0eae5ff700 1 -- start start 2023-10-09T12:00:25.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0eae5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ea8157740 0x7f0ea80adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:25.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0eae5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0ea8068aa0 0x7f0ea806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:25.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0eae5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea806dc20 con 0x7f0ea80b2100 2023-10-09T12:00:25.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0eae5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea80acc00 con 0x7f0ea8068aa0 2023-10-09T12:00:25.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0eae5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea806d6a0 con 0x7f0ea8157740 2023-10-09T12:00:25.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0e9ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0ea80b2100 0x7f0ea8068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46224/0 (socket says 172.21.15.86:46224) 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0e9ffff700 1 -- 172.21.15.86:0/956962385 learned_addr learned my addr 172.21.15.86:0/956962385 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0eacb9c700 1 --2- 172.21.15.86:0/956962385 >> v2:172.21.15.86:3300/0 conn(0x7f0ea8068aa0 0x7f0ea806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0ea7fff700 1 --2- 172.21.15.86:0/956962385 >> v2:172.21.15.135:3300/0 conn(0x7f0ea8157740 0x7f0ea80adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0ea77fe700 1 -- 172.21.15.86:0/956962385 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378118156 0 0) 0x7f0ea806dc20 con 0x7f0ea80b2100 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.244+0000 7f0ea77fe700 1 -- 172.21.15.86:0/956962385 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e94003570 con 0x7f0ea80b2100 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0eacb9c700 1 -- 172.21.15.86:0/956962385 >> v2:172.21.15.135:3300/0 conn(0x7f0ea8157740 msgr2=0x7f0ea80adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0eacb9c700 1 --2- 172.21.15.86:0/956962385 >> v2:172.21.15.135:3300/0 conn(0x7f0ea8157740 0x7f0ea80adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0eacb9c700 1 -- 172.21.15.86:0/956962385 >> v1:172.21.15.86:6789/0 conn(0x7f0ea80b2100 legacy=0x7f0ea8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0eacb9c700 1 -- 172.21.15.86:0/956962385 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80ae910 con 0x7f0ea8068aa0 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0ea7fff700 1 --2- 172.21.15.86:0/956962385 >> v2:172.21.15.135:3300/0 conn(0x7f0ea8157740 0x7f0ea80adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:25.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0eacb9c700 1 --2- 172.21.15.86:0/956962385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea8068aa0 0x7f0ea806e0b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80abfa0 tx=0x7f0ea0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c929fbd2a202e12e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0ea77fe700 1 -- 172.21.15.86:0/956962385 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000e070 con 0x7f0ea8068aa0 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0ea77fe700 1 -- 172.21.15.86:0/956962385 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000bb60 con 0x7f0ea8068aa0 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.245+0000 7f0ea77fe700 1 -- 172.21.15.86:0/956962385 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0012430 con 0x7f0ea8068aa0 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 -- 172.21.15.86:0/956962385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea8068aa0 msgr2=0x7f0ea806e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/956962385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea8068aa0 0x7f0ea806e0b0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80abfa0 tx=0x7f0ea0009780 comp rx=0 tx=0).stop 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 -- 172.21.15.86:0/956962385 shutdown_connections 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/956962385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea8068aa0 0x7f0ea806e0b0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/956962385 >> v2:172.21.15.135:3300/0 conn(0x7f0ea8157740 0x7f0ea80adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 -- 172.21.15.86:0/956962385 >> 172.21.15.86:0/956962385 conn(0x7f0ea80c8f90 msgr2=0x7f0ea80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 -- 172.21.15.86:0/956962385 shutdown_connections 2023-10-09T12:00:25.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.246+0000 7f0eae5ff700 1 -- 172.21.15.86:0/956962385 wait complete. 2023-10-09T12:00:25.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.247+0000 7f0eae5ff700 1 Processor -- start 2023-10-09T12:00:25.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.247+0000 7f0eae5ff700 1 -- start start 2023-10-09T12:00:25.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0eae5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ea8068aa0 0x7f0ea8155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:25.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0eae5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea80b2100 0x7f0ea80c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0eae5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ea8157740 0x7f0ea80c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0eae5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80c41d0 con 0x7f0ea80b2100 2023-10-09T12:00:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0eae5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80c65f0 con 0x7f0ea8157740 2023-10-09T12:00:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0eae5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80c68d0 con 0x7f0ea8068aa0 2023-10-09T12:00:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea80b2100 0x7f0ea80c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea80b2100 0x7f0ea80c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56724/0 (socket says 172.21.15.86:56724) 2023-10-09T12:00:25.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.248+0000 7f0e9ffff700 1 -- 172.21.15.86:0/4106788896 learned_addr learned my addr 172.21.15.86:0/4106788896 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0ea7fff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ea8068aa0 0x7f0ea8155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0eacb9c700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ea8157740 0x7f0ea80c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0e9ffff700 1 -- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ea8068aa0 msgr2=0x7f0ea8155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0e9ffff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ea8068aa0 0x7f0ea8155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0e9ffff700 1 -- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ea8157740 msgr2=0x7f0ea80c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0e9ffff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ea8157740 0x7f0ea80c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0e9ffff700 1 -- 172.21.15.86:0/4106788896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009a20 con 0x7f0ea80b2100 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0e9ffff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea80b2100 0x7f0ea80c7690 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c7c0 tx=0x7f0e90007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:25.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0ea4ff9700 1 -- 172.21.15.86:0/4106788896 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90005b30 con 0x7f0ea80b2100 2023-10-09T12:00:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0ea4ff9700 1 -- 172.21.15.86:0/4106788896 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90005c90 con 0x7f0ea80b2100 2023-10-09T12:00:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea80c6bb0 con 0x7f0ea80b2100 2023-10-09T12:00:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0ea4ff9700 1 -- 172.21.15.86:0/4106788896 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90007340 con 0x7f0ea80b2100 2023-10-09T12:00:25.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.249+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea80c7170 con 0x7f0ea80b2100 2023-10-09T12:00:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.250+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea80c7360 con 0x7f0ea80b2100 2023-10-09T12:00:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.251+0000 7f0ea4ff9700 1 -- 172.21.15.86:0/4106788896 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e9001b400 con 0x7f0ea80b2100 2023-10-09T12:00:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.252+0000 7f0ea4ff9700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.253+0000 7f0ea4ff9700 1 -- 172.21.15.86:0/4106788896 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5257+0+0 (secure 0 0 0) 0x7f0e90083f20 con 0x7f0ea80b2100 2023-10-09T12:00:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.253+0000 7f0ea7fff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:25.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.253+0000 7f0ea7fff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e88066f30 0x7f0e880693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e98006f00 tx=0x7f0e98008040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:25.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.256+0000 7f0ea4ff9700 1 -- 172.21.15.86:0/4106788896 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e90051330 con 0x7f0ea80b2100 2023-10-09T12:00:25.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:25.450+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0ea80718b0 con 0x7f0ea80b2100 2023-10-09T12:00:26.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.356+0000 7f0ea4ff9700 1 -- 172.21.15.86:0/4106788896 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v136) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0e90054950 con 0x7f0ea80b2100 2023-10-09T12:00:26.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e88066f30 msgr2=0x7f0e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:26.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e88066f30 0x7f0e880693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e98006f00 tx=0x7f0e98008040 comp rx=0 tx=0).stop 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea80b2100 msgr2=0x7f0ea80c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea80b2100 0x7f0ea80c7690 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c7c0 tx=0x7f0e90007e00 comp rx=0 tx=0).stop 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 shutdown_connections 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ea8157740 0x7f0ea80c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ea8068aa0 0x7f0ea8155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e88066f30 0x7f0e880693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 --2- 172.21.15.86:0/4106788896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ea80b2100 0x7f0ea80c7690 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.361+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 >> 172.21.15.86:0/4106788896 conn(0x7f0ea80c8f90 msgr2=0x7f0ea8156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:26.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.364+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 shutdown_connections 2023-10-09T12:00:26.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.365+0000 7f0eae5ff700 1 -- 172.21.15.86:0/4106788896 wait complete. 2023-10-09T12:00:26.368 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T12:00:26.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T12:00:26.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.577+0000 7fd01359e700 1 Processor -- start 2023-10-09T12:00:26.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.577+0000 7fd01359e700 1 -- start start 2023-10-09T12:00:26.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.578+0000 7fd01359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd01415ec50 0x7fd014161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.578+0000 7fd01359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01406e510 con 0x7fd0140cc930 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.578+0000 7fd01359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01406df20 con 0x7fd0140ccd00 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.578+0000 7fd01359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0140c7220 con 0x7fd01415ec50 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.578+0000 7fd01259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd0140cc930 0x7fd0140c7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46230/0 (socket says 172.21.15.86:46230) 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.578+0000 7fd01259c700 1 -- 172.21.15.86:0/801433916 learned_addr learned my addr 172.21.15.86:0/801433916 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.578+0000 7fd012d9d700 1 --2- 172.21.15.86:0/801433916 >> v2:172.21.15.135:3300/0 conn(0x7fd01415ec50 0x7fd014161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351482831 0 0) 0x7fd01406e510 con 0x7fd0140cc930 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcffc003570 con 0x7fd0140cc930 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044070334 0 0) 0x7fcffc003570 con 0x7fd0140cc930 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 >> v2:172.21.15.135:3300/0 conn(0x7fd01415ec50 msgr2=0x7fd014161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:26.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 --2- 172.21.15.86:0/801433916 >> v2:172.21.15.135:3300/0 conn(0x7fd01415ec50 0x7fd014161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 >> v1:172.21.15.135:6789/0 conn(0x7fd0140ccd00 legacy=0x7fd014155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140c7f50 con 0x7fd0140cc930 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fd004001470 con 0x7fd0140cc930 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 >> v1:172.21.15.86:6789/0 conn(0x7fd0140cc930 legacy=0x7fd0140c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc003a60 0x7fcffc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004810 0x7fcffc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fcffc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140c7220 con 0x7fcffc0051c0 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc00c0d0 con 0x7fcffc004810 2023-10-09T12:00:26.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc00c290 con 0x7fcffc003a60 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.579+0000 7fd012d9d700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fcffc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd01259c700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc003a60 0x7fcffc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd011d9b700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004810 0x7fcffc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd012d9d700 1 -- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc003a60 msgr2=0x7fcffc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd012d9d700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcffc003a60 0x7fcffc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd012d9d700 1 -- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004810 msgr2=0x7fcffc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd012d9d700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcffc004810 0x7fcffc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd012d9d700 1 -- 172.21.15.86:0/801433916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc003570 con 0x7fcffc0051c0 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd012d9d700 1 -- 172.21.15.86:0/801433916 reap_dead start 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd012d9d700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fcffc00ba60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fd0140ab850 tx=0x7fd00c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba78b59aabd59c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:26.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00ea90 con 0x7fcffc0051c0 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c00f040 con 0x7fcffc0051c0 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.580+0000 7fd01159a700 1 -- 172.21.15.86:0/801433916 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00ee40 con 0x7fcffc0051c0 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.581+0000 7fd01359e700 1 -- 172.21.15.86:0/801433916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 msgr2=0x7fcffc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.581+0000 7fd01359e700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fcffc00ba60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fd0140ab850 tx=0x7fd00c00b040 comp rx=0 tx=0).stop 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.581+0000 7fd01359e700 1 -- 172.21.15.86:0/801433916 shutdown_connections 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.581+0000 7fd01359e700 1 --2- 172.21.15.86:0/801433916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fcffc00ba60 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.581+0000 7fd01359e700 1 -- 172.21.15.86:0/801433916 >> 172.21.15.86:0/801433916 conn(0x7fd014068e20 msgr2=0x7fd0140cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.581+0000 7fd01359e700 1 -- 172.21.15.86:0/801433916 shutdown_connections 2023-10-09T12:00:26.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.581+0000 7fd01359e700 1 -- 172.21.15.86:0/801433916 wait complete. 2023-10-09T12:00:26.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.582+0000 7fd01359e700 1 Processor -- start 2023-10-09T12:00:26.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.583+0000 7fd01359e700 1 -- start start 2023-10-09T12:00:26.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.583+0000 7fd01359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fd01416d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.583+0000 7fd01359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd01416a610 0x7fd01414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.583+0000 7fd01359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd01416ad00 0x7fd0140c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.583+0000 7fd01359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140c4750 con 0x7fcffc0051c0 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.583+0000 7fd01359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01414f2b0 con 0x7fd01416ad00 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.583+0000 7fd01359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01416aa80 con 0x7fd01416a610 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fd01416d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fd01416d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56740/0 (socket says 172.21.15.86:56740) 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 -- 172.21.15.86:0/2293650225 learned_addr learned my addr 172.21.15.86:0/2293650225 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd012d9d700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd01416ad00 0x7fd0140c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd011d9b700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd01416a610 0x7fd01414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 -- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd01416a610 msgr2=0x7fd01414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd01416a610 0x7fd01414ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 -- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd01416ad00 msgr2=0x7fd0140c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:26.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd01416ad00 0x7fd0140c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 -- 172.21.15.86:0/2293650225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01416d860 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01259c700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fd01416d1f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd004007390 tx=0x7fd004001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd0027fc700 1 -- 172.21.15.86:0/2293650225 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004018030 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd0027fc700 1 -- 172.21.15.86:0/2293650225 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00400f8d0 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd0027fc700 1 -- 172.21.15.86:0/2293650225 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400fc70 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.584+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01416db40 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.585+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01416b180 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.585+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01404c3c0 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.586+0000 7fd0027fc700 1 -- 172.21.15.86:0/2293650225 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd00401b070 con 0x7fcffc0051c0 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.587+0000 7fd0027fc700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcff4066f30 0x7fcff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:26.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.587+0000 7fd0027fc700 1 -- 172.21.15.86:0/2293650225 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5627+0+0 (secure 0 0 0) 0x7fd004019070 con 0x7fcffc0051c0 2023-10-09T12:00:26.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.588+0000 7fd011d9b700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcff4066f30 0x7fcff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:26.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.588+0000 7fd011d9b700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcff4066f30 0x7fcff40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd008000f60 tx=0x7fd008009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:26.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.592+0000 7fd0027fc700 1 -- 172.21.15.86:0/2293650225 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd004051640 con 0x7fcffc0051c0 2023-10-09T12:00:26.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:26.781+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd01414f4b0 con 0x7fcffc0051c0 2023-10-09T12:00:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.359+0000 7fd0027fc700 1 -- 172.21.15.86:0/2293650225 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v137) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd004054c60 con 0x7fcffc0051c0 2023-10-09T12:00:27.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.365+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcff4066f30 msgr2=0x7fcff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:27.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.365+0000 7fd01359e700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcff4066f30 0x7fcff40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd008000f60 tx=0x7fd008009040 comp rx=0 tx=0).stop 2023-10-09T12:00:27.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.365+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 msgr2=0x7fd01416d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:27.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.365+0000 7fd01359e700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fd01416d1f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd004007390 tx=0x7fd004001e50 comp rx=0 tx=0).stop 2023-10-09T12:00:27.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.370+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 shutdown_connections 2023-10-09T12:00:27.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.370+0000 7fd01359e700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcff4066f30 0x7fcff40693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.370+0000 7fd01359e700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcffc0051c0 0x7fd01416d1f0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.370+0000 7fd01359e700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd01416ad00 0x7fd0140c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.370+0000 7fd01359e700 1 --2- 172.21.15.86:0/2293650225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd01416a610 0x7fd01414ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.370+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 >> 172.21.15.86:0/2293650225 conn(0x7fd014068e20 msgr2=0x7fd0140c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:27.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.371+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 shutdown_connections 2023-10-09T12:00:27.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.371+0000 7fd01359e700 1 -- 172.21.15.86:0/2293650225 wait complete. 2023-10-09T12:00:27.383 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T12:00:27.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T12:00:27.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.582+0000 7fa3549ff700 1 Processor -- start 2023-10-09T12:00:27.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.582+0000 7fa3549ff700 1 -- start start 2023-10-09T12:00:27.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.583+0000 7fa3549ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa35006bcd0 0x7fa3500caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.583+0000 7fa3549ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35015d7e0 con 0x7fa35015df50 2023-10-09T12:00:27.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.583+0000 7fa3549ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35015dac0 con 0x7fa35006c0a0 2023-10-09T12:00:27.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.583+0000 7fa3549ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35015aa30 con 0x7fa35006bcd0 2023-10-09T12:00:27.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.583+0000 7fa34ed9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa35015df50 0x7fa3500c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46244/0 (socket says 172.21.15.86:46244) 2023-10-09T12:00:27.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.583+0000 7fa34ed9d700 1 -- 172.21.15.86:0/1043591762 learned_addr learned my addr 172.21.15.86:0/1043591762 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34e59c700 1 --2- 172.21.15.86:0/1043591762 >> v2:172.21.15.135:3300/0 conn(0x7fa35006bcd0 0x7fa3500caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037546186 0 0) 0x7fa35015d7e0 con 0x7fa35015df50 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa338003570 con 0x7fa35015df50 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1241999108 0 0) 0x7fa338003570 con 0x7fa35015df50 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 >> v2:172.21.15.135:3300/0 conn(0x7fa35006bcd0 msgr2=0x7fa3500caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 --2- 172.21.15.86:0/1043591762 >> v2:172.21.15.135:3300/0 conn(0x7fa35006bcd0 0x7fa3500caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 >> v1:172.21.15.135:6789/0 conn(0x7fa35006c0a0 legacy=0x7fa35015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35015ad10 con 0x7fa35015df50 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa3480017f0 con 0x7fa35015df50 2023-10-09T12:00:27.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 >> v1:172.21.15.86:6789/0 conn(0x7fa35015df50 legacy=0x7fa3500c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa338003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa338004810 0x7fa338004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3380052e0 0x7fa33800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35015aa30 con 0x7fa338003a60 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33800c2a0 con 0x7fa3380052e0 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.584+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33800c460 con 0x7fa338004810 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34e59c700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa338003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34dd9b700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa338004810 0x7fa338004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34ed9d700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3380052e0 0x7fa33800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34e59c700 1 -- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa338004810 msgr2=0x7fa338004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34e59c700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa338004810 0x7fa338004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34e59c700 1 -- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3380052e0 msgr2=0x7fa33800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34e59c700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3380052e0 0x7fa33800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34e59c700 1 -- 172.21.15.86:0/1043591762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338003570 con 0x7fa338003a60 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34ed9d700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3380052e0 0x7fa33800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34dd9b700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa338004810 0x7fa338004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34ed9d700 1 -- 172.21.15.86:0/1043591762 reap_dead start 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34e59c700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa338003e70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa340009c00 tx=0x7fa3400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f610a6dda6376310 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000e710 con 0x7fa338003a60 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.585+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34000e870 con 0x7fa338003a60 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa34d59a700 1 -- 172.21.15.86:0/1043591762 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000ec30 con 0x7fa338003a60 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa3549ff700 1 -- 172.21.15.86:0/1043591762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 msgr2=0x7fa338003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:27.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa3549ff700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa338003e70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fa340009c00 tx=0x7fa3400091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa3549ff700 1 -- 172.21.15.86:0/1043591762 shutdown_connections 2023-10-09T12:00:27.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa3549ff700 1 --2- 172.21.15.86:0/1043591762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa338003e70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa3549ff700 1 -- 172.21.15.86:0/1043591762 >> 172.21.15.86:0/1043591762 conn(0x7fa3500ce600 msgr2=0x7fa3500cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:27.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa3549ff700 1 -- 172.21.15.86:0/1043591762 shutdown_connections 2023-10-09T12:00:27.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.586+0000 7fa3549ff700 1 -- 172.21.15.86:0/1043591762 wait complete. 2023-10-09T12:00:27.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.588+0000 7fa3549ff700 1 Processor -- start 2023-10-09T12:00:27.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.588+0000 7fa3549ff700 1 -- start start 2023-10-09T12:00:27.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.588+0000 7fa3549ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa35016df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.588+0000 7fa3549ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3500c8370 0x7fa3500c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa3549ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3500696d0 0x7fa350149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa3549ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500c72d0 con 0x7fa338003a60 2023-10-09T12:00:27.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa3549ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500c75b0 con 0x7fa3500c8370 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa3549ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3500c7890 con 0x7fa3500696d0 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa35016df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa35016df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56754/0 (socket says 172.21.15.86:56754) 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 -- 172.21.15.86:0/546392626 learned_addr learned my addr 172.21.15.86:0/546392626 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 -- 172.21.15.86:0/546392626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3500696d0 msgr2=0x7fa350149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3500696d0 0x7fa350149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 -- 172.21.15.86:0/546392626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3500c8370 msgr2=0x7fa3500c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3500c8370 0x7fa3500c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 -- 172.21.15.86:0/546392626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3500c7b70 con 0x7fa338003a60 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa34e59c700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa35016df00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa33800c270 tx=0x7fa34001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:27.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.589+0000 7fa33e7fc700 1 -- 172.21.15.86:0/546392626 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340022070 con 0x7fa338003a60 2023-10-09T12:00:27.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.590+0000 7fa33e7fc700 1 -- 172.21.15.86:0/546392626 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34000e9e0 con 0x7fa338003a60 2023-10-09T12:00:27.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.590+0000 7fa33e7fc700 1 -- 172.21.15.86:0/546392626 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400276a0 con 0x7fa338003a60 2023-10-09T12:00:27.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.590+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3500c7e50 con 0x7fa338003a60 2023-10-09T12:00:27.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.590+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3500c5bf0 con 0x7fa338003a60 2023-10-09T12:00:27.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.591+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3500c81c0 con 0x7fa338003a60 2023-10-09T12:00:27.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.592+0000 7fa33e7fc700 1 -- 172.21.15.86:0/546392626 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa34001c450 con 0x7fa338003a60 2023-10-09T12:00:27.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.592+0000 7fa33e7fc700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa330066f30 0x7fa3300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:27.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.593+0000 7fa33e7fc700 1 -- 172.21.15.86:0/546392626 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6009+0+0 (secure 0 0 0) 0x7fa3400862d0 con 0x7fa338003a60 2023-10-09T12:00:27.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.593+0000 7fa34dd9b700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa330066f30 0x7fa3300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:27.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.593+0000 7fa34dd9b700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa330066f30 0x7fa3300693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa344000f60 tx=0x7fa344009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:27.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.597+0000 7fa33e7fc700 1 -- 172.21.15.86:0/546392626 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3400533b0 con 0x7fa338003a60 2023-10-09T12:00:27.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:27.830+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa3500c72d0 con 0x7fa338003a60 2023-10-09T12:00:28.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.389+0000 7fa33e7fc700 1 -- 172.21.15.86:0/546392626 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa340056990 con 0x7fa338003a60 2023-10-09T12:00:28.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa330066f30 msgr2=0x7fa3300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa330066f30 0x7fa3300693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa344000f60 tx=0x7fa344009040 comp rx=0 tx=0).stop 2023-10-09T12:00:28.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 msgr2=0x7fa35016df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa35016df00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa33800c270 tx=0x7fa34001a000 comp rx=0 tx=0).stop 2023-10-09T12:00:28.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 shutdown_connections 2023-10-09T12:00:28.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa330066f30 0x7fa3300693e0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa344000f60 tx=0x7fa344009040 comp rx=0 tx=0).stop 2023-10-09T12:00:28.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa338003a60 0x7fa35016df00 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3500696d0 0x7fa350149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 --2- 172.21.15.86:0/546392626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3500c8370 0x7fa3500c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.395+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 >> 172.21.15.86:0/546392626 conn(0x7fa3500ce600 msgr2=0x7fa35015caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:28.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.399+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 shutdown_connections 2023-10-09T12:00:28.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.399+0000 7fa3549ff700 1 -- 172.21.15.86:0/546392626 wait complete. 2023-10-09T12:00:28.402 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 16 and data pool 17 2023-10-09T12:00:28.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:00:28.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.608+0000 7f189979d700 1 Processor -- start 2023-10-09T12:00:28.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.608+0000 7f189979d700 1 -- start start 2023-10-09T12:00:28.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f189979d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1894156310 0x7f18940c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f189979d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18940ca860 con 0x7f18941566e0 2023-10-09T12:00:28.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f189979d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18940cab40 con 0x7f18940ae710 2023-10-09T12:00:28.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f189979d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940cae20 con 0x7f1894156310 2023-10-09T12:00:28.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f188bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f18941566e0 0x7f18940ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46250/0 (socket says 172.21.15.86:46250) 2023-10-09T12:00:28.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f188bfff700 1 -- 172.21.15.86:0/1325460877 learned_addr learned my addr 172.21.15.86:0/1325460877 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:28.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246427859 0 0) 0x7f18940ca860 con 0x7f18941566e0 2023-10-09T12:00:28.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f1893fff700 1 --2- 172.21.15.86:0/1325460877 >> v2:172.21.15.135:3300/0 conn(0x7f1894156310 0x7f18940c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.610+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1880003570 con 0x7f18941566e0 2023-10-09T12:00:28.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138746891 0 0) 0x7f1880003570 con 0x7f18941566e0 2023-10-09T12:00:28.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 >> v2:172.21.15.135:3300/0 conn(0x7f1894156310 msgr2=0x7f18940c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:28.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 --2- 172.21.15.86:0/1325460877 >> v2:172.21.15.135:3300/0 conn(0x7f1894156310 0x7f18940c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 >> v1:172.21.15.135:6789/0 conn(0x7f18940ae710 legacy=0x7f18940c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940cb100 con 0x7f18941566e0 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f187c001470 con 0x7f18941566e0 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 >> v1:172.21.15.86:6789/0 conn(0x7f18941566e0 legacy=0x7f18940ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880003ab0 0x7f1880003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1880004810 0x7f1880004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1880005210 0x7f188000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18940cae20 con 0x7f1880005210 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188000e340 con 0x7f1880003ab0 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188000e500 con 0x7f1880004810 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f1898f9c700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1880005210 0x7f188000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f188bfff700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1880004810 0x7f1880004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.611+0000 7f1893fff700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880003ab0 0x7f1880003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f1898f9c700 1 -- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1880004810 msgr2=0x7f1880004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f1898f9c700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1880004810 0x7f1880004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f1898f9c700 1 -- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880003ab0 msgr2=0x7f1880003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f1898f9c700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880003ab0 0x7f1880003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f1898f9c700 1 -- 172.21.15.86:0/1325460877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880003570 con 0x7f1880005210 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f1898f9c700 1 -- 172.21.15.86:0/1325460877 reap_dead start 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f1898f9c700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1880005210 0x7f188000dc70 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f188c001f90 tx=0x7f188c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d49606443a7070 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c001950 con 0x7f1880005210 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00c8b0 con 0x7f1880005210 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.612+0000 7f18937fe700 1 -- 172.21.15.86:0/1325460877 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00cc50 con 0x7f1880005210 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.613+0000 7f189979d700 1 -- 172.21.15.86:0/1325460877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1880005210 msgr2=0x7f188000dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.613+0000 7f189979d700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1880005210 0x7f188000dc70 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f188c001f90 tx=0x7f188c001640 comp rx=0 tx=0).stop 2023-10-09T12:00:28.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.613+0000 7f189979d700 1 -- 172.21.15.86:0/1325460877 shutdown_connections 2023-10-09T12:00:28.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.613+0000 7f189979d700 1 --2- 172.21.15.86:0/1325460877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1880005210 0x7f188000dc70 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.613+0000 7f189979d700 1 -- 172.21.15.86:0/1325460877 >> 172.21.15.86:0/1325460877 conn(0x7f18940cc1f0 msgr2=0x7f18940cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:28.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.613+0000 7f189979d700 1 -- 172.21.15.86:0/1325460877 shutdown_connections 2023-10-09T12:00:28.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.613+0000 7f189979d700 1 -- 172.21.15.86:0/1325460877 wait complete. 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.614+0000 7f189979d700 1 Processor -- start 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.614+0000 7f189979d700 1 -- start start 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f189979d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880005210 0x7f189413d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f189979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1894169ec0 0x7f189416a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f189979d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1894154030 0x7f1894154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f189979d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189416b050 con 0x7f1894154030 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f189979d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189416b8f0 con 0x7f1880005210 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f189979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189416a870 con 0x7f1894169ec0 2023-10-09T12:00:28.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f1898f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1894154030 0x7f1894154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f1898f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1894154030 0x7f1894154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56772/0 (socket says 172.21.15.86:56772) 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.615+0000 7f1898f9c700 1 -- 172.21.15.86:0/1001678909 learned_addr learned my addr 172.21.15.86:0/1001678909 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f188bfff700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1894169ec0 0x7f189416a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1893fff700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880005210 0x7f189413d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1898f9c700 1 -- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1894169ec0 msgr2=0x7f189416a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1898f9c700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1894169ec0 0x7f189416a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1898f9c700 1 -- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880005210 msgr2=0x7f189413d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1898f9c700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880005210 0x7f189413d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1898f9c700 1 -- 172.21.15.86:0/1001678909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894154d90 con 0x7f1894154030 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1893fff700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880005210 0x7f189413d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1898f9c700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1894154030 0x7f1894154480 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f189406d580 tx=0x7f188c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:28.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1890ff9700 1 -- 172.21.15.86:0/1001678909 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00c6d0 con 0x7f1894154030 2023-10-09T12:00:28.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1890ff9700 1 -- 172.21.15.86:0/1001678909 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00cc30 con 0x7f1894154030 2023-10-09T12:00:28.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f1890ff9700 1 -- 172.21.15.86:0/1001678909 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c01e640 con 0x7f1894154030 2023-10-09T12:00:28.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189416b2a0 con 0x7f1894154030 2023-10-09T12:00:28.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.616+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18941549c0 con 0x7f1894154030 2023-10-09T12:00:28.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.617+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189416ba60 con 0x7f1894154030 2023-10-09T12:00:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.618+0000 7f1890ff9700 1 -- 172.21.15.86:0/1001678909 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f188c01ea70 con 0x7f1894154030 2023-10-09T12:00:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.619+0000 7f1890ff9700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1874066f30 0x7f18740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.619+0000 7f1890ff9700 1 -- 172.21.15.86:0/1001678909 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f188c086070 con 0x7f1894154030 2023-10-09T12:00:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.619+0000 7f1893fff700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1874066f30 0x7f18740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:28.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.620+0000 7f1893fff700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1874066f30 0x7f18740693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1884006f00 tx=0x7f1884008040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:28.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.623+0000 7f1890ff9700 1 -- 172.21.15.86:0/1001678909 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f188c0530b0 con 0x7f1894154030 2023-10-09T12:00:28.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.816+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f189404c3c0 con 0x7f1894154030 2023-10-09T12:00:28.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.817+0000 7f1890ff9700 1 -- 172.21.15.86:0/1001678909 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16040 (secure 0 0 0) 0x7f188c017030 con 0x7f1894154030 2023-10-09T12:00:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:28.818 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":138,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:00:27.831349+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:00:25.489470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T12:00:26.820007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:00:28.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1874066f30 msgr2=0x7f18740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1874066f30 0x7f18740693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1884006f00 tx=0x7f1884008040 comp rx=0 tx=0).stop 2023-10-09T12:00:28.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1894154030 msgr2=0x7f1894154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:28.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1894154030 0x7f1894154480 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f189406d580 tx=0x7f188c015000 comp rx=0 tx=0).stop 2023-10-09T12:00:28.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 shutdown_connections 2023-10-09T12:00:28.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1874066f30 0x7f18740693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1894154030 0x7f1894154480 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1880005210 0x7f189413d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 --2- 172.21.15.86:0/1001678909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1894169ec0 0x7f189416a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:28.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.819+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 >> 172.21.15.86:0/1001678909 conn(0x7f18940cc1f0 msgr2=0x7f18940c2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:28.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.820+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 shutdown_connections 2023-10-09T12:00:28.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:28.820+0000 7f189979d700 1 -- 172.21.15.86:0/1001678909 wait complete. 2023-10-09T12:00:28.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:00:29.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.018+0000 7fde6abff700 1 Processor -- start 2023-10-09T12:00:29.018 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.018+0000 7fde6abff700 1 -- start start 2023-10-09T12:00:29.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.019+0000 7fde6abff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde64155c10 0x7fde64155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6abff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac6d0 0x7fde640b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6abff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde640acac0 con 0x7fde640ac230 2023-10-09T12:00:29.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6abff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640ad930 con 0x7fde64155c10 2023-10-09T12:00:29.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6abff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640acd20 con 0x7fde640ac6d0 2023-10-09T12:00:29.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6919c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac6d0 0x7fde640b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6899b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde64155c10 0x7fde64155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6899b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde64155c10 0x7fde64155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:50808/0 (socket says 172.21.15.86:50808) 2023-10-09T12:00:29.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6899b700 1 -- 172.21.15.86:0/1005678246 learned_addr learned my addr 172.21.15.86:0/1005678246 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:29.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.020+0000 7fde6919c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac6d0 0x7fde640b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:47336/0 (socket says 172.21.15.86:47336) 2023-10-09T12:00:29.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.021+0000 7fde6919c700 1 -- 172.21.15.86:0/1005678246 >> v2:172.21.15.135:3300/0 conn(0x7fde64155c10 msgr2=0x7fde64155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:29.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.021+0000 7fde6919c700 1 --2- 172.21.15.86:0/1005678246 >> v2:172.21.15.135:3300/0 conn(0x7fde64155c10 0x7fde64155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.021+0000 7fde6919c700 1 -- 172.21.15.86:0/1005678246 >> v1:172.21.15.135:6789/0 conn(0x7fde640ac230 legacy=0x7fde641568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.021+0000 7fde6919c700 1 -- 172.21.15.86:0/1005678246 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640ad000 con 0x7fde640ac6d0 2023-10-09T12:00:29.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.021+0000 7fde6899b700 1 --2- 172.21.15.86:0/1005678246 >> v2:172.21.15.135:3300/0 conn(0x7fde64155c10 0x7fde64155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:29.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.021+0000 7fde6919c700 1 --2- 172.21.15.86:0/1005678246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac6d0 0x7fde640b0300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fde640acc50 tx=0x7fde5c00b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d327893d44ab8d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.021+0000 7fde637fe700 1 -- 172.21.15.86:0/1005678246 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c010070 con 0x7fde640ac6d0 2023-10-09T12:00:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde637fe700 1 -- 172.21.15.86:0/1005678246 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c00db00 con 0x7fde640ac6d0 2023-10-09T12:00:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde637fe700 1 -- 172.21.15.86:0/1005678246 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c016440 con 0x7fde640ac6d0 2023-10-09T12:00:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 -- 172.21.15.86:0/1005678246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac6d0 msgr2=0x7fde640b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 --2- 172.21.15.86:0/1005678246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac6d0 0x7fde640b0300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fde640acc50 tx=0x7fde5c00b990 comp rx=0 tx=0).stop 2023-10-09T12:00:29.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 -- 172.21.15.86:0/1005678246 shutdown_connections 2023-10-09T12:00:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 --2- 172.21.15.86:0/1005678246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac6d0 0x7fde640b0300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 --2- 172.21.15.86:0/1005678246 >> v2:172.21.15.135:3300/0 conn(0x7fde64155c10 0x7fde64155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 -- 172.21.15.86:0/1005678246 >> 172.21.15.86:0/1005678246 conn(0x7fde6406a320 msgr2=0x7fde640cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 -- 172.21.15.86:0/1005678246 shutdown_connections 2023-10-09T12:00:29.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.022+0000 7fde6abff700 1 -- 172.21.15.86:0/1005678246 wait complete. 2023-10-09T12:00:29.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.024+0000 7fde6abff700 1 Processor -- start 2023-10-09T12:00:29.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.024+0000 7fde6abff700 1 -- start start 2023-10-09T12:00:29.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6abff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac230 0x7fde640c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6abff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde640ac6d0 0x7fde640a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6abff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde64155c10 0x7fde640a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6abff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640a6950 con 0x7fde64155c10 2023-10-09T12:00:29.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6abff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640a8130 con 0x7fde640ac6d0 2023-10-09T12:00:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6abff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640a6b90 con 0x7fde640ac230 2023-10-09T12:00:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde64155c10 0x7fde640a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde64155c10 0x7fde640a6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56788/0 (socket says 172.21.15.86:56788) 2023-10-09T12:00:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 -- 172.21.15.86:0/2981125208 learned_addr learned my addr 172.21.15.86:0/2981125208 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6899b700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac230 0x7fde640c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde63fff700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde640ac6d0 0x7fde640a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 -- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac230 msgr2=0x7fde640c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac230 0x7fde640c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 -- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde640ac6d0 msgr2=0x7fde640a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde640ac6d0 0x7fde640a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.025+0000 7fde6919c700 1 -- 172.21.15.86:0/2981125208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580094f0 con 0x7fde64155c10 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.026+0000 7fde6919c700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde64155c10 0x7fde640a6410 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00bc00 tx=0x7fde5c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.026+0000 7fde60ff9700 1 -- 172.21.15.86:0/2981125208 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c020620 con 0x7fde64155c10 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.026+0000 7fde60ff9700 1 -- 172.21.15.86:0/2981125208 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c0207a0 con 0x7fde64155c10 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.026+0000 7fde60ff9700 1 -- 172.21.15.86:0/2981125208 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c020b60 con 0x7fde64155c10 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.026+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c00bc30 con 0x7fde64155c10 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.026+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde640a7ae0 con 0x7fde64155c10 2023-10-09T12:00:29.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.027+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6404c3c0 con 0x7fde64155c10 2023-10-09T12:00:29.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.028+0000 7fde60ff9700 1 -- 172.21.15.86:0/2981125208 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde5c01d050 con 0x7fde64155c10 2023-10-09T12:00:29.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.029+0000 7fde60ff9700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.029+0000 7fde60ff9700 1 -- 172.21.15.86:0/2981125208 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fde5c088530 con 0x7fde64155c10 2023-10-09T12:00:29.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.029+0000 7fde6899b700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.030+0000 7fde6899b700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde640c1db0 tx=0x7fde58009250 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:29.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.033+0000 7fde60ff9700 1 -- 172.21.15.86:0/2981125208 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde5c055570 con 0x7fde64155c10 2023-10-09T12:00:29.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.224+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde640ad2e0 con 0x7fde64155c10 2023-10-09T12:00:29.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.225+0000 7fde60ff9700 1 -- 172.21.15.86:0/2981125208 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16040 (secure 0 0 0) 0x7fde5c058b90 con 0x7fde64155c10 2023-10-09T12:00:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:29.226 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":138,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:00:27.831349+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:00:25.489470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T12:00:26.820007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:00:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fde48066f30 msgr2=0x7fde480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde640c1db0 tx=0x7fde58009250 comp rx=0 tx=0).stop 2023-10-09T12:00:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde64155c10 msgr2=0x7fde640a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde64155c10 0x7fde640a6410 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00bc00 tx=0x7fde5c01b000 comp rx=0 tx=0).stop 2023-10-09T12:00:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 shutdown_connections 2023-10-09T12:00:29.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde64155c10 0x7fde640a6410 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde640ac230 0x7fde640c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 --2- 172.21.15.86:0/2981125208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde640ac6d0 0x7fde640a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.227+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 >> 172.21.15.86:0/2981125208 conn(0x7fde6406a320 msgr2=0x7fde6406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.228+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 shutdown_connections 2023-10-09T12:00:29.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.228+0000 7fde6abff700 1 -- 172.21.15.86:0/2981125208 wait complete. 2023-10-09T12:00:29.245 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T12:00:29.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.432+0000 7fa2423ff700 1 Processor -- start 2023-10-09T12:00:29.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.432+0000 7fa2423ff700 1 -- start start 2023-10-09T12:00:29.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.433+0000 7fa2423ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.433+0000 7fa2423ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa23c069d60 0x7fa23c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.433+0000 7fa2423ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c06bdb0 con 0x7fa23c0c81f0 2023-10-09T12:00:29.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.433+0000 7fa2423ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c0c8670 con 0x7fa23c069d60 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.433+0000 7fa2423ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0cb370 con 0x7fa23c0aca80 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa23c069d60 0x7fa23c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa23c069d60 0x7fa23c0c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56802/0 (socket says 172.21.15.86:56802) 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 -- 172.21.15.86:0/734470282 learned_addr learned my addr 172.21.15.86:0/734470282 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23bfff700 1 --2- 172.21.15.86:0/734470282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 -- 172.21.15.86:0/734470282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 msgr2=0x7fa23c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 --2- 172.21.15.86:0/734470282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c06aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 -- 172.21.15.86:0/734470282 >> v1:172.21.15.135:6789/0 conn(0x7fa23c0c81f0 legacy=0x7fa23c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 -- 172.21.15.86:0/734470282 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c159f60 con 0x7fa23c069d60 2023-10-09T12:00:29.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23b7fe700 1 --2- 172.21.15.86:0/734470282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c069d60 0x7fa23c0c7cb0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fa2300099b0 tx=0x7fa230009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa73cb50a6870b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.434+0000 7fa23affd700 1 -- 172.21.15.86:0/734470282 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23000b860 con 0x7fa23c069d60 2023-10-09T12:00:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa23affd700 1 -- 172.21.15.86:0/734470282 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23000b9c0 con 0x7fa23c069d60 2023-10-09T12:00:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa23affd700 1 -- 172.21.15.86:0/734470282 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23000bd60 con 0x7fa23c069d60 2023-10-09T12:00:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 -- 172.21.15.86:0/734470282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c069d60 msgr2=0x7fa23c0c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 --2- 172.21.15.86:0/734470282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c069d60 0x7fa23c0c7cb0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fa2300099b0 tx=0x7fa230009250 comp rx=0 tx=0).stop 2023-10-09T12:00:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 -- 172.21.15.86:0/734470282 shutdown_connections 2023-10-09T12:00:29.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 --2- 172.21.15.86:0/734470282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c06aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 --2- 172.21.15.86:0/734470282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c069d60 0x7fa23c0c7cb0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 -- 172.21.15.86:0/734470282 >> 172.21.15.86:0/734470282 conn(0x7fa23c0cd670 msgr2=0x7fa23c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:29.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 -- 172.21.15.86:0/734470282 shutdown_connections 2023-10-09T12:00:29.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.435+0000 7fa2423ff700 1 -- 172.21.15.86:0/734470282 wait complete. 2023-10-09T12:00:29.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.437+0000 7fa2423ff700 1 Processor -- start 2023-10-09T12:00:29.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.437+0000 7fa2423ff700 1 -- start start 2023-10-09T12:00:29.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa2423ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa23c069d60 0x7fa23c0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa2423ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa2423ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c0c81f0 0x7fa23c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa2423ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0b0410 con 0x7fa23c0c81f0 2023-10-09T12:00:29.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa2423ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c16dcd0 con 0x7fa23c069d60 2023-10-09T12:00:29.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa2423ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c16dfb0 con 0x7fa23c0aca80 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c0c81f0 0x7fa23c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c0c81f0 0x7fa23c149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56816/0 (socket says 172.21.15.86:56816) 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 -- 172.21.15.86:0/2685251622 learned_addr learned my addr 172.21.15.86:0/2685251622 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa23bfff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa23c069d60 0x7fa23c0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa23b7fe700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 -- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 msgr2=0x7fa23c158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 -- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa23c069d60 msgr2=0x7fa23c0b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa23c069d60 0x7fa23c0b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:29.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.438+0000 7fa24099c700 1 -- 172.21.15.86:0/2685251622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300094f0 con 0x7fa23c0c81f0 2023-10-09T12:00:29.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.439+0000 7fa24099c700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c0c81f0 0x7fa23c149310 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa23400c840 tx=0x7fa234001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:29.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.439+0000 7fa223fff700 1 -- 172.21.15.86:0/2685251622 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234012630 con 0x7fa23c0c81f0 2023-10-09T12:00:29.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.439+0000 7fa223fff700 1 -- 172.21.15.86:0/2685251622 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340127b0 con 0x7fa23c0c81f0 2023-10-09T12:00:29.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.439+0000 7fa223fff700 1 -- 172.21.15.86:0/2685251622 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234012b70 con 0x7fa23c0c81f0 2023-10-09T12:00:29.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.439+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c16e290 con 0x7fa23c0c81f0 2023-10-09T12:00:29.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.439+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c146e20 con 0x7fa23c0c81f0 2023-10-09T12:00:29.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.440+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c04c3c0 con 0x7fa23c0c81f0 2023-10-09T12:00:29.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.441+0000 7fa223fff700 1 -- 172.21.15.86:0/2685251622 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa23401a3a0 con 0x7fa23c0c81f0 2023-10-09T12:00:29.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.442+0000 7fa223fff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa228066f30 0x7fa2280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:29.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.442+0000 7fa223fff700 1 -- 172.21.15.86:0/2685251622 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fa234084890 con 0x7fa23c0c81f0 2023-10-09T12:00:29.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.442+0000 7fa23bfff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa228066f30 0x7fa2280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:29.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.443+0000 7fa23bfff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa228066f30 0x7fa2280693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa22c006aa0 tx=0x7fa22c008040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:29.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.446+0000 7fa223fff700 1 -- 172.21.15.86:0/2685251622 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2340518d0 con 0x7fa23c0c81f0 2023-10-09T12:00:29.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:29.681+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa23c06b510 con 0x7fa23c0c81f0 2023-10-09T12:00:30.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.405+0000 7fa223fff700 1 -- 172.21.15.86:0/2685251622 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa234054ef0 con 0x7fa23c0c81f0 2023-10-09T12:00:30.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa228066f30 msgr2=0x7fa2280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:30.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa228066f30 0x7fa2280693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa22c006aa0 tx=0x7fa22c008040 comp rx=0 tx=0).stop 2023-10-09T12:00:30.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c0c81f0 msgr2=0x7fa23c149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c0c81f0 0x7fa23c149310 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa23400c840 tx=0x7fa234001670 comp rx=0 tx=0).stop 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 shutdown_connections 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa228066f30 0x7fa2280693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa23c0c81f0 0x7fa23c149310 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa23c069d60 0x7fa23c0b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 --2- 172.21.15.86:0/2685251622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa23c0aca80 0x7fa23c158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 >> 172.21.15.86:0/2685251622 conn(0x7fa23c0cd670 msgr2=0x7fa23c159430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 shutdown_connections 2023-10-09T12:00:30.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.408+0000 7fa2423ff700 1 -- 172.21.15.86:0/2685251622 wait complete. 2023-10-09T12:00:30.428 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T12:00:30.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.616+0000 7ff4dc7ff700 1 Processor -- start 2023-10-09T12:00:30.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.616+0000 7ff4dc7ff700 1 -- start start 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.617+0000 7ff4dc7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4d40c70b0 0x7ff4d4069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.617+0000 7ff4dc7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.617+0000 7ff4dc7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d406e950 con 0x7ff4d4155eb0 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.617+0000 7ff4dc7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d406a130 con 0x7ff4d40c70b0 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.617+0000 7ff4dc7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d406eb90 con 0x7ff4d4069cb0 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4d40c70b0 0x7ff4d4069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4d40c70b0 0x7ff4d4069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56824/0 (socket says 172.21.15.86:56824) 2023-10-09T12:00:30.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/331472359 learned_addr learned my addr 172.21.15.86:0/331472359 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4dad9c700 1 --2- 172.21.15.86:0/331472359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/331472359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 msgr2=0x7ff4d40ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 --2- 172.21.15.86:0/331472359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/331472359 >> v1:172.21.15.135:6789/0 conn(0x7ff4d4155eb0 legacy=0x7ff4d406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/331472359 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d406ee70 con 0x7ff4d40c70b0 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.618+0000 7ff4d9d9a700 1 --2- 172.21.15.86:0/331472359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d4069770 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400bc80 tx=0x7ff4c400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec97efd623bc54 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4d9599700 1 -- 172.21.15.86:0/331472359 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400be90 con 0x7ff4d40c70b0 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4d9599700 1 -- 172.21.15.86:0/331472359 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400dd80 con 0x7ff4d40c70b0 2023-10-09T12:00:30.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4d9599700 1 -- 172.21.15.86:0/331472359 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40106a0 con 0x7ff4d40c70b0 2023-10-09T12:00:30.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/331472359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 msgr2=0x7ff4d4069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:30.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/331472359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d4069770 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400bc80 tx=0x7ff4c400b4f0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/331472359 shutdown_connections 2023-10-09T12:00:30.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/331472359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/331472359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d4069770 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/331472359 >> 172.21.15.86:0/331472359 conn(0x7ff4d4068e10 msgr2=0x7ff4d40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:30.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/331472359 shutdown_connections 2023-10-09T12:00:30.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.619+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/331472359 wait complete. 2023-10-09T12:00:30.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.621+0000 7ff4dc7ff700 1 Processor -- start 2023-10-09T12:00:30.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.621+0000 7ff4dc7ff700 1 -- start start 2023-10-09T12:00:30.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4dc7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:30.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4dc7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d40af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4dc7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4155eb0 0x7ff4d4153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4dc7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d415f430 con 0x7ff4d40c70b0 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4dc7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40b0270 con 0x7ff4d4155eb0 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4dc7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40abcf0 con 0x7ff4d4069cb0 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4d9d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d40af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4d9d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d40af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56838/0 (socket says 172.21.15.86:56838) 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/2383131492 learned_addr learned my addr 172.21.15.86:0/2383131492 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4dad9c700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4155eb0 0x7ff4d4153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4da59b700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.622+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 msgr2=0x7ff4d40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:30.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4d9d9a700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4155eb0 msgr2=0x7ff4d4153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4d9d9a700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4155eb0 0x7ff4d4153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4d9d9a700 1 -- 172.21.15.86:0/2383131492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c400b790 con 0x7ff4d40c70b0 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4d9d9a700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d40af2d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b760 tx=0x7ff4c401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4ca7fc700 1 -- 172.21.15.86:0/2383131492 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40186b0 con 0x7ff4d40c70b0 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4ca7fc700 1 -- 172.21.15.86:0/2383131492 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c4018850 con 0x7ff4d40c70b0 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40af9d0 con 0x7ff4d40c70b0 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4ca7fc700 1 -- 172.21.15.86:0/2383131492 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4018c10 con 0x7ff4d40c70b0 2023-10-09T12:00:30.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.623+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40aff90 con 0x7ff4d40c70b0 2023-10-09T12:00:30.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.624+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d404c3c0 con 0x7ff4d40c70b0 2023-10-09T12:00:30.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.625+0000 7ff4ca7fc700 1 -- 172.21.15.86:0/2383131492 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4c4021630 con 0x7ff4d40c70b0 2023-10-09T12:00:30.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.626+0000 7ff4ca7fc700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4b8066f00 0x7ff4b80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:30.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.626+0000 7ff4ca7fc700 1 -- 172.21.15.86:0/2383131492 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7ff4c4014070 con 0x7ff4d40c70b0 2023-10-09T12:00:30.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.626+0000 7ff4da59b700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4b8066f00 0x7ff4b80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:30.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.627+0000 7ff4da59b700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4b8066f00 0x7ff4b80693b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0006fd0 tx=0x7ff4d0008040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:30.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.630+0000 7ff4ca7fc700 1 -- 172.21.15.86:0/2383131492 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4c4052c50 con 0x7ff4d40c70b0 2023-10-09T12:00:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:30.866+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff4d406e950 con 0x7ff4d40c70b0 2023-10-09T12:00:31.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.406+0000 7ff4ca7fc700 1 -- 172.21.15.86:0/2383131492 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4d406e950 con 0x7ff4d40c70b0 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4b8066f00 msgr2=0x7ff4b80693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4b8066f00 0x7ff4b80693b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0006fd0 tx=0x7ff4d0008040 comp rx=0 tx=0).stop 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 msgr2=0x7ff4d40af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d40af2d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b760 tx=0x7ff4c401a000 comp rx=0 tx=0).stop 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 shutdown_connections 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4155eb0 0x7ff4d4153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4d4069cb0 0x7ff4d40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff4b8066f00 0x7ff4b80693b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 --2- 172.21.15.86:0/2383131492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d40c70b0 0x7ff4d40af2d0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 >> 172.21.15.86:0/2383131492 conn(0x7ff4d4068e10 msgr2=0x7ff4d40aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:31.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.409+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 shutdown_connections 2023-10-09T12:00:31.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.410+0000 7ff4dc7ff700 1 -- 172.21.15.86:0/2383131492 wait complete. 2023-10-09T12:00:31.429 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:00:31.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.611+0000 7fb363fff700 1 Processor -- start 2023-10-09T12:00:31.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.611+0000 7fb363fff700 1 -- start start 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.612+0000 7fb363fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb35c0cd010 0x7fb35c0ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.612+0000 7fb363fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb35c0ac770 0x7fb35c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.612+0000 7fb363fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c0ad930 con 0x7fb35c0ccc40 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.612+0000 7fb363fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0acd20 con 0x7fb35c0cd010 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.612+0000 7fb363fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0ad000 con 0x7fb35c0ac770 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb361d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb35c0ccc40 0x7fb35c155c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46264/0 (socket says 172.21.15.86:46264) 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb361d9b700 1 -- 172.21.15.86:0/3050667759 learned_addr learned my addr 172.21.15.86:0/3050667759 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36159a700 1 --2- 172.21.15.86:0/3050667759 >> v2:172.21.15.86:3300/0 conn(0x7fb35c0cd010 0x7fb35c0ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36259c700 1 --2- 172.21.15.86:0/3050667759 >> v2:172.21.15.135:3300/0 conn(0x7fb35c0ac770 0x7fb35c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:31.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb360d99700 1 -- 172.21.15.86:0/3050667759 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150163314 0 0) 0x7fb35c0ad930 con 0x7fb35c0ccc40 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb360d99700 1 -- 172.21.15.86:0/3050667759 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb348003570 con 0x7fb35c0ccc40 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36159a700 1 -- 172.21.15.86:0/3050667759 >> v2:172.21.15.135:3300/0 conn(0x7fb35c0ac770 msgr2=0x7fb35c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36159a700 1 --2- 172.21.15.86:0/3050667759 >> v2:172.21.15.135:3300/0 conn(0x7fb35c0ac770 0x7fb35c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36159a700 1 -- 172.21.15.86:0/3050667759 >> v1:172.21.15.86:6789/0 conn(0x7fb35c0ccc40 legacy=0x7fb35c155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36159a700 1 -- 172.21.15.86:0/3050667759 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0ad2e0 con 0x7fb35c0cd010 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36259c700 1 --2- 172.21.15.86:0/3050667759 >> v2:172.21.15.135:3300/0 conn(0x7fb35c0ac770 0x7fb35c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.613+0000 7fb36159a700 1 --2- 172.21.15.86:0/3050667759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0cd010 0x7fb35c0ac230 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb35c065be0 tx=0x7fb34c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248bcca89a240afe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb360d99700 1 -- 172.21.15.86:0/3050667759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011630 con 0x7fb35c0cd010 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb360d99700 1 -- 172.21.15.86:0/3050667759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c011790 con 0x7fb35c0cd010 2023-10-09T12:00:31.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb360d99700 1 -- 172.21.15.86:0/3050667759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011b30 con 0x7fb35c0cd010 2023-10-09T12:00:31.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 -- 172.21.15.86:0/3050667759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0cd010 msgr2=0x7fb35c0ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 --2- 172.21.15.86:0/3050667759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0cd010 0x7fb35c0ac230 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb35c065be0 tx=0x7fb34c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 -- 172.21.15.86:0/3050667759 shutdown_connections 2023-10-09T12:00:31.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 --2- 172.21.15.86:0/3050667759 >> v2:172.21.15.135:3300/0 conn(0x7fb35c0ac770 0x7fb35c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 --2- 172.21.15.86:0/3050667759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0cd010 0x7fb35c0ac230 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 -- 172.21.15.86:0/3050667759 >> 172.21.15.86:0/3050667759 conn(0x7fb35c06a320 msgr2=0x7fb35c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:31.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 -- 172.21.15.86:0/3050667759 shutdown_connections 2023-10-09T12:00:31.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.614+0000 7fb363fff700 1 -- 172.21.15.86:0/3050667759 wait complete. 2023-10-09T12:00:31.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.616+0000 7fb363fff700 1 Processor -- start 2023-10-09T12:00:31.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.616+0000 7fb363fff700 1 -- start start 2023-10-09T12:00:31.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb363fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35c0ac770 0x7fb35c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb363fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0ccc40 0x7fb35c06def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb363fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35c0cd010 0x7fb35c148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb363fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c06f200 con 0x7fb35c0ccc40 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb363fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c06e5f0 con 0x7fb35c0cd010 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb363fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c06e8d0 con 0x7fb35c0ac770 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb36159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0ccc40 0x7fb35c06def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb36159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0ccc40 0x7fb35c06def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56856/0 (socket says 172.21.15.86:56856) 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb36159a700 1 -- 172.21.15.86:0/1990231341 learned_addr learned my addr 172.21.15.86:0/1990231341 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb36259c700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35c0cd010 0x7fb35c148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.617+0000 7fb361d9b700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35c0ac770 0x7fb35c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:31.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb36159a700 1 -- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35c0ac770 msgr2=0x7fb35c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb36159a700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35c0ac770 0x7fb35c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb36159a700 1 -- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35c0cd010 msgr2=0x7fb35c148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb36159a700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35c0cd010 0x7fb35c148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb36159a700 1 -- 172.21.15.86:0/1990231341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009420 con 0x7fb35c0ccc40 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb36159a700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0ccc40 0x7fb35c06def0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fb35c064290 tx=0x7fb34c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb351ffb700 1 -- 172.21.15.86:0/1990231341 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011b10 con 0x7fb35c0ccc40 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb351ffb700 1 -- 172.21.15.86:0/1990231341 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c000c90 con 0x7fb35c0ccc40 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c06ebb0 con 0x7fb35c0ccc40 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb351ffb700 1 -- 172.21.15.86:0/1990231341 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c025600 con 0x7fb35c0ccc40 2023-10-09T12:00:31.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.618+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c1494d0 con 0x7fb35c0ccc40 2023-10-09T12:00:31.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.619+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c1552a0 con 0x7fb35c0ccc40 2023-10-09T12:00:31.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.620+0000 7fb351ffb700 1 -- 172.21.15.86:0/1990231341 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb34c0259b0 con 0x7fb35c0ccc40 2023-10-09T12:00:31.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.621+0000 7fb351ffb700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb340066f30 0x7fb3400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:31.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.621+0000 7fb351ffb700 1 -- 172.21.15.86:0/1990231341 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fb34c085e60 con 0x7fb35c0ccc40 2023-10-09T12:00:31.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.621+0000 7fb361d9b700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb340066f30 0x7fb3400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:31.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.622+0000 7fb361d9b700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb340066f30 0x7fb3400693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb358007fd0 tx=0x7fb358009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:31.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.625+0000 7fb351ffb700 1 -- 172.21.15.86:0/1990231341 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb34c052ea0 con 0x7fb35c0ccc40 2023-10-09T12:00:31.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.858+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb35c04c3c0 con 0x7fb35c0ccc40 2023-10-09T12:00:31.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.859+0000 7fb351ffb700 1 -- 172.21.15.86:0/1990231341 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb34c015020 con 0x7fb35c0ccc40 2023-10-09T12:00:31.859 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:31.859 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4273963470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4273963470},{"type":"v1","addr":"172.21.15.135:6834","nonce":4273963470}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1830713158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1830713158},{"type":"v1","addr":"172.21.15.135:6835","nonce":1830713158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/51772873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":51772873},{"type":"v1","addr":"172.21.15.86:6833","nonce":51772873}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:00:27.831701+0000","modified":"2023-10-09T12:00:31.403803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2423117806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2423117806},{"type":"v1","addr":"172.21.15.86:6835","nonce":2423117806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T12:00:31.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb340066f30 msgr2=0x7fb3400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb340066f30 0x7fb3400693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb358007fd0 tx=0x7fb358009040 comp rx=0 tx=0).stop 2023-10-09T12:00:31.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0ccc40 msgr2=0x7fb35c06def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:31.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0ccc40 0x7fb35c06def0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fb35c064290 tx=0x7fb34c017000 comp rx=0 tx=0).stop 2023-10-09T12:00:31.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 shutdown_connections 2023-10-09T12:00:31.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb35c0cd010 0x7fb35c148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb35c0ac770 0x7fb35c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb340066f30 0x7fb3400693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 --2- 172.21.15.86:0/1990231341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb35c0ccc40 0x7fb35c06def0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:31.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 >> 172.21.15.86:0/1990231341 conn(0x7fb35c06a320 msgr2=0x7fb35c0c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:31.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 shutdown_connections 2023-10-09T12:00:31.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:31.861+0000 7fb363fff700 1 -- 172.21.15.86:0/1990231341 wait complete. 2023-10-09T12:00:31.864 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 63 2023-10-09T12:00:31.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:00:32.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.060+0000 7f654b59e700 1 Processor -- start 2023-10-09T12:00:32.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.060+0000 7f654b59e700 1 -- start start 2023-10-09T12:00:32.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c150550 0x7f654c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654b59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f654c0c7410 0x7f654c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654b59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c06e2a0 con 0x7f654c150180 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654b59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c06b2e0 con 0x7f654c0c7410 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0c78e0 con 0x7f654c150550 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f654c0c7410 0x7f654c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f654c0c7410 0x7f654c069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56858/0 (socket says 172.21.15.86:56858) 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654a59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f654c150180 0x7f654c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46270/0 (socket says 172.21.15.86:46270) 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.061+0000 7f654ad9d700 1 -- 172.21.15.86:0/889097577 learned_addr learned my addr 172.21.15.86:0/889097577 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f6549d9b700 1 --2- 172.21.15.86:0/889097577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c150550 0x7f654c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654ad9d700 1 -- 172.21.15.86:0/889097577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c150550 msgr2=0x7f654c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:32.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654ad9d700 1 --2- 172.21.15.86:0/889097577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c150550 0x7f654c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654ad9d700 1 -- 172.21.15.86:0/889097577 >> v1:172.21.15.86:6789/0 conn(0x7f654c150180 legacy=0x7f654c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654ad9d700 1 -- 172.21.15.86:0/889097577 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0c7bc0 con 0x7f654c0c7410 2023-10-09T12:00:32.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654959a700 1 -- 172.21.15.86:0/889097577 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684010518 0 0) 0x7f654c06e2a0 con 0x7f654c150180 2023-10-09T12:00:32.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654ad9d700 1 --2- 172.21.15.86:0/889097577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c0c7410 0x7f654c069f50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f654400d1d0 tx=0x7f654400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f2816e5c565226 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654959a700 1 -- 172.21.15.86:0/889097577 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544010070 con 0x7f654c0c7410 2023-10-09T12:00:32.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654959a700 1 -- 172.21.15.86:0/889097577 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654400b0d0 con 0x7f654c0c7410 2023-10-09T12:00:32.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.062+0000 7f654959a700 1 -- 172.21.15.86:0/889097577 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400b490 con 0x7f654c0c7410 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 -- 172.21.15.86:0/889097577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c0c7410 msgr2=0x7f654c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 --2- 172.21.15.86:0/889097577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c0c7410 0x7f654c069f50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f654400d1d0 tx=0x7f654400ba50 comp rx=0 tx=0).stop 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 -- 172.21.15.86:0/889097577 shutdown_connections 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 --2- 172.21.15.86:0/889097577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c0c7410 0x7f654c069f50 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 --2- 172.21.15.86:0/889097577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c150550 0x7f654c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 -- 172.21.15.86:0/889097577 >> 172.21.15.86:0/889097577 conn(0x7f654c0cc1f0 msgr2=0x7f654c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 -- 172.21.15.86:0/889097577 shutdown_connections 2023-10-09T12:00:32.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.063+0000 7f654b59e700 1 -- 172.21.15.86:0/889097577 wait complete. 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.064+0000 7f654b59e700 1 Processor -- start 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.065+0000 7f654b59e700 1 -- start start 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.065+0000 7f654b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c0c7410 0x7f654c149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.065+0000 7f654b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654c150180 0x7f654c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.065+0000 7f654b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c150550 0x7f654c0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.065+0000 7f654b59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0ae2e0 con 0x7f654c150550 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.065+0000 7f654b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0ae5c0 con 0x7f654c150180 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.065+0000 7f654b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0ae8a0 con 0x7f654c0c7410 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c150550 0x7f654c0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c150550 0x7f654c0c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56866/0 (socket says 172.21.15.86:56866) 2023-10-09T12:00:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 -- 172.21.15.86:0/711805936 learned_addr learned my addr 172.21.15.86:0/711805936 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f6549d9b700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654c150180 0x7f654c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654a59c700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c0c7410 0x7f654c149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 -- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c0c7410 msgr2=0x7f654c149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c0c7410 0x7f654c149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 -- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654c150180 msgr2=0x7f654c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654c150180 0x7f654c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 -- 172.21.15.86:0/711805936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654400bcf0 con 0x7f654c150550 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654a59c700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c0c7410 0x7f654c149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f654ad9d700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c150550 0x7f654c0c3770 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f654c06fe40 tx=0x7f654401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.066+0000 7f653a7fc700 1 -- 172.21.15.86:0/711805936 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400ad80 con 0x7f654c150550 2023-10-09T12:00:32.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.067+0000 7f653a7fc700 1 -- 172.21.15.86:0/711805936 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654401d430 con 0x7f654c150550 2023-10-09T12:00:32.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.067+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c0a9970 con 0x7f654c150550 2023-10-09T12:00:32.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.067+0000 7f653a7fc700 1 -- 172.21.15.86:0/711805936 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654401d7f0 con 0x7f654c150550 2023-10-09T12:00:32.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.067+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c14a2a0 con 0x7f654c150550 2023-10-09T12:00:32.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.068+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c0a9e90 con 0x7f654c150550 2023-10-09T12:00:32.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.068+0000 7f653a7fc700 1 -- 172.21.15.86:0/711805936 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6544003040 con 0x7f654c150550 2023-10-09T12:00:32.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.070+0000 7f653a7fc700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.070+0000 7f653a7fc700 1 -- 172.21.15.86:0/711805936 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f6544085f30 con 0x7f654c150550 2023-10-09T12:00:32.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.070+0000 7f654a59c700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.070+0000 7f654a59c700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f653c0018d0 tx=0x7f653c009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.073+0000 7f653a7fc700 1 -- 172.21.15.86:0/711805936 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f654c0a9e90 con 0x7f654c150550 2023-10-09T12:00:32.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.262+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f654c0a9e90 con 0x7f654c150550 2023-10-09T12:00:32.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.263+0000 7f653a7fc700 1 -- 172.21.15.86:0/711805936 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16027 (secure 0 0 0) 0x7f654c0a9e90 con 0x7f654c150550 2023-10-09T12:00:32.263 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:32.264 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":139,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:00:29.372037+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:00:25.489470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T12:00:26.820007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f652c066f30 msgr2=0x7f652c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f653c0018d0 tx=0x7f653c009040 comp rx=0 tx=0).stop 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c150550 msgr2=0x7f654c0c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c150550 0x7f654c0c3770 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f654c06fe40 tx=0x7f654401a000 comp rx=0 tx=0).stop 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 shutdown_connections 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f654c150550 0x7f654c0c3770 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f654c0c7410 0x7f654c149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.265+0000 7f654b59e700 1 --2- 172.21.15.86:0/711805936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654c150180 0x7f654c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.266+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 >> 172.21.15.86:0/711805936 conn(0x7f654c0cc1f0 msgr2=0x7f654c14a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:32.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.266+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 shutdown_connections 2023-10-09T12:00:32.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.266+0000 7f654b59e700 1 -- 172.21.15.86:0/711805936 wait complete. 2023-10-09T12:00:32.283 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T12:00:32.283 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:00:32.342 INFO:tasks.ceph.mds.a.smithi086.stderr:2023-10-09T12:00:32.342+0000 7f23939f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T12:00:32.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.466+0000 7f735cdff700 1 Processor -- start 2023-10-09T12:00:32.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.466+0000 7f735cdff700 1 -- start start 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f735cdff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f735806c0a0 0x7f73580caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f735cdff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f735815df50 0x7f735815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f735cdff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735815d7e0 con 0x7f735806bcd0 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f735cdff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735815dac0 con 0x7f735806c0a0 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f735cdff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735815aa30 con 0x7f735815df50 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f7355d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f735806c0a0 0x7f73580caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f7355d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f735806c0a0 0x7f73580caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56876/0 (socket says 172.21.15.86:56876) 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.467+0000 7f7355d9b700 1 -- 172.21.15.86:0/2778670108 learned_addr learned my addr 172.21.15.86:0/2778670108 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f7356d9d700 1 --2- 172.21.15.86:0/2778670108 >> v2:172.21.15.135:3300/0 conn(0x7f735815df50 0x7f735815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f7355d9b700 1 -- 172.21.15.86:0/2778670108 >> v2:172.21.15.135:3300/0 conn(0x7f735815df50 msgr2=0x7f735815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:32.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f7355d9b700 1 --2- 172.21.15.86:0/2778670108 >> v2:172.21.15.135:3300/0 conn(0x7f735815df50 0x7f735815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f7355d9b700 1 -- 172.21.15.86:0/2778670108 >> v1:172.21.15.135:6789/0 conn(0x7f735806bcd0 legacy=0x7f735815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f7355d9b700 1 -- 172.21.15.86:0/2778670108 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735815ad10 con 0x7f735806c0a0 2023-10-09T12:00:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f7355d9b700 1 --2- 172.21.15.86:0/2778670108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f73580caa90 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f735815d720 tx=0x7f734c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9eed1db546f7c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f735559a700 1 -- 172.21.15.86:0/2778670108 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00b860 con 0x7f735806c0a0 2023-10-09T12:00:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f735559a700 1 -- 172.21.15.86:0/2778670108 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c00b9c0 con 0x7f735806c0a0 2023-10-09T12:00:32.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.468+0000 7f735559a700 1 -- 172.21.15.86:0/2778670108 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00bd80 con 0x7f735806c0a0 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 -- 172.21.15.86:0/2778670108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 msgr2=0x7f73580caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 --2- 172.21.15.86:0/2778670108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f73580caa90 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f735815d720 tx=0x7f734c009250 comp rx=0 tx=0).stop 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 -- 172.21.15.86:0/2778670108 shutdown_connections 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 --2- 172.21.15.86:0/2778670108 >> v2:172.21.15.135:3300/0 conn(0x7f735815df50 0x7f735815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 --2- 172.21.15.86:0/2778670108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f73580caa90 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 -- 172.21.15.86:0/2778670108 >> 172.21.15.86:0/2778670108 conn(0x7f73580ce600 msgr2=0x7f73580cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 -- 172.21.15.86:0/2778670108 shutdown_connections 2023-10-09T12:00:32.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.469+0000 7f735cdff700 1 -- 172.21.15.86:0/2778670108 wait complete. 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.470+0000 7f735cdff700 1 Processor -- start 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.471+0000 7f735cdff700 1 -- start start 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.471+0000 7f735cdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735806bcd0 0x7f73580b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.471+0000 7f735cdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f7358158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.471+0000 7f735cdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f735815df50 0x7f7358069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f735cdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580b42a0 con 0x7f735806c0a0 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f735cdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580b0970 con 0x7f735806bcd0 2023-10-09T12:00:32.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f735cdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735816df00 con 0x7f735815df50 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f7358158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f7358158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56878/0 (socket says 172.21.15.86:56878) 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 -- 172.21.15.86:0/3689027161 learned_addr learned my addr 172.21.15.86:0/3689027161 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 -- 172.21.15.86:0/3689027161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f735815df50 msgr2=0x7f7358069480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f735815df50 0x7f7358069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 -- 172.21.15.86:0/3689027161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735806bcd0 msgr2=0x7f73580b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735806bcd0 0x7f73580b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 -- 172.21.15.86:0/3689027161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0094f0 con 0x7f735806c0a0 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f7355d9b700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f7358158360 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7358069220 tx=0x7f734c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.472+0000 7f73467fc700 1 -- 172.21.15.86:0/3689027161 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c01f070 con 0x7f735806c0a0 2023-10-09T12:00:32.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.473+0000 7f73467fc700 1 -- 172.21.15.86:0/3689027161 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c002f30 con 0x7f735806c0a0 2023-10-09T12:00:32.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.473+0000 7f73467fc700 1 -- 172.21.15.86:0/3689027161 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c025420 con 0x7f735806c0a0 2023-10-09T12:00:32.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.473+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73581588a0 con 0x7f735806c0a0 2023-10-09T12:00:32.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.473+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735816d8b0 con 0x7f735806c0a0 2023-10-09T12:00:32.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.474+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735804c3c0 con 0x7f735806c0a0 2023-10-09T12:00:32.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.474+0000 7f73467fc700 1 -- 172.21.15.86:0/3689027161 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f734c023070 con 0x7f735806c0a0 2023-10-09T12:00:32.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.475+0000 7f73467fc700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7338066f30 0x7f73380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.475+0000 7f73467fc700 1 -- 172.21.15.86:0/3689027161 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f734c085c10 con 0x7f735806c0a0 2023-10-09T12:00:32.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.475+0000 7f735659c700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7338066f30 0x7f73380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.476+0000 7f735659c700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7338066f30 0x7f73380693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73580c3f10 tx=0x7f7348007b40 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.480+0000 7f73467fc700 1 -- 172.21.15.86:0/3689027161 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f734c052c50 con 0x7f735806c0a0 2023-10-09T12:00:32.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.664+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f735816e040 con 0x7f7338066f30 2023-10-09T12:00:32.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.674+0000 7f73467fc700 1 -- 172.21.15.86:0/3689027161 <== mgr.6599 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289414 (secure 0 0 0) 0x7f735816e040 con 0x7f7338066f30 2023-10-09T12:00:32.678 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7338066f30 msgr2=0x7f73380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7338066f30 0x7f73380693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73580c3f10 tx=0x7f7348007b40 comp rx=0 tx=0).stop 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 msgr2=0x7f7358158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f7358158360 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7358069220 tx=0x7f734c017000 comp rx=0 tx=0).stop 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 shutdown_connections 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f735815df50 0x7f7358069480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f735806bcd0 0x7f73580b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7338066f30 0x7f73380693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 --2- 172.21.15.86:0/3689027161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f735806c0a0 0x7f7358158360 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 >> 172.21.15.86:0/3689027161 conn(0x7f73580ce600 msgr2=0x7f73580c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:32.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 shutdown_connections 2023-10-09T12:00:32.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.678+0000 7f735cdff700 1 -- 172.21.15.86:0/3689027161 wait complete. 2023-10-09T12:00:32.682 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:00:32.696 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T12:00:31.756167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2446140,"kb_used_data":14588,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752528580,"statfs":{"total":773094113280,"available":770589265920,"internally_reserved":0,"allocated":14938112,"data_stored":7896448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.400795"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.397253+0000","last_change":"2023-10-09T12:00:28.394574+0000","last_active":"2023-10-09T12:00:28.397253+0000","last_peered":"2023-10-09T12:00:28.397253+0000","last_clean":"2023-10-09T12:00:28.397253+0000","last_became_active":"2023-10-09T12:00:28.394298+0000","last_became_peered":"2023-10-09T12:00:28.394298+0000","last_unstale":"2023-10-09T12:00:28.397253+0000","last_undegraded":"2023-10-09T12:00:28.397253+0000","last_fullsized":"2023-10-09T12:00:28.397253+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:25.327551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395434+0000","last_change":"2023-10-09T12:00:28.391058+0000","last_active":"2023-10-09T12:00:28.395434+0000","last_peered":"2023-10-09T12:00:28.395434+0000","last_clean":"2023-10-09T12:00:28.395434+0000","last_became_active":"2023-10-09T12:00:28.389381+0000","last_became_peered":"2023-10-09T12:00:28.389381+0000","last_unstale":"2023-10-09T12:00:28.395434+0000","last_undegraded":"2023-10-09T12:00:28.395434+0000","last_fullsized":"2023-10-09T12:00:28.395434+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:13.644755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.405397+0000","last_change":"2023-10-09T12:00:28.402711+0000","last_active":"2023-10-09T12:00:28.405397+0000","last_peered":"2023-10-09T12:00:28.405397+0000","last_clean":"2023-10-09T12:00:28.405397+0000","last_became_active":"2023-10-09T12:00:28.402393+0000","last_became_peered":"2023-10-09T12:00:28.402393+0000","last_unstale":"2023-10-09T12:00:28.405397+0000","last_undegraded":"2023-10-09T12:00:28.405397+0000","last_fullsized":"2023-10-09T12:00:28.405397+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:52.121783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399161+0000","last_change":"2023-10-09T12:00:28.395026+0000","last_active":"2023-10-09T12:00:28.399161+0000","last_peered":"2023-10-09T12:00:28.399161+0000","last_clean":"2023-10-09T12:00:28.399161+0000","last_became_active":"2023-10-09T12:00:28.394559+0000","last_became_peered":"2023-10-09T12:00:28.394559+0000","last_unstale":"2023-10-09T12:00:28.399161+0000","last_undegraded":"2023-10-09T12:00:28.399161+0000","last_fullsized":"2023-10-09T12:00:28.399161+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:19.865816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.379885+0000","last_change":"2023-10-09T12:00:28.379050+0000","last_active":"2023-10-09T12:00:28.379885+0000","last_peered":"2023-10-09T12:00:28.379885+0000","last_clean":"2023-10-09T12:00:28.379885+0000","last_became_active":"2023-10-09T12:00:28.378787+0000","last_became_peered":"2023-10-09T12:00:28.378787+0000","last_unstale":"2023-10-09T12:00:28.379885+0000","last_undegraded":"2023-10-09T12:00:28.379885+0000","last_fullsized":"2023-10-09T12:00:28.379885+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:16.799363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398868+0000","last_change":"2023-10-09T12:00:28.394714+0000","last_active":"2023-10-09T12:00:28.398868+0000","last_peered":"2023-10-09T12:00:28.398868+0000","last_clean":"2023-10-09T12:00:28.398868+0000","last_became_active":"2023-10-09T12:00:28.394443+0000","last_became_peered":"2023-10-09T12:00:28.394443+0000","last_unstale":"2023-10-09T12:00:28.398868+0000","last_undegraded":"2023-10-09T12:00:28.398868+0000","last_fullsized":"2023-10-09T12:00:28.398868+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:14.896805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400951+0000","last_change":"2023-10-09T12:00:28.394618+0000","last_active":"2023-10-09T12:00:28.400951+0000","last_peered":"2023-10-09T12:00:28.400951+0000","last_clean":"2023-10-09T12:00:28.400951+0000","last_became_active":"2023-10-09T12:00:28.394351+0000","last_became_peered":"2023-10-09T12:00:28.394351+0000","last_unstale":"2023-10-09T12:00:28.400951+0000","last_undegraded":"2023-10-09T12:00:28.400951+0000","last_fullsized":"2023-10-09T12:00:28.400951+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:13.522842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390655+0000","last_change":"2023-10-09T12:00:28.389432+0000","last_active":"2023-10-09T12:00:28.390655+0000","last_peered":"2023-10-09T12:00:28.390655+0000","last_clean":"2023-10-09T12:00:28.390655+0000","last_became_active":"2023-10-09T12:00:28.388517+0000","last_became_peered":"2023-10-09T12:00:28.388517+0000","last_unstale":"2023-10-09T12:00:28.390655+0000","last_undegraded":"2023-10-09T12:00:28.390655+0000","last_fullsized":"2023-10-09T12:00:28.390655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:15.620008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401530+0000","last_change":"2023-10-09T12:00:28.398485+0000","last_active":"2023-10-09T12:00:28.401530+0000","last_peered":"2023-10-09T12:00:28.401530+0000","last_clean":"2023-10-09T12:00:28.401530+0000","last_became_active":"2023-10-09T12:00:28.398231+0000","last_became_peered":"2023-10-09T12:00:28.398231+0000","last_unstale":"2023-10-09T12:00:28.401530+0000","last_undegraded":"2023-10-09T12:00:28.401530+0000","last_fullsized":"2023-10-09T12:00:28.401530+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:11.442519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.407259+0000","last_change":"2023-10-09T12:00:28.399827+0000","last_active":"2023-10-09T12:00:28.407259+0000","last_peered":"2023-10-09T12:00:28.407259+0000","last_clean":"2023-10-09T12:00:28.407259+0000","last_became_active":"2023-10-09T12:00:28.399447+0000","last_became_peered":"2023-10-09T12:00:28.399447+0000","last_unstale":"2023-10-09T12:00:28.407259+0000","last_undegraded":"2023-10-09T12:00:28.407259+0000","last_fullsized":"2023-10-09T12:00:28.407259+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:59.677346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393680+0000","last_change":"2023-10-09T12:00:28.388952+0000","last_active":"2023-10-09T12:00:28.393680+0000","last_peered":"2023-10-09T12:00:28.393680+0000","last_clean":"2023-10-09T12:00:28.393680+0000","last_became_active":"2023-10-09T12:00:28.388484+0000","last_became_peered":"2023-10-09T12:00:28.388484+0000","last_unstale":"2023-10-09T12:00:28.393680+0000","last_undegraded":"2023-10-09T12:00:28.393680+0000","last_fullsized":"2023-10-09T12:00:28.393680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:26.803994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402753+0000","last_change":"2023-10-09T12:00:28.399209+0000","last_active":"2023-10-09T12:00:28.402753+0000","last_peered":"2023-10-09T12:00:28.402753+0000","last_clean":"2023-10-09T12:00:28.402753+0000","last_became_active":"2023-10-09T12:00:28.398214+0000","last_became_peered":"2023-10-09T12:00:28.398214+0000","last_unstale":"2023-10-09T12:00:28.402753+0000","last_undegraded":"2023-10-09T12:00:28.402753+0000","last_fullsized":"2023-10-09T12:00:28.402753+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:39.586421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.397230+0000","last_change":"2023-10-09T12:00:28.396630+0000","last_active":"2023-10-09T12:00:28.397230+0000","last_peered":"2023-10-09T12:00:28.397230+0000","last_clean":"2023-10-09T12:00:28.397230+0000","last_became_active":"2023-10-09T12:00:28.396342+0000","last_became_peered":"2023-10-09T12:00:28.396342+0000","last_unstale":"2023-10-09T12:00:28.397230+0000","last_undegraded":"2023-10-09T12:00:28.397230+0000","last_fullsized":"2023-10-09T12:00:28.397230+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:58.105895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.389919+0000","last_change":"2023-10-09T12:00:28.387582+0000","last_active":"2023-10-09T12:00:28.389919+0000","last_peered":"2023-10-09T12:00:28.389919+0000","last_clean":"2023-10-09T12:00:28.389919+0000","last_became_active":"2023-10-09T12:00:28.387315+0000","last_became_peered":"2023-10-09T12:00:28.387315+0000","last_unstale":"2023-10-09T12:00:28.389919+0000","last_undegraded":"2023-10-09T12:00:28.389919+0000","last_fullsized":"2023-10-09T12:00:28.389919+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:43.752853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390925+0000","last_change":"2023-10-09T12:00:28.386691+0000","last_active":"2023-10-09T12:00:28.390925+0000","last_peered":"2023-10-09T12:00:28.390925+0000","last_clean":"2023-10-09T12:00:28.390925+0000","last_became_active":"2023-10-09T12:00:28.386440+0000","last_became_peered":"2023-10-09T12:00:28.386440+0000","last_unstale":"2023-10-09T12:00:28.390925+0000","last_undegraded":"2023-10-09T12:00:28.390925+0000","last_fullsized":"2023-10-09T12:00:28.390925+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:07.631980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396367+0000","last_change":"2023-10-09T12:00:28.393411+0000","last_active":"2023-10-09T12:00:28.396367+0000","last_peered":"2023-10-09T12:00:28.396367+0000","last_clean":"2023-10-09T12:00:28.396367+0000","last_became_active":"2023-10-09T12:00:28.393178+0000","last_became_peered":"2023-10-09T12:00:28.393178+0000","last_unstale":"2023-10-09T12:00:28.396367+0000","last_undegraded":"2023-10-09T12:00:28.396367+0000","last_fullsized":"2023-10-09T12:00:28.396367+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:19.909094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394538+0000","last_change":"2023-10-09T12:00:28.393597+0000","last_active":"2023-10-09T12:00:28.394538+0000","last_peered":"2023-10-09T12:00:28.394538+0000","last_clean":"2023-10-09T12:00:28.394538+0000","last_became_active":"2023-10-09T12:00:28.393296+0000","last_became_peered":"2023-10-09T12:00:28.393296+0000","last_unstale":"2023-10-09T12:00:28.394538+0000","last_undegraded":"2023-10-09T12:00:28.394538+0000","last_fullsized":"2023-10-09T12:00:28.394538+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:50.827398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400520+0000","last_change":"2023-10-09T12:00:28.396412+0000","last_active":"2023-10-09T12:00:28.400520+0000","last_peered":"2023-10-09T12:00:28.400520+0000","last_clean":"2023-10-09T12:00:28.400520+0000","last_became_active":"2023-10-09T12:00:28.396144+0000","last_became_peered":"2023-10-09T12:00:28.396144+0000","last_unstale":"2023-10-09T12:00:28.400520+0000","last_undegraded":"2023-10-09T12:00:28.400520+0000","last_fullsized":"2023-10-09T12:00:28.400520+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:11:06.167202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394859+0000","last_change":"2023-10-09T12:00:28.392225+0000","last_active":"2023-10-09T12:00:28.394859+0000","last_peered":"2023-10-09T12:00:28.394859+0000","last_clean":"2023-10-09T12:00:28.394859+0000","last_became_active":"2023-10-09T12:00:28.391353+0000","last_became_peered":"2023-10-09T12:00:28.391353+0000","last_unstale":"2023-10-09T12:00:28.394859+0000","last_undegraded":"2023-10-09T12:00:28.394859+0000","last_fullsized":"2023-10-09T12:00:28.394859+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:21.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.403207+0000","last_change":"2023-10-09T12:00:28.400586+0000","last_active":"2023-10-09T12:00:28.403207+0000","last_peered":"2023-10-09T12:00:28.403207+0000","last_clean":"2023-10-09T12:00:28.403207+0000","last_became_active":"2023-10-09T12:00:28.400058+0000","last_became_peered":"2023-10-09T12:00:28.400058+0000","last_unstale":"2023-10-09T12:00:28.403207+0000","last_undegraded":"2023-10-09T12:00:28.403207+0000","last_fullsized":"2023-10-09T12:00:28.403207+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:36.174774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.403193+0000","last_change":"2023-10-09T12:00:28.399666+0000","last_active":"2023-10-09T12:00:28.403193+0000","last_peered":"2023-10-09T12:00:28.403193+0000","last_clean":"2023-10-09T12:00:28.403193+0000","last_became_active":"2023-10-09T12:00:28.399357+0000","last_became_peered":"2023-10-09T12:00:28.399357+0000","last_unstale":"2023-10-09T12:00:28.403193+0000","last_undegraded":"2023-10-09T12:00:28.403193+0000","last_fullsized":"2023-10-09T12:00:28.403193+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:51.916912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390202+0000","last_change":"2023-10-09T12:00:28.383875+0000","last_active":"2023-10-09T12:00:28.390202+0000","last_peered":"2023-10-09T12:00:28.390202+0000","last_clean":"2023-10-09T12:00:28.390202+0000","last_became_active":"2023-10-09T12:00:28.383554+0000","last_became_peered":"2023-10-09T12:00:28.383554+0000","last_unstale":"2023-10-09T12:00:28.390202+0000","last_undegraded":"2023-10-09T12:00:28.390202+0000","last_fullsized":"2023-10-09T12:00:28.390202+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:45.230666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.403148+0000","last_change":"2023-10-09T12:00:28.399389+0000","last_active":"2023-10-09T12:00:28.403148+0000","last_peered":"2023-10-09T12:00:28.403148+0000","last_clean":"2023-10-09T12:00:28.403148+0000","last_became_active":"2023-10-09T12:00:28.399067+0000","last_became_peered":"2023-10-09T12:00:28.399067+0000","last_unstale":"2023-10-09T12:00:28.403148+0000","last_undegraded":"2023-10-09T12:00:28.403148+0000","last_fullsized":"2023-10-09T12:00:28.403148+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:00.155083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393256+0000","last_change":"2023-10-09T12:00:28.388606+0000","last_active":"2023-10-09T12:00:28.393256+0000","last_peered":"2023-10-09T12:00:28.393256+0000","last_clean":"2023-10-09T12:00:28.393256+0000","last_became_active":"2023-10-09T12:00:28.388340+0000","last_became_peered":"2023-10-09T12:00:28.388340+0000","last_unstale":"2023-10-09T12:00:28.393256+0000","last_undegraded":"2023-10-09T12:00:28.393256+0000","last_fullsized":"2023-10-09T12:00:28.393256+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:19.489101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394521+0000","last_change":"2023-10-09T12:00:28.392436+0000","last_active":"2023-10-09T12:00:28.394521+0000","last_peered":"2023-10-09T12:00:28.394521+0000","last_clean":"2023-10-09T12:00:28.394521+0000","last_became_active":"2023-10-09T12:00:28.392172+0000","last_became_peered":"2023-10-09T12:00:28.392172+0000","last_unstale":"2023-10-09T12:00:28.394521+0000","last_undegraded":"2023-10-09T12:00:28.394521+0000","last_fullsized":"2023-10-09T12:00:28.394521+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:36.067308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399252+0000","last_change":"2023-10-09T12:00:28.396396+0000","last_active":"2023-10-09T12:00:28.399252+0000","last_peered":"2023-10-09T12:00:28.399252+0000","last_clean":"2023-10-09T12:00:28.399252+0000","last_became_active":"2023-10-09T12:00:28.393705+0000","last_became_peered":"2023-10-09T12:00:28.393705+0000","last_unstale":"2023-10-09T12:00:28.399252+0000","last_undegraded":"2023-10-09T12:00:28.399252+0000","last_fullsized":"2023-10-09T12:00:28.399252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:10.967658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401104+0000","last_change":"2023-10-09T12:00:28.395411+0000","last_active":"2023-10-09T12:00:28.401104+0000","last_peered":"2023-10-09T12:00:28.401104+0000","last_clean":"2023-10-09T12:00:28.401104+0000","last_became_active":"2023-10-09T12:00:28.395135+0000","last_became_peered":"2023-10-09T12:00:28.395135+0000","last_unstale":"2023-10-09T12:00:28.401104+0000","last_undegraded":"2023-10-09T12:00:28.401104+0000","last_fullsized":"2023-10-09T12:00:28.401104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:02.072933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398620+0000","last_change":"2023-10-09T12:00:28.393145+0000","last_active":"2023-10-09T12:00:28.398620+0000","last_peered":"2023-10-09T12:00:28.398620+0000","last_clean":"2023-10-09T12:00:28.398620+0000","last_became_active":"2023-10-09T12:00:28.392908+0000","last_became_peered":"2023-10-09T12:00:28.392908+0000","last_unstale":"2023-10-09T12:00:28.398620+0000","last_undegraded":"2023-10-09T12:00:28.398620+0000","last_fullsized":"2023-10-09T12:00:28.398620+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:41.714587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.404420+0000","last_change":"2023-10-09T12:00:28.401776+0000","last_active":"2023-10-09T12:00:28.404420+0000","last_peered":"2023-10-09T12:00:28.404420+0000","last_clean":"2023-10-09T12:00:28.404420+0000","last_became_active":"2023-10-09T12:00:28.401359+0000","last_became_peered":"2023-10-09T12:00:28.401359+0000","last_unstale":"2023-10-09T12:00:28.404420+0000","last_undegraded":"2023-10-09T12:00:28.404420+0000","last_fullsized":"2023-10-09T12:00:28.404420+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:54.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400897+0000","last_change":"2023-10-09T12:00:28.395440+0000","last_active":"2023-10-09T12:00:28.400897+0000","last_peered":"2023-10-09T12:00:28.400897+0000","last_clean":"2023-10-09T12:00:28.400897+0000","last_became_active":"2023-10-09T12:00:28.395153+0000","last_became_peered":"2023-10-09T12:00:28.395153+0000","last_unstale":"2023-10-09T12:00:28.400897+0000","last_undegraded":"2023-10-09T12:00:28.400897+0000","last_fullsized":"2023-10-09T12:00:28.400897+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:31.446323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396352+0000","last_change":"2023-10-09T12:00:28.394198+0000","last_active":"2023-10-09T12:00:28.396352+0000","last_peered":"2023-10-09T12:00:28.396352+0000","last_clean":"2023-10-09T12:00:28.396352+0000","last_became_active":"2023-10-09T12:00:28.393693+0000","last_became_peered":"2023-10-09T12:00:28.393693+0000","last_unstale":"2023-10-09T12:00:28.396352+0000","last_undegraded":"2023-10-09T12:00:28.396352+0000","last_fullsized":"2023-10-09T12:00:28.396352+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:23.829767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394801+0000","last_change":"2023-10-09T12:00:28.389015+0000","last_active":"2023-10-09T12:00:28.394801+0000","last_peered":"2023-10-09T12:00:28.394801+0000","last_clean":"2023-10-09T12:00:28.394801+0000","last_became_active":"2023-10-09T12:00:28.388767+0000","last_became_peered":"2023-10-09T12:00:28.388767+0000","last_unstale":"2023-10-09T12:00:28.394801+0000","last_undegraded":"2023-10-09T12:00:28.394801+0000","last_fullsized":"2023-10-09T12:00:28.394801+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:11:11.612556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.384577+0000","last_change":"2023-10-09T12:00:28.381383+0000","last_active":"2023-10-09T12:00:28.384577+0000","last_peered":"2023-10-09T12:00:28.384577+0000","last_clean":"2023-10-09T12:00:28.384577+0000","last_became_active":"2023-10-09T12:00:28.381019+0000","last_became_peered":"2023-10-09T12:00:28.381019+0000","last_unstale":"2023-10-09T12:00:28.384577+0000","last_undegraded":"2023-10-09T12:00:28.384577+0000","last_fullsized":"2023-10-09T12:00:28.384577+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:12.594584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.407867+0000","last_change":"2023-10-09T12:00:27.383625+0000","last_active":"2023-10-09T12:00:28.407867+0000","last_peered":"2023-10-09T12:00:28.407867+0000","last_clean":"2023-10-09T12:00:28.407867+0000","last_became_active":"2023-10-09T12:00:27.383259+0000","last_became_peered":"2023-10-09T12:00:27.383259+0000","last_unstale":"2023-10-09T12:00:28.407867+0000","last_undegraded":"2023-10-09T12:00:28.407867+0000","last_fullsized":"2023-10-09T12:00:28.407867+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:17.020206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.392321+0000","last_change":"2023-10-09T12:00:28.391115+0000","last_active":"2023-10-09T12:00:28.392321+0000","last_peered":"2023-10-09T12:00:28.392321+0000","last_clean":"2023-10-09T12:00:28.392321+0000","last_became_active":"2023-10-09T12:00:28.390767+0000","last_became_peered":"2023-10-09T12:00:28.390767+0000","last_unstale":"2023-10-09T12:00:28.392321+0000","last_undegraded":"2023-10-09T12:00:28.392321+0000","last_fullsized":"2023-10-09T12:00:28.392321+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:45.654030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.408213+0000","last_change":"2023-10-09T12:00:27.379527+0000","last_active":"2023-10-09T12:00:28.408213+0000","last_peered":"2023-10-09T12:00:28.408213+0000","last_clean":"2023-10-09T12:00:28.408213+0000","last_became_active":"2023-10-09T12:00:27.379268+0000","last_became_peered":"2023-10-09T12:00:27.379268+0000","last_unstale":"2023-10-09T12:00:28.408213+0000","last_undegraded":"2023-10-09T12:00:28.408213+0000","last_fullsized":"2023-10-09T12:00:28.408213+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:49.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395126+0000","last_change":"2023-10-09T12:00:28.388399+0000","last_active":"2023-10-09T12:00:28.395126+0000","last_peered":"2023-10-09T12:00:28.395126+0000","last_clean":"2023-10-09T12:00:28.395126+0000","last_became_active":"2023-10-09T12:00:28.388128+0000","last_became_peered":"2023-10-09T12:00:28.388128+0000","last_unstale":"2023-10-09T12:00:28.395126+0000","last_undegraded":"2023-10-09T12:00:28.395126+0000","last_fullsized":"2023-10-09T12:00:28.395126+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:53.092713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.413383+0000","last_change":"2023-10-09T12:00:27.380522+0000","last_active":"2023-10-09T12:00:28.413383+0000","last_peered":"2023-10-09T12:00:28.413383+0000","last_clean":"2023-10-09T12:00:28.413383+0000","last_became_active":"2023-10-09T12:00:27.380270+0000","last_became_peered":"2023-10-09T12:00:27.380270+0000","last_unstale":"2023-10-09T12:00:28.413383+0000","last_undegraded":"2023-10-09T12:00:28.413383+0000","last_fullsized":"2023-10-09T12:00:28.413383+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:43.278528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394834+0000","last_change":"2023-10-09T12:00:28.391611+0000","last_active":"2023-10-09T12:00:28.394834+0000","last_peered":"2023-10-09T12:00:28.394834+0000","last_clean":"2023-10-09T12:00:28.394834+0000","last_became_active":"2023-10-09T12:00:28.391017+0000","last_became_peered":"2023-10-09T12:00:28.391017+0000","last_unstale":"2023-10-09T12:00:28.394834+0000","last_undegraded":"2023-10-09T12:00:28.394834+0000","last_fullsized":"2023-10-09T12:00:28.394834+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:07.829098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.415964+0000","last_change":"2023-10-09T12:00:27.380118+0000","last_active":"2023-10-09T12:00:28.415964+0000","last_peered":"2023-10-09T12:00:28.415964+0000","last_clean":"2023-10-09T12:00:28.415964+0000","last_became_active":"2023-10-09T12:00:27.379847+0000","last_became_peered":"2023-10-09T12:00:27.379847+0000","last_unstale":"2023-10-09T12:00:28.415964+0000","last_undegraded":"2023-10-09T12:00:28.415964+0000","last_fullsized":"2023-10-09T12:00:28.415964+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:15.566815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396302+0000","last_change":"2023-10-09T12:00:28.392794+0000","last_active":"2023-10-09T12:00:28.396302+0000","last_peered":"2023-10-09T12:00:28.396302+0000","last_clean":"2023-10-09T12:00:28.396302+0000","last_became_active":"2023-10-09T12:00:28.392539+0000","last_became_peered":"2023-10-09T12:00:28.392539+0000","last_unstale":"2023-10-09T12:00:28.396302+0000","last_undegraded":"2023-10-09T12:00:28.396302+0000","last_fullsized":"2023-10-09T12:00:28.396302+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:53.566547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.411874+0000","last_change":"2023-10-09T12:00:27.380055+0000","last_active":"2023-10-09T12:00:28.411874+0000","last_peered":"2023-10-09T12:00:28.411874+0000","last_clean":"2023-10-09T12:00:28.411874+0000","last_became_active":"2023-10-09T12:00:27.379792+0000","last_became_peered":"2023-10-09T12:00:27.379792+0000","last_unstale":"2023-10-09T12:00:28.411874+0000","last_undegraded":"2023-10-09T12:00:28.411874+0000","last_fullsized":"2023-10-09T12:00:28.411874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:03.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394468+0000","last_change":"2023-10-09T12:00:28.391725+0000","last_active":"2023-10-09T12:00:28.394468+0000","last_peered":"2023-10-09T12:00:28.394468+0000","last_clean":"2023-10-09T12:00:28.394468+0000","last_became_active":"2023-10-09T12:00:28.391443+0000","last_became_peered":"2023-10-09T12:00:28.391443+0000","last_unstale":"2023-10-09T12:00:28.394468+0000","last_undegraded":"2023-10-09T12:00:28.394468+0000","last_fullsized":"2023-10-09T12:00:28.394468+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:31.851605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.413660+0000","last_change":"2023-10-09T12:00:27.374156+0000","last_active":"2023-10-09T12:00:28.413660+0000","last_peered":"2023-10-09T12:00:28.413660+0000","last_clean":"2023-10-09T12:00:28.413660+0000","last_became_active":"2023-10-09T12:00:27.373926+0000","last_became_peered":"2023-10-09T12:00:27.373926+0000","last_unstale":"2023-10-09T12:00:28.413660+0000","last_undegraded":"2023-10-09T12:00:28.413660+0000","last_fullsized":"2023-10-09T12:00:28.413660+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:02.930389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396348+0000","last_change":"2023-10-09T12:00:28.392090+0000","last_active":"2023-10-09T12:00:28.396348+0000","last_peered":"2023-10-09T12:00:28.396348+0000","last_clean":"2023-10-09T12:00:28.396348+0000","last_became_active":"2023-10-09T12:00:28.391825+0000","last_became_peered":"2023-10-09T12:00:28.391825+0000","last_unstale":"2023-10-09T12:00:28.396348+0000","last_undegraded":"2023-10-09T12:00:28.396348+0000","last_fullsized":"2023-10-09T12:00:28.396348+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:12.756113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.383467+0000","last_change":"2023-10-09T12:00:27.377605+0000","last_active":"2023-10-09T12:00:28.383467+0000","last_peered":"2023-10-09T12:00:28.383467+0000","last_clean":"2023-10-09T12:00:28.383467+0000","last_became_active":"2023-10-09T12:00:27.377282+0000","last_became_peered":"2023-10-09T12:00:27.377282+0000","last_unstale":"2023-10-09T12:00:28.383467+0000","last_undegraded":"2023-10-09T12:00:28.383467+0000","last_fullsized":"2023-10-09T12:00:28.383467+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:12.516018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401004+0000","last_change":"2023-10-09T12:00:28.395253+0000","last_active":"2023-10-09T12:00:28.401004+0000","last_peered":"2023-10-09T12:00:28.401004+0000","last_clean":"2023-10-09T12:00:28.401004+0000","last_became_active":"2023-10-09T12:00:28.394982+0000","last_became_peered":"2023-10-09T12:00:28.394982+0000","last_unstale":"2023-10-09T12:00:28.401004+0000","last_undegraded":"2023-10-09T12:00:28.401004+0000","last_fullsized":"2023-10-09T12:00:28.401004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:34.564989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.380731+0000","last_change":"2023-10-09T12:00:27.378312+0000","last_active":"2023-10-09T12:00:28.380731+0000","last_peered":"2023-10-09T12:00:28.380731+0000","last_clean":"2023-10-09T12:00:28.380731+0000","last_became_active":"2023-10-09T12:00:27.376005+0000","last_became_peered":"2023-10-09T12:00:27.376005+0000","last_unstale":"2023-10-09T12:00:28.380731+0000","last_undegraded":"2023-10-09T12:00:28.380731+0000","last_fullsized":"2023-10-09T12:00:28.380731+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:30.878360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402320+0000","last_change":"2023-10-09T12:00:28.398392+0000","last_active":"2023-10-09T12:00:28.402320+0000","last_peered":"2023-10-09T12:00:28.402320+0000","last_clean":"2023-10-09T12:00:28.402320+0000","last_became_active":"2023-10-09T12:00:28.397883+0000","last_became_peered":"2023-10-09T12:00:28.397883+0000","last_unstale":"2023-10-09T12:00:28.402320+0000","last_undegraded":"2023-10-09T12:00:28.402320+0000","last_fullsized":"2023-10-09T12:00:28.402320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:03.297354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.374958+0000","last_change":"2023-10-09T12:00:27.380426+0000","last_active":"2023-10-09T12:00:28.374958+0000","last_peered":"2023-10-09T12:00:28.374958+0000","last_clean":"2023-10-09T12:00:28.374958+0000","last_became_active":"2023-10-09T12:00:27.380160+0000","last_became_peered":"2023-10-09T12:00:27.380160+0000","last_unstale":"2023-10-09T12:00:28.374958+0000","last_undegraded":"2023-10-09T12:00:28.374958+0000","last_fullsized":"2023-10-09T12:00:28.374958+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:22.024683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401925+0000","last_change":"2023-10-09T12:00:28.400374+0000","last_active":"2023-10-09T12:00:28.401925+0000","last_peered":"2023-10-09T12:00:28.401925+0000","last_clean":"2023-10-09T12:00:28.401925+0000","last_became_active":"2023-10-09T12:00:28.400052+0000","last_became_peered":"2023-10-09T12:00:28.400052+0000","last_unstale":"2023-10-09T12:00:28.401925+0000","last_undegraded":"2023-10-09T12:00:28.401925+0000","last_fullsized":"2023-10-09T12:00:28.401925+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:38.455403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.375219+0000","last_change":"2023-10-09T12:00:27.378225+0000","last_active":"2023-10-09T12:00:28.375219+0000","last_peered":"2023-10-09T12:00:28.375219+0000","last_clean":"2023-10-09T12:00:28.375219+0000","last_became_active":"2023-10-09T12:00:27.377961+0000","last_became_peered":"2023-10-09T12:00:27.377961+0000","last_unstale":"2023-10-09T12:00:28.375219+0000","last_undegraded":"2023-10-09T12:00:28.375219+0000","last_fullsized":"2023-10-09T12:00:28.375219+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:26.384134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393219+0000","last_change":"2023-10-09T12:00:28.390147+0000","last_active":"2023-10-09T12:00:28.393219+0000","last_peered":"2023-10-09T12:00:28.393219+0000","last_clean":"2023-10-09T12:00:28.393219+0000","last_became_active":"2023-10-09T12:00:28.389908+0000","last_became_peered":"2023-10-09T12:00:28.389908+0000","last_unstale":"2023-10-09T12:00:28.393219+0000","last_undegraded":"2023-10-09T12:00:28.393219+0000","last_fullsized":"2023-10-09T12:00:28.393219+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:31.885184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.416035+0000","last_change":"2023-10-09T12:00:27.373740+0000","last_active":"2023-10-09T12:00:28.416035+0000","last_peered":"2023-10-09T12:00:28.416035+0000","last_clean":"2023-10-09T12:00:28.416035+0000","last_became_active":"2023-10-09T12:00:27.373493+0000","last_became_peered":"2023-10-09T12:00:27.373493+0000","last_unstale":"2023-10-09T12:00:28.416035+0000","last_undegraded":"2023-10-09T12:00:28.416035+0000","last_fullsized":"2023-10-09T12:00:28.416035+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:29.627753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402151+0000","last_change":"2023-10-09T12:00:28.395721+0000","last_active":"2023-10-09T12:00:28.402151+0000","last_peered":"2023-10-09T12:00:28.402151+0000","last_clean":"2023-10-09T12:00:28.402151+0000","last_became_active":"2023-10-09T12:00:28.394539+0000","last_became_peered":"2023-10-09T12:00:28.394539+0000","last_unstale":"2023-10-09T12:00:28.402151+0000","last_undegraded":"2023-10-09T12:00:28.402151+0000","last_fullsized":"2023-10-09T12:00:28.402151+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:02.594716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"138'6","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.418139+0000","last_change":"2023-10-09T12:00:27.375754+0000","last_active":"2023-10-09T12:00:28.418139+0000","last_peered":"2023-10-09T12:00:28.418139+0000","last_clean":"2023-10-09T12:00:28.418139+0000","last_became_active":"2023-10-09T12:00:27.375452+0000","last_became_peered":"2023-10-09T12:00:27.375452+0000","last_unstale":"2023-10-09T12:00:28.418139+0000","last_undegraded":"2023-10-09T12:00:28.418139+0000","last_fullsized":"2023-10-09T12:00:28.418139+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:40.707764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398378+0000","last_change":"2023-10-09T12:00:28.393823+0000","last_active":"2023-10-09T12:00:28.398378+0000","last_peered":"2023-10-09T12:00:28.398378+0000","last_clean":"2023-10-09T12:00:28.398378+0000","last_became_active":"2023-10-09T12:00:28.393537+0000","last_became_peered":"2023-10-09T12:00:28.393537+0000","last_unstale":"2023-10-09T12:00:28.398378+0000","last_undegraded":"2023-10-09T12:00:28.398378+0000","last_fullsized":"2023-10-09T12:00:28.398378+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:23.434021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.409823+0000","last_change":"2023-10-09T12:00:27.375453+0000","last_active":"2023-10-09T12:00:28.409823+0000","last_peered":"2023-10-09T12:00:28.409823+0000","last_clean":"2023-10-09T12:00:28.409823+0000","last_became_active":"2023-10-09T12:00:27.375206+0000","last_became_peered":"2023-10-09T12:00:27.375206+0000","last_unstale":"2023-10-09T12:00:28.409823+0000","last_undegraded":"2023-10-09T12:00:28.409823+0000","last_fullsized":"2023-10-09T12:00:28.409823+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:54.449599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.392974+0000","last_change":"2023-10-09T12:00:28.386269+0000","last_active":"2023-10-09T12:00:28.392974+0000","last_peered":"2023-10-09T12:00:28.392974+0000","last_clean":"2023-10-09T12:00:28.392974+0000","last_became_active":"2023-10-09T12:00:28.386015+0000","last_became_peered":"2023-10-09T12:00:28.386015+0000","last_unstale":"2023-10-09T12:00:28.392974+0000","last_undegraded":"2023-10-09T12:00:28.392974+0000","last_fullsized":"2023-10-09T12:00:28.392974+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:40.344727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.379664+0000","last_change":"2023-10-09T12:00:27.372016+0000","last_active":"2023-10-09T12:00:28.379664+0000","last_peered":"2023-10-09T12:00:28.379664+0000","last_clean":"2023-10-09T12:00:28.379664+0000","last_became_active":"2023-10-09T12:00:27.371730+0000","last_became_peered":"2023-10-09T12:00:27.371730+0000","last_unstale":"2023-10-09T12:00:28.379664+0000","last_undegraded":"2023-10-09T12:00:28.379664+0000","last_fullsized":"2023-10-09T12:00:28.379664+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.167950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395432+0000","last_change":"2023-10-09T12:00:28.390694+0000","last_active":"2023-10-09T12:00:28.395432+0000","last_peered":"2023-10-09T12:00:28.395432+0000","last_clean":"2023-10-09T12:00:28.395432+0000","last_became_active":"2023-10-09T12:00:28.390468+0000","last_became_peered":"2023-10-09T12:00:28.390468+0000","last_unstale":"2023-10-09T12:00:28.395432+0000","last_undegraded":"2023-10-09T12:00:28.395432+0000","last_fullsized":"2023-10-09T12:00:28.395432+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:21.243895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"138'8","reported_seq":18,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.416470+0000","last_change":"2023-10-09T12:00:27.375771+0000","last_active":"2023-10-09T12:00:28.416470+0000","last_peered":"2023-10-09T12:00:28.416470+0000","last_clean":"2023-10-09T12:00:28.416470+0000","last_became_active":"2023-10-09T12:00:27.375488+0000","last_became_peered":"2023-10-09T12:00:27.375488+0000","last_unstale":"2023-10-09T12:00:28.416470+0000","last_undegraded":"2023-10-09T12:00:28.416470+0000","last_fullsized":"2023-10-09T12:00:28.416470+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:14.189851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399688+0000","last_change":"2023-10-09T12:00:28.397768+0000","last_active":"2023-10-09T12:00:28.399688+0000","last_peered":"2023-10-09T12:00:28.399688+0000","last_clean":"2023-10-09T12:00:28.399688+0000","last_became_active":"2023-10-09T12:00:28.397525+0000","last_became_peered":"2023-10-09T12:00:28.397525+0000","last_unstale":"2023-10-09T12:00:28.399688+0000","last_undegraded":"2023-10-09T12:00:28.399688+0000","last_fullsized":"2023-10-09T12:00:28.399688+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:45.154194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.412957+0000","last_change":"2023-10-09T12:00:27.381084+0000","last_active":"2023-10-09T12:00:28.412957+0000","last_peered":"2023-10-09T12:00:28.412957+0000","last_clean":"2023-10-09T12:00:28.412957+0000","last_became_active":"2023-10-09T12:00:27.380835+0000","last_became_peered":"2023-10-09T12:00:27.380835+0000","last_unstale":"2023-10-09T12:00:28.412957+0000","last_undegraded":"2023-10-09T12:00:28.412957+0000","last_fullsized":"2023-10-09T12:00:28.412957+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:44.223842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401147+0000","last_change":"2023-10-09T12:00:28.397845+0000","last_active":"2023-10-09T12:00:28.401147+0000","last_peered":"2023-10-09T12:00:28.401147+0000","last_clean":"2023-10-09T12:00:28.401147+0000","last_became_active":"2023-10-09T12:00:28.397590+0000","last_became_peered":"2023-10-09T12:00:28.397590+0000","last_unstale":"2023-10-09T12:00:28.401147+0000","last_undegraded":"2023-10-09T12:00:28.401147+0000","last_fullsized":"2023-10-09T12:00:28.401147+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:47.420001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.412711+0000","last_change":"2023-10-09T12:00:27.377527+0000","last_active":"2023-10-09T12:00:28.412711+0000","last_peered":"2023-10-09T12:00:28.412711+0000","last_clean":"2023-10-09T12:00:28.412711+0000","last_became_active":"2023-10-09T12:00:27.377263+0000","last_became_peered":"2023-10-09T12:00:27.377263+0000","last_unstale":"2023-10-09T12:00:28.412711+0000","last_undegraded":"2023-10-09T12:00:28.412711+0000","last_fullsized":"2023-10-09T12:00:28.412711+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:19.400629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402522+0000","last_change":"2023-10-09T12:00:28.400099+0000","last_active":"2023-10-09T12:00:28.402522+0000","last_peered":"2023-10-09T12:00:28.402522+0000","last_clean":"2023-10-09T12:00:28.402522+0000","last_became_active":"2023-10-09T12:00:28.399666+0000","last_became_peered":"2023-10-09T12:00:28.399666+0000","last_unstale":"2023-10-09T12:00:28.402522+0000","last_undegraded":"2023-10-09T12:00:28.402522+0000","last_fullsized":"2023-10-09T12:00:28.402522+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:20.416932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.416048+0000","last_change":"2023-10-09T12:00:27.378518+0000","last_active":"2023-10-09T12:00:28.416048+0000","last_peered":"2023-10-09T12:00:28.416048+0000","last_clean":"2023-10-09T12:00:28.416048+0000","last_became_active":"2023-10-09T12:00:27.378133+0000","last_became_peered":"2023-10-09T12:00:27.378133+0000","last_unstale":"2023-10-09T12:00:28.416048+0000","last_undegraded":"2023-10-09T12:00:28.416048+0000","last_fullsized":"2023-10-09T12:00:28.416048+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:11.975971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394875+0000","last_change":"2023-10-09T12:00:28.392423+0000","last_active":"2023-10-09T12:00:28.394875+0000","last_peered":"2023-10-09T12:00:28.394875+0000","last_clean":"2023-10-09T12:00:28.394875+0000","last_became_active":"2023-10-09T12:00:28.391949+0000","last_became_peered":"2023-10-09T12:00:28.391949+0000","last_unstale":"2023-10-09T12:00:28.394875+0000","last_undegraded":"2023-10-09T12:00:28.394875+0000","last_fullsized":"2023-10-09T12:00:28.394875+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:32.264708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.383359+0000","last_change":"2023-10-09T12:00:27.384554+0000","last_active":"2023-10-09T12:00:28.383359+0000","last_peered":"2023-10-09T12:00:28.383359+0000","last_clean":"2023-10-09T12:00:28.383359+0000","last_became_active":"2023-10-09T12:00:27.384242+0000","last_became_peered":"2023-10-09T12:00:27.384242+0000","last_unstale":"2023-10-09T12:00:28.383359+0000","last_undegraded":"2023-10-09T12:00:28.383359+0000","last_fullsized":"2023-10-09T12:00:28.383359+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:46.788652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.405514+0000","last_change":"2023-10-09T12:00:28.402997+0000","last_active":"2023-10-09T12:00:28.405514+0000","last_peered":"2023-10-09T12:00:28.405514+0000","last_clean":"2023-10-09T12:00:28.405514+0000","last_became_active":"2023-10-09T12:00:28.402668+0000","last_became_peered":"2023-10-09T12:00:28.402668+0000","last_unstale":"2023-10-09T12:00:28.405514+0000","last_undegraded":"2023-10-09T12:00:28.405514+0000","last_fullsized":"2023-10-09T12:00:28.405514+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:38.455403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.411960+0000","last_change":"2023-10-09T12:00:27.374722+0000","last_active":"2023-10-09T12:00:28.411960+0000","last_peered":"2023-10-09T12:00:28.411960+0000","last_clean":"2023-10-09T12:00:28.411960+0000","last_became_active":"2023-10-09T12:00:27.374360+0000","last_became_peered":"2023-10-09T12:00:27.374360+0000","last_unstale":"2023-10-09T12:00:28.411960+0000","last_undegraded":"2023-10-09T12:00:28.411960+0000","last_fullsized":"2023-10-09T12:00:28.411960+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:41.477146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399115+0000","last_change":"2023-10-09T12:00:28.396959+0000","last_active":"2023-10-09T12:00:28.399115+0000","last_peered":"2023-10-09T12:00:28.399115+0000","last_clean":"2023-10-09T12:00:28.399115+0000","last_became_active":"2023-10-09T12:00:28.396718+0000","last_became_peered":"2023-10-09T12:00:28.396718+0000","last_unstale":"2023-10-09T12:00:28.399115+0000","last_undegraded":"2023-10-09T12:00:28.399115+0000","last_fullsized":"2023-10-09T12:00:28.399115+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:10.839734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.374616+0000","last_change":"2023-10-09T12:00:27.379728+0000","last_active":"2023-10-09T12:00:28.374616+0000","last_peered":"2023-10-09T12:00:28.374616+0000","last_clean":"2023-10-09T12:00:28.374616+0000","last_became_active":"2023-10-09T12:00:27.379386+0000","last_became_peered":"2023-10-09T12:00:27.379386+0000","last_unstale":"2023-10-09T12:00:28.374616+0000","last_undegraded":"2023-10-09T12:00:28.374616+0000","last_fullsized":"2023-10-09T12:00:28.374616+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:25.602701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390674+0000","last_change":"2023-10-09T12:00:28.389456+0000","last_active":"2023-10-09T12:00:28.390674+0000","last_peered":"2023-10-09T12:00:28.390674+0000","last_clean":"2023-10-09T12:00:28.390674+0000","last_became_active":"2023-10-09T12:00:28.388953+0000","last_became_peered":"2023-10-09T12:00:28.388953+0000","last_unstale":"2023-10-09T12:00:28.390674+0000","last_undegraded":"2023-10-09T12:00:28.390674+0000","last_fullsized":"2023-10-09T12:00:28.390674+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:45.654030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.378081+0000","last_change":"2023-10-09T12:00:27.374044+0000","last_active":"2023-10-09T12:00:28.378081+0000","last_peered":"2023-10-09T12:00:28.378081+0000","last_clean":"2023-10-09T12:00:28.378081+0000","last_became_active":"2023-10-09T12:00:27.373825+0000","last_became_peered":"2023-10-09T12:00:27.373825+0000","last_unstale":"2023-10-09T12:00:28.378081+0000","last_undegraded":"2023-10-09T12:00:28.378081+0000","last_fullsized":"2023-10-09T12:00:28.378081+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:18.403971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398651+0000","last_change":"2023-10-09T12:00:28.393807+0000","last_active":"2023-10-09T12:00:28.398651+0000","last_peered":"2023-10-09T12:00:28.398651+0000","last_clean":"2023-10-09T12:00:28.398651+0000","last_became_active":"2023-10-09T12:00:28.393560+0000","last_became_peered":"2023-10-09T12:00:28.393560+0000","last_unstale":"2023-10-09T12:00:28.398651+0000","last_undegraded":"2023-10-09T12:00:28.398651+0000","last_fullsized":"2023-10-09T12:00:28.398651+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:35.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.380824+0000","last_change":"2023-10-09T12:00:27.373283+0000","last_active":"2023-10-09T12:00:28.380824+0000","last_peered":"2023-10-09T12:00:28.380824+0000","last_clean":"2023-10-09T12:00:28.380824+0000","last_became_active":"2023-10-09T12:00:27.373036+0000","last_became_peered":"2023-10-09T12:00:27.373036+0000","last_unstale":"2023-10-09T12:00:28.380824+0000","last_undegraded":"2023-10-09T12:00:28.380824+0000","last_fullsized":"2023-10-09T12:00:28.380824+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:34.771168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400541+0000","last_change":"2023-10-09T12:00:28.398047+0000","last_active":"2023-10-09T12:00:28.400541+0000","last_peered":"2023-10-09T12:00:28.400541+0000","last_clean":"2023-10-09T12:00:28.400541+0000","last_became_active":"2023-10-09T12:00:28.397737+0000","last_became_peered":"2023-10-09T12:00:28.397737+0000","last_unstale":"2023-10-09T12:00:28.400541+0000","last_undegraded":"2023-10-09T12:00:28.400541+0000","last_fullsized":"2023-10-09T12:00:28.400541+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:20.416932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.415805+0000","last_change":"2023-10-09T12:00:27.385452+0000","last_active":"2023-10-09T12:00:28.415805+0000","last_peered":"2023-10-09T12:00:28.415805+0000","last_clean":"2023-10-09T12:00:28.415805+0000","last_became_active":"2023-10-09T12:00:27.385123+0000","last_became_peered":"2023-10-09T12:00:27.385123+0000","last_unstale":"2023-10-09T12:00:28.415805+0000","last_undegraded":"2023-10-09T12:00:28.415805+0000","last_fullsized":"2023-10-09T12:00:28.415805+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:44.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399132+0000","last_change":"2023-10-09T12:00:28.397369+0000","last_active":"2023-10-09T12:00:28.399132+0000","last_peered":"2023-10-09T12:00:28.399132+0000","last_clean":"2023-10-09T12:00:28.399132+0000","last_became_active":"2023-10-09T12:00:28.397095+0000","last_became_peered":"2023-10-09T12:00:28.397095+0000","last_unstale":"2023-10-09T12:00:28.399132+0000","last_undegraded":"2023-10-09T12:00:28.399132+0000","last_fullsized":"2023-10-09T12:00:28.399132+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:48.364473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.379945+0000","last_change":"2023-10-09T12:00:27.376650+0000","last_active":"2023-10-09T12:00:28.379945+0000","last_peered":"2023-10-09T12:00:28.379945+0000","last_clean":"2023-10-09T12:00:28.379945+0000","last_became_active":"2023-10-09T12:00:27.376374+0000","last_became_peered":"2023-10-09T12:00:27.376374+0000","last_unstale":"2023-10-09T12:00:28.379945+0000","last_undegraded":"2023-10-09T12:00:28.379945+0000","last_fullsized":"2023-10-09T12:00:28.379945+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:35.060485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.410777+0000","last_change":"2023-10-09T12:00:28.402678+0000","last_active":"2023-10-09T12:00:28.410777+0000","last_peered":"2023-10-09T12:00:28.410777+0000","last_clean":"2023-10-09T12:00:28.410777+0000","last_became_active":"2023-10-09T12:00:28.402421+0000","last_became_peered":"2023-10-09T12:00:28.402421+0000","last_unstale":"2023-10-09T12:00:28.410777+0000","last_undegraded":"2023-10-09T12:00:28.410777+0000","last_fullsized":"2023-10-09T12:00:28.410777+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:51.680088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.384743+0000","last_change":"2023-10-09T12:00:27.381879+0000","last_active":"2023-10-09T12:00:28.384743+0000","last_peered":"2023-10-09T12:00:28.384743+0000","last_clean":"2023-10-09T12:00:28.384743+0000","last_became_active":"2023-10-09T12:00:27.381614+0000","last_became_peered":"2023-10-09T12:00:27.381614+0000","last_unstale":"2023-10-09T12:00:28.384743+0000","last_undegraded":"2023-10-09T12:00:28.384743+0000","last_fullsized":"2023-10-09T12:00:28.384743+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:22.427197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401991+0000","last_change":"2023-10-09T12:00:28.398586+0000","last_active":"2023-10-09T12:00:28.401991+0000","last_peered":"2023-10-09T12:00:28.401991+0000","last_clean":"2023-10-09T12:00:28.401991+0000","last_became_active":"2023-10-09T12:00:28.398322+0000","last_became_peered":"2023-10-09T12:00:28.398322+0000","last_unstale":"2023-10-09T12:00:28.401991+0000","last_undegraded":"2023-10-09T12:00:28.401991+0000","last_fullsized":"2023-10-09T12:00:28.401991+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:00.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.375874+0000","last_change":"2023-10-09T12:00:27.373361+0000","last_active":"2023-10-09T12:00:28.375874+0000","last_peered":"2023-10-09T12:00:28.375874+0000","last_clean":"2023-10-09T12:00:28.375874+0000","last_became_active":"2023-10-09T12:00:27.373121+0000","last_became_peered":"2023-10-09T12:00:27.373121+0000","last_unstale":"2023-10-09T12:00:28.375874+0000","last_undegraded":"2023-10-09T12:00:28.375874+0000","last_fullsized":"2023-10-09T12:00:28.375874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:15.088429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393732+0000","last_change":"2023-10-09T12:00:28.389552+0000","last_active":"2023-10-09T12:00:28.393732+0000","last_peered":"2023-10-09T12:00:28.393732+0000","last_clean":"2023-10-09T12:00:28.393732+0000","last_became_active":"2023-10-09T12:00:28.389273+0000","last_became_peered":"2023-10-09T12:00:28.389273+0000","last_unstale":"2023-10-09T12:00:28.393732+0000","last_undegraded":"2023-10-09T12:00:28.393732+0000","last_fullsized":"2023-10-09T12:00:28.393732+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:47.244776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.384081+0000","last_change":"2023-10-09T12:00:27.381451+0000","last_active":"2023-10-09T12:00:28.384081+0000","last_peered":"2023-10-09T12:00:28.384081+0000","last_clean":"2023-10-09T12:00:28.384081+0000","last_became_active":"2023-10-09T12:00:27.381142+0000","last_became_peered":"2023-10-09T12:00:27.381142+0000","last_unstale":"2023-10-09T12:00:28.384081+0000","last_undegraded":"2023-10-09T12:00:28.384081+0000","last_fullsized":"2023-10-09T12:00:28.384081+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:39.507109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393718+0000","last_change":"2023-10-09T12:00:28.388892+0000","last_active":"2023-10-09T12:00:28.393718+0000","last_peered":"2023-10-09T12:00:28.393718+0000","last_clean":"2023-10-09T12:00:28.393718+0000","last_became_active":"2023-10-09T12:00:28.388417+0000","last_became_peered":"2023-10-09T12:00:28.388417+0000","last_unstale":"2023-10-09T12:00:28.393718+0000","last_undegraded":"2023-10-09T12:00:28.393718+0000","last_fullsized":"2023-10-09T12:00:28.393718+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:52.691048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.383314+0000","last_change":"2023-10-09T12:00:27.371638+0000","last_active":"2023-10-09T12:00:28.383314+0000","last_peered":"2023-10-09T12:00:28.383314+0000","last_clean":"2023-10-09T12:00:28.383314+0000","last_became_active":"2023-10-09T12:00:27.371368+0000","last_became_peered":"2023-10-09T12:00:27.371368+0000","last_unstale":"2023-10-09T12:00:28.383314+0000","last_undegraded":"2023-10-09T12:00:28.383314+0000","last_fullsized":"2023-10-09T12:00:28.383314+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:30.439499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390069+0000","last_change":"2023-10-09T12:00:28.387928+0000","last_active":"2023-10-09T12:00:28.390069+0000","last_peered":"2023-10-09T12:00:28.390069+0000","last_clean":"2023-10-09T12:00:28.390069+0000","last_became_active":"2023-10-09T12:00:28.387547+0000","last_became_peered":"2023-10-09T12:00:28.387547+0000","last_unstale":"2023-10-09T12:00:28.390069+0000","last_undegraded":"2023-10-09T12:00:28.390069+0000","last_fullsized":"2023-10-09T12:00:28.390069+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:00.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.374609+0000","last_change":"2023-10-09T12:00:27.378921+0000","last_active":"2023-10-09T12:00:28.374609+0000","last_peered":"2023-10-09T12:00:28.374609+0000","last_clean":"2023-10-09T12:00:28.374609+0000","last_became_active":"2023-10-09T12:00:27.378639+0000","last_became_peered":"2023-10-09T12:00:27.378639+0000","last_unstale":"2023-10-09T12:00:28.374609+0000","last_undegraded":"2023-10-09T12:00:28.374609+0000","last_fullsized":"2023-10-09T12:00:28.374609+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:35.774400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.407256+0000","last_change":"2023-10-09T12:00:28.401413+0000","last_active":"2023-10-09T12:00:28.407256+0000","last_peered":"2023-10-09T12:00:28.407256+0000","last_clean":"2023-10-09T12:00:28.407256+0000","last_became_active":"2023-10-09T12:00:28.399871+0000","last_became_peered":"2023-10-09T12:00:28.399871+0000","last_unstale":"2023-10-09T12:00:28.407256+0000","last_undegraded":"2023-10-09T12:00:28.407256+0000","last_fullsized":"2023-10-09T12:00:28.407256+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:39.005471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.380931+0000","last_change":"2023-10-09T12:00:27.373834+0000","last_active":"2023-10-09T12:00:28.380931+0000","last_peered":"2023-10-09T12:00:28.380931+0000","last_clean":"2023-10-09T12:00:28.380931+0000","last_became_active":"2023-10-09T12:00:27.373603+0000","last_became_peered":"2023-10-09T12:00:27.373603+0000","last_unstale":"2023-10-09T12:00:28.380931+0000","last_undegraded":"2023-10-09T12:00:28.380931+0000","last_fullsized":"2023-10-09T12:00:28.380931+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:39.337904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395404+0000","last_change":"2023-10-09T12:00:28.391242+0000","last_active":"2023-10-09T12:00:28.395404+0000","last_peered":"2023-10-09T12:00:28.395404+0000","last_clean":"2023-10-09T12:00:28.395404+0000","last_became_active":"2023-10-09T12:00:28.390986+0000","last_became_peered":"2023-10-09T12:00:28.390986+0000","last_unstale":"2023-10-09T12:00:28.395404+0000","last_undegraded":"2023-10-09T12:00:28.395404+0000","last_fullsized":"2023-10-09T12:00:28.395404+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:30.634576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.386416+0000","last_change":"2023-10-09T12:00:27.385248+0000","last_active":"2023-10-09T12:00:28.386416+0000","last_peered":"2023-10-09T12:00:28.386416+0000","last_clean":"2023-10-09T12:00:28.386416+0000","last_became_active":"2023-10-09T12:00:27.385046+0000","last_became_peered":"2023-10-09T12:00:27.385046+0000","last_unstale":"2023-10-09T12:00:28.386416+0000","last_undegraded":"2023-10-09T12:00:28.386416+0000","last_fullsized":"2023-10-09T12:00:28.386416+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:46.413177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":729,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.381115+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:00:28.381115+0000","last_peered":"2023-10-09T12:00:28.381115+0000","last_clean":"2023-10-09T12:00:28.381115+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:00:28.381115+0000","last_undegraded":"2023-10-09T12:00:28.381115+0000","last_fullsized":"2023-10-09T12:00:28.381115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476962,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1430680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.70999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36599999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72499999999999998,"15min":0.753},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.47799999999999998},"max":{"1min":0.79300000000000004,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.73899999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67900000000000005,"15min":0.70399999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71899999999999997,"15min":0.73599999999999999},"min":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84999999999999998,"5min":1.0209999999999999,"15min":1.048},"last":0.75800000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.80600000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.82899999999999996,"5min":0.98899999999999999,"15min":1.073},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68999999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82299999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.98599999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42999999999999999},"max":{"1min":0.69399999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.083,"15min":1.083},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90600000000000003,"5min":1.111,"15min":1.111},"last":0.97099999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303060,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068780,"statfs":{"total":96636764160,"available":96326430720,"internally_reserved":0,"allocated":1716224,"data_stored":839794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.72399999999999998},"min":{"1min":0.438,"5min":0.311,"15min":0.311},"max":{"1min":0.80900000000000005,"5min":0.97999999999999998,"15min":1.0629999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.73299999999999998},"min":{"1min":0.54600000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90100000000000002,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.70899999999999996},"min":{"1min":0.50800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82199999999999995,"5min":0.98999999999999999,"15min":1.121},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.73699999999999999},"min":{"1min":0.51700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88400000000000001,"5min":1.0049999999999999,"15min":1.216},"last":0.877}]},{"osd":2,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.752},"min":{"1min":0.55800000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.876,"5min":0.98799999999999999,"15min":1.139},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":1.0009999999999999,"15min":1.278},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69899999999999995,"15min":0.74299999999999999},"min":{"1min":0.47699999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.85599999999999998,"5min":1.042,"15min":1.1040000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68899999999999995,"15min":0.73099999999999998},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85799999999999998,"5min":0.94699999999999995,"15min":1.244},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.46100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.875,"5min":1.02,"15min":1.1060000000000001},"last":0.627},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.4750000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77100000000000002,"5min":0.92200000000000004,"15min":1.143},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.441,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93100000000000005,"5min":0.98999999999999999,"15min":1.327},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85099999999999998,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.53100000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509667,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":839848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.45700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60899999999999999,"5min":0.67900000000000005,"15min":1.0580000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.34699999999999998,"15min":0.25},"max":{"1min":0.623,"5min":1.079,"15min":1.079},"last":0.45800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.28399999999999997},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.99099999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"max":{"1min":0.61699999999999999,"5min":0.76800000000000002,"15min":1.099},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":1.044,"15min":1.1779999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.046},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.78800000000000003},"min":{"1min":0.57699999999999996,"5min":0.51200000000000001,"15min":0.45500000000000002},"max":{"1min":0.98299999999999998,"5min":1.143,"15min":1.7210000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.79000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97799999999999998,"5min":1.0660000000000001,"15min":1.552},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75600000000000001,"15min":0.78500000000000003},"min":{"1min":0.54700000000000004,"5min":0.46000000000000002,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":1.202,"15min":1.677},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.77800000000000002,"15min":0.80500000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.501},"max":{"1min":0.94499999999999995,"5min":1.103,"15min":1.778},"last":0.76500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0509999999999999,"5min":1.464,"15min":1.623},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.0429999999999999,"15min":1.708},"last":0.78900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":1.222,"15min":1.659},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.071,"5min":1.1419999999999999,"15min":1.736},"last":0.93700000000000006}]}]},{"osd":0,"up_from":14,"seq":60129542370,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1431740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26700000000000002},"max":{"1min":0.81200000000000006,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.219},"max":{"1min":0.66100000000000003,"5min":1.012,"15min":1.012},"last":0.371}]},{"osd":2,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":2.097,"15min":2.097},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.55200000000000005},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":1.282,"15min":1.282},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.39900000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.82199999999999995},"min":{"1min":0.52900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.999,"5min":1.399,"15min":1.587},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.61099999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":1.389,"15min":1.389},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.46300000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0229999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.58299999999999996,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.99399999999999999,"5min":1.1899999999999999,"15min":1.2709999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0509999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.82499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0660000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542370,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307140,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064700,"statfs":{"total":96636764160,"available":96322252800,"internally_reserved":0,"allocated":1699840,"data_stored":833032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.628,"5min":0.876,"15min":0.876},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.56399999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.57199999999999995},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.95199999999999996},"last":0.502}]},{"osd":4,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.748,"15min":0.78500000000000003},"min":{"1min":0.58799999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93899999999999995,"5min":1.0620000000000001,"15min":1.1839999999999999},"last":0.75},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.79800000000000004},"min":{"1min":0.52300000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.2629999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.61899999999999999,"5min":0.53400000000000003,"15min":0.499},"max":{"1min":0.98199999999999998,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.81799999999999995},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95199999999999996,"5min":1.1839999999999999,"15min":1.216},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"min":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54600000000000004},"max":{"1min":0.94999999999999996,"5min":1.1419999999999999,"15min":1.204},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.135,"5min":1.153,"15min":1.2310000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.82899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.079,"5min":1.111,"15min":1.155},"last":0.73799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307168,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064672,"statfs":{"total":96636764160,"available":96322224128,"internally_reserved":0,"allocated":1728512,"data_stored":841330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.627,"5min":0.91300000000000003,"15min":1.0149999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.28699999999999998,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.89500000000000002,"15min":0.95999999999999996},"last":0.33700000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.32300000000000001},"max":{"1min":0.69599999999999995,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.33700000000000002,"15min":0.317},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.876},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.36099999999999999},"max":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.308},"max":{"1min":0.68100000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80200000000000005,"15min":0.80300000000000005},"min":{"1min":0.68600000000000005,"5min":0.55800000000000005,"15min":0.54900000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.327},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.68200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.749}]},{"osd":5,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.59399999999999997,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":1.115,"5min":1.246,"15min":1.252},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.41299999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.3660000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.624,"5min":0.504,"15min":0.48199999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.2989999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.999,"5min":1.1240000000000001,"15min":1.218},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.46999999999999997},"max":{"1min":1.1359999999999999,"5min":1.25,"15min":1.333},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.60299999999999998,"5min":0.53900000000000003,"15min":0.51400000000000001},"max":{"1min":1.054,"5min":1.194,"15min":1.3560000000000001},"last":0.67900000000000005}]}]},{"osd":4,"up_from":16,"seq":68719476962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311248,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060592,"statfs":{"total":96636764160,"available":96318046208,"internally_reserved":0,"allocated":1712128,"data_stored":839724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68500000000000005,"15min":0.71499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":0.98499999999999999,"15min":1.071},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69399999999999995,"15min":0.71699999999999997},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.86299999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.72699999999999998},"min":{"1min":0.50800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.091},"last":0.87},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.72899999999999998},"min":{"1min":0.50600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.89000000000000001,"5min":1.587,"15min":1.587},"last":0.85399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.72699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95899999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.747,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97099999999999997,"5min":1.419,"15min":1.419},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69699999999999995,"15min":0.72599999999999998},"min":{"1min":0.54700000000000004,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91000000000000003,"5min":1.367,"15min":1.367},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.54500000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95499999999999996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.46899999999999997,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":0.96099999999999997,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.88100000000000001,"5min":1.613,"15min":1.613},"last":0.58299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67100000000000004,"15min":0.65600000000000003},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.69999999999999996,"15min":0.69399999999999995},"min":{"1min":0.52400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.997,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":0.96799999999999997,"5min":1.484,"15min":1.484},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97899999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.97399999999999998}]}]},{"osd":5,"up_from":16,"seq":68719476962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":840300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.70599999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93600000000000005,"5min":0.97699999999999998,"15min":1.8680000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.71799999999999997},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.96199999999999997,"5min":1.014,"15min":1.9770000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.69299999999999995},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.376},"max":{"1min":0.93200000000000005,"5min":0.97599999999999998,"15min":1.0840000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66900000000000004,"15min":0.72199999999999998},"min":{"1min":0.51100000000000001,"5min":0.44600000000000001,"15min":0.40100000000000002},"max":{"1min":0.872,"5min":0.92800000000000005,"15min":2.0840000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68400000000000005,"15min":0.71499999999999997},"min":{"1min":0.496,"5min":0.435,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.909},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.71599999999999997},"min":{"1min":0.51200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89600000000000002,"5min":1.046,"15min":1.9450000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.47999999999999998,"15min":0.46899999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":2.1850000000000001},"last":0.88},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.77500000000000002},"min":{"1min":0.61299999999999999,"5min":0.52600000000000002,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.048,"15min":2.1240000000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.78700000000000003,"5min":0.84099999999999997,"15min":2.105},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.47499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":1.02,"15min":2.2669999999999999},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88100000000000001,"5min":0.995,"15min":2.0169999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.84099999999999997,"5min":0.93500000000000005,"15min":2.0350000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.0489999999999999,"15min":2.2309999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":2.2130000000000001},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:00:32.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:00:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.916+0000 7fdbe2bff700 1 Processor -- start 2023-10-09T12:00:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.916+0000 7fdbe2bff700 1 -- start start 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.917+0000 7fdbe2bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.917+0000 7fdbe2bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdbdc069560 0x7fdbdc0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.917+0000 7fdbe2bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc15a160 con 0x7fdbdc159c60 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.917+0000 7fdbe2bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc069f20 con 0x7fdbdc069560 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.917+0000 7fdbe2bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0d13a0 con 0x7fdbdc159890 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe099b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe119c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdbdc069560 0x7fdbdc0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe119c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdbdc069560 0x7fdbdc0699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:50890/0 (socket says 172.21.15.86:50890) 2023-10-09T12:00:32.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe099b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:47412/0 (socket says 172.21.15.86:47412) 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe119c700 1 -- 172.21.15.86:0/1350238435 learned_addr learned my addr 172.21.15.86:0/1350238435 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbdbfff700 1 --1- 172.21.15.86:0/1350238435 >> v1:172.21.15.135:6789/0 conn(0x7fdbdc159c60 0x7fdbdc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:60266/0 (socket says 172.21.15.86:60266) 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe099b700 1 -- 172.21.15.86:0/1350238435 >> v2:172.21.15.135:3300/0 conn(0x7fdbdc069560 msgr2=0x7fdbdc0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe099b700 1 --2- 172.21.15.86:0/1350238435 >> v2:172.21.15.135:3300/0 conn(0x7fdbdc069560 0x7fdbdc0699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe099b700 1 -- 172.21.15.86:0/1350238435 >> v1:172.21.15.135:6789/0 conn(0x7fdbdc159c60 legacy=0x7fdbdc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe099b700 1 -- 172.21.15.86:0/1350238435 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc15e140 con 0x7fdbdc159890 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.918+0000 7fdbe119c700 1 --2- 172.21.15.86:0/1350238435 >> v2:172.21.15.135:3300/0 conn(0x7fdbdc069560 0x7fdbdc0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:00:32.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.919+0000 7fdbe099b700 1 --2- 172.21.15.86:0/1350238435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc15abd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00098e0 tx=0x7fdbd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d517cbd6c63c979 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.919+0000 7fdbdb7fe700 1 -- 172.21.15.86:0/1350238435 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000b640 con 0x7fdbdc159890 2023-10-09T12:00:32.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.919+0000 7fdbdb7fe700 1 -- 172.21.15.86:0/1350238435 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd000b7a0 con 0x7fdbdc159890 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.919+0000 7fdbdb7fe700 1 -- 172.21.15.86:0/1350238435 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000bb40 con 0x7fdbdc159890 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 -- 172.21.15.86:0/1350238435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 msgr2=0x7fdbdc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/1350238435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc15abd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00098e0 tx=0x7fdbd00091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 -- 172.21.15.86:0/1350238435 shutdown_connections 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/1350238435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc15abd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/1350238435 >> v2:172.21.15.135:3300/0 conn(0x7fdbdc069560 0x7fdbdc0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 -- 172.21.15.86:0/1350238435 >> 172.21.15.86:0/1350238435 conn(0x7fdbdc068e20 msgr2=0x7fdbdc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 -- 172.21.15.86:0/1350238435 shutdown_connections 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.920+0000 7fdbe2bff700 1 -- 172.21.15.86:0/1350238435 wait complete. 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.921+0000 7fdbe2bff700 1 Processor -- start 2023-10-09T12:00:32.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.921+0000 7fdbe2bff700 1 -- start start 2023-10-09T12:00:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe2bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbdc069560 0x7fdbdc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe2bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe2bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbdc159c60 0x7fdbdc0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe2bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0b5c00 con 0x7fdbdc069560 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe2bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0b3590 con 0x7fdbdc159c60 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe2bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0b3870 con 0x7fdbdc159890 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe099b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbdc069560 0x7fdbdc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe099b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbdc069560 0x7fdbdc0c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56888/0 (socket says 172.21.15.86:56888) 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.922+0000 7fdbe099b700 1 -- 172.21.15.86:0/921388975 learned_addr learned my addr 172.21.15.86:0/921388975 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbdbfff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe119c700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbdc159c60 0x7fdbdc0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe099b700 1 -- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 msgr2=0x7fdbdc0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe099b700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe099b700 1 -- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbdc159c60 msgr2=0x7fdbdc0c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe099b700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbdc159c60 0x7fdbdc0c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe099b700 1 -- 172.21.15.86:0/921388975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4009ae0 con 0x7fdbdc069560 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbdbfff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe119c700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbdc159c60 0x7fdbdc0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe099b700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbdc069560 0x7fdbdc0c9cb0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009f80 tx=0x7fdbd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbd8ff9700 1 -- 172.21.15.86:0/921388975 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd001bd90 con 0x7fdbdc069560 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbd8ff9700 1 -- 172.21.15.86:0/921388975 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd0011420 con 0x7fdbdc069560 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbd8ff9700 1 -- 172.21.15.86:0/921388975 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00117e0 con 0x7fdbdc069560 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.923+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd0009420 con 0x7fdbdc069560 2023-10-09T12:00:32.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.924+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc0c9050 con 0x7fdbdc069560 2023-10-09T12:00:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.925+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc04c3c0 con 0x7fdbdc069560 2023-10-09T12:00:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.925+0000 7fdbd8ff9700 1 -- 172.21.15.86:0/921388975 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbd0011b90 con 0x7fdbdc069560 2023-10-09T12:00:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.927+0000 7fdbd8ff9700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdbc0066f30 0x7fdbc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:32.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.927+0000 7fdbd8ff9700 1 -- 172.21.15.86:0/921388975 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fdbd0085e10 con 0x7fdbdc069560 2023-10-09T12:00:32.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.927+0000 7fdbdbfff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdbc0066f30 0x7fdbc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:32.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.928+0000 7fdbdbfff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdbc0066f30 0x7fdbc00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc16d020 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:32.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:32.931+0000 7fdbd8ff9700 1 -- 172.21.15.86:0/921388975 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbd0089030 con 0x7fdbdc069560 2023-10-09T12:00:33.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.117+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbdc0b39b0 con 0x7fdbc0066f30 2023-10-09T12:00:33.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.125+0000 7fdbd8ff9700 1 -- 172.21.15.86:0/921388975 <== mgr.6599 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289414 (secure 0 0 0) 0x7fdbc8001cc0 con 0x7fdbc0066f30 2023-10-09T12:00:33.129 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:33.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdbc0066f30 msgr2=0x7fdbc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdbc0066f30 0x7fdbc00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc16d020 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbdc069560 msgr2=0x7fdbdc0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbdc069560 0x7fdbdc0c9cb0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009f80 tx=0x7fdbd0017000 comp rx=0 tx=0).stop 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 shutdown_connections 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdbc0066f30 0x7fdbc00693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbdc069560 0x7fdbdc0c9cb0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbdc159c60 0x7fdbdc0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 --2- 172.21.15.86:0/921388975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbdc159890 0x7fdbdc0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 >> 172.21.15.86:0/921388975 conn(0x7fdbdc068e20 msgr2=0x7fdbdc158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 shutdown_connections 2023-10-09T12:00:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.129+0000 7fdbe2bff700 1 -- 172.21.15.86:0/921388975 wait complete. 2023-10-09T12:00:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:00:33.147 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T12:00:31.756167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2446140,"kb_used_data":14588,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752528580,"statfs":{"total":773094113280,"available":770589265920,"internally_reserved":0,"allocated":14938112,"data_stored":7896448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.400795"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.397253+0000","last_change":"2023-10-09T12:00:28.394574+0000","last_active":"2023-10-09T12:00:28.397253+0000","last_peered":"2023-10-09T12:00:28.397253+0000","last_clean":"2023-10-09T12:00:28.397253+0000","last_became_active":"2023-10-09T12:00:28.394298+0000","last_became_peered":"2023-10-09T12:00:28.394298+0000","last_unstale":"2023-10-09T12:00:28.397253+0000","last_undegraded":"2023-10-09T12:00:28.397253+0000","last_fullsized":"2023-10-09T12:00:28.397253+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:25.327551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395434+0000","last_change":"2023-10-09T12:00:28.391058+0000","last_active":"2023-10-09T12:00:28.395434+0000","last_peered":"2023-10-09T12:00:28.395434+0000","last_clean":"2023-10-09T12:00:28.395434+0000","last_became_active":"2023-10-09T12:00:28.389381+0000","last_became_peered":"2023-10-09T12:00:28.389381+0000","last_unstale":"2023-10-09T12:00:28.395434+0000","last_undegraded":"2023-10-09T12:00:28.395434+0000","last_fullsized":"2023-10-09T12:00:28.395434+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:13.644755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.405397+0000","last_change":"2023-10-09T12:00:28.402711+0000","last_active":"2023-10-09T12:00:28.405397+0000","last_peered":"2023-10-09T12:00:28.405397+0000","last_clean":"2023-10-09T12:00:28.405397+0000","last_became_active":"2023-10-09T12:00:28.402393+0000","last_became_peered":"2023-10-09T12:00:28.402393+0000","last_unstale":"2023-10-09T12:00:28.405397+0000","last_undegraded":"2023-10-09T12:00:28.405397+0000","last_fullsized":"2023-10-09T12:00:28.405397+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:52.121783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399161+0000","last_change":"2023-10-09T12:00:28.395026+0000","last_active":"2023-10-09T12:00:28.399161+0000","last_peered":"2023-10-09T12:00:28.399161+0000","last_clean":"2023-10-09T12:00:28.399161+0000","last_became_active":"2023-10-09T12:00:28.394559+0000","last_became_peered":"2023-10-09T12:00:28.394559+0000","last_unstale":"2023-10-09T12:00:28.399161+0000","last_undegraded":"2023-10-09T12:00:28.399161+0000","last_fullsized":"2023-10-09T12:00:28.399161+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:19.865816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.379885+0000","last_change":"2023-10-09T12:00:28.379050+0000","last_active":"2023-10-09T12:00:28.379885+0000","last_peered":"2023-10-09T12:00:28.379885+0000","last_clean":"2023-10-09T12:00:28.379885+0000","last_became_active":"2023-10-09T12:00:28.378787+0000","last_became_peered":"2023-10-09T12:00:28.378787+0000","last_unstale":"2023-10-09T12:00:28.379885+0000","last_undegraded":"2023-10-09T12:00:28.379885+0000","last_fullsized":"2023-10-09T12:00:28.379885+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:16.799363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398868+0000","last_change":"2023-10-09T12:00:28.394714+0000","last_active":"2023-10-09T12:00:28.398868+0000","last_peered":"2023-10-09T12:00:28.398868+0000","last_clean":"2023-10-09T12:00:28.398868+0000","last_became_active":"2023-10-09T12:00:28.394443+0000","last_became_peered":"2023-10-09T12:00:28.394443+0000","last_unstale":"2023-10-09T12:00:28.398868+0000","last_undegraded":"2023-10-09T12:00:28.398868+0000","last_fullsized":"2023-10-09T12:00:28.398868+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:14.896805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400951+0000","last_change":"2023-10-09T12:00:28.394618+0000","last_active":"2023-10-09T12:00:28.400951+0000","last_peered":"2023-10-09T12:00:28.400951+0000","last_clean":"2023-10-09T12:00:28.400951+0000","last_became_active":"2023-10-09T12:00:28.394351+0000","last_became_peered":"2023-10-09T12:00:28.394351+0000","last_unstale":"2023-10-09T12:00:28.400951+0000","last_undegraded":"2023-10-09T12:00:28.400951+0000","last_fullsized":"2023-10-09T12:00:28.400951+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:13.522842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390655+0000","last_change":"2023-10-09T12:00:28.389432+0000","last_active":"2023-10-09T12:00:28.390655+0000","last_peered":"2023-10-09T12:00:28.390655+0000","last_clean":"2023-10-09T12:00:28.390655+0000","last_became_active":"2023-10-09T12:00:28.388517+0000","last_became_peered":"2023-10-09T12:00:28.388517+0000","last_unstale":"2023-10-09T12:00:28.390655+0000","last_undegraded":"2023-10-09T12:00:28.390655+0000","last_fullsized":"2023-10-09T12:00:28.390655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:15.620008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401530+0000","last_change":"2023-10-09T12:00:28.398485+0000","last_active":"2023-10-09T12:00:28.401530+0000","last_peered":"2023-10-09T12:00:28.401530+0000","last_clean":"2023-10-09T12:00:28.401530+0000","last_became_active":"2023-10-09T12:00:28.398231+0000","last_became_peered":"2023-10-09T12:00:28.398231+0000","last_unstale":"2023-10-09T12:00:28.401530+0000","last_undegraded":"2023-10-09T12:00:28.401530+0000","last_fullsized":"2023-10-09T12:00:28.401530+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:11.442519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.407259+0000","last_change":"2023-10-09T12:00:28.399827+0000","last_active":"2023-10-09T12:00:28.407259+0000","last_peered":"2023-10-09T12:00:28.407259+0000","last_clean":"2023-10-09T12:00:28.407259+0000","last_became_active":"2023-10-09T12:00:28.399447+0000","last_became_peered":"2023-10-09T12:00:28.399447+0000","last_unstale":"2023-10-09T12:00:28.407259+0000","last_undegraded":"2023-10-09T12:00:28.407259+0000","last_fullsized":"2023-10-09T12:00:28.407259+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:59.677346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393680+0000","last_change":"2023-10-09T12:00:28.388952+0000","last_active":"2023-10-09T12:00:28.393680+0000","last_peered":"2023-10-09T12:00:28.393680+0000","last_clean":"2023-10-09T12:00:28.393680+0000","last_became_active":"2023-10-09T12:00:28.388484+0000","last_became_peered":"2023-10-09T12:00:28.388484+0000","last_unstale":"2023-10-09T12:00:28.393680+0000","last_undegraded":"2023-10-09T12:00:28.393680+0000","last_fullsized":"2023-10-09T12:00:28.393680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:26.803994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402753+0000","last_change":"2023-10-09T12:00:28.399209+0000","last_active":"2023-10-09T12:00:28.402753+0000","last_peered":"2023-10-09T12:00:28.402753+0000","last_clean":"2023-10-09T12:00:28.402753+0000","last_became_active":"2023-10-09T12:00:28.398214+0000","last_became_peered":"2023-10-09T12:00:28.398214+0000","last_unstale":"2023-10-09T12:00:28.402753+0000","last_undegraded":"2023-10-09T12:00:28.402753+0000","last_fullsized":"2023-10-09T12:00:28.402753+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:39.586421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.397230+0000","last_change":"2023-10-09T12:00:28.396630+0000","last_active":"2023-10-09T12:00:28.397230+0000","last_peered":"2023-10-09T12:00:28.397230+0000","last_clean":"2023-10-09T12:00:28.397230+0000","last_became_active":"2023-10-09T12:00:28.396342+0000","last_became_peered":"2023-10-09T12:00:28.396342+0000","last_unstale":"2023-10-09T12:00:28.397230+0000","last_undegraded":"2023-10-09T12:00:28.397230+0000","last_fullsized":"2023-10-09T12:00:28.397230+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:58.105895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.389919+0000","last_change":"2023-10-09T12:00:28.387582+0000","last_active":"2023-10-09T12:00:28.389919+0000","last_peered":"2023-10-09T12:00:28.389919+0000","last_clean":"2023-10-09T12:00:28.389919+0000","last_became_active":"2023-10-09T12:00:28.387315+0000","last_became_peered":"2023-10-09T12:00:28.387315+0000","last_unstale":"2023-10-09T12:00:28.389919+0000","last_undegraded":"2023-10-09T12:00:28.389919+0000","last_fullsized":"2023-10-09T12:00:28.389919+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:43.752853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390925+0000","last_change":"2023-10-09T12:00:28.386691+0000","last_active":"2023-10-09T12:00:28.390925+0000","last_peered":"2023-10-09T12:00:28.390925+0000","last_clean":"2023-10-09T12:00:28.390925+0000","last_became_active":"2023-10-09T12:00:28.386440+0000","last_became_peered":"2023-10-09T12:00:28.386440+0000","last_unstale":"2023-10-09T12:00:28.390925+0000","last_undegraded":"2023-10-09T12:00:28.390925+0000","last_fullsized":"2023-10-09T12:00:28.390925+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:07.631980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396367+0000","last_change":"2023-10-09T12:00:28.393411+0000","last_active":"2023-10-09T12:00:28.396367+0000","last_peered":"2023-10-09T12:00:28.396367+0000","last_clean":"2023-10-09T12:00:28.396367+0000","last_became_active":"2023-10-09T12:00:28.393178+0000","last_became_peered":"2023-10-09T12:00:28.393178+0000","last_unstale":"2023-10-09T12:00:28.396367+0000","last_undegraded":"2023-10-09T12:00:28.396367+0000","last_fullsized":"2023-10-09T12:00:28.396367+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:38:19.909094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394538+0000","last_change":"2023-10-09T12:00:28.393597+0000","last_active":"2023-10-09T12:00:28.394538+0000","last_peered":"2023-10-09T12:00:28.394538+0000","last_clean":"2023-10-09T12:00:28.394538+0000","last_became_active":"2023-10-09T12:00:28.393296+0000","last_became_peered":"2023-10-09T12:00:28.393296+0000","last_unstale":"2023-10-09T12:00:28.394538+0000","last_undegraded":"2023-10-09T12:00:28.394538+0000","last_fullsized":"2023-10-09T12:00:28.394538+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:50.827398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400520+0000","last_change":"2023-10-09T12:00:28.396412+0000","last_active":"2023-10-09T12:00:28.400520+0000","last_peered":"2023-10-09T12:00:28.400520+0000","last_clean":"2023-10-09T12:00:28.400520+0000","last_became_active":"2023-10-09T12:00:28.396144+0000","last_became_peered":"2023-10-09T12:00:28.396144+0000","last_unstale":"2023-10-09T12:00:28.400520+0000","last_undegraded":"2023-10-09T12:00:28.400520+0000","last_fullsized":"2023-10-09T12:00:28.400520+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:11:06.167202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394859+0000","last_change":"2023-10-09T12:00:28.392225+0000","last_active":"2023-10-09T12:00:28.394859+0000","last_peered":"2023-10-09T12:00:28.394859+0000","last_clean":"2023-10-09T12:00:28.394859+0000","last_became_active":"2023-10-09T12:00:28.391353+0000","last_became_peered":"2023-10-09T12:00:28.391353+0000","last_unstale":"2023-10-09T12:00:28.394859+0000","last_undegraded":"2023-10-09T12:00:28.394859+0000","last_fullsized":"2023-10-09T12:00:28.394859+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:21.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.403207+0000","last_change":"2023-10-09T12:00:28.400586+0000","last_active":"2023-10-09T12:00:28.403207+0000","last_peered":"2023-10-09T12:00:28.403207+0000","last_clean":"2023-10-09T12:00:28.403207+0000","last_became_active":"2023-10-09T12:00:28.400058+0000","last_became_peered":"2023-10-09T12:00:28.400058+0000","last_unstale":"2023-10-09T12:00:28.403207+0000","last_undegraded":"2023-10-09T12:00:28.403207+0000","last_fullsized":"2023-10-09T12:00:28.403207+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:36.174774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.403193+0000","last_change":"2023-10-09T12:00:28.399666+0000","last_active":"2023-10-09T12:00:28.403193+0000","last_peered":"2023-10-09T12:00:28.403193+0000","last_clean":"2023-10-09T12:00:28.403193+0000","last_became_active":"2023-10-09T12:00:28.399357+0000","last_became_peered":"2023-10-09T12:00:28.399357+0000","last_unstale":"2023-10-09T12:00:28.403193+0000","last_undegraded":"2023-10-09T12:00:28.403193+0000","last_fullsized":"2023-10-09T12:00:28.403193+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:11:51.916912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390202+0000","last_change":"2023-10-09T12:00:28.383875+0000","last_active":"2023-10-09T12:00:28.390202+0000","last_peered":"2023-10-09T12:00:28.390202+0000","last_clean":"2023-10-09T12:00:28.390202+0000","last_became_active":"2023-10-09T12:00:28.383554+0000","last_became_peered":"2023-10-09T12:00:28.383554+0000","last_unstale":"2023-10-09T12:00:28.390202+0000","last_undegraded":"2023-10-09T12:00:28.390202+0000","last_fullsized":"2023-10-09T12:00:28.390202+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:45.230666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.403148+0000","last_change":"2023-10-09T12:00:28.399389+0000","last_active":"2023-10-09T12:00:28.403148+0000","last_peered":"2023-10-09T12:00:28.403148+0000","last_clean":"2023-10-09T12:00:28.403148+0000","last_became_active":"2023-10-09T12:00:28.399067+0000","last_became_peered":"2023-10-09T12:00:28.399067+0000","last_unstale":"2023-10-09T12:00:28.403148+0000","last_undegraded":"2023-10-09T12:00:28.403148+0000","last_fullsized":"2023-10-09T12:00:28.403148+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:00.155083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393256+0000","last_change":"2023-10-09T12:00:28.388606+0000","last_active":"2023-10-09T12:00:28.393256+0000","last_peered":"2023-10-09T12:00:28.393256+0000","last_clean":"2023-10-09T12:00:28.393256+0000","last_became_active":"2023-10-09T12:00:28.388340+0000","last_became_peered":"2023-10-09T12:00:28.388340+0000","last_unstale":"2023-10-09T12:00:28.393256+0000","last_undegraded":"2023-10-09T12:00:28.393256+0000","last_fullsized":"2023-10-09T12:00:28.393256+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:19.489101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394521+0000","last_change":"2023-10-09T12:00:28.392436+0000","last_active":"2023-10-09T12:00:28.394521+0000","last_peered":"2023-10-09T12:00:28.394521+0000","last_clean":"2023-10-09T12:00:28.394521+0000","last_became_active":"2023-10-09T12:00:28.392172+0000","last_became_peered":"2023-10-09T12:00:28.392172+0000","last_unstale":"2023-10-09T12:00:28.394521+0000","last_undegraded":"2023-10-09T12:00:28.394521+0000","last_fullsized":"2023-10-09T12:00:28.394521+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:36.067308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399252+0000","last_change":"2023-10-09T12:00:28.396396+0000","last_active":"2023-10-09T12:00:28.399252+0000","last_peered":"2023-10-09T12:00:28.399252+0000","last_clean":"2023-10-09T12:00:28.399252+0000","last_became_active":"2023-10-09T12:00:28.393705+0000","last_became_peered":"2023-10-09T12:00:28.393705+0000","last_unstale":"2023-10-09T12:00:28.399252+0000","last_undegraded":"2023-10-09T12:00:28.399252+0000","last_fullsized":"2023-10-09T12:00:28.399252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:10.967658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401104+0000","last_change":"2023-10-09T12:00:28.395411+0000","last_active":"2023-10-09T12:00:28.401104+0000","last_peered":"2023-10-09T12:00:28.401104+0000","last_clean":"2023-10-09T12:00:28.401104+0000","last_became_active":"2023-10-09T12:00:28.395135+0000","last_became_peered":"2023-10-09T12:00:28.395135+0000","last_unstale":"2023-10-09T12:00:28.401104+0000","last_undegraded":"2023-10-09T12:00:28.401104+0000","last_fullsized":"2023-10-09T12:00:28.401104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:02.072933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398620+0000","last_change":"2023-10-09T12:00:28.393145+0000","last_active":"2023-10-09T12:00:28.398620+0000","last_peered":"2023-10-09T12:00:28.398620+0000","last_clean":"2023-10-09T12:00:28.398620+0000","last_became_active":"2023-10-09T12:00:28.392908+0000","last_became_peered":"2023-10-09T12:00:28.392908+0000","last_unstale":"2023-10-09T12:00:28.398620+0000","last_undegraded":"2023-10-09T12:00:28.398620+0000","last_fullsized":"2023-10-09T12:00:28.398620+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:41.714587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.404420+0000","last_change":"2023-10-09T12:00:28.401776+0000","last_active":"2023-10-09T12:00:28.404420+0000","last_peered":"2023-10-09T12:00:28.404420+0000","last_clean":"2023-10-09T12:00:28.404420+0000","last_became_active":"2023-10-09T12:00:28.401359+0000","last_became_peered":"2023-10-09T12:00:28.401359+0000","last_unstale":"2023-10-09T12:00:28.404420+0000","last_undegraded":"2023-10-09T12:00:28.404420+0000","last_fullsized":"2023-10-09T12:00:28.404420+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:54.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400897+0000","last_change":"2023-10-09T12:00:28.395440+0000","last_active":"2023-10-09T12:00:28.400897+0000","last_peered":"2023-10-09T12:00:28.400897+0000","last_clean":"2023-10-09T12:00:28.400897+0000","last_became_active":"2023-10-09T12:00:28.395153+0000","last_became_peered":"2023-10-09T12:00:28.395153+0000","last_unstale":"2023-10-09T12:00:28.400897+0000","last_undegraded":"2023-10-09T12:00:28.400897+0000","last_fullsized":"2023-10-09T12:00:28.400897+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:31.446323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396352+0000","last_change":"2023-10-09T12:00:28.394198+0000","last_active":"2023-10-09T12:00:28.396352+0000","last_peered":"2023-10-09T12:00:28.396352+0000","last_clean":"2023-10-09T12:00:28.396352+0000","last_became_active":"2023-10-09T12:00:28.393693+0000","last_became_peered":"2023-10-09T12:00:28.393693+0000","last_unstale":"2023-10-09T12:00:28.396352+0000","last_undegraded":"2023-10-09T12:00:28.396352+0000","last_fullsized":"2023-10-09T12:00:28.396352+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:23.829767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394801+0000","last_change":"2023-10-09T12:00:28.389015+0000","last_active":"2023-10-09T12:00:28.394801+0000","last_peered":"2023-10-09T12:00:28.394801+0000","last_clean":"2023-10-09T12:00:28.394801+0000","last_became_active":"2023-10-09T12:00:28.388767+0000","last_became_peered":"2023-10-09T12:00:28.388767+0000","last_unstale":"2023-10-09T12:00:28.394801+0000","last_undegraded":"2023-10-09T12:00:28.394801+0000","last_fullsized":"2023-10-09T12:00:28.394801+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:11:11.612556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.384577+0000","last_change":"2023-10-09T12:00:28.381383+0000","last_active":"2023-10-09T12:00:28.384577+0000","last_peered":"2023-10-09T12:00:28.384577+0000","last_clean":"2023-10-09T12:00:28.384577+0000","last_became_active":"2023-10-09T12:00:28.381019+0000","last_became_peered":"2023-10-09T12:00:28.381019+0000","last_unstale":"2023-10-09T12:00:28.384577+0000","last_undegraded":"2023-10-09T12:00:28.384577+0000","last_fullsized":"2023-10-09T12:00:28.384577+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:57:12.594584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.407867+0000","last_change":"2023-10-09T12:00:27.383625+0000","last_active":"2023-10-09T12:00:28.407867+0000","last_peered":"2023-10-09T12:00:28.407867+0000","last_clean":"2023-10-09T12:00:28.407867+0000","last_became_active":"2023-10-09T12:00:27.383259+0000","last_became_peered":"2023-10-09T12:00:27.383259+0000","last_unstale":"2023-10-09T12:00:28.407867+0000","last_undegraded":"2023-10-09T12:00:28.407867+0000","last_fullsized":"2023-10-09T12:00:28.407867+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:17.020206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.392321+0000","last_change":"2023-10-09T12:00:28.391115+0000","last_active":"2023-10-09T12:00:28.392321+0000","last_peered":"2023-10-09T12:00:28.392321+0000","last_clean":"2023-10-09T12:00:28.392321+0000","last_became_active":"2023-10-09T12:00:28.390767+0000","last_became_peered":"2023-10-09T12:00:28.390767+0000","last_unstale":"2023-10-09T12:00:28.392321+0000","last_undegraded":"2023-10-09T12:00:28.392321+0000","last_fullsized":"2023-10-09T12:00:28.392321+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:45.654030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.408213+0000","last_change":"2023-10-09T12:00:27.379527+0000","last_active":"2023-10-09T12:00:28.408213+0000","last_peered":"2023-10-09T12:00:28.408213+0000","last_clean":"2023-10-09T12:00:28.408213+0000","last_became_active":"2023-10-09T12:00:27.379268+0000","last_became_peered":"2023-10-09T12:00:27.379268+0000","last_unstale":"2023-10-09T12:00:28.408213+0000","last_undegraded":"2023-10-09T12:00:28.408213+0000","last_fullsized":"2023-10-09T12:00:28.408213+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:03:49.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395126+0000","last_change":"2023-10-09T12:00:28.388399+0000","last_active":"2023-10-09T12:00:28.395126+0000","last_peered":"2023-10-09T12:00:28.395126+0000","last_clean":"2023-10-09T12:00:28.395126+0000","last_became_active":"2023-10-09T12:00:28.388128+0000","last_became_peered":"2023-10-09T12:00:28.388128+0000","last_unstale":"2023-10-09T12:00:28.395126+0000","last_undegraded":"2023-10-09T12:00:28.395126+0000","last_fullsized":"2023-10-09T12:00:28.395126+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:53.092713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.413383+0000","last_change":"2023-10-09T12:00:27.380522+0000","last_active":"2023-10-09T12:00:28.413383+0000","last_peered":"2023-10-09T12:00:28.413383+0000","last_clean":"2023-10-09T12:00:28.413383+0000","last_became_active":"2023-10-09T12:00:27.380270+0000","last_became_peered":"2023-10-09T12:00:27.380270+0000","last_unstale":"2023-10-09T12:00:28.413383+0000","last_undegraded":"2023-10-09T12:00:28.413383+0000","last_fullsized":"2023-10-09T12:00:28.413383+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:43.278528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394834+0000","last_change":"2023-10-09T12:00:28.391611+0000","last_active":"2023-10-09T12:00:28.394834+0000","last_peered":"2023-10-09T12:00:28.394834+0000","last_clean":"2023-10-09T12:00:28.394834+0000","last_became_active":"2023-10-09T12:00:28.391017+0000","last_became_peered":"2023-10-09T12:00:28.391017+0000","last_unstale":"2023-10-09T12:00:28.394834+0000","last_undegraded":"2023-10-09T12:00:28.394834+0000","last_fullsized":"2023-10-09T12:00:28.394834+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:31:07.829098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.415964+0000","last_change":"2023-10-09T12:00:27.380118+0000","last_active":"2023-10-09T12:00:28.415964+0000","last_peered":"2023-10-09T12:00:28.415964+0000","last_clean":"2023-10-09T12:00:28.415964+0000","last_became_active":"2023-10-09T12:00:27.379847+0000","last_became_peered":"2023-10-09T12:00:27.379847+0000","last_unstale":"2023-10-09T12:00:28.415964+0000","last_undegraded":"2023-10-09T12:00:28.415964+0000","last_fullsized":"2023-10-09T12:00:28.415964+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:15.566815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396302+0000","last_change":"2023-10-09T12:00:28.392794+0000","last_active":"2023-10-09T12:00:28.396302+0000","last_peered":"2023-10-09T12:00:28.396302+0000","last_clean":"2023-10-09T12:00:28.396302+0000","last_became_active":"2023-10-09T12:00:28.392539+0000","last_became_peered":"2023-10-09T12:00:28.392539+0000","last_unstale":"2023-10-09T12:00:28.396302+0000","last_undegraded":"2023-10-09T12:00:28.396302+0000","last_fullsized":"2023-10-09T12:00:28.396302+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:53.566547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.411874+0000","last_change":"2023-10-09T12:00:27.380055+0000","last_active":"2023-10-09T12:00:28.411874+0000","last_peered":"2023-10-09T12:00:28.411874+0000","last_clean":"2023-10-09T12:00:28.411874+0000","last_became_active":"2023-10-09T12:00:27.379792+0000","last_became_peered":"2023-10-09T12:00:27.379792+0000","last_unstale":"2023-10-09T12:00:28.411874+0000","last_undegraded":"2023-10-09T12:00:28.411874+0000","last_fullsized":"2023-10-09T12:00:28.411874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:03.236810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394468+0000","last_change":"2023-10-09T12:00:28.391725+0000","last_active":"2023-10-09T12:00:28.394468+0000","last_peered":"2023-10-09T12:00:28.394468+0000","last_clean":"2023-10-09T12:00:28.394468+0000","last_became_active":"2023-10-09T12:00:28.391443+0000","last_became_peered":"2023-10-09T12:00:28.391443+0000","last_unstale":"2023-10-09T12:00:28.394468+0000","last_undegraded":"2023-10-09T12:00:28.394468+0000","last_fullsized":"2023-10-09T12:00:28.394468+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:31.851605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.413660+0000","last_change":"2023-10-09T12:00:27.374156+0000","last_active":"2023-10-09T12:00:28.413660+0000","last_peered":"2023-10-09T12:00:28.413660+0000","last_clean":"2023-10-09T12:00:28.413660+0000","last_became_active":"2023-10-09T12:00:27.373926+0000","last_became_peered":"2023-10-09T12:00:27.373926+0000","last_unstale":"2023-10-09T12:00:28.413660+0000","last_undegraded":"2023-10-09T12:00:28.413660+0000","last_fullsized":"2023-10-09T12:00:28.413660+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:02.930389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.396348+0000","last_change":"2023-10-09T12:00:28.392090+0000","last_active":"2023-10-09T12:00:28.396348+0000","last_peered":"2023-10-09T12:00:28.396348+0000","last_clean":"2023-10-09T12:00:28.396348+0000","last_became_active":"2023-10-09T12:00:28.391825+0000","last_became_peered":"2023-10-09T12:00:28.391825+0000","last_unstale":"2023-10-09T12:00:28.396348+0000","last_undegraded":"2023-10-09T12:00:28.396348+0000","last_fullsized":"2023-10-09T12:00:28.396348+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:12.756113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.383467+0000","last_change":"2023-10-09T12:00:27.377605+0000","last_active":"2023-10-09T12:00:28.383467+0000","last_peered":"2023-10-09T12:00:28.383467+0000","last_clean":"2023-10-09T12:00:28.383467+0000","last_became_active":"2023-10-09T12:00:27.377282+0000","last_became_peered":"2023-10-09T12:00:27.377282+0000","last_unstale":"2023-10-09T12:00:28.383467+0000","last_undegraded":"2023-10-09T12:00:28.383467+0000","last_fullsized":"2023-10-09T12:00:28.383467+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:12.516018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401004+0000","last_change":"2023-10-09T12:00:28.395253+0000","last_active":"2023-10-09T12:00:28.401004+0000","last_peered":"2023-10-09T12:00:28.401004+0000","last_clean":"2023-10-09T12:00:28.401004+0000","last_became_active":"2023-10-09T12:00:28.394982+0000","last_became_peered":"2023-10-09T12:00:28.394982+0000","last_unstale":"2023-10-09T12:00:28.401004+0000","last_undegraded":"2023-10-09T12:00:28.401004+0000","last_fullsized":"2023-10-09T12:00:28.401004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:34.564989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.380731+0000","last_change":"2023-10-09T12:00:27.378312+0000","last_active":"2023-10-09T12:00:28.380731+0000","last_peered":"2023-10-09T12:00:28.380731+0000","last_clean":"2023-10-09T12:00:28.380731+0000","last_became_active":"2023-10-09T12:00:27.376005+0000","last_became_peered":"2023-10-09T12:00:27.376005+0000","last_unstale":"2023-10-09T12:00:28.380731+0000","last_undegraded":"2023-10-09T12:00:28.380731+0000","last_fullsized":"2023-10-09T12:00:28.380731+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:30.878360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402320+0000","last_change":"2023-10-09T12:00:28.398392+0000","last_active":"2023-10-09T12:00:28.402320+0000","last_peered":"2023-10-09T12:00:28.402320+0000","last_clean":"2023-10-09T12:00:28.402320+0000","last_became_active":"2023-10-09T12:00:28.397883+0000","last_became_peered":"2023-10-09T12:00:28.397883+0000","last_unstale":"2023-10-09T12:00:28.402320+0000","last_undegraded":"2023-10-09T12:00:28.402320+0000","last_fullsized":"2023-10-09T12:00:28.402320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:03.297354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.374958+0000","last_change":"2023-10-09T12:00:27.380426+0000","last_active":"2023-10-09T12:00:28.374958+0000","last_peered":"2023-10-09T12:00:28.374958+0000","last_clean":"2023-10-09T12:00:28.374958+0000","last_became_active":"2023-10-09T12:00:27.380160+0000","last_became_peered":"2023-10-09T12:00:27.380160+0000","last_unstale":"2023-10-09T12:00:28.374958+0000","last_undegraded":"2023-10-09T12:00:28.374958+0000","last_fullsized":"2023-10-09T12:00:28.374958+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:22.024683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401925+0000","last_change":"2023-10-09T12:00:28.400374+0000","last_active":"2023-10-09T12:00:28.401925+0000","last_peered":"2023-10-09T12:00:28.401925+0000","last_clean":"2023-10-09T12:00:28.401925+0000","last_became_active":"2023-10-09T12:00:28.400052+0000","last_became_peered":"2023-10-09T12:00:28.400052+0000","last_unstale":"2023-10-09T12:00:28.401925+0000","last_undegraded":"2023-10-09T12:00:28.401925+0000","last_fullsized":"2023-10-09T12:00:28.401925+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:38.455403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.375219+0000","last_change":"2023-10-09T12:00:27.378225+0000","last_active":"2023-10-09T12:00:28.375219+0000","last_peered":"2023-10-09T12:00:28.375219+0000","last_clean":"2023-10-09T12:00:28.375219+0000","last_became_active":"2023-10-09T12:00:27.377961+0000","last_became_peered":"2023-10-09T12:00:27.377961+0000","last_unstale":"2023-10-09T12:00:28.375219+0000","last_undegraded":"2023-10-09T12:00:28.375219+0000","last_fullsized":"2023-10-09T12:00:28.375219+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:26.384134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393219+0000","last_change":"2023-10-09T12:00:28.390147+0000","last_active":"2023-10-09T12:00:28.393219+0000","last_peered":"2023-10-09T12:00:28.393219+0000","last_clean":"2023-10-09T12:00:28.393219+0000","last_became_active":"2023-10-09T12:00:28.389908+0000","last_became_peered":"2023-10-09T12:00:28.389908+0000","last_unstale":"2023-10-09T12:00:28.393219+0000","last_undegraded":"2023-10-09T12:00:28.393219+0000","last_fullsized":"2023-10-09T12:00:28.393219+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:31.885184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.416035+0000","last_change":"2023-10-09T12:00:27.373740+0000","last_active":"2023-10-09T12:00:28.416035+0000","last_peered":"2023-10-09T12:00:28.416035+0000","last_clean":"2023-10-09T12:00:28.416035+0000","last_became_active":"2023-10-09T12:00:27.373493+0000","last_became_peered":"2023-10-09T12:00:27.373493+0000","last_unstale":"2023-10-09T12:00:28.416035+0000","last_undegraded":"2023-10-09T12:00:28.416035+0000","last_fullsized":"2023-10-09T12:00:28.416035+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:29.627753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402151+0000","last_change":"2023-10-09T12:00:28.395721+0000","last_active":"2023-10-09T12:00:28.402151+0000","last_peered":"2023-10-09T12:00:28.402151+0000","last_clean":"2023-10-09T12:00:28.402151+0000","last_became_active":"2023-10-09T12:00:28.394539+0000","last_became_peered":"2023-10-09T12:00:28.394539+0000","last_unstale":"2023-10-09T12:00:28.402151+0000","last_undegraded":"2023-10-09T12:00:28.402151+0000","last_fullsized":"2023-10-09T12:00:28.402151+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:02.594716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"138'6","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.418139+0000","last_change":"2023-10-09T12:00:27.375754+0000","last_active":"2023-10-09T12:00:28.418139+0000","last_peered":"2023-10-09T12:00:28.418139+0000","last_clean":"2023-10-09T12:00:28.418139+0000","last_became_active":"2023-10-09T12:00:27.375452+0000","last_became_peered":"2023-10-09T12:00:27.375452+0000","last_unstale":"2023-10-09T12:00:28.418139+0000","last_undegraded":"2023-10-09T12:00:28.418139+0000","last_fullsized":"2023-10-09T12:00:28.418139+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:40.707764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398378+0000","last_change":"2023-10-09T12:00:28.393823+0000","last_active":"2023-10-09T12:00:28.398378+0000","last_peered":"2023-10-09T12:00:28.398378+0000","last_clean":"2023-10-09T12:00:28.398378+0000","last_became_active":"2023-10-09T12:00:28.393537+0000","last_became_peered":"2023-10-09T12:00:28.393537+0000","last_unstale":"2023-10-09T12:00:28.398378+0000","last_undegraded":"2023-10-09T12:00:28.398378+0000","last_fullsized":"2023-10-09T12:00:28.398378+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:23.434021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.409823+0000","last_change":"2023-10-09T12:00:27.375453+0000","last_active":"2023-10-09T12:00:28.409823+0000","last_peered":"2023-10-09T12:00:28.409823+0000","last_clean":"2023-10-09T12:00:28.409823+0000","last_became_active":"2023-10-09T12:00:27.375206+0000","last_became_peered":"2023-10-09T12:00:27.375206+0000","last_unstale":"2023-10-09T12:00:28.409823+0000","last_undegraded":"2023-10-09T12:00:28.409823+0000","last_fullsized":"2023-10-09T12:00:28.409823+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:54.449599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.392974+0000","last_change":"2023-10-09T12:00:28.386269+0000","last_active":"2023-10-09T12:00:28.392974+0000","last_peered":"2023-10-09T12:00:28.392974+0000","last_clean":"2023-10-09T12:00:28.392974+0000","last_became_active":"2023-10-09T12:00:28.386015+0000","last_became_peered":"2023-10-09T12:00:28.386015+0000","last_unstale":"2023-10-09T12:00:28.392974+0000","last_undegraded":"2023-10-09T12:00:28.392974+0000","last_fullsized":"2023-10-09T12:00:28.392974+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:40.344727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.379664+0000","last_change":"2023-10-09T12:00:27.372016+0000","last_active":"2023-10-09T12:00:28.379664+0000","last_peered":"2023-10-09T12:00:28.379664+0000","last_clean":"2023-10-09T12:00:28.379664+0000","last_became_active":"2023-10-09T12:00:27.371730+0000","last_became_peered":"2023-10-09T12:00:27.371730+0000","last_unstale":"2023-10-09T12:00:28.379664+0000","last_undegraded":"2023-10-09T12:00:28.379664+0000","last_fullsized":"2023-10-09T12:00:28.379664+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:35.167950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395432+0000","last_change":"2023-10-09T12:00:28.390694+0000","last_active":"2023-10-09T12:00:28.395432+0000","last_peered":"2023-10-09T12:00:28.395432+0000","last_clean":"2023-10-09T12:00:28.395432+0000","last_became_active":"2023-10-09T12:00:28.390468+0000","last_became_peered":"2023-10-09T12:00:28.390468+0000","last_unstale":"2023-10-09T12:00:28.395432+0000","last_undegraded":"2023-10-09T12:00:28.395432+0000","last_fullsized":"2023-10-09T12:00:28.395432+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:04:21.243895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"138'8","reported_seq":18,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.416470+0000","last_change":"2023-10-09T12:00:27.375771+0000","last_active":"2023-10-09T12:00:28.416470+0000","last_peered":"2023-10-09T12:00:28.416470+0000","last_clean":"2023-10-09T12:00:28.416470+0000","last_became_active":"2023-10-09T12:00:27.375488+0000","last_became_peered":"2023-10-09T12:00:27.375488+0000","last_unstale":"2023-10-09T12:00:28.416470+0000","last_undegraded":"2023-10-09T12:00:28.416470+0000","last_fullsized":"2023-10-09T12:00:28.416470+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:14.189851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399688+0000","last_change":"2023-10-09T12:00:28.397768+0000","last_active":"2023-10-09T12:00:28.399688+0000","last_peered":"2023-10-09T12:00:28.399688+0000","last_clean":"2023-10-09T12:00:28.399688+0000","last_became_active":"2023-10-09T12:00:28.397525+0000","last_became_peered":"2023-10-09T12:00:28.397525+0000","last_unstale":"2023-10-09T12:00:28.399688+0000","last_undegraded":"2023-10-09T12:00:28.399688+0000","last_fullsized":"2023-10-09T12:00:28.399688+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:45.154194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.412957+0000","last_change":"2023-10-09T12:00:27.381084+0000","last_active":"2023-10-09T12:00:28.412957+0000","last_peered":"2023-10-09T12:00:28.412957+0000","last_clean":"2023-10-09T12:00:28.412957+0000","last_became_active":"2023-10-09T12:00:27.380835+0000","last_became_peered":"2023-10-09T12:00:27.380835+0000","last_unstale":"2023-10-09T12:00:28.412957+0000","last_undegraded":"2023-10-09T12:00:28.412957+0000","last_fullsized":"2023-10-09T12:00:28.412957+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:44.223842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401147+0000","last_change":"2023-10-09T12:00:28.397845+0000","last_active":"2023-10-09T12:00:28.401147+0000","last_peered":"2023-10-09T12:00:28.401147+0000","last_clean":"2023-10-09T12:00:28.401147+0000","last_became_active":"2023-10-09T12:00:28.397590+0000","last_became_peered":"2023-10-09T12:00:28.397590+0000","last_unstale":"2023-10-09T12:00:28.401147+0000","last_undegraded":"2023-10-09T12:00:28.401147+0000","last_fullsized":"2023-10-09T12:00:28.401147+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:47.420001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.412711+0000","last_change":"2023-10-09T12:00:27.377527+0000","last_active":"2023-10-09T12:00:28.412711+0000","last_peered":"2023-10-09T12:00:28.412711+0000","last_clean":"2023-10-09T12:00:28.412711+0000","last_became_active":"2023-10-09T12:00:27.377263+0000","last_became_peered":"2023-10-09T12:00:27.377263+0000","last_unstale":"2023-10-09T12:00:28.412711+0000","last_undegraded":"2023-10-09T12:00:28.412711+0000","last_fullsized":"2023-10-09T12:00:28.412711+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:24:19.400629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.402522+0000","last_change":"2023-10-09T12:00:28.400099+0000","last_active":"2023-10-09T12:00:28.402522+0000","last_peered":"2023-10-09T12:00:28.402522+0000","last_clean":"2023-10-09T12:00:28.402522+0000","last_became_active":"2023-10-09T12:00:28.399666+0000","last_became_peered":"2023-10-09T12:00:28.399666+0000","last_unstale":"2023-10-09T12:00:28.402522+0000","last_undegraded":"2023-10-09T12:00:28.402522+0000","last_fullsized":"2023-10-09T12:00:28.402522+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:20.416932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.416048+0000","last_change":"2023-10-09T12:00:27.378518+0000","last_active":"2023-10-09T12:00:28.416048+0000","last_peered":"2023-10-09T12:00:28.416048+0000","last_clean":"2023-10-09T12:00:28.416048+0000","last_became_active":"2023-10-09T12:00:27.378133+0000","last_became_peered":"2023-10-09T12:00:27.378133+0000","last_unstale":"2023-10-09T12:00:28.416048+0000","last_undegraded":"2023-10-09T12:00:28.416048+0000","last_fullsized":"2023-10-09T12:00:28.416048+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:11.975971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.394875+0000","last_change":"2023-10-09T12:00:28.392423+0000","last_active":"2023-10-09T12:00:28.394875+0000","last_peered":"2023-10-09T12:00:28.394875+0000","last_clean":"2023-10-09T12:00:28.394875+0000","last_became_active":"2023-10-09T12:00:28.391949+0000","last_became_peered":"2023-10-09T12:00:28.391949+0000","last_unstale":"2023-10-09T12:00:28.394875+0000","last_undegraded":"2023-10-09T12:00:28.394875+0000","last_fullsized":"2023-10-09T12:00:28.394875+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:32.264708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.383359+0000","last_change":"2023-10-09T12:00:27.384554+0000","last_active":"2023-10-09T12:00:28.383359+0000","last_peered":"2023-10-09T12:00:28.383359+0000","last_clean":"2023-10-09T12:00:28.383359+0000","last_became_active":"2023-10-09T12:00:27.384242+0000","last_became_peered":"2023-10-09T12:00:27.384242+0000","last_unstale":"2023-10-09T12:00:28.383359+0000","last_undegraded":"2023-10-09T12:00:28.383359+0000","last_fullsized":"2023-10-09T12:00:28.383359+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:46.788652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.405514+0000","last_change":"2023-10-09T12:00:28.402997+0000","last_active":"2023-10-09T12:00:28.405514+0000","last_peered":"2023-10-09T12:00:28.405514+0000","last_clean":"2023-10-09T12:00:28.405514+0000","last_became_active":"2023-10-09T12:00:28.402668+0000","last_became_peered":"2023-10-09T12:00:28.402668+0000","last_unstale":"2023-10-09T12:00:28.405514+0000","last_undegraded":"2023-10-09T12:00:28.405514+0000","last_fullsized":"2023-10-09T12:00:28.405514+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:38.455403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.411960+0000","last_change":"2023-10-09T12:00:27.374722+0000","last_active":"2023-10-09T12:00:28.411960+0000","last_peered":"2023-10-09T12:00:28.411960+0000","last_clean":"2023-10-09T12:00:28.411960+0000","last_became_active":"2023-10-09T12:00:27.374360+0000","last_became_peered":"2023-10-09T12:00:27.374360+0000","last_unstale":"2023-10-09T12:00:28.411960+0000","last_undegraded":"2023-10-09T12:00:28.411960+0000","last_fullsized":"2023-10-09T12:00:28.411960+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:41.477146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399115+0000","last_change":"2023-10-09T12:00:28.396959+0000","last_active":"2023-10-09T12:00:28.399115+0000","last_peered":"2023-10-09T12:00:28.399115+0000","last_clean":"2023-10-09T12:00:28.399115+0000","last_became_active":"2023-10-09T12:00:28.396718+0000","last_became_peered":"2023-10-09T12:00:28.396718+0000","last_unstale":"2023-10-09T12:00:28.399115+0000","last_undegraded":"2023-10-09T12:00:28.399115+0000","last_fullsized":"2023-10-09T12:00:28.399115+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:10.839734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.374616+0000","last_change":"2023-10-09T12:00:27.379728+0000","last_active":"2023-10-09T12:00:28.374616+0000","last_peered":"2023-10-09T12:00:28.374616+0000","last_clean":"2023-10-09T12:00:28.374616+0000","last_became_active":"2023-10-09T12:00:27.379386+0000","last_became_peered":"2023-10-09T12:00:27.379386+0000","last_unstale":"2023-10-09T12:00:28.374616+0000","last_undegraded":"2023-10-09T12:00:28.374616+0000","last_fullsized":"2023-10-09T12:00:28.374616+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:25.602701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390674+0000","last_change":"2023-10-09T12:00:28.389456+0000","last_active":"2023-10-09T12:00:28.390674+0000","last_peered":"2023-10-09T12:00:28.390674+0000","last_clean":"2023-10-09T12:00:28.390674+0000","last_became_active":"2023-10-09T12:00:28.388953+0000","last_became_peered":"2023-10-09T12:00:28.388953+0000","last_unstale":"2023-10-09T12:00:28.390674+0000","last_undegraded":"2023-10-09T12:00:28.390674+0000","last_fullsized":"2023-10-09T12:00:28.390674+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:45.654030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.378081+0000","last_change":"2023-10-09T12:00:27.374044+0000","last_active":"2023-10-09T12:00:28.378081+0000","last_peered":"2023-10-09T12:00:28.378081+0000","last_clean":"2023-10-09T12:00:28.378081+0000","last_became_active":"2023-10-09T12:00:27.373825+0000","last_became_peered":"2023-10-09T12:00:27.373825+0000","last_unstale":"2023-10-09T12:00:28.378081+0000","last_undegraded":"2023-10-09T12:00:28.378081+0000","last_fullsized":"2023-10-09T12:00:28.378081+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:18.403971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.398651+0000","last_change":"2023-10-09T12:00:28.393807+0000","last_active":"2023-10-09T12:00:28.398651+0000","last_peered":"2023-10-09T12:00:28.398651+0000","last_clean":"2023-10-09T12:00:28.398651+0000","last_became_active":"2023-10-09T12:00:28.393560+0000","last_became_peered":"2023-10-09T12:00:28.393560+0000","last_unstale":"2023-10-09T12:00:28.398651+0000","last_undegraded":"2023-10-09T12:00:28.398651+0000","last_fullsized":"2023-10-09T12:00:28.398651+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:35.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.380824+0000","last_change":"2023-10-09T12:00:27.373283+0000","last_active":"2023-10-09T12:00:28.380824+0000","last_peered":"2023-10-09T12:00:28.380824+0000","last_clean":"2023-10-09T12:00:28.380824+0000","last_became_active":"2023-10-09T12:00:27.373036+0000","last_became_peered":"2023-10-09T12:00:27.373036+0000","last_unstale":"2023-10-09T12:00:28.380824+0000","last_undegraded":"2023-10-09T12:00:28.380824+0000","last_fullsized":"2023-10-09T12:00:28.380824+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:34.771168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.400541+0000","last_change":"2023-10-09T12:00:28.398047+0000","last_active":"2023-10-09T12:00:28.400541+0000","last_peered":"2023-10-09T12:00:28.400541+0000","last_clean":"2023-10-09T12:00:28.400541+0000","last_became_active":"2023-10-09T12:00:28.397737+0000","last_became_peered":"2023-10-09T12:00:28.397737+0000","last_unstale":"2023-10-09T12:00:28.400541+0000","last_undegraded":"2023-10-09T12:00:28.400541+0000","last_fullsized":"2023-10-09T12:00:28.400541+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:20.416932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.415805+0000","last_change":"2023-10-09T12:00:27.385452+0000","last_active":"2023-10-09T12:00:28.415805+0000","last_peered":"2023-10-09T12:00:28.415805+0000","last_clean":"2023-10-09T12:00:28.415805+0000","last_became_active":"2023-10-09T12:00:27.385123+0000","last_became_peered":"2023-10-09T12:00:27.385123+0000","last_unstale":"2023-10-09T12:00:28.415805+0000","last_undegraded":"2023-10-09T12:00:28.415805+0000","last_fullsized":"2023-10-09T12:00:28.415805+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:07:44.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.399132+0000","last_change":"2023-10-09T12:00:28.397369+0000","last_active":"2023-10-09T12:00:28.399132+0000","last_peered":"2023-10-09T12:00:28.399132+0000","last_clean":"2023-10-09T12:00:28.399132+0000","last_became_active":"2023-10-09T12:00:28.397095+0000","last_became_peered":"2023-10-09T12:00:28.397095+0000","last_unstale":"2023-10-09T12:00:28.399132+0000","last_undegraded":"2023-10-09T12:00:28.399132+0000","last_fullsized":"2023-10-09T12:00:28.399132+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:48.364473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.379945+0000","last_change":"2023-10-09T12:00:27.376650+0000","last_active":"2023-10-09T12:00:28.379945+0000","last_peered":"2023-10-09T12:00:28.379945+0000","last_clean":"2023-10-09T12:00:28.379945+0000","last_became_active":"2023-10-09T12:00:27.376374+0000","last_became_peered":"2023-10-09T12:00:27.376374+0000","last_unstale":"2023-10-09T12:00:28.379945+0000","last_undegraded":"2023-10-09T12:00:28.379945+0000","last_fullsized":"2023-10-09T12:00:28.379945+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:35.060485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.410777+0000","last_change":"2023-10-09T12:00:28.402678+0000","last_active":"2023-10-09T12:00:28.410777+0000","last_peered":"2023-10-09T12:00:28.410777+0000","last_clean":"2023-10-09T12:00:28.410777+0000","last_became_active":"2023-10-09T12:00:28.402421+0000","last_became_peered":"2023-10-09T12:00:28.402421+0000","last_unstale":"2023-10-09T12:00:28.410777+0000","last_undegraded":"2023-10-09T12:00:28.410777+0000","last_fullsized":"2023-10-09T12:00:28.410777+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:51.680088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.384743+0000","last_change":"2023-10-09T12:00:27.381879+0000","last_active":"2023-10-09T12:00:28.384743+0000","last_peered":"2023-10-09T12:00:28.384743+0000","last_clean":"2023-10-09T12:00:28.384743+0000","last_became_active":"2023-10-09T12:00:27.381614+0000","last_became_peered":"2023-10-09T12:00:27.381614+0000","last_unstale":"2023-10-09T12:00:28.384743+0000","last_undegraded":"2023-10-09T12:00:28.384743+0000","last_fullsized":"2023-10-09T12:00:28.384743+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:22.427197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.401991+0000","last_change":"2023-10-09T12:00:28.398586+0000","last_active":"2023-10-09T12:00:28.401991+0000","last_peered":"2023-10-09T12:00:28.401991+0000","last_clean":"2023-10-09T12:00:28.401991+0000","last_became_active":"2023-10-09T12:00:28.398322+0000","last_became_peered":"2023-10-09T12:00:28.398322+0000","last_unstale":"2023-10-09T12:00:28.401991+0000","last_undegraded":"2023-10-09T12:00:28.401991+0000","last_fullsized":"2023-10-09T12:00:28.401991+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:00.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.375874+0000","last_change":"2023-10-09T12:00:27.373361+0000","last_active":"2023-10-09T12:00:28.375874+0000","last_peered":"2023-10-09T12:00:28.375874+0000","last_clean":"2023-10-09T12:00:28.375874+0000","last_became_active":"2023-10-09T12:00:27.373121+0000","last_became_peered":"2023-10-09T12:00:27.373121+0000","last_unstale":"2023-10-09T12:00:28.375874+0000","last_undegraded":"2023-10-09T12:00:28.375874+0000","last_fullsized":"2023-10-09T12:00:28.375874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:15.088429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393732+0000","last_change":"2023-10-09T12:00:28.389552+0000","last_active":"2023-10-09T12:00:28.393732+0000","last_peered":"2023-10-09T12:00:28.393732+0000","last_clean":"2023-10-09T12:00:28.393732+0000","last_became_active":"2023-10-09T12:00:28.389273+0000","last_became_peered":"2023-10-09T12:00:28.389273+0000","last_unstale":"2023-10-09T12:00:28.393732+0000","last_undegraded":"2023-10-09T12:00:28.393732+0000","last_fullsized":"2023-10-09T12:00:28.393732+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:47.244776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.384081+0000","last_change":"2023-10-09T12:00:27.381451+0000","last_active":"2023-10-09T12:00:28.384081+0000","last_peered":"2023-10-09T12:00:28.384081+0000","last_clean":"2023-10-09T12:00:28.384081+0000","last_became_active":"2023-10-09T12:00:27.381142+0000","last_became_peered":"2023-10-09T12:00:27.381142+0000","last_unstale":"2023-10-09T12:00:28.384081+0000","last_undegraded":"2023-10-09T12:00:28.384081+0000","last_fullsized":"2023-10-09T12:00:28.384081+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:04:39.507109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.393718+0000","last_change":"2023-10-09T12:00:28.388892+0000","last_active":"2023-10-09T12:00:28.393718+0000","last_peered":"2023-10-09T12:00:28.393718+0000","last_clean":"2023-10-09T12:00:28.393718+0000","last_became_active":"2023-10-09T12:00:28.388417+0000","last_became_peered":"2023-10-09T12:00:28.388417+0000","last_unstale":"2023-10-09T12:00:28.393718+0000","last_undegraded":"2023-10-09T12:00:28.393718+0000","last_fullsized":"2023-10-09T12:00:28.393718+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:00:52.691048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.383314+0000","last_change":"2023-10-09T12:00:27.371638+0000","last_active":"2023-10-09T12:00:28.383314+0000","last_peered":"2023-10-09T12:00:28.383314+0000","last_clean":"2023-10-09T12:00:28.383314+0000","last_became_active":"2023-10-09T12:00:27.371368+0000","last_became_peered":"2023-10-09T12:00:27.371368+0000","last_unstale":"2023-10-09T12:00:28.383314+0000","last_undegraded":"2023-10-09T12:00:28.383314+0000","last_fullsized":"2023-10-09T12:00:28.383314+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:30.439499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.390069+0000","last_change":"2023-10-09T12:00:28.387928+0000","last_active":"2023-10-09T12:00:28.390069+0000","last_peered":"2023-10-09T12:00:28.390069+0000","last_clean":"2023-10-09T12:00:28.390069+0000","last_became_active":"2023-10-09T12:00:28.387547+0000","last_became_peered":"2023-10-09T12:00:28.387547+0000","last_unstale":"2023-10-09T12:00:28.390069+0000","last_undegraded":"2023-10-09T12:00:28.390069+0000","last_fullsized":"2023-10-09T12:00:28.390069+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:00.760055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.374609+0000","last_change":"2023-10-09T12:00:27.378921+0000","last_active":"2023-10-09T12:00:28.374609+0000","last_peered":"2023-10-09T12:00:28.374609+0000","last_clean":"2023-10-09T12:00:28.374609+0000","last_became_active":"2023-10-09T12:00:27.378639+0000","last_became_peered":"2023-10-09T12:00:27.378639+0000","last_unstale":"2023-10-09T12:00:28.374609+0000","last_undegraded":"2023-10-09T12:00:28.374609+0000","last_fullsized":"2023-10-09T12:00:28.374609+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:35.774400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.407256+0000","last_change":"2023-10-09T12:00:28.401413+0000","last_active":"2023-10-09T12:00:28.407256+0000","last_peered":"2023-10-09T12:00:28.407256+0000","last_clean":"2023-10-09T12:00:28.407256+0000","last_became_active":"2023-10-09T12:00:28.399871+0000","last_became_peered":"2023-10-09T12:00:28.399871+0000","last_unstale":"2023-10-09T12:00:28.407256+0000","last_undegraded":"2023-10-09T12:00:28.407256+0000","last_fullsized":"2023-10-09T12:00:28.407256+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:40:39.005471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.380931+0000","last_change":"2023-10-09T12:00:27.373834+0000","last_active":"2023-10-09T12:00:28.380931+0000","last_peered":"2023-10-09T12:00:28.380931+0000","last_clean":"2023-10-09T12:00:28.380931+0000","last_became_active":"2023-10-09T12:00:27.373603+0000","last_became_peered":"2023-10-09T12:00:27.373603+0000","last_unstale":"2023-10-09T12:00:28.380931+0000","last_undegraded":"2023-10-09T12:00:28.380931+0000","last_fullsized":"2023-10-09T12:00:28.380931+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:39.337904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.395404+0000","last_change":"2023-10-09T12:00:28.391242+0000","last_active":"2023-10-09T12:00:28.395404+0000","last_peered":"2023-10-09T12:00:28.395404+0000","last_clean":"2023-10-09T12:00:28.395404+0000","last_became_active":"2023-10-09T12:00:28.390986+0000","last_became_peered":"2023-10-09T12:00:28.390986+0000","last_unstale":"2023-10-09T12:00:28.395404+0000","last_undegraded":"2023-10-09T12:00:28.395404+0000","last_fullsized":"2023-10-09T12:00:28.395404+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:27.354694+0000","last_clean_scrub_stamp":"2023-10-09T12:00:27.354694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:34:30.634576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.386416+0000","last_change":"2023-10-09T12:00:27.385248+0000","last_active":"2023-10-09T12:00:28.386416+0000","last_peered":"2023-10-09T12:00:28.386416+0000","last_clean":"2023-10-09T12:00:28.386416+0000","last_became_active":"2023-10-09T12:00:27.385046+0000","last_became_peered":"2023-10-09T12:00:27.385046+0000","last_unstale":"2023-10-09T12:00:28.386416+0000","last_undegraded":"2023-10-09T12:00:28.386416+0000","last_fullsized":"2023-10-09T12:00:28.386416+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:00:26.347870+0000","last_clean_scrub_stamp":"2023-10-09T12:00:26.347870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:46.413177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"128'249","reported_seq":729,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T12:00:28.381115+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:00:28.381115+0000","last_peered":"2023-10-09T12:00:28.381115+0000","last_clean":"2023-10-09T12:00:28.381115+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:00:28.381115+0000","last_undegraded":"2023-10-09T12:00:28.381115+0000","last_fullsized":"2023-10-09T12:00:28.381115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476962,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1430680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.36499999999999999},"max":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":1.0109999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.70999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36599999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72499999999999998,"15min":0.753},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.99199999999999999,"15min":1.0580000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.47799999999999998},"max":{"1min":0.79300000000000004,"5min":1.0169999999999999,"15min":1.0349999999999999},"last":0.73899999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67900000000000005,"15min":0.70399999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71899999999999997,"15min":0.73599999999999999},"min":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.84999999999999998,"5min":1.0209999999999999,"15min":1.048},"last":0.75800000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.80600000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.82899999999999996,"5min":0.98899999999999999,"15min":1.073},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68999999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82299999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.98599999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42999999999999999},"max":{"1min":0.69399999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45300000000000001},"max":{"1min":0.83899999999999997,"5min":1.083,"15min":1.083},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90600000000000003,"5min":1.111,"15min":1.111},"last":0.97099999999999997}]}]},{"osd":6,"up_from":16,"seq":68719476963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303060,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068780,"statfs":{"total":96636764160,"available":96326430720,"internally_reserved":0,"allocated":1716224,"data_stored":839794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.72399999999999998},"min":{"1min":0.438,"5min":0.311,"15min":0.311},"max":{"1min":0.80900000000000005,"5min":0.97999999999999998,"15min":1.0629999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.73299999999999998},"min":{"1min":0.54600000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90100000000000002,"5min":0.94499999999999995,"15min":1.0349999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.70899999999999996},"min":{"1min":0.50800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82199999999999995,"5min":0.98999999999999999,"15min":1.121},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.73699999999999999},"min":{"1min":0.51700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88400000000000001,"5min":1.0049999999999999,"15min":1.216},"last":0.877}]},{"osd":2,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.752},"min":{"1min":0.55800000000000005,"5min":0.379,"15min":0.379},"max":{"1min":0.876,"5min":0.98799999999999999,"15min":1.139},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":1.0009999999999999,"15min":1.278},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69899999999999995,"15min":0.74299999999999999},"min":{"1min":0.47699999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.85599999999999998,"5min":1.042,"15min":1.1040000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68899999999999995,"15min":0.73099999999999998},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85799999999999998,"5min":0.94699999999999995,"15min":1.244},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.46100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.875,"5min":1.02,"15min":1.1060000000000001},"last":0.627},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.4750000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77100000000000002,"5min":0.92200000000000004,"15min":1.143},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.441,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":1.2410000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93100000000000005,"5min":0.98999999999999999,"15min":1.327},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85099999999999998,"5min":0.97499999999999998,"15min":1.1679999999999999},"last":0.53100000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509667,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":839848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.45700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60899999999999999,"5min":0.67900000000000005,"15min":1.0580000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.34699999999999998,"15min":0.25},"max":{"1min":0.623,"5min":1.079,"15min":1.079},"last":0.45800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.28399999999999997},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.99099999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.32200000000000001},"max":{"1min":0.61699999999999999,"5min":0.76800000000000002,"15min":1.099},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":1.044,"15min":1.1779999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.046},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.78800000000000003},"min":{"1min":0.57699999999999996,"5min":0.51200000000000001,"15min":0.45500000000000002},"max":{"1min":0.98299999999999998,"5min":1.143,"15min":1.7210000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.79000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97799999999999998,"5min":1.0660000000000001,"15min":1.552},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75600000000000001,"15min":0.78500000000000003},"min":{"1min":0.54700000000000004,"5min":0.46000000000000002,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":1.202,"15min":1.677},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.77800000000000002,"15min":0.80500000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.501},"max":{"1min":0.94499999999999995,"5min":1.103,"15min":1.778},"last":0.76500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0509999999999999,"5min":1.464,"15min":1.623},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77600000000000002,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.47099999999999997},"max":{"1min":0.95199999999999996,"5min":1.0429999999999999,"15min":1.708},"last":0.78900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":1.222,"15min":1.659},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.071,"5min":1.1419999999999999,"15min":1.736},"last":0.93700000000000006}]}]},{"osd":0,"up_from":14,"seq":60129542370,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1431740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26700000000000002},"max":{"1min":0.81200000000000006,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.31,"5min":0.28699999999999998,"15min":0.219},"max":{"1min":0.66100000000000003,"5min":1.012,"15min":1.012},"last":0.371}]},{"osd":2,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":2.097,"15min":2.097},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53700000000000003,"15min":0.55200000000000005},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":1.282,"15min":1.282},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.39900000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.82199999999999995},"min":{"1min":0.52900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.999,"5min":1.399,"15min":1.587},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.61099999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":1.389,"15min":1.389},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.46300000000000002,"15min":0.46100000000000002},"max":{"1min":1.014,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0229999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.58299999999999996,"5min":0.502,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.99399999999999999,"5min":1.1899999999999999,"15min":1.2709999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0509999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.82499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0660000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542370,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307140,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064700,"statfs":{"total":96636764160,"available":96322252800,"internally_reserved":0,"allocated":1699840,"data_stored":833032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.37,"5min":0.311,"15min":0.311},"max":{"1min":0.63700000000000001,"5min":0.70499999999999996,"15min":0.83499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.628,"5min":0.876,"15min":0.876},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.56399999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.57199999999999995},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.95199999999999996},"last":0.502}]},{"osd":4,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.748,"15min":0.78500000000000003},"min":{"1min":0.58799999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93899999999999995,"5min":1.0620000000000001,"15min":1.1839999999999999},"last":0.75},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.79800000000000004},"min":{"1min":0.52300000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.56999999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.2629999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.61899999999999999,"5min":0.53400000000000003,"15min":0.499},"max":{"1min":0.98199999999999998,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.81799999999999995},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95199999999999996,"5min":1.1839999999999999,"15min":1.216},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"min":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54600000000000004},"max":{"1min":0.94999999999999996,"5min":1.1419999999999999,"15min":1.204},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.53100000000000003},"max":{"1min":1.135,"5min":1.153,"15min":1.2310000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.82899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.079,"5min":1.111,"15min":1.155},"last":0.73799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307168,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064672,"statfs":{"total":96636764160,"available":96322224128,"internally_reserved":0,"allocated":1728512,"data_stored":841330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.627,"5min":0.91300000000000003,"15min":1.0149999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48899999999999999,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.28699999999999998,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.89500000000000002,"15min":0.95999999999999996},"last":0.33700000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.32300000000000001},"max":{"1min":0.69599999999999995,"5min":0.83099999999999996,"15min":1.0229999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.33700000000000002,"15min":0.317},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.876},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.36099999999999999},"max":{"1min":0.72899999999999998,"5min":0.79100000000000004,"15min":1.1140000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.308},"max":{"1min":0.68100000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80200000000000005,"15min":0.80300000000000005},"min":{"1min":0.68600000000000005,"5min":0.55800000000000005,"15min":0.54900000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.327},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.68200000000000005,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.749}]},{"osd":5,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.59399999999999997,"5min":0.52600000000000002,"15min":0.495},"max":{"1min":1.115,"5min":1.246,"15min":1.252},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.41299999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.3660000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.624,"5min":0.504,"15min":0.48199999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.2989999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.999,"5min":1.1240000000000001,"15min":1.218},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.46999999999999997},"max":{"1min":1.1359999999999999,"5min":1.25,"15min":1.333},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.60299999999999998,"5min":0.53900000000000003,"15min":0.51400000000000001},"max":{"1min":1.054,"5min":1.194,"15min":1.3560000000000001},"last":0.67900000000000005}]}]},{"osd":4,"up_from":16,"seq":68719476962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311248,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060592,"statfs":{"total":96636764160,"available":96318046208,"internally_reserved":0,"allocated":1712128,"data_stored":839724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68500000000000005,"15min":0.71499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":0.98499999999999999,"15min":1.071},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69399999999999995,"15min":0.71699999999999997},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.374},"max":{"1min":0.86299999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.72699999999999998},"min":{"1min":0.50800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.091},"last":0.87},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.72899999999999998},"min":{"1min":0.50600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.89000000000000001,"5min":1.587,"15min":1.587},"last":0.85399999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70299999999999996,"15min":0.72699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95899999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.747,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97099999999999997,"5min":1.419,"15min":1.419},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69699999999999995,"15min":0.72599999999999998},"min":{"1min":0.54700000000000004,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91000000000000003,"5min":1.367,"15min":1.367},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.54500000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95499999999999996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.46899999999999997,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":0.96099999999999997,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.88100000000000001,"5min":1.613,"15min":1.613},"last":0.58299999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67100000000000004,"15min":0.65600000000000003},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.69999999999999996,"15min":0.69399999999999995},"min":{"1min":0.52400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.997,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:59:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.44800000000000001,"15min":0.44400000000000001},"max":{"1min":0.96799999999999997,"5min":1.484,"15min":1.484},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97899999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.97399999999999998}]}]},{"osd":5,"up_from":16,"seq":68719476962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":840300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.70599999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93600000000000005,"5min":0.97699999999999998,"15min":1.8680000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.71799999999999997},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.96199999999999997,"5min":1.014,"15min":1.9770000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.69299999999999995},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.376},"max":{"1min":0.93200000000000005,"5min":0.97599999999999998,"15min":1.0840000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66900000000000004,"15min":0.72199999999999998},"min":{"1min":0.51100000000000001,"5min":0.44600000000000001,"15min":0.40100000000000002},"max":{"1min":0.872,"5min":0.92800000000000005,"15min":2.0840000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68400000000000005,"15min":0.71499999999999997},"min":{"1min":0.496,"5min":0.435,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.909},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.71599999999999997},"min":{"1min":0.51200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89600000000000002,"5min":1.046,"15min":1.9450000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.47999999999999998,"15min":0.46899999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":2.1850000000000001},"last":0.88},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.77500000000000002},"min":{"1min":0.61299999999999999,"5min":0.52600000000000002,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.048,"15min":2.1240000000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.78700000000000003,"5min":0.84099999999999997,"15min":2.105},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.47499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.872,"5min":1.02,"15min":2.2669999999999999},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88100000000000001,"5min":0.995,"15min":2.0169999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.84099999999999997,"5min":0.93500000000000005,"15min":2.0350000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.68300000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.0489999999999999,"15min":2.2309999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":2.2130000000000001},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:00:33.153 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T12:00:33.153 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T12:00:33.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.374+0000 7f7d193ff700 1 Processor -- start 2023-10-09T12:00:33.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.374+0000 7f7d193ff700 1 -- start start 2023-10-09T12:00:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.375+0000 7f7d193ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d141569f0 0x7f7d140c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.375+0000 7f7d193ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1415a6f0 con 0x7f7d14156620 2023-10-09T12:00:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.375+0000 7f7d193ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1415a9d0 con 0x7f7d14068390 2023-10-09T12:00:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.375+0000 7f7d193ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140c8d30 con 0x7f7d141569f0 2023-10-09T12:00:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.375+0000 7f7d12ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7d14156620 0x7f7d140ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46284/0 (socket says 172.21.15.86:46284) 2023-10-09T12:00:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d12ffd700 1 -- 172.21.15.86:0/4127211252 learned_addr learned my addr 172.21.15.86:0/4127211252 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:33.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d127fc700 1 --2- 172.21.15.86:0/4127211252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d141569f0 0x7f7d140c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d11ffb700 1 -- 172.21.15.86:0/4127211252 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770739502 0 0) 0x7f7d1415a6f0 con 0x7f7d14156620 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d11ffb700 1 -- 172.21.15.86:0/4127211252 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cfc003570 con 0x7f7d14156620 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d11ffb700 1 -- 172.21.15.86:0/4127211252 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129684179 0 0) 0x7f7d1415a9d0 con 0x7f7d14068390 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d11ffb700 1 -- 172.21.15.86:0/4127211252 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d1415a6f0 con 0x7f7d14068390 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d127fc700 1 -- 172.21.15.86:0/4127211252 >> v1:172.21.15.135:6789/0 conn(0x7f7d14068390 legacy=0x7f7d1406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d127fc700 1 -- 172.21.15.86:0/4127211252 >> v1:172.21.15.86:6789/0 conn(0x7f7d14156620 legacy=0x7f7d140ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.376+0000 7f7d127fc700 1 -- 172.21.15.86:0/4127211252 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1415acb0 con 0x7f7d141569f0 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d127fc700 1 --2- 172.21.15.86:0/4127211252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d141569f0 0x7f7d140c87f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009910 tx=0x7f7d080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb3cec32cc937c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d11ffb700 1 -- 172.21.15.86:0/4127211252 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011630 con 0x7f7d141569f0 2023-10-09T12:00:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d11ffb700 1 -- 172.21.15.86:0/4127211252 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d08011790 con 0x7f7d141569f0 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d11ffb700 1 -- 172.21.15.86:0/4127211252 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011b30 con 0x7f7d141569f0 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d193ff700 1 -- 172.21.15.86:0/4127211252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d141569f0 msgr2=0x7f7d140c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d193ff700 1 --2- 172.21.15.86:0/4127211252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d141569f0 0x7f7d140c87f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009910 tx=0x7f7d080091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d193ff700 1 -- 172.21.15.86:0/4127211252 shutdown_connections 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d193ff700 1 --2- 172.21.15.86:0/4127211252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d141569f0 0x7f7d140c87f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d193ff700 1 -- 172.21.15.86:0/4127211252 >> 172.21.15.86:0/4127211252 conn(0x7f7d140cc540 msgr2=0x7f7d140cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.377+0000 7f7d193ff700 1 -- 172.21.15.86:0/4127211252 shutdown_connections 2023-10-09T12:00:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.378+0000 7f7d193ff700 1 -- 172.21.15.86:0/4127211252 wait complete. 2023-10-09T12:00:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.379+0000 7f7d193ff700 1 Processor -- start 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.379+0000 7f7d193ff700 1 -- start start 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d193ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d14068390 0x7f7d14155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d193ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d14156620 0x7f7d1414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d193ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d141569f0 0x7f7d14145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d193ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14145460 con 0x7f7d14156620 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d193ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14156240 con 0x7f7d141569f0 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d193ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140a98e0 con 0x7f7d14068390 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d127fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d14156620 0x7f7d1414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d127fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d14156620 0x7f7d1414c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56892/0 (socket says 172.21.15.86:56892) 2023-10-09T12:00:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d127fc700 1 -- 172.21.15.86:0/3221969891 learned_addr learned my addr 172.21.15.86:0/3221969891 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d12ffd700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d14068390 0x7f7d14155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.380+0000 7f7d137fe700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d141569f0 0x7f7d14145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d127fc700 1 -- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d14068390 msgr2=0x7f7d14155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d127fc700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d14068390 0x7f7d14155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d127fc700 1 -- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d141569f0 msgr2=0x7f7d14145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d127fc700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d141569f0 0x7f7d14145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d127fc700 1 -- 172.21.15.86:0/3221969891 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009420 con 0x7f7d14156620 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d127fc700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d14156620 0x7f7d1414c980 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7d1406bae0 tx=0x7f7d08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7cfaffd700 1 -- 172.21.15.86:0/3221969891 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0801f070 con 0x7f7d14156620 2023-10-09T12:00:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7cfaffd700 1 -- 172.21.15.86:0/3221969891 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d08000bc0 con 0x7f7d14156620 2023-10-09T12:00:33.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d140a9bc0 con 0x7f7d14156620 2023-10-09T12:00:33.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7cfaffd700 1 -- 172.21.15.86:0/3221969891 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011b30 con 0x7f7d14156620 2023-10-09T12:00:33.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.381+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d141575d0 con 0x7f7d14156620 2023-10-09T12:00:33.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.382+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d140a9d50 con 0x7f7d14156620 2023-10-09T12:00:33.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.383+0000 7f7cfaffd700 1 -- 172.21.15.86:0/3221969891 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d08023070 con 0x7f7d14156620 2023-10-09T12:00:33.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.384+0000 7f7cfaffd700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d00066f30 0x7f7d000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.384+0000 7f7cfaffd700 1 -- 172.21.15.86:0/3221969891 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f7d08085ea0 con 0x7f7d14156620 2023-10-09T12:00:33.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.384+0000 7f7d12ffd700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d00066f30 0x7f7d000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.385+0000 7f7d12ffd700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d00066f30 0x7f7d000693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d040058d0 tx=0x7f7d04009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:33.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.388+0000 7f7cfaffd700 1 -- 172.21.15.86:0/3221969891 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d08052f60 con 0x7f7d14156620 2023-10-09T12:00:33.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.656+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7d140718b0 con 0x7f7d14156620 2023-10-09T12:00:33.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.660+0000 7f7cfaffd700 1 -- 172.21.15.86:0/3221969891 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7d080150e0 con 0x7f7d14156620 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d00066f30 msgr2=0x7f7d000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d00066f30 0x7f7d000693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d040058d0 tx=0x7f7d04009040 comp rx=0 tx=0).stop 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d14156620 msgr2=0x7f7d1414c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d14156620 0x7f7d1414c980 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7d1406bae0 tx=0x7f7d08017000 comp rx=0 tx=0).stop 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 shutdown_connections 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d141569f0 0x7f7d14145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d14068390 0x7f7d14155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7d00066f30 0x7f7d000693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 --2- 172.21.15.86:0/3221969891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d14156620 0x7f7d1414c980 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 >> 172.21.15.86:0/3221969891 conn(0x7f7d140cc540 msgr2=0x7f7d14069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:33.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 shutdown_connections 2023-10-09T12:00:33.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.663+0000 7f7d193ff700 1 -- 172.21.15.86:0/3221969891 wait complete. 2023-10-09T12:00:33.665 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T12:00:33.681 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:00:33.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.861+0000 7f843b19d700 1 Processor -- start 2023-10-09T12:00:33.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.861+0000 7f843b19d700 1 -- start start 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843b19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8434156310 0x7f84340c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843b19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84341566e0 0x7f84340ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843b19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84340ca300 0x7f84340ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843b19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84340ca860 con 0x7f8434156310 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843b19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84340cab40 con 0x7f84341566e0 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843b19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84340cae20 con 0x7f84340ca300 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843a19b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8434156310 0x7f84340c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843a19b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8434156310 0x7f84340c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56908/0 (socket says 172.21.15.86:56908) 2023-10-09T12:00:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.862+0000 7f843a19b700 1 -- 172.21.15.86:0/3678404086 learned_addr learned my addr 172.21.15.86:0/3678404086 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843999a700 1 --2- 172.21.15.86:0/3678404086 >> v2:172.21.15.135:3300/0 conn(0x7f84341566e0 0x7f84340ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843a99c700 1 --2- 172.21.15.86:0/3678404086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84340ca300 0x7f84340ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843a19b700 1 -- 172.21.15.86:0/3678404086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84340ca300 msgr2=0x7f84340ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843a19b700 1 --2- 172.21.15.86:0/3678404086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84340ca300 0x7f84340ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843a19b700 1 -- 172.21.15.86:0/3678404086 >> v2:172.21.15.135:3300/0 conn(0x7f84341566e0 msgr2=0x7f84340ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843a19b700 1 --2- 172.21.15.86:0/3678404086 >> v2:172.21.15.135:3300/0 conn(0x7f84341566e0 0x7f84340ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843a19b700 1 -- 172.21.15.86:0/3678404086 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340cb100 con 0x7f8434156310 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f843a19b700 1 --2- 172.21.15.86:0/3678404086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8434156310 0x7f84340c9dc0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f843406c000 tx=0x7f8430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1076ad0e7cdcc43b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f8439199700 1 -- 172.21.15.86:0/3678404086 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000b860 con 0x7f8434156310 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f8439199700 1 -- 172.21.15.86:0/3678404086 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843000b9c0 con 0x7f8434156310 2023-10-09T12:00:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.863+0000 7f8439199700 1 -- 172.21.15.86:0/3678404086 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000bd60 con 0x7f8434156310 2023-10-09T12:00:33.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 -- 172.21.15.86:0/3678404086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8434156310 msgr2=0x7f84340c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 --2- 172.21.15.86:0/3678404086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8434156310 0x7f84340c9dc0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f843406c000 tx=0x7f8430009250 comp rx=0 tx=0).stop 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 -- 172.21.15.86:0/3678404086 shutdown_connections 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 --2- 172.21.15.86:0/3678404086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84340ca300 0x7f84340ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 --2- 172.21.15.86:0/3678404086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8434156310 0x7f84340c9dc0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 --2- 172.21.15.86:0/3678404086 >> v2:172.21.15.135:3300/0 conn(0x7f84341566e0 0x7f84340ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 -- 172.21.15.86:0/3678404086 >> 172.21.15.86:0/3678404086 conn(0x7f84340cc1f0 msgr2=0x7f84340cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 -- 172.21.15.86:0/3678404086 shutdown_connections 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.864+0000 7f843b19d700 1 -- 172.21.15.86:0/3678404086 wait complete. 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.865+0000 7f843b19d700 1 Processor -- start 2023-10-09T12:00:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.866+0000 7f843b19d700 1 -- start start 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.866+0000 7f843b19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84340ca300 0x7f843415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.866+0000 7f843b19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8434156310 0x7f843414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843b19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84341566e0 0x7f8434169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843b19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8434153710 con 0x7f84340ca300 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843b19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8434154290 con 0x7f84341566e0 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843b19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8434153960 con 0x7f8434156310 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84340ca300 0x7f843415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84340ca300 0x7f843415c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56914/0 (socket says 172.21.15.86:56914) 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 -- 172.21.15.86:0/641540874 learned_addr learned my addr 172.21.15.86:0/641540874 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843999a700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8434156310 0x7f843414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 -- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8434156310 msgr2=0x7f843414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a99c700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84341566e0 0x7f8434169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8434156310 0x7f843414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 -- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84341566e0 msgr2=0x7f8434169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84341566e0 0x7f8434169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 -- 172.21.15.86:0/641540874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300094f0 con 0x7f84340ca300 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843999a700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8434156310 0x7f843414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a99c700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84341566e0 0x7f8434169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.867+0000 7f843a19b700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84340ca300 0x7f843415c5b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8430006fd0 tx=0x7f8430017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.868+0000 7f842a7fc700 1 -- 172.21.15.86:0/641540874 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430024440 con 0x7f84340ca300 2023-10-09T12:00:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.868+0000 7f842a7fc700 1 -- 172.21.15.86:0/641540874 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300245a0 con 0x7f84340ca300 2023-10-09T12:00:33.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.868+0000 7f842a7fc700 1 -- 172.21.15.86:0/641540874 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430024960 con 0x7f84340ca300 2023-10-09T12:00:33.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.868+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8434153c40 con 0x7f84340ca300 2023-10-09T12:00:33.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.868+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843415caf0 con 0x7f84340ca300 2023-10-09T12:00:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.869+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843404c3c0 con 0x7f84340ca300 2023-10-09T12:00:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.870+0000 7f842a7fc700 1 -- 172.21.15.86:0/641540874 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f843001a420 con 0x7f84340ca300 2023-10-09T12:00:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.870+0000 7f842a7fc700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8418066f30 0x7f84180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.871+0000 7f842a7fc700 1 -- 172.21.15.86:0/641540874 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f8430086670 con 0x7f84340ca300 2023-10-09T12:00:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.871+0000 7f843999a700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8418066f30 0x7f84180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.871+0000 7f843999a700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8418066f30 0x7f84180693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8434069f50 tx=0x7f8424008040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:33.875+0000 7f842a7fc700 1 -- 172.21.15.86:0/641540874 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84300536b0 con 0x7f84340ca300 2023-10-09T12:00:34.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.106+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f843406cf60 con 0x7f84340ca300 2023-10-09T12:00:34.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.107+0000 7f842a7fc700 1 -- 172.21.15.86:0/641540874 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f8430056cd0 con 0x7f84340ca300 2023-10-09T12:00:34.107 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:34.107 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4273963470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4273963470},{"type":"v1","addr":"172.21.15.135:6834","nonce":4273963470}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1830713158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1830713158},{"type":"v1","addr":"172.21.15.135:6835","nonce":1830713158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/51772873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":51772873},{"type":"v1","addr":"172.21.15.86:6833","nonce":51772873}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:00:27.831701+0000","modified":"2023-10-09T12:00:31.403803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2423117806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2423117806},{"type":"v1","addr":"172.21.15.86:6835","nonce":2423117806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8418066f30 msgr2=0x7f84180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8418066f30 0x7f84180693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8434069f50 tx=0x7f8424008040 comp rx=0 tx=0).stop 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84340ca300 msgr2=0x7f843415c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84340ca300 0x7f843415c5b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8430006fd0 tx=0x7f8430017000 comp rx=0 tx=0).stop 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 shutdown_connections 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8418066f30 0x7f84180693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84340ca300 0x7f843415c5b0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84341566e0 0x7f8434169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 --2- 172.21.15.86:0/641540874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8434156310 0x7f843414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 >> 172.21.15.86:0/641540874 conn(0x7f84340cc1f0 msgr2=0x7f84340b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 shutdown_connections 2023-10-09T12:00:34.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.109+0000 7f843b19d700 1 -- 172.21.15.86:0/641540874 wait complete. 2023-10-09T12:00:34.111 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 63 2023-10-09T12:00:34.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T12:00:27.831701+0000', 'modified': '2023-10-09T12:00:31.403803+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8133}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8133': {'gid': 8133, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/2423117806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 2423117806}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 2423117806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T12:00:34.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T12:00:34.530 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T12:00:34.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.712+0000 7fcad51ff700 1 Processor -- start 2023-10-09T12:00:34.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.712+0000 7fcad51ff700 1 -- start start 2023-10-09T12:00:34.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.713+0000 7fcad51ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.713+0000 7fcad51ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcad00af2f0 0x7fcad00af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.713+0000 7fcad51ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad00ad930 con 0x7fcad0155c10 2023-10-09T12:00:34.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.713+0000 7fcad51ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00b0c60 con 0x7fcad00af2f0 2023-10-09T12:00:34.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.713+0000 7fcad51ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00acd20 con 0x7fcad01578b0 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcacf59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcad00af2f0 0x7fcad00af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcace59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcacf59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcad00af2f0 0x7fcad00af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:50940/0 (socket says 172.21.15.86:50940) 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcacf59e700 1 -- 172.21.15.86:0/3943656502 learned_addr learned my addr 172.21.15.86:0/3943656502 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcace59c700 1 --2- 172.21.15.86:0/3943656502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad0155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:47470/0 (socket says 172.21.15.86:47470) 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcace59c700 1 -- 172.21.15.86:0/3943656502 >> v2:172.21.15.135:3300/0 conn(0x7fcad00af2f0 msgr2=0x7fcad00af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcace59c700 1 --2- 172.21.15.86:0/3943656502 >> v2:172.21.15.135:3300/0 conn(0x7fcad00af2f0 0x7fcad00af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcace59c700 1 -- 172.21.15.86:0/3943656502 >> v1:172.21.15.135:6789/0 conn(0x7fcad0155c10 legacy=0x7fcad00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.714+0000 7fcace59c700 1 -- 172.21.15.86:0/3943656502 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00ad000 con 0x7fcad01578b0 2023-10-09T12:00:34.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.715+0000 7fcace59c700 1 --2- 172.21.15.86:0/3943656502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad0155fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcac40098e0 tx=0x7fcac40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d4a49923b21049c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.715+0000 7fcacdd9b700 1 -- 172.21.15.86:0/3943656502 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac400b640 con 0x7fcad01578b0 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.715+0000 7fcacdd9b700 1 -- 172.21.15.86:0/3943656502 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac400b7a0 con 0x7fcad01578b0 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.715+0000 7fcacdd9b700 1 -- 172.21.15.86:0/3943656502 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac400bb40 con 0x7fcad01578b0 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 -- 172.21.15.86:0/3943656502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 msgr2=0x7fcad0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3943656502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad0155fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcac40098e0 tx=0x7fcac40091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 -- 172.21.15.86:0/3943656502 shutdown_connections 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3943656502 >> v2:172.21.15.135:3300/0 conn(0x7fcad00af2f0 0x7fcad00af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3943656502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad0155fe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 -- 172.21.15.86:0/3943656502 >> 172.21.15.86:0/3943656502 conn(0x7fcad006a320 msgr2=0x7fcad00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 -- 172.21.15.86:0/3943656502 shutdown_connections 2023-10-09T12:00:34.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.716+0000 7fcad51ff700 1 -- 172.21.15.86:0/3943656502 wait complete. 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.717+0000 7fcad51ff700 1 Processor -- start 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.717+0000 7fcad51ff700 1 -- start start 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.718+0000 7fcad51ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00af2f0 0x7fcad00ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.718+0000 7fcad51ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad0155c10 0x7fcad0144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.718+0000 7fcad51ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad00ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.718+0000 7fcad51ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00cc890 con 0x7fcad00af2f0 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.718+0000 7fcad51ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00cd260 con 0x7fcad0155c10 2023-10-09T12:00:34.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.718+0000 7fcad51ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00cbc80 con 0x7fcad01578b0 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00af2f0 0x7fcad00ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00af2f0 0x7fcad00ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56922/0 (socket says 172.21.15.86:56922) 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 -- 172.21.15.86:0/3287819906 learned_addr learned my addr 172.21.15.86:0/3287819906 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcace59c700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad0155c10 0x7fcad0144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcacf59e700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad00ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 -- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 msgr2=0x7fcad00ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad00ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 -- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad0155c10 msgr2=0x7fcad0144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad0155c10 0x7fcad0144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 -- 172.21.15.86:0/3287819906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009420 con 0x7fcad00af2f0 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcacf59e700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad00ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:34.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcaced9d700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00af2f0 0x7fcad00ccd20 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c590 tx=0x7fcac000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.719+0000 7fcab6ffd700 1 -- 172.21.15.86:0/3287819906 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0011590 con 0x7fcad00af2f0 2023-10-09T12:00:34.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.720+0000 7fcab6ffd700 1 -- 172.21.15.86:0/3287819906 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac00116f0 con 0x7fcad00af2f0 2023-10-09T12:00:34.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.720+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad00cbf60 con 0x7fcad00af2f0 2023-10-09T12:00:34.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.720+0000 7fcab6ffd700 1 -- 172.21.15.86:0/3287819906 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0011ab0 con 0x7fcad00af2f0 2023-10-09T12:00:34.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.720+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad00cc520 con 0x7fcad00af2f0 2023-10-09T12:00:34.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.722+0000 7fcab6ffd700 1 -- 172.21.15.86:0/3287819906 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcac001b3b0 con 0x7fcad00af2f0 2023-10-09T12:00:34.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.722+0000 7fcab6ffd700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcabc066f30 0x7fcabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.723+0000 7fcab6ffd700 1 -- 172.21.15.86:0/3287819906 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fcac0083d10 con 0x7fcad00af2f0 2023-10-09T12:00:34.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.723+0000 7fcace59c700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcabc066f30 0x7fcabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.723+0000 7fcace59c700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcabc066f30 0x7fcabc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcac40091e0 tx=0x7fcac4017000 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.724+0000 7fcae38e8b80 1 Processor -- start 2023-10-09T12:00:34.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.724+0000 7fcae38e8b80 1 -- start start 2023-10-09T12:00:34.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.725+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 0x55b2b8824e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.725+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b886ed00 0x55b2b884da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.725+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b8820cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.725+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b877ba70 con 0x55b2b884df60 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.725+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8779270 con 0x55b2b8824a50 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.725+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8775060 con 0x55b2b886ed00 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b8820cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b8820cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56928/0 (socket says 172.21.15.86:56928) 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 -- 172.21.15.86:0/1195016025 learned_addr learned my addr 172.21.15.86:0/1195016025 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 -- 172.21.15.86:0/1195016025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b886ed00 msgr2=0x55b2b884da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 --2- 172.21.15.86:0/1195016025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b886ed00 0x55b2b884da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 -- 172.21.15.86:0/1195016025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 msgr2=0x55b2b8824e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 --2- 172.21.15.86:0/1195016025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 0x55b2b8824e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 -- 172.21.15.86:0/1195016025 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2b860f270 con 0x55b2b884df60 2023-10-09T12:00:34.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcacf59e700 1 --2- 172.21.15.86:0/1195016025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b8820cf0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009e60 tx=0x7fcac800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc316ef7b216d083 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcaaffff700 1 -- 172.21.15.86:0/1195016025 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8013580 con 0x55b2b884df60 2023-10-09T12:00:34.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcaaffff700 1 -- 172.21.15.86:0/1195016025 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800f070 con 0x55b2b884df60 2023-10-09T12:00:34.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.726+0000 7fcaaffff700 1 -- 172.21.15.86:0/1195016025 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8013910 con 0x55b2b884df60 2023-10-09T12:00:34.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 -- 172.21.15.86:0/1195016025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 msgr2=0x55b2b8820cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/1195016025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b8820cf0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009e60 tx=0x7fcac800b040 comp rx=0 tx=0).stop 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 -- 172.21.15.86:0/1195016025 shutdown_connections 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/1195016025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b8820cf0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/1195016025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 0x55b2b8824e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/1195016025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b886ed00 0x55b2b884da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 -- 172.21.15.86:0/1195016025 >> 172.21.15.86:0/1195016025 conn(0x55b2b8826370 msgr2=0x55b2b8826740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 -- 172.21.15.86:0/1195016025 shutdown_connections 2023-10-09T12:00:34.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.727+0000 7fcae38e8b80 1 -- 172.21.15.86:0/1195016025 wait complete. 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.728+0000 7fcae38e8b80 1 -- start start 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.728+0000 7fcae38e8b80 1 Processor -- start 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b884df60 0x55b2b8868c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b881fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8720890 con 0x55b2b886ed00 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b873bea0 con 0x55b2b884df60 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2b85f7e30 con 0x55b2b8824a50 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcae38e8b80 10 client.0 _ll_register_callbacks cb 0x55b2b87e8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcacf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b881fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcacf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b881fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56936/0 (socket says 172.21.15.86:56936) 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcacf59e700 1 -- 172.21.15.86:0/3909120914 learned_addr learned my addr 172.21.15.86:0/3909120914 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:34.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcace59c700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b884df60 0x55b2b8868c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.729+0000 7fcaced9d700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcacf59e700 1 -- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 msgr2=0x55b2b884a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcacf59e700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcacf59e700 1 -- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b884df60 msgr2=0x55b2b8868c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcacf59e700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b884df60 0x55b2b8868c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcacf59e700 1 -- 172.21.15.86:0/3909120914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac8009b80 con 0x55b2b886ed00 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcaced9d700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcace59c700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b884df60 0x55b2b8868c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcacf59e700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b881fef0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fcac8015000 tx=0x7fcac8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4be6b210fe7423 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcaad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcaad7fa700 1 -- 172.21.15.86:0/3909120914 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8014620 con 0x55b2b886ed00 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcaad7fa700 1 -- 172.21.15.86:0/3909120914 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fcac8014780 con 0x55b2b886ed00 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2b8819b70 con 0x55b2b886ed00 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcaad7fa700 1 -- 172.21.15.86:0/3909120914 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac8014b50 con 0x55b2b886ed00 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcae38e8b80 10 client.8253 fetch_fsmap learned FSMap version 63 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.730+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55b2b85b1fe0 con 0x55b2b886ed00 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcaad7fa700 1 -- 172.21.15.86:0/3909120914 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac802d070 con 0x55b2b886ed00 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcaad7fa700 1 -- 172.21.15.86:0/3909120914 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcac8014cb0 con 0x55b2b886ed00 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcae38e8b80 10 client.8253 fetch_fsmap finished waiting for FSMap version 63 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcae38e8b80 10 client.8253 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcae38e8b80 20 client.8253 populate_metadata read hostname 'smithi086' 2023-10-09T12:00:34.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8869180 0x55b2b88672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcae38e8b80 4 client.8253 mds_command: new command op to 8133 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T12:00:34.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 --> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2b87f6aa0 con 0x55b2b8869180 2023-10-09T12:00:34.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcaced9d700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8869180 0x55b2b88672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcaced9d700 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8869180 0x55b2b88672e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=accdc758408065e1 server_cookie=e5a9131a67a99139 in_seq=0 out_seq=0 2023-10-09T12:00:34.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.731+0000 7fcaad7fa700 10 client.8253 ms_handle_connect on v2:172.21.15.86:6834/2423117806 2023-10-09T12:00:34.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcaad7fa700 1 -- 172.21.15.86:0/3909120914 <== mds.0 v2:172.21.15.86:6834/2423117806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b2b87f6aa0 con 0x55b2b8869180 2023-10-09T12:00:34.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcaad7fa700 10 client.8253 handle_command_reply: tid=0 2023-10-09T12:00:34.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 client.8253 shutdown 2023-10-09T12:00:34.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 msgr2=0x55b2b881fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b881fef0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fcac8015000 tx=0x7fcac8019000 comp rx=0 tx=0).stop 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 shutdown_connections 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8869180 0x55b2b88672e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b881fef0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/3909120914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b884df60 0x55b2b8868c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcaad7fa700 0 client.8253 ms_handle_reset on v2:172.21.15.86:6834/2423117806 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.732+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 >> 172.21.15.86:0/3909120914 conn(0x55b2b8826370 msgr2=0x55b2b88251a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.733+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 shutdown_connections 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.733+0000 7fcae38e8b80 1 -- 172.21.15.86:0/3909120914 wait complete. 2023-10-09T12:00:34.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.733+0000 7fcae38e8b80 20 client.8253 trim_cache size 0 max 16384 2023-10-09T12:00:34.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.750+0000 7fcae38e8b80 1 Processor -- start 2023-10-09T12:00:34.750 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.750+0000 7fcae38e8b80 1 -- start start 2023-10-09T12:00:34.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b88257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b884d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b886ed00 0x55b2b884a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8868990 con 0x55b2b884df60 2023-10-09T12:00:34.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8826cc0 con 0x55b2b886ed00 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8868b70 con 0x55b2b8824a50 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b884d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b884d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56946/0 (socket says 172.21.15.86:56946) 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 -- 172.21.15.86:0/2981207548 learned_addr learned my addr 172.21.15.86:0/2981207548 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcaced9d700 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b88257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 -- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 msgr2=0x55b2b88257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b88257d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcacf59e700 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b886ed00 0x55b2b884a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 -- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b886ed00 msgr2=0x55b2b884a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b886ed00 0x55b2b884a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcace59c700 1 -- 172.21.15.86:0/2981207548 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2b8743780 con 0x55b2b884df60 2023-10-09T12:00:34.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcaced9d700 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b88257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:34.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.751+0000 7fcacf59e700 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b886ed00 0x55b2b884a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:34.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcace59c700 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b884d0e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b9e0 tx=0x7fcac4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59f541c281bff4b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcab4ff9700 1 -- 172.21.15.86:0/2981207548 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac402e070 con 0x55b2b884df60 2023-10-09T12:00:34.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcab4ff9700 1 -- 172.21.15.86:0/2981207548 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac400bac0 con 0x55b2b884df60 2023-10-09T12:00:34.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcab4ff9700 1 -- 172.21.15.86:0/2981207548 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4020070 con 0x55b2b884df60 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcae38e8b80 1 -- 172.21.15.86:0/2981207548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 msgr2=0x55b2b884d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b884d0e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b9e0 tx=0x7fcac4020000 comp rx=0 tx=0).stop 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcae38e8b80 1 -- 172.21.15.86:0/2981207548 shutdown_connections 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b886ed00 0x55b2b884a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b8824a50 0x55b2b88257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.752+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/2981207548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b884df60 0x55b2b884d0e0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.753+0000 7fcae38e8b80 1 -- 172.21.15.86:0/2981207548 >> 172.21.15.86:0/2981207548 conn(0x55b2b8826370 msgr2=0x55b2b881d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.753+0000 7fcae38e8b80 1 -- 172.21.15.86:0/2981207548 shutdown_connections 2023-10-09T12:00:34.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.753+0000 7fcae38e8b80 1 -- 172.21.15.86:0/2981207548 wait complete. 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.753+0000 7fcae38e8b80 1 -- start start 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.753+0000 7fcae38e8b80 1 Processor -- start 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.754+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.754+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b884df60 0x55b2b884a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.754+0000 7fcae38e8b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b88d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.754+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b886f840 con 0x55b2b886ed00 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.754+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8849910 con 0x55b2b8824a50 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.754+0000 7fcae38e8b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2b8849b60 con 0x55b2b884df60 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.754+0000 7fcae38e8b80 10 client.0 _ll_register_callbacks cb 0x55b2b87e8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b88d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b88d1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56960/0 (socket says 172.21.15.86:56960) 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 -- 172.21.15.86:0/652112283 learned_addr learned my addr 172.21.15.86:0/652112283 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcaced9d700 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcace59c700 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b884df60 0x55b2b884a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 -- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b884df60 msgr2=0x55b2b884a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b884df60 0x55b2b884a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 -- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 msgr2=0x55b2b884a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 -- 172.21.15.86:0/652112283 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad00ad000 con 0x55b2b886ed00 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcacf59e700 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b88d1130 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcac80268c0 tx=0x7fcac8020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3335882832268b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcaad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.755+0000 7fcaad7fa700 1 -- 172.21.15.86:0/652112283 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8000f40 con 0x55b2b886ed00 2023-10-09T12:00:34.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcaad7fa700 1 -- 172.21.15.86:0/652112283 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fcac8013db0 con 0x55b2b886ed00 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcad00a8540 con 0x55b2b886ed00 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcaad7fa700 1 -- 172.21.15.86:0/652112283 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac8014d60 con 0x55b2b886ed00 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 10 client.8259 fetch_fsmap learned FSMap version 63 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55b2b872a470 con 0x55b2b886ed00 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcaad7fa700 1 -- 172.21.15.86:0/652112283 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad00a8540 con 0x55b2b886ed00 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcaad7fa700 1 -- 172.21.15.86:0/652112283 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 63) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcac8013070 con 0x55b2b886ed00 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 10 client.8259 fetch_fsmap finished waiting for FSMap version 63 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 10 client.8259 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 20 client.8259 populate_metadata read hostname 'smithi086' 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8848820 0x55b2b88d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 4 client.8259 mds_command: new command op to 8133 tid=0[{"prefix": "status"}] 2023-10-09T12:00:34.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 --> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fcac800f070 con 0x55b2b8848820 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.756+0000 7fcaced9d700 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8848820 0x55b2b88d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcaced9d700 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8848820 0x55b2b88d1670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b61a0e2df8f574 server_cookie=6e373be31f9e31ea in_seq=0 out_seq=0 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcaad7fa700 10 client.8259 ms_handle_connect on v2:172.21.15.86:6834/2423117806 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcaad7fa700 1 -- 172.21.15.86:0/652112283 <== mds.0 v2:172.21.15.86:6834/2423117806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fcac800f070 con 0x55b2b8848820 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcaad7fa700 10 client.8259 handle_command_reply: tid=0 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 client.8259 shutdown 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 msgr2=0x55b2b88d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b88d1130 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcac80268c0 tx=0x7fcac8020070 comp rx=0 tx=0).stop 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 shutdown_connections 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:6834/2423117806,v1:172.21.15.86:6835/2423117806] conn(0x55b2b8848820 0x55b2b88d1670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b2b886ed00 0x55b2b88d1130 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2b8824a50 0x55b2b884a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 --2- 172.21.15.86:0/652112283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b2b884df60 0x55b2b884a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 >> 172.21.15.86:0/652112283 conn(0x55b2b8826370 msgr2=0x55b2b881d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcaad7fa700 0 client.8259 ms_handle_reset on v2:172.21.15.86:6834/2423117806 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 shutdown_connections 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.757+0000 7fcae38e8b80 1 -- 172.21.15.86:0/652112283 wait complete. 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcae38e8b80 20 client.8259 trim_cache size 0 max 16384 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T12:00:34.764 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 8133, 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 6.3732056979999996, 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 63, 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 139, 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 139, 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 12.778999355 2023-10-09T12:00:34.765 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T12:00:34.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcabc066f30 msgr2=0x7fcabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcabc066f30 0x7fcabc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcac40091e0 tx=0x7fcac4017000 comp rx=0 tx=0).stop 2023-10-09T12:00:34.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00af2f0 msgr2=0x7fcad00ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00af2f0 0x7fcad00ccd20 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c590 tx=0x7fcac000c950 comp rx=0 tx=0).stop 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 shutdown_connections 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcabc066f30 0x7fcabc0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00af2f0 0x7fcad00ccd20 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad01578b0 0x7fcad00ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 --2- 172.21.15.86:0/3287819906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad0155c10 0x7fcad0144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 >> 172.21.15.86:0/3287819906 conn(0x7fcad006a320 msgr2=0x7fcad00b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 shutdown_connections 2023-10-09T12:00:34.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.758+0000 7fcad51ff700 1 -- 172.21.15.86:0/3287819906 wait complete. 2023-10-09T12:00:34.775 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T12:00:34.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.956+0000 7f631319d700 1 Processor -- start 2023-10-09T12:00:34.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.956+0000 7f631319d700 1 -- start start 2023-10-09T12:00:34.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.957+0000 7f631319d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f630c157770 0x7f630c150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.957+0000 7f631319d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 0x7f630c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.957+0000 7f631319d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c06e2a0 con 0x7f630c0c6d00 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.957+0000 7f631319d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c157b40 con 0x7f630c157770 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.957+0000 7f631319d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c06b2e0 con 0x7f630c0c7150 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.957+0000 7f631199a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f630c0c6d00 0x7f630c06e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:51870/0 (socket says 172.21.15.86:51870) 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.957+0000 7f631199a700 1 -- 172.21.15.86:0/2966410731 learned_addr learned my addr 172.21.15.86:0/2966410731 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f631219b700 1 --2- 172.21.15.86:0/2966410731 >> v2:172.21.15.135:3300/0 conn(0x7f630c157770 0x7f630c150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f631299c700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 0x7f630c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850594576 0 0) 0x7f630c06e2a0 con 0x7f630c0c6d00 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f8003570 con 0x7f630c0c6d00 2023-10-09T12:00:34.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402233901 0 0) 0x7f62f8003570 con 0x7f630c0c6d00 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 msgr2=0x7f630c06ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 0x7f630c06ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 >> v2:172.21.15.135:3300/0 conn(0x7f630c157770 msgr2=0x7f630c150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 --2- 172.21.15.86:0/2966410731 >> v2:172.21.15.135:3300/0 conn(0x7f630c157770 0x7f630c150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0c78e0 con 0x7f630c0c6d00 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f62fc001470 con 0x7f630c0c6d00 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 >> v1:172.21.15.86:6789/0 conn(0x7f630c0c6d00 legacy=0x7f630c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62f8003ae0 0x7f62f8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 0x7f62f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f62f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c157b40 con 0x7f62f8004d50 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c06b2e0 con 0x7f62f8003ae0 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.958+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f800dd20 con 0x7f630c0c7150 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631299c700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f62f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631219b700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62f8003ae0 0x7f62f8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631199a700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 0x7f62f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631299c700 1 -- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 msgr2=0x7f62f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631299c700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 0x7f62f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631299c700 1 -- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62f8003ae0 msgr2=0x7f62f8003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631299c700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62f8003ae0 0x7f62f8003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631299c700 1 -- 172.21.15.86:0/2966410731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8003570 con 0x7f62f8004d50 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631199a700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0c7150 0x7f62f8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.959+0000 7f631299c700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f62f80051c0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f630400e240 tx=0x7f630400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e176e901096392 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400eaf0 con 0x7f62f8004d50 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400f040 con 0x7f62f8004d50 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f6311199700 1 -- 172.21.15.86:0/2966410731 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400eea0 con 0x7f62f8004d50 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f631319d700 1 -- 172.21.15.86:0/2966410731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 msgr2=0x7f62f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f631319d700 1 --2- 172.21.15.86:0/2966410731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f62f80051c0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f630400e240 tx=0x7f630400b040 comp rx=0 tx=0).stop 2023-10-09T12:00:34.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f631299c700 1 -- 172.21.15.86:0/2966410731 reap_dead start 2023-10-09T12:00:34.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f631319d700 1 -- 172.21.15.86:0/2966410731 shutdown_connections 2023-10-09T12:00:34.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f631319d700 1 -- 172.21.15.86:0/2966410731 >> 172.21.15.86:0/2966410731 conn(0x7f630c0cc1f0 msgr2=0x7f630c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:34.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f631319d700 1 -- 172.21.15.86:0/2966410731 shutdown_connections 2023-10-09T12:00:34.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.960+0000 7f631319d700 1 -- 172.21.15.86:0/2966410731 wait complete. 2023-10-09T12:00:34.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.962+0000 7f631319d700 1 Processor -- start 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.962+0000 7f631319d700 1 -- start start 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631319d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f630c148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631319d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c0affe0 0x7f630c168cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631319d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0b0450 0x7f630c169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631319d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c165a70 con 0x7f62f8004d50 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631319d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0afb50 con 0x7f630c0affe0 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631319d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c1490f0 con 0x7f630c0b0450 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f630c148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f630c148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34716/0 (socket says 172.21.15.86:34716) 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 -- 172.21.15.86:0/3921260498 learned_addr learned my addr 172.21.15.86:0/3921260498 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:34.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 -- 172.21.15.86:0/3921260498 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0b0450 msgr2=0x7f630c169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0b0450 0x7f630c169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 -- 172.21.15.86:0/3921260498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c0affe0 msgr2=0x7f630c168cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c0affe0 0x7f630c168cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 -- 172.21.15.86:0/3921260498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c1698a0 con 0x7f62f8004d50 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.963+0000 7f631219b700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f630c148bb0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6308006ac0 tx=0x7f63080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.964+0000 7f63027fc700 1 -- 172.21.15.86:0/3921260498 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800fa10 con 0x7f62f8004d50 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.964+0000 7f63027fc700 1 -- 172.21.15.86:0/3921260498 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800fb70 con 0x7f62f8004d50 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.964+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c0af500 con 0x7f62f8004d50 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.964+0000 7f63027fc700 1 -- 172.21.15.86:0/3921260498 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308014440 con 0x7f62f8004d50 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.964+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c14a780 con 0x7f62f8004d50 2023-10-09T12:00:34.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.965+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c04c3c0 con 0x7f62f8004d50 2023-10-09T12:00:34.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.966+0000 7f63027fc700 1 -- 172.21.15.86:0/3921260498 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6308014830 con 0x7f62f8004d50 2023-10-09T12:00:34.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.966+0000 7f63027fc700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:34.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.967+0000 7f63027fc700 1 -- 172.21.15.86:0/3921260498 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f6308018030 con 0x7f62f8004d50 2023-10-09T12:00:34.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.967+0000 7f631199a700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:34.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.967+0000 7f631199a700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62f0066f30 0x7f62f00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62fc000e10 tx=0x7f630c156270 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:34.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:34.971+0000 7f63027fc700 1 -- 172.21.15.86:0/3921260498 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63080521f0 con 0x7f62f8004d50 2023-10-09T12:00:35.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.202+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f630c0afe30 con 0x7f62f8004d50 2023-10-09T12:00:35.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.202+0000 7f63027fc700 1 -- 172.21.15.86:0/3921260498 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6308055810 con 0x7f62f8004d50 2023-10-09T12:00:35.202 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62f0066f30 msgr2=0x7f62f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62f0066f30 0x7f62f00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62fc000e10 tx=0x7f630c156270 comp rx=0 tx=0).stop 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 msgr2=0x7f630c148bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f630c148bb0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6308006ac0 tx=0x7f63080091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 shutdown_connections 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f8004d50 0x7f630c148bb0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f630c0b0450 0x7f630c169200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 --2- 172.21.15.86:0/3921260498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c0affe0 0x7f630c168cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:35.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 >> 172.21.15.86:0/3921260498 conn(0x7f630c0cc1f0 msgr2=0x7f630c157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:35.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 shutdown_connections 2023-10-09T12:00:35.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:35.204+0000 7f631319d700 1 -- 172.21.15.86:0/3921260498 wait complete. 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T12:00:35.222 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:00:35.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:35.223 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T12:00:35.260 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T12:00:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T12:00:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T12:00:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:00:35.260 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:00:35.261 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41108sec preferred_lft 41108sec 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T12:00:35.262 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T12:00:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T12:00:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:00:35.263 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T12:00:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T12:00:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T12:00:35.263 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:00:35.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:35.263 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T12:00:35.358 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T12:00:35.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:35.361 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T12:00:35.400 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T12:00:35.400 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T12:00:35.400 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T12:00:35.401 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T12:00:35.401 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T12:00:35.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:35.402 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T12:00:35.402 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T12:00:35.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T12:00:35.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T12:00:35.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T12:00:35.402 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T12:00:35.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:35.597 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T12:00:35.632 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T12:00:35.632 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T12:00:35.633 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:00:35.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:35.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T12:00:35.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T12:00:35.733 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T12:00:35.770 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:00:35.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T12:00:35.771 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T12:00:35.846 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T12:00:35.846 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T12:00:35.846 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:00:35.976 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:00:35.976 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T12:00:36.004 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:00:36.005 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T12:00:36.005 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T12:00:36.005 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T12:00:36.005 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T12:00:36.010 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T12:00:36.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:00:36.010 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T12:00:36.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T12:00:36.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.256+0000 7f0e99b9d700 1 Processor -- start 2023-10-09T12:00:36.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.256+0000 7f0e99b9d700 1 -- start start 2023-10-09T12:00:36.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.257+0000 7f0e99b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0e940ae710 0x7f0e940c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.257+0000 7f0e99b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940ca860 con 0x7f0e94156310 2023-10-09T12:00:36.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.257+0000 7f0e99b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940cab40 con 0x7f0e941566e0 2023-10-09T12:00:36.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.257+0000 7f0e99b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940cae20 con 0x7f0e940ae710 2023-10-09T12:00:36.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.257+0000 7f0e98b9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0e94156310 0x7f0e940c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:51884/0 (socket says 172.21.15.86:51884) 2023-10-09T12:00:36.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.257+0000 7f0e98b9b700 1 -- 172.21.15.86:0/409001200 learned_addr learned my addr 172.21.15.86:0/409001200 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:36.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.257+0000 7f0e9939c700 1 --2- 172.21.15.86:0/409001200 >> v2:172.21.15.135:3300/0 conn(0x7f0e940ae710 0x7f0e940c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294713052 0 0) 0x7f0e940ca860 con 0x7f0e94156310 2023-10-09T12:00:36.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e84003570 con 0x7f0e94156310 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4168898229 0 0) 0x7f0e84003570 con 0x7f0e94156310 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 >> v2:172.21.15.135:3300/0 conn(0x7f0e940ae710 msgr2=0x7f0e940c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 --2- 172.21.15.86:0/409001200 >> v2:172.21.15.135:3300/0 conn(0x7f0e940ae710 0x7f0e940c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 >> v1:172.21.15.135:6789/0 conn(0x7f0e941566e0 legacy=0x7f0e940ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940cb100 con 0x7f0e94156310 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f0e88001470 con 0x7f0e94156310 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 >> v1:172.21.15.86:6789/0 conn(0x7f0e94156310 legacy=0x7f0e940c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84003a60 0x7f0e84003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e84004810 0x7f0e84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e840051c0 0x7f0e8400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940cae20 con 0x7f0e84004810 2023-10-09T12:00:36.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8400e2e0 con 0x7f0e840051c0 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8400e4a0 con 0x7f0e84003a60 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e93fff700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e84004810 0x7f0e84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e98b9b700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84003a60 0x7f0e84003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.258+0000 7f0e9939c700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e840051c0 0x7f0e8400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e93fff700 1 -- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84003a60 msgr2=0x7f0e84003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e93fff700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84003a60 0x7f0e84003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e93fff700 1 -- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e840051c0 msgr2=0x7f0e8400dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e93fff700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e840051c0 0x7f0e8400dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e93fff700 1 -- 172.21.15.86:0/409001200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84003570 con 0x7f0e84004810 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e9939c700 1 -- 172.21.15.86:0/409001200 reap_dead start 2023-10-09T12:00:36.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e98b9b700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84003a60 0x7f0e84003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e93fff700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e84004810 0x7f0e84004c80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001880 tx=0x7f0e80007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e9e20310459331 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80012420 con 0x7f0e84004810 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800125a0 con 0x7f0e84004810 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.259+0000 7f0e937fe700 1 -- 172.21.15.86:0/409001200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80012960 con 0x7f0e84004810 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.260+0000 7f0e99b9d700 1 -- 172.21.15.86:0/409001200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e84004810 msgr2=0x7f0e84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.260+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e84004810 0x7f0e84004c80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001880 tx=0x7f0e80007d30 comp rx=0 tx=0).stop 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.260+0000 7f0e99b9d700 1 -- 172.21.15.86:0/409001200 shutdown_connections 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.260+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/409001200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e84004810 0x7f0e84004c80 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.260+0000 7f0e99b9d700 1 -- 172.21.15.86:0/409001200 >> 172.21.15.86:0/409001200 conn(0x7f0e940cc1f0 msgr2=0x7f0e940cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.260+0000 7f0e99b9d700 1 -- 172.21.15.86:0/409001200 shutdown_connections 2023-10-09T12:00:36.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.260+0000 7f0e99b9d700 1 -- 172.21.15.86:0/409001200 wait complete. 2023-10-09T12:00:36.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.261+0000 7f0e99b9d700 1 Processor -- start 2023-10-09T12:00:36.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.261+0000 7f0e99b9d700 1 -- start start 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e99b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84004810 0x7f0e9414bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e99b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e940afcf0 0x7f0e94147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e99b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e9406ebd0 0x7f0e9406f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e99b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9406f5b0 con 0x7f0e940afcf0 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e99b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9414a760 con 0x7f0e9406ebd0 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e99b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9414aa40 con 0x7f0e84004810 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e93fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e940afcf0 0x7f0e94147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e93fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e940afcf0 0x7f0e94147cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34732/0 (socket says 172.21.15.86:34732) 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.262+0000 7f0e93fff700 1 -- 172.21.15.86:0/4135367857 learned_addr learned my addr 172.21.15.86:0/4135367857 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e9939c700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e9406ebd0 0x7f0e9406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e98b9b700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84004810 0x7f0e9414bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e93fff700 1 -- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84004810 msgr2=0x7f0e9414bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e93fff700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84004810 0x7f0e9414bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e93fff700 1 -- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e9406ebd0 msgr2=0x7f0e9406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e93fff700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e9406ebd0 0x7f0e9406f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e93fff700 1 -- 172.21.15.86:0/4135367857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9414ad20 con 0x7f0e940afcf0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e93fff700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e940afcf0 0x7f0e94147cb0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001e70 tx=0x7f0e80015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e90ff9700 1 -- 172.21.15.86:0/4135367857 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80001200 con 0x7f0e940afcf0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e90ff9700 1 -- 172.21.15.86:0/4135367857 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80012cd0 con 0x7f0e940afcf0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e90ff9700 1 -- 172.21.15.86:0/4135367857 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80012940 con 0x7f0e940afcf0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9414b000 con 0x7f0e940afcf0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.263+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9414c4d0 con 0x7f0e940afcf0 2023-10-09T12:00:36.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.264+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9406f5b0 con 0x7f0e940afcf0 2023-10-09T12:00:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.265+0000 7f0e90ff9700 1 -- 172.21.15.86:0/4135367857 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e80019030 con 0x7f0e940afcf0 2023-10-09T12:00:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.266+0000 7f0e90ff9700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e78066f30 0x7f0e780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.266+0000 7f0e90ff9700 1 -- 172.21.15.86:0/4135367857 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f0e80085890 con 0x7f0e940afcf0 2023-10-09T12:00:36.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.266+0000 7f0e98b9b700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e78066f30 0x7f0e780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.267+0000 7f0e98b9b700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e78066f30 0x7f0e780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e88001200 tx=0x7f0e88009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:36.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.270+0000 7f0e90ff9700 1 -- 172.21.15.86:0/4135367857 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e800528d0 con 0x7f0e940afcf0 2023-10-09T12:00:36.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.498+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e9404c3c0 con 0x7f0e78066f30 2023-10-09T12:00:36.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.500+0000 7f0e90ff9700 1 -- 172.21.15.86:0/4135367857 <== mgr.6599 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0e9404c3c0 con 0x7f0e78066f30 2023-10-09T12:00:36.500 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T12:00:36.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:00:36.500 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T12:00:36.500 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:00:36.501 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T12:00:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e78066f30 msgr2=0x7f0e780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e78066f30 0x7f0e780693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e88001200 tx=0x7f0e88009040 comp rx=0 tx=0).stop 2023-10-09T12:00:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e940afcf0 msgr2=0x7f0e94147cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e940afcf0 0x7f0e94147cb0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001e70 tx=0x7f0e80015000 comp rx=0 tx=0).stop 2023-10-09T12:00:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 shutdown_connections 2023-10-09T12:00:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e9406ebd0 0x7f0e9406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e84004810 0x7f0e9414bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e78066f30 0x7f0e780693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 --2- 172.21.15.86:0/4135367857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e940afcf0 0x7f0e94147cb0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.502+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 >> 172.21.15.86:0/4135367857 conn(0x7f0e940cc1f0 msgr2=0x7f0e940c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:36.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.503+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 shutdown_connections 2023-10-09T12:00:36.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.503+0000 7f0e99b9d700 1 -- 172.21.15.86:0/4135367857 wait complete. 2023-10-09T12:00:36.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T12:00:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.702+0000 7fd46ddff700 1 Processor -- start 2023-10-09T12:00:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.702+0000 7fd46ddff700 1 -- start start 2023-10-09T12:00:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.703+0000 7fd46ddff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4680c70b0 0x7fd468155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd46ddff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46806e950 con 0x7fd4680ccc40 2023-10-09T12:00:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd46ddff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46806eb90 con 0x7fd4680cd0b0 2023-10-09T12:00:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd46ddff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4681563f0 con 0x7fd4680c70b0 2023-10-09T12:00:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd466ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd4680ccc40 0x7fd46806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:51892/0 (socket says 172.21.15.86:51892) 2023-10-09T12:00:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd466ffd700 1 -- 172.21.15.86:0/3649925725 learned_addr learned my addr 172.21.15.86:0/3649925725 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:36.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd4677fe700 1 --2- 172.21.15.86:0/3649925725 >> v2:172.21.15.135:3300/0 conn(0x7fd4680c70b0 0x7fd468155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910071492 0 0) 0x7fd45c001110 con 0x7fd4680ccc40 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd450003570 con 0x7fd4680ccc40 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 544157502 0 0) 0x7fd450003570 con 0x7fd4680ccc40 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 >> v2:172.21.15.135:3300/0 conn(0x7fd4680c70b0 msgr2=0x7fd468155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd4667fc700 1 --2- 172.21.15.86:0/3649925725 >> v2:172.21.15.135:3300/0 conn(0x7fd4680c70b0 0x7fd468155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.704+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 >> v1:172.21.15.135:6789/0 conn(0x7fd4680cd0b0 legacy=0x7fd468069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46806ee70 con 0x7fd4680ccc40 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fd45c001600 con 0x7fd4680ccc40 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 >> v1:172.21.15.86:6789/0 conn(0x7fd4680ccc40 legacy=0x7fd46806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd450003a60 0x7fd450003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd450004810 0x7fd450004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd45000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681563f0 con 0x7fd4500051c0 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45000e2e0 con 0x7fd450004810 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45000e4a0 con 0x7fd450003a60 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd467fff700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd45000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd466ffd700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd450004810 0x7fd450004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd4677fe700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd450003a60 0x7fd450003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd467fff700 1 -- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd450003a60 msgr2=0x7fd450003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd467fff700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd450003a60 0x7fd450003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd467fff700 1 -- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd450004810 msgr2=0x7fd450004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd467fff700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd450004810 0x7fd450004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd467fff700 1 -- 172.21.15.86:0/3649925725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450003570 con 0x7fd4500051c0 2023-10-09T12:00:36.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.705+0000 7fd467fff700 1 -- 172.21.15.86:0/3649925725 reap_dead start 2023-10-09T12:00:36.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd467fff700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd45000dc70 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fd4680c6b20 tx=0x7fd460001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c876499ef9e10313 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:36.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460001950 con 0x7fd4500051c0 2023-10-09T12:00:36.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460004030 con 0x7fd4500051c0 2023-10-09T12:00:36.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd4667fc700 1 -- 172.21.15.86:0/3649925725 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000cae0 con 0x7fd4500051c0 2023-10-09T12:00:36.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd46ddff700 1 -- 172.21.15.86:0/3649925725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 msgr2=0x7fd45000dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd46ddff700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd45000dc70 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fd4680c6b20 tx=0x7fd460001640 comp rx=0 tx=0).stop 2023-10-09T12:00:36.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd46ddff700 1 -- 172.21.15.86:0/3649925725 shutdown_connections 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd46ddff700 1 --2- 172.21.15.86:0/3649925725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd45000dc70 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd46ddff700 1 -- 172.21.15.86:0/3649925725 >> 172.21.15.86:0/3649925725 conn(0x7fd468068e10 msgr2=0x7fd4680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd46ddff700 1 -- 172.21.15.86:0/3649925725 shutdown_connections 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.706+0000 7fd46ddff700 1 -- 172.21.15.86:0/3649925725 wait complete. 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.708+0000 7fd46ddff700 1 Processor -- start 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.708+0000 7fd46ddff700 1 -- start start 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd46ddff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd46815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd46ddff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd468154c20 0x7fd4680b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd46ddff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4680b1960 0x7fd468169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd46ddff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46816aa50 con 0x7fd4500051c0 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd46ddff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680b1dd0 con 0x7fd468154c20 2023-10-09T12:00:36.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd46ddff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46815b0c0 con 0x7fd4680b1960 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd46815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd46815b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34744/0 (socket says 172.21.15.86:34744) 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 -- 172.21.15.86:0/2346094567 learned_addr learned my addr 172.21.15.86:0/2346094567 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd467fff700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4680b1960 0x7fd468169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd466ffd700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd468154c20 0x7fd4680b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 -- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4680b1960 msgr2=0x7fd468169a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4680b1960 0x7fd468169a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 -- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd468154c20 msgr2=0x7fd4680b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd468154c20 0x7fd4680b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.709+0000 7fd4677fe700 1 -- 172.21.15.86:0/2346094567 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46816a770 con 0x7fd4500051c0 2023-10-09T12:00:36.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.710+0000 7fd4677fe700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd46815b550 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fd458006ac0 tx=0x7fd4580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.710+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800fa10 con 0x7fd4500051c0 2023-10-09T12:00:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.710+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800fb70 con 0x7fd4500051c0 2023-10-09T12:00:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.710+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458014440 con 0x7fd4500051c0 2023-10-09T12:00:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.710+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46815aa70 con 0x7fd4500051c0 2023-10-09T12:00:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.710+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd468155090 con 0x7fd4500051c0 2023-10-09T12:00:36.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.711+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46804c3c0 con 0x7fd4500051c0 2023-10-09T12:00:36.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.712+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 63) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd458014830 con 0x7fd4500051c0 2023-10-09T12:00:36.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.713+0000 7fd44f7fe700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:36.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.713+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fd458018030 con 0x7fd4500051c0 2023-10-09T12:00:36.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.713+0000 7fd466ffd700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:36.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.714+0000 7fd466ffd700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd454066f30 0x7fd4540693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd45c000f60 tx=0x7fd45c009040 comp rx=0 tx=0).ready entity=mgr.6599 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:36.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.717+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd458052250 con 0x7fd4500051c0 2023-10-09T12:00:36.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:36.958+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd4680678d0 con 0x7fd4500051c0 2023-10-09T12:00:37.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.430+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 64) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fd4580519b0 con 0x7fd4500051c0 2023-10-09T12:00:37.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.431+0000 7fd44f7fe700 1 -- 172.21.15.86:0/2346094567 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v64) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd458052250 con 0x7fd4500051c0 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd454066f30 msgr2=0x7fd4540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd454066f30 0x7fd4540693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd45c000f60 tx=0x7fd45c009040 comp rx=0 tx=0).stop 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 msgr2=0x7fd46815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd46815b550 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fd458006ac0 tx=0x7fd4580091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 shutdown_connections 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4500051c0 0x7fd46815b550 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4680b1960 0x7fd468169a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 --2- 172.21.15.86:0/2346094567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd468154c20 0x7fd4680b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 >> 172.21.15.86:0/2346094567 conn(0x7fd468068e10 msgr2=0x7fd4680c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:37.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 shutdown_connections 2023-10-09T12:00:37.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.434+0000 7fd46ddff700 1 -- 172.21.15.86:0/2346094567 wait complete. 2023-10-09T12:00:37.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T12:00:37.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.643+0000 7fba2659d700 1 Processor -- start 2023-10-09T12:00:37.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.643+0000 7fba2659d700 1 -- start start 2023-10-09T12:00:37.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2659d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba200b4e70 0x7fba200ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b1b40 0x7fba2015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2659d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba200cfb00 con 0x7fba200b16d0 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2659d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba200b5c40 con 0x7fba200b4e70 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200b5f20 con 0x7fba200b1b40 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2559b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba200b4e70 0x7fba200ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2559b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba200b4e70 0x7fba200ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34778/0 (socket says 172.21.15.86:34778) 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba2559b700 1 -- 172.21.15.86:0/101049597 learned_addr learned my addr 172.21.15.86:0/101049597 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.644+0000 7fba25d9c700 1 --2- 172.21.15.86:0/101049597 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b1b40 0x7fba2015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba2559b700 1 -- 172.21.15.86:0/101049597 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b1b40 msgr2=0x7fba2015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:37.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba2559b700 1 --2- 172.21.15.86:0/101049597 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b1b40 0x7fba2015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba2559b700 1 -- 172.21.15.86:0/101049597 >> v1:172.21.15.135:6789/0 conn(0x7fba200b16d0 legacy=0x7fba2015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:37.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba2559b700 1 -- 172.21.15.86:0/101049597 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200b6200 con 0x7fba200b4e70 2023-10-09T12:00:37.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba2559b700 1 --2- 172.21.15.86:0/101049597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b4e70 0x7fba200ccff0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0099b0 tx=0x7fba1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb46bd8d55795cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:37.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba17fff700 1 -- 172.21.15.86:0/101049597 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c009ea0 con 0x7fba200b4e70 2023-10-09T12:00:37.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba17fff700 1 -- 172.21.15.86:0/101049597 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c00b860 con 0x7fba200b4e70 2023-10-09T12:00:37.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.645+0000 7fba17fff700 1 -- 172.21.15.86:0/101049597 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00bc00 con 0x7fba200b4e70 2023-10-09T12:00:37.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 -- 172.21.15.86:0/101049597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b4e70 msgr2=0x7fba200ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:37.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 --2- 172.21.15.86:0/101049597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b4e70 0x7fba200ccff0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0099b0 tx=0x7fba1c009250 comp rx=0 tx=0).stop 2023-10-09T12:00:37.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 -- 172.21.15.86:0/101049597 shutdown_connections 2023-10-09T12:00:37.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 --2- 172.21.15.86:0/101049597 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b1b40 0x7fba2015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 --2- 172.21.15.86:0/101049597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b4e70 0x7fba200ccff0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 -- 172.21.15.86:0/101049597 >> 172.21.15.86:0/101049597 conn(0x7fba200d10c0 msgr2=0x7fba200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:37.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 -- 172.21.15.86:0/101049597 shutdown_connections 2023-10-09T12:00:37.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.646+0000 7fba2659d700 1 -- 172.21.15.86:0/101049597 wait complete. 2023-10-09T12:00:37.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.648+0000 7fba2659d700 1 Processor -- start 2023-10-09T12:00:37.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.648+0000 7fba2659d700 1 -- start start 2023-10-09T12:00:37.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba2659d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba200b16d0 0x7fba2015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:37.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba2659d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b1b40 0x7fba2015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:37.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba2659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b4e70 0x7fba2016d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:37.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba2659d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200a7200 con 0x7fba200b1b40 2023-10-09T12:00:37.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba2659d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200c8850 con 0x7fba200b16d0 2023-10-09T12:00:37.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba2659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200c8b30 con 0x7fba200b4e70 2023-10-09T12:00:37.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b1b40 0x7fba2015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba25d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b4e70 0x7fba2016d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba2559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba200b16d0 0x7fba2015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b1b40 0x7fba2015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34786/0 (socket says 172.21.15.86:34786) 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba25d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b4e70 0x7fba2016d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:60548/0 (socket says 172.21.15.86:60548) 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 -- 172.21.15.86:0/1643321778 learned_addr learned my addr 172.21.15.86:0/1643321778 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 -- 172.21.15.86:0/1643321778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b4e70 msgr2=0x7fba2016d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b4e70 0x7fba2016d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 -- 172.21.15.86:0/1643321778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba200b16d0 msgr2=0x7fba2015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba200b16d0 0x7fba2015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.649+0000 7fba24d9a700 1 -- 172.21.15.86:0/1643321778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0094f0 con 0x7fba200b1b40 2023-10-09T12:00:37.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.650+0000 7fba24d9a700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b1b40 0x7fba2015c0c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fba1000c4e0 tx=0x7fba1000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:37.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.650+0000 7fba157fa700 1 -- 172.21.15.86:0/1643321778 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10011590 con 0x7fba200b1b40 2023-10-09T12:00:37.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.650+0000 7fba157fa700 1 -- 172.21.15.86:0/1643321778 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10011710 con 0x7fba200b1b40 2023-10-09T12:00:37.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.650+0000 7fba157fa700 1 -- 172.21.15.86:0/1643321778 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10011ad0 con 0x7fba200b1b40 2023-10-09T12:00:37.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.650+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba200c8e10 con 0x7fba200b1b40 2023-10-09T12:00:37.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.650+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba20147cd0 con 0x7fba200b1b40 2023-10-09T12:00:37.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.651+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba200c92b0 con 0x7fba200b1b40 2023-10-09T12:00:37.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.652+0000 7fba157fa700 1 -- 172.21.15.86:0/1643321778 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 64) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fba1001b3b0 con 0x7fba200b1b40 2023-10-09T12:00:37.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.653+0000 7fba157fa700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 0x7fba04069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:37.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.653+0000 7fba157fa700 1 -- 172.21.15.86:0/1643321778 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fba10083b80 con 0x7fba200b1b40 2023-10-09T12:00:37.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.653+0000 7fba2559b700 1 -- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 msgr2=0x7fba04069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:37.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.653+0000 7fba2559b700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 0x7fba04069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:37.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.657+0000 7fba157fa700 1 -- 172.21.15.86:0/1643321778 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba10050bc0 con 0x7fba200b1b40 2023-10-09T12:00:37.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.854+0000 7fba2559b700 1 -- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 msgr2=0x7fba04069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:37.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.854+0000 7fba2559b700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 0x7fba04069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:37.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.931+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fba20069b20 con 0x7fba200b1b40 2023-10-09T12:00:37.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.937+0000 7fba157fa700 1 -- 172.21.15.86:0/1643321778 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7fba10017070 con 0x7fba200b1b40 2023-10-09T12:00:37.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 msgr2=0x7fba04069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:37.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 0x7fba04069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b1b40 msgr2=0x7fba2015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:37.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b1b40 0x7fba2015c0c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fba1000c4e0 tx=0x7fba1000c7f0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 shutdown_connections 2023-10-09T12:00:37.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba200b4e70 0x7fba2016d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba200b16d0 0x7fba2015bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fba04066f80 0x7fba04069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 --2- 172.21.15.86:0/1643321778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba200b1b40 0x7fba2015c0c0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:37.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.939+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 >> 172.21.15.86:0/1643321778 conn(0x7fba200d10c0 msgr2=0x7fba200b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:37.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.940+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 shutdown_connections 2023-10-09T12:00:37.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:37.940+0000 7fba2659d700 1 -- 172.21.15.86:0/1643321778 wait complete. 2023-10-09T12:00:37.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T12:00:38.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.144+0000 7f65dc99d700 1 Processor -- start 2023-10-09T12:00:38.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.145+0000 7f65dc99d700 1 -- start start 2023-10-09T12:00:38.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65dc99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65d80b4e70 0x7f65d80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65dc99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65dc99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d80cfb00 con 0x7f65d80b16d0 2023-10-09T12:00:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65dc99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d80b5c40 con 0x7f65d80b4e70 2023-10-09T12:00:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65dc99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80b5f20 con 0x7f65d80b1b40 2023-10-09T12:00:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65d77fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65d80b4e70 0x7f65d80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65d7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65d77fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65d80b4e70 0x7f65d80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:50358/0 (socket says 172.21.15.86:50358) 2023-10-09T12:00:38.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65d77fe700 1 -- 172.21.15.86:0/1555232799 learned_addr learned my addr 172.21.15.86:0/1555232799 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:38.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.146+0000 7f65d6ffd700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f65d80b16d0 0x7f65d815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:43190/0 (socket says 172.21.15.86:43190) 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d7fff700 1 -- 172.21.15.86:0/1555232799 >> v2:172.21.15.135:3300/0 conn(0x7f65d80b4e70 msgr2=0x7f65d80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d7fff700 1 --2- 172.21.15.86:0/1555232799 >> v2:172.21.15.135:3300/0 conn(0x7f65d80b4e70 0x7f65d80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d7fff700 1 -- 172.21.15.86:0/1555232799 >> v1:172.21.15.135:6789/0 conn(0x7f65d80b16d0 legacy=0x7f65d815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d7fff700 1 -- 172.21.15.86:0/1555232799 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80b6200 con 0x7f65d80b1b40 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d7fff700 1 --2- 172.21.15.86:0/1555232799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815d950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009e60 tx=0x7f65d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84708c67e063dfcf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d67fc700 1 -- 172.21.15.86:0/1555232799 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d000e070 con 0x7f65d80b1b40 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d67fc700 1 -- 172.21.15.86:0/1555232799 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d000bb60 con 0x7f65d80b1b40 2023-10-09T12:00:38.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.147+0000 7f65d67fc700 1 -- 172.21.15.86:0/1555232799 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0012430 con 0x7f65d80b1b40 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 -- 172.21.15.86:0/1555232799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 msgr2=0x7f65d815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1555232799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815d950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009e60 tx=0x7f65d0009780 comp rx=0 tx=0).stop 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 -- 172.21.15.86:0/1555232799 shutdown_connections 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1555232799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815d950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1555232799 >> v2:172.21.15.135:3300/0 conn(0x7f65d80b4e70 0x7f65d80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 -- 172.21.15.86:0/1555232799 >> 172.21.15.86:0/1555232799 conn(0x7f65d80d10c0 msgr2=0x7f65d80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 -- 172.21.15.86:0/1555232799 shutdown_connections 2023-10-09T12:00:38.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.148+0000 7f65dc99d700 1 -- 172.21.15.86:0/1555232799 wait complete. 2023-10-09T12:00:38.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.149+0000 7f65dc99d700 1 Processor -- start 2023-10-09T12:00:38.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.150+0000 7f65dc99d700 1 -- start start 2023-10-09T12:00:38.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.150+0000 7f65dc99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d80b16d0 0x7f65d80c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.150+0000 7f65dc99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.150+0000 7f65dc99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d80b4e70 0x7f65d81561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.150+0000 7f65dc99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80c6630 con 0x7f65d80b4e70 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.150+0000 7f65dc99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80c5a20 con 0x7f65d80b16d0 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.150+0000 7f65dc99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80c5d00 con 0x7f65d80b1b40 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d80b4e70 0x7f65d81561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d80b4e70 0x7f65d81561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34802/0 (socket says 172.21.15.86:34802) 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 -- 172.21.15.86:0/1134629604 learned_addr learned my addr 172.21.15.86:0/1134629604 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d77fe700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d80b16d0 0x7f65d80c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d6ffd700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 -- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 msgr2=0x7f65d815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 -- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d80b16d0 msgr2=0x7f65d80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d80b16d0 0x7f65d80c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 -- 172.21.15.86:0/1134629604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0009a20 con 0x7f65d80b4e70 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.151+0000 7f65d7fff700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d80b4e70 0x7f65d81561e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f65d80b6060 tx=0x7f65d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.152+0000 7f65bf7fe700 1 -- 172.21.15.86:0/1134629604 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0012ea0 con 0x7f65d80b4e70 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.152+0000 7f65bf7fe700 1 -- 172.21.15.86:0/1134629604 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d0027470 con 0x7f65d80b4e70 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.152+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d80c5fe0 con 0x7f65d80b4e70 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.152+0000 7f65bf7fe700 1 -- 172.21.15.86:0/1134629604 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0027850 con 0x7f65d80b4e70 2023-10-09T12:00:38.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.152+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d8156720 con 0x7f65d80b4e70 2023-10-09T12:00:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.153+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d80c67e0 con 0x7f65d80b4e70 2023-10-09T12:00:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.154+0000 7f65bf7fe700 1 -- 172.21.15.86:0/1134629604 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 64) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f65d0024070 con 0x7f65d80b4e70 2023-10-09T12:00:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.155+0000 7f65bf7fe700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 0x7f65c4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.155+0000 7f65d77fe700 1 -- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 msgr2=0x7f65c4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:38.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.155+0000 7f65bf7fe700 1 -- 172.21.15.86:0/1134629604 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f65d0087130 con 0x7f65d80b4e70 2023-10-09T12:00:38.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.155+0000 7f65d77fe700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 0x7f65c4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:38.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.159+0000 7f65bf7fe700 1 -- 172.21.15.86:0/1134629604 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65d80c67e0 con 0x7f65d80b4e70 2023-10-09T12:00:38.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.354+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f65d80c6770 con 0x7f65d80b4e70 2023-10-09T12:00:38.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.356+0000 7f65d77fe700 1 -- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 msgr2=0x7f65c4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:38.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.356+0000 7f65d77fe700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 0x7f65c4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:38.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.360+0000 7f65bf7fe700 1 -- 172.21.15.86:0/1134629604 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f65d005be60 con 0x7f65d80b4e70 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 msgr2=0x7f65c4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 0x7f65c4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d80b4e70 msgr2=0x7f65d81561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d80b4e70 0x7f65d81561e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f65d80b6060 tx=0x7f65d0019000 comp rx=0 tx=0).stop 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 shutdown_connections 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f65c4066f80 0x7f65c4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65d80b4e70 0x7f65d81561e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d80b16d0 0x7f65d80c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 --2- 172.21.15.86:0/1134629604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d80b1b40 0x7f65d815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 >> 172.21.15.86:0/1134629604 conn(0x7f65d80d10c0 msgr2=0x7f65d8159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:38.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 shutdown_connections 2023-10-09T12:00:38.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.362+0000 7f65dc99d700 1 -- 172.21.15.86:0/1134629604 wait complete. 2023-10-09T12:00:38.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:00:38.381 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T12:00:38.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-10-09T12:00:38.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.650+0000 7f6c38b9d700 1 Processor -- start 2023-10-09T12:00:38.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.650+0000 7f6c38b9d700 1 -- start start 2023-10-09T12:00:38.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c38b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6c340b0790 0x7f6c340cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c38b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c341591e0 0x7f6c34159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c38b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340cfa00 con 0x7f6c340b03c0 2023-10-09T12:00:38.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c38b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340cb580 con 0x7f6c341591e0 2023-10-09T12:00:38.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c38b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340cf160 con 0x7f6c340b0790 2023-10-09T12:00:38.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c33fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c341591e0 0x7f6c34159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c33fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c341591e0 0x7f6c34159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34808/0 (socket says 172.21.15.86:34808) 2023-10-09T12:00:38.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c33fff700 1 -- 172.21.15.86:0/1728393640 learned_addr learned my addr 172.21.15.86:0/1728393640 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:38.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c32ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6c340b0790 0x7f6c340cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c33fff700 1 -- 172.21.15.86:0/1728393640 >> v2:172.21.15.135:3300/0 conn(0x7f6c340b0790 msgr2=0x7f6c340cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:38.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c33fff700 1 --2- 172.21.15.86:0/1728393640 >> v2:172.21.15.135:3300/0 conn(0x7f6c340b0790 0x7f6c340cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c33fff700 1 -- 172.21.15.86:0/1728393640 >> v1:172.21.15.135:6789/0 conn(0x7f6c340b03c0 legacy=0x7f6c340b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c327fc700 1 -- 172.21.15.86:0/1728393640 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435636708 0 0) 0x7f6c340cfa00 con 0x7f6c340b03c0 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.652+0000 7f6c33fff700 1 -- 172.21.15.86:0/1728393640 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340cf440 con 0x7f6c341591e0 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.653+0000 7f6c33fff700 1 --2- 172.21.15.86:0/1728393640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c341591e0 0x7f6c34159600 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009f20 tx=0x7f6c2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28819364041f82b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.653+0000 7f6c327fc700 1 -- 172.21.15.86:0/1728393640 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00e070 con 0x7f6c341591e0 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.653+0000 7f6c327fc700 1 -- 172.21.15.86:0/1728393640 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00b990 con 0x7f6c341591e0 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.653+0000 7f6c327fc700 1 -- 172.21.15.86:0/1728393640 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0092e0 con 0x7f6c341591e0 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.653+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1728393640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c341591e0 msgr2=0x7f6c34159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.653+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1728393640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c341591e0 0x7f6c34159600 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009f20 tx=0x7f6c2c009840 comp rx=0 tx=0).stop 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.654+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1728393640 shutdown_connections 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.654+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1728393640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c341591e0 0x7f6c34159600 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.654+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1728393640 >> v2:172.21.15.135:3300/0 conn(0x7f6c340b0790 0x7f6c340cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.654+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1728393640 >> 172.21.15.86:0/1728393640 conn(0x7f6c34063230 msgr2=0x7f6c34063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:38.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.654+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1728393640 shutdown_connections 2023-10-09T12:00:38.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.654+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1728393640 wait complete. 2023-10-09T12:00:38.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.655+0000 7f6c38b9d700 1 Processor -- start 2023-10-09T12:00:38.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.655+0000 7f6c38b9d700 1 -- start start 2023-10-09T12:00:38.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c38b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340b03c0 0x7f6c340c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c38b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b0790 0x7f6c340c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c38b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c341591e0 0x7f6c34156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c38b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415aee0 con 0x7f6c340b03c0 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c38b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c9610 con 0x7f6c340b0790 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c38b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c6240 con 0x7f6c341591e0 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c337fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340b03c0 0x7f6c340c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c337fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340b03c0 0x7f6c340c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34824/0 (socket says 172.21.15.86:34824) 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.656+0000 7f6c337fe700 1 -- 172.21.15.86:0/1499833376 learned_addr learned my addr 172.21.15.86:0/1499833376 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b0790 0x7f6c340c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c33fff700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c341591e0 0x7f6c34156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c337fe700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c341591e0 msgr2=0x7f6c34156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c337fe700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c341591e0 0x7f6c34156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c337fe700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b0790 msgr2=0x7f6c340c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c337fe700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b0790 0x7f6c340c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:38.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c337fe700 1 -- 172.21.15.86:0/1499833376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009ae0 con 0x7f6c340b03c0 2023-10-09T12:00:38.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c33fff700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c341591e0 0x7f6c34156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:38.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c337fe700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340b03c0 0x7f6c340c5c60 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c530 tx=0x7f6c2400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:38.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24011590 con 0x7f6c340b03c0 2023-10-09T12:00:38.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24011710 con 0x7f6c340b03c0 2023-10-09T12:00:38.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24011ad0 con 0x7f6c340b03c0 2023-10-09T12:00:38.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.657+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340c6520 con 0x7f6c340b03c0 2023-10-09T12:00:38.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.658+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340c6ae0 con 0x7f6c340b03c0 2023-10-09T12:00:38.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.659+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340c3f70 con 0x7f6c340b03c0 2023-10-09T12:00:38.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.659+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 64) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6c2401b3b0 con 0x7f6c340b03c0 2023-10-09T12:00:38.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.660+0000 7f6c1b7fe700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c20069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:38.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.660+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f6c24083c00 con 0x7f6c340b03c0 2023-10-09T12:00:38.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.660+0000 7f6c32ffd700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 msgr2=0x7f6c20069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:38.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.660+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:00:38.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.664+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c2408a080 con 0x7f6c340b03c0 2023-10-09T12:00:38.696 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:38.696+0000 7f73e412b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:00:38.812 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:38.811+0000 7f24d48d5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:00:38.860 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:38.860+0000 7f73e412b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:38.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.861+0000 7f6c32ffd700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 msgr2=0x7f6c20069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:38.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.861+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:00:38.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:38.883+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c3404c3c0 con 0x7f6c20066f80 2023-10-09T12:00:38.946 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:38.946+0000 7f73e412b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:00:38.976 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:38.975+0000 7f24d48d5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:39.061 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:39.060+0000 7f24d48d5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:00:39.170 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:39.170+0000 7f73e412b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:39.262+0000 7f6c32ffd700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 msgr2=0x7f6c20069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:39.262+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T12:00:39.283 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:39.282+0000 7f24d48d5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:39.346 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:39.345+0000 7f73e412b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:00:39.437 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:39.437+0000 7f73e412b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:00:39.458 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:39.457+0000 7f24d48d5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:00:39.548 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:39.547+0000 7f24d48d5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:00:39.600 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:39.600+0000 7f73e412b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:00:39.701 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:39.701+0000 7f73e412b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:39.708 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:39.707+0000 7f24d48d5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:00:39.806 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:39.805+0000 7f24d48d5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:00:40.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:40.063+0000 7f6c32ffd700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 msgr2=0x7f6c20069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:40.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:40.063+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T12:00:40.182 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:40.182+0000 7f73e412b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:00:40.276 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:40.276+0000 7f73e412b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:00:40.285 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:40.284+0000 7f24d48d5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:00:40.365 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:40.365+0000 7f73e412b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:00:40.377 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:40.376+0000 7f24d48d5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:00:40.466 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:40.465+0000 7f24d48d5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:00:40.985 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:40.985+0000 7f73e412b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:00:41.082 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:41.081+0000 7f24d48d5180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:00:41.157 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:41.156+0000 7f73e412b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:41.253 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:41.253+0000 7f73e412b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:00:41.254 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:41.253+0000 7f24d48d5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:00:41.348 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:41.347+0000 7f24d48d5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:00:41.547 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:41.547+0000 7f73e412b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:00:41.638 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:41.637+0000 7f24d48d5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:00:41.639 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:00:41.642 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:41.642+0000 7f73e412b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:00:41.643 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:00:41.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:41.665+0000 7f6c32ffd700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 msgr2=0x7f6c20069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:00:41.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:41.665+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T12:00:41.739 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:41.738+0000 7f24d48d5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:00:42.347 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:42.347+0000 7f73e412b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:00:42.437 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:42.436+0000 7f24d48d5180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:00:42.634 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:42.633+0000 7f73e412b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:00:42.719 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:42.718+0000 7f24d48d5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:00:42.726 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:42.725+0000 7f73e412b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:00:42.811 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:42.809+0000 7f24d48d5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:00:42.878 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:42.878+0000 7f73e412b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:00:42.962 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:42.961+0000 7f24d48d5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:00:42.983 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:42.983+0000 7f73e412b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:00:43.065 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.064+0000 7f24d48d5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:00:43.171 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:43.171+0000 7f73e412b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:00:43.252 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.251+0000 7f24d48d5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:00:43.263 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:43.263+0000 7f73e412b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:00:43.343 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.342+0000 7f24d48d5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:00:43.356 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:43.356+0000 7f73e412b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:00:43.439 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.438+0000 7f24d48d5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:00:43.452 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:00:43.452+0000 7f73e412b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:00:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:43.511+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 65) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6c240510b0 con 0x7f6c340b03c0 2023-10-09T12:00:43.538 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.537+0000 7f24d48d5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:00:43.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:43.547+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 66) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f6c24070460 con 0x7f6c340b03c0 2023-10-09T12:00:43.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:43.547+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 msgr2=0x7f6c20069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:00:43.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:43.547+0000 7f6c1b7fe700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c20069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:43.661 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2446c31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.661 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2446c31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.661 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2446c31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.661 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2446c31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.661 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2446c31700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.662 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2449436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.662 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2449436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.662 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2449436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.662 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2449436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:43.662 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:00:43.660+0000 7f2449436700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:00:44.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.552+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mon.0 v2:172.21.15.86:3300/0 9 ==== mgrmap(e 67) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f6c24051980 con 0x7f6c340b03c0 2023-10-09T12:00:44.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.552+0000 7f6c1b7fe700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c200693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:44.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.552+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c3404c3c0 con 0x7f6c20066f80 2023-10-09T12:00:44.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.555+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c200693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:44.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.558+0000 7f6c32ffd700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c200693b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6c34068680 tx=0x7f6c280091a0 comp rx=0 tx=0).ready entity=mgr.8289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:44.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.624+0000 7f6c1b7fe700 1 -- 172.21.15.86:0/1499833376 <== mgr.8289 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f6c3404c3c0 con 0x7f6c20066f80 2023-10-09T12:00:44.626 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1 2023-10-09T12:00:44.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 msgr2=0x7f6c200693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c200693b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6c34068680 tx=0x7f6c280091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340b03c0 msgr2=0x7f6c340c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340b03c0 0x7f6c340c5c60 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c530 tx=0x7f6c2400c840 comp rx=0 tx=0).stop 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 shutdown_connections 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6c20066f80 0x7f6c200693b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340b03c0 0x7f6c340c5c60 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c341591e0 0x7f6c34156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 --2- 172.21.15.86:0/1499833376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b0790 0x7f6c340c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 >> 172.21.15.86:0/1499833376 conn(0x7f6c34063230 msgr2=0x7f6c34068990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 shutdown_connections 2023-10-09T12:00:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.627+0000 7f6c38b9d700 1 -- 172.21.15.86:0/1499833376 wait complete. 2023-10-09T12:00:44.648 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-10-09T12:00:44.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-10-09T12:00:44.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.834+0000 7f18929ff700 1 Processor -- start 2023-10-09T12:00:44.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.834+0000 7f18929ff700 1 -- start start 2023-10-09T12:00:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.835+0000 7f18929ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c069fa0 0x7f188c06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:44.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.835+0000 7f18929ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c156340 con 0x7f188c156ee0 2023-10-09T12:00:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.835+0000 7f18929ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c0c8990 con 0x7f188c0c85c0 2023-10-09T12:00:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.835+0000 7f18929ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c06ee20 con 0x7f188c069fa0 2023-10-09T12:00:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.835+0000 7f1890f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f188c156ee0 0x7f188c0c6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:51908/0 (socket says 172.21.15.86:51908) 2023-10-09T12:00:44.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.835+0000 7f1890f9c700 1 -- 172.21.15.86:0/1572274480 learned_addr learned my addr 172.21.15.86:0/1572274480 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:44.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188b7fe700 1 --2- 172.21.15.86:0/1572274480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c069fa0 0x7f188c06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649736772 0 0) 0x7f188c156340 con 0x7f188c156ee0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1874004680 con 0x7f188c156ee0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809518057 0 0) 0x7f188c0c8990 con 0x7f188c0c85c0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f188c156340 con 0x7f188c0c85c0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3970719336 0 0) 0x7f1874004680 con 0x7f188c156ee0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188b7fe700 1 -- 172.21.15.86:0/1572274480 >> v1:172.21.15.135:6789/0 conn(0x7f188c0c85c0 legacy=0x7f188c069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188b7fe700 1 -- 172.21.15.86:0/1572274480 >> v1:172.21.15.86:6789/0 conn(0x7f188c156ee0 legacy=0x7f188c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.836+0000 7f188b7fe700 1 -- 172.21.15.86:0/1572274480 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c06dd80 con 0x7f188c069fa0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f188b7fe700 1 --2- 172.21.15.86:0/1572274480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c069fa0 0x7f188c06d6c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1880009910 tx=0x7f18800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c2536b64de33b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18840017f0 con 0x7f188c069fa0 2023-10-09T12:00:44.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880011420 con 0x7f188c069fa0 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f188affd700 1 -- 172.21.15.86:0/1572274480 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800117c0 con 0x7f188c069fa0 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f18929ff700 1 -- 172.21.15.86:0/1572274480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c069fa0 msgr2=0x7f188c06d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f18929ff700 1 --2- 172.21.15.86:0/1572274480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c069fa0 0x7f188c06d6c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1880009910 tx=0x7f18800091a0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f18929ff700 1 -- 172.21.15.86:0/1572274480 shutdown_connections 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.837+0000 7f18929ff700 1 --2- 172.21.15.86:0/1572274480 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c069fa0 0x7f188c06d6c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.838+0000 7f18929ff700 1 -- 172.21.15.86:0/1572274480 >> 172.21.15.86:0/1572274480 conn(0x7f188c0cc540 msgr2=0x7f188c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.838+0000 7f18929ff700 1 -- 172.21.15.86:0/1572274480 shutdown_connections 2023-10-09T12:00:44.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.838+0000 7f18929ff700 1 -- 172.21.15.86:0/1572274480 wait complete. 2023-10-09T12:00:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.839+0000 7f18929ff700 1 Processor -- start 2023-10-09T12:00:44.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.839+0000 7f18929ff700 1 -- start start 2023-10-09T12:00:44.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f18929ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f188c069fa0 0x7f188c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f18929ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c0c85c0 0x7f188c158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f18929ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c156ee0 0x7f188c1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f18929ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1583f0 con 0x7f188c156ee0 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f18929ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1577e0 con 0x7f188c069fa0 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f18929ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c157ac0 con 0x7f188c0c85c0 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f1890f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c156ee0 0x7f188c1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f1890f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c156ee0 0x7f188c1532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34978/0 (socket says 172.21.15.86:34978) 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.840+0000 7f1890f9c700 1 -- 172.21.15.86:0/1659172409 learned_addr learned my addr 172.21.15.86:0/1659172409 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f188bfff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f188c069fa0 0x7f188c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:44.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f188b7fe700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c0c85c0 0x7f188c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1890f9c700 1 -- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c0c85c0 msgr2=0x7f188c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1890f9c700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c0c85c0 0x7f188c158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1890f9c700 1 -- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f188c069fa0 msgr2=0x7f188c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1890f9c700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f188c069fa0 0x7f188c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1890f9c700 1 -- 172.21.15.86:0/1659172409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880009420 con 0x7f188c156ee0 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f188b7fe700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c0c85c0 0x7f188c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f188bfff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f188c069fa0 0x7f188c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1890f9c700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c156ee0 0x7f188c1532f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1884001560 tx=0x7f1884007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1873fff700 1 -- 172.21.15.86:0/1659172409 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884004dc0 con 0x7f188c156ee0 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1873fff700 1 -- 172.21.15.86:0/1659172409 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188400a710 con 0x7f188c156ee0 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c157da0 con 0x7f188c156ee0 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f1873fff700 1 -- 172.21.15.86:0/1659172409 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400aad0 con 0x7f188c156ee0 2023-10-09T12:00:44.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.841+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c155600 con 0x7f188c156ee0 2023-10-09T12:00:44.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.842+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c0718b0 con 0x7f188c156ee0 2023-10-09T12:00:44.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.843+0000 7f1873fff700 1 -- 172.21.15.86:0/1659172409 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 67) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f1884007150 con 0x7f188c156ee0 2023-10-09T12:00:44.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.844+0000 7f1873fff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1878066dd0 0x7f1878069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:44.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.844+0000 7f1873fff700 1 -- 172.21.15.86:0/1659172409 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6367+0+0 (secure 0 0 0) 0x7f1884083ef0 con 0x7f188c156ee0 2023-10-09T12:00:44.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.844+0000 7f188bfff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1878066dd0 0x7f1878069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:44.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.845+0000 7f188bfff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1878066dd0 0x7f1878069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f188c1559d0 tx=0x7f187c009040 comp rx=0 tx=0).ready entity=mgr.8289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:44.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:44.849+0000 7f1873fff700 1 -- 172.21.15.86:0/1659172409 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1884051200 con 0x7f188c156ee0 2023-10-09T12:00:45.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.065+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7f188c06e060 con 0x7f1878066dd0 2023-10-09T12:00:45.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.131+0000 7f1873fff700 1 -- 172.21.15.86:0/1659172409 <== mgr.8289 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7f188c06e060 con 0x7f1878066dd0 2023-10-09T12:00:45.133 INFO:teuthology.orchestra.run.smithi086.stdout:Retention added to path /snap_test_dir1 2023-10-09T12:00:45.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1878066dd0 msgr2=0x7f1878069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1878066dd0 0x7f1878069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f188c1559d0 tx=0x7f187c009040 comp rx=0 tx=0).stop 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c156ee0 msgr2=0x7f188c1532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c156ee0 0x7f188c1532f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1884001560 tx=0x7f1884007d20 comp rx=0 tx=0).stop 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 shutdown_connections 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1878066dd0 0x7f1878069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c156ee0 0x7f188c1532f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f188c069fa0 0x7f188c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 --2- 172.21.15.86:0/1659172409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f188c0c85c0 0x7f188c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 >> 172.21.15.86:0/1659172409 conn(0x7f188c0cc540 msgr2=0x7f188c0ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 shutdown_connections 2023-10-09T12:00:45.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.134+0000 7f18929ff700 1 -- 172.21.15.86:0/1659172409 wait complete. 2023-10-09T12:00:45.153 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-10-09T12:00:45.153 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-09T12:00:45.153 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-10-09T12:00:45.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.336+0000 7fd1199ff700 1 Processor -- start 2023-10-09T12:00:45.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.336+0000 7fd1199ff700 1 -- start start 2023-10-09T12:00:45.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.337+0000 7fd1199ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd114068890 0x7fd1140c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:45.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.337+0000 7fd1199ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11415a9b0 con 0x7fd11415a440 2023-10-09T12:00:45.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.337+0000 7fd1199ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11415ac90 con 0x7fd1141563b0 2023-10-09T12:00:45.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.337+0000 7fd1199ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11415af70 con 0x7fd114068890 2023-10-09T12:00:45.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1137fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd114068890 0x7fd1140c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:45.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1127fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd11415a440 0x7fd1140acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:48696/0 (socket says 172.21.15.86:48696) 2023-10-09T12:00:45.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1137fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd114068890 0x7fd1140c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60424/0 (socket says 172.21.15.86:60424) 2023-10-09T12:00:45.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1127fc700 1 -- 172.21.15.86:0/36543950 learned_addr learned my addr 172.21.15.86:0/36543950 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:00:45.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1137fe700 1 -- 172.21.15.86:0/36543950 >> v1:172.21.15.135:6789/0 conn(0x7fd1141563b0 legacy=0x7fd114156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:00:45.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1137fe700 1 -- 172.21.15.86:0/36543950 >> v1:172.21.15.86:6789/0 conn(0x7fd11415a440 legacy=0x7fd1140acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1137fe700 1 -- 172.21.15.86:0/36543950 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11415b250 con 0x7fd114068890 2023-10-09T12:00:45.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.338+0000 7fd1137fe700 1 --2- 172.21.15.86:0/36543950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd114068890 0x7fd1140c8230 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009e60 tx=0x7fd10c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949361a2dd930610 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:45.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd111ffb700 1 -- 172.21.15.86:0/36543950 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c00e070 con 0x7fd114068890 2023-10-09T12:00:45.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd111ffb700 1 -- 172.21.15.86:0/36543950 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c00bbf0 con 0x7fd114068890 2023-10-09T12:00:45.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd111ffb700 1 -- 172.21.15.86:0/36543950 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c012430 con 0x7fd114068890 2023-10-09T12:00:45.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd1199ff700 1 -- 172.21.15.86:0/36543950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd114068890 msgr2=0x7fd1140c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd1199ff700 1 --2- 172.21.15.86:0/36543950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd114068890 0x7fd1140c8230 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009e60 tx=0x7fd10c009780 comp rx=0 tx=0).stop 2023-10-09T12:00:45.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd1199ff700 1 -- 172.21.15.86:0/36543950 shutdown_connections 2023-10-09T12:00:45.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd1199ff700 1 --2- 172.21.15.86:0/36543950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd114068890 0x7fd1140c8230 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd1199ff700 1 -- 172.21.15.86:0/36543950 >> 172.21.15.86:0/36543950 conn(0x7fd1140c8f90 msgr2=0x7fd1140c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:45.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd1199ff700 1 -- 172.21.15.86:0/36543950 shutdown_connections 2023-10-09T12:00:45.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.339+0000 7fd1199ff700 1 -- 172.21.15.86:0/36543950 wait complete. 2023-10-09T12:00:45.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.341+0000 7fd1199ff700 1 Processor -- start 2023-10-09T12:00:45.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.341+0000 7fd1199ff700 1 -- start start 2023-10-09T12:00:45.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1199ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd114068890 0x7fd11414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:45.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1199ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1141563b0 0x7fd1140bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1199ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd11415a440 0x7fd11415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1199ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b1150 con 0x7fd11415a440 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1199ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd114155330 con 0x7fd1141563b0 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1199ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b02a0 con 0x7fd114068890 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd11415a440 0x7fd11415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd11415a440 0x7fd11415c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60430/0 (socket says 172.21.15.86:60430) 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1137fe700 1 -- 172.21.15.86:0/625261333 learned_addr learned my addr 172.21.15.86:0/625261333 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd1127fc700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1141563b0 0x7fd1140bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.342+0000 7fd112ffd700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd114068890 0x7fd11414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1137fe700 1 -- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd114068890 msgr2=0x7fd11414aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1137fe700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd114068890 0x7fd11414aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1137fe700 1 -- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1141563b0 msgr2=0x7fd1140bfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1137fe700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1141563b0 0x7fd1140bfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1137fe700 1 -- 172.21.15.86:0/625261333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009a20 con 0x7fd11415a440 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd112ffd700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd114068890 0x7fd11414aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1137fe700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd11415a440 0x7fd11415c870 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fd11406bbb0 tx=0x7fd10c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c01e640 con 0x7fd11415a440 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c01e7a0 con 0x7fd11415a440 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c01eb60 con 0x7fd11415a440 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1140b0540 con 0x7fd11415a440 2023-10-09T12:00:45.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.343+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1140b0b00 con 0x7fd11415a440 2023-10-09T12:00:45.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.344+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140c1ac0 con 0x7fd11415a440 2023-10-09T12:00:45.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.345+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 67) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fd10c024070 con 0x7fd11415a440 2023-10-09T12:00:45.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.346+0000 7fd0faffd700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd100066dd0 0x7fd100069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:00:45.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.346+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6367+0+0 (secure 0 0 0) 0x7fd10c086fd0 con 0x7fd11415a440 2023-10-09T12:00:45.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.346+0000 7fd112ffd700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd100066dd0 0x7fd100069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:00:45.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.347+0000 7fd112ffd700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd100066dd0 0x7fd100069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd104009a80 tx=0x7fd104008040 comp rx=0 tx=0).ready entity=mgr.8289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:00:45.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.350+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd10c054260 con 0x7fd11415a440 2023-10-09T12:00:45.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.564+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 68) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fd10c054630 con 0x7fd11415a440 2023-10-09T12:00:45.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.574+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1140718b0 con 0x7fd100066dd0 2023-10-09T12:00:45.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.582+0000 7fd0faffd700 1 -- 172.21.15.86:0/625261333 <== mgr.8289 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7fd1140718b0 con 0x7fd100066dd0 2023-10-09T12:00:45.583 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:00:45.583 INFO:teuthology.orchestra.run.smithi086.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd100066dd0 msgr2=0x7fd100069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd100066dd0 0x7fd100069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd104009a80 tx=0x7fd104008040 comp rx=0 tx=0).stop 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd11415a440 msgr2=0x7fd11415c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd11415a440 0x7fd11415c870 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fd11406bbb0 tx=0x7fd10c018000 comp rx=0 tx=0).stop 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 shutdown_connections 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd100066dd0 0x7fd100069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd11415a440 0x7fd11415c870 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd114068890 0x7fd11414aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 --2- 172.21.15.86:0/625261333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1141563b0 0x7fd1140bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:00:45.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 >> 172.21.15.86:0/625261333 conn(0x7fd1140c8f90 msgr2=0x7fd1140c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:00:45.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 shutdown_connections 2023-10-09T12:00:45.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:00:45.584+0000 7fd1199ff700 1 -- 172.21.15.86:0/625261333 wait complete. 2023-10-09T12:00:45.603 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-09T12:00:45.603 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-10-09T12:01:00.145 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:01:00.144+0000 7f2438c15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:01:00.145 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:01:00.144+0000 7f2438c15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:01:00.146 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:01:00.144+0000 7f2438c15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:01:00.146 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:01:00.144+0000 7f2438c15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:01:00.146 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:01:00.144+0000 7f2438c15700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:01:11.753 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:01:11.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:01:41.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:01:41.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:02:11.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:02:11.977 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:02:42.080 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:02:42.085 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:03:12.194 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:03:12.199 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:03:42.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:03:42.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:04:12.414 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:04:12.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:04:42.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:04:42.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:05:12.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:05:12.641 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:05:42.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:05:42.773 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:06:12.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:06:12.877 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:06:43.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:06:43.023 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:07:13.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:07:13.139 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:07:43.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:07:43.255 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:08:13.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:08:13.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:08:43.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:08:43.474 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:09:13.575 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:09:13.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:09:43.689 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:09:43.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:10:13.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:10:13.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:10:43.961 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:10:43.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:11:14.074 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:11:14.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:11:44.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:11:44.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:12:14.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:12:14.300 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:12:44.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:12:44.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:13:14.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:13:14.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:13:44.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:13:44.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:14:14.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:14:14.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:14:44.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:14:44.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:15:14.968 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:15:14.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:15:45.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:15:45.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:16:15.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:16:15.250 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:16:45.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:16:45.374 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:17:15.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:17:15.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:17:45.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:17:45.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:18:15.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:18:15.701 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:18:45.866 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:18:45.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:19:16.031 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:19:16.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:19:46.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:19:46.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:20:16.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:20:16.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:20:46.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:20:46.529 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:21:16.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:21:16.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:21:46.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:21:46.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:22:17.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:22:17.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:22:47.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:22:47.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:23:17.532 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:23:17.542 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:23:47.707 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:23:47.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:24:17.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:24:17.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:24:47.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:24:47.962 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:25:18.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:25:18.148 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:25:48.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:25:48.336 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:26:18.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:26:18.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:26:48.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:26:48.700 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:27:18.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:27:18.866 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:27:48.990 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:27:48.996 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:28:19.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:28:19.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:28:49.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:28:49.365 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:29:19.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:29:19.530 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:29:49.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:29:49.702 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:30:19.819 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:30:19.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:30:50.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:30:50.022 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:31:20.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:31:20.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:31:50.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:31:50.392 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:32:20.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:32:20.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:32:50.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:32:50.782 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:33:20.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:33:20.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:33:51.103 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:33:51.109 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:34:21.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:34:21.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:34:51.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:34:51.496 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:35:21.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:35:21.670 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:35:51.785 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:35:51.791 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:36:21.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:36:21.964 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:36:52.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:36:52.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:37:22.254 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:37:22.260 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:37:52.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:37:52.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:38:22.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:38:22.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:38:52.797 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:38:52.803 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:39:22.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:39:22.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:39:53.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:39:53.091 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:40:23.256 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:40:23.262 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:40:53.454 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:40:53.459 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:41:23.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:41:23.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:41:53.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:41:53.831 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:42:24.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:42:24.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:42:54.136 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:42:54.142 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:43:24.326 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:43:24.332 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:43:54.507 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:43:54.512 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:44:24.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:44:24.677 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:44:54.777 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:44:54.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:45:24.949 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:45:24.955 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:45:55.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:45:55.161 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:46:25.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:46:25.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:46:55.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:46:55.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:47:25.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:47:25.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:47:55.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:47:55.853 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:48:26.026 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:48:26.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:48:56.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:48:56.221 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:49:26.396 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:49:26.401 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:49:56.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:49:56.516 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:50:26.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:50:26.699 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:50:56.891 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:50:56.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:51:27.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:51:27.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:51:57.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:51:57.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:52:27.449 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:52:27.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:52:57.624 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:52:57.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:53:27.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:53:27.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:53:57.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:53:57.991 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:54:28.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:54:28.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:54:58.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:54:58.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:55:28.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:55:28.467 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:55:58.658 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:55:58.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:56:15.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:15.604 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_02_00_UTC 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_03_00_UTC 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_04_00_UTC 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_05_00_UTC 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_06_00_UTC 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_07_00_UTC 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_08_00_UTC 2023-10-09T12:56:15.651 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_09_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_10_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_11_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_12_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_13_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_14_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_15_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_16_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_17_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_18_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_19_00_UTC 2023-10-09T12:56:15.652 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_20_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_21_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_22_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_23_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_24_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_25_01_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_26_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_27_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_28_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_29_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_30_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_31_00_UTC 2023-10-09T12:56:15.653 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_32_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_33_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_34_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_35_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_36_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_37_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_38_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_39_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_40_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_41_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_42_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_43_00_UTC 2023-10-09T12:56:15.654 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_44_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_45_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_46_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_47_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_48_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_49_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_50_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_51_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_52_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_53_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_54_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_55_00_UTC 2023-10-09T12:56:15.655 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_56_00_UTC 2023-10-09T12:56:15.656 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-12_02_00_UTC', 'scheduled-2023-10-09-12_03_00_UTC', 'scheduled-2023-10-09-12_04_00_UTC', 'scheduled-2023-10-09-12_05_00_UTC', 'scheduled-2023-10-09-12_06_00_UTC', 'scheduled-2023-10-09-12_07_00_UTC', 'scheduled-2023-10-09-12_08_00_UTC', 'scheduled-2023-10-09-12_09_00_UTC', 'scheduled-2023-10-09-12_10_00_UTC', 'scheduled-2023-10-09-12_11_00_UTC', 'scheduled-2023-10-09-12_12_00_UTC', 'scheduled-2023-10-09-12_13_00_UTC', 'scheduled-2023-10-09-12_14_00_UTC', 'scheduled-2023-10-09-12_15_00_UTC', 'scheduled-2023-10-09-12_16_00_UTC', 'scheduled-2023-10-09-12_17_00_UTC', 'scheduled-2023-10-09-12_18_00_UTC', 'scheduled-2023-10-09-12_19_00_UTC', 'scheduled-2023-10-09-12_20_00_UTC', 'scheduled-2023-10-09-12_21_00_UTC', 'scheduled-2023-10-09-12_22_00_UTC', 'scheduled-2023-10-09-12_23_00_UTC', 'scheduled-2023-10-09-12_24_00_UTC', 'scheduled-2023-10-09-12_25_01_UTC', 'scheduled-2023-10-09-12_26_00_UTC', 'scheduled-2023-10-09-12_27_00_UTC', 'scheduled-2023-10-09-12_28_00_UTC', 'scheduled-2023-10-09-12_29_00_UTC', 'scheduled-2023-10-09-12_30_00_UTC', 'scheduled-2023-10-09-12_31_00_UTC', 'scheduled-2023-10-09-12_32_00_UTC', 'scheduled-2023-10-09-12_33_00_UTC', 'scheduled-2023-10-09-12_34_00_UTC', 'scheduled-2023-10-09-12_35_00_UTC', 'scheduled-2023-10-09-12_36_00_UTC', 'scheduled-2023-10-09-12_37_00_UTC', 'scheduled-2023-10-09-12_38_00_UTC', 'scheduled-2023-10-09-12_39_00_UTC', 'scheduled-2023-10-09-12_40_00_UTC', 'scheduled-2023-10-09-12_41_00_UTC', 'scheduled-2023-10-09-12_42_00_UTC', 'scheduled-2023-10-09-12_43_00_UTC', 'scheduled-2023-10-09-12_44_00_UTC', 'scheduled-2023-10-09-12_45_00_UTC', 'scheduled-2023-10-09-12_46_00_UTC', 'scheduled-2023-10-09-12_47_00_UTC', 'scheduled-2023-10-09-12_48_00_UTC', 'scheduled-2023-10-09-12_49_00_UTC', 'scheduled-2023-10-09-12_50_00_UTC', 'scheduled-2023-10-09-12_51_00_UTC', 'scheduled-2023-10-09-12_52_00_UTC', 'scheduled-2023-10-09-12_53_00_UTC', 'scheduled-2023-10-09-12_54_00_UTC', 'scheduled-2023-10-09-12_55_00_UTC', 'scheduled-2023-10-09-12_56_00_UTC'] 2023-10-09T12:56:15.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-10-09T12:56:15.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.886+0000 7fa3fb5ff700 1 Processor -- start 2023-10-09T12:56:15.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.886+0000 7fa3fb5ff700 1 -- start start 2023-10-09T12:56:15.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.887+0000 7fa3fb5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa3f41563b0 0x7fa3f4156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.887+0000 7fa3fb5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 0x7fa3f40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.887+0000 7fa3fb5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f415a9b0 con 0x7fa3f4068890 2023-10-09T12:56:15.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.887+0000 7fa3fb5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f415ac90 con 0x7fa3f41563b0 2023-10-09T12:56:15.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.887+0000 7fa3fb5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415af70 con 0x7fa3f415a440 2023-10-09T12:56:15.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3f9b9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa3f4068890 0x7fa3f40c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37478/0 (socket says 172.21.15.86:37478) 2023-10-09T12:56:15.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/231036934 learned_addr learned my addr 172.21.15.86:0/231036934 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3f939b700 1 --2- 172.21.15.86:0/231036934 >> v2:172.21.15.135:3300/0 conn(0x7fa3f41563b0 0x7fa3f4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3f8b9a700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 0x7fa3f40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402277840 0 0) 0x7fa3f415a9b0 con 0x7fa3f4068890 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e0003570 con 0x7fa3f4068890 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799360668 0 0) 0x7fa3e0003570 con 0x7fa3f4068890 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 msgr2=0x7fa3f40acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 0x7fa3f40acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:15.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 >> v2:172.21.15.135:3300/0 conn(0x7fa3f41563b0 msgr2=0x7fa3f4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 --2- 172.21.15.86:0/231036934 >> v2:172.21.15.135:3300/0 conn(0x7fa3f41563b0 0x7fa3f4156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f415b250 con 0x7fa3f4068890 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.888+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa3ec0017f0 con 0x7fa3f4068890 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 >> v1:172.21.15.86:6789/0 conn(0x7fa3f4068890 legacy=0x7fa3f40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3ebfff700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 0x7fa3e0003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3ebfff700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e00040b0 0x7fa3e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3ebfff700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e0004d50 0x7fa3e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415ac90 con 0x7fa3e0004d50 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415af70 con 0x7fa3e00040b0 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e000dd70 con 0x7fa3f415a440 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f9b9c700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e0004d50 0x7fa3e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f939b700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 0x7fa3e0003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f8b9a700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e00040b0 0x7fa3e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 msgr2=0x7fa3e0003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f9b9c700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3f415a440 0x7fa3e0003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e00040b0 msgr2=0x7fa3e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f9b9c700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3e00040b0 0x7fa3e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.889+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/231036934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0003570 con 0x7fa3e0004d50 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3f9b9c700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e0004d50 0x7fa3e00051c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00a870 tx=0x7fa3ec002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ce275bffbc20b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00a230 con 0x7fa3e0004d50 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0070f0 con 0x7fa3e0004d50 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3ebfff700 1 -- 172.21.15.86:0/231036934 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0074b0 con 0x7fa3e0004d50 2023-10-09T12:56:15.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/231036934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e0004d50 msgr2=0x7fa3e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:15.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3fb5ff700 1 --2- 172.21.15.86:0/231036934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e0004d50 0x7fa3e00051c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00a870 tx=0x7fa3ec002140 comp rx=0 tx=0).stop 2023-10-09T12:56:15.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/231036934 reap_dead start 2023-10-09T12:56:15.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/231036934 shutdown_connections 2023-10-09T12:56:15.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/231036934 >> 172.21.15.86:0/231036934 conn(0x7fa3f40c8f90 msgr2=0x7fa3f40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:15.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/231036934 shutdown_connections 2023-10-09T12:56:15.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.890+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/231036934 wait complete. 2023-10-09T12:56:15.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.892+0000 7fa3fb5ff700 1 Processor -- start 2023-10-09T12:56:15.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.892+0000 7fa3fb5ff700 1 -- start start 2023-10-09T12:56:15.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3fb5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3e0004d50 0x7fa3f41536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3fb5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f40b0370 0x7fa3f40ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3fb5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3f40caec0 0x7fa3f40c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3fb5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40cb360 con 0x7fa3f40caec0 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3fb5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415f230 con 0x7fa3f40b0370 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3fb5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40af2d0 con 0x7fa3e0004d50 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3f9b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3f40caec0 0x7fa3f40c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3f9b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3f40caec0 0x7fa3f40c2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34826/0 (socket says 172.21.15.86:34826) 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/3002116448 learned_addr learned my addr 172.21.15.86:0/3002116448 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3f939b700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3e0004d50 0x7fa3f41536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.893+0000 7fa3f8b9a700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f40b0370 0x7fa3f40ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3e0004d50 msgr2=0x7fa3f41536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3f9b9c700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3e0004d50 0x7fa3f41536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f40b0370 msgr2=0x7fa3f40ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3f9b9c700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f40b0370 0x7fa3f40ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3f9b9c700 1 -- 172.21.15.86:0/3002116448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40af5b0 con 0x7fa3f40caec0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3f8b9a700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f40b0370 0x7fa3f40ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3f9b9c700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3f40caec0 0x7fa3f40c2720 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0004760 tx=0x7fa3ec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3e97fa700 1 -- 172.21.15.86:0/3002116448 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec01f440 con 0x7fa3f40caec0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3e97fa700 1 -- 172.21.15.86:0/3002116448 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec01f5c0 con 0x7fa3f40caec0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f40af890 con 0x7fa3f40caec0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3e97fa700 1 -- 172.21.15.86:0/3002116448 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec01f980 con 0x7fa3f40caec0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.894+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f40afe50 con 0x7fa3f40caec0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.895+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f40b0040 con 0x7fa3f40caec0 2023-10-09T12:56:15.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.896+0000 7fa3e97fa700 1 -- 172.21.15.86:0/3002116448 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 70) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fa3ec01fd30 con 0x7fa3f40caec0 2023-10-09T12:56:15.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.897+0000 7fa3e97fa700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa3d80670a0 0x7fa3d8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:15.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.897+0000 7fa3e97fa700 1 -- 172.21.15.86:0/3002116448 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6469+0+0 (secure 0 0 0) 0x7fa3ec087640 con 0x7fa3f40caec0 2023-10-09T12:56:15.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.897+0000 7fa3f939b700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa3d80670a0 0x7fa3d8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:15.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.898+0000 7fa3f939b700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa3d80670a0 0x7fa3d8069550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0006f00 tx=0x7fa3f00091a0 comp rx=0 tx=0).ready entity=mgr.8289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:15.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:15.901+0000 7fa3e97fa700 1 -- 172.21.15.86:0/3002116448 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3ec054400 con 0x7fa3f40caec0 2023-10-09T12:56:16.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.114+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3f40718b0 con 0x7fa3d80670a0 2023-10-09T12:56:16.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.124+0000 7fa3e97fa700 1 -- 172.21.15.86:0/3002116448 <== mgr.8289 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fa3f40718b0 con 0x7fa3d80670a0 2023-10-09T12:56:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:16.125 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T12:00:44", "first": "2023-10-09T12:01:00", "last": "2023-10-09T12:56:00", "last_pruned": "2023-10-09T12:56:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-09T12:56:16.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa3d80670a0 msgr2=0x7fa3d8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa3d80670a0 0x7fa3d8069550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0006f00 tx=0x7fa3f00091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3f40caec0 msgr2=0x7fa3f40c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3f40caec0 0x7fa3f40c2720 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0004760 tx=0x7fa3ec013000 comp rx=0 tx=0).stop 2023-10-09T12:56:16.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 shutdown_connections 2023-10-09T12:56:16.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa3d80670a0 0x7fa3d8069550 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3f40caec0 0x7fa3f40c2720 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3e0004d50 0x7fa3f41536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.126+0000 7fa3fb5ff700 1 --2- 172.21.15.86:0/3002116448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f40b0370 0x7fa3f40ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.127+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 >> 172.21.15.86:0/3002116448 conn(0x7fa3f40c8f90 msgr2=0x7fa3f41555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:16.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.127+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 shutdown_connections 2023-10-09T12:56:16.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.127+0000 7fa3fb5ff700 1 -- 172.21.15.86:0/3002116448 wait complete. 2023-10-09T12:56:16.145 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T12:00:44", "first": "2023-10-09T12:01:00", "last": "2023-10-09T12:56:00", "last_pruned": "2023-10-09T12:56:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-09T12:56:16.145 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T12:00:44', 'first': '2023-10-09T12:01:00', 'last': '2023-10-09T12:56:00', 'last_pruned': '2023-10-09T12:56:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-10-09T12:56:16.145 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-10-09T12:56:16.145 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-10-09T12:56:16.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-10-09T12:56:16.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.330+0000 7ff5cb9ff700 1 Processor -- start 2023-10-09T12:56:16.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.331+0000 7ff5cb9ff700 1 -- start start 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5cb9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5c4157740 0x7ff5c40adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5cb9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4068aa0 0x7ff5c406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5cb9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c406dc20 con 0x7ff5c40b2100 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5cb9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c40acc00 con 0x7ff5c4157740 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5cb9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c406d6a0 con 0x7ff5c4068aa0 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c979b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5c4157740 0x7ff5c40adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c979b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5c4157740 0x7ff5c40adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34840/0 (socket says 172.21.15.86:34840) 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c979b700 1 -- 172.21.15.86:0/3251150119 learned_addr learned my addr 172.21.15.86:0/3251150119 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:16.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c9f9c700 1 --2- 172.21.15.86:0/3251150119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4068aa0 0x7ff5c406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c979b700 1 -- 172.21.15.86:0/3251150119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4068aa0 msgr2=0x7ff5c406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c979b700 1 --2- 172.21.15.86:0/3251150119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4068aa0 0x7ff5c406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c979b700 1 -- 172.21.15.86:0/3251150119 >> v1:172.21.15.135:6789/0 conn(0x7ff5c40b2100 legacy=0x7ff5c4068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.332+0000 7ff5c979b700 1 -- 172.21.15.86:0/3251150119 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40ae910 con 0x7ff5c4157740 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.333+0000 7ff5c979b700 1 --2- 172.21.15.86:0/3251150119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c4157740 0x7ff5c40adfc0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00099b0 tx=0x7ff5c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366699ce3a5e1e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.333+0000 7ff5bbfff700 1 -- 172.21.15.86:0/3251150119 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000b860 con 0x7ff5c4157740 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.333+0000 7ff5bbfff700 1 -- 172.21.15.86:0/3251150119 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000b9c0 con 0x7ff5c4157740 2023-10-09T12:56:16.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.333+0000 7ff5bbfff700 1 -- 172.21.15.86:0/3251150119 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000bd60 con 0x7ff5c4157740 2023-10-09T12:56:16.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.333+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/3251150119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c4157740 msgr2=0x7ff5c40adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.333+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/3251150119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c4157740 0x7ff5c40adfc0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00099b0 tx=0x7ff5c0009250 comp rx=0 tx=0).stop 2023-10-09T12:56:16.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.334+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/3251150119 shutdown_connections 2023-10-09T12:56:16.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.334+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/3251150119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4068aa0 0x7ff5c406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.334+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/3251150119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c4157740 0x7ff5c40adfc0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.334+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/3251150119 >> 172.21.15.86:0/3251150119 conn(0x7ff5c40c8f90 msgr2=0x7ff5c40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:16.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.334+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/3251150119 shutdown_connections 2023-10-09T12:56:16.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.334+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/3251150119 wait complete. 2023-10-09T12:56:16.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.335+0000 7ff5cb9ff700 1 Processor -- start 2023-10-09T12:56:16.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.335+0000 7ff5cb9ff700 1 -- start start 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5cb9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c4068aa0 0x7ff5c40af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5cb9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c40b2100 0x7ff5c40b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5cb9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4157740 0x7ff5c40c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5cb9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c415f0a0 con 0x7ff5c40b2100 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5cb9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40af9e0 con 0x7ff5c4068aa0 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5cb9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c415d130 con 0x7ff5c4157740 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5c8f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c40b2100 0x7ff5c40b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5c8f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c40b2100 0x7ff5c40b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34846/0 (socket says 172.21.15.86:34846) 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.336+0000 7ff5c8f9a700 1 -- 172.21.15.86:0/2419297197 learned_addr learned my addr 172.21.15.86:0/2419297197 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c979b700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c4068aa0 0x7ff5c40af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c9f9c700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4157740 0x7ff5c40c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c8f9a700 1 -- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4157740 msgr2=0x7ff5c40c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c8f9a700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4157740 0x7ff5c40c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c8f9a700 1 -- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c4068aa0 msgr2=0x7ff5c40af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c8f9a700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c4068aa0 0x7ff5c40af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c8f9a700 1 -- 172.21.15.86:0/2419297197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00094f0 con 0x7ff5c40b2100 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5c8f9a700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c40b2100 0x7ff5c40b0030 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c5c0 tx=0x7ff5b400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5b97fa700 1 -- 172.21.15.86:0/2419297197 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4011590 con 0x7ff5c40b2100 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5b97fa700 1 -- 172.21.15.86:0/2419297197 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b4011710 con 0x7ff5c40b2100 2023-10-09T12:56:16.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c415c520 con 0x7ff5c40b2100 2023-10-09T12:56:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5b97fa700 1 -- 172.21.15.86:0/2419297197 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4011ad0 con 0x7ff5c40b2100 2023-10-09T12:56:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.337+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c415cae0 con 0x7ff5c40b2100 2023-10-09T12:56:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.338+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c40718b0 con 0x7ff5c40b2100 2023-10-09T12:56:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.339+0000 7ff5b97fa700 1 -- 172.21.15.86:0/2419297197 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 70) v1 ==== 84871+0+0 (secure 0 0 0) 0x7ff5b401b3b0 con 0x7ff5c40b2100 2023-10-09T12:56:16.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.340+0000 7ff5b97fa700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5a80670a0 0x7ff5a8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:16.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.340+0000 7ff5b97fa700 1 -- 172.21.15.86:0/2419297197 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6469+0+0 (secure 0 0 0) 0x7ff5b4083fe0 con 0x7ff5c40b2100 2023-10-09T12:56:16.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.340+0000 7ff5c979b700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5a80670a0 0x7ff5a8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:16.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.341+0000 7ff5c979b700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5a80670a0 0x7ff5a8069550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00099b0 tx=0x7ff5c0017000 comp rx=0 tx=0).ready entity=mgr.8289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:16.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.344+0000 7ff5b97fa700 1 -- 172.21.15.86:0/2419297197 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5b4050e00 con 0x7ff5c40b2100 2023-10-09T12:56:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.563+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5c40aec20 con 0x7ff5a80670a0 2023-10-09T12:56:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.643+0000 7ff5b97fa700 1 -- 172.21.15.86:0/2419297197 <== mgr.8289 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7ff5c40aec20 con 0x7ff5a80670a0 2023-10-09T12:56:16.644 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5a80670a0 msgr2=0x7ff5a8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5a80670a0 0x7ff5a8069550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00099b0 tx=0x7ff5c0017000 comp rx=0 tx=0).stop 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c40b2100 msgr2=0x7ff5c40b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c40b2100 0x7ff5c40b0030 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c5c0 tx=0x7ff5b400c980 comp rx=0 tx=0).stop 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 shutdown_connections 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5c4157740 0x7ff5c40c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c4068aa0 0x7ff5c40af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff5a80670a0 0x7ff5a8069550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 --2- 172.21.15.86:0/2419297197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c40b2100 0x7ff5c40b0030 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.645+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 >> 172.21.15.86:0/2419297197 conn(0x7ff5c40c8f90 msgr2=0x7ff5c406f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.646+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 shutdown_connections 2023-10-09T12:56:16.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:16.646+0000 7ff5cb9ff700 1 -- 172.21.15.86:0/2419297197 wait complete. 2023-10-09T12:56:16.664 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-10-09T12:56:16.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:16.664 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T12:56:16.703 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_02_00_UTC 2023-10-09T12:56:16.703 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_03_00_UTC 2023-10-09T12:56:16.703 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_04_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_05_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_06_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_07_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_08_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_09_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_10_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_11_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_12_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_13_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_14_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_15_00_UTC 2023-10-09T12:56:16.704 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_16_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_17_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_18_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_19_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_20_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_21_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_22_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_23_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_24_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_25_01_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_26_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_27_00_UTC 2023-10-09T12:56:16.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_28_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_29_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_30_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_31_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_32_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_33_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_34_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_35_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_36_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_37_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_38_00_UTC 2023-10-09T12:56:16.706 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_39_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_40_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_41_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_42_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_43_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_44_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_45_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_46_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_47_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_48_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_49_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_50_00_UTC 2023-10-09T12:56:16.707 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_51_00_UTC 2023-10-09T12:56:16.708 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_52_00_UTC 2023-10-09T12:56:16.708 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_53_00_UTC 2023-10-09T12:56:16.708 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_54_00_UTC 2023-10-09T12:56:16.708 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_55_00_UTC 2023-10-09T12:56:16.708 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_56_00_UTC 2023-10-09T12:56:16.709 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_02_00_UTC 2023-10-09T12:56:16.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:16.709 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_02_00_UTC) 2023-10-09T12:56:16.791 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_03_00_UTC 2023-10-09T12:56:16.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:16.791 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_03_00_UTC) 2023-10-09T12:56:16.873 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_04_00_UTC 2023-10-09T12:56:16.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:16.873 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_04_00_UTC) 2023-10-09T12:56:16.956 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_05_00_UTC 2023-10-09T12:56:16.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:16.956 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_05_00_UTC) 2023-10-09T12:56:17.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_06_00_UTC 2023-10-09T12:56:17.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.038 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_06_00_UTC) 2023-10-09T12:56:17.121 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_07_00_UTC 2023-10-09T12:56:17.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.121 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_07_00_UTC) 2023-10-09T12:56:17.216 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_08_00_UTC 2023-10-09T12:56:17.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.216 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_08_00_UTC) 2023-10-09T12:56:17.258 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_09_00_UTC 2023-10-09T12:56:17.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.258 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_09_00_UTC) 2023-10-09T12:56:17.341 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_10_00_UTC 2023-10-09T12:56:17.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.342 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_10_00_UTC) 2023-10-09T12:56:17.424 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_11_00_UTC 2023-10-09T12:56:17.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.424 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_11_00_UTC) 2023-10-09T12:56:17.507 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_12_00_UTC 2023-10-09T12:56:17.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.507 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_12_00_UTC) 2023-10-09T12:56:17.590 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_13_00_UTC 2023-10-09T12:56:17.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.590 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_13_00_UTC) 2023-10-09T12:56:17.673 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_14_00_UTC 2023-10-09T12:56:17.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.673 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_14_00_UTC) 2023-10-09T12:56:17.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_15_00_UTC 2023-10-09T12:56:17.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.759 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_15_00_UTC) 2023-10-09T12:56:17.841 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_16_00_UTC 2023-10-09T12:56:17.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.841 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_16_00_UTC) 2023-10-09T12:56:17.923 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_17_00_UTC 2023-10-09T12:56:17.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:17.924 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_17_00_UTC) 2023-10-09T12:56:18.006 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_18_00_UTC 2023-10-09T12:56:18.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.006 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_18_00_UTC) 2023-10-09T12:56:18.090 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_19_00_UTC 2023-10-09T12:56:18.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.090 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_19_00_UTC) 2023-10-09T12:56:18.173 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_20_00_UTC 2023-10-09T12:56:18.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.174 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_20_00_UTC) 2023-10-09T12:56:18.256 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_21_00_UTC 2023-10-09T12:56:18.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.256 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_21_00_UTC) 2023-10-09T12:56:18.337 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_22_00_UTC 2023-10-09T12:56:18.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.338 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_22_00_UTC) 2023-10-09T12:56:18.419 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_23_00_UTC 2023-10-09T12:56:18.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.419 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_23_00_UTC) 2023-10-09T12:56:18.502 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_24_00_UTC 2023-10-09T12:56:18.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.502 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_24_00_UTC) 2023-10-09T12:56:18.584 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_25_01_UTC 2023-10-09T12:56:18.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.584 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_25_01_UTC) 2023-10-09T12:56:18.665 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_26_00_UTC 2023-10-09T12:56:18.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.666 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_26_00_UTC) 2023-10-09T12:56:18.749 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_27_00_UTC 2023-10-09T12:56:18.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.749 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_27_00_UTC) 2023-10-09T12:56:18.832 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_28_00_UTC 2023-10-09T12:56:18.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.832 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_28_00_UTC) 2023-10-09T12:56:18.916 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_29_00_UTC 2023-10-09T12:56:18.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.916 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_29_00_UTC) 2023-10-09T12:56:18.997 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_30_00_UTC 2023-10-09T12:56:18.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:18.998 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_30_00_UTC) 2023-10-09T12:56:19.080 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_31_00_UTC 2023-10-09T12:56:19.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.080 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_31_00_UTC) 2023-10-09T12:56:19.163 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_32_00_UTC 2023-10-09T12:56:19.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.163 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_32_00_UTC) 2023-10-09T12:56:19.268 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_33_00_UTC 2023-10-09T12:56:19.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.269 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_33_00_UTC) 2023-10-09T12:56:19.310 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_34_00_UTC 2023-10-09T12:56:19.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.310 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_34_00_UTC) 2023-10-09T12:56:19.391 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_35_00_UTC 2023-10-09T12:56:19.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.392 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_35_00_UTC) 2023-10-09T12:56:19.486 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_36_00_UTC 2023-10-09T12:56:19.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.487 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_36_00_UTC) 2023-10-09T12:56:19.529 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_37_00_UTC 2023-10-09T12:56:19.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.530 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_37_00_UTC) 2023-10-09T12:56:19.612 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_38_00_UTC 2023-10-09T12:56:19.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.612 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_38_00_UTC) 2023-10-09T12:56:19.695 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_39_00_UTC 2023-10-09T12:56:19.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.695 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_39_00_UTC) 2023-10-09T12:56:19.779 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_40_00_UTC 2023-10-09T12:56:19.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.779 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_40_00_UTC) 2023-10-09T12:56:19.862 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_41_00_UTC 2023-10-09T12:56:19.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.862 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_41_00_UTC) 2023-10-09T12:56:19.944 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_42_00_UTC 2023-10-09T12:56:19.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:19.944 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_42_00_UTC) 2023-10-09T12:56:20.027 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_43_00_UTC 2023-10-09T12:56:20.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.027 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_43_00_UTC) 2023-10-09T12:56:20.112 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_44_00_UTC 2023-10-09T12:56:20.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.112 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_44_00_UTC) 2023-10-09T12:56:20.208 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_45_00_UTC 2023-10-09T12:56:20.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.208 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_45_00_UTC) 2023-10-09T12:56:20.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_46_00_UTC 2023-10-09T12:56:20.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.261 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_46_00_UTC) 2023-10-09T12:56:20.303 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_47_00_UTC 2023-10-09T12:56:20.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.303 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_47_00_UTC) 2023-10-09T12:56:20.385 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_48_00_UTC 2023-10-09T12:56:20.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.386 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_48_00_UTC) 2023-10-09T12:56:20.476 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_49_00_UTC 2023-10-09T12:56:20.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.476 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_49_00_UTC) 2023-10-09T12:56:20.532 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_50_00_UTC 2023-10-09T12:56:20.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.532 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_50_00_UTC) 2023-10-09T12:56:20.580 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_51_00_UTC 2023-10-09T12:56:20.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.580 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_51_00_UTC) 2023-10-09T12:56:20.662 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_52_00_UTC 2023-10-09T12:56:20.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.663 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_52_00_UTC) 2023-10-09T12:56:20.745 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_53_00_UTC 2023-10-09T12:56:20.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.746 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_53_00_UTC) 2023-10-09T12:56:20.829 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_54_00_UTC 2023-10-09T12:56:20.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.830 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_54_00_UTC) 2023-10-09T12:56:20.912 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_55_00_UTC 2023-10-09T12:56:20.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.912 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_55_00_UTC) 2023-10-09T12:56:20.994 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-12_56_00_UTC 2023-10-09T12:56:20.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:20.995 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-12_56_00_UTC) 2023-10-09T12:56:21.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:21.078 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T12:56:21.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T12:56:21.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.422+0000 7fbca8d9d700 1 Processor -- start 2023-10-09T12:56:21.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.422+0000 7fbca8d9d700 1 -- start start 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca8d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbca4159a60 0x7fbca40c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca8d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40ccc00 0x7fbca4069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca8d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbca406a020 0x7fbca40cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca8d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca406dfc0 con 0x7fbca406a020 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca8d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca40c9cb0 con 0x7fbca4159a60 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca8d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40c9f30 con 0x7fbca40ccc00 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbca406a020 0x7fbca40cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:21.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbca406a020 0x7fbca40cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34848/0 (socket says 172.21.15.86:34848) 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca3fff700 1 -- 172.21.15.86:0/2806538910 learned_addr learned my addr 172.21.15.86:0/2806538910 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca37fe700 1 --2- 172.21.15.86:0/2806538910 >> v2:172.21.15.135:3300/0 conn(0x7fbca4159a60 0x7fbca40c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca2ffd700 1 --2- 172.21.15.86:0/2806538910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40ccc00 0x7fbca4069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca3fff700 1 -- 172.21.15.86:0/2806538910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40ccc00 msgr2=0x7fbca4069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.424+0000 7fbca3fff700 1 --2- 172.21.15.86:0/2806538910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40ccc00 0x7fbca4069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca3fff700 1 -- 172.21.15.86:0/2806538910 >> v2:172.21.15.135:3300/0 conn(0x7fbca4159a60 msgr2=0x7fbca40c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca3fff700 1 --2- 172.21.15.86:0/2806538910 >> v2:172.21.15.135:3300/0 conn(0x7fbca4159a60 0x7fbca40c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca3fff700 1 -- 172.21.15.86:0/2806538910 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40ca470 con 0x7fbca406a020 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca3fff700 1 --2- 172.21.15.86:0/2806538910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca406a020 0x7fbca40cb230 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fbca406e510 tx=0x7fbc9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6e36e3fdf5ec17 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:21.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca27fc700 1 -- 172.21.15.86:0/2806538910 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00e070 con 0x7fbca406a020 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca27fc700 1 -- 172.21.15.86:0/2806538910 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c00ba00 con 0x7fbca406a020 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca27fc700 1 -- 172.21.15.86:0/2806538910 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0092e0 con 0x7fbca406a020 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca8d9d700 1 -- 172.21.15.86:0/2806538910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca406a020 msgr2=0x7fbca40cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.425+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/2806538910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca406a020 0x7fbca40cb230 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fbca406e510 tx=0x7fbc9c009840 comp rx=0 tx=0).stop 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.426+0000 7fbca8d9d700 1 -- 172.21.15.86:0/2806538910 shutdown_connections 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.426+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/2806538910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca406a020 0x7fbca40cb230 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.426+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/2806538910 >> v2:172.21.15.135:3300/0 conn(0x7fbca4159a60 0x7fbca40c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.426+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/2806538910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca40ccc00 0x7fbca4069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.426+0000 7fbca8d9d700 1 -- 172.21.15.86:0/2806538910 >> 172.21.15.86:0/2806538910 conn(0x7fbca406baa0 msgr2=0x7fbca406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:21.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.426+0000 7fbca8d9d700 1 -- 172.21.15.86:0/2806538910 shutdown_connections 2023-10-09T12:56:21.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.426+0000 7fbca8d9d700 1 -- 172.21.15.86:0/2806538910 wait complete. 2023-10-09T12:56:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.427+0000 7fbca8d9d700 1 Processor -- start 2023-10-09T12:56:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.427+0000 7fbca8d9d700 1 -- start start 2023-10-09T12:56:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca8d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca406a020 0x7fbca413ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca8d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca40ccc00 0x7fbca413f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:21.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca8d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca4159a60 0x7fbca4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca8d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40b4120 con 0x7fbca40ccc00 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca8d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40c65e0 con 0x7fbca406a020 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca8d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40c5cb0 con 0x7fbca4159a60 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca40ccc00 0x7fbca413f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca40ccc00 0x7fbca413f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34862/0 (socket says 172.21.15.86:34862) 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca2ffd700 1 -- 172.21.15.86:0/88240030 learned_addr learned my addr 172.21.15.86:0/88240030 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca37fe700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca406a020 0x7fbca413ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.428+0000 7fbca3fff700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca4159a60 0x7fbca4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:21.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca2ffd700 1 -- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca4159a60 msgr2=0x7fbca4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca2ffd700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca4159a60 0x7fbca4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca2ffd700 1 -- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca406a020 msgr2=0x7fbca413ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca2ffd700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca406a020 0x7fbca413ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca2ffd700 1 -- 172.21.15.86:0/88240030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c009ae0 con 0x7fbca40ccc00 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca2ffd700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca40ccc00 0x7fbca413f1f0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800ecb0 tx=0x7fbc980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800c850 con 0x7fbca40ccc00 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9800c9d0 con 0x7fbca40ccc00 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca40c5f90 con 0x7fbca40ccc00 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800cd90 con 0x7fbca40ccc00 2023-10-09T12:56:21.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.429+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca4157400 con 0x7fbca40ccc00 2023-10-09T12:56:21.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.430+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca40c6770 con 0x7fbca40ccc00 2023-10-09T12:56:21.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.431+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 70) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fbc98013680 con 0x7fbca40ccc00 2023-10-09T12:56:21.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.432+0000 7fbc8b7fe700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc900670a0 0x7fbc90069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:21.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.432+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fbc98084d30 con 0x7fbca40ccc00 2023-10-09T12:56:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.432+0000 7fbca37fe700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc900670a0 0x7fbc90069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:21.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.433+0000 7fbca37fe700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc900670a0 0x7fbc90069550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009d10 tx=0x7fbc940091a0 comp rx=0 tx=0).ready entity=mgr.8289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:21.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.436+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc98051ac0 con 0x7fbca40ccc00 2023-10-09T12:56:21.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:21.677+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fbca40ca750 con 0x7fbca40ccc00 2023-10-09T12:56:22.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.206+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fbc98051e90 con 0x7fbca40ccc00 2023-10-09T12:56:22.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.208+0000 7fbc8b7fe700 1 -- 172.21.15.86:0/88240030 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v71) v1 ==== 93+0+0 (secure 0 0 0) 0x7fbc980538c0 con 0x7fbca40ccc00 2023-10-09T12:56:22.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.213+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc900670a0 msgr2=0x7fbc90069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:22.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.213+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc900670a0 0x7fbc90069550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009d10 tx=0x7fbc940091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.213+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca40ccc00 msgr2=0x7fbca413f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:22.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.213+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca40ccc00 0x7fbca413f1f0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800ecb0 tx=0x7fbc980091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.215+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 shutdown_connections 2023-10-09T12:56:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.215+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbca4159a60 0x7fbca4154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.215+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca406a020 0x7fbca413ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.215+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc900670a0 0x7fbc90069550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.215+0000 7fbca8d9d700 1 --2- 172.21.15.86:0/88240030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbca40ccc00 0x7fbca413f1f0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.215+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 >> 172.21.15.86:0/88240030 conn(0x7fbca406baa0 msgr2=0x7fbca415fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.215+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 shutdown_connections 2023-10-09T12:56:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.216+0000 7fbca8d9d700 1 -- 172.21.15.86:0/88240030 wait complete. 2023-10-09T12:56:22.246 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T12:56:22.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:56:22.329 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:56:22.410 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T12:56:22.410 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T12:56:22.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:22.410 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T12:56:22.520 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T12:56:22.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:22.520 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T12:56:22.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:56:22.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.794+0000 7f035739d700 1 Processor -- start 2023-10-09T12:56:22.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.794+0000 7f035739d700 1 -- start start 2023-10-09T12:56:22.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.795+0000 7f035739d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f03500c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:22.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.795+0000 7f035739d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f03501566e0 0x7f03500ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:22.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.795+0000 7f035739d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03500ca860 con 0x7f03500ca300 2023-10-09T12:56:22.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.796+0000 7f035739d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500cab40 con 0x7f03501566e0 2023-10-09T12:56:22.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.796+0000 7f035739d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03500cae20 con 0x7f0350156310 2023-10-09T12:56:22.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.796+0000 7f0355b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f03501566e0 0x7f03500ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:22.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.796+0000 7f035639b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f03500c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:22.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.796+0000 7f0355b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f03501566e0 0x7f03500ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34894/0 (socket says 172.21.15.86:34894) 2023-10-09T12:56:22.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.796+0000 7f0355b9a700 1 -- 172.21.15.86:0/576429897 learned_addr learned my addr 172.21.15.86:0/576429897 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:22.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.796+0000 7f035639b700 1 --2- 172.21.15.86:0/576429897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f03500c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:52450/0 (socket says 172.21.15.86:52450) 2023-10-09T12:56:22.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f035639b700 1 -- 172.21.15.86:0/576429897 >> v2:172.21.15.86:3300/0 conn(0x7f03501566e0 msgr2=0x7f03500ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:22.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f035639b700 1 --2- 172.21.15.86:0/576429897 >> v2:172.21.15.86:3300/0 conn(0x7f03501566e0 0x7f03500ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f035639b700 1 -- 172.21.15.86:0/576429897 >> v1:172.21.15.86:6789/0 conn(0x7f03500ca300 legacy=0x7f03500c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:22.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f0355399700 1 -- 172.21.15.86:0/576429897 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410704449 0 0) 0x7f03500ca860 con 0x7f03500ca300 2023-10-09T12:56:22.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f035639b700 1 -- 172.21.15.86:0/576429897 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500cb100 con 0x7f0350156310 2023-10-09T12:56:22.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f0355b9a700 1 --2- 172.21.15.86:0/576429897 >> v2:172.21.15.86:3300/0 conn(0x7f03501566e0 0x7f03500ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:22.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f035639b700 1 --2- 172.21.15.86:0/576429897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f03500c9dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f034c0098e0 tx=0x7f034c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e43bf0a8a5951e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:22.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f0355399700 1 -- 172.21.15.86:0/576429897 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00b640 con 0x7f0350156310 2023-10-09T12:56:22.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f0355399700 1 -- 172.21.15.86:0/576429897 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c00b7a0 con 0x7f0350156310 2023-10-09T12:56:22.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.797+0000 7f0355399700 1 -- 172.21.15.86:0/576429897 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00bb40 con 0x7f0350156310 2023-10-09T12:56:22.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 -- 172.21.15.86:0/576429897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 msgr2=0x7f03500c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:22.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 --2- 172.21.15.86:0/576429897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f03500c9dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f034c0098e0 tx=0x7f034c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 -- 172.21.15.86:0/576429897 shutdown_connections 2023-10-09T12:56:22.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 --2- 172.21.15.86:0/576429897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f03500c9dc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 --2- 172.21.15.86:0/576429897 >> v2:172.21.15.86:3300/0 conn(0x7f03501566e0 0x7f03500ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 -- 172.21.15.86:0/576429897 >> 172.21.15.86:0/576429897 conn(0x7f03500cc1f0 msgr2=0x7f03500cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:22.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 -- 172.21.15.86:0/576429897 shutdown_connections 2023-10-09T12:56:22.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.798+0000 7f035739d700 1 -- 172.21.15.86:0/576429897 wait complete. 2023-10-09T12:56:22.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.800+0000 7f035739d700 1 Processor -- start 2023-10-09T12:56:22.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.800+0000 7f035739d700 1 -- start start 2023-10-09T12:56:22.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f035739d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03500ca300 0x7f035013bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:22.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f035739d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f0350145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:22.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f035739d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03501566e0 0x7f0350146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:22.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f035739d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03500af6f0 con 0x7f03501566e0 2023-10-09T12:56:22.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f035739d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03500af990 con 0x7f03500ca300 2023-10-09T12:56:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f035739d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03500afc70 con 0x7f0350156310 2023-10-09T12:56:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0356b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03501566e0 0x7f0350146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0356b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03501566e0 0x7f0350146070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34906/0 (socket says 172.21.15.86:34906) 2023-10-09T12:56:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f035639b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03500ca300 0x7f035013bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0356b9c700 1 -- 172.21.15.86:0/93840076 learned_addr learned my addr 172.21.15.86:0/93840076 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0355b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f0350145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0356b9c700 1 -- 172.21.15.86:0/93840076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 msgr2=0x7f0350145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0356b9c700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f0350145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0356b9c700 1 -- 172.21.15.86:0/93840076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03500ca300 msgr2=0x7f035013bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.801+0000 7f0356b9c700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03500ca300 0x7f035013bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.802+0000 7f0356b9c700 1 -- 172.21.15.86:0/93840076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03400094f0 con 0x7f03501566e0 2023-10-09T12:56:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.802+0000 7f0356b9c700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03501566e0 0x7f0350146070 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f034800c890 tx=0x7f0348001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:22.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.802+0000 7f03467fc700 1 -- 172.21.15.86:0/93840076 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348012630 con 0x7f03501566e0 2023-10-09T12:56:22.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.802+0000 7f03467fc700 1 -- 172.21.15.86:0/93840076 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348012790 con 0x7f03501566e0 2023-10-09T12:56:22.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.802+0000 7f03467fc700 1 -- 172.21.15.86:0/93840076 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348012b50 con 0x7f03501566e0 2023-10-09T12:56:22.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.802+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c009420 con 0x7f03501566e0 2023-10-09T12:56:22.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.802+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035013d2c0 con 0x7f03501566e0 2023-10-09T12:56:22.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.803+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03500b0190 con 0x7f03501566e0 2023-10-09T12:56:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.804+0000 7f03467fc700 1 -- 172.21.15.86:0/93840076 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f034801a3a0 con 0x7f03501566e0 2023-10-09T12:56:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.805+0000 7f03467fc700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 0x7f0334069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.805+0000 7f03467fc700 1 -- 172.21.15.86:0/93840076 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6513+0+0 (secure 0 0 0) 0x7f0348084c40 con 0x7f03501566e0 2023-10-09T12:56:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.805+0000 7f035639b700 1 -- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 msgr2=0x7f0334069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:22.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.805+0000 7f035639b700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 0x7f0334069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:22.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:22.809+0000 7f03467fc700 1 -- 172.21.15.86:0/93840076 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03500b0190 con 0x7f03501566e0 2023-10-09T12:56:23.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.006+0000 7f035639b700 1 -- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 msgr2=0x7f0334069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:23.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.006+0000 7f035639b700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 0x7f0334069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:23.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.069+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03500b0190 con 0x7f03501566e0 2023-10-09T12:56:23.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.070+0000 7f03467fc700 1 -- 172.21.15.86:0/93840076 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f03500b0190 con 0x7f03501566e0 2023-10-09T12:56:23.071 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:23.071 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4273963470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4273963470},{"type":"v1","addr":"172.21.15.135:6834","nonce":4273963470}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1830713158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1830713158},{"type":"v1","addr":"172.21.15.135:6835","nonce":1830713158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/51772873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":51772873},{"type":"v1","addr":"172.21.15.86:6833","nonce":51772873}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:00:27.831701+0000","modified":"2023-10-09T12:00:31.403803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2423117806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2423117806},{"type":"v1","addr":"172.21.15.86:6835","nonce":2423117806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T12:56:23.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 msgr2=0x7f0334069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:23.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 0x7f0334069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03501566e0 msgr2=0x7f0350146070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03501566e0 0x7f0350146070 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f034800c890 tx=0x7f0348001670 comp rx=0 tx=0).stop 2023-10-09T12:56:23.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 shutdown_connections 2023-10-09T12:56:23.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0334067050 0x7f0334069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03501566e0 0x7f0350146070 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03500ca300 0x7f035013bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 --2- 172.21.15.86:0/93840076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0350156310 0x7f0350145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 >> 172.21.15.86:0/93840076 conn(0x7f03500cc1f0 msgr2=0x7f03500c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:23.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 shutdown_connections 2023-10-09T12:56:23.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.072+0000 7f035739d700 1 -- 172.21.15.86:0/93840076 wait complete. 2023-10-09T12:56:23.076 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 63 2023-10-09T12:56:23.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:56:23.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.293+0000 7f21f8f9d700 1 Processor -- start 2023-10-09T12:56:23.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.293+0000 7f21f8f9d700 1 -- start start 2023-10-09T12:56:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f8f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f21f40c6c60 0x7f21f40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f8f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21f406e8c0 0x7f21f40c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f8f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40b1410 con 0x7f21f41595a0 2023-10-09T12:56:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f8f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f40b2b90 con 0x7f21f406e8c0 2023-10-09T12:56:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f8f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f4063230 con 0x7f21f40c6c60 2023-10-09T12:56:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21f406e8c0 0x7f21f40c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21f406e8c0 0x7f21f40c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34912/0 (socket says 172.21.15.86:34912) 2023-10-09T12:56:23.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.295+0000 7f21f3fff700 1 -- 172.21.15.86:0/2548370096 learned_addr learned my addr 172.21.15.86:0/2548370096 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:23.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f2ffd700 1 --2- 172.21.15.86:0/2548370096 >> v2:172.21.15.135:3300/0 conn(0x7f21f40c6c60 0x7f21f40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f3fff700 1 -- 172.21.15.86:0/2548370096 >> v2:172.21.15.135:3300/0 conn(0x7f21f40c6c60 msgr2=0x7f21f40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f3fff700 1 --2- 172.21.15.86:0/2548370096 >> v2:172.21.15.135:3300/0 conn(0x7f21f40c6c60 0x7f21f40c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f3fff700 1 -- 172.21.15.86:0/2548370096 >> v1:172.21.15.135:6789/0 conn(0x7f21f41595a0 legacy=0x7f21f40b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f3fff700 1 -- 172.21.15.86:0/2548370096 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40634f0 con 0x7f21f406e8c0 2023-10-09T12:56:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f3fff700 1 --2- 172.21.15.86:0/2548370096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f406e8c0 0x7f21f40c8660 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f21f40b07d0 tx=0x7f21ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a190fb79e5430c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f27fc700 1 -- 172.21.15.86:0/2548370096 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00e070 con 0x7f21f406e8c0 2023-10-09T12:56:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f27fc700 1 -- 172.21.15.86:0/2548370096 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00ba20 con 0x7f21f406e8c0 2023-10-09T12:56:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.296+0000 7f21f27fc700 1 -- 172.21.15.86:0/2548370096 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0092e0 con 0x7f21f406e8c0 2023-10-09T12:56:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2548370096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f406e8c0 msgr2=0x7f21f40c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2548370096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f406e8c0 0x7f21f40c8660 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f21f40b07d0 tx=0x7f21ec009840 comp rx=0 tx=0).stop 2023-10-09T12:56:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2548370096 shutdown_connections 2023-10-09T12:56:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2548370096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f406e8c0 0x7f21f40c8660 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2548370096 >> v2:172.21.15.135:3300/0 conn(0x7f21f40c6c60 0x7f21f40c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2548370096 >> 172.21.15.86:0/2548370096 conn(0x7f21f406ddb0 msgr2=0x7f21f406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2548370096 shutdown_connections 2023-10-09T12:56:23.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.297+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2548370096 wait complete. 2023-10-09T12:56:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.299+0000 7f21f8f9d700 1 Processor -- start 2023-10-09T12:56:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.299+0000 7f21f8f9d700 1 -- start start 2023-10-09T12:56:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f8f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f406e8c0 0x7f21f416a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f8f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21f40c6c60 0x7f21f40a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f8f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f41595a0 0x7f21f40a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f8f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40af440 con 0x7f21f41595a0 2023-10-09T12:56:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f8f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40c5660 con 0x7f21f40c6c60 2023-10-09T12:56:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f8f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40c5940 con 0x7f21f406e8c0 2023-10-09T12:56:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f41595a0 0x7f21f40a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f41595a0 0x7f21f40a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34924/0 (socket says 172.21.15.86:34924) 2023-10-09T12:56:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 -- 172.21.15.86:0/2038084633 learned_addr learned my addr 172.21.15.86:0/2038084633 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f37fe700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f406e8c0 0x7f21f416a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 -- 172.21.15.86:0/2038084633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f406e8c0 msgr2=0x7f21f416a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f406e8c0 0x7f21f416a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 -- 172.21.15.86:0/2038084633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21f40c6c60 msgr2=0x7f21f40a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21f40c6c60 0x7f21f40a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.300+0000 7f21f3fff700 1 -- 172.21.15.86:0/2038084633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec009ae0 con 0x7f21f41595a0 2023-10-09T12:56:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.301+0000 7f21f3fff700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f41595a0 0x7f21f40a8ea0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009880 tx=0x7f21ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.301+0000 7f21db7fe700 1 -- 172.21.15.86:0/2038084633 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec008be0 con 0x7f21f41595a0 2023-10-09T12:56:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.301+0000 7f21db7fe700 1 -- 172.21.15.86:0/2038084633 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec008d40 con 0x7f21f41595a0 2023-10-09T12:56:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.301+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f40c5c20 con 0x7f21f41595a0 2023-10-09T12:56:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.301+0000 7f21db7fe700 1 -- 172.21.15.86:0/2038084633 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0266b0 con 0x7f21f41595a0 2023-10-09T12:56:23.306 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.301+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f40c61e0 con 0x7f21f41595a0 2023-10-09T12:56:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.303+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f404c3c0 con 0x7f21f41595a0 2023-10-09T12:56:23.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.304+0000 7f21db7fe700 1 -- 172.21.15.86:0/2038084633 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f21ec003040 con 0x7f21f41595a0 2023-10-09T12:56:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.305+0000 7f21db7fe700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 0x7f21e0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.305+0000 7f21f37fe700 1 -- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 msgr2=0x7f21e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.305+0000 7f21db7fe700 1 -- 172.21.15.86:0/2038084633 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f21ec086be0 con 0x7f21f41595a0 2023-10-09T12:56:23.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.305+0000 7f21f37fe700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 0x7f21e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:23.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.309+0000 7f21db7fe700 1 -- 172.21.15.86:0/2038084633 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21ec0538f0 con 0x7f21f41595a0 2023-10-09T12:56:23.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.506+0000 7f21f37fe700 1 -- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 msgr2=0x7f21e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:23.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.506+0000 7f21f37fe700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 0x7f21e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:23.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.510+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21f40637d0 con 0x7f21f41595a0 2023-10-09T12:56:23.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.511+0000 7f21db7fe700 1 -- 172.21.15.86:0/2038084633 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f21ec056f10 con 0x7f21f41595a0 2023-10-09T12:56:23.512 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:23.512 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":151,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:56:23.157000+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:00:25.489470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T12:00:26.820007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":151,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T12:00:43.540321+0000","172.21.15.86:6836/85490":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/3103181679":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/2262430303":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/1847574361":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/4006031168":"2023-10-10T12:00:43.540321+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":3,"length":17},{"begin":59,"length":17}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:56:23.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 msgr2=0x7f21e0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:23.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 0x7f21e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f41595a0 msgr2=0x7f21f40a8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f41595a0 0x7f21f40a8ea0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009880 tx=0x7f21ec018000 comp rx=0 tx=0).stop 2023-10-09T12:56:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 shutdown_connections 2023-10-09T12:56:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f21e0067050 0x7f21e0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21f41595a0 0x7f21f40a8ea0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f406e8c0 0x7f21f416a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 --2- 172.21.15.86:0/2038084633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21f40c6c60 0x7f21f40a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 >> 172.21.15.86:0/2038084633 conn(0x7f21f406ddb0 msgr2=0x7f21f4158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:23.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 shutdown_connections 2023-10-09T12:56:23.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.513+0000 7f21f8f9d700 1 -- 172.21.15.86:0/2038084633 wait complete. 2023-10-09T12:56:23.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T12:00:25.489470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T12:00:26.820007+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 113, 'snap_epoch': 151, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T12:56:23.533 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T12:56:23.584 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:23.584+0000 7f596ff9e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:56:23.643 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:23.642+0000 7fe12ec6f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:56:23.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.725+0000 7fda3db9d700 1 Processor -- start 2023-10-09T12:56:23.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.725+0000 7fda3db9d700 1 -- start start 2023-10-09T12:56:23.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.726+0000 7fda3db9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fda380b4e70 0x7fda380ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.726+0000 7fda3db9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda380b16d0 0x7fda380b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.726+0000 7fda3db9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda380b2080 con 0x7fda3815d240 2023-10-09T12:56:23.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.726+0000 7fda3db9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380cfb00 con 0x7fda380b16d0 2023-10-09T12:56:23.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.726+0000 7fda3db9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380b5c40 con 0x7fda380b4e70 2023-10-09T12:56:23.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda380b16d0 0x7fda380b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda380b16d0 0x7fda380b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34932/0 (socket says 172.21.15.86:34932) 2023-10-09T12:56:23.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 -- 172.21.15.86:0/3857833415 learned_addr learned my addr 172.21.15.86:0/3857833415 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:23.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda3cb9b700 1 --2- 172.21.15.86:0/3857833415 >> v2:172.21.15.135:3300/0 conn(0x7fda380b4e70 0x7fda380ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 -- 172.21.15.86:0/3857833415 >> v2:172.21.15.135:3300/0 conn(0x7fda380b4e70 msgr2=0x7fda380ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:23.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 --2- 172.21.15.86:0/3857833415 >> v2:172.21.15.135:3300/0 conn(0x7fda380b4e70 0x7fda380ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 -- 172.21.15.86:0/3857833415 >> v1:172.21.15.135:6789/0 conn(0x7fda3815d240 legacy=0x7fda3815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 -- 172.21.15.86:0/3857833415 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380b5f20 con 0x7fda380b16d0 2023-10-09T12:56:23.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda3cb9b700 1 --2- 172.21.15.86:0/3857833415 >> v2:172.21.15.135:3300/0 conn(0x7fda380b4e70 0x7fda380ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:23.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.727+0000 7fda37fff700 1 --2- 172.21.15.86:0/3857833415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b16d0 0x7fda380b1b40 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fda38064910 tx=0x7fda24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a41f72c788eed9a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:23.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda377fe700 1 -- 172.21.15.86:0/3857833415 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400b860 con 0x7fda380b16d0 2023-10-09T12:56:23.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda377fe700 1 -- 172.21.15.86:0/3857833415 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400b9c0 con 0x7fda380b16d0 2023-10-09T12:56:23.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda377fe700 1 -- 172.21.15.86:0/3857833415 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400bd60 con 0x7fda380b16d0 2023-10-09T12:56:23.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 -- 172.21.15.86:0/3857833415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b16d0 msgr2=0x7fda380b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 --2- 172.21.15.86:0/3857833415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b16d0 0x7fda380b1b40 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fda38064910 tx=0x7fda24009250 comp rx=0 tx=0).stop 2023-10-09T12:56:23.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 -- 172.21.15.86:0/3857833415 shutdown_connections 2023-10-09T12:56:23.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 --2- 172.21.15.86:0/3857833415 >> v2:172.21.15.135:3300/0 conn(0x7fda380b4e70 0x7fda380ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 --2- 172.21.15.86:0/3857833415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b16d0 0x7fda380b1b40 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 -- 172.21.15.86:0/3857833415 >> 172.21.15.86:0/3857833415 conn(0x7fda380d10c0 msgr2=0x7fda380affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 -- 172.21.15.86:0/3857833415 shutdown_connections 2023-10-09T12:56:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.728+0000 7fda3db9d700 1 -- 172.21.15.86:0/3857833415 wait complete. 2023-10-09T12:56:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.730+0000 7fda3db9d700 1 Processor -- start 2023-10-09T12:56:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.730+0000 7fda3db9d700 1 -- start start 2023-10-09T12:56:23.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3db9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda380b16d0 0x7fda38155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3db9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b4e70 0x7fda3815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3db9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815d240 0x7fda38157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3db9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38155b70 con 0x7fda380b4e70 2023-10-09T12:56:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3db9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda380c5880 con 0x7fda3815d240 2023-10-09T12:56:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3db9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3815b570 con 0x7fda380b16d0 2023-10-09T12:56:23.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda37fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b4e70 0x7fda3815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda37fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b4e70 0x7fda3815b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34938/0 (socket says 172.21.15.86:34938) 2023-10-09T12:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda37fff700 1 -- 172.21.15.86:0/1804681000 learned_addr learned my addr 172.21.15.86:0/1804681000 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3cb9b700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda380b16d0 0x7fda38155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.731+0000 7fda3d39c700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815d240 0x7fda38157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda37fff700 1 -- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda380b16d0 msgr2=0x7fda38155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda37fff700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda380b16d0 0x7fda38155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda37fff700 1 -- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815d240 msgr2=0x7fda38157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda37fff700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815d240 0x7fda38157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda37fff700 1 -- 172.21.15.86:0/1804681000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240094f0 con 0x7fda380b4e70 2023-10-09T12:56:23.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda37fff700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b4e70 0x7fda3815b030 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fda24009290 tx=0x7fda24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda34ff9700 1 -- 172.21.15.86:0/1804681000 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24026480 con 0x7fda380b4e70 2023-10-09T12:56:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda34ff9700 1 -- 172.21.15.86:0/1804681000 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2401f070 con 0x7fda380b4e70 2023-10-09T12:56:23.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3815be50 con 0x7fda380b4e70 2023-10-09T12:56:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda34ff9700 1 -- 172.21.15.86:0/1804681000 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24026850 con 0x7fda380b4e70 2023-10-09T12:56:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.732+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3815c410 con 0x7fda380b4e70 2023-10-09T12:56:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.733+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda38088990 con 0x7fda380b4e70 2023-10-09T12:56:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.734+0000 7fda34ff9700 1 -- 172.21.15.86:0/1804681000 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fda2401a430 con 0x7fda380b4e70 2023-10-09T12:56:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.735+0000 7fda34ff9700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 0x7fda1c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:23.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.735+0000 7fda34ff9700 1 -- 172.21.15.86:0/1804681000 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fda24021070 con 0x7fda380b4e70 2023-10-09T12:56:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.735+0000 7fda3cb9b700 1 -- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 msgr2=0x7fda1c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.735+0000 7fda3cb9b700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 0x7fda1c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.739+0000 7fda34ff9700 1 -- 172.21.15.86:0/1804681000 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda24053640 con 0x7fda380b4e70 2023-10-09T12:56:23.751 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:23.751+0000 7f596ff9e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:23.813 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:23.813+0000 7fe12ec6f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:23.837 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:23.837+0000 7f596ff9e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:56:23.899 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:23.898+0000 7fe12ec6f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:56:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.933+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda380c59c0 con 0x7fda380b4e70 2023-10-09T12:56:23.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.934+0000 7fda34ff9700 1 -- 172.21.15.86:0/1804681000 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v151) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda24056c60 con 0x7fda380b4e70 2023-10-09T12:56:23.935 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T12:56:23.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3cb9b700 1 -- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 msgr2=0x7fda1c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:23.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3cb9b700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 0x7fda1c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:23.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 msgr2=0x7fda1c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:23.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 0x7fda1c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b4e70 msgr2=0x7fda3815b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:23.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b4e70 0x7fda3815b030 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fda24009290 tx=0x7fda24017000 comp rx=0 tx=0).stop 2023-10-09T12:56:23.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 shutdown_connections 2023-10-09T12:56:23.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda3815d240 0x7fda38157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda380b16d0 0x7fda38155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fda1c067050 0x7fda1c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 --2- 172.21.15.86:0/1804681000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda380b4e70 0x7fda3815b030 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:23.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.936+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 >> 172.21.15.86:0/1804681000 conn(0x7fda380d10c0 msgr2=0x7fda380b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:23.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.937+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 shutdown_connections 2023-10-09T12:56:23.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:23.937+0000 7fda3db9d700 1 -- 172.21.15.86:0/1804681000 wait complete. 2023-10-09T12:56:23.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T12:56:24.062 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:24.062+0000 7f596ff9e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:24.137 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:24.136+0000 7fe12ec6f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:24.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.150+0000 7f84c199d700 1 Processor -- start 2023-10-09T12:56:24.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.150+0000 7f84c199d700 1 -- start start 2023-10-09T12:56:24.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.151+0000 7f84c199d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc15a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.151+0000 7f84c199d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84bc06e470 0x7f84bc06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.151+0000 7f84c199d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0aea70 con 0x7f84bc0aef00 2023-10-09T12:56:24.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.151+0000 7f84c199d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc06ee30 con 0x7f84bc06e470 2023-10-09T12:56:24.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.151+0000 7f84c199d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc15dad0 con 0x7f84bc15a3b0 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84bbfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f84bc0aef00 0x7f84bc15d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:37492/0 (socket says 172.21.15.86:37492) 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84bbfff700 1 -- 172.21.15.86:0/2797690851 learned_addr learned my addr 172.21.15.86:0/2797690851 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84c099b700 1 --2- 172.21.15.86:0/2797690851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84c119c700 1 --2- 172.21.15.86:0/2797690851 >> v2:172.21.15.135:3300/0 conn(0x7f84bc06e470 0x7f84bc06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84bb7fe700 1 -- 172.21.15.86:0/2797690851 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176842093 0 0) 0x7f84bc0aea70 con 0x7f84bc0aef00 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84bb7fe700 1 -- 172.21.15.86:0/2797690851 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ac003570 con 0x7f84bc0aef00 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84c099b700 1 -- 172.21.15.86:0/2797690851 >> v2:172.21.15.135:3300/0 conn(0x7f84bc06e470 msgr2=0x7f84bc06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84c099b700 1 --2- 172.21.15.86:0/2797690851 >> v2:172.21.15.135:3300/0 conn(0x7f84bc06e470 0x7f84bc06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84c099b700 1 -- 172.21.15.86:0/2797690851 >> v1:172.21.15.86:6789/0 conn(0x7f84bc0aef00 legacy=0x7f84bc15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84c099b700 1 -- 172.21.15.86:0/2797690851 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0ae480 con 0x7f84bc15a3b0 2023-10-09T12:56:24.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.152+0000 7f84c119c700 1 --2- 172.21.15.86:0/2797690851 >> v2:172.21.15.135:3300/0 conn(0x7f84bc06e470 0x7f84bc06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:24.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.153+0000 7f84c099b700 1 --2- 172.21.15.86:0/2797690851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc15a780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84b00098e0 tx=0x7f84b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dd6096586af81a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:24.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.153+0000 7f84bb7fe700 1 -- 172.21.15.86:0/2797690851 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011630 con 0x7f84bc15a3b0 2023-10-09T12:56:24.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.153+0000 7f84bb7fe700 1 -- 172.21.15.86:0/2797690851 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b0011790 con 0x7f84bc15a3b0 2023-10-09T12:56:24.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.153+0000 7f84bb7fe700 1 -- 172.21.15.86:0/2797690851 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011b30 con 0x7f84bc15a3b0 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.153+0000 7f84c199d700 1 -- 172.21.15.86:0/2797690851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 msgr2=0x7f84bc15a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.154+0000 7f84c199d700 1 --2- 172.21.15.86:0/2797690851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc15a780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84b00098e0 tx=0x7f84b00091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.154+0000 7f84c199d700 1 -- 172.21.15.86:0/2797690851 shutdown_connections 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.154+0000 7f84c199d700 1 --2- 172.21.15.86:0/2797690851 >> v2:172.21.15.135:3300/0 conn(0x7f84bc06e470 0x7f84bc06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.154+0000 7f84c199d700 1 --2- 172.21.15.86:0/2797690851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc15a780 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.154+0000 7f84c199d700 1 -- 172.21.15.86:0/2797690851 >> 172.21.15.86:0/2797690851 conn(0x7f84bc0c9f70 msgr2=0x7f84bc06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.154+0000 7f84c199d700 1 -- 172.21.15.86:0/2797690851 shutdown_connections 2023-10-09T12:56:24.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.154+0000 7f84c199d700 1 -- 172.21.15.86:0/2797690851 wait complete. 2023-10-09T12:56:24.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.155+0000 7f84c199d700 1 Processor -- start 2023-10-09T12:56:24.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.155+0000 7f84c199d700 1 -- start start 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c199d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84bc06e470 0x7f84bc16acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c199d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84bc0aef00 0x7f84bc0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c199d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c199d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc16cf40 con 0x7f84bc06e470 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c199d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b0ca0 con 0x7f84bc0aef00 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c199d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b1820 con 0x7f84bc15a3b0 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c099b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84bc06e470 0x7f84bc16acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c099b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84bc06e470 0x7f84bc16acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34950/0 (socket says 172.21.15.86:34950) 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84c099b700 1 -- 172.21.15.86:0/774685526 learned_addr learned my addr 172.21.15.86:0/774685526 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.156+0000 7f84bbfff700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84bc0aef00 0x7f84bc0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c119c700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c099b700 1 -- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 msgr2=0x7f84bc0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c099b700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c099b700 1 -- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84bc0aef00 msgr2=0x7f84bc0b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c099b700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84bc0aef00 0x7f84bc0b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c099b700 1 -- 172.21.15.86:0/774685526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4009a20 con 0x7f84bc06e470 2023-10-09T12:56:24.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c099b700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84bc06e470 0x7f84bc16acf0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009ed0 tx=0x7f84b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:24.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84b8ff9700 1 -- 172.21.15.86:0/774685526 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0000cc0 con 0x7f84bc06e470 2023-10-09T12:56:24.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84b8ff9700 1 -- 172.21.15.86:0/774685526 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b0011900 con 0x7f84bc06e470 2023-10-09T12:56:24.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b0009420 con 0x7f84bc06e470 2023-10-09T12:56:24.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.157+0000 7f84b8ff9700 1 -- 172.21.15.86:0/774685526 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0025420 con 0x7f84bc06e470 2023-10-09T12:56:24.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.158+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0b11d0 con 0x7f84bc06e470 2023-10-09T12:56:24.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.159+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc0ad200 con 0x7f84bc06e470 2023-10-09T12:56:24.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.160+0000 7f84b8ff9700 1 -- 172.21.15.86:0/774685526 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f84b0023070 con 0x7f84bc06e470 2023-10-09T12:56:24.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.160+0000 7f84b8ff9700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 0x7f84a0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.161+0000 7f84bbfff700 1 -- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 msgr2=0x7f84a0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:24.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.161+0000 7f84b8ff9700 1 -- 172.21.15.86:0/774685526 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f84b0085d00 con 0x7f84bc06e470 2023-10-09T12:56:24.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.161+0000 7f84bbfff700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 0x7f84a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:24.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.168+0000 7f84b8ff9700 1 -- 172.21.15.86:0/774685526 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84b0052bd0 con 0x7f84bc06e470 2023-10-09T12:56:24.247 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:24.247+0000 7f596ff9e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:56:24.326 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:24.325+0000 7fe12ec6f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:56:24.338 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:24.338+0000 7f596ff9e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:56:24.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.362+0000 7f84bbfff700 1 -- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 msgr2=0x7f84a0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:24.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.362+0000 7f84bbfff700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 0x7f84a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:24.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.367+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84bc159ab0 con 0x7f84bc06e470 2023-10-09T12:56:24.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.367+0000 7f84b8ff9700 1 -- 172.21.15.86:0/774685526 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v151) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84b002a020 con 0x7f84bc06e470 2023-10-09T12:56:24.368 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T12:56:24.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 msgr2=0x7f84a0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:24.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 0x7f84a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84bc06e470 msgr2=0x7f84bc16acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84bc06e470 0x7f84bc16acf0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009ed0 tx=0x7f84b0017000 comp rx=0 tx=0).stop 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 shutdown_connections 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f84a0067050 0x7f84a0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84bc06e470 0x7f84bc16acf0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84bc15a3b0 0x7f84bc0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 --2- 172.21.15.86:0/774685526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84bc0aef00 0x7f84bc0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 >> 172.21.15.86:0/774685526 conn(0x7f84bc0c9f70 msgr2=0x7f84bc152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 shutdown_connections 2023-10-09T12:56:24.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.370+0000 7f84c199d700 1 -- 172.21.15.86:0/774685526 wait complete. 2023-10-09T12:56:24.390 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T12:56:24.424 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:24.423+0000 7fe12ec6f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:56:24.500 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:24.499+0000 7f596ff9e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:56:24.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.581+0000 7fd5cb59e700 1 Processor -- start 2023-10-09T12:56:24.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.581+0000 7fd5cb59e700 1 -- start start 2023-10-09T12:56:24.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5cb59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5cc0b4e70 0x7fd5cc0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5cb59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5cc0b16d0 0x7fd5cc0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5cb59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5cb59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0b2080 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5cb59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0cfb00 con 0x7fd5cc0b16d0 2023-10-09T12:56:24.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5cb59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0b5c40 con 0x7fd5cc15d240 2023-10-09T12:56:24.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5ca59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5cc0b4e70 0x7fd5cc0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5ca59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5cc0b4e70 0x7fd5cc0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34956/0 (socket says 172.21.15.86:34956) 2023-10-09T12:56:24.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5ca59c700 1 -- 172.21.15.86:0/342361568 learned_addr learned my addr 172.21.15.86:0/342361568 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:24.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5c9d9b700 1 --2- 172.21.15.86:0/342361568 >> v2:172.21.15.135:3300/0 conn(0x7fd5cc0b16d0 0x7fd5cc0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.582+0000 7fd5cad9d700 1 --2- 172.21.15.86:0/342361568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5ca59c700 1 -- 172.21.15.86:0/342361568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 msgr2=0x7fd5cc15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:24.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5ca59c700 1 --2- 172.21.15.86:0/342361568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc15d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5ca59c700 1 -- 172.21.15.86:0/342361568 >> v2:172.21.15.135:3300/0 conn(0x7fd5cc0b16d0 msgr2=0x7fd5cc0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5ca59c700 1 --2- 172.21.15.86:0/342361568 >> v2:172.21.15.135:3300/0 conn(0x7fd5cc0b16d0 0x7fd5cc0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5ca59c700 1 -- 172.21.15.86:0/342361568 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0b5f20 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5ca59c700 1 --2- 172.21.15.86:0/342361568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc0ccff0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc089830 tx=0x7fd5bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902e6bd1ee9a0024 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5c959a700 1 -- 172.21.15.86:0/342361568 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00b640 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5c959a700 1 -- 172.21.15.86:0/342361568 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00b7a0 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.583+0000 7fd5c959a700 1 -- 172.21.15.86:0/342361568 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00bb60 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 -- 172.21.15.86:0/342361568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 msgr2=0x7fd5cc0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/342361568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc0ccff0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc089830 tx=0x7fd5bc009250 comp rx=0 tx=0).stop 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 -- 172.21.15.86:0/342361568 shutdown_connections 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/342361568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/342361568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc0ccff0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/342361568 >> v2:172.21.15.135:3300/0 conn(0x7fd5cc0b16d0 0x7fd5cc0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 -- 172.21.15.86:0/342361568 >> 172.21.15.86:0/342361568 conn(0x7fd5cc0d10c0 msgr2=0x7fd5cc0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:24.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 -- 172.21.15.86:0/342361568 shutdown_connections 2023-10-09T12:56:24.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.584+0000 7fd5cb59e700 1 -- 172.21.15.86:0/342361568 wait complete. 2023-10-09T12:56:24.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.586+0000 7fd5cb59e700 1 Processor -- start 2023-10-09T12:56:24.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.586+0000 7fd5cb59e700 1 -- start start 2023-10-09T12:56:24.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.586+0000 7fd5cb59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5cc0b16d0 0x7fd5cc0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5cb59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5cb59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5cb59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c7f20 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5cb59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c7b60 con 0x7fd5cc0b16d0 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5cb59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c6940 con 0x7fd5cc15d240 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34960/0 (socket says 172.21.15.86:34960) 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 -- 172.21.15.86:0/729679635 learned_addr learned my addr 172.21.15.86:0/729679635 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5ca59c700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5cc0b16d0 0x7fd5cc0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5cad9d700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 -- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 msgr2=0x7fd5cc0c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc0c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 -- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5cc0b16d0 msgr2=0x7fd5cc0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5cc0b16d0 0x7fd5cc0c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 -- 172.21.15.86:0/729679635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0094f0 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.587+0000 7fd5c9d9b700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc145eb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000e960 tx=0x7fd5c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:24.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.588+0000 7fd5ba7fc700 1 -- 172.21.15.86:0/729679635 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0013680 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.588+0000 7fd5ba7fc700 1 -- 172.21.15.86:0/729679635 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c00137e0 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.588+0000 7fd5ba7fc700 1 -- 172.21.15.86:0/729679635 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0013b80 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.588+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc0c6c20 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.588+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc0c71e0 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.589+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc088990 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.590+0000 7fd5ba7fc700 1 -- 172.21.15.86:0/729679635 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fd5c00123d0 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.591+0000 7fd5ba7fc700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 0x7fd5ac069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.591+0000 7fd5ba7fc700 1 -- 172.21.15.86:0/729679635 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fd5c0084b90 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.591+0000 7fd5ca59c700 1 -- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 msgr2=0x7fd5ac069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:24.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.591+0000 7fd5ca59c700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 0x7fd5ac069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:24.595 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:24.594+0000 7fe12ec6f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:56:24.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.598+0000 7fd5ba7fc700 1 -- 172.21.15.86:0/729679635 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5c0051900 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.603 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:24.602+0000 7f596ff9e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:24.700 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:24.700+0000 7fe12ec6f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:24.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.792+0000 7fd5ca59c700 1 -- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 msgr2=0x7fd5ac069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:24.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.792+0000 7fd5ca59c700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 0x7fd5ac069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.794+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5cc04bb80 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.795+0000 7fd5ba7fc700 1 -- 172.21.15.86:0/729679635 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v151) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5c0054f20 con 0x7fd5cc0b4e70 2023-10-09T12:56:24.796 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T12:56:24.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 msgr2=0x7fd5ac069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:24.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 0x7fd5ac069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 msgr2=0x7fd5cc145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:24.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc145eb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000e960 tx=0x7fd5c00091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 shutdown_connections 2023-10-09T12:56:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5cc15d240 0x7fd5cc0c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5cc0b16d0 0x7fd5cc0c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd5ac067050 0x7fd5ac069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 --2- 172.21.15.86:0/729679635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5cc0b4e70 0x7fd5cc145eb0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 >> 172.21.15.86:0/729679635 conn(0x7fd5cc0d10c0 msgr2=0x7fd5cc068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 shutdown_connections 2023-10-09T12:56:24.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:24.797+0000 7fd5cb59e700 1 -- 172.21.15.86:0/729679635 wait complete. 2023-10-09T12:56:24.816 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:56:25.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.045+0000 7f689a99d700 1 Processor -- start 2023-10-09T12:56:25.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.046+0000 7f689a99d700 1 -- start start 2023-10-09T12:56:25.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689a99d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6894159420 0x7f68940b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689a99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68940b2980 con 0x7f689415d230 2023-10-09T12:56:25.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689a99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68940b11d0 con 0x7f68941597f0 2023-10-09T12:56:25.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689a99d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940b14b0 con 0x7f6894159420 2023-10-09T12:56:25.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689999b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6894159420 0x7f68940b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689999b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6894159420 0x7f68940b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43596/0 (socket says 172.21.15.86:43596) 2023-10-09T12:56:25.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689999b700 1 -- 172.21.15.86:0/2895394741 learned_addr learned my addr 172.21.15.86:0/2895394741 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:25.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.047+0000 7f689a19c700 1 --1- 172.21.15.86:0/2895394741 >> v1:172.21.15.86:6789/0 conn(0x7f689415d230 0x7f689415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60910/0 (socket says 172.21.15.86:60910) 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f689999b700 1 -- 172.21.15.86:0/2895394741 >> v1:172.21.15.135:6789/0 conn(0x7f68941597f0 legacy=0x7f68940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f689999b700 1 -- 172.21.15.86:0/2895394741 >> v1:172.21.15.86:6789/0 conn(0x7f689415d230 legacy=0x7f689415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f689999b700 1 -- 172.21.15.86:0/2895394741 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940b1790 con 0x7f6894159420 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f6898999700 1 -- 172.21.15.86:0/2895394741 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132461266 0 0) 0x7f68940b2980 con 0x7f689415d230 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f689999b700 1 --2- 172.21.15.86:0/2895394741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f68940b5f40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f68900099b0 tx=0x7f6890009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1917324d9f72cff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f6898999700 1 -- 172.21.15.86:0/2895394741 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000b860 con 0x7f6894159420 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f6898999700 1 -- 172.21.15.86:0/2895394741 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000b9c0 con 0x7f6894159420 2023-10-09T12:56:25.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.048+0000 7f6898999700 1 -- 172.21.15.86:0/2895394741 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000bd60 con 0x7f6894159420 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.049+0000 7f689a99d700 1 -- 172.21.15.86:0/2895394741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 msgr2=0x7f68940b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.049+0000 7f689a99d700 1 --2- 172.21.15.86:0/2895394741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f68940b5f40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f68900099b0 tx=0x7f6890009250 comp rx=0 tx=0).stop 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.049+0000 7f689a99d700 1 -- 172.21.15.86:0/2895394741 shutdown_connections 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.049+0000 7f689a99d700 1 --2- 172.21.15.86:0/2895394741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f68940b5f40 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.049+0000 7f689a99d700 1 -- 172.21.15.86:0/2895394741 >> 172.21.15.86:0/2895394741 conn(0x7f68940d0660 msgr2=0x7f68940d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.049+0000 7f689a99d700 1 -- 172.21.15.86:0/2895394741 shutdown_connections 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.049+0000 7f689a99d700 1 -- 172.21.15.86:0/2895394741 wait complete. 2023-10-09T12:56:25.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.050+0000 7f689a99d700 1 Processor -- start 2023-10-09T12:56:25.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.051+0000 7f689a99d700 1 -- start start 2023-10-09T12:56:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.051+0000 7f689a99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f6894144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.051+0000 7f689a99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68941597f0 0x7f68940c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689a99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689415d230 0x7f6894069010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689a99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894144ca0 con 0x7f6894159420 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689a99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68941442d0 con 0x7f689415d230 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689a99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68941436c0 con 0x7f68941597f0 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f6894144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f6894144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43598/0 (socket says 172.21.15.86:43598) 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 -- 172.21.15.86:0/3910632052 learned_addr learned my addr 172.21.15.86:0/3910632052 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689a19c700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689415d230 0x7f6894069010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689919a700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68941597f0 0x7f68940c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 -- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68941597f0 msgr2=0x7f68940c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68941597f0 0x7f68940c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 -- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689415d230 msgr2=0x7f6894069010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689415d230 0x7f6894069010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 -- 172.21.15.86:0/3910632052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900094f0 con 0x7f6894159420 2023-10-09T12:56:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689a19c700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689415d230 0x7f6894069010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.052+0000 7f689999b700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f6894144760 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f6890006f50 tx=0x7f6890017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.053+0000 7f6889ffb700 1 -- 172.21.15.86:0/3910632052 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689001f070 con 0x7f6894159420 2023-10-09T12:56:25.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.053+0000 7f6889ffb700 1 -- 172.21.15.86:0/3910632052 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6890011d10 con 0x7f6894159420 2023-10-09T12:56:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.053+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68941439a0 con 0x7f6894159420 2023-10-09T12:56:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.053+0000 7f6889ffb700 1 -- 172.21.15.86:0/3910632052 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890025650 con 0x7f6894159420 2023-10-09T12:56:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.053+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6894143f60 con 0x7f6894159420 2023-10-09T12:56:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.054+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689404c3c0 con 0x7f6894159420 2023-10-09T12:56:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.055+0000 7f6889ffb700 1 -- 172.21.15.86:0/3910632052 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6890023070 con 0x7f6894159420 2023-10-09T12:56:25.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.055+0000 7f6889ffb700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 0x7f6878069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.056+0000 7f6889ffb700 1 -- 172.21.15.86:0/3910632052 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f68900861e0 con 0x7f6894159420 2023-10-09T12:56:25.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.056+0000 7f689919a700 1 -- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 msgr2=0x7f6878069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:25.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.056+0000 7f689919a700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 0x7f6878069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:25.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.060+0000 7f6889ffb700 1 -- 172.21.15.86:0/3910632052 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6890052f90 con 0x7f6894159420 2023-10-09T12:56:25.088 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:25.087+0000 7f596ff9e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:56:25.183 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:25.182+0000 7f596ff9e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:56:25.201 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:25.201+0000 7fe12ec6f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:56:25.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.257+0000 7f689919a700 1 -- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 msgr2=0x7f6878069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:25.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.257+0000 7f689919a700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 0x7f6878069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:25.278 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:25.277+0000 7f596ff9e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:56:25.297 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:25.297+0000 7fe12ec6f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:56:25.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.300+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68940b1a70 con 0x7f6894159420 2023-10-09T12:56:25.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.300+0000 7f6889ffb700 1 -- 172.21.15.86:0/3910632052 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6890056570 con 0x7f6894159420 2023-10-09T12:56:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:25.302 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4273963470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4273963470},{"type":"v1","addr":"172.21.15.135:6834","nonce":4273963470}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1830713158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1830713158},{"type":"v1","addr":"172.21.15.135:6835","nonce":1830713158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/51772873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":51772873},{"type":"v1","addr":"172.21.15.86:6833","nonce":51772873}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:00:27.831701+0000","modified":"2023-10-09T12:00:31.403803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2423117806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2423117806},{"type":"v1","addr":"172.21.15.86:6835","nonce":2423117806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T12:56:25.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 msgr2=0x7f6878069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:25.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 0x7f6878069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 msgr2=0x7f6894144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f6894144760 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f6890006f50 tx=0x7f6890017000 comp rx=0 tx=0).stop 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 shutdown_connections 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6878067050 0x7f6878069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894159420 0x7f6894144760 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689415d230 0x7f6894069010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 --2- 172.21.15.86:0/3910632052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68941597f0 0x7f68940c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 >> 172.21.15.86:0/3910632052 conn(0x7f68940d0660 msgr2=0x7f6894155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 shutdown_connections 2023-10-09T12:56:25.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.303+0000 7f689a99d700 1 -- 172.21.15.86:0/3910632052 wait complete. 2023-10-09T12:56:25.306 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 63 2023-10-09T12:56:25.322 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:56:25.399 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:25.398+0000 7fe12ec6f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:56:25.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.510+0000 7f573dd9d700 1 Processor -- start 2023-10-09T12:56:25.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.510+0000 7f573dd9d700 1 -- start start 2023-10-09T12:56:25.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.511+0000 7f573dd9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5738159420 0x7f57380b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573dd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573dd9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380b2980 con 0x7f57381597f0 2023-10-09T12:56:25.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573dd9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573815dbb0 con 0x7f5738159420 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573dd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57380b11d0 con 0x7f573815d230 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573cd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5738159420 0x7f57380b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573cd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5738159420 0x7f57380b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43604/0 (socket says 172.21.15.86:43604) 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573cd9b700 1 -- 172.21.15.86:0/478524983 learned_addr learned my addr 172.21.15.86:0/478524983 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573d59c700 1 --2- 172.21.15.86:0/478524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573cd9b700 1 -- 172.21.15.86:0/478524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 msgr2=0x7f573815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573cd9b700 1 --2- 172.21.15.86:0/478524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573cd9b700 1 -- 172.21.15.86:0/478524983 >> v1:172.21.15.135:6789/0 conn(0x7f57381597f0 legacy=0x7f57380b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573cd9b700 1 -- 172.21.15.86:0/478524983 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380b14b0 con 0x7f5738159420 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.512+0000 7f573d59c700 1 --2- 172.21.15.86:0/478524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:25.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.513+0000 7f573cd9b700 1 --2- 172.21.15.86:0/478524983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5738159420 0x7f57380b5f40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f572c0099b0 tx=0x7f572c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc91180a414227be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:25.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.513+0000 7f57377fe700 1 -- 172.21.15.86:0/478524983 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00b860 con 0x7f5738159420 2023-10-09T12:56:25.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.513+0000 7f57377fe700 1 -- 172.21.15.86:0/478524983 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00b9c0 con 0x7f5738159420 2023-10-09T12:56:25.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.513+0000 7f57377fe700 1 -- 172.21.15.86:0/478524983 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00bd60 con 0x7f5738159420 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.513+0000 7f573dd9d700 1 -- 172.21.15.86:0/478524983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5738159420 msgr2=0x7f57380b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.513+0000 7f573dd9d700 1 --2- 172.21.15.86:0/478524983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5738159420 0x7f57380b5f40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f572c0099b0 tx=0x7f572c009250 comp rx=0 tx=0).stop 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.514+0000 7f573dd9d700 1 -- 172.21.15.86:0/478524983 shutdown_connections 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.514+0000 7f573dd9d700 1 --2- 172.21.15.86:0/478524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.514+0000 7f573dd9d700 1 --2- 172.21.15.86:0/478524983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5738159420 0x7f57380b5f40 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.514+0000 7f573dd9d700 1 -- 172.21.15.86:0/478524983 >> 172.21.15.86:0/478524983 conn(0x7f57380d0660 msgr2=0x7f57380d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.514+0000 7f573dd9d700 1 -- 172.21.15.86:0/478524983 shutdown_connections 2023-10-09T12:56:25.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.514+0000 7f573dd9d700 1 -- 172.21.15.86:0/478524983 wait complete. 2023-10-09T12:56:25.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.515+0000 7f573dd9d700 1 Processor -- start 2023-10-09T12:56:25.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.515+0000 7f573dd9d700 1 -- start start 2023-10-09T12:56:25.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573dd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738159420 0x7f573815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573dd9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57381597f0 0x7f573815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573dd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573816cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573dd9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573815c0c0 con 0x7f57381597f0 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573dd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573815b4b0 con 0x7f5738159420 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573dd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573815b790 con 0x7f573815d230 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f5737fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57381597f0 0x7f573815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f5737fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57381597f0 0x7f573815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43614/0 (socket says 172.21.15.86:43614) 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f5737fff700 1 -- 172.21.15.86:0/2534162108 learned_addr learned my addr 172.21.15.86:0/2534162108 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573d59c700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573816cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.516+0000 7f573cd9b700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738159420 0x7f573815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5737fff700 1 -- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 msgr2=0x7f573816cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5737fff700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573816cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5737fff700 1 -- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738159420 msgr2=0x7f573815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5737fff700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738159420 0x7f573815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5737fff700 1 -- 172.21.15.86:0/2534162108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0094f0 con 0x7f57381597f0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5737fff700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57381597f0 0x7f573815aa60 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f572400c7c0 tx=0x7f5724007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5734ff9700 1 -- 172.21.15.86:0/2534162108 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724011590 con 0x7f57381597f0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5734ff9700 1 -- 172.21.15.86:0/2534162108 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57240116f0 con 0x7f57381597f0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573815ba70 con 0x7f57381597f0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f5734ff9700 1 -- 172.21.15.86:0/2534162108 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724011ab0 con 0x7f57381597f0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.517+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57380c5f60 con 0x7f57381597f0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.518+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573815c270 con 0x7f57381597f0 2023-10-09T12:56:25.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.519+0000 7f5734ff9700 1 -- 172.21.15.86:0/2534162108 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f572401b3b0 con 0x7f57381597f0 2023-10-09T12:56:25.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.520+0000 7f5734ff9700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 0x7f571c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.520+0000 7f5734ff9700 1 -- 172.21.15.86:0/2534162108 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f5724083e70 con 0x7f57381597f0 2023-10-09T12:56:25.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.520+0000 7f573cd9b700 1 -- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 msgr2=0x7f571c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:25.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.520+0000 7f573cd9b700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 0x7f571c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:25.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.524+0000 7f5734ff9700 1 -- 172.21.15.86:0/2534162108 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f573815c270 con 0x7f57381597f0 2023-10-09T12:56:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.720+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f573804c3c0 con 0x7f57381597f0 2023-10-09T12:56:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.721+0000 7f573cd9b700 1 -- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 msgr2=0x7f571c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:25.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.721+0000 7f573cd9b700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 0x7f571c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:25.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.721+0000 7f5734ff9700 1 -- 172.21.15.86:0/2534162108 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f5724017070 con 0x7f57381597f0 2023-10-09T12:56:25.722 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:25.723 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":151,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:56:23.157000+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:00:25.489470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T12:00:26.820007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":151,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T12:00:43.540321+0000","172.21.15.86:6836/85490":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/3103181679":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/2262430303":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/1847574361":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/4006031168":"2023-10-10T12:00:43.540321+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":3,"length":17},{"begin":59,"length":17}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:56:25.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 msgr2=0x7f571c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 0x7f571c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57381597f0 msgr2=0x7f573815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57381597f0 0x7f573815aa60 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f572400c7c0 tx=0x7f5724007f50 comp rx=0 tx=0).stop 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 shutdown_connections 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f573815d230 0x7f573816cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738159420 0x7f573815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f571c067050 0x7f571c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 --2- 172.21.15.86:0/2534162108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57381597f0 0x7f573815aa60 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 >> 172.21.15.86:0/2534162108 conn(0x7f57380d0660 msgr2=0x7f57381560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 shutdown_connections 2023-10-09T12:56:25.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.723+0000 7f573dd9d700 1 -- 172.21.15.86:0/2534162108 wait complete. 2023-10-09T12:56:25.743 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T12:56:25.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:56:25.902 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:25.901+0000 7f596ff9e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:56:25.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.941+0000 7fcade79d700 1 Processor -- start 2023-10-09T12:56:25.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.942+0000 7fcade79d700 1 -- start start 2023-10-09T12:56:25.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.944+0000 7fcade79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.944+0000 7fcade79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcad8087830 0x7fcad8170040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.944+0000 7fcade79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8069cd0 con 0x7fcad8166530 2023-10-09T12:56:25.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.944+0000 7fcade79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad80c76d0 con 0x7fcad8087830 2023-10-09T12:56:25.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.944+0000 7fcade79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8166900 con 0x7fcad80c7260 2023-10-09T12:56:25.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.945+0000 7fcaddf9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcad8087830 0x7fcad8170040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.945+0000 7fcadd79b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcad8166530 0x7fcad80caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60926/0 (socket says 172.21.15.86:60926) 2023-10-09T12:56:25.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.945+0000 7fcadd79b700 1 -- 172.21.15.86:0/2704651117 learned_addr learned my addr 172.21.15.86:0/2704651117 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:25.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.945+0000 7fcadcf9a700 1 --2- 172.21.15.86:0/2704651117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.945+0000 7fcad7fff700 1 -- 172.21.15.86:0/2704651117 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448261162 0 0) 0x7fcad8069cd0 con 0x7fcad8166530 2023-10-09T12:56:25.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.945+0000 7fcad7fff700 1 -- 172.21.15.86:0/2704651117 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac0003570 con 0x7fcad8166530 2023-10-09T12:56:25.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.946+0000 7fcaddf9c700 1 -- 172.21.15.86:0/2704651117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 msgr2=0x7fcad80872f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:25.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.946+0000 7fcaddf9c700 1 --2- 172.21.15.86:0/2704651117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80872f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.946+0000 7fcaddf9c700 1 -- 172.21.15.86:0/2704651117 >> v1:172.21.15.86:6789/0 conn(0x7fcad8166530 legacy=0x7fcad80caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.946+0000 7fcaddf9c700 1 -- 172.21.15.86:0/2704651117 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8087c70 con 0x7fcad8087830 2023-10-09T12:56:25.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.946+0000 7fcaddf9c700 1 --2- 172.21.15.86:0/2704651117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8087830 0x7fcad8170040 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0098e0 tx=0x7fcacc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25991d66384e5b59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:25.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.946+0000 7fcad7fff700 1 -- 172.21.15.86:0/2704651117 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00b640 con 0x7fcad8087830 2023-10-09T12:56:25.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.947+0000 7fcad7fff700 1 -- 172.21.15.86:0/2704651117 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00b7a0 con 0x7fcad8087830 2023-10-09T12:56:25.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.947+0000 7fcad7fff700 1 -- 172.21.15.86:0/2704651117 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00bb60 con 0x7fcad8087830 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.947+0000 7fcade79d700 1 -- 172.21.15.86:0/2704651117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8087830 msgr2=0x7fcad8170040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.947+0000 7fcade79d700 1 --2- 172.21.15.86:0/2704651117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8087830 0x7fcad8170040 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0098e0 tx=0x7fcacc0091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.948+0000 7fcade79d700 1 -- 172.21.15.86:0/2704651117 shutdown_connections 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.948+0000 7fcade79d700 1 --2- 172.21.15.86:0/2704651117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8087830 0x7fcad8170040 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.948+0000 7fcade79d700 1 --2- 172.21.15.86:0/2704651117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80872f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.948+0000 7fcade79d700 1 -- 172.21.15.86:0/2704651117 >> 172.21.15.86:0/2704651117 conn(0x7fcad80cc1f0 msgr2=0x7fcad80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.948+0000 7fcade79d700 1 -- 172.21.15.86:0/2704651117 shutdown_connections 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.948+0000 7fcade79d700 1 -- 172.21.15.86:0/2704651117 wait complete. 2023-10-09T12:56:25.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.951+0000 7fcade79d700 1 Processor -- start 2023-10-09T12:56:25.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.951+0000 7fcade79d700 1 -- start start 2023-10-09T12:56:25.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.952+0000 7fcade79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad8087830 0x7fcad80aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.952+0000 7fcade79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.952+0000 7fcade79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8166530 0x7fcad815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.952+0000 7fcade79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80ad090 con 0x7fcad8166530 2023-10-09T12:56:25.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.952+0000 7fcade79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80c4ba0 con 0x7fcad8087830 2023-10-09T12:56:25.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.952+0000 7fcade79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80ad2e0 con 0x7fcad80c7260 2023-10-09T12:56:25.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad8087830 0x7fcad80aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad8087830 0x7fcad80aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:46530/0 (socket says 172.21.15.86:46530) 2023-10-09T12:56:25.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 -- 172.21.15.86:0/755617203 learned_addr learned my addr 172.21.15.86:0/755617203 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:25.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcaddf9c700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8166530 0x7fcad815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadcf9a700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:25.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 -- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 msgr2=0x7fcad80c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 -- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8166530 msgr2=0x7fcad815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8166530 0x7fcad815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcadd79b700 1 -- 172.21.15.86:0/755617203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc009420 con 0x7fcad8087830 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.953+0000 7fcaddf9c700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8166530 0x7fcad815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.954+0000 7fcadd79b700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad8087830 0x7fcad80aef90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c590 tx=0x7fcad0007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.954+0000 7fcad57fa700 1 -- 172.21.15.86:0/755617203 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0005cd0 con 0x7fcad8087830 2023-10-09T12:56:25.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.954+0000 7fcad57fa700 1 -- 172.21.15.86:0/755617203 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0005e50 con 0x7fcad8087830 2023-10-09T12:56:25.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.955+0000 7fcad57fa700 1 -- 172.21.15.86:0/755617203 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0007320 con 0x7fcad8087830 2023-10-09T12:56:25.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.955+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad80ad5c0 con 0x7fcad8087830 2023-10-09T12:56:25.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.955+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad80af4d0 con 0x7fcad8087830 2023-10-09T12:56:25.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.956+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad804c3c0 con 0x7fcad8087830 2023-10-09T12:56:25.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.958+0000 7fcad57fa700 1 -- 172.21.15.86:0/755617203 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fcad001b3b0 con 0x7fcad8087830 2023-10-09T12:56:25.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.959+0000 7fcad57fa700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 0x7fcac4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:25.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.960+0000 7fcad57fa700 1 -- 172.21.15.86:0/755617203 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7fcad0084040 con 0x7fcad8087830 2023-10-09T12:56:25.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.960+0000 7fcadcf9a700 1 -- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 msgr2=0x7fcac4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:25.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.960+0000 7fcadcf9a700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 0x7fcac4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:25.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:25.968+0000 7fcad57fa700 1 -- 172.21.15.86:0/755617203 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcad0050e50 con 0x7fcad8087830 2023-10-09T12:56:26.041 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:26.040+0000 7fe12ec6f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:56:26.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:26.079+0000 7f596ff9e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:26.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.161+0000 7fcadcf9a700 1 -- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 msgr2=0x7fcac4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:26.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.161+0000 7fcadcf9a700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 0x7fcac4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:26.176 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:26.175+0000 7f596ff9e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:56:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.213+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcad80ada60 con 0x7fcad8087830 2023-10-09T12:56:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.214+0000 7fcad57fa700 1 -- 172.21.15.86:0/755617203 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fcad0017020 con 0x7fcad8087830 2023-10-09T12:56:26.215 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:26.215 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4273963470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4273963470},{"type":"v1","addr":"172.21.15.135:6834","nonce":4273963470}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1830713158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1830713158},{"type":"v1","addr":"172.21.15.135:6835","nonce":1830713158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/51772873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":51772873},{"type":"v1","addr":"172.21.15.86:6833","nonce":51772873}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:00:27.831701+0000","modified":"2023-10-09T12:00:31.403803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2423117806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2423117806},{"type":"v1","addr":"172.21.15.86:6835","nonce":2423117806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T12:56:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.216+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 msgr2=0x7fcac4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.216+0000 7fcade79d700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 0x7fcac4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad8087830 msgr2=0x7fcad80aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad8087830 0x7fcad80aef90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c590 tx=0x7fcad0007e00 comp rx=0 tx=0).stop 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 shutdown_connections 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcac4067050 0x7fcac4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad8166530 0x7fcad815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcad8087830 0x7fcad80aef90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 --2- 172.21.15.86:0/755617203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcad80c7260 0x7fcad80c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 >> 172.21.15.86:0/755617203 conn(0x7fcad80cc1f0 msgr2=0x7fcad8069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 shutdown_connections 2023-10-09T12:56:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fcade79d700 1 -- 172.21.15.86:0/755617203 wait complete. 2023-10-09T12:56:26.220 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:26.217+0000 7fe12ec6f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 63 2023-10-09T12:56:26.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:56:26.319 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:26.318+0000 7fe12ec6f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:56:26.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.422+0000 7f775eb9d700 1 Processor -- start 2023-10-09T12:56:26.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.422+0000 7f775eb9d700 1 -- start start 2023-10-09T12:56:26.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775eb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7758159420 0x7f77580b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775eb9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f77581597f0 0x7f77580b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775eb9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77580b11d0 con 0x7f775815d230 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775eb9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77580b14b0 con 0x7f77581597f0 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775eb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77580b1790 con 0x7f7758159420 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775d39a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f77581597f0 0x7f77580b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775d39a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f77581597f0 0x7f77580b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43646/0 (socket says 172.21.15.86:43646) 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775d39a700 1 -- 172.21.15.86:0/3473067651 learned_addr learned my addr 172.21.15.86:0/3473067651 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.423+0000 7f775db9b700 1 --2- 172.21.15.86:0/3473067651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7758159420 0x7f77580b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775d39a700 1 -- 172.21.15.86:0/3473067651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7758159420 msgr2=0x7f77580b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775d39a700 1 --2- 172.21.15.86:0/3473067651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7758159420 0x7f77580b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775d39a700 1 -- 172.21.15.86:0/3473067651 >> v1:172.21.15.135:6789/0 conn(0x7f775815d230 legacy=0x7f77580b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775cb99700 1 -- 172.21.15.86:0/3473067651 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678934033 0 0) 0x7f77580b11d0 con 0x7f775815d230 2023-10-09T12:56:26.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775d39a700 1 -- 172.21.15.86:0/3473067651 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580b1a70 con 0x7f77581597f0 2023-10-09T12:56:26.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775d39a700 1 --2- 172.21.15.86:0/3473067651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77581597f0 0x7f77580b2270 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f77480099b0 tx=0x7f7748009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a1f7b1f095786b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:26.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775cb99700 1 -- 172.21.15.86:0/3473067651 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7748009ea0 con 0x7f77581597f0 2023-10-09T12:56:26.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775cb99700 1 -- 172.21.15.86:0/3473067651 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800b860 con 0x7f77581597f0 2023-10-09T12:56:26.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.424+0000 7f775cb99700 1 -- 172.21.15.86:0/3473067651 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800bc00 con 0x7f77581597f0 2023-10-09T12:56:26.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 -- 172.21.15.86:0/3473067651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77581597f0 msgr2=0x7f77580b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 --2- 172.21.15.86:0/3473067651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77581597f0 0x7f77580b2270 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f77480099b0 tx=0x7f7748009250 comp rx=0 tx=0).stop 2023-10-09T12:56:26.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 -- 172.21.15.86:0/3473067651 shutdown_connections 2023-10-09T12:56:26.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 --2- 172.21.15.86:0/3473067651 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7758159420 0x7f77580b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 --2- 172.21.15.86:0/3473067651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77581597f0 0x7f77580b2270 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 -- 172.21.15.86:0/3473067651 >> 172.21.15.86:0/3473067651 conn(0x7f77580d0660 msgr2=0x7f77580d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:26.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 -- 172.21.15.86:0/3473067651 shutdown_connections 2023-10-09T12:56:26.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.425+0000 7f775eb9d700 1 -- 172.21.15.86:0/3473067651 wait complete. 2023-10-09T12:56:26.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.427+0000 7f775eb9d700 1 Processor -- start 2023-10-09T12:56:26.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.427+0000 7f775eb9d700 1 -- start start 2023-10-09T12:56:26.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775eb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7758159420 0x7f775815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775eb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77581597f0 0x7f775816ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775eb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f775815d230 0x7f775816b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775eb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775816b5b0 con 0x7f7758159420 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775eb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77581548c0 con 0x7f775815d230 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775eb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775815b960 con 0x7f77581597f0 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775db9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7758159420 0x7f775815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775db9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7758159420 0x7f775815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43654/0 (socket says 172.21.15.86:43654) 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775db9b700 1 -- 172.21.15.86:0/798302028 learned_addr learned my addr 172.21.15.86:0/798302028 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775d39a700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77581597f0 0x7f775816ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.428+0000 7f775e39c700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f775815d230 0x7f775816b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f775db9b700 1 -- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77581597f0 msgr2=0x7f775816ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f775db9b700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77581597f0 0x7f775816ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f775db9b700 1 -- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f775815d230 msgr2=0x7f775816b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f775db9b700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f775815d230 0x7f775816b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f775db9b700 1 -- 172.21.15.86:0/798302028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77480094f0 con 0x7f7758159420 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f775db9b700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7758159420 0x7f775815bdf0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f775400ec80 tx=0x7f77540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f774dffb700 1 -- 172.21.15.86:0/798302028 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775400c850 con 0x7f7758159420 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f774dffb700 1 -- 172.21.15.86:0/798302028 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775400c9b0 con 0x7f7758159420 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f774dffb700 1 -- 172.21.15.86:0/798302028 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775400cd50 con 0x7f7758159420 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.429+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775815ad50 con 0x7f7758159420 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.430+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775815b310 con 0x7f7758159420 2023-10-09T12:56:26.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.430+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775804c3c0 con 0x7f7758159420 2023-10-09T12:56:26.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.432+0000 7f774dffb700 1 -- 172.21.15.86:0/798302028 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f7754013680 con 0x7f7758159420 2023-10-09T12:56:26.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.432+0000 7f774dffb700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 0x7f773c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.433+0000 7f774dffb700 1 -- 172.21.15.86:0/798302028 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f7754084cd0 con 0x7f7758159420 2023-10-09T12:56:26.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.433+0000 7f775d39a700 1 -- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 msgr2=0x7f773c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:26.434 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.433+0000 7f775d39a700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 0x7f773c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:26.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.439+0000 7f774dffb700 1 -- 172.21.15.86:0/798302028 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7754051a40 con 0x7f7758159420 2023-10-09T12:56:26.475 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:26.474+0000 7f596ff9e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:56:26.571 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:26.569+0000 7f596ff9e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:56:26.622 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:26.621+0000 7fe12ec6f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:56:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.634+0000 7f775d39a700 1 -- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 msgr2=0x7f773c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.634+0000 7f775d39a700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 0x7f773c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:26.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.679+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77580b1d50 con 0x7f7758159420 2023-10-09T12:56:26.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.680+0000 7f774dffb700 1 -- 172.21.15.86:0/798302028 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f7754055060 con 0x7f7758159420 2023-10-09T12:56:26.681 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:26.681 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4273963470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4273963470},{"type":"v1","addr":"172.21.15.135:6834","nonce":4273963470}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1830713158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1830713158},{"type":"v1","addr":"172.21.15.135:6835","nonce":1830713158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/51772873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":51772873},{"type":"v1","addr":"172.21.15.86:6833","nonce":51772873}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:00:27.831701+0000","modified":"2023-10-09T12:00:31.403803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2423117806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2423117806},{"type":"v1","addr":"172.21.15.86:6835","nonce":2423117806}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T12:56:26.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 msgr2=0x7f773c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:26.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 0x7f773c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7758159420 msgr2=0x7f775815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7758159420 0x7f775815bdf0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f775400ec80 tx=0x7f77540091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 shutdown_connections 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f773c067050 0x7f773c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7758159420 0x7f775815bdf0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f775815d230 0x7f775816b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 --2- 172.21.15.86:0/798302028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77581597f0 0x7f775816ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 >> 172.21.15.86:0/798302028 conn(0x7f77580d0660 msgr2=0x7f77580b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 shutdown_connections 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.683+0000 7f775eb9d700 1 -- 172.21.15.86:0/798302028 wait complete. 2023-10-09T12:56:26.685 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 63 2023-10-09T12:56:26.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:56:26.722 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:26.721+0000 7fe12ec6f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:56:26.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.885+0000 7f2757fff700 1 Processor -- start 2023-10-09T12:56:26.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.886+0000 7f2757fff700 1 -- start start 2023-10-09T12:56:26.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.887+0000 7f2757fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2758159420 0x7f27580b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.887+0000 7f2757fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580b2980 con 0x7f275815d230 2023-10-09T12:56:26.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.887+0000 7f2757fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580b11d0 con 0x7f27581597f0 2023-10-09T12:56:26.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.887+0000 7f2757fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580b14b0 con 0x7f2758159420 2023-10-09T12:56:26.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.887+0000 7f27577fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f275815d230 0x7f275815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60928/0 (socket says 172.21.15.86:60928) 2023-10-09T12:56:26.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.887+0000 7f27577fe700 1 -- 172.21.15.86:0/1306874377 learned_addr learned my addr 172.21.15.86:0/1306874377 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:26.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.887+0000 7f2756ffd700 1 --2- 172.21.15.86:0/1306874377 >> v2:172.21.15.135:3300/0 conn(0x7f2758159420 0x7f27580b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2755ffb700 1 -- 172.21.15.86:0/1306874377 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405619112 0 0) 0x7f27580b2980 con 0x7f275815d230 2023-10-09T12:56:26.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2755ffb700 1 -- 172.21.15.86:0/1306874377 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2740003570 con 0x7f275815d230 2023-10-09T12:56:26.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2756ffd700 1 -- 172.21.15.86:0/1306874377 >> v1:172.21.15.135:6789/0 conn(0x7f27581597f0 legacy=0x7f27580b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2756ffd700 1 -- 172.21.15.86:0/1306874377 >> v1:172.21.15.86:6789/0 conn(0x7f275815d230 legacy=0x7f275815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2756ffd700 1 -- 172.21.15.86:0/1306874377 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580b1790 con 0x7f2758159420 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2756ffd700 1 --2- 172.21.15.86:0/1306874377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f27580b5f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27480098e0 tx=0x7f27480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=112fe7f57b8c00bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2755ffb700 1 -- 172.21.15.86:0/1306874377 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800b640 con 0x7f2758159420 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2755ffb700 1 -- 172.21.15.86:0/1306874377 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800b7a0 con 0x7f2758159420 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.888+0000 7f2755ffb700 1 -- 172.21.15.86:0/1306874377 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800bb40 con 0x7f2758159420 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.889+0000 7f2757fff700 1 -- 172.21.15.86:0/1306874377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 msgr2=0x7f27580b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.889+0000 7f2757fff700 1 --2- 172.21.15.86:0/1306874377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f27580b5f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27480098e0 tx=0x7f27480091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.889+0000 7f2757fff700 1 -- 172.21.15.86:0/1306874377 shutdown_connections 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.889+0000 7f2757fff700 1 --2- 172.21.15.86:0/1306874377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f27580b5f40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.889+0000 7f2757fff700 1 -- 172.21.15.86:0/1306874377 >> 172.21.15.86:0/1306874377 conn(0x7f27580d0660 msgr2=0x7f27580d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.889+0000 7f2757fff700 1 -- 172.21.15.86:0/1306874377 shutdown_connections 2023-10-09T12:56:26.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.889+0000 7f2757fff700 1 -- 172.21.15.86:0/1306874377 wait complete. 2023-10-09T12:56:26.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.891+0000 7f2757fff700 1 Processor -- start 2023-10-09T12:56:26.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.891+0000 7f2757fff700 1 -- start start 2023-10-09T12:56:26.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2757fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f2758169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2757fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27581597f0 0x7f27580cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2757fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f275815d230 0x7f27580b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2757fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275815bb00 con 0x7f275815d230 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2757fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275816db70 con 0x7f2758159420 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2757fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275815b1d0 con 0x7f27581597f0 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f2758169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f27577fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f275815d230 0x7f27580b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f2758169680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:46564/0 (socket says 172.21.15.86:46564) 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 -- 172.21.15.86:0/2411718233 learned_addr learned my addr 172.21.15.86:0/2411718233 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:26.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f27567fc700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27581597f0 0x7f27580cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:26.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 -- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27581597f0 msgr2=0x7f27580cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27581597f0 0x7f27580cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 -- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f275815d230 msgr2=0x7f27580b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:26.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f275815d230 0x7f27580b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:26.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f2756ffd700 1 -- 172.21.15.86:0/2411718233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009420 con 0x7f2758159420 2023-10-09T12:56:26.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.892+0000 7f27577fe700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f275815d230 0x7f27580b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:26.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.893+0000 7f2756ffd700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f2758169680 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2758089340 tx=0x7f2748017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:26.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.893+0000 7f273effd700 1 -- 172.21.15.86:0/2411718233 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748000d10 con 0x7f2758159420 2023-10-09T12:56:26.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.893+0000 7f273effd700 1 -- 172.21.15.86:0/2411718233 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800bb20 con 0x7f2758159420 2023-10-09T12:56:26.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.893+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275815b4b0 con 0x7f2758159420 2023-10-09T12:56:26.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.893+0000 7f273effd700 1 -- 172.21.15.86:0/2411718233 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011670 con 0x7f2758159420 2023-10-09T12:56:26.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.893+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2758169bc0 con 0x7f2758159420 2023-10-09T12:56:26.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.894+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804c3c0 con 0x7f2758159420 2023-10-09T12:56:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.895+0000 7f273effd700 1 -- 172.21.15.86:0/2411718233 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f27480119e0 con 0x7f2758159420 2023-10-09T12:56:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.896+0000 7f273effd700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 0x7f2744069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.896+0000 7f273effd700 1 -- 172.21.15.86:0/2411718233 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f27480860c0 con 0x7f2758159420 2023-10-09T12:56:26.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.896+0000 7f27567fc700 1 -- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 msgr2=0x7f2744069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:26.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.896+0000 7f27567fc700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 0x7f2744069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:26.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:26.900+0000 7f273effd700 1 -- 172.21.15.86:0/2411718233 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2748052e30 con 0x7f2758159420 2023-10-09T12:56:27.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.097+0000 7f27567fc700 1 -- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 msgr2=0x7f2744069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:27.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.097+0000 7f27567fc700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 0x7f2744069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:27.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.101+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27580b1a70 con 0x7f2758159420 2023-10-09T12:56:27.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.102+0000 7f273effd700 1 -- 172.21.15.86:0/2411718233 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f2748056450 con 0x7f2758159420 2023-10-09T12:56:27.103 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:27.103 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":151,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:56:23.157000+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:00:25.489470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T12:00:26.820007+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":151,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":5}]},{"pgid":"17.26","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T12:00:43.540321+0000","172.21.15.86:6836/85490":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/3103181679":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/2262430303":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/1847574361":"2023-10-10T12:00:43.540321+0000","172.21.15.86:0/4006031168":"2023-10-10T12:00:43.540321+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":3,"length":17},{"begin":59,"length":17}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.104+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 msgr2=0x7f2744069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.104+0000 7f2757fff700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 0x7f2744069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.104+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 msgr2=0x7f2758169680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.104+0000 7f2757fff700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f2758169680 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2758089340 tx=0x7f2748017000 comp rx=0 tx=0).stop 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.104+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 shutdown_connections 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.105+0000 7f2757fff700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2744067050 0x7f2744069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.105+0000 7f2757fff700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f275815d230 0x7f27580b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.105+0000 7f2757fff700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2758159420 0x7f2758169680 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.105+0000 7f2757fff700 1 --2- 172.21.15.86:0/2411718233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27581597f0 0x7f27580cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.105+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 >> 172.21.15.86:0/2411718233 conn(0x7f27580d0660 msgr2=0x7f2758069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:27.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.105+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 shutdown_connections 2023-10-09T12:56:27.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.105+0000 7f2757fff700 1 -- 172.21.15.86:0/2411718233 wait complete. 2023-10-09T12:56:27.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T12:56:27.283 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:27.282+0000 7f596ff9e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:56:27.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.354+0000 7f34e899d700 1 Processor -- start 2023-10-09T12:56:27.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.354+0000 7f34e899d700 1 -- start start 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.355+0000 7f34e899d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34e41595a0 0x7f34e40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.355+0000 7f34e899d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f34e40c8830 0x7f34e4159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e899d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40b1410 con 0x7f34e40c6c60 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e899d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e40b2b90 con 0x7f34e41595a0 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e899d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e4063230 con 0x7f34e40c8830 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34e41595a0 0x7f34e40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34e41595a0 0x7f34e40b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43674/0 (socket says 172.21.15.86:43674) 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e37fe700 1 -- 172.21.15.86:0/3033724641 learned_addr learned my addr 172.21.15.86:0/3033724641 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e3fff700 1 --2- 172.21.15.86:0/3033724641 >> v2:172.21.15.135:3300/0 conn(0x7f34e40c8830 0x7f34e4159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e37fe700 1 -- 172.21.15.86:0/3033724641 >> v2:172.21.15.135:3300/0 conn(0x7f34e40c8830 msgr2=0x7f34e4159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e37fe700 1 --2- 172.21.15.86:0/3033724641 >> v2:172.21.15.135:3300/0 conn(0x7f34e40c8830 0x7f34e4159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e37fe700 1 -- 172.21.15.86:0/3033724641 >> v1:172.21.15.135:6789/0 conn(0x7f34e40c6c60 legacy=0x7f34e40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e37fe700 1 -- 172.21.15.86:0/3033724641 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40634f0 con 0x7f34e41595a0 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.356+0000 7f34e3fff700 1 --2- 172.21.15.86:0/3033724641 >> v2:172.21.15.135:3300/0 conn(0x7f34e40c8830 0x7f34e4159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e37fe700 1 --2- 172.21.15.86:0/3033724641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e41595a0 0x7f34e40b18a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f34e415d390 tx=0x7f34d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d506ecf21f43bef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e27fc700 1 -- 172.21.15.86:0/3033724641 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400b860 con 0x7f34e41595a0 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e27fc700 1 -- 172.21.15.86:0/3033724641 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400b9c0 con 0x7f34e41595a0 2023-10-09T12:56:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e27fc700 1 -- 172.21.15.86:0/3033724641 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400bd60 con 0x7f34e41595a0 2023-10-09T12:56:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e899d700 1 -- 172.21.15.86:0/3033724641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e41595a0 msgr2=0x7f34e40b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e899d700 1 --2- 172.21.15.86:0/3033724641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e41595a0 0x7f34e40b18a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f34e415d390 tx=0x7f34d4009250 comp rx=0 tx=0).stop 2023-10-09T12:56:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e899d700 1 -- 172.21.15.86:0/3033724641 shutdown_connections 2023-10-09T12:56:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e899d700 1 --2- 172.21.15.86:0/3033724641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e41595a0 0x7f34e40b18a0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e899d700 1 --2- 172.21.15.86:0/3033724641 >> v2:172.21.15.135:3300/0 conn(0x7f34e40c8830 0x7f34e4159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.357+0000 7f34e899d700 1 -- 172.21.15.86:0/3033724641 >> 172.21.15.86:0/3033724641 conn(0x7f34e406ddb0 msgr2=0x7f34e406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:27.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.358+0000 7f34e899d700 1 -- 172.21.15.86:0/3033724641 shutdown_connections 2023-10-09T12:56:27.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.358+0000 7f34e899d700 1 -- 172.21.15.86:0/3033724641 wait complete. 2023-10-09T12:56:27.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.359+0000 7f34e899d700 1 Processor -- start 2023-10-09T12:56:27.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.359+0000 7f34e899d700 1 -- start start 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e899d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e40c6c60 0x7f34e414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e899d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e40c8830 0x7f34e40c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e899d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e41595a0 0x7f34e40c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e899d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4159b10 con 0x7f34e40c6c60 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e899d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4159df0 con 0x7f34e40c8830 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e899d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e415a0d0 con 0x7f34e41595a0 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e40c6c60 0x7f34e414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e40c6c60 0x7f34e414a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43684/0 (socket says 172.21.15.86:43684) 2023-10-09T12:56:27.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.360+0000 7f34e37fe700 1 -- 172.21.15.86:0/3702543899 learned_addr learned my addr 172.21.15.86:0/3702543899 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e2ffd700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e40c8830 0x7f34e40c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e3fff700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e41595a0 0x7f34e40c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e37fe700 1 -- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e41595a0 msgr2=0x7f34e40c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e37fe700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e41595a0 0x7f34e40c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e37fe700 1 -- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e40c8830 msgr2=0x7f34e40c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e37fe700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e40c8830 0x7f34e40c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e37fe700 1 -- 172.21.15.86:0/3702543899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40094f0 con 0x7f34e40c6c60 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e37fe700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e40c6c60 0x7f34e414a540 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009290 tx=0x7f34d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34cb7fe700 1 -- 172.21.15.86:0/3702543899 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4026480 con 0x7f34e40c6c60 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34cb7fe700 1 -- 172.21.15.86:0/3702543899 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d401f070 con 0x7f34e40c6c60 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34cb7fe700 1 -- 172.21.15.86:0/3702543899 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4026850 con 0x7f34e40c6c60 2023-10-09T12:56:27.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.361+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e415a3b0 con 0x7f34e40c6c60 2023-10-09T12:56:27.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.362+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e414ac40 con 0x7f34e40c6c60 2023-10-09T12:56:27.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.363+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e40b2750 con 0x7f34e40c6c60 2023-10-09T12:56:27.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.364+0000 7f34cb7fe700 1 -- 172.21.15.86:0/3702543899 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f34d401a430 con 0x7f34e40c6c60 2023-10-09T12:56:27.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.364+0000 7f34cb7fe700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 0x7f34d0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.365+0000 7f34e2ffd700 1 -- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 msgr2=0x7f34d0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:27.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.365+0000 7f34cb7fe700 1 -- 172.21.15.86:0/3702543899 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6557+0+0 (secure 0 0 0) 0x7f34d4021070 con 0x7f34e40c6c60 2023-10-09T12:56:27.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.365+0000 7f34e2ffd700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 0x7f34d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:27.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.372+0000 7f34cb7fe700 1 -- 172.21.15.86:0/3702543899 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34d4053480 con 0x7f34e40c6c60 2023-10-09T12:56:27.466 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:27.465+0000 7fe12ec6f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:56:27.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.566+0000 7f34e2ffd700 1 -- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 msgr2=0x7f34d0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:27.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.566+0000 7f34e2ffd700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 0x7f34d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:27.570 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:27.569+0000 7f596ff9e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:56:27.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.616+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f34e414ac40 con 0x7f34e40c6c60 2023-10-09T12:56:27.618 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T12:56:27.617+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T12:56:27.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.623+0000 7f34cb7fe700 1 -- 172.21.15.86:0/3702543899 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7f34e414ac40 con 0x7f34e40c6c60 2023-10-09T12:56:27.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 msgr2=0x7f34d0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:27.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 0x7f34d0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e40c6c60 msgr2=0x7f34e414a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e40c6c60 0x7f34e414a540 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009290 tx=0x7f34d4017000 comp rx=0 tx=0).stop 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 shutdown_connections 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f34d0067050 0x7f34d0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e40c6c60 0x7f34e414a540 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e41595a0 0x7f34e40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 --2- 172.21.15.86:0/3702543899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e40c8830 0x7f34e40c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 >> 172.21.15.86:0/3702543899 conn(0x7f34e406ddb0 msgr2=0x7f34e415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 shutdown_connections 2023-10-09T12:56:27.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.626+0000 7f34e899d700 1 -- 172.21.15.86:0/3702543899 wait complete. 2023-10-09T12:56:27.629 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T12:56:27.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T12:56:27.665 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:27.664+0000 7f596ff9e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:56:27.683 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T12:56:27.767 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:27.766+0000 7fe12ec6f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:56:27.820 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:27.819+0000 7f596ff9e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:56:27.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.835+0000 7fd8f5fff700 1 Processor -- start 2023-10-09T12:56:27.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.835+0000 7fd8f5fff700 1 -- start start 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8f5fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006bcd0 0x7fd8f00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8f5fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8f006c0a0 0x7fd8f015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8f5fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd8f015df50 0x7fd8f015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8f5fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f015d7e0 con 0x7fd8f006c0a0 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8f5fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f015dac0 con 0x7fd8f015df50 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8f5fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015aa30 con 0x7fd8f006bcd0 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8eeffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8f006c0a0 0x7fd8f015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8eeffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8f006c0a0 0x7fd8f015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43716/0 (socket says 172.21.15.86:43716) 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8eeffd700 1 -- 172.21.15.86:0/3143025341 learned_addr learned my addr 172.21.15.86:0/3143025341 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:27.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8effff700 1 --2- 172.21.15.86:0/3143025341 >> v2:172.21.15.135:3300/0 conn(0x7fd8f015df50 0x7fd8f015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.836+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/3143025341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006bcd0 0x7fd8f00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ef7fe700 1 -- 172.21.15.86:0/3143025341 >> v2:172.21.15.135:3300/0 conn(0x7fd8f015df50 msgr2=0x7fd8f015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/3143025341 >> v2:172.21.15.135:3300/0 conn(0x7fd8f015df50 0x7fd8f015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ef7fe700 1 -- 172.21.15.86:0/3143025341 >> v2:172.21.15.86:3300/0 conn(0x7fd8f006c0a0 msgr2=0x7fd8f015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/3143025341 >> v2:172.21.15.86:3300/0 conn(0x7fd8f006c0a0 0x7fd8f015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ef7fe700 1 -- 172.21.15.86:0/3143025341 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f015ad10 con 0x7fd8f006bcd0 2023-10-09T12:56:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/3143025341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006bcd0 0x7fd8f00caa90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8f006b620 tx=0x7fd8e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76c29bec6a0cd9ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ee7fc700 1 -- 172.21.15.86:0/3143025341 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0011630 con 0x7fd8f006bcd0 2023-10-09T12:56:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ee7fc700 1 -- 172.21.15.86:0/3143025341 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e00117b0 con 0x7fd8f006bcd0 2023-10-09T12:56:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.837+0000 7fd8ee7fc700 1 -- 172.21.15.86:0/3143025341 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0011b70 con 0x7fd8f006bcd0 2023-10-09T12:56:27.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 -- 172.21.15.86:0/3143025341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006bcd0 msgr2=0x7fd8f00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/3143025341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006bcd0 0x7fd8f00caa90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8f006b620 tx=0x7fd8e00091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 -- 172.21.15.86:0/3143025341 shutdown_connections 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/3143025341 >> v2:172.21.15.135:3300/0 conn(0x7fd8f015df50 0x7fd8f015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/3143025341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006bcd0 0x7fd8f00caa90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/3143025341 >> v2:172.21.15.86:3300/0 conn(0x7fd8f006c0a0 0x7fd8f015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 -- 172.21.15.86:0/3143025341 >> 172.21.15.86:0/3143025341 conn(0x7fd8f00ce600 msgr2=0x7fd8f00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 -- 172.21.15.86:0/3143025341 shutdown_connections 2023-10-09T12:56:27.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.838+0000 7fd8f5fff700 1 -- 172.21.15.86:0/3143025341 wait complete. 2023-10-09T12:56:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.840+0000 7fd8f5fff700 1 Processor -- start 2023-10-09T12:56:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.840+0000 7fd8f5fff700 1 -- start start 2023-10-09T12:56:27.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8f5fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8f006bcd0 0x7fd8f00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8f5fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006c0a0 0x7fd8f0142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8f5fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8f015df50 0x7fd8f01571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8f5fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00c8e40 con 0x7fd8f015df50 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8f5fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00c8230 con 0x7fd8f006bcd0 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8f5fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00c8510 con 0x7fd8f006c0a0 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8f015df50 0x7fd8f01571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8f015df50 0x7fd8f01571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43722/0 (socket says 172.21.15.86:43722) 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 -- 172.21.15.86:0/2976831766 learned_addr learned my addr 172.21.15.86:0/2976831766 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8eeffd700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006c0a0 0x7fd8f0142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8f006bcd0 0x7fd8f00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 -- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006c0a0 msgr2=0x7fd8f0142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006c0a0 0x7fd8f0142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 -- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8f006bcd0 msgr2=0x7fd8f00c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8f006bcd0 0x7fd8f00c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8effff700 1 -- 172.21.15.86:0/2976831766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0009420 con 0x7fd8f015df50 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.841+0000 7fd8eeffd700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006c0a0 0x7fd8f0142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.842+0000 7fd8effff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8f015df50 0x7fd8f01571e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009e90 tx=0x7fd8e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.842+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800cb70 con 0x7fd8f015df50 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.842+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e800f040 con 0x7fd8f015df50 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.842+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8014480 con 0x7fd8f015df50 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.842+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f00c87f0 con 0x7fd8f015df50 2023-10-09T12:56:27.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.842+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f00c9810 con 0x7fd8f015df50 2023-10-09T12:56:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.843+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f004c3c0 con 0x7fd8f015df50 2023-10-09T12:56:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.844+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 71) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fd8e8014830 con 0x7fd8f015df50 2023-10-09T12:56:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.845+0000 7fd8d77fe700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 0x7fd8dc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:27.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.845+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6555+0+0 (secure 0 0 0) 0x7fd8e8085580 con 0x7fd8f015df50 2023-10-09T12:56:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.845+0000 7fd8ef7fe700 1 -- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 msgr2=0x7fd8dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:27.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.845+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 0x7fd8dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:27.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:27.849+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8e80521e0 con 0x7fd8f015df50 2023-10-09T12:56:27.866 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:27.865+0000 7fe12ec6f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:56:27.927 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:27.926+0000 7f596ff9e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:56:28.025 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:28.024+0000 7fe12ec6f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:56:28.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.046+0000 7fd8ef7fe700 1 -- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 msgr2=0x7fd8dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:28.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.046+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 0x7fd8dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:28.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.092+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8f00c8f80 con 0x7fd8f015df50 2023-10-09T12:56:28.117 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:28.116+0000 7f596ff9e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:56:28.134 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:28.133+0000 7fe12ec6f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:56:28.215 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:28.214+0000 7f596ff9e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:56:28.308 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:28.307+0000 7f596ff9e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:56:28.328 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:28.327+0000 7fe12ec6f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:56:28.403 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:28.402+0000 7f596ff9e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:56:28.421 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:28.421+0000 7fe12ec6f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:56:28.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.447+0000 7fd8ef7fe700 1 -- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 msgr2=0x7fd8dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:28.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.447+0000 7fd8ef7fe700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 0x7fd8dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T12:56:28.514 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:28.514+0000 7fe12ec6f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:56:28.612 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:28.611+0000 7fe12ec6f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:56:28.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.621+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 72) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fd8e805b0f0 con 0x7fd8f015df50 2023-10-09T12:56:28.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.621+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 msgr2=0x7fd8dc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:28.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.621+0000 7fd8d77fe700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 0x7fd8dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.630+0000 7fd8d77fe700 1 -- 172.21.15.86:0/2976831766 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd8e8070120 con 0x7fd8f015df50 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8f015df50 msgr2=0x7fd8f01571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8f015df50 0x7fd8f01571e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009e90 tx=0x7fd8e800b040 comp rx=0 tx=0).stop 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 shutdown_connections 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd8dc067050 0x7fd8dc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8f015df50 0x7fd8f01571e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8f006bcd0 0x7fd8f00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 --2- 172.21.15.86:0/2976831766 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8f006c0a0 0x7fd8f0142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 >> 172.21.15.86:0/2976831766 conn(0x7fd8f00ce600 msgr2=0x7fd8f01551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 shutdown_connections 2023-10-09T12:56:28.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.634+0000 7fd8f5fff700 1 -- 172.21.15.86:0/2976831766 wait complete. 2023-10-09T12:56:28.655 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T12:56:28.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:56:28.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:56:28.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.884+0000 7f4f6259d700 1 Processor -- start 2023-10-09T12:56:28.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.884+0000 7f4f6259d700 1 -- start start 2023-10-09T12:56:28.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.885+0000 7f4f6259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0cca20 0x7f4f5c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:28.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.885+0000 7f4f6259d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0cfa00 con 0x7f4f5c0b0790 2023-10-09T12:56:28.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.885+0000 7f4f6259d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0cb580 con 0x7f4f5c0b03c0 2023-10-09T12:56:28.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.885+0000 7f4f6259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0cf160 con 0x7f4f5c0cca20 2023-10-09T12:56:28.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f60d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4f5c0b0790 0x7f4f5c1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60940/0 (socket says 172.21.15.86:60940) 2023-10-09T12:56:28.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f60d9a700 1 -- 172.21.15.86:0/4024395145 learned_addr learned my addr 172.21.15.86:0/4024395145 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:28.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f61d9c700 1 --2- 172.21.15.86:0/4024395145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0cca20 0x7f4f5c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f53fff700 1 -- 172.21.15.86:0/4024395145 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267789542 0 0) 0x7f4f5c0cfa00 con 0x7f4f5c0b0790 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f53fff700 1 -- 172.21.15.86:0/4024395145 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f48003570 con 0x7f4f5c0b0790 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f53fff700 1 -- 172.21.15.86:0/4024395145 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344475569 0 0) 0x7f4f5c0cb580 con 0x7f4f5c0b03c0 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f61d9c700 1 -- 172.21.15.86:0/4024395145 >> v1:172.21.15.135:6789/0 conn(0x7f4f5c0b03c0 legacy=0x7f4f5c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f61d9c700 1 -- 172.21.15.86:0/4024395145 >> v1:172.21.15.86:6789/0 conn(0x7f4f5c0b0790 legacy=0x7f4f5c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.886+0000 7f4f61d9c700 1 -- 172.21.15.86:0/4024395145 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0cf440 con 0x7f4f5c0cca20 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.887+0000 7f4f61d9c700 1 --2- 172.21.15.86:0/4024395145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0cca20 0x7f4f5c0cea70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009ec0 tx=0x7f4f54009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef341473cb890d08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.887+0000 7f4f53fff700 1 -- 172.21.15.86:0/4024395145 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400e070 con 0x7f4f5c0cca20 2023-10-09T12:56:28.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.887+0000 7f4f53fff700 1 -- 172.21.15.86:0/4024395145 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5400bbf0 con 0x7f4f5c0cca20 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.887+0000 7f4f53fff700 1 -- 172.21.15.86:0/4024395145 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54012430 con 0x7f4f5c0cca20 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.888+0000 7f4f6259d700 1 -- 172.21.15.86:0/4024395145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0cca20 msgr2=0x7f4f5c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.888+0000 7f4f6259d700 1 --2- 172.21.15.86:0/4024395145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0cca20 0x7f4f5c0cea70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009ec0 tx=0x7f4f54009780 comp rx=0 tx=0).stop 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.888+0000 7f4f6259d700 1 -- 172.21.15.86:0/4024395145 shutdown_connections 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.888+0000 7f4f6259d700 1 --2- 172.21.15.86:0/4024395145 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0cca20 0x7f4f5c0cea70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.888+0000 7f4f6259d700 1 -- 172.21.15.86:0/4024395145 >> 172.21.15.86:0/4024395145 conn(0x7f4f5c063230 msgr2=0x7f4f5c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.888+0000 7f4f6259d700 1 -- 172.21.15.86:0/4024395145 shutdown_connections 2023-10-09T12:56:28.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.888+0000 7f4f6259d700 1 -- 172.21.15.86:0/4024395145 wait complete. 2023-10-09T12:56:28.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.889+0000 7f4f6259d700 1 Processor -- start 2023-10-09T12:56:28.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.889+0000 7f4f6259d700 1 -- start start 2023-10-09T12:56:28.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.890+0000 7f4f6259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0b03c0 0x7f4f5c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:28.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.890+0000 7f4f6259d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c0b0790 0x7f4f5c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:28.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.890+0000 7f4f6259d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c0cca20 0x7f4f5c0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.890+0000 7f4f6259d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c6490 con 0x7f4f5c0cca20 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.890+0000 7f4f6259d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c7b80 con 0x7f4f5c0b0790 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.890+0000 7f4f6259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c7e60 con 0x7f4f5c0b03c0 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c0cca20 0x7f4f5c0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f6159b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0b03c0 0x7f4f5c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c0cca20 0x7f4f5c0cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43842/0 (socket says 172.21.15.86:43842) 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 -- 172.21.15.86:0/1860137289 learned_addr learned my addr 172.21.15.86:0/1860137289 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f60d9a700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c0b0790 0x7f4f5c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 -- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0b03c0 msgr2=0x7f4f5c0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0b03c0 0x7f4f5c0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 -- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c0b0790 msgr2=0x7f4f5c0c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c0b0790 0x7f4f5c0c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 -- 172.21.15.86:0/1860137289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54009a20 con 0x7f4f5c0cca20 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f60d9a700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c0b0790 0x7f4f5c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f61d9c700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c0cca20 0x7f4f5c0cba10 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b6c0 tx=0x7f4f54019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.891+0000 7f4f517fa700 1 -- 172.21.15.86:0/1860137289 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540032f0 con 0x7f4f5c0cca20 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.892+0000 7f4f517fa700 1 -- 172.21.15.86:0/1860137289 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5401b420 con 0x7f4f5c0cca20 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.892+0000 7f4f517fa700 1 -- 172.21.15.86:0/1860137289 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5401b7c0 con 0x7f4f5c0cca20 2023-10-09T12:56:28.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.892+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c0c8140 con 0x7f4f5c0cca20 2023-10-09T12:56:28.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.892+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c16a4b0 con 0x7f4f5c0cca20 2023-10-09T12:56:28.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.893+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c16a6a0 con 0x7f4f5c0cca20 2023-10-09T12:56:28.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.893+0000 7f4f517fa700 1 -- 172.21.15.86:0/1860137289 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 72) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f4f5401bbb0 con 0x7f4f5c0cca20 2023-10-09T12:56:28.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.894+0000 7f4f517fa700 1 -- 172.21.15.86:0/1860137289 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f54085ff0 con 0x7f4f5c0cca20 2023-10-09T12:56:28.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:28.899+0000 7f4f517fa700 1 -- 172.21.15.86:0/1860137289 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f540b75a0 con 0x7f4f5c0cca20 2023-10-09T12:56:29.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.093+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4f5c04c3c0 con 0x7f4f5c0cca20 2023-10-09T12:56:29.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.634+0000 7f4f517fa700 1 -- 172.21.15.86:0/1860137289 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v154) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4f54053100 con 0x7f4f5c0cca20 2023-10-09T12:56:29.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.639+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c0cca20 msgr2=0x7f4f5c0cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:29.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.639+0000 7f4f6259d700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c0cca20 0x7f4f5c0cba10 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b6c0 tx=0x7f4f54019000 comp rx=0 tx=0).stop 2023-10-09T12:56:29.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.639+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 shutdown_connections 2023-10-09T12:56:29.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.639+0000 7f4f6259d700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c0cca20 0x7f4f5c0cba10 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.639+0000 7f4f6259d700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0b03c0 0x7f4f5c0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.639+0000 7f4f6259d700 1 --2- 172.21.15.86:0/1860137289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c0b0790 0x7f4f5c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.639+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 >> 172.21.15.86:0/1860137289 conn(0x7f4f5c063230 msgr2=0x7f4f5c15afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:29.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.640+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 shutdown_connections 2023-10-09T12:56:29.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.640+0000 7f4f6259d700 1 -- 172.21.15.86:0/1860137289 wait complete. 2023-10-09T12:56:29.643 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T12:56:29.668 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T12:56:29.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.854+0000 7f4ab1dff700 1 Processor -- start 2023-10-09T12:56:29.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.854+0000 7f4ab1dff700 1 -- start start 2023-10-09T12:56:29.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.855+0000 7f4ab1dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac0c6890 0x7f4aac06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:29.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.855+0000 7f4ab1dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4aac156480 0x7f4aac06e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:29.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.855+0000 7f4ab1dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aac0c79a0 con 0x7f4aac1560b0 2023-10-09T12:56:29.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4ab1dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0acc60 con 0x7f4aac156480 2023-10-09T12:56:29.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4ab1dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0c6d90 con 0x7f4aac0c6890 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aaaffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac0c6890 0x7f4aac06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aabfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4aac156480 0x7f4aac06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aabfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4aac156480 0x7f4aac06e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:46730/0 (socket says 172.21.15.86:46730) 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aabfff700 1 -- 172.21.15.86:0/2445465916 learned_addr learned my addr 172.21.15.86:0/2445465916 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aab7fe700 1 --1- 172.21.15.86:0/2445465916 >> v1:172.21.15.135:6789/0 conn(0x7f4aac1560b0 0x7f4aac0ac550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:36678/0 (socket says 172.21.15.86:36678) 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aabfff700 1 -- 172.21.15.86:0/2445465916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac0c6890 msgr2=0x7f4aac06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aabfff700 1 --2- 172.21.15.86:0/2445465916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac0c6890 0x7f4aac06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.856+0000 7f4aabfff700 1 -- 172.21.15.86:0/2445465916 >> v1:172.21.15.135:6789/0 conn(0x7f4aac1560b0 legacy=0x7f4aac0ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:29.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.857+0000 7f4aabfff700 1 -- 172.21.15.86:0/2445465916 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0c7070 con 0x7f4aac156480 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.857+0000 7f4aaa7fc700 1 -- 172.21.15.86:0/2445465916 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339725125 0 0) 0x7f4aac0c79a0 con 0x7f4aac1560b0 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.857+0000 7f4aabfff700 1 --2- 172.21.15.86:0/2445465916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac156480 0x7f4aac06e380 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009f20 tx=0x7f4aa4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c674157e44910c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.857+0000 7f4aaa7fc700 1 -- 172.21.15.86:0/2445465916 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400e070 con 0x7f4aac156480 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.857+0000 7f4aaa7fc700 1 -- 172.21.15.86:0/2445465916 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400b9d0 con 0x7f4aac156480 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.857+0000 7f4aaa7fc700 1 -- 172.21.15.86:0/2445465916 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400bd90 con 0x7f4aac156480 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2445465916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac156480 msgr2=0x7f4aac06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2445465916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac156480 0x7f4aac06e380 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009f20 tx=0x7f4aa4009840 comp rx=0 tx=0).stop 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2445465916 shutdown_connections 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2445465916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac156480 0x7f4aac06e380 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2445465916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac0c6890 0x7f4aac06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2445465916 >> 172.21.15.86:0/2445465916 conn(0x7f4aac068390 msgr2=0x7f4aac068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:29.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2445465916 shutdown_connections 2023-10-09T12:56:29.861 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.858+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2445465916 wait complete. 2023-10-09T12:56:29.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.859+0000 7f4ab1dff700 1 Processor -- start 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.859+0000 7f4ab1dff700 1 -- start start 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.860+0000 7f4ab1dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4aac0c6890 0x7f4aac165b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.860+0000 7f4ab1dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac1560b0 0x7f4aac0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.860+0000 7f4ab1dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac156480 0x7f4aac0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.860+0000 7f4ab1dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0c4340 con 0x7f4aac0c6890 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.860+0000 7f4ab1dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0bfcd0 con 0x7f4aac1560b0 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.860+0000 7f4ab1dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0bff20 con 0x7f4aac156480 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.860+0000 7f4aab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4aac0c6890 0x7f4aac165b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4aac0c6890 0x7f4aac165b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43856/0 (socket says 172.21.15.86:43856) 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 -- 172.21.15.86:0/2907114700 learned_addr learned my addr 172.21.15.86:0/2907114700 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:29.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aabfff700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac156480 0x7f4aac0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aaaffd700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac1560b0 0x7f4aac0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 -- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac156480 msgr2=0x7f4aac0c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac156480 0x7f4aac0c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 -- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac1560b0 msgr2=0x7f4aac0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac1560b0 0x7f4aac0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 -- 172.21.15.86:0/2907114700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4009ae0 con 0x7f4aac0c6890 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4aab7fe700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4aac0c6890 0x7f4aac165b30 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00e960 tx=0x7f4a9c001300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.861+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c007cd0 con 0x7f4aac0c6890 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.862+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c007e30 con 0x7f4aac0c6890 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.862+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c009340 con 0x7f4aac0c6890 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.862+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac0c0200 con 0x7f4aac0c6890 2023-10-09T12:56:29.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.862+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac0c07c0 con 0x7f4aac0c6890 2023-10-09T12:56:29.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.863+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac04c3c0 con 0x7f4aac0c6890 2023-10-09T12:56:29.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.864+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 73) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f4a9c0096f0 con 0x7f4aac0c6890 2023-10-09T12:56:29.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.864+0000 7f4a937fe700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a98066d80 0x7f4a98069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:29.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.865+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f4a9c0860a0 con 0x7f4aac0c6890 2023-10-09T12:56:29.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.865+0000 7f4aaaffd700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a98066d80 0x7f4a98069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:29.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.865+0000 7f4aaaffd700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a98066d80 0x7f4a98069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0ca450 tx=0x7f4aa00091a0 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:29.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:29.869+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a9c0533a0 con 0x7f4aac0c6890 2023-10-09T12:56:30.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.069+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4aac0ac5f0 con 0x7f4aac0c6890 2023-10-09T12:56:30.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.654+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a9c053770 con 0x7f4aac0c6890 2023-10-09T12:56:30.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.655+0000 7f4a937fe700 1 -- 172.21.15.86:0/2907114700 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v155) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4a9c0533a0 con 0x7f4aac0c6890 2023-10-09T12:56:30.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a98066d80 msgr2=0x7f4a98069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:30.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a98066d80 0x7f4a98069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0ca450 tx=0x7f4aa00091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4aac0c6890 msgr2=0x7f4aac165b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4aac0c6890 0x7f4aac165b30 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00e960 tx=0x7f4a9c001300 comp rx=0 tx=0).stop 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 shutdown_connections 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a98066d80 0x7f4a98069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4aac0c6890 0x7f4aac165b30 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aac156480 0x7f4aac0c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 --2- 172.21.15.86:0/2907114700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac1560b0 0x7f4aac0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 >> 172.21.15.86:0/2907114700 conn(0x7f4aac068390 msgr2=0x7f4aac0c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 shutdown_connections 2023-10-09T12:56:30.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.659+0000 7f4ab1dff700 1 -- 172.21.15.86:0/2907114700 wait complete. 2023-10-09T12:56:30.662 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T12:56:30.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T12:56:30.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.863+0000 7f2006f9d700 1 Processor -- start 2023-10-09T12:56:30.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.863+0000 7f2006f9d700 1 -- start start 2023-10-09T12:56:30.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.864+0000 7f2006f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2000153900 0x7f20000c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:30.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.864+0000 7f2006f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f200006a710 0x7f200006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:30.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.864+0000 7f2006f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200006e150 con 0x7f20000c9db0 2023-10-09T12:56:30.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.864+0000 7f2006f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000c7800 con 0x7f2000153900 2023-10-09T12:56:30.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.864+0000 7f2006f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000c7ae0 con 0x7f200006a710 2023-10-09T12:56:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f200679c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f200006a710 0x7f200006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f2005f9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2000153900 0x7f20000c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f2005f9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2000153900 0x7f20000c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:46754/0 (socket says 172.21.15.86:46754) 2023-10-09T12:56:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f200679c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f200006a710 0x7f200006e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:51974/0 (socket says 172.21.15.86:51974) 2023-10-09T12:56:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f2005f9b700 1 -- 172.21.15.86:0/606365853 learned_addr learned my addr 172.21.15.86:0/606365853 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f200579a700 1 --1- 172.21.15.86:0/606365853 >> v1:172.21.15.135:6789/0 conn(0x7f20000c9db0 0x7f200006a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:36692/0 (socket says 172.21.15.86:36692) 2023-10-09T12:56:30.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f200679c700 1 -- 172.21.15.86:0/606365853 >> v2:172.21.15.135:3300/0 conn(0x7f2000153900 msgr2=0x7f20000c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f200679c700 1 --2- 172.21.15.86:0/606365853 >> v2:172.21.15.135:3300/0 conn(0x7f2000153900 0x7f20000c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f200679c700 1 -- 172.21.15.86:0/606365853 >> v1:172.21.15.135:6789/0 conn(0x7f20000c9db0 legacy=0x7f200006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f200679c700 1 -- 172.21.15.86:0/606365853 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000c7dc0 con 0x7f200006a710 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.865+0000 7f2005f9b700 1 --2- 172.21.15.86:0/606365853 >> v2:172.21.15.135:3300/0 conn(0x7f2000153900 0x7f20000c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.866+0000 7f200679c700 1 --2- 172.21.15.86:0/606365853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f200006a710 0x7f200006e5e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009e60 tx=0x7f1ff8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1baccfb3ee3d8412 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.866+0000 7f2004f99700 1 -- 172.21.15.86:0/606365853 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800e070 con 0x7f200006a710 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.866+0000 7f2004f99700 1 -- 172.21.15.86:0/606365853 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff800b950 con 0x7f200006a710 2023-10-09T12:56:30.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.866+0000 7f2004f99700 1 -- 172.21.15.86:0/606365853 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800bd10 con 0x7f200006a710 2023-10-09T12:56:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.866+0000 7f2006f9d700 1 -- 172.21.15.86:0/606365853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f200006a710 msgr2=0x7f200006e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.866+0000 7f2006f9d700 1 --2- 172.21.15.86:0/606365853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f200006a710 0x7f200006e5e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009e60 tx=0x7f1ff8009780 comp rx=0 tx=0).stop 2023-10-09T12:56:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.867+0000 7f2006f9d700 1 -- 172.21.15.86:0/606365853 shutdown_connections 2023-10-09T12:56:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.867+0000 7f2006f9d700 1 --2- 172.21.15.86:0/606365853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f200006a710 0x7f200006e5e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.867+0000 7f2006f9d700 1 --2- 172.21.15.86:0/606365853 >> v2:172.21.15.135:3300/0 conn(0x7f2000153900 0x7f20000c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.867+0000 7f2006f9d700 1 -- 172.21.15.86:0/606365853 >> 172.21.15.86:0/606365853 conn(0x7f20000cc1e0 msgr2=0x7f20000cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:30.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.867+0000 7f2006f9d700 1 -- 172.21.15.86:0/606365853 shutdown_connections 2023-10-09T12:56:30.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.867+0000 7f2006f9d700 1 -- 172.21.15.86:0/606365853 wait complete. 2023-10-09T12:56:30.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.868+0000 7f2006f9d700 1 Processor -- start 2023-10-09T12:56:30.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.868+0000 7f2006f9d700 1 -- start start 2023-10-09T12:56:30.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2006f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f200006a710 0x7f2000151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:30.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2006f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20000c9db0 0x7f20000b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2006f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2000153900 0x7f20001548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2006f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2000151760 con 0x7f200006a710 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2006f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2000169420 con 0x7f20000c9db0 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2006f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2000169700 con 0x7f2000153900 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2005f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f200006a710 0x7f2000151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2005f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f200006a710 0x7f2000151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43870/0 (socket says 172.21.15.86:43870) 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.869+0000 7f2005f9b700 1 -- 172.21.15.86:0/2079893398 learned_addr learned my addr 172.21.15.86:0/2079893398 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2005f9b700 1 -- 172.21.15.86:0/2079893398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2000153900 msgr2=0x7f20001548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2005f9b700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2000153900 0x7f20001548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2005f9b700 1 -- 172.21.15.86:0/2079893398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20000c9db0 msgr2=0x7f20000b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:30.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2005f9b700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20000c9db0 0x7f20000b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2005f9b700 1 -- 172.21.15.86:0/2079893398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0094f0 con 0x7f200006a710 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2005f9b700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f200006a710 0x7f2000151220 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00ec50 tx=0x7f1ffc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f1ff5ffb700 1 -- 172.21.15.86:0/2079893398 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00c9d0 con 0x7f200006a710 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f1ff5ffb700 1 -- 172.21.15.86:0/2079893398 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc00cb30 con 0x7f200006a710 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff8009a20 con 0x7f200006a710 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f1ff5ffb700 1 -- 172.21.15.86:0/2079893398 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc013470 con 0x7f200006a710 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.870+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2000169cc0 con 0x7f200006a710 2023-10-09T12:56:30.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.872+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20000af140 con 0x7f200006a710 2023-10-09T12:56:30.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.872+0000 7f1ff5ffb700 1 -- 172.21.15.86:0/2079893398 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ffc013860 con 0x7f200006a710 2023-10-09T12:56:30.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.873+0000 7f1ff5ffb700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1fe4066f30 0x7f1fe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:30.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.873+0000 7f1ff5ffb700 1 -- 172.21.15.86:0/2079893398 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7f1ffc084960 con 0x7f200006a710 2023-10-09T12:56:30.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.873+0000 7f200579a700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1fe4066f30 0x7f1fe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:30.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.874+0000 7f200579a700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1fe4066f30 0x7f1fe40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2000154850 tx=0x7f1ff0009d40 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:30.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:30.877+0000 7f1ff5ffb700 1 -- 172.21.15.86:0/2079893398 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ffc051b10 con 0x7f200006a710 2023-10-09T12:56:31.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.067+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f200006dd20 con 0x7f200006a710 2023-10-09T12:56:31.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.072+0000 7f1ff5ffb700 1 -- 172.21.15.86:0/2079893398 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v49) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1ffc055130 con 0x7f200006a710 2023-10-09T12:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1fe4066f30 msgr2=0x7f1fe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1fe4066f30 0x7f1fe40693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2000154850 tx=0x7f1ff0009d40 comp rx=0 tx=0).stop 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f200006a710 msgr2=0x7f2000151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f200006a710 0x7f2000151220 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00ec50 tx=0x7f1ffc009250 comp rx=0 tx=0).stop 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 shutdown_connections 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1fe4066f30 0x7f1fe40693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f200006a710 0x7f2000151220 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2000153900 0x7f20001548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 --2- 172.21.15.86:0/2079893398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20000c9db0 0x7f20000b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 >> 172.21.15.86:0/2079893398 conn(0x7f20000cc1e0 msgr2=0x7f2000158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 shutdown_connections 2023-10-09T12:56:31.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.074+0000 7f2006f9d700 1 -- 172.21.15.86:0/2079893398 wait complete. 2023-10-09T12:56:31.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T12:56:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.275+0000 7f4e059ff700 1 Processor -- start 2023-10-09T12:56:31.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.275+0000 7f4e059ff700 1 -- start start 2023-10-09T12:56:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.276+0000 7f4e059ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4e001568e0 0x7f4e001616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.276+0000 7f4e059ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0015b0d0 con 0x7f4e000ccee0 2023-10-09T12:56:31.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.276+0000 7f4e059ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0015a4c0 con 0x7f4e000c83f0 2023-10-09T12:56:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.276+0000 7f4e059ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0015a7a0 con 0x7f4e001568e0 2023-10-09T12:56:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.276+0000 7f4dfe7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4e000ccee0 0x7f4e001561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60952/0 (socket says 172.21.15.86:60952) 2023-10-09T12:56:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dfe7fc700 1 -- 172.21.15.86:0/350130743 learned_addr learned my addr 172.21.15.86:0/350130743 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dff7fe700 1 --2- 172.21.15.86:0/350130743 >> v2:172.21.15.135:3300/0 conn(0x7f4e001568e0 0x7f4e001616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dfdffb700 1 -- 172.21.15.86:0/350130743 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250740941 0 0) 0x7f4e0015b0d0 con 0x7f4e000ccee0 2023-10-09T12:56:31.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dfdffb700 1 -- 172.21.15.86:0/350130743 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de8003570 con 0x7f4e000ccee0 2023-10-09T12:56:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dff7fe700 1 -- 172.21.15.86:0/350130743 >> v1:172.21.15.135:6789/0 conn(0x7f4e000c83f0 legacy=0x7f4e000c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dff7fe700 1 -- 172.21.15.86:0/350130743 >> v1:172.21.15.86:6789/0 conn(0x7f4e000ccee0 legacy=0x7f4e001561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dfdffb700 1 -- 172.21.15.86:0/350130743 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1322987043 0 0) 0x7f4de8003570 con 0x7f4e000ccee0 2023-10-09T12:56:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.277+0000 7f4dff7fe700 1 -- 172.21.15.86:0/350130743 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0015aa80 con 0x7f4e001568e0 2023-10-09T12:56:31.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4dff7fe700 1 --2- 172.21.15.86:0/350130743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e001568e0 0x7f4e001616c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009e60 tx=0x7f4df8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b63434396458c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4dfdffb700 1 -- 172.21.15.86:0/350130743 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800e070 con 0x7f4e001568e0 2023-10-09T12:56:31.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4dfdffb700 1 -- 172.21.15.86:0/350130743 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800b850 con 0x7f4e001568e0 2023-10-09T12:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4dfdffb700 1 -- 172.21.15.86:0/350130743 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4001470 con 0x7f4e001568e0 2023-10-09T12:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4e059ff700 1 -- 172.21.15.86:0/350130743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e001568e0 msgr2=0x7f4e001616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4e059ff700 1 --2- 172.21.15.86:0/350130743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e001568e0 0x7f4e001616c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009e60 tx=0x7f4df8009780 comp rx=0 tx=0).stop 2023-10-09T12:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4e059ff700 1 -- 172.21.15.86:0/350130743 shutdown_connections 2023-10-09T12:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4e059ff700 1 --2- 172.21.15.86:0/350130743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e001568e0 0x7f4e001616c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4e059ff700 1 -- 172.21.15.86:0/350130743 >> 172.21.15.86:0/350130743 conn(0x7f4e00068e10 msgr2=0x7f4e000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4e059ff700 1 -- 172.21.15.86:0/350130743 shutdown_connections 2023-10-09T12:56:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.278+0000 7f4e059ff700 1 -- 172.21.15.86:0/350130743 wait complete. 2023-10-09T12:56:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.280+0000 7f4e059ff700 1 Processor -- start 2023-10-09T12:56:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.280+0000 7f4e059ff700 1 -- start start 2023-10-09T12:56:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4e059ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e000c83f0 0x7f4e000c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4e059ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000ccee0 0x7f4e00169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4e059ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e001568e0 0x7f4e00159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4e059ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0016a160 con 0x7f4e000c83f0 2023-10-09T12:56:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4e059ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0016a3b0 con 0x7f4e000ccee0 2023-10-09T12:56:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4e059ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0016a690 con 0x7f4e001568e0 2023-10-09T12:56:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e000c83f0 0x7f4e000c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e000c83f0 0x7f4e000c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43882/0 (socket says 172.21.15.86:43882) 2023-10-09T12:56:31.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 -- 172.21.15.86:0/2403669972 learned_addr learned my addr 172.21.15.86:0/2403669972 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dff7fe700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e001568e0 0x7f4e00159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfe7fc700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000ccee0 0x7f4e00169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 -- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e001568e0 msgr2=0x7f4e00159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e001568e0 0x7f4e00159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 -- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000ccee0 msgr2=0x7f4e00169880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000ccee0 0x7f4e00169880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.281+0000 7f4dfeffd700 1 -- 172.21.15.86:0/2403669972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009a20 con 0x7f4e000c83f0 2023-10-09T12:56:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.282+0000 7f4dfeffd700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e000c83f0 0x7f4e000c2f80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c790 tx=0x7f4df0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.282+0000 7f4de6ffd700 1 -- 172.21.15.86:0/2403669972 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0012630 con 0x7f4e000c83f0 2023-10-09T12:56:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.282+0000 7f4de6ffd700 1 -- 172.21.15.86:0/2403669972 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df00127b0 con 0x7f4e000c83f0 2023-10-09T12:56:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.282+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e00158fe0 con 0x7f4e000c83f0 2023-10-09T12:56:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.282+0000 7f4de6ffd700 1 -- 172.21.15.86:0/2403669972 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0012b70 con 0x7f4e000c83f0 2023-10-09T12:56:31.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.282+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e00159a40 con 0x7f4e000c83f0 2023-10-09T12:56:31.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.283+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e00158e00 con 0x7f4e000c83f0 2023-10-09T12:56:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.284+0000 7f4de6ffd700 1 -- 172.21.15.86:0/2403669972 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4df001b400 con 0x7f4e000c83f0 2023-10-09T12:56:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.285+0000 7f4de6ffd700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.285+0000 7f4de6ffd700 1 -- 172.21.15.86:0/2403669972 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7f4df0084170 con 0x7f4e000c83f0 2023-10-09T12:56:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.285+0000 7f4dfe7fc700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.286+0000 7f4dfe7fc700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4dec066f30 0x7f4dec0693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4df4005c20 tx=0x7f4df4001120 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:31.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.289+0000 7f4de6ffd700 1 -- 172.21.15.86:0/2403669972 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df0051320 con 0x7f4e000c83f0 2023-10-09T12:56:31.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.491+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f4e001591d0 con 0x7f4e000c83f0 2023-10-09T12:56:31.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.495+0000 7f4de6ffd700 1 -- 172.21.15.86:0/2403669972 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v50) v1 ==== 120+0+0 (secure 0 0 0) 0x7f4df0054940 con 0x7f4e000c83f0 2023-10-09T12:56:31.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4dec066f30 msgr2=0x7f4dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4dec066f30 0x7f4dec0693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4df4005c20 tx=0x7f4df4001120 comp rx=0 tx=0).stop 2023-10-09T12:56:31.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e000c83f0 msgr2=0x7f4e000c2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e000c83f0 0x7f4e000c2f80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c790 tx=0x7f4df0007f60 comp rx=0 tx=0).stop 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 shutdown_connections 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e000c83f0 0x7f4e000c2f80 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e001568e0 0x7f4e00159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 --2- 172.21.15.86:0/2403669972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e000ccee0 0x7f4e00169880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 >> 172.21.15.86:0/2403669972 conn(0x7f4e00068e10 msgr2=0x7f4e000c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 shutdown_connections 2023-10-09T12:56:31.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.498+0000 7f4e059ff700 1 -- 172.21.15.86:0/2403669972 wait complete. 2023-10-09T12:56:31.517 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T12:56:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.701+0000 7fbc8cf9d700 1 Processor -- start 2023-10-09T12:56:31.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.701+0000 7fbc8cf9d700 1 -- start start 2023-10-09T12:56:31.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.702+0000 7fbc8cf9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbc88153900 0x7fbc880c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.702+0000 7fbc8cf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc8806a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.702+0000 7fbc8cf9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc88157130 0x7fbc8806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.702+0000 7fbc8cf9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8806e150 con 0x7fbc88157130 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.702+0000 7fbc8cf9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc880c7800 con 0x7fbc88153900 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.702+0000 7fbc8cf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880c7ae0 con 0x7fbc880c9db0 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc88157130 0x7fbc8806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc88157130 0x7fbc8806a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43896/0 (socket says 172.21.15.86:43896) 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 -- 172.21.15.86:0/212590317 learned_addr learned my addr 172.21.15.86:0/212590317 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc86ffd700 1 --2- 172.21.15.86:0/212590317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc8806a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc877fe700 1 --2- 172.21.15.86:0/212590317 >> v2:172.21.15.135:3300/0 conn(0x7fbc88153900 0x7fbc880c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 -- 172.21.15.86:0/212590317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 msgr2=0x7fbc8806a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 --2- 172.21.15.86:0/212590317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc8806a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 -- 172.21.15.86:0/212590317 >> v2:172.21.15.135:3300/0 conn(0x7fbc88153900 msgr2=0x7fbc880c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 --2- 172.21.15.86:0/212590317 >> v2:172.21.15.135:3300/0 conn(0x7fbc88153900 0x7fbc880c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 -- 172.21.15.86:0/212590317 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880c7dc0 con 0x7fbc88157130 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.703+0000 7fbc87fff700 1 --2- 172.21.15.86:0/212590317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc8806a540 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fbc8806aed0 tx=0x7fbc80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2379f24028376e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc867fc700 1 -- 172.21.15.86:0/212590317 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000e070 con 0x7fbc88157130 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc867fc700 1 -- 172.21.15.86:0/212590317 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8000ba50 con 0x7fbc88157130 2023-10-09T12:56:31.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc867fc700 1 -- 172.21.15.86:0/212590317 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800092e0 con 0x7fbc88157130 2023-10-09T12:56:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/212590317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 msgr2=0x7fbc8806a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/212590317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc8806a540 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fbc8806aed0 tx=0x7fbc80009840 comp rx=0 tx=0).stop 2023-10-09T12:56:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/212590317 shutdown_connections 2023-10-09T12:56:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/212590317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc8806a540 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/212590317 >> v2:172.21.15.135:3300/0 conn(0x7fbc88153900 0x7fbc880c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/212590317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc8806a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/212590317 >> 172.21.15.86:0/212590317 conn(0x7fbc880cc1e0 msgr2=0x7fbc880cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/212590317 shutdown_connections 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.704+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/212590317 wait complete. 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.706+0000 7fbc8cf9d700 1 Processor -- start 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.706+0000 7fbc8cf9d700 1 -- start start 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc8cf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc881526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc8cf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc88153900 0x7fbc880ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc8cf9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc880ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc8cf9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880ac500 con 0x7fbc88157130 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc8cf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880ae930 con 0x7fbc88153900 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc8cf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88152cb0 con 0x7fbc880c9db0 2023-10-09T12:56:31.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc880ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc880ae3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43900/0 (socket says 172.21.15.86:43900) 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 -- 172.21.15.86:0/3352211118 learned_addr learned my addr 172.21.15.86:0/3352211118 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc86ffd700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc88153900 0x7fbc880ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 -- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 msgr2=0x7fbc881526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc877fe700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc881526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc881526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 -- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc88153900 msgr2=0x7fbc880ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc88153900 0x7fbc880ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc87fff700 1 -- 172.21.15.86:0/3352211118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80009ae0 con 0x7fbc88157130 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc86ffd700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc88153900 0x7fbc880ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.707+0000 7fbc877fe700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc881526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:31.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.708+0000 7fbc87fff700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc880ae3f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009fd0 tx=0x7fbc80018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.708+0000 7fbc6f7fe700 1 -- 172.21.15.86:0/3352211118 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800032f0 con 0x7fbc88157130 2023-10-09T12:56:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.708+0000 7fbc6f7fe700 1 -- 172.21.15.86:0/3352211118 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc80008e70 con 0x7fbc88157130 2023-10-09T12:56:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.708+0000 7fbc6f7fe700 1 -- 172.21.15.86:0/3352211118 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80026690 con 0x7fbc88157130 2023-10-09T12:56:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.708+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc880abc10 con 0x7fbc88157130 2023-10-09T12:56:31.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.708+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc880ac190 con 0x7fbc88157130 2023-10-09T12:56:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.709+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc880ac6b0 con 0x7fbc88157130 2023-10-09T12:56:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.710+0000 7fbc6f7fe700 1 -- 172.21.15.86:0/3352211118 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc80003040 con 0x7fbc88157130 2023-10-09T12:56:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.711+0000 7fbc6f7fe700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc74066f30 0x7fbc740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.711+0000 7fbc6f7fe700 1 -- 172.21.15.86:0/3352211118 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7fbc80086660 con 0x7fbc88157130 2023-10-09T12:56:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.711+0000 7fbc877fe700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc74066f30 0x7fbc740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:31.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.712+0000 7fbc877fe700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc74066f30 0x7fbc740693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc78006fd0 tx=0x7fbc78008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:31.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.715+0000 7fbc6f7fe700 1 -- 172.21.15.86:0/3352211118 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc80053810 con 0x7fbc88157130 2023-10-09T12:56:31.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.909+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc8806dd20 con 0x7fbc88157130 2023-10-09T12:56:31.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.913+0000 7fbc6f7fe700 1 -- 172.21.15.86:0/3352211118 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc80009940 con 0x7fbc88157130 2023-10-09T12:56:31.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc74066f30 msgr2=0x7fbc740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc74066f30 0x7fbc740693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc78006fd0 tx=0x7fbc78008040 comp rx=0 tx=0).stop 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 msgr2=0x7fbc880ae3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc880ae3f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009fd0 tx=0x7fbc80018000 comp rx=0 tx=0).stop 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 shutdown_connections 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fbc74066f30 0x7fbc740693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88157130 0x7fbc880ae3f0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc880c9db0 0x7fbc881526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 --2- 172.21.15.86:0/3352211118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc88153900 0x7fbc880ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 >> 172.21.15.86:0/3352211118 conn(0x7fbc880cc1e0 msgr2=0x7fbc8814d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 shutdown_connections 2023-10-09T12:56:31.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:31.915+0000 7fbc8cf9d700 1 -- 172.21.15.86:0/3352211118 wait complete. 2023-10-09T12:56:31.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-09T12:56:32.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.112+0000 7f21199ff700 1 Processor -- start 2023-10-09T12:56:32.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.113+0000 7f21199ff700 1 -- start start 2023-10-09T12:56:32.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f21199ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f21140cbf30 0x7f21140ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f21199ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21140ccf90 0x7f21140b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f21199ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f211415a270 0x7f21140b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f21199ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2114156bf0 con 0x7f21140ccf90 2023-10-09T12:56:32.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f21199ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140ae950 con 0x7f21140cbf30 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f21199ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21140cc300 con 0x7f211415a270 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f210bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21140ccf90 0x7f21140b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f210bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21140ccf90 0x7f21140b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43912/0 (socket says 172.21.15.86:43912) 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f210bfff700 1 -- 172.21.15.86:0/679677332 learned_addr learned my addr 172.21.15.86:0/679677332 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f2112ffd700 1 --2- 172.21.15.86:0/679677332 >> v2:172.21.15.135:3300/0 conn(0x7f21140cbf30 0x7f21140ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.114+0000 7f21137fe700 1 --2- 172.21.15.86:0/679677332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f211415a270 0x7f21140b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f210bfff700 1 -- 172.21.15.86:0/679677332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f211415a270 msgr2=0x7f21140b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f210bfff700 1 --2- 172.21.15.86:0/679677332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f211415a270 0x7f21140b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f210bfff700 1 -- 172.21.15.86:0/679677332 >> v2:172.21.15.135:3300/0 conn(0x7f21140cbf30 msgr2=0x7f21140ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f210bfff700 1 --2- 172.21.15.86:0/679677332 >> v2:172.21.15.135:3300/0 conn(0x7f21140cbf30 0x7f21140ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f210bfff700 1 -- 172.21.15.86:0/679677332 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140ad370 con 0x7f21140ccf90 2023-10-09T12:56:32.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f210bfff700 1 --2- 172.21.15.86:0/679677332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21140ccf90 0x7f21140b0d10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2114063d40 tx=0x7f20fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1105a6e8d0478d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:32.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f21127fc700 1 -- 172.21.15.86:0/679677332 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00b820 con 0x7f21140ccf90 2023-10-09T12:56:32.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f21127fc700 1 -- 172.21.15.86:0/679677332 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc00b980 con 0x7f21140ccf90 2023-10-09T12:56:32.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.115+0000 7f21127fc700 1 -- 172.21.15.86:0/679677332 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00bd20 con 0x7f21140ccf90 2023-10-09T12:56:32.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 -- 172.21.15.86:0/679677332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21140ccf90 msgr2=0x7f21140b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 --2- 172.21.15.86:0/679677332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21140ccf90 0x7f21140b0d10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f2114063d40 tx=0x7f20fc009250 comp rx=0 tx=0).stop 2023-10-09T12:56:32.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 -- 172.21.15.86:0/679677332 shutdown_connections 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 --2- 172.21.15.86:0/679677332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f211415a270 0x7f21140b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 --2- 172.21.15.86:0/679677332 >> v2:172.21.15.135:3300/0 conn(0x7f21140cbf30 0x7f21140ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 --2- 172.21.15.86:0/679677332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21140ccf90 0x7f21140b0d10 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 -- 172.21.15.86:0/679677332 >> 172.21.15.86:0/679677332 conn(0x7f211406a320 msgr2=0x7f21140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 -- 172.21.15.86:0/679677332 shutdown_connections 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.116+0000 7f21199ff700 1 -- 172.21.15.86:0/679677332 wait complete. 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.117+0000 7f21199ff700 1 Processor -- start 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.117+0000 7f21199ff700 1 -- start start 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.118+0000 7f21199ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21140cbf30 0x7f211416bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.118+0000 7f21199ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21140ccf90 0x7f211406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.118+0000 7f21199ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211415a270 0x7f2114149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.118+0000 7f21199ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211406ed70 con 0x7f211415a270 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.118+0000 7f21199ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2114169000 con 0x7f21140ccf90 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.118+0000 7f21199ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2114169230 con 0x7f21140cbf30 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211415a270 0x7f2114149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211415a270 0x7f2114149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43914/0 (socket says 172.21.15.86:43914) 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 -- 172.21.15.86:0/2520375690 learned_addr learned my addr 172.21.15.86:0/2520375690 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f2112ffd700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21140cbf30 0x7f211416bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f210bfff700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21140ccf90 0x7f211406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 -- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21140cbf30 msgr2=0x7f211416bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21140cbf30 0x7f211416bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 -- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21140ccf90 msgr2=0x7f211406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21140ccf90 0x7f211406e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 -- 172.21.15.86:0/2520375690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc0094f0 con 0x7f211415a270 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21137fe700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211415a270 0x7f2114149120 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f210c009fa0 tx=0x7f210c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f210affd700 1 -- 172.21.15.86:0/2520375690 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c00ed20 con 0x7f211415a270 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f210affd700 1 -- 172.21.15.86:0/2520375690 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c00ee80 con 0x7f211415a270 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f210affd700 1 -- 172.21.15.86:0/2520375690 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c014670 con 0x7f211415a270 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.119+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2114169510 con 0x7f211415a270 2023-10-09T12:56:32.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.120+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2114169ad0 con 0x7f211415a270 2023-10-09T12:56:32.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.121+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211404c3c0 con 0x7f211415a270 2023-10-09T12:56:32.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.121+0000 7f210affd700 1 -- 172.21.15.86:0/2520375690 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f210c0149e0 con 0x7f211415a270 2023-10-09T12:56:32.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.122+0000 7f210affd700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f20f4066f30 0x7f20f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.122+0000 7f210affd700 1 -- 172.21.15.86:0/2520375690 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7f210c084de0 con 0x7f211415a270 2023-10-09T12:56:32.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.122+0000 7f2112ffd700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f20f4066f30 0x7f20f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.123+0000 7f2112ffd700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f20f4066f30 0x7f20f40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2104006fd0 tx=0x7f2104008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:32.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.126+0000 7f210affd700 1 -- 172.21.15.86:0/2520375690 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f210c051f90 con 0x7f211415a270 2023-10-09T12:56:32.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.392+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f211406f8a0 con 0x7f211415a270 2023-10-09T12:56:32.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.652+0000 7f210affd700 1 -- 172.21.15.86:0/2520375690 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2427) v1 ==== 178+0+0 (secure 0 0 0) 0x7f210c0555b0 con 0x7f211415a270 2023-10-09T12:56:32.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.654+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f20f4066f30 msgr2=0x7f20f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.654+0000 7f21199ff700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f20f4066f30 0x7f20f40693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2104006fd0 tx=0x7f2104008040 comp rx=0 tx=0).stop 2023-10-09T12:56:32.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.654+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211415a270 msgr2=0x7f2114149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.654+0000 7f21199ff700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211415a270 0x7f2114149120 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f210c009fa0 tx=0x7f210c009900 comp rx=0 tx=0).stop 2023-10-09T12:56:32.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 shutdown_connections 2023-10-09T12:56:32.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f20f4066f30 0x7f20f40693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211415a270 0x7f2114149120 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21140cbf30 0x7f211416bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 --2- 172.21.15.86:0/2520375690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21140ccf90 0x7f211406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 >> 172.21.15.86:0/2520375690 conn(0x7f211406a320 msgr2=0x7f2114155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:32.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 shutdown_connections 2023-10-09T12:56:32.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.655+0000 7f21199ff700 1 -- 172.21.15.86:0/2520375690 wait complete. 2023-10-09T12:56:32.673 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-10-09T12:56:32.674 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-10-09T12:56:32.674 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T12:56:32.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-09T12:56:32.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.853+0000 7fd578b9d700 1 Processor -- start 2023-10-09T12:56:32.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.853+0000 7fd578b9d700 1 -- start start 2023-10-09T12:56:32.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.854+0000 7fd578b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd574150550 0x7fd574157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd578b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57406e2a0 con 0x7fd574150180 2023-10-09T12:56:32.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd578b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57406b2e0 con 0x7fd5740c7410 2023-10-09T12:56:32.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd578b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740c78e0 con 0x7fd574150550 2023-10-09T12:56:32.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd56bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd574150550 0x7fd574157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd5737fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd574150180 0x7fd5740c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60962/0 (socket says 172.21.15.86:60962) 2023-10-09T12:56:32.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd5737fe700 1 -- 172.21.15.86:0/645520855 learned_addr learned my addr 172.21.15.86:0/645520855 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:32.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd56bfff700 1 -- 172.21.15.86:0/645520855 >> v1:172.21.15.135:6789/0 conn(0x7fd5740c7410 legacy=0x7fd574069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:32.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd56bfff700 1 -- 172.21.15.86:0/645520855 >> v1:172.21.15.86:6789/0 conn(0x7fd574150180 legacy=0x7fd5740c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd56bfff700 1 -- 172.21.15.86:0/645520855 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740c7bc0 con 0x7fd574150550 2023-10-09T12:56:32.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.855+0000 7fd572ffd700 1 -- 172.21.15.86:0/645520855 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675043934 0 0) 0x7fd57406e2a0 con 0x7fd574150180 2023-10-09T12:56:32.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd56bfff700 1 --2- 172.21.15.86:0/645520855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd574150550 0x7fd574157770 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0098e0 tx=0x7fd55c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6fe8eed08e729e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:32.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd572ffd700 1 -- 172.21.15.86:0/645520855 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c009e80 con 0x7fd574150550 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd572ffd700 1 -- 172.21.15.86:0/645520855 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c00b820 con 0x7fd574150550 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd572ffd700 1 -- 172.21.15.86:0/645520855 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c00bba0 con 0x7fd574150550 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd578b9d700 1 -- 172.21.15.86:0/645520855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd574150550 msgr2=0x7fd574157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd578b9d700 1 --2- 172.21.15.86:0/645520855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd574150550 0x7fd574157770 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0098e0 tx=0x7fd55c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd578b9d700 1 -- 172.21.15.86:0/645520855 shutdown_connections 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd578b9d700 1 --2- 172.21.15.86:0/645520855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd574150550 0x7fd574157770 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd578b9d700 1 -- 172.21.15.86:0/645520855 >> 172.21.15.86:0/645520855 conn(0x7fd5740cc1f0 msgr2=0x7fd5740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd578b9d700 1 -- 172.21.15.86:0/645520855 shutdown_connections 2023-10-09T12:56:32.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.856+0000 7fd578b9d700 1 -- 172.21.15.86:0/645520855 wait complete. 2023-10-09T12:56:32.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.858+0000 7fd578b9d700 1 Processor -- start 2023-10-09T12:56:32.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.858+0000 7fd578b9d700 1 -- start start 2023-10-09T12:56:32.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd578b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5740c7410 0x7fd5740c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd578b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574150180 0x7fd57414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd578b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd574150550 0x7fd5740c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd578b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740c1300 con 0x7fd5740c7410 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd578b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740c25b0 con 0x7fd574150180 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd578b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740c2f80 con 0x7fd574150550 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd5737fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5740c7410 0x7fd5740c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd5737fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5740c7410 0x7fd5740c2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43924/0 (socket says 172.21.15.86:43924) 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd5737fe700 1 -- 172.21.15.86:0/674803326 learned_addr learned my addr 172.21.15.86:0/674803326 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd573fff700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd574150550 0x7fd5740c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.859+0000 7fd56bfff700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574150180 0x7fd57414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd5737fe700 1 -- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd574150550 msgr2=0x7fd5740c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd5737fe700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd574150550 0x7fd5740c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd5737fe700 1 -- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574150180 msgr2=0x7fd57414bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd5737fe700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574150180 0x7fd57414bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd5737fe700 1 -- 172.21.15.86:0/674803326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c009420 con 0x7fd5740c7410 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd56bfff700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574150180 0x7fd57414bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd5737fe700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5740c7410 0x7fd5740c2a40 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd56400c7e0 tx=0x7fd564007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd56b7fe700 1 -- 172.21.15.86:0/674803326 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564005b30 con 0x7fd5740c7410 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd56b7fe700 1 -- 172.21.15.86:0/674803326 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564005c90 con 0x7fd5740c7410 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd56b7fe700 1 -- 172.21.15.86:0/674803326 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564007300 con 0x7fd5740c7410 2023-10-09T12:56:32.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5740c19a0 con 0x7fd5740c7410 2023-10-09T12:56:32.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.860+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5740c1f60 con 0x7fd5740c7410 2023-10-09T12:56:32.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.861+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57404c3c0 con 0x7fd5740c7410 2023-10-09T12:56:32.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.862+0000 7fd56b7fe700 1 -- 172.21.15.86:0/674803326 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd56401b400 con 0x7fd5740c7410 2023-10-09T12:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.863+0000 7fd56b7fe700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd554066f30 0x7fd5540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.863+0000 7fd56b7fe700 1 -- 172.21.15.86:0/674803326 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7fd564084200 con 0x7fd5740c7410 2023-10-09T12:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.863+0000 7fd56bfff700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd554066f30 0x7fd5540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.864+0000 7fd56bfff700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd554066f30 0x7fd5540693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0030c0 tx=0x7fd55c016000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:32.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:32.867+0000 7fd56b7fe700 1 -- 172.21.15.86:0/674803326 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd564051390 con 0x7fd5740c7410 2023-10-09T12:56:33.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.131+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fd5740ae8c0 con 0x7fd5740c7410 2023-10-09T12:56:33.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.657+0000 7fd56b7fe700 1 -- 172.21.15.86:0/674803326 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2428) v1 ==== 177+0+0 (secure 0 0 0) 0x7fd5640549b0 con 0x7fd5740c7410 2023-10-09T12:56:33.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd554066f30 msgr2=0x7fd5540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:33.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd554066f30 0x7fd5540693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0030c0 tx=0x7fd55c016000 comp rx=0 tx=0).stop 2023-10-09T12:56:33.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5740c7410 msgr2=0x7fd5740c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:33.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5740c7410 0x7fd5740c2a40 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd56400c7e0 tx=0x7fd564007df0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 shutdown_connections 2023-10-09T12:56:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd554066f30 0x7fd5540693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5740c7410 0x7fd5740c2a40 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd574150550 0x7fd5740c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 --2- 172.21.15.86:0/674803326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574150180 0x7fd57414bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 >> 172.21.15.86:0/674803326 conn(0x7fd5740cc1f0 msgr2=0x7fd574158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 shutdown_connections 2023-10-09T12:56:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.660+0000 7fd578b9d700 1 -- 172.21.15.86:0/674803326 wait complete. 2023-10-09T12:56:33.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T12:56:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.864+0000 7fa0239ff700 1 Processor -- start 2023-10-09T12:56:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.864+0000 7fa0239ff700 1 -- start start 2023-10-09T12:56:33.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa0239ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa01c15ac80 0x7fa01c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:33.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa0239ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c0af2f0 con 0x7fa01c069cb0 2023-10-09T12:56:33.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa0239ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c0af5d0 con 0x7fa01c15b050 2023-10-09T12:56:33.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa0239ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c06a0e0 con 0x7fa01c15ac80 2023-10-09T12:56:33.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa02179b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa01c15ac80 0x7fa01c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:33.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa02179b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa01c15ac80 0x7fa01c069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43936/0 (socket says 172.21.15.86:43936) 2023-10-09T12:56:33.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa02179b700 1 -- 172.21.15.86:0/3134807811 learned_addr learned my addr 172.21.15.86:0/3134807811 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:33.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.866+0000 7fa021f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa01c069cb0 0x7fa01c0c7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60978/0 (socket says 172.21.15.86:60978) 2023-10-09T12:56:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa02179b700 1 -- 172.21.15.86:0/3134807811 >> v1:172.21.15.135:6789/0 conn(0x7fa01c15b050 legacy=0x7fa01c0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa02179b700 1 -- 172.21.15.86:0/3134807811 >> v1:172.21.15.86:6789/0 conn(0x7fa01c069cb0 legacy=0x7fa01c0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa02179b700 1 -- 172.21.15.86:0/3134807811 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c0c8660 con 0x7fa01c15ac80 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa013fff700 1 -- 172.21.15.86:0/3134807811 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668550445 0 0) 0x7fa01c0af2f0 con 0x7fa01c069cb0 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa02179b700 1 --2- 172.21.15.86:0/3134807811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c15ac80 0x7fa01c069770 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa0180099b0 tx=0x7fa018009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab869ebb782cfb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa013fff700 1 -- 172.21.15.86:0/3134807811 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01800b860 con 0x7fa01c15ac80 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa013fff700 1 -- 172.21.15.86:0/3134807811 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01800b9c0 con 0x7fa01c15ac80 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.867+0000 7fa013fff700 1 -- 172.21.15.86:0/3134807811 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01800bd60 con 0x7fa01c15ac80 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.868+0000 7fa0239ff700 1 -- 172.21.15.86:0/3134807811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c15ac80 msgr2=0x7fa01c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.868+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3134807811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c15ac80 0x7fa01c069770 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa0180099b0 tx=0x7fa018009250 comp rx=0 tx=0).stop 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.868+0000 7fa0239ff700 1 -- 172.21.15.86:0/3134807811 shutdown_connections 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.868+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3134807811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c15ac80 0x7fa01c069770 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.868+0000 7fa0239ff700 1 -- 172.21.15.86:0/3134807811 >> 172.21.15.86:0/3134807811 conn(0x7fa01c068e10 msgr2=0x7fa01c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.868+0000 7fa0239ff700 1 -- 172.21.15.86:0/3134807811 shutdown_connections 2023-10-09T12:56:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.868+0000 7fa0239ff700 1 -- 172.21.15.86:0/3134807811 wait complete. 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.869+0000 7fa0239ff700 1 Processor -- start 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.869+0000 7fa0239ff700 1 -- start start 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa0239ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c069cb0 0x7fa01c0ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa0239ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa01c15ac80 0x7fa01c143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa0239ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa01c15b050 0x7fa01c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa0239ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c143570 con 0x7fa01c069cb0 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa0239ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c14da50 con 0x7fa01c15b050 2023-10-09T12:56:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa0239ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c14e2f0 con 0x7fa01c15ac80 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa02179b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c069cb0 0x7fa01c0ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa02179b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c069cb0 0x7fa01c0ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43946/0 (socket says 172.21.15.86:43946) 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.870+0000 7fa02179b700 1 -- 172.21.15.86:0/3621211029 learned_addr learned my addr 172.21.15.86:0/3621211029 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa021f9c700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa01c15b050 0x7fa01c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa020f9a700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa01c15ac80 0x7fa01c143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa02179b700 1 -- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa01c15ac80 msgr2=0x7fa01c143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa02179b700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa01c15ac80 0x7fa01c143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa02179b700 1 -- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa01c15b050 msgr2=0x7fa01c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa02179b700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa01c15b050 0x7fa01c155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa02179b700 1 -- 172.21.15.86:0/3621211029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180094f0 con 0x7fa01c069cb0 2023-10-09T12:56:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa02179b700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c069cb0 0x7fa01c0ad110 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa01c063d40 tx=0x7fa018017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:33.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa0117fa700 1 -- 172.21.15.86:0/3621211029 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01801f070 con 0x7fa01c069cb0 2023-10-09T12:56:33.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa0117fa700 1 -- 172.21.15.86:0/3621211029 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa018011e70 con 0x7fa01c069cb0 2023-10-09T12:56:33.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c14d7f0 con 0x7fa01c069cb0 2023-10-09T12:56:33.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.871+0000 7fa0117fa700 1 -- 172.21.15.86:0/3621211029 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01801a670 con 0x7fa01c069cb0 2023-10-09T12:56:33.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.872+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c14dca0 con 0x7fa01c069cb0 2023-10-09T12:56:33.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.873+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c04c3c0 con 0x7fa01c069cb0 2023-10-09T12:56:33.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.873+0000 7fa0117fa700 1 -- 172.21.15.86:0/3621211029 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa01801a9e0 con 0x7fa01c069cb0 2023-10-09T12:56:33.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.875+0000 7fa0117fa700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa000066f30 0x7fa0000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:33.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.875+0000 7fa0117fa700 1 -- 172.21.15.86:0/3621211029 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7fa018085ac0 con 0x7fa01c069cb0 2023-10-09T12:56:33.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.875+0000 7fa020f9a700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa000066f30 0x7fa0000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:33.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.875+0000 7fa020f9a700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa000066f30 0x7fa0000693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0ad060 tx=0x7fa00c009040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:33.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:33.879+0000 7fa0117fa700 1 -- 172.21.15.86:0/3621211029 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa018052c70 con 0x7fa01c069cb0 2023-10-09T12:56:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.071+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa01c0c8940 con 0x7fa01c069cb0 2023-10-09T12:56:34.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.075+0000 7fa0117fa700 1 -- 172.21.15.86:0/3621211029 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa0180280c0 con 0x7fa01c069cb0 2023-10-09T12:56:34.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa000066f30 msgr2=0x7fa0000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa000066f30 0x7fa0000693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0ad060 tx=0x7fa00c009040 comp rx=0 tx=0).stop 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c069cb0 msgr2=0x7fa01c0ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c069cb0 0x7fa01c0ad110 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa01c063d40 tx=0x7fa018017000 comp rx=0 tx=0).stop 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 shutdown_connections 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa000066f30 0x7fa0000693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa01c069cb0 0x7fa01c0ad110 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa01c15b050 0x7fa01c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 --2- 172.21.15.86:0/3621211029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa01c15ac80 0x7fa01c143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 >> 172.21.15.86:0/3621211029 conn(0x7fa01c068e10 msgr2=0x7fa01c0c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 shutdown_connections 2023-10-09T12:56:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.078+0000 7fa0239ff700 1 -- 172.21.15.86:0/3621211029 wait complete. 2023-10-09T12:56:34.096 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T12:56:34.096 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:56:34.179 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:56:34.262 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T12:56:34.262 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T12:56:34.262 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:56:34.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.441+0000 7f0b1b9ff700 1 Processor -- start 2023-10-09T12:56:34.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.442+0000 7f0b1b9ff700 1 -- start start 2023-10-09T12:56:34.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b1b9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b140cbf30 0x7f0b140ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b1b9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140cc300 con 0x7f0b140b1420 2023-10-09T12:56:34.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b1b9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140ad370 con 0x7f0b140ccf90 2023-10-09T12:56:34.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b1b9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b14156bf0 con 0x7f0b140cbf30 2023-10-09T12:56:34.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b19f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0b140b1420 0x7f0b140c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:60984/0 (socket says 172.21.15.86:60984) 2023-10-09T12:56:34.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b19f9c700 1 -- 172.21.15.86:0/54568337 learned_addr learned my addr 172.21.15.86:0/54568337 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:34.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b1979b700 1 --2- 172.21.15.86:0/54568337 >> v2:172.21.15.135:3300/0 conn(0x7f0b140cbf30 0x7f0b140ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716315833 0 0) 0x7f0b140cc300 con 0x7f0b140b1420 2023-10-09T12:56:34.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b00003570 con 0x7f0b140b1420 2023-10-09T12:56:34.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2936046325 0 0) 0x7f0b00003570 con 0x7f0b140b1420 2023-10-09T12:56:34.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 >> v2:172.21.15.135:3300/0 conn(0x7f0b140cbf30 msgr2=0x7f0b140ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 --2- 172.21.15.86:0/54568337 >> v2:172.21.15.135:3300/0 conn(0x7f0b140cbf30 0x7f0b140ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 >> v1:172.21.15.135:6789/0 conn(0x7f0b140ccf90 legacy=0x7f0b140b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140ad650 con 0x7f0b140b1420 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f0b0c0017f0 con 0x7f0b140b1420 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 >> v1:172.21.15.86:6789/0 conn(0x7f0b140b1420 legacy=0x7f0b140c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b00003a60 0x7f0b00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00004810 0x7f0b00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b000051c0 0x7f0b0000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14156bf0 con 0x7f0b000051c0 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0000e2e0 con 0x7f0b00004810 2023-10-09T12:56:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0000e4a0 con 0x7f0b00003a60 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b19f9c700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b000051c0 0x7f0b0000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b1979b700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b00003a60 0x7f0b00003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.444+0000 7f0b18f9a700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00004810 0x7f0b00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b19f9c700 1 -- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b00003a60 msgr2=0x7f0b00003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b19f9c700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b00003a60 0x7f0b00003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b19f9c700 1 -- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00004810 msgr2=0x7f0b00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b19f9c700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00004810 0x7f0b00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b19f9c700 1 -- 172.21.15.86:0/54568337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00003570 con 0x7f0b000051c0 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b19f9c700 1 -- 172.21.15.86:0/54568337 reap_dead start 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b19f9c700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b000051c0 0x7f0b0000dc70 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a930 tx=0x7f0b0c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30133223b86e8d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:34.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0070d0 con 0x7f0b000051c0 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c007270 con 0x7f0b000051c0 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.445+0000 7f0b0bfff700 1 -- 172.21.15.86:0/54568337 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c007630 con 0x7f0b000051c0 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.446+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/54568337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b000051c0 msgr2=0x7f0b0000dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.446+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b000051c0 0x7f0b0000dc70 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a930 tx=0x7f0b0c0021d0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.446+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/54568337 shutdown_connections 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.446+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/54568337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b000051c0 0x7f0b0000dc70 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.446+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/54568337 >> 172.21.15.86:0/54568337 conn(0x7f0b1406a320 msgr2=0x7f0b140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.446+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/54568337 shutdown_connections 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.446+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/54568337 wait complete. 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.447+0000 7f0b1b9ff700 1 Processor -- start 2023-10-09T12:56:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.447+0000 7f0b1b9ff700 1 -- start start 2023-10-09T12:56:34.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b1b9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b000051c0 0x7f0b14152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b1b9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b1415aa10 0x7f0b141655f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b1b9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1415ae80 0x7f0b14165b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b1b9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14166070 con 0x7f0b1415ae80 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b1b9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b141596b0 con 0x7f0b000051c0 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b1b9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14158aa0 con 0x7f0b1415aa10 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b19f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1415ae80 0x7f0b14165b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b19f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1415ae80 0x7f0b14165b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:43966/0 (socket says 172.21.15.86:43966) 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.448+0000 7f0b19f9c700 1 -- 172.21.15.86:0/80880602 learned_addr learned my addr 172.21.15.86:0/80880602 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b1979b700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b000051c0 0x7f0b14152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b18f9a700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b1415aa10 0x7f0b141655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b19f9c700 1 -- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b1415aa10 msgr2=0x7f0b141655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b19f9c700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b1415aa10 0x7f0b141655f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b19f9c700 1 -- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b000051c0 msgr2=0x7f0b14152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b19f9c700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b000051c0 0x7f0b14152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b19f9c700 1 -- 172.21.15.86:0/80880602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b14158d80 con 0x7f0b1415ae80 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b19f9c700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1415ae80 0x7f0b14165b30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a3f0 tx=0x7f0b0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b097fa700 1 -- 172.21.15.86:0/80880602 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0017f0 con 0x7f0b1415ae80 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b097fa700 1 -- 172.21.15.86:0/80880602 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c001970 con 0x7f0b1415ae80 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b097fa700 1 -- 172.21.15.86:0/80880602 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0073e0 con 0x7f0b1415ae80 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.449+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b14159060 con 0x7f0b1415ae80 2023-10-09T12:56:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.450+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b14158770 con 0x7f0b1415ae80 2023-10-09T12:56:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.451+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1404c3c0 con 0x7f0b1415ae80 2023-10-09T12:56:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.452+0000 7f0b097fa700 1 -- 172.21.15.86:0/80880602 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b0c004bb0 con 0x7f0b1415ae80 2023-10-09T12:56:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.452+0000 7f0b097fa700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0af8066f30 0x7f0af80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.452+0000 7f0b097fa700 1 -- 172.21.15.86:0/80880602 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7f0b0c085b80 con 0x7f0b1415ae80 2023-10-09T12:56:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.453+0000 7f0b1979b700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0af8066f30 0x7f0af80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.453+0000 7f0b1979b700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0af8066f30 0x7f0af80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0b140c5250 tx=0x7f0b100091a0 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:34.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.457+0000 7f0b097fa700 1 -- 172.21.15.86:0/80880602 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b0c052d30 con 0x7f0b1415ae80 2023-10-09T12:56:34.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.691+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b140ad930 con 0x7f0b1415ae80 2023-10-09T12:56:34.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.692+0000 7f0b097fa700 1 -- 172.21.15.86:0/80880602 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f0b0c023070 con 0x7f0b1415ae80 2023-10-09T12:56:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:34.693 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6722,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4273963470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4273963470},{"type":"v1","addr":"172.21.15.135:6834","nonce":4273963470}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":6971,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1059899757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1059899757},{"type":"v1","addr":"172.21.15.86:6835","nonce":1059899757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1830713158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1830713158},{"type":"v1","addr":"172.21.15.135:6835","nonce":1830713158}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/51772873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":51772873},{"type":"v1","addr":"172.21.15.86:6833","nonce":51772873}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[]} 2023-10-09T12:56:34.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0af8066f30 msgr2=0x7f0af80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0af8066f30 0x7f0af80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0b140c5250 tx=0x7f0b100091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1415ae80 msgr2=0x7f0b14165b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1415ae80 0x7f0b14165b30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a3f0 tx=0x7f0b0c016000 comp rx=0 tx=0).stop 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 shutdown_connections 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0af8066f30 0x7f0af80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1415ae80 0x7f0b14165b30 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b000051c0 0x7f0b14152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 --2- 172.21.15.86:0/80880602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b1415aa10 0x7f0b141655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 >> 172.21.15.86:0/80880602 conn(0x7f0b1406a320 msgr2=0x7f0b140c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 shutdown_connections 2023-10-09T12:56:34.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.694+0000 7f0b1b9ff700 1 -- 172.21.15.86:0/80880602 wait complete. 2023-10-09T12:56:34.697 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 65 2023-10-09T12:56:34.713 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T12:56:34.713 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T12:56:34.713 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T12:56:34.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:56:34.713 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T12:56:34.713 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T12:56:34.714 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T12:56:34.714 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:56:34.714 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T12:56:34.714 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T12:56:34.714 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T12:56:34.714 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:56:34.714 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T12:56:34.715 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T12:56:34.715 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T12:56:34.715 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:56:34.727 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T12:56:34.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T12:56:34.731 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T12:56:34.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T12:56:34.732 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T12:56:34.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T12:56:34.733 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T12:56:34.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T12:56:34.775 INFO:tasks.ceph.mds.a:Started 2023-10-09T12:56:34.775 DEBUG:teuthology.parallel:result is None 2023-10-09T12:56:34.777 INFO:tasks.ceph.mds.b:Started 2023-10-09T12:56:34.777 DEBUG:teuthology.parallel:result is None 2023-10-09T12:56:34.778 INFO:tasks.ceph.mds.c:Started 2023-10-09T12:56:34.778 DEBUG:teuthology.parallel:result is None 2023-10-09T12:56:34.780 INFO:tasks.ceph.mds.d:Started 2023-10-09T12:56:34.781 DEBUG:teuthology.parallel:result is None 2023-10-09T12:56:34.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T12:56:34.911 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T12:56:34.911 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T12:56:34.929 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T12:56:34.929 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T12:56:34.930 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-10-09T12:56:34.929+0000 7f2fe83fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-09T12:56:34.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.973+0000 7ff318fff700 1 Processor -- start 2023-10-09T12:56:34.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.973+0000 7ff318fff700 1 -- start start 2023-10-09T12:56:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.974+0000 7ff318fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff3141578b0 0x7ff314155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.974+0000 7ff318fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3140af2f0 0x7ff3140af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff318fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140ad930 con 0x7ff314155c10 2023-10-09T12:56:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff318fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140b0c80 con 0x7ff3140af2f0 2023-10-09T12:56:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff318fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140acd20 con 0x7ff3141578b0 2023-10-09T12:56:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff312d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3140af2f0 0x7ff3140af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff312d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3140af2f0 0x7ff3140af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42770/0 (socket says 172.21.15.86:42770) 2023-10-09T12:56:34.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff312d9d700 1 -- 172.21.15.86:0/111694734 learned_addr learned my addr 172.21.15.86:0/111694734 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:34.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff311d9b700 1 --2- 172.21.15.86:0/111694734 >> v2:172.21.15.135:3300/0 conn(0x7ff3141578b0 0x7ff314155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff312d9d700 1 -- 172.21.15.86:0/111694734 >> v2:172.21.15.135:3300/0 conn(0x7ff3141578b0 msgr2=0x7ff314155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:34.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff31159a700 1 -- 172.21.15.86:0/111694734 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623712098 0 0) 0x7ff3140ad930 con 0x7ff314155c10 2023-10-09T12:56:34.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff312d9d700 1 --2- 172.21.15.86:0/111694734 >> v2:172.21.15.135:3300/0 conn(0x7ff3141578b0 0x7ff314155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff312d9d700 1 -- 172.21.15.86:0/111694734 >> v1:172.21.15.135:6789/0 conn(0x7ff314155c10 legacy=0x7ff3140ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.975+0000 7ff312d9d700 1 -- 172.21.15.86:0/111694734 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140ad000 con 0x7ff3140af2f0 2023-10-09T12:56:34.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff312d9d700 1 --2- 172.21.15.86:0/111694734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff3140af730 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7ff3140c8c60 tx=0x7ff30c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d2aff5ecf481ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff31159a700 1 -- 172.21.15.86:0/111694734 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00e070 con 0x7ff3140af2f0 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff31159a700 1 -- 172.21.15.86:0/111694734 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c00ba20 con 0x7ff3140af2f0 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff31159a700 1 -- 172.21.15.86:0/111694734 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c0092e0 con 0x7ff3140af2f0 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff318fff700 1 -- 172.21.15.86:0/111694734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 msgr2=0x7ff3140af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff318fff700 1 --2- 172.21.15.86:0/111694734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff3140af730 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7ff3140c8c60 tx=0x7ff30c009840 comp rx=0 tx=0).stop 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff318fff700 1 -- 172.21.15.86:0/111694734 shutdown_connections 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff318fff700 1 --2- 172.21.15.86:0/111694734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff3140af730 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.976+0000 7ff318fff700 1 --2- 172.21.15.86:0/111694734 >> v2:172.21.15.135:3300/0 conn(0x7ff3141578b0 0x7ff314155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.977+0000 7ff318fff700 1 -- 172.21.15.86:0/111694734 >> 172.21.15.86:0/111694734 conn(0x7ff31406a320 msgr2=0x7ff3140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.977+0000 7ff318fff700 1 -- 172.21.15.86:0/111694734 shutdown_connections 2023-10-09T12:56:34.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.977+0000 7ff318fff700 1 -- 172.21.15.86:0/111694734 wait complete. 2023-10-09T12:56:34.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.978+0000 7ff318fff700 1 Processor -- start 2023-10-09T12:56:34.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.978+0000 7ff318fff700 1 -- start start 2023-10-09T12:56:34.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff318fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff31414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff318fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314155c10 0x7ff3140a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff318fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3141578b0 0x7ff3140a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff318fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140a54c0 con 0x7ff3140af2f0 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff318fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140a5760 con 0x7ff314155c10 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff318fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140a5a40 con 0x7ff3141578b0 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff31259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff31414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff31259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff31414e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42780/0 (socket says 172.21.15.86:42780) 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff31259c700 1 -- 172.21.15.86:0/3540533421 learned_addr learned my addr 172.21.15.86:0/3540533421 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff312d9d700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3141578b0 0x7ff3140a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.979+0000 7ff311d9b700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314155c10 0x7ff3140a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff31259c700 1 -- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3141578b0 msgr2=0x7ff3140a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff31259c700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3141578b0 0x7ff3140a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff31259c700 1 -- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314155c10 msgr2=0x7ff3140a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff31259c700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314155c10 0x7ff3140a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff31259c700 1 -- 172.21.15.86:0/3540533421 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c009ae0 con 0x7ff3140af2f0 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff311d9b700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314155c10 0x7ff3140a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff31259c700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff31414e150 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c7e0 tx=0x7ff304007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff3027fc700 1 -- 172.21.15.86:0/3540533421 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011590 con 0x7ff3140af2f0 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff3027fc700 1 -- 172.21.15.86:0/3540533421 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304011710 con 0x7ff3140af2f0 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3140a5d20 con 0x7ff3140af2f0 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff3027fc700 1 -- 172.21.15.86:0/3540533421 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011ad0 con 0x7ff3140af2f0 2023-10-09T12:56:34.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.980+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31414ded0 con 0x7ff3140af2f0 2023-10-09T12:56:34.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.982+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140a6240 con 0x7ff3140af2f0 2023-10-09T12:56:34.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.982+0000 7ff3027fc700 1 -- 172.21.15.86:0/3540533421 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff30401b3b0 con 0x7ff3140af2f0 2023-10-09T12:56:34.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.983+0000 7ff3027fc700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:34.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.983+0000 7ff3027fc700 1 -- 172.21.15.86:0/3540533421 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5903+0+0 (secure 0 0 0) 0x7ff304083be0 con 0x7ff3140af2f0 2023-10-09T12:56:34.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.984+0000 7ff311d9b700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:34.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.984+0000 7ff311d9b700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2f4066f30 0x7ff2f40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff308009ce0 tx=0x7ff308008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:34.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:34.988+0000 7ff3027fc700 1 -- 172.21.15.86:0/3540533421 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff304050cf0 con 0x7ff3140af2f0 2023-10-09T12:56:35.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:35.200+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff31404c3c0 con 0x7ff3140af2f0 2023-10-09T12:56:36.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.107+0000 7ff3027fc700 1 -- 172.21.15.86:0/3540533421 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v160) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff304017070 con 0x7ff3140af2f0 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2f4066f30 msgr2=0x7ff2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2f4066f30 0x7ff2f40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff308009ce0 tx=0x7ff308008040 comp rx=0 tx=0).stop 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 msgr2=0x7ff31414e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff31414e150 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c7e0 tx=0x7ff304007df0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 shutdown_connections 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140af2f0 0x7ff31414e150 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3141578b0 0x7ff3140a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 --2- 172.21.15.86:0/3540533421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff314155c10 0x7ff3140a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.109+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 >> 172.21.15.86:0/3540533421 conn(0x7ff31406a320 msgr2=0x7ff314153690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:36.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.110+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 shutdown_connections 2023-10-09T12:56:36.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.110+0000 7ff318fff700 1 -- 172.21.15.86:0/3540533421 wait complete. 2023-10-09T12:56:36.111 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T12:56:36.128 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T12:56:36.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.308+0000 7f193d7ff700 1 Processor -- start 2023-10-09T12:56:36.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.308+0000 7f193d7ff700 1 -- start start 2023-10-09T12:56:36.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.309+0000 7f193d7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1938155c10 0x7f1938155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f193d7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f19380ac230 0x7f19380ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f193d7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19380ad930 con 0x7f19381568a0 2023-10-09T12:56:36.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f193d7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380acd20 con 0x7f1938155c10 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f193d7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380ad000 con 0x7f19380ac230 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1938155c10 0x7f1938155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1938155c10 0x7f1938155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42790/0 (socket says 172.21.15.86:42790) 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 -- 172.21.15.86:0/3919314711 learned_addr learned my addr 172.21.15.86:0/3919314711 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f19367fc700 1 --2- 172.21.15.86:0/3919314711 >> v2:172.21.15.135:3300/0 conn(0x7f19380ac230 0x7f19380ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 -- 172.21.15.86:0/3919314711 >> v2:172.21.15.135:3300/0 conn(0x7f19380ac230 msgr2=0x7f19380ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 --2- 172.21.15.86:0/3919314711 >> v2:172.21.15.135:3300/0 conn(0x7f19380ac230 0x7f19380ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 -- 172.21.15.86:0/3919314711 >> v1:172.21.15.135:6789/0 conn(0x7f19381568a0 legacy=0x7f1938156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 -- 172.21.15.86:0/3919314711 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19380ad2e0 con 0x7f1938155c10 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.310+0000 7f1936ffd700 1 --2- 172.21.15.86:0/3919314711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f1938155fe0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f1938065bb0 tx=0x7f1928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa26c00aa37cf6e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f1935ffb700 1 -- 172.21.15.86:0/3919314711 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800b820 con 0x7f1938155c10 2023-10-09T12:56:36.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f1935ffb700 1 -- 172.21.15.86:0/3919314711 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192800b980 con 0x7f1938155c10 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f1935ffb700 1 -- 172.21.15.86:0/3919314711 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800bd20 con 0x7f1938155c10 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 -- 172.21.15.86:0/3919314711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 msgr2=0x7f1938155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 --2- 172.21.15.86:0/3919314711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f1938155fe0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f1938065bb0 tx=0x7f1928009250 comp rx=0 tx=0).stop 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 -- 172.21.15.86:0/3919314711 shutdown_connections 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 --2- 172.21.15.86:0/3919314711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f1938155fe0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 --2- 172.21.15.86:0/3919314711 >> v2:172.21.15.135:3300/0 conn(0x7f19380ac230 0x7f19380ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 -- 172.21.15.86:0/3919314711 >> 172.21.15.86:0/3919314711 conn(0x7f193806a320 msgr2=0x7f19380cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 -- 172.21.15.86:0/3919314711 shutdown_connections 2023-10-09T12:56:36.313 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.311+0000 7f193d7ff700 1 -- 172.21.15.86:0/3919314711 wait complete. 2023-10-09T12:56:36.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.313+0000 7f193d7ff700 1 Processor -- start 2023-10-09T12:56:36.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.313+0000 7f193d7ff700 1 -- start start 2023-10-09T12:56:36.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f193d7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19380ac230 0x7f1938140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f193d7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f19380cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f193d7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19381568a0 0x7f19380cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f193d7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19380cb840 con 0x7f1938155c10 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f193d7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193813d760 con 0x7f19381568a0 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f193d7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193813da40 con 0x7f19380ac230 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f19380cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f19380cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42802/0 (socket says 172.21.15.86:42802) 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 -- 172.21.15.86:0/1550639050 learned_addr learned my addr 172.21.15.86:0/1550639050 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 -- 172.21.15.86:0/1550639050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19380ac230 msgr2=0x7f1938140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19380ac230 0x7f1938140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 -- 172.21.15.86:0/1550639050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19381568a0 msgr2=0x7f19380cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19381568a0 0x7f19380cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.314+0000 7f19367fc700 1 -- 172.21.15.86:0/1550639050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280094f0 con 0x7f1938155c10 2023-10-09T12:56:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.315+0000 7f19367fc700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f19380cadc0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f192c00d890 tx=0x7f192c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:36.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.315+0000 7f191effd700 1 -- 172.21.15.86:0/1550639050 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0125f0 con 0x7f1938155c10 2023-10-09T12:56:36.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.315+0000 7f191effd700 1 -- 172.21.15.86:0/1550639050 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c012770 con 0x7f1938155c10 2023-10-09T12:56:36.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.315+0000 7f191effd700 1 -- 172.21.15.86:0/1550639050 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c012b30 con 0x7f1938155c10 2023-10-09T12:56:36.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.315+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19380cce60 con 0x7f1938155c10 2023-10-09T12:56:36.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.315+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19380cbff0 con 0x7f1938155c10 2023-10-09T12:56:36.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.316+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193804c3c0 con 0x7f1938155c10 2023-10-09T12:56:36.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.317+0000 7f191effd700 1 -- 172.21.15.86:0/1550639050 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f192c01e460 con 0x7f1938155c10 2023-10-09T12:56:36.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.318+0000 7f191effd700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1924066f30 0x7f19240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.318+0000 7f191effd700 1 -- 172.21.15.86:0/1550639050 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5301+0+0 (secure 0 0 0) 0x7f192c084a60 con 0x7f1938155c10 2023-10-09T12:56:36.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.318+0000 7f1936ffd700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1924066f30 0x7f19240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.318 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.319+0000 7f1936ffd700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1924066f30 0x7f19240693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1938065bb0 tx=0x7f1928016000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:36.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.321+0000 7f191effd700 1 -- 172.21.15.86:0/1550639050 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f192c0558f0 con 0x7f1938155c10 2023-10-09T12:56:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.587+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f193813dbb0 con 0x7f1938155c10 2023-10-09T12:56:36.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.588+0000 7f191effd700 1 -- 172.21.15.86:0/1550639050 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f192c055480 con 0x7f1938155c10 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:56:36.588 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.589 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.590 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T12:56:36.592 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.593 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T12:56:36.595 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.596 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T12:56:36.598 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.599 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:56:36.600 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.601 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:36.602 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T12:56:36.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1924066f30 msgr2=0x7f19240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1924066f30 0x7f19240693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1938065bb0 tx=0x7f1928016000 comp rx=0 tx=0).stop 2023-10-09T12:56:36.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 msgr2=0x7f19380cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f19380cadc0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f192c00d890 tx=0x7f192c008040 comp rx=0 tx=0).stop 2023-10-09T12:56:36.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 shutdown_connections 2023-10-09T12:56:36.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19381568a0 0x7f19380cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19380ac230 0x7f1938140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1924066f30 0x7f19240693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 --2- 172.21.15.86:0/1550639050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1938155c10 0x7f19380cadc0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 >> 172.21.15.86:0/1550639050 conn(0x7f193806a320 msgr2=0x7f19380ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:36.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 shutdown_connections 2023-10-09T12:56:36.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.590+0000 7f193d7ff700 1 -- 172.21.15.86:0/1550639050 wait complete. 2023-10-09T12:56:36.608 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:56:36.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.792+0000 7fb1067ff700 1 Processor -- start 2023-10-09T12:56:36.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.792+0000 7fb1067ff700 1 -- start start 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.793+0000 7fb1067ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1001578b0 0x7fb100155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.793+0000 7fb1067ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb1000af2f0 0x7fb1000af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.793+0000 7fb1067ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1000ad930 con 0x7fb100155c10 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.793+0000 7fb1067ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000b0c80 con 0x7fb1001578b0 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.793+0000 7fb1067ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000acd20 con 0x7fb1000af2f0 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.793+0000 7fb0ff7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1001578b0 0x7fb100155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0ff7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1001578b0 0x7fb100155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42804/0 (socket says 172.21.15.86:42804) 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0ff7fe700 1 -- 172.21.15.86:0/557453076 learned_addr learned my addr 172.21.15.86:0/557453076 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:36.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb104d9c700 1 --2- 172.21.15.86:0/557453076 >> v2:172.21.15.135:3300/0 conn(0x7fb1000af2f0 0x7fb1000af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0ff7fe700 1 -- 172.21.15.86:0/557453076 >> v2:172.21.15.135:3300/0 conn(0x7fb1000af2f0 msgr2=0x7fb1000af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:36.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0ff7fe700 1 --2- 172.21.15.86:0/557453076 >> v2:172.21.15.135:3300/0 conn(0x7fb1000af2f0 0x7fb1000af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0ff7fe700 1 -- 172.21.15.86:0/557453076 >> v1:172.21.15.135:6789/0 conn(0x7fb100155c10 legacy=0x7fb1000ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0ff7fe700 1 -- 172.21.15.86:0/557453076 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000ad000 con 0x7fb1001578b0 2023-10-09T12:56:36.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb104d9c700 1 --2- 172.21.15.86:0/557453076 >> v2:172.21.15.135:3300/0 conn(0x7fb1000af2f0 0x7fb1000af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:36.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0ff7fe700 1 --2- 172.21.15.86:0/557453076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001578b0 0x7fb100155fe0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb100065be0 tx=0x7fb0f400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4f37a6f863599f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:36.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.794+0000 7fb0feffd700 1 -- 172.21.15.86:0/557453076 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400dc50 con 0x7fb1001578b0 2023-10-09T12:56:36.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb0feffd700 1 -- 172.21.15.86:0/557453076 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400ddb0 con 0x7fb1001578b0 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb0feffd700 1 -- 172.21.15.86:0/557453076 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40196d0 con 0x7fb1001578b0 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 -- 172.21.15.86:0/557453076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001578b0 msgr2=0x7fb100155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 --2- 172.21.15.86:0/557453076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001578b0 0x7fb100155fe0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb100065be0 tx=0x7fb0f400b4f0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 -- 172.21.15.86:0/557453076 shutdown_connections 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 --2- 172.21.15.86:0/557453076 >> v2:172.21.15.135:3300/0 conn(0x7fb1000af2f0 0x7fb1000af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 --2- 172.21.15.86:0/557453076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001578b0 0x7fb100155fe0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 -- 172.21.15.86:0/557453076 >> 172.21.15.86:0/557453076 conn(0x7fb10006a320 msgr2=0x7fb1000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 -- 172.21.15.86:0/557453076 shutdown_connections 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.795+0000 7fb1067ff700 1 -- 172.21.15.86:0/557453076 wait complete. 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.797+0000 7fb1067ff700 1 Processor -- start 2023-10-09T12:56:36.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.797+0000 7fb1067ff700 1 -- start start 2023-10-09T12:56:36.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.797+0000 7fb1067ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1000af2f0 0x7fb1000a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.797+0000 7fb1067ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb100155c10 0x7fb1000a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb1067ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1001578b0 0x7fb1000a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb1067ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb100151ef0 con 0x7fb1000af2f0 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb1067ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb100168dd0 con 0x7fb1001578b0 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb1067ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001690b0 con 0x7fb100155c10 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1000af2f0 0x7fb1000a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1000af2f0 0x7fb1000a5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42812/0 (socket says 172.21.15.86:42812) 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 -- 172.21.15.86:0/1119092037 learned_addr learned my addr 172.21.15.86:0/1119092037 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0ff7fe700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb100155c10 0x7fb1000a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb104d9c700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1001578b0 0x7fb1000a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 -- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb100155c10 msgr2=0x7fb1000a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb100155c10 0x7fb1000a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 -- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1001578b0 msgr2=0x7fb1000a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1001578b0 0x7fb1000a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:36.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 -- 172.21.15.86:0/1119092037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f400b790 con 0x7fb1000af2f0 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0ff7fe700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb100155c10 0x7fb1000a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb104d9c700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1001578b0 0x7fb1000a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0fffff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1000af2f0 0x7fb1000a5c40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000c590 tx=0x7fb0f000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.798+0000 7fb0e7fff700 1 -- 172.21.15.86:0/1119092037 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0011590 con 0x7fb1000af2f0 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.799+0000 7fb0e7fff700 1 -- 172.21.15.86:0/1119092037 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f00116f0 con 0x7fb1000af2f0 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.799+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100169390 con 0x7fb1000af2f0 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.799+0000 7fb0e7fff700 1 -- 172.21.15.86:0/1119092037 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0011ab0 con 0x7fb1000af2f0 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.799+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1001689f0 con 0x7fb1000af2f0 2023-10-09T12:56:36.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.800+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10004c3c0 con 0x7fb1000af2f0 2023-10-09T12:56:36.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.800+0000 7fb0e7fff700 1 -- 172.21.15.86:0/1119092037 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0f001b3b0 con 0x7fb1000af2f0 2023-10-09T12:56:36.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.801+0000 7fb0e7fff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0ec066f30 0x7fb0ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:36.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.801+0000 7fb0e7fff700 1 -- 172.21.15.86:0/1119092037 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5301+0+0 (secure 0 0 0) 0x7fb0f00839f0 con 0x7fb1000af2f0 2023-10-09T12:56:36.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.801+0000 7fb0ff7fe700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0ec066f30 0x7fb0ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:36.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.802+0000 7fb0ff7fe700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0ec066f30 0x7fb0ec0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb100065be0 tx=0x7fb0f401b000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:36.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.805+0000 7fb0e7fff700 1 -- 172.21.15.86:0/1119092037 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0f0050d50 con 0x7fb1000af2f0 2023-10-09T12:56:36.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.996+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1000cb040 con 0x7fb1000af2f0 2023-10-09T12:56:36.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.997+0000 7fb0e7fff700 1 -- 172.21.15.86:0/1119092037 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+12879 (secure 0 0 0) 0x7fb0f0017070 con 0x7fb1000af2f0 2023-10-09T12:56:36.997 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:36.997 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":160,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:56:36.099194+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0ec066f30 msgr2=0x7fb0ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0ec066f30 0x7fb0ec0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb100065be0 tx=0x7fb0f401b000 comp rx=0 tx=0).stop 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1000af2f0 msgr2=0x7fb1000a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1000af2f0 0x7fb1000a5c40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000c590 tx=0x7fb0f000c950 comp rx=0 tx=0).stop 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 shutdown_connections 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb0ec066f30 0x7fb0ec0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1000af2f0 0x7fb1000a5c40 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1001578b0 0x7fb1000a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 --2- 172.21.15.86:0/1119092037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb100155c10 0x7fb1000a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:36.999+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 >> 172.21.15.86:0/1119092037 conn(0x7fb10006a320 msgr2=0x7fb1000b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:37.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.000+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 shutdown_connections 2023-10-09T12:56:37.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.000+0000 7fb1067ff700 1 -- 172.21.15.86:0/1119092037 wait complete. 2023-10-09T12:56:37.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T12:56:37.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T12:56:37.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.202+0000 7f04c4dff700 1 Processor -- start 2023-10-09T12:56:37.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.202+0000 7f04c4dff700 1 -- start start 2023-10-09T12:56:37.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04c4dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04c0159890 0x7f04c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04c4dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04c4dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f04c015db10 0x7f04c0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04c4dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c015a160 con 0x7f04c0159890 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04c4dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00d13a0 con 0x7f04c015db10 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04c4dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c015e140 con 0x7f04c0159c60 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04c0159890 0x7f04c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04c0159890 0x7f04c015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42818/0 (socket says 172.21.15.86:42818) 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 -- 172.21.15.86:0/1755917114 learned_addr learned my addr 172.21.15.86:0/1755917114 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04bed9d700 1 --2- 172.21.15.86:0/1755917114 >> v2:172.21.15.135:3300/0 conn(0x7f04c015db10 0x7f04c0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04bdd9b700 1 --2- 172.21.15.86:0/1755917114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 -- 172.21.15.86:0/1755917114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 msgr2=0x7f04c015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 --2- 172.21.15.86:0/1755917114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 -- 172.21.15.86:0/1755917114 >> v2:172.21.15.135:3300/0 conn(0x7f04c015db10 msgr2=0x7f04c0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:37.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 --2- 172.21.15.86:0/1755917114 >> v2:172.21.15.135:3300/0 conn(0x7f04c015db10 0x7f04c0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.204+0000 7f04be59c700 1 -- 172.21.15.86:0/1755917114 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c015a3d0 con 0x7f04c0159890 2023-10-09T12:56:37.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04be59c700 1 --2- 172.21.15.86:0/1755917114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c015abd0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f04c0089b50 tx=0x7f04b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbfd69af84921dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:37.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04bd59a700 1 -- 172.21.15.86:0/1755917114 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000b860 con 0x7f04c0159890 2023-10-09T12:56:37.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04bd59a700 1 -- 172.21.15.86:0/1755917114 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000b9c0 con 0x7f04c0159890 2023-10-09T12:56:37.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04bd59a700 1 -- 172.21.15.86:0/1755917114 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000bd60 con 0x7f04c0159890 2023-10-09T12:56:37.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04c4dff700 1 -- 172.21.15.86:0/1755917114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 msgr2=0x7f04c015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1755917114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c015abd0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f04c0089b50 tx=0x7f04b0009250 comp rx=0 tx=0).stop 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04c4dff700 1 -- 172.21.15.86:0/1755917114 shutdown_connections 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1755917114 >> v2:172.21.15.135:3300/0 conn(0x7f04c015db10 0x7f04c0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1755917114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c015abd0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1755917114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.205+0000 7f04c4dff700 1 -- 172.21.15.86:0/1755917114 >> 172.21.15.86:0/1755917114 conn(0x7f04c0068e20 msgr2=0x7f04c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.206+0000 7f04c4dff700 1 -- 172.21.15.86:0/1755917114 shutdown_connections 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.206+0000 7f04c4dff700 1 -- 172.21.15.86:0/1755917114 wait complete. 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.207+0000 7f04c4dff700 1 Processor -- start 2023-10-09T12:56:37.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.207+0000 7f04c4dff700 1 -- start start 2023-10-09T12:56:37.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04c4dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c0152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04c4dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c0169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04c4dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04c015db10 0x7f04c00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04c4dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0152d40 con 0x7f04c0159890 2023-10-09T12:56:37.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04c4dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c016b220 con 0x7f04c015db10 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04c4dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c016ab50 con 0x7f04c0159c60 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04be59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c0152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04be59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c0152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42826/0 (socket says 172.21.15.86:42826) 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04be59c700 1 -- 172.21.15.86:0/1919241099 learned_addr learned my addr 172.21.15.86:0/1919241099 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.208+0000 7f04bdd9b700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c0169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04bed9d700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04c015db10 0x7f04c00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04be59c700 1 -- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 msgr2=0x7f04c0169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04be59c700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c0169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04be59c700 1 -- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04c015db10 msgr2=0x7f04c00b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04be59c700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04c015db10 0x7f04c00b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04be59c700 1 -- 172.21.15.86:0/1919241099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00094f0 con 0x7f04c0159890 2023-10-09T12:56:37.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04be59c700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c0152800 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f04b0006fd0 tx=0x7f04b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:37.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04ae7fc700 1 -- 172.21.15.86:0/1919241099 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0024440 con 0x7f04c0159890 2023-10-09T12:56:37.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04ae7fc700 1 -- 172.21.15.86:0/1919241099 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b00245a0 con 0x7f04c0159890 2023-10-09T12:56:37.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c016a590 con 0x7f04c0159890 2023-10-09T12:56:37.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04ae7fc700 1 -- 172.21.15.86:0/1919241099 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0024960 con 0x7f04c0159890 2023-10-09T12:56:37.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.209+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c016aeb0 con 0x7f04c0159890 2023-10-09T12:56:37.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.210+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c004c3c0 con 0x7f04c0159890 2023-10-09T12:56:37.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.211+0000 7f04ae7fc700 1 -- 172.21.15.86:0/1919241099 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04b0024d50 con 0x7f04c0159890 2023-10-09T12:56:37.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.212+0000 7f04ae7fc700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.212+0000 7f04ae7fc700 1 -- 172.21.15.86:0/1919241099 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5301+0+0 (secure 0 0 0) 0x7f04b0085fe0 con 0x7f04c0159890 2023-10-09T12:56:37.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.212+0000 7f04bdd9b700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.213+0000 7f04bdd9b700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f04a0066f30 0x7f04a00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04c015c290 tx=0x7f04b4008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:37.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.216+0000 7f04ae7fc700 1 -- 172.21.15.86:0/1919241099 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04b00533e0 con 0x7f04c0159890 2023-10-09T12:56:37.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.405+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04c006a5b0 con 0x7f04c0159890 2023-10-09T12:56:37.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.405+0000 7f04ae7fc700 1 -- 172.21.15.86:0/1919241099 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04b002b340 con 0x7f04c0159890 2023-10-09T12:56:37.405 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T12:56:37.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f04a0066f30 msgr2=0x7f04a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f04a0066f30 0x7f04a00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04c015c290 tx=0x7f04b4008040 comp rx=0 tx=0).stop 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 msgr2=0x7f04c0152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c0152800 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f04b0006fd0 tx=0x7f04b0017000 comp rx=0 tx=0).stop 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 shutdown_connections 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c0159890 0x7f04c0152800 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04c015db10 0x7f04c00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 --2- 172.21.15.86:0/1919241099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04c0159c60 0x7f04c0169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 >> 172.21.15.86:0/1919241099 conn(0x7f04c0068e20 msgr2=0x7f04c0153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 shutdown_connections 2023-10-09T12:56:37.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.407+0000 7f04c4dff700 1 -- 172.21.15.86:0/1919241099 wait complete. 2023-10-09T12:56:37.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T12:56:37.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.606+0000 7f883bbff700 1 Processor -- start 2023-10-09T12:56:37.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.606+0000 7f883bbff700 1 -- start start 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.607+0000 7f883bbff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f88340b1850 0x7f88340b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.607+0000 7f883bbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88340abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883bbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340cb300 con 0x7f88340ae680 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883bbff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883406fc30 con 0x7f88340b1850 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883bbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340cc260 con 0x7f88341579f0 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883999b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f88340b1850 0x7f88340b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883919a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f88340ae680 0x7f88341572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41304/0 (socket says 172.21.15.86:41304) 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883919a700 1 -- 172.21.15.86:0/3721553412 learned_addr learned my addr 172.21.15.86:0/3721553412 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883a19c700 1 --2- 172.21.15.86:0/3721553412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88340abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883999b700 1 -- 172.21.15.86:0/3721553412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 msgr2=0x7f88340abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883999b700 1 --2- 172.21.15.86:0/3721553412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88340abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883999b700 1 -- 172.21.15.86:0/3721553412 >> v1:172.21.15.86:6789/0 conn(0x7f88340ae680 legacy=0x7f88341572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f8838999700 1 -- 172.21.15.86:0/3721553412 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427541963 0 0) 0x7f88340cb300 con 0x7f88340ae680 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.608+0000 7f883999b700 1 -- 172.21.15.86:0/3721553412 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340cb5e0 con 0x7f88340b1850 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f883999b700 1 --2- 172.21.15.86:0/3721553412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f88340b1c20 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f8830009910 tx=0x7f88300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe4ce4e0db9a6d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f8838999700 1 -- 172.21.15.86:0/3721553412 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000b640 con 0x7f88340b1850 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f8838999700 1 -- 172.21.15.86:0/3721553412 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000b7a0 con 0x7f88340b1850 2023-10-09T12:56:37.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f8838999700 1 -- 172.21.15.86:0/3721553412 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000bb60 con 0x7f88340b1850 2023-10-09T12:56:37.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f883bbff700 1 -- 172.21.15.86:0/3721553412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 msgr2=0x7f88340b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f883bbff700 1 --2- 172.21.15.86:0/3721553412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f88340b1c20 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f8830009910 tx=0x7f88300091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f883bbff700 1 -- 172.21.15.86:0/3721553412 shutdown_connections 2023-10-09T12:56:37.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f883bbff700 1 --2- 172.21.15.86:0/3721553412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88340abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f883bbff700 1 --2- 172.21.15.86:0/3721553412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f88340b1c20 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.609+0000 7f883bbff700 1 -- 172.21.15.86:0/3721553412 >> 172.21.15.86:0/3721553412 conn(0x7f883406a320 msgr2=0x7f88340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:37.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.610+0000 7f883bbff700 1 -- 172.21.15.86:0/3721553412 shutdown_connections 2023-10-09T12:56:37.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.610+0000 7f883bbff700 1 -- 172.21.15.86:0/3721553412 wait complete. 2023-10-09T12:56:37.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.611+0000 7f883bbff700 1 Processor -- start 2023-10-09T12:56:37.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.611+0000 7f883bbff700 1 -- start start 2023-10-09T12:56:37.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883bbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88340ae680 0x7f883413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883bbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f8834150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883bbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88341512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883bbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834153010 con 0x7f88340b1850 2023-10-09T12:56:37.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883bbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834151950 con 0x7f88340ae680 2023-10-09T12:56:37.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883bbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834151c30 con 0x7f88341579f0 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883919a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f8834150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883919a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f8834150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42846/0 (socket says 172.21.15.86:42846) 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883919a700 1 -- 172.21.15.86:0/3449299840 learned_addr learned my addr 172.21.15.86:0/3449299840 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.612+0000 7f883a19c700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88341512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883999b700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88340ae680 0x7f883413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883919a700 1 -- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 msgr2=0x7f88341512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883919a700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88341512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883919a700 1 -- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88340ae680 msgr2=0x7f883413ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883919a700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88340ae680 0x7f883413ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883919a700 1 -- 172.21.15.86:0/3449299840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009420 con 0x7f88340b1850 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883919a700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f8834150d90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f882400c7e0 tx=0x7f8824007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:37.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f8829ffb700 1 -- 172.21.15.86:0/3449299840 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824005b30 con 0x7f88340b1850 2023-10-09T12:56:37.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f8829ffb700 1 -- 172.21.15.86:0/3449299840 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824005c90 con 0x7f88340b1850 2023-10-09T12:56:37.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8834151f10 con 0x7f88340b1850 2023-10-09T12:56:37.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f8829ffb700 1 -- 172.21.15.86:0/3449299840 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824007300 con 0x7f88340b1850 2023-10-09T12:56:37.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.613+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8834167600 con 0x7f88340b1850 2023-10-09T12:56:37.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.614+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883404c3c0 con 0x7f88340b1850 2023-10-09T12:56:37.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.615+0000 7f8829ffb700 1 -- 172.21.15.86:0/3449299840 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f882401b400 con 0x7f88340b1850 2023-10-09T12:56:37.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.616+0000 7f8829ffb700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:37.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.616+0000 7f8829ffb700 1 -- 172.21.15.86:0/3449299840 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5301+0+0 (secure 0 0 0) 0x7f8824083f40 con 0x7f88340b1850 2023-10-09T12:56:37.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.616+0000 7f883999b700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:37.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.617+0000 7f883999b700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8818066f30 0x7f88180693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8830009860 tx=0x7f8830017000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:37.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.620+0000 7f8829ffb700 1 -- 172.21.15.86:0/3449299840 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8824051320 con 0x7f88340b1850 2023-10-09T12:56:37.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.813+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f88340cb8c0 con 0x7f88340b1850 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.814+0000 7f8829ffb700 1 -- 172.21.15.86:0/3449299840 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v160) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8824054940 con 0x7f88340b1850 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:37.814 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8818066f30 msgr2=0x7f88180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8818066f30 0x7f88180693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8830009860 tx=0x7f8830017000 comp rx=0 tx=0).stop 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 msgr2=0x7f8834150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f8834150d90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f882400c7e0 tx=0x7f8824007df0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 shutdown_connections 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88341579f0 0x7f88341512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88340ae680 0x7f883413ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8818066f30 0x7f88180693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 --2- 172.21.15.86:0/3449299840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88340b1850 0x7f8834150d90 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:37.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 >> 172.21.15.86:0/3449299840 conn(0x7f883406a320 msgr2=0x7f883406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:37.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 shutdown_connections 2023-10-09T12:56:37.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:37.816+0000 7f883bbff700 1 -- 172.21.15.86:0/3449299840 wait complete. 2023-10-09T12:56:37.834 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T12:56:37.834 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T12:56:38.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.020+0000 7f910dbff700 1 Processor -- start 2023-10-09T12:56:38.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.021+0000 7f910dbff700 1 -- start start 2023-10-09T12:56:38.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f910dbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91080b2100 0x7f9108068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f910dbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91080ae6d0 con 0x7f9108157740 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f910dbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910806dc20 con 0x7f91080688d0 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f910dbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080acc00 con 0x7f91080b2100 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f91077fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9108157740 0x7f91080adfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41314/0 (socket says 172.21.15.86:41314) 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f91077fe700 1 -- 172.21.15.86:0/3644261703 learned_addr learned my addr 172.21.15.86:0/3644261703 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f90fffff700 1 --2- 172.21.15.86:0/3644261703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91080b2100 0x7f9108068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707698065 0 0) 0x7f90f8001110 con 0x7f9108157740 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f4003570 con 0x7f9108157740 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.022+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348904400 0 0) 0x7f910806dc20 con 0x7f91080688d0 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f8001110 con 0x7f91080688d0 2023-10-09T12:56:38.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f90fffff700 1 -- 172.21.15.86:0/3644261703 >> v1:172.21.15.135:6789/0 conn(0x7f91080688d0 legacy=0x7f910806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:38.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f90fffff700 1 -- 172.21.15.86:0/3644261703 >> v1:172.21.15.86:6789/0 conn(0x7f9108157740 legacy=0x7f91080adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:38.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3095638887 0 0) 0x7f90f4003570 con 0x7f9108157740 2023-10-09T12:56:38.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f90fffff700 1 -- 172.21.15.86:0/3644261703 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080ae910 con 0x7f91080b2100 2023-10-09T12:56:38.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f90fffff700 1 --2- 172.21.15.86:0/3644261703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91080b2100 0x7f9108068390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009910 tx=0x7f90f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9348cbd4d35b4d31 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:38.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8001600 con 0x7f91080b2100 2023-10-09T12:56:38.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f0011420 con 0x7f91080b2100 2023-10-09T12:56:38.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.023+0000 7f9106ffd700 1 -- 172.21.15.86:0/3644261703 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00117c0 con 0x7f91080b2100 2023-10-09T12:56:38.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.024+0000 7f910dbff700 1 -- 172.21.15.86:0/3644261703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91080b2100 msgr2=0x7f9108068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.024+0000 7f910dbff700 1 --2- 172.21.15.86:0/3644261703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91080b2100 0x7f9108068390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009910 tx=0x7f90f00091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.024+0000 7f910dbff700 1 -- 172.21.15.86:0/3644261703 shutdown_connections 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.024+0000 7f910dbff700 1 --2- 172.21.15.86:0/3644261703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91080b2100 0x7f9108068390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.024+0000 7f910dbff700 1 -- 172.21.15.86:0/3644261703 >> 172.21.15.86:0/3644261703 conn(0x7f91080c8f90 msgr2=0x7f91080c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.024+0000 7f910dbff700 1 -- 172.21.15.86:0/3644261703 shutdown_connections 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.024+0000 7f910dbff700 1 -- 172.21.15.86:0/3644261703 wait complete. 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.025+0000 7f910dbff700 1 Processor -- start 2023-10-09T12:56:38.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.025+0000 7f910dbff700 1 -- start start 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.026+0000 7f910dbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91080688d0 0x7f91080c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.026+0000 7f910dbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91080b2100 0x7f9108154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.026+0000 7f910dbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9108157740 0x7f91080b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.026+0000 7f910dbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080c6140 con 0x7f91080688d0 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.026+0000 7f910dbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080c5530 con 0x7f91080b2100 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.026+0000 7f910dbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080c5810 con 0x7f9108157740 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91080688d0 0x7f91080c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:38.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91080688d0 0x7f91080c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42856/0 (socket says 172.21.15.86:42856) 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 -- 172.21.15.86:0/4180456911 learned_addr learned my addr 172.21.15.86:0/4180456911 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f90fffff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91080b2100 0x7f9108154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f9107fff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9108157740 0x7f91080b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 -- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9108157740 msgr2=0x7f91080b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9108157740 0x7f91080b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 -- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91080b2100 msgr2=0x7f9108154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91080b2100 0x7f9108154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 -- 172.21.15.86:0/4180456911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009420 con 0x7f91080688d0 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f90fffff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91080b2100 0x7f9108154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f9107fff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9108157740 0x7f91080b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f91077fe700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91080688d0 0x7f91080c3ef0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f90f800cb60 tx=0x7f90f8001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:38.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.027+0000 7f90ff7fe700 1 -- 172.21.15.86:0/4180456911 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8007360 con 0x7f91080688d0 2023-10-09T12:56:38.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.028+0000 7f90ff7fe700 1 -- 172.21.15.86:0/4180456911 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f80074e0 con 0x7f91080688d0 2023-10-09T12:56:38.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.028+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91080c5af0 con 0x7f91080688d0 2023-10-09T12:56:38.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.028+0000 7f90ff7fe700 1 -- 172.21.15.86:0/4180456911 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8004830 con 0x7f91080688d0 2023-10-09T12:56:38.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.028+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91080c4430 con 0x7f91080688d0 2023-10-09T12:56:38.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.029+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91080718b0 con 0x7f91080688d0 2023-10-09T12:56:38.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.029+0000 7f90ff7fe700 1 -- 172.21.15.86:0/4180456911 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90f8004c20 con 0x7f91080688d0 2023-10-09T12:56:38.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.030+0000 7f90ff7fe700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90e8066f30 0x7f90e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:38.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.030+0000 7f90ff7fe700 1 -- 172.21.15.86:0/4180456911 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5301+0+0 (secure 0 0 0) 0x7f90f8083a70 con 0x7f91080688d0 2023-10-09T12:56:38.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.031+0000 7f90fffff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90e8066f30 0x7f90e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:38.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.031+0000 7f90fffff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90e8066f30 0x7f90e80693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90f00030c0 tx=0x7f90f0016000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:38.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.034+0000 7f90ff7fe700 1 -- 172.21.15.86:0/4180456911 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90f8050e50 con 0x7f91080688d0 2023-10-09T12:56:38.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:38.225+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f91080ae6d0 con 0x7f91080688d0 2023-10-09T12:56:39.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.173+0000 7f90ff7fe700 1 -- 172.21.15.86:0/4180456911 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v161) v1 ==== 138+0+0 (secure 0 0 0) 0x7f91080ae6d0 con 0x7f91080688d0 2023-10-09T12:56:39.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.181+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90e8066f30 msgr2=0x7f90e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:39.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.181+0000 7f910dbff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90e8066f30 0x7f90e80693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90f00030c0 tx=0x7f90f0016000 comp rx=0 tx=0).stop 2023-10-09T12:56:39.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.181+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91080688d0 msgr2=0x7f91080c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:39.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.181+0000 7f910dbff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91080688d0 0x7f91080c3ef0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f90f800cb60 tx=0x7f90f8001c40 comp rx=0 tx=0).stop 2023-10-09T12:56:39.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 shutdown_connections 2023-10-09T12:56:39.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f90e8066f30 0x7f90e80693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91080688d0 0x7f91080c3ef0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9108157740 0x7f91080b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 --2- 172.21.15.86:0/4180456911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91080b2100 0x7f9108154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 >> 172.21.15.86:0/4180456911 conn(0x7f91080c8f90 msgr2=0x7f9108156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:39.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 shutdown_connections 2023-10-09T12:56:39.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.182+0000 7f910dbff700 1 -- 172.21.15.86:0/4180456911 wait complete. 2023-10-09T12:56:39.183 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T12:56:39.202 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T12:56:39.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.394+0000 7feccffff700 1 Processor -- start 2023-10-09T12:56:39.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.394+0000 7feccffff700 1 -- start start 2023-10-09T12:56:39.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7feccffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fecd015ba80 0x7fecd006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:39.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7feccffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fecd006e4b0 0x7fecd01583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:39.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7feccffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd0159c00 con 0x7fecd015b6b0 2023-10-09T12:56:39.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7feccffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd006f6f0 con 0x7fecd006e4b0 2023-10-09T12:56:39.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7feccffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd0159ee0 con 0x7fecd015ba80 2023-10-09T12:56:39.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7feccf7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fecd006e4b0 0x7fecd01583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:39.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7fecceffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fecd015b6b0 0x7fecd015aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41320/0 (socket says 172.21.15.86:41320) 2023-10-09T12:56:39.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.395+0000 7fecceffd700 1 -- 172.21.15.86:0/2662554636 learned_addr learned my addr 172.21.15.86:0/2662554636 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:39.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7fecce7fc700 1 --2- 172.21.15.86:0/2662554636 >> v2:172.21.15.135:3300/0 conn(0x7fecd015ba80 0x7fecd006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:39.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccdffb700 1 -- 172.21.15.86:0/2662554636 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584452829 0 0) 0x7fecd0159c00 con 0x7fecd015b6b0 2023-10-09T12:56:39.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccf7fe700 1 -- 172.21.15.86:0/2662554636 >> v2:172.21.15.135:3300/0 conn(0x7fecd015ba80 msgr2=0x7fecd006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccf7fe700 1 --2- 172.21.15.86:0/2662554636 >> v2:172.21.15.135:3300/0 conn(0x7fecd015ba80 0x7fecd006df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccf7fe700 1 -- 172.21.15.86:0/2662554636 >> v1:172.21.15.86:6789/0 conn(0x7fecd015b6b0 legacy=0x7fecd015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccf7fe700 1 -- 172.21.15.86:0/2662554636 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd015a1c0 con 0x7fecd006e4b0 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccf7fe700 1 --2- 172.21.15.86:0/2662554636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd006e4b0 0x7fecd01583f0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fecd0159070 tx=0x7fecc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391240905651591c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccdffb700 1 -- 172.21.15.86:0/2662554636 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800e070 con 0x7fecd006e4b0 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccdffb700 1 -- 172.21.15.86:0/2662554636 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc800bc30 con 0x7fecd006e4b0 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.396+0000 7feccdffb700 1 -- 172.21.15.86:0/2662554636 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8012430 con 0x7fecd006e4b0 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 -- 172.21.15.86:0/2662554636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd006e4b0 msgr2=0x7fecd01583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 --2- 172.21.15.86:0/2662554636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd006e4b0 0x7fecd01583f0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fecd0159070 tx=0x7fecc8009780 comp rx=0 tx=0).stop 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 -- 172.21.15.86:0/2662554636 shutdown_connections 2023-10-09T12:56:39.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 --2- 172.21.15.86:0/2662554636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd006e4b0 0x7fecd01583f0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 --2- 172.21.15.86:0/2662554636 >> v2:172.21.15.135:3300/0 conn(0x7fecd015ba80 0x7fecd006df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 -- 172.21.15.86:0/2662554636 >> 172.21.15.86:0/2662554636 conn(0x7fecd0068e00 msgr2=0x7fecd0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:39.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 -- 172.21.15.86:0/2662554636 shutdown_connections 2023-10-09T12:56:39.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.397+0000 7feccffff700 1 -- 172.21.15.86:0/2662554636 wait complete. 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.398+0000 7feccffff700 1 Processor -- start 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.399+0000 7feccffff700 1 -- start start 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.399+0000 7feccffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd006e4b0 0x7fecd00c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.399+0000 7feccffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd015b6b0 0x7fecd0169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.399+0000 7feccffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd015ba80 0x7fecd0156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0155f70 con 0x7fecd015ba80 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd016a480 con 0x7fecd015b6b0 2023-10-09T12:56:39.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd016a750 con 0x7fecd006e4b0 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd015ba80 0x7fecd0156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd015ba80 0x7fecd0156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42882/0 (socket says 172.21.15.86:42882) 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 -- 172.21.15.86:0/1136868290 learned_addr learned my addr 172.21.15.86:0/1136868290 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7fecce7fc700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd015b6b0 0x7fecd0169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7fecceffd700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd006e4b0 0x7fecd00c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 -- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd006e4b0 msgr2=0x7fecd00c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd006e4b0 0x7fecd00c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 -- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd015b6b0 msgr2=0x7fecd0169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd015b6b0 0x7fecd0169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:39.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 -- 172.21.15.86:0/1136868290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009a20 con 0x7fecd015ba80 2023-10-09T12:56:39.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.400+0000 7feccf7fe700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd015ba80 0x7fecd0156400 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097c0 tx=0x7fecc8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:39.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.401+0000 7fecb6ffd700 1 -- 172.21.15.86:0/1136868290 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8027470 con 0x7fecd015ba80 2023-10-09T12:56:39.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.401+0000 7fecb6ffd700 1 -- 172.21.15.86:0/1136868290 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc80275d0 con 0x7fecd015ba80 2023-10-09T12:56:39.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.401+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd016aa30 con 0x7fecd015ba80 2023-10-09T12:56:39.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.401+0000 7fecb6ffd700 1 -- 172.21.15.86:0/1136868290 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8027990 con 0x7fecd015ba80 2023-10-09T12:56:39.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.401+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd0155c00 con 0x7fecd015ba80 2023-10-09T12:56:39.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.402+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd004c3c0 con 0x7fecd015ba80 2023-10-09T12:56:39.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.403+0000 7fecb6ffd700 1 -- 172.21.15.86:0/1136868290 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fecc8024070 con 0x7fecd015ba80 2023-10-09T12:56:39.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.404+0000 7fecb6ffd700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fecbc066f30 0x7fecbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:39.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.404+0000 7fecb6ffd700 1 -- 172.21.15.86:0/1136868290 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5671+0+0 (secure 0 0 0) 0x7fecc8086c60 con 0x7fecd015ba80 2023-10-09T12:56:39.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.404+0000 7fecceffd700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fecbc066f30 0x7fecbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:39.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.404+0000 7fecceffd700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fecbc066f30 0x7fecbc0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007fd0 tx=0x7fecc0007d30 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:39.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.409+0000 7fecb6ffd700 1 -- 172.21.15.86:0/1136868290 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecc8053e50 con 0x7fecd015ba80 2023-10-09T12:56:39.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:39.597+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fecd01560b0 con 0x7fecd015ba80 2023-10-09T12:56:40.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.179+0000 7fecb6ffd700 1 -- 172.21.15.86:0/1136868290 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v162) v1 ==== 170+0+0 (secure 0 0 0) 0x7fecc802c020 con 0x7fecd015ba80 2023-10-09T12:56:40.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.184+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fecbc066f30 msgr2=0x7fecbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:40.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.184+0000 7feccffff700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fecbc066f30 0x7fecbc0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007fd0 tx=0x7fecc0007d30 comp rx=0 tx=0).stop 2023-10-09T12:56:40.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.184+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd015ba80 msgr2=0x7fecd0156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:40.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.184+0000 7feccffff700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd015ba80 0x7fecd0156400 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097c0 tx=0x7fecc8019000 comp rx=0 tx=0).stop 2023-10-09T12:56:40.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.185+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 shutdown_connections 2023-10-09T12:56:40.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.185+0000 7feccffff700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fecbc066f30 0x7fecbc0693e0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007fd0 tx=0x7fecc0007d30 comp rx=0 tx=0).stop 2023-10-09T12:56:40.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.185+0000 7feccffff700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecd015ba80 0x7fecd0156400 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.185+0000 7feccffff700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd006e4b0 0x7fecd00c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.185+0000 7feccffff700 1 --2- 172.21.15.86:0/1136868290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd015b6b0 0x7fecd0169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.185+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 >> 172.21.15.86:0/1136868290 conn(0x7fecd0068e00 msgr2=0x7fecd00c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:40.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.188+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 shutdown_connections 2023-10-09T12:56:40.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.188+0000 7feccffff700 1 -- 172.21.15.86:0/1136868290 wait complete. 2023-10-09T12:56:40.196 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T12:56:40.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T12:56:40.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.400+0000 7f0eca5ff700 1 Processor -- start 2023-10-09T12:56:40.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.400+0000 7f0eca5ff700 1 -- start start 2023-10-09T12:56:40.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0eca5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ec4159c60 0x7f0ec415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:40.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0eca5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec415db10 0x7f0ec4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:40.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0eca5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec415a160 con 0x7f0ec4159890 2023-10-09T12:56:40.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0eca5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec415df50 con 0x7f0ec4159c60 2023-10-09T12:56:40.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0eca5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40d13a0 con 0x7f0ec415db10 2023-10-09T12:56:40.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0ec37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ec4159c60 0x7f0ec415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:40.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0ec8b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec415db10 0x7f0ec4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:40.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0ec37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ec4159c60 0x7f0ec415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:44680/0 (socket says 172.21.15.86:44680) 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0ec8b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec415db10 0x7f0ec4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:32948/0 (socket says 172.21.15.86:32948) 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.402+0000 7f0ec37fe700 1 -- 172.21.15.86:0/3363863487 learned_addr learned my addr 172.21.15.86:0/3363863487 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec8b9c700 1 -- 172.21.15.86:0/3363863487 >> v2:172.21.15.135:3300/0 conn(0x7f0ec4159c60 msgr2=0x7f0ec415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec8b9c700 1 --2- 172.21.15.86:0/3363863487 >> v2:172.21.15.135:3300/0 conn(0x7f0ec4159c60 0x7f0ec415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec8b9c700 1 -- 172.21.15.86:0/3363863487 >> v1:172.21.15.135:6789/0 conn(0x7f0ec4159890 legacy=0x7f0ec415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec8b9c700 1 -- 172.21.15.86:0/3363863487 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec415e140 con 0x7f0ec415db10 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec37fe700 1 --2- 172.21.15.86:0/3363863487 >> v2:172.21.15.135:3300/0 conn(0x7f0ec4159c60 0x7f0ec415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec8b9c700 1 --2- 172.21.15.86:0/3363863487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec415db10 0x7f0ec4069560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0098e0 tx=0x7f0ebc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3089f02c1dc6a5ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec2ffd700 1 -- 172.21.15.86:0/3363863487 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00b640 con 0x7f0ec415db10 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec2ffd700 1 -- 172.21.15.86:0/3363863487 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc00b7a0 con 0x7f0ec415db10 2023-10-09T12:56:40.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.403+0000 7f0ec2ffd700 1 -- 172.21.15.86:0/3363863487 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00bb40 con 0x7f0ec415db10 2023-10-09T12:56:40.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 -- 172.21.15.86:0/3363863487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec415db10 msgr2=0x7f0ec4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:40.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/3363863487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec415db10 0x7f0ec4069560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0098e0 tx=0x7f0ebc0091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 -- 172.21.15.86:0/3363863487 shutdown_connections 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/3363863487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec415db10 0x7f0ec4069560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/3363863487 >> v2:172.21.15.135:3300/0 conn(0x7f0ec4159c60 0x7f0ec415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 -- 172.21.15.86:0/3363863487 >> 172.21.15.86:0/3363863487 conn(0x7f0ec4068e20 msgr2=0x7f0ec40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 -- 172.21.15.86:0/3363863487 shutdown_connections 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.404+0000 7f0eca5ff700 1 -- 172.21.15.86:0/3363863487 wait complete. 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.405+0000 7f0eca5ff700 1 Processor -- start 2023-10-09T12:56:40.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.406+0000 7f0eca5ff700 1 -- start start 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.406+0000 7f0eca5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ec4159890 0x7f0ec414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0eca5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec4159c60 0x7f0ec4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0eca5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec415db10 0x7f0ec4152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0eca5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40cdc00 con 0x7f0ec4159890 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0eca5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40cd5f0 con 0x7f0ec415db10 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0eca5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec415fa50 con 0x7f0ec4159c60 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ec4159890 0x7f0ec414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:40.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ec4159890 0x7f0ec414d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42892/0 (socket says 172.21.15.86:42892) 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 -- 172.21.15.86:0/1916246219 learned_addr learned my addr 172.21.15.86:0/1916246219 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec8b9c700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec415db10 0x7f0ec4152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec37fe700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec4159c60 0x7f0ec4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 -- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec4159c60 msgr2=0x7f0ec4151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec4159c60 0x7f0ec4151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 -- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec415db10 msgr2=0x7f0ec4152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec415db10 0x7f0ec4152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 -- 172.21.15.86:0/1916246219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80094f0 con 0x7f0ec4159890 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec37fe700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec4159c60 0x7f0ec4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.407+0000 7f0ec3fff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ec4159890 0x7f0ec414d480 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400cb10 tx=0x7f0eb40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.408+0000 7f0eabfff700 1 -- 172.21.15.86:0/1916246219 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400a760 con 0x7f0ec4159890 2023-10-09T12:56:40.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.408+0000 7f0eabfff700 1 -- 172.21.15.86:0/1916246219 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400a8e0 con 0x7f0ec4159890 2023-10-09T12:56:40.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.408+0000 7f0eabfff700 1 -- 172.21.15.86:0/1916246219 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400aca0 con 0x7f0ec4159890 2023-10-09T12:56:40.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.408+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc009420 con 0x7f0ec4159890 2023-10-09T12:56:40.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.408+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40cd890 con 0x7f0ec4159890 2023-10-09T12:56:40.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.409+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec415ff50 con 0x7f0ec4159890 2023-10-09T12:56:40.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.410+0000 7f0eabfff700 1 -- 172.21.15.86:0/1916246219 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0eb4003030 con 0x7f0ec4159890 2023-10-09T12:56:40.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.411+0000 7f0eabfff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0eb0066f30 0x7f0eb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:40.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.411+0000 7f0eabfff700 1 -- 172.21.15.86:0/1916246219 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6053+0+0 (secure 0 0 0) 0x7f0eb4084ed0 con 0x7f0ec4159890 2023-10-09T12:56:40.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.411+0000 7f0ec37fe700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0eb0066f30 0x7f0eb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:40.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.412+0000 7f0ec37fe700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0eb0066f30 0x7f0eb00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80094c0 tx=0x7f0eb8008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:40.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.414+0000 7f0eabfff700 1 -- 172.21.15.86:0/1916246219 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0eb4052060 con 0x7f0ec4159890 2023-10-09T12:56:40.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:40.648+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0ec40cda50 con 0x7f0ec4159890 2023-10-09T12:56:41.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.203+0000 7f0eabfff700 1 -- 172.21.15.86:0/1916246219 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0eb4055680 con 0x7f0ec4159890 2023-10-09T12:56:41.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.211+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0eb0066f30 msgr2=0x7f0eb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.211+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0eb0066f30 0x7f0eb00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80094c0 tx=0x7f0eb8008040 comp rx=0 tx=0).stop 2023-10-09T12:56:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.211+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ec4159890 msgr2=0x7f0ec414d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.211+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ec4159890 0x7f0ec414d480 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400cb10 tx=0x7f0eb40017b0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.212+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 shutdown_connections 2023-10-09T12:56:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.212+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0eb0066f30 0x7f0eb00693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.212+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ec4159890 0x7f0ec414d480 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.212+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec415db10 0x7f0ec4152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.212+0000 7f0eca5ff700 1 --2- 172.21.15.86:0/1916246219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec4159c60 0x7f0ec4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.212+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 >> 172.21.15.86:0/1916246219 conn(0x7f0ec4068e20 msgr2=0x7f0ec40b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.212+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 shutdown_connections 2023-10-09T12:56:41.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.213+0000 7f0eca5ff700 1 -- 172.21.15.86:0/1916246219 wait complete. 2023-10-09T12:56:41.215 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 18 and data pool 19 2023-10-09T12:56:41.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:56:41.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.419+0000 7f4285bff700 1 Processor -- start 2023-10-09T12:56:41.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.419+0000 7f4285bff700 1 -- start start 2023-10-09T12:56:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.420+0000 7f4285bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800b1850 0x7f42800b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f4285bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42801579f0 0x7f42800abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f4285bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800cb300 con 0x7f42800ae680 2023-10-09T12:56:41.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f4285bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428006fc30 con 0x7f42801579f0 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f4285bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cc260 con 0x7f42800b1850 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42801579f0 0x7f42800abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42801579f0 0x7f42800abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42902/0 (socket says 172.21.15.86:42902) 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427ffff700 1 -- 172.21.15.86:0/1499465052 learned_addr learned my addr 172.21.15.86:0/1499465052 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427f7fe700 1 --2- 172.21.15.86:0/1499465052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800b1850 0x7f42800b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427ffff700 1 -- 172.21.15.86:0/1499465052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800b1850 msgr2=0x7f42800b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427ffff700 1 --2- 172.21.15.86:0/1499465052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800b1850 0x7f42800b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427ffff700 1 -- 172.21.15.86:0/1499465052 >> v1:172.21.15.135:6789/0 conn(0x7f42800ae680 legacy=0x7f42801572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.421+0000 7f427ffff700 1 -- 172.21.15.86:0/1499465052 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800cb5e0 con 0x7f42801579f0 2023-10-09T12:56:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f427ffff700 1 --2- 172.21.15.86:0/1499465052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42801579f0 0x7f42800abf60 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4278009f20 tx=0x7f4278009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad8e46dff98180d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f427e7fc700 1 -- 172.21.15.86:0/1499465052 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800e070 con 0x7f42801579f0 2023-10-09T12:56:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f427e7fc700 1 -- 172.21.15.86:0/1499465052 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800ba80 con 0x7f42801579f0 2023-10-09T12:56:41.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f427e7fc700 1 -- 172.21.15.86:0/1499465052 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780092e0 con 0x7f42801579f0 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f4285bff700 1 -- 172.21.15.86:0/1499465052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42801579f0 msgr2=0x7f42800abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f4285bff700 1 --2- 172.21.15.86:0/1499465052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42801579f0 0x7f42800abf60 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4278009f20 tx=0x7f4278009840 comp rx=0 tx=0).stop 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f4285bff700 1 -- 172.21.15.86:0/1499465052 shutdown_connections 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f4285bff700 1 --2- 172.21.15.86:0/1499465052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42801579f0 0x7f42800abf60 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f4285bff700 1 --2- 172.21.15.86:0/1499465052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800b1850 0x7f42800b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.422+0000 7f4285bff700 1 -- 172.21.15.86:0/1499465052 >> 172.21.15.86:0/1499465052 conn(0x7f428006a320 msgr2=0x7f42800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.423+0000 7f4285bff700 1 -- 172.21.15.86:0/1499465052 shutdown_connections 2023-10-09T12:56:41.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.423+0000 7f4285bff700 1 -- 172.21.15.86:0/1499465052 wait complete. 2023-10-09T12:56:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.424+0000 7f4285bff700 1 Processor -- start 2023-10-09T12:56:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.424+0000 7f4285bff700 1 -- start start 2023-10-09T12:56:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f4285bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800ae680 0x7f428015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f4285bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42800b1850 0x7f4280159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f4285bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801579f0 0x7f4280150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f4285bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280159ec0 con 0x7f42800b1850 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f4285bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428015c550 con 0x7f42801579f0 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f4285bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428015c830 con 0x7f42800ae680 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f427effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42800b1850 0x7f4280159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f427effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42800b1850 0x7f4280159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42904/0 (socket says 172.21.15.86:42904) 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f427effd700 1 -- 172.21.15.86:0/3108300051 learned_addr learned my addr 172.21.15.86:0/3108300051 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f427ffff700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801579f0 0x7f4280150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.425+0000 7f427f7fe700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800ae680 0x7f428015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f427effd700 1 -- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800ae680 msgr2=0x7f428015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f427effd700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800ae680 0x7f428015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f427effd700 1 -- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801579f0 msgr2=0x7f4280150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f427effd700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801579f0 0x7f4280150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f427effd700 1 -- 172.21.15.86:0/3108300051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009ae0 con 0x7f42800b1850 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f427effd700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42800b1850 0x7f4280159980 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f427400c590 tx=0x7f427400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f42677fe700 1 -- 172.21.15.86:0/3108300051 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011590 con 0x7f42800b1850 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f42677fe700 1 -- 172.21.15.86:0/3108300051 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274011710 con 0x7f42800b1850 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f42677fe700 1 -- 172.21.15.86:0/3108300051 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011ad0 con 0x7f42800b1850 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428015cb10 con 0x7f42800b1850 2023-10-09T12:56:41.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.426+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800af490 con 0x7f42800b1850 2023-10-09T12:56:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.427+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42800af6b0 con 0x7f42800b1850 2023-10-09T12:56:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.428+0000 7f42677fe700 1 -- 172.21.15.86:0/3108300051 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f427401b3b0 con 0x7f42800b1850 2023-10-09T12:56:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.429+0000 7f42677fe700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f426c066f30 0x7f426c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.429+0000 7f42677fe700 1 -- 172.21.15.86:0/3108300051 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f4274083c00 con 0x7f42800b1850 2023-10-09T12:56:41.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.429+0000 7f427f7fe700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f426c066f30 0x7f426c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.430+0000 7f427f7fe700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f426c066f30 0x7f426c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4270006fd0 tx=0x7f4270008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:41.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.433+0000 7f42677fe700 1 -- 172.21.15.86:0/3108300051 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4274050c10 con 0x7f42800b1850 2023-10-09T12:56:41.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.622+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f428004c3c0 con 0x7f42800b1850 2023-10-09T12:56:41.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.623+0000 7f42677fe700 1 -- 172.21.15.86:0/3108300051 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16112 (secure 0 0 0) 0x7f4274017070 con 0x7f42800b1850 2023-10-09T12:56:41.623 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:41.623 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":163,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:56:40.649302+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:56:38.265725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T12:56:39.638355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f426c066f30 msgr2=0x7f426c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f426c066f30 0x7f426c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4270006fd0 tx=0x7f4270008040 comp rx=0 tx=0).stop 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42800b1850 msgr2=0x7f4280159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42800b1850 0x7f4280159980 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f427400c590 tx=0x7f427400c8a0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 shutdown_connections 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42801579f0 0x7f4280150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42800ae680 0x7f428015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f426c066f30 0x7f426c0693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 --2- 172.21.15.86:0/3108300051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42800b1850 0x7f4280159980 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.625+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 >> 172.21.15.86:0/3108300051 conn(0x7f428006a320 msgr2=0x7f42800ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:41.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.626+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 shutdown_connections 2023-10-09T12:56:41.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.626+0000 7f4285bff700 1 -- 172.21.15.86:0/3108300051 wait complete. 2023-10-09T12:56:41.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:56:41.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.825+0000 7fcfbffff700 1 Processor -- start 2023-10-09T12:56:41.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.825+0000 7fcfbffff700 1 -- start start 2023-10-09T12:56:41.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.826+0000 7fcfbffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcfc006c0f0 0x7fcfc01642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.826+0000 7fcfbffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00b40f0 con 0x7fcfc0142ea0 2023-10-09T12:56:41.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.826+0000 7fcfbffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc0069640 con 0x7fcfc00ad870 2023-10-09T12:56:41.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.826+0000 7fcfbffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc0069920 con 0x7fcfc006c0f0 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.826+0000 7fcfbeffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcfc0142ea0 0x7fcfc00b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41334/0 (socket says 172.21.15.86:41334) 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.826+0000 7fcfbeffd700 1 -- 172.21.15.86:0/1490658481 learned_addr learned my addr 172.21.15.86:0/1490658481 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbf7fe700 1 --2- 172.21.15.86:0/1490658481 >> v2:172.21.15.135:3300/0 conn(0x7fcfc006c0f0 0x7fcfc01642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882672375 0 0) 0x7fcfc00b40f0 con 0x7fcfc0142ea0 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa8003570 con 0x7fcfc0142ea0 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1517885728 0 0) 0x7fcfa8003570 con 0x7fcfc0142ea0 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 >> v2:172.21.15.135:3300/0 conn(0x7fcfc006c0f0 msgr2=0x7fcfc01642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 --2- 172.21.15.86:0/1490658481 >> v2:172.21.15.135:3300/0 conn(0x7fcfc006c0f0 0x7fcfc01642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 >> v1:172.21.15.135:6789/0 conn(0x7fcfc00ad870 legacy=0x7fcfc006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0069c00 con 0x7fcfc0142ea0 2023-10-09T12:56:41.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fcfb0001470 con 0x7fcfc0142ea0 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 >> v1:172.21.15.86:6789/0 conn(0x7fcfc0142ea0 legacy=0x7fcfc00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa8003a60 0x7fcfa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8004810 0x7fcfa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa80051c0 0x7fcfa800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0069920 con 0x7fcfa8003a60 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa800c0d0 con 0x7fcfa8004810 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.827+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa800c290 con 0x7fcfa80051c0 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbeffd700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa8003a60 0x7fcfa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbf7fe700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa80051c0 0x7fcfa800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbe7fc700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8004810 0x7fcfa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbeffd700 1 -- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa80051c0 msgr2=0x7fcfa800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:41.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbeffd700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa80051c0 0x7fcfa800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbeffd700 1 -- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8004810 msgr2=0x7fcfa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbeffd700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa8004810 0x7fcfa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbeffd700 1 -- 172.21.15.86:0/1490658481 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8003570 con 0x7fcfa8003a60 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbf7fe700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa80051c0 0x7fcfa800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbf7fe700 1 -- 172.21.15.86:0/1490658481 reap_dead start 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbeffd700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa8003a60 0x7fcfa8003e70 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c3c0 tx=0x7fcfb0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e2307dde359631 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000cc90 con 0x7fcfa8003a60 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000cdf0 con 0x7fcfa8003a60 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.828+0000 7fcfbdffb700 1 -- 172.21.15.86:0/1490658481 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0005b50 con 0x7fcfa8003a60 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.829+0000 7fcfbffff700 1 -- 172.21.15.86:0/1490658481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa8003a60 msgr2=0x7fcfa8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.829+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa8003a60 0x7fcfa8003e70 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c3c0 tx=0x7fcfb0001e50 comp rx=0 tx=0).stop 2023-10-09T12:56:41.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.829+0000 7fcfbffff700 1 -- 172.21.15.86:0/1490658481 shutdown_connections 2023-10-09T12:56:41.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.829+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1490658481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa8003a60 0x7fcfa8003e70 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.829+0000 7fcfbffff700 1 -- 172.21.15.86:0/1490658481 >> 172.21.15.86:0/1490658481 conn(0x7fcfc00ce430 msgr2=0x7fcfc00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:41.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.829+0000 7fcfbffff700 1 -- 172.21.15.86:0/1490658481 shutdown_connections 2023-10-09T12:56:41.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.829+0000 7fcfbffff700 1 -- 172.21.15.86:0/1490658481 wait complete. 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.830+0000 7fcfbffff700 1 Processor -- start 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.831+0000 7fcfbffff700 1 -- start start 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.831+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa8003a60 0x7fcfc00b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.831+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00aef90 0x7fcfc00af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.831+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfc0158ba0 0x7fcfc0159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00b0010 con 0x7fcfc0158ba0 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0159560 con 0x7fcfc00aef90 2023-10-09T12:56:41.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc015cf60 con 0x7fcfa8003a60 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfc0158ba0 0x7fcfc0159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfc0158ba0 0x7fcfc0159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42912/0 (socket says 172.21.15.86:42912) 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 -- 172.21.15.86:0/1040850942 learned_addr learned my addr 172.21.15.86:0/1040850942 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbeffd700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa8003a60 0x7fcfc00b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbe7fc700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00aef90 0x7fcfc00af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 -- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa8003a60 msgr2=0x7fcfc00b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa8003a60 0x7fcfc00b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 -- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00aef90 msgr2=0x7fcfc00af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00aef90 0x7fcfc00af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 -- 172.21.15.86:0/1040850942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00afa50 con 0x7fcfc0158ba0 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfbf7fe700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfc0158ba0 0x7fcfc0159020 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fcfc006c4f0 tx=0x7fcfb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:41.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.832+0000 7fcfa6ffd700 1 -- 172.21.15.86:0/1040850942 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb801b070 con 0x7fcfc0158ba0 2023-10-09T12:56:41.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.833+0000 7fcfa6ffd700 1 -- 172.21.15.86:0/1040850942 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb800f040 con 0x7fcfc0158ba0 2023-10-09T12:56:41.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.833+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc00afd30 con 0x7fcfc0158ba0 2023-10-09T12:56:41.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.833+0000 7fcfa6ffd700 1 -- 172.21.15.86:0/1040850942 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800e050 con 0x7fcfc0158ba0 2023-10-09T12:56:41.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.833+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc015d470 con 0x7fcfc0158ba0 2023-10-09T12:56:41.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.834+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc004c3c0 con 0x7fcfc0158ba0 2023-10-09T12:56:41.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.835+0000 7fcfa6ffd700 1 -- 172.21.15.86:0/1040850942 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfb8003020 con 0x7fcfc0158ba0 2023-10-09T12:56:41.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.835+0000 7fcfa6ffd700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcfac066f30 0x7fcfac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:41.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.836+0000 7fcfa6ffd700 1 -- 172.21.15.86:0/1040850942 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fcfb8084b60 con 0x7fcfc0158ba0 2023-10-09T12:56:41.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.836+0000 7fcfbeffd700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcfac066f30 0x7fcfac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:41.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.836+0000 7fcfbeffd700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcfac066f30 0x7fcfac0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0007cd0 tx=0x7fcfb0015000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:41.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:41.840+0000 7fcfa6ffd700 1 -- 172.21.15.86:0/1040850942 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfb8051c10 con 0x7fcfc0158ba0 2023-10-09T12:56:42.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.029+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfc0143270 con 0x7fcfc0158ba0 2023-10-09T12:56:42.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.030+0000 7fcfa6ffd700 1 -- 172.21.15.86:0/1040850942 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16112 (secure 0 0 0) 0x7fcfb8055230 con 0x7fcfc0158ba0 2023-10-09T12:56:42.031 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:42.031 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":163,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:56:40.649302+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:56:38.265725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T12:56:39.638355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:56:42.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcfac066f30 msgr2=0x7fcfac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:42.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcfac066f30 0x7fcfac0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0007cd0 tx=0x7fcfb0015000 comp rx=0 tx=0).stop 2023-10-09T12:56:42.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfc0158ba0 msgr2=0x7fcfc0159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfc0158ba0 0x7fcfc0159020 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fcfc006c4f0 tx=0x7fcfb800b040 comp rx=0 tx=0).stop 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 shutdown_connections 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcfac066f30 0x7fcfac0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfc0158ba0 0x7fcfc0159020 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa8003a60 0x7fcfc00b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 --2- 172.21.15.86:0/1040850942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00aef90 0x7fcfc00af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 >> 172.21.15.86:0/1040850942 conn(0x7fcfc00ce430 msgr2=0x7fcfc00cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 shutdown_connections 2023-10-09T12:56:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.033+0000 7fcfbffff700 1 -- 172.21.15.86:0/1040850942 wait complete. 2023-10-09T12:56:42.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T12:56:42.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.237+0000 7f8eb89ff700 1 Processor -- start 2023-10-09T12:56:42.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.237+0000 7f8eb89ff700 1 -- start start 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.238+0000 7f8eb89ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb415ac80 0x7f8eb4069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.238+0000 7f8eb89ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8eb4069cb0 0x7f8eb40c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.238+0000 7f8eb89ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb40af2f0 con 0x7f8eb415b050 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.238+0000 7f8eb89ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb40af5d0 con 0x7f8eb415ac80 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.238+0000 7f8eb89ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb406a0e0 con 0x7f8eb4069cb0 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eb259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb415ac80 0x7f8eb4069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eabfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8eb415b050 0x7f8eb40afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41338/0 (socket says 172.21.15.86:41338) 2023-10-09T12:56:42.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eabfff700 1 -- 172.21.15.86:0/3564919784 learned_addr learned my addr 172.21.15.86:0/3564919784 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eb2d9d700 1 --2- 172.21.15.86:0/3564919784 >> v2:172.21.15.135:3300/0 conn(0x7f8eb4069cb0 0x7f8eb40c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eb259c700 1 -- 172.21.15.86:0/3564919784 >> v2:172.21.15.135:3300/0 conn(0x7f8eb4069cb0 msgr2=0x7f8eb40c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eb259c700 1 --2- 172.21.15.86:0/3564919784 >> v2:172.21.15.135:3300/0 conn(0x7f8eb4069cb0 0x7f8eb40c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eb1d9b700 1 -- 172.21.15.86:0/3564919784 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071132905 0 0) 0x7f8eb40af2f0 con 0x7f8eb415b050 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eb259c700 1 -- 172.21.15.86:0/3564919784 >> v1:172.21.15.86:6789/0 conn(0x7f8eb415b050 legacy=0x7f8eb40afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.239+0000 7f8eb259c700 1 -- 172.21.15.86:0/3564919784 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40c8660 con 0x7f8eb415ac80 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb259c700 1 --2- 172.21.15.86:0/3564919784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415ac80 0x7f8eb4069770 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8eb406d240 tx=0x7f8ea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a8ac3e14e7d57d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb1d9b700 1 -- 172.21.15.86:0/3564919784 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011630 con 0x7f8eb415ac80 2023-10-09T12:56:42.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb1d9b700 1 -- 172.21.15.86:0/3564919784 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4011790 con 0x7f8eb415ac80 2023-10-09T12:56:42.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb1d9b700 1 -- 172.21.15.86:0/3564919784 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011b30 con 0x7f8eb415ac80 2023-10-09T12:56:42.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 -- 172.21.15.86:0/3564919784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415ac80 msgr2=0x7f8eb4069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/3564919784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415ac80 0x7f8eb4069770 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f8eb406d240 tx=0x7f8ea40091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 -- 172.21.15.86:0/3564919784 shutdown_connections 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/3564919784 >> v2:172.21.15.135:3300/0 conn(0x7f8eb4069cb0 0x7f8eb40c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/3564919784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415ac80 0x7f8eb4069770 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 -- 172.21.15.86:0/3564919784 >> 172.21.15.86:0/3564919784 conn(0x7f8eb4068e10 msgr2=0x7f8eb40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 -- 172.21.15.86:0/3564919784 shutdown_connections 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.240+0000 7f8eb89ff700 1 -- 172.21.15.86:0/3564919784 wait complete. 2023-10-09T12:56:42.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.242+0000 7f8eb89ff700 1 Processor -- start 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.242+0000 7f8eb89ff700 1 -- start start 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb89ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb4069cb0 0x7f8eb40c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb89ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb415ac80 0x7f8eb40c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb89ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415b050 0x7f8eb415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb89ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40c7b30 con 0x7f8eb415b050 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb89ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40c6cd0 con 0x7f8eb415ac80 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb89ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb415c530 con 0x7f8eb4069cb0 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415b050 0x7f8eb415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:42.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415b050 0x7f8eb415bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42932/0 (socket says 172.21.15.86:42932) 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 -- 172.21.15.86:0/4174548625 learned_addr learned my addr 172.21.15.86:0/4174548625 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb259c700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb4069cb0 0x7f8eb40c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eabfff700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb415ac80 0x7f8eb40c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 -- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb4069cb0 msgr2=0x7f8eb40c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb4069cb0 0x7f8eb40c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 -- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb415ac80 msgr2=0x7f8eb40c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb415ac80 0x7f8eb40c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb2d9d700 1 -- 172.21.15.86:0/4174548625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009420 con 0x7f8eb415b050 2023-10-09T12:56:42.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.243+0000 7f8eb259c700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb4069cb0 0x7f8eb40c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:42.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.244+0000 7f8eb2d9d700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415b050 0x7f8eb415bff0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009ec0 tx=0x7f8eac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:42.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.244+0000 7f8eaa7fc700 1 -- 172.21.15.86:0/4174548625 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00cc20 con 0x7f8eb415b050 2023-10-09T12:56:42.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.244+0000 7f8eaa7fc700 1 -- 172.21.15.86:0/4174548625 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac00f040 con 0x7f8eb415b050 2023-10-09T12:56:42.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.244+0000 7f8eaa7fc700 1 -- 172.21.15.86:0/4174548625 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac014480 con 0x7f8eb415b050 2023-10-09T12:56:42.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.244+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb40c6f20 con 0x7f8eb415b050 2023-10-09T12:56:42.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.244+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb40c74e0 con 0x7f8eb415b050 2023-10-09T12:56:42.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.245+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb404c3c0 con 0x7f8eb415b050 2023-10-09T12:56:42.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.246+0000 7f8eaa7fc700 1 -- 172.21.15.86:0/4174548625 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8eac014830 con 0x7f8eb415b050 2023-10-09T12:56:42.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.247+0000 7f8eaa7fc700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e94066f30 0x7f8e940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:42.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.247+0000 7f8eaa7fc700 1 -- 172.21.15.86:0/4174548625 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f8eac0854d0 con 0x7f8eb415b050 2023-10-09T12:56:42.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.247+0000 7f8eb259c700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e94066f30 0x7f8e940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:42.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.248+0000 7f8eb259c700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e94066f30 0x7f8e940693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40093f0 tx=0x7f8ea4017000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:42.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.251+0000 7f8eaa7fc700 1 -- 172.21.15.86:0/4174548625 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8eac055f70 con 0x7f8eb415b050 2023-10-09T12:56:42.488 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:42.487+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8eb4156590 con 0x7f8eb415b050 2023-10-09T12:56:43.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.212+0000 7f8eaa7fc700 1 -- 172.21.15.86:0/4174548625 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8eac055b00 con 0x7f8eb415b050 2023-10-09T12:56:43.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e94066f30 msgr2=0x7f8e940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:43.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e94066f30 0x7f8e940693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40093f0 tx=0x7f8ea4017000 comp rx=0 tx=0).stop 2023-10-09T12:56:43.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415b050 msgr2=0x7f8eb415bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:43.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415b050 0x7f8eb415bff0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009ec0 tx=0x7f8eac00b040 comp rx=0 tx=0).stop 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 shutdown_connections 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e94066f30 0x7f8e940693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb415b050 0x7f8eb415bff0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb4069cb0 0x7f8eb40c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 --2- 172.21.15.86:0/4174548625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb415ac80 0x7f8eb40c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 >> 172.21.15.86:0/4174548625 conn(0x7f8eb4068e10 msgr2=0x7f8eb406daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 shutdown_connections 2023-10-09T12:56:43.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.215+0000 7f8eb89ff700 1 -- 172.21.15.86:0/4174548625 wait complete. 2023-10-09T12:56:43.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T12:56:43.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.420+0000 7f09d09fe700 1 Processor -- start 2023-10-09T12:56:43.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.420+0000 7f09d09fe700 1 -- start start 2023-10-09T12:56:43.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.421+0000 7f09d09fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:43.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.421+0000 7f09d09fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f09cc0c9db0 0x7f09cc06a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:43.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.421+0000 7f09d09fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc06e150 con 0x7f09cc157130 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.421+0000 7f09d09fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc0c7800 con 0x7f09cc0c9db0 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.421+0000 7f09d09fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0c7ae0 con 0x7f09cc153900 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.421+0000 7f09cb59e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f09cc157130 0x7f09cc159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41344/0 (socket says 172.21.15.86:41344) 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.421+0000 7f09cb59e700 1 -- 172.21.15.86:0/2218685232 learned_addr learned my addr 172.21.15.86:0/2218685232 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09cad9d700 1 --2- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09c3fff700 1 --2- 172.21.15.86:0/2218685232 >> v2:172.21.15.135:3300/0 conn(0x7f09cc0c9db0 0x7f09cc06a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09ca59c700 1 -- 172.21.15.86:0/2218685232 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105599009 0 0) 0x7f09cc06e150 con 0x7f09cc157130 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09ca59c700 1 -- 172.21.15.86:0/2218685232 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b8003570 con 0x7f09cc157130 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09ca59c700 1 -- 172.21.15.86:0/2218685232 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 337620712 0 0) 0x7f09b8003570 con 0x7f09cc157130 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09c3fff700 1 -- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 msgr2=0x7f09cc0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:43.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09c3fff700 1 --2- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09c3fff700 1 -- 172.21.15.86:0/2218685232 >> v1:172.21.15.86:6789/0 conn(0x7f09cc157130 legacy=0x7f09cc159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:43.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09c3fff700 1 -- 172.21.15.86:0/2218685232 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0c7dc0 con 0x7f09cc0c9db0 2023-10-09T12:56:43.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09cad9d700 1 --2- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:43.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.422+0000 7f09c3fff700 1 --2- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 0x7f09cc06a000 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f09b40098e0 tx=0x7f09b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faddff359dc83b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:43.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09ca59c700 1 -- 172.21.15.86:0/2218685232 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40017f0 con 0x7f09cc0c9db0 2023-10-09T12:56:43.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09ca59c700 1 -- 172.21.15.86:0/2218685232 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b4011420 con 0x7f09cc0c9db0 2023-10-09T12:56:43.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09ca59c700 1 -- 172.21.15.86:0/2218685232 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40117c0 con 0x7f09cc0c9db0 2023-10-09T12:56:43.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 -- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 msgr2=0x7f09cc06a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:43.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 0x7f09cc06a000 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f09b40098e0 tx=0x7f09b40091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 -- 172.21.15.86:0/2218685232 shutdown_connections 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2218685232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 0x7f09cc06a000 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 -- 172.21.15.86:0/2218685232 >> 172.21.15.86:0/2218685232 conn(0x7f09cc0cc1e0 msgr2=0x7f09cc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 -- 172.21.15.86:0/2218685232 shutdown_connections 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.423+0000 7f09d09fe700 1 -- 172.21.15.86:0/2218685232 wait complete. 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.425+0000 7f09d09fe700 1 Processor -- start 2023-10-09T12:56:43.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.425+0000 7f09d09fe700 1 -- start start 2023-10-09T12:56:43.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09d09fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 0x7f09cc1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:43.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09d09fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:43.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09d09fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09cc157130 0x7f09cc0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:43.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09d09fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0c4c40 con 0x7f09cc157130 2023-10-09T12:56:43.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09d09fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc1527f0 con 0x7f09cc0c9db0 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09d09fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0c4180 con 0x7f09cc153900 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09cc157130 0x7f09cc0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09cc157130 0x7f09cc0b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42942/0 (socket says 172.21.15.86:42942) 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 -- 172.21.15.86:0/2235723997 learned_addr learned my addr 172.21.15.86:0/2235723997 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cad9d700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 0x7f09cc1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09c3fff700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 -- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 msgr2=0x7f09cc0c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 -- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 msgr2=0x7f09cc1522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 0x7f09cc1522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:43.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.426+0000 7f09cb59e700 1 -- 172.21.15.86:0/2235723997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc009420 con 0x7f09cc157130 2023-10-09T12:56:43.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.427+0000 7f09cb59e700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09cc157130 0x7f09cc0b18b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f09c400cb70 tx=0x7f09c4007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:43.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.427+0000 7f09c2ffd700 1 -- 172.21.15.86:0/2235723997 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4004dc0 con 0x7f09cc157130 2023-10-09T12:56:43.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.427+0000 7f09c2ffd700 1 -- 172.21.15.86:0/2235723997 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c400a6c0 con 0x7f09cc157130 2023-10-09T12:56:43.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.427+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b4009420 con 0x7f09cc157130 2023-10-09T12:56:43.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.427+0000 7f09c2ffd700 1 -- 172.21.15.86:0/2235723997 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400aa80 con 0x7f09cc157130 2023-10-09T12:56:43.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.427+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc0b1df0 con 0x7f09cc157130 2023-10-09T12:56:43.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.428+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc06c450 con 0x7f09cc157130 2023-10-09T12:56:43.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.429+0000 7f09c2ffd700 1 -- 172.21.15.86:0/2235723997 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09c4007150 con 0x7f09cc157130 2023-10-09T12:56:43.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.430+0000 7f09c2ffd700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f09ac066f30 0x7f09ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:43.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.430+0000 7f09c2ffd700 1 -- 172.21.15.86:0/2235723997 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f09c4084140 con 0x7f09cc157130 2023-10-09T12:56:43.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.431+0000 7f09cad9d700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f09ac066f30 0x7f09ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:43.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.431+0000 7f09cad9d700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f09ac066f30 0x7f09ac0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0093f0 tx=0x7f09bc008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:43.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.435+0000 7f09c2ffd700 1 -- 172.21.15.86:0/2235723997 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09c40511d0 con 0x7f09cc157130 2023-10-09T12:56:43.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:43.669+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f09cc0b1df0 con 0x7f09cc157130 2023-10-09T12:56:44.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.214+0000 7f09c2ffd700 1 -- 172.21.15.86:0/2235723997 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) v1 ==== 122+0+0 (secure 0 0 0) 0x7f09cc0b1df0 con 0x7f09cc157130 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f09ac066f30 msgr2=0x7f09ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f09ac066f30 0x7f09ac0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0093f0 tx=0x7f09bc008040 comp rx=0 tx=0).stop 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09cc157130 msgr2=0x7f09cc0b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09cc157130 0x7f09cc0b18b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f09c400cb70 tx=0x7f09c4007c70 comp rx=0 tx=0).stop 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 shutdown_connections 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f09ac066f30 0x7f09ac0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09cc157130 0x7f09cc0b18b0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc0c9db0 0x7f09cc1522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 --2- 172.21.15.86:0/2235723997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc153900 0x7f09cc0c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.216+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 >> 172.21.15.86:0/2235723997 conn(0x7f09cc0cc1e0 msgr2=0x7f09cc0ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:44.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.217+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 shutdown_connections 2023-10-09T12:56:44.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.217+0000 7f09d09fe700 1 -- 172.21.15.86:0/2235723997 wait complete. 2023-10-09T12:56:44.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:56:44.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.416+0000 7feeb27ff700 1 Processor -- start 2023-10-09T12:56:44.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.416+0000 7feeb27ff700 1 -- start start 2023-10-09T12:56:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.417+0000 7feeb27ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feeac0b0a10 0x7feeac155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.417+0000 7feeb27ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0ad930 con 0x7feeac155c10 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.417+0000 7feeb27ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0acd20 con 0x7feeac1578b0 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.417+0000 7feeb27ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0ad000 con 0x7feeac0b0a10 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeabfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7feeac155c10 0x7feeac0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41350/0 (socket says 172.21.15.86:41350) 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeabfff700 1 -- 172.21.15.86:0/1529264933 learned_addr learned my addr 172.21.15.86:0/1529264933 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeb0d9c700 1 --2- 172.21.15.86:0/1529264933 >> v2:172.21.15.135:3300/0 conn(0x7feeac0b0a10 0x7feeac155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054589788 0 0) 0x7feeac0ad930 con 0x7feeac155c10 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee94004680 con 0x7feeac155c10 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96025554 0 0) 0x7fee94004680 con 0x7feeac155c10 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 >> v2:172.21.15.135:3300/0 conn(0x7feeac0b0a10 msgr2=0x7feeac155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 --2- 172.21.15.86:0/1529264933 >> v2:172.21.15.135:3300/0 conn(0x7feeac0b0a10 0x7feeac155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 >> v1:172.21.15.135:6789/0 conn(0x7feeac1578b0 legacy=0x7feeac0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0ad2e0 con 0x7feeac155c10 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fee9c001470 con 0x7feeac155c10 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeb0d9c700 1 --2- 172.21.15.86:0/1529264933 >> v2:172.21.15.135:3300/0 conn(0x7feeac0b0a10 0x7feeac155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.418+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 >> v1:172.21.15.86:6789/0 conn(0x7feeac155c10 legacy=0x7feeac0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeaaffd700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee94004b70 0x7fee94004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeaaffd700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94005920 0x7fee94005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeaaffd700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee940062d0 0x7fee9400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0ad000 con 0x7fee94004b70 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400d1e0 con 0x7fee94005920 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee94003510 con 0x7fee940062d0 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeabfff700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee94004b70 0x7fee94004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeab7fe700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94005920 0x7fee94005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeb0d9c700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee940062d0 0x7fee9400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeabfff700 1 -- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee940062d0 msgr2=0x7fee9400cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeabfff700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee940062d0 0x7fee9400cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeabfff700 1 -- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94005920 msgr2=0x7fee94005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeabfff700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94005920 0x7fee94005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeabfff700 1 -- 172.21.15.86:0/1529264933 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94004680 con 0x7fee94004b70 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeb0d9c700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee940062d0 0x7fee9400cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeb0d9c700 1 -- 172.21.15.86:0/1529264933 reap_dead start 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.419+0000 7feeabfff700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee94004b70 0x7fee94004f80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c3c0 tx=0x7fee9c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b22d5490b62291 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00cc90 con 0x7fee94004b70 2023-10-09T12:56:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00cdf0 con 0x7fee94004b70 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeaaffd700 1 -- 172.21.15.86:0/1529264933 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c005b50 con 0x7fee94004b70 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeb27ff700 1 -- 172.21.15.86:0/1529264933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee94004b70 msgr2=0x7fee94004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeb27ff700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee94004b70 0x7fee94004f80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c3c0 tx=0x7fee9c001e50 comp rx=0 tx=0).stop 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeb27ff700 1 -- 172.21.15.86:0/1529264933 shutdown_connections 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeb27ff700 1 --2- 172.21.15.86:0/1529264933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee94004b70 0x7fee94004f80 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeb27ff700 1 -- 172.21.15.86:0/1529264933 >> 172.21.15.86:0/1529264933 conn(0x7feeac06a320 msgr2=0x7feeac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeb27ff700 1 -- 172.21.15.86:0/1529264933 shutdown_connections 2023-10-09T12:56:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.420+0000 7feeb27ff700 1 -- 172.21.15.86:0/1529264933 wait complete. 2023-10-09T12:56:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.422+0000 7feeb27ff700 1 Processor -- start 2023-10-09T12:56:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.422+0000 7feeb27ff700 1 -- start start 2023-10-09T12:56:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeb27ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94004b70 0x7feeac14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeb27ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeac138850 0x7feeac147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeb27ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeac14aae0 0x7feeac1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeb27ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15d020 con 0x7feeac138850 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeb27ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15dba0 con 0x7fee94004b70 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeb27ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15d270 con 0x7feeac14aae0 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeac138850 0x7feeac147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeab7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeac138850 0x7feeac147d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42958/0 (socket says 172.21.15.86:42958) 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeab7fe700 1 -- 172.21.15.86:0/104620782 learned_addr learned my addr 172.21.15.86:0/104620782 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeabfff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94004b70 0x7feeac14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeb0d9c700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeac14aae0 0x7feeac1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.423+0000 7feeab7fe700 1 -- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeac14aae0 msgr2=0x7feeac1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7feeab7fe700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeac14aae0 0x7feeac1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7feeab7fe700 1 -- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94004b70 msgr2=0x7feeac14a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7feeab7fe700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94004b70 0x7feeac14a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7feeab7fe700 1 -- 172.21.15.86:0/104620782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac15d550 con 0x7feeac138850 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7feeab7fe700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeac138850 0x7feeac147d70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7feea000e590 tx=0x7feea0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7fee93fff700 1 -- 172.21.15.86:0/104620782 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0012590 con 0x7feeac138850 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7fee93fff700 1 -- 172.21.15.86:0/104620782 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00126f0 con 0x7feeac138850 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac15d830 con 0x7feeac138850 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7fee93fff700 1 -- 172.21.15.86:0/104620782 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0012ab0 con 0x7feeac138850 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.424+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac068810 con 0x7feeac138850 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.425+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac15dd10 con 0x7feeac138850 2023-10-09T12:56:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.426+0000 7fee93fff700 1 -- 172.21.15.86:0/104620782 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feea0013420 con 0x7feeac138850 2023-10-09T12:56:44.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.427+0000 7fee93fff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fee98066f30 0x7fee980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.427+0000 7fee93fff700 1 -- 172.21.15.86:0/104620782 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7feea0084600 con 0x7feeac138850 2023-10-09T12:56:44.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.427+0000 7feeabfff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fee98066f30 0x7fee980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.428+0000 7feeabfff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fee98066f30 0x7fee980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feeac06aa40 tx=0x7fee9c015000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:44.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.431+0000 7fee93fff700 1 -- 172.21.15.86:0/104620782 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea0051610 con 0x7feeac138850 2023-10-09T12:56:44.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.665+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeac04c3c0 con 0x7feeac138850 2023-10-09T12:56:44.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.666+0000 7fee93fff700 1 -- 172.21.15.86:0/104620782 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4602 (secure 0 0 0) 0x7feea0054c30 con 0x7feeac138850 2023-10-09T12:56:44.666 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:44.666 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/2700721489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2700721489},{"type":"v1","addr":"172.21.15.135:6834","nonce":2700721489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1754968847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1754968847},{"type":"v1","addr":"172.21.15.135:6835","nonce":1754968847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/885619835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":885619835},{"type":"v1","addr":"172.21.15.86:6834","nonce":885619835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:56:40.649653+0000","modified":"2023-10-09T12:56:44.211663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8580":{"gid":8580,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3313043174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":3313043174},{"type":"v1","addr":"172.21.15.86:6835","nonce":3313043174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T12:56:44.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fee98066f30 msgr2=0x7fee980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fee98066f30 0x7fee980693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feeac06aa40 tx=0x7fee9c015000 comp rx=0 tx=0).stop 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeac138850 msgr2=0x7feeac147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeac138850 0x7feeac147d70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7feea000e590 tx=0x7feea0009040 comp rx=0 tx=0).stop 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 shutdown_connections 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeac14aae0 0x7feeac1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee94004b70 0x7feeac14a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fee98066f30 0x7fee980693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 --2- 172.21.15.86:0/104620782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeac138850 0x7feeac147d70 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 >> 172.21.15.86:0/104620782 conn(0x7feeac06a320 msgr2=0x7feeac14eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 shutdown_connections 2023-10-09T12:56:44.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.668+0000 7feeb27ff700 1 -- 172.21.15.86:0/104620782 wait complete. 2023-10-09T12:56:44.670 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 71 2023-10-09T12:56:44.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:56:44.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.867+0000 7fcb74d9d700 1 Processor -- start 2023-10-09T12:56:44.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.867+0000 7fcb74d9d700 1 -- start start 2023-10-09T12:56:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.868+0000 7fcb74d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb70159420 0x7fcb700b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.868+0000 7fcb74d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcb701597f0 0x7fcb700b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.868+0000 7fcb74d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700b11d0 con 0x7fcb7015d230 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.868+0000 7fcb74d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700b14b0 con 0x7fcb70159420 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.868+0000 7fcb74d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700b1790 con 0x7fcb701597f0 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.868+0000 7fcb6f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb70159420 0x7fcb700b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb70159420 0x7fcb700b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42962/0 (socket says 172.21.15.86:42962) 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/1246311413 learned_addr learned my addr 172.21.15.86:0/1246311413 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6effd700 1 --2- 172.21.15.86:0/1246311413 >> v2:172.21.15.135:3300/0 conn(0x7fcb701597f0 0x7fcb700b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/1246311413 >> v2:172.21.15.135:3300/0 conn(0x7fcb701597f0 msgr2=0x7fcb700b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6f7fe700 1 --2- 172.21.15.86:0/1246311413 >> v2:172.21.15.135:3300/0 conn(0x7fcb701597f0 0x7fcb700b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/1246311413 >> v1:172.21.15.135:6789/0 conn(0x7fcb7015d230 legacy=0x7fcb7015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/1246311413 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700b1a70 con 0x7fcb70159420 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.869+0000 7fcb6f7fe700 1 --2- 172.21.15.86:0/1246311413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700b5f40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fcb70089750 tx=0x7fcb60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6c4ec939a0f510 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb6e7fc700 1 -- 172.21.15.86:0/1246311413 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60009e70 con 0x7fcb70159420 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb6e7fc700 1 -- 172.21.15.86:0/1246311413 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6000b860 con 0x7fcb70159420 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb6e7fc700 1 -- 172.21.15.86:0/1246311413 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000bc00 con 0x7fcb70159420 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 -- 172.21.15.86:0/1246311413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 msgr2=0x7fcb700b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/1246311413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700b5f40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fcb70089750 tx=0x7fcb60009250 comp rx=0 tx=0).stop 2023-10-09T12:56:44.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 -- 172.21.15.86:0/1246311413 shutdown_connections 2023-10-09T12:56:44.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/1246311413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700b5f40 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/1246311413 >> v2:172.21.15.135:3300/0 conn(0x7fcb701597f0 0x7fcb700b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 -- 172.21.15.86:0/1246311413 >> 172.21.15.86:0/1246311413 conn(0x7fcb700d0660 msgr2=0x7fcb700d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:44.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 -- 172.21.15.86:0/1246311413 shutdown_connections 2023-10-09T12:56:44.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.870+0000 7fcb74d9d700 1 -- 172.21.15.86:0/1246311413 wait complete. 2023-10-09T12:56:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.872+0000 7fcb74d9d700 1 Processor -- start 2023-10-09T12:56:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.872+0000 7fcb74d9d700 1 -- start start 2023-10-09T12:56:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb74d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb74d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb701597f0 0x7fcb700cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb74d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb7015d230 0x7fcb70155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb74d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700cb9c0 con 0x7fcb70159420 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb74d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700cf970 con 0x7fcb701597f0 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb74d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700cfc50 con 0x7fcb7015d230 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42970/0 (socket says 172.21.15.86:42970) 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/518789521 learned_addr learned my addr 172.21.15.86:0/518789521 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6effd700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb701597f0 0x7fcb700cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6ffff700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb7015d230 0x7fcb70155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb7015d230 msgr2=0x7fcb70155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb7015d230 0x7fcb70155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb701597f0 msgr2=0x7fcb700cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb701597f0 0x7fcb700cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6f7fe700 1 -- 172.21.15.86:0/518789521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600094f0 con 0x7fcb70159420 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.873+0000 7fcb6ffff700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb7015d230 0x7fcb70155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.874+0000 7fcb6f7fe700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700cf340 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fcb70089340 tx=0x7fcb60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.874+0000 7fcb577fe700 1 -- 172.21.15.86:0/518789521 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011420 con 0x7fcb70159420 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.874+0000 7fcb577fe700 1 -- 172.21.15.86:0/518789521 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb600115a0 con 0x7fcb70159420 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.874+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb700cff30 con 0x7fcb70159420 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.874+0000 7fcb577fe700 1 -- 172.21.15.86:0/518789521 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011960 con 0x7fcb70159420 2023-10-09T12:56:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.874+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb700c5ba0 con 0x7fcb70159420 2023-10-09T12:56:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.875+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7004c3c0 con 0x7fcb70159420 2023-10-09T12:56:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.876+0000 7fcb577fe700 1 -- 172.21.15.86:0/518789521 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb600253f0 con 0x7fcb70159420 2023-10-09T12:56:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.877+0000 7fcb577fe700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcb5c066f30 0x7fcb5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:44.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.877+0000 7fcb577fe700 1 -- 172.21.15.86:0/518789521 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fcb600860e0 con 0x7fcb70159420 2023-10-09T12:56:44.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.877+0000 7fcb6effd700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcb5c066f30 0x7fcb5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:44.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.878+0000 7fcb6effd700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcb5c066f30 0x7fcb5c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb700cbdf0 tx=0x7fcb64008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:44.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:44.881+0000 7fcb577fe700 1 -- 172.21.15.86:0/518789521 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb60053190 con 0x7fcb70159420 2023-10-09T12:56:45.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.072+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb700b1d50 con 0x7fcb70159420 2023-10-09T12:56:45.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.073+0000 7fcb577fe700 1 -- 172.21.15.86:0/518789521 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16099 (secure 0 0 0) 0x7fcb600567b0 con 0x7fcb70159420 2023-10-09T12:56:45.073 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:45.073 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":164,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:56:42.185359+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:56:38.265725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T12:56:39.638355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:56:45.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcb5c066f30 msgr2=0x7fcb5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcb5c066f30 0x7fcb5c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb700cbdf0 tx=0x7fcb64008040 comp rx=0 tx=0).stop 2023-10-09T12:56:45.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 msgr2=0x7fcb700cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700cf340 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fcb70089340 tx=0x7fcb60017000 comp rx=0 tx=0).stop 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 shutdown_connections 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fcb5c066f30 0x7fcb5c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb70159420 0x7fcb700cf340 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb7015d230 0x7fcb70155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 --2- 172.21.15.86:0/518789521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb701597f0 0x7fcb700cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 >> 172.21.15.86:0/518789521 conn(0x7fcb700d0660 msgr2=0x7fcb70156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 shutdown_connections 2023-10-09T12:56:45.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.075+0000 7fcb74d9d700 1 -- 172.21.15.86:0/518789521 wait complete. 2023-10-09T12:56:45.092 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T12:56:45.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:56:45.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.275+0000 7f97e25ff700 1 Processor -- start 2023-10-09T12:56:45.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.275+0000 7f97e25ff700 1 -- start start 2023-10-09T12:56:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97e25ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0cbf30 0x7f97dc0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97e25ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f97dc0ccf90 0x7f97dc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97e25ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f97dc15a270 0x7f97dc0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97e25ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc156bf0 con 0x7f97dc0ccf90 2023-10-09T12:56:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97e25ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc0ae950 con 0x7f97dc15a270 2023-10-09T12:56:45.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97e25ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0cc300 con 0x7f97dc0cbf30 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97d3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f97dc0ccf90 0x7f97dc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97d3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f97dc0ccf90 0x7f97dc0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39238/0 (socket says 172.21.15.86:39238) 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.277+0000 7f97d3fff700 1 -- 172.21.15.86:0/798382931 learned_addr learned my addr 172.21.15.86:0/798382931 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97d3fff700 1 -- 172.21.15.86:0/798382931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0cbf30 msgr2=0x7f97dc0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97d3fff700 1 --2- 172.21.15.86:0/798382931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0cbf30 0x7f97dc0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97e0b9c700 1 --2- 172.21.15.86:0/798382931 >> v2:172.21.15.135:3300/0 conn(0x7f97dc15a270 0x7f97dc0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97d3fff700 1 -- 172.21.15.86:0/798382931 >> v2:172.21.15.135:3300/0 conn(0x7f97dc15a270 msgr2=0x7f97dc0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97d3fff700 1 --2- 172.21.15.86:0/798382931 >> v2:172.21.15.135:3300/0 conn(0x7f97dc15a270 0x7f97dc0b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97d3fff700 1 -- 172.21.15.86:0/798382931 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc0ad370 con 0x7f97dc0ccf90 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97e0b9c700 1 --2- 172.21.15.86:0/798382931 >> v2:172.21.15.135:3300/0 conn(0x7f97dc15a270 0x7f97dc0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:45.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97d3fff700 1 --2- 172.21.15.86:0/798382931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc0ccf90 0x7f97dc0b0d10 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0b25e0 tx=0x7f97c400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b10fea345390c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97db7fe700 1 -- 172.21.15.86:0/798382931 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400be60 con 0x7f97dc0ccf90 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97db7fe700 1 -- 172.21.15.86:0/798382931 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400ddc0 con 0x7f97dc0ccf90 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.278+0000 7f97db7fe700 1 -- 172.21.15.86:0/798382931 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40196b0 con 0x7f97dc0ccf90 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 -- 172.21.15.86:0/798382931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc0ccf90 msgr2=0x7f97dc0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 --2- 172.21.15.86:0/798382931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc0ccf90 0x7f97dc0b0d10 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0b25e0 tx=0x7f97c400b4f0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 -- 172.21.15.86:0/798382931 shutdown_connections 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 --2- 172.21.15.86:0/798382931 >> v2:172.21.15.135:3300/0 conn(0x7f97dc15a270 0x7f97dc0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 --2- 172.21.15.86:0/798382931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0cbf30 0x7f97dc0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 --2- 172.21.15.86:0/798382931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc0ccf90 0x7f97dc0b0d10 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 -- 172.21.15.86:0/798382931 >> 172.21.15.86:0/798382931 conn(0x7f97dc06a320 msgr2=0x7f97dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 -- 172.21.15.86:0/798382931 shutdown_connections 2023-10-09T12:56:45.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.279+0000 7f97e25ff700 1 -- 172.21.15.86:0/798382931 wait complete. 2023-10-09T12:56:45.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.280+0000 7f97e25ff700 1 Processor -- start 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.280+0000 7f97e25ff700 1 -- start start 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.281+0000 7f97e25ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97dc0cbf30 0x7f97dc163b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.281+0000 7f97e25ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0ccf90 0x7f97dc0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.281+0000 7f97e25ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc15a270 0x7f97dc167030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.281+0000 7f97e25ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0c7180 con 0x7f97dc15a270 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.281+0000 7f97e25ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc164f30 con 0x7f97dc0cbf30 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.281+0000 7f97e25ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1640a0 con 0x7f97dc0ccf90 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc15a270 0x7f97dc167030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc15a270 0x7f97dc167030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39248/0 (socket says 172.21.15.86:39248) 2023-10-09T12:56:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 -- 172.21.15.86:0/1031578224 learned_addr learned my addr 172.21.15.86:0/1031578224 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97d3fff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0ccf90 0x7f97dc0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97dbfff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97dc0cbf30 0x7f97dc163b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 -- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0ccf90 msgr2=0x7f97dc0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0ccf90 0x7f97dc0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 -- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97dc0cbf30 msgr2=0x7f97dc163b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97dc0cbf30 0x7f97dc163b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 -- 172.21.15.86:0/1031578224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c400b790 con 0x7f97dc15a270 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97e0b9c700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc15a270 0x7f97dc167030 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f97d400a380 tx=0x7f97d4007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97d8ff9700 1 -- 172.21.15.86:0/1031578224 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d400ae10 con 0x7f97dc15a270 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97d8ff9700 1 -- 172.21.15.86:0/1031578224 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d400d650 con 0x7f97dc15a270 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.282+0000 7f97d8ff9700 1 -- 172.21.15.86:0/1031578224 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d400da10 con 0x7f97dc15a270 2023-10-09T12:56:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.283+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc164320 con 0x7f97dc15a270 2023-10-09T12:56:45.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.283+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc164bc0 con 0x7f97dc15a270 2023-10-09T12:56:45.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.284+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc164720 con 0x7f97dc15a270 2023-10-09T12:56:45.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.285+0000 7f97d8ff9700 1 -- 172.21.15.86:0/1031578224 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97d401e3b0 con 0x7f97dc15a270 2023-10-09T12:56:45.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.286+0000 7f97d8ff9700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f97bc066f30 0x7f97bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.286+0000 7f97d8ff9700 1 -- 172.21.15.86:0/1031578224 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f97d4085140 con 0x7f97dc15a270 2023-10-09T12:56:45.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.286+0000 7f97dbfff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f97bc066f30 0x7f97bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.287+0000 7f97dbfff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f97bc066f30 0x7f97bc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f97dc154bd0 tx=0x7f97cc008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:45.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.290+0000 7f97d8ff9700 1 -- 172.21.15.86:0/1031578224 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97d40521f0 con 0x7f97dc15a270 2023-10-09T12:56:45.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.477+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97dc06fb70 con 0x7f97bc066f30 2023-10-09T12:56:45.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.487+0000 7f97d8ff9700 1 -- 172.21.15.86:0/1031578224 <== mgr.8400 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278559 (secure 0 0 0) 0x7f97dc06fb70 con 0x7f97bc066f30 2023-10-09T12:56:45.490 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f97bc066f30 msgr2=0x7f97bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f97bc066f30 0x7f97bc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f97dc154bd0 tx=0x7f97cc008040 comp rx=0 tx=0).stop 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc15a270 msgr2=0x7f97dc167030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc15a270 0x7f97dc167030 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f97d400a380 tx=0x7f97d4007900 comp rx=0 tx=0).stop 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 shutdown_connections 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f97bc066f30 0x7f97bc0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc15a270 0x7f97dc167030 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97dc0cbf30 0x7f97dc163b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 --2- 172.21.15.86:0/1031578224 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97dc0ccf90 0x7f97dc0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.491+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 >> 172.21.15.86:0/1031578224 conn(0x7f97dc06a320 msgr2=0x7f97dc159ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:45.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.492+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 shutdown_connections 2023-10-09T12:56:45.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.492+0000 7f97e25ff700 1 -- 172.21.15.86:0/1031578224 wait complete. 2023-10-09T12:56:45.494 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:56:45.509 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T12:56:44.637040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2468672,"kb_used_data":16640,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752506048,"statfs":{"total":773094113280,"available":770566193152,"internally_reserved":0,"allocated":17039360,"data_stored":9048210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464944"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178838+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:41.075000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175834+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:41.686939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178557+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:19.431400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175516+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:27.246926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175427+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:11:37.410009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.179520+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:22.872942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175372+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:34.543448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174780+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:53.808357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.176101+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:28.943865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.179659+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:08.696086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175412+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:50.297195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.177927+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:44.764961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178141+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:57.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174808+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:03.835300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.177834+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:59.422818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175548+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:52.698247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178152+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:39.506975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175410+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:01.913140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175873+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:41.655720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175306+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:41.919817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178945+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.648604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.180013+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:23.797808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178926+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:51.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178212+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:24.545292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178351+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174833+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:34.591057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178939+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:53.050567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174836+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.809349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178174+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:09.794998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178887+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:09.166901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178125+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:46:37.237422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178104+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:06.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"153'271","reported_seq":827,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T12:56:36.908877+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:56:36.908877+0000","last_peered":"2023-10-09T12:56:36.908877+0000","last_clean":"2023-10-09T12:56:36.908877+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:56:36.908877+0000","last_undegraded":"2023-10-09T12:56:36.908877+0000","last_fullsized":"2023-10-09T12:56:36.908877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477634,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2572288,"data_stored":1572239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.499},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.746}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56699999999999995}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":0.81399999999999995}]}]},{"osd":6,"up_from":16,"seq":68719477635,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.65000000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.76100000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.75},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.88}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":0.89400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307412,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064428,"statfs":{"total":96636764160,"available":96321974272,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.65300000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92200000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.014}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.93899999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1578492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.69999999999999996,"5min":1.008,"15min":1.008},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.59099999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.69599999999999995,"5min":0.73299999999999998,"15min":0.83199999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.498}]},{"osd":3,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.879},"last":0.438},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.042,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.71599999999999997,"5min":0.57199999999999995,"15min":0.502},"max":{"1min":1.091,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.48899999999999999},"max":{"1min":1.0069999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.60399999999999998,"15min":0.54900000000000004},"max":{"1min":1.0409999999999999,"5min":1.105,"15min":1.1639999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.5},"max":{"1min":0.998,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.872},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.67300000000000004,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0529999999999999,"5min":1.175,"15min":1.1990000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68100000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0940000000000001,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.629,"5min":0.59799999999999998,"15min":0.53900000000000003},"max":{"1min":1.0720000000000001,"5min":1.208,"15min":1.208},"last":0.92400000000000004}]}]},{"osd":2,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.72599999999999998,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.89400000000000002},"last":0.439}]},{"osd":1,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":1.038},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.47799999999999998,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44500000000000001,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.75600000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81899999999999995,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.50700000000000001},"max":{"1min":1.079,"5min":1.347,"15min":1.347},"last":0.876}]},{"osd":5,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.629,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"max":{"1min":0.98799999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.60699999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0429999999999999,"5min":1.2210000000000001,"15min":1.254},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.85499999999999998},"min":{"1min":0.63,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.022,"5min":1.357,"15min":1.357},"last":0.88900000000000001}]},{"osd":7,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86599999999999999,"15min":0.86899999999999999},"min":{"1min":0.67300000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0509999999999999,"5min":1.302,"15min":1.302},"last":0.83299999999999996}]}]},{"osd":3,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":988124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.67400000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.76100000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.502}]},{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.56499999999999995},"max":{"1min":1.149,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.876,"15min":0.875},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1910000000000001,"5min":1.321,"15min":1.321},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.59699999999999998,"15min":0.59599999999999997},"max":{"1min":0.98699999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.0509999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76500000000000001}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.57499999999999996,"15min":0.54200000000000004},"max":{"1min":1.0069999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.624,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.089,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.62,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77300000000000002}]}]},{"osd":4,"up_from":16,"seq":68719477634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299220,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072620,"statfs":{"total":96636764160,"available":96330362880,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":0.63500000000000001}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.749},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":0.72499999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:56:45.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:56:45.671 INFO:tasks.ceph.mds.a.smithi086.stderr:2023-10-09T12:56:45.671+0000 7fb1243f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T12:56:45.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.731+0000 7f82869ff700 1 Processor -- start 2023-10-09T12:56:45.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.732+0000 7f82869ff700 1 -- start start 2023-10-09T12:56:45.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.733+0000 7f82869ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82800b1420 0x7f82800ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.733+0000 7f82869ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800cc300 con 0x7f82800cbf30 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.733+0000 7f82869ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800ad370 con 0x7f82800ccf90 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.733+0000 7f82869ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8280156bf0 con 0x7f82800b1420 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.733+0000 7f827f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82800b1420 0x7f82800ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.733+0000 7f827ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f82800cbf30 0x7f82800b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54220/0 (socket says 172.21.15.86:54220) 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.733+0000 7f827ffff700 1 -- 172.21.15.86:0/1817872430 learned_addr learned my addr 172.21.15.86:0/1817872430 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.734+0000 7f827f7fe700 1 -- 172.21.15.86:0/1817872430 >> v1:172.21.15.135:6789/0 conn(0x7f82800ccf90 legacy=0x7f82800c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.734+0000 7f827f7fe700 1 -- 172.21.15.86:0/1817872430 >> v1:172.21.15.86:6789/0 conn(0x7f82800cbf30 legacy=0x7f82800b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.734+0000 7f827f7fe700 1 -- 172.21.15.86:0/1817872430 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800ad650 con 0x7f82800b1420 2023-10-09T12:56:45.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.734+0000 7f827f7fe700 1 --2- 172.21.15.86:0/1817872430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800b1420 0x7f82800ae410 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f82740098e0 tx=0x7f82740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99b231ca9d2562 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:45.735 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.734+0000 7f827effd700 1 -- 172.21.15.86:0/1817872430 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274009e80 con 0x7f82800b1420 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.734+0000 7f827effd700 1 -- 172.21.15.86:0/1817872430 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827400b860 con 0x7f82800b1420 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.734+0000 7f827effd700 1 -- 172.21.15.86:0/1817872430 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827400bbe0 con 0x7f82800b1420 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.735+0000 7f82869ff700 1 -- 172.21.15.86:0/1817872430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800b1420 msgr2=0x7f82800ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.735+0000 7f82869ff700 1 --2- 172.21.15.86:0/1817872430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800b1420 0x7f82800ae410 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f82740098e0 tx=0x7f82740091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.735+0000 7f82869ff700 1 -- 172.21.15.86:0/1817872430 shutdown_connections 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.735+0000 7f82869ff700 1 --2- 172.21.15.86:0/1817872430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800b1420 0x7f82800ae410 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.735+0000 7f82869ff700 1 -- 172.21.15.86:0/1817872430 >> 172.21.15.86:0/1817872430 conn(0x7f828006a320 msgr2=0x7f82800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.735+0000 7f82869ff700 1 -- 172.21.15.86:0/1817872430 shutdown_connections 2023-10-09T12:56:45.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.735+0000 7f82869ff700 1 -- 172.21.15.86:0/1817872430 wait complete. 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.736+0000 7f82869ff700 1 Processor -- start 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.736+0000 7f82869ff700 1 -- start start 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f82869ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82800b1420 0x7f82800a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f82869ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800cbf30 0x7f8280168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f82869ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82800ccf90 0x7f82800c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f82869ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800a9b30 con 0x7f82800cbf30 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f82869ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800a8f20 con 0x7f82800ccf90 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f82869ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800a9200 con 0x7f82800b1420 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f827f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800cbf30 0x7f8280168650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f827f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800cbf30 0x7f8280168650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39254/0 (socket says 172.21.15.86:39254) 2023-10-09T12:56:45.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.737+0000 7f827f7fe700 1 -- 172.21.15.86:0/3582877488 learned_addr learned my addr 172.21.15.86:0/3582877488 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f827ffff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82800b1420 0x7f82800a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f8284f9c700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82800ccf90 0x7f82800c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f827f7fe700 1 -- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82800b1420 msgr2=0x7f82800a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f827f7fe700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82800b1420 0x7f82800a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f827f7fe700 1 -- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82800ccf90 msgr2=0x7f82800c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f827f7fe700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82800ccf90 0x7f82800c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f827f7fe700 1 -- 172.21.15.86:0/3582877488 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274009420 con 0x7f82800cbf30 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f827f7fe700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800cbf30 0x7f8280168650 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8274013000 tx=0x7f8274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f8267fff700 1 -- 172.21.15.86:0/3582877488 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827400bb20 con 0x7f82800cbf30 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f8267fff700 1 -- 172.21.15.86:0/3582877488 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8274025420 con 0x7f82800cbf30 2023-10-09T12:56:45.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f8267fff700 1 -- 172.21.15.86:0/3582877488 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82740257c0 con 0x7f82800cbf30 2023-10-09T12:56:45.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.738+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800a94e0 con 0x7f82800cbf30 2023-10-09T12:56:45.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.739+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8280168130 con 0x7f82800cbf30 2023-10-09T12:56:45.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.739+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82800a9ca0 con 0x7f82800cbf30 2023-10-09T12:56:45.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.740+0000 7f8267fff700 1 -- 172.21.15.86:0/3582877488 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8274023070 con 0x7f82800cbf30 2023-10-09T12:56:45.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.741+0000 7f8267fff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f826c066f30 0x7f826c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:45.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.741+0000 7f8267fff700 1 -- 172.21.15.86:0/3582877488 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f8274085e90 con 0x7f82800cbf30 2023-10-09T12:56:45.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.741+0000 7f827ffff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f826c066f30 0x7f826c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:45.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.742+0000 7f827ffff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f826c066f30 0x7f826c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f828006d340 tx=0x7f8270009040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:45.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.745+0000 7f8267fff700 1 -- 172.21.15.86:0/3582877488 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8274052ea0 con 0x7f82800cbf30 2023-10-09T12:56:45.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.930+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f828004c3c0 con 0x7f826c066f30 2023-10-09T12:56:45.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.938+0000 7f8267fff700 1 -- 172.21.15.86:0/3582877488 <== mgr.8400 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278559 (secure 0 0 0) 0x7f828004c3c0 con 0x7f826c066f30 2023-10-09T12:56:45.942 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:45.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f826c066f30 msgr2=0x7f826c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f826c066f30 0x7f826c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f828006d340 tx=0x7f8270009040 comp rx=0 tx=0).stop 2023-10-09T12:56:45.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800cbf30 msgr2=0x7f8280168650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:45.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800cbf30 0x7f8280168650 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8274013000 tx=0x7f8274017000 comp rx=0 tx=0).stop 2023-10-09T12:56:45.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 shutdown_connections 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82800ccf90 0x7f82800c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82800b1420 0x7f82800a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f826c066f30 0x7f826c0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.942+0000 7f82869ff700 1 --2- 172.21.15.86:0/3582877488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82800cbf30 0x7f8280168650 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.943+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 >> 172.21.15.86:0/3582877488 conn(0x7f828006a320 msgr2=0x7f828006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.943+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 shutdown_connections 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:45.943+0000 7f82869ff700 1 -- 172.21.15.86:0/3582877488 wait complete. 2023-10-09T12:56:45.945 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:56:45.960 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T12:56:44.637040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2468672,"kb_used_data":16640,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752506048,"statfs":{"total":773094113280,"available":770566193152,"internally_reserved":0,"allocated":17039360,"data_stored":9048210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464944"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178838+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:41.075000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175834+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:41.686939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178557+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:19.431400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175516+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:27.246926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175427+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:11:37.410009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.179520+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:22.872942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175372+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:34.543448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174780+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:53.808357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.176101+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:28.943865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.179659+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:08.696086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175412+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:50.297195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.177927+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:44.764961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178141+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:57.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174808+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:03.835300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.177834+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:59.422818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175548+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:52.698247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178152+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:39.506975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175410+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:01.913140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175873+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:41.655720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175306+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:41.919817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178945+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.648604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.180013+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:23.797808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178926+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:51.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178212+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:24.545292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178351+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174833+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:34.591057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178939+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:53.050567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174836+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.809349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178174+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:09.794998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178887+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:09.166901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178125+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:46:37.237422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178104+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:06.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"153'271","reported_seq":827,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T12:56:36.908877+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:56:36.908877+0000","last_peered":"2023-10-09T12:56:36.908877+0000","last_clean":"2023-10-09T12:56:36.908877+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:56:36.908877+0000","last_undegraded":"2023-10-09T12:56:36.908877+0000","last_fullsized":"2023-10-09T12:56:36.908877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477634,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2572288,"data_stored":1572239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.499},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.746}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56699999999999995}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":0.81399999999999995}]}]},{"osd":6,"up_from":16,"seq":68719477635,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.65000000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.76100000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.75},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.88}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":0.89400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307412,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064428,"statfs":{"total":96636764160,"available":96321974272,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.65300000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92200000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.014}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.93899999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1578492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.69999999999999996,"5min":1.008,"15min":1.008},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.59099999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.69599999999999995,"5min":0.73299999999999998,"15min":0.83199999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.498}]},{"osd":3,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.879},"last":0.438},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.042,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.71599999999999997,"5min":0.57199999999999995,"15min":0.502},"max":{"1min":1.091,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.48899999999999999},"max":{"1min":1.0069999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.60399999999999998,"15min":0.54900000000000004},"max":{"1min":1.0409999999999999,"5min":1.105,"15min":1.1639999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.5},"max":{"1min":0.998,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.872},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.67300000000000004,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0529999999999999,"5min":1.175,"15min":1.1990000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68100000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0940000000000001,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.629,"5min":0.59799999999999998,"15min":0.53900000000000003},"max":{"1min":1.0720000000000001,"5min":1.208,"15min":1.208},"last":0.92400000000000004}]}]},{"osd":2,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.72599999999999998,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.89400000000000002},"last":0.439}]},{"osd":1,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":1.038},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.47799999999999998,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44500000000000001,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.75600000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81899999999999995,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.50700000000000001},"max":{"1min":1.079,"5min":1.347,"15min":1.347},"last":0.876}]},{"osd":5,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.629,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"max":{"1min":0.98799999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.60699999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0429999999999999,"5min":1.2210000000000001,"15min":1.254},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.85499999999999998},"min":{"1min":0.63,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.022,"5min":1.357,"15min":1.357},"last":0.88900000000000001}]},{"osd":7,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86599999999999999,"15min":0.86899999999999999},"min":{"1min":0.67300000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0509999999999999,"5min":1.302,"15min":1.302},"last":0.83299999999999996}]}]},{"osd":3,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":988124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.67400000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.76100000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.502}]},{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.56499999999999995},"max":{"1min":1.149,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.876,"15min":0.875},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1910000000000001,"5min":1.321,"15min":1.321},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.59699999999999998,"15min":0.59599999999999997},"max":{"1min":0.98699999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.0509999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76500000000000001}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.57499999999999996,"15min":0.54200000000000004},"max":{"1min":1.0069999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.624,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.089,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.62,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77300000000000002}]}]},{"osd":4,"up_from":16,"seq":68719477634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299220,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072620,"statfs":{"total":96636764160,"available":96330362880,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":0.63500000000000001}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.749},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":0.72499999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:56:45.966 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:56:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.182+0000 7f9591dff700 1 Processor -- start 2023-10-09T12:56:46.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.182+0000 7f9591dff700 1 -- start start 2023-10-09T12:56:46.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f9591dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f958c1578b0 0x7f958c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f9591dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c0ad930 con 0x7f958c0af2f0 2023-10-09T12:56:46.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f9591dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c0acd20 con 0x7f958c155c10 2023-10-09T12:56:46.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f9591dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958c0ad000 con 0x7f958c1578b0 2023-10-09T12:56:46.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f958bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f958c0af2f0 0x7f958c0af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54230/0 (socket says 172.21.15.86:54230) 2023-10-09T12:56:46.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f958affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f958c1578b0 0x7f958c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f958bfff700 1 -- 172.21.15.86:0/3138896998 learned_addr learned my addr 172.21.15.86:0/3138896998 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f958affd700 1 -- 172.21.15.86:0/3138896998 >> v1:172.21.15.135:6789/0 conn(0x7f958c155c10 legacy=0x7f958c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f958a7fc700 1 -- 172.21.15.86:0/3138896998 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291668038 0 0) 0x7f958c0ad930 con 0x7f958c0af2f0 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.184+0000 7f958affd700 1 -- 172.21.15.86:0/3138896998 >> v1:172.21.15.86:6789/0 conn(0x7f958c0af2f0 legacy=0x7f958c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.185+0000 7f958affd700 1 -- 172.21.15.86:0/3138896998 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c0ad2e0 con 0x7f958c1578b0 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.185+0000 7f958affd700 1 --2- 172.21.15.86:0/3138896998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c1578b0 0x7f958c155fe0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f958000aa90 tx=0x7f958000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4c409b511e1775 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.185+0000 7f958a7fc700 1 -- 172.21.15.86:0/3138896998 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000ca40 con 0x7f958c1578b0 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.185+0000 7f958a7fc700 1 -- 172.21.15.86:0/3138896998 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958000cba0 con 0x7f958c1578b0 2023-10-09T12:56:46.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.185+0000 7f958a7fc700 1 -- 172.21.15.86:0/3138896998 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580018400 con 0x7f958c1578b0 2023-10-09T12:56:46.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.185+0000 7f9591dff700 1 -- 172.21.15.86:0/3138896998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c1578b0 msgr2=0x7f958c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.185+0000 7f9591dff700 1 --2- 172.21.15.86:0/3138896998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c1578b0 0x7f958c155fe0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f958000aa90 tx=0x7f958000a330 comp rx=0 tx=0).stop 2023-10-09T12:56:46.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.186+0000 7f9591dff700 1 -- 172.21.15.86:0/3138896998 shutdown_connections 2023-10-09T12:56:46.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.186+0000 7f9591dff700 1 --2- 172.21.15.86:0/3138896998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c1578b0 0x7f958c155fe0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.186+0000 7f9591dff700 1 -- 172.21.15.86:0/3138896998 >> 172.21.15.86:0/3138896998 conn(0x7f958c06a320 msgr2=0x7f958c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:46.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.186+0000 7f9591dff700 1 -- 172.21.15.86:0/3138896998 shutdown_connections 2023-10-09T12:56:46.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.186+0000 7f9591dff700 1 -- 172.21.15.86:0/3138896998 wait complete. 2023-10-09T12:56:46.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.187+0000 7f9591dff700 1 Processor -- start 2023-10-09T12:56:46.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.187+0000 7f9591dff700 1 -- start start 2023-10-09T12:56:46.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f9591dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c0af2f0 0x7f958c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f9591dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c155c10 0x7f958c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f9591dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958c1578b0 0x7f958c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f9591dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c151370 con 0x7f958c155c10 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f9591dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c150760 con 0x7f958c0af2f0 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f9591dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c150a40 con 0x7f958c1578b0 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f958affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c155c10 0x7f958c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f958affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c155c10 0x7f958c13a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39260/0 (socket says 172.21.15.86:39260) 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.188+0000 7f958affd700 1 -- 172.21.15.86:0/4197813731 learned_addr learned my addr 172.21.15.86:0/4197813731 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958bfff700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958c1578b0 0x7f958c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958b7fe700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c0af2f0 0x7f958c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958affd700 1 -- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958c1578b0 msgr2=0x7f958c14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958affd700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958c1578b0 0x7f958c14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958affd700 1 -- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c0af2f0 msgr2=0x7f958c151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958affd700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c0af2f0 0x7f958c151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958affd700 1 -- 172.21.15.86:0/4197813731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958000a5d0 con 0x7f958c155c10 2023-10-09T12:56:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f958affd700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c155c10 0x7f958c13a730 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f958000a5a0 tx=0x7f958001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f95737fe700 1 -- 172.21.15.86:0/4197813731 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000cee0 con 0x7f958c155c10 2023-10-09T12:56:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f95737fe700 1 -- 172.21.15.86:0/4197813731 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580010600 con 0x7f958c155c10 2023-10-09T12:56:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f95737fe700 1 -- 172.21.15.86:0/4197813731 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800109c0 con 0x7f958c155c10 2023-10-09T12:56:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c150d20 con 0x7f958c155c10 2023-10-09T12:56:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.189+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c14f590 con 0x7f958c155c10 2023-10-09T12:56:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.190+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c1514e0 con 0x7f958c155c10 2023-10-09T12:56:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.191+0000 7f95737fe700 1 -- 172.21.15.86:0/4197813731 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f958002a3b0 con 0x7f958c155c10 2023-10-09T12:56:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.192+0000 7f95737fe700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.192+0000 7f95737fe700 1 -- 172.21.15.86:0/4197813731 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f9580085da0 con 0x7f958c155c10 2023-10-09T12:56:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.192+0000 7f958b7fe700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.193+0000 7f958b7fe700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9578066f30 0x7f95780693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f957c003860 tx=0x7f957c009040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:46.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.196+0000 7f95737fe700 1 -- 172.21.15.86:0/4197813731 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9580052db0 con 0x7f958c155c10 2023-10-09T12:56:46.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.383+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f958c04c3c0 con 0x7f9578066f30 2023-10-09T12:56:46.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.390+0000 7f95737fe700 1 -- 172.21.15.86:0/4197813731 <== mgr.8400 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278559 (secure 0 0 0) 0x7f958c04c3c0 con 0x7f9578066f30 2023-10-09T12:56:46.394 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:46.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.394+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9578066f30 msgr2=0x7f95780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.394+0000 7f9591dff700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9578066f30 0x7f95780693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f957c003860 tx=0x7f957c009040 comp rx=0 tx=0).stop 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.394+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c155c10 msgr2=0x7f958c13a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.394+0000 7f9591dff700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c155c10 0x7f958c13a730 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f958000a5a0 tx=0x7f958001a000 comp rx=0 tx=0).stop 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 shutdown_connections 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f958c1578b0 0x7f958c14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c0af2f0 0x7f958c151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 --2- 172.21.15.86:0/4197813731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f958c155c10 0x7f958c13a730 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 >> 172.21.15.86:0/4197813731 conn(0x7f958c06a320 msgr2=0x7f958c14eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 shutdown_connections 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.395+0000 7f9591dff700 1 -- 172.21.15.86:0/4197813731 wait complete. 2023-10-09T12:56:46.397 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:56:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T12:56:44.637040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2468672,"kb_used_data":16640,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752506048,"statfs":{"total":773094113280,"available":770566193152,"internally_reserved":0,"allocated":17039360,"data_stored":9048210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464944"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178838+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:41.075000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175834+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:41.686939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178557+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:19.431400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175516+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:27.246926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175427+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:11:37.410009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.179520+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:22.872942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175372+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:34.543448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174780+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:53.808357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.176101+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:28.943865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.179659+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:08.696086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175412+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:50.297195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.177927+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:44.764961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178141+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:57.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174808+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:03.835300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.177834+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:59.422818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175548+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:52.698247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178152+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:39.506975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175410+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:01.913140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175873+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:41.655720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.175306+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:41.919817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178945+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:53.648604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.180013+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:23.797808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178926+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:51.258822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178212+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:24.545292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178351+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174833+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:34.591057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178939+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:53.050567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.174836+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.809349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178174+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:09.794998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178887+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:09.166901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178125+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:46:37.237422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:56:40.171132+0000","last_change":"2023-10-09T12:56:40.171132+0000","last_active":"2023-10-09T12:56:40.171132+0000","last_peered":"2023-10-09T12:56:40.171132+0000","last_clean":"2023-10-09T12:56:40.171132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:40.171132+0000","last_undegraded":"2023-10-09T12:56:40.171132+0000","last_fullsized":"2023-10-09T12:56:40.171132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:56:39.165378+0000","last_change":"2023-10-09T12:56:39.178104+0000","last_active":"2023-10-09T12:56:39.165378+0000","last_peered":"2023-10-09T12:56:39.165378+0000","last_clean":"2023-10-09T12:56:39.165378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:56:39.165378+0000","last_undegraded":"2023-10-09T12:56:39.165378+0000","last_fullsized":"2023-10-09T12:56:39.165378+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:06.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"153'271","reported_seq":827,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T12:56:36.908877+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:56:36.908877+0000","last_peered":"2023-10-09T12:56:36.908877+0000","last_clean":"2023-10-09T12:56:36.908877+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:56:36.908877+0000","last_undegraded":"2023-10-09T12:56:36.908877+0000","last_fullsized":"2023-10-09T12:56:36.908877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477634,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2572288,"data_stored":1572239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.499},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.746}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56699999999999995}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":0.81399999999999995}]}]},{"osd":6,"up_from":16,"seq":68719477635,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.65000000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.76100000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.75},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.88}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":0.89400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307412,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064428,"statfs":{"total":96636764160,"available":96321974272,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.65300000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92200000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.014}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.93899999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308004,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063836,"statfs":{"total":96636764160,"available":96321368064,"internally_reserved":0,"allocated":2584576,"data_stored":1578492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.69999999999999996,"5min":1.008,"15min":1.008},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.59099999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.69599999999999995,"5min":0.73299999999999998,"15min":0.83199999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.498}]},{"osd":3,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.879},"last":0.438},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.042,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.71599999999999997,"5min":0.57199999999999995,"15min":0.502},"max":{"1min":1.091,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.48899999999999999},"max":{"1min":1.0069999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.60399999999999998,"15min":0.54900000000000004},"max":{"1min":1.0409999999999999,"5min":1.105,"15min":1.1639999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.5},"max":{"1min":0.998,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.872},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.67300000000000004,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0529999999999999,"5min":1.175,"15min":1.1990000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68100000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0940000000000001,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.629,"5min":0.59799999999999998,"15min":0.53900000000000003},"max":{"1min":1.0720000000000001,"5min":1.208,"15min":1.208},"last":0.92400000000000004}]}]},{"osd":2,"up_from":14,"seq":60129543042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.30399999999999999},"max":{"1min":0.72599999999999998,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.89400000000000002},"last":0.439}]},{"osd":1,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":1.038},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.47799999999999998,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.77000000000000002,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.44500000000000001,"5min":0.42599999999999999,"15min":0.38500000000000001},"max":{"1min":0.75600000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81899999999999995,"15min":0.81000000000000005},"min":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.50700000000000001},"max":{"1min":1.079,"5min":1.347,"15min":1.347},"last":0.876}]},{"osd":5,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.629,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"max":{"1min":0.98799999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.60699999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0429999999999999,"5min":1.2210000000000001,"15min":1.254},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.85499999999999998},"min":{"1min":0.63,"5min":0.60399999999999998,"15min":0.57399999999999995},"max":{"1min":1.022,"5min":1.357,"15min":1.357},"last":0.88900000000000001}]},{"osd":7,"last update":"Mon Oct 9 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":0.85899999999999999},"min":{"1min":0.625,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.999,"5min":1.373,"15min":1.373},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.86599999999999999,"15min":0.86899999999999999},"min":{"1min":0.67300000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0509999999999999,"5min":1.302,"15min":1.302},"last":0.83299999999999996}]}]},{"osd":3,"up_from":15,"seq":64424510339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311520,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060320,"statfs":{"total":96636764160,"available":96317767680,"internally_reserved":0,"allocated":1990656,"data_stored":988124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.67400000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.76100000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.502}]},{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.56499999999999995},"max":{"1min":1.149,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.876,"15min":0.875},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1910000000000001,"5min":1.321,"15min":1.321},"last":0.73099999999999998}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.59699999999999998,"15min":0.59599999999999997},"max":{"1min":0.98699999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.0509999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76500000000000001}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.57499999999999996,"15min":0.54200000000000004},"max":{"1min":1.0069999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.624,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.089,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.62,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77300000000000002}]}]},{"osd":4,"up_from":16,"seq":68719477634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299220,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072620,"statfs":{"total":96636764160,"available":96330362880,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":0.63500000000000001}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.749},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":0.72499999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311508,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060332,"statfs":{"total":96636764160,"available":96317779968,"internally_reserved":0,"allocated":1978368,"data_stored":981871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3f is not active+clean 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3c is not active+clean 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2023-10-09T12:56:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.33 is not active+clean 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.31 is not active+clean 2023-10-09T12:56:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.30 is not active+clean 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2e is not active+clean 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2d is not active+clean 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2c is not active+clean 2023-10-09T12:56:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2a is not active+clean 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-10-09T12:56:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.26 is not active+clean 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.25 is not active+clean 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.23 is not active+clean 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.22 is not active+clean 2023-10-09T12:56:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178838+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:42:41.075000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-10-09T12:56:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175834+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:36:41.686939+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178557+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:50:19.431400+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175516+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:55:27.246926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T12:56:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175427+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:11:37.410009+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.179520+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:36:22.872942+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-10-09T12:56:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175372+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:29:34.543448+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.174780+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:02:53.808357+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.16 is not active+clean 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.176101+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:31:28.943865+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.179659+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:28:08.696086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175412+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:37:50.297195+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-10-09T12:56:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.177927+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:54:44.764961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.13 is not active+clean 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178141+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:56:57.316649+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-10-09T12:56:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.174808+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:00:03.835300+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.177834+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:36:59.422818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175548+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:50:52.698247+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:56:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178152+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:01:39.506975+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175410+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:12:01.913140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175873+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:31:41.655720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.a is not active+clean 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.175306+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:52:41.919817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178945+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:42:53.648604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T12:56:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.180013+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:13:23.797808+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178926+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:45:51.258822+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178212+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:15:24.545292+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.7 is not active+clean 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178351+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:22:35.192812+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.174833+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:39:34.591057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T12:56:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178939+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:35:53.050567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.174836+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:34:30.809349+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178174+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:58:09.794998+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178887+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:36:09.166901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-10-09T12:56:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178125+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:46:37.237422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T12:56:46.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-10-09T12:56:46.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:56:40.171132+0000', 'last_change': '2023-10-09T12:56:40.171132+0000', 'last_active': '2023-10-09T12:56:40.171132+0000', 'last_peered': '2023-10-09T12:56:40.171132+0000', 'last_clean': '2023-10-09T12:56:40.171132+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:40.171132+0000', 'last_undegraded': '2023-10-09T12:56:40.171132+0000', 'last_fullsized': '2023-10-09T12:56:40.171132+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:40.171132+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:56:46.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-10-09T12:56:46.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:56:39.165378+0000', 'last_change': '2023-10-09T12:56:39.178104+0000', 'last_active': '2023-10-09T12:56:39.165378+0000', 'last_peered': '2023-10-09T12:56:39.165378+0000', 'last_clean': '2023-10-09T12:56:39.165378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:56:39.165378+0000', 'last_undegraded': '2023-10-09T12:56:39.165378+0000', 'last_fullsized': '2023-10-09T12:56:39.165378+0000', 'mapping_epoch': 161, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 161, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'last_clean_scrub_stamp': '2023-10-09T12:56:39.165378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:05:06.282517+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:56:46.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T12:56:46.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.633+0000 7f0e39dff700 1 Processor -- start 2023-10-09T12:56:46.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.633+0000 7f0e39dff700 1 -- start start 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e39dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e340a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e39dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e340ad730 0x7f0e340af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e39dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e340a9e10 con 0x7f0e340ad360 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e39dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e340aac60 con 0x7f0e340ad730 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e39dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340aa050 con 0x7f0e340abd10 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e33fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e340ad730 0x7f0e340af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e337fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0e340ad360 0x7f0e340ab0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54244/0 (socket says 172.21.15.86:54244) 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e337fe700 1 -- 172.21.15.86:0/1628955184 learned_addr learned my addr 172.21.15.86:0/1628955184 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:46.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e32ffd700 1 --2- 172.21.15.86:0/1628955184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e340a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e33fff700 1 -- 172.21.15.86:0/1628955184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 msgr2=0x7f0e340a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e33fff700 1 --2- 172.21.15.86:0/1628955184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e340a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e33fff700 1 -- 172.21.15.86:0/1628955184 >> v1:172.21.15.86:6789/0 conn(0x7f0e340ad360 legacy=0x7f0e340ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e33fff700 1 -- 172.21.15.86:0/1628955184 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340aa330 con 0x7f0e340ad730 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.635+0000 7f0e327fc700 1 -- 172.21.15.86:0/1628955184 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047949116 0 0) 0x7f0e24001110 con 0x7f0e340ad360 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e33fff700 1 --2- 172.21.15.86:0/1628955184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad730 0x7f0e340af640 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009e60 tx=0x7f0e2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bec3eba966cb83 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e327fc700 1 -- 172.21.15.86:0/1628955184 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00e070 con 0x7f0e340ad730 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e327fc700 1 -- 172.21.15.86:0/1628955184 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c00bc30 con 0x7f0e340ad730 2023-10-09T12:56:46.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e327fc700 1 -- 172.21.15.86:0/1628955184 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c012430 con 0x7f0e340ad730 2023-10-09T12:56:46.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e39dff700 1 -- 172.21.15.86:0/1628955184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad730 msgr2=0x7f0e340af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e39dff700 1 --2- 172.21.15.86:0/1628955184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad730 0x7f0e340af640 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009e60 tx=0x7f0e2c009780 comp rx=0 tx=0).stop 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e39dff700 1 -- 172.21.15.86:0/1628955184 shutdown_connections 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e39dff700 1 --2- 172.21.15.86:0/1628955184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad730 0x7f0e340af640 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.636+0000 7f0e39dff700 1 --2- 172.21.15.86:0/1628955184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e340a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.637+0000 7f0e39dff700 1 -- 172.21.15.86:0/1628955184 >> 172.21.15.86:0/1628955184 conn(0x7f0e3406a310 msgr2=0x7f0e340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.637+0000 7f0e39dff700 1 -- 172.21.15.86:0/1628955184 shutdown_connections 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.637+0000 7f0e39dff700 1 -- 172.21.15.86:0/1628955184 wait complete. 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.638+0000 7f0e39dff700 1 Processor -- start 2023-10-09T12:56:46.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.638+0000 7f0e39dff700 1 -- start start 2023-10-09T12:56:46.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.639+0000 7f0e39dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e3414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.639+0000 7f0e39dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad360 0x7f0e34150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.639+0000 7f0e39dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ad730 0x7f0e34150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.639+0000 7f0e39dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e34150ba0 con 0x7f0e340ad360 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.639+0000 7f0e39dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3414d460 con 0x7f0e340ad730 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.639+0000 7f0e39dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340b1020 con 0x7f0e340abd10 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad360 0x7f0e34150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad360 0x7f0e34150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39280/0 (socket says 172.21.15.86:39280) 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 -- 172.21.15.86:0/2392205957 learned_addr learned my addr 172.21.15.86:0/2392205957 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e337fe700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e3414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e33fff700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ad730 0x7f0e34150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 -- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 msgr2=0x7f0e3414c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e3414c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 -- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ad730 msgr2=0x7f0e34150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ad730 0x7f0e34150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 -- 172.21.15.86:0/2392205957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c009a20 con 0x7f0e340ad360 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e32ffd700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad360 0x7f0e34150120 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800d890 tx=0x7f0e28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e1b7fe700 1 -- 172.21.15.86:0/2392205957 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280125f0 con 0x7f0e340ad360 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e1b7fe700 1 -- 172.21.15.86:0/2392205957 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28012750 con 0x7f0e340ad360 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.640+0000 7f0e1b7fe700 1 -- 172.21.15.86:0/2392205957 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28012af0 con 0x7f0e340ad360 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.641+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e340b0430 con 0x7f0e340ad360 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.641+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e340b07a0 con 0x7f0e340ad360 2023-10-09T12:56:46.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.642+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3404c3c0 con 0x7f0e340ad360 2023-10-09T12:56:46.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.642+0000 7f0e1b7fe700 1 -- 172.21.15.86:0/2392205957 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e2801e460 con 0x7f0e340ad360 2023-10-09T12:56:46.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.644+0000 7f0e1b7fe700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e20066f30 0x7f0e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:46.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.644+0000 7f0e1b7fe700 1 -- 172.21.15.86:0/2392205957 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f0e28084c60 con 0x7f0e340ad360 2023-10-09T12:56:46.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.644+0000 7f0e337fe700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e20066f30 0x7f0e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:46.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.645+0000 7f0e337fe700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e20066f30 0x7f0e200693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e24006fc0 tx=0x7f0e24007b90 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:46.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.648+0000 7f0e1b7fe700 1 -- 172.21.15.86:0/2392205957 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e28051d10 con 0x7f0e340ad360 2023-10-09T12:56:46.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.915+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0e340b0d70 con 0x7f0e340ad360 2023-10-09T12:56:46.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.916+0000 7f0e1b7fe700 1 -- 172.21.15.86:0/2392205957 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1114 (secure 0 0 0) 0x7f0e28055330 con 0x7f0e340ad360 2023-10-09T12:56:46.916 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:46.916 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4559,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":164,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2527920128,"bytes_avail":770566193152,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":71,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8580}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-09T12:46:46.297146+0000","services":{}},"progress_events":{}} 2023-10-09T12:56:46.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e20066f30 msgr2=0x7f0e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e20066f30 0x7f0e200693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e24006fc0 tx=0x7f0e24007b90 comp rx=0 tx=0).stop 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad360 msgr2=0x7f0e34150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad360 0x7f0e34150120 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800d890 tx=0x7f0e28008040 comp rx=0 tx=0).stop 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 shutdown_connections 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ad730 0x7f0e34150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e340abd10 0x7f0e3414c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0e20066f30 0x7f0e200693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 --2- 172.21.15.86:0/2392205957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e340ad360 0x7f0e34150120 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 >> 172.21.15.86:0/2392205957 conn(0x7f0e3406a310 msgr2=0x7f0e34158940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 shutdown_connections 2023-10-09T12:56:46.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:46.918+0000 7f0e39dff700 1 -- 172.21.15.86:0/2392205957 wait complete. 2023-10-09T12:56:46.936 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T12:56:46.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:56:47.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.115+0000 7febdc9ff700 1 Processor -- start 2023-10-09T12:56:47.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.115+0000 7febdc9ff700 1 -- start start 2023-10-09T12:56:47.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.116+0000 7febdc9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7febd8155c10 0x7febd8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.116+0000 7febdc9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7febd80ac6d0 0x7febd80b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.116+0000 7febdc9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80acac0 con 0x7febd80ac230 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.116+0000 7febdc9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80ad930 con 0x7febd80ac6d0 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.116+0000 7febdc9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80acd20 con 0x7febd8155c10 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7febd80ac6d0 0x7febd80b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7febd80ac6d0 0x7febd80b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39290/0 (socket says 172.21.15.86:39290) 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 -- 172.21.15.86:0/4068859325 learned_addr learned my addr 172.21.15.86:0/4068859325 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd659c700 1 --2- 172.21.15.86:0/4068859325 >> v2:172.21.15.135:3300/0 conn(0x7febd8155c10 0x7febd8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 -- 172.21.15.86:0/4068859325 >> v2:172.21.15.135:3300/0 conn(0x7febd8155c10 msgr2=0x7febd8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:47.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 --2- 172.21.15.86:0/4068859325 >> v2:172.21.15.135:3300/0 conn(0x7febd8155c10 0x7febd8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 -- 172.21.15.86:0/4068859325 >> v1:172.21.15.135:6789/0 conn(0x7febd80ac230 legacy=0x7febd81568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:47.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 -- 172.21.15.86:0/4068859325 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80ad000 con 0x7febd80ac6d0 2023-10-09T12:56:47.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd659c700 1 --2- 172.21.15.86:0/4068859325 >> v2:172.21.15.135:3300/0 conn(0x7febd8155c10 0x7febd8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:47.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.117+0000 7febd6d9d700 1 --2- 172.21.15.86:0/4068859325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac6d0 0x7febd80b0300 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7febd8063d40 tx=0x7febd000a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5834689cd0aff575 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:47.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febd559a700 1 -- 172.21.15.86:0/4068859325 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000f070 con 0x7febd80ac6d0 2023-10-09T12:56:47.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febd559a700 1 -- 172.21.15.86:0/4068859325 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000cdc0 con 0x7febd80ac6d0 2023-10-09T12:56:47.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febd559a700 1 -- 172.21.15.86:0/4068859325 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000a320 con 0x7febd80ac6d0 2023-10-09T12:56:47.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 -- 172.21.15.86:0/4068859325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac6d0 msgr2=0x7febd80b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:47.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4068859325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac6d0 0x7febd80b0300 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7febd8063d40 tx=0x7febd000a950 comp rx=0 tx=0).stop 2023-10-09T12:56:47.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 -- 172.21.15.86:0/4068859325 shutdown_connections 2023-10-09T12:56:47.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4068859325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac6d0 0x7febd80b0300 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4068859325 >> v2:172.21.15.135:3300/0 conn(0x7febd8155c10 0x7febd8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 -- 172.21.15.86:0/4068859325 >> 172.21.15.86:0/4068859325 conn(0x7febd806a320 msgr2=0x7febd80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:47.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 -- 172.21.15.86:0/4068859325 shutdown_connections 2023-10-09T12:56:47.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.118+0000 7febdc9ff700 1 -- 172.21.15.86:0/4068859325 wait complete. 2023-10-09T12:56:47.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.120+0000 7febdc9ff700 1 Processor -- start 2023-10-09T12:56:47.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.120+0000 7febdc9ff700 1 -- start start 2023-10-09T12:56:47.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febdc9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac230 0x7febd816ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:47.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febdc9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd80ac6d0 0x7febd814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:47.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febdc9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd8155c10 0x7febd81677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:47.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febdc9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd816b370 con 0x7febd80ac230 2023-10-09T12:56:47.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febdc9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd816b5a0 con 0x7febd80ac6d0 2023-10-09T12:56:47.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febdc9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd816b880 con 0x7febd8155c10 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac230 0x7febd816ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac230 0x7febd816ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39306/0 (socket says 172.21.15.86:39306) 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 -- 172.21.15.86:0/4077664689 learned_addr learned my addr 172.21.15.86:0/4077664689 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd6d9d700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd8155c10 0x7febd81677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd5d9b700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd80ac6d0 0x7febd814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 -- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd8155c10 msgr2=0x7febd81677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd8155c10 0x7febd81677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 -- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd80ac6d0 msgr2=0x7febd814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd80ac6d0 0x7febd814d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd659c700 1 -- 172.21.15.86:0/4077664689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd000abf0 con 0x7febd80ac230 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.121+0000 7febd5d9b700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd80ac6d0 0x7febd814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:56:47.124 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.122+0000 7febd659c700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac230 0x7febd816ae30 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7febc800d860 tx=0x7febc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:47.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.122+0000 7febc67fc700 1 -- 172.21.15.86:0/4077664689 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80125f0 con 0x7febd80ac230 2023-10-09T12:56:47.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.122+0000 7febc67fc700 1 -- 172.21.15.86:0/4077664689 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8012750 con 0x7febd80ac230 2023-10-09T12:56:47.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.122+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd816bb60 con 0x7febd80ac230 2023-10-09T12:56:47.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.122+0000 7febc67fc700 1 -- 172.21.15.86:0/4077664689 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8012ad0 con 0x7febd80ac230 2023-10-09T12:56:47.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.122+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd814d6b0 con 0x7febd80ac230 2023-10-09T12:56:47.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.123+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd816bd50 con 0x7febd80ac230 2023-10-09T12:56:47.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.124+0000 7febc67fc700 1 -- 172.21.15.86:0/4077664689 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febc8014430 con 0x7febd80ac230 2023-10-09T12:56:47.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.125+0000 7febc67fc700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7febb8066f30 0x7febb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:47.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.125+0000 7febc67fc700 1 -- 172.21.15.86:0/4077664689 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7febc8084b40 con 0x7febd80ac230 2023-10-09T12:56:47.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.125+0000 7febd5d9b700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7febb8066f30 0x7febb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:47.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.126+0000 7febd5d9b700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7febb8066f30 0x7febb80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febd8157ba0 tx=0x7febcc009040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:47.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.129+0000 7febc67fc700 1 -- 172.21.15.86:0/4077664689 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febc8055680 con 0x7febd80ac230 2023-10-09T12:56:47.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.316+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febd8159c30 con 0x7febb8066f30 2023-10-09T12:56:47.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.325+0000 7febc67fc700 1 -- 172.21.15.86:0/4077664689 <== mgr.8400 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289551 (secure 0 0 0) 0x7febcc001490 con 0x7febb8066f30 2023-10-09T12:56:47.328 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:47.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7febb8066f30 msgr2=0x7febb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7febb8066f30 0x7febb80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febd8157ba0 tx=0x7febcc009040 comp rx=0 tx=0).stop 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac230 msgr2=0x7febd816ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac230 0x7febd816ae30 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7febc800d860 tx=0x7febc8008040 comp rx=0 tx=0).stop 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 shutdown_connections 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7febb8066f30 0x7febb80693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd80ac230 0x7febd816ae30 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febd8155c10 0x7febd81677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 --2- 172.21.15.86:0/4077664689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd80ac6d0 0x7febd814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 >> 172.21.15.86:0/4077664689 conn(0x7febd806a320 msgr2=0x7febd8154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:47.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 shutdown_connections 2023-10-09T12:56:47.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:47.329+0000 7febdc9ff700 1 -- 172.21.15.86:0/4077664689 wait complete. 2023-10-09T12:56:47.332 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:56:47.347 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T12:56:46.637426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469096,"kb_used_data":17064,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752505624,"statfs":{"total":773094113280,"available":770565758976,"internally_reserved":0,"allocated":17473536,"data_stored":9255604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.462242"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215595+0000","last_change":"2023-10-09T12:56:41.213768+0000","last_active":"2023-10-09T12:56:41.215595+0000","last_peered":"2023-10-09T12:56:41.215595+0000","last_clean":"2023-10-09T12:56:41.215595+0000","last_became_active":"2023-10-09T12:56:41.212491+0000","last_became_peered":"2023-10-09T12:56:41.212491+0000","last_unstale":"2023-10-09T12:56:41.215595+0000","last_undegraded":"2023-10-09T12:56:41.215595+0000","last_fullsized":"2023-10-09T12:56:41.215595+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:54.590624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.194371+0000","last_change":"2023-10-09T12:56:41.193747+0000","last_active":"2023-10-09T12:56:41.194371+0000","last_peered":"2023-10-09T12:56:41.194371+0000","last_clean":"2023-10-09T12:56:41.194371+0000","last_became_active":"2023-10-09T12:56:41.193452+0000","last_became_peered":"2023-10-09T12:56:41.193452+0000","last_unstale":"2023-10-09T12:56:41.194371+0000","last_undegraded":"2023-10-09T12:56:41.194371+0000","last_fullsized":"2023-10-09T12:56:41.194371+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:14.963616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210676+0000","last_change":"2023-10-09T12:56:41.206038+0000","last_active":"2023-10-09T12:56:41.210676+0000","last_peered":"2023-10-09T12:56:41.210676+0000","last_clean":"2023-10-09T12:56:41.210676+0000","last_became_active":"2023-10-09T12:56:41.205601+0000","last_became_peered":"2023-10-09T12:56:41.205601+0000","last_unstale":"2023-10-09T12:56:41.210676+0000","last_undegraded":"2023-10-09T12:56:41.210676+0000","last_fullsized":"2023-10-09T12:56:41.210676+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:19.749204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226628+0000","last_change":"2023-10-09T12:56:41.221969+0000","last_active":"2023-10-09T12:56:41.226628+0000","last_peered":"2023-10-09T12:56:41.226628+0000","last_clean":"2023-10-09T12:56:41.226628+0000","last_became_active":"2023-10-09T12:56:41.221428+0000","last_became_peered":"2023-10-09T12:56:41.221428+0000","last_unstale":"2023-10-09T12:56:41.226628+0000","last_undegraded":"2023-10-09T12:56:41.226628+0000","last_fullsized":"2023-10-09T12:56:41.226628+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:10.320356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206235+0000","last_change":"2023-10-09T12:56:41.203881+0000","last_active":"2023-10-09T12:56:41.206235+0000","last_peered":"2023-10-09T12:56:41.206235+0000","last_clean":"2023-10-09T12:56:41.206235+0000","last_became_active":"2023-10-09T12:56:41.203349+0000","last_became_peered":"2023-10-09T12:56:41.203349+0000","last_unstale":"2023-10-09T12:56:41.206235+0000","last_undegraded":"2023-10-09T12:56:41.206235+0000","last_fullsized":"2023-10-09T12:56:41.206235+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:33.134573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210600+0000","last_change":"2023-10-09T12:56:41.203781+0000","last_active":"2023-10-09T12:56:41.210600+0000","last_peered":"2023-10-09T12:56:41.210600+0000","last_clean":"2023-10-09T12:56:41.210600+0000","last_became_active":"2023-10-09T12:56:41.203481+0000","last_became_peered":"2023-10-09T12:56:41.203481+0000","last_unstale":"2023-10-09T12:56:41.210600+0000","last_undegraded":"2023-10-09T12:56:41.210600+0000","last_fullsized":"2023-10-09T12:56:41.210600+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:10.089824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210554+0000","last_change":"2023-10-09T12:56:41.202860+0000","last_active":"2023-10-09T12:56:41.210554+0000","last_peered":"2023-10-09T12:56:41.210554+0000","last_clean":"2023-10-09T12:56:41.210554+0000","last_became_active":"2023-10-09T12:56:41.202600+0000","last_became_peered":"2023-10-09T12:56:41.202600+0000","last_unstale":"2023-10-09T12:56:41.210554+0000","last_undegraded":"2023-10-09T12:56:41.210554+0000","last_fullsized":"2023-10-09T12:56:41.210554+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:30.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213188+0000","last_change":"2023-10-09T12:56:41.211251+0000","last_active":"2023-10-09T12:56:41.213188+0000","last_peered":"2023-10-09T12:56:41.213188+0000","last_clean":"2023-10-09T12:56:41.213188+0000","last_became_active":"2023-10-09T12:56:41.210620+0000","last_became_peered":"2023-10-09T12:56:41.210620+0000","last_unstale":"2023-10-09T12:56:41.213188+0000","last_undegraded":"2023-10-09T12:56:41.213188+0000","last_fullsized":"2023-10-09T12:56:41.213188+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:19.628878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212780+0000","last_change":"2023-10-09T12:56:41.209624+0000","last_active":"2023-10-09T12:56:41.212780+0000","last_peered":"2023-10-09T12:56:41.212780+0000","last_clean":"2023-10-09T12:56:41.212780+0000","last_became_active":"2023-10-09T12:56:41.209328+0000","last_became_peered":"2023-10-09T12:56:41.209328+0000","last_unstale":"2023-10-09T12:56:41.212780+0000","last_undegraded":"2023-10-09T12:56:41.212780+0000","last_fullsized":"2023-10-09T12:56:41.212780+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:53.540498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.196427+0000","last_change":"2023-10-09T12:56:41.194282+0000","last_active":"2023-10-09T12:56:41.196427+0000","last_peered":"2023-10-09T12:56:41.196427+0000","last_clean":"2023-10-09T12:56:41.196427+0000","last_became_active":"2023-10-09T12:56:41.194023+0000","last_became_peered":"2023-10-09T12:56:41.194023+0000","last_unstale":"2023-10-09T12:56:41.196427+0000","last_undegraded":"2023-10-09T12:56:41.196427+0000","last_fullsized":"2023-10-09T12:56:41.196427+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:42.661474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.201762+0000","last_change":"2023-10-09T12:56:41.199470+0000","last_active":"2023-10-09T12:56:41.201762+0000","last_peered":"2023-10-09T12:56:41.201762+0000","last_clean":"2023-10-09T12:56:41.201762+0000","last_became_active":"2023-10-09T12:56:41.199035+0000","last_became_peered":"2023-10-09T12:56:41.199035+0000","last_unstale":"2023-10-09T12:56:41.201762+0000","last_undegraded":"2023-10-09T12:56:41.201762+0000","last_fullsized":"2023-10-09T12:56:41.201762+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:35.023110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212642+0000","last_change":"2023-10-09T12:56:41.206916+0000","last_active":"2023-10-09T12:56:41.212642+0000","last_peered":"2023-10-09T12:56:41.212642+0000","last_clean":"2023-10-09T12:56:41.212642+0000","last_became_active":"2023-10-09T12:56:41.206343+0000","last_became_peered":"2023-10-09T12:56:41.206343+0000","last_unstale":"2023-10-09T12:56:41.212642+0000","last_undegraded":"2023-10-09T12:56:41.212642+0000","last_fullsized":"2023-10-09T12:56:41.212642+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:11.234309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.214895+0000","last_change":"2023-10-09T12:56:41.212161+0000","last_active":"2023-10-09T12:56:41.214895+0000","last_peered":"2023-10-09T12:56:41.214895+0000","last_clean":"2023-10-09T12:56:41.214895+0000","last_became_active":"2023-10-09T12:56:41.211687+0000","last_became_peered":"2023-10-09T12:56:41.211687+0000","last_unstale":"2023-10-09T12:56:41.214895+0000","last_undegraded":"2023-10-09T12:56:41.214895+0000","last_fullsized":"2023-10-09T12:56:41.214895+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:09.335463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.203167+0000","last_change":"2023-10-09T12:56:41.201499+0000","last_active":"2023-10-09T12:56:41.203167+0000","last_peered":"2023-10-09T12:56:41.203167+0000","last_clean":"2023-10-09T12:56:41.203167+0000","last_became_active":"2023-10-09T12:56:41.200932+0000","last_became_peered":"2023-10-09T12:56:41.200932+0000","last_unstale":"2023-10-09T12:56:41.203167+0000","last_undegraded":"2023-10-09T12:56:41.203167+0000","last_fullsized":"2023-10-09T12:56:41.203167+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:42.925571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.217554+0000","last_change":"2023-10-09T12:56:41.215278+0000","last_active":"2023-10-09T12:56:41.217554+0000","last_peered":"2023-10-09T12:56:41.217554+0000","last_clean":"2023-10-09T12:56:41.217554+0000","last_became_active":"2023-10-09T12:56:41.214975+0000","last_became_peered":"2023-10-09T12:56:41.214975+0000","last_unstale":"2023-10-09T12:56:41.217554+0000","last_undegraded":"2023-10-09T12:56:41.217554+0000","last_fullsized":"2023-10-09T12:56:41.217554+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:28.935539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.220151+0000","last_change":"2023-10-09T12:56:41.218193+0000","last_active":"2023-10-09T12:56:41.220151+0000","last_peered":"2023-10-09T12:56:41.220151+0000","last_clean":"2023-10-09T12:56:41.220151+0000","last_became_active":"2023-10-09T12:56:41.217929+0000","last_became_peered":"2023-10-09T12:56:41.217929+0000","last_unstale":"2023-10-09T12:56:41.220151+0000","last_undegraded":"2023-10-09T12:56:41.220151+0000","last_fullsized":"2023-10-09T12:56:41.220151+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:54.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205200+0000","last_change":"2023-10-09T12:56:41.201268+0000","last_active":"2023-10-09T12:56:41.205200+0000","last_peered":"2023-10-09T12:56:41.205200+0000","last_clean":"2023-10-09T12:56:41.205200+0000","last_became_active":"2023-10-09T12:56:41.200992+0000","last_became_peered":"2023-10-09T12:56:41.200992+0000","last_unstale":"2023-10-09T12:56:41.205200+0000","last_undegraded":"2023-10-09T12:56:41.205200+0000","last_fullsized":"2023-10-09T12:56:41.205200+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:45.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212548+0000","last_change":"2023-10-09T12:56:41.207789+0000","last_active":"2023-10-09T12:56:41.212548+0000","last_peered":"2023-10-09T12:56:41.212548+0000","last_clean":"2023-10-09T12:56:41.212548+0000","last_became_active":"2023-10-09T12:56:41.207551+0000","last_became_peered":"2023-10-09T12:56:41.207551+0000","last_unstale":"2023-10-09T12:56:41.212548+0000","last_undegraded":"2023-10-09T12:56:41.212548+0000","last_fullsized":"2023-10-09T12:56:41.212548+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:52.264576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.201725+0000","last_change":"2023-10-09T12:56:41.199295+0000","last_active":"2023-10-09T12:56:41.201725+0000","last_peered":"2023-10-09T12:56:41.201725+0000","last_clean":"2023-10-09T12:56:41.201725+0000","last_became_active":"2023-10-09T12:56:41.198704+0000","last_became_peered":"2023-10-09T12:56:41.198704+0000","last_unstale":"2023-10-09T12:56:41.201725+0000","last_undegraded":"2023-10-09T12:56:41.201725+0000","last_fullsized":"2023-10-09T12:56:41.201725+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:38.935064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.214618+0000","last_change":"2023-10-09T12:56:41.208786+0000","last_active":"2023-10-09T12:56:41.214618+0000","last_peered":"2023-10-09T12:56:41.214618+0000","last_clean":"2023-10-09T12:56:41.214618+0000","last_became_active":"2023-10-09T12:56:41.208539+0000","last_became_peered":"2023-10-09T12:56:41.208539+0000","last_unstale":"2023-10-09T12:56:41.214618+0000","last_undegraded":"2023-10-09T12:56:41.214618+0000","last_fullsized":"2023-10-09T12:56:41.214618+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:48.819064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206253+0000","last_change":"2023-10-09T12:56:41.204063+0000","last_active":"2023-10-09T12:56:41.206253+0000","last_peered":"2023-10-09T12:56:41.206253+0000","last_clean":"2023-10-09T12:56:41.206253+0000","last_became_active":"2023-10-09T12:56:41.203787+0000","last_became_peered":"2023-10-09T12:56:41.203787+0000","last_unstale":"2023-10-09T12:56:41.206253+0000","last_undegraded":"2023-10-09T12:56:41.206253+0000","last_fullsized":"2023-10-09T12:56:41.206253+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:14.496883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.200376+0000","last_change":"2023-10-09T12:56:41.197401+0000","last_active":"2023-10-09T12:56:41.200376+0000","last_peered":"2023-10-09T12:56:41.200376+0000","last_clean":"2023-10-09T12:56:41.200376+0000","last_became_active":"2023-10-09T12:56:41.197140+0000","last_became_peered":"2023-10-09T12:56:41.197140+0000","last_unstale":"2023-10-09T12:56:41.200376+0000","last_undegraded":"2023-10-09T12:56:41.200376+0000","last_fullsized":"2023-10-09T12:56:41.200376+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:33.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212701+0000","last_change":"2023-10-09T12:56:41.208397+0000","last_active":"2023-10-09T12:56:41.212701+0000","last_peered":"2023-10-09T12:56:41.212701+0000","last_clean":"2023-10-09T12:56:41.212701+0000","last_became_active":"2023-10-09T12:56:41.208100+0000","last_became_peered":"2023-10-09T12:56:41.208100+0000","last_unstale":"2023-10-09T12:56:41.212701+0000","last_undegraded":"2023-10-09T12:56:41.212701+0000","last_fullsized":"2023-10-09T12:56:41.212701+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:03.347149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.208108+0000","last_change":"2023-10-09T12:56:41.203328+0000","last_active":"2023-10-09T12:56:41.208108+0000","last_peered":"2023-10-09T12:56:41.208108+0000","last_clean":"2023-10-09T12:56:41.208108+0000","last_became_active":"2023-10-09T12:56:41.203070+0000","last_became_peered":"2023-10-09T12:56:41.203070+0000","last_unstale":"2023-10-09T12:56:41.208108+0000","last_undegraded":"2023-10-09T12:56:41.208108+0000","last_fullsized":"2023-10-09T12:56:41.208108+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:55.784512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205803+0000","last_change":"2023-10-09T12:56:41.197725+0000","last_active":"2023-10-09T12:56:41.205803+0000","last_peered":"2023-10-09T12:56:41.205803+0000","last_clean":"2023-10-09T12:56:41.205803+0000","last_became_active":"2023-10-09T12:56:41.197463+0000","last_became_peered":"2023-10-09T12:56:41.197463+0000","last_unstale":"2023-10-09T12:56:41.205803+0000","last_undegraded":"2023-10-09T12:56:41.205803+0000","last_fullsized":"2023-10-09T12:56:41.205803+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:48.052991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226627+0000","last_change":"2023-10-09T12:56:41.223742+0000","last_active":"2023-10-09T12:56:41.226627+0000","last_peered":"2023-10-09T12:56:41.226627+0000","last_clean":"2023-10-09T12:56:41.226627+0000","last_became_active":"2023-10-09T12:56:41.223417+0000","last_became_peered":"2023-10-09T12:56:41.223417+0000","last_unstale":"2023-10-09T12:56:41.226627+0000","last_undegraded":"2023-10-09T12:56:41.226627+0000","last_fullsized":"2023-10-09T12:56:41.226627+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:46:38.243176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215594+0000","last_change":"2023-10-09T12:56:41.212742+0000","last_active":"2023-10-09T12:56:41.215594+0000","last_peered":"2023-10-09T12:56:41.215594+0000","last_clean":"2023-10-09T12:56:41.215594+0000","last_became_active":"2023-10-09T12:56:41.212461+0000","last_became_peered":"2023-10-09T12:56:41.212461+0000","last_unstale":"2023-10-09T12:56:41.215594+0000","last_undegraded":"2023-10-09T12:56:41.215594+0000","last_fullsized":"2023-10-09T12:56:41.215594+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:37.512580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212610+0000","last_change":"2023-10-09T12:56:41.208601+0000","last_active":"2023-10-09T12:56:41.212610+0000","last_peered":"2023-10-09T12:56:41.212610+0000","last_clean":"2023-10-09T12:56:41.212610+0000","last_became_active":"2023-10-09T12:56:41.208280+0000","last_became_peered":"2023-10-09T12:56:41.208280+0000","last_unstale":"2023-10-09T12:56:41.212610+0000","last_undegraded":"2023-10-09T12:56:41.212610+0000","last_fullsized":"2023-10-09T12:56:41.212610+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:15.444415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215624+0000","last_change":"2023-10-09T12:56:41.214466+0000","last_active":"2023-10-09T12:56:41.215624+0000","last_peered":"2023-10-09T12:56:41.215624+0000","last_clean":"2023-10-09T12:56:41.215624+0000","last_became_active":"2023-10-09T12:56:41.214145+0000","last_became_peered":"2023-10-09T12:56:41.214145+0000","last_unstale":"2023-10-09T12:56:41.215624+0000","last_undegraded":"2023-10-09T12:56:41.215624+0000","last_fullsized":"2023-10-09T12:56:41.215624+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:30.365070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215558+0000","last_change":"2023-10-09T12:56:41.214286+0000","last_active":"2023-10-09T12:56:41.215558+0000","last_peered":"2023-10-09T12:56:41.215558+0000","last_clean":"2023-10-09T12:56:41.215558+0000","last_became_active":"2023-10-09T12:56:41.214015+0000","last_became_peered":"2023-10-09T12:56:41.214015+0000","last_unstale":"2023-10-09T12:56:41.215558+0000","last_undegraded":"2023-10-09T12:56:41.215558+0000","last_fullsized":"2023-10-09T12:56:41.215558+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:26.115172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221594+0000","last_change":"2023-10-09T12:56:41.218221+0000","last_active":"2023-10-09T12:56:41.221594+0000","last_peered":"2023-10-09T12:56:41.221594+0000","last_clean":"2023-10-09T12:56:41.221594+0000","last_became_active":"2023-10-09T12:56:41.217961+0000","last_became_peered":"2023-10-09T12:56:41.217961+0000","last_unstale":"2023-10-09T12:56:41.221594+0000","last_undegraded":"2023-10-09T12:56:41.221594+0000","last_fullsized":"2023-10-09T12:56:41.221594+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:25.910571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213227+0000","last_change":"2023-10-09T12:56:41.209949+0000","last_active":"2023-10-09T12:56:41.213227+0000","last_peered":"2023-10-09T12:56:41.213227+0000","last_clean":"2023-10-09T12:56:41.213227+0000","last_became_active":"2023-10-09T12:56:41.209641+0000","last_became_peered":"2023-10-09T12:56:41.209641+0000","last_unstale":"2023-10-09T12:56:41.213227+0000","last_undegraded":"2023-10-09T12:56:41.213227+0000","last_fullsized":"2023-10-09T12:56:41.213227+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:19.749204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.208086+0000","last_change":"2023-10-09T12:56:41.207222+0000","last_active":"2023-10-09T12:56:41.208086+0000","last_peered":"2023-10-09T12:56:41.208086+0000","last_clean":"2023-10-09T12:56:41.208086+0000","last_became_active":"2023-10-09T12:56:41.206946+0000","last_became_peered":"2023-10-09T12:56:41.206946+0000","last_unstale":"2023-10-09T12:56:41.208086+0000","last_undegraded":"2023-10-09T12:56:41.208086+0000","last_fullsized":"2023-10-09T12:56:41.208086+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:02.903312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"163'4","reported_seq":14,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.227304+0000","last_change":"2023-10-09T12:56:40.200986+0000","last_active":"2023-10-09T12:56:41.227304+0000","last_peered":"2023-10-09T12:56:41.227304+0000","last_clean":"2023-10-09T12:56:41.227304+0000","last_became_active":"2023-10-09T12:56:40.200216+0000","last_became_peered":"2023-10-09T12:56:40.200216+0000","last_unstale":"2023-10-09T12:56:41.227304+0000","last_undegraded":"2023-10-09T12:56:41.227304+0000","last_fullsized":"2023-10-09T12:56:41.227304+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:07.511454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.225588+0000","last_change":"2023-10-09T12:56:41.221520+0000","last_active":"2023-10-09T12:56:41.225588+0000","last_peered":"2023-10-09T12:56:41.225588+0000","last_clean":"2023-10-09T12:56:41.225588+0000","last_became_active":"2023-10-09T12:56:41.220945+0000","last_became_peered":"2023-10-09T12:56:41.220945+0000","last_unstale":"2023-10-09T12:56:41.225588+0000","last_undegraded":"2023-10-09T12:56:41.225588+0000","last_fullsized":"2023-10-09T12:56:41.225588+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:30.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.224057+0000","last_change":"2023-10-09T12:56:40.199587+0000","last_active":"2023-10-09T12:56:41.224057+0000","last_peered":"2023-10-09T12:56:41.224057+0000","last_clean":"2023-10-09T12:56:41.224057+0000","last_became_active":"2023-10-09T12:56:40.199326+0000","last_became_peered":"2023-10-09T12:56:40.199326+0000","last_unstale":"2023-10-09T12:56:41.224057+0000","last_undegraded":"2023-10-09T12:56:41.224057+0000","last_fullsized":"2023-10-09T12:56:41.224057+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:11.717159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.211184+0000","last_change":"2023-10-09T12:56:41.208062+0000","last_active":"2023-10-09T12:56:41.211184+0000","last_peered":"2023-10-09T12:56:41.211184+0000","last_clean":"2023-10-09T12:56:41.211184+0000","last_became_active":"2023-10-09T12:56:41.207688+0000","last_became_peered":"2023-10-09T12:56:41.207688+0000","last_unstale":"2023-10-09T12:56:41.211184+0000","last_undegraded":"2023-10-09T12:56:41.211184+0000","last_fullsized":"2023-10-09T12:56:41.211184+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:18.942937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.224722+0000","last_change":"2023-10-09T12:56:40.193710+0000","last_active":"2023-10-09T12:56:41.224722+0000","last_peered":"2023-10-09T12:56:41.224722+0000","last_clean":"2023-10-09T12:56:41.224722+0000","last_became_active":"2023-10-09T12:56:40.193438+0000","last_became_peered":"2023-10-09T12:56:40.193438+0000","last_unstale":"2023-10-09T12:56:41.224722+0000","last_undegraded":"2023-10-09T12:56:41.224722+0000","last_fullsized":"2023-10-09T12:56:41.224722+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:47.900965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.204288+0000","last_change":"2023-10-09T12:56:41.200279+0000","last_active":"2023-10-09T12:56:41.204288+0000","last_peered":"2023-10-09T12:56:41.204288+0000","last_clean":"2023-10-09T12:56:41.204288+0000","last_became_active":"2023-10-09T12:56:41.199991+0000","last_became_peered":"2023-10-09T12:56:41.199991+0000","last_unstale":"2023-10-09T12:56:41.204288+0000","last_undegraded":"2023-10-09T12:56:41.204288+0000","last_fullsized":"2023-10-09T12:56:41.204288+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:24.008950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.224816+0000","last_change":"2023-10-09T12:56:40.198835+0000","last_active":"2023-10-09T12:56:41.224816+0000","last_peered":"2023-10-09T12:56:41.224816+0000","last_clean":"2023-10-09T12:56:41.224816+0000","last_became_active":"2023-10-09T12:56:40.198517+0000","last_became_peered":"2023-10-09T12:56:40.198517+0000","last_unstale":"2023-10-09T12:56:41.224816+0000","last_undegraded":"2023-10-09T12:56:41.224816+0000","last_fullsized":"2023-10-09T12:56:41.224816+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:34.192813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.207427+0000","last_change":"2023-10-09T12:56:41.206685+0000","last_active":"2023-10-09T12:56:41.207427+0000","last_peered":"2023-10-09T12:56:41.207427+0000","last_clean":"2023-10-09T12:56:41.207427+0000","last_became_active":"2023-10-09T12:56:41.206395+0000","last_became_peered":"2023-10-09T12:56:41.206395+0000","last_unstale":"2023-10-09T12:56:41.207427+0000","last_undegraded":"2023-10-09T12:56:41.207427+0000","last_fullsized":"2023-10-09T12:56:41.207427+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:20.437154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.222734+0000","last_change":"2023-10-09T12:56:40.200402+0000","last_active":"2023-10-09T12:56:41.222734+0000","last_peered":"2023-10-09T12:56:41.222734+0000","last_clean":"2023-10-09T12:56:41.222734+0000","last_became_active":"2023-10-09T12:56:40.200142+0000","last_became_peered":"2023-10-09T12:56:40.200142+0000","last_unstale":"2023-10-09T12:56:41.222734+0000","last_undegraded":"2023-10-09T12:56:41.222734+0000","last_fullsized":"2023-10-09T12:56:41.222734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:36.087066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205189+0000","last_change":"2023-10-09T12:56:41.201963+0000","last_active":"2023-10-09T12:56:41.205189+0000","last_peered":"2023-10-09T12:56:41.205189+0000","last_clean":"2023-10-09T12:56:41.205189+0000","last_became_active":"2023-10-09T12:56:41.201649+0000","last_became_peered":"2023-10-09T12:56:41.201649+0000","last_unstale":"2023-10-09T12:56:41.205189+0000","last_undegraded":"2023-10-09T12:56:41.205189+0000","last_fullsized":"2023-10-09T12:56:41.205189+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:53.540498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.225095+0000","last_change":"2023-10-09T12:56:40.200866+0000","last_active":"2023-10-09T12:56:41.225095+0000","last_peered":"2023-10-09T12:56:41.225095+0000","last_clean":"2023-10-09T12:56:41.225095+0000","last_became_active":"2023-10-09T12:56:40.200604+0000","last_became_peered":"2023-10-09T12:56:40.200604+0000","last_unstale":"2023-10-09T12:56:41.225095+0000","last_undegraded":"2023-10-09T12:56:41.225095+0000","last_fullsized":"2023-10-09T12:56:41.225095+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:37.283044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213324+0000","last_change":"2023-10-09T12:56:41.211706+0000","last_active":"2023-10-09T12:56:41.213324+0000","last_peered":"2023-10-09T12:56:41.213324+0000","last_clean":"2023-10-09T12:56:41.213324+0000","last_became_active":"2023-10-09T12:56:41.210992+0000","last_became_peered":"2023-10-09T12:56:41.210992+0000","last_unstale":"2023-10-09T12:56:41.213324+0000","last_undegraded":"2023-10-09T12:56:41.213324+0000","last_fullsized":"2023-10-09T12:56:41.213324+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:10.089824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.190938+0000","last_change":"2023-10-09T12:56:40.198474+0000","last_active":"2023-10-09T12:56:41.190938+0000","last_peered":"2023-10-09T12:56:41.190938+0000","last_clean":"2023-10-09T12:56:41.190938+0000","last_became_active":"2023-10-09T12:56:40.198020+0000","last_became_peered":"2023-10-09T12:56:40.198020+0000","last_unstale":"2023-10-09T12:56:41.190938+0000","last_undegraded":"2023-10-09T12:56:41.190938+0000","last_fullsized":"2023-10-09T12:56:41.190938+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:06.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.202031+0000","last_change":"2023-10-09T12:56:41.197159+0000","last_active":"2023-10-09T12:56:41.202031+0000","last_peered":"2023-10-09T12:56:41.202031+0000","last_clean":"2023-10-09T12:56:41.202031+0000","last_became_active":"2023-10-09T12:56:41.196894+0000","last_became_peered":"2023-10-09T12:56:41.196894+0000","last_unstale":"2023-10-09T12:56:41.202031+0000","last_undegraded":"2023-10-09T12:56:41.202031+0000","last_fullsized":"2023-10-09T12:56:41.202031+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:40.820496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188028+0000","last_change":"2023-10-09T12:56:40.198174+0000","last_active":"2023-10-09T12:56:41.188028+0000","last_peered":"2023-10-09T12:56:41.188028+0000","last_clean":"2023-10-09T12:56:41.188028+0000","last_became_active":"2023-10-09T12:56:40.197916+0000","last_became_peered":"2023-10-09T12:56:40.197916+0000","last_unstale":"2023-10-09T12:56:41.188028+0000","last_undegraded":"2023-10-09T12:56:41.188028+0000","last_fullsized":"2023-10-09T12:56:41.188028+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:20:58.207467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221740+0000","last_change":"2023-10-09T12:56:41.217019+0000","last_active":"2023-10-09T12:56:41.221740+0000","last_peered":"2023-10-09T12:56:41.221740+0000","last_clean":"2023-10-09T12:56:41.221740+0000","last_became_active":"2023-10-09T12:56:41.216575+0000","last_became_peered":"2023-10-09T12:56:41.216575+0000","last_unstale":"2023-10-09T12:56:41.221740+0000","last_undegraded":"2023-10-09T12:56:41.221740+0000","last_fullsized":"2023-10-09T12:56:41.221740+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:42.712885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.192232+0000","last_change":"2023-10-09T12:56:40.190266+0000","last_active":"2023-10-09T12:56:41.192232+0000","last_peered":"2023-10-09T12:56:41.192232+0000","last_clean":"2023-10-09T12:56:41.192232+0000","last_became_active":"2023-10-09T12:56:40.189994+0000","last_became_peered":"2023-10-09T12:56:40.189994+0000","last_unstale":"2023-10-09T12:56:41.192232+0000","last_undegraded":"2023-10-09T12:56:41.192232+0000","last_fullsized":"2023-10-09T12:56:41.192232+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:13.957862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213356+0000","last_change":"2023-10-09T12:56:41.210602+0000","last_active":"2023-10-09T12:56:41.213356+0000","last_peered":"2023-10-09T12:56:41.213356+0000","last_clean":"2023-10-09T12:56:41.213356+0000","last_became_active":"2023-10-09T12:56:41.209873+0000","last_became_peered":"2023-10-09T12:56:41.209873+0000","last_unstale":"2023-10-09T12:56:41.213356+0000","last_undegraded":"2023-10-09T12:56:41.213356+0000","last_fullsized":"2023-10-09T12:56:41.213356+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:40.291478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.198639+0000","last_change":"2023-10-09T12:56:40.197850+0000","last_active":"2023-10-09T12:56:41.198639+0000","last_peered":"2023-10-09T12:56:41.198639+0000","last_clean":"2023-10-09T12:56:41.198639+0000","last_became_active":"2023-10-09T12:56:40.197613+0000","last_became_peered":"2023-10-09T12:56:40.197613+0000","last_unstale":"2023-10-09T12:56:41.198639+0000","last_undegraded":"2023-10-09T12:56:41.198639+0000","last_fullsized":"2023-10-09T12:56:41.198639+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:09.163749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212818+0000","last_change":"2023-10-09T12:56:41.209083+0000","last_active":"2023-10-09T12:56:41.212818+0000","last_peered":"2023-10-09T12:56:41.212818+0000","last_clean":"2023-10-09T12:56:41.212818+0000","last_became_active":"2023-10-09T12:56:41.208688+0000","last_became_peered":"2023-10-09T12:56:41.208688+0000","last_unstale":"2023-10-09T12:56:41.212818+0000","last_undegraded":"2023-10-09T12:56:41.212818+0000","last_fullsized":"2023-10-09T12:56:41.212818+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:59.474169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"163'3","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226818+0000","last_change":"2023-10-09T12:56:40.194468+0000","last_active":"2023-10-09T12:56:41.226818+0000","last_peered":"2023-10-09T12:56:41.226818+0000","last_clean":"2023-10-09T12:56:41.226818+0000","last_became_active":"2023-10-09T12:56:40.194156+0000","last_became_peered":"2023-10-09T12:56:40.194156+0000","last_unstale":"2023-10-09T12:56:41.226818+0000","last_undegraded":"2023-10-09T12:56:41.226818+0000","last_fullsized":"2023-10-09T12:56:41.226818+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:39.814742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.208735+0000","last_change":"2023-10-09T12:56:41.206945+0000","last_active":"2023-10-09T12:56:41.208735+0000","last_peered":"2023-10-09T12:56:41.208735+0000","last_clean":"2023-10-09T12:56:41.208735+0000","last_became_active":"2023-10-09T12:56:41.206648+0000","last_became_peered":"2023-10-09T12:56:41.206648+0000","last_unstale":"2023-10-09T12:56:41.208735+0000","last_undegraded":"2023-10-09T12:56:41.208735+0000","last_fullsized":"2023-10-09T12:56:41.208735+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:53.392012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"163'6","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.228887+0000","last_change":"2023-10-09T12:56:40.198051+0000","last_active":"2023-10-09T12:56:41.228887+0000","last_peered":"2023-10-09T12:56:41.228887+0000","last_clean":"2023-10-09T12:56:41.228887+0000","last_became_active":"2023-10-09T12:56:40.197783+0000","last_became_peered":"2023-10-09T12:56:40.197783+0000","last_unstale":"2023-10-09T12:56:41.228887+0000","last_undegraded":"2023-10-09T12:56:41.228887+0000","last_fullsized":"2023-10-09T12:56:41.228887+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:46.133012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221775+0000","last_change":"2023-10-09T12:56:41.217468+0000","last_active":"2023-10-09T12:56:41.221775+0000","last_peered":"2023-10-09T12:56:41.221775+0000","last_clean":"2023-10-09T12:56:41.221775+0000","last_became_active":"2023-10-09T12:56:41.217131+0000","last_became_peered":"2023-10-09T12:56:41.217131+0000","last_unstale":"2023-10-09T12:56:41.221775+0000","last_undegraded":"2023-10-09T12:56:41.221775+0000","last_fullsized":"2023-10-09T12:56:41.221775+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:22.704200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.196005+0000","last_change":"2023-10-09T12:56:40.193811+0000","last_active":"2023-10-09T12:56:41.196005+0000","last_peered":"2023-10-09T12:56:41.196005+0000","last_clean":"2023-10-09T12:56:41.196005+0000","last_became_active":"2023-10-09T12:56:40.193555+0000","last_became_peered":"2023-10-09T12:56:40.193555+0000","last_unstale":"2023-10-09T12:56:41.196005+0000","last_undegraded":"2023-10-09T12:56:41.196005+0000","last_fullsized":"2023-10-09T12:56:41.196005+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:36.381029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215840+0000","last_change":"2023-10-09T12:56:41.210594+0000","last_active":"2023-10-09T12:56:41.215840+0000","last_peered":"2023-10-09T12:56:41.215840+0000","last_clean":"2023-10-09T12:56:41.215840+0000","last_became_active":"2023-10-09T12:56:41.210338+0000","last_became_peered":"2023-10-09T12:56:41.210338+0000","last_unstale":"2023-10-09T12:56:41.215840+0000","last_undegraded":"2023-10-09T12:56:41.215840+0000","last_fullsized":"2023-10-09T12:56:41.215840+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:12.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188106+0000","last_change":"2023-10-09T12:56:40.199574+0000","last_active":"2023-10-09T12:56:41.188106+0000","last_peered":"2023-10-09T12:56:41.188106+0000","last_clean":"2023-10-09T12:56:41.188106+0000","last_became_active":"2023-10-09T12:56:40.199173+0000","last_became_peered":"2023-10-09T12:56:40.199173+0000","last_unstale":"2023-10-09T12:56:41.188106+0000","last_undegraded":"2023-10-09T12:56:41.188106+0000","last_fullsized":"2023-10-09T12:56:41.188106+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:05.454354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212681+0000","last_change":"2023-10-09T12:56:41.207253+0000","last_active":"2023-10-09T12:56:41.212681+0000","last_peered":"2023-10-09T12:56:41.212681+0000","last_clean":"2023-10-09T12:56:41.212681+0000","last_became_active":"2023-10-09T12:56:41.206948+0000","last_became_peered":"2023-10-09T12:56:41.206948+0000","last_unstale":"2023-10-09T12:56:41.212681+0000","last_undegraded":"2023-10-09T12:56:41.212681+0000","last_fullsized":"2023-10-09T12:56:41.212681+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:34.816541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"163'8","reported_seq":18,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.227033+0000","last_change":"2023-10-09T12:56:40.191977+0000","last_active":"2023-10-09T12:56:41.227033+0000","last_peered":"2023-10-09T12:56:41.227033+0000","last_clean":"2023-10-09T12:56:41.227033+0000","last_became_active":"2023-10-09T12:56:40.191227+0000","last_became_peered":"2023-10-09T12:56:40.191227+0000","last_unstale":"2023-10-09T12:56:41.227033+0000","last_undegraded":"2023-10-09T12:56:41.227033+0000","last_fullsized":"2023-10-09T12:56:41.227033+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:01.913140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223148+0000","last_change":"2023-10-09T12:56:41.220651+0000","last_active":"2023-10-09T12:56:41.223148+0000","last_peered":"2023-10-09T12:56:41.223148+0000","last_clean":"2023-10-09T12:56:41.223148+0000","last_became_active":"2023-10-09T12:56:41.220366+0000","last_became_peered":"2023-10-09T12:56:41.220366+0000","last_unstale":"2023-10-09T12:56:41.223148+0000","last_undegraded":"2023-10-09T12:56:41.223148+0000","last_fullsized":"2023-10-09T12:56:41.223148+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:45.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223630+0000","last_change":"2023-10-09T12:56:40.197291+0000","last_active":"2023-10-09T12:56:41.223630+0000","last_peered":"2023-10-09T12:56:41.223630+0000","last_clean":"2023-10-09T12:56:41.223630+0000","last_became_active":"2023-10-09T12:56:40.197037+0000","last_became_peered":"2023-10-09T12:56:40.197037+0000","last_unstale":"2023-10-09T12:56:41.223630+0000","last_undegraded":"2023-10-09T12:56:41.223630+0000","last_fullsized":"2023-10-09T12:56:41.223630+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:47.047237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205431+0000","last_change":"2023-10-09T12:56:41.202322+0000","last_active":"2023-10-09T12:56:41.205431+0000","last_peered":"2023-10-09T12:56:41.205431+0000","last_clean":"2023-10-09T12:56:41.205431+0000","last_became_active":"2023-10-09T12:56:41.202080+0000","last_became_peered":"2023-10-09T12:56:41.202080+0000","last_unstale":"2023-10-09T12:56:41.205431+0000","last_undegraded":"2023-10-09T12:56:41.205431+0000","last_fullsized":"2023-10-09T12:56:41.205431+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:32.283953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226124+0000","last_change":"2023-10-09T12:56:40.195245+0000","last_active":"2023-10-09T12:56:41.226124+0000","last_peered":"2023-10-09T12:56:41.226124+0000","last_clean":"2023-10-09T12:56:41.226124+0000","last_became_active":"2023-10-09T12:56:40.195008+0000","last_became_peered":"2023-10-09T12:56:40.195008+0000","last_unstale":"2023-10-09T12:56:41.226124+0000","last_undegraded":"2023-10-09T12:56:41.226124+0000","last_fullsized":"2023-10-09T12:56:41.226124+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:01.897558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221239+0000","last_change":"2023-10-09T12:56:41.218145+0000","last_active":"2023-10-09T12:56:41.221239+0000","last_peered":"2023-10-09T12:56:41.221239+0000","last_clean":"2023-10-09T12:56:41.221239+0000","last_became_active":"2023-10-09T12:56:41.217872+0000","last_became_peered":"2023-10-09T12:56:41.217872+0000","last_unstale":"2023-10-09T12:56:41.221239+0000","last_undegraded":"2023-10-09T12:56:41.221239+0000","last_fullsized":"2023-10-09T12:56:41.221239+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:40.512729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223920+0000","last_change":"2023-10-09T12:56:40.194095+0000","last_active":"2023-10-09T12:56:41.223920+0000","last_peered":"2023-10-09T12:56:41.223920+0000","last_clean":"2023-10-09T12:56:41.223920+0000","last_became_active":"2023-10-09T12:56:40.193831+0000","last_became_peered":"2023-10-09T12:56:40.193831+0000","last_unstale":"2023-10-09T12:56:41.223920+0000","last_undegraded":"2023-10-09T12:56:41.223920+0000","last_fullsized":"2023-10-09T12:56:41.223920+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:09.794998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.214744+0000","last_change":"2023-10-09T12:56:41.209388+0000","last_active":"2023-10-09T12:56:41.214744+0000","last_peered":"2023-10-09T12:56:41.214744+0000","last_clean":"2023-10-09T12:56:41.214744+0000","last_became_active":"2023-10-09T12:56:41.209116+0000","last_became_peered":"2023-10-09T12:56:41.209116+0000","last_unstale":"2023-10-09T12:56:41.214744+0000","last_undegraded":"2023-10-09T12:56:41.214744+0000","last_fullsized":"2023-10-09T12:56:41.214744+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:00.320657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.191313+0000","last_change":"2023-10-09T12:56:40.195728+0000","last_active":"2023-10-09T12:56:41.191313+0000","last_peered":"2023-10-09T12:56:41.191313+0000","last_clean":"2023-10-09T12:56:41.191313+0000","last_became_active":"2023-10-09T12:56:40.194932+0000","last_became_peered":"2023-10-09T12:56:40.194932+0000","last_unstale":"2023-10-09T12:56:41.191313+0000","last_undegraded":"2023-10-09T12:56:41.191313+0000","last_fullsized":"2023-10-09T12:56:41.191313+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:35.240421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213846+0000","last_change":"2023-10-09T12:56:41.211438+0000","last_active":"2023-10-09T12:56:41.213846+0000","last_peered":"2023-10-09T12:56:41.213846+0000","last_clean":"2023-10-09T12:56:41.213846+0000","last_became_active":"2023-10-09T12:56:41.211052+0000","last_became_peered":"2023-10-09T12:56:41.211052+0000","last_unstale":"2023-10-09T12:56:41.213846+0000","last_undegraded":"2023-10-09T12:56:41.213846+0000","last_fullsized":"2023-10-09T12:56:41.213846+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:28.664807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.222319+0000","last_change":"2023-10-09T12:56:40.189077+0000","last_active":"2023-10-09T12:56:41.222319+0000","last_peered":"2023-10-09T12:56:41.222319+0000","last_clean":"2023-10-09T12:56:41.222319+0000","last_became_active":"2023-10-09T12:56:40.188745+0000","last_became_peered":"2023-10-09T12:56:40.188745+0000","last_unstale":"2023-10-09T12:56:41.222319+0000","last_undegraded":"2023-10-09T12:56:41.222319+0000","last_fullsized":"2023-10-09T12:56:41.222319+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:59.314903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213144+0000","last_change":"2023-10-09T12:56:41.210679+0000","last_active":"2023-10-09T12:56:41.213144+0000","last_peered":"2023-10-09T12:56:41.213144+0000","last_clean":"2023-10-09T12:56:41.213144+0000","last_became_active":"2023-10-09T12:56:41.210391+0000","last_became_peered":"2023-10-09T12:56:41.210391+0000","last_unstale":"2023-10-09T12:56:41.213144+0000","last_undegraded":"2023-10-09T12:56:41.213144+0000","last_fullsized":"2023-10-09T12:56:41.213144+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:03.347149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.199289+0000","last_change":"2023-10-09T12:56:40.191302+0000","last_active":"2023-10-09T12:56:41.199289+0000","last_peered":"2023-10-09T12:56:41.199289+0000","last_clean":"2023-10-09T12:56:41.199289+0000","last_became_active":"2023-10-09T12:56:40.191034+0000","last_became_peered":"2023-10-09T12:56:40.191034+0000","last_unstale":"2023-10-09T12:56:41.199289+0000","last_undegraded":"2023-10-09T12:56:41.199289+0000","last_fullsized":"2023-10-09T12:56:41.199289+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:44.846869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205963+0000","last_change":"2023-10-09T12:56:41.201338+0000","last_active":"2023-10-09T12:56:41.205963+0000","last_peered":"2023-10-09T12:56:41.205963+0000","last_clean":"2023-10-09T12:56:41.205963+0000","last_became_active":"2023-10-09T12:56:41.201056+0000","last_became_peered":"2023-10-09T12:56:41.201056+0000","last_unstale":"2023-10-09T12:56:41.205963+0000","last_undegraded":"2023-10-09T12:56:41.205963+0000","last_fullsized":"2023-10-09T12:56:41.205963+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:53.704001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.199067+0000","last_change":"2023-10-09T12:56:40.192745+0000","last_active":"2023-10-09T12:56:41.199067+0000","last_peered":"2023-10-09T12:56:41.199067+0000","last_clean":"2023-10-09T12:56:41.199067+0000","last_became_active":"2023-10-09T12:56:40.192347+0000","last_became_peered":"2023-10-09T12:56:40.192347+0000","last_unstale":"2023-10-09T12:56:41.199067+0000","last_undegraded":"2023-10-09T12:56:41.199067+0000","last_fullsized":"2023-10-09T12:56:41.199067+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:31.491695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221613+0000","last_change":"2023-10-09T12:56:41.219289+0000","last_active":"2023-10-09T12:56:41.221613+0000","last_peered":"2023-10-09T12:56:41.221613+0000","last_clean":"2023-10-09T12:56:41.221613+0000","last_became_active":"2023-10-09T12:56:41.219049+0000","last_became_peered":"2023-10-09T12:56:41.219049+0000","last_unstale":"2023-10-09T12:56:41.221613+0000","last_undegraded":"2023-10-09T12:56:41.221613+0000","last_fullsized":"2023-10-09T12:56:41.221613+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:57.140466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.192203+0000","last_change":"2023-10-09T12:56:40.195810+0000","last_active":"2023-10-09T12:56:41.192203+0000","last_peered":"2023-10-09T12:56:41.192203+0000","last_clean":"2023-10-09T12:56:41.192203+0000","last_became_active":"2023-10-09T12:56:40.195575+0000","last_became_peered":"2023-10-09T12:56:40.195575+0000","last_unstale":"2023-10-09T12:56:41.192203+0000","last_undegraded":"2023-10-09T12:56:41.192203+0000","last_fullsized":"2023-10-09T12:56:41.192203+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:28.695383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205502+0000","last_change":"2023-10-09T12:56:41.198625+0000","last_active":"2023-10-09T12:56:41.205502+0000","last_peered":"2023-10-09T12:56:41.205502+0000","last_clean":"2023-10-09T12:56:41.205502+0000","last_became_active":"2023-10-09T12:56:41.198378+0000","last_became_peered":"2023-10-09T12:56:41.198378+0000","last_unstale":"2023-10-09T12:56:41.205502+0000","last_undegraded":"2023-10-09T12:56:41.205502+0000","last_fullsized":"2023-10-09T12:56:41.205502+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:53.131336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223179+0000","last_change":"2023-10-09T12:56:40.190441+0000","last_active":"2023-10-09T12:56:41.223179+0000","last_peered":"2023-10-09T12:56:41.223179+0000","last_clean":"2023-10-09T12:56:41.223179+0000","last_became_active":"2023-10-09T12:56:40.190179+0000","last_became_peered":"2023-10-09T12:56:40.190179+0000","last_unstale":"2023-10-09T12:56:41.223179+0000","last_undegraded":"2023-10-09T12:56:41.223179+0000","last_fullsized":"2023-10-09T12:56:41.223179+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:21.041311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.217546+0000","last_change":"2023-10-09T12:56:41.215445+0000","last_active":"2023-10-09T12:56:41.217546+0000","last_peered":"2023-10-09T12:56:41.217546+0000","last_clean":"2023-10-09T12:56:41.217546+0000","last_became_active":"2023-10-09T12:56:41.215168+0000","last_became_peered":"2023-10-09T12:56:41.215168+0000","last_unstale":"2023-10-09T12:56:41.217546+0000","last_undegraded":"2023-10-09T12:56:41.217546+0000","last_fullsized":"2023-10-09T12:56:41.217546+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:39.700317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.193482+0000","last_change":"2023-10-09T12:56:40.197211+0000","last_active":"2023-10-09T12:56:41.193482+0000","last_peered":"2023-10-09T12:56:41.193482+0000","last_clean":"2023-10-09T12:56:41.193482+0000","last_became_active":"2023-10-09T12:56:40.196962+0000","last_became_peered":"2023-10-09T12:56:40.196962+0000","last_unstale":"2023-10-09T12:56:41.193482+0000","last_undegraded":"2023-10-09T12:56:41.193482+0000","last_fullsized":"2023-10-09T12:56:41.193482+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:13.143189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206864+0000","last_change":"2023-10-09T12:56:41.205183+0000","last_active":"2023-10-09T12:56:41.206864+0000","last_peered":"2023-10-09T12:56:41.206864+0000","last_clean":"2023-10-09T12:56:41.206864+0000","last_became_active":"2023-10-09T12:56:41.204903+0000","last_became_peered":"2023-10-09T12:56:41.204903+0000","last_unstale":"2023-10-09T12:56:41.206864+0000","last_undegraded":"2023-10-09T12:56:41.206864+0000","last_fullsized":"2023-10-09T12:56:41.206864+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:29.949619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188156+0000","last_change":"2023-10-09T12:56:40.200422+0000","last_active":"2023-10-09T12:56:41.188156+0000","last_peered":"2023-10-09T12:56:41.188156+0000","last_clean":"2023-10-09T12:56:41.188156+0000","last_became_active":"2023-10-09T12:56:40.200192+0000","last_became_peered":"2023-10-09T12:56:40.200192+0000","last_unstale":"2023-10-09T12:56:41.188156+0000","last_undegraded":"2023-10-09T12:56:41.188156+0000","last_fullsized":"2023-10-09T12:56:41.188156+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:39.028277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210631+0000","last_change":"2023-10-09T12:56:41.204825+0000","last_active":"2023-10-09T12:56:41.210631+0000","last_peered":"2023-10-09T12:56:41.210631+0000","last_clean":"2023-10-09T12:56:41.210631+0000","last_became_active":"2023-10-09T12:56:41.204442+0000","last_became_peered":"2023-10-09T12:56:41.204442+0000","last_unstale":"2023-10-09T12:56:41.210631+0000","last_undegraded":"2023-10-09T12:56:41.210631+0000","last_fullsized":"2023-10-09T12:56:41.210631+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:19.628878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.193383+0000","last_change":"2023-10-09T12:56:40.202977+0000","last_active":"2023-10-09T12:56:41.193383+0000","last_peered":"2023-10-09T12:56:41.193383+0000","last_clean":"2023-10-09T12:56:41.193383+0000","last_became_active":"2023-10-09T12:56:40.202657+0000","last_became_peered":"2023-10-09T12:56:40.202657+0000","last_unstale":"2023-10-09T12:56:41.193383+0000","last_undegraded":"2023-10-09T12:56:41.193383+0000","last_fullsized":"2023-10-09T12:56:41.193383+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:34.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.209275+0000","last_change":"2023-10-09T12:56:41.207482+0000","last_active":"2023-10-09T12:56:41.209275+0000","last_peered":"2023-10-09T12:56:41.209275+0000","last_clean":"2023-10-09T12:56:41.209275+0000","last_became_active":"2023-10-09T12:56:41.206703+0000","last_became_peered":"2023-10-09T12:56:41.206703+0000","last_unstale":"2023-10-09T12:56:41.209275+0000","last_undegraded":"2023-10-09T12:56:41.209275+0000","last_fullsized":"2023-10-09T12:56:41.209275+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188296+0000","last_change":"2023-10-09T12:56:40.199752+0000","last_active":"2023-10-09T12:56:41.188296+0000","last_peered":"2023-10-09T12:56:41.188296+0000","last_clean":"2023-10-09T12:56:41.188296+0000","last_became_active":"2023-10-09T12:56:40.199414+0000","last_became_peered":"2023-10-09T12:56:40.199414+0000","last_unstale":"2023-10-09T12:56:41.188296+0000","last_undegraded":"2023-10-09T12:56:41.188296+0000","last_fullsized":"2023-10-09T12:56:41.188296+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:48.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212897+0000","last_change":"2023-10-09T12:56:41.205990+0000","last_active":"2023-10-09T12:56:41.212897+0000","last_peered":"2023-10-09T12:56:41.212897+0000","last_clean":"2023-10-09T12:56:41.212897+0000","last_became_active":"2023-10-09T12:56:41.205728+0000","last_became_peered":"2023-10-09T12:56:41.205728+0000","last_unstale":"2023-10-09T12:56:41.212897+0000","last_undegraded":"2023-10-09T12:56:41.212897+0000","last_fullsized":"2023-10-09T12:56:41.212897+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:43.369811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.194615+0000","last_change":"2023-10-09T12:56:40.196159+0000","last_active":"2023-10-09T12:56:41.194615+0000","last_peered":"2023-10-09T12:56:41.194615+0000","last_clean":"2023-10-09T12:56:41.194615+0000","last_became_active":"2023-10-09T12:56:40.195887+0000","last_became_peered":"2023-10-09T12:56:40.195887+0000","last_unstale":"2023-10-09T12:56:41.194615+0000","last_undegraded":"2023-10-09T12:56:41.194615+0000","last_fullsized":"2023-10-09T12:56:41.194615+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:42.346778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.218289+0000","last_change":"2023-10-09T12:56:41.214437+0000","last_active":"2023-10-09T12:56:41.218289+0000","last_peered":"2023-10-09T12:56:41.218289+0000","last_clean":"2023-10-09T12:56:41.218289+0000","last_became_active":"2023-10-09T12:56:41.213608+0000","last_became_peered":"2023-10-09T12:56:41.213608+0000","last_unstale":"2023-10-09T12:56:41.218289+0000","last_undegraded":"2023-10-09T12:56:41.218289+0000","last_fullsized":"2023-10-09T12:56:41.218289+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:48.906719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.199170+0000","last_change":"2023-10-09T12:56:40.198115+0000","last_active":"2023-10-09T12:56:41.199170+0000","last_peered":"2023-10-09T12:56:41.199170+0000","last_clean":"2023-10-09T12:56:41.199170+0000","last_became_active":"2023-10-09T12:56:40.197366+0000","last_became_peered":"2023-10-09T12:56:40.197366+0000","last_unstale":"2023-10-09T12:56:41.199170+0000","last_undegraded":"2023-10-09T12:56:41.199170+0000","last_fullsized":"2023-10-09T12:56:41.199170+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:59.854272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206838+0000","last_change":"2023-10-09T12:56:41.204583+0000","last_active":"2023-10-09T12:56:41.206838+0000","last_peered":"2023-10-09T12:56:41.206838+0000","last_clean":"2023-10-09T12:56:41.206838+0000","last_became_active":"2023-10-09T12:56:41.204306+0000","last_became_peered":"2023-10-09T12:56:41.204306+0000","last_unstale":"2023-10-09T12:56:41.206838+0000","last_undegraded":"2023-10-09T12:56:41.206838+0000","last_fullsized":"2023-10-09T12:56:41.206838+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:42.692693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.192306+0000","last_change":"2023-10-09T12:56:40.194547+0000","last_active":"2023-10-09T12:56:41.192306+0000","last_peered":"2023-10-09T12:56:41.192306+0000","last_clean":"2023-10-09T12:56:41.192306+0000","last_became_active":"2023-10-09T12:56:40.194294+0000","last_became_peered":"2023-10-09T12:56:40.194294+0000","last_unstale":"2023-10-09T12:56:41.192306+0000","last_undegraded":"2023-10-09T12:56:41.192306+0000","last_fullsized":"2023-10-09T12:56:41.192306+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:47.813310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205110+0000","last_change":"2023-10-09T12:56:41.203176+0000","last_active":"2023-10-09T12:56:41.205110+0000","last_peered":"2023-10-09T12:56:41.205110+0000","last_clean":"2023-10-09T12:56:41.205110+0000","last_became_active":"2023-10-09T12:56:41.202880+0000","last_became_peered":"2023-10-09T12:56:41.202880+0000","last_unstale":"2023-10-09T12:56:41.205110+0000","last_undegraded":"2023-10-09T12:56:41.205110+0000","last_fullsized":"2023-10-09T12:56:41.205110+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:16.139773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223189+0000","last_change":"2023-10-09T12:56:40.200814+0000","last_active":"2023-10-09T12:56:41.223189+0000","last_peered":"2023-10-09T12:56:41.223189+0000","last_clean":"2023-10-09T12:56:41.223189+0000","last_became_active":"2023-10-09T12:56:40.200552+0000","last_became_peered":"2023-10-09T12:56:40.200552+0000","last_unstale":"2023-10-09T12:56:41.223189+0000","last_undegraded":"2023-10-09T12:56:41.223189+0000","last_fullsized":"2023-10-09T12:56:41.223189+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:31.267875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"153'271","reported_seq":830,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.195397+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:56:41.195397+0000","last_peered":"2023-10-09T12:56:41.195397+0000","last_clean":"2023-10-09T12:56:41.195397+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:56:41.195397+0000","last_undegraded":"2023-10-09T12:56:41.195397+0000","last_fullsized":"2023-10-09T12:56:41.195397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308064,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063776,"statfs":{"total":96636764160,"available":96321306624,"internally_reserved":0,"allocated":2646016,"data_stored":1601296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.66800000000000004}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.60399999999999998}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":0.68400000000000005}]}]},{"osd":6,"up_from":16,"seq":68719477636,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060272,"statfs":{"total":96636764160,"available":96317718528,"internally_reserved":0,"allocated":2039808,"data_stored":1010318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.83499999999999996}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.65700000000000003}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.77200000000000002}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.88},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.85299999999999998}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":0.89300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424510340,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307460,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064380,"statfs":{"total":96636764160,"available":96321925120,"internally_reserved":0,"allocated":2027520,"data_stored":1008782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.47599999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.88600000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.90100000000000002}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.81100000000000005}]}]},{"osd":0,"up_from":14,"seq":60129543043,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308040,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063800,"statfs":{"total":96636764160,"available":96321331200,"internally_reserved":0,"allocated":2621440,"data_stored":1599150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.69999999999999996,"5min":1.008,"15min":1.008},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.59099999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.69599999999999995,"5min":0.73299999999999998,"15min":0.83199999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.879},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.042,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.71599999999999997,"5min":0.57199999999999995,"15min":0.502},"max":{"1min":1.091,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.48899999999999999},"max":{"1min":1.0069999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.60399999999999998,"15min":0.54900000000000004},"max":{"1min":1.0409999999999999,"5min":1.105,"15min":1.1639999999999999},"last":0.63}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.5},"max":{"1min":0.998,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.67300000000000004,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0529999999999999,"5min":1.175,"15min":1.1990000000000001},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68100000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0940000000000001,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.629,"5min":0.59799999999999998,"15min":0.53900000000000003},"max":{"1min":1.0720000000000001,"5min":1.208,"15min":1.208},"last":0.76400000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1009370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73499999999999999,"5min":0.753,"15min":0.89400000000000002},"last":0.41699999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":1.038},"last":0.441},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78200000000000003,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46999999999999997},"max":{"1min":1.139,"5min":1.194,"15min":1.1990000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.254},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2270000000000001,"5min":1.357,"15min":1.357},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.373},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.73699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510340,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1008942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.67400000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.76100000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54500000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.56499999999999995},"max":{"1min":1.149,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.876,"15min":0.875},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1910000000000001,"5min":1.321,"15min":1.321},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.59699999999999998,"15min":0.59599999999999997},"max":{"1min":0.98699999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.874},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.0509999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.57499999999999996,"15min":0.54200000000000004},"max":{"1min":1.0069999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.84599999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.624,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.089,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.62,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.94199999999999995}]}]},{"osd":4,"up_from":16,"seq":68719477635,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299272,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072568,"statfs":{"total":96636764160,"available":96330309632,"internally_reserved":0,"allocated":2031616,"data_stored":1008852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.624},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.72499999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.75}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":0.83799999999999997}]}]},{"osd":5,"up_from":16,"seq":68719477635,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1008894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.94899999999999995}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.625},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":0.81599999999999995}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.998}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.91800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:56:50.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:56:50.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.543+0000 7f421179d700 1 Processor -- start 2023-10-09T12:56:50.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.543+0000 7f421179d700 1 -- start start 2023-10-09T12:56:50.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f421179d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150550 0x7f420c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:50.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f421179d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f420c0c7410 0x7f420c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:50.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f421179d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c06e2a0 con 0x7f420c150180 2023-10-09T12:56:50.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f421179d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c06b2e0 con 0x7f420c0c7410 2023-10-09T12:56:50.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f421179d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0c78e0 con 0x7f420c150550 2023-10-09T12:56:50.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f4210f9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f420c0c7410 0x7f420c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:50.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f420b7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150550 0x7f420c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:50.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f4210f9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f420c0c7410 0x7f420c069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:42752/0 (socket says 172.21.15.86:42752) 2023-10-09T12:56:50.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f420bfff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f420c150180 0x7f420c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:49298/0 (socket says 172.21.15.86:49298) 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f4210f9c700 1 -- 172.21.15.86:0/2685206475 learned_addr learned my addr 172.21.15.86:0/2685206475 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.545+0000 7f420b7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150550 0x7f420c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38194/0 (socket says 172.21.15.86:38194) 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420b7fe700 1 -- 172.21.15.86:0/2685206475 >> v2:172.21.15.135:3300/0 conn(0x7f420c0c7410 msgr2=0x7f420c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420affd700 1 -- 172.21.15.86:0/2685206475 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217871994 0 0) 0x7f420c06e2a0 con 0x7f420c150180 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420b7fe700 1 --2- 172.21.15.86:0/2685206475 >> v2:172.21.15.135:3300/0 conn(0x7f420c0c7410 0x7f420c069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420b7fe700 1 -- 172.21.15.86:0/2685206475 >> v1:172.21.15.135:6789/0 conn(0x7f420c150180 legacy=0x7f420c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420b7fe700 1 -- 172.21.15.86:0/2685206475 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0c7bc0 con 0x7f420c150550 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f4210f9c700 1 --2- 172.21.15.86:0/2685206475 >> v2:172.21.15.135:3300/0 conn(0x7f420c0c7410 0x7f420c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420b7fe700 1 --2- 172.21.15.86:0/2685206475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150550 0x7f420c157770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f420000aac0 tx=0x7f420000a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5e348a1e21810b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420affd700 1 -- 172.21.15.86:0/2685206475 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000c930 con 0x7f420c150550 2023-10-09T12:56:50.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420affd700 1 -- 172.21.15.86:0/2685206475 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420000ca90 con 0x7f420c150550 2023-10-09T12:56:50.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.546+0000 7f420affd700 1 -- 172.21.15.86:0/2685206475 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000ce30 con 0x7f420c150550 2023-10-09T12:56:50.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 -- 172.21.15.86:0/2685206475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150550 msgr2=0x7f420c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 --2- 172.21.15.86:0/2685206475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150550 0x7f420c157770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f420000aac0 tx=0x7f420000a330 comp rx=0 tx=0).stop 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 -- 172.21.15.86:0/2685206475 shutdown_connections 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 --2- 172.21.15.86:0/2685206475 >> v2:172.21.15.135:3300/0 conn(0x7f420c0c7410 0x7f420c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 --2- 172.21.15.86:0/2685206475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150550 0x7f420c157770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 -- 172.21.15.86:0/2685206475 >> 172.21.15.86:0/2685206475 conn(0x7f420c0cc1f0 msgr2=0x7f420c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 -- 172.21.15.86:0/2685206475 shutdown_connections 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.547+0000 7f421179d700 1 -- 172.21.15.86:0/2685206475 wait complete. 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.548+0000 7f421179d700 1 Processor -- start 2023-10-09T12:56:50.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.548+0000 7f421179d700 1 -- start start 2023-10-09T12:56:50.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.549+0000 7f421179d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0c7410 0x7f420c0c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:50.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.549+0000 7f421179d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150180 0x7f420c0adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:50.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.549+0000 7f421179d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c150550 0x7f420c0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:50.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.549+0000 7f421179d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0b0420 con 0x7f420c150550 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.549+0000 7f421179d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0af850 con 0x7f420c0c7410 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.549+0000 7f421179d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0afaf0 con 0x7f420c150180 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c150550 0x7f420c0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c150550 0x7f420c0ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39316/0 (socket says 172.21.15.86:39316) 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f420bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0c7410 0x7f420c0c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 -- 172.21.15.86:0/2938798318 learned_addr learned my addr 172.21.15.86:0/2938798318 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f420b7fe700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150180 0x7f420c0adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 -- 172.21.15.86:0/2938798318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150180 msgr2=0x7f420c0adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150180 0x7f420c0adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 -- 172.21.15.86:0/2938798318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0c7410 msgr2=0x7f420c0c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0c7410 0x7f420c0c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 -- 172.21.15.86:0/2938798318 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204009ae0 con 0x7f420c150550 2023-10-09T12:56:50.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.550+0000 7f4210f9c700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c150550 0x7f420c0ae200 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f42040070b0 tx=0x7f420400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:50.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.551+0000 7f41f3fff700 1 -- 172.21.15.86:0/2938798318 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420400c890 con 0x7f420c150550 2023-10-09T12:56:50.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.551+0000 7f41f3fff700 1 -- 172.21.15.86:0/2938798318 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420400f040 con 0x7f420c150550 2023-10-09T12:56:50.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.551+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420000a5d0 con 0x7f420c150550 2023-10-09T12:56:50.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.551+0000 7f41f3fff700 1 -- 172.21.15.86:0/2938798318 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420400cc60 con 0x7f420c150550 2023-10-09T12:56:50.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.551+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c0b00b0 con 0x7f420c150550 2023-10-09T12:56:50.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.552+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c0b0590 con 0x7f420c150550 2023-10-09T12:56:50.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.553+0000 7f41f3fff700 1 -- 172.21.15.86:0/2938798318 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4204014650 con 0x7f420c150550 2023-10-09T12:56:50.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.553+0000 7f41f3fff700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f41f8066f30 0x7f41f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:50.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.554+0000 7f41f3fff700 1 -- 172.21.15.86:0/2938798318 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f4204084e80 con 0x7f420c150550 2023-10-09T12:56:50.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.554+0000 7f420bfff700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f41f8066f30 0x7f41f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:50.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.554+0000 7f420bfff700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f41f8066f30 0x7f41f80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f41fc007fd0 tx=0x7f41fc007d50 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:50.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.558+0000 7f41f3fff700 1 -- 172.21.15.86:0/2938798318 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42040559c0 con 0x7f420c150550 2023-10-09T12:56:50.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.745+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f420c04c3c0 con 0x7f41f8066f30 2023-10-09T12:56:50.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.754+0000 7f41f3fff700 1 -- 172.21.15.86:0/2938798318 <== mgr.8400 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289435 (secure 0 0 0) 0x7f420c04c3c0 con 0x7f41f8066f30 2023-10-09T12:56:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f41f8066f30 msgr2=0x7f41f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f41f8066f30 0x7f41f80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f41fc007fd0 tx=0x7f41fc007d50 comp rx=0 tx=0).stop 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c150550 msgr2=0x7f420c0ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c150550 0x7f420c0ae200 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f42040070b0 tx=0x7f420400b040 comp rx=0 tx=0).stop 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 shutdown_connections 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f41f8066f30 0x7f41f80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c150550 0x7f420c0ae200 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f420c0c7410 0x7f420c0c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 --2- 172.21.15.86:0/2938798318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f420c150180 0x7f420c0adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:50.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.758+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 >> 172.21.15.86:0/2938798318 conn(0x7f420c0cc1f0 msgr2=0x7f420c158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:50.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.759+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 shutdown_connections 2023-10-09T12:56:50.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:50.759+0000 7f421179d700 1 -- 172.21.15.86:0/2938798318 wait complete. 2023-10-09T12:56:50.761 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:56:50.776 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T12:56:50.638454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469096,"kb_used_data":17064,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752505624,"statfs":{"total":773094113280,"available":770565758976,"internally_reserved":0,"allocated":17473536,"data_stored":9255604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.452551"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215595+0000","last_change":"2023-10-09T12:56:41.213768+0000","last_active":"2023-10-09T12:56:41.215595+0000","last_peered":"2023-10-09T12:56:41.215595+0000","last_clean":"2023-10-09T12:56:41.215595+0000","last_became_active":"2023-10-09T12:56:41.212491+0000","last_became_peered":"2023-10-09T12:56:41.212491+0000","last_unstale":"2023-10-09T12:56:41.215595+0000","last_undegraded":"2023-10-09T12:56:41.215595+0000","last_fullsized":"2023-10-09T12:56:41.215595+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:54.590624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.194371+0000","last_change":"2023-10-09T12:56:41.193747+0000","last_active":"2023-10-09T12:56:41.194371+0000","last_peered":"2023-10-09T12:56:41.194371+0000","last_clean":"2023-10-09T12:56:41.194371+0000","last_became_active":"2023-10-09T12:56:41.193452+0000","last_became_peered":"2023-10-09T12:56:41.193452+0000","last_unstale":"2023-10-09T12:56:41.194371+0000","last_undegraded":"2023-10-09T12:56:41.194371+0000","last_fullsized":"2023-10-09T12:56:41.194371+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:14.963616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210676+0000","last_change":"2023-10-09T12:56:41.206038+0000","last_active":"2023-10-09T12:56:41.210676+0000","last_peered":"2023-10-09T12:56:41.210676+0000","last_clean":"2023-10-09T12:56:41.210676+0000","last_became_active":"2023-10-09T12:56:41.205601+0000","last_became_peered":"2023-10-09T12:56:41.205601+0000","last_unstale":"2023-10-09T12:56:41.210676+0000","last_undegraded":"2023-10-09T12:56:41.210676+0000","last_fullsized":"2023-10-09T12:56:41.210676+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:19.749204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226628+0000","last_change":"2023-10-09T12:56:41.221969+0000","last_active":"2023-10-09T12:56:41.226628+0000","last_peered":"2023-10-09T12:56:41.226628+0000","last_clean":"2023-10-09T12:56:41.226628+0000","last_became_active":"2023-10-09T12:56:41.221428+0000","last_became_peered":"2023-10-09T12:56:41.221428+0000","last_unstale":"2023-10-09T12:56:41.226628+0000","last_undegraded":"2023-10-09T12:56:41.226628+0000","last_fullsized":"2023-10-09T12:56:41.226628+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:10.320356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206235+0000","last_change":"2023-10-09T12:56:41.203881+0000","last_active":"2023-10-09T12:56:41.206235+0000","last_peered":"2023-10-09T12:56:41.206235+0000","last_clean":"2023-10-09T12:56:41.206235+0000","last_became_active":"2023-10-09T12:56:41.203349+0000","last_became_peered":"2023-10-09T12:56:41.203349+0000","last_unstale":"2023-10-09T12:56:41.206235+0000","last_undegraded":"2023-10-09T12:56:41.206235+0000","last_fullsized":"2023-10-09T12:56:41.206235+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:33.134573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210600+0000","last_change":"2023-10-09T12:56:41.203781+0000","last_active":"2023-10-09T12:56:41.210600+0000","last_peered":"2023-10-09T12:56:41.210600+0000","last_clean":"2023-10-09T12:56:41.210600+0000","last_became_active":"2023-10-09T12:56:41.203481+0000","last_became_peered":"2023-10-09T12:56:41.203481+0000","last_unstale":"2023-10-09T12:56:41.210600+0000","last_undegraded":"2023-10-09T12:56:41.210600+0000","last_fullsized":"2023-10-09T12:56:41.210600+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:10.089824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210554+0000","last_change":"2023-10-09T12:56:41.202860+0000","last_active":"2023-10-09T12:56:41.210554+0000","last_peered":"2023-10-09T12:56:41.210554+0000","last_clean":"2023-10-09T12:56:41.210554+0000","last_became_active":"2023-10-09T12:56:41.202600+0000","last_became_peered":"2023-10-09T12:56:41.202600+0000","last_unstale":"2023-10-09T12:56:41.210554+0000","last_undegraded":"2023-10-09T12:56:41.210554+0000","last_fullsized":"2023-10-09T12:56:41.210554+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:30.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213188+0000","last_change":"2023-10-09T12:56:41.211251+0000","last_active":"2023-10-09T12:56:41.213188+0000","last_peered":"2023-10-09T12:56:41.213188+0000","last_clean":"2023-10-09T12:56:41.213188+0000","last_became_active":"2023-10-09T12:56:41.210620+0000","last_became_peered":"2023-10-09T12:56:41.210620+0000","last_unstale":"2023-10-09T12:56:41.213188+0000","last_undegraded":"2023-10-09T12:56:41.213188+0000","last_fullsized":"2023-10-09T12:56:41.213188+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:19.628878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212780+0000","last_change":"2023-10-09T12:56:41.209624+0000","last_active":"2023-10-09T12:56:41.212780+0000","last_peered":"2023-10-09T12:56:41.212780+0000","last_clean":"2023-10-09T12:56:41.212780+0000","last_became_active":"2023-10-09T12:56:41.209328+0000","last_became_peered":"2023-10-09T12:56:41.209328+0000","last_unstale":"2023-10-09T12:56:41.212780+0000","last_undegraded":"2023-10-09T12:56:41.212780+0000","last_fullsized":"2023-10-09T12:56:41.212780+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:53.540498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.196427+0000","last_change":"2023-10-09T12:56:41.194282+0000","last_active":"2023-10-09T12:56:41.196427+0000","last_peered":"2023-10-09T12:56:41.196427+0000","last_clean":"2023-10-09T12:56:41.196427+0000","last_became_active":"2023-10-09T12:56:41.194023+0000","last_became_peered":"2023-10-09T12:56:41.194023+0000","last_unstale":"2023-10-09T12:56:41.196427+0000","last_undegraded":"2023-10-09T12:56:41.196427+0000","last_fullsized":"2023-10-09T12:56:41.196427+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:42.661474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.201762+0000","last_change":"2023-10-09T12:56:41.199470+0000","last_active":"2023-10-09T12:56:41.201762+0000","last_peered":"2023-10-09T12:56:41.201762+0000","last_clean":"2023-10-09T12:56:41.201762+0000","last_became_active":"2023-10-09T12:56:41.199035+0000","last_became_peered":"2023-10-09T12:56:41.199035+0000","last_unstale":"2023-10-09T12:56:41.201762+0000","last_undegraded":"2023-10-09T12:56:41.201762+0000","last_fullsized":"2023-10-09T12:56:41.201762+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:35.023110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212642+0000","last_change":"2023-10-09T12:56:41.206916+0000","last_active":"2023-10-09T12:56:41.212642+0000","last_peered":"2023-10-09T12:56:41.212642+0000","last_clean":"2023-10-09T12:56:41.212642+0000","last_became_active":"2023-10-09T12:56:41.206343+0000","last_became_peered":"2023-10-09T12:56:41.206343+0000","last_unstale":"2023-10-09T12:56:41.212642+0000","last_undegraded":"2023-10-09T12:56:41.212642+0000","last_fullsized":"2023-10-09T12:56:41.212642+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:11.234309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.214895+0000","last_change":"2023-10-09T12:56:41.212161+0000","last_active":"2023-10-09T12:56:41.214895+0000","last_peered":"2023-10-09T12:56:41.214895+0000","last_clean":"2023-10-09T12:56:41.214895+0000","last_became_active":"2023-10-09T12:56:41.211687+0000","last_became_peered":"2023-10-09T12:56:41.211687+0000","last_unstale":"2023-10-09T12:56:41.214895+0000","last_undegraded":"2023-10-09T12:56:41.214895+0000","last_fullsized":"2023-10-09T12:56:41.214895+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:09.335463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.203167+0000","last_change":"2023-10-09T12:56:41.201499+0000","last_active":"2023-10-09T12:56:41.203167+0000","last_peered":"2023-10-09T12:56:41.203167+0000","last_clean":"2023-10-09T12:56:41.203167+0000","last_became_active":"2023-10-09T12:56:41.200932+0000","last_became_peered":"2023-10-09T12:56:41.200932+0000","last_unstale":"2023-10-09T12:56:41.203167+0000","last_undegraded":"2023-10-09T12:56:41.203167+0000","last_fullsized":"2023-10-09T12:56:41.203167+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:42.925571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.217554+0000","last_change":"2023-10-09T12:56:41.215278+0000","last_active":"2023-10-09T12:56:41.217554+0000","last_peered":"2023-10-09T12:56:41.217554+0000","last_clean":"2023-10-09T12:56:41.217554+0000","last_became_active":"2023-10-09T12:56:41.214975+0000","last_became_peered":"2023-10-09T12:56:41.214975+0000","last_unstale":"2023-10-09T12:56:41.217554+0000","last_undegraded":"2023-10-09T12:56:41.217554+0000","last_fullsized":"2023-10-09T12:56:41.217554+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:28.935539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.220151+0000","last_change":"2023-10-09T12:56:41.218193+0000","last_active":"2023-10-09T12:56:41.220151+0000","last_peered":"2023-10-09T12:56:41.220151+0000","last_clean":"2023-10-09T12:56:41.220151+0000","last_became_active":"2023-10-09T12:56:41.217929+0000","last_became_peered":"2023-10-09T12:56:41.217929+0000","last_unstale":"2023-10-09T12:56:41.220151+0000","last_undegraded":"2023-10-09T12:56:41.220151+0000","last_fullsized":"2023-10-09T12:56:41.220151+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:54.056321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205200+0000","last_change":"2023-10-09T12:56:41.201268+0000","last_active":"2023-10-09T12:56:41.205200+0000","last_peered":"2023-10-09T12:56:41.205200+0000","last_clean":"2023-10-09T12:56:41.205200+0000","last_became_active":"2023-10-09T12:56:41.200992+0000","last_became_peered":"2023-10-09T12:56:41.200992+0000","last_unstale":"2023-10-09T12:56:41.205200+0000","last_undegraded":"2023-10-09T12:56:41.205200+0000","last_fullsized":"2023-10-09T12:56:41.205200+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:45.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212548+0000","last_change":"2023-10-09T12:56:41.207789+0000","last_active":"2023-10-09T12:56:41.212548+0000","last_peered":"2023-10-09T12:56:41.212548+0000","last_clean":"2023-10-09T12:56:41.212548+0000","last_became_active":"2023-10-09T12:56:41.207551+0000","last_became_peered":"2023-10-09T12:56:41.207551+0000","last_unstale":"2023-10-09T12:56:41.212548+0000","last_undegraded":"2023-10-09T12:56:41.212548+0000","last_fullsized":"2023-10-09T12:56:41.212548+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:45:52.264576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.201725+0000","last_change":"2023-10-09T12:56:41.199295+0000","last_active":"2023-10-09T12:56:41.201725+0000","last_peered":"2023-10-09T12:56:41.201725+0000","last_clean":"2023-10-09T12:56:41.201725+0000","last_became_active":"2023-10-09T12:56:41.198704+0000","last_became_peered":"2023-10-09T12:56:41.198704+0000","last_unstale":"2023-10-09T12:56:41.201725+0000","last_undegraded":"2023-10-09T12:56:41.201725+0000","last_fullsized":"2023-10-09T12:56:41.201725+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:38.935064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.214618+0000","last_change":"2023-10-09T12:56:41.208786+0000","last_active":"2023-10-09T12:56:41.214618+0000","last_peered":"2023-10-09T12:56:41.214618+0000","last_clean":"2023-10-09T12:56:41.214618+0000","last_became_active":"2023-10-09T12:56:41.208539+0000","last_became_peered":"2023-10-09T12:56:41.208539+0000","last_unstale":"2023-10-09T12:56:41.214618+0000","last_undegraded":"2023-10-09T12:56:41.214618+0000","last_fullsized":"2023-10-09T12:56:41.214618+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:48.819064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206253+0000","last_change":"2023-10-09T12:56:41.204063+0000","last_active":"2023-10-09T12:56:41.206253+0000","last_peered":"2023-10-09T12:56:41.206253+0000","last_clean":"2023-10-09T12:56:41.206253+0000","last_became_active":"2023-10-09T12:56:41.203787+0000","last_became_peered":"2023-10-09T12:56:41.203787+0000","last_unstale":"2023-10-09T12:56:41.206253+0000","last_undegraded":"2023-10-09T12:56:41.206253+0000","last_fullsized":"2023-10-09T12:56:41.206253+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:14.496883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.200376+0000","last_change":"2023-10-09T12:56:41.197401+0000","last_active":"2023-10-09T12:56:41.200376+0000","last_peered":"2023-10-09T12:56:41.200376+0000","last_clean":"2023-10-09T12:56:41.200376+0000","last_became_active":"2023-10-09T12:56:41.197140+0000","last_became_peered":"2023-10-09T12:56:41.197140+0000","last_unstale":"2023-10-09T12:56:41.200376+0000","last_undegraded":"2023-10-09T12:56:41.200376+0000","last_fullsized":"2023-10-09T12:56:41.200376+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:33.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212701+0000","last_change":"2023-10-09T12:56:41.208397+0000","last_active":"2023-10-09T12:56:41.212701+0000","last_peered":"2023-10-09T12:56:41.212701+0000","last_clean":"2023-10-09T12:56:41.212701+0000","last_became_active":"2023-10-09T12:56:41.208100+0000","last_became_peered":"2023-10-09T12:56:41.208100+0000","last_unstale":"2023-10-09T12:56:41.212701+0000","last_undegraded":"2023-10-09T12:56:41.212701+0000","last_fullsized":"2023-10-09T12:56:41.212701+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:03.347149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.208108+0000","last_change":"2023-10-09T12:56:41.203328+0000","last_active":"2023-10-09T12:56:41.208108+0000","last_peered":"2023-10-09T12:56:41.208108+0000","last_clean":"2023-10-09T12:56:41.208108+0000","last_became_active":"2023-10-09T12:56:41.203070+0000","last_became_peered":"2023-10-09T12:56:41.203070+0000","last_unstale":"2023-10-09T12:56:41.208108+0000","last_undegraded":"2023-10-09T12:56:41.208108+0000","last_fullsized":"2023-10-09T12:56:41.208108+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:55.784512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205803+0000","last_change":"2023-10-09T12:56:41.197725+0000","last_active":"2023-10-09T12:56:41.205803+0000","last_peered":"2023-10-09T12:56:41.205803+0000","last_clean":"2023-10-09T12:56:41.205803+0000","last_became_active":"2023-10-09T12:56:41.197463+0000","last_became_peered":"2023-10-09T12:56:41.197463+0000","last_unstale":"2023-10-09T12:56:41.205803+0000","last_undegraded":"2023-10-09T12:56:41.205803+0000","last_fullsized":"2023-10-09T12:56:41.205803+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:48.052991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226627+0000","last_change":"2023-10-09T12:56:41.223742+0000","last_active":"2023-10-09T12:56:41.226627+0000","last_peered":"2023-10-09T12:56:41.226627+0000","last_clean":"2023-10-09T12:56:41.226627+0000","last_became_active":"2023-10-09T12:56:41.223417+0000","last_became_peered":"2023-10-09T12:56:41.223417+0000","last_unstale":"2023-10-09T12:56:41.226627+0000","last_undegraded":"2023-10-09T12:56:41.226627+0000","last_fullsized":"2023-10-09T12:56:41.226627+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:46:38.243176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215594+0000","last_change":"2023-10-09T12:56:41.212742+0000","last_active":"2023-10-09T12:56:41.215594+0000","last_peered":"2023-10-09T12:56:41.215594+0000","last_clean":"2023-10-09T12:56:41.215594+0000","last_became_active":"2023-10-09T12:56:41.212461+0000","last_became_peered":"2023-10-09T12:56:41.212461+0000","last_unstale":"2023-10-09T12:56:41.215594+0000","last_undegraded":"2023-10-09T12:56:41.215594+0000","last_fullsized":"2023-10-09T12:56:41.215594+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:37.512580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212610+0000","last_change":"2023-10-09T12:56:41.208601+0000","last_active":"2023-10-09T12:56:41.212610+0000","last_peered":"2023-10-09T12:56:41.212610+0000","last_clean":"2023-10-09T12:56:41.212610+0000","last_became_active":"2023-10-09T12:56:41.208280+0000","last_became_peered":"2023-10-09T12:56:41.208280+0000","last_unstale":"2023-10-09T12:56:41.212610+0000","last_undegraded":"2023-10-09T12:56:41.212610+0000","last_fullsized":"2023-10-09T12:56:41.212610+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:15.444415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215624+0000","last_change":"2023-10-09T12:56:41.214466+0000","last_active":"2023-10-09T12:56:41.215624+0000","last_peered":"2023-10-09T12:56:41.215624+0000","last_clean":"2023-10-09T12:56:41.215624+0000","last_became_active":"2023-10-09T12:56:41.214145+0000","last_became_peered":"2023-10-09T12:56:41.214145+0000","last_unstale":"2023-10-09T12:56:41.215624+0000","last_undegraded":"2023-10-09T12:56:41.215624+0000","last_fullsized":"2023-10-09T12:56:41.215624+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:30.365070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215558+0000","last_change":"2023-10-09T12:56:41.214286+0000","last_active":"2023-10-09T12:56:41.215558+0000","last_peered":"2023-10-09T12:56:41.215558+0000","last_clean":"2023-10-09T12:56:41.215558+0000","last_became_active":"2023-10-09T12:56:41.214015+0000","last_became_peered":"2023-10-09T12:56:41.214015+0000","last_unstale":"2023-10-09T12:56:41.215558+0000","last_undegraded":"2023-10-09T12:56:41.215558+0000","last_fullsized":"2023-10-09T12:56:41.215558+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:26.115172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221594+0000","last_change":"2023-10-09T12:56:41.218221+0000","last_active":"2023-10-09T12:56:41.221594+0000","last_peered":"2023-10-09T12:56:41.221594+0000","last_clean":"2023-10-09T12:56:41.221594+0000","last_became_active":"2023-10-09T12:56:41.217961+0000","last_became_peered":"2023-10-09T12:56:41.217961+0000","last_unstale":"2023-10-09T12:56:41.221594+0000","last_undegraded":"2023-10-09T12:56:41.221594+0000","last_fullsized":"2023-10-09T12:56:41.221594+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:25.910571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213227+0000","last_change":"2023-10-09T12:56:41.209949+0000","last_active":"2023-10-09T12:56:41.213227+0000","last_peered":"2023-10-09T12:56:41.213227+0000","last_clean":"2023-10-09T12:56:41.213227+0000","last_became_active":"2023-10-09T12:56:41.209641+0000","last_became_peered":"2023-10-09T12:56:41.209641+0000","last_unstale":"2023-10-09T12:56:41.213227+0000","last_undegraded":"2023-10-09T12:56:41.213227+0000","last_fullsized":"2023-10-09T12:56:41.213227+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:19.749204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.208086+0000","last_change":"2023-10-09T12:56:41.207222+0000","last_active":"2023-10-09T12:56:41.208086+0000","last_peered":"2023-10-09T12:56:41.208086+0000","last_clean":"2023-10-09T12:56:41.208086+0000","last_became_active":"2023-10-09T12:56:41.206946+0000","last_became_peered":"2023-10-09T12:56:41.206946+0000","last_unstale":"2023-10-09T12:56:41.208086+0000","last_undegraded":"2023-10-09T12:56:41.208086+0000","last_fullsized":"2023-10-09T12:56:41.208086+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:02.903312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"163'4","reported_seq":14,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.227304+0000","last_change":"2023-10-09T12:56:40.200986+0000","last_active":"2023-10-09T12:56:41.227304+0000","last_peered":"2023-10-09T12:56:41.227304+0000","last_clean":"2023-10-09T12:56:41.227304+0000","last_became_active":"2023-10-09T12:56:40.200216+0000","last_became_peered":"2023-10-09T12:56:40.200216+0000","last_unstale":"2023-10-09T12:56:41.227304+0000","last_undegraded":"2023-10-09T12:56:41.227304+0000","last_fullsized":"2023-10-09T12:56:41.227304+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:07.511454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.225588+0000","last_change":"2023-10-09T12:56:41.221520+0000","last_active":"2023-10-09T12:56:41.225588+0000","last_peered":"2023-10-09T12:56:41.225588+0000","last_clean":"2023-10-09T12:56:41.225588+0000","last_became_active":"2023-10-09T12:56:41.220945+0000","last_became_peered":"2023-10-09T12:56:41.220945+0000","last_unstale":"2023-10-09T12:56:41.225588+0000","last_undegraded":"2023-10-09T12:56:41.225588+0000","last_fullsized":"2023-10-09T12:56:41.225588+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:30.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.224057+0000","last_change":"2023-10-09T12:56:40.199587+0000","last_active":"2023-10-09T12:56:41.224057+0000","last_peered":"2023-10-09T12:56:41.224057+0000","last_clean":"2023-10-09T12:56:41.224057+0000","last_became_active":"2023-10-09T12:56:40.199326+0000","last_became_peered":"2023-10-09T12:56:40.199326+0000","last_unstale":"2023-10-09T12:56:41.224057+0000","last_undegraded":"2023-10-09T12:56:41.224057+0000","last_fullsized":"2023-10-09T12:56:41.224057+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:11.717159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.211184+0000","last_change":"2023-10-09T12:56:41.208062+0000","last_active":"2023-10-09T12:56:41.211184+0000","last_peered":"2023-10-09T12:56:41.211184+0000","last_clean":"2023-10-09T12:56:41.211184+0000","last_became_active":"2023-10-09T12:56:41.207688+0000","last_became_peered":"2023-10-09T12:56:41.207688+0000","last_unstale":"2023-10-09T12:56:41.211184+0000","last_undegraded":"2023-10-09T12:56:41.211184+0000","last_fullsized":"2023-10-09T12:56:41.211184+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:18.942937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.224722+0000","last_change":"2023-10-09T12:56:40.193710+0000","last_active":"2023-10-09T12:56:41.224722+0000","last_peered":"2023-10-09T12:56:41.224722+0000","last_clean":"2023-10-09T12:56:41.224722+0000","last_became_active":"2023-10-09T12:56:40.193438+0000","last_became_peered":"2023-10-09T12:56:40.193438+0000","last_unstale":"2023-10-09T12:56:41.224722+0000","last_undegraded":"2023-10-09T12:56:41.224722+0000","last_fullsized":"2023-10-09T12:56:41.224722+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:47.900965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.204288+0000","last_change":"2023-10-09T12:56:41.200279+0000","last_active":"2023-10-09T12:56:41.204288+0000","last_peered":"2023-10-09T12:56:41.204288+0000","last_clean":"2023-10-09T12:56:41.204288+0000","last_became_active":"2023-10-09T12:56:41.199991+0000","last_became_peered":"2023-10-09T12:56:41.199991+0000","last_unstale":"2023-10-09T12:56:41.204288+0000","last_undegraded":"2023-10-09T12:56:41.204288+0000","last_fullsized":"2023-10-09T12:56:41.204288+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:24.008950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.224816+0000","last_change":"2023-10-09T12:56:40.198835+0000","last_active":"2023-10-09T12:56:41.224816+0000","last_peered":"2023-10-09T12:56:41.224816+0000","last_clean":"2023-10-09T12:56:41.224816+0000","last_became_active":"2023-10-09T12:56:40.198517+0000","last_became_peered":"2023-10-09T12:56:40.198517+0000","last_unstale":"2023-10-09T12:56:41.224816+0000","last_undegraded":"2023-10-09T12:56:41.224816+0000","last_fullsized":"2023-10-09T12:56:41.224816+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:34.192813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.207427+0000","last_change":"2023-10-09T12:56:41.206685+0000","last_active":"2023-10-09T12:56:41.207427+0000","last_peered":"2023-10-09T12:56:41.207427+0000","last_clean":"2023-10-09T12:56:41.207427+0000","last_became_active":"2023-10-09T12:56:41.206395+0000","last_became_peered":"2023-10-09T12:56:41.206395+0000","last_unstale":"2023-10-09T12:56:41.207427+0000","last_undegraded":"2023-10-09T12:56:41.207427+0000","last_fullsized":"2023-10-09T12:56:41.207427+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:20.437154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.222734+0000","last_change":"2023-10-09T12:56:40.200402+0000","last_active":"2023-10-09T12:56:41.222734+0000","last_peered":"2023-10-09T12:56:41.222734+0000","last_clean":"2023-10-09T12:56:41.222734+0000","last_became_active":"2023-10-09T12:56:40.200142+0000","last_became_peered":"2023-10-09T12:56:40.200142+0000","last_unstale":"2023-10-09T12:56:41.222734+0000","last_undegraded":"2023-10-09T12:56:41.222734+0000","last_fullsized":"2023-10-09T12:56:41.222734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:36.087066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205189+0000","last_change":"2023-10-09T12:56:41.201963+0000","last_active":"2023-10-09T12:56:41.205189+0000","last_peered":"2023-10-09T12:56:41.205189+0000","last_clean":"2023-10-09T12:56:41.205189+0000","last_became_active":"2023-10-09T12:56:41.201649+0000","last_became_peered":"2023-10-09T12:56:41.201649+0000","last_unstale":"2023-10-09T12:56:41.205189+0000","last_undegraded":"2023-10-09T12:56:41.205189+0000","last_fullsized":"2023-10-09T12:56:41.205189+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:53.540498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.225095+0000","last_change":"2023-10-09T12:56:40.200866+0000","last_active":"2023-10-09T12:56:41.225095+0000","last_peered":"2023-10-09T12:56:41.225095+0000","last_clean":"2023-10-09T12:56:41.225095+0000","last_became_active":"2023-10-09T12:56:40.200604+0000","last_became_peered":"2023-10-09T12:56:40.200604+0000","last_unstale":"2023-10-09T12:56:41.225095+0000","last_undegraded":"2023-10-09T12:56:41.225095+0000","last_fullsized":"2023-10-09T12:56:41.225095+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:37.283044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213324+0000","last_change":"2023-10-09T12:56:41.211706+0000","last_active":"2023-10-09T12:56:41.213324+0000","last_peered":"2023-10-09T12:56:41.213324+0000","last_clean":"2023-10-09T12:56:41.213324+0000","last_became_active":"2023-10-09T12:56:41.210992+0000","last_became_peered":"2023-10-09T12:56:41.210992+0000","last_unstale":"2023-10-09T12:56:41.213324+0000","last_undegraded":"2023-10-09T12:56:41.213324+0000","last_fullsized":"2023-10-09T12:56:41.213324+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:10.089824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.190938+0000","last_change":"2023-10-09T12:56:40.198474+0000","last_active":"2023-10-09T12:56:41.190938+0000","last_peered":"2023-10-09T12:56:41.190938+0000","last_clean":"2023-10-09T12:56:41.190938+0000","last_became_active":"2023-10-09T12:56:40.198020+0000","last_became_peered":"2023-10-09T12:56:40.198020+0000","last_unstale":"2023-10-09T12:56:41.190938+0000","last_undegraded":"2023-10-09T12:56:41.190938+0000","last_fullsized":"2023-10-09T12:56:41.190938+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:06.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.202031+0000","last_change":"2023-10-09T12:56:41.197159+0000","last_active":"2023-10-09T12:56:41.202031+0000","last_peered":"2023-10-09T12:56:41.202031+0000","last_clean":"2023-10-09T12:56:41.202031+0000","last_became_active":"2023-10-09T12:56:41.196894+0000","last_became_peered":"2023-10-09T12:56:41.196894+0000","last_unstale":"2023-10-09T12:56:41.202031+0000","last_undegraded":"2023-10-09T12:56:41.202031+0000","last_fullsized":"2023-10-09T12:56:41.202031+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:40.820496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188028+0000","last_change":"2023-10-09T12:56:40.198174+0000","last_active":"2023-10-09T12:56:41.188028+0000","last_peered":"2023-10-09T12:56:41.188028+0000","last_clean":"2023-10-09T12:56:41.188028+0000","last_became_active":"2023-10-09T12:56:40.197916+0000","last_became_peered":"2023-10-09T12:56:40.197916+0000","last_unstale":"2023-10-09T12:56:41.188028+0000","last_undegraded":"2023-10-09T12:56:41.188028+0000","last_fullsized":"2023-10-09T12:56:41.188028+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:20:58.207467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221740+0000","last_change":"2023-10-09T12:56:41.217019+0000","last_active":"2023-10-09T12:56:41.221740+0000","last_peered":"2023-10-09T12:56:41.221740+0000","last_clean":"2023-10-09T12:56:41.221740+0000","last_became_active":"2023-10-09T12:56:41.216575+0000","last_became_peered":"2023-10-09T12:56:41.216575+0000","last_unstale":"2023-10-09T12:56:41.221740+0000","last_undegraded":"2023-10-09T12:56:41.221740+0000","last_fullsized":"2023-10-09T12:56:41.221740+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:42.712885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.192232+0000","last_change":"2023-10-09T12:56:40.190266+0000","last_active":"2023-10-09T12:56:41.192232+0000","last_peered":"2023-10-09T12:56:41.192232+0000","last_clean":"2023-10-09T12:56:41.192232+0000","last_became_active":"2023-10-09T12:56:40.189994+0000","last_became_peered":"2023-10-09T12:56:40.189994+0000","last_unstale":"2023-10-09T12:56:41.192232+0000","last_undegraded":"2023-10-09T12:56:41.192232+0000","last_fullsized":"2023-10-09T12:56:41.192232+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:13.957862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213356+0000","last_change":"2023-10-09T12:56:41.210602+0000","last_active":"2023-10-09T12:56:41.213356+0000","last_peered":"2023-10-09T12:56:41.213356+0000","last_clean":"2023-10-09T12:56:41.213356+0000","last_became_active":"2023-10-09T12:56:41.209873+0000","last_became_peered":"2023-10-09T12:56:41.209873+0000","last_unstale":"2023-10-09T12:56:41.213356+0000","last_undegraded":"2023-10-09T12:56:41.213356+0000","last_fullsized":"2023-10-09T12:56:41.213356+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:54:40.291478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.198639+0000","last_change":"2023-10-09T12:56:40.197850+0000","last_active":"2023-10-09T12:56:41.198639+0000","last_peered":"2023-10-09T12:56:41.198639+0000","last_clean":"2023-10-09T12:56:41.198639+0000","last_became_active":"2023-10-09T12:56:40.197613+0000","last_became_peered":"2023-10-09T12:56:40.197613+0000","last_unstale":"2023-10-09T12:56:41.198639+0000","last_undegraded":"2023-10-09T12:56:41.198639+0000","last_fullsized":"2023-10-09T12:56:41.198639+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:09.163749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212818+0000","last_change":"2023-10-09T12:56:41.209083+0000","last_active":"2023-10-09T12:56:41.212818+0000","last_peered":"2023-10-09T12:56:41.212818+0000","last_clean":"2023-10-09T12:56:41.212818+0000","last_became_active":"2023-10-09T12:56:41.208688+0000","last_became_peered":"2023-10-09T12:56:41.208688+0000","last_unstale":"2023-10-09T12:56:41.212818+0000","last_undegraded":"2023-10-09T12:56:41.212818+0000","last_fullsized":"2023-10-09T12:56:41.212818+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:59.474169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"163'3","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226818+0000","last_change":"2023-10-09T12:56:40.194468+0000","last_active":"2023-10-09T12:56:41.226818+0000","last_peered":"2023-10-09T12:56:41.226818+0000","last_clean":"2023-10-09T12:56:41.226818+0000","last_became_active":"2023-10-09T12:56:40.194156+0000","last_became_peered":"2023-10-09T12:56:40.194156+0000","last_unstale":"2023-10-09T12:56:41.226818+0000","last_undegraded":"2023-10-09T12:56:41.226818+0000","last_fullsized":"2023-10-09T12:56:41.226818+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:49:39.814742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.208735+0000","last_change":"2023-10-09T12:56:41.206945+0000","last_active":"2023-10-09T12:56:41.208735+0000","last_peered":"2023-10-09T12:56:41.208735+0000","last_clean":"2023-10-09T12:56:41.208735+0000","last_became_active":"2023-10-09T12:56:41.206648+0000","last_became_peered":"2023-10-09T12:56:41.206648+0000","last_unstale":"2023-10-09T12:56:41.208735+0000","last_undegraded":"2023-10-09T12:56:41.208735+0000","last_fullsized":"2023-10-09T12:56:41.208735+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:53.392012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"163'6","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.228887+0000","last_change":"2023-10-09T12:56:40.198051+0000","last_active":"2023-10-09T12:56:41.228887+0000","last_peered":"2023-10-09T12:56:41.228887+0000","last_clean":"2023-10-09T12:56:41.228887+0000","last_became_active":"2023-10-09T12:56:40.197783+0000","last_became_peered":"2023-10-09T12:56:40.197783+0000","last_unstale":"2023-10-09T12:56:41.228887+0000","last_undegraded":"2023-10-09T12:56:41.228887+0000","last_fullsized":"2023-10-09T12:56:41.228887+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:46.133012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221775+0000","last_change":"2023-10-09T12:56:41.217468+0000","last_active":"2023-10-09T12:56:41.221775+0000","last_peered":"2023-10-09T12:56:41.221775+0000","last_clean":"2023-10-09T12:56:41.221775+0000","last_became_active":"2023-10-09T12:56:41.217131+0000","last_became_peered":"2023-10-09T12:56:41.217131+0000","last_unstale":"2023-10-09T12:56:41.221775+0000","last_undegraded":"2023-10-09T12:56:41.221775+0000","last_fullsized":"2023-10-09T12:56:41.221775+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:22.704200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.196005+0000","last_change":"2023-10-09T12:56:40.193811+0000","last_active":"2023-10-09T12:56:41.196005+0000","last_peered":"2023-10-09T12:56:41.196005+0000","last_clean":"2023-10-09T12:56:41.196005+0000","last_became_active":"2023-10-09T12:56:40.193555+0000","last_became_peered":"2023-10-09T12:56:40.193555+0000","last_unstale":"2023-10-09T12:56:41.196005+0000","last_undegraded":"2023-10-09T12:56:41.196005+0000","last_fullsized":"2023-10-09T12:56:41.196005+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:11:36.381029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.215840+0000","last_change":"2023-10-09T12:56:41.210594+0000","last_active":"2023-10-09T12:56:41.215840+0000","last_peered":"2023-10-09T12:56:41.215840+0000","last_clean":"2023-10-09T12:56:41.215840+0000","last_became_active":"2023-10-09T12:56:41.210338+0000","last_became_peered":"2023-10-09T12:56:41.210338+0000","last_unstale":"2023-10-09T12:56:41.215840+0000","last_undegraded":"2023-10-09T12:56:41.215840+0000","last_fullsized":"2023-10-09T12:56:41.215840+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:12.722913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188106+0000","last_change":"2023-10-09T12:56:40.199574+0000","last_active":"2023-10-09T12:56:41.188106+0000","last_peered":"2023-10-09T12:56:41.188106+0000","last_clean":"2023-10-09T12:56:41.188106+0000","last_became_active":"2023-10-09T12:56:40.199173+0000","last_became_peered":"2023-10-09T12:56:40.199173+0000","last_unstale":"2023-10-09T12:56:41.188106+0000","last_undegraded":"2023-10-09T12:56:41.188106+0000","last_fullsized":"2023-10-09T12:56:41.188106+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:05.454354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212681+0000","last_change":"2023-10-09T12:56:41.207253+0000","last_active":"2023-10-09T12:56:41.212681+0000","last_peered":"2023-10-09T12:56:41.212681+0000","last_clean":"2023-10-09T12:56:41.212681+0000","last_became_active":"2023-10-09T12:56:41.206948+0000","last_became_peered":"2023-10-09T12:56:41.206948+0000","last_unstale":"2023-10-09T12:56:41.212681+0000","last_undegraded":"2023-10-09T12:56:41.212681+0000","last_fullsized":"2023-10-09T12:56:41.212681+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:34.816541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"163'8","reported_seq":18,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.227033+0000","last_change":"2023-10-09T12:56:40.191977+0000","last_active":"2023-10-09T12:56:41.227033+0000","last_peered":"2023-10-09T12:56:41.227033+0000","last_clean":"2023-10-09T12:56:41.227033+0000","last_became_active":"2023-10-09T12:56:40.191227+0000","last_became_peered":"2023-10-09T12:56:40.191227+0000","last_unstale":"2023-10-09T12:56:41.227033+0000","last_undegraded":"2023-10-09T12:56:41.227033+0000","last_fullsized":"2023-10-09T12:56:41.227033+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:12:01.913140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223148+0000","last_change":"2023-10-09T12:56:41.220651+0000","last_active":"2023-10-09T12:56:41.223148+0000","last_peered":"2023-10-09T12:56:41.223148+0000","last_clean":"2023-10-09T12:56:41.223148+0000","last_became_active":"2023-10-09T12:56:41.220366+0000","last_became_peered":"2023-10-09T12:56:41.220366+0000","last_unstale":"2023-10-09T12:56:41.223148+0000","last_undegraded":"2023-10-09T12:56:41.223148+0000","last_fullsized":"2023-10-09T12:56:41.223148+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:45.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223630+0000","last_change":"2023-10-09T12:56:40.197291+0000","last_active":"2023-10-09T12:56:41.223630+0000","last_peered":"2023-10-09T12:56:41.223630+0000","last_clean":"2023-10-09T12:56:41.223630+0000","last_became_active":"2023-10-09T12:56:40.197037+0000","last_became_peered":"2023-10-09T12:56:40.197037+0000","last_unstale":"2023-10-09T12:56:41.223630+0000","last_undegraded":"2023-10-09T12:56:41.223630+0000","last_fullsized":"2023-10-09T12:56:41.223630+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:47.047237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205431+0000","last_change":"2023-10-09T12:56:41.202322+0000","last_active":"2023-10-09T12:56:41.205431+0000","last_peered":"2023-10-09T12:56:41.205431+0000","last_clean":"2023-10-09T12:56:41.205431+0000","last_became_active":"2023-10-09T12:56:41.202080+0000","last_became_peered":"2023-10-09T12:56:41.202080+0000","last_unstale":"2023-10-09T12:56:41.205431+0000","last_undegraded":"2023-10-09T12:56:41.205431+0000","last_fullsized":"2023-10-09T12:56:41.205431+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:32.283953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.226124+0000","last_change":"2023-10-09T12:56:40.195245+0000","last_active":"2023-10-09T12:56:41.226124+0000","last_peered":"2023-10-09T12:56:41.226124+0000","last_clean":"2023-10-09T12:56:41.226124+0000","last_became_active":"2023-10-09T12:56:40.195008+0000","last_became_peered":"2023-10-09T12:56:40.195008+0000","last_unstale":"2023-10-09T12:56:41.226124+0000","last_undegraded":"2023-10-09T12:56:41.226124+0000","last_fullsized":"2023-10-09T12:56:41.226124+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:01.897558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221239+0000","last_change":"2023-10-09T12:56:41.218145+0000","last_active":"2023-10-09T12:56:41.221239+0000","last_peered":"2023-10-09T12:56:41.221239+0000","last_clean":"2023-10-09T12:56:41.221239+0000","last_became_active":"2023-10-09T12:56:41.217872+0000","last_became_peered":"2023-10-09T12:56:41.217872+0000","last_unstale":"2023-10-09T12:56:41.221239+0000","last_undegraded":"2023-10-09T12:56:41.221239+0000","last_fullsized":"2023-10-09T12:56:41.221239+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:40.512729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"163'1","reported_seq":11,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223920+0000","last_change":"2023-10-09T12:56:40.194095+0000","last_active":"2023-10-09T12:56:41.223920+0000","last_peered":"2023-10-09T12:56:41.223920+0000","last_clean":"2023-10-09T12:56:41.223920+0000","last_became_active":"2023-10-09T12:56:40.193831+0000","last_became_peered":"2023-10-09T12:56:40.193831+0000","last_unstale":"2023-10-09T12:56:41.223920+0000","last_undegraded":"2023-10-09T12:56:41.223920+0000","last_fullsized":"2023-10-09T12:56:41.223920+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:58:09.794998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.214744+0000","last_change":"2023-10-09T12:56:41.209388+0000","last_active":"2023-10-09T12:56:41.214744+0000","last_peered":"2023-10-09T12:56:41.214744+0000","last_clean":"2023-10-09T12:56:41.214744+0000","last_became_active":"2023-10-09T12:56:41.209116+0000","last_became_peered":"2023-10-09T12:56:41.209116+0000","last_unstale":"2023-10-09T12:56:41.214744+0000","last_undegraded":"2023-10-09T12:56:41.214744+0000","last_fullsized":"2023-10-09T12:56:41.214744+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:00.320657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.191313+0000","last_change":"2023-10-09T12:56:40.195728+0000","last_active":"2023-10-09T12:56:41.191313+0000","last_peered":"2023-10-09T12:56:41.191313+0000","last_clean":"2023-10-09T12:56:41.191313+0000","last_became_active":"2023-10-09T12:56:40.194932+0000","last_became_peered":"2023-10-09T12:56:40.194932+0000","last_unstale":"2023-10-09T12:56:41.191313+0000","last_undegraded":"2023-10-09T12:56:41.191313+0000","last_fullsized":"2023-10-09T12:56:41.191313+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:35.240421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213846+0000","last_change":"2023-10-09T12:56:41.211438+0000","last_active":"2023-10-09T12:56:41.213846+0000","last_peered":"2023-10-09T12:56:41.213846+0000","last_clean":"2023-10-09T12:56:41.213846+0000","last_became_active":"2023-10-09T12:56:41.211052+0000","last_became_peered":"2023-10-09T12:56:41.211052+0000","last_unstale":"2023-10-09T12:56:41.213846+0000","last_undegraded":"2023-10-09T12:56:41.213846+0000","last_fullsized":"2023-10-09T12:56:41.213846+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:28.664807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.222319+0000","last_change":"2023-10-09T12:56:40.189077+0000","last_active":"2023-10-09T12:56:41.222319+0000","last_peered":"2023-10-09T12:56:41.222319+0000","last_clean":"2023-10-09T12:56:41.222319+0000","last_became_active":"2023-10-09T12:56:40.188745+0000","last_became_peered":"2023-10-09T12:56:40.188745+0000","last_unstale":"2023-10-09T12:56:41.222319+0000","last_undegraded":"2023-10-09T12:56:41.222319+0000","last_fullsized":"2023-10-09T12:56:41.222319+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:59.314903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.213144+0000","last_change":"2023-10-09T12:56:41.210679+0000","last_active":"2023-10-09T12:56:41.213144+0000","last_peered":"2023-10-09T12:56:41.213144+0000","last_clean":"2023-10-09T12:56:41.213144+0000","last_became_active":"2023-10-09T12:56:41.210391+0000","last_became_peered":"2023-10-09T12:56:41.210391+0000","last_unstale":"2023-10-09T12:56:41.213144+0000","last_undegraded":"2023-10-09T12:56:41.213144+0000","last_fullsized":"2023-10-09T12:56:41.213144+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:03.347149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.199289+0000","last_change":"2023-10-09T12:56:40.191302+0000","last_active":"2023-10-09T12:56:41.199289+0000","last_peered":"2023-10-09T12:56:41.199289+0000","last_clean":"2023-10-09T12:56:41.199289+0000","last_became_active":"2023-10-09T12:56:40.191034+0000","last_became_peered":"2023-10-09T12:56:40.191034+0000","last_unstale":"2023-10-09T12:56:41.199289+0000","last_undegraded":"2023-10-09T12:56:41.199289+0000","last_fullsized":"2023-10-09T12:56:41.199289+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:44.846869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205963+0000","last_change":"2023-10-09T12:56:41.201338+0000","last_active":"2023-10-09T12:56:41.205963+0000","last_peered":"2023-10-09T12:56:41.205963+0000","last_clean":"2023-10-09T12:56:41.205963+0000","last_became_active":"2023-10-09T12:56:41.201056+0000","last_became_peered":"2023-10-09T12:56:41.201056+0000","last_unstale":"2023-10-09T12:56:41.205963+0000","last_undegraded":"2023-10-09T12:56:41.205963+0000","last_fullsized":"2023-10-09T12:56:41.205963+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:53.704001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.199067+0000","last_change":"2023-10-09T12:56:40.192745+0000","last_active":"2023-10-09T12:56:41.199067+0000","last_peered":"2023-10-09T12:56:41.199067+0000","last_clean":"2023-10-09T12:56:41.199067+0000","last_became_active":"2023-10-09T12:56:40.192347+0000","last_became_peered":"2023-10-09T12:56:40.192347+0000","last_unstale":"2023-10-09T12:56:41.199067+0000","last_undegraded":"2023-10-09T12:56:41.199067+0000","last_fullsized":"2023-10-09T12:56:41.199067+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:31.491695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.221613+0000","last_change":"2023-10-09T12:56:41.219289+0000","last_active":"2023-10-09T12:56:41.221613+0000","last_peered":"2023-10-09T12:56:41.221613+0000","last_clean":"2023-10-09T12:56:41.221613+0000","last_became_active":"2023-10-09T12:56:41.219049+0000","last_became_peered":"2023-10-09T12:56:41.219049+0000","last_unstale":"2023-10-09T12:56:41.221613+0000","last_undegraded":"2023-10-09T12:56:41.221613+0000","last_fullsized":"2023-10-09T12:56:41.221613+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:57.140466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.192203+0000","last_change":"2023-10-09T12:56:40.195810+0000","last_active":"2023-10-09T12:56:41.192203+0000","last_peered":"2023-10-09T12:56:41.192203+0000","last_clean":"2023-10-09T12:56:41.192203+0000","last_became_active":"2023-10-09T12:56:40.195575+0000","last_became_peered":"2023-10-09T12:56:40.195575+0000","last_unstale":"2023-10-09T12:56:41.192203+0000","last_undegraded":"2023-10-09T12:56:41.192203+0000","last_fullsized":"2023-10-09T12:56:41.192203+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:28.695383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205502+0000","last_change":"2023-10-09T12:56:41.198625+0000","last_active":"2023-10-09T12:56:41.205502+0000","last_peered":"2023-10-09T12:56:41.205502+0000","last_clean":"2023-10-09T12:56:41.205502+0000","last_became_active":"2023-10-09T12:56:41.198378+0000","last_became_peered":"2023-10-09T12:56:41.198378+0000","last_unstale":"2023-10-09T12:56:41.205502+0000","last_undegraded":"2023-10-09T12:56:41.205502+0000","last_fullsized":"2023-10-09T12:56:41.205502+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:53.131336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223179+0000","last_change":"2023-10-09T12:56:40.190441+0000","last_active":"2023-10-09T12:56:41.223179+0000","last_peered":"2023-10-09T12:56:41.223179+0000","last_clean":"2023-10-09T12:56:41.223179+0000","last_became_active":"2023-10-09T12:56:40.190179+0000","last_became_peered":"2023-10-09T12:56:40.190179+0000","last_unstale":"2023-10-09T12:56:41.223179+0000","last_undegraded":"2023-10-09T12:56:41.223179+0000","last_fullsized":"2023-10-09T12:56:41.223179+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:21.041311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.217546+0000","last_change":"2023-10-09T12:56:41.215445+0000","last_active":"2023-10-09T12:56:41.217546+0000","last_peered":"2023-10-09T12:56:41.217546+0000","last_clean":"2023-10-09T12:56:41.217546+0000","last_became_active":"2023-10-09T12:56:41.215168+0000","last_became_peered":"2023-10-09T12:56:41.215168+0000","last_unstale":"2023-10-09T12:56:41.217546+0000","last_undegraded":"2023-10-09T12:56:41.217546+0000","last_fullsized":"2023-10-09T12:56:41.217546+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:39.700317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-09T12:56:42.257618+0000","last_change":"2023-10-09T12:56:40.197211+0000","last_active":"2023-10-09T12:56:42.257618+0000","last_peered":"2023-10-09T12:56:42.257618+0000","last_clean":"2023-10-09T12:56:42.257618+0000","last_became_active":"2023-10-09T12:56:40.196962+0000","last_became_peered":"2023-10-09T12:56:40.196962+0000","last_unstale":"2023-10-09T12:56:42.257618+0000","last_undegraded":"2023-10-09T12:56:42.257618+0000","last_fullsized":"2023-10-09T12:56:42.257618+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:13.143189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206864+0000","last_change":"2023-10-09T12:56:41.205183+0000","last_active":"2023-10-09T12:56:41.206864+0000","last_peered":"2023-10-09T12:56:41.206864+0000","last_clean":"2023-10-09T12:56:41.206864+0000","last_became_active":"2023-10-09T12:56:41.204903+0000","last_became_peered":"2023-10-09T12:56:41.204903+0000","last_unstale":"2023-10-09T12:56:41.206864+0000","last_undegraded":"2023-10-09T12:56:41.206864+0000","last_fullsized":"2023-10-09T12:56:41.206864+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:29.949619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188156+0000","last_change":"2023-10-09T12:56:40.200422+0000","last_active":"2023-10-09T12:56:41.188156+0000","last_peered":"2023-10-09T12:56:41.188156+0000","last_clean":"2023-10-09T12:56:41.188156+0000","last_became_active":"2023-10-09T12:56:40.200192+0000","last_became_peered":"2023-10-09T12:56:40.200192+0000","last_unstale":"2023-10-09T12:56:41.188156+0000","last_undegraded":"2023-10-09T12:56:41.188156+0000","last_fullsized":"2023-10-09T12:56:41.188156+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:14:39.028277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.210631+0000","last_change":"2023-10-09T12:56:41.204825+0000","last_active":"2023-10-09T12:56:41.210631+0000","last_peered":"2023-10-09T12:56:41.210631+0000","last_clean":"2023-10-09T12:56:41.210631+0000","last_became_active":"2023-10-09T12:56:41.204442+0000","last_became_peered":"2023-10-09T12:56:41.204442+0000","last_unstale":"2023-10-09T12:56:41.210631+0000","last_undegraded":"2023-10-09T12:56:41.210631+0000","last_fullsized":"2023-10-09T12:56:41.210631+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:19.628878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.193383+0000","last_change":"2023-10-09T12:56:40.202977+0000","last_active":"2023-10-09T12:56:41.193383+0000","last_peered":"2023-10-09T12:56:41.193383+0000","last_clean":"2023-10-09T12:56:41.193383+0000","last_became_active":"2023-10-09T12:56:40.202657+0000","last_became_peered":"2023-10-09T12:56:40.202657+0000","last_unstale":"2023-10-09T12:56:41.193383+0000","last_undegraded":"2023-10-09T12:56:41.193383+0000","last_fullsized":"2023-10-09T12:56:41.193383+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:34.557634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.209275+0000","last_change":"2023-10-09T12:56:41.207482+0000","last_active":"2023-10-09T12:56:41.209275+0000","last_peered":"2023-10-09T12:56:41.209275+0000","last_clean":"2023-10-09T12:56:41.209275+0000","last_became_active":"2023-10-09T12:56:41.206703+0000","last_became_peered":"2023-10-09T12:56:41.206703+0000","last_unstale":"2023-10-09T12:56:41.209275+0000","last_undegraded":"2023-10-09T12:56:41.209275+0000","last_fullsized":"2023-10-09T12:56:41.209275+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:09:51.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.188296+0000","last_change":"2023-10-09T12:56:40.199752+0000","last_active":"2023-10-09T12:56:41.188296+0000","last_peered":"2023-10-09T12:56:41.188296+0000","last_clean":"2023-10-09T12:56:41.188296+0000","last_became_active":"2023-10-09T12:56:40.199414+0000","last_became_peered":"2023-10-09T12:56:40.199414+0000","last_unstale":"2023-10-09T12:56:41.188296+0000","last_undegraded":"2023-10-09T12:56:41.188296+0000","last_fullsized":"2023-10-09T12:56:41.188296+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:48.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.212897+0000","last_change":"2023-10-09T12:56:41.205990+0000","last_active":"2023-10-09T12:56:41.212897+0000","last_peered":"2023-10-09T12:56:41.212897+0000","last_clean":"2023-10-09T12:56:41.212897+0000","last_became_active":"2023-10-09T12:56:41.205728+0000","last_became_peered":"2023-10-09T12:56:41.205728+0000","last_unstale":"2023-10-09T12:56:41.212897+0000","last_undegraded":"2023-10-09T12:56:41.212897+0000","last_fullsized":"2023-10-09T12:56:41.212897+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:43.369811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.194615+0000","last_change":"2023-10-09T12:56:40.196159+0000","last_active":"2023-10-09T12:56:41.194615+0000","last_peered":"2023-10-09T12:56:41.194615+0000","last_clean":"2023-10-09T12:56:41.194615+0000","last_became_active":"2023-10-09T12:56:40.195887+0000","last_became_peered":"2023-10-09T12:56:40.195887+0000","last_unstale":"2023-10-09T12:56:41.194615+0000","last_undegraded":"2023-10-09T12:56:41.194615+0000","last_fullsized":"2023-10-09T12:56:41.194615+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:42.346778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.218289+0000","last_change":"2023-10-09T12:56:41.214437+0000","last_active":"2023-10-09T12:56:41.218289+0000","last_peered":"2023-10-09T12:56:41.218289+0000","last_clean":"2023-10-09T12:56:41.218289+0000","last_became_active":"2023-10-09T12:56:41.213608+0000","last_became_peered":"2023-10-09T12:56:41.213608+0000","last_unstale":"2023-10-09T12:56:41.218289+0000","last_undegraded":"2023-10-09T12:56:41.218289+0000","last_fullsized":"2023-10-09T12:56:41.218289+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:48.906719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.199170+0000","last_change":"2023-10-09T12:56:40.198115+0000","last_active":"2023-10-09T12:56:41.199170+0000","last_peered":"2023-10-09T12:56:41.199170+0000","last_clean":"2023-10-09T12:56:41.199170+0000","last_became_active":"2023-10-09T12:56:40.197366+0000","last_became_peered":"2023-10-09T12:56:40.197366+0000","last_unstale":"2023-10-09T12:56:41.199170+0000","last_undegraded":"2023-10-09T12:56:41.199170+0000","last_fullsized":"2023-10-09T12:56:41.199170+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:59.854272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.206838+0000","last_change":"2023-10-09T12:56:41.204583+0000","last_active":"2023-10-09T12:56:41.206838+0000","last_peered":"2023-10-09T12:56:41.206838+0000","last_clean":"2023-10-09T12:56:41.206838+0000","last_became_active":"2023-10-09T12:56:41.204306+0000","last_became_peered":"2023-10-09T12:56:41.204306+0000","last_unstale":"2023-10-09T12:56:41.206838+0000","last_undegraded":"2023-10-09T12:56:41.206838+0000","last_fullsized":"2023-10-09T12:56:41.206838+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:42.692693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.192306+0000","last_change":"2023-10-09T12:56:40.194547+0000","last_active":"2023-10-09T12:56:41.192306+0000","last_peered":"2023-10-09T12:56:41.192306+0000","last_clean":"2023-10-09T12:56:41.192306+0000","last_became_active":"2023-10-09T12:56:40.194294+0000","last_became_peered":"2023-10-09T12:56:40.194294+0000","last_unstale":"2023-10-09T12:56:41.192306+0000","last_undegraded":"2023-10-09T12:56:41.192306+0000","last_fullsized":"2023-10-09T12:56:41.192306+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:47.813310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.205110+0000","last_change":"2023-10-09T12:56:41.203176+0000","last_active":"2023-10-09T12:56:41.205110+0000","last_peered":"2023-10-09T12:56:41.205110+0000","last_clean":"2023-10-09T12:56:41.205110+0000","last_became_active":"2023-10-09T12:56:41.202880+0000","last_became_peered":"2023-10-09T12:56:41.202880+0000","last_unstale":"2023-10-09T12:56:41.205110+0000","last_undegraded":"2023-10-09T12:56:41.205110+0000","last_fullsized":"2023-10-09T12:56:41.205110+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:40.171132+0000","last_clean_scrub_stamp":"2023-10-09T12:56:40.171132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:16.139773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"163'2","reported_seq":12,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.223189+0000","last_change":"2023-10-09T12:56:40.200814+0000","last_active":"2023-10-09T12:56:41.223189+0000","last_peered":"2023-10-09T12:56:41.223189+0000","last_clean":"2023-10-09T12:56:41.223189+0000","last_became_active":"2023-10-09T12:56:40.200552+0000","last_became_peered":"2023-10-09T12:56:40.200552+0000","last_unstale":"2023-10-09T12:56:41.223189+0000","last_undegraded":"2023-10-09T12:56:41.223189+0000","last_fullsized":"2023-10-09T12:56:41.223189+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:56:39.165378+0000","last_clean_scrub_stamp":"2023-10-09T12:56:39.165378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:31.267875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"153'271","reported_seq":830,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-09T12:56:41.195397+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:56:41.195397+0000","last_peered":"2023-10-09T12:56:41.195397+0000","last_clean":"2023-10-09T12:56:41.195397+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:56:41.195397+0000","last_undegraded":"2023-10-09T12:56:41.195397+0000","last_fullsized":"2023-10-09T12:56:41.195397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308064,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063776,"statfs":{"total":96636764160,"available":96321306624,"internally_reserved":0,"allocated":2646016,"data_stored":1601296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.626}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.74199999999999999}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51000000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":0.70899999999999996}]}]},{"osd":6,"up_from":16,"seq":68719477637,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060272,"statfs":{"total":96636764160,"available":96317718528,"internally_reserved":0,"allocated":2039808,"data_stored":1010318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.85699999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.753}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":0.73599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424510341,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307460,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064380,"statfs":{"total":96636764160,"available":96321925120,"internally_reserved":0,"allocated":2027520,"data_stored":1008782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.873},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.0129999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.97999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129543044,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308040,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063800,"statfs":{"total":96636764160,"available":96321331200,"internally_reserved":0,"allocated":2621440,"data_stored":1599150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.496},"min":{"1min":0.33700000000000002,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.69999999999999996,"5min":1.008,"15min":1.008},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.59099999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.495}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.69599999999999995,"5min":0.73299999999999998,"15min":0.83199999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.67800000000000005,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.879},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.042,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.71599999999999997,"5min":0.57199999999999995,"15min":0.502},"max":{"1min":1.091,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80200000000000005},"min":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.48899999999999999},"max":{"1min":1.0069999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.75},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.60399999999999998,"15min":0.54900000000000004},"max":{"1min":1.0409999999999999,"5min":1.105,"15min":1.1639999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.5},"max":{"1min":0.998,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.67300000000000004,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0529999999999999,"5min":1.175,"15min":1.1990000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68100000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0940000000000001,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.629,"5min":0.59799999999999998,"15min":0.53900000000000003},"max":{"1min":1.0720000000000001,"5min":1.208,"15min":1.208},"last":0.91400000000000003}]}]},{"osd":2,"up_from":14,"seq":60129543044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1009370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73499999999999999,"5min":0.753,"15min":0.89400000000000002},"last":0.5}]},{"osd":1,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":1.038},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.75}]},{"osd":3,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78200000000000003,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46999999999999997},"max":{"1min":1.139,"5min":1.194,"15min":1.1990000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.254},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2270000000000001,"5min":1.357,"15min":1.357},"last":0.92200000000000004}]},{"osd":7,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.373},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.0189999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1008942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.35199999999999998,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.67400000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.45500000000000002,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.76100000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.32400000000000001}]},{"osd":1,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.43099999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.56499999999999995},"max":{"1min":1.149,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.876,"15min":0.875},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1910000000000001,"5min":1.321,"15min":1.321},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.59699999999999998,"15min":0.59599999999999997},"max":{"1min":0.98699999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.0509999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.57499999999999996,"15min":0.54200000000000004},"max":{"1min":1.0069999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93899999999999995,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 9 12:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.624,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.089,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.62,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76600000000000001}]}]},{"osd":4,"up_from":16,"seq":68719477636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299272,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072568,"statfs":{"total":96636764160,"available":96330309632,"internally_reserved":0,"allocated":2031616,"data_stored":1008852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":1.079}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.84799999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.80800000000000005}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.878}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":1.1819999999999999}]}]},{"osd":5,"up_from":16,"seq":68719477636,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":1008894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.62}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.50900000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":0.66700000000000004}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.68600000000000005}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:56:50.806 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T12:56:50.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T12:56:51.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.005+0000 7f6e4bfff700 1 Processor -- start 2023-10-09T12:56:51.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.005+0000 7f6e4bfff700 1 -- start start 2023-10-09T12:56:51.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.006+0000 7f6e4bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6e4c1563b0 0x7f6e4c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.006+0000 7f6e4bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e4c0ae9c0 0x7f6e4c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.006+0000 7f6e4bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c0cbe50 con 0x7f6e4c156780 2023-10-09T12:56:51.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.006+0000 7f6e4bfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c0cb370 con 0x7f6e4c1563b0 2023-10-09T12:56:51.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.006+0000 7f6e4bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c0cb650 con 0x7f6e4c0ae9c0 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.006+0000 7f6e4affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6e4c1563b0 0x7f6e4c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6e4c1563b0 0x7f6e4c0ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39332/0 (socket says 172.21.15.86:39332) 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4affd700 1 -- 172.21.15.86:0/2810630146 learned_addr learned my addr 172.21.15.86:0/2810630146 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4b7fe700 1 --2- 172.21.15.86:0/2810630146 >> v2:172.21.15.135:3300/0 conn(0x7f6e4c0ae9c0 0x7f6e4c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4affd700 1 -- 172.21.15.86:0/2810630146 >> v2:172.21.15.135:3300/0 conn(0x7f6e4c0ae9c0 msgr2=0x7f6e4c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4affd700 1 --2- 172.21.15.86:0/2810630146 >> v2:172.21.15.135:3300/0 conn(0x7f6e4c0ae9c0 0x7f6e4c0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4affd700 1 -- 172.21.15.86:0/2810630146 >> v1:172.21.15.135:6789/0 conn(0x7f6e4c156780 legacy=0x7f6e4c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4affd700 1 -- 172.21.15.86:0/2810630146 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0c6860 con 0x7f6e4c1563b0 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e4affd700 1 --2- 172.21.15.86:0/2810630146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0ca7d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c156c20 tx=0x7f6e3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe3a8dab73a5673 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e49ffb700 1 -- 172.21.15.86:0/2810630146 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00e070 con 0x7f6e4c1563b0 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e49ffb700 1 -- 172.21.15.86:0/2810630146 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c00ba10 con 0x7f6e4c1563b0 2023-10-09T12:56:51.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.007+0000 7f6e49ffb700 1 -- 172.21.15.86:0/2810630146 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0092e0 con 0x7f6e4c1563b0 2023-10-09T12:56:51.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 -- 172.21.15.86:0/2810630146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 msgr2=0x7f6e4c0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/2810630146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0ca7d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c156c20 tx=0x7f6e3c009840 comp rx=0 tx=0).stop 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 -- 172.21.15.86:0/2810630146 shutdown_connections 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/2810630146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0ca7d0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/2810630146 >> v2:172.21.15.135:3300/0 conn(0x7f6e4c0ae9c0 0x7f6e4c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 -- 172.21.15.86:0/2810630146 >> 172.21.15.86:0/2810630146 conn(0x7f6e4c068e20 msgr2=0x7f6e4c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 -- 172.21.15.86:0/2810630146 shutdown_connections 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.008+0000 7f6e4bfff700 1 -- 172.21.15.86:0/2810630146 wait complete. 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.010+0000 7f6e4bfff700 1 Processor -- start 2023-10-09T12:56:51.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.010+0000 7f6e4bfff700 1 -- start start 2023-10-09T12:56:51.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e4c0ae9c0 0x7f6e4c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c156780 0x7f6e4c0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c156de0 con 0x7f6e4c1563b0 2023-10-09T12:56:51.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c169d40 con 0x7f6e4c156780 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0c6150 con 0x7f6e4c0ae9c0 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39340/0 (socket says 172.21.15.86:39340) 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 -- 172.21.15.86:0/3710303577 learned_addr learned my addr 172.21.15.86:0/3710303577 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4b7fe700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c156780 0x7f6e4c0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4affd700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e4c0ae9c0 0x7f6e4c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 -- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e4c0ae9c0 msgr2=0x7f6e4c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e4c0ae9c0 0x7f6e4c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 -- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c156780 msgr2=0x7f6e4c0c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c156780 0x7f6e4c0c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.011+0000 7f6e4a7fc700 1 -- 172.21.15.86:0/3710303577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c009ae0 con 0x7f6e4c1563b0 2023-10-09T12:56:51.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.012+0000 7f6e4a7fc700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0c96e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000b5e0 tx=0x7f6e40009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:51.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.012+0000 7f6e32ffd700 1 -- 172.21.15.86:0/3710303577 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000f510 con 0x7f6e4c1563b0 2023-10-09T12:56:51.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.012+0000 7f6e32ffd700 1 -- 172.21.15.86:0/3710303577 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4000f670 con 0x7f6e4c1563b0 2023-10-09T12:56:51.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.012+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c156ff0 con 0x7f6e4c1563b0 2023-10-09T12:56:51.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.012+0000 7f6e32ffd700 1 -- 172.21.15.86:0/3710303577 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000fa30 con 0x7f6e4c1563b0 2023-10-09T12:56:51.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.012+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c1575b0 con 0x7f6e4c1563b0 2023-10-09T12:56:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.013+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c0c8990 con 0x7f6e4c1563b0 2023-10-09T12:56:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.014+0000 7f6e32ffd700 1 -- 172.21.15.86:0/3710303577 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e4001a400 con 0x7f6e4c1563b0 2023-10-09T12:56:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.015+0000 7f6e32ffd700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6e38066f30 0x7f6e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.015+0000 7f6e32ffd700 1 -- 172.21.15.86:0/3710303577 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f6e400840e0 con 0x7f6e4c1563b0 2023-10-09T12:56:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.015+0000 7f6e4affd700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6e38066f30 0x7f6e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.016+0000 7f6e4affd700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6e38066f30 0x7f6e380693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009880 tx=0x7f6e3c017000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:51.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.019+0000 7f6e32ffd700 1 -- 172.21.15.86:0/3710303577 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e40051210 con 0x7f6e4c1563b0 2023-10-09T12:56:51.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.284+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6e4c1577d0 con 0x7f6e4c1563b0 2023-10-09T12:56:51.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.287+0000 7f6e32ffd700 1 -- 172.21.15.86:0/3710303577 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v44) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6e40058e60 con 0x7f6e4c1563b0 2023-10-09T12:56:51.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6e38066f30 msgr2=0x7f6e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6e38066f30 0x7f6e380693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009880 tx=0x7f6e3c017000 comp rx=0 tx=0).stop 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 msgr2=0x7f6e4c0c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0c96e0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000b5e0 tx=0x7f6e40009120 comp rx=0 tx=0).stop 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 shutdown_connections 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c156780 0x7f6e4c0c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e4c0ae9c0 0x7f6e4c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6e38066f30 0x7f6e380693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 --2- 172.21.15.86:0/3710303577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e4c1563b0 0x7f6e4c0c96e0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 >> 172.21.15.86:0/3710303577 conn(0x7f6e4c068e20 msgr2=0x7f6e4c0caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 shutdown_connections 2023-10-09T12:56:51.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.290+0000 7f6e4bfff700 1 -- 172.21.15.86:0/3710303577 wait complete. 2023-10-09T12:56:51.292 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T12:56:51.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:56:51.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.489+0000 7f52e3fff700 1 Processor -- start 2023-10-09T12:56:51.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.489+0000 7f52e3fff700 1 -- start start 2023-10-09T12:56:51.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.490+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.490+0000 7f52e3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f52dc0ac6a0 0x7f52dc0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.490+0000 7f52e3fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc0acac0 con 0x7f52dc0ac230 2023-10-09T12:56:51.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.490+0000 7f52e3fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc0ad930 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.490+0000 7f52e3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0acd20 con 0x7f52dc155c10 2023-10-09T12:56:51.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e259c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f52dc0ac6a0 0x7f52dc0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e1d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e1d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38218/0 (socket says 172.21.15.86:38218) 2023-10-09T12:56:51.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e1d9b700 1 -- 172.21.15.86:0/1027053314 learned_addr learned my addr 172.21.15.86:0/1027053314 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:51.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e159a700 1 --1- 172.21.15.86:0/1027053314 >> v1:172.21.15.135:6789/0 conn(0x7f52dc0ac230 0x7f52dc1568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:49308/0 (socket says 172.21.15.86:49308) 2023-10-09T12:56:51.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e1d9b700 1 -- 172.21.15.86:0/1027053314 >> v2:172.21.15.135:3300/0 conn(0x7f52dc0ac6a0 msgr2=0x7f52dc0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:51.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e1d9b700 1 --2- 172.21.15.86:0/1027053314 >> v2:172.21.15.135:3300/0 conn(0x7f52dc0ac6a0 0x7f52dc0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e1d9b700 1 -- 172.21.15.86:0/1027053314 >> v1:172.21.15.135:6789/0 conn(0x7f52dc0ac230 legacy=0x7f52dc1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.491+0000 7f52e1d9b700 1 -- 172.21.15.86:0/1027053314 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc0ad000 con 0x7f52dc155c10 2023-10-09T12:56:51.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.492+0000 7f52e1d9b700 1 --2- 172.21.15.86:0/1027053314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc155fe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52d80099b0 tx=0x7f52d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dd3edf9d20a7afc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:51.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.492+0000 7f52e0d99700 1 -- 172.21.15.86:0/1027053314 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8009ea0 con 0x7f52dc155c10 2023-10-09T12:56:51.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.492+0000 7f52e0d99700 1 -- 172.21.15.86:0/1027053314 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800b860 con 0x7f52dc155c10 2023-10-09T12:56:51.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.492+0000 7f52e0d99700 1 -- 172.21.15.86:0/1027053314 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d800bc00 con 0x7f52dc155c10 2023-10-09T12:56:51.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.492+0000 7f52e3fff700 1 -- 172.21.15.86:0/1027053314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 msgr2=0x7f52dc155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.492+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1027053314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc155fe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52d80099b0 tx=0x7f52d8009250 comp rx=0 tx=0).stop 2023-10-09T12:56:51.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.493+0000 7f52e3fff700 1 -- 172.21.15.86:0/1027053314 shutdown_connections 2023-10-09T12:56:51.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.493+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1027053314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc155fe0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.493+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1027053314 >> v2:172.21.15.135:3300/0 conn(0x7f52dc0ac6a0 0x7f52dc0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.493+0000 7f52e3fff700 1 -- 172.21.15.86:0/1027053314 >> 172.21.15.86:0/1027053314 conn(0x7f52dc06a320 msgr2=0x7f52dc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:51.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.493+0000 7f52e3fff700 1 -- 172.21.15.86:0/1027053314 shutdown_connections 2023-10-09T12:56:51.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.493+0000 7f52e3fff700 1 -- 172.21.15.86:0/1027053314 wait complete. 2023-10-09T12:56:51.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.494+0000 7f52e3fff700 1 Processor -- start 2023-10-09T12:56:51.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.494+0000 7f52e3fff700 1 -- start start 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.495+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52dc0ac230 0x7f52dc147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.495+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52dc0ac6a0 0x7f52dc1456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.495+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.495+0000 7f52e3fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc146bd0 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.495+0000 7f52e3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc145fc0 con 0x7f52dc0ac230 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.495+0000 7f52e3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1462a0 con 0x7f52dc155c10 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52dc0ac6a0 0x7f52dc1456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52dc0ac6a0 0x7f52dc1456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39346/0 (socket says 172.21.15.86:39346) 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 -- 172.21.15.86:0/1509283084 learned_addr learned my addr 172.21.15.86:0/1509283084 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:51.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e259c700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e1d9b700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52dc0ac230 0x7f52dc147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 -- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 msgr2=0x7f52dc1441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc1441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 -- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52dc0ac230 msgr2=0x7f52dc147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52dc0ac230 0x7f52dc147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 -- 172.21.15.86:0/1509283084 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80094f0 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52e159a700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52dc0ac6a0 0x7f52dc1456c0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c7c0 tx=0x7f52cc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.496+0000 7f52d1ffb700 1 -- 172.21.15.86:0/1509283084 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc005a70 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.497+0000 7f52d1ffb700 1 -- 172.21.15.86:0/1509283084 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc005bd0 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.497+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc146580 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.497+0000 7f52d1ffb700 1 -- 172.21.15.86:0/1509283084 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0070d0 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.497+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc145c00 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.498+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc146d40 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.499+0000 7f52d1ffb700 1 -- 172.21.15.86:0/1509283084 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52cc007480 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.499+0000 7f52d1ffb700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c0066f30 0x7f52c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:51.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.500+0000 7f52d1ffb700 1 -- 172.21.15.86:0/1509283084 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f52cc083b30 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.500+0000 7f52e1d9b700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c0066f30 0x7f52c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:51.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.500+0000 7f52e1d9b700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c0066f30 0x7f52c00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52d80099b0 tx=0x7f52d8017000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:51.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.503+0000 7f52d1ffb700 1 -- 172.21.15.86:0/1509283084 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52cc050be0 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.737+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52dc04c3c0 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.738+0000 7f52d1ffb700 1 -- 172.21.15.86:0/1509283084 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f52cc017070 con 0x7f52dc0ac6a0 2023-10-09T12:56:51.738 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:56:51.738 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/2700721489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2700721489},{"type":"v1","addr":"172.21.15.135:6834","nonce":2700721489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1754968847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1754968847},{"type":"v1","addr":"172.21.15.135:6835","nonce":1754968847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/885619835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":885619835},{"type":"v1","addr":"172.21.15.86:6834","nonce":885619835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:56:40.649653+0000","modified":"2023-10-09T12:56:44.211663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8580":{"gid":8580,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3313043174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":3313043174},{"type":"v1","addr":"172.21.15.86:6835","nonce":3313043174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T12:56:51.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c0066f30 msgr2=0x7f52c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c0066f30 0x7f52c00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52d80099b0 tx=0x7f52d8017000 comp rx=0 tx=0).stop 2023-10-09T12:56:51.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52dc0ac6a0 msgr2=0x7f52dc1456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52dc0ac6a0 0x7f52dc1456c0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c7c0 tx=0x7f52cc007f70 comp rx=0 tx=0).stop 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 shutdown_connections 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52dc155c10 0x7f52dc1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52dc0ac230 0x7f52dc147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f52c0066f30 0x7f52c00693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 --2- 172.21.15.86:0/1509283084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52dc0ac6a0 0x7f52dc1456c0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 >> 172.21.15.86:0/1509283084 conn(0x7f52dc06a320 msgr2=0x7f52dc14aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 shutdown_connections 2023-10-09T12:56:51.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:51.740+0000 7f52e3fff700 1 -- 172.21.15.86:0/1509283084 wait complete. 2023-10-09T12:56:51.742 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 71 2023-10-09T12:56:52.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T12:56:40.649653+0000', 'modified': '2023-10-09T12:56:44.211663+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8580}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8580': {'gid': 8580, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/3313043174', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6833', 'nonce': 3313043174}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 3313043174}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T12:56:52.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T12:56:52.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T12:56:52.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.345+0000 7ff2f5dff700 1 Processor -- start 2023-10-09T12:56:52.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.345+0000 7ff2f5dff700 1 -- start start 2023-10-09T12:56:52.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.346+0000 7ff2f5dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff2f0159760 0x7ff2f00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.346+0000 7ff2f5dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f00af960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.346+0000 7ff2f5dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00c7af0 con 0x7ff2f00c84c0 2023-10-09T12:56:52.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.346+0000 7ff2f5dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f00c74e0 con 0x7ff2f0159760 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.346+0000 7ff2f5dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00cc870 con 0x7ff2f0159b30 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2ef7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff2f0159760 0x7ff2f00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2effff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff2f00c84c0 0x7ff2f006e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54260/0 (socket says 172.21.15.86:54260) 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2effff700 1 -- 172.21.15.86:0/3690333804 learned_addr learned my addr 172.21.15.86:0/3690333804 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/3690333804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f00af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/3690333804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 msgr2=0x7ff2f00af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/3690333804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f00af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/3690333804 >> v1:172.21.15.86:6789/0 conn(0x7ff2f00c84c0 legacy=0x7ff2f006e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/3690333804 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00cc590 con 0x7ff2f0159760 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2ee7fc700 1 -- 172.21.15.86:0/3690333804 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575766153 0 0) 0x7ff2f00c7af0 con 0x7ff2f00c84c0 2023-10-09T12:56:52.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.347+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/3690333804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f0159760 0x7ff2f00c7f80 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00098e0 tx=0x7ff2e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caba6e8880772d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2ee7fc700 1 -- 172.21.15.86:0/3690333804 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0009e80 con 0x7ff2f0159760 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2ee7fc700 1 -- 172.21.15.86:0/3690333804 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000b860 con 0x7ff2f0159760 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2ee7fc700 1 -- 172.21.15.86:0/3690333804 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000bbe0 con 0x7ff2f0159760 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3690333804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f0159760 msgr2=0x7ff2f00c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3690333804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f0159760 0x7ff2f00c7f80 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00098e0 tx=0x7ff2e00091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3690333804 shutdown_connections 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3690333804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f0159760 0x7ff2f00c7f80 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3690333804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f00af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3690333804 >> 172.21.15.86:0/3690333804 conn(0x7ff2f00ca060 msgr2=0x7ff2f006de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3690333804 shutdown_connections 2023-10-09T12:56:52.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.348+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3690333804 wait complete. 2023-10-09T12:56:52.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.350+0000 7ff2f5dff700 1 Processor -- start 2023-10-09T12:56:52.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.350+0000 7ff2f5dff700 1 -- start start 2023-10-09T12:56:52.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2f5dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f00c84c0 0x7ff2f00b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2f5dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f0159760 0x7ff2f0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2f5dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f0158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2f5dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0158510 con 0x7ff2f00c84c0 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2f5dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0159010 con 0x7ff2f0159760 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2f5dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00c58e0 con 0x7ff2f0159b30 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f00c84c0 0x7ff2f00b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f00c84c0 0x7ff2f00b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39370/0 (socket says 172.21.15.86:39370) 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/3779164930 learned_addr learned my addr 172.21.15.86:0/3779164930 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f0159760 0x7ff2f0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.351+0000 7ff2effff700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f0158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 msgr2=0x7ff2f0158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f0158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f0159760 msgr2=0x7ff2f0157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f0159760 0x7ff2f0157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/3779164930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0009420 con 0x7ff2f00c84c0 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f00c84c0 0x7ff2f00b0a70 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff2f006da80 tx=0x7ff2e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2d77fe700 1 -- 172.21.15.86:0/3779164930 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000b9d0 con 0x7ff2f00c84c0 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2d77fe700 1 -- 172.21.15.86:0/3779164930 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000bb30 con 0x7ff2f00c84c0 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f0158230 con 0x7ff2f00c84c0 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2d77fe700 1 -- 172.21.15.86:0/3779164930 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011670 con 0x7ff2f00c84c0 2023-10-09T12:56:52.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.352+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f00c5570 con 0x7ff2f00c84c0 2023-10-09T12:56:52.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.354+0000 7ff2d77fe700 1 -- 172.21.15.86:0/3779164930 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2e0011a20 con 0x7ff2f00c84c0 2023-10-09T12:56:52.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.355+0000 7ff2d77fe700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.355+0000 7ff2d77fe700 1 -- 172.21.15.86:0/3779164930 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7ff2e0085ff0 con 0x7ff2f00c84c0 2023-10-09T12:56:52.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.355+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.356+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2dc066f30 0x7ff2dc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b0100 tx=0x7ff2e4008040 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.357+0000 7ff3044adb80 1 Processor -- start 2023-10-09T12:56:52.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.357+0000 7ff3044adb80 1 -- start start 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df472e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df49ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df46ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff3044adb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df3c9a70 con 0x55e9df472a50 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df3c7270 con 0x55e9df49bf60 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9df3c3060 con 0x55e9df4bcd00 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df472e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df472e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39376/0 (socket says 172.21.15.86:39376) 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/383177937 learned_addr learned my addr 172.21.15.86:0/383177937 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff2effff700 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df46ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df49ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.358+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 msgr2=0x55e9df49ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df49ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 msgr2=0x55e9df46ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df46ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/383177937 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9df25d270 con 0x55e9df472a50 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2effff700 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df46ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df472e20 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000b440 tx=0x7ff2e0003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e297b4bda15af1d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2d4ff9700 1 -- 172.21.15.86:0/383177937 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0056d40 con 0x55e9df472a50 2023-10-09T12:56:52.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2d4ff9700 1 -- 172.21.15.86:0/383177937 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0059f10 con 0x55e9df472a50 2023-10-09T12:56:52.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff2d4ff9700 1 -- 172.21.15.86:0/383177937 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e005dc60 con 0x55e9df472a50 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff3044adb80 1 -- 172.21.15.86:0/383177937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 msgr2=0x55e9df472e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.359+0000 7ff3044adb80 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df472e20 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000b440 tx=0x7ff2e0003040 comp rx=0 tx=0).stop 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 -- 172.21.15.86:0/383177937 shutdown_connections 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df472e20 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df46ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 --2- 172.21.15.86:0/383177937 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df49ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 -- 172.21.15.86:0/383177937 >> 172.21.15.86:0/383177937 conn(0x55e9df474370 msgr2=0x55e9df474740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 -- 172.21.15.86:0/383177937 shutdown_connections 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 -- 172.21.15.86:0/383177937 wait complete. 2023-10-09T12:56:52.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.360+0000 7ff3044adb80 1 -- start start 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.361+0000 7ff3044adb80 1 Processor -- start 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.361+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df472a50 0x55e9df4b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.361+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.361+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df46e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff3044adb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df36e890 con 0x55e9df49bf60 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df389ea0 con 0x55e9df472a50 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9df245e30 con 0x55e9df4bcd00 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff3044adb80 10 client.0 _ll_register_callbacks cb 0x55e9df436110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39378/0 (socket says 172.21.15.86:39378) 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 -- 172.21.15.86:0/1515599147 learned_addr learned my addr 172.21.15.86:0/1515599147 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2effff700 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df46e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df472a50 0x55e9df4b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 -- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 msgr2=0x55e9df46e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df46e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 -- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df472a50 msgr2=0x55e9df4b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df472a50 0x55e9df4b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 -- 172.21.15.86:0/1515599147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f00c5570 con 0x55e9df49bf60 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4ccdd0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4016bb0 tx=0x7ff2e4019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202bfc83ceeeeccf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.362+0000 7ff2cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff2cdffb700 1 -- 172.21.15.86:0/1515599147 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40148c0 con 0x55e9df49bf60 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9df467b70 con 0x55e9df49bf60 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff2cdffb700 1 -- 172.21.15.86:0/1515599147 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7ff2e4014a20 con 0x55e9df49bf60 2023-10-09T12:56:52.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff2cdffb700 1 -- 172.21.15.86:0/1515599147 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e4014df0 con 0x55e9df49bf60 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 10 client.8751 fetch_fsmap learned FSMap version 71 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55e9df1fffe0 con 0x55e9df49bf60 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff2cdffb700 1 -- 172.21.15.86:0/1515599147 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9df467b70 con 0x55e9df49bf60 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff2cdffb700 1 -- 172.21.15.86:0/1515599147 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2e4005a00 con 0x55e9df49bf60 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 10 client.8751 fetch_fsmap finished waiting for FSMap version 71 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 10 client.8751 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 20 client.8751 populate_metadata read hostname 'smithi086' 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4979b0 0x55e9df497d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 4 client.8751 mds_command: new command op to 8580 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.363+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 --> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9df444aa0 con 0x55e9df4979b0 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.364+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4979b0 0x55e9df497d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.364+0000 7ff2cdffb700 10 client.8751 ms_handle_connect on v2:172.21.15.86:6833/3313043174 2023-10-09T12:56:52.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.364+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4979b0 0x55e9df497d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8a2984692eee275 server_cookie=71a1ffbc3eb31ecb in_seq=0 out_seq=0 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff2cdffb700 1 -- 172.21.15.86:0/1515599147 <== mds.0 v2:172.21.15.86:6833/3313043174 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e9df444aa0 con 0x55e9df4979b0 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff2cdffb700 10 client.8751 handle_command_reply: tid=0 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 client.8751 shutdown 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 msgr2=0x55e9df4ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4ccdd0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4016bb0 tx=0x7ff2e4019040 comp rx=0 tx=0).stop 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 shutdown_connections 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4979b0 0x55e9df497d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df46e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df472a50 0x55e9df4b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 --2- 172.21.15.86:0/1515599147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4ccdd0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff2cdffb700 0 client.8751 ms_handle_reset on v2:172.21.15.86:6833/3313043174 2023-10-09T12:56:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 >> 172.21.15.86:0/1515599147 conn(0x55e9df474370 msgr2=0x55e9df4b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 shutdown_connections 2023-10-09T12:56:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 1 -- 172.21.15.86:0/1515599147 wait complete. 2023-10-09T12:56:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.365+0000 7ff3044adb80 20 client.8751 trim_cache size 0 max 16384 2023-10-09T12:56:52.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.382+0000 7ff3044adb80 1 Processor -- start 2023-10-09T12:56:52.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.382+0000 7ff3044adb80 1 -- start start 2023-10-09T12:56:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.383+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df49b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.383+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df49b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.383+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df472e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.383+0000 7ff3044adb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df4b8680 con 0x55e9df472a50 2023-10-09T12:56:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.383+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df46fb90 con 0x55e9df49bf60 2023-10-09T12:56:52.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.383+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9df4b6340 con 0x55e9df4bcd00 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.383+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df49b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df49b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39388/0 (socket says 172.21.15.86:39388) 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/4267059951 learned_addr learned my addr 172.21.15.86:0/4267059951 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2effff700 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df472e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 msgr2=0x55e9df472e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df49b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df472e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 msgr2=0x55e9df49b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df49b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 -- 172.21.15.86:0/4267059951 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9df391780 con 0x55e9df472a50 2023-10-09T12:56:52.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df49b330 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0084310 tx=0x7ff2e001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab11cdcf8f924a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2d57fa700 1 -- 172.21.15.86:0/4267059951 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0056cc0 con 0x55e9df472a50 2023-10-09T12:56:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2d57fa700 1 -- 172.21.15.86:0/4267059951 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0054e00 con 0x55e9df472a50 2023-10-09T12:56:52.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.384+0000 7ff2d57fa700 1 -- 172.21.15.86:0/4267059951 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0000c40 con 0x55e9df472a50 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 -- 172.21.15.86:0/4267059951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 msgr2=0x55e9df49b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df49b330 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0084310 tx=0x7ff2e001e040 comp rx=0 tx=0).stop 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 -- 172.21.15.86:0/4267059951 shutdown_connections 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df472a50 0x55e9df49b330 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df4bcd00 0x55e9df472e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 --2- 172.21.15.86:0/4267059951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df49bf60 0x55e9df49b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 -- 172.21.15.86:0/4267059951 >> 172.21.15.86:0/4267059951 conn(0x55e9df474370 msgr2=0x55e9df4b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 -- 172.21.15.86:0/4267059951 shutdown_connections 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.385+0000 7ff3044adb80 1 -- 172.21.15.86:0/4267059951 wait complete. 2023-10-09T12:56:52.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.386+0000 7ff3044adb80 1 -- start start 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.386+0000 7ff3044adb80 1 Processor -- start 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df472a50 0x55e9df51e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff3044adb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df4bcd00 0x55e9df4bd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff3044adb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df4bdf90 con 0x55e9df49bf60 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9df51f3d0 con 0x55e9df4bcd00 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff3044adb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9df4b6600 con 0x55e9df472a50 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff3044adb80 10 client.0 _ll_register_callbacks cb 0x55e9df436110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4bd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39394/0 (socket says 172.21.15.86:39394) 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 -- 172.21.15.86:0/120334511 learned_addr learned my addr 172.21.15.86:0/120334511 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:52.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df472a50 0x55e9df51e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2effff700 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df4bcd00 0x55e9df4bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 -- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df472a50 msgr2=0x55e9df51e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df472a50 0x55e9df51e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 -- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df4bcd00 msgr2=0x55e9df4bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df4bcd00 0x55e9df4bd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.387+0000 7ff2eeffd700 1 -- 172.21.15.86:0/120334511 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9df25d270 con 0x55e9df49bf60 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff2eeffd700 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4bd0d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b690 tx=0x7ff2e4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878c74c98e5f3554 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff2cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff2cdffb700 1 -- 172.21.15.86:0/120334511 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4005b50 con 0x55e9df49bf60 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff2cdffb700 1 -- 172.21.15.86:0/120334511 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7ff2e4014920 con 0x55e9df49bf60 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2f016a2d0 con 0x55e9df49bf60 2023-10-09T12:56:52.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff2cdffb700 1 -- 172.21.15.86:0/120334511 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e4022630 con 0x55e9df49bf60 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 10 client.8757 fetch_fsmap learned FSMap version 71 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55e9df378470 con 0x55e9df49bf60 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff2cdffb700 1 -- 172.21.15.86:0/120334511 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f016a2d0 con 0x55e9df49bf60 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff2cdffb700 1 -- 172.21.15.86:0/120334511 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2e4022790 con 0x55e9df49bf60 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 10 client.8757 fetch_fsmap finished waiting for FSMap version 71 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 10 client.8757 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 20 client.8757 populate_metadata read hostname 'smithi086' 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4b6b80 0x55e9df4b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 4 client.8757 mds_command: new command op to 8580 tid=0[{"prefix": "status"}] 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.388+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 --> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff2e0059f10 con 0x55e9df4b6b80 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4b6b80 0x55e9df4b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff2cdffb700 10 client.8757 ms_handle_connect on v2:172.21.15.86:6833/3313043174 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff2ef7fe700 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4b6b80 0x55e9df4b6f50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3638e567c9d742fb server_cookie=2e2e9ac7b2ad86d6 in_seq=0 out_seq=0 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff2cdffb700 1 -- 172.21.15.86:0/120334511 <== mds.0 v2:172.21.15.86:6833/3313043174 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7ff2e0059f10 con 0x55e9df4b6b80 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff2cdffb700 10 client.8757 handle_command_reply: tid=0 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 client.8757 shutdown 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 msgr2=0x55e9df4bd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4bd0d0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b690 tx=0x7ff2e4022000 comp rx=0 tx=0).stop 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 shutdown_connections 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:6833/3313043174,v1:172.21.15.86:6835/3313043174] conn(0x55e9df4b6b80 0x55e9df4b6f50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e9df4bcd00 0x55e9df4bd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e9df472a50 0x55e9df51e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff2cdffb700 0 client.8757 ms_handle_reset on v2:172.21.15.86:6833/3313043174 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 --2- 172.21.15.86:0/120334511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9df49bf60 0x55e9df4bd0d0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.389+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 >> 172.21.15.86:0/120334511 conn(0x55e9df474370 msgr2=0x55e9df4a2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 shutdown_connections 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff3044adb80 1 -- 172.21.15.86:0/120334511 wait complete. 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff3044adb80 20 client.8757 trim_cache size 0 max 16384 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T12:56:52.395 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 8580, 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.191039686, 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 71, 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 164, 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 164, 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 17.474958945000001 2023-10-09T12:56:52.396 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T12:56:52.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2dc066f30 msgr2=0x7ff2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2dc066f30 0x7ff2dc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b0100 tx=0x7ff2e4008040 comp rx=0 tx=0).stop 2023-10-09T12:56:52.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f00c84c0 msgr2=0x7ff2f00b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f00c84c0 0x7ff2f00b0a70 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff2f006da80 tx=0x7ff2e0017000 comp rx=0 tx=0).stop 2023-10-09T12:56:52.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 shutdown_connections 2023-10-09T12:56:52.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2f00c84c0 0x7ff2f00b0a70 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2f0159b30 0x7ff2f0158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 --2- 172.21.15.86:0/3779164930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f0159760 0x7ff2f0157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.390+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 >> 172.21.15.86:0/3779164930 conn(0x7ff2f00ca060 msgr2=0x7ff2f015a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.391+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 shutdown_connections 2023-10-09T12:56:52.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.391+0000 7ff2f5dff700 1 -- 172.21.15.86:0/3779164930 wait complete. 2023-10-09T12:56:52.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T12:56:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.588+0000 7fdfd259d700 1 Processor -- start 2023-10-09T12:56:52.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.588+0000 7fdfd259d700 1 -- start start 2023-10-09T12:56:52.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.589+0000 7fdfd259d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdfcc1597f0 0x7fdfcc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.589+0000 7fdfd259d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdfcc15d230 0x7fdfcc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.589+0000 7fdfd259d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc15db70 con 0x7fdfcc159420 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.589+0000 7fdfd259d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b11d0 con 0x7fdfcc15d230 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.589+0000 7fdfd259d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b14b0 con 0x7fdfcc1597f0 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd1d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdfcc15d230 0x7fdfcc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd159b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdfcc159420 0x7fdfcc0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54266/0 (socket says 172.21.15.86:54266) 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd159b700 1 -- 172.21.15.86:0/2671029697 learned_addr learned my addr 172.21.15.86:0/2671029697 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:52.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd0d9a700 1 --2- 172.21.15.86:0/2671029697 >> v2:172.21.15.135:3300/0 conn(0x7fdfcc1597f0 0x7fdfcc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd1d9c700 1 -- 172.21.15.86:0/2671029697 >> v2:172.21.15.135:3300/0 conn(0x7fdfcc1597f0 msgr2=0x7fdfcc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd1d9c700 1 --2- 172.21.15.86:0/2671029697 >> v2:172.21.15.135:3300/0 conn(0x7fdfcc1597f0 0x7fdfcc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd1d9c700 1 -- 172.21.15.86:0/2671029697 >> v1:172.21.15.86:6789/0 conn(0x7fdfcc159420 legacy=0x7fdfcc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd1d9c700 1 -- 172.21.15.86:0/2671029697 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0b1790 con 0x7fdfcc15d230 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfc3fff700 1 -- 172.21.15.86:0/2671029697 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430504103 0 0) 0x7fdfcc15db70 con 0x7fdfcc159420 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.590+0000 7fdfd1d9c700 1 --2- 172.21.15.86:0/2671029697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc15d230 0x7fdfcc15d630 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc089750 tx=0x7fdfc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f87cecffc3176d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfc3fff700 1 -- 172.21.15.86:0/2671029697 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc400e070 con 0x7fdfcc15d230 2023-10-09T12:56:52.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfc3fff700 1 -- 172.21.15.86:0/2671029697 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc400bc30 con 0x7fdfcc15d230 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfc3fff700 1 -- 172.21.15.86:0/2671029697 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4012430 con 0x7fdfcc15d230 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 -- 172.21.15.86:0/2671029697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc15d230 msgr2=0x7fdfcc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 --2- 172.21.15.86:0/2671029697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc15d230 0x7fdfcc15d630 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc089750 tx=0x7fdfc4009780 comp rx=0 tx=0).stop 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 -- 172.21.15.86:0/2671029697 shutdown_connections 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 --2- 172.21.15.86:0/2671029697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc15d230 0x7fdfcc15d630 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 --2- 172.21.15.86:0/2671029697 >> v2:172.21.15.135:3300/0 conn(0x7fdfcc1597f0 0x7fdfcc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 -- 172.21.15.86:0/2671029697 >> 172.21.15.86:0/2671029697 conn(0x7fdfcc0d0660 msgr2=0x7fdfcc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 -- 172.21.15.86:0/2671029697 shutdown_connections 2023-10-09T12:56:52.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.591+0000 7fdfd259d700 1 -- 172.21.15.86:0/2671029697 wait complete. 2023-10-09T12:56:52.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.593+0000 7fdfd259d700 1 Processor -- start 2023-10-09T12:56:52.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.593+0000 7fdfd259d700 1 -- start start 2023-10-09T12:56:52.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfcc159420 0x7fdfcc154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd259d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc1597f0 0x7fdfcc0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd259d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfcc15d230 0x7fdfcc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd259d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b55d0 con 0x7fdfcc1597f0 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd259d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc15acb0 con 0x7fdfcc15d230 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc155230 con 0x7fdfcc159420 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc1597f0 0x7fdfcc0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc1597f0 0x7fdfcc0b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39424/0 (socket says 172.21.15.86:39424) 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 -- 172.21.15.86:0/3231854920 learned_addr learned my addr 172.21.15.86:0/3231854920 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd1d9c700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfcc15d230 0x7fdfcc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd159b700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfcc159420 0x7fdfcc154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 -- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfcc159420 msgr2=0x7fdfcc154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfcc159420 0x7fdfcc154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 -- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfcc15d230 msgr2=0x7fdfcc0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfcc15d230 0x7fdfcc0b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.594+0000 7fdfd0d9a700 1 -- 172.21.15.86:0/3231854920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4009a20 con 0x7fdfcc1597f0 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.595+0000 7fdfd0d9a700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc1597f0 0x7fdfcc0b3e50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00d860 tx=0x7fdfbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.595+0000 7fdfc17fa700 1 -- 172.21.15.86:0/3231854920 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0125f0 con 0x7fdfcc1597f0 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.595+0000 7fdfc17fa700 1 -- 172.21.15.86:0/3231854920 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc012750 con 0x7fdfcc1597f0 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.595+0000 7fdfc17fa700 1 -- 172.21.15.86:0/3231854920 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc012af0 con 0x7fdfcc1597f0 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.595+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc0b49c0 con 0x7fdfcc1597f0 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.595+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc0b4f80 con 0x7fdfcc1597f0 2023-10-09T12:56:52.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.596+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc0b5740 con 0x7fdfcc1597f0 2023-10-09T12:56:52.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.597+0000 7fdfc17fa700 1 -- 172.21.15.86:0/3231854920 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfbc013480 con 0x7fdfcc1597f0 2023-10-09T12:56:52.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.598+0000 7fdfc17fa700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfb0066f30 0x7fdfb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:52.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.598+0000 7fdfc17fa700 1 -- 172.21.15.86:0/3231854920 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fdfbc084b00 con 0x7fdfcc1597f0 2023-10-09T12:56:52.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.599+0000 7fdfd159b700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfb0066f30 0x7fdfb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:52.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.599+0000 7fdfd159b700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfb0066f30 0x7fdfb00693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8007fd0 tx=0x7fdfc8007d30 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:52.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.602+0000 7fdfc17fa700 1 -- 172.21.15.86:0/3231854920 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfbc086e60 con 0x7fdfcc1597f0 2023-10-09T12:56:52.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.837+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfcc04c3c0 con 0x7fdfcc1597f0 2023-10-09T12:56:52.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.837+0000 7fdfc17fa700 1 -- 172.21.15.86:0/3231854920 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdfbc0555a0 con 0x7fdfcc1597f0 2023-10-09T12:56:52.838 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T12:56:52.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.839+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfb0066f30 msgr2=0x7fdfb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.839+0000 7fdfd259d700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfb0066f30 0x7fdfb00693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8007fd0 tx=0x7fdfc8007d30 comp rx=0 tx=0).stop 2023-10-09T12:56:52.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc1597f0 msgr2=0x7fdfcc0b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:52.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc1597f0 0x7fdfcc0b3e50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00d860 tx=0x7fdfbc008040 comp rx=0 tx=0).stop 2023-10-09T12:56:52.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 shutdown_connections 2023-10-09T12:56:52.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfcc15d230 0x7fdfcc0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdfcc159420 0x7fdfcc154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfb0066f30 0x7fdfb00693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 --2- 172.21.15.86:0/3231854920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfcc1597f0 0x7fdfcc0b3e50 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 >> 172.21.15.86:0/3231854920 conn(0x7fdfcc0d0660 msgr2=0x7fdfcc157190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 shutdown_connections 2023-10-09T12:56:52.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:52.840+0000 7fdfd259d700 1 -- 172.21.15.86:0/3231854920 wait complete. 2023-10-09T12:56:52.857 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T12:56:52.857 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T12:56:52.858 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T12:56:52.858 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T12:56:52.858 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T12:56:52.858 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T12:56:52.858 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T12:56:52.858 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T12:56:52.858 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:56:52.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:52.858 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:56:52.895 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 37730sec preferred_lft 37730sec 2023-10-09T12:56:52.896 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T12:56:52.897 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:56:52.898 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T12:56:52.898 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T12:56:52.898 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T12:56:52.898 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:56:52.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:52.898 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T12:56:52.993 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T12:56:52.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:52.996 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T12:56:53.034 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T12:56:53.034 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T12:56:53.034 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T12:56:53.034 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T12:56:53.034 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T12:56:53.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:53.035 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T12:56:53.035 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T12:56:53.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T12:56:53.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T12:56:53.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T12:56:53.036 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T12:56:53.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:53.232 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T12:56:53.269 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T12:56:53.270 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T12:56:53.270 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:56:53.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:53.270 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T12:56:53.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T12:56:53.370 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T12:56:53.406 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:56:53.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T12:56:53.406 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T12:56:53.481 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T12:56:53.481 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T12:56:53.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:56:53.612 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:56:53.612 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T12:56:53.640 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:56:53.641 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T12:56:53.641 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T12:56:53.641 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T12:56:53.641 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T12:56:53.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T12:56:53.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:56:53.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T12:56:53.707 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T12:56:53.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.889+0000 7fe66359e700 1 Processor -- start 2023-10-09T12:56:53.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.889+0000 7fe66359e700 1 -- start start 2023-10-09T12:56:53.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.890+0000 7fe66359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe664159420 0x7fe6640b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:53.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.890+0000 7fe66359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe66415d230 0x7fe66415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.890+0000 7fe66359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6640b2980 con 0x7fe6641597f0 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.890+0000 7fe66359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66415dbb0 con 0x7fe664159420 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.890+0000 7fe66359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640b11d0 con 0x7fe66415d230 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe664159420 0x7fe6640b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe662d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe66415d230 0x7fe66415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe664159420 0x7fe6640b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:42854/0 (socket says 172.21.15.86:42854) 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe662d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe66415d230 0x7fe66415d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38316/0 (socket says 172.21.15.86:38316) 2023-10-09T12:56:53.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 -- 172.21.15.86:0/3417757756 learned_addr learned my addr 172.21.15.86:0/3417757756 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66159a700 1 -- 172.21.15.86:0/3417757756 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451920954 0 0) 0x7fe6640b2980 con 0x7fe6641597f0 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 -- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe66415d230 msgr2=0x7fe66415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 --2- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe66415d230 0x7fe66415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 -- 172.21.15.86:0/3417757756 >> v1:172.21.15.135:6789/0 conn(0x7fe6641597f0 legacy=0x7fe6640b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 -- 172.21.15.86:0/3417757756 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6640b14b0 con 0x7fe664159420 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe662d9d700 1 --2- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe66415d230 0x7fe66415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.891+0000 7fe66259c700 1 --2- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe664159420 0x7fe6640b5f40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=860e7bc72988f193 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66159a700 1 -- 172.21.15.86:0/3417757756 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654009ea0 con 0x7fe664159420 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66159a700 1 -- 172.21.15.86:0/3417757756 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400b860 con 0x7fe664159420 2023-10-09T12:56:53.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66159a700 1 -- 172.21.15.86:0/3417757756 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400bc00 con 0x7fe664159420 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 -- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe664159420 msgr2=0x7fe6640b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 --2- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe664159420 0x7fe6640b5f40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654009250 comp rx=0 tx=0).stop 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 -- 172.21.15.86:0/3417757756 shutdown_connections 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 --2- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe66415d230 0x7fe66415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 --2- 172.21.15.86:0/3417757756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe664159420 0x7fe6640b5f40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 -- 172.21.15.86:0/3417757756 >> 172.21.15.86:0/3417757756 conn(0x7fe6640d0660 msgr2=0x7fe6640d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 -- 172.21.15.86:0/3417757756 shutdown_connections 2023-10-09T12:56:53.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.892+0000 7fe66359e700 1 -- 172.21.15.86:0/3417757756 wait complete. 2023-10-09T12:56:53.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.894+0000 7fe66359e700 1 Processor -- start 2023-10-09T12:56:53.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.894+0000 7fe66359e700 1 -- start start 2023-10-09T12:56:53.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe66359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe664159420 0x7fe664150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:53.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe66359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6641597f0 0x7fe664152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:53.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe66359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66415d230 0x7fe6640b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe66359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6641515f0 con 0x7fe66415d230 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe66359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6641518d0 con 0x7fe6641597f0 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe66359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664151bb0 con 0x7fe664159420 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66415d230 0x7fe6640b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66415d230 0x7fe6640b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39432/0 (socket says 172.21.15.86:39432) 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 -- 172.21.15.86:0/2352128565 learned_addr learned my addr 172.21.15.86:0/2352128565 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe661d9b700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6641597f0 0x7fe664152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe66259c700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe664159420 0x7fe664150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 -- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe664159420 msgr2=0x7fe664150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe664159420 0x7fe664150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 -- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6641597f0 msgr2=0x7fe664152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:53.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6641597f0 0x7fe664152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe662d9d700 1 -- 172.21.15.86:0/2352128565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c009a20 con 0x7fe66415d230 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.895+0000 7fe661d9b700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6641597f0 0x7fe664152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.896+0000 7fe662d9d700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66415d230 0x7fe6640b54b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009f20 tx=0x7fe65c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.896+0000 7fe6527fc700 1 -- 172.21.15.86:0/2352128565 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00cbd0 con 0x7fe66415d230 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.896+0000 7fe6527fc700 1 -- 172.21.15.86:0/2352128565 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00f040 con 0x7fe66415d230 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.896+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6540094f0 con 0x7fe66415d230 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.896+0000 7fe6527fc700 1 -- 172.21.15.86:0/2352128565 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c014480 con 0x7fe66415d230 2023-10-09T12:56:53.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.896+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe664152170 con 0x7fe66415d230 2023-10-09T12:56:53.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.897+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66404c3c0 con 0x7fe66415d230 2023-10-09T12:56:53.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.898+0000 7fe6527fc700 1 -- 172.21.15.86:0/2352128565 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe65c003020 con 0x7fe66415d230 2023-10-09T12:56:53.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.898+0000 7fe6527fc700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:53.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.899+0000 7fe6527fc700 1 -- 172.21.15.86:0/2352128565 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fe65c085010 con 0x7fe66415d230 2023-10-09T12:56:53.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.899+0000 7fe66259c700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:53.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.899+0000 7fe66259c700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe644066f30 0x7fe6440693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654017000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:53.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:53.903+0000 7fe6527fc700 1 -- 172.21.15.86:0/2352128565 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe65c0520c0 con 0x7fe66415d230 2023-10-09T12:56:54.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.125+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6640b1790 con 0x7fe644066f30 2023-10-09T12:56:54.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.127+0000 7fe6527fc700 1 -- 172.21.15.86:0/2352128565 <== mgr.8400 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe6640b1790 con 0x7fe644066f30 2023-10-09T12:56:54.127 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T12:56:54.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:56:54.127 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T12:56:54.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:56:54.127 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T12:56:54.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe644066f30 msgr2=0x7fe6440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:54.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe644066f30 0x7fe6440693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654017000 comp rx=0 tx=0).stop 2023-10-09T12:56:54.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66415d230 msgr2=0x7fe6640b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66415d230 0x7fe6640b54b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009f20 tx=0x7fe65c00b040 comp rx=0 tx=0).stop 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 shutdown_connections 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66415d230 0x7fe6640b54b0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe664159420 0x7fe664150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 --2- 172.21.15.86:0/2352128565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6641597f0 0x7fe664152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 >> 172.21.15.86:0/2352128565 conn(0x7fe6640d0660 msgr2=0x7fe664069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 shutdown_connections 2023-10-09T12:56:54.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.129+0000 7fe66359e700 1 -- 172.21.15.86:0/2352128565 wait complete. 2023-10-09T12:56:54.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T12:56:54.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.339+0000 7f4a6499d700 1 Processor -- start 2023-10-09T12:56:54.340 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.340+0000 7f4a6499d700 1 -- start start 2023-10-09T12:56:54.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a6499d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4a6006f060 0x7f4a600ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a6499d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6006ebd0 con 0x7f4a600cb1a0 2023-10-09T12:56:54.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a6499d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6015aa70 con 0x7f4a6006f4b0 2023-10-09T12:56:54.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a6499d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6015b2e0 con 0x7f4a6006f060 2023-10-09T12:56:54.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a5f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4a600cb1a0 0x7f4a6015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:54270/0 (socket says 172.21.15.86:54270) 2023-10-09T12:56:54.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a5f7fe700 1 -- 172.21.15.86:0/3920634454 learned_addr learned my addr 172.21.15.86:0/3920634454 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a5effd700 1 --2- 172.21.15.86:0/3920634454 >> v2:172.21.15.135:3300/0 conn(0x7f4a6006f060 0x7f4a600ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250081585 0 0) 0x7f4a6006ebd0 con 0x7f4a600cb1a0 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.341+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a48003570 con 0x7f4a600cb1a0 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178406023 0 0) 0x7f4a48003570 con 0x7f4a600cb1a0 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 >> v2:172.21.15.135:3300/0 conn(0x7f4a6006f060 msgr2=0x7f4a600ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 --2- 172.21.15.86:0/3920634454 >> v2:172.21.15.135:3300/0 conn(0x7f4a6006f060 0x7f4a600ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 >> v1:172.21.15.135:6789/0 conn(0x7f4a6006f4b0 legacy=0x7f4a600c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:54.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6015ad20 con 0x7f4a600cb1a0 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f4a50001470 con 0x7f4a600cb1a0 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 >> v1:172.21.15.86:6789/0 conn(0x7f4a600cb1a0 legacy=0x7f4a6015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a48003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a48004810 0x7f4a48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a480051c0 0x7f4a4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6015b2e0 con 0x7f4a48004810 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4800c050 con 0x7f4a48003a60 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4800c210 con 0x7f4a480051c0 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a48003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5ffff700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a480051c0 0x7f4a4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.342+0000 7f4a5effd700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a48004810 0x7f4a48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5f7fe700 1 -- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a480051c0 msgr2=0x7f4a4800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a480051c0 0x7f4a4800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5f7fe700 1 -- 172.21.15.86:0/3920634454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a48004810 msgr2=0x7f4a48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a48004810 0x7f4a48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5f7fe700 1 -- 172.21.15.86:0/3920634454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48003570 con 0x7f4a48003a60 2023-10-09T12:56:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5ffff700 1 -- 172.21.15.86:0/3920634454 reap_dead start 2023-10-09T12:56:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5effd700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a48004810 0x7f4a48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a48003e30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4a50007c50 tx=0x7f4a600c8be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7dff6eaa21b1f44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:54.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000cbc0 con 0x7f4a48003a60 2023-10-09T12:56:54.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000cd20 con 0x7f4a48003a60 2023-10-09T12:56:54.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.343+0000 7f4a5e7fc700 1 -- 172.21.15.86:0/3920634454 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50005b70 con 0x7f4a48003a60 2023-10-09T12:56:54.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.344+0000 7f4a6499d700 1 -- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 msgr2=0x7f4a48003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:54.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.344+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a48003e30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4a50007c50 tx=0x7f4a600c8be0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.344+0000 7f4a6499d700 1 -- 172.21.15.86:0/3920634454 shutdown_connections 2023-10-09T12:56:54.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.344+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3920634454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a48003e30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.344+0000 7f4a6499d700 1 -- 172.21.15.86:0/3920634454 >> 172.21.15.86:0/3920634454 conn(0x7f4a600cc1e0 msgr2=0x7f4a600cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:54.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.344+0000 7f4a6499d700 1 -- 172.21.15.86:0/3920634454 shutdown_connections 2023-10-09T12:56:54.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.344+0000 7f4a6499d700 1 -- 172.21.15.86:0/3920634454 wait complete. 2023-10-09T12:56:54.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.345+0000 7f4a6499d700 1 Processor -- start 2023-10-09T12:56:54.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.346+0000 7f4a6499d700 1 -- start start 2023-10-09T12:56:54.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.346+0000 7f4a6499d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a60151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.346+0000 7f4a6499d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a60160080 0x7f4a601589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.346+0000 7f4a6499d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a601604f0 0x7f4a60158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.346+0000 7f4a6499d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600afca0 con 0x7f4a60160080 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.346+0000 7f4a6499d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60152450 con 0x7f4a48003a60 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.346+0000 7f4a6499d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600af090 con 0x7f4a601604f0 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a60160080 0x7f4a601589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a60160080 0x7f4a601589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39452/0 (socket says 172.21.15.86:39452) 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 -- 172.21.15.86:0/3868040880 learned_addr learned my addr 172.21.15.86:0/3868040880 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a60151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5ffff700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a601604f0 0x7f4a60158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 -- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a601604f0 msgr2=0x7f4a60158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a601604f0 0x7f4a60158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 -- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 msgr2=0x7f4a60151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a60151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 -- 172.21.15.86:0/3868040880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a600af370 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a60151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.347+0000 7f4a5effd700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a60160080 0x7f4a601589b0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f4a54011d20 tx=0x7f4a540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.348+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54011ed0 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.348+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5400fcd0 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.348+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5401d6b0 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.348+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a600af650 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.348+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a60152790 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.349+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a600afe50 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.350+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 74) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a5401da60 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.351+0000 7f4a477fe700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a4c066f30 0x7f4a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.351+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f4a54018070 con 0x7f4a60160080 2023-10-09T12:56:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.351+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a4c066f30 0x7f4a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:54.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.351+0000 7f4a5f7fe700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a4c066f30 0x7f4a4c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a50007c20 tx=0x7f4a50017000 comp rx=0 tx=0).ready entity=mgr.8400 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:54.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.359+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a600afe50 con 0x7f4a60160080 2023-10-09T12:56:54.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:54.615+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f4a600afe50 con 0x7f4a60160080 2023-10-09T12:56:55.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.252+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 75) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f4a5401dd10 con 0x7f4a60160080 2023-10-09T12:56:55.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.253+0000 7f4a477fe700 1 -- 172.21.15.86:0/3868040880 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v75) v1 ==== 92+0+0 (secure 0 0 0) 0x7f4a54056050 con 0x7f4a60160080 2023-10-09T12:56:55.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a4c066f30 msgr2=0x7f4a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a4c066f30 0x7f4a4c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a50007c20 tx=0x7f4a50017000 comp rx=0 tx=0).stop 2023-10-09T12:56:55.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a60160080 msgr2=0x7f4a601589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a60160080 0x7f4a601589b0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f4a54011d20 tx=0x7f4a540091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 shutdown_connections 2023-10-09T12:56:55.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a601604f0 0x7f4a60158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a48003a60 0x7f4a60151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4a4c066f30 0x7f4a4c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 --2- 172.21.15.86:0/3868040880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a60160080 0x7f4a601589b0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 >> 172.21.15.86:0/3868040880 conn(0x7f4a600cc1e0 msgr2=0x7f4a600c1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:55.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 shutdown_connections 2023-10-09T12:56:55.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.256+0000 7f4a6499d700 1 -- 172.21.15.86:0/3868040880 wait complete. 2023-10-09T12:56:55.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T12:56:55.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.469+0000 7f1a83dff700 1 Processor -- start 2023-10-09T12:56:55.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.469+0000 7f1a83dff700 1 -- start start 2023-10-09T12:56:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a83dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1a7c06b160 0x7f1a7c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a83dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a7c0637d0 0x7f1a7c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a83dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7c0ac450 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a83dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c06adc0 con 0x7f1a7c06b160 2023-10-09T12:56:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a83dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c069d00 con 0x7f1a7c0637d0 2023-10-09T12:56:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a81b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1a7c06b160 0x7f1a7c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a81b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1a7c06b160 0x7f1a7c06b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36760/0 (socket says 172.21.15.86:36760) 2023-10-09T12:56:55.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a81b9b700 1 -- 172.21.15.86:0/2304274250 learned_addr learned my addr 172.21.15.86:0/2304274250 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:55.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.472+0000 7f1a8139a700 1 --2- 172.21.15.86:0/2304274250 >> v2:172.21.15.135:3300/0 conn(0x7f1a7c0637d0 0x7f1a7c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a8139a700 1 -- 172.21.15.86:0/2304274250 >> v2:172.21.15.86:3300/0 conn(0x7f1a7c06b160 msgr2=0x7f1a7c06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:55.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a8139a700 1 --2- 172.21.15.86:0/2304274250 >> v2:172.21.15.86:3300/0 conn(0x7f1a7c06b160 0x7f1a7c06b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a8139a700 1 -- 172.21.15.86:0/2304274250 >> v1:172.21.15.86:6789/0 conn(0x7f1a7c06a2b0 legacy=0x7f1a7c06a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a8139a700 1 -- 172.21.15.86:0/2304274250 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c068830 con 0x7f1a7c0637d0 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a8139a700 1 --2- 172.21.15.86:0/2304274250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c068cc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0af860 tx=0x7f1a6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=201f0180a6bbd4e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a80b99700 1 -- 172.21.15.86:0/2304274250 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c011630 con 0x7f1a7c0637d0 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a80b99700 1 -- 172.21.15.86:0/2304274250 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c011790 con 0x7f1a7c0637d0 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.473+0000 7f1a80b99700 1 -- 172.21.15.86:0/2304274250 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c011b30 con 0x7f1a7c0637d0 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 -- 172.21.15.86:0/2304274250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c0637d0 msgr2=0x7f1a7c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 --2- 172.21.15.86:0/2304274250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c068cc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0af860 tx=0x7f1a6c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 -- 172.21.15.86:0/2304274250 shutdown_connections 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 --2- 172.21.15.86:0/2304274250 >> v2:172.21.15.86:3300/0 conn(0x7f1a7c06b160 0x7f1a7c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 --2- 172.21.15.86:0/2304274250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c068cc0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 -- 172.21.15.86:0/2304274250 >> 172.21.15.86:0/2304274250 conn(0x7f1a7c06ded0 msgr2=0x7f1a7c06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 -- 172.21.15.86:0/2304274250 shutdown_connections 2023-10-09T12:56:55.475 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.474+0000 7f1a83dff700 1 -- 172.21.15.86:0/2304274250 wait complete. 2023-10-09T12:56:55.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.475+0000 7f1a83dff700 1 Processor -- start 2023-10-09T12:56:55.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.476+0000 7f1a83dff700 1 -- start start 2023-10-09T12:56:55.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.476+0000 7f1a83dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c16a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.476+0000 7f1a83dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a7c06a2b0 0x7f1a7c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.476+0000 7f1a83dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c06b160 0x7f1a7c1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.476+0000 7f1a83dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c158dc0 con 0x7f1a7c0637d0 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.476+0000 7f1a83dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c16acc0 con 0x7f1a7c06b160 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.476+0000 7f1a83dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c156d40 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a81b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c16a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a8139a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a7c06a2b0 0x7f1a7c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a81b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c16a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36770/0 (socket says 172.21.15.86:36770) 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a81b9b700 1 -- 172.21.15.86:0/3309090461 learned_addr learned my addr 172.21.15.86:0/3309090461 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a8239c700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c06b160 0x7f1a7c1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a8139a700 1 -- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c06b160 msgr2=0x7f1a7c1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a8139a700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c06b160 0x7f1a7c1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a8139a700 1 -- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a7c0637d0 msgr2=0x7f1a7c16a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a8139a700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c16a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.477+0000 7f1a8139a700 1 -- 172.21.15.86:0/3309090461 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c009420 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.478+0000 7f1a8139a700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a7c06a2b0 0x7f1a7c156800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c016000 tx=0x7f1a6c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:55.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.478+0000 7f1a71ffb700 1 -- 172.21.15.86:0/3309090461 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c011b10 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.478+0000 7f1a71ffb700 1 -- 172.21.15.86:0/3309090461 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c000c90 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.478+0000 7f1a71ffb700 1 -- 172.21.15.86:0/3309090461 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c025660 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.478+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c156fa0 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.478+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c1575e0 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.479+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c158f30 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.480+0000 7f1a71ffb700 1 -- 172.21.15.86:0/3309090461 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 75) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f1a6c025a90 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.481+0000 7f1a71ffb700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 0x7f1a60069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.481+0000 7f1a71ffb700 1 -- 172.21.15.86:0/3309090461 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f1a6c085f20 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.481+0000 7f1a81b9b700 1 -- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 msgr2=0x7f1a60069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:55.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.481+0000 7f1a81b9b700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 0x7f1a60069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:55.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.486+0000 7f1a71ffb700 1 -- 172.21.15.86:0/3309090461 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a7c158f30 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.682+0000 7f1a81b9b700 1 -- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 msgr2=0x7f1a60069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:55.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.682+0000 7f1a81b9b700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 0x7f1a60069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:55.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.686+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f1a7c158f30 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.691+0000 7f1a71ffb700 1 -- 172.21.15.86:0/3309090461 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1a7c158f30 con 0x7f1a7c06a2b0 2023-10-09T12:56:55.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 msgr2=0x7f1a60069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 0x7f1a60069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a7c06a2b0 msgr2=0x7f1a7c156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a7c06a2b0 0x7f1a7c156800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c016000 tx=0x7f1a6c017000 comp rx=0 tx=0).stop 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 shutdown_connections 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1a60066f80 0x7f1a60069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a7c0637d0 0x7f1a7c16a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a7c06b160 0x7f1a7c1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 --2- 172.21.15.86:0/3309090461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a7c06a2b0 0x7f1a7c156800 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 >> 172.21.15.86:0/3309090461 conn(0x7f1a7c06ded0 msgr2=0x7f1a7c06e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 shutdown_connections 2023-10-09T12:56:55.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.694+0000 7f1a83dff700 1 -- 172.21.15.86:0/3309090461 wait complete. 2023-10-09T12:56:55.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T12:56:55.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.908+0000 7f08f39ff700 1 Processor -- start 2023-10-09T12:56:55.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.908+0000 7f08f39ff700 1 -- start start 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.909+0000 7f08f39ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08ec15ac80 0x7f08ec069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.909+0000 7f08f39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.909+0000 7f08f39ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ec0af2f0 con 0x7f08ec0afa60 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.909+0000 7f08f39ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec0af5d0 con 0x7f08ec15ac80 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.909+0000 7f08f39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0c8660 con 0x7f08ec15b050 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f1f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f08ec0afa60 0x7f08ec0aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58468/0 (socket says 172.21.15.86:58468) 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f1f9c700 1 -- 172.21.15.86:0/1002448812 learned_addr learned my addr 172.21.15.86:0/1002448812 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f0f9a700 1 --2- 172.21.15.86:0/1002448812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f179b700 1 --2- 172.21.15.86:0/1002448812 >> v2:172.21.15.135:3300/0 conn(0x7f08ec15ac80 0x7f08ec069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08e3fff700 1 -- 172.21.15.86:0/1002448812 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974960990 0 0) 0x7f08ec0af2f0 con 0x7f08ec0afa60 2023-10-09T12:56:55.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08e3fff700 1 -- 172.21.15.86:0/1002448812 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d8003570 con 0x7f08ec0afa60 2023-10-09T12:56:55.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f0f9a700 1 -- 172.21.15.86:0/1002448812 >> v2:172.21.15.135:3300/0 conn(0x7f08ec15ac80 msgr2=0x7f08ec069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:55.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f0f9a700 1 --2- 172.21.15.86:0/1002448812 >> v2:172.21.15.135:3300/0 conn(0x7f08ec15ac80 0x7f08ec069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f0f9a700 1 -- 172.21.15.86:0/1002448812 >> v1:172.21.15.86:6789/0 conn(0x7f08ec0afa60 legacy=0x7f08ec0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f0f9a700 1 -- 172.21.15.86:0/1002448812 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0c8940 con 0x7f08ec15b050 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.910+0000 7f08f179b700 1 --2- 172.21.15.86:0/1002448812 >> v2:172.21.15.135:3300/0 conn(0x7f08ec15ac80 0x7f08ec069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.911+0000 7f08f0f9a700 1 --2- 172.21.15.86:0/1002448812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec069cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0098e0 tx=0x7f08dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f474903d4f84f72a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.911+0000 7f08e3fff700 1 -- 172.21.15.86:0/1002448812 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011630 con 0x7f08ec15b050 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.911+0000 7f08e3fff700 1 -- 172.21.15.86:0/1002448812 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc011790 con 0x7f08ec15b050 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.911+0000 7f08e3fff700 1 -- 172.21.15.86:0/1002448812 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011b30 con 0x7f08ec15b050 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 -- 172.21.15.86:0/1002448812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 msgr2=0x7f08ec069cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 --2- 172.21.15.86:0/1002448812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec069cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0098e0 tx=0x7f08dc0091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 -- 172.21.15.86:0/1002448812 shutdown_connections 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 --2- 172.21.15.86:0/1002448812 >> v2:172.21.15.135:3300/0 conn(0x7f08ec15ac80 0x7f08ec069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 --2- 172.21.15.86:0/1002448812 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec069cb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 -- 172.21.15.86:0/1002448812 >> 172.21.15.86:0/1002448812 conn(0x7f08ec068e10 msgr2=0x7f08ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:55.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 -- 172.21.15.86:0/1002448812 shutdown_connections 2023-10-09T12:56:55.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.912+0000 7f08f39ff700 1 -- 172.21.15.86:0/1002448812 wait complete. 2023-10-09T12:56:55.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.915+0000 7f08f39ff700 1 Processor -- start 2023-10-09T12:56:55.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.915+0000 7f08f39ff700 1 -- start start 2023-10-09T12:56:55.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f39ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ec0afa60 0x7f08ec0aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f39ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec15ac80 0x7f08ec1426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f39ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec143b30 con 0x7f08ec15ac80 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f39ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0ab330 con 0x7f08ec0afa60 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec142f20 con 0x7f08ec15b050 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ec0afa60 0x7f08ec0aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f0f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec15ac80 0x7f08ec1426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ec0afa60 0x7f08ec0aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:38846/0 (socket says 172.21.15.86:38846) 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f179b700 1 -- 172.21.15.86:0/4288124954 learned_addr learned my addr 172.21.15.86:0/4288124954 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:55.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f1f9c700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:55.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.917+0000 7f08f179b700 1 -- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 msgr2=0x7f08ec143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08f179b700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08f179b700 1 -- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec15ac80 msgr2=0x7f08ec1426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:55.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08f179b700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec15ac80 0x7f08ec1426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:55.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08f179b700 1 -- 172.21.15.86:0/4288124954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8009420 con 0x7f08ec0afa60 2023-10-09T12:56:55.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08f179b700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ec0afa60 0x7f08ec0aadf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ec80 tx=0x7f08e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:55.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08e17fa700 1 -- 172.21.15.86:0/4288124954 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800c920 con 0x7f08ec0afa60 2023-10-09T12:56:55.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08e17fa700 1 -- 172.21.15.86:0/4288124954 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800ca80 con 0x7f08ec0afa60 2023-10-09T12:56:55.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08e17fa700 1 -- 172.21.15.86:0/4288124954 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800ce00 con 0x7f08ec0afa60 2023-10-09T12:56:55.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08dc009420 con 0x7f08ec0afa60 2023-10-09T12:56:55.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.918+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec1434e0 con 0x7f08ec0afa60 2023-10-09T12:56:55.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.919+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec143e10 con 0x7f08ec0afa60 2023-10-09T12:56:55.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.921+0000 7f08e17fa700 1 -- 172.21.15.86:0/4288124954 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 75) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f08e8013680 con 0x7f08ec0afa60 2023-10-09T12:56:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.922+0000 7f08e17fa700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 0x7f08d0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.922+0000 7f08f0f9a700 1 -- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 msgr2=0x7f08d0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.922+0000 7f08e17fa700 1 -- 172.21.15.86:0/4288124954 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f08e8084b30 con 0x7f08ec0afa60 2023-10-09T12:56:55.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.922+0000 7f08f0f9a700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 0x7f08d0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:55.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:55.926+0000 7f08e17fa700 1 -- 172.21.15.86:0/4288124954 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08e8051be0 con 0x7f08ec0afa60 2023-10-09T12:56:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.123+0000 7f08f0f9a700 1 -- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 msgr2=0x7f08d0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:56.123 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.123+0000 7f08f0f9a700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 0x7f08d0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:56.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.127+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f08ec04c3c0 con 0x7f08ec0afa60 2023-10-09T12:56:56.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.134+0000 7f08e17fa700 1 -- 172.21.15.86:0/4288124954 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7f08e8055200 con 0x7f08ec0afa60 2023-10-09T12:56:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 msgr2=0x7f08d0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:56:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 0x7f08d0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ec0afa60 msgr2=0x7f08ec0aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ec0afa60 0x7f08ec0aadf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ec80 tx=0x7f08e80091a0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 shutdown_connections 2023-10-09T12:56:56.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08ec15b050 0x7f08ec143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08ec0afa60 0x7f08ec0aadf0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f08d0066f80 0x7f08d0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 --2- 172.21.15.86:0/4288124954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec15ac80 0x7f08ec1426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 >> 172.21.15.86:0/4288124954 conn(0x7f08ec068e10 msgr2=0x7f08ec158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 shutdown_connections 2023-10-09T12:56:56.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.137+0000 7f08f39ff700 1 -- 172.21.15.86:0/4288124954 wait complete. 2023-10-09T12:56:56.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:56:56.155 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T12:56:56.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-10-09T12:56:56.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.446+0000 7f2c9759e700 1 Processor -- start 2023-10-09T12:56:56.446 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.446+0000 7f2c9759e700 1 -- start start 2023-10-09T12:56:56.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.447+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b0790 0x7f2c980cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:56.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.447+0000 7f2c9759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2c981591e0 0x7f2c98159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.447+0000 7f2c9759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c980cfa00 con 0x7f2c980b03c0 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.447+0000 7f2c9759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980cb580 con 0x7f2c981591e0 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.447+0000 7f2c9759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980cf160 con 0x7f2c980b0790 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c95d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b0790 0x7f2c980cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c96d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2c981591e0 0x7f2c98159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c9659c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f2c980b03c0 0x7f2c980b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:55422/0 (socket says 172.21.15.86:55422) 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c95d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b0790 0x7f2c980cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:45566/0 (socket says 172.21.15.86:45566) 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c96d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2c981591e0 0x7f2c98159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:38858/0 (socket says 172.21.15.86:38858) 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c9659c700 1 -- 172.21.15.86:0/774152613 learned_addr learned my addr 172.21.15.86:0/774152613 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:56:56.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c9559a700 1 -- 172.21.15.86:0/774152613 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831984106 0 0) 0x7f2c980cfa00 con 0x7f2c980b03c0 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c9559a700 1 -- 172.21.15.86:0/774152613 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c80003570 con 0x7f2c980b03c0 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c96d9d700 1 -- 172.21.15.86:0/774152613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b0790 msgr2=0x7f2c980cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c96d9d700 1 --2- 172.21.15.86:0/774152613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b0790 0x7f2c980cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c96d9d700 1 -- 172.21.15.86:0/774152613 >> v1:172.21.15.135:6789/0 conn(0x7f2c980b03c0 legacy=0x7f2c980b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c96d9d700 1 -- 172.21.15.86:0/774152613 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c980cf440 con 0x7f2c981591e0 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.448+0000 7f2c96d9d700 1 --2- 172.21.15.86:0/774152613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c981591e0 0x7f2c98159620 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009e60 tx=0x7f2c90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1592970e3fd90c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9559a700 1 -- 172.21.15.86:0/774152613 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000e070 con 0x7f2c981591e0 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9559a700 1 -- 172.21.15.86:0/774152613 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000bab0 con 0x7f2c981591e0 2023-10-09T12:56:56.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9559a700 1 -- 172.21.15.86:0/774152613 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000be70 con 0x7f2c981591e0 2023-10-09T12:56:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 -- 172.21.15.86:0/774152613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c981591e0 msgr2=0x7f2c98159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 --2- 172.21.15.86:0/774152613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c981591e0 0x7f2c98159620 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009e60 tx=0x7f2c90009780 comp rx=0 tx=0).stop 2023-10-09T12:56:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 -- 172.21.15.86:0/774152613 shutdown_connections 2023-10-09T12:56:56.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 --2- 172.21.15.86:0/774152613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c981591e0 0x7f2c98159620 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 --2- 172.21.15.86:0/774152613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b0790 0x7f2c980cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 -- 172.21.15.86:0/774152613 >> 172.21.15.86:0/774152613 conn(0x7f2c98063230 msgr2=0x7f2c98063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:56:56.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 -- 172.21.15.86:0/774152613 shutdown_connections 2023-10-09T12:56:56.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.449+0000 7f2c9759e700 1 -- 172.21.15.86:0/774152613 wait complete. 2023-10-09T12:56:56.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.451+0000 7f2c9759e700 1 Processor -- start 2023-10-09T12:56:56.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.451+0000 7f2c9759e700 1 -- start start 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b03c0 0x7f2c98157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980b0790 0x7f2c9815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c9759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c981591e0 0x7f2c9815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c9759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9815c4b0 con 0x7f2c981591e0 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c9759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9815cd10 con 0x7f2c980b0790 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c9759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98157960 con 0x7f2c980b03c0 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c96d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c981591e0 0x7f2c9815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:56.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c95d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980b0790 0x7f2c9815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c9659c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b03c0 0x7f2c98157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c95d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980b0790 0x7f2c9815d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:38874/0 (socket says 172.21.15.86:38874) 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.452+0000 7f2c95d9b700 1 -- 172.21.15.86:0/4075682771 learned_addr learned my addr 172.21.15.86:0/4075682771 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c95d9b700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b03c0 msgr2=0x7f2c98157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c95d9b700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b03c0 0x7f2c98157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c95d9b700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c981591e0 msgr2=0x7f2c9815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c95d9b700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c981591e0 0x7f2c9815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c95d9b700 1 -- 172.21.15.86:0/4075682771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90009a20 con 0x7f2c980b0790 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c95d9b700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980b0790 0x7f2c9815d1a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00ec80 tx=0x7f2c8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00c850 con 0x7f2c980b0790 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00c9b0 con 0x7f2c980b0790 2023-10-09T12:56:56.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9815ace0 con 0x7f2c980b0790 2023-10-09T12:56:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00cd50 con 0x7f2c980b0790 2023-10-09T12:56:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.453+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9815c9a0 con 0x7f2c980b0790 2023-10-09T12:56:56.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.454+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9815b020 con 0x7f2c980b0790 2023-10-09T12:56:56.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.455+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 75) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2c8c013680 con 0x7f2c980b0790 2023-10-09T12:56:56.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.456+0000 7f2c867fc700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c78069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:56:56.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.456+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f2c8c084a70 con 0x7f2c980b0790 2023-10-09T12:56:56.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.457+0000 7f2c9659c700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 msgr2=0x7f2c78069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:56.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.457+0000 7f2c9659c700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c78069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:56:56.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.460+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c8c051a80 con 0x7f2c980b0790 2023-10-09T12:56:56.533 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:56.533+0000 7f44f223d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:56:56.621 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:56.621+0000 7f790eb6f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:56:56.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.658+0000 7f2c9659c700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 msgr2=0x7f2c78069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:56.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.658+0000 7f2c9659c700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c78069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:56:56.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:56.685+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c9804c3c0 con 0x7f2c78066f80 2023-10-09T12:56:56.696 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:56.696+0000 7f44f223d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:56.782 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:56.782+0000 7f44f223d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:56:56.786 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:56.786+0000 7f790eb6f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:56.871 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:56.871+0000 7f790eb6f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:56:57.006 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:57.006+0000 7f44f223d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:57.059+0000 7f2c9659c700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 msgr2=0x7f2c78069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:57.059+0000 7f2c9659c700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c78069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T12:56:57.095 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:57.096+0000 7f790eb6f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:57.184 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:57.184+0000 7f44f223d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:56:57.278 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:57.279+0000 7f790eb6f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:56:57.281 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:57.281+0000 7f44f223d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:56:57.371 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:57.371+0000 7f790eb6f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:56:57.443 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:57.443+0000 7f44f223d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:56:57.532 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:57.533+0000 7f790eb6f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:56:57.544 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:57.544+0000 7f44f223d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:57.632 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:57.632+0000 7f790eb6f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:56:57.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:57.860+0000 7f2c9659c700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 msgr2=0x7f2c78069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:57.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:57.860+0000 7f2c9659c700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c78069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T12:56:58.027 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:58.027+0000 7f44f223d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:56:58.113 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:58.113+0000 7f790eb6f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:56:58.121 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:58.121+0000 7f44f223d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:56:58.207 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:58.208+0000 7f790eb6f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:56:58.213 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:58.213+0000 7f44f223d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:56:58.299 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:58.299+0000 7f790eb6f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:56:58.836 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:58.836+0000 7f44f223d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:56:58.915 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:58.914+0000 7f790eb6f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:56:59.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:56:59.008 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:56:59.009 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:59.009+0000 7f44f223d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:59.092 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:59.091+0000 7f790eb6f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:56:59.109 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:59.108+0000 7f44f223d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:56:59.186 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:59.185+0000 7f790eb6f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:56:59.404 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:59.404+0000 7f44f223d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:56:59.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:59.461+0000 7f2c9659c700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 msgr2=0x7f2c78069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:56:59.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:56:59.461+0000 7f2c9659c700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c78069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T12:56:59.481 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:59.481+0000 7f790eb6f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:56:59.502 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:56:59.501+0000 7f44f223d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:56:59.578 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:56:59.577+0000 7f790eb6f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:57:00.206 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:00.206+0000 7f44f223d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:57:00.278 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:00.277+0000 7f790eb6f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:57:00.494 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:00.494+0000 7f44f223d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:57:00.562 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:00.561+0000 7f790eb6f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:57:00.587 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:00.587+0000 7f44f223d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:57:00.654 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:00.654+0000 7f790eb6f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:57:00.740 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:00.740+0000 7f44f223d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:57:00.807 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:00.806+0000 7f790eb6f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:57:00.843 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:00.843+0000 7f44f223d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:57:00.911 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:00.910+0000 7f790eb6f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:57:01.033 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:01.033+0000 7f44f223d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:57:01.098 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.097+0000 7f790eb6f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:57:01.126 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:01.126+0000 7f44f223d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:57:01.190 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.189+0000 7f790eb6f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:57:01.217 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:01.217+0000 7f44f223d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:57:01.281 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.280+0000 7f790eb6f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:57:01.310 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:01.310+0000 7f44f223d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:57:01.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:01.372+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 76) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2c8c051e50 con 0x7f2c980b0790 2023-10-09T12:57:01.379 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.378+0000 7f790eb6f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:57:01.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:01.390+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 77) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f2c8c05c250 con 0x7f2c980b0790 2023-10-09T12:57:01.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:01.391+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 msgr2=0x7f2c78069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:01.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:01.391+0000 7f2c867fc700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c78069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:01.512 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7880eb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7880eb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7880eb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7880eb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7880eb1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7883eb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7883eb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.511+0000 7f7883eb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.512+0000 7f7883eb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:01.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:01.512+0000 7f7883eb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:02.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.397+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mon.1 v2:172.21.15.135:3300/0 9 ==== mgrmap(e 78) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f2c8c04f2d0 con 0x7f2c980b0790 2023-10-09T12:57:02.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.397+0000 7f2c867fc700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c780693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:02.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.397+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c9804c3c0 con 0x7f2c78066f80 2023-10-09T12:57:02.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.400+0000 7f2c9659c700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c780693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:02.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.402+0000 7f2c9659c700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c780693b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c88007fd0 tx=0x7f2c88009040 comp rx=0 tx=0).ready entity=mgr.7178 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:02.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.467+0000 7f2c867fc700 1 -- 172.21.15.86:0/4075682771 <== mgr.7178 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2c9804c3c0 con 0x7f2c78066f80 2023-10-09T12:57:02.468 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path snap_test_dir1 2023-10-09T12:57:02.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 msgr2=0x7f2c780693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c780693b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c88007fd0 tx=0x7f2c88009040 comp rx=0 tx=0).stop 2023-10-09T12:57:02.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980b0790 msgr2=0x7f2c9815d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980b0790 0x7f2c9815d1a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00ec80 tx=0x7f2c8c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 shutdown_connections 2023-10-09T12:57:02.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2c78066f80 0x7f2c780693b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c981591e0 0x7f2c9815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c980b03c0 0x7f2c98157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 --2- 172.21.15.86:0/4075682771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980b0790 0x7f2c9815d1a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 >> 172.21.15.86:0/4075682771 conn(0x7f2c98063230 msgr2=0x7f2c980b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:02.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 shutdown_connections 2023-10-09T12:57:02.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.470+0000 7f2c9759e700 1 -- 172.21.15.86:0/4075682771 wait complete. 2023-10-09T12:57:02.490 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T12:57:02.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T12:57:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.675+0000 7f6ec73ff700 1 Processor -- start 2023-10-09T12:57:02.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.675+0000 7f6ec73ff700 1 -- start start 2023-10-09T12:57:02.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.676+0000 7f6ec73ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec0157740 0x7f6ec00adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.676+0000 7f6ec73ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ec00b2100 0x7f6ec0068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.676+0000 7f6ec73ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec006dc20 con 0x7f6ec00688d0 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.676+0000 7f6ec73ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec00acc00 con 0x7f6ec00b2100 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.676+0000 7f6ec73ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec006d6a0 con 0x7f6ec0157740 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.676+0000 7f6ec499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ec00b2100 0x7f6ec0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ec00b2100 0x7f6ec0068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36932/0 (socket says 172.21.15.86:36932) 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec499a700 1 -- 172.21.15.86:0/3338596953 learned_addr learned my addr 172.21.15.86:0/3338596953 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec599c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6ec00688d0 0x7f6ec0069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58470/0 (socket says 172.21.15.86:58470) 2023-10-09T12:57:02.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec519b700 1 --2- 172.21.15.86:0/3338596953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec0157740 0x7f6ec00adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:02.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec499a700 1 -- 172.21.15.86:0/3338596953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec0157740 msgr2=0x7f6ec00adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:02.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec499a700 1 --2- 172.21.15.86:0/3338596953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec0157740 0x7f6ec00adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec499a700 1 -- 172.21.15.86:0/3338596953 >> v1:172.21.15.86:6789/0 conn(0x7f6ec00688d0 legacy=0x7f6ec0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec499a700 1 -- 172.21.15.86:0/3338596953 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00ae910 con 0x7f6ec00b2100 2023-10-09T12:57:02.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6eb7fff700 1 -- 172.21.15.86:0/3338596953 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508838723 0 0) 0x7f6ec006dc20 con 0x7f6ec00688d0 2023-10-09T12:57:02.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6ec499a700 1 --2- 172.21.15.86:0/3338596953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec0068390 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00099b0 tx=0x7f6eb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acc96a39039e4f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:02.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.677+0000 7f6eb7fff700 1 -- 172.21.15.86:0/3338596953 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0009ea0 con 0x7f6ec00b2100 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6eb7fff700 1 -- 172.21.15.86:0/3338596953 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000b860 con 0x7f6ec00b2100 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6eb7fff700 1 -- 172.21.15.86:0/3338596953 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000bc00 con 0x7f6ec00b2100 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 -- 172.21.15.86:0/3338596953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 msgr2=0x7f6ec0068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/3338596953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec0068390 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00099b0 tx=0x7f6eb0009250 comp rx=0 tx=0).stop 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 -- 172.21.15.86:0/3338596953 shutdown_connections 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/3338596953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec0157740 0x7f6ec00adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/3338596953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec0068390 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 -- 172.21.15.86:0/3338596953 >> 172.21.15.86:0/3338596953 conn(0x7f6ec00c8f90 msgr2=0x7f6ec00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 -- 172.21.15.86:0/3338596953 shutdown_connections 2023-10-09T12:57:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.678+0000 7f6ec73ff700 1 -- 172.21.15.86:0/3338596953 wait complete. 2023-10-09T12:57:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.679+0000 7f6ec73ff700 1 Processor -- start 2023-10-09T12:57:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.680+0000 7f6ec73ff700 1 -- start start 2023-10-09T12:57:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.680+0000 7f6ec73ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec00688d0 0x7f6ec00c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.680+0000 7f6ec73ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec00b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.680+0000 7f6ec73ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec0157740 0x7f6ec0154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.680+0000 7f6ec73ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00c63d0 con 0x7f6ec00b2100 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.680+0000 7f6ec73ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00c60f0 con 0x7f6ec0157740 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.680+0000 7f6ec73ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec016b1d0 con 0x7f6ec00688d0 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec00b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec00b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36948/0 (socket says 172.21.15.86:36948) 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 -- 172.21.15.86:0/180614624 learned_addr learned my addr 172.21.15.86:0/180614624 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec519b700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec00688d0 0x7f6ec00c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec599c700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec0157740 0x7f6ec0154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 -- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec00688d0 msgr2=0x7f6ec00c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec00688d0 0x7f6ec00c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 -- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec0157740 msgr2=0x7f6ec0154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec0157740 0x7f6ec0154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 -- 172.21.15.86:0/180614624 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00094f0 con 0x7f6ec00b2100 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec519b700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec00688d0 0x7f6ec00c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.681+0000 7f6ec499a700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec00b04f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6ec006b890 tx=0x7f6eb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.682+0000 7f6eb57fa700 1 -- 172.21.15.86:0/180614624 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000bbe0 con 0x7f6ec00b2100 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.682+0000 7f6eb57fa700 1 -- 172.21.15.86:0/180614624 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0011420 con 0x7f6ec00b2100 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.682+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec016b4b0 con 0x7f6ec00b2100 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.682+0000 7f6eb57fa700 1 -- 172.21.15.86:0/180614624 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00117c0 con 0x7f6ec00b2100 2023-10-09T12:57:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.682+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec00c5cc0 con 0x7f6ec00b2100 2023-10-09T12:57:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.683+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec016b030 con 0x7f6ec00b2100 2023-10-09T12:57:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.684+0000 7f6eb57fa700 1 -- 172.21.15.86:0/180614624 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 78) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f6eb0011b70 con 0x7f6ec00b2100 2023-10-09T12:57:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.685+0000 7f6eb57fa700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6ea4066dd0 0x7f6ea4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.685+0000 7f6eb57fa700 1 -- 172.21.15.86:0/180614624 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f6eb0085ee0 con 0x7f6ec00b2100 2023-10-09T12:57:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.685+0000 7f6ec519b700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6ea4066dd0 0x7f6ea4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.685+0000 7f6ec519b700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6ea4066dd0 0x7f6ea4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009d80 tx=0x7f6ebc008040 comp rx=0 tx=0).ready entity=mgr.7178 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:02.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.689+0000 7f6eb57fa700 1 -- 172.21.15.86:0/180614624 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ec016b030 con 0x7f6ec00b2100 2023-10-09T12:57:02.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.904+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ec016b9d0 con 0x7f6ea4066dd0 2023-10-09T12:57:02.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.977+0000 7f6eb57fa700 1 -- 172.21.15.86:0/180614624 <== mgr.7178 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6ec016b9d0 con 0x7f6ea4066dd0 2023-10-09T12:57:02.979 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path snap_test_dir1 2023-10-09T12:57:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6ea4066dd0 msgr2=0x7f6ea4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6ea4066dd0 0x7f6ea4069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009d80 tx=0x7f6ebc008040 comp rx=0 tx=0).stop 2023-10-09T12:57:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 msgr2=0x7f6ec00b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:02.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec00b04f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6ec006b890 tx=0x7f6eb0017000 comp rx=0 tx=0).stop 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 shutdown_connections 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec0157740 0x7f6ec0154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec00688d0 0x7f6ec00c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6ea4066dd0 0x7f6ea4069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 --2- 172.21.15.86:0/180614624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec00b2100 0x7f6ec00b04f0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 >> 172.21.15.86:0/180614624 conn(0x7f6ec00c8f90 msgr2=0x7f6ec0156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 shutdown_connections 2023-10-09T12:57:02.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:02.980+0000 7f6ec73ff700 1 -- 172.21.15.86:0/180614624 wait complete. 2023-10-09T12:57:02.998 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T12:57:02.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-09T12:57:03.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.183+0000 7fb4b81ff700 1 Processor -- start 2023-10-09T12:57:03.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.183+0000 7fb4b81ff700 1 -- start start 2023-10-09T12:57:03.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.184+0000 7fb4b81ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4b00c8490 0x7fb4b00c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.184+0000 7fb4b81ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b015a490 0x7fb4b0068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.184+0000 7fb4b81ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b00ac030 con 0x7fb4b0069a50 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.184+0000 7fb4b81ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b00ab820 con 0x7fb4b00c8490 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.184+0000 7fb4b81ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b006dbb0 con 0x7fb4b015a490 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.184+0000 7fb4b5f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4b00c8490 0x7fb4b00c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b5f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4b00c8490 0x7fb4b00c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36962/0 (socket says 172.21.15.86:36962) 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b5f9b700 1 -- 172.21.15.86:0/943619290 learned_addr learned my addr 172.21.15.86:0/943619290 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b679c700 1 --1- 172.21.15.86:0/943619290 >> v1:172.21.15.86:6789/0 conn(0x7fb4b0069a50 0x7fb4b0156ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58472/0 (socket says 172.21.15.86:58472) 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b579a700 1 --2- 172.21.15.86:0/943619290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b015a490 0x7fb4b0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b4f99700 1 -- 172.21.15.86:0/943619290 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927258329 0 0) 0x7fb4a8001490 con 0x7fb4b0069a50 2023-10-09T12:57:03.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b4f99700 1 -- 172.21.15.86:0/943619290 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb49c003570 con 0x7fb4b0069a50 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b5f9b700 1 -- 172.21.15.86:0/943619290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b015a490 msgr2=0x7fb4b0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b5f9b700 1 --2- 172.21.15.86:0/943619290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b015a490 0x7fb4b0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b5f9b700 1 -- 172.21.15.86:0/943619290 >> v1:172.21.15.86:6789/0 conn(0x7fb4b0069a50 legacy=0x7fb4b0156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b5f9b700 1 -- 172.21.15.86:0/943619290 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b00aba70 con 0x7fb4b00c8490 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.185+0000 7fb4b5f9b700 1 --2- 172.21.15.86:0/943619290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 0x7fb4b00c6ac0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0099b0 tx=0x7fb4ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e10b09bdb6c81a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b4f99700 1 -- 172.21.15.86:0/943619290 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00b680 con 0x7fb4b00c8490 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b4f99700 1 -- 172.21.15.86:0/943619290 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac00b7e0 con 0x7fb4b00c8490 2023-10-09T12:57:03.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b4f99700 1 -- 172.21.15.86:0/943619290 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00bb80 con 0x7fb4b00c8490 2023-10-09T12:57:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 -- 172.21.15.86:0/943619290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 msgr2=0x7fb4b00c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 --2- 172.21.15.86:0/943619290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 0x7fb4b00c6ac0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0099b0 tx=0x7fb4ac009250 comp rx=0 tx=0).stop 2023-10-09T12:57:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 -- 172.21.15.86:0/943619290 shutdown_connections 2023-10-09T12:57:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 --2- 172.21.15.86:0/943619290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 0x7fb4b00c6ac0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 --2- 172.21.15.86:0/943619290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b015a490 0x7fb4b0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 -- 172.21.15.86:0/943619290 >> 172.21.15.86:0/943619290 conn(0x7fb4b00c8f90 msgr2=0x7fb4b00c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 -- 172.21.15.86:0/943619290 shutdown_connections 2023-10-09T12:57:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.186+0000 7fb4b81ff700 1 -- 172.21.15.86:0/943619290 wait complete. 2023-10-09T12:57:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.188+0000 7fb4b81ff700 1 Processor -- start 2023-10-09T12:57:03.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.188+0000 7fb4b81ff700 1 -- start start 2023-10-09T12:57:03.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b81ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b0069a50 0x7fb4b015e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b81ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 0x7fb4b00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b81ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b015a490 0x7fb4b015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b81ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b015e110 con 0x7fb4b00c8490 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b81ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b015d500 con 0x7fb4b015a490 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b81ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b015d7e0 con 0x7fb4b0069a50 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b579a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 0x7fb4b00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b579a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 0x7fb4b00c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36966/0 (socket says 172.21.15.86:36966) 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b579a700 1 -- 172.21.15.86:0/2825699070 learned_addr learned my addr 172.21.15.86:0/2825699070 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b5f9b700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b0069a50 0x7fb4b015e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.189+0000 7fb4b679c700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b015a490 0x7fb4b015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b579a700 1 -- 172.21.15.86:0/2825699070 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b0069a50 msgr2=0x7fb4b015e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b579a700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4b0069a50 0x7fb4b015e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b579a700 1 -- 172.21.15.86:0/2825699070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b015a490 msgr2=0x7fb4b015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b579a700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b015a490 0x7fb4b015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b579a700 1 -- 172.21.15.86:0/2825699070 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0094f0 con 0x7fb4b00c8490 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b679c700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b015a490 0x7fb4b015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b579a700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4b00c8490 0x7fb4b00c2700 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000e950 tx=0x7fb4a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4a5ffb700 1 -- 172.21.15.86:0/2825699070 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0013680 con 0x7fb4b00c8490 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4a5ffb700 1 -- 172.21.15.86:0/2825699070 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a00137e0 con 0x7fb4b00c8490 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4a5ffb700 1 -- 172.21.15.86:0/2825699070 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0013ba0 con 0x7fb4b00c8490 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b81ff700 1 -- 172.21.15.86:0/2825699070 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b015dac0 con 0x7fb4b00c8490 2023-10-09T12:57:03.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.190+0000 7fb4b81ff700 1 -- 172.21.15.86:0/2825699070 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b00c2c40 con 0x7fb4b00c8490 2023-10-09T12:57:03.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.191+0000 7fb4b81ff700 1 -- 172.21.15.86:0/2825699070 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b015e2c0 con 0x7fb4b00c8490 2023-10-09T12:57:03.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.192+0000 7fb4a5ffb700 1 -- 172.21.15.86:0/2825699070 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 78) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fb4a000c490 con 0x7fb4b00c8490 2023-10-09T12:57:03.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.193+0000 7fb4a5ffb700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb494066dd0 0x7fb494069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.193+0000 7fb4a5ffb700 1 -- 172.21.15.86:0/2825699070 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fb4a00847a0 con 0x7fb4b00c8490 2023-10-09T12:57:03.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.193+0000 7fb4b5f9b700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb494066dd0 0x7fb494069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.194+0000 7fb4b5f9b700 1 --2- 172.21.15.86:0/2825699070 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb494066dd0 0x7fb494069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0099b0 tx=0x7fb4ac017000 comp rx=0 tx=0).ready entity=mgr.7178 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:03.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.197+0000 7fb4a5ffb700 1 -- 172.21.15.86:0/2825699070 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4b015e2c0 con 0x7fb4b00c8490 2023-10-09T12:57:03.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.414+0000 7fb4b81ff700 1 -- 172.21.15.86:0/2825699070 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4b00718b0 con 0x7fb494066dd0 2023-10-09T12:57:03.422 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:03.421+0000 7f788aec5700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-09T12:57:03.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.421+0000 7fb4a5ffb700 1 -- 172.21.15.86:0/2825699070 <== mgr.7178 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fb4b00718b0 con 0x7fb494066dd0 2023-10-09T12:57:03.424 INFO:teuthology.orchestra.run.smithi086.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-09T12:57:03.432 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-09T12:57:03.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:57:03.433 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T12:57:03.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T12:57:03.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.693+0000 7fa377bff700 1 Processor -- start 2023-10-09T12:57:03.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.693+0000 7fa377bff700 1 -- start start 2023-10-09T12:57:03.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.694+0000 7fa377bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 0x7fa37015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.694+0000 7fa377bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa370069560 0x7fa3700699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.694+0000 7fa377bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37015a160 con 0x7fa370159c60 2023-10-09T12:57:03.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.694+0000 7fa377bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa370069f20 con 0x7fa370069560 2023-10-09T12:57:03.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.694+0000 7fa377bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700d13a0 con 0x7fa370159890 2023-10-09T12:57:03.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa37519a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa370159c60 0x7fa37015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58484/0 (socket says 172.21.15.86:58484) 2023-10-09T12:57:03.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa37519a700 1 -- 172.21.15.86:0/2532735529 learned_addr learned my addr 172.21.15.86:0/2532735529 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa37599b700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 0x7fa37015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa37619c700 1 --2- 172.21.15.86:0/2532735529 >> v2:172.21.15.135:3300/0 conn(0x7fa370069560 0x7fa3700699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963287971 0 0) 0x7fa37015a160 con 0x7fa370159c60 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c003570 con 0x7fa370159c60 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3195239818 0 0) 0x7fa35c003570 con 0x7fa370159c60 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 msgr2=0x7fa37015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 0x7fa37015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 >> v2:172.21.15.135:3300/0 conn(0x7fa370069560 msgr2=0x7fa3700699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:03.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 --2- 172.21.15.86:0/2532735529 >> v2:172.21.15.135:3300/0 conn(0x7fa370069560 0x7fa3700699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37015e140 con 0x7fa370159c60 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa360001470 con 0x7fa370159c60 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 >> v1:172.21.15.86:6789/0 conn(0x7fa370159c60 legacy=0x7fa37015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa35c003a60 0x7fa35c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.695+0000 7fa374999700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 0x7fa35c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa374999700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c004d50 0x7fa35c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370069f20 con 0x7fa35c003a60 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700d13a0 con 0x7fa35c004d50 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c00ba60 con 0x7fa370159890 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37599b700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa35c003a60 0x7fa35c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37619c700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c004d50 0x7fa35c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37519a700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 0x7fa35c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37599b700 1 -- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 msgr2=0x7fa35c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37599b700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 0x7fa35c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37599b700 1 -- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c004d50 msgr2=0x7fa35c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37599b700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c004d50 0x7fa35c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37599b700 1 -- 172.21.15.86:0/2532735529 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c003570 con 0x7fa35c003a60 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37519a700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370159890 0x7fa35c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.696+0000 7fa37599b700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa35c003a60 0x7fa35c003e70 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009c00 tx=0x7fa36c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b2110c8635bbb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00e6b0 con 0x7fa35c003a60 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00e810 con 0x7fa35c003a60 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa374999700 1 -- 172.21.15.86:0/2532735529 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00ebd0 con 0x7fa35c003a60 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa377bff700 1 -- 172.21.15.86:0/2532735529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa35c003a60 msgr2=0x7fa35c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa377bff700 1 --2- 172.21.15.86:0/2532735529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa35c003a60 0x7fa35c003e70 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009c00 tx=0x7fa36c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa37619c700 1 -- 172.21.15.86:0/2532735529 reap_dead start 2023-10-09T12:57:03.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa377bff700 1 -- 172.21.15.86:0/2532735529 shutdown_connections 2023-10-09T12:57:03.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa377bff700 1 -- 172.21.15.86:0/2532735529 >> 172.21.15.86:0/2532735529 conn(0x7fa370068e20 msgr2=0x7fa3700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:03.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa377bff700 1 -- 172.21.15.86:0/2532735529 shutdown_connections 2023-10-09T12:57:03.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.697+0000 7fa377bff700 1 -- 172.21.15.86:0/2532735529 wait complete. 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.699+0000 7fa377bff700 1 Processor -- start 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.699+0000 7fa377bff700 1 -- start start 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa377bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa35c003a60 0x7fa3700ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa377bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3700cfc50 0x7fa370152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa377bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3700cd250 0x7fa37015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa377bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700ce9c0 con 0x7fa3700cfc50 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa377bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700cebd0 con 0x7fa3700cd250 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa377bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700ceeb0 con 0x7fa35c003a60 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3700cfc50 0x7fa370152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3700cfc50 0x7fa370152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:36978/0 (socket says 172.21.15.86:36978) 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 -- 172.21.15.86:0/4057606888 learned_addr learned my addr 172.21.15.86:0/4057606888 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37619c700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3700cd250 0x7fa37015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37599b700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa35c003a60 0x7fa3700ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 -- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa35c003a60 msgr2=0x7fa3700ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa35c003a60 0x7fa3700ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 -- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3700cd250 msgr2=0x7fa37015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3700cd250 0x7fa37015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37519a700 1 -- 172.21.15.86:0/4057606888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700cf190 con 0x7fa3700cfc50 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.700+0000 7fa37619c700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3700cd250 0x7fa37015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.701+0000 7fa37519a700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3700cfc50 0x7fa370152c10 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fa36000eb90 tx=0x7fa360001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.701+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000c7e0 con 0x7fa3700cfc50 2023-10-09T12:57:03.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.701+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36000c940 con 0x7fa3700cfc50 2023-10-09T12:57:03.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.701+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000ccc0 con 0x7fa3700cfc50 2023-10-09T12:57:03.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.701+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3700cf470 con 0x7fa3700cfc50 2023-10-09T12:57:03.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.701+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa370153150 con 0x7fa3700cfc50 2023-10-09T12:57:03.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.702+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa370153370 con 0x7fa3700cfc50 2023-10-09T12:57:03.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.703+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 78) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fa360013630 con 0x7fa3700cfc50 2023-10-09T12:57:03.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.704+0000 7fa365ffb700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa354066dd0 0x7fa354069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:03.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.704+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fa360084630 con 0x7fa3700cfc50 2023-10-09T12:57:03.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.705+0000 7fa37599b700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa354066dd0 0x7fa354069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:03.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.705+0000 7fa37599b700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa354066dd0 0x7fa354069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0091e0 tx=0x7fa36c01a000 comp rx=0 tx=0).ready entity=mgr.7178 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:03.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.709+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa360051890 con 0x7fa3700cfc50 2023-10-09T12:57:03.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:03.953+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa370154550 con 0x7fa3700cfc50 2023-10-09T12:57:04.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.177+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa360051c60 con 0x7fa3700cfc50 2023-10-09T12:57:04.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.179+0000 7fa365ffb700 1 -- 172.21.15.86:0/4057606888 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v79) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa360070330 con 0x7fa3700cfc50 2023-10-09T12:57:04.182 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa354066dd0 msgr2=0x7fa354069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa354066dd0 0x7fa354069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0091e0 tx=0x7fa36c01a000 comp rx=0 tx=0).stop 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3700cfc50 msgr2=0x7fa370152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3700cfc50 0x7fa370152c10 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fa36000eb90 tx=0x7fa360001e90 comp rx=0 tx=0).stop 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 shutdown_connections 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3700cd250 0x7fa37015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa35c003a60 0x7fa3700ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa354066dd0 0x7fa354069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 --2- 172.21.15.86:0/4057606888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3700cfc50 0x7fa370152c10 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 >> 172.21.15.86:0/4057606888 conn(0x7fa370068e20 msgr2=0x7fa37014d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:04.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 shutdown_connections 2023-10-09T12:57:04.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.181+0000 7fa377bff700 1 -- 172.21.15.86:0/4057606888 wait complete. 2023-10-09T12:57:04.204 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T12:57:04.204 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:57:04.285 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:57:04.365 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T12:57:04.365 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T12:57:04.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:57:04.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T12:57:04.456 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T12:57:04.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:04.456 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T12:57:04.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:57:04.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.718+0000 7f398b59d700 1 Processor -- start 2023-10-09T12:57:04.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.718+0000 7f398b59d700 1 -- start start 2023-10-09T12:57:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.719+0000 7f398b59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f398415d230 0x7f398415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.719+0000 7f398b59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840b2980 con 0x7f39841597f0 2023-10-09T12:57:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.719+0000 7f398b59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398415db70 con 0x7f3984159420 2023-10-09T12:57:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.719+0000 7f398b59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840b11d0 con 0x7f398415d230 2023-10-09T12:57:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f3989d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f39841597f0 0x7f39840b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58510/0 (socket says 172.21.15.86:58510) 2023-10-09T12:57:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f3989d9a700 1 -- 172.21.15.86:0/1297907130 learned_addr learned my addr 172.21.15.86:0/1297907130 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:04.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f398ad9c700 1 --2- 172.21.15.86:0/1297907130 >> v2:172.21.15.135:3300/0 conn(0x7f398415d230 0x7f398415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f3989599700 1 -- 172.21.15.86:0/1297907130 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112191692 0 0) 0x7f39840b2980 con 0x7f39841597f0 2023-10-09T12:57:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f3989599700 1 -- 172.21.15.86:0/1297907130 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3970003570 con 0x7f39841597f0 2023-10-09T12:57:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f3989599700 1 -- 172.21.15.86:0/1297907130 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773521601 0 0) 0x7f398415db70 con 0x7f3984159420 2023-10-09T12:57:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f3989599700 1 -- 172.21.15.86:0/1297907130 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39840b2980 con 0x7f3984159420 2023-10-09T12:57:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f398ad9c700 1 -- 172.21.15.86:0/1297907130 >> v1:172.21.15.135:6789/0 conn(0x7f3984159420 legacy=0x7f39840b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f398ad9c700 1 -- 172.21.15.86:0/1297907130 >> v1:172.21.15.86:6789/0 conn(0x7f39841597f0 legacy=0x7f39840b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.720+0000 7f398ad9c700 1 -- 172.21.15.86:0/1297907130 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840b14b0 con 0x7f398415d230 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.721+0000 7f398ad9c700 1 --2- 172.21.15.86:0/1297907130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f398415d230 0x7f398415d630 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f397c009e60 tx=0x7f397c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20d1a793c55b9019 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.721+0000 7f3989599700 1 -- 172.21.15.86:0/1297907130 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00e070 con 0x7f398415d230 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.721+0000 7f3989599700 1 -- 172.21.15.86:0/1297907130 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00bab0 con 0x7f398415d230 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.721+0000 7f3989599700 1 -- 172.21.15.86:0/1297907130 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00be70 con 0x7f398415d230 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.721+0000 7f398b59d700 1 -- 172.21.15.86:0/1297907130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f398415d230 msgr2=0x7f398415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.722+0000 7f398b59d700 1 --2- 172.21.15.86:0/1297907130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f398415d230 0x7f398415d630 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f397c009e60 tx=0x7f397c009780 comp rx=0 tx=0).stop 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.722+0000 7f398b59d700 1 -- 172.21.15.86:0/1297907130 shutdown_connections 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.722+0000 7f398b59d700 1 --2- 172.21.15.86:0/1297907130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f398415d230 0x7f398415d630 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.722+0000 7f398b59d700 1 -- 172.21.15.86:0/1297907130 >> 172.21.15.86:0/1297907130 conn(0x7f39840d0660 msgr2=0x7f39840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.722+0000 7f398b59d700 1 -- 172.21.15.86:0/1297907130 shutdown_connections 2023-10-09T12:57:04.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.722+0000 7f398b59d700 1 -- 172.21.15.86:0/1297907130 wait complete. 2023-10-09T12:57:04.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.723+0000 7f398b59d700 1 Processor -- start 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.723+0000 7f398b59d700 1 -- start start 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398b59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3984159420 0x7f3984154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398b59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39841597f0 0x7f398415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398b59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f398415d230 0x7f39840b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398b59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398415ac20 con 0x7f39841597f0 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398b59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398415a010 con 0x7f3984159420 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398b59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398415a2f0 con 0x7f398415d230 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f3989d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39841597f0 0x7f398415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f3989d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39841597f0 0x7f398415c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:37002/0 (socket says 172.21.15.86:37002) 2023-10-09T12:57:04.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f3989d9a700 1 -- 172.21.15.86:0/1833185723 learned_addr learned my addr 172.21.15.86:0/1833185723 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398ad9c700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f398415d230 0x7f39840b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.724+0000 7f398a59b700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3984159420 0x7f3984154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f3989d9a700 1 -- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f398415d230 msgr2=0x7f39840b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f3989d9a700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f398415d230 0x7f39840b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f3989d9a700 1 -- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3984159420 msgr2=0x7f3984154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f3989d9a700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3984159420 0x7f3984154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f3989d9a700 1 -- 172.21.15.86:0/1833185723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c009a20 con 0x7f39841597f0 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f398a59b700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3984159420 0x7f3984154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f3989d9a700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39841597f0 0x7f398415c7d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f397400c790 tx=0x7f3974007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f397a7fc700 1 -- 172.21.15.86:0/1833185723 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974005b30 con 0x7f39841597f0 2023-10-09T12:57:04.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f397a7fc700 1 -- 172.21.15.86:0/1833185723 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974005c90 con 0x7f39841597f0 2023-10-09T12:57:04.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f397a7fc700 1 -- 172.21.15.86:0/1833185723 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740072e0 con 0x7f39841597f0 2023-10-09T12:57:04.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.725+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398415a5d0 con 0x7f39841597f0 2023-10-09T12:57:04.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.726+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3984159ca0 con 0x7f39841597f0 2023-10-09T12:57:04.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.726+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398415c110 con 0x7f39841597f0 2023-10-09T12:57:04.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.727+0000 7f397a7fc700 1 -- 172.21.15.86:0/1833185723 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f3974007690 con 0x7f39841597f0 2023-10-09T12:57:04.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.728+0000 7f397a7fc700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 0x7f3968069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:04.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.728+0000 7f397a7fc700 1 -- 172.21.15.86:0/1833185723 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f3974083fd0 con 0x7f39841597f0 2023-10-09T12:57:04.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.728+0000 7f398a59b700 1 -- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 msgr2=0x7f3968069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:04.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.728+0000 7f398a59b700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 0x7f3968069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:04.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.732+0000 7f397a7fc700 1 -- 172.21.15.86:0/1833185723 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f397404b5a0 con 0x7f39841597f0 2023-10-09T12:57:04.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.929+0000 7f398a59b700 1 -- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 msgr2=0x7f3968069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:04.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.929+0000 7f398a59b700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 0x7f3968069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.993+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f398404c3c0 con 0x7f39841597f0 2023-10-09T12:57:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.994+0000 7f397a7fc700 1 -- 172.21.15.86:0/1833185723 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3974017020 con 0x7f39841597f0 2023-10-09T12:57:04.995 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:04.995 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/2700721489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2700721489},{"type":"v1","addr":"172.21.15.135:6834","nonce":2700721489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1754968847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1754968847},{"type":"v1","addr":"172.21.15.135:6835","nonce":1754968847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/885619835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":885619835},{"type":"v1","addr":"172.21.15.86:6834","nonce":885619835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:56:40.649653+0000","modified":"2023-10-09T12:56:44.211663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8580":{"gid":8580,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3313043174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":3313043174},{"type":"v1","addr":"172.21.15.86:6835","nonce":3313043174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T12:57:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 msgr2=0x7f3968069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 0x7f3968069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39841597f0 msgr2=0x7f398415c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39841597f0 0x7f398415c7d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f397400c790 tx=0x7f3974007e40 comp rx=0 tx=0).stop 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 shutdown_connections 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f398415d230 0x7f39840b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3984159420 0x7f3984154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f39680670e0 0x7f3968069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 --2- 172.21.15.86:0/1833185723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39841597f0 0x7f398415c7d0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 >> 172.21.15.86:0/1833185723 conn(0x7f39840d0660 msgr2=0x7f39840694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 shutdown_connections 2023-10-09T12:57:04.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:04.996+0000 7f398b59d700 1 -- 172.21.15.86:0/1833185723 wait complete. 2023-10-09T12:57:04.999 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 71 2023-10-09T12:57:05.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:57:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.200+0000 7fe64179d700 1 Processor -- start 2023-10-09T12:57:05.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.200+0000 7fe64179d700 1 -- start start 2023-10-09T12:57:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe64179d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe64179d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c0b2980 con 0x7fe63c1597f0 2023-10-09T12:57:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe64179d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c15dbb0 con 0x7fe63c159420 2023-10-09T12:57:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe64179d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0b11d0 con 0x7fe63c15d230 2023-10-09T12:57:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe63b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe63c1597f0 0x7fe63c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39498/0 (socket says 172.21.15.86:39498) 2023-10-09T12:57:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe63b7fe700 1 -- 172.21.15.86:0/2746634863 learned_addr learned my addr 172.21.15.86:0/2746634863 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:05.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe640f9c700 1 --2- 172.21.15.86:0/2746634863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.202+0000 7fe63affd700 1 -- 172.21.15.86:0/2746634863 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826244308 0 0) 0x7fe63c0b2980 con 0x7fe63c1597f0 2023-10-09T12:57:05.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe63affd700 1 -- 172.21.15.86:0/2746634863 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe624003570 con 0x7fe63c1597f0 2023-10-09T12:57:05.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe63affd700 1 -- 172.21.15.86:0/2746634863 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013407414 0 0) 0x7fe63c15dbb0 con 0x7fe63c159420 2023-10-09T12:57:05.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe63affd700 1 -- 172.21.15.86:0/2746634863 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe63c0b2980 con 0x7fe63c159420 2023-10-09T12:57:05.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe640f9c700 1 -- 172.21.15.86:0/2746634863 >> v1:172.21.15.135:6789/0 conn(0x7fe63c159420 legacy=0x7fe63c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe640f9c700 1 -- 172.21.15.86:0/2746634863 >> v1:172.21.15.86:6789/0 conn(0x7fe63c1597f0 legacy=0x7fe63c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe640f9c700 1 -- 172.21.15.86:0/2746634863 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0b14b0 con 0x7fe63c15d230 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe640f9c700 1 --2- 172.21.15.86:0/2746634863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c15d670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe634009e90 tx=0x7fe634009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44db3aa016946fd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe63affd700 1 -- 172.21.15.86:0/2746634863 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400e070 con 0x7fe63c15d230 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe63affd700 1 -- 172.21.15.86:0/2746634863 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63400bb80 con 0x7fe63c15d230 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.203+0000 7fe63affd700 1 -- 172.21.15.86:0/2746634863 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634012430 con 0x7fe63c15d230 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.204+0000 7fe64179d700 1 -- 172.21.15.86:0/2746634863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 msgr2=0x7fe63c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.204+0000 7fe64179d700 1 --2- 172.21.15.86:0/2746634863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c15d670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe634009e90 tx=0x7fe634009780 comp rx=0 tx=0).stop 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.204+0000 7fe64179d700 1 -- 172.21.15.86:0/2746634863 shutdown_connections 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.204+0000 7fe64179d700 1 --2- 172.21.15.86:0/2746634863 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c15d670 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.204+0000 7fe64179d700 1 -- 172.21.15.86:0/2746634863 >> 172.21.15.86:0/2746634863 conn(0x7fe63c0d0660 msgr2=0x7fe63c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:05.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.204+0000 7fe64179d700 1 -- 172.21.15.86:0/2746634863 shutdown_connections 2023-10-09T12:57:05.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.204+0000 7fe64179d700 1 -- 172.21.15.86:0/2746634863 wait complete. 2023-10-09T12:57:05.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.206+0000 7fe64179d700 1 Processor -- start 2023-10-09T12:57:05.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.206+0000 7fe64179d700 1 -- start start 2023-10-09T12:57:05.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.207+0000 7fe64179d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe63c159420 0x7fe63c16d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.207+0000 7fe64179d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe63c1597f0 0x7fe63c16d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.207+0000 7fe64179d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.207+0000 7fe64179d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c16ae60 con 0x7fe63c1597f0 2023-10-09T12:57:05.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.207+0000 7fe64179d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c16b700 con 0x7fe63c159420 2023-10-09T12:57:05.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.207+0000 7fe64179d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0b56b0 con 0x7fe63c15d230 2023-10-09T12:57:05.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe63c159420 0x7fe63c16d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe640f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe63c159420 0x7fe63c16d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:56382/0 (socket says 172.21.15.86:56382) 2023-10-09T12:57:05.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 -- 172.21.15.86:0/590871782 learned_addr learned my addr 172.21.15.86:0/590871782 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:05.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63b7fe700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe63c1597f0 0x7fe63c16d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 -- 172.21.15.86:0/590871782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 msgr2=0x7fe63c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c0b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 -- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe63c1597f0 msgr2=0x7fe63c16d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe63c1597f0 0x7fe63c16d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 -- 172.21.15.86:0/590871782 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe634009a20 con 0x7fe63c159420 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.208+0000 7fe63bfff700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe63c159420 0x7fe63c16d290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c7c0 tx=0x7fe62c007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.209+0000 7fe623fff700 1 -- 172.21.15.86:0/590871782 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0015f0 con 0x7fe63c159420 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.209+0000 7fe623fff700 1 -- 172.21.15.86:0/590871782 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c001790 con 0x7fe63c159420 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.209+0000 7fe623fff700 1 -- 172.21.15.86:0/590871782 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c001b50 con 0x7fe63c159420 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.209+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c16b0b0 con 0x7fe63c159420 2023-10-09T12:57:05.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.209+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c154d90 con 0x7fe63c159420 2023-10-09T12:57:05.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.210+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c04c3c0 con 0x7fe63c159420 2023-10-09T12:57:05.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.211+0000 7fe623fff700 1 -- 172.21.15.86:0/590871782 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe62c01b400 con 0x7fe63c159420 2023-10-09T12:57:05.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.212+0000 7fe623fff700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 0x7fe628069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.212+0000 7fe623fff700 1 -- 172.21.15.86:0/590871782 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fe62c0849b0 con 0x7fe63c159420 2023-10-09T12:57:05.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.212+0000 7fe63b7fe700 1 -- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 msgr2=0x7fe628069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:05.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.212+0000 7fe63b7fe700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 0x7fe628069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:05.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.217+0000 7fe623fff700 1 -- 172.21.15.86:0/590871782 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe62c051640 con 0x7fe63c159420 2023-10-09T12:57:05.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.413+0000 7fe63b7fe700 1 -- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 msgr2=0x7fe628069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:05.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.413+0000 7fe63b7fe700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 0x7fe628069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:05.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.422+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe63c0b1790 con 0x7fe63c159420 2023-10-09T12:57:05.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.424+0000 7fe623fff700 1 -- 172.21.15.86:0/590871782 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16464 (secure 0 0 0) 0x7fe62c054c60 con 0x7fe63c159420 2023-10-09T12:57:05.425 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:05.425 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":165,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:57:01.382656+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:56:38.265725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T12:56:39.638355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T12:57:01.382626+0000","172.21.15.86:6836/85490":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/2030851234":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/705200734":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/3854445144":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/714172173":"2023-10-10T12:57:01.382626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:57:05.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 msgr2=0x7fe628069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:05.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 0x7fe628069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe63c159420 msgr2=0x7fe63c16d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe63c159420 0x7fe63c16d290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c7c0 tx=0x7fe62c007dd0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 shutdown_connections 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe63c15d230 0x7fe63c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe63c159420 0x7fe63c16d290 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe6280670e0 0x7fe628069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 --2- 172.21.15.86:0/590871782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe63c1597f0 0x7fe63c16d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 >> 172.21.15.86:0/590871782 conn(0x7fe63c0d0660 msgr2=0x7fe63c0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 shutdown_connections 2023-10-09T12:57:05.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.426+0000 7fe64179d700 1 -- 172.21.15.86:0/590871782 wait complete. 2023-10-09T12:57:05.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T12:56:38.265725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T12:56:39.638355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T12:57:05.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T12:57:05.475 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:05.475+0000 7f01fc265180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:57:05.528 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:05.527+0000 7f172d878180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:57:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.635+0000 7f561a39d700 1 Processor -- start 2023-10-09T12:57:05.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.635+0000 7f561a39d700 1 -- start start 2023-10-09T12:57:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.636+0000 7f561a39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f56140b4e70 0x7f56140ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.636+0000 7f561a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b16d0 0x7f56140b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.636+0000 7f561a39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f561415d240 0x7f561415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.636+0000 7f561a39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140b2080 con 0x7f561415d240 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.636+0000 7f561a39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140cfb00 con 0x7f56140b4e70 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.636+0000 7f561a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140b5c40 con 0x7f56140b16d0 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f561415d240 0x7f561415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f561415d240 0x7f561415d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53816/0 (socket says 172.21.15.86:53816) 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 -- 172.21.15.86:0/867274576 learned_addr learned my addr 172.21.15.86:0/867274576 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f561939b700 1 --2- 172.21.15.86:0/867274576 >> v2:172.21.15.135:3300/0 conn(0x7f56140b4e70 0x7f56140ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5618b9a700 1 --2- 172.21.15.86:0/867274576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b16d0 0x7f56140b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 -- 172.21.15.86:0/867274576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b16d0 msgr2=0x7f56140b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 --2- 172.21.15.86:0/867274576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b16d0 0x7f56140b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 -- 172.21.15.86:0/867274576 >> v2:172.21.15.135:3300/0 conn(0x7f56140b4e70 msgr2=0x7f56140ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 --2- 172.21.15.86:0/867274576 >> v2:172.21.15.135:3300/0 conn(0x7f56140b4e70 0x7f56140ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.637+0000 7f5619b9c700 1 -- 172.21.15.86:0/867274576 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140b5f20 con 0x7f561415d240 2023-10-09T12:57:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.638+0000 7f5619b9c700 1 --2- 172.21.15.86:0/867274576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415d6c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5614064910 tx=0x7f560c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae3827bb18b9644 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:05.640 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:05.638+0000 7f01fc265180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:05.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.638+0000 7f560bfff700 1 -- 172.21.15.86:0/867274576 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c00e070 con 0x7f561415d240 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.638+0000 7f560bfff700 1 -- 172.21.15.86:0/867274576 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c00b970 con 0x7f561415d240 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.638+0000 7f560bfff700 1 -- 172.21.15.86:0/867274576 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0092e0 con 0x7f561415d240 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.638+0000 7f561a39d700 1 -- 172.21.15.86:0/867274576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 msgr2=0x7f561415d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.638+0000 7f561a39d700 1 --2- 172.21.15.86:0/867274576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415d6c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5614064910 tx=0x7f560c009840 comp rx=0 tx=0).stop 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.639+0000 7f561a39d700 1 -- 172.21.15.86:0/867274576 shutdown_connections 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.639+0000 7f561a39d700 1 --2- 172.21.15.86:0/867274576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415d6c0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.639+0000 7f561a39d700 1 --2- 172.21.15.86:0/867274576 >> v2:172.21.15.135:3300/0 conn(0x7f56140b4e70 0x7f56140ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.639+0000 7f561a39d700 1 --2- 172.21.15.86:0/867274576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b16d0 0x7f56140b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.639+0000 7f561a39d700 1 -- 172.21.15.86:0/867274576 >> 172.21.15.86:0/867274576 conn(0x7f56140d10c0 msgr2=0x7f56140affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:05.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.639+0000 7f561a39d700 1 -- 172.21.15.86:0/867274576 shutdown_connections 2023-10-09T12:57:05.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.639+0000 7f561a39d700 1 -- 172.21.15.86:0/867274576 wait complete. 2023-10-09T12:57:05.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.640+0000 7f561a39d700 1 Processor -- start 2023-10-09T12:57:05.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.640+0000 7f561a39d700 1 -- start start 2023-10-09T12:57:05.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f561a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56140b16d0 0x7f56141471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f561a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b4e70 0x7f561415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f561a39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f561a39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140cae90 con 0x7f561415d240 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f561a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140ca280 con 0x7f56140b16d0 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f561a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140ca560 con 0x7f56140b4e70 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f5619b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f5619b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53818/0 (socket says 172.21.15.86:53818) 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f5619b9c700 1 -- 172.21.15.86:0/3166655934 learned_addr learned my addr 172.21.15.86:0/3166655934 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f561939b700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56140b16d0 0x7f56141471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.641+0000 7f5618b9a700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b4e70 0x7f561415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f5619b9c700 1 -- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b4e70 msgr2=0x7f561415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f5619b9c700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b4e70 0x7f561415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f5619b9c700 1 -- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56140b16d0 msgr2=0x7f56141471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f5619b9c700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56140b16d0 0x7f56141471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f5619b9c700 1 -- 172.21.15.86:0/3166655934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c009ae0 con 0x7f561415d240 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f5619b9c700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415be60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5614070dd0 tx=0x7f560c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f56097fa700 1 -- 172.21.15.86:0/3166655934 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c008ad0 con 0x7f561415d240 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f56097fa700 1 -- 172.21.15.86:0/3166655934 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c008c50 con 0x7f561415d240 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56140ca840 con 0x7f561415d240 2023-10-09T12:57:05.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f56097fa700 1 -- 172.21.15.86:0/3166655934 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c025460 con 0x7f561415d240 2023-10-09T12:57:05.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.642+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5614147b80 con 0x7f561415d240 2023-10-09T12:57:05.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.644+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614088990 con 0x7f561415d240 2023-10-09T12:57:05.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.644+0000 7f56097fa700 1 -- 172.21.15.86:0/3166655934 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f560c003040 con 0x7f561415d240 2023-10-09T12:57:05.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.646+0000 7f56097fa700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 0x7f55f8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.646+0000 7f561939b700 1 -- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 msgr2=0x7f55f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.646+0000 7f56097fa700 1 -- 172.21.15.86:0/3166655934 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f560c086060 con 0x7f561415d240 2023-10-09T12:57:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.646+0000 7f561939b700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 0x7f55f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:05.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.650+0000 7f56097fa700 1 -- 172.21.15.86:0/3166655934 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f560c052c90 con 0x7f561415d240 2023-10-09T12:57:05.708 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:05.707+0000 7f172d878180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:05.724 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:05.724+0000 7f01fc265180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:57:05.796 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:05.795+0000 7f172d878180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:57:05.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.847+0000 7f561939b700 1 -- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 msgr2=0x7f55f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:05.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.847+0000 7f561939b700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 0x7f55f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:05.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.859+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56140cafd0 con 0x7f561415d240 2023-10-09T12:57:05.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.859+0000 7f56097fa700 1 -- 172.21.15.86:0/3166655934 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7f560c0562b0 con 0x7f561415d240 2023-10-09T12:57:05.860 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T12:57:05.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 msgr2=0x7f55f8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:05.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 0x7f55f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 msgr2=0x7f561415be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415be60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5614070dd0 tx=0x7f560c018000 comp rx=0 tx=0).stop 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 shutdown_connections 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f55f80670e0 0x7f55f8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561415d240 0x7f561415be60 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56140b16d0 0x7f56141471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 --2- 172.21.15.86:0/3166655934 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56140b4e70 0x7f561415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 >> 172.21.15.86:0/3166655934 conn(0x7f56140d10c0 msgr2=0x7f5614159060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 shutdown_connections 2023-10-09T12:57:05.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:05.862+0000 7f561a39d700 1 -- 172.21.15.86:0/3166655934 wait complete. 2023-10-09T12:57:05.891 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T12:57:05.949 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:05.949+0000 7f01fc265180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:06.035 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:06.034+0000 7f172d878180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:06.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.079+0000 7f5edf19d700 1 Processor -- start 2023-10-09T12:57:06.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.079+0000 7f5edf19d700 1 -- start start 2023-10-09T12:57:06.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.080+0000 7f5edf19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5ed8159a60 0x7f5ed80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.080+0000 7f5edf19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ed80ccc00 0x7f5ed8069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.080+0000 7f5edf19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.080+0000 7f5edf19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed806dfc0 con 0x7f5ed80ccc00 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.080+0000 7f5edf19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed80c9cb0 con 0x7f5ed8159a60 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.080+0000 7f5edf19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80c9f30 con 0x7f5ed806a020 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ed80ccc00 0x7f5ed8069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ed80ccc00 0x7f5ed8069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53826/0 (socket says 172.21.15.86:53826) 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 -- 172.21.15.86:0/3385066532 learned_addr learned my addr 172.21.15.86:0/3385066532 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5ede99c700 1 --2- 172.21.15.86:0/3385066532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5ede19b700 1 --2- 172.21.15.86:0/3385066532 >> v2:172.21.15.135:3300/0 conn(0x7f5ed8159a60 0x7f5ed80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 -- 172.21.15.86:0/3385066532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 msgr2=0x7f5ed80cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 --2- 172.21.15.86:0/3385066532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed80cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 -- 172.21.15.86:0/3385066532 >> v2:172.21.15.135:3300/0 conn(0x7f5ed8159a60 msgr2=0x7f5ed80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 --2- 172.21.15.86:0/3385066532 >> v2:172.21.15.135:3300/0 conn(0x7f5ed8159a60 0x7f5ed80c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 -- 172.21.15.86:0/3385066532 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80ca470 con 0x7f5ed80ccc00 2023-10-09T12:57:06.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.081+0000 7f5edd99a700 1 --2- 172.21.15.86:0/3385066532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed80ccc00 0x7f5ed8069ae0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806e510 tx=0x7f5ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafbfdd9dfc1b230 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edd199700 1 -- 172.21.15.86:0/3385066532 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800b6d0 con 0x7f5ed80ccc00 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edd199700 1 -- 172.21.15.86:0/3385066532 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec800b830 con 0x7f5ed80ccc00 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edd199700 1 -- 172.21.15.86:0/3385066532 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800bbf0 con 0x7f5ed80ccc00 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 -- 172.21.15.86:0/3385066532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed80ccc00 msgr2=0x7f5ed8069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 --2- 172.21.15.86:0/3385066532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed80ccc00 0x7f5ed8069ae0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806e510 tx=0x7f5ec8009250 comp rx=0 tx=0).stop 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 -- 172.21.15.86:0/3385066532 shutdown_connections 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 --2- 172.21.15.86:0/3385066532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 --2- 172.21.15.86:0/3385066532 >> v2:172.21.15.135:3300/0 conn(0x7f5ed8159a60 0x7f5ed80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 --2- 172.21.15.86:0/3385066532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed80ccc00 0x7f5ed8069ae0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 -- 172.21.15.86:0/3385066532 >> 172.21.15.86:0/3385066532 conn(0x7f5ed806baa0 msgr2=0x7f5ed806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:06.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.082+0000 7f5edf19d700 1 -- 172.21.15.86:0/3385066532 shutdown_connections 2023-10-09T12:57:06.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.083+0000 7f5edf19d700 1 -- 172.21.15.86:0/3385066532 wait complete. 2023-10-09T12:57:06.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.084+0000 7f5edf19d700 1 Processor -- start 2023-10-09T12:57:06.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.084+0000 7f5edf19d700 1 -- start start 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5edf19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed81553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5edf19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed80ccc00 0x7f5ed80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5edf19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8159a60 0x7f5ed8152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5edf19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8155c20 con 0x7f5ed8159a60 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5edf19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80c6210 con 0x7f5ed80ccc00 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5edf19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80c58e0 con 0x7f5ed806a020 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5ede99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8159a60 0x7f5ed8152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5ede99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8159a60 0x7f5ed8152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53840/0 (socket says 172.21.15.86:53840) 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5ede99c700 1 -- 172.21.15.86:0/2640124822 learned_addr learned my addr 172.21.15.86:0/2640124822 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5ede19b700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed81553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.085+0000 7f5edd99a700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed80ccc00 0x7f5ed80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ede99c700 1 -- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 msgr2=0x7f5ed81553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ede99c700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed81553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ede99c700 1 -- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed80ccc00 msgr2=0x7f5ed80b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ede99c700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed80ccc00 0x7f5ed80b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ede99c700 1 -- 172.21.15.86:0/2640124822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec80094f0 con 0x7f5ed8159a60 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ede99c700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8159a60 0x7f5ed8152bf0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000ea50 tx=0x7f5ed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ece7fc700 1 -- 172.21.15.86:0/2640124822 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00096b0 con 0x7f5ed8159a60 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ece7fc700 1 -- 172.21.15.86:0/2640124822 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000c850 con 0x7f5ed8159a60 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5ece7fc700 1 -- 172.21.15.86:0/2640124822 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000cc10 con 0x7f5ed8159a60 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed80c5bc0 con 0x7f5ed8159a60 2023-10-09T12:57:06.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.086+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed8155930 con 0x7f5ed8159a60 2023-10-09T12:57:06.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.087+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed80ca130 con 0x7f5ed8159a60 2023-10-09T12:57:06.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.089+0000 7f5ece7fc700 1 -- 172.21.15.86:0/2640124822 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5ed0013470 con 0x7f5ed8159a60 2023-10-09T12:57:06.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.090+0000 7f5ece7fc700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 0x7f5ebc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.090+0000 7f5ece7fc700 1 -- 172.21.15.86:0/2640124822 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f5ed0084ca0 con 0x7f5ed8159a60 2023-10-09T12:57:06.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.090+0000 7f5ede19b700 1 -- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 msgr2=0x7f5ebc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:06.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.090+0000 7f5ede19b700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 0x7f5ebc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:06.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.094+0000 7f5ece7fc700 1 -- 172.21.15.86:0/2640124822 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ed00519d0 con 0x7f5ed8159a60 2023-10-09T12:57:06.127 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:06.127+0000 7f01fc265180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:57:06.218 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:06.218+0000 7f01fc265180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:57:06.220 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:06.219+0000 7f172d878180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:57:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.291+0000 7f5ede19b700 1 -- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 msgr2=0x7f5ebc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.291+0000 7f5ede19b700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 0x7f5ebc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:06.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.294+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ed80ca750 con 0x7f5ed8159a60 2023-10-09T12:57:06.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.295+0000 7f5ece7fc700 1 -- 172.21.15.86:0/2640124822 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v165) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ed0054ff0 con 0x7f5ed8159a60 2023-10-09T12:57:06.296 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 msgr2=0x7f5ebc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 0x7f5ebc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8159a60 msgr2=0x7f5ed8152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8159a60 0x7f5ed8152bf0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000ea50 tx=0x7f5ed00091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 shutdown_connections 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ebc0670e0 0x7f5ebc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8159a60 0x7f5ed8152bf0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ed806a020 0x7f5ed81553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 --2- 172.21.15.86:0/2640124822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed80ccc00 0x7f5ed80b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 >> 172.21.15.86:0/2640124822 conn(0x7f5ed806baa0 msgr2=0x7f5ed80cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:06.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 shutdown_connections 2023-10-09T12:57:06.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.297+0000 7f5edf19d700 1 -- 172.21.15.86:0/2640124822 wait complete. 2023-10-09T12:57:06.315 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:06.314+0000 7f172d878180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:57:06.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T12:57:06.379 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:06.379+0000 7f01fc265180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:57:06.481 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:06.481+0000 7f01fc265180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:06.486 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:06.486+0000 7f172d878180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:57:06.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.508+0000 7f3fa09fe700 1 Processor -- start 2023-10-09T12:57:06.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.508+0000 7f3fa09fe700 1 -- start start 2023-10-09T12:57:06.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.509+0000 7f3fa09fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3f9c0b4e70 0x7f3f9c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.509+0000 7f3fa09fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b1b40 0x7f3f9c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.509+0000 7f3fa09fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c0cfb00 con 0x7f3f9c0b16d0 2023-10-09T12:57:06.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.509+0000 7f3fa09fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9c0b5c40 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.509+0000 7f3fa09fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0b5f20 con 0x7f3f9c0b1b40 2023-10-09T12:57:06.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.509+0000 7f3f9a59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3f9c0b16d0 0x7f3f9c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39512/0 (socket says 172.21.15.86:39512) 2023-10-09T12:57:06.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.509+0000 7f3f9a59c700 1 -- 172.21.15.86:0/4245975839 learned_addr learned my addr 172.21.15.86:0/4245975839 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:06.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9ad9d700 1 --2- 172.21.15.86:0/4245975839 >> v2:172.21.15.135:3300/0 conn(0x7f3f9c0b4e70 0x7f3f9c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9b59e700 1 --2- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b1b40 0x7f3f9c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f99d9b700 1 -- 172.21.15.86:0/4245975839 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182669399 0 0) 0x7f3f9c0cfb00 con 0x7f3f9c0b16d0 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f99d9b700 1 -- 172.21.15.86:0/4245975839 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f84003570 con 0x7f3f9c0b16d0 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9ad9d700 1 -- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b1b40 msgr2=0x7f3f9c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9ad9d700 1 --2- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b1b40 0x7f3f9c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9ad9d700 1 -- 172.21.15.86:0/4245975839 >> v1:172.21.15.86:6789/0 conn(0x7f3f9c0b16d0 legacy=0x7f3f9c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9ad9d700 1 -- 172.21.15.86:0/4245975839 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0b6200 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9b59e700 1 --2- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b1b40 0x7f3f9c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:06.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.510+0000 7f3f9ad9d700 1 --2- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0ccff0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0098e0 tx=0x7f3f8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb4213f5115384cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3f99d9b700 1 -- 172.21.15.86:0/4245975839 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c011630 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3f99d9b700 1 -- 172.21.15.86:0/4245975839 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c011790 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3f99d9b700 1 -- 172.21.15.86:0/4245975839 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c011b30 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 -- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b4e70 msgr2=0x7f3f9c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0ccff0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0098e0 tx=0x7f3f8c0091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 -- 172.21.15.86:0/4245975839 shutdown_connections 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b1b40 0x7f3f9c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/4245975839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0ccff0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 -- 172.21.15.86:0/4245975839 >> 172.21.15.86:0/4245975839 conn(0x7f3f9c0d10c0 msgr2=0x7f3f9c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:06.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 -- 172.21.15.86:0/4245975839 shutdown_connections 2023-10-09T12:57:06.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.511+0000 7f3fa09fe700 1 -- 172.21.15.86:0/4245975839 wait complete. 2023-10-09T12:57:06.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.513+0000 7f3fa09fe700 1 Processor -- start 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.513+0000 7f3fa09fe700 1 -- start start 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3fa09fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b16d0 0x7f3f9c15be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3fa09fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b1b40 0x7f3f9c0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3fa09fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3fa09fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c7ae0 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3fa09fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c6ed0 con 0x7f3f9c0b1b40 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3fa09fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c71b0 con 0x7f3f9c0b16d0 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53850/0 (socket says 172.21.15.86:53850) 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 -- 172.21.15.86:0/5170689 learned_addr learned my addr 172.21.15.86:0/5170689 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9ad9d700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b16d0 0x7f3f9c15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9a59c700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b1b40 0x7f3f9c0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 -- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b16d0 msgr2=0x7f3f9c15be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b16d0 0x7f3f9c15be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 -- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b1b40 msgr2=0x7f3f9c0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b1b40 0x7f3f9c0c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.514+0000 7f3f9b59e700 1 -- 172.21.15.86:0/5170689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94009a20 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.515+0000 7f3f9b59e700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0c9ce0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009fc0 tx=0x7f3f9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:06.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.515+0000 7f3f82ffd700 1 -- 172.21.15.86:0/5170689 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400cbd0 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.515+0000 7f3f82ffd700 1 -- 172.21.15.86:0/5170689 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400f040 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.515+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c009420 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.515+0000 7f3f82ffd700 1 -- 172.21.15.86:0/5170689 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94014480 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.515+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c0c7770 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.516+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c088990 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.517+0000 7f3f82ffd700 1 -- 172.21.15.86:0/5170689 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f3f94003020 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.518+0000 7f3f82ffd700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 0x7f3f88069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.518+0000 7f3f82ffd700 1 -- 172.21.15.86:0/5170689 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f3f940856c0 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.518+0000 7f3f9ad9d700 1 -- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 msgr2=0x7f3f88069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:06.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.518+0000 7f3f9ad9d700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 0x7f3f88069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:06.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.526+0000 7f3f82ffd700 1 -- 172.21.15.86:0/5170689 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f94052240 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.595 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:06.595+0000 7f172d878180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:06.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.719+0000 7f3f9ad9d700 1 -- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 msgr2=0x7f3f88069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:06.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.719+0000 7f3f9ad9d700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 0x7f3f88069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:06.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.723+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f9c0c7c20 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.724+0000 7f3f82ffd700 1 -- 172.21.15.86:0/5170689 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v165) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f94055860 con 0x7f3f9c0b4e70 2023-10-09T12:57:06.725 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T12:57:06.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 msgr2=0x7f3f88069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:06.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 0x7f3f88069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f9c0b4e70 msgr2=0x7f3f9c0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0c9ce0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009fc0 tx=0x7f3f9400b040 comp rx=0 tx=0).stop 2023-10-09T12:57:06.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 shutdown_connections 2023-10-09T12:57:06.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f3f880670e0 0x7f3f88069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f9c0b4e70 0x7f3f9c0c9ce0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f9c0b16d0 0x7f3f9c15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 --2- 172.21.15.86:0/5170689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f9c0b1b40 0x7f3f9c0c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.726+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 >> 172.21.15.86:0/5170689 conn(0x7f3f9c0d10c0 msgr2=0x7f3f9c158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:06.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.727+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 shutdown_connections 2023-10-09T12:57:06.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.727+0000 7f3fa09fe700 1 -- 172.21.15.86:0/5170689 wait complete. 2023-10-09T12:57:06.747 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:57:06.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.932+0000 7faf98b9d700 1 Processor -- start 2023-10-09T12:57:06.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.933+0000 7faf98b9d700 1 -- start start 2023-10-09T12:57:06.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf98b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faf941597f0 0x7faf940b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf98b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf9415d230 0x7faf9415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf98b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9415db70 con 0x7faf94159420 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf98b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940b11d0 con 0x7faf9415d230 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf98b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940b14b0 con 0x7faf941597f0 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf937fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7faf94159420 0x7faf940b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39514/0 (socket says 172.21.15.86:39514) 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf937fe700 1 -- 172.21.15.86:0/31764748 learned_addr learned my addr 172.21.15.86:0/31764748 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf93fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf9415d230 0x7faf9415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.934+0000 7faf92ffd700 1 --2- 172.21.15.86:0/31764748 >> v2:172.21.15.135:3300/0 conn(0x7faf941597f0 0x7faf940b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf927fc700 1 -- 172.21.15.86:0/31764748 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359156601 0 0) 0x7faf9415db70 con 0x7faf94159420 2023-10-09T12:57:06.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf927fc700 1 -- 172.21.15.86:0/31764748 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf7c003570 con 0x7faf94159420 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf93fff700 1 -- 172.21.15.86:0/31764748 >> v2:172.21.15.135:3300/0 conn(0x7faf941597f0 msgr2=0x7faf940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf93fff700 1 --2- 172.21.15.86:0/31764748 >> v2:172.21.15.135:3300/0 conn(0x7faf941597f0 0x7faf940b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf93fff700 1 -- 172.21.15.86:0/31764748 >> v1:172.21.15.86:6789/0 conn(0x7faf94159420 legacy=0x7faf940b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf93fff700 1 -- 172.21.15.86:0/31764748 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf940b1790 con 0x7faf9415d230 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf92ffd700 1 --2- 172.21.15.86:0/31764748 >> v2:172.21.15.135:3300/0 conn(0x7faf941597f0 0x7faf940b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf93fff700 1 --2- 172.21.15.86:0/31764748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf9415d230 0x7faf9415d630 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7faf94089750 tx=0x7faf8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63dfadf454add338 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf927fc700 1 -- 172.21.15.86:0/31764748 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c00e070 con 0x7faf9415d230 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf927fc700 1 -- 172.21.15.86:0/31764748 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c00bab0 con 0x7faf9415d230 2023-10-09T12:57:06.938 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.935+0000 7faf927fc700 1 -- 172.21.15.86:0/31764748 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c00be70 con 0x7faf9415d230 2023-10-09T12:57:06.940 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 -- 172.21.15.86:0/31764748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf9415d230 msgr2=0x7faf9415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 --2- 172.21.15.86:0/31764748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf9415d230 0x7faf9415d630 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7faf94089750 tx=0x7faf8c009780 comp rx=0 tx=0).stop 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 -- 172.21.15.86:0/31764748 shutdown_connections 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 --2- 172.21.15.86:0/31764748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf9415d230 0x7faf9415d630 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 --2- 172.21.15.86:0/31764748 >> v2:172.21.15.135:3300/0 conn(0x7faf941597f0 0x7faf940b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 -- 172.21.15.86:0/31764748 >> 172.21.15.86:0/31764748 conn(0x7faf940d0660 msgr2=0x7faf940d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 -- 172.21.15.86:0/31764748 shutdown_connections 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.936+0000 7faf98b9d700 1 -- 172.21.15.86:0/31764748 wait complete. 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.938+0000 7faf98b9d700 1 Processor -- start 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.938+0000 7faf98b9d700 1 -- start start 2023-10-09T12:57:06.941 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf98b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf94159420 0x7faf9415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf98b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf941597f0 0x7faf9416cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf98b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf9415d230 0x7faf94156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf98b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9416db80 con 0x7faf94159420 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf98b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940c6db0 con 0x7faf9415d230 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf98b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9416d2e0 con 0x7faf941597f0 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf94159420 0x7faf9415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf94159420 0x7faf9415b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53868/0 (socket says 172.21.15.86:53868) 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 -- 172.21.15.86:0/1866071877 learned_addr learned my addr 172.21.15.86:0/1866071877 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:06.942 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf93fff700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf9415d230 0x7faf94156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf92ffd700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf941597f0 0x7faf9416cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:06.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 -- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf941597f0 msgr2=0x7faf9416cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf941597f0 0x7faf9416cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 -- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf9415d230 msgr2=0x7faf94156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:06.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf9415d230 0x7faf94156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:06.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.939+0000 7faf937fe700 1 -- 172.21.15.86:0/1866071877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf88009420 con 0x7faf94159420 2023-10-09T12:57:06.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.940+0000 7faf937fe700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf94159420 0x7faf9415b630 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c7c0 tx=0x7faf84007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:06.944 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.940+0000 7faf7b7fe700 1 -- 172.21.15.86:0/1866071877 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84005cd0 con 0x7faf94159420 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.940+0000 7faf7b7fe700 1 -- 172.21.15.86:0/1866071877 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84005e30 con 0x7faf94159420 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.940+0000 7faf7b7fe700 1 -- 172.21.15.86:0/1866071877 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84007320 con 0x7faf94159420 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.940+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c009a20 con 0x7faf94159420 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.940+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9416d8a0 con 0x7faf94159420 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.941+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf940c6b80 con 0x7faf94159420 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.942+0000 7faf7b7fe700 1 -- 172.21.15.86:0/1866071877 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7faf8401b3b0 con 0x7faf94159420 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.943+0000 7faf7b7fe700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 0x7faf80069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:06.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.943+0000 7faf7b7fe700 1 -- 172.21.15.86:0/1866071877 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7faf84084220 con 0x7faf94159420 2023-10-09T12:57:06.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.943+0000 7faf92ffd700 1 -- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 msgr2=0x7faf80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:06.946 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.943+0000 7faf92ffd700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 0x7faf80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:06.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:06.951+0000 7faf7b7fe700 1 -- 172.21.15.86:0/1866071877 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf940c6b80 con 0x7faf94159420 2023-10-09T12:57:06.963 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:06.963+0000 7f01fc265180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:57:07.056 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:07.056+0000 7f01fc265180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:57:07.102 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:07.101+0000 7f172d878180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:57:07.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.144+0000 7faf92ffd700 1 -- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 msgr2=0x7faf80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:07.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.144+0000 7faf92ffd700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 0x7faf80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:07.146 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:07.146+0000 7f01fc265180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:57:07.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.193+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf940c6b80 con 0x7faf94159420 2023-10-09T12:57:07.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.194+0000 7faf7b7fe700 1 -- 172.21.15.86:0/1866071877 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4602 (secure 0 0 0) 0x7faf940c6b80 con 0x7faf94159420 2023-10-09T12:57:07.195 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:07.195 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/2700721489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2700721489},{"type":"v1","addr":"172.21.15.135:6834","nonce":2700721489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1754968847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1754968847},{"type":"v1","addr":"172.21.15.135:6835","nonce":1754968847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/885619835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":885619835},{"type":"v1","addr":"172.21.15.86:6834","nonce":885619835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:56:40.649653+0000","modified":"2023-10-09T12:56:44.211663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8580":{"gid":8580,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3313043174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":3313043174},{"type":"v1","addr":"172.21.15.86:6835","nonce":3313043174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 msgr2=0x7faf80069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 0x7faf80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf94159420 msgr2=0x7faf9415b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf94159420 0x7faf9415b630 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c7c0 tx=0x7faf84007e00 comp rx=0 tx=0).stop 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 shutdown_connections 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7faf800670e0 0x7faf80069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf94159420 0x7faf9415b630 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf9415d230 0x7faf94156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.196+0000 7faf98b9d700 1 --2- 172.21.15.86:0/1866071877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf941597f0 0x7faf9416cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.197+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 >> 172.21.15.86:0/1866071877 conn(0x7faf940d0660 msgr2=0x7faf94068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:07.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.197+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 shutdown_connections 2023-10-09T12:57:07.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.197+0000 7faf98b9d700 1 -- 172.21.15.86:0/1866071877 wait complete. 2023-10-09T12:57:07.201 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 71 2023-10-09T12:57:07.202 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:07.198+0000 7f172d878180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:57:07.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:57:07.297 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:07.296+0000 7f172d878180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:57:07.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.401+0000 7f297359e700 1 Processor -- start 2023-10-09T12:57:07.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.402+0000 7f297359e700 1 -- start start 2023-10-09T12:57:07.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f297359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f29740b1e50 0x7f2974159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f297359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29740ceaa0 0x7f29740b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f297359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29740b6570 con 0x7f29741593b0 2023-10-09T12:57:07.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f297359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29740cfe20 con 0x7f29740ceaa0 2023-10-09T12:57:07.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f297359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29740cf210 con 0x7f29740b1e50 2023-10-09T12:57:07.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f2972d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29740ceaa0 0x7f29740b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f297259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f29741593b0 0x7f29740b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39520/0 (socket says 172.21.15.86:39520) 2023-10-09T12:57:07.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f297259c700 1 -- 172.21.15.86:0/1523309171 learned_addr learned my addr 172.21.15.86:0/1523309171 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:07.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.403+0000 7f2971d9b700 1 --2- 172.21.15.86:0/1523309171 >> v2:172.21.15.135:3300/0 conn(0x7f29740b1e50 0x7f2974159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f297159a700 1 -- 172.21.15.86:0/1523309171 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113042704 0 0) 0x7f2964001110 con 0x7f29741593b0 2023-10-09T12:57:07.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f2972d9d700 1 -- 172.21.15.86:0/1523309171 >> v2:172.21.15.135:3300/0 conn(0x7f29740b1e50 msgr2=0x7f2974159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:07.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f2972d9d700 1 --2- 172.21.15.86:0/1523309171 >> v2:172.21.15.135:3300/0 conn(0x7f29740b1e50 0x7f2974159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f2972d9d700 1 -- 172.21.15.86:0/1523309171 >> v1:172.21.15.86:6789/0 conn(0x7f29741593b0 legacy=0x7f29740b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f2972d9d700 1 -- 172.21.15.86:0/1523309171 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740cf4f0 con 0x7f29740ceaa0 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f2972d9d700 1 --2- 172.21.15.86:0/1523309171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29740ceaa0 0x7f29740b6030 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f29740b2d90 tx=0x7f296c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3536499e295ddb8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f297159a700 1 -- 172.21.15.86:0/1523309171 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00e070 con 0x7f29740ceaa0 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f297159a700 1 -- 172.21.15.86:0/1523309171 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c00bb60 con 0x7f29740ceaa0 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.404+0000 7f297159a700 1 -- 172.21.15.86:0/1523309171 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c012430 con 0x7f29740ceaa0 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 -- 172.21.15.86:0/1523309171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29740ceaa0 msgr2=0x7f29740b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 --2- 172.21.15.86:0/1523309171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29740ceaa0 0x7f29740b6030 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f29740b2d90 tx=0x7f296c009780 comp rx=0 tx=0).stop 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 -- 172.21.15.86:0/1523309171 shutdown_connections 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 --2- 172.21.15.86:0/1523309171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29740ceaa0 0x7f29740b6030 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 --2- 172.21.15.86:0/1523309171 >> v2:172.21.15.135:3300/0 conn(0x7f29740b1e50 0x7f2974159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.407 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 -- 172.21.15.86:0/1523309171 >> 172.21.15.86:0/1523309171 conn(0x7f29740d1130 msgr2=0x7f29740b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:07.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 -- 172.21.15.86:0/1523309171 shutdown_connections 2023-10-09T12:57:07.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.405+0000 7f297359e700 1 -- 172.21.15.86:0/1523309171 wait complete. 2023-10-09T12:57:07.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.406+0000 7f297359e700 1 Processor -- start 2023-10-09T12:57:07.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.406+0000 7f297359e700 1 -- start start 2023-10-09T12:57:07.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.407+0000 7f297359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29740b1e50 0x7f2974142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.407+0000 7f297359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29740ceaa0 0x7f2974150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.407+0000 7f297359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29741593b0 0x7f2974150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.407+0000 7f297359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974152a90 con 0x7f29741593b0 2023-10-09T12:57:07.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.407+0000 7f297359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974152160 con 0x7f29740b1e50 2023-10-09T12:57:07.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.407+0000 7f297359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2974152440 con 0x7f29740ceaa0 2023-10-09T12:57:07.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2971d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29740ceaa0 0x7f2974150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2972d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29741593b0 0x7f2974150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2971d9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29740ceaa0 0x7f2974150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:39502/0 (socket says 172.21.15.86:39502) 2023-10-09T12:57:07.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2971d9b700 1 -- 172.21.15.86:0/1206216355 learned_addr learned my addr 172.21.15.86:0/1206216355 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:07.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f297259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29740b1e50 0x7f2974142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2972d9d700 1 -- 172.21.15.86:0/1206216355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29740ceaa0 msgr2=0x7f2974150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2972d9d700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29740ceaa0 0x7f2974150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2972d9d700 1 -- 172.21.15.86:0/1206216355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29740b1e50 msgr2=0x7f2974142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2972d9d700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29740b1e50 0x7f2974142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f2972d9d700 1 -- 172.21.15.86:0/1206216355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c009a20 con 0x7f29741593b0 2023-10-09T12:57:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.408+0000 7f297259c700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29740b1e50 0x7f2974142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:07.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.409+0000 7f2972d9d700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29741593b0 0x7f2974150eb0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f296c016000 tx=0x7f296c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.410+0000 7f29627fc700 1 -- 172.21.15.86:0/1206216355 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c027470 con 0x7f29741593b0 2023-10-09T12:57:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.410+0000 7f29627fc700 1 -- 172.21.15.86:0/1206216355 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c027610 con 0x7f29741593b0 2023-10-09T12:57:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.410+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2974152720 con 0x7f29741593b0 2023-10-09T12:57:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.410+0000 7f29627fc700 1 -- 172.21.15.86:0/1206216355 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c0279d0 con 0x7f29741593b0 2023-10-09T12:57:07.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.411+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297416a9a0 con 0x7f29741593b0 2023-10-09T12:57:07.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.412+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297416ab90 con 0x7f29741593b0 2023-10-09T12:57:07.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.412+0000 7f29627fc700 1 -- 172.21.15.86:0/1206216355 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f296c024070 con 0x7f29741593b0 2023-10-09T12:57:07.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.413+0000 7f29627fc700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 0x7f2954069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.413+0000 7f29627fc700 1 -- 172.21.15.86:0/1206216355 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f296c087250 con 0x7f29741593b0 2023-10-09T12:57:07.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.413+0000 7f297259c700 1 -- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 msgr2=0x7f2954069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:07.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.413+0000 7f297259c700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 0x7f2954069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:07.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.421+0000 7f29627fc700 1 -- 172.21.15.86:0/1206216355 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f296c053ee0 con 0x7f29741593b0 2023-10-09T12:57:07.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.614+0000 7f297259c700 1 -- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 msgr2=0x7f2954069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:07.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.614+0000 7f297259c700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 0x7f2954069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:07.621 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.621+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f297404bb80 con 0x7f29741593b0 2023-10-09T12:57:07.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.622+0000 7f29627fc700 1 -- 172.21.15.86:0/1206216355 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16464 (secure 0 0 0) 0x7f296c057500 con 0x7f29741593b0 2023-10-09T12:57:07.623 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:07.624 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":165,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:57:01.382656+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:56:38.265725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T12:56:39.638355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T12:57:01.382626+0000","172.21.15.86:6836/85490":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/2030851234":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/705200734":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/3854445144":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/714172173":"2023-10-10T12:57:01.382626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 msgr2=0x7f2954069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 0x7f2954069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29741593b0 msgr2=0x7f2974150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29741593b0 0x7f2974150eb0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f296c016000 tx=0x7f296c019000 comp rx=0 tx=0).stop 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 shutdown_connections 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f29540670e0 0x7f2954069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29741593b0 0x7f2974150eb0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29740b1e50 0x7f2974142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 --2- 172.21.15.86:0/1206216355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29740ceaa0 0x7f2974150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.624+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 >> 172.21.15.86:0/1206216355 conn(0x7f29740d1130 msgr2=0x7f29740af120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:07.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.625+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 shutdown_connections 2023-10-09T12:57:07.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.625+0000 7f297359e700 1 -- 172.21.15.86:0/1206216355 wait complete. 2023-10-09T12:57:07.644 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T12:57:07.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:57:07.768 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:07.768+0000 7f01fc265180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:57:07.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.841+0000 7fa62739d700 1 Processor -- start 2023-10-09T12:57:07.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.841+0000 7fa62739d700 1 -- start start 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa62739d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa6200872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa62739d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa620087830 0x7fa620170040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa62739d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa620069cd0 con 0x7fa620166530 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa62739d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200c76d0 con 0x7fa620087830 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa62739d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa620166900 con 0x7fa6200c7260 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa625b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa6200872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa625b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa6200872f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:39512/0 (socket says 172.21.15.86:39512) 2023-10-09T12:57:07.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa625b9a700 1 -- 172.21.15.86:0/3304629020 learned_addr learned my addr 172.21.15.86:0/3304629020 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:07.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.843+0000 7fa62639b700 1 --1- 172.21.15.86:0/3304629020 >> v1:172.21.15.86:6789/0 conn(0x7fa620166530 0x7fa6200caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39522/0 (socket says 172.21.15.86:39522) 2023-10-09T12:57:07.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.844+0000 7fa626b9c700 1 --2- 172.21.15.86:0/3304629020 >> v2:172.21.15.135:3300/0 conn(0x7fa620087830 0x7fa620170040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.844+0000 7fa625b9a700 1 -- 172.21.15.86:0/3304629020 >> v2:172.21.15.135:3300/0 conn(0x7fa620087830 msgr2=0x7fa620170040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:07.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.844+0000 7fa625b9a700 1 --2- 172.21.15.86:0/3304629020 >> v2:172.21.15.135:3300/0 conn(0x7fa620087830 0x7fa620170040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.844+0000 7fa625b9a700 1 -- 172.21.15.86:0/3304629020 >> v1:172.21.15.86:6789/0 conn(0x7fa620166530 legacy=0x7fa6200caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.844+0000 7fa625b9a700 1 -- 172.21.15.86:0/3304629020 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620087c70 con 0x7fa6200c7260 2023-10-09T12:57:07.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.844+0000 7fa626b9c700 1 --2- 172.21.15.86:0/3304629020 >> v2:172.21.15.135:3300/0 conn(0x7fa620087830 0x7fa620170040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:07.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.844+0000 7fa625b9a700 1 --2- 172.21.15.86:0/3304629020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa6200872f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa610007740 tx=0x7fa61000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5157045b8a636efb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:07.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.845+0000 7fa625399700 1 -- 172.21.15.86:0/3304629020 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000a960 con 0x7fa6200c7260 2023-10-09T12:57:07.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.845+0000 7fa625399700 1 -- 172.21.15.86:0/3304629020 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000aac0 con 0x7fa6200c7260 2023-10-09T12:57:07.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.845+0000 7fa625399700 1 -- 172.21.15.86:0/3304629020 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000ae40 con 0x7fa6200c7260 2023-10-09T12:57:07.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.845+0000 7fa62739d700 1 -- 172.21.15.86:0/3304629020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 msgr2=0x7fa6200872f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.845+0000 7fa62739d700 1 --2- 172.21.15.86:0/3304629020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa6200872f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa610007740 tx=0x7fa61000b040 comp rx=0 tx=0).stop 2023-10-09T12:57:07.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.846+0000 7fa62739d700 1 -- 172.21.15.86:0/3304629020 shutdown_connections 2023-10-09T12:57:07.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.846+0000 7fa62739d700 1 --2- 172.21.15.86:0/3304629020 >> v2:172.21.15.135:3300/0 conn(0x7fa620087830 0x7fa620170040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.846+0000 7fa62739d700 1 --2- 172.21.15.86:0/3304629020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa6200872f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.846+0000 7fa62739d700 1 -- 172.21.15.86:0/3304629020 >> 172.21.15.86:0/3304629020 conn(0x7fa6200cc1f0 msgr2=0x7fa6200cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:07.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.846+0000 7fa62739d700 1 -- 172.21.15.86:0/3304629020 shutdown_connections 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.846+0000 7fa62739d700 1 -- 172.21.15.86:0/3304629020 wait complete. 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.849+0000 7fa62739d700 1 Processor -- start 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.849+0000 7fa62739d700 1 -- start start 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62739d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa620087830 0x7fa6200c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62739d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa62015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62739d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa620166530 0x7fa6200c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62739d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200c5850 con 0x7fa620166530 2023-10-09T12:57:07.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62739d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200c4a90 con 0x7fa620087830 2023-10-09T12:57:07.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62739d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62015e1f0 con 0x7fa6200c7260 2023-10-09T12:57:07.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62639b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa620087830 0x7fa6200c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa626b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa620166530 0x7fa6200c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa625b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa62015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62639b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa620087830 0x7fa6200c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:56494/0 (socket says 172.21.15.86:56494) 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa62639b700 1 -- 172.21.15.86:0/2320352562 learned_addr learned my addr 172.21.15.86:0/2320352562 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa625b9a700 1 -- 172.21.15.86:0/2320352562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa620087830 msgr2=0x7fa6200c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa625b9a700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa620087830 0x7fa6200c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa625b9a700 1 -- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa620166530 msgr2=0x7fa6200c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.851+0000 7fa625b9a700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa620166530 0x7fa6200c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:07.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.852+0000 7fa625b9a700 1 -- 172.21.15.86:0/2320352562 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610009a50 con 0x7fa6200c7260 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.852+0000 7fa626b9c700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa620166530 0x7fa6200c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.852+0000 7fa625b9a700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa62015dcb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6200c3050 tx=0x7fa61001d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.852+0000 7fa61e7fc700 1 -- 172.21.15.86:0/2320352562 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610008e90 con 0x7fa6200c7260 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.852+0000 7fa61e7fc700 1 -- 172.21.15.86:0/2320352562 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000e760 con 0x7fa6200c7260 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.852+0000 7fa61e7fc700 1 -- 172.21.15.86:0/2320352562 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000eb40 con 0x7fa6200c7260 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.852+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6200c3e80 con 0x7fa6200c7260 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.853+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6200c4440 con 0x7fa6200c7260 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.855+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6200c4c00 con 0x7fa6200c7260 2023-10-09T12:57:07.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.856+0000 7fa61e7fc700 1 -- 172.21.15.86:0/2320352562 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa61001a070 con 0x7fa6200c7260 2023-10-09T12:57:07.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.857+0000 7fa61e7fc700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 0x7fa60c069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:07.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.857+0000 7fa61e7fc700 1 -- 172.21.15.86:0/2320352562 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fa610017050 con 0x7fa6200c7260 2023-10-09T12:57:07.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.857+0000 7fa62639b700 1 -- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 msgr2=0x7fa60c069610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:07.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.857+0000 7fa62639b700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 0x7fa60c069610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:07.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:07.861+0000 7fa61e7fc700 1 -- 172.21.15.86:0/2320352562 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6100532c0 con 0x7fa6200c7260 2023-10-09T12:57:07.941 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:07.941+0000 7f01fc265180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:07.950 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:07.950+0000 7f172d878180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:57:08.036 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:08.036+0000 7f01fc265180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:57:08.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.058+0000 7fa62639b700 1 -- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 msgr2=0x7fa60c069610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:08.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.058+0000 7fa62639b700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 0x7fa60c069610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:08.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.117+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa62004c3c0 con 0x7fa6200c7260 2023-10-09T12:57:08.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.118+0000 7fa61e7fc700 1 -- 172.21.15.86:0/2320352562 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa6100568e0 con 0x7fa6200c7260 2023-10-09T12:57:08.119 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:08.119 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/2700721489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2700721489},{"type":"v1","addr":"172.21.15.135:6834","nonce":2700721489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1754968847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1754968847},{"type":"v1","addr":"172.21.15.135:6835","nonce":1754968847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/885619835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":885619835},{"type":"v1","addr":"172.21.15.86:6834","nonce":885619835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:56:40.649653+0000","modified":"2023-10-09T12:56:44.211663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8580":{"gid":8580,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3313043174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":3313043174},{"type":"v1","addr":"172.21.15.86:6835","nonce":3313043174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T12:57:08.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 msgr2=0x7fa60c069610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:08.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 0x7fa60c069610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.121 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 msgr2=0x7fa62015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa62015dcb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6200c3050 tx=0x7fa61001d000 comp rx=0 tx=0).stop 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 shutdown_connections 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa60c067160 0x7fa60c069610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa620166530 0x7fa6200c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa620087830 0x7fa6200c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 --2- 172.21.15.86:0/2320352562 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6200c7260 0x7fa62015dcb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 >> 172.21.15.86:0/2320352562 conn(0x7fa6200cc1f0 msgr2=0x7fa62006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 shutdown_connections 2023-10-09T12:57:08.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.120+0000 7fa62739d700 1 -- 172.21.15.86:0/2320352562 wait complete. 2023-10-09T12:57:08.123 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 71 2023-10-09T12:57:08.127 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:08.127+0000 7f172d878180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:08.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:57:08.230 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:08.230+0000 7f172d878180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:57:08.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.325+0000 7f8b4639d700 1 Processor -- start 2023-10-09T12:57:08.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.325+0000 7f8b4639d700 1 -- start start 2023-10-09T12:57:08.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.326+0000 7f8b4639d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8b40159420 0x7f8b400b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.326+0000 7f8b4639d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b401597f0 0x7f8b400b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.326+0000 7f8b4639d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b400b11d0 con 0x7f8b4015d230 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.326+0000 7f8b4639d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b400b14b0 con 0x7f8b40159420 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.326+0000 7f8b4639d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b400b1790 con 0x7f8b401597f0 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b45b9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8b4015d230 0x7f8b400b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39524/0 (socket says 172.21.15.86:39524) 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b45b9c700 1 -- 172.21.15.86:0/3087773881 learned_addr learned my addr 172.21.15.86:0/3087773881 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b4539b700 1 --2- 172.21.15.86:0/3087773881 >> v2:172.21.15.135:3300/0 conn(0x7f8b40159420 0x7f8b400b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b44b9a700 1 --2- 172.21.15.86:0/3087773881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b401597f0 0x7f8b400b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b37fff700 1 -- 172.21.15.86:0/3087773881 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136479481 0 0) 0x7f8b400b11d0 con 0x7f8b4015d230 2023-10-09T12:57:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b37fff700 1 -- 172.21.15.86:0/3087773881 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2c003570 con 0x7f8b4015d230 2023-10-09T12:57:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b44b9a700 1 -- 172.21.15.86:0/3087773881 >> v2:172.21.15.135:3300/0 conn(0x7f8b40159420 msgr2=0x7f8b400b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b44b9a700 1 --2- 172.21.15.86:0/3087773881 >> v2:172.21.15.135:3300/0 conn(0x7f8b40159420 0x7f8b400b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b44b9a700 1 -- 172.21.15.86:0/3087773881 >> v1:172.21.15.86:6789/0 conn(0x7f8b4015d230 legacy=0x7f8b400b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b44b9a700 1 -- 172.21.15.86:0/3087773881 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b400b1a70 con 0x7f8b401597f0 2023-10-09T12:57:08.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.327+0000 7f8b4539b700 1 --2- 172.21.15.86:0/3087773881 >> v2:172.21.15.135:3300/0 conn(0x7f8b40159420 0x7f8b400b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b44b9a700 1 --2- 172.21.15.86:0/3087773881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b401597f0 0x7f8b400b2270 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8b300098e0 tx=0x7f8b300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af529a13f2bb86cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b37fff700 1 -- 172.21.15.86:0/3087773881 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30011630 con 0x7f8b401597f0 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b37fff700 1 -- 172.21.15.86:0/3087773881 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30011790 con 0x7f8b401597f0 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b37fff700 1 -- 172.21.15.86:0/3087773881 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30011b30 con 0x7f8b401597f0 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b4639d700 1 -- 172.21.15.86:0/3087773881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b401597f0 msgr2=0x7f8b400b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b4639d700 1 --2- 172.21.15.86:0/3087773881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b401597f0 0x7f8b400b2270 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8b300098e0 tx=0x7f8b300091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b4639d700 1 -- 172.21.15.86:0/3087773881 shutdown_connections 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.328+0000 7f8b4639d700 1 --2- 172.21.15.86:0/3087773881 >> v2:172.21.15.135:3300/0 conn(0x7f8b40159420 0x7f8b400b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.329+0000 7f8b4639d700 1 --2- 172.21.15.86:0/3087773881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b401597f0 0x7f8b400b2270 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.329+0000 7f8b4639d700 1 -- 172.21.15.86:0/3087773881 >> 172.21.15.86:0/3087773881 conn(0x7f8b400d0660 msgr2=0x7f8b400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:08.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.329+0000 7f8b4639d700 1 -- 172.21.15.86:0/3087773881 shutdown_connections 2023-10-09T12:57:08.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.329+0000 7f8b4639d700 1 -- 172.21.15.86:0/3087773881 wait complete. 2023-10-09T12:57:08.332 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:08.332+0000 7f01fc265180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:57:08.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.330+0000 7f8b4639d700 1 Processor -- start 2023-10-09T12:57:08.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.330+0000 7f8b4639d700 1 -- start start 2023-10-09T12:57:08.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b4639d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b40159420 0x7f8b401548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b4639d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b401597f0 0x7f8b400c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b4639d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b4015d230 0x7f8b400c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b4639d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b40155520 con 0x7f8b4015d230 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b4639d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4015bae0 con 0x7f8b401597f0 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b4639d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4015bdc0 con 0x7f8b40159420 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b45b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b4015d230 0x7f8b400c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b4539b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b40159420 0x7f8b401548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b45b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b4015d230 0x7f8b400c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53914/0 (socket says 172.21.15.86:53914) 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b45b9c700 1 -- 172.21.15.86:0/1995390121 learned_addr learned my addr 172.21.15.86:0/1995390121 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.331+0000 7f8b44b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b401597f0 0x7f8b400c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b45b9c700 1 -- 172.21.15.86:0/1995390121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b40159420 msgr2=0x7f8b401548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b45b9c700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b40159420 0x7f8b401548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b45b9c700 1 -- 172.21.15.86:0/1995390121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b401597f0 msgr2=0x7f8b400c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b45b9c700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b401597f0 0x7f8b400c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b45b9c700 1 -- 172.21.15.86:0/1995390121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c009420 con 0x7f8b4015d230 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b44b9a700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b401597f0 0x7f8b400c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b45b9c700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b4015d230 0x7f8b400c8500 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8b38001460 tx=0x7f8b38001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b357fa700 1 -- 172.21.15.86:0/1995390121 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800a870 con 0x7f8b4015d230 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b357fa700 1 -- 172.21.15.86:0/1995390121 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800a9d0 con 0x7f8b4015d230 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b357fa700 1 -- 172.21.15.86:0/1995390121 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800ad50 con 0x7f8b4015d230 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.332+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b30009420 con 0x7f8b4015d230 2023-10-09T12:57:08.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.333+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4015c380 con 0x7f8b4015d230 2023-10-09T12:57:08.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.334+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4004c3c0 con 0x7f8b4015d230 2023-10-09T12:57:08.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.335+0000 7f8b357fa700 1 -- 172.21.15.86:0/1995390121 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f8b38007300 con 0x7f8b4015d230 2023-10-09T12:57:08.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.336+0000 7f8b357fa700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 0x7f8b24069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.336+0000 7f8b357fa700 1 -- 172.21.15.86:0/1995390121 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f8b38084e50 con 0x7f8b4015d230 2023-10-09T12:57:08.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.336+0000 7f8b4539b700 1 -- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 msgr2=0x7f8b24069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:08.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.336+0000 7f8b4539b700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 0x7f8b24069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:08.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.340+0000 7f8b357fa700 1 -- 172.21.15.86:0/1995390121 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b38051b60 con 0x7f8b4015d230 2023-10-09T12:57:08.429 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:08.429+0000 7f01fc265180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:57:08.535 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:08.534+0000 7f172d878180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:57:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.537+0000 7f8b4539b700 1 -- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 msgr2=0x7f8b24069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:08.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.537+0000 7f8b4539b700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 0x7f8b24069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:08.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.583+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b400b1d50 con 0x7f8b4015d230 2023-10-09T12:57:08.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.584+0000 7f8b357fa700 1 -- 172.21.15.86:0/1995390121 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f8b38055180 con 0x7f8b4015d230 2023-10-09T12:57:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:08.585 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/2700721489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2700721489},{"type":"v1","addr":"172.21.15.135:6834","nonce":2700721489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1754968847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1754968847},{"type":"v1","addr":"172.21.15.135:6835","nonce":1754968847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/885619835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":885619835},{"type":"v1","addr":"172.21.15.86:6834","nonce":885619835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:56:40.649653+0000","modified":"2023-10-09T12:56:44.211663+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8580":{"gid":8580,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3313043174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":3313043174},{"type":"v1","addr":"172.21.15.86:6835","nonce":3313043174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T12:57:08.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 msgr2=0x7f8b24069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:08.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 0x7f8b24069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b4015d230 msgr2=0x7f8b400c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b4015d230 0x7f8b400c8500 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8b38001460 tx=0x7f8b38001a40 comp rx=0 tx=0).stop 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 shutdown_connections 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8b240670e0 0x7f8b24069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b4015d230 0x7f8b400c8500 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b40159420 0x7f8b401548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 --2- 172.21.15.86:0/1995390121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b401597f0 0x7f8b400c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 >> 172.21.15.86:0/1995390121 conn(0x7f8b400d0660 msgr2=0x7f8b400b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 shutdown_connections 2023-10-09T12:57:08.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.586+0000 7f8b4639d700 1 -- 172.21.15.86:0/1995390121 wait complete. 2023-10-09T12:57:08.589 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 71 2023-10-09T12:57:08.605 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:57:08.636 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:08.635+0000 7f172d878180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:57:08.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.790+0000 7fc2b2b9d700 1 Processor -- start 2023-10-09T12:57:08.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.790+0000 7fc2b2b9d700 1 -- start start 2023-10-09T12:57:08.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.791+0000 7fc2b2b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac1595a0 0x7fc2ac0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.791+0000 7fc2b2b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc2ac0c8830 0x7fc2ac159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.791+0000 7fc2b2b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0b1410 con 0x7fc2ac0c6c60 2023-10-09T12:57:08.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.791+0000 7fc2b2b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac0b2b90 con 0x7fc2ac0c8830 2023-10-09T12:57:08.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.791+0000 7fc2b2b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac063230 con 0x7fc2ac1595a0 2023-10-09T12:57:08.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.791+0000 7fc2b139a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc2ac0c6c60 0x7fc2ac0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39530/0 (socket says 172.21.15.86:39530) 2023-10-09T12:57:08.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.791+0000 7fc2b139a700 1 -- 172.21.15.86:0/2349982157 learned_addr learned my addr 172.21.15.86:0/2349982157 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:08.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b239c700 1 --2- 172.21.15.86:0/2349982157 >> v2:172.21.15.135:3300/0 conn(0x7fc2ac0c8830 0x7fc2ac159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b1b9b700 1 --2- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac1595a0 0x7fc2ac0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b0b99700 1 -- 172.21.15.86:0/2349982157 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693038776 0 0) 0x7fc2ac0b1410 con 0x7fc2ac0c6c60 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b0b99700 1 -- 172.21.15.86:0/2349982157 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc298003570 con 0x7fc2ac0c6c60 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b239c700 1 -- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac1595a0 msgr2=0x7fc2ac0b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b239c700 1 --2- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac1595a0 0x7fc2ac0b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b239c700 1 -- 172.21.15.86:0/2349982157 >> v1:172.21.15.86:6789/0 conn(0x7fc2ac0c6c60 legacy=0x7fc2ac0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b239c700 1 -- 172.21.15.86:0/2349982157 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac0634f0 con 0x7fc2ac0c8830 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.792+0000 7fc2b239c700 1 --2- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac0c8830 0x7fc2ac159970 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009e60 tx=0x7fc2a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97affc0a66daa1ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:08.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b0b99700 1 -- 172.21.15.86:0/2349982157 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400e070 con 0x7fc2ac0c8830 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b0b99700 1 -- 172.21.15.86:0/2349982157 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a400bab0 con 0x7fc2ac0c8830 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b0b99700 1 -- 172.21.15.86:0/2349982157 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400be70 con 0x7fc2ac0c8830 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac0c8830 msgr2=0x7fc2ac159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac0c8830 0x7fc2ac159970 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009e60 tx=0x7fc2a4009780 comp rx=0 tx=0).stop 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/2349982157 shutdown_connections 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac0c8830 0x7fc2ac159970 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/2349982157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac1595a0 0x7fc2ac0b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/2349982157 >> 172.21.15.86:0/2349982157 conn(0x7fc2ac06ddb0 msgr2=0x7fc2ac06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/2349982157 shutdown_connections 2023-10-09T12:57:08.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.793+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/2349982157 wait complete. 2023-10-09T12:57:08.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.795+0000 7fc2b2b9d700 1 Processor -- start 2023-10-09T12:57:08.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.795+0000 7fc2b2b9d700 1 -- start start 2023-10-09T12:57:08.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b2b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac0c6c60 0x7fc2ac154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b2b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2ac0c8830 0x7fc2ac0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b2b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac1595a0 0x7fc2ac169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b2b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0c6760 con 0x7fc2ac0c8830 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b2b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0c23b0 con 0x7fc2ac1595a0 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b2b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0c1a80 con 0x7fc2ac0c6c60 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b139a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2ac0c8830 0x7fc2ac0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac1595a0 0x7fc2ac169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b1b9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac0c6c60 0x7fc2ac154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac1595a0 0x7fc2ac169e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:56528/0 (socket says 172.21.15.86:56528) 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b239c700 1 -- 172.21.15.86:0/3346819605 learned_addr learned my addr 172.21.15.86:0/3346819605 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b239c700 1 -- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac0c6c60 msgr2=0x7fc2ac154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b239c700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac0c6c60 0x7fc2ac154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b239c700 1 -- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2ac0c8830 msgr2=0x7fc2ac0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:08.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.796+0000 7fc2b239c700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2ac0c8830 0x7fc2ac0c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2b239c700 1 -- 172.21.15.86:0/3346819605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4009a20 con 0x7fc2ac1595a0 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2b1b9b700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac0c6c60 0x7fc2ac154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2b239c700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac1595a0 0x7fc2ac169e20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4013000 tx=0x7fc2a4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2a1ffb700 1 -- 172.21.15.86:0/3346819605 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4012e10 con 0x7fc2ac1595a0 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2a1ffb700 1 -- 172.21.15.86:0/3346819605 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4027470 con 0x7fc2ac1595a0 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac0c1d60 con 0x7fc2ac1595a0 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2a1ffb700 1 -- 172.21.15.86:0/3346819605 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4027830 con 0x7fc2ac1595a0 2023-10-09T12:57:08.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.797+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac0c2840 con 0x7fc2ac1595a0 2023-10-09T12:57:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.799+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac0c2a60 con 0x7fc2ac1595a0 2023-10-09T12:57:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.799+0000 7fc2a1ffb700 1 -- 172.21.15.86:0/3346819605 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc2a4024070 con 0x7fc2ac1595a0 2023-10-09T12:57:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.800+0000 7fc2a1ffb700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 0x7fc290069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.800+0000 7fc2b1b9b700 1 -- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 msgr2=0x7fc290069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.800+0000 7fc2a1ffb700 1 -- 172.21.15.86:0/3346819605 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fc2a4087460 con 0x7fc2ac1595a0 2023-10-09T12:57:08.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.800+0000 7fc2b1b9b700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 0x7fc290069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:08.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:08.804+0000 7fc2a1ffb700 1 -- 172.21.15.86:0/3346819605 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2a40540f0 con 0x7fc2ac1595a0 2023-10-09T12:57:09.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.001+0000 7fc2b1b9b700 1 -- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 msgr2=0x7fc290069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:09.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.001+0000 7fc2b1b9b700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 0x7fc290069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:09.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.002+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2ac0b2600 con 0x7fc2ac1595a0 2023-10-09T12:57:09.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.003+0000 7fc2a1ffb700 1 -- 172.21.15.86:0/3346819605 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16464 (secure 0 0 0) 0x7fc2a4057710 con 0x7fc2ac1595a0 2023-10-09T12:57:09.004 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:09.005 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":165,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:57:01.382656+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:56:38.265725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T12:56:39.638355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/85490":"2023-10-10T12:57:01.382626+0000","172.21.15.86:6836/85490":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/2030851234":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/705200734":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/3854445144":"2023-10-10T12:57:01.382626+0000","172.21.15.86:0/714172173":"2023-10-10T12:57:01.382626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:57:09.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 msgr2=0x7fc290069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:09.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 0x7fc290069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac1595a0 msgr2=0x7fc2ac169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac1595a0 0x7fc2ac169e20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4013000 tx=0x7fc2a4019000 comp rx=0 tx=0).stop 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 shutdown_connections 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2ac1595a0 0x7fc2ac169e20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2ac0c6c60 0x7fc2ac154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc2900670e0 0x7fc290069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 --2- 172.21.15.86:0/3346819605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2ac0c8830 0x7fc2ac0c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 >> 172.21.15.86:0/3346819605 conn(0x7fc2ac06ddb0 msgr2=0x7fc2ac13d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 shutdown_connections 2023-10-09T12:57:09.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.006+0000 7fc2b2b9d700 1 -- 172.21.15.86:0/3346819605 wait complete. 2023-10-09T12:57:09.026 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T12:57:09.133 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:09.132+0000 7f01fc265180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:57:09.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.252+0000 7f2786d9d700 1 Processor -- start 2023-10-09T12:57:09.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.252+0000 7f2786d9d700 1 -- start start 2023-10-09T12:57:09.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.253+0000 7f2786d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f27800ad870 0x7f278006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f2786d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27800b40f0 con 0x7f278006bf20 2023-10-09T12:57:09.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f2786d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2780069640 con 0x7f2780142ea0 2023-10-09T12:57:09.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f2786d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278006c3a0 con 0x7f27800ad870 2023-10-09T12:57:09.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f278659c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f278006bf20 0x7f278006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39544/0 (socket says 172.21.15.86:39544) 2023-10-09T12:57:09.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f278659c700 1 -- 172.21.15.86:0/999934571 learned_addr learned my addr 172.21.15.86:0/999934571 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:09.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f278559a700 1 --2- 172.21.15.86:0/999934571 >> v2:172.21.15.135:3300/0 conn(0x7f27800ad870 0x7f278006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f2784d99700 1 -- 172.21.15.86:0/999934571 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510250598 0 0) 0x7f27800b40f0 con 0x7f278006bf20 2023-10-09T12:57:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f2784d99700 1 -- 172.21.15.86:0/999934571 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f276c003570 con 0x7f278006bf20 2023-10-09T12:57:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f2784d99700 1 -- 172.21.15.86:0/999934571 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917948704 0 0) 0x7f2780069640 con 0x7f2780142ea0 2023-10-09T12:57:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f2784d99700 1 -- 172.21.15.86:0/999934571 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27800b40f0 con 0x7f2780142ea0 2023-10-09T12:57:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f278559a700 1 -- 172.21.15.86:0/999934571 >> v1:172.21.15.135:6789/0 conn(0x7f2780142ea0 legacy=0x7f27800b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f278559a700 1 -- 172.21.15.86:0/999934571 >> v1:172.21.15.86:6789/0 conn(0x7f278006bf20 legacy=0x7f278006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.254+0000 7f278559a700 1 -- 172.21.15.86:0/999934571 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780069920 con 0x7f27800ad870 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.255+0000 7f278559a700 1 --2- 172.21.15.86:0/999934571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27800ad870 0x7f278006b9e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f27700098e0 tx=0x7f27700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c455a1b612843a7d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.255+0000 7f2784d99700 1 -- 172.21.15.86:0/999934571 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011630 con 0x7f27800ad870 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.255+0000 7f2784d99700 1 -- 172.21.15.86:0/999934571 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770011790 con 0x7f27800ad870 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.255+0000 7f2784d99700 1 -- 172.21.15.86:0/999934571 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011b30 con 0x7f27800ad870 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.256+0000 7f2786d9d700 1 -- 172.21.15.86:0/999934571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27800ad870 msgr2=0x7f278006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.256+0000 7f2786d9d700 1 --2- 172.21.15.86:0/999934571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27800ad870 0x7f278006b9e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f27700098e0 tx=0x7f27700091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.256+0000 7f2786d9d700 1 -- 172.21.15.86:0/999934571 shutdown_connections 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.256+0000 7f2786d9d700 1 --2- 172.21.15.86:0/999934571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27800ad870 0x7f278006b9e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.256+0000 7f2786d9d700 1 -- 172.21.15.86:0/999934571 >> 172.21.15.86:0/999934571 conn(0x7f27800ce430 msgr2=0x7f27800ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.256+0000 7f2786d9d700 1 -- 172.21.15.86:0/999934571 shutdown_connections 2023-10-09T12:57:09.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.256+0000 7f2786d9d700 1 -- 172.21.15.86:0/999934571 wait complete. 2023-10-09T12:57:09.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.257+0000 7f2786d9d700 1 Processor -- start 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.257+0000 7f2786d9d700 1 -- start start 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.258+0000 7f2786d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f278006bf20 0x7f278013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.258+0000 7f2786d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2780142ea0 0x7f278015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.258+0000 7f2786d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278015aee0 0x7f27800b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.258+0000 7f2786d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278013ef70 con 0x7f278006bf20 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.258+0000 7f2786d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27800c8290 con 0x7f278015aee0 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.258+0000 7f2786d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278015b360 con 0x7f2780142ea0 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f278006bf20 0x7f278013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f278006bf20 0x7f278013ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53932/0 (socket says 172.21.15.86:53932) 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 -- 172.21.15.86:0/3065729107 learned_addr learned my addr 172.21.15.86:0/3065729107 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:09.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f278559a700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2780142ea0 0x7f278015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f278659c700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278015aee0 0x7f27800b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 -- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2780142ea0 msgr2=0x7f278015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2780142ea0 0x7f278015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 -- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278015aee0 msgr2=0x7f27800b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278015aee0 0x7f27800b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 -- 172.21.15.86:0/3065729107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009420 con 0x7f278006bf20 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2785d9b700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f278006bf20 0x7f278013ea30 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c5b0 tx=0x7f277c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.259+0000 7f2775ffb700 1 -- 172.21.15.86:0/3065729107 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c010510 con 0x7f278006bf20 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.260+0000 7f2775ffb700 1 -- 172.21.15.86:0/3065729107 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c010670 con 0x7f278006bf20 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.260+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27800c7680 con 0x7f278006bf20 2023-10-09T12:57:09.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.260+0000 7f2775ffb700 1 -- 172.21.15.86:0/3065729107 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c010a30 con 0x7f278006bf20 2023-10-09T12:57:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.260+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27800c7c40 con 0x7f278006bf20 2023-10-09T12:57:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.261+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27800c8600 con 0x7f278006bf20 2023-10-09T12:57:09.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.263+0000 7f2775ffb700 1 -- 172.21.15.86:0/3065729107 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f277c01b400 con 0x7f278006bf20 2023-10-09T12:57:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.263+0000 7f2775ffb700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 0x7f2764069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.263+0000 7f2775ffb700 1 -- 172.21.15.86:0/3065729107 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f277c084730 con 0x7f278006bf20 2023-10-09T12:57:09.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.263+0000 7f278559a700 1 -- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 msgr2=0x7f2764069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:09.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.263+0000 7f278559a700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 0x7f2764069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:09.268 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.268+0000 7f2775ffb700 1 -- 172.21.15.86:0/3065729107 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f277c0513c0 con 0x7f278006bf20 2023-10-09T12:57:09.373 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:09.372+0000 7f172d878180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:57:09.420 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:09.420+0000 7f01fc265180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:57:09.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.464+0000 7f278559a700 1 -- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 msgr2=0x7f2764069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:09.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.464+0000 7f278559a700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 0x7f2764069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:09.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.506+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f278004c3c0 con 0x7f278006bf20 2023-10-09T12:57:09.507 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T12:57:09.506+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T12:57:09.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.511+0000 7f2775ffb700 1 -- 172.21.15.86:0/3065729107 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7f277c0549e0 con 0x7f278006bf20 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 msgr2=0x7f2764069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 0x7f2764069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f278006bf20 msgr2=0x7f278013ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f278006bf20 0x7f278013ea30 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c5b0 tx=0x7f277c007e10 comp rx=0 tx=0).stop 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 shutdown_connections 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27640670e0 0x7f2764069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f278006bf20 0x7f278013ea30 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278015aee0 0x7f27800b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 --2- 172.21.15.86:0/3065729107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2780142ea0 0x7f278015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 >> 172.21.15.86:0/3065729107 conn(0x7f27800ce430 msgr2=0x7f2780141db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:09.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.514+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 shutdown_connections 2023-10-09T12:57:09.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.515+0000 7f2786d9d700 1 -- 172.21.15.86:0/3065729107 wait complete. 2023-10-09T12:57:09.517 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:09.515+0000 7f01fc265180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:57:09.517 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T12:57:09.518 INFO:tasks.ceph.mds.a.smithi086.stderr: -2276> 2023-10-09T12:56:45.671+0000 7fb1243f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T12:57:09.536 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T12:57:09.560 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T12:57:09.675 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:09.675+0000 7f01fc265180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:57:09.676 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:09.675+0000 7f172d878180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:57:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.728+0000 7f9a4f59e700 1 Processor -- start 2023-10-09T12:57:09.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.728+0000 7f9a4f59e700 1 -- start start 2023-10-09T12:57:09.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a500c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4f59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a500ccc00 0x7f9a50069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4f59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a500c9cb0 con 0x7f9a5006a020 2023-10-09T12:57:09.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4f59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5006dfc0 con 0x7f9a500ccc00 2023-10-09T12:57:09.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500c9f30 con 0x7f9a50159a60 2023-10-09T12:57:09.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4ed9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9a5006a020 0x7f9a500cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39566/0 (socket says 172.21.15.86:39566) 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4ed9d700 1 -- 172.21.15.86:0/2613003310 learned_addr learned my addr 172.21.15.86:0/2613003310 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4e59c700 1 --2- 172.21.15.86:0/2613003310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a500c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.729+0000 7f9a4dd9b700 1 --2- 172.21.15.86:0/2613003310 >> v2:172.21.15.135:3300/0 conn(0x7f9a500ccc00 0x7f9a50069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.730+0000 7f9a4d59a700 1 -- 172.21.15.86:0/2613003310 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005453412 0 0) 0x7f9a500c9cb0 con 0x7f9a5006a020 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.730+0000 7f9a4d59a700 1 -- 172.21.15.86:0/2613003310 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a38003570 con 0x7f9a5006a020 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.730+0000 7f9a4e59c700 1 -- 172.21.15.86:0/2613003310 >> v2:172.21.15.135:3300/0 conn(0x7f9a500ccc00 msgr2=0x7f9a50069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.730+0000 7f9a4e59c700 1 --2- 172.21.15.86:0/2613003310 >> v2:172.21.15.135:3300/0 conn(0x7f9a500ccc00 0x7f9a50069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.730+0000 7f9a4e59c700 1 -- 172.21.15.86:0/2613003310 >> v1:172.21.15.86:6789/0 conn(0x7f9a5006a020 legacy=0x7f9a500cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.730+0000 7f9a4e59c700 1 -- 172.21.15.86:0/2613003310 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500ca470 con 0x7f9a50159a60 2023-10-09T12:57:09.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.730+0000 7f9a4e59c700 1 --2- 172.21.15.86:0/2613003310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a500c9770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a400098e0 tx=0x7f9a400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19cf48568826697 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4d59a700 1 -- 172.21.15.86:0/2613003310 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40011630 con 0x7f9a50159a60 2023-10-09T12:57:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4d59a700 1 -- 172.21.15.86:0/2613003310 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a40011790 con 0x7f9a50159a60 2023-10-09T12:57:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4d59a700 1 -- 172.21.15.86:0/2613003310 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40011b30 con 0x7f9a50159a60 2023-10-09T12:57:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 -- 172.21.15.86:0/2613003310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 msgr2=0x7f9a500c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/2613003310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a500c9770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a400098e0 tx=0x7f9a400091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 -- 172.21.15.86:0/2613003310 shutdown_connections 2023-10-09T12:57:09.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/2613003310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a500c9770 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/2613003310 >> v2:172.21.15.135:3300/0 conn(0x7f9a500ccc00 0x7f9a50069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 -- 172.21.15.86:0/2613003310 >> 172.21.15.86:0/2613003310 conn(0x7f9a5006baa0 msgr2=0x7f9a5006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 -- 172.21.15.86:0/2613003310 shutdown_connections 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.731+0000 7f9a4f59e700 1 -- 172.21.15.86:0/2613003310 wait complete. 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.733+0000 7f9a4f59e700 1 Processor -- start 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.733+0000 7f9a4f59e700 1 -- start start 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a5006a020 0x7f9a500b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a500ccc00 0x7f9a50169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a501588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4f59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5014dc50 con 0x7f9a5006a020 2023-10-09T12:57:09.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4f59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500b2500 con 0x7f9a500ccc00 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500b2780 con 0x7f9a50159a60 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a5006a020 0x7f9a500b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a5006a020 0x7f9a500b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53936/0 (socket says 172.21.15.86:53936) 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 -- 172.21.15.86:0/844358502 learned_addr learned my addr 172.21.15.86:0/844358502 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4ed9d700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a501588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4dd9b700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a500ccc00 0x7f9a50169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 -- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 msgr2=0x7f9a501588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a501588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 -- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a500ccc00 msgr2=0x7f9a50169910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a500ccc00 0x7f9a50169910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:09.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.734+0000 7f9a4e59c700 1 -- 172.21.15.86:0/844358502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40009420 con 0x7f9a5006a020 2023-10-09T12:57:09.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.735+0000 7f9a4e59c700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a5006a020 0x7f9a500b1fc0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f9a500ca070 tx=0x7f9a40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:09.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.735+0000 7f9a3e7fc700 1 -- 172.21.15.86:0/844358502 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40000d10 con 0x7f9a5006a020 2023-10-09T12:57:09.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.735+0000 7f9a3e7fc700 1 -- 172.21.15.86:0/844358502 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a40011900 con 0x7f9a5006a020 2023-10-09T12:57:09.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.735+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a500b2a60 con 0x7f9a5006a020 2023-10-09T12:57:09.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.735+0000 7f9a3e7fc700 1 -- 172.21.15.86:0/844358502 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40025420 con 0x7f9a5006a020 2023-10-09T12:57:09.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.735+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a500b3020 con 0x7f9a5006a020 2023-10-09T12:57:09.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.736+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5006e1d0 con 0x7f9a5006a020 2023-10-09T12:57:09.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.737+0000 7f9a3e7fc700 1 -- 172.21.15.86:0/844358502 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 79) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9a40023070 con 0x7f9a5006a020 2023-10-09T12:57:09.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.738+0000 7f9a3e7fc700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 0x7f9a30069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:09.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.738+0000 7f9a3e7fc700 1 -- 172.21.15.86:0/844358502 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f9a40085e50 con 0x7f9a5006a020 2023-10-09T12:57:09.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.738+0000 7f9a4dd9b700 1 -- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 msgr2=0x7f9a30069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:09.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.738+0000 7f9a4dd9b700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 0x7f9a30069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:09.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.745+0000 7f9a3e7fc700 1 -- 172.21.15.86:0/844358502 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a40052bd0 con 0x7f9a5006a020 2023-10-09T12:57:09.777 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:09.776+0000 7f172d878180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:57:09.782 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:09.782+0000 7f01fc265180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:57:09.934 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:09.933+0000 7f172d878180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:57:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.942+0000 7f9a4dd9b700 1 -- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 msgr2=0x7f9a30069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:09.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.942+0000 7f9a4dd9b700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 0x7f9a30069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:09.971 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:09.971+0000 7f01fc265180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:57:09.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:09.987+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9a500ca750 con 0x7f9a5006a020 2023-10-09T12:57:10.042 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:10.041+0000 7f172d878180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:57:10.064 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:10.064+0000 7f01fc265180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:57:10.156 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:10.156+0000 7f01fc265180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:57:10.234 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:10.233+0000 7f172d878180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:57:10.249 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:10.249+0000 7f01fc265180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:57:10.328 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:10.328+0000 7f172d878180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:57:10.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.343+0000 7f9a4dd9b700 1 -- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 msgr2=0x7f9a30069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:10.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.343+0000 7f9a4dd9b700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 0x7f9a30069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T12:57:10.422 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:10.421+0000 7f172d878180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:57:10.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.511+0000 7f9a3e7fc700 1 -- 172.21.15.86:0/844358502 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9a4002a0a0 con 0x7f9a5006a020 2023-10-09T12:57:10.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 msgr2=0x7f9a30069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 0x7f9a30069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a5006a020 msgr2=0x7f9a500b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a5006a020 0x7f9a500b1fc0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f9a500ca070 tx=0x7f9a40017000 comp rx=0 tx=0).stop 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 shutdown_connections 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f9a300670e0 0x7f9a30069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a5006a020 0x7f9a500b1fc0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a50159a60 0x7f9a501588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 --2- 172.21.15.86:0/844358502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a500ccc00 0x7f9a50169910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.514+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 >> 172.21.15.86:0/844358502 conn(0x7f9a5006baa0 msgr2=0x7f9a50156650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:10.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.515+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 shutdown_connections 2023-10-09T12:57:10.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.515+0000 7f9a4f59e700 1 -- 172.21.15.86:0/844358502 wait complete. 2023-10-09T12:57:10.519 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:10.518+0000 7f172d878180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:57:10.541 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T12:57:10.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.771+0000 7fe68619d700 1 Processor -- start 2023-10-09T12:57:10.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.771+0000 7fe68619d700 1 -- start start 2023-10-09T12:57:10.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.772+0000 7fe68619d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6800ccb40 0x7fe6800697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:10.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.772+0000 7fe68619d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe680159db0 con 0x7fe6800cb560 2023-10-09T12:57:10.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.772+0000 7fe68619d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68006a470 con 0x7fe680069cf0 2023-10-09T12:57:10.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.772+0000 7fe68619d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68006aa30 con 0x7fe6800ccb40 2023-10-09T12:57:10.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.772+0000 7fe68499a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6800ccb40 0x7fe6800697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:10.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.772+0000 7fe68519b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe6800cb560 0x7fe6800cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39570/0 (socket says 172.21.15.86:39570) 2023-10-09T12:57:10.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.772+0000 7fe68519b700 1 -- 172.21.15.86:0/1293034757 learned_addr learned my addr 172.21.15.86:0/1293034757 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:10.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe677fff700 1 -- 172.21.15.86:0/1293034757 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681263464 0 0) 0x7fe680159db0 con 0x7fe6800cb560 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe677fff700 1 -- 172.21.15.86:0/1293034757 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c003570 con 0x7fe6800cb560 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe68499a700 1 -- 172.21.15.86:0/1293034757 >> v1:172.21.15.135:6789/0 conn(0x7fe680069cf0 legacy=0x7fe68015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe68499a700 1 -- 172.21.15.86:0/1293034757 >> v1:172.21.15.86:6789/0 conn(0x7fe6800cb560 legacy=0x7fe6800cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe68499a700 1 -- 172.21.15.86:0/1293034757 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68006a750 con 0x7fe6800ccb40 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe68499a700 1 --2- 172.21.15.86:0/1293034757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800697b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fe670009910 tx=0x7fe6700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da19d38a42cb20f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe677fff700 1 -- 172.21.15.86:0/1293034757 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000b640 con 0x7fe6800ccb40 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.773+0000 7fe677fff700 1 -- 172.21.15.86:0/1293034757 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000b7a0 con 0x7fe6800ccb40 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe677fff700 1 -- 172.21.15.86:0/1293034757 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000bb60 con 0x7fe6800ccb40 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe68619d700 1 -- 172.21.15.86:0/1293034757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 msgr2=0x7fe6800697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe68619d700 1 --2- 172.21.15.86:0/1293034757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800697b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fe670009910 tx=0x7fe6700091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe68619d700 1 -- 172.21.15.86:0/1293034757 shutdown_connections 2023-10-09T12:57:10.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe68619d700 1 --2- 172.21.15.86:0/1293034757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800697b0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe68619d700 1 -- 172.21.15.86:0/1293034757 >> 172.21.15.86:0/1293034757 conn(0x7fe68006baf0 msgr2=0x7fe68006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:10.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe68619d700 1 -- 172.21.15.86:0/1293034757 shutdown_connections 2023-10-09T12:57:10.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.774+0000 7fe68619d700 1 -- 172.21.15.86:0/1293034757 wait complete. 2023-10-09T12:57:10.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.776+0000 7fe68619d700 1 Processor -- start 2023-10-09T12:57:10.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.776+0000 7fe68619d700 1 -- start start 2023-10-09T12:57:10.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe680069cf0 0x7fe6800b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:10.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68619d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800cb560 0x7fe6800b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:10.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68619d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68619d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800aed70 con 0x7fe6800ccb40 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68619d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800af540 con 0x7fe6800cb560 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68015d570 con 0x7fe680069cf0 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68499a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800cb560 0x7fe6800b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68519b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe680069cf0 0x7fe6800b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54028/0 (socket says 172.21.15.86:54028) 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 -- 172.21.15.86:0/1323511942 learned_addr learned my addr 172.21.15.86:0/1323511942 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 -- 172.21.15.86:0/1323511942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe680069cf0 msgr2=0x7fe6800b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe680069cf0 0x7fe6800b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 -- 172.21.15.86:0/1323511942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800cb560 msgr2=0x7fe6800b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800cb560 0x7fe6800b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.777+0000 7fe68599c700 1 -- 172.21.15.86:0/1323511942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe670009420 con 0x7fe6800ccb40 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.778+0000 7fe68599c700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800c5700 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c870 tx=0x7fe678001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.778+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678012630 con 0x7fe6800ccb40 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.778+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6780127b0 con 0x7fe6800ccb40 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.778+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678012b70 con 0x7fe6800ccb40 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.778+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6800aef80 con 0x7fe6800ccb40 2023-10-09T12:57:10.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.778+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe680158440 con 0x7fe6800ccb40 2023-10-09T12:57:10.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.779+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68015d3d0 con 0x7fe6800ccb40 2023-10-09T12:57:10.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.780+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 81) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fe678003030 con 0x7fe6800ccb40 2023-10-09T12:57:10.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.781+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6798+0+0 (secure 0 0 0) 0x7fe6780843f0 con 0x7fe6800ccb40 2023-10-09T12:57:10.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.785+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe68015d3d0 con 0x7fe6800ccb40 2023-10-09T12:57:10.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:10.975+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe68015d3d0 con 0x7fe6800ccb40 2023-10-09T12:57:11.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.535+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 82) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fe678050fa0 con 0x7fe6800ccb40 2023-10-09T12:57:11.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.535+0000 7fe6757fa700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe66406cad0 0x7fe66406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.537+0000 7fe68519b700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe66406cad0 0x7fe66406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.541+0000 7fe68519b700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe66406cad0 0x7fe66406eeb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe67c007fd0 tx=0x7fe67c009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:11.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.546+0000 7fe6757fa700 1 -- 172.21.15.86:0/1323511942 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v168) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe678070130 con 0x7fe6800ccb40 2023-10-09T12:57:11.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe66406cad0 msgr2=0x7fe66406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:11.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe66406cad0 0x7fe66406eeb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe67c007fd0 tx=0x7fe67c009040 comp rx=0 tx=0).stop 2023-10-09T12:57:11.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 msgr2=0x7fe6800c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:11.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800c5700 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c870 tx=0x7fe678001670 comp rx=0 tx=0).stop 2023-10-09T12:57:11.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 shutdown_connections 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe66406cad0 0x7fe66406eeb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6800ccb40 0x7fe6800c5700 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe680069cf0 0x7fe6800b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 --2- 172.21.15.86:0/1323511942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800cb560 0x7fe6800b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 >> 172.21.15.86:0/1323511942 conn(0x7fe68006baf0 msgr2=0x7fe6800c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 shutdown_connections 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.550+0000 7fe68619d700 1 -- 172.21.15.86:0/1323511942 wait complete. 2023-10-09T12:57:11.552 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T12:57:11.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T12:57:11.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.757+0000 7f5049fff700 1 Processor -- start 2023-10-09T12:57:11.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.758+0000 7f5049fff700 1 -- start start 2023-10-09T12:57:11.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f5049fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f504415a440 0x7f50440acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f5049fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 0x7f50440c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f5049fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504415a9b0 con 0x7f50441563b0 2023-10-09T12:57:11.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f5049fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504415ac90 con 0x7f504415a440 2023-10-09T12:57:11.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f5049fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504415af70 con 0x7f5044068890 2023-10-09T12:57:11.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f50437fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f50441563b0 0x7f5044156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39572/0 (socket says 172.21.15.86:39572) 2023-10-09T12:57:11.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f50437fe700 1 -- 172.21.15.86:0/2184192273 learned_addr learned my addr 172.21.15.86:0/2184192273 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:11.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f5042ffd700 1 --2- 172.21.15.86:0/2184192273 >> v2:172.21.15.135:3300/0 conn(0x7f504415a440 0x7f50440acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627143068 0 0) 0x7f504415a9b0 con 0x7f50441563b0 2023-10-09T12:57:11.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.759+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f502c003570 con 0x7f50441563b0 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f5043fff700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 0x7f50440c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1106175475 0 0) 0x7f502c003570 con 0x7f50441563b0 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 msgr2=0x7f50440c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 0x7f50440c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 >> v2:172.21.15.135:3300/0 conn(0x7f504415a440 msgr2=0x7f50440acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 --2- 172.21.15.86:0/2184192273 >> v2:172.21.15.135:3300/0 conn(0x7f504415a440 0x7f50440acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504415b250 con 0x7f50441563b0 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f5034001470 con 0x7f50441563b0 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 >> v1:172.21.15.86:6789/0 conn(0x7f50441563b0 legacy=0x7f5044156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:11.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f502c003a60 0x7f502c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c004810 0x7f502c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 0x7f502c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504415ac90 con 0x7f502c003a60 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504415af70 con 0x7f502c004810 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c00dc70 con 0x7f5044068890 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f50437fe700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f502c003a60 0x7f502c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f5042ffd700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c004810 0x7f502c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.760+0000 7f5043fff700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 0x7f502c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50437fe700 1 -- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 msgr2=0x7f502c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50437fe700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044068890 0x7f502c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50437fe700 1 -- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c004810 msgr2=0x7f502c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50437fe700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c004810 0x7f502c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50437fe700 1 -- 172.21.15.86:0/2184192273 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c003570 con 0x7f502c003a60 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50437fe700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f502c003a60 0x7f502c003e70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f503400c3f0 tx=0x7f5034001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851d815d93bc919d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400cc80 con 0x7f502c003a60 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400ce20 con 0x7f502c003a60 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.761+0000 7f50427fc700 1 -- 172.21.15.86:0/2184192273 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034005b70 con 0x7f502c003a60 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.762+0000 7f5049fff700 1 -- 172.21.15.86:0/2184192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f502c003a60 msgr2=0x7f502c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.762+0000 7f5049fff700 1 --2- 172.21.15.86:0/2184192273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f502c003a60 0x7f502c003e70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f503400c3f0 tx=0x7f5034001e90 comp rx=0 tx=0).stop 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.762+0000 7f5043fff700 1 -- 172.21.15.86:0/2184192273 reap_dead start 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.762+0000 7f5049fff700 1 -- 172.21.15.86:0/2184192273 shutdown_connections 2023-10-09T12:57:11.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.762+0000 7f5049fff700 1 -- 172.21.15.86:0/2184192273 >> 172.21.15.86:0/2184192273 conn(0x7f50440c8f90 msgr2=0x7f50440c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:11.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.762+0000 7f5049fff700 1 -- 172.21.15.86:0/2184192273 shutdown_connections 2023-10-09T12:57:11.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.762+0000 7f5049fff700 1 -- 172.21.15.86:0/2184192273 wait complete. 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.763+0000 7f5049fff700 1 Processor -- start 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.763+0000 7f5049fff700 1 -- start start 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5049fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c003a60 0x7f504414a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5049fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044153600 0x7f5044150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5049fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50440af2d0 0x7f50440af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5049fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044158af0 con 0x7f50440af2d0 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5049fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044151c80 con 0x7f502c003a60 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5049fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504414aec0 con 0x7f5044153600 2023-10-09T12:57:11.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5043fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50440af2d0 0x7f50440af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5043fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50440af2d0 0x7f50440af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54038/0 (socket says 172.21.15.86:54038) 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.764+0000 7f5043fff700 1 -- 172.21.15.86:0/3527102398 learned_addr learned my addr 172.21.15.86:0/3527102398 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f50437fe700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c003a60 0x7f504414a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5042ffd700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044153600 0x7f5044150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5043fff700 1 -- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044153600 msgr2=0x7f5044150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5043fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044153600 0x7f5044150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5043fff700 1 -- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c003a60 msgr2=0x7f504414a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5043fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c003a60 0x7f504414a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5043fff700 1 -- 172.21.15.86:0/3527102398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044151070 con 0x7f50440af2d0 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5043fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50440af2d0 0x7f50440af700 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f504406b950 tx=0x7f503c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:11.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00e040 con 0x7f50440af2d0 2023-10-09T12:57:11.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00f040 con 0x7f50440af2d0 2023-10-09T12:57:11.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5044151350 con 0x7f50440af2d0 2023-10-09T12:57:11.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00fe20 con 0x7f50440af2d0 2023-10-09T12:57:11.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.765+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5044151910 con 0x7f50440af2d0 2023-10-09T12:57:11.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.767+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5044151e10 con 0x7f50440af2d0 2023-10-09T12:57:11.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.767+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 82) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f503c015640 con 0x7f50440af2d0 2023-10-09T12:57:11.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.768+0000 7f502b7fe700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5030066d80 0x7f5030069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:11.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.768+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6360+0+0 (secure 0 0 0) 0x7f503c084e70 con 0x7f50440af2d0 2023-10-09T12:57:11.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.768+0000 7f50437fe700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5030066d80 0x7f5030069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:11.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.769+0000 7f50437fe700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5030066d80 0x7f5030069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f503400c3f0 tx=0x7f5034015000 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:11.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.772+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f503c052100 con 0x7f50440af2d0 2023-10-09T12:57:11.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:11.965+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50440718b0 con 0x7f50440af2d0 2023-10-09T12:57:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.563+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f503c059d50 con 0x7f50440af2d0 2023-10-09T12:57:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.564+0000 7f502b7fe700 1 -- 172.21.15.86:0/3527102398 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v169) v1 ==== 169+0+0 (secure 0 0 0) 0x7f503c04f410 con 0x7f50440af2d0 2023-10-09T12:57:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5030066d80 msgr2=0x7f5030069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5030066d80 0x7f5030069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f503400c3f0 tx=0x7f5034015000 comp rx=0 tx=0).stop 2023-10-09T12:57:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50440af2d0 msgr2=0x7f50440af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50440af2d0 0x7f50440af700 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f504406b950 tx=0x7f503c00b040 comp rx=0 tx=0).stop 2023-10-09T12:57:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 shutdown_connections 2023-10-09T12:57:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5030066d80 0x7f5030069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50440af2d0 0x7f50440af700 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f502c003a60 0x7f504414a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 --2- 172.21.15.86:0/3527102398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5044153600 0x7f5044150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 >> 172.21.15.86:0/3527102398 conn(0x7f50440c8f90 msgr2=0x7f504406e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 shutdown_connections 2023-10-09T12:57:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.568+0000 7f5049fff700 1 -- 172.21.15.86:0/3527102398 wait complete. 2023-10-09T12:57:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T12:57:12.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T12:57:12.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.772+0000 7f8ebffff700 1 Processor -- start 2023-10-09T12:57:12.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.772+0000 7f8ebffff700 1 -- start start 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb80ccee0 0x7f8eb81561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8eb80c87c0 0x7f8eb8156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb815b0d0 con 0x7f8eb80c83f0 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb8156c50 con 0x7f8eb80ccee0 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb815a4c0 con 0x7f8eb80c87c0 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebd59a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb80ccee0 0x7f8eb81561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebd59a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb80ccee0 0x7f8eb81561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54040/0 (socket says 172.21.15.86:54040) 2023-10-09T12:57:12.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3281842096 learned_addr learned my addr 172.21.15.86:0/3281842096 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebe59c700 1 --2- 172.21.15.86:0/3281842096 >> v2:172.21.15.135:3300/0 conn(0x7f8eb80c87c0 0x7f8eb8156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3281842096 >> v2:172.21.15.135:3300/0 conn(0x7f8eb80c87c0 msgr2=0x7f8eb8156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebd59a700 1 --2- 172.21.15.86:0/3281842096 >> v2:172.21.15.135:3300/0 conn(0x7f8eb80c87c0 0x7f8eb8156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3281842096 >> v1:172.21.15.135:6789/0 conn(0x7f8eb80c83f0 legacy=0x7f8eb80c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.774+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3281842096 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb815a7a0 con 0x7f8eb80ccee0 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.775+0000 7f8ebd59a700 1 --2- 172.21.15.86:0/3281842096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80ccee0 0x7f8eb81561d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f8eb806d240 tx=0x7f8ea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24219ffb269657ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.775+0000 7f8ebcd99700 1 -- 172.21.15.86:0/3281842096 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800b860 con 0x7f8eb80ccee0 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.775+0000 7f8ebcd99700 1 -- 172.21.15.86:0/3281842096 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800b9c0 con 0x7f8eb80ccee0 2023-10-09T12:57:12.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.775+0000 7f8ebcd99700 1 -- 172.21.15.86:0/3281842096 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800bd60 con 0x7f8eb80ccee0 2023-10-09T12:57:12.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.775+0000 7f8ebffff700 1 -- 172.21.15.86:0/3281842096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80ccee0 msgr2=0x7f8eb81561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:12.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.775+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3281842096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80ccee0 0x7f8eb81561d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f8eb806d240 tx=0x7f8ea8009250 comp rx=0 tx=0).stop 2023-10-09T12:57:12.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.776+0000 7f8ebffff700 1 -- 172.21.15.86:0/3281842096 shutdown_connections 2023-10-09T12:57:12.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.776+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3281842096 >> v2:172.21.15.135:3300/0 conn(0x7f8eb80c87c0 0x7f8eb8156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.776+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3281842096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80ccee0 0x7f8eb81561d0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.776+0000 7f8ebffff700 1 -- 172.21.15.86:0/3281842096 >> 172.21.15.86:0/3281842096 conn(0x7f8eb8068e10 msgr2=0x7f8eb80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:12.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.776+0000 7f8ebffff700 1 -- 172.21.15.86:0/3281842096 shutdown_connections 2023-10-09T12:57:12.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.776+0000 7f8ebffff700 1 -- 172.21.15.86:0/3281842096 wait complete. 2023-10-09T12:57:12.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.777+0000 7f8ebffff700 1 Processor -- start 2023-10-09T12:57:12.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.777+0000 7f8ebffff700 1 -- start start 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80c83f0 0x7f8eb80b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80c87c0 0x7f8eb80c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb80ccee0 0x7f8eb81553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8158d20 con 0x7f8eb80c87c0 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8158110 con 0x7f8eb80c83f0 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81583f0 con 0x7f8eb80ccee0 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebd59a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80c87c0 0x7f8eb80c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:12.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebd59a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80c87c0 0x7f8eb80c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54042/0 (socket says 172.21.15.86:54042) 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3833795066 learned_addr learned my addr 172.21.15.86:0/3833795066 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.778+0000 7f8ebdd9b700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80c83f0 0x7f8eb80b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebe59c700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb80ccee0 0x7f8eb81553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb80ccee0 msgr2=0x7f8eb81553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebd59a700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb80ccee0 0x7f8eb81553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80c83f0 msgr2=0x7f8eb80b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebd59a700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80c83f0 0x7f8eb80b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebd59a700 1 -- 172.21.15.86:0/3833795066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80094f0 con 0x7f8eb80c87c0 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebd59a700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80c87c0 0x7f8eb80c35e0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8063d40 tx=0x7f8ea8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8eadffb700 1 -- 172.21.15.86:0/3833795066 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8024440 con 0x7f8eb80c87c0 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8eadffb700 1 -- 172.21.15.86:0/3833795066 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea80245a0 con 0x7f8eb80c87c0 2023-10-09T12:57:12.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb81586d0 con 0x7f8eb80c87c0 2023-10-09T12:57:12.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.779+0000 7f8eadffb700 1 -- 172.21.15.86:0/3833795066 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8024960 con 0x7f8eb80c87c0 2023-10-09T12:57:12.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.780+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb80b1fb0 con 0x7f8eb80c87c0 2023-10-09T12:57:12.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.781+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb804c3c0 con 0x7f8eb80c87c0 2023-10-09T12:57:12.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.781+0000 7f8eadffb700 1 -- 172.21.15.86:0/3833795066 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ea8024d50 con 0x7f8eb80c87c0 2023-10-09T12:57:12.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.782+0000 7f8eadffb700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e9c066f60 0x7f8e9c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:12.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.782+0000 7f8eadffb700 1 -- 172.21.15.86:0/3833795066 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7f8ea80860d0 con 0x7f8eb80c87c0 2023-10-09T12:57:12.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.783+0000 7f8ebdd9b700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e9c066f60 0x7f8e9c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:12.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.783+0000 7f8ebdd9b700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e9c066f60 0x7f8e9c069410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4003a80 tx=0x7f8eb4007ec0 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:12.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.786+0000 7f8eadffb700 1 -- 172.21.15.86:0/3833795066 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ea8053250 con 0x7f8eb80c87c0 2023-10-09T12:57:12.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.976+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f8eb80cbd90 con 0x7f8eb80c87c0 2023-10-09T12:57:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.980+0000 7f8eadffb700 1 -- 172.21.15.86:0/3833795066 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v55) v1 ==== 115+0+0 (secure 0 0 0) 0x7f8ea802b340 con 0x7f8eb80c87c0 2023-10-09T12:57:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e9c066f60 msgr2=0x7f8e9c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e9c066f60 0x7f8e9c069410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4003a80 tx=0x7f8eb4007ec0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80c87c0 msgr2=0x7f8eb80c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80c87c0 0x7f8eb80c35e0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8063d40 tx=0x7f8ea8017000 comp rx=0 tx=0).stop 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 shutdown_connections 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb80ccee0 0x7f8eb81553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80c83f0 0x7f8eb80b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8e9c066f60 0x7f8e9c069410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 --2- 172.21.15.86:0/3833795066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb80c87c0 0x7f8eb80c35e0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 >> 172.21.15.86:0/3833795066 conn(0x7f8eb8068e10 msgr2=0x7f8eb80c2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 shutdown_connections 2023-10-09T12:57:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:12.983+0000 7f8ebffff700 1 -- 172.21.15.86:0/3833795066 wait complete. 2023-10-09T12:57:13.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T12:57:13.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.185+0000 7fe0047ff700 1 Processor -- start 2023-10-09T12:57:13.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.186+0000 7fe0047ff700 1 -- start start 2023-10-09T12:57:13.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe0047ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdffc0c83f0 0x7fdffc0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe0047ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 0x7fdffc0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe0047ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc15b0d0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe0047ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc0c7a60 con 0x7fdffc0c83f0 2023-10-09T12:57:13.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe0047ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc15a4c0 con 0x7fdffc1568e0 2023-10-09T12:57:13.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe00259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdffc0c83f0 0x7fdffc0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe00259b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdffc0c83f0 0x7fdffc0c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54044/0 (socket says 172.21.15.86:54044) 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe001d9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdffc0ccee0 0x7fdffc1561d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39574/0 (socket says 172.21.15.86:39574) 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe00259b700 1 -- 172.21.15.86:0/1909113305 learned_addr learned my addr 172.21.15.86:0/1909113305 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe00259b700 1 -- 172.21.15.86:0/1909113305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 msgr2=0x7fdffc0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe00259b700 1 --2- 172.21.15.86:0/1909113305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 0x7fdffc0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe00259b700 1 -- 172.21.15.86:0/1909113305 >> v1:172.21.15.86:6789/0 conn(0x7fdffc0ccee0 legacy=0x7fdffc1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe00259b700 1 -- 172.21.15.86:0/1909113305 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc15a7a0 con 0x7fdffc0c83f0 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.187+0000 7fe001599700 1 -- 172.21.15.86:0/1909113305 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524785262 0 0) 0x7fdffc15b0d0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.188+0000 7fe00259b700 1 --2- 172.21.15.86:0/1909113305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0c83f0 0x7fdffc0c7520 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fdff800bc50 tx=0x7fdff800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abc2f8fc6be35c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.188+0000 7fe001599700 1 -- 172.21.15.86:0/1909113305 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800be60 con 0x7fdffc0c83f0 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.188+0000 7fe001599700 1 -- 172.21.15.86:0/1909113305 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800de00 con 0x7fdffc0c83f0 2023-10-09T12:57:13.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.188+0000 7fe001599700 1 -- 172.21.15.86:0/1909113305 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80196b0 con 0x7fdffc0c83f0 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.188+0000 7fe0047ff700 1 -- 172.21.15.86:0/1909113305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0c83f0 msgr2=0x7fdffc0c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.188+0000 7fe0047ff700 1 --2- 172.21.15.86:0/1909113305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0c83f0 0x7fdffc0c7520 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fdff800bc50 tx=0x7fdff800b4f0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.189+0000 7fe0047ff700 1 -- 172.21.15.86:0/1909113305 shutdown_connections 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.189+0000 7fe0047ff700 1 --2- 172.21.15.86:0/1909113305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 0x7fdffc0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.189+0000 7fe0047ff700 1 --2- 172.21.15.86:0/1909113305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0c83f0 0x7fdffc0c7520 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.189+0000 7fe0047ff700 1 -- 172.21.15.86:0/1909113305 >> 172.21.15.86:0/1909113305 conn(0x7fdffc068e10 msgr2=0x7fdffc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.189+0000 7fe0047ff700 1 -- 172.21.15.86:0/1909113305 shutdown_connections 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.189+0000 7fe0047ff700 1 -- 172.21.15.86:0/1909113305 wait complete. 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.190+0000 7fe0047ff700 1 Processor -- start 2023-10-09T12:57:13.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.190+0000 7fe0047ff700 1 -- start start 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe0047ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdffc0c83f0 0x7fdffc0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe0047ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0ccee0 0x7fdffc168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe0047ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 0x7fdffc0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe0047ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc169ce0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe0047ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0b10a0 con 0x7fdffc0c83f0 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe0047ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc169720 con 0x7fdffc1568e0 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe001d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0ccee0 0x7fdffc168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe001d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0ccee0 0x7fdffc168dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54052/0 (socket says 172.21.15.86:54052) 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe001d9a700 1 -- 172.21.15.86:0/3526409716 learned_addr learned my addr 172.21.15.86:0/3526409716 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe00259b700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdffc0c83f0 0x7fdffc0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.191+0000 7fe002d9c700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 0x7fdffc0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe001d9a700 1 -- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 msgr2=0x7fdffc0b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe001d9a700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 0x7fdffc0b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe001d9a700 1 -- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdffc0c83f0 msgr2=0x7fdffc0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe001d9a700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdffc0c83f0 0x7fdffc0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe001d9a700 1 -- 172.21.15.86:0/3526409716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff800b790 con 0x7fdffc0ccee0 2023-10-09T12:57:13.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe001d9a700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0ccee0 0x7fdffc168dd0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0011e0 tx=0x7fdfec007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:13.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fdff27fc700 1 -- 172.21.15.86:0/3526409716 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec005a70 con 0x7fdffc0ccee0 2023-10-09T12:57:13.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fdff27fc700 1 -- 172.21.15.86:0/3526409716 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec005bd0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fdff27fc700 1 -- 172.21.15.86:0/3526409716 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0070d0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc169a00 con 0x7fdffc0ccee0 2023-10-09T12:57:13.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.192+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc0b08a0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.193+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc0b0b90 con 0x7fdffc0ccee0 2023-10-09T12:57:13.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.194+0000 7fdff27fc700 1 -- 172.21.15.86:0/3526409716 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfec007480 con 0x7fdffc0ccee0 2023-10-09T12:57:13.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.195+0000 7fdff27fc700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfe0066f60 0x7fdfe0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.196+0000 7fdff27fc700 1 -- 172.21.15.86:0/3526409716 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7fdfec083a40 con 0x7fdffc0ccee0 2023-10-09T12:57:13.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.196+0000 7fe00259b700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfe0066f60 0x7fdfe0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.196+0000 7fe00259b700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfe0066f60 0x7fdfe0069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdff800bc50 tx=0x7fdff801b000 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:13.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.200+0000 7fdff27fc700 1 -- 172.21.15.86:0/3526409716 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfec04b5a0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.395+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fdffc04c3c0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.400+0000 7fdff27fc700 1 -- 172.21.15.86:0/3526409716 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v56) v1 ==== 120+0+0 (secure 0 0 0) 0x7fdfec0170b0 con 0x7fdffc0ccee0 2023-10-09T12:57:13.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfe0066f60 msgr2=0x7fdfe0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfe0066f60 0x7fdfe0069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdff800bc50 tx=0x7fdff801b000 comp rx=0 tx=0).stop 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0ccee0 msgr2=0x7fdffc168dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0ccee0 0x7fdffc168dd0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0011e0 tx=0x7fdfec007e10 comp rx=0 tx=0).stop 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 shutdown_connections 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdffc1568e0 0x7fdffc0b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdffc0c83f0 0x7fdffc0b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fdfe0066f60 0x7fdfe0069410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 --2- 172.21.15.86:0/3526409716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc0ccee0 0x7fdffc168dd0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 >> 172.21.15.86:0/3526409716 conn(0x7fdffc068e10 msgr2=0x7fdffc069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 shutdown_connections 2023-10-09T12:57:13.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.403+0000 7fe0047ff700 1 -- 172.21.15.86:0/3526409716 wait complete. 2023-10-09T12:57:13.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T12:57:13.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.605+0000 7f393e39d700 1 Processor -- start 2023-10-09T12:57:13.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.605+0000 7f393e39d700 1 -- start start 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.606+0000 7f393e39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393815a3b0 0x7f393815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.606+0000 7f393e39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f393806e470 0x7f393806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.606+0000 7f393e39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380aea70 con 0x7f39380aef00 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.606+0000 7f393e39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393806ee30 con 0x7f393806e470 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.606+0000 7f393e39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393815dad0 con 0x7f393815a3b0 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f393806e470 0x7f393806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f393806e470 0x7f393806e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54068/0 (socket says 172.21.15.86:54068) 2023-10-09T12:57:13.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 -- 172.21.15.86:0/4253722482 learned_addr learned my addr 172.21.15.86:0/4253722482 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393d39b700 1 --2- 172.21.15.86:0/4253722482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393815a3b0 0x7f393815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 -- 172.21.15.86:0/4253722482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393815a3b0 msgr2=0x7f393815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 --2- 172.21.15.86:0/4253722482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393815a3b0 0x7f393815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 -- 172.21.15.86:0/4253722482 >> v1:172.21.15.135:6789/0 conn(0x7f39380aef00 legacy=0x7f393815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 -- 172.21.15.86:0/4253722482 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380ae480 con 0x7f393806e470 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f393db9c700 1 --2- 172.21.15.86:0/4253722482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f393806e470 0x7f393806e8f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f3930009f20 tx=0x7f3930009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcef1cfbf8f72a6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.607+0000 7f392ffff700 1 -- 172.21.15.86:0/4253722482 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000e070 con 0x7f393806e470 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f392ffff700 1 -- 172.21.15.86:0/4253722482 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000b9d0 con 0x7f393806e470 2023-10-09T12:57:13.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f392ffff700 1 -- 172.21.15.86:0/4253722482 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39300092e0 con 0x7f393806e470 2023-10-09T12:57:13.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 -- 172.21.15.86:0/4253722482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f393806e470 msgr2=0x7f393806e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 --2- 172.21.15.86:0/4253722482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f393806e470 0x7f393806e8f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f3930009f20 tx=0x7f3930009840 comp rx=0 tx=0).stop 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 -- 172.21.15.86:0/4253722482 shutdown_connections 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 --2- 172.21.15.86:0/4253722482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f393806e470 0x7f393806e8f0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 --2- 172.21.15.86:0/4253722482 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393815a3b0 0x7f393815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 -- 172.21.15.86:0/4253722482 >> 172.21.15.86:0/4253722482 conn(0x7f39380c9f70 msgr2=0x7f393806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 -- 172.21.15.86:0/4253722482 shutdown_connections 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.608+0000 7f393e39d700 1 -- 172.21.15.86:0/4253722482 wait complete. 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.610+0000 7f393e39d700 1 Processor -- start 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.610+0000 7f393e39d700 1 -- start start 2023-10-09T12:57:13.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393e39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393806e470 0x7f393806a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393e39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380aef00 0x7f393806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393e39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393815a3b0 0x7f393806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393e39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393806b430 con 0x7f39380aef00 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393e39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393806b680 con 0x7f393815a3b0 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393e39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393806b960 con 0x7f393806e470 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380aef00 0x7f393806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380aef00 0x7f393806a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54070/0 (socket says 172.21.15.86:54070) 2023-10-09T12:57:13.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 -- 172.21.15.86:0/3162389928 learned_addr learned my addr 172.21.15.86:0/3162389928 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393d39b700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393806e470 0x7f393806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393db9c700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393815a3b0 0x7f393806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 -- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393806e470 msgr2=0x7f393806a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393806e470 0x7f393806a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 -- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393815a3b0 msgr2=0x7f393806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393815a3b0 0x7f393806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.611+0000 7f393cb9a700 1 -- 172.21.15.86:0/3162389928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930009ae0 con 0x7f39380aef00 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.612+0000 7f393cb9a700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380aef00 0x7f393806a9b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f392800c590 tx=0x7f392800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:13.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.612+0000 7f392d7fa700 1 -- 172.21.15.86:0/3162389928 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928011590 con 0x7f39380aef00 2023-10-09T12:57:13.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.612+0000 7f392d7fa700 1 -- 172.21.15.86:0/3162389928 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928011710 con 0x7f39380aef00 2023-10-09T12:57:13.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.612+0000 7f392d7fa700 1 -- 172.21.15.86:0/3162389928 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928011ad0 con 0x7f39380aef00 2023-10-09T12:57:13.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.612+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393806bc40 con 0x7f39380aef00 2023-10-09T12:57:13.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.612+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393806c200 con 0x7f39380aef00 2023-10-09T12:57:13.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.613+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393806cfa0 con 0x7f39380aef00 2023-10-09T12:57:13.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.614+0000 7f392d7fa700 1 -- 172.21.15.86:0/3162389928 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f392801b3b0 con 0x7f39380aef00 2023-10-09T12:57:13.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.615+0000 7f392d7fa700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:13.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.615+0000 7f392d7fa700 1 -- 172.21.15.86:0/3162389928 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7f3928083b30 con 0x7f39380aef00 2023-10-09T12:57:13.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.615+0000 7f393d39b700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:13.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.616+0000 7f393d39b700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f391c066f30 0x7f391c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3934009d10 tx=0x7f39340091a0 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:13.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.619+0000 7f392d7fa700 1 -- 172.21.15.86:0/3162389928 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3928050c10 con 0x7f39380aef00 2023-10-09T12:57:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.814+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f393815a070 con 0x7f39380aef00 2023-10-09T12:57:13.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.818+0000 7f392d7fa700 1 -- 172.21.15.86:0/3162389928 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3928017020 con 0x7f39380aef00 2023-10-09T12:57:13.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f391c066f30 msgr2=0x7f391c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f391c066f30 0x7f391c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3934009d10 tx=0x7f39340091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380aef00 msgr2=0x7f393806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380aef00 0x7f393806a9b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f392800c590 tx=0x7f392800c8a0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 shutdown_connections 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f393815a3b0 0x7f393806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f393806e470 0x7f393806a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f391c066f30 0x7f391c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 --2- 172.21.15.86:0/3162389928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380aef00 0x7f393806a9b0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 >> 172.21.15.86:0/3162389928 conn(0x7f39380c9f70 msgr2=0x7f39381524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 shutdown_connections 2023-10-09T12:57:13.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:13.821+0000 7f393e39d700 1 -- 172.21.15.86:0/3162389928 wait complete. 2023-10-09T12:57:13.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-09T12:57:14.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.019+0000 7f93c05ff700 1 Processor -- start 2023-10-09T12:57:14.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.019+0000 7f93c05ff700 1 -- start start 2023-10-09T12:57:14.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.020+0000 7f93c05ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f93b80b1420 0x7f93b80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.020+0000 7f93c05ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f93b80ccf90 0x7f93b80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.020+0000 7f93c05ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b80cc300 con 0x7f93b80cbf30 2023-10-09T12:57:14.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.020+0000 7f93c05ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b8156bf0 con 0x7f93b80b1420 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.020+0000 7f93c05ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80ae950 con 0x7f93b80ccf90 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f93b80b1420 0x7f93b80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f93b80b1420 0x7f93b80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54086/0 (socket says 172.21.15.86:54086) 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 -- 172.21.15.86:0/3171644328 learned_addr learned my addr 172.21.15.86:0/3171644328 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93beb9c700 1 --2- 172.21.15.86:0/3171644328 >> v2:172.21.15.135:3300/0 conn(0x7f93b80ccf90 0x7f93b80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 -- 172.21.15.86:0/3171644328 >> v2:172.21.15.135:3300/0 conn(0x7f93b80ccf90 msgr2=0x7f93b80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 --2- 172.21.15.86:0/3171644328 >> v2:172.21.15.135:3300/0 conn(0x7f93b80ccf90 0x7f93b80c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 -- 172.21.15.86:0/3171644328 >> v1:172.21.15.135:6789/0 conn(0x7f93b80cbf30 legacy=0x7f93b80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 -- 172.21.15.86:0/3171644328 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80ad370 con 0x7f93b80b1420 2023-10-09T12:57:14.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.021+0000 7f93bdb9a700 1 --2- 172.21.15.86:0/3171644328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b80ae410 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f93b80c8fd0 tx=0x7f93a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789bbdba8f1d0b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:14.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93bd399700 1 -- 172.21.15.86:0/3171644328 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800b820 con 0x7f93b80b1420 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93bd399700 1 -- 172.21.15.86:0/3171644328 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800b980 con 0x7f93b80b1420 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93bd399700 1 -- 172.21.15.86:0/3171644328 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800bd20 con 0x7f93b80b1420 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93c05ff700 1 -- 172.21.15.86:0/3171644328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 msgr2=0x7f93b80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93c05ff700 1 --2- 172.21.15.86:0/3171644328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b80ae410 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f93b80c8fd0 tx=0x7f93a8009250 comp rx=0 tx=0).stop 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93c05ff700 1 -- 172.21.15.86:0/3171644328 shutdown_connections 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93c05ff700 1 --2- 172.21.15.86:0/3171644328 >> v2:172.21.15.135:3300/0 conn(0x7f93b80ccf90 0x7f93b80c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93c05ff700 1 --2- 172.21.15.86:0/3171644328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b80ae410 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93c05ff700 1 -- 172.21.15.86:0/3171644328 >> 172.21.15.86:0/3171644328 conn(0x7f93b806a320 msgr2=0x7f93b80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.022+0000 7f93c05ff700 1 -- 172.21.15.86:0/3171644328 shutdown_connections 2023-10-09T12:57:14.025 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.023+0000 7f93c05ff700 1 -- 172.21.15.86:0/3171644328 wait complete. 2023-10-09T12:57:14.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.024+0000 7f93c05ff700 1 Processor -- start 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.024+0000 7f93c05ff700 1 -- start start 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93c05ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b81557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93c05ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80cbf30 0x7f93b80a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93c05ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b80ccf90 0x7f93b81592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93c05ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8158e10 con 0x7f93b80b1420 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93c05ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8155d20 con 0x7f93b80cbf30 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93c05ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8158200 con 0x7f93b80ccf90 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93be39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b81557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93be39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b81557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54098/0 (socket says 172.21.15.86:54098) 2023-10-09T12:57:14.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.025+0000 7f93be39b700 1 -- 172.21.15.86:0/82630671 learned_addr learned my addr 172.21.15.86:0/82630671 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93bdb9a700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80cbf30 0x7f93b80a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93beb9c700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b80ccf90 0x7f93b81592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93be39b700 1 -- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b80ccf90 msgr2=0x7f93b81592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93be39b700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b80ccf90 0x7f93b81592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93be39b700 1 -- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80cbf30 msgr2=0x7f93b80a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93be39b700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80cbf30 0x7f93b80a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93be39b700 1 -- 172.21.15.86:0/82630671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80094f0 con 0x7f93b80b1420 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93bdb9a700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80cbf30 0x7f93b80a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93beb9c700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b80ccf90 0x7f93b81592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93be39b700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b81557e0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c590 tx=0x7f93b400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:14.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93ae7fc700 1 -- 172.21.15.86:0/82630671 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4011590 con 0x7f93b80b1420 2023-10-09T12:57:14.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93ae7fc700 1 -- 172.21.15.86:0/82630671 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40116f0 con 0x7f93b80b1420 2023-10-09T12:57:14.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b81584e0 con 0x7f93b80b1420 2023-10-09T12:57:14.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93ae7fc700 1 -- 172.21.15.86:0/82630671 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4011ab0 con 0x7f93b80b1420 2023-10-09T12:57:14.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.026+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b8158aa0 con 0x7f93b80b1420 2023-10-09T12:57:14.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.027+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b804c3c0 con 0x7f93b80b1420 2023-10-09T12:57:14.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.028+0000 7f93ae7fc700 1 -- 172.21.15.86:0/82630671 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93b401b3b0 con 0x7f93b80b1420 2023-10-09T12:57:14.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.029+0000 7f93ae7fc700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f939c066f30 0x7f939c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.029+0000 7f93ae7fc700 1 -- 172.21.15.86:0/82630671 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7f93b4083bd0 con 0x7f93b80b1420 2023-10-09T12:57:14.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.029+0000 7f93bdb9a700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f939c066f30 0x7f939c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.030+0000 7f93bdb9a700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f939c066f30 0x7f939c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93b80c8fd0 tx=0x7f93a8017000 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:14.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.033+0000 7f93ae7fc700 1 -- 172.21.15.86:0/82630671 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93b4050d50 con 0x7f93b80b1420 2023-10-09T12:57:14.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.298+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f93b80ad650 con 0x7f93b80b1420 2023-10-09T12:57:14.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.561+0000 7f93ae7fc700 1 -- 172.21.15.86:0/82630671 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2462) v1 ==== 174+0+0 (secure 0 0 0) 0x7f93b4017070 con 0x7f93b80b1420 2023-10-09T12:57:14.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f939c066f30 msgr2=0x7f939c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f939c066f30 0x7f939c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93b80c8fd0 tx=0x7f93a8017000 comp rx=0 tx=0).stop 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 msgr2=0x7f93b81557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b81557e0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c590 tx=0x7f93b400c950 comp rx=0 tx=0).stop 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 shutdown_connections 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f939c066f30 0x7f939c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b80b1420 0x7f93b81557e0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93b80ccf90 0x7f93b81592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 --2- 172.21.15.86:0/82630671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93b80cbf30 0x7f93b80a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 >> 172.21.15.86:0/82630671 conn(0x7f93b806a320 msgr2=0x7f93b80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:14.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 shutdown_connections 2023-10-09T12:57:14.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.563+0000 7f93c05ff700 1 -- 172.21.15.86:0/82630671 wait complete. 2023-10-09T12:57:14.582 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-10-09T12:57:14.582 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-10-09T12:57:14.583 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T12:57:14.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-09T12:57:14.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.763+0000 7f85639ff700 1 Processor -- start 2023-10-09T12:57:14.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.764+0000 7f85639ff700 1 -- start start 2023-10-09T12:57:14.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f85639ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f855c0cbf30 0x7f855c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f85639ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c0ccf90 0x7f855c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f85639ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c0cc300 con 0x7f855c15a270 2023-10-09T12:57:14.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f85639ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c156bf0 con 0x7f855c0cbf30 2023-10-09T12:57:14.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f85639ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0ae950 con 0x7f855c0ccf90 2023-10-09T12:57:14.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f856179b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f855c0cbf30 0x7f855c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f8561f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f855c15a270 0x7f855c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:39586/0 (socket says 172.21.15.86:39586) 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f8561f9c700 1 -- 172.21.15.86:0/3252675960 learned_addr learned my addr 172.21.15.86:0/3252675960 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.765+0000 7f8560f9a700 1 --2- 172.21.15.86:0/3252675960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c0ccf90 0x7f855c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f856179b700 1 -- 172.21.15.86:0/3252675960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c0ccf90 msgr2=0x7f855c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f856179b700 1 --2- 172.21.15.86:0/3252675960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c0ccf90 0x7f855c0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f856179b700 1 -- 172.21.15.86:0/3252675960 >> v1:172.21.15.86:6789/0 conn(0x7f855c15a270 legacy=0x7f855c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f856179b700 1 -- 172.21.15.86:0/3252675960 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0ad370 con 0x7f855c0cbf30 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f8553fff700 1 -- 172.21.15.86:0/3252675960 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131204629 0 0) 0x7f855c0cc300 con 0x7f855c15a270 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f856179b700 1 --2- 172.21.15.86:0/3252675960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c0ae410 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8558009910 tx=0x7f85580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd70e76d894e7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f8553fff700 1 -- 172.21.15.86:0/3252675960 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800b820 con 0x7f855c0cbf30 2023-10-09T12:57:14.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f8553fff700 1 -- 172.21.15.86:0/3252675960 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855800b980 con 0x7f855c0cbf30 2023-10-09T12:57:14.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.766+0000 7f8553fff700 1 -- 172.21.15.86:0/3252675960 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800bd20 con 0x7f855c0cbf30 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 -- 172.21.15.86:0/3252675960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 msgr2=0x7f855c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 --2- 172.21.15.86:0/3252675960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c0ae410 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8558009910 tx=0x7f85580091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 -- 172.21.15.86:0/3252675960 shutdown_connections 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 --2- 172.21.15.86:0/3252675960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c0ae410 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 --2- 172.21.15.86:0/3252675960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c0ccf90 0x7f855c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 -- 172.21.15.86:0/3252675960 >> 172.21.15.86:0/3252675960 conn(0x7f855c06a320 msgr2=0x7f855c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 -- 172.21.15.86:0/3252675960 shutdown_connections 2023-10-09T12:57:14.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.767+0000 7f85639ff700 1 -- 172.21.15.86:0/3252675960 wait complete. 2023-10-09T12:57:14.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.768+0000 7f85639ff700 1 Processor -- start 2023-10-09T12:57:14.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.768+0000 7f85639ff700 1 -- start start 2023-10-09T12:57:14.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f85639ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f85639ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855c0ccf90 0x7f855c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f85639ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c15a270 0x7f855c0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f85639ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c16dc60 con 0x7f855c0cbf30 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f85639ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c16d090 con 0x7f855c0ccf90 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f85639ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c16d330 con 0x7f855c15a270 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f856179b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f856179b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54116/0 (socket says 172.21.15.86:54116) 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.769+0000 7f856179b700 1 -- 172.21.15.86:0/1518263278 learned_addr learned my addr 172.21.15.86:0/1518263278 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f8560f9a700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855c0ccf90 0x7f855c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f8561f9c700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c15a270 0x7f855c0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f856179b700 1 -- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c15a270 msgr2=0x7f855c0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f856179b700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c15a270 0x7f855c0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f856179b700 1 -- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855c0ccf90 msgr2=0x7f855c0c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f856179b700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855c0ccf90 0x7f855c0c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f856179b700 1 -- 172.21.15.86:0/1518263278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558009420 con 0x7f855c0cbf30 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f856179b700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c147fb0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f855800b3c0 tx=0x7f8558017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.770+0000 7f85517fa700 1 -- 172.21.15.86:0/1518263278 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855801f070 con 0x7f855c0cbf30 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.771+0000 7f85517fa700 1 -- 172.21.15.86:0/1518263278 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8558002f70 con 0x7f855c0cbf30 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.771+0000 7f85517fa700 1 -- 172.21.15.86:0/1518263278 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558011d40 con 0x7f855c0cbf30 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.771+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c16d610 con 0x7f855c0cbf30 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.771+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c1484f0 con 0x7f855c0cbf30 2023-10-09T12:57:14.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.772+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c16df40 con 0x7f855c0cbf30 2023-10-09T12:57:14.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.773+0000 7f85517fa700 1 -- 172.21.15.86:0/1518263278 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8558023070 con 0x7f855c0cbf30 2023-10-09T12:57:14.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.773+0000 7f85517fa700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:14.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.773+0000 7f85517fa700 1 -- 172.21.15.86:0/1518263278 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7f85580859d0 con 0x7f855c0cbf30 2023-10-09T12:57:14.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.774+0000 7f8560f9a700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:14.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.774+0000 7f8560f9a700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8540066f30 0x7f85400693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f855c156210 tx=0x7f854c008040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:14.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:14.778+0000 7f85517fa700 1 -- 172.21.15.86:0/1518263278 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8558052ab0 con 0x7f855c0cbf30 2023-10-09T12:57:15.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.045+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f855c04c3c0 con 0x7f855c0cbf30 2023-10-09T12:57:15.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.560+0000 7f85517fa700 1 -- 172.21.15.86:0/1518263278 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2463) v1 ==== 168+0+0 (secure 0 0 0) 0x7f85580560d0 con 0x7f855c0cbf30 2023-10-09T12:57:15.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8540066f30 msgr2=0x7f85400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8540066f30 0x7f85400693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f855c156210 tx=0x7f854c008040 comp rx=0 tx=0).stop 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 msgr2=0x7f855c147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c147fb0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f855800b3c0 tx=0x7f8558017000 comp rx=0 tx=0).stop 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 shutdown_connections 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8540066f30 0x7f85400693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f855c0cbf30 0x7f855c147fb0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f855c15a270 0x7f855c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 --2- 172.21.15.86:0/1518263278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f855c0ccf90 0x7f855c0c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 >> 172.21.15.86:0/1518263278 conn(0x7f855c06a320 msgr2=0x7f855c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:15.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 shutdown_connections 2023-10-09T12:57:15.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.563+0000 7f85639ff700 1 -- 172.21.15.86:0/1518263278 wait complete. 2023-10-09T12:57:15.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T12:57:15.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.766+0000 7f781f7ff700 1 Processor -- start 2023-10-09T12:57:15.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.766+0000 7f781f7ff700 1 -- start start 2023-10-09T12:57:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781f7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7818155eb0 0x7f781806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781f7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7818069e80 0x7f78180ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781f7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781806eb90 con 0x7f78180c70b0 2023-10-09T12:57:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781f7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781806ee70 con 0x7f7818155eb0 2023-10-09T12:57:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781f7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781806f150 con 0x7f7818069e80 2023-10-09T12:57:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781d59b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7818155eb0 0x7f781806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:15.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781d59b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7818155eb0 0x7f781806e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52426/0 (socket says 172.21.15.86:52426) 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781d59b700 1 -- 172.21.15.86:0/2039152220 learned_addr learned my addr 172.21.15.86:0/2039152220 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781dd9c700 1 --2- 172.21.15.86:0/2039152220 >> v2:172.21.15.135:3300/0 conn(0x7f7818069e80 0x7f78180ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781d59b700 1 -- 172.21.15.86:0/2039152220 >> v2:172.21.15.135:3300/0 conn(0x7f7818069e80 msgr2=0x7f78180ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781d59b700 1 --2- 172.21.15.86:0/2039152220 >> v2:172.21.15.135:3300/0 conn(0x7f7818069e80 0x7f78180ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.768+0000 7f781d59b700 1 -- 172.21.15.86:0/2039152220 >> v1:172.21.15.135:6789/0 conn(0x7f78180c70b0 legacy=0x7f7818069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.769+0000 7f781d59b700 1 -- 172.21.15.86:0/2039152220 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781806f430 con 0x7f7818155eb0 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.769+0000 7f781d59b700 1 --2- 172.21.15.86:0/2039152220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7818155eb0 0x7f781806e240 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f781806d270 tx=0x7f7814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b9c911579a8c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:15.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.769+0000 7f780ffff700 1 -- 172.21.15.86:0/2039152220 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400b860 con 0x7f7818155eb0 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.769+0000 7f780ffff700 1 -- 172.21.15.86:0/2039152220 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400b9c0 con 0x7f7818155eb0 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.769+0000 7f780ffff700 1 -- 172.21.15.86:0/2039152220 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400bd60 con 0x7f7818155eb0 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 -- 172.21.15.86:0/2039152220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7818155eb0 msgr2=0x7f781806e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 --2- 172.21.15.86:0/2039152220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7818155eb0 0x7f781806e240 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f781806d270 tx=0x7f7814009250 comp rx=0 tx=0).stop 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 -- 172.21.15.86:0/2039152220 shutdown_connections 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 --2- 172.21.15.86:0/2039152220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7818155eb0 0x7f781806e240 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 --2- 172.21.15.86:0/2039152220 >> v2:172.21.15.135:3300/0 conn(0x7f7818069e80 0x7f78180ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 -- 172.21.15.86:0/2039152220 >> 172.21.15.86:0/2039152220 conn(0x7f7818068e10 msgr2=0x7f78180cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:15.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 -- 172.21.15.86:0/2039152220 shutdown_connections 2023-10-09T12:57:15.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.770+0000 7f781f7ff700 1 -- 172.21.15.86:0/2039152220 wait complete. 2023-10-09T12:57:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.771+0000 7f781f7ff700 1 Processor -- start 2023-10-09T12:57:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.771+0000 7f781f7ff700 1 -- start start 2023-10-09T12:57:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781f7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7818069e80 0x7f7818153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:15.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781f7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78180c70b0 0x7f78180c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781f7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7818155eb0 0x7f78180c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781f7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818153590 con 0x7f78180c70b0 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781f7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180ac7d0 con 0x7f7818155eb0 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781f7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78180abbc0 con 0x7f7818069e80 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781cd9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78180c70b0 0x7f78180c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781cd9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78180c70b0 0x7f78180c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52436/0 (socket says 172.21.15.86:52436) 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.772+0000 7f781cd9a700 1 -- 172.21.15.86:0/1474476533 learned_addr learned my addr 172.21.15.86:0/1474476533 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:15.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781dd9c700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7818155eb0 0x7f78180c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781d59b700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7818069e80 0x7f7818153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781cd9a700 1 -- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7818069e80 msgr2=0x7f7818153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781cd9a700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7818069e80 0x7f7818153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781cd9a700 1 -- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7818155eb0 msgr2=0x7f78180c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781cd9a700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7818155eb0 0x7f78180c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781cd9a700 1 -- 172.21.15.86:0/1474476533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140094f0 con 0x7f78180c70b0 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781dd9c700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7818155eb0 0x7f78180c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781cd9a700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78180c70b0 0x7f78180c3fb0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f780800c590 tx=0x7f780800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:15.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f780d7fa700 1 -- 172.21.15.86:0/1474476533 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808011590 con 0x7f78180c70b0 2023-10-09T12:57:15.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f780d7fa700 1 -- 172.21.15.86:0/1474476533 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78080116f0 con 0x7f78180c70b0 2023-10-09T12:57:15.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78180abea0 con 0x7f78180c70b0 2023-10-09T12:57:15.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f780d7fa700 1 -- 172.21.15.86:0/1474476533 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808011ab0 con 0x7f78180c70b0 2023-10-09T12:57:15.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.773+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78180ac460 con 0x7f78180c70b0 2023-10-09T12:57:15.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.774+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781804c3c0 con 0x7f78180c70b0 2023-10-09T12:57:15.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.775+0000 7f780d7fa700 1 -- 172.21.15.86:0/1474476533 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f780801b3b0 con 0x7f78180c70b0 2023-10-09T12:57:15.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.776+0000 7f780d7fa700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f77fc066f30 0x7f77fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:15.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.776+0000 7f780d7fa700 1 -- 172.21.15.86:0/1474476533 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7f7808083bb0 con 0x7f78180c70b0 2023-10-09T12:57:15.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.776+0000 7f781d59b700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f77fc066f30 0x7f77fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:15.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.777+0000 7f781d59b700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f77fc066f30 0x7f77fc0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f781806d270 tx=0x7f7814017000 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:15.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.780+0000 7f780d7fa700 1 -- 172.21.15.86:0/1474476533 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7808050d30 con 0x7f78180c70b0 2023-10-09T12:57:15.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.969+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7818156280 con 0x7f78180c70b0 2023-10-09T12:57:15.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.973+0000 7f780d7fa700 1 -- 172.21.15.86:0/1474476533 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7808017070 con 0x7f78180c70b0 2023-10-09T12:57:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f77fc066f30 msgr2=0x7f77fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f77fc066f30 0x7f77fc0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f781806d270 tx=0x7f7814017000 comp rx=0 tx=0).stop 2023-10-09T12:57:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78180c70b0 msgr2=0x7f78180c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:15.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78180c70b0 0x7f78180c3fb0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f780800c590 tx=0x7f780800c950 comp rx=0 tx=0).stop 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 shutdown_connections 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7818155eb0 0x7f78180c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7818069e80 0x7f7818153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f77fc066f30 0x7f77fc0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 --2- 172.21.15.86:0/1474476533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78180c70b0 0x7f78180c3fb0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 >> 172.21.15.86:0/1474476533 conn(0x7f7818068e10 msgr2=0x7f78180c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 shutdown_connections 2023-10-09T12:57:15.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:15.976+0000 7f781f7ff700 1 -- 172.21.15.86:0/1474476533 wait complete. 2023-10-09T12:57:15.994 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T12:57:15.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:57:16.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T12:57:16.156 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T12:57:16.157 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T12:57:16.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:57:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.338+0000 7f0d5efff700 1 Processor -- start 2023-10-09T12:57:16.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.338+0000 7f0d5efff700 1 -- start start 2023-10-09T12:57:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.339+0000 7f0d5efff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58155c10 0x7f0d58155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d5efff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0d580ac6a0 0x7f0d580b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d5efff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d580acac0 con 0x7f0d580ac230 2023-10-09T12:57:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d5efff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d580ad930 con 0x7f0d580ac6a0 2023-10-09T12:57:16.341 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d5efff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580acd20 con 0x7f0d58155c10 2023-10-09T12:57:16.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d5d59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0d580ac6a0 0x7f0d580b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d57fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0d580ac230 0x7f0d581568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:37416/0 (socket says 172.21.15.86:37416) 2023-10-09T12:57:16.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d57fff700 1 -- 172.21.15.86:0/2365344703 learned_addr learned my addr 172.21.15.86:0/2365344703 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.340+0000 7f0d5cd9b700 1 --2- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58155c10 0x7f0d58155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d5d59c700 1 -- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58155c10 msgr2=0x7f0d58155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d5d59c700 1 --2- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58155c10 0x7f0d58155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d5d59c700 1 -- 172.21.15.86:0/2365344703 >> v1:172.21.15.135:6789/0 conn(0x7f0d580ac230 legacy=0x7f0d581568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d5d59c700 1 -- 172.21.15.86:0/2365344703 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d580ad000 con 0x7f0d580ac6a0 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d5d59c700 1 --2- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac6a0 0x7f0d580b0300 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009e60 tx=0x7f0d50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60e20e0fae8ebe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d577fe700 1 -- 172.21.15.86:0/2365344703 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000e070 con 0x7f0d580ac6a0 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d577fe700 1 -- 172.21.15.86:0/2365344703 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5000bb60 con 0x7f0d580ac6a0 2023-10-09T12:57:16.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.341+0000 7f0d577fe700 1 -- 172.21.15.86:0/2365344703 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50012430 con 0x7f0d580ac6a0 2023-10-09T12:57:16.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 -- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac6a0 msgr2=0x7f0d580b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac6a0 0x7f0d580b0300 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009e60 tx=0x7f0d50009780 comp rx=0 tx=0).stop 2023-10-09T12:57:16.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 -- 172.21.15.86:0/2365344703 shutdown_connections 2023-10-09T12:57:16.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d58155c10 0x7f0d58155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2365344703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac6a0 0x7f0d580b0300 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 -- 172.21.15.86:0/2365344703 >> 172.21.15.86:0/2365344703 conn(0x7f0d5806a320 msgr2=0x7f0d580cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:16.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 -- 172.21.15.86:0/2365344703 shutdown_connections 2023-10-09T12:57:16.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.342+0000 7f0d5efff700 1 -- 172.21.15.86:0/2365344703 wait complete. 2023-10-09T12:57:16.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.343+0000 7f0d5efff700 1 Processor -- start 2023-10-09T12:57:16.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.344+0000 7f0d5efff700 1 -- start start 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.344+0000 7f0d5efff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac230 0x7f0d5814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.344+0000 7f0d5efff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d580ac6a0 0x7f0d58158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.344+0000 7f0d5efff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58155c10 0x7f0d58159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.344+0000 7f0d5efff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d581583a0 con 0x7f0d58155c10 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.344+0000 7f0d5efff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5815f040 con 0x7f0d580ac230 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.344+0000 7f0d5efff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5814f960 con 0x7f0d580ac6a0 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58155c10 0x7f0d58159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58155c10 0x7f0d58159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52450/0 (socket says 172.21.15.86:52450) 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 -- 172.21.15.86:0/2460617281 learned_addr learned my addr 172.21.15.86:0/2460617281 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:16.347 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5cd9b700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac230 0x7f0d5814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d57fff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d580ac6a0 0x7f0d58158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 -- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d580ac6a0 msgr2=0x7f0d58158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d580ac6a0 0x7f0d58158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 -- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac230 msgr2=0x7f0d5814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac230 0x7f0d5814f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 -- 172.21.15.86:0/2460617281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009a20 con 0x7f0d58155c10 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d57fff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d580ac6a0 0x7f0d58158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.345+0000 7f0d5d59c700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58155c10 0x7f0d58159330 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000b6c0 tx=0x7f0d50019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.346+0000 7f0d54ff9700 1 -- 172.21.15.86:0/2460617281 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50027470 con 0x7f0d58155c10 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.346+0000 7f0d54ff9700 1 -- 172.21.15.86:0/2460617281 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d500275f0 con 0x7f0d58155c10 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.346+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5815e280 con 0x7f0d58155c10 2023-10-09T12:57:16.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.346+0000 7f0d54ff9700 1 -- 172.21.15.86:0/2460617281 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d500279b0 con 0x7f0d58155c10 2023-10-09T12:57:16.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.346+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d581585f0 con 0x7f0d58155c10 2023-10-09T12:57:16.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.347+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5804c3c0 con 0x7f0d58155c10 2023-10-09T12:57:16.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.348+0000 7f0d54ff9700 1 -- 172.21.15.86:0/2460617281 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d50024070 con 0x7f0d58155c10 2023-10-09T12:57:16.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.349+0000 7f0d54ff9700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0d3c066f30 0x7f0d3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.349+0000 7f0d54ff9700 1 -- 172.21.15.86:0/2460617281 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7f0d50087030 con 0x7f0d58155c10 2023-10-09T12:57:16.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.349+0000 7f0d5cd9b700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0d3c066f30 0x7f0d3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.350+0000 7f0d5cd9b700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0d3c066f30 0x7f0d3c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006fd0 tx=0x7f0d4c00b780 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:16.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.353+0000 7f0d54ff9700 1 -- 172.21.15.86:0/2460617281 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d500541b0 con 0x7f0d58155c10 2023-10-09T12:57:16.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.585+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d580ad2e0 con 0x7f0d58155c10 2023-10-09T12:57:16.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.586+0000 7f0d54ff9700 1 -- 172.21.15.86:0/2460617281 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f0d500577d0 con 0x7f0d58155c10 2023-10-09T12:57:16.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:16.587 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/2700721489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2700721489},{"type":"v1","addr":"172.21.15.135:6834","nonce":2700721489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1754968847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1754968847},{"type":"v1","addr":"172.21.15.135:6835","nonce":1754968847}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8437,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/957231001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":957231001},{"type":"v1","addr":"172.21.15.86:6835","nonce":957231001}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/885619835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":885619835},{"type":"v1","addr":"172.21.15.86:6834","nonce":885619835}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[]} 2023-10-09T12:57:16.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0d3c066f30 msgr2=0x7f0d3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0d3c066f30 0x7f0d3c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006fd0 tx=0x7f0d4c00b780 comp rx=0 tx=0).stop 2023-10-09T12:57:16.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58155c10 msgr2=0x7f0d58159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58155c10 0x7f0d58159330 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000b6c0 tx=0x7f0d50019000 comp rx=0 tx=0).stop 2023-10-09T12:57:16.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 shutdown_connections 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f0d3c066f30 0x7f0d3c0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d58155c10 0x7f0d58159330 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d580ac230 0x7f0d5814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 --2- 172.21.15.86:0/2460617281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d580ac6a0 0x7f0d58158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 >> 172.21.15.86:0/2460617281 conn(0x7f0d5806a320 msgr2=0x7f0d5815f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 shutdown_connections 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.588+0000 7f0d5efff700 1 -- 172.21.15.86:0/2460617281 wait complete. 2023-10-09T12:57:16.590 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 73 2023-10-09T12:57:16.607 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T12:57:16.607 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T12:57:16.607 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T12:57:16.608 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:57:16.608 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T12:57:16.608 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T12:57:16.608 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T12:57:16.608 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:57:16.608 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T12:57:16.608 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T12:57:16.609 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T12:57:16.609 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:57:16.609 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T12:57:16.609 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T12:57:16.609 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T12:57:16.609 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T12:57:16.620 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T12:57:16.621 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T12:57:16.621 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T12:57:16.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T12:57:16.625 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T12:57:16.625 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T12:57:16.626 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T12:57:16.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T12:57:16.665 INFO:tasks.ceph.mds.a:Started 2023-10-09T12:57:16.665 DEBUG:teuthology.parallel:result is None 2023-10-09T12:57:16.668 INFO:tasks.ceph.mds.c:Started 2023-10-09T12:57:16.668 DEBUG:teuthology.parallel:result is None 2023-10-09T12:57:16.669 INFO:tasks.ceph.mds.b:Started 2023-10-09T12:57:16.670 DEBUG:teuthology.parallel:result is None 2023-10-09T12:57:16.672 INFO:tasks.ceph.mds.d:Started 2023-10-09T12:57:16.673 DEBUG:teuthology.parallel:result is None 2023-10-09T12:57:16.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T12:57:16.799 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T12:57:16.802 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T12:57:16.810 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T12:57:16.810 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T12:57:16.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.863+0000 7f28a759e700 1 Processor -- start 2023-10-09T12:57:16.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.863+0000 7f28a759e700 1 -- start start 2023-10-09T12:57:16.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.864+0000 7f28a759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28a80c6c60 0x7f28a80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.864+0000 7f28a759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.864+0000 7f28a759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a80b1410 con 0x7f28a81595a0 2023-10-09T12:57:16.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.864+0000 7f28a759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a80b2b90 con 0x7f28a80c6c60 2023-10-09T12:57:16.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.864+0000 7f28a759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8063230 con 0x7f28a806e8c0 2023-10-09T12:57:16.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.864+0000 7f28a5d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28a80c6c60 0x7f28a80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.864+0000 7f28a6d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a5d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28a80c6c60 0x7f28a80c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:48080/0 (socket says 172.21.15.86:48080) 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a659c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f28a81595a0 0x7f28a80b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:37438/0 (socket says 172.21.15.86:37438) 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a5d9b700 1 -- 172.21.15.86:0/1527398164 learned_addr learned my addr 172.21.15.86:0/1527398164 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a559a700 1 -- 172.21.15.86:0/1527398164 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473445932 0 0) 0x7f28a80b1410 con 0x7f28a81595a0 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a559a700 1 -- 172.21.15.86:0/1527398164 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2890003570 con 0x7f28a81595a0 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a6d9d700 1 -- 172.21.15.86:0/1527398164 >> v2:172.21.15.135:3300/0 conn(0x7f28a80c6c60 msgr2=0x7f28a80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a6d9d700 1 --2- 172.21.15.86:0/1527398164 >> v2:172.21.15.135:3300/0 conn(0x7f28a80c6c60 0x7f28a80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a6d9d700 1 -- 172.21.15.86:0/1527398164 >> v1:172.21.15.135:6789/0 conn(0x7f28a81595a0 legacy=0x7f28a80b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a6d9d700 1 -- 172.21.15.86:0/1527398164 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a80634f0 con 0x7f28a806e8c0 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a5d9b700 1 --2- 172.21.15.86:0/1527398164 >> v2:172.21.15.135:3300/0 conn(0x7f28a80c6c60 0x7f28a80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.865+0000 7f28a6d9d700 1 --2- 172.21.15.86:0/1527398164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a80c8660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009e60 tx=0x7f28a0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33a50d5f638e7461 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:16.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a559a700 1 -- 172.21.15.86:0/1527398164 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000e070 con 0x7f28a806e8c0 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a559a700 1 -- 172.21.15.86:0/1527398164 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a000bab0 con 0x7f28a806e8c0 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a559a700 1 -- 172.21.15.86:0/1527398164 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000be70 con 0x7f28a806e8c0 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 -- 172.21.15.86:0/1527398164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 msgr2=0x7f28a80c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 --2- 172.21.15.86:0/1527398164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a80c8660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009e60 tx=0x7f28a0009780 comp rx=0 tx=0).stop 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 -- 172.21.15.86:0/1527398164 shutdown_connections 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 --2- 172.21.15.86:0/1527398164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a80c8660 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 --2- 172.21.15.86:0/1527398164 >> v2:172.21.15.135:3300/0 conn(0x7f28a80c6c60 0x7f28a80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 -- 172.21.15.86:0/1527398164 >> 172.21.15.86:0/1527398164 conn(0x7f28a806ddb0 msgr2=0x7f28a806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 -- 172.21.15.86:0/1527398164 shutdown_connections 2023-10-09T12:57:16.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.866+0000 7f28a759e700 1 -- 172.21.15.86:0/1527398164 wait complete. 2023-10-09T12:57:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.868+0000 7f28a759e700 1 Processor -- start 2023-10-09T12:57:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.868+0000 7f28a759e700 1 -- start start 2023-10-09T12:57:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a8158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28a80c6c60 0x7f28a813ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a81595a0 0x7f28a813d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a81402c0 con 0x7f28a81595a0 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a813f6b0 con 0x7f28a80c6c60 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a813f990 con 0x7f28a806e8c0 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a81595a0 0x7f28a813d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a81595a0 0x7f28a813d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52482/0 (socket says 172.21.15.86:52482) 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 -- 172.21.15.86:0/2257640099 learned_addr learned my addr 172.21.15.86:0/2257640099 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a659c700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a8158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a5d9b700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28a80c6c60 0x7f28a813ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 -- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 msgr2=0x7f28a8158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a8158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 -- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28a80c6c60 msgr2=0x7f28a813ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28a80c6c60 0x7f28a813ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.869+0000 7f28a6d9d700 1 -- 172.21.15.86:0/2257640099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c0094f0 con 0x7f28a81595a0 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.870+0000 7f28a6d9d700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a81595a0 0x7f28a813d390 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f28a815d3c0 tx=0x7f28a0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.870+0000 7f28967fc700 1 -- 172.21.15.86:0/2257640099 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0012e10 con 0x7f28a81595a0 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.870+0000 7f28967fc700 1 -- 172.21.15.86:0/2257640099 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a0027470 con 0x7f28a81595a0 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.870+0000 7f28967fc700 1 -- 172.21.15.86:0/2257640099 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0027830 con 0x7f28a81595a0 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.870+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a0009a20 con 0x7f28a81595a0 2023-10-09T12:57:16.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.870+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a813ff50 con 0x7f28a81595a0 2023-10-09T12:57:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.871+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a8140430 con 0x7f28a81595a0 2023-10-09T12:57:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.872+0000 7f28967fc700 1 -- 172.21.15.86:0/2257640099 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28a0024070 con 0x7f28a81595a0 2023-10-09T12:57:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.873+0000 7f28967fc700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2888066f30 0x7f28880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.873+0000 7f28967fc700 1 -- 172.21.15.86:0/2257640099 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5946+0+0 (secure 0 0 0) 0x7f28a0086fe0 con 0x7f28a81595a0 2023-10-09T12:57:16.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.873+0000 7f28a659c700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2888066f30 0x7f28880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:16.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.874+0000 7f28a659c700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2888066f30 0x7f28880693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2898004f70 tx=0x7f2898007d40 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:16.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:16.878+0000 7f28967fc700 1 -- 172.21.15.86:0/2257640099 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28a00540e0 con 0x7f28a81595a0 2023-10-09T12:57:17.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.089+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f28a804c3c0 con 0x7f28a81595a0 2023-10-09T12:57:17.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.993+0000 7f28967fc700 1 -- 172.21.15.86:0/2257640099 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v174) v1 ==== 97+0+0 (secure 0 0 0) 0x7f28a0057700 con 0x7f28a81595a0 2023-10-09T12:57:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2888066f30 msgr2=0x7f28880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2888066f30 0x7f28880693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2898004f70 tx=0x7f2898007d40 comp rx=0 tx=0).stop 2023-10-09T12:57:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a81595a0 msgr2=0x7f28a813d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:17.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a81595a0 0x7f28a813d390 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f28a815d3c0 tx=0x7f28a0019000 comp rx=0 tx=0).stop 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 shutdown_connections 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2888066f30 0x7f28880693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a81595a0 0x7f28a813d390 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28a806e8c0 0x7f28a8158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 --2- 172.21.15.86:0/2257640099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28a80c6c60 0x7f28a813ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 >> 172.21.15.86:0/2257640099 conn(0x7f28a806ddb0 msgr2=0x7f28a80cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 shutdown_connections 2023-10-09T12:57:17.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:17.996+0000 7f28a759e700 1 -- 172.21.15.86:0/2257640099 wait complete. 2023-10-09T12:57:17.999 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T12:57:18.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T12:57:18.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.200+0000 7fc86559d700 1 Processor -- start 2023-10-09T12:57:18.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.200+0000 7fc86559d700 1 -- start start 2023-10-09T12:57:18.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.201+0000 7fc86559d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc860159420 0x7fc8600b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.201+0000 7fc86559d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc86015d230 0x7fc86015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.201+0000 7fc86559d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8600b2980 con 0x7fc8601597f0 2023-10-09T12:57:18.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.201+0000 7fc86559d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86015db70 con 0x7fc86015d230 2023-10-09T12:57:18.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.201+0000 7fc86559d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8600b11d0 con 0x7fc860159420 2023-10-09T12:57:18.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.201+0000 7fc864d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc86015d230 0x7fc86015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc864d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc86015d230 0x7fc86015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52486/0 (socket says 172.21.15.86:52486) 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc85f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc8601597f0 0x7fc8600b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47634/0 (socket says 172.21.15.86:47634) 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc864d9c700 1 -- 172.21.15.86:0/583108746 learned_addr learned my addr 172.21.15.86:0/583108746 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc85ffff700 1 --2- 172.21.15.86:0/583108746 >> v2:172.21.15.135:3300/0 conn(0x7fc860159420 0x7fc8600b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc864d9c700 1 -- 172.21.15.86:0/583108746 >> v2:172.21.15.135:3300/0 conn(0x7fc860159420 msgr2=0x7fc8600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc864d9c700 1 --2- 172.21.15.86:0/583108746 >> v2:172.21.15.135:3300/0 conn(0x7fc860159420 0x7fc8600b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc864d9c700 1 -- 172.21.15.86:0/583108746 >> v1:172.21.15.86:6789/0 conn(0x7fc8601597f0 legacy=0x7fc8600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc864d9c700 1 -- 172.21.15.86:0/583108746 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8600b14b0 con 0x7fc86015d230 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc85effd700 1 -- 172.21.15.86:0/583108746 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348923744 0 0) 0x7fc8600b2980 con 0x7fc8601597f0 2023-10-09T12:57:18.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc864d9c700 1 --2- 172.21.15.86:0/583108746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc86015d230 0x7fc86015d630 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc8600b2f20 tx=0x7fc858009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4993b09ed8137b62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:18.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.202+0000 7fc85effd700 1 -- 172.21.15.86:0/583108746 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800e070 con 0x7fc86015d230 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc85effd700 1 -- 172.21.15.86:0/583108746 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85800ba50 con 0x7fc86015d230 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc85effd700 1 -- 172.21.15.86:0/583108746 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8580092e0 con 0x7fc86015d230 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 -- 172.21.15.86:0/583108746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc86015d230 msgr2=0x7fc86015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 --2- 172.21.15.86:0/583108746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc86015d230 0x7fc86015d630 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc8600b2f20 tx=0x7fc858009840 comp rx=0 tx=0).stop 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 -- 172.21.15.86:0/583108746 shutdown_connections 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 --2- 172.21.15.86:0/583108746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc86015d230 0x7fc86015d630 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 --2- 172.21.15.86:0/583108746 >> v2:172.21.15.135:3300/0 conn(0x7fc860159420 0x7fc8600b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 -- 172.21.15.86:0/583108746 >> 172.21.15.86:0/583108746 conn(0x7fc8600d0660 msgr2=0x7fc8600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 -- 172.21.15.86:0/583108746 shutdown_connections 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.203+0000 7fc86559d700 1 -- 172.21.15.86:0/583108746 wait complete. 2023-10-09T12:57:18.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.205+0000 7fc86559d700 1 Processor -- start 2023-10-09T12:57:18.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.205+0000 7fc86559d700 1 -- start start 2023-10-09T12:57:18.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc86559d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc860159420 0x7fc860169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc86559d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8601597f0 0x7fc86016a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc86559d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc86015d230 0x7fc8600cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc86559d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86016ab60 con 0x7fc860159420 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc86559d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86016ad70 con 0x7fc8601597f0 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc86559d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86016b050 con 0x7fc86015d230 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc860159420 0x7fc860169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc860159420 0x7fc860169fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52500/0 (socket says 172.21.15.86:52500) 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 -- 172.21.15.86:0/2973966677 learned_addr learned my addr 172.21.15.86:0/2973966677 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85f7fe700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8601597f0 0x7fc86016a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc864d9c700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc86015d230 0x7fc8600cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 -- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc86015d230 msgr2=0x7fc8600cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc86015d230 0x7fc8600cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 -- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8601597f0 msgr2=0x7fc86016a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8601597f0 0x7fc86016a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 -- 172.21.15.86:0/2973966677 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009ae0 con 0x7fc860159420 2023-10-09T12:57:18.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.206+0000 7fc85ffff700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc860159420 0x7fc860169fa0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc85000d890 tx=0x7fc850008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:18.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.207+0000 7fc847fff700 1 -- 172.21.15.86:0/2973966677 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000b600 con 0x7fc860159420 2023-10-09T12:57:18.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.207+0000 7fc847fff700 1 -- 172.21.15.86:0/2973966677 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85000b760 con 0x7fc860159420 2023-10-09T12:57:18.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.207+0000 7fc847fff700 1 -- 172.21.15.86:0/2973966677 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000bae0 con 0x7fc860159420 2023-10-09T12:57:18.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.207+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86016b330 con 0x7fc860159420 2023-10-09T12:57:18.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.207+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86016b8f0 con 0x7fc860159420 2023-10-09T12:57:18.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.208+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86004c3c0 con 0x7fc860159420 2023-10-09T12:57:18.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.209+0000 7fc847fff700 1 -- 172.21.15.86:0/2973966677 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc85001e460 con 0x7fc860159420 2023-10-09T12:57:18.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.210+0000 7fc847fff700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc84c066f30 0x7fc84c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.210+0000 7fc847fff700 1 -- 172.21.15.86:0/2973966677 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5301+0+0 (secure 0 0 0) 0x7fc850084af0 con 0x7fc860159420 2023-10-09T12:57:18.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.210+0000 7fc85f7fe700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc84c066f30 0x7fc84c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.210+0000 7fc85f7fe700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc84c066f30 0x7fc84c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc860147b90 tx=0x7fc854007bf0 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.214+0000 7fc847fff700 1 -- 172.21.15.86:0/2973966677 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc850051e50 con 0x7fc860159420 2023-10-09T12:57:18.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.477+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc8600b1790 con 0x7fc860159420 2023-10-09T12:57:18.478 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.478+0000 7fc847fff700 1 -- 172.21.15.86:0/2973966677 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v45) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc850055470 con 0x7fc860159420 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.479 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:57:18.480 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.482 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.483 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T12:57:18.485 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.486 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T12:57:18.488 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:57:18.489 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.491 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.492 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:18.494 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T12:57:18.494 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc84c066f30 msgr2=0x7fc84c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc84c066f30 0x7fc84c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc860147b90 tx=0x7fc854007bf0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc860159420 msgr2=0x7fc860169fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc860159420 0x7fc860169fa0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc85000d890 tx=0x7fc850008040 comp rx=0 tx=0).stop 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 shutdown_connections 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc84c066f30 0x7fc84c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc860159420 0x7fc860169fa0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc86015d230 0x7fc8600cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 --2- 172.21.15.86:0/2973966677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8601597f0 0x7fc86016a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 >> 172.21.15.86:0/2973966677 conn(0x7fc8600d0660 msgr2=0x7fc860069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:18.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 shutdown_connections 2023-10-09T12:57:18.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.480+0000 7fc86559d700 1 -- 172.21.15.86:0/2973966677 wait complete. 2023-10-09T12:57:18.498 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:57:18.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.679+0000 7f7c349ff700 1 Processor -- start 2023-10-09T12:57:18.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.680+0000 7f7c349ff700 1 -- start start 2023-10-09T12:57:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c349ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c349ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c300ccf90 0x7f7c300c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c349ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c300cc300 con 0x7f7c300cbf30 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c349ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c30156bf0 con 0x7f7c300ccf90 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c349ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300ae950 con 0x7f7c300b1420 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c2ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c300ccf90 0x7f7c300c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c2ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c300ccf90 0x7f7c300c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52514/0 (socket says 172.21.15.86:52514) 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/3029424450 learned_addr learned my addr 172.21.15.86:0/3029424450 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c2dd9b700 1 --2- 172.21.15.86:0/3029424450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/3029424450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 msgr2=0x7f7c300ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c2ed9d700 1 --2- 172.21.15.86:0/3029424450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.681+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/3029424450 >> v1:172.21.15.135:6789/0 conn(0x7f7c300cbf30 legacy=0x7f7c300b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/3029424450 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300ad370 con 0x7f7c300ccf90 2023-10-09T12:57:18.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c2dd9b700 1 --2- 172.21.15.86:0/3029424450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:18.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c2ed9d700 1 --2- 172.21.15.86:0/3029424450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c300c9740 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f7c280099e0 tx=0x7f7c28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8444a5e2dcbd2e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c2d59a700 1 -- 172.21.15.86:0/3029424450 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800b820 con 0x7f7c300ccf90 2023-10-09T12:57:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c2d59a700 1 -- 172.21.15.86:0/3029424450 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2800b980 con 0x7f7c300ccf90 2023-10-09T12:57:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c2d59a700 1 -- 172.21.15.86:0/3029424450 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800bd20 con 0x7f7c300ccf90 2023-10-09T12:57:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c349ff700 1 -- 172.21.15.86:0/3029424450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 msgr2=0x7f7c300c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.682+0000 7f7c349ff700 1 --2- 172.21.15.86:0/3029424450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c300c9740 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f7c280099e0 tx=0x7f7c28009250 comp rx=0 tx=0).stop 2023-10-09T12:57:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.683+0000 7f7c349ff700 1 -- 172.21.15.86:0/3029424450 shutdown_connections 2023-10-09T12:57:18.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.683+0000 7f7c349ff700 1 --2- 172.21.15.86:0/3029424450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c300c9740 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.683+0000 7f7c349ff700 1 --2- 172.21.15.86:0/3029424450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.683+0000 7f7c349ff700 1 -- 172.21.15.86:0/3029424450 >> 172.21.15.86:0/3029424450 conn(0x7f7c3006a320 msgr2=0x7f7c300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.683+0000 7f7c349ff700 1 -- 172.21.15.86:0/3029424450 shutdown_connections 2023-10-09T12:57:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.683+0000 7f7c349ff700 1 -- 172.21.15.86:0/3029424450 wait complete. 2023-10-09T12:57:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.684+0000 7f7c349ff700 1 Processor -- start 2023-10-09T12:57:18.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.684+0000 7f7c349ff700 1 -- start start 2023-10-09T12:57:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.685+0000 7f7c349ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.685+0000 7f7c349ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300cbf30 0x7f7c30165d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.685+0000 7f7c349ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c301662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.685+0000 7f7c349ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30142ad0 con 0x7f7c300ccf90 2023-10-09T12:57:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.685+0000 7f7c349ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300a64b0 con 0x7f7c300cbf30 2023-10-09T12:57:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.685+0000 7f7c349ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300a6e80 con 0x7f7c300b1420 2023-10-09T12:57:18.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.685+0000 7f7c2ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c301662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c301662c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52528/0 (socket says 172.21.15.86:52528) 2023-10-09T12:57:18.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/1160709467 learned_addr learned my addr 172.21.15.86:0/1160709467 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:18.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2dd9b700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300cbf30 0x7f7c30165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2e59c700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 msgr2=0x7f7c300a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300cbf30 msgr2=0x7f7c30165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300cbf30 0x7f7c30165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 -- 172.21.15.86:0/1160709467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280094f0 con 0x7f7c300ccf90 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2e59c700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2dd9b700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300cbf30 0x7f7c30165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c2ed9d700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c301662c0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009290 tx=0x7f7c28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c1e7fc700 1 -- 172.21.15.86:0/1160709467 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800b820 con 0x7f7c300ccf90 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c1e7fc700 1 -- 172.21.15.86:0/1160709467 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2801f070 con 0x7f7c300ccf90 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c300a58a0 con 0x7f7c300ccf90 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.686+0000 7f7c1e7fc700 1 -- 172.21.15.86:0/1160709467 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2801a870 con 0x7f7c300ccf90 2023-10-09T12:57:18.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.687+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c300a5e60 con 0x7f7c300ccf90 2023-10-09T12:57:18.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.687+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c300a6620 con 0x7f7c300ccf90 2023-10-09T12:57:18.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.688+0000 7f7c1e7fc700 1 -- 172.21.15.86:0/1160709467 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c2801ac60 con 0x7f7c300ccf90 2023-10-09T12:57:18.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.689+0000 7f7c1e7fc700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7c10066f30 0x7f7c100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:18.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.689+0000 7f7c1e7fc700 1 -- 172.21.15.86:0/1160709467 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5301+0+0 (secure 0 0 0) 0x7f7c28021070 con 0x7f7c300ccf90 2023-10-09T12:57:18.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.690+0000 7f7c2e59c700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7c10066f30 0x7f7c100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:18.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.690+0000 7f7c2e59c700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7c10066f30 0x7f7c100693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c20007fd0 tx=0x7f7c20009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:18.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.694+0000 7f7c1e7fc700 1 -- 172.21.15.86:0/1160709467 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c28053820 con 0x7f7c300ccf90 2023-10-09T12:57:18.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.885+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c3004c3c0 con 0x7f7c300ccf90 2023-10-09T12:57:18.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.886+0000 7f7c1e7fc700 1 -- 172.21.15.86:0/1160709467 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+12879 (secure 0 0 0) 0x7f7c28015090 con 0x7f7c300ccf90 2023-10-09T12:57:18.888 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:18.888 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":174,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:57:17.990456+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:57:18.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7c10066f30 msgr2=0x7f7c100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7c10066f30 0x7f7c100693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c20007fd0 tx=0x7f7c20009040 comp rx=0 tx=0).stop 2023-10-09T12:57:18.890 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 msgr2=0x7f7c301662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c301662c0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009290 tx=0x7f7c28017000 comp rx=0 tx=0).stop 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 shutdown_connections 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f7c10066f30 0x7f7c100693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300ccf90 0x7f7c301662c0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 --2- 172.21.15.86:0/1160709467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300cbf30 0x7f7c30165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 >> 172.21.15.86:0/1160709467 conn(0x7f7c3006a320 msgr2=0x7f7c3015a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 shutdown_connections 2023-10-09T12:57:18.891 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:18.889+0000 7f7c349ff700 1 -- 172.21.15.86:0/1160709467 wait complete. 2023-10-09T12:57:18.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T12:57:18.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T12:57:19.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.090+0000 7ff8fdbff700 1 Processor -- start 2023-10-09T12:57:19.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.090+0000 7ff8fdbff700 1 -- start start 2023-10-09T12:57:19.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.091+0000 7ff8fdbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f81561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.091+0000 7ff8fdbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f815b0d0 con 0x7ff8f80c83f0 2023-10-09T12:57:19.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.091+0000 7ff8fdbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f815a4c0 con 0x7ff8f80c87c0 2023-10-09T12:57:19.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.091+0000 7ff8fdbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f815a7a0 con 0x7ff8f80ccee0 2023-10-09T12:57:19.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f77fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff8f80c83f0 0x7ff8f80c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47646/0 (socket says 172.21.15.86:47646) 2023-10-09T12:57:19.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f77fe700 1 -- 172.21.15.86:0/270597109 learned_addr learned my addr 172.21.15.86:0/270597109 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:19.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f6ffd700 1 --2- 172.21.15.86:0/270597109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f81561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f67fc700 1 -- 172.21.15.86:0/270597109 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624724966 0 0) 0x7ff8f815b0d0 con 0x7ff8f80c83f0 2023-10-09T12:57:19.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f67fc700 1 -- 172.21.15.86:0/270597109 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e0003570 con 0x7ff8f80c83f0 2023-10-09T12:57:19.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f67fc700 1 -- 172.21.15.86:0/270597109 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760470877 0 0) 0x7ff8f815a4c0 con 0x7ff8f80c87c0 2023-10-09T12:57:19.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f67fc700 1 -- 172.21.15.86:0/270597109 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8f815b0d0 con 0x7ff8f80c87c0 2023-10-09T12:57:19.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f6ffd700 1 -- 172.21.15.86:0/270597109 >> v1:172.21.15.135:6789/0 conn(0x7ff8f80c87c0 legacy=0x7ff8f80ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f6ffd700 1 -- 172.21.15.86:0/270597109 >> v1:172.21.15.86:6789/0 conn(0x7ff8f80c83f0 legacy=0x7ff8f80c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.092+0000 7ff8f6ffd700 1 -- 172.21.15.86:0/270597109 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f815aa80 con 0x7ff8f80ccee0 2023-10-09T12:57:19.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.093+0000 7ff8f6ffd700 1 --2- 172.21.15.86:0/270597109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f81561d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009910 tx=0x7ff8ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bec2c0e8cd119c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.093+0000 7ff8f67fc700 1 -- 172.21.15.86:0/270597109 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec011630 con 0x7ff8f80ccee0 2023-10-09T12:57:19.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.093+0000 7ff8f67fc700 1 -- 172.21.15.86:0/270597109 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec011790 con 0x7ff8f80ccee0 2023-10-09T12:57:19.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.093+0000 7ff8f67fc700 1 -- 172.21.15.86:0/270597109 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec011b30 con 0x7ff8f80ccee0 2023-10-09T12:57:19.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.094+0000 7ff8fdbff700 1 -- 172.21.15.86:0/270597109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 msgr2=0x7ff8f81561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.094+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/270597109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f81561d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009910 tx=0x7ff8ec0091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.094+0000 7ff8fdbff700 1 -- 172.21.15.86:0/270597109 shutdown_connections 2023-10-09T12:57:19.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.094+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/270597109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f81561d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.094+0000 7ff8fdbff700 1 -- 172.21.15.86:0/270597109 >> 172.21.15.86:0/270597109 conn(0x7ff8f8068e10 msgr2=0x7ff8f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:19.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.094+0000 7ff8fdbff700 1 -- 172.21.15.86:0/270597109 shutdown_connections 2023-10-09T12:57:19.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.094+0000 7ff8fdbff700 1 -- 172.21.15.86:0/270597109 wait complete. 2023-10-09T12:57:19.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.095+0000 7ff8fdbff700 1 Processor -- start 2023-10-09T12:57:19.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.096+0000 7ff8fdbff700 1 -- start start 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.096+0000 7ff8fdbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8f80c83f0 0x7ff8f81442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.096+0000 7ff8fdbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8f80c87c0 0x7ff8f80af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.096+0000 7ff8fdbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f80b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.096+0000 7ff8fdbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8144810 con 0x7ff8f80c87c0 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.096+0000 7ff8fdbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f80afab0 con 0x7ff8f80c83f0 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.096+0000 7ff8fdbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8141b60 con 0x7ff8f80ccee0 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8f80c87c0 0x7ff8f80af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8f80c87c0 0x7ff8f80af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52542/0 (socket says 172.21.15.86:52542) 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 -- 172.21.15.86:0/3768636911 learned_addr learned my addr 172.21.15.86:0/3768636911 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f77fe700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8f80c83f0 0x7ff8f81442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f7fff700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f80b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 -- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 msgr2=0x7ff8f80b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f80b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 -- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8f80c83f0 msgr2=0x7ff8f81442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8f80c83f0 0x7ff8f81442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 -- 172.21.15.86:0/3768636911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec009420 con 0x7ff8f80c87c0 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.097+0000 7ff8f6ffd700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8f80c87c0 0x7ff8f80af570 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009f00 tx=0x7ff8ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.098+0000 7ff8df7fe700 1 -- 172.21.15.86:0/3768636911 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec01f070 con 0x7ff8f80c87c0 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.098+0000 7ff8df7fe700 1 -- 172.21.15.86:0/3768636911 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec000bc0 con 0x7ff8f80c87c0 2023-10-09T12:57:19.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.098+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f8144a30 con 0x7ff8f80c87c0 2023-10-09T12:57:19.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.098+0000 7ff8df7fe700 1 -- 172.21.15.86:0/3768636911 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec025420 con 0x7ff8f80c87c0 2023-10-09T12:57:19.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.098+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f8141510 con 0x7ff8f80c87c0 2023-10-09T12:57:19.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.099+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f8141cf0 con 0x7ff8f80c87c0 2023-10-09T12:57:19.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.100+0000 7ff8df7fe700 1 -- 172.21.15.86:0/3768636911 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8ec023070 con 0x7ff8f80c87c0 2023-10-09T12:57:19.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.100+0000 7ff8df7fe700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff8e4066f30 0x7ff8e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.101+0000 7ff8df7fe700 1 -- 172.21.15.86:0/3768636911 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5301+0+0 (secure 0 0 0) 0x7ff8ec0856f0 con 0x7ff8f80c87c0 2023-10-09T12:57:19.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.101+0000 7ff8f77fe700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff8e4066f30 0x7ff8e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.101+0000 7ff8f77fe700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff8e4066f30 0x7ff8e40693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8007fd0 tx=0x7ff8e8009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.105+0000 7ff8df7fe700 1 -- 172.21.15.86:0/3768636911 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8ec052a50 con 0x7ff8f80c87c0 2023-10-09T12:57:19.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.295+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8f80aee20 con 0x7ff8f80c87c0 2023-10-09T12:57:19.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.295+0000 7ff8df7fe700 1 -- 172.21.15.86:0/3768636911 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8ec0150a0 con 0x7ff8f80c87c0 2023-10-09T12:57:19.296 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff8e4066f30 msgr2=0x7ff8e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff8e4066f30 0x7ff8e40693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8007fd0 tx=0x7ff8e8009040 comp rx=0 tx=0).stop 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8f80c87c0 msgr2=0x7ff8f80af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8f80c87c0 0x7ff8f80af570 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009f00 tx=0x7ff8ec017000 comp rx=0 tx=0).stop 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 shutdown_connections 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8f80ccee0 0x7ff8f80b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8f80c83f0 0x7ff8f81442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7ff8e4066f30 0x7ff8e40693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 --2- 172.21.15.86:0/3768636911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8f80c87c0 0x7ff8f80af570 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.297+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 >> 172.21.15.86:0/3768636911 conn(0x7ff8f8068e10 msgr2=0x7ff8f80c1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:19.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.298+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 shutdown_connections 2023-10-09T12:57:19.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.298+0000 7ff8fdbff700 1 -- 172.21.15.86:0/3768636911 wait complete. 2023-10-09T12:57:19.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T12:57:19.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.498+0000 7fb48e39d700 1 Processor -- start 2023-10-09T12:57:19.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.498+0000 7fb48e39d700 1 -- start start 2023-10-09T12:57:19.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48e39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4880ad870 0x7fb48806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48e39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb48806bf20 0x7fb48806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48e39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880b40f0 con 0x7fb488142ea0 2023-10-09T12:57:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48e39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48806c3a0 con 0x7fb4880ad870 2023-10-09T12:57:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48e39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb488069640 con 0x7fb48806bf20 2023-10-09T12:57:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48cb9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4880ad870 0x7fb48806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48cb9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4880ad870 0x7fb48806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52546/0 (socket says 172.21.15.86:52546) 2023-10-09T12:57:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.499+0000 7fb48db9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb48806bf20 0x7fb48806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.500+0000 7fb48cb9a700 1 -- 172.21.15.86:0/434550946 learned_addr learned my addr 172.21.15.86:0/434550946 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.500+0000 7fb48cb9a700 1 -- 172.21.15.86:0/434550946 >> v2:172.21.15.135:3300/0 conn(0x7fb48806bf20 msgr2=0x7fb48806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:19.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.500+0000 7fb48cb9a700 1 --2- 172.21.15.86:0/434550946 >> v2:172.21.15.135:3300/0 conn(0x7fb48806bf20 0x7fb48806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.500+0000 7fb48cb9a700 1 -- 172.21.15.86:0/434550946 >> v1:172.21.15.135:6789/0 conn(0x7fb488142ea0 legacy=0x7fb4880b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.500+0000 7fb48cb9a700 1 -- 172.21.15.86:0/434550946 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488069920 con 0x7fb4880ad870 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.500+0000 7fb48cb9a700 1 --2- 172.21.15.86:0/434550946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4880ad870 0x7fb48806b9e0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb488071330 tx=0x7fb478009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db7e0d04f33668f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.500+0000 7fb47ffff700 1 -- 172.21.15.86:0/434550946 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478009e70 con 0x7fb4880ad870 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb47ffff700 1 -- 172.21.15.86:0/434550946 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800b860 con 0x7fb4880ad870 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb47ffff700 1 -- 172.21.15.86:0/434550946 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800bc00 con 0x7fb4880ad870 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 -- 172.21.15.86:0/434550946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4880ad870 msgr2=0x7fb48806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 --2- 172.21.15.86:0/434550946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4880ad870 0x7fb48806b9e0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb488071330 tx=0x7fb478009250 comp rx=0 tx=0).stop 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 -- 172.21.15.86:0/434550946 shutdown_connections 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 --2- 172.21.15.86:0/434550946 >> v2:172.21.15.135:3300/0 conn(0x7fb48806bf20 0x7fb48806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 --2- 172.21.15.86:0/434550946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4880ad870 0x7fb48806b9e0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 -- 172.21.15.86:0/434550946 >> 172.21.15.86:0/434550946 conn(0x7fb4880ce430 msgr2=0x7fb4880ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 -- 172.21.15.86:0/434550946 shutdown_connections 2023-10-09T12:57:19.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.501+0000 7fb48e39d700 1 -- 172.21.15.86:0/434550946 wait complete. 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.503+0000 7fb48e39d700 1 Processor -- start 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.503+0000 7fb48e39d700 1 -- start start 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48e39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb48806bf20 0x7fb488158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48e39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb488142ea0 0x7fb4880c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48e39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880c8570 0x7fb48815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48e39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880b0060 con 0x7fb488142ea0 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48e39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880c75e0 con 0x7fb4880c8570 2023-10-09T12:57:19.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48e39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880aed00 con 0x7fb48806bf20 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb488142ea0 0x7fb4880c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb488142ea0 0x7fb4880c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52560/0 (socket says 172.21.15.86:52560) 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 -- 172.21.15.86:0/2161298982 learned_addr learned my addr 172.21.15.86:0/2161298982 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48db9c700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880c8570 0x7fb48815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48d39b700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb48806bf20 0x7fb488158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 -- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb48806bf20 msgr2=0x7fb488158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb48806bf20 0x7fb488158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 -- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880c8570 msgr2=0x7fb48815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880c8570 0x7fb48815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 -- 172.21.15.86:0/2161298982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780094f0 con 0x7fb488142ea0 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48d39b700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb48806bf20 0x7fb488158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:19.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.504+0000 7fb48cb9a700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb488142ea0 0x7fb4880c8030 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb48806f0d0 tx=0x7fb478017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.505+0000 7fb47d7fa700 1 -- 172.21.15.86:0/2161298982 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478011420 con 0x7fb488142ea0 2023-10-09T12:57:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.505+0000 7fb47d7fa700 1 -- 172.21.15.86:0/2161298982 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780115a0 con 0x7fb488142ea0 2023-10-09T12:57:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.505+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4880aefe0 con 0x7fb488142ea0 2023-10-09T12:57:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.505+0000 7fb47d7fa700 1 -- 172.21.15.86:0/2161298982 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478011960 con 0x7fb488142ea0 2023-10-09T12:57:19.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.505+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4880c7b10 con 0x7fb488142ea0 2023-10-09T12:57:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.506+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4880c7d30 con 0x7fb488142ea0 2023-10-09T12:57:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.507+0000 7fb47d7fa700 1 -- 172.21.15.86:0/2161298982 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4780253f0 con 0x7fb488142ea0 2023-10-09T12:57:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.507+0000 7fb47d7fa700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.508+0000 7fb47d7fa700 1 -- 172.21.15.86:0/2161298982 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5301+0+0 (secure 0 0 0) 0x7fb478085d50 con 0x7fb488142ea0 2023-10-09T12:57:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.508+0000 7fb48d39b700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.508+0000 7fb48d39b700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb4840017a0 tx=0x7fb484009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.512+0000 7fb47d7fa700 1 -- 172.21.15.86:0/2161298982 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb478089030 con 0x7fb488142ea0 2023-10-09T12:57:19.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.710+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb48804c3c0 con 0x7fb488142ea0 2023-10-09T12:57:19.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.710+0000 7fb47d7fa700 1 -- 172.21.15.86:0/2161298982 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v174) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb478053150 con 0x7fb488142ea0 2023-10-09T12:57:19.711 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:19.711 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T12:57:19.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:19.712 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T12:57:19.712 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T12:57:19.712 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:19.712 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 msgr2=0x7fb46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb4840017a0 tx=0x7fb484009040 comp rx=0 tx=0).stop 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb488142ea0 msgr2=0x7fb4880c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb488142ea0 0x7fb4880c8030 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb48806f0d0 tx=0x7fb478017000 comp rx=0 tx=0).stop 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 shutdown_connections 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4880c8570 0x7fb48815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb48806bf20 0x7fb488158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 --2- 172.21.15.86:0/2161298982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb488142ea0 0x7fb4880c8030 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.712+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 >> 172.21.15.86:0/2161298982 conn(0x7fb4880ce430 msgr2=0x7fb4880cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:19.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.713+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 shutdown_connections 2023-10-09T12:57:19.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.713+0000 7fb48e39d700 1 -- 172.21.15.86:0/2161298982 wait complete. 2023-10-09T12:57:19.731 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T12:57:19.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T12:57:19.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.915+0000 7f6169d9d700 1 Processor -- start 2023-10-09T12:57:19.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.915+0000 7f6169d9d700 1 -- start start 2023-10-09T12:57:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.916+0000 7f6169d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f61640b0c00 0x7f61640ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.916+0000 7f6169d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640b0570 con 0x7f6164156350 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.916+0000 7f6169d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640af4d0 con 0x7f61640b0760 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.916+0000 7f6169d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640af7b0 con 0x7f61640b0c00 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.916+0000 7f6168d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6164156350 0x7f6164157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47660/0 (socket says 172.21.15.86:47660) 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.916+0000 7f6168d9b700 1 -- 172.21.15.86:0/4285838269 learned_addr learned my addr 172.21.15.86:0/4285838269 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.916+0000 7f616959c700 1 --2- 172.21.15.86:0/4285838269 >> v2:172.21.15.86:3300/0 conn(0x7f61640b0c00 0x7f61640ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.917+0000 7f61637fe700 1 -- 172.21.15.86:0/4285838269 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415803740 0 0) 0x7f61640b0570 con 0x7f6164156350 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.917+0000 7f61637fe700 1 -- 172.21.15.86:0/4285838269 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6154003570 con 0x7f6164156350 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.917+0000 7f616959c700 1 -- 172.21.15.86:0/4285838269 >> v1:172.21.15.135:6789/0 conn(0x7f61640b0760 legacy=0x7f61640ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.917+0000 7f616959c700 1 -- 172.21.15.86:0/4285838269 >> v1:172.21.15.86:6789/0 conn(0x7f6164156350 legacy=0x7f6164157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.917+0000 7f616959c700 1 -- 172.21.15.86:0/4285838269 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640afa90 con 0x7f61640b0c00 2023-10-09T12:57:19.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.917+0000 7f616959c700 1 --2- 172.21.15.86:0/4285838269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640ad570 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f615c009e60 tx=0x7f615c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52eec64da8805691 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.917+0000 7f61637fe700 1 -- 172.21.15.86:0/4285838269 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00e070 con 0x7f61640b0c00 2023-10-09T12:57:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f61637fe700 1 -- 172.21.15.86:0/4285838269 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c00bb20 con 0x7f61640b0c00 2023-10-09T12:57:19.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f61637fe700 1 -- 172.21.15.86:0/4285838269 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c012430 con 0x7f61640b0c00 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f6169d9d700 1 -- 172.21.15.86:0/4285838269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 msgr2=0x7f61640ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f6169d9d700 1 --2- 172.21.15.86:0/4285838269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640ad570 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f615c009e60 tx=0x7f615c009780 comp rx=0 tx=0).stop 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f6169d9d700 1 -- 172.21.15.86:0/4285838269 shutdown_connections 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f6169d9d700 1 --2- 172.21.15.86:0/4285838269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640ad570 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f6169d9d700 1 -- 172.21.15.86:0/4285838269 >> 172.21.15.86:0/4285838269 conn(0x7f6164068e20 msgr2=0x7f61640cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f6169d9d700 1 -- 172.21.15.86:0/4285838269 shutdown_connections 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.918+0000 7f6169d9d700 1 -- 172.21.15.86:0/4285838269 wait complete. 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.920+0000 7f6169d9d700 1 Processor -- start 2023-10-09T12:57:19.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.920+0000 7f6169d9d700 1 -- start start 2023-10-09T12:57:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6169d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61640b0760 0x7f61640aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6169d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6169d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6164156350 0x7f61640cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6169d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616414f600 con 0x7f61640b0c00 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6169d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61641696c0 con 0x7f6164156350 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6169d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6164166600 con 0x7f61640b0760 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6163fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6163fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52574/0 (socket says 172.21.15.86:52574) 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6163fff700 1 -- 172.21.15.86:0/3891004029 learned_addr learned my addr 172.21.15.86:0/3891004029 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f6168d9b700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61640b0760 0x7f61640aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.921+0000 7f616959c700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6164156350 0x7f61640cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6163fff700 1 -- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61640b0760 msgr2=0x7f61640aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6163fff700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61640b0760 0x7f61640aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6163fff700 1 -- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6164156350 msgr2=0x7f61640cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6163fff700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6164156350 0x7f61640cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6163fff700 1 -- 172.21.15.86:0/3891004029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c009a20 con 0x7f61640b0c00 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6163fff700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640cb030 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f615000b5e0 tx=0x7f6150009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6160ff9700 1 -- 172.21.15.86:0/3891004029 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000f510 con 0x7f61640b0c00 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6160ff9700 1 -- 172.21.15.86:0/3891004029 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000f670 con 0x7f61640b0c00 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6164168d90 con 0x7f61640b0c00 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6160ff9700 1 -- 172.21.15.86:0/3891004029 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000fa30 con 0x7f61640b0c00 2023-10-09T12:57:19.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.922+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6164169350 con 0x7f61640b0c00 2023-10-09T12:57:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.923+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6164169830 con 0x7f61640b0c00 2023-10-09T12:57:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.924+0000 7f6160ff9700 1 -- 172.21.15.86:0/3891004029 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f615001a400 con 0x7f61640b0c00 2023-10-09T12:57:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.925+0000 7f6160ff9700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6148066f30 0x7f61480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.925+0000 7f6160ff9700 1 -- 172.21.15.86:0/3891004029 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5301+0+0 (secure 0 0 0) 0x7f6150083e30 con 0x7f61640b0c00 2023-10-09T12:57:19.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.925+0000 7f6168d9b700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6148066f30 0x7f61480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:19.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.926+0000 7f6168d9b700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6148066f30 0x7f61480693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6158007fd0 tx=0x7f6158009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:19.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:19.929+0000 7f6160ff9700 1 -- 172.21.15.86:0/3891004029 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6150051210 con 0x7f61640b0c00 2023-10-09T12:57:20.120 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.119+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f616404c3c0 con 0x7f61640b0c00 2023-10-09T12:57:20.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.578+0000 7f6160ff9700 1 -- 172.21.15.86:0/3891004029 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v175) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6150058e60 con 0x7f61640b0c00 2023-10-09T12:57:20.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6148066f30 msgr2=0x7f61480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:20.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6148066f30 0x7f61480693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6158007fd0 tx=0x7f6158009040 comp rx=0 tx=0).stop 2023-10-09T12:57:20.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 msgr2=0x7f61640cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:20.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640cb030 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f615000b5e0 tx=0x7f6150009120 comp rx=0 tx=0).stop 2023-10-09T12:57:20.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 shutdown_connections 2023-10-09T12:57:20.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6164156350 0x7f61640cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61640b0760 0x7f61640aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f6148066f30 0x7f61480693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 --2- 172.21.15.86:0/3891004029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61640b0c00 0x7f61640cb030 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 >> 172.21.15.86:0/3891004029 conn(0x7f6164068e20 msgr2=0x7f6164158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:20.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 shutdown_connections 2023-10-09T12:57:20.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.582+0000 7f6169d9d700 1 -- 172.21.15.86:0/3891004029 wait complete. 2023-10-09T12:57:20.585 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T12:57:20.604 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T12:57:20.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.791+0000 7f880cd9d700 1 Processor -- start 2023-10-09T12:57:20.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.791+0000 7f880cd9d700 1 -- start start 2023-10-09T12:57:20.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.791+0000 7f880cd9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88080cf480 0x7f880815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:20.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.791+0000 7f880cd9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080b10f0 con 0x7f880815d760 2023-10-09T12:57:20.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.791+0000 7f880cd9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880815db80 con 0x7f88081595d0 2023-10-09T12:57:20.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.791+0000 7f880cd9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880815e000 con 0x7f88080cf480 2023-10-09T12:57:20.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f8807fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f880815d760 0x7f88080b1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47668/0 (socket says 172.21.15.86:47668) 2023-10-09T12:57:20.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f8807fff700 1 -- 172.21.15.86:0/2778268932 learned_addr learned my addr 172.21.15.86:0/2778268932 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:20.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f8806ffd700 1 --2- 172.21.15.86:0/2778268932 >> v2:172.21.15.135:3300/0 conn(0x7f88080cf480 0x7f880815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:20.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f88067fc700 1 -- 172.21.15.86:0/2778268932 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243263160 0 0) 0x7f88080b10f0 con 0x7f880815d760 2023-10-09T12:57:20.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f88067fc700 1 -- 172.21.15.86:0/2778268932 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f0003570 con 0x7f880815d760 2023-10-09T12:57:20.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f8806ffd700 1 -- 172.21.15.86:0/2778268932 >> v1:172.21.15.135:6789/0 conn(0x7f88081595d0 legacy=0x7f88080ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:20.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f8806ffd700 1 -- 172.21.15.86:0/2778268932 >> v1:172.21.15.86:6789/0 conn(0x7f880815d760 legacy=0x7f88080b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:20.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.792+0000 7f8806ffd700 1 -- 172.21.15.86:0/2778268932 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080cf990 con 0x7f88080cf480 2023-10-09T12:57:20.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.793+0000 7f8806ffd700 1 --2- 172.21.15.86:0/2778268932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 0x7f880815d220 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0098e0 tx=0x7f87fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5bbcc5c81df1f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:20.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.793+0000 7f88067fc700 1 -- 172.21.15.86:0/2778268932 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00b640 con 0x7f88080cf480 2023-10-09T12:57:20.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.793+0000 7f88067fc700 1 -- 172.21.15.86:0/2778268932 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00b7a0 con 0x7f88080cf480 2023-10-09T12:57:20.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.793+0000 7f88067fc700 1 -- 172.21.15.86:0/2778268932 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00bb20 con 0x7f88080cf480 2023-10-09T12:57:20.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.794+0000 7f880cd9d700 1 -- 172.21.15.86:0/2778268932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 msgr2=0x7f880815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:20.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.794+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2778268932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 0x7f880815d220 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0098e0 tx=0x7f87fc0091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.794+0000 7f880cd9d700 1 -- 172.21.15.86:0/2778268932 shutdown_connections 2023-10-09T12:57:20.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.794+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2778268932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 0x7f880815d220 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.794+0000 7f880cd9d700 1 -- 172.21.15.86:0/2778268932 >> 172.21.15.86:0/2778268932 conn(0x7f88080d05f0 msgr2=0x7f88080d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:20.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.794+0000 7f880cd9d700 1 -- 172.21.15.86:0/2778268932 shutdown_connections 2023-10-09T12:57:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.794+0000 7f880cd9d700 1 -- 172.21.15.86:0/2778268932 wait complete. 2023-10-09T12:57:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.795+0000 7f880cd9d700 1 Processor -- start 2023-10-09T12:57:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.795+0000 7f880cd9d700 1 -- start start 2023-10-09T12:57:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f880cd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 0x7f880816b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f880cd9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88081595d0 0x7f880816aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f880cd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f880815d760 0x7f88080c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:20.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f880cd9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808152a90 con 0x7f88081595d0 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f880cd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808157ad0 con 0x7f88080cf480 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f880cd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c66f0 con 0x7f880815d760 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f8806ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88081595d0 0x7f880816aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f8806ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88081595d0 0x7f880816aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52578/0 (socket says 172.21.15.86:52578) 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.796+0000 7f8806ffd700 1 -- 172.21.15.86:0/2521641931 learned_addr learned my addr 172.21.15.86:0/2521641931 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f8807fff700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f880815d760 0x7f88080c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f88077fe700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 0x7f880816b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:20.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f8806ffd700 1 -- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f880815d760 msgr2=0x7f88080c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:20.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f8806ffd700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f880815d760 0x7f88080c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f8806ffd700 1 -- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 msgr2=0x7f880816b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:20.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f8806ffd700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 0x7f880816b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:20.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f8806ffd700 1 -- 172.21.15.86:0/2521641931 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc009420 con 0x7f88081595d0 2023-10-09T12:57:20.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f8806ffd700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88081595d0 0x7f880816aca0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f87fc013000 tx=0x7f87fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:20.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f87ef7fe700 1 -- 172.21.15.86:0/2521641931 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00b910 con 0x7f88081595d0 2023-10-09T12:57:20.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f87ef7fe700 1 -- 172.21.15.86:0/2521641931 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00bab0 con 0x7f88081595d0 2023-10-09T12:57:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.797+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880816b1e0 con 0x7f88081595d0 2023-10-09T12:57:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.798+0000 7f87ef7fe700 1 -- 172.21.15.86:0/2521641931 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc025670 con 0x7f88081595d0 2023-10-09T12:57:20.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.798+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808157480 con 0x7f88081595d0 2023-10-09T12:57:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.799+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8808157c60 con 0x7f88081595d0 2023-10-09T12:57:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.800+0000 7f87ef7fe700 1 -- 172.21.15.86:0/2521641931 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87fc023070 con 0x7f88081595d0 2023-10-09T12:57:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.800+0000 7f87ef7fe700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f87f4066f30 0x7f87f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.801+0000 7f87ef7fe700 1 -- 172.21.15.86:0/2521641931 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5671+0+0 (secure 0 0 0) 0x7f87fc086230 con 0x7f88081595d0 2023-10-09T12:57:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.801+0000 7f88077fe700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f87f4066f30 0x7f87f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:20.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.801+0000 7f88077fe700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f87f4066f30 0x7f87f40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f87f8000fb0 tx=0x7f87f8009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:20.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.804+0000 7f87ef7fe700 1 -- 172.21.15.86:0/2521641931 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87fc0534a0 con 0x7f88081595d0 2023-10-09T12:57:20.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:20.997+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f880804c3c0 con 0x7f88081595d0 2023-10-09T12:57:21.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.584+0000 7f87ef7fe700 1 -- 172.21.15.86:0/2521641931 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v176) v1 ==== 170+0+0 (secure 0 0 0) 0x7f87fc056ac0 con 0x7f88081595d0 2023-10-09T12:57:21.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.599+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f87f4066f30 msgr2=0x7f87f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:21.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.599+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f87f4066f30 0x7f87f40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f87f8000fb0 tx=0x7f87f8009040 comp rx=0 tx=0).stop 2023-10-09T12:57:21.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.599+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88081595d0 msgr2=0x7f880816aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:21.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.600+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88081595d0 0x7f880816aca0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f87fc013000 tx=0x7f87fc017000 comp rx=0 tx=0).stop 2023-10-09T12:57:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.600+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 shutdown_connections 2023-10-09T12:57:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.600+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f880815d760 0x7f88080c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.600+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88080cf480 0x7f880816b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.600+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f87f4066f30 0x7f87f40693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.600+0000 7f880cd9d700 1 --2- 172.21.15.86:0/2521641931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88081595d0 0x7f880816aca0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.600+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 >> 172.21.15.86:0/2521641931 conn(0x7f88080d05f0 msgr2=0x7f8808152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:21.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.601+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 shutdown_connections 2023-10-09T12:57:21.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.601+0000 7f880cd9d700 1 -- 172.21.15.86:0/2521641931 wait complete. 2023-10-09T12:57:21.605 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T12:57:21.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T12:57:21.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.806+0000 7fa869bff700 1 Processor -- start 2023-10-09T12:57:21.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.806+0000 7fa869bff700 1 -- start start 2023-10-09T12:57:21.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.807+0000 7fa869bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa8640aca80 0x7fa86406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa869bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86406bdb0 con 0x7fa864069d60 2023-10-09T12:57:21.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa869bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640cb370 con 0x7fa8640c83c0 2023-10-09T12:57:21.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa869bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa864159f60 con 0x7fa8640aca80 2023-10-09T12:57:21.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa862ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa864069d60 0x7fa8640c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47680/0 (socket says 172.21.15.86:47680) 2023-10-09T12:57:21.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa862ffd700 1 -- 172.21.15.86:0/1058508699 learned_addr learned my addr 172.21.15.86:0/1058508699 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:21.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332457206 0 0) 0x7fa86406bdb0 con 0x7fa864069d60 2023-10-09T12:57:21.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c003570 con 0x7fa864069d60 2023-10-09T12:57:21.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa8637fe700 1 --2- 172.21.15.86:0/1058508699 >> v2:172.21.15.135:3300/0 conn(0x7fa8640aca80 0x7fa86406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717486610 0 0) 0x7fa84c003570 con 0x7fa864069d60 2023-10-09T12:57:21.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 >> v2:172.21.15.135:3300/0 conn(0x7fa8640aca80 msgr2=0x7fa86406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.808+0000 7fa8627fc700 1 --2- 172.21.15.86:0/1058508699 >> v2:172.21.15.135:3300/0 conn(0x7fa8640aca80 0x7fa86406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 >> v1:172.21.15.135:6789/0 conn(0x7fa8640c83c0 legacy=0x7fa8640cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86406b510 con 0x7fa864069d60 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa858001470 con 0x7fa864069d60 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 >> v1:172.21.15.86:6789/0 conn(0x7fa864069d60 legacy=0x7fa8640c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c003a60 0x7fa84c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa84c004810 0x7fa84c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84c0052e0 0x7fa84c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864159f60 con 0x7fa84c004810 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c00c190 con 0x7fa84c0052e0 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c00c350 con 0x7fa84c003a60 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8637fe700 1 --2- 172.21.15.86:0/1058508699 >> v2:172.21.15.135:3300/0 conn(0x7fa8640aca80 0x7fa86406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa862ffd700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa84c004810 0x7fa84c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa863fff700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84c0052e0 0x7fa84c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa8637fe700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c003a60 0x7fa84c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa862ffd700 1 -- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c003a60 msgr2=0x7fa84c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa862ffd700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c003a60 0x7fa84c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa862ffd700 1 -- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84c0052e0 msgr2=0x7fa84c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:21.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa862ffd700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84c0052e0 0x7fa84c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa862ffd700 1 -- 172.21.15.86:0/1058508699 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c003570 con 0x7fa84c004810 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.809+0000 7fa863fff700 1 -- 172.21.15.86:0/1058508699 reap_dead start 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa862ffd700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa84c004810 0x7fa84c004c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c390 tx=0x7fa858001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9618bf220cf953a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85800cc60 con 0x7fa84c004810 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85800cdc0 con 0x7fa84c004810 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa8627fc700 1 -- 172.21.15.86:0/1058508699 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858005b50 con 0x7fa84c004810 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa869bff700 1 -- 172.21.15.86:0/1058508699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa84c004810 msgr2=0x7fa84c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa869bff700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa84c004810 0x7fa84c004c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c390 tx=0x7fa858001e50 comp rx=0 tx=0).stop 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa869bff700 1 -- 172.21.15.86:0/1058508699 shutdown_connections 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa869bff700 1 --2- 172.21.15.86:0/1058508699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa84c004810 0x7fa84c004c80 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa869bff700 1 -- 172.21.15.86:0/1058508699 >> 172.21.15.86:0/1058508699 conn(0x7fa8640cd670 msgr2=0x7fa8640cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:21.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa869bff700 1 -- 172.21.15.86:0/1058508699 shutdown_connections 2023-10-09T12:57:21.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.810+0000 7fa869bff700 1 -- 172.21.15.86:0/1058508699 wait complete. 2023-10-09T12:57:21.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.812+0000 7fa869bff700 1 Processor -- start 2023-10-09T12:57:21.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.812+0000 7fa869bff700 1 -- start start 2023-10-09T12:57:21.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa869bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c004810 0x7fa864157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa869bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8641577b0 0x7fa8640b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa869bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8640b0dd0 0x7fa8640b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa869bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640afd50 con 0x7fa8641577b0 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa869bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864157c20 con 0x7fa8640b0dd0 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa869bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640b3410 con 0x7fa84c004810 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8641577b0 0x7fa8640b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8641577b0 0x7fa8640b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52592/0 (socket says 172.21.15.86:52592) 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 -- 172.21.15.86:0/2095226642 learned_addr learned my addr 172.21.15.86:0/2095226642 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa863fff700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8640b0dd0 0x7fa8640b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa8637fe700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c004810 0x7fa864157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 -- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c004810 msgr2=0x7fa864157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c004810 0x7fa864157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 -- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8640b0dd0 msgr2=0x7fa8640b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:21.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8640b0dd0 0x7fa8640b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.813+0000 7fa862ffd700 1 -- 172.21.15.86:0/2095226642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640b2e50 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.814+0000 7fa862ffd700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8641577b0 0x7fa8640b0890 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c980 tx=0x7fa858015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.814+0000 7fa84b7fe700 1 -- 172.21.15.86:0/2095226642 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858001430 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.814+0000 7fa84b7fe700 1 -- 172.21.15.86:0/2095226642 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8580070d0 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.814+0000 7fa84b7fe700 1 -- 172.21.15.86:0/2095226642 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858007490 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.814+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8640b3130 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.814+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86416b3c0 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.815+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86416b580 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.816+0000 7fa84b7fe700 1 -- 172.21.15.86:0/2095226642 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa858028460 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.817+0000 7fa84b7fe700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa850066f30 0x7fa8500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.817+0000 7fa84b7fe700 1 -- 172.21.15.86:0/2095226642 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6053+0+0 (secure 0 0 0) 0x7fa858086880 con 0x7fa8641577b0 2023-10-09T12:57:21.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.818+0000 7fa8637fe700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa850066f30 0x7fa8500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:21.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.818+0000 7fa8637fe700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa850066f30 0x7fa8500693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa864061160 tx=0x7fa854008040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:21.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:21.821+0000 7fa84b7fe700 1 -- 172.21.15.86:0/2095226642 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8580538f0 con 0x7fa8641577b0 2023-10-09T12:57:22.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.055+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa86404c3c0 con 0x7fa8641577b0 2023-10-09T12:57:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.610+0000 7fa84b7fe700 1 -- 172.21.15.86:0/2095226642 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v75) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa858017070 con 0x7fa8641577b0 2023-10-09T12:57:22.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa850066f30 msgr2=0x7fa8500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:22.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa850066f30 0x7fa8500693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa864061160 tx=0x7fa854008040 comp rx=0 tx=0).stop 2023-10-09T12:57:22.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8641577b0 msgr2=0x7fa8640b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:22.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8641577b0 0x7fa8640b0890 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c980 tx=0x7fa858015000 comp rx=0 tx=0).stop 2023-10-09T12:57:22.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 shutdown_connections 2023-10-09T12:57:22.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8640b0dd0 0x7fa8640b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84c004810 0x7fa864157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa850066f30 0x7fa8500693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 --2- 172.21.15.86:0/2095226642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8641577b0 0x7fa8640b0890 secure :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c980 tx=0x7fa858015000 comp rx=0 tx=0).stop 2023-10-09T12:57:22.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.615+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 >> 172.21.15.86:0/2095226642 conn(0x7fa8640cd670 msgr2=0x7fa864152450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:22.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.617+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 shutdown_connections 2023-10-09T12:57:22.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.618+0000 7fa869bff700 1 -- 172.21.15.86:0/2095226642 wait complete. 2023-10-09T12:57:22.621 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 20 and data pool 21 2023-10-09T12:57:22.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:57:22.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.825+0000 7f8c7359e700 1 Processor -- start 2023-10-09T12:57:22.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.826+0000 7f8c7359e700 1 -- start start 2023-10-09T12:57:22.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.827+0000 7f8c7359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c741566e0 0x7f8c740ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.827+0000 7f8c7359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 0x7f8c740ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.827+0000 7f8c7359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c740ca860 con 0x7f8c74156310 2023-10-09T12:57:22.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.827+0000 7f8c7359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740cab40 con 0x7f8c741566e0 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.827+0000 7f8c7359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740cae20 con 0x7f8c740cb900 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.827+0000 7f8c7259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8c74156310 0x7f8c740c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47688/0 (socket says 172.21.15.86:47688) 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.827+0000 7f8c7259c700 1 -- 172.21.15.86:0/2665041861 learned_addr learned my addr 172.21.15.86:0/2665041861 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c71d9b700 1 --2- 172.21.15.86:0/2665041861 >> v2:172.21.15.135:3300/0 conn(0x7f8c741566e0 0x7f8c740ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 0x7f8c740ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53747780 0 0) 0x7f8c740ca860 con 0x7f8c74156310 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c5c003570 con 0x7f8c74156310 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2747584517 0 0) 0x7f8c5c003570 con 0x7f8c74156310 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 msgr2=0x7f8c740ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:22.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 0x7f8c740ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 >> v2:172.21.15.135:3300/0 conn(0x7f8c741566e0 msgr2=0x7f8c740ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 --2- 172.21.15.86:0/2665041861 >> v2:172.21.15.135:3300/0 conn(0x7f8c741566e0 0x7f8c740ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740cb100 con 0x7f8c74156310 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f8c64001470 con 0x7f8c74156310 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 >> v1:172.21.15.86:6789/0 conn(0x7f8c74156310 legacy=0x7f8c740c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c003a60 0x7f8c5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 0x7f8c5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c5c004d50 0x7f8c5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740cab40 con 0x7f8c5c004d50 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740cae20 con 0x7f8c5c003a60 2023-10-09T12:57:22.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c00dc70 con 0x7f8c740cb900 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.828+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c5c004d50 0x7f8c5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c7259c700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c003a60 0x7f8c5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c71d9b700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 0x7f8c5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c72d9d700 1 -- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 msgr2=0x7f8c5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c740cb900 0x7f8c5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c72d9d700 1 -- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c003a60 msgr2=0x7f8c5c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c003a60 0x7f8c5c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c72d9d700 1 -- 172.21.15.86:0/2665041861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c003570 con 0x7f8c5c004d50 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c5c004d50 0x7f8c5c0051c0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e210 tx=0x7f8c6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a413dabe96af6c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00ea60 con 0x7f8c5c004d50 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00f040 con 0x7f8c5c004d50 2023-10-09T12:57:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.829+0000 7f8c7159a700 1 -- 172.21.15.86:0/2665041861 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00ee10 con 0x7f8c5c004d50 2023-10-09T12:57:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.830+0000 7f8c7359e700 1 -- 172.21.15.86:0/2665041861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c5c004d50 msgr2=0x7f8c5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.830+0000 7f8c7359e700 1 --2- 172.21.15.86:0/2665041861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c5c004d50 0x7f8c5c0051c0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e210 tx=0x7f8c6c00b040 comp rx=0 tx=0).stop 2023-10-09T12:57:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.830+0000 7f8c72d9d700 1 -- 172.21.15.86:0/2665041861 reap_dead start 2023-10-09T12:57:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.830+0000 7f8c7359e700 1 -- 172.21.15.86:0/2665041861 shutdown_connections 2023-10-09T12:57:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.830+0000 7f8c7359e700 1 -- 172.21.15.86:0/2665041861 >> 172.21.15.86:0/2665041861 conn(0x7f8c740cc1f0 msgr2=0x7f8c740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.830+0000 7f8c7359e700 1 -- 172.21.15.86:0/2665041861 shutdown_connections 2023-10-09T12:57:22.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.830+0000 7f8c7359e700 1 -- 172.21.15.86:0/2665041861 wait complete. 2023-10-09T12:57:22.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.831+0000 7f8c7359e700 1 Processor -- start 2023-10-09T12:57:22.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.832+0000 7f8c7359e700 1 -- start start 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.832+0000 7f8c7359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c004d50 0x7f8c7414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.832+0000 7f8c7359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c74154d10 0x7f8c74155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.832+0000 7f8c7359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c740c1090 0x7f8c740c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.832+0000 7f8c7359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740c1a70 con 0x7f8c740c1090 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.832+0000 7f8c7359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7415e280 con 0x7f8c5c004d50 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.832+0000 7f8c7359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7415ddf0 con 0x7f8c74154d10 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c740c1090 0x7f8c740c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c740c1090 0x7f8c740c1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52620/0 (socket says 172.21.15.86:52620) 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 -- 172.21.15.86:0/3880979289 learned_addr learned my addr 172.21.15.86:0/3880979289 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:22.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c71d9b700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c74154d10 0x7f8c74155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c7259c700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c004d50 0x7f8c7414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 -- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c74154d10 msgr2=0x7f8c74155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c74154d10 0x7f8c74155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 -- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c004d50 msgr2=0x7f8c7414b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c004d50 0x7f8c7414b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 -- 172.21.15.86:0/3880979289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7415d1e0 con 0x7f8c740c1090 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c7259c700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c004d50 0x7f8c7414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c72d9d700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c740c1090 0x7f8c740c1530 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c016000 tx=0x7f8c6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.833+0000 7f8c627fc700 1 -- 172.21.15.86:0/3880979289 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00eee0 con 0x7f8c740c1090 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.834+0000 7f8c627fc700 1 -- 172.21.15.86:0/3880979289 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c022070 con 0x7f8c740c1090 2023-10-09T12:57:22.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.834+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7415d4c0 con 0x7f8c740c1090 2023-10-09T12:57:22.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.834+0000 7f8c627fc700 1 -- 172.21.15.86:0/3880979289 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0276a0 con 0x7f8c740c1090 2023-10-09T12:57:22.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.834+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7415da80 con 0x7f8c740c1090 2023-10-09T12:57:22.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.835+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7415df80 con 0x7f8c740c1090 2023-10-09T12:57:22.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.835+0000 7f8c627fc700 1 -- 172.21.15.86:0/3880979289 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c6c024030 con 0x7f8c740c1090 2023-10-09T12:57:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.837+0000 7f8c627fc700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c54066f30 0x7f8c540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.837+0000 7f8c627fc700 1 -- 172.21.15.86:0/3880979289 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f8c6c086360 con 0x7f8c740c1090 2023-10-09T12:57:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.837+0000 7f8c7259c700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c54066f30 0x7f8c540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:22.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.838+0000 7f8c7259c700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c54066f30 0x7f8c540693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c64000e10 tx=0x7f8c64009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:22.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:22.841+0000 7f8c627fc700 1 -- 172.21.15.86:0/3880979289 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c6c053370 con 0x7f8c740c1090 2023-10-09T12:57:23.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.031+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c7404c3c0 con 0x7f8c740c1090 2023-10-09T12:57:23.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.032+0000 7f8c627fc700 1 -- 172.21.15.86:0/3880979289 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+16112 (secure 0 0 0) 0x7f8c6c056990 con 0x7f8c740c1090 2023-10-09T12:57:23.032 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:23.032 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":177,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:57:22.056003+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:57:20.160700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T12:57:21.037369+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:57:23.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c54066f30 msgr2=0x7f8c540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c54066f30 0x7f8c540693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c64000e10 tx=0x7f8c64009040 comp rx=0 tx=0).stop 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c740c1090 msgr2=0x7f8c740c1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c740c1090 0x7f8c740c1530 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c016000 tx=0x7f8c6c01a000 comp rx=0 tx=0).stop 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 shutdown_connections 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8c54066f30 0x7f8c540693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c740c1090 0x7f8c740c1530 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c5c004d50 0x7f8c7414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 --2- 172.21.15.86:0/3880979289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c74154d10 0x7f8c74155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 >> 172.21.15.86:0/3880979289 conn(0x7f8c740cc1f0 msgr2=0x7f8c7414e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 shutdown_connections 2023-10-09T12:57:23.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.034+0000 7f8c7359e700 1 -- 172.21.15.86:0/3880979289 wait complete. 2023-10-09T12:57:23.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:57:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.234+0000 7f2898dff700 1 Processor -- start 2023-10-09T12:57:23.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.234+0000 7f2898dff700 1 -- start start 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.235+0000 7f2898dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28941578b0 0x7f2894155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.235+0000 7f2898dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f28940af2f0 0x7f28940af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.235+0000 7f2898dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28940ad930 con 0x7f2894155c10 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2898dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28940b0c80 con 0x7f28940af2f0 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2898dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28940acd20 con 0x7f28941578b0 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f289259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2894155c10 0x7f28940ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47696/0 (socket says 172.21.15.86:47696) 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f289259c700 1 -- 172.21.15.86:0/161464830 learned_addr learned my addr 172.21.15.86:0/161464830 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2892d9d700 1 --2- 172.21.15.86:0/161464830 >> v2:172.21.15.86:3300/0 conn(0x7f28940af2f0 0x7f28940af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f288bfff700 1 --2- 172.21.15.86:0/161464830 >> v2:172.21.15.135:3300/0 conn(0x7f28941578b0 0x7f2894155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2892d9d700 1 -- 172.21.15.86:0/161464830 >> v2:172.21.15.135:3300/0 conn(0x7f28941578b0 msgr2=0x7f2894155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2891d9b700 1 -- 172.21.15.86:0/161464830 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582676722 0 0) 0x7f28940ad930 con 0x7f2894155c10 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2892d9d700 1 --2- 172.21.15.86:0/161464830 >> v2:172.21.15.135:3300/0 conn(0x7f28941578b0 0x7f2894155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2892d9d700 1 -- 172.21.15.86:0/161464830 >> v1:172.21.15.86:6789/0 conn(0x7f2894155c10 legacy=0x7f28940ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.236+0000 7f2892d9d700 1 -- 172.21.15.86:0/161464830 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28940ad000 con 0x7f28940af2f0 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2892d9d700 1 --2- 172.21.15.86:0/161464830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28940af2f0 0x7f28940af730 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f28940c8c60 tx=0x7f288c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ca8d9aa704b0de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2891d9b700 1 -- 172.21.15.86:0/161464830 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00e070 con 0x7f28940af2f0 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2891d9b700 1 -- 172.21.15.86:0/161464830 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00bc30 con 0x7f28940af2f0 2023-10-09T12:57:23.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2891d9b700 1 -- 172.21.15.86:0/161464830 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c012430 con 0x7f28940af2f0 2023-10-09T12:57:23.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2898dff700 1 -- 172.21.15.86:0/161464830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28940af2f0 msgr2=0x7f28940af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2898dff700 1 --2- 172.21.15.86:0/161464830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28940af2f0 0x7f28940af730 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f28940c8c60 tx=0x7f288c009780 comp rx=0 tx=0).stop 2023-10-09T12:57:23.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2898dff700 1 -- 172.21.15.86:0/161464830 shutdown_connections 2023-10-09T12:57:23.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2898dff700 1 --2- 172.21.15.86:0/161464830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28940af2f0 0x7f28940af730 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2898dff700 1 --2- 172.21.15.86:0/161464830 >> v2:172.21.15.135:3300/0 conn(0x7f28941578b0 0x7f2894155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2898dff700 1 -- 172.21.15.86:0/161464830 >> 172.21.15.86:0/161464830 conn(0x7f289406a320 msgr2=0x7f28940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:23.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.237+0000 7f2898dff700 1 -- 172.21.15.86:0/161464830 shutdown_connections 2023-10-09T12:57:23.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.238+0000 7f2898dff700 1 -- 172.21.15.86:0/161464830 wait complete. 2023-10-09T12:57:23.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.239+0000 7f2898dff700 1 Processor -- start 2023-10-09T12:57:23.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.239+0000 7f2898dff700 1 -- start start 2023-10-09T12:57:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2898dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28940af2f0 0x7f28940c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2898dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2894155c10 0x7f289406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2898dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28941578b0 0x7f28941653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2898dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289406e7e0 con 0x7f28941578b0 2023-10-09T12:57:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2898dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289406ecd0 con 0x7f28940af2f0 2023-10-09T12:57:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2898dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28940ca5b0 con 0x7f2894155c10 2023-10-09T12:57:23.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2892d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28941578b0 0x7f28941653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2892d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28941578b0 0x7f28941653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52638/0 (socket says 172.21.15.86:52638) 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f2892d9d700 1 -- 172.21.15.86:0/155578926 learned_addr learned my addr 172.21.15.86:0/155578926 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f289259c700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28940af2f0 0x7f28940c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.240+0000 7f288bfff700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2894155c10 0x7f289406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2892d9d700 1 -- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2894155c10 msgr2=0x7f289406e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2892d9d700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2894155c10 0x7f289406e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2892d9d700 1 -- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28940af2f0 msgr2=0x7f28940c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2892d9d700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28940af2f0 0x7f28940c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2892d9d700 1 -- 172.21.15.86:0/155578926 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c009a20 con 0x7f28941578b0 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2892d9d700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28941578b0 0x7f28941653e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2894064290 tx=0x7f288c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f288a7fc700 1 -- 172.21.15.86:0/155578926 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c027470 con 0x7f28941578b0 2023-10-09T12:57:23.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f288a7fc700 1 -- 172.21.15.86:0/155578926 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c0275d0 con 0x7f28941578b0 2023-10-09T12:57:23.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289406e9f0 con 0x7f28941578b0 2023-10-09T12:57:23.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f288a7fc700 1 -- 172.21.15.86:0/155578926 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c027990 con 0x7f28941578b0 2023-10-09T12:57:23.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.241+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28940cab30 con 0x7f28941578b0 2023-10-09T12:57:23.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.242+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289404c3c0 con 0x7f28941578b0 2023-10-09T12:57:23.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.243+0000 7f288a7fc700 1 -- 172.21.15.86:0/155578926 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f288c024070 con 0x7f28941578b0 2023-10-09T12:57:23.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.244+0000 7f288a7fc700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2874066f30 0x7f28740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.244+0000 7f288a7fc700 1 -- 172.21.15.86:0/155578926 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f288c086dc0 con 0x7f28941578b0 2023-10-09T12:57:23.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.244+0000 7f289259c700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2874066f30 0x7f28740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.245+0000 7f289259c700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2874066f30 0x7f28740693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2884007fd0 tx=0x7f2884007d30 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:23.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.248+0000 7f288a7fc700 1 -- 172.21.15.86:0/155578926 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f288c053e80 con 0x7f28941578b0 2023-10-09T12:57:23.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.437+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28940ad2e0 con 0x7f28941578b0 2023-10-09T12:57:23.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.438+0000 7f288a7fc700 1 -- 172.21.15.86:0/155578926 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+16112 (secure 0 0 0) 0x7f288c02c020 con 0x7f28941578b0 2023-10-09T12:57:23.438 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:23.438 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":177,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:57:22.056003+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:57:20.160700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T12:57:21.037369+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2874066f30 msgr2=0x7f28740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2874066f30 0x7f28740693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2884007fd0 tx=0x7f2884007d30 comp rx=0 tx=0).stop 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28941578b0 msgr2=0x7f28941653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28941578b0 0x7f28941653e0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2894064290 tx=0x7f288c019000 comp rx=0 tx=0).stop 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 shutdown_connections 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f2874066f30 0x7f28740693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28941578b0 0x7f28941653e0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28940af2f0 0x7f28940c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 --2- 172.21.15.86:0/155578926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2894155c10 0x7f289406e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.440+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 >> 172.21.15.86:0/155578926 conn(0x7f289406a320 msgr2=0x7f28940c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:23.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.441+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 shutdown_connections 2023-10-09T12:57:23.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.441+0000 7f2898dff700 1 -- 172.21.15.86:0/155578926 wait complete. 2023-10-09T12:57:23.458 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T12:57:23.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.645+0000 7f59757ff700 1 Processor -- start 2023-10-09T12:57:23.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.645+0000 7f59757ff700 1 -- start start 2023-10-09T12:57:23.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f59757ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59700ccee0 0x7f59701561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f59757ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f59700c87c0 0x7f5970156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f59757ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597015b0d0 con 0x7f59700c83f0 2023-10-09T12:57:23.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f59757ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5970156c50 con 0x7f59700ccee0 2023-10-09T12:57:23.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f59757ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597015a4c0 con 0x7f59700c87c0 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f5967fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59700ccee0 0x7f59701561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f5967fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59700ccee0 0x7f59701561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52648/0 (socket says 172.21.15.86:52648) 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f5967fff700 1 -- 172.21.15.86:0/2014637017 learned_addr learned my addr 172.21.15.86:0/2014637017 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f596effd700 1 --1- 172.21.15.86:0/2014637017 >> v1:172.21.15.86:6789/0 conn(0x7f59700c83f0 0x7f59700c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47698/0 (socket says 172.21.15.86:47698) 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f596f7fe700 1 --2- 172.21.15.86:0/2014637017 >> v2:172.21.15.135:3300/0 conn(0x7f59700c87c0 0x7f5970156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f596e7fc700 1 -- 172.21.15.86:0/2014637017 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354878014 0 0) 0x7f597015b0d0 con 0x7f59700c83f0 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f5967fff700 1 -- 172.21.15.86:0/2014637017 >> v2:172.21.15.135:3300/0 conn(0x7f59700c87c0 msgr2=0x7f5970156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f5967fff700 1 --2- 172.21.15.86:0/2014637017 >> v2:172.21.15.135:3300/0 conn(0x7f59700c87c0 0x7f5970156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.647+0000 7f5967fff700 1 -- 172.21.15.86:0/2014637017 >> v1:172.21.15.86:6789/0 conn(0x7f59700c83f0 legacy=0x7f59700c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.648+0000 7f5967fff700 1 -- 172.21.15.86:0/2014637017 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597015a7a0 con 0x7f59700ccee0 2023-10-09T12:57:23.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.648+0000 7f5967fff700 1 --2- 172.21.15.86:0/2014637017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f59701561d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f597006d240 tx=0x7f595800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9630b7cf5826b615 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:23.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.648+0000 7f596e7fc700 1 -- 172.21.15.86:0/2014637017 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800dc50 con 0x7f59700ccee0 2023-10-09T12:57:23.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.648+0000 7f596e7fc700 1 -- 172.21.15.86:0/2014637017 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800ddb0 con 0x7f59700ccee0 2023-10-09T12:57:23.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.648+0000 7f596e7fc700 1 -- 172.21.15.86:0/2014637017 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580196d0 con 0x7f59700ccee0 2023-10-09T12:57:23.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.648+0000 7f59757ff700 1 -- 172.21.15.86:0/2014637017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 msgr2=0x7f59701561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.648+0000 7f59757ff700 1 --2- 172.21.15.86:0/2014637017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f59701561d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f597006d240 tx=0x7f595800b4f0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.649+0000 7f59757ff700 1 -- 172.21.15.86:0/2014637017 shutdown_connections 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.649+0000 7f59757ff700 1 --2- 172.21.15.86:0/2014637017 >> v2:172.21.15.135:3300/0 conn(0x7f59700c87c0 0x7f5970156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.649+0000 7f59757ff700 1 --2- 172.21.15.86:0/2014637017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f59701561d0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.649+0000 7f59757ff700 1 -- 172.21.15.86:0/2014637017 >> 172.21.15.86:0/2014637017 conn(0x7f5970068e10 msgr2=0x7f59700cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.649+0000 7f59757ff700 1 -- 172.21.15.86:0/2014637017 shutdown_connections 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.649+0000 7f59757ff700 1 -- 172.21.15.86:0/2014637017 wait complete. 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.650+0000 7f59757ff700 1 Processor -- start 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.650+0000 7f59757ff700 1 -- start start 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f59757ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59700c83f0 0x7f59701514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f59757ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59700c87c0 0x7f59700c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f59757ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f5970153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f59757ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59701580d0 con 0x7f59700ccee0 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f59757ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700c3f50 con 0x7f59700c83f0 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f59757ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700c4230 con 0x7f59700c87c0 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f5970153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f5970153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52656/0 (socket says 172.21.15.86:52656) 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.651+0000 7f596f7fe700 1 -- 172.21.15.86:0/3919404604 learned_addr learned my addr 172.21.15.86:0/3919404604 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f596effd700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59700c83f0 0x7f59701514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f5967fff700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59700c87c0 0x7f59700c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f596f7fe700 1 -- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59700c87c0 msgr2=0x7f59700c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f596f7fe700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59700c87c0 0x7f59700c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f596f7fe700 1 -- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59700c83f0 msgr2=0x7f59701514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f596f7fe700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59700c83f0 0x7f59701514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f596f7fe700 1 -- 172.21.15.86:0/3919404604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595800b790 con 0x7f59700ccee0 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f596f7fe700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f5970153290 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5968009fa0 tx=0x7f5968009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f5966ffd700 1 -- 172.21.15.86:0/3919404604 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596800ed20 con 0x7f59700ccee0 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f5966ffd700 1 -- 172.21.15.86:0/3919404604 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596800ee80 con 0x7f59700ccee0 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f5966ffd700 1 -- 172.21.15.86:0/3919404604 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968014670 con 0x7f59700ccee0 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59700c4510 con 0x7f59700ccee0 2023-10-09T12:57:23.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.652+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5970151a10 con 0x7f59700ccee0 2023-10-09T12:57:23.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.653+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5970158240 con 0x7f59700ccee0 2023-10-09T12:57:23.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.654+0000 7f5966ffd700 1 -- 172.21.15.86:0/3919404604 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5968014a20 con 0x7f59700ccee0 2023-10-09T12:57:23.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.655+0000 7f5966ffd700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5950066f30 0x7f59500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:23.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.655+0000 7f5966ffd700 1 -- 172.21.15.86:0/3919404604 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f5968084ef0 con 0x7f59700ccee0 2023-10-09T12:57:23.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.655+0000 7f596effd700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5950066f30 0x7f59500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:23.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.656+0000 7f596effd700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5950066f30 0x7f59500693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5960007fd0 tx=0x7f5960007e10 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:23.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.659+0000 7f5966ffd700 1 -- 172.21.15.86:0/3919404604 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5968051f00 con 0x7f59700ccee0 2023-10-09T12:57:23.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:23.897+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f597004c3c0 con 0x7f59700ccee0 2023-10-09T12:57:24.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.629+0000 7f5966ffd700 1 -- 172.21.15.86:0/3919404604 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5968055520 con 0x7f59700ccee0 2023-10-09T12:57:24.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5950066f30 msgr2=0x7f59500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5950066f30 0x7f59500693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5960007fd0 tx=0x7f5960007e10 comp rx=0 tx=0).stop 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 msgr2=0x7f5970153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f5970153290 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5968009fa0 tx=0x7f5968009900 comp rx=0 tx=0).stop 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 shutdown_connections 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5950066f30 0x7f59500693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59700ccee0 0x7f5970153290 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59700c83f0 0x7f59701514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 --2- 172.21.15.86:0/3919404604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59700c87c0 0x7f59700c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 >> 172.21.15.86:0/3919404604 conn(0x7f5970068e10 msgr2=0x7f59700cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:24.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 shutdown_connections 2023-10-09T12:57:24.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.632+0000 7f59757ff700 1 -- 172.21.15.86:0/3919404604 wait complete. 2023-10-09T12:57:24.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T12:57:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.836+0000 7f88737ff700 1 Processor -- start 2023-10-09T12:57:24.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.837+0000 7f88737ff700 1 -- start start 2023-10-09T12:57:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f88737ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c155eb0 0x7f886c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f88737ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f886c0c70b0 0x7f886c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f88737ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c06eb90 con 0x7f886c069cb0 2023-10-09T12:57:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f88737ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c06a130 con 0x7f886c0c70b0 2023-10-09T12:57:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f88737ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c06ee70 con 0x7f886c155eb0 2023-10-09T12:57:24.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f8870d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f886c0c70b0 0x7f886c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f8870d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f886c0c70b0 0x7f886c069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52664/0 (socket says 172.21.15.86:52664) 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f8870d9a700 1 -- 172.21.15.86:0/1967535556 learned_addr learned my addr 172.21.15.86:0/1967535556 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.838+0000 7f887159b700 1 --2- 172.21.15.86:0/1967535556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c155eb0 0x7f886c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8870d9a700 1 -- 172.21.15.86:0/1967535556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c155eb0 msgr2=0x7f886c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8870d9a700 1 --2- 172.21.15.86:0/1967535556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c155eb0 0x7f886c06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8870d9a700 1 -- 172.21.15.86:0/1967535556 >> v1:172.21.15.135:6789/0 conn(0x7f886c069cb0 legacy=0x7f886c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8870d9a700 1 -- 172.21.15.86:0/1967535556 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c06f150 con 0x7f886c0c70b0 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8870d9a700 1 --2- 172.21.15.86:0/1967535556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c0c70b0 0x7f886c069770 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f885c00bc40 tx=0x7f885c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0b4475fd4af013 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8863fff700 1 -- 172.21.15.86:0/1967535556 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00db40 con 0x7f886c0c70b0 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8863fff700 1 -- 172.21.15.86:0/1967535556 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00dca0 con 0x7f886c0c70b0 2023-10-09T12:57:24.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.839+0000 7f8863fff700 1 -- 172.21.15.86:0/1967535556 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c017640 con 0x7f886c0c70b0 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 -- 172.21.15.86:0/1967535556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c0c70b0 msgr2=0x7f886c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 --2- 172.21.15.86:0/1967535556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c0c70b0 0x7f886c069770 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f885c00bc40 tx=0x7f885c00b4e0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 -- 172.21.15.86:0/1967535556 shutdown_connections 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 --2- 172.21.15.86:0/1967535556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c155eb0 0x7f886c06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 --2- 172.21.15.86:0/1967535556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c0c70b0 0x7f886c069770 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 -- 172.21.15.86:0/1967535556 >> 172.21.15.86:0/1967535556 conn(0x7f886c068e10 msgr2=0x7f886c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 -- 172.21.15.86:0/1967535556 shutdown_connections 2023-10-09T12:57:24.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.840+0000 7f88737ff700 1 -- 172.21.15.86:0/1967535556 wait complete. 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.841+0000 7f88737ff700 1 Processor -- start 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.841+0000 7f88737ff700 1 -- start start 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.842+0000 7f88737ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f886c069cb0 0x7f886c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.842+0000 7f88737ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c0c70b0 0x7f886c0c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.842+0000 7f88737ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c155eb0 0x7f886c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.842+0000 7f88737ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0c46f0 con 0x7f886c155eb0 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.842+0000 7f88737ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0ca3c0 con 0x7f886c069cb0 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.842+0000 7f88737ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0c44e0 con 0x7f886c0c70b0 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c155eb0 0x7f886c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:24.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c155eb0 0x7f886c0c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52666/0 (socket says 172.21.15.86:52666) 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 -- 172.21.15.86:0/451730051 learned_addr learned my addr 172.21.15.86:0/451730051 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f887159b700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f886c069cb0 0x7f886c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8870d9a700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c0c70b0 0x7f886c0c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 -- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c0c70b0 msgr2=0x7f886c0c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c0c70b0 0x7f886c0c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 -- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f886c069cb0 msgr2=0x7f886c15f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f886c069cb0 0x7f886c15f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 -- 172.21.15.86:0/451730051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c00b780 con 0x7f886c155eb0 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8870d9a700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c0c70b0 0x7f886c0c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f8871d9c700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c155eb0 0x7f886c0c5e30 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f886400c8e0 tx=0x7f8864001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:24.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.843+0000 7f88617fa700 1 -- 172.21.15.86:0/451730051 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886400ce80 con 0x7f886c155eb0 2023-10-09T12:57:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.844+0000 7f88617fa700 1 -- 172.21.15.86:0/451730051 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886400a7e0 con 0x7f886c155eb0 2023-10-09T12:57:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.844+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c0ca5d0 con 0x7f886c155eb0 2023-10-09T12:57:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.844+0000 7f88617fa700 1 -- 172.21.15.86:0/451730051 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886400ab80 con 0x7f886c155eb0 2023-10-09T12:57:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.844+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c0cab90 con 0x7f886c155eb0 2023-10-09T12:57:24.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.845+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c0cb070 con 0x7f886c155eb0 2023-10-09T12:57:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.846+0000 7f88617fa700 1 -- 172.21.15.86:0/451730051 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8864012420 con 0x7f886c155eb0 2023-10-09T12:57:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.846+0000 7f88617fa700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8850066f30 0x7f88500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.847+0000 7f88617fa700 1 -- 172.21.15.86:0/451730051 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f8864084a80 con 0x7f886c155eb0 2023-10-09T12:57:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.847+0000 7f887159b700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8850066f30 0x7f88500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:24.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.847+0000 7f887159b700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8850066f30 0x7f88500693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8868006fd0 tx=0x7f8868008040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:24.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:24.850+0000 7f88617fa700 1 -- 172.21.15.86:0/451730051 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8864051a90 con 0x7f886c155eb0 2023-10-09T12:57:25.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.088+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f886c04c430 con 0x7f886c155eb0 2023-10-09T12:57:25.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.634+0000 7f88617fa700 1 -- 172.21.15.86:0/451730051 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f886c04c430 con 0x7f886c155eb0 2023-10-09T12:57:25.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8850066f30 msgr2=0x7f88500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:25.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8850066f30 0x7f88500693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8868006fd0 tx=0x7f8868008040 comp rx=0 tx=0).stop 2023-10-09T12:57:25.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c155eb0 msgr2=0x7f886c0c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:25.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c155eb0 0x7f886c0c5e30 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f886400c8e0 tx=0x7f8864001710 comp rx=0 tx=0).stop 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 shutdown_connections 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f8850066f30 0x7f88500693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f886c155eb0 0x7f886c0c5e30 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f886c069cb0 0x7f886c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 --2- 172.21.15.86:0/451730051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f886c0c70b0 0x7f886c0c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 >> 172.21.15.86:0/451730051 conn(0x7f886c068e10 msgr2=0x7f886c0aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 shutdown_connections 2023-10-09T12:57:25.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.637+0000 7f88737ff700 1 -- 172.21.15.86:0/451730051 wait complete. 2023-10-09T12:57:25.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:57:25.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.837+0000 7f68d759e700 1 Processor -- start 2023-10-09T12:57:25.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.837+0000 7f68d759e700 1 -- start start 2023-10-09T12:57:25.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.838+0000 7f68d759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.838+0000 7f68d759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68d815d230 0x7f68d815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.838+0000 7f68d759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d815dbd0 con 0x7f68d81597f0 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.838+0000 7f68d759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80b2980 con 0x7f68d815d230 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.838+0000 7f68d759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80b11d0 con 0x7f68d8159420 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.838+0000 7f68d5d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f68d81597f0 0x7f68d80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47098/0 (socket says 172.21.15.86:47098) 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.838+0000 7f68d5d9b700 1 -- 172.21.15.86:0/2024415272 learned_addr learned my addr 172.21.15.86:0/2024415272 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d6d9d700 1 --2- 172.21.15.86:0/2024415272 >> v2:172.21.15.86:3300/0 conn(0x7f68d815d230 0x7f68d815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d659c700 1 --2- 172.21.15.86:0/2024415272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:25.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d559a700 1 -- 172.21.15.86:0/2024415272 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201024257 0 0) 0x7f68cc001110 con 0x7f68d81597f0 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d559a700 1 -- 172.21.15.86:0/2024415272 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c0003570 con 0x7f68d81597f0 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d6d9d700 1 -- 172.21.15.86:0/2024415272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 msgr2=0x7f68d80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d6d9d700 1 --2- 172.21.15.86:0/2024415272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d6d9d700 1 -- 172.21.15.86:0/2024415272 >> v1:172.21.15.86:6789/0 conn(0x7f68d81597f0 legacy=0x7f68d80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d6d9d700 1 -- 172.21.15.86:0/2024415272 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80b14b0 con 0x7f68d815d230 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d6d9d700 1 --2- 172.21.15.86:0/2024415272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d815d230 0x7f68d815d690 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009e60 tx=0x7f68d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86647e06c58c16c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.839+0000 7f68d559a700 1 -- 172.21.15.86:0/2024415272 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000e070 con 0x7f68d815d230 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d559a700 1 -- 172.21.15.86:0/2024415272 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000bab0 con 0x7f68d815d230 2023-10-09T12:57:25.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d559a700 1 -- 172.21.15.86:0/2024415272 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000be70 con 0x7f68d815d230 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 -- 172.21.15.86:0/2024415272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d815d230 msgr2=0x7f68d815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 --2- 172.21.15.86:0/2024415272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d815d230 0x7f68d815d690 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009e60 tx=0x7f68d0009780 comp rx=0 tx=0).stop 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 -- 172.21.15.86:0/2024415272 shutdown_connections 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 --2- 172.21.15.86:0/2024415272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d815d230 0x7f68d815d690 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 --2- 172.21.15.86:0/2024415272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 -- 172.21.15.86:0/2024415272 >> 172.21.15.86:0/2024415272 conn(0x7f68d80d0660 msgr2=0x7f68d80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 -- 172.21.15.86:0/2024415272 shutdown_connections 2023-10-09T12:57:25.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.840+0000 7f68d759e700 1 -- 172.21.15.86:0/2024415272 wait complete. 2023-10-09T12:57:25.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.842+0000 7f68d759e700 1 Processor -- start 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.842+0000 7f68d759e700 1 -- start start 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d8145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d81597f0 0x7f68d815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d815d230 0x7f68d815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c5400 con 0x7f68d81597f0 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c5650 con 0x7f68d815d230 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c5930 con 0x7f68d8159420 2023-10-09T12:57:25.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d81597f0 0x7f68d815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d81597f0 0x7f68d815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52272/0 (socket says 172.21.15.86:52272) 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 -- 172.21.15.86:0/2743692367 learned_addr learned my addr 172.21.15.86:0/2743692367 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d659c700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d8145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d6d9d700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d815d230 0x7f68d815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 -- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 msgr2=0x7f68d8145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d8145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 -- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d815d230 msgr2=0x7f68d815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d815d230 0x7f68d815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.843+0000 7f68d5d9b700 1 -- 172.21.15.86:0/2743692367 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009a20 con 0x7f68d81597f0 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.844+0000 7f68d5d9b700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d81597f0 0x7f68d815ae70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00c7c0 tx=0x7f68cc007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.844+0000 7f68c67fc700 1 -- 172.21.15.86:0/2743692367 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc005b30 con 0x7f68d81597f0 2023-10-09T12:57:25.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.844+0000 7f68c67fc700 1 -- 172.21.15.86:0/2743692367 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc005cb0 con 0x7f68d81597f0 2023-10-09T12:57:25.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.844+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d80c5c10 con 0x7f68d81597f0 2023-10-09T12:57:25.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.844+0000 7f68c67fc700 1 -- 172.21.15.86:0/2743692367 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc007320 con 0x7f68d81597f0 2023-10-09T12:57:25.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.844+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d80c61d0 con 0x7f68d81597f0 2023-10-09T12:57:25.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.845+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d80c63f0 con 0x7f68d81597f0 2023-10-09T12:57:25.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.846+0000 7f68c67fc700 1 -- 172.21.15.86:0/2743692367 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68cc01b3b0 con 0x7f68d81597f0 2023-10-09T12:57:25.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.847+0000 7f68c67fc700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f68b8066f30 0x7f68b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:25.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.847+0000 7f68c67fc700 1 -- 172.21.15.86:0/2743692367 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f68cc083ae0 con 0x7f68d81597f0 2023-10-09T12:57:25.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.847+0000 7f68d659c700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f68b8066f30 0x7f68b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:25.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.847+0000 7f68d659c700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f68b8066f30 0x7f68b80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009db0 tx=0x7f68c80091a0 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:25.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:25.851+0000 7f68c67fc700 1 -- 172.21.15.86:0/2743692367 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68cc050af0 con 0x7f68d81597f0 2023-10-09T12:57:26.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.081+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68d815dbd0 con 0x7f68d81597f0 2023-10-09T12:57:26.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.082+0000 7f68c67fc700 1 -- 172.21.15.86:0/2743692367 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f68d815dbd0 con 0x7f68d81597f0 2023-10-09T12:57:26.082 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:26.082 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7391,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3278560114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3278560114},{"type":"v1","addr":"172.21.15.135:6834","nonce":3278560114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/740435858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":740435858},{"type":"v1","addr":"172.21.15.86:6833","nonce":740435858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1073483795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1073483795},{"type":"v1","addr":"172.21.15.86:6835","nonce":1073483795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:57:22.056332+0000","modified":"2023-10-09T12:57:25.626438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"d","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3750723208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3750723208},{"type":"v1","addr":"172.21.15.135:6835","nonce":3750723208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T12:57:26.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f68b8066f30 msgr2=0x7f68b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f68b8066f30 0x7f68b80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009db0 tx=0x7f68c80091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d81597f0 msgr2=0x7f68d815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d81597f0 0x7f68d815ae70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00c7c0 tx=0x7f68cc007c70 comp rx=0 tx=0).stop 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 shutdown_connections 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d815d230 0x7f68d815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8159420 0x7f68d8145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f68b8066f30 0x7f68b80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 --2- 172.21.15.86:0/2743692367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68d81597f0 0x7f68d815ae70 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 >> 172.21.15.86:0/2743692367 conn(0x7f68d80d0660 msgr2=0x7f68d80d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:26.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.084+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 shutdown_connections 2023-10-09T12:57:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.085+0000 7f68d759e700 1 -- 172.21.15.86:0/2743692367 wait complete. 2023-10-09T12:57:26.086 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 78 2023-10-09T12:57:26.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T12:57:26.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.284+0000 7efc3b39d700 1 Processor -- start 2023-10-09T12:57:26.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.284+0000 7efc3b39d700 1 -- start start 2023-10-09T12:57:26.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3b39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc34157770 0x7efc34150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3b39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efc340c7150 0x7efc3406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3b39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3406e2a0 con 0x7efc340c6d00 2023-10-09T12:57:26.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3b39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc34157b40 con 0x7efc34157770 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3b39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3406b2e0 con 0x7efc340c7150 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3a39b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc34157770 0x7efc34150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3a39b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc34157770 0x7efc34150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52274/0 (socket says 172.21.15.86:52274) 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.285+0000 7efc3a39b700 1 -- 172.21.15.86:0/308838436 learned_addr learned my addr 172.21.15.86:0/308838436 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc3ab9c700 1 --2- 172.21.15.86:0/308838436 >> v2:172.21.15.135:3300/0 conn(0x7efc340c7150 0x7efc3406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc3a39b700 1 -- 172.21.15.86:0/308838436 >> v2:172.21.15.135:3300/0 conn(0x7efc340c7150 msgr2=0x7efc3406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc3a39b700 1 --2- 172.21.15.86:0/308838436 >> v2:172.21.15.135:3300/0 conn(0x7efc340c7150 0x7efc3406ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc3a39b700 1 -- 172.21.15.86:0/308838436 >> v1:172.21.15.135:6789/0 conn(0x7efc340c6d00 legacy=0x7efc3406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc3a39b700 1 -- 172.21.15.86:0/308838436 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc340c78e0 con 0x7efc34157770 2023-10-09T12:57:26.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc3ab9c700 1 --2- 172.21.15.86:0/308838436 >> v2:172.21.15.135:3300/0 conn(0x7efc340c7150 0x7efc3406ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc3a39b700 1 --2- 172.21.15.86:0/308838436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc34157770 0x7efc34150180 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7efc340c67c0 tx=0x7efc3000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfb92b3f2cd41a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc39399700 1 -- 172.21.15.86:0/308838436 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000dc50 con 0x7efc34157770 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc39399700 1 -- 172.21.15.86:0/308838436 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3000ddb0 con 0x7efc34157770 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.286+0000 7efc39399700 1 -- 172.21.15.86:0/308838436 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300196d0 con 0x7efc34157770 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 -- 172.21.15.86:0/308838436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc34157770 msgr2=0x7efc34150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 --2- 172.21.15.86:0/308838436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc34157770 0x7efc34150180 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7efc340c67c0 tx=0x7efc3000b4f0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 -- 172.21.15.86:0/308838436 shutdown_connections 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 --2- 172.21.15.86:0/308838436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc34157770 0x7efc34150180 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 --2- 172.21.15.86:0/308838436 >> v2:172.21.15.135:3300/0 conn(0x7efc340c7150 0x7efc3406ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 -- 172.21.15.86:0/308838436 >> 172.21.15.86:0/308838436 conn(0x7efc340cc1f0 msgr2=0x7efc340cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:26.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 -- 172.21.15.86:0/308838436 shutdown_connections 2023-10-09T12:57:26.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.287+0000 7efc3b39d700 1 -- 172.21.15.86:0/308838436 wait complete. 2023-10-09T12:57:26.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.288+0000 7efc3b39d700 1 Processor -- start 2023-10-09T12:57:26.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.289+0000 7efc3b39d700 1 -- start start 2023-10-09T12:57:26.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3b39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc340c6d00 0x7efc340ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3b39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc340c7150 0x7efc3414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3b39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc34157770 0x7efc3414c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3b39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc340adc30 con 0x7efc340c7150 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3b39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc340ad020 con 0x7efc340c6d00 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3b39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc340ad300 con 0x7efc34157770 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc340c7150 0x7efc3414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc340c7150 0x7efc3414c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52280/0 (socket says 172.21.15.86:52280) 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 -- 172.21.15.86:0/920796976 learned_addr learned my addr 172.21.15.86:0/920796976 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3a39b700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc340c6d00 0x7efc340ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc3ab9c700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc34157770 0x7efc3414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 -- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc34157770 msgr2=0x7efc3414c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc34157770 0x7efc3414c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 -- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc340c6d00 msgr2=0x7efc340ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc340c6d00 0x7efc340ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.290+0000 7efc39b9a700 1 -- 172.21.15.86:0/920796976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3000b790 con 0x7efc340c7150 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.291+0000 7efc39b9a700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc340c7150 0x7efc3414c120 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c590 tx=0x7efc2400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.291+0000 7efc2a7fc700 1 -- 172.21.15.86:0/920796976 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24011590 con 0x7efc340c7150 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.291+0000 7efc2a7fc700 1 -- 172.21.15.86:0/920796976 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc240116f0 con 0x7efc340c7150 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.291+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc340ad5e0 con 0x7efc340c7150 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.291+0000 7efc2a7fc700 1 -- 172.21.15.86:0/920796976 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24011ab0 con 0x7efc340c7150 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.291+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc340ae600 con 0x7efc340c7150 2023-10-09T12:57:26.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.292+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3404c3c0 con 0x7efc340c7150 2023-10-09T12:57:26.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.293+0000 7efc2a7fc700 1 -- 172.21.15.86:0/920796976 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc2401b3b0 con 0x7efc340c7150 2023-10-09T12:57:26.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.294+0000 7efc2a7fc700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc18066f30 0x7efc180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.294+0000 7efc2a7fc700 1 -- 172.21.15.86:0/920796976 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7efc24083cf0 con 0x7efc340c7150 2023-10-09T12:57:26.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.294+0000 7efc3a39b700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc18066f30 0x7efc180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.295+0000 7efc3a39b700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc18066f30 0x7efc180693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efc340c67c0 tx=0x7efc3001b000 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:26.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.298+0000 7efc2a7fc700 1 -- 172.21.15.86:0/920796976 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc24050d00 con 0x7efc340c7150 2023-10-09T12:57:26.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.490+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc340add70 con 0x7efc340c7150 2023-10-09T12:57:26.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.491+0000 7efc2a7fc700 1 -- 172.21.15.86:0/920796976 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16099 (secure 0 0 0) 0x7efc24017020 con 0x7efc340c7150 2023-10-09T12:57:26.491 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:26.491 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":178,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T12:57:23.607308+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:57:20.160700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T12:57:21.037369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T12:57:26.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc18066f30 msgr2=0x7efc180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc18066f30 0x7efc180693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efc340c67c0 tx=0x7efc3001b000 comp rx=0 tx=0).stop 2023-10-09T12:57:26.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc340c7150 msgr2=0x7efc3414c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc340c7150 0x7efc3414c120 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c590 tx=0x7efc2400c950 comp rx=0 tx=0).stop 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 shutdown_connections 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc34157770 0x7efc3414c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc340c6d00 0x7efc340ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7efc18066f30 0x7efc180693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 --2- 172.21.15.86:0/920796976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc340c7150 0x7efc3414c120 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 >> 172.21.15.86:0/920796976 conn(0x7efc340cc1f0 msgr2=0x7efc340c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 shutdown_connections 2023-10-09T12:57:26.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.493+0000 7efc3b39d700 1 -- 172.21.15.86:0/920796976 wait complete. 2023-10-09T12:57:26.510 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T12:57:26.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:57:26.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.692+0000 7f4b263ff700 1 Processor -- start 2023-10-09T12:57:26.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.692+0000 7f4b263ff700 1 -- start start 2023-10-09T12:57:26.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b263ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b201578b0 0x7f4b20155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b263ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4b200af2f0 0x7f4b200af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b263ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b200ad930 con 0x7f4b20155c10 2023-10-09T12:57:26.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b263ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200b0c60 con 0x7f4b200af2f0 2023-10-09T12:57:26.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b263ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200acd20 con 0x7f4b201578b0 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b1ffff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4b20155c10 0x7f4b200ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:39724/0 (socket says 172.21.15.86:39724) 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b1ffff700 1 -- 172.21.15.86:0/609202699 learned_addr learned my addr 172.21.15.86:0/609202699 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b17fff700 1 --2- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b201578b0 0x7f4b20155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.694+0000 7f4b2499c700 1 --2- 172.21.15.86:0/609202699 >> v2:172.21.15.135:3300/0 conn(0x7f4b200af2f0 0x7f4b200af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b1f7fe700 1 -- 172.21.15.86:0/609202699 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337134284 0 0) 0x7f4b200ad930 con 0x7f4b20155c10 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b1f7fe700 1 -- 172.21.15.86:0/609202699 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c004680 con 0x7f4b20155c10 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b2499c700 1 -- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b201578b0 msgr2=0x7f4b20155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b2499c700 1 --2- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b201578b0 0x7f4b20155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b2499c700 1 -- 172.21.15.86:0/609202699 >> v1:172.21.15.135:6789/0 conn(0x7f4b20155c10 legacy=0x7f4b200ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b2499c700 1 -- 172.21.15.86:0/609202699 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200ad000 con 0x7f4b200af2f0 2023-10-09T12:57:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b17fff700 1 --2- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b201578b0 0x7f4b20155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.695+0000 7f4b2499c700 1 --2- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 0x7f4b200af710 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009e60 tx=0x7f4b18009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=570d851f1508b7da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b1f7fe700 1 -- 172.21.15.86:0/609202699 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800e070 con 0x7f4b200af2f0 2023-10-09T12:57:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b1f7fe700 1 -- 172.21.15.86:0/609202699 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800bab0 con 0x7f4b200af2f0 2023-10-09T12:57:26.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b1f7fe700 1 -- 172.21.15.86:0/609202699 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800be70 con 0x7f4b200af2f0 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 -- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 msgr2=0x7f4b200af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 --2- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 0x7f4b200af710 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009e60 tx=0x7f4b18009780 comp rx=0 tx=0).stop 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 -- 172.21.15.86:0/609202699 shutdown_connections 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 --2- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 0x7f4b200af710 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 --2- 172.21.15.86:0/609202699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b201578b0 0x7f4b20155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 -- 172.21.15.86:0/609202699 >> 172.21.15.86:0/609202699 conn(0x7f4b2006a320 msgr2=0x7f4b200cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 -- 172.21.15.86:0/609202699 shutdown_connections 2023-10-09T12:57:26.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.696+0000 7f4b263ff700 1 -- 172.21.15.86:0/609202699 wait complete. 2023-10-09T12:57:26.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.698+0000 7f4b263ff700 1 Processor -- start 2023-10-09T12:57:26.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.698+0000 7f4b263ff700 1 -- start start 2023-10-09T12:57:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b263ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 0x7f4b200c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b263ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b20155c10 0x7f4b200aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b263ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b201578b0 0x7f4b20143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b263ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200ab2d0 con 0x7f4b201578b0 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b263ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c9fe0 con 0x7f4b200af2f0 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b263ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200ca2c0 con 0x7f4b20155c10 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b2499c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b201578b0 0x7f4b20143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b2499c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b201578b0 0x7f4b20143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52292/0 (socket says 172.21.15.86:52292) 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b17fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b20155c10 0x7f4b200aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b2499c700 1 -- 172.21.15.86:0/1893978017 learned_addr learned my addr 172.21.15.86:0/1893978017 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.699+0000 7f4b1ffff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 0x7f4b200c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b2499c700 1 -- 172.21.15.86:0/1893978017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b20155c10 msgr2=0x7f4b200aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b2499c700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b20155c10 0x7f4b200aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b2499c700 1 -- 172.21.15.86:0/1893978017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 msgr2=0x7f4b200c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b2499c700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 0x7f4b200c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b2499c700 1 -- 172.21.15.86:0/1893978017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b08009420 con 0x7f4b201578b0 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b2499c700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b201578b0 0x7f4b20143150 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f4b20064290 tx=0x7f4b18019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b1cff9700 1 -- 172.21.15.86:0/1893978017 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18012e10 con 0x7f4b201578b0 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b1cff9700 1 -- 172.21.15.86:0/1893978017 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18027470 con 0x7f4b201578b0 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b18009a20 con 0x7f4b201578b0 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b1cff9700 1 -- 172.21.15.86:0/1893978017 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18027830 con 0x7f4b201578b0 2023-10-09T12:57:26.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.700+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b200ca880 con 0x7f4b201578b0 2023-10-09T12:57:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.701+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2004c3c0 con 0x7f4b201578b0 2023-10-09T12:57:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.702+0000 7f4b1cff9700 1 -- 172.21.15.86:0/1893978017 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b18024070 con 0x7f4b201578b0 2023-10-09T12:57:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.703+0000 7f4b1cff9700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.703+0000 7f4b1cff9700 1 -- 172.21.15.86:0/1893978017 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f4b180871c0 con 0x7f4b201578b0 2023-10-09T12:57:26.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.703+0000 7f4b1ffff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:26.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.704+0000 7f4b1ffff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b00066f30 0x7f4b000693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b10007fd0 tx=0x7f4b10009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:26.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.707+0000 7f4b1cff9700 1 -- 172.21.15.86:0/1893978017 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b180541d0 con 0x7f4b201578b0 2023-10-09T12:57:26.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.894+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b200ad2e0 con 0x7f4b00066f30 2023-10-09T12:57:26.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.904+0000 7f4b1cff9700 1 -- 172.21.15.86:0/1893978017 <== mgr.8883 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284046 (secure 0 0 0) 0x7f4b200ad2e0 con 0x7f4b00066f30 2023-10-09T12:57:26.907 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:26.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b00066f30 msgr2=0x7f4b000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b00066f30 0x7f4b000693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b10007fd0 tx=0x7f4b10009040 comp rx=0 tx=0).stop 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b201578b0 msgr2=0x7f4b20143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b201578b0 0x7f4b20143150 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f4b20064290 tx=0x7f4b18019000 comp rx=0 tx=0).stop 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 shutdown_connections 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b201578b0 0x7f4b20143150 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b200af2f0 0x7f4b200c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 --2- 172.21.15.86:0/1893978017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b20155c10 0x7f4b200aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 >> 172.21.15.86:0/1893978017 conn(0x7f4b2006a320 msgr2=0x7f4b200b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 shutdown_connections 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:26.908+0000 7f4b263ff700 1 -- 172.21.15.86:0/1893978017 wait complete. 2023-10-09T12:57:26.910 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:57:26.926 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T12:57:26.546115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591974,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":502,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":314,"ondisk_log_size":314,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470336,"kb_used_data":18304,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504384,"statfs":{"total":773094113280,"available":770564489216,"internally_reserved":0,"allocated":18743296,"data_stored":9908596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1606,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.967906"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638747+0000","last_change":"2023-10-09T12:57:22.636031+0000","last_active":"2023-10-09T12:57:22.638747+0000","last_peered":"2023-10-09T12:57:22.638747+0000","last_clean":"2023-10-09T12:57:22.638747+0000","last_became_active":"2023-10-09T12:57:22.635750+0000","last_became_peered":"2023-10-09T12:57:22.635750+0000","last_unstale":"2023-10-09T12:57:22.638747+0000","last_undegraded":"2023-10-09T12:57:22.638747+0000","last_fullsized":"2023-10-09T12:57:22.638747+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:36.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614061+0000","last_change":"2023-10-09T12:57:22.611976+0000","last_active":"2023-10-09T12:57:22.614061+0000","last_peered":"2023-10-09T12:57:22.614061+0000","last_clean":"2023-10-09T12:57:22.614061+0000","last_became_active":"2023-10-09T12:57:22.611701+0000","last_became_peered":"2023-10-09T12:57:22.611701+0000","last_unstale":"2023-10-09T12:57:22.614061+0000","last_undegraded":"2023-10-09T12:57:22.614061+0000","last_fullsized":"2023-10-09T12:57:22.614061+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625495+0000","last_change":"2023-10-09T12:57:22.622355+0000","last_active":"2023-10-09T12:57:22.625495+0000","last_peered":"2023-10-09T12:57:22.625495+0000","last_clean":"2023-10-09T12:57:22.625495+0000","last_became_active":"2023-10-09T12:57:22.622088+0000","last_became_peered":"2023-10-09T12:57:22.622088+0000","last_unstale":"2023-10-09T12:57:22.625495+0000","last_undegraded":"2023-10-09T12:57:22.625495+0000","last_fullsized":"2023-10-09T12:57:22.625495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:11:58.040597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625337+0000","last_change":"2023-10-09T12:57:22.621443+0000","last_active":"2023-10-09T12:57:22.625337+0000","last_peered":"2023-10-09T12:57:22.625337+0000","last_clean":"2023-10-09T12:57:22.625337+0000","last_became_active":"2023-10-09T12:57:22.621180+0000","last_became_peered":"2023-10-09T12:57:22.621180+0000","last_unstale":"2023-10-09T12:57:22.625337+0000","last_undegraded":"2023-10-09T12:57:22.625337+0000","last_fullsized":"2023-10-09T12:57:22.625337+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630227+0000","last_change":"2023-10-09T12:57:22.627728+0000","last_active":"2023-10-09T12:57:22.630227+0000","last_peered":"2023-10-09T12:57:22.630227+0000","last_clean":"2023-10-09T12:57:22.630227+0000","last_became_active":"2023-10-09T12:57:22.627440+0000","last_became_peered":"2023-10-09T12:57:22.627440+0000","last_unstale":"2023-10-09T12:57:22.630227+0000","last_undegraded":"2023-10-09T12:57:22.630227+0000","last_fullsized":"2023-10-09T12:57:22.630227+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:55.583107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614035+0000","last_change":"2023-10-09T12:57:22.611974+0000","last_active":"2023-10-09T12:57:22.614035+0000","last_peered":"2023-10-09T12:57:22.614035+0000","last_clean":"2023-10-09T12:57:22.614035+0000","last_became_active":"2023-10-09T12:57:22.611699+0000","last_became_peered":"2023-10-09T12:57:22.611699+0000","last_unstale":"2023-10-09T12:57:22.614035+0000","last_undegraded":"2023-10-09T12:57:22.614035+0000","last_fullsized":"2023-10-09T12:57:22.614035+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:39.982603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627919+0000","last_change":"2023-10-09T12:57:22.624085+0000","last_active":"2023-10-09T12:57:22.627919+0000","last_peered":"2023-10-09T12:57:22.627919+0000","last_clean":"2023-10-09T12:57:22.627919+0000","last_became_active":"2023-10-09T12:57:22.623822+0000","last_became_peered":"2023-10-09T12:57:22.623822+0000","last_unstale":"2023-10-09T12:57:22.627919+0000","last_undegraded":"2023-10-09T12:57:22.627919+0000","last_fullsized":"2023-10-09T12:57:22.627919+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:26.255875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615271+0000","last_change":"2023-10-09T12:57:22.610213+0000","last_active":"2023-10-09T12:57:22.615271+0000","last_peered":"2023-10-09T12:57:22.615271+0000","last_clean":"2023-10-09T12:57:22.615271+0000","last_became_active":"2023-10-09T12:57:22.609967+0000","last_became_peered":"2023-10-09T12:57:22.609967+0000","last_unstale":"2023-10-09T12:57:22.615271+0000","last_undegraded":"2023-10-09T12:57:22.615271+0000","last_fullsized":"2023-10-09T12:57:22.615271+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:28:10.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619071+0000","last_change":"2023-10-09T12:57:22.613666+0000","last_active":"2023-10-09T12:57:22.619071+0000","last_peered":"2023-10-09T12:57:22.619071+0000","last_clean":"2023-10-09T12:57:22.619071+0000","last_became_active":"2023-10-09T12:57:22.613331+0000","last_became_peered":"2023-10-09T12:57:22.613331+0000","last_unstale":"2023-10-09T12:57:22.619071+0000","last_undegraded":"2023-10-09T12:57:22.619071+0000","last_fullsized":"2023-10-09T12:57:22.619071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:14.886124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.618816+0000","last_change":"2023-10-09T12:57:22.617496+0000","last_active":"2023-10-09T12:57:22.618816+0000","last_peered":"2023-10-09T12:57:22.618816+0000","last_clean":"2023-10-09T12:57:22.618816+0000","last_became_active":"2023-10-09T12:57:22.617196+0000","last_became_peered":"2023-10-09T12:57:22.617196+0000","last_unstale":"2023-10-09T12:57:22.618816+0000","last_undegraded":"2023-10-09T12:57:22.618816+0000","last_fullsized":"2023-10-09T12:57:22.618816+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:29.620453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.617901+0000","last_change":"2023-10-09T12:57:22.615483+0000","last_active":"2023-10-09T12:57:22.617901+0000","last_peered":"2023-10-09T12:57:22.617901+0000","last_clean":"2023-10-09T12:57:22.617901+0000","last_became_active":"2023-10-09T12:57:22.615223+0000","last_became_peered":"2023-10-09T12:57:22.615223+0000","last_unstale":"2023-10-09T12:57:22.617901+0000","last_undegraded":"2023-10-09T12:57:22.617901+0000","last_fullsized":"2023-10-09T12:57:22.617901+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:05.692178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619083+0000","last_change":"2023-10-09T12:57:22.613737+0000","last_active":"2023-10-09T12:57:22.619083+0000","last_peered":"2023-10-09T12:57:22.619083+0000","last_clean":"2023-10-09T12:57:22.619083+0000","last_became_active":"2023-10-09T12:57:22.613227+0000","last_became_peered":"2023-10-09T12:57:22.613227+0000","last_unstale":"2023-10-09T12:57:22.619083+0000","last_undegraded":"2023-10-09T12:57:22.619083+0000","last_fullsized":"2023-10-09T12:57:22.619083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:51.856277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630735+0000","last_change":"2023-10-09T12:57:22.626583+0000","last_active":"2023-10-09T12:57:22.630735+0000","last_peered":"2023-10-09T12:57:22.630735+0000","last_clean":"2023-10-09T12:57:22.630735+0000","last_became_active":"2023-10-09T12:57:22.626327+0000","last_became_peered":"2023-10-09T12:57:22.626327+0000","last_unstale":"2023-10-09T12:57:22.630735+0000","last_undegraded":"2023-10-09T12:57:22.630735+0000","last_fullsized":"2023-10-09T12:57:22.630735+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:20.275237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627649+0000","last_change":"2023-10-09T12:57:22.624916+0000","last_active":"2023-10-09T12:57:22.627649+0000","last_peered":"2023-10-09T12:57:22.627649+0000","last_clean":"2023-10-09T12:57:22.627649+0000","last_became_active":"2023-10-09T12:57:22.624661+0000","last_became_peered":"2023-10-09T12:57:22.624661+0000","last_unstale":"2023-10-09T12:57:22.627649+0000","last_undegraded":"2023-10-09T12:57:22.627649+0000","last_fullsized":"2023-10-09T12:57:22.627649+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625458+0000","last_change":"2023-10-09T12:57:22.622049+0000","last_active":"2023-10-09T12:57:22.625458+0000","last_peered":"2023-10-09T12:57:22.625458+0000","last_clean":"2023-10-09T12:57:22.625458+0000","last_became_active":"2023-10-09T12:57:22.621769+0000","last_became_peered":"2023-10-09T12:57:22.621769+0000","last_unstale":"2023-10-09T12:57:22.625458+0000","last_undegraded":"2023-10-09T12:57:22.625458+0000","last_fullsized":"2023-10-09T12:57:22.625458+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:50.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630955+0000","last_change":"2023-10-09T12:57:22.627678+0000","last_active":"2023-10-09T12:57:22.630955+0000","last_peered":"2023-10-09T12:57:22.630955+0000","last_clean":"2023-10-09T12:57:22.630955+0000","last_became_active":"2023-10-09T12:57:22.627139+0000","last_became_peered":"2023-10-09T12:57:22.627139+0000","last_unstale":"2023-10-09T12:57:22.630955+0000","last_undegraded":"2023-10-09T12:57:22.630955+0000","last_fullsized":"2023-10-09T12:57:22.630955+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:58.263529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628975+0000","last_change":"2023-10-09T12:57:22.624700+0000","last_active":"2023-10-09T12:57:22.628975+0000","last_peered":"2023-10-09T12:57:22.628975+0000","last_clean":"2023-10-09T12:57:22.628975+0000","last_became_active":"2023-10-09T12:57:22.624369+0000","last_became_peered":"2023-10-09T12:57:22.624369+0000","last_unstale":"2023-10-09T12:57:22.628975+0000","last_undegraded":"2023-10-09T12:57:22.628975+0000","last_fullsized":"2023-10-09T12:57:22.628975+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:15.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585504+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:43.822255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614017+0000","last_change":"2023-10-09T12:57:22.611789+0000","last_active":"2023-10-09T12:57:22.614017+0000","last_peered":"2023-10-09T12:57:22.614017+0000","last_clean":"2023-10-09T12:57:22.614017+0000","last_became_active":"2023-10-09T12:57:22.611456+0000","last_became_peered":"2023-10-09T12:57:22.611456+0000","last_unstale":"2023-10-09T12:57:22.614017+0000","last_undegraded":"2023-10-09T12:57:22.614017+0000","last_fullsized":"2023-10-09T12:57:22.614017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:35.215673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635479+0000","last_change":"2023-10-09T12:57:21.609699+0000","last_active":"2023-10-09T12:57:22.635479+0000","last_peered":"2023-10-09T12:57:22.635479+0000","last_clean":"2023-10-09T12:57:22.635479+0000","last_became_active":"2023-10-09T12:57:21.609416+0000","last_became_peered":"2023-10-09T12:57:21.609416+0000","last_unstale":"2023-10-09T12:57:22.635479+0000","last_undegraded":"2023-10-09T12:57:22.635479+0000","last_fullsized":"2023-10-09T12:57:22.635479+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:28.632953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619875+0000","last_change":"2023-10-09T12:57:22.617329+0000","last_active":"2023-10-09T12:57:22.619875+0000","last_peered":"2023-10-09T12:57:22.619875+0000","last_clean":"2023-10-09T12:57:22.619875+0000","last_became_active":"2023-10-09T12:57:22.615838+0000","last_became_peered":"2023-10-09T12:57:22.615838+0000","last_unstale":"2023-10-09T12:57:22.619875+0000","last_undegraded":"2023-10-09T12:57:22.619875+0000","last_fullsized":"2023-10-09T12:57:22.619875+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:11.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584709+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583077+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630886+0000","last_change":"2023-10-09T12:57:22.627451+0000","last_active":"2023-10-09T12:57:22.630886+0000","last_peered":"2023-10-09T12:57:22.630886+0000","last_clean":"2023-10-09T12:57:22.630886+0000","last_became_active":"2023-10-09T12:57:22.627150+0000","last_became_peered":"2023-10-09T12:57:22.627150+0000","last_unstale":"2023-10-09T12:57:22.630886+0000","last_undegraded":"2023-10-09T12:57:22.630886+0000","last_fullsized":"2023-10-09T12:57:22.630886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:40.741655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637597+0000","last_change":"2023-10-09T12:57:21.601324+0000","last_active":"2023-10-09T12:57:22.637597+0000","last_peered":"2023-10-09T12:57:22.637597+0000","last_clean":"2023-10-09T12:57:22.637597+0000","last_became_active":"2023-10-09T12:57:21.601065+0000","last_became_peered":"2023-10-09T12:57:21.601065+0000","last_unstale":"2023-10-09T12:57:22.637597+0000","last_undegraded":"2023-10-09T12:57:22.637597+0000","last_fullsized":"2023-10-09T12:57:22.637597+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:29.021722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583077+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633755+0000","last_change":"2023-10-09T12:57:22.629636+0000","last_active":"2023-10-09T12:57:22.633755+0000","last_peered":"2023-10-09T12:57:22.633755+0000","last_clean":"2023-10-09T12:57:22.633755+0000","last_became_active":"2023-10-09T12:57:22.629297+0000","last_became_peered":"2023-10-09T12:57:22.629297+0000","last_unstale":"2023-10-09T12:57:22.633755+0000","last_undegraded":"2023-10-09T12:57:22.633755+0000","last_fullsized":"2023-10-09T12:57:22.633755+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.605892+0000","last_change":"2023-10-09T12:57:21.597160+0000","last_active":"2023-10-09T12:57:22.605892+0000","last_peered":"2023-10-09T12:57:22.605892+0000","last_clean":"2023-10-09T12:57:22.605892+0000","last_became_active":"2023-10-09T12:57:21.596858+0000","last_became_peered":"2023-10-09T12:57:21.596858+0000","last_unstale":"2023-10-09T12:57:22.605892+0000","last_undegraded":"2023-10-09T12:57:22.605892+0000","last_fullsized":"2023-10-09T12:57:22.605892+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:39.389828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583139+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604011+0000","last_change":"2023-10-09T12:57:21.603114+0000","last_active":"2023-10-09T12:57:22.604011+0000","last_peered":"2023-10-09T12:57:22.604011+0000","last_clean":"2023-10-09T12:57:22.604011+0000","last_became_active":"2023-10-09T12:57:21.602848+0000","last_became_peered":"2023-10-09T12:57:21.602848+0000","last_unstale":"2023-10-09T12:57:22.604011+0000","last_undegraded":"2023-10-09T12:57:22.604011+0000","last_fullsized":"2023-10-09T12:57:22.604011+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:47.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585927+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:08.548490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615217+0000","last_change":"2023-10-09T12:57:22.612914+0000","last_active":"2023-10-09T12:57:22.615217+0000","last_peered":"2023-10-09T12:57:22.615217+0000","last_clean":"2023-10-09T12:57:22.615217+0000","last_became_active":"2023-10-09T12:57:22.612654+0000","last_became_peered":"2023-10-09T12:57:22.612654+0000","last_unstale":"2023-10-09T12:57:22.615217+0000","last_undegraded":"2023-10-09T12:57:22.615217+0000","last_fullsized":"2023-10-09T12:57:22.615217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:28.372635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"177'6","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.642564+0000","last_change":"2023-10-09T12:57:21.594239+0000","last_active":"2023-10-09T12:57:22.642564+0000","last_peered":"2023-10-09T12:57:22.642564+0000","last_clean":"2023-10-09T12:57:22.642564+0000","last_became_active":"2023-10-09T12:57:21.593748+0000","last_became_peered":"2023-10-09T12:57:21.593748+0000","last_unstale":"2023-10-09T12:57:22.642564+0000","last_undegraded":"2023-10-09T12:57:22.642564+0000","last_fullsized":"2023-10-09T12:57:22.642564+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:09.926296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585363+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:45.912841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.613966+0000","last_change":"2023-10-09T12:57:22.611664+0000","last_active":"2023-10-09T12:57:22.613966+0000","last_peered":"2023-10-09T12:57:22.613966+0000","last_clean":"2023-10-09T12:57:22.613966+0000","last_became_active":"2023-10-09T12:57:22.611336+0000","last_became_peered":"2023-10-09T12:57:22.611336+0000","last_unstale":"2023-10-09T12:57:22.613966+0000","last_undegraded":"2023-10-09T12:57:22.613966+0000","last_fullsized":"2023-10-09T12:57:22.613966+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:27.112437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586602+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.600525+0000","last_change":"2023-10-09T12:57:21.597869+0000","last_active":"2023-10-09T12:57:22.600525+0000","last_peered":"2023-10-09T12:57:22.600525+0000","last_clean":"2023-10-09T12:57:22.600525+0000","last_became_active":"2023-10-09T12:57:21.597615+0000","last_became_peered":"2023-10-09T12:57:21.597615+0000","last_unstale":"2023-10-09T12:57:22.600525+0000","last_undegraded":"2023-10-09T12:57:22.600525+0000","last_fullsized":"2023-10-09T12:57:22.600525+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"177'8","reported_seq":18,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635696+0000","last_change":"2023-10-09T12:57:21.597629+0000","last_active":"2023-10-09T12:57:22.635696+0000","last_peered":"2023-10-09T12:57:22.635696+0000","last_clean":"2023-10-09T12:57:22.635696+0000","last_became_active":"2023-10-09T12:57:21.597355+0000","last_became_peered":"2023-10-09T12:57:21.597355+0000","last_unstale":"2023-10-09T12:57:22.635696+0000","last_undegraded":"2023-10-09T12:57:22.635696+0000","last_fullsized":"2023-10-09T12:57:22.635696+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:23.097372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583227+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.636307+0000","last_change":"2023-10-09T12:57:22.632816+0000","last_active":"2023-10-09T12:57:22.636307+0000","last_peered":"2023-10-09T12:57:22.636307+0000","last_clean":"2023-10-09T12:57:22.636307+0000","last_became_active":"2023-10-09T12:57:22.632525+0000","last_became_peered":"2023-10-09T12:57:22.632525+0000","last_unstale":"2023-10-09T12:57:22.636307+0000","last_undegraded":"2023-10-09T12:57:22.636307+0000","last_fullsized":"2023-10-09T12:57:22.636307+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:31.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628132+0000","last_change":"2023-10-09T12:57:21.606002+0000","last_active":"2023-10-09T12:57:22.628132+0000","last_peered":"2023-10-09T12:57:22.628132+0000","last_clean":"2023-10-09T12:57:22.628132+0000","last_became_active":"2023-10-09T12:57:21.605728+0000","last_became_peered":"2023-10-09T12:57:21.605728+0000","last_unstale":"2023-10-09T12:57:22.628132+0000","last_undegraded":"2023-10-09T12:57:22.628132+0000","last_fullsized":"2023-10-09T12:57:22.628132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.996883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637660+0000","last_change":"2023-10-09T12:57:21.599422+0000","last_active":"2023-10-09T12:57:22.637660+0000","last_peered":"2023-10-09T12:57:22.637660+0000","last_clean":"2023-10-09T12:57:22.637660+0000","last_became_active":"2023-10-09T12:57:21.599151+0000","last_became_peered":"2023-10-09T12:57:21.599151+0000","last_unstale":"2023-10-09T12:57:22.637660+0000","last_undegraded":"2023-10-09T12:57:22.637660+0000","last_fullsized":"2023-10-09T12:57:22.637660+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:45.965489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625242+0000","last_change":"2023-10-09T12:57:22.622000+0000","last_active":"2023-10-09T12:57:22.625242+0000","last_peered":"2023-10-09T12:57:22.625242+0000","last_clean":"2023-10-09T12:57:22.625242+0000","last_became_active":"2023-10-09T12:57:22.621737+0000","last_became_peered":"2023-10-09T12:57:22.621737+0000","last_unstale":"2023-10-09T12:57:22.625242+0000","last_undegraded":"2023-10-09T12:57:22.625242+0000","last_fullsized":"2023-10-09T12:57:22.625242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:43.225188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604091+0000","last_change":"2023-10-09T12:57:21.605816+0000","last_active":"2023-10-09T12:57:22.604091+0000","last_peered":"2023-10-09T12:57:22.604091+0000","last_clean":"2023-10-09T12:57:22.604091+0000","last_became_active":"2023-10-09T12:57:21.605528+0000","last_became_peered":"2023-10-09T12:57:21.605528+0000","last_unstale":"2023-10-09T12:57:22.604091+0000","last_undegraded":"2023-10-09T12:57:22.604091+0000","last_fullsized":"2023-10-09T12:57:22.604091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:17.071923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633437+0000","last_change":"2023-10-09T12:57:21.599237+0000","last_active":"2023-10-09T12:57:22.633437+0000","last_peered":"2023-10-09T12:57:22.633437+0000","last_clean":"2023-10-09T12:57:22.633437+0000","last_became_active":"2023-10-09T12:57:21.598939+0000","last_became_peered":"2023-10-09T12:57:21.598939+0000","last_unstale":"2023-10-09T12:57:22.633437+0000","last_undegraded":"2023-10-09T12:57:22.633437+0000","last_fullsized":"2023-10-09T12:57:22.633437+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:26.106984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616131+0000","last_change":"2023-10-09T12:57:22.615086+0000","last_active":"2023-10-09T12:57:22.616131+0000","last_peered":"2023-10-09T12:57:22.616131+0000","last_clean":"2023-10-09T12:57:22.616131+0000","last_became_active":"2023-10-09T12:57:22.614828+0000","last_became_peered":"2023-10-09T12:57:22.614828+0000","last_unstale":"2023-10-09T12:57:22.616131+0000","last_undegraded":"2023-10-09T12:57:22.616131+0000","last_fullsized":"2023-10-09T12:57:22.616131+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:46.019043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585115+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:24.386174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584417+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:19.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616086+0000","last_change":"2023-10-09T12:57:22.615055+0000","last_active":"2023-10-09T12:57:22.616086+0000","last_peered":"2023-10-09T12:57:22.616086+0000","last_clean":"2023-10-09T12:57:22.616086+0000","last_became_active":"2023-10-09T12:57:22.614806+0000","last_became_peered":"2023-10-09T12:57:22.614806+0000","last_unstale":"2023-10-09T12:57:22.616086+0000","last_undegraded":"2023-10-09T12:57:22.616086+0000","last_fullsized":"2023-10-09T12:57:22.616086+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585821+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584933+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:32.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601006+0000","last_change":"2023-10-09T12:57:21.604265+0000","last_active":"2023-10-09T12:57:22.601006+0000","last_peered":"2023-10-09T12:57:22.601006+0000","last_clean":"2023-10-09T12:57:22.601006+0000","last_became_active":"2023-10-09T12:57:21.603970+0000","last_became_peered":"2023-10-09T12:57:21.603970+0000","last_unstale":"2023-10-09T12:57:22.601006+0000","last_undegraded":"2023-10-09T12:57:22.601006+0000","last_fullsized":"2023-10-09T12:57:22.601006+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:04.329182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614593+0000","last_change":"2023-10-09T12:57:22.611673+0000","last_active":"2023-10-09T12:57:22.614593+0000","last_peered":"2023-10-09T12:57:22.614593+0000","last_clean":"2023-10-09T12:57:22.614593+0000","last_became_active":"2023-10-09T12:57:22.611426+0000","last_became_peered":"2023-10-09T12:57:22.611426+0000","last_unstale":"2023-10-09T12:57:22.614593+0000","last_undegraded":"2023-10-09T12:57:22.614593+0000","last_fullsized":"2023-10-09T12:57:22.614593+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:03:40.616620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.602023+0000","last_change":"2023-10-09T12:57:21.595696+0000","last_active":"2023-10-09T12:57:22.602023+0000","last_peered":"2023-10-09T12:57:22.602023+0000","last_clean":"2023-10-09T12:57:22.602023+0000","last_became_active":"2023-10-09T12:57:21.595435+0000","last_became_peered":"2023-10-09T12:57:21.595435+0000","last_unstale":"2023-10-09T12:57:22.602023+0000","last_undegraded":"2023-10-09T12:57:22.602023+0000","last_fullsized":"2023-10-09T12:57:22.602023+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:30.351371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619850+0000","last_change":"2023-10-09T12:57:22.617179+0000","last_active":"2023-10-09T12:57:22.619850+0000","last_peered":"2023-10-09T12:57:22.619850+0000","last_clean":"2023-10-09T12:57:22.619850+0000","last_became_active":"2023-10-09T12:57:22.616900+0000","last_became_peered":"2023-10-09T12:57:22.616900+0000","last_unstale":"2023-10-09T12:57:22.619850+0000","last_undegraded":"2023-10-09T12:57:22.619850+0000","last_fullsized":"2023-10-09T12:57:22.619850+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:44.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601003+0000","last_change":"2023-10-09T12:57:21.596493+0000","last_active":"2023-10-09T12:57:22.601003+0000","last_peered":"2023-10-09T12:57:22.601003+0000","last_clean":"2023-10-09T12:57:22.601003+0000","last_became_active":"2023-10-09T12:57:21.596245+0000","last_became_peered":"2023-10-09T12:57:21.596245+0000","last_unstale":"2023-10-09T12:57:22.601003+0000","last_undegraded":"2023-10-09T12:57:22.601003+0000","last_fullsized":"2023-10-09T12:57:22.601003+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619423+0000","last_change":"2023-10-09T12:57:22.618476+0000","last_active":"2023-10-09T12:57:22.619423+0000","last_peered":"2023-10-09T12:57:22.619423+0000","last_clean":"2023-10-09T12:57:22.619423+0000","last_became_active":"2023-10-09T12:57:22.618207+0000","last_became_peered":"2023-10-09T12:57:22.618207+0000","last_unstale":"2023-10-09T12:57:22.619423+0000","last_undegraded":"2023-10-09T12:57:22.619423+0000","last_fullsized":"2023-10-09T12:57:22.619423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:00.884319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606622+0000","last_change":"2023-10-09T12:57:21.600975+0000","last_active":"2023-10-09T12:57:22.606622+0000","last_peered":"2023-10-09T12:57:22.606622+0000","last_clean":"2023-10-09T12:57:22.606622+0000","last_became_active":"2023-10-09T12:57:21.600264+0000","last_became_peered":"2023-10-09T12:57:21.600264+0000","last_unstale":"2023-10-09T12:57:22.606622+0000","last_undegraded":"2023-10-09T12:57:22.606622+0000","last_fullsized":"2023-10-09T12:57:22.606622+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:12.067958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584501+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:14.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586617+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:47.959787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.603409+0000","last_change":"2023-10-09T12:57:21.609638+0000","last_active":"2023-10-09T12:57:22.603409+0000","last_peered":"2023-10-09T12:57:22.603409+0000","last_clean":"2023-10-09T12:57:22.603409+0000","last_became_active":"2023-10-09T12:57:21.609342+0000","last_became_peered":"2023-10-09T12:57:21.609342+0000","last_unstale":"2023-10-09T12:57:22.603409+0000","last_undegraded":"2023-10-09T12:57:22.603409+0000","last_fullsized":"2023-10-09T12:57:22.603409+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:47.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616422+0000","last_change":"2023-10-09T12:57:22.613537+0000","last_active":"2023-10-09T12:57:22.616422+0000","last_peered":"2023-10-09T12:57:22.616422+0000","last_clean":"2023-10-09T12:57:22.616422+0000","last_became_active":"2023-10-09T12:57:22.613287+0000","last_became_peered":"2023-10-09T12:57:22.613287+0000","last_unstale":"2023-10-09T12:57:22.616422+0000","last_undegraded":"2023-10-09T12:57:22.616422+0000","last_fullsized":"2023-10-09T12:57:22.616422+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:38.765063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586117+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"167'293","reported_seq":916,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-09T12:57:19.410936+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:57:19.410936+0000","last_peered":"2023-10-09T12:57:19.410936+0000","last_clean":"2023-10-09T12:57:19.410936+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:57:19.410936+0000","last_undegraded":"2023-10-09T12:57:19.410936+0000","last_fullsized":"2023-10-09T12:57:19.410936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":62,"acting":62,"num_store_stats":4},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1606,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477641,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308180,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063660,"statfs":{"total":96636764160,"available":96321187840,"internally_reserved":0,"allocated":2764800,"data_stored":1670544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.82699999999999996}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.754}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":1.036}]}]},{"osd":6,"up_from":16,"seq":68719477642,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.85299999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.77400000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.876}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":1.0609999999999999}]}]},{"osd":1,"up_from":15,"seq":64424510347,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307640,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064200,"statfs":{"total":96636764160,"available":96321740800,"internally_reserved":0,"allocated":2211840,"data_stored":1101388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.879}]}]},{"osd":0,"up_from":14,"seq":60129543050,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308232,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063608,"statfs":{"total":96636764160,"available":96321134592,"internally_reserved":0,"allocated":2818048,"data_stored":1692772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.628,"5min":1.008,"15min":1.008},"last":0.308},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.83199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95899999999999996,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97399999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.79800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":1.105,"15min":1.1639999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.1990000000000001},"last":0.747}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.004,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.208,"15min":1.208},"last":0.59299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311748,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060092,"statfs":{"total":96636764160,"available":96317534208,"internally_reserved":0,"allocated":2224128,"data_stored":1102440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73499999999999999,"5min":0.753,"15min":0.89400000000000002},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":1.038},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78200000000000003,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46999999999999997},"max":{"1min":1.139,"5min":1.194,"15min":1.1990000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.254},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2270000000000001,"5min":1.357,"15min":1.357},"last":0.69199999999999995}]},{"osd":7,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.373},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.66700000000000004}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1100924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.66800000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.317},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.88100000000000001,"15min":0.97199999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69299999999999995,"5min":0.876,"15min":0.876},"last":0.502},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.374},"max":{"1min":0.65400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.83199999999999996,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.083,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.121,"5min":1.321,"15min":1.321},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0129999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.623},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.96299999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"max":{"1min":1.002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76400000000000001}]}]},{"osd":4,"up_from":16,"seq":68719477641,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072432,"statfs":{"total":96636764160,"available":96330170368,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.752},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":0.81699999999999995}]}]},{"osd":5,"up_from":16,"seq":68719477641,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.95999999999999996}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.97199999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":1.0009999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.873}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:57:26.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:57:27.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.145+0000 7f402a1ff700 1 Processor -- start 2023-10-09T12:57:27.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.145+0000 7f402a1ff700 1 -- start start 2023-10-09T12:57:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f402a1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 0x7f4024155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f402a1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240ad930 con 0x7f4024155c10 2023-10-09T12:57:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f402a1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240acd20 con 0x7f40241578b0 2023-10-09T12:57:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f402a1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240ad000 con 0x7f40240b0a10 2023-10-09T12:57:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f40237fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4024155c10 0x7f40240ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47104/0 (socket says 172.21.15.86:47104) 2023-10-09T12:57:27.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f40237fe700 1 -- 172.21.15.86:0/1222936636 learned_addr learned my addr 172.21.15.86:0/1222936636 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:27.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f4023fff700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 0x7f4024155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653410458 0 0) 0x7f40240ad930 con 0x7f4024155c10 2023-10-09T12:57:27.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.147+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f400c003570 con 0x7f4024155c10 2023-10-09T12:57:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2265529495 0 0) 0x7f400c003570 con 0x7f4024155c10 2023-10-09T12:57:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 msgr2=0x7f4024155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 0x7f4024155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 >> v1:172.21.15.135:6789/0 conn(0x7f40241578b0 legacy=0x7f40240af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240ad2e0 con 0x7f4024155c10 2023-10-09T12:57:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f4014001470 con 0x7f4024155c10 2023-10-09T12:57:27.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 >> v1:172.21.15.86:6789/0 conn(0x7f4024155c10 legacy=0x7f40240ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 0x7f400c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f400c003fd0 0x7f400c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c004d50 0x7f400c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240ad000 con 0x7f400c003fd0 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c00bb40 con 0x7f400c004d50 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c00bd00 con 0x7f40240b0a10 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f4022ffd700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f400c003fd0 0x7f400c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f40237fe700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 0x7f400c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f4023fff700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c004d50 0x7f400c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f4022ffd700 1 -- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 msgr2=0x7f400c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f4022ffd700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40240b0a10 0x7f400c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f4022ffd700 1 -- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c004d50 msgr2=0x7f400c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f4022ffd700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c004d50 0x7f400c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.148+0000 7f4022ffd700 1 -- 172.21.15.86:0/1222936636 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c003570 con 0x7f400c003fd0 2023-10-09T12:57:27.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f4022ffd700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f400c003fd0 0x7f400c004810 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f40180019a0 tx=0x7f4018007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c43f1dc10cb6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401800c5d0 con 0x7f400c003fd0 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401800c750 con 0x7f400c003fd0 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f40227fc700 1 -- 172.21.15.86:0/1222936636 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401800cb10 con 0x7f400c003fd0 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f402a1ff700 1 -- 172.21.15.86:0/1222936636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f400c003fd0 msgr2=0x7f400c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f402a1ff700 1 --2- 172.21.15.86:0/1222936636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f400c003fd0 0x7f400c004810 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f40180019a0 tx=0x7f4018007d10 comp rx=0 tx=0).stop 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f4023fff700 1 -- 172.21.15.86:0/1222936636 reap_dead start 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.149+0000 7f402a1ff700 1 -- 172.21.15.86:0/1222936636 shutdown_connections 2023-10-09T12:57:27.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.150+0000 7f402a1ff700 1 -- 172.21.15.86:0/1222936636 >> 172.21.15.86:0/1222936636 conn(0x7f402406a320 msgr2=0x7f40240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:27.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.150+0000 7f402a1ff700 1 -- 172.21.15.86:0/1222936636 shutdown_connections 2023-10-09T12:57:27.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.150+0000 7f402a1ff700 1 -- 172.21.15.86:0/1222936636 wait complete. 2023-10-09T12:57:27.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.151+0000 7f402a1ff700 1 Processor -- start 2023-10-09T12:57:27.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.151+0000 7f402a1ff700 1 -- start start 2023-10-09T12:57:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f402a1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c003fd0 0x7f4024141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f402a1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4024158700 0x7f4024158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f402a1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406e4f0 0x7f402406e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f402a1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241590b0 con 0x7f402406e4f0 2023-10-09T12:57:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f402a1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402406eea0 con 0x7f400c003fd0 2023-10-09T12:57:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f402a1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4024150020 con 0x7f4024158700 2023-10-09T12:57:27.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f4023fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406e4f0 0x7f402406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f4023fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406e4f0 0x7f402406e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52298/0 (socket says 172.21.15.86:52298) 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f4023fff700 1 -- 172.21.15.86:0/719961375 learned_addr learned my addr 172.21.15.86:0/719961375 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f40237fe700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c003fd0 0x7f4024141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.152+0000 7f4022ffd700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4024158700 0x7f4024158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f4023fff700 1 -- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4024158700 msgr2=0x7f4024158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f4023fff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4024158700 0x7f4024158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f4023fff700 1 -- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c003fd0 msgr2=0x7f4024141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f4023fff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c003fd0 0x7f4024141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f4023fff700 1 -- 172.21.15.86:0/719961375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402414f410 con 0x7f402406e4f0 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f4023fff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406e4f0 0x7f402406e960 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f401c0094d0 tx=0x7f401c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f400b7fe700 1 -- 172.21.15.86:0/719961375 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00e040 con 0x7f402406e4f0 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f400b7fe700 1 -- 172.21.15.86:0/719961375 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c00f040 con 0x7f402406e4f0 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f400b7fe700 1 -- 172.21.15.86:0/719961375 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00fd90 con 0x7f402406e4f0 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.153+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402414f6f0 con 0x7f402406e4f0 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.154+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402414fcb0 con 0x7f402406e4f0 2023-10-09T12:57:27.160 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.155+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4024150190 con 0x7f402406e4f0 2023-10-09T12:57:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.155+0000 7f400b7fe700 1 -- 172.21.15.86:0/719961375 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f401c015640 con 0x7f402406e4f0 2023-10-09T12:57:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.156+0000 7f400b7fe700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.156+0000 7f400b7fe700 1 -- 172.21.15.86:0/719961375 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f401c0850d0 con 0x7f402406e4f0 2023-10-09T12:57:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.156+0000 7f40237fe700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.157+0000 7f40237fe700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4014001200 tx=0x7f40240ad8a0 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:27.161 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.160+0000 7f400b7fe700 1 -- 172.21.15.86:0/719961375 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f401c0520e0 con 0x7f402406e4f0 2023-10-09T12:57:27.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.345+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f402404c3c0 con 0x7f4010066f30 2023-10-09T12:57:27.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.354+0000 7f400b7fe700 1 -- 172.21.15.86:0/719961375 <== mgr.8883 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284046 (secure 0 0 0) 0x7f402404c3c0 con 0x7f4010066f30 2023-10-09T12:57:27.357 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.357+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4010066f30 msgr2=0x7f40100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.357+0000 7f402a1ff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4014001200 tx=0x7f40240ad8a0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.357+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406e4f0 msgr2=0x7f402406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.357+0000 7f402a1ff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406e4f0 0x7f402406e960 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f401c0094d0 tx=0x7f401c00b040 comp rx=0 tx=0).stop 2023-10-09T12:57:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 shutdown_connections 2023-10-09T12:57:27.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406e4f0 0x7f402406e960 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f400c003fd0 0x7f4024141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 --2- 172.21.15.86:0/719961375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4024158700 0x7f4024158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 >> 172.21.15.86:0/719961375 conn(0x7f402406a320 msgr2=0x7f402406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 shutdown_connections 2023-10-09T12:57:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.358+0000 7f402a1ff700 1 -- 172.21.15.86:0/719961375 wait complete. 2023-10-09T12:57:27.360 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:57:27.375 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T12:57:26.546115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591974,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":502,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":314,"ondisk_log_size":314,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470336,"kb_used_data":18304,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504384,"statfs":{"total":773094113280,"available":770564489216,"internally_reserved":0,"allocated":18743296,"data_stored":9908596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1606,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.967906"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638747+0000","last_change":"2023-10-09T12:57:22.636031+0000","last_active":"2023-10-09T12:57:22.638747+0000","last_peered":"2023-10-09T12:57:22.638747+0000","last_clean":"2023-10-09T12:57:22.638747+0000","last_became_active":"2023-10-09T12:57:22.635750+0000","last_became_peered":"2023-10-09T12:57:22.635750+0000","last_unstale":"2023-10-09T12:57:22.638747+0000","last_undegraded":"2023-10-09T12:57:22.638747+0000","last_fullsized":"2023-10-09T12:57:22.638747+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:36.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614061+0000","last_change":"2023-10-09T12:57:22.611976+0000","last_active":"2023-10-09T12:57:22.614061+0000","last_peered":"2023-10-09T12:57:22.614061+0000","last_clean":"2023-10-09T12:57:22.614061+0000","last_became_active":"2023-10-09T12:57:22.611701+0000","last_became_peered":"2023-10-09T12:57:22.611701+0000","last_unstale":"2023-10-09T12:57:22.614061+0000","last_undegraded":"2023-10-09T12:57:22.614061+0000","last_fullsized":"2023-10-09T12:57:22.614061+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625495+0000","last_change":"2023-10-09T12:57:22.622355+0000","last_active":"2023-10-09T12:57:22.625495+0000","last_peered":"2023-10-09T12:57:22.625495+0000","last_clean":"2023-10-09T12:57:22.625495+0000","last_became_active":"2023-10-09T12:57:22.622088+0000","last_became_peered":"2023-10-09T12:57:22.622088+0000","last_unstale":"2023-10-09T12:57:22.625495+0000","last_undegraded":"2023-10-09T12:57:22.625495+0000","last_fullsized":"2023-10-09T12:57:22.625495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:11:58.040597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625337+0000","last_change":"2023-10-09T12:57:22.621443+0000","last_active":"2023-10-09T12:57:22.625337+0000","last_peered":"2023-10-09T12:57:22.625337+0000","last_clean":"2023-10-09T12:57:22.625337+0000","last_became_active":"2023-10-09T12:57:22.621180+0000","last_became_peered":"2023-10-09T12:57:22.621180+0000","last_unstale":"2023-10-09T12:57:22.625337+0000","last_undegraded":"2023-10-09T12:57:22.625337+0000","last_fullsized":"2023-10-09T12:57:22.625337+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630227+0000","last_change":"2023-10-09T12:57:22.627728+0000","last_active":"2023-10-09T12:57:22.630227+0000","last_peered":"2023-10-09T12:57:22.630227+0000","last_clean":"2023-10-09T12:57:22.630227+0000","last_became_active":"2023-10-09T12:57:22.627440+0000","last_became_peered":"2023-10-09T12:57:22.627440+0000","last_unstale":"2023-10-09T12:57:22.630227+0000","last_undegraded":"2023-10-09T12:57:22.630227+0000","last_fullsized":"2023-10-09T12:57:22.630227+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:55.583107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614035+0000","last_change":"2023-10-09T12:57:22.611974+0000","last_active":"2023-10-09T12:57:22.614035+0000","last_peered":"2023-10-09T12:57:22.614035+0000","last_clean":"2023-10-09T12:57:22.614035+0000","last_became_active":"2023-10-09T12:57:22.611699+0000","last_became_peered":"2023-10-09T12:57:22.611699+0000","last_unstale":"2023-10-09T12:57:22.614035+0000","last_undegraded":"2023-10-09T12:57:22.614035+0000","last_fullsized":"2023-10-09T12:57:22.614035+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:39.982603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627919+0000","last_change":"2023-10-09T12:57:22.624085+0000","last_active":"2023-10-09T12:57:22.627919+0000","last_peered":"2023-10-09T12:57:22.627919+0000","last_clean":"2023-10-09T12:57:22.627919+0000","last_became_active":"2023-10-09T12:57:22.623822+0000","last_became_peered":"2023-10-09T12:57:22.623822+0000","last_unstale":"2023-10-09T12:57:22.627919+0000","last_undegraded":"2023-10-09T12:57:22.627919+0000","last_fullsized":"2023-10-09T12:57:22.627919+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:26.255875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615271+0000","last_change":"2023-10-09T12:57:22.610213+0000","last_active":"2023-10-09T12:57:22.615271+0000","last_peered":"2023-10-09T12:57:22.615271+0000","last_clean":"2023-10-09T12:57:22.615271+0000","last_became_active":"2023-10-09T12:57:22.609967+0000","last_became_peered":"2023-10-09T12:57:22.609967+0000","last_unstale":"2023-10-09T12:57:22.615271+0000","last_undegraded":"2023-10-09T12:57:22.615271+0000","last_fullsized":"2023-10-09T12:57:22.615271+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:28:10.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619071+0000","last_change":"2023-10-09T12:57:22.613666+0000","last_active":"2023-10-09T12:57:22.619071+0000","last_peered":"2023-10-09T12:57:22.619071+0000","last_clean":"2023-10-09T12:57:22.619071+0000","last_became_active":"2023-10-09T12:57:22.613331+0000","last_became_peered":"2023-10-09T12:57:22.613331+0000","last_unstale":"2023-10-09T12:57:22.619071+0000","last_undegraded":"2023-10-09T12:57:22.619071+0000","last_fullsized":"2023-10-09T12:57:22.619071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:14.886124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.618816+0000","last_change":"2023-10-09T12:57:22.617496+0000","last_active":"2023-10-09T12:57:22.618816+0000","last_peered":"2023-10-09T12:57:22.618816+0000","last_clean":"2023-10-09T12:57:22.618816+0000","last_became_active":"2023-10-09T12:57:22.617196+0000","last_became_peered":"2023-10-09T12:57:22.617196+0000","last_unstale":"2023-10-09T12:57:22.618816+0000","last_undegraded":"2023-10-09T12:57:22.618816+0000","last_fullsized":"2023-10-09T12:57:22.618816+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:29.620453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.617901+0000","last_change":"2023-10-09T12:57:22.615483+0000","last_active":"2023-10-09T12:57:22.617901+0000","last_peered":"2023-10-09T12:57:22.617901+0000","last_clean":"2023-10-09T12:57:22.617901+0000","last_became_active":"2023-10-09T12:57:22.615223+0000","last_became_peered":"2023-10-09T12:57:22.615223+0000","last_unstale":"2023-10-09T12:57:22.617901+0000","last_undegraded":"2023-10-09T12:57:22.617901+0000","last_fullsized":"2023-10-09T12:57:22.617901+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:05.692178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619083+0000","last_change":"2023-10-09T12:57:22.613737+0000","last_active":"2023-10-09T12:57:22.619083+0000","last_peered":"2023-10-09T12:57:22.619083+0000","last_clean":"2023-10-09T12:57:22.619083+0000","last_became_active":"2023-10-09T12:57:22.613227+0000","last_became_peered":"2023-10-09T12:57:22.613227+0000","last_unstale":"2023-10-09T12:57:22.619083+0000","last_undegraded":"2023-10-09T12:57:22.619083+0000","last_fullsized":"2023-10-09T12:57:22.619083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:51.856277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630735+0000","last_change":"2023-10-09T12:57:22.626583+0000","last_active":"2023-10-09T12:57:22.630735+0000","last_peered":"2023-10-09T12:57:22.630735+0000","last_clean":"2023-10-09T12:57:22.630735+0000","last_became_active":"2023-10-09T12:57:22.626327+0000","last_became_peered":"2023-10-09T12:57:22.626327+0000","last_unstale":"2023-10-09T12:57:22.630735+0000","last_undegraded":"2023-10-09T12:57:22.630735+0000","last_fullsized":"2023-10-09T12:57:22.630735+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:20.275237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627649+0000","last_change":"2023-10-09T12:57:22.624916+0000","last_active":"2023-10-09T12:57:22.627649+0000","last_peered":"2023-10-09T12:57:22.627649+0000","last_clean":"2023-10-09T12:57:22.627649+0000","last_became_active":"2023-10-09T12:57:22.624661+0000","last_became_peered":"2023-10-09T12:57:22.624661+0000","last_unstale":"2023-10-09T12:57:22.627649+0000","last_undegraded":"2023-10-09T12:57:22.627649+0000","last_fullsized":"2023-10-09T12:57:22.627649+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625458+0000","last_change":"2023-10-09T12:57:22.622049+0000","last_active":"2023-10-09T12:57:22.625458+0000","last_peered":"2023-10-09T12:57:22.625458+0000","last_clean":"2023-10-09T12:57:22.625458+0000","last_became_active":"2023-10-09T12:57:22.621769+0000","last_became_peered":"2023-10-09T12:57:22.621769+0000","last_unstale":"2023-10-09T12:57:22.625458+0000","last_undegraded":"2023-10-09T12:57:22.625458+0000","last_fullsized":"2023-10-09T12:57:22.625458+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:50.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630955+0000","last_change":"2023-10-09T12:57:22.627678+0000","last_active":"2023-10-09T12:57:22.630955+0000","last_peered":"2023-10-09T12:57:22.630955+0000","last_clean":"2023-10-09T12:57:22.630955+0000","last_became_active":"2023-10-09T12:57:22.627139+0000","last_became_peered":"2023-10-09T12:57:22.627139+0000","last_unstale":"2023-10-09T12:57:22.630955+0000","last_undegraded":"2023-10-09T12:57:22.630955+0000","last_fullsized":"2023-10-09T12:57:22.630955+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:58.263529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628975+0000","last_change":"2023-10-09T12:57:22.624700+0000","last_active":"2023-10-09T12:57:22.628975+0000","last_peered":"2023-10-09T12:57:22.628975+0000","last_clean":"2023-10-09T12:57:22.628975+0000","last_became_active":"2023-10-09T12:57:22.624369+0000","last_became_peered":"2023-10-09T12:57:22.624369+0000","last_unstale":"2023-10-09T12:57:22.628975+0000","last_undegraded":"2023-10-09T12:57:22.628975+0000","last_fullsized":"2023-10-09T12:57:22.628975+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:15.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585504+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:43.822255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614017+0000","last_change":"2023-10-09T12:57:22.611789+0000","last_active":"2023-10-09T12:57:22.614017+0000","last_peered":"2023-10-09T12:57:22.614017+0000","last_clean":"2023-10-09T12:57:22.614017+0000","last_became_active":"2023-10-09T12:57:22.611456+0000","last_became_peered":"2023-10-09T12:57:22.611456+0000","last_unstale":"2023-10-09T12:57:22.614017+0000","last_undegraded":"2023-10-09T12:57:22.614017+0000","last_fullsized":"2023-10-09T12:57:22.614017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:35.215673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635479+0000","last_change":"2023-10-09T12:57:21.609699+0000","last_active":"2023-10-09T12:57:22.635479+0000","last_peered":"2023-10-09T12:57:22.635479+0000","last_clean":"2023-10-09T12:57:22.635479+0000","last_became_active":"2023-10-09T12:57:21.609416+0000","last_became_peered":"2023-10-09T12:57:21.609416+0000","last_unstale":"2023-10-09T12:57:22.635479+0000","last_undegraded":"2023-10-09T12:57:22.635479+0000","last_fullsized":"2023-10-09T12:57:22.635479+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:28.632953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619875+0000","last_change":"2023-10-09T12:57:22.617329+0000","last_active":"2023-10-09T12:57:22.619875+0000","last_peered":"2023-10-09T12:57:22.619875+0000","last_clean":"2023-10-09T12:57:22.619875+0000","last_became_active":"2023-10-09T12:57:22.615838+0000","last_became_peered":"2023-10-09T12:57:22.615838+0000","last_unstale":"2023-10-09T12:57:22.619875+0000","last_undegraded":"2023-10-09T12:57:22.619875+0000","last_fullsized":"2023-10-09T12:57:22.619875+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:11.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584709+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583077+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630886+0000","last_change":"2023-10-09T12:57:22.627451+0000","last_active":"2023-10-09T12:57:22.630886+0000","last_peered":"2023-10-09T12:57:22.630886+0000","last_clean":"2023-10-09T12:57:22.630886+0000","last_became_active":"2023-10-09T12:57:22.627150+0000","last_became_peered":"2023-10-09T12:57:22.627150+0000","last_unstale":"2023-10-09T12:57:22.630886+0000","last_undegraded":"2023-10-09T12:57:22.630886+0000","last_fullsized":"2023-10-09T12:57:22.630886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:40.741655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637597+0000","last_change":"2023-10-09T12:57:21.601324+0000","last_active":"2023-10-09T12:57:22.637597+0000","last_peered":"2023-10-09T12:57:22.637597+0000","last_clean":"2023-10-09T12:57:22.637597+0000","last_became_active":"2023-10-09T12:57:21.601065+0000","last_became_peered":"2023-10-09T12:57:21.601065+0000","last_unstale":"2023-10-09T12:57:22.637597+0000","last_undegraded":"2023-10-09T12:57:22.637597+0000","last_fullsized":"2023-10-09T12:57:22.637597+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:29.021722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583077+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633755+0000","last_change":"2023-10-09T12:57:22.629636+0000","last_active":"2023-10-09T12:57:22.633755+0000","last_peered":"2023-10-09T12:57:22.633755+0000","last_clean":"2023-10-09T12:57:22.633755+0000","last_became_active":"2023-10-09T12:57:22.629297+0000","last_became_peered":"2023-10-09T12:57:22.629297+0000","last_unstale":"2023-10-09T12:57:22.633755+0000","last_undegraded":"2023-10-09T12:57:22.633755+0000","last_fullsized":"2023-10-09T12:57:22.633755+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.605892+0000","last_change":"2023-10-09T12:57:21.597160+0000","last_active":"2023-10-09T12:57:22.605892+0000","last_peered":"2023-10-09T12:57:22.605892+0000","last_clean":"2023-10-09T12:57:22.605892+0000","last_became_active":"2023-10-09T12:57:21.596858+0000","last_became_peered":"2023-10-09T12:57:21.596858+0000","last_unstale":"2023-10-09T12:57:22.605892+0000","last_undegraded":"2023-10-09T12:57:22.605892+0000","last_fullsized":"2023-10-09T12:57:22.605892+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:39.389828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583139+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604011+0000","last_change":"2023-10-09T12:57:21.603114+0000","last_active":"2023-10-09T12:57:22.604011+0000","last_peered":"2023-10-09T12:57:22.604011+0000","last_clean":"2023-10-09T12:57:22.604011+0000","last_became_active":"2023-10-09T12:57:21.602848+0000","last_became_peered":"2023-10-09T12:57:21.602848+0000","last_unstale":"2023-10-09T12:57:22.604011+0000","last_undegraded":"2023-10-09T12:57:22.604011+0000","last_fullsized":"2023-10-09T12:57:22.604011+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:47.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585927+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:08.548490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615217+0000","last_change":"2023-10-09T12:57:22.612914+0000","last_active":"2023-10-09T12:57:22.615217+0000","last_peered":"2023-10-09T12:57:22.615217+0000","last_clean":"2023-10-09T12:57:22.615217+0000","last_became_active":"2023-10-09T12:57:22.612654+0000","last_became_peered":"2023-10-09T12:57:22.612654+0000","last_unstale":"2023-10-09T12:57:22.615217+0000","last_undegraded":"2023-10-09T12:57:22.615217+0000","last_fullsized":"2023-10-09T12:57:22.615217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:28.372635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"177'6","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.642564+0000","last_change":"2023-10-09T12:57:21.594239+0000","last_active":"2023-10-09T12:57:22.642564+0000","last_peered":"2023-10-09T12:57:22.642564+0000","last_clean":"2023-10-09T12:57:22.642564+0000","last_became_active":"2023-10-09T12:57:21.593748+0000","last_became_peered":"2023-10-09T12:57:21.593748+0000","last_unstale":"2023-10-09T12:57:22.642564+0000","last_undegraded":"2023-10-09T12:57:22.642564+0000","last_fullsized":"2023-10-09T12:57:22.642564+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:09.926296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585363+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:45.912841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.613966+0000","last_change":"2023-10-09T12:57:22.611664+0000","last_active":"2023-10-09T12:57:22.613966+0000","last_peered":"2023-10-09T12:57:22.613966+0000","last_clean":"2023-10-09T12:57:22.613966+0000","last_became_active":"2023-10-09T12:57:22.611336+0000","last_became_peered":"2023-10-09T12:57:22.611336+0000","last_unstale":"2023-10-09T12:57:22.613966+0000","last_undegraded":"2023-10-09T12:57:22.613966+0000","last_fullsized":"2023-10-09T12:57:22.613966+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:27.112437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586602+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.600525+0000","last_change":"2023-10-09T12:57:21.597869+0000","last_active":"2023-10-09T12:57:22.600525+0000","last_peered":"2023-10-09T12:57:22.600525+0000","last_clean":"2023-10-09T12:57:22.600525+0000","last_became_active":"2023-10-09T12:57:21.597615+0000","last_became_peered":"2023-10-09T12:57:21.597615+0000","last_unstale":"2023-10-09T12:57:22.600525+0000","last_undegraded":"2023-10-09T12:57:22.600525+0000","last_fullsized":"2023-10-09T12:57:22.600525+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"177'8","reported_seq":18,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635696+0000","last_change":"2023-10-09T12:57:21.597629+0000","last_active":"2023-10-09T12:57:22.635696+0000","last_peered":"2023-10-09T12:57:22.635696+0000","last_clean":"2023-10-09T12:57:22.635696+0000","last_became_active":"2023-10-09T12:57:21.597355+0000","last_became_peered":"2023-10-09T12:57:21.597355+0000","last_unstale":"2023-10-09T12:57:22.635696+0000","last_undegraded":"2023-10-09T12:57:22.635696+0000","last_fullsized":"2023-10-09T12:57:22.635696+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:23.097372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583227+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.636307+0000","last_change":"2023-10-09T12:57:22.632816+0000","last_active":"2023-10-09T12:57:22.636307+0000","last_peered":"2023-10-09T12:57:22.636307+0000","last_clean":"2023-10-09T12:57:22.636307+0000","last_became_active":"2023-10-09T12:57:22.632525+0000","last_became_peered":"2023-10-09T12:57:22.632525+0000","last_unstale":"2023-10-09T12:57:22.636307+0000","last_undegraded":"2023-10-09T12:57:22.636307+0000","last_fullsized":"2023-10-09T12:57:22.636307+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:31.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628132+0000","last_change":"2023-10-09T12:57:21.606002+0000","last_active":"2023-10-09T12:57:22.628132+0000","last_peered":"2023-10-09T12:57:22.628132+0000","last_clean":"2023-10-09T12:57:22.628132+0000","last_became_active":"2023-10-09T12:57:21.605728+0000","last_became_peered":"2023-10-09T12:57:21.605728+0000","last_unstale":"2023-10-09T12:57:22.628132+0000","last_undegraded":"2023-10-09T12:57:22.628132+0000","last_fullsized":"2023-10-09T12:57:22.628132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.996883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637660+0000","last_change":"2023-10-09T12:57:21.599422+0000","last_active":"2023-10-09T12:57:22.637660+0000","last_peered":"2023-10-09T12:57:22.637660+0000","last_clean":"2023-10-09T12:57:22.637660+0000","last_became_active":"2023-10-09T12:57:21.599151+0000","last_became_peered":"2023-10-09T12:57:21.599151+0000","last_unstale":"2023-10-09T12:57:22.637660+0000","last_undegraded":"2023-10-09T12:57:22.637660+0000","last_fullsized":"2023-10-09T12:57:22.637660+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:45.965489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625242+0000","last_change":"2023-10-09T12:57:22.622000+0000","last_active":"2023-10-09T12:57:22.625242+0000","last_peered":"2023-10-09T12:57:22.625242+0000","last_clean":"2023-10-09T12:57:22.625242+0000","last_became_active":"2023-10-09T12:57:22.621737+0000","last_became_peered":"2023-10-09T12:57:22.621737+0000","last_unstale":"2023-10-09T12:57:22.625242+0000","last_undegraded":"2023-10-09T12:57:22.625242+0000","last_fullsized":"2023-10-09T12:57:22.625242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:43.225188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604091+0000","last_change":"2023-10-09T12:57:21.605816+0000","last_active":"2023-10-09T12:57:22.604091+0000","last_peered":"2023-10-09T12:57:22.604091+0000","last_clean":"2023-10-09T12:57:22.604091+0000","last_became_active":"2023-10-09T12:57:21.605528+0000","last_became_peered":"2023-10-09T12:57:21.605528+0000","last_unstale":"2023-10-09T12:57:22.604091+0000","last_undegraded":"2023-10-09T12:57:22.604091+0000","last_fullsized":"2023-10-09T12:57:22.604091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:17.071923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633437+0000","last_change":"2023-10-09T12:57:21.599237+0000","last_active":"2023-10-09T12:57:22.633437+0000","last_peered":"2023-10-09T12:57:22.633437+0000","last_clean":"2023-10-09T12:57:22.633437+0000","last_became_active":"2023-10-09T12:57:21.598939+0000","last_became_peered":"2023-10-09T12:57:21.598939+0000","last_unstale":"2023-10-09T12:57:22.633437+0000","last_undegraded":"2023-10-09T12:57:22.633437+0000","last_fullsized":"2023-10-09T12:57:22.633437+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:26.106984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616131+0000","last_change":"2023-10-09T12:57:22.615086+0000","last_active":"2023-10-09T12:57:22.616131+0000","last_peered":"2023-10-09T12:57:22.616131+0000","last_clean":"2023-10-09T12:57:22.616131+0000","last_became_active":"2023-10-09T12:57:22.614828+0000","last_became_peered":"2023-10-09T12:57:22.614828+0000","last_unstale":"2023-10-09T12:57:22.616131+0000","last_undegraded":"2023-10-09T12:57:22.616131+0000","last_fullsized":"2023-10-09T12:57:22.616131+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:46.019043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585115+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:24.386174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584417+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:19.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616086+0000","last_change":"2023-10-09T12:57:22.615055+0000","last_active":"2023-10-09T12:57:22.616086+0000","last_peered":"2023-10-09T12:57:22.616086+0000","last_clean":"2023-10-09T12:57:22.616086+0000","last_became_active":"2023-10-09T12:57:22.614806+0000","last_became_peered":"2023-10-09T12:57:22.614806+0000","last_unstale":"2023-10-09T12:57:22.616086+0000","last_undegraded":"2023-10-09T12:57:22.616086+0000","last_fullsized":"2023-10-09T12:57:22.616086+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585821+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584933+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:32.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601006+0000","last_change":"2023-10-09T12:57:21.604265+0000","last_active":"2023-10-09T12:57:22.601006+0000","last_peered":"2023-10-09T12:57:22.601006+0000","last_clean":"2023-10-09T12:57:22.601006+0000","last_became_active":"2023-10-09T12:57:21.603970+0000","last_became_peered":"2023-10-09T12:57:21.603970+0000","last_unstale":"2023-10-09T12:57:22.601006+0000","last_undegraded":"2023-10-09T12:57:22.601006+0000","last_fullsized":"2023-10-09T12:57:22.601006+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:04.329182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614593+0000","last_change":"2023-10-09T12:57:22.611673+0000","last_active":"2023-10-09T12:57:22.614593+0000","last_peered":"2023-10-09T12:57:22.614593+0000","last_clean":"2023-10-09T12:57:22.614593+0000","last_became_active":"2023-10-09T12:57:22.611426+0000","last_became_peered":"2023-10-09T12:57:22.611426+0000","last_unstale":"2023-10-09T12:57:22.614593+0000","last_undegraded":"2023-10-09T12:57:22.614593+0000","last_fullsized":"2023-10-09T12:57:22.614593+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:03:40.616620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.602023+0000","last_change":"2023-10-09T12:57:21.595696+0000","last_active":"2023-10-09T12:57:22.602023+0000","last_peered":"2023-10-09T12:57:22.602023+0000","last_clean":"2023-10-09T12:57:22.602023+0000","last_became_active":"2023-10-09T12:57:21.595435+0000","last_became_peered":"2023-10-09T12:57:21.595435+0000","last_unstale":"2023-10-09T12:57:22.602023+0000","last_undegraded":"2023-10-09T12:57:22.602023+0000","last_fullsized":"2023-10-09T12:57:22.602023+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:30.351371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619850+0000","last_change":"2023-10-09T12:57:22.617179+0000","last_active":"2023-10-09T12:57:22.619850+0000","last_peered":"2023-10-09T12:57:22.619850+0000","last_clean":"2023-10-09T12:57:22.619850+0000","last_became_active":"2023-10-09T12:57:22.616900+0000","last_became_peered":"2023-10-09T12:57:22.616900+0000","last_unstale":"2023-10-09T12:57:22.619850+0000","last_undegraded":"2023-10-09T12:57:22.619850+0000","last_fullsized":"2023-10-09T12:57:22.619850+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:44.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601003+0000","last_change":"2023-10-09T12:57:21.596493+0000","last_active":"2023-10-09T12:57:22.601003+0000","last_peered":"2023-10-09T12:57:22.601003+0000","last_clean":"2023-10-09T12:57:22.601003+0000","last_became_active":"2023-10-09T12:57:21.596245+0000","last_became_peered":"2023-10-09T12:57:21.596245+0000","last_unstale":"2023-10-09T12:57:22.601003+0000","last_undegraded":"2023-10-09T12:57:22.601003+0000","last_fullsized":"2023-10-09T12:57:22.601003+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619423+0000","last_change":"2023-10-09T12:57:22.618476+0000","last_active":"2023-10-09T12:57:22.619423+0000","last_peered":"2023-10-09T12:57:22.619423+0000","last_clean":"2023-10-09T12:57:22.619423+0000","last_became_active":"2023-10-09T12:57:22.618207+0000","last_became_peered":"2023-10-09T12:57:22.618207+0000","last_unstale":"2023-10-09T12:57:22.619423+0000","last_undegraded":"2023-10-09T12:57:22.619423+0000","last_fullsized":"2023-10-09T12:57:22.619423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:00.884319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606622+0000","last_change":"2023-10-09T12:57:21.600975+0000","last_active":"2023-10-09T12:57:22.606622+0000","last_peered":"2023-10-09T12:57:22.606622+0000","last_clean":"2023-10-09T12:57:22.606622+0000","last_became_active":"2023-10-09T12:57:21.600264+0000","last_became_peered":"2023-10-09T12:57:21.600264+0000","last_unstale":"2023-10-09T12:57:22.606622+0000","last_undegraded":"2023-10-09T12:57:22.606622+0000","last_fullsized":"2023-10-09T12:57:22.606622+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:12.067958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584501+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:14.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586617+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:47.959787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.603409+0000","last_change":"2023-10-09T12:57:21.609638+0000","last_active":"2023-10-09T12:57:22.603409+0000","last_peered":"2023-10-09T12:57:22.603409+0000","last_clean":"2023-10-09T12:57:22.603409+0000","last_became_active":"2023-10-09T12:57:21.609342+0000","last_became_peered":"2023-10-09T12:57:21.609342+0000","last_unstale":"2023-10-09T12:57:22.603409+0000","last_undegraded":"2023-10-09T12:57:22.603409+0000","last_fullsized":"2023-10-09T12:57:22.603409+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:47.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616422+0000","last_change":"2023-10-09T12:57:22.613537+0000","last_active":"2023-10-09T12:57:22.616422+0000","last_peered":"2023-10-09T12:57:22.616422+0000","last_clean":"2023-10-09T12:57:22.616422+0000","last_became_active":"2023-10-09T12:57:22.613287+0000","last_became_peered":"2023-10-09T12:57:22.613287+0000","last_unstale":"2023-10-09T12:57:22.616422+0000","last_undegraded":"2023-10-09T12:57:22.616422+0000","last_fullsized":"2023-10-09T12:57:22.616422+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:38.765063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586117+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"167'293","reported_seq":916,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-09T12:57:19.410936+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:57:19.410936+0000","last_peered":"2023-10-09T12:57:19.410936+0000","last_clean":"2023-10-09T12:57:19.410936+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:57:19.410936+0000","last_undegraded":"2023-10-09T12:57:19.410936+0000","last_fullsized":"2023-10-09T12:57:19.410936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":62,"acting":62,"num_store_stats":4},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1606,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477641,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308180,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063660,"statfs":{"total":96636764160,"available":96321187840,"internally_reserved":0,"allocated":2764800,"data_stored":1670544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.82699999999999996}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.754}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":1.036}]}]},{"osd":6,"up_from":16,"seq":68719477642,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.85299999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.77400000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.876}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":1.0609999999999999}]}]},{"osd":1,"up_from":15,"seq":64424510347,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307640,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064200,"statfs":{"total":96636764160,"available":96321740800,"internally_reserved":0,"allocated":2211840,"data_stored":1101388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.879}]}]},{"osd":0,"up_from":14,"seq":60129543050,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308232,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063608,"statfs":{"total":96636764160,"available":96321134592,"internally_reserved":0,"allocated":2818048,"data_stored":1692772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.628,"5min":1.008,"15min":1.008},"last":0.308},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.83199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95899999999999996,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97399999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.79800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":1.105,"15min":1.1639999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.1990000000000001},"last":0.747}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.004,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.208,"15min":1.208},"last":0.59299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311748,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060092,"statfs":{"total":96636764160,"available":96317534208,"internally_reserved":0,"allocated":2224128,"data_stored":1102440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73499999999999999,"5min":0.753,"15min":0.89400000000000002},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":1.038},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78200000000000003,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46999999999999997},"max":{"1min":1.139,"5min":1.194,"15min":1.1990000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.254},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2270000000000001,"5min":1.357,"15min":1.357},"last":0.69199999999999995}]},{"osd":7,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.373},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.66700000000000004}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1100924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.66800000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.317},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.88100000000000001,"15min":0.97199999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69299999999999995,"5min":0.876,"15min":0.876},"last":0.502},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.374},"max":{"1min":0.65400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.83199999999999996,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.083,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.121,"5min":1.321,"15min":1.321},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0129999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.623},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.96299999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"max":{"1min":1.002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76400000000000001}]}]},{"osd":4,"up_from":16,"seq":68719477641,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072432,"statfs":{"total":96636764160,"available":96330170368,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.752},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":0.81699999999999995}]}]},{"osd":5,"up_from":16,"seq":68719477641,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.95999999999999996}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.97199999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":1.0009999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.873}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:57:27.381 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:57:27.575 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-10-09T12:57:27.575+0000 7f2d625f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T12:57:27.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.597+0000 7f280b3ff700 1 Processor -- start 2023-10-09T12:57:27.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.597+0000 7f280b3ff700 1 -- start start 2023-10-09T12:57:27.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.598+0000 7f280b3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28040ccc40 0x7f2804155c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.598+0000 7f280b3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28040ad930 con 0x7f2804156150 2023-10-09T12:57:27.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.598+0000 7f280b3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28040acd20 con 0x7f28040cd010 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.598+0000 7f280b3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28040ad000 con 0x7f28040ccc40 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f280899a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2804156150 0x7f28040ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47116/0 (socket says 172.21.15.86:47116) 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f280899a700 1 -- 172.21.15.86:0/1558646779 learned_addr learned my addr 172.21.15.86:0/1558646779 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f280919b700 1 --2- 172.21.15.86:0/1558646779 >> v2:172.21.15.135:3300/0 conn(0x7f28040ccc40 0x7f2804155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411996444 0 0) 0x7f28040ad930 con 0x7f2804156150 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f0003570 con 0x7f2804156150 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025765348 0 0) 0x7f28040acd20 con 0x7f28040cd010 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28040ad930 con 0x7f28040cd010 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375514736 0 0) 0x7f27f0003570 con 0x7f2804156150 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f280919b700 1 -- 172.21.15.86:0/1558646779 >> v1:172.21.15.135:6789/0 conn(0x7f28040cd010 legacy=0x7f28040b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f280919b700 1 -- 172.21.15.86:0/1558646779 >> v1:172.21.15.86:6789/0 conn(0x7f2804156150 legacy=0x7f28040ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.599+0000 7f280919b700 1 -- 172.21.15.86:0/1558646779 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040ad2e0 con 0x7f28040ccc40 2023-10-09T12:57:27.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.600+0000 7f280919b700 1 --2- 172.21.15.86:0/1558646779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040ccc40 0x7f2804155c10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f28000098e0 tx=0x7f28000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5369b8bb3640f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.600+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011630 con 0x7f28040ccc40 2023-10-09T12:57:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.600+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800011790 con 0x7f28040ccc40 2023-10-09T12:57:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.600+0000 7f27fbfff700 1 -- 172.21.15.86:0/1558646779 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011b30 con 0x7f28040ccc40 2023-10-09T12:57:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.600+0000 7f280b3ff700 1 -- 172.21.15.86:0/1558646779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040ccc40 msgr2=0x7f2804155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.600+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1558646779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040ccc40 0x7f2804155c10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f28000098e0 tx=0x7f28000091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.601+0000 7f280b3ff700 1 -- 172.21.15.86:0/1558646779 shutdown_connections 2023-10-09T12:57:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.601+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1558646779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040ccc40 0x7f2804155c10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.601+0000 7f280b3ff700 1 -- 172.21.15.86:0/1558646779 >> 172.21.15.86:0/1558646779 conn(0x7f280406a320 msgr2=0x7f28040cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.601+0000 7f280b3ff700 1 -- 172.21.15.86:0/1558646779 shutdown_connections 2023-10-09T12:57:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.601+0000 7f280b3ff700 1 -- 172.21.15.86:0/1558646779 wait complete. 2023-10-09T12:57:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.602+0000 7f280b3ff700 1 Processor -- start 2023-10-09T12:57:27.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.602+0000 7f280b3ff700 1 -- start start 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280b3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28040ccc40 0x7f280406e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040cd010 0x7f28040a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2804156150 0x7f28040a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280b3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040a8680 con 0x7f28040ccc40 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280406e880 con 0x7f28040cd010 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280406eb60 con 0x7f2804156150 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28040ccc40 0x7f280406e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28040ccc40 0x7f280406e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52314/0 (socket says 172.21.15.86:52314) 2023-10-09T12:57:27.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.603+0000 7f280919b700 1 -- 172.21.15.86:0/1760582668 learned_addr learned my addr 172.21.15.86:0/1760582668 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280899a700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040cd010 0x7f28040a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280919b700 1 -- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2804156150 msgr2=0x7f28040a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280999c700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2804156150 0x7f28040a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280919b700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2804156150 0x7f28040a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280919b700 1 -- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040cd010 msgr2=0x7f28040a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280919b700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040cd010 0x7f28040a8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280919b700 1 -- 172.21.15.86:0/1760582668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800009420 con 0x7f28040ccc40 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280899a700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040cd010 0x7f28040a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280999c700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2804156150 0x7f28040a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280919b700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28040ccc40 0x7f280406e250 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f2804064290 tx=0x7f2800017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f27f97fa700 1 -- 172.21.15.86:0/1760582668 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280001f070 con 0x7f28040ccc40 2023-10-09T12:57:27.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f27f97fa700 1 -- 172.21.15.86:0/1760582668 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800000c90 con 0x7f28040ccc40 2023-10-09T12:57:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f27f97fa700 1 -- 172.21.15.86:0/1760582668 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800025420 con 0x7f28040ccc40 2023-10-09T12:57:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.604+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280406ee40 con 0x7f28040ccc40 2023-10-09T12:57:27.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.605+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28040c5f90 con 0x7f28040ccc40 2023-10-09T12:57:27.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.605+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280404c3c0 con 0x7f28040ccc40 2023-10-09T12:57:27.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.606+0000 7f27f97fa700 1 -- 172.21.15.86:0/1760582668 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2800023070 con 0x7f28040ccc40 2023-10-09T12:57:27.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.607+0000 7f27f97fa700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27e8066f30 0x7f27e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:27.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.607+0000 7f27f97fa700 1 -- 172.21.15.86:0/1760582668 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f2800085b20 con 0x7f28040ccc40 2023-10-09T12:57:27.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.607+0000 7f280899a700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27e8066f30 0x7f27e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:27.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.608+0000 7f280899a700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27e8066f30 0x7f27e80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28040c8310 tx=0x7f27f4009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:27.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.611+0000 7f27f97fa700 1 -- 172.21.15.86:0/1760582668 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2800052b30 con 0x7f28040ccc40 2023-10-09T12:57:27.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.798+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28040ad5c0 con 0x7f27e8066f30 2023-10-09T12:57:27.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.806+0000 7f27f97fa700 1 -- 172.21.15.86:0/1760582668 <== mgr.8883 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284046 (secure 0 0 0) 0x7f28040ad5c0 con 0x7f27e8066f30 2023-10-09T12:57:27.809 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:27.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27e8066f30 msgr2=0x7f27e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27e8066f30 0x7f27e80693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28040c8310 tx=0x7f27f4009040 comp rx=0 tx=0).stop 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28040ccc40 msgr2=0x7f280406e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28040ccc40 0x7f280406e250 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f2804064290 tx=0x7f2800017000 comp rx=0 tx=0).stop 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 shutdown_connections 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27e8066f30 0x7f27e80693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28040ccc40 0x7f280406e250 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2804156150 0x7f28040a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 --2- 172.21.15.86:0/1760582668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28040cd010 0x7f28040a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.810+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 >> 172.21.15.86:0/1760582668 conn(0x7f280406a320 msgr2=0x7f28040ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.811+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 shutdown_connections 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:27.811+0000 7f280b3ff700 1 -- 172.21.15.86:0/1760582668 wait complete. 2023-10-09T12:57:27.812 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:57:27.828 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T12:57:26.546115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591974,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":502,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":314,"ondisk_log_size":314,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470336,"kb_used_data":18304,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504384,"statfs":{"total":773094113280,"available":770564489216,"internally_reserved":0,"allocated":18743296,"data_stored":9908596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1606,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.967906"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638747+0000","last_change":"2023-10-09T12:57:22.636031+0000","last_active":"2023-10-09T12:57:22.638747+0000","last_peered":"2023-10-09T12:57:22.638747+0000","last_clean":"2023-10-09T12:57:22.638747+0000","last_became_active":"2023-10-09T12:57:22.635750+0000","last_became_peered":"2023-10-09T12:57:22.635750+0000","last_unstale":"2023-10-09T12:57:22.638747+0000","last_undegraded":"2023-10-09T12:57:22.638747+0000","last_fullsized":"2023-10-09T12:57:22.638747+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:36.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614061+0000","last_change":"2023-10-09T12:57:22.611976+0000","last_active":"2023-10-09T12:57:22.614061+0000","last_peered":"2023-10-09T12:57:22.614061+0000","last_clean":"2023-10-09T12:57:22.614061+0000","last_became_active":"2023-10-09T12:57:22.611701+0000","last_became_peered":"2023-10-09T12:57:22.611701+0000","last_unstale":"2023-10-09T12:57:22.614061+0000","last_undegraded":"2023-10-09T12:57:22.614061+0000","last_fullsized":"2023-10-09T12:57:22.614061+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625495+0000","last_change":"2023-10-09T12:57:22.622355+0000","last_active":"2023-10-09T12:57:22.625495+0000","last_peered":"2023-10-09T12:57:22.625495+0000","last_clean":"2023-10-09T12:57:22.625495+0000","last_became_active":"2023-10-09T12:57:22.622088+0000","last_became_peered":"2023-10-09T12:57:22.622088+0000","last_unstale":"2023-10-09T12:57:22.625495+0000","last_undegraded":"2023-10-09T12:57:22.625495+0000","last_fullsized":"2023-10-09T12:57:22.625495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:11:58.040597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625337+0000","last_change":"2023-10-09T12:57:22.621443+0000","last_active":"2023-10-09T12:57:22.625337+0000","last_peered":"2023-10-09T12:57:22.625337+0000","last_clean":"2023-10-09T12:57:22.625337+0000","last_became_active":"2023-10-09T12:57:22.621180+0000","last_became_peered":"2023-10-09T12:57:22.621180+0000","last_unstale":"2023-10-09T12:57:22.625337+0000","last_undegraded":"2023-10-09T12:57:22.625337+0000","last_fullsized":"2023-10-09T12:57:22.625337+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630227+0000","last_change":"2023-10-09T12:57:22.627728+0000","last_active":"2023-10-09T12:57:22.630227+0000","last_peered":"2023-10-09T12:57:22.630227+0000","last_clean":"2023-10-09T12:57:22.630227+0000","last_became_active":"2023-10-09T12:57:22.627440+0000","last_became_peered":"2023-10-09T12:57:22.627440+0000","last_unstale":"2023-10-09T12:57:22.630227+0000","last_undegraded":"2023-10-09T12:57:22.630227+0000","last_fullsized":"2023-10-09T12:57:22.630227+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:55.583107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614035+0000","last_change":"2023-10-09T12:57:22.611974+0000","last_active":"2023-10-09T12:57:22.614035+0000","last_peered":"2023-10-09T12:57:22.614035+0000","last_clean":"2023-10-09T12:57:22.614035+0000","last_became_active":"2023-10-09T12:57:22.611699+0000","last_became_peered":"2023-10-09T12:57:22.611699+0000","last_unstale":"2023-10-09T12:57:22.614035+0000","last_undegraded":"2023-10-09T12:57:22.614035+0000","last_fullsized":"2023-10-09T12:57:22.614035+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:39.982603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627919+0000","last_change":"2023-10-09T12:57:22.624085+0000","last_active":"2023-10-09T12:57:22.627919+0000","last_peered":"2023-10-09T12:57:22.627919+0000","last_clean":"2023-10-09T12:57:22.627919+0000","last_became_active":"2023-10-09T12:57:22.623822+0000","last_became_peered":"2023-10-09T12:57:22.623822+0000","last_unstale":"2023-10-09T12:57:22.627919+0000","last_undegraded":"2023-10-09T12:57:22.627919+0000","last_fullsized":"2023-10-09T12:57:22.627919+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:26.255875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615271+0000","last_change":"2023-10-09T12:57:22.610213+0000","last_active":"2023-10-09T12:57:22.615271+0000","last_peered":"2023-10-09T12:57:22.615271+0000","last_clean":"2023-10-09T12:57:22.615271+0000","last_became_active":"2023-10-09T12:57:22.609967+0000","last_became_peered":"2023-10-09T12:57:22.609967+0000","last_unstale":"2023-10-09T12:57:22.615271+0000","last_undegraded":"2023-10-09T12:57:22.615271+0000","last_fullsized":"2023-10-09T12:57:22.615271+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:28:10.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619071+0000","last_change":"2023-10-09T12:57:22.613666+0000","last_active":"2023-10-09T12:57:22.619071+0000","last_peered":"2023-10-09T12:57:22.619071+0000","last_clean":"2023-10-09T12:57:22.619071+0000","last_became_active":"2023-10-09T12:57:22.613331+0000","last_became_peered":"2023-10-09T12:57:22.613331+0000","last_unstale":"2023-10-09T12:57:22.619071+0000","last_undegraded":"2023-10-09T12:57:22.619071+0000","last_fullsized":"2023-10-09T12:57:22.619071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:14.886124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.618816+0000","last_change":"2023-10-09T12:57:22.617496+0000","last_active":"2023-10-09T12:57:22.618816+0000","last_peered":"2023-10-09T12:57:22.618816+0000","last_clean":"2023-10-09T12:57:22.618816+0000","last_became_active":"2023-10-09T12:57:22.617196+0000","last_became_peered":"2023-10-09T12:57:22.617196+0000","last_unstale":"2023-10-09T12:57:22.618816+0000","last_undegraded":"2023-10-09T12:57:22.618816+0000","last_fullsized":"2023-10-09T12:57:22.618816+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:29.620453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.617901+0000","last_change":"2023-10-09T12:57:22.615483+0000","last_active":"2023-10-09T12:57:22.617901+0000","last_peered":"2023-10-09T12:57:22.617901+0000","last_clean":"2023-10-09T12:57:22.617901+0000","last_became_active":"2023-10-09T12:57:22.615223+0000","last_became_peered":"2023-10-09T12:57:22.615223+0000","last_unstale":"2023-10-09T12:57:22.617901+0000","last_undegraded":"2023-10-09T12:57:22.617901+0000","last_fullsized":"2023-10-09T12:57:22.617901+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:05.692178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619083+0000","last_change":"2023-10-09T12:57:22.613737+0000","last_active":"2023-10-09T12:57:22.619083+0000","last_peered":"2023-10-09T12:57:22.619083+0000","last_clean":"2023-10-09T12:57:22.619083+0000","last_became_active":"2023-10-09T12:57:22.613227+0000","last_became_peered":"2023-10-09T12:57:22.613227+0000","last_unstale":"2023-10-09T12:57:22.619083+0000","last_undegraded":"2023-10-09T12:57:22.619083+0000","last_fullsized":"2023-10-09T12:57:22.619083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:51.856277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630735+0000","last_change":"2023-10-09T12:57:22.626583+0000","last_active":"2023-10-09T12:57:22.630735+0000","last_peered":"2023-10-09T12:57:22.630735+0000","last_clean":"2023-10-09T12:57:22.630735+0000","last_became_active":"2023-10-09T12:57:22.626327+0000","last_became_peered":"2023-10-09T12:57:22.626327+0000","last_unstale":"2023-10-09T12:57:22.630735+0000","last_undegraded":"2023-10-09T12:57:22.630735+0000","last_fullsized":"2023-10-09T12:57:22.630735+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:20.275237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627649+0000","last_change":"2023-10-09T12:57:22.624916+0000","last_active":"2023-10-09T12:57:22.627649+0000","last_peered":"2023-10-09T12:57:22.627649+0000","last_clean":"2023-10-09T12:57:22.627649+0000","last_became_active":"2023-10-09T12:57:22.624661+0000","last_became_peered":"2023-10-09T12:57:22.624661+0000","last_unstale":"2023-10-09T12:57:22.627649+0000","last_undegraded":"2023-10-09T12:57:22.627649+0000","last_fullsized":"2023-10-09T12:57:22.627649+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625458+0000","last_change":"2023-10-09T12:57:22.622049+0000","last_active":"2023-10-09T12:57:22.625458+0000","last_peered":"2023-10-09T12:57:22.625458+0000","last_clean":"2023-10-09T12:57:22.625458+0000","last_became_active":"2023-10-09T12:57:22.621769+0000","last_became_peered":"2023-10-09T12:57:22.621769+0000","last_unstale":"2023-10-09T12:57:22.625458+0000","last_undegraded":"2023-10-09T12:57:22.625458+0000","last_fullsized":"2023-10-09T12:57:22.625458+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:50.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630955+0000","last_change":"2023-10-09T12:57:22.627678+0000","last_active":"2023-10-09T12:57:22.630955+0000","last_peered":"2023-10-09T12:57:22.630955+0000","last_clean":"2023-10-09T12:57:22.630955+0000","last_became_active":"2023-10-09T12:57:22.627139+0000","last_became_peered":"2023-10-09T12:57:22.627139+0000","last_unstale":"2023-10-09T12:57:22.630955+0000","last_undegraded":"2023-10-09T12:57:22.630955+0000","last_fullsized":"2023-10-09T12:57:22.630955+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:58.263529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628975+0000","last_change":"2023-10-09T12:57:22.624700+0000","last_active":"2023-10-09T12:57:22.628975+0000","last_peered":"2023-10-09T12:57:22.628975+0000","last_clean":"2023-10-09T12:57:22.628975+0000","last_became_active":"2023-10-09T12:57:22.624369+0000","last_became_peered":"2023-10-09T12:57:22.624369+0000","last_unstale":"2023-10-09T12:57:22.628975+0000","last_undegraded":"2023-10-09T12:57:22.628975+0000","last_fullsized":"2023-10-09T12:57:22.628975+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:15.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585504+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:43.822255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614017+0000","last_change":"2023-10-09T12:57:22.611789+0000","last_active":"2023-10-09T12:57:22.614017+0000","last_peered":"2023-10-09T12:57:22.614017+0000","last_clean":"2023-10-09T12:57:22.614017+0000","last_became_active":"2023-10-09T12:57:22.611456+0000","last_became_peered":"2023-10-09T12:57:22.611456+0000","last_unstale":"2023-10-09T12:57:22.614017+0000","last_undegraded":"2023-10-09T12:57:22.614017+0000","last_fullsized":"2023-10-09T12:57:22.614017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:35.215673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635479+0000","last_change":"2023-10-09T12:57:21.609699+0000","last_active":"2023-10-09T12:57:22.635479+0000","last_peered":"2023-10-09T12:57:22.635479+0000","last_clean":"2023-10-09T12:57:22.635479+0000","last_became_active":"2023-10-09T12:57:21.609416+0000","last_became_peered":"2023-10-09T12:57:21.609416+0000","last_unstale":"2023-10-09T12:57:22.635479+0000","last_undegraded":"2023-10-09T12:57:22.635479+0000","last_fullsized":"2023-10-09T12:57:22.635479+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:28.632953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619875+0000","last_change":"2023-10-09T12:57:22.617329+0000","last_active":"2023-10-09T12:57:22.619875+0000","last_peered":"2023-10-09T12:57:22.619875+0000","last_clean":"2023-10-09T12:57:22.619875+0000","last_became_active":"2023-10-09T12:57:22.615838+0000","last_became_peered":"2023-10-09T12:57:22.615838+0000","last_unstale":"2023-10-09T12:57:22.619875+0000","last_undegraded":"2023-10-09T12:57:22.619875+0000","last_fullsized":"2023-10-09T12:57:22.619875+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:11.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584709+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583077+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630886+0000","last_change":"2023-10-09T12:57:22.627451+0000","last_active":"2023-10-09T12:57:22.630886+0000","last_peered":"2023-10-09T12:57:22.630886+0000","last_clean":"2023-10-09T12:57:22.630886+0000","last_became_active":"2023-10-09T12:57:22.627150+0000","last_became_peered":"2023-10-09T12:57:22.627150+0000","last_unstale":"2023-10-09T12:57:22.630886+0000","last_undegraded":"2023-10-09T12:57:22.630886+0000","last_fullsized":"2023-10-09T12:57:22.630886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:40.741655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637597+0000","last_change":"2023-10-09T12:57:21.601324+0000","last_active":"2023-10-09T12:57:22.637597+0000","last_peered":"2023-10-09T12:57:22.637597+0000","last_clean":"2023-10-09T12:57:22.637597+0000","last_became_active":"2023-10-09T12:57:21.601065+0000","last_became_peered":"2023-10-09T12:57:21.601065+0000","last_unstale":"2023-10-09T12:57:22.637597+0000","last_undegraded":"2023-10-09T12:57:22.637597+0000","last_fullsized":"2023-10-09T12:57:22.637597+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:29.021722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583077+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633755+0000","last_change":"2023-10-09T12:57:22.629636+0000","last_active":"2023-10-09T12:57:22.633755+0000","last_peered":"2023-10-09T12:57:22.633755+0000","last_clean":"2023-10-09T12:57:22.633755+0000","last_became_active":"2023-10-09T12:57:22.629297+0000","last_became_peered":"2023-10-09T12:57:22.629297+0000","last_unstale":"2023-10-09T12:57:22.633755+0000","last_undegraded":"2023-10-09T12:57:22.633755+0000","last_fullsized":"2023-10-09T12:57:22.633755+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.605892+0000","last_change":"2023-10-09T12:57:21.597160+0000","last_active":"2023-10-09T12:57:22.605892+0000","last_peered":"2023-10-09T12:57:22.605892+0000","last_clean":"2023-10-09T12:57:22.605892+0000","last_became_active":"2023-10-09T12:57:21.596858+0000","last_became_peered":"2023-10-09T12:57:21.596858+0000","last_unstale":"2023-10-09T12:57:22.605892+0000","last_undegraded":"2023-10-09T12:57:22.605892+0000","last_fullsized":"2023-10-09T12:57:22.605892+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:39.389828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583139+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604011+0000","last_change":"2023-10-09T12:57:21.603114+0000","last_active":"2023-10-09T12:57:22.604011+0000","last_peered":"2023-10-09T12:57:22.604011+0000","last_clean":"2023-10-09T12:57:22.604011+0000","last_became_active":"2023-10-09T12:57:21.602848+0000","last_became_peered":"2023-10-09T12:57:21.602848+0000","last_unstale":"2023-10-09T12:57:22.604011+0000","last_undegraded":"2023-10-09T12:57:22.604011+0000","last_fullsized":"2023-10-09T12:57:22.604011+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:47.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585927+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:08.548490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615217+0000","last_change":"2023-10-09T12:57:22.612914+0000","last_active":"2023-10-09T12:57:22.615217+0000","last_peered":"2023-10-09T12:57:22.615217+0000","last_clean":"2023-10-09T12:57:22.615217+0000","last_became_active":"2023-10-09T12:57:22.612654+0000","last_became_peered":"2023-10-09T12:57:22.612654+0000","last_unstale":"2023-10-09T12:57:22.615217+0000","last_undegraded":"2023-10-09T12:57:22.615217+0000","last_fullsized":"2023-10-09T12:57:22.615217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:28.372635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"177'6","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.642564+0000","last_change":"2023-10-09T12:57:21.594239+0000","last_active":"2023-10-09T12:57:22.642564+0000","last_peered":"2023-10-09T12:57:22.642564+0000","last_clean":"2023-10-09T12:57:22.642564+0000","last_became_active":"2023-10-09T12:57:21.593748+0000","last_became_peered":"2023-10-09T12:57:21.593748+0000","last_unstale":"2023-10-09T12:57:22.642564+0000","last_undegraded":"2023-10-09T12:57:22.642564+0000","last_fullsized":"2023-10-09T12:57:22.642564+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:09.926296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585363+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:45.912841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.613966+0000","last_change":"2023-10-09T12:57:22.611664+0000","last_active":"2023-10-09T12:57:22.613966+0000","last_peered":"2023-10-09T12:57:22.613966+0000","last_clean":"2023-10-09T12:57:22.613966+0000","last_became_active":"2023-10-09T12:57:22.611336+0000","last_became_peered":"2023-10-09T12:57:22.611336+0000","last_unstale":"2023-10-09T12:57:22.613966+0000","last_undegraded":"2023-10-09T12:57:22.613966+0000","last_fullsized":"2023-10-09T12:57:22.613966+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:27.112437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586602+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.600525+0000","last_change":"2023-10-09T12:57:21.597869+0000","last_active":"2023-10-09T12:57:22.600525+0000","last_peered":"2023-10-09T12:57:22.600525+0000","last_clean":"2023-10-09T12:57:22.600525+0000","last_became_active":"2023-10-09T12:57:21.597615+0000","last_became_peered":"2023-10-09T12:57:21.597615+0000","last_unstale":"2023-10-09T12:57:22.600525+0000","last_undegraded":"2023-10-09T12:57:22.600525+0000","last_fullsized":"2023-10-09T12:57:22.600525+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"177'8","reported_seq":18,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635696+0000","last_change":"2023-10-09T12:57:21.597629+0000","last_active":"2023-10-09T12:57:22.635696+0000","last_peered":"2023-10-09T12:57:22.635696+0000","last_clean":"2023-10-09T12:57:22.635696+0000","last_became_active":"2023-10-09T12:57:21.597355+0000","last_became_peered":"2023-10-09T12:57:21.597355+0000","last_unstale":"2023-10-09T12:57:22.635696+0000","last_undegraded":"2023-10-09T12:57:22.635696+0000","last_fullsized":"2023-10-09T12:57:22.635696+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:23.097372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.583227+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.636307+0000","last_change":"2023-10-09T12:57:22.632816+0000","last_active":"2023-10-09T12:57:22.636307+0000","last_peered":"2023-10-09T12:57:22.636307+0000","last_clean":"2023-10-09T12:57:22.636307+0000","last_became_active":"2023-10-09T12:57:22.632525+0000","last_became_peered":"2023-10-09T12:57:22.632525+0000","last_unstale":"2023-10-09T12:57:22.636307+0000","last_undegraded":"2023-10-09T12:57:22.636307+0000","last_fullsized":"2023-10-09T12:57:22.636307+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:31.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628132+0000","last_change":"2023-10-09T12:57:21.606002+0000","last_active":"2023-10-09T12:57:22.628132+0000","last_peered":"2023-10-09T12:57:22.628132+0000","last_clean":"2023-10-09T12:57:22.628132+0000","last_became_active":"2023-10-09T12:57:21.605728+0000","last_became_peered":"2023-10-09T12:57:21.605728+0000","last_unstale":"2023-10-09T12:57:22.628132+0000","last_undegraded":"2023-10-09T12:57:22.628132+0000","last_fullsized":"2023-10-09T12:57:22.628132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.996883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637660+0000","last_change":"2023-10-09T12:57:21.599422+0000","last_active":"2023-10-09T12:57:22.637660+0000","last_peered":"2023-10-09T12:57:22.637660+0000","last_clean":"2023-10-09T12:57:22.637660+0000","last_became_active":"2023-10-09T12:57:21.599151+0000","last_became_peered":"2023-10-09T12:57:21.599151+0000","last_unstale":"2023-10-09T12:57:22.637660+0000","last_undegraded":"2023-10-09T12:57:22.637660+0000","last_fullsized":"2023-10-09T12:57:22.637660+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:45.965489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625242+0000","last_change":"2023-10-09T12:57:22.622000+0000","last_active":"2023-10-09T12:57:22.625242+0000","last_peered":"2023-10-09T12:57:22.625242+0000","last_clean":"2023-10-09T12:57:22.625242+0000","last_became_active":"2023-10-09T12:57:22.621737+0000","last_became_peered":"2023-10-09T12:57:22.621737+0000","last_unstale":"2023-10-09T12:57:22.625242+0000","last_undegraded":"2023-10-09T12:57:22.625242+0000","last_fullsized":"2023-10-09T12:57:22.625242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:43.225188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604091+0000","last_change":"2023-10-09T12:57:21.605816+0000","last_active":"2023-10-09T12:57:22.604091+0000","last_peered":"2023-10-09T12:57:22.604091+0000","last_clean":"2023-10-09T12:57:22.604091+0000","last_became_active":"2023-10-09T12:57:21.605528+0000","last_became_peered":"2023-10-09T12:57:21.605528+0000","last_unstale":"2023-10-09T12:57:22.604091+0000","last_undegraded":"2023-10-09T12:57:22.604091+0000","last_fullsized":"2023-10-09T12:57:22.604091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:17.071923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633437+0000","last_change":"2023-10-09T12:57:21.599237+0000","last_active":"2023-10-09T12:57:22.633437+0000","last_peered":"2023-10-09T12:57:22.633437+0000","last_clean":"2023-10-09T12:57:22.633437+0000","last_became_active":"2023-10-09T12:57:21.598939+0000","last_became_peered":"2023-10-09T12:57:21.598939+0000","last_unstale":"2023-10-09T12:57:22.633437+0000","last_undegraded":"2023-10-09T12:57:22.633437+0000","last_fullsized":"2023-10-09T12:57:22.633437+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:26.106984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616131+0000","last_change":"2023-10-09T12:57:22.615086+0000","last_active":"2023-10-09T12:57:22.616131+0000","last_peered":"2023-10-09T12:57:22.616131+0000","last_clean":"2023-10-09T12:57:22.616131+0000","last_became_active":"2023-10-09T12:57:22.614828+0000","last_became_peered":"2023-10-09T12:57:22.614828+0000","last_unstale":"2023-10-09T12:57:22.616131+0000","last_undegraded":"2023-10-09T12:57:22.616131+0000","last_fullsized":"2023-10-09T12:57:22.616131+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:46.019043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585115+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:24.386174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584417+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:19.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616086+0000","last_change":"2023-10-09T12:57:22.615055+0000","last_active":"2023-10-09T12:57:22.616086+0000","last_peered":"2023-10-09T12:57:22.616086+0000","last_clean":"2023-10-09T12:57:22.616086+0000","last_became_active":"2023-10-09T12:57:22.614806+0000","last_became_peered":"2023-10-09T12:57:22.614806+0000","last_unstale":"2023-10-09T12:57:22.616086+0000","last_undegraded":"2023-10-09T12:57:22.616086+0000","last_fullsized":"2023-10-09T12:57:22.616086+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.585821+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584933+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:32.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601006+0000","last_change":"2023-10-09T12:57:21.604265+0000","last_active":"2023-10-09T12:57:22.601006+0000","last_peered":"2023-10-09T12:57:22.601006+0000","last_clean":"2023-10-09T12:57:22.601006+0000","last_became_active":"2023-10-09T12:57:21.603970+0000","last_became_peered":"2023-10-09T12:57:21.603970+0000","last_unstale":"2023-10-09T12:57:22.601006+0000","last_undegraded":"2023-10-09T12:57:22.601006+0000","last_fullsized":"2023-10-09T12:57:22.601006+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:04.329182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614593+0000","last_change":"2023-10-09T12:57:22.611673+0000","last_active":"2023-10-09T12:57:22.614593+0000","last_peered":"2023-10-09T12:57:22.614593+0000","last_clean":"2023-10-09T12:57:22.614593+0000","last_became_active":"2023-10-09T12:57:22.611426+0000","last_became_peered":"2023-10-09T12:57:22.611426+0000","last_unstale":"2023-10-09T12:57:22.614593+0000","last_undegraded":"2023-10-09T12:57:22.614593+0000","last_fullsized":"2023-10-09T12:57:22.614593+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:03:40.616620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.602023+0000","last_change":"2023-10-09T12:57:21.595696+0000","last_active":"2023-10-09T12:57:22.602023+0000","last_peered":"2023-10-09T12:57:22.602023+0000","last_clean":"2023-10-09T12:57:22.602023+0000","last_became_active":"2023-10-09T12:57:21.595435+0000","last_became_peered":"2023-10-09T12:57:21.595435+0000","last_unstale":"2023-10-09T12:57:22.602023+0000","last_undegraded":"2023-10-09T12:57:22.602023+0000","last_fullsized":"2023-10-09T12:57:22.602023+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:30.351371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619850+0000","last_change":"2023-10-09T12:57:22.617179+0000","last_active":"2023-10-09T12:57:22.619850+0000","last_peered":"2023-10-09T12:57:22.619850+0000","last_clean":"2023-10-09T12:57:22.619850+0000","last_became_active":"2023-10-09T12:57:22.616900+0000","last_became_peered":"2023-10-09T12:57:22.616900+0000","last_unstale":"2023-10-09T12:57:22.619850+0000","last_undegraded":"2023-10-09T12:57:22.619850+0000","last_fullsized":"2023-10-09T12:57:22.619850+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:44.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601003+0000","last_change":"2023-10-09T12:57:21.596493+0000","last_active":"2023-10-09T12:57:22.601003+0000","last_peered":"2023-10-09T12:57:22.601003+0000","last_clean":"2023-10-09T12:57:22.601003+0000","last_became_active":"2023-10-09T12:57:21.596245+0000","last_became_peered":"2023-10-09T12:57:21.596245+0000","last_unstale":"2023-10-09T12:57:22.601003+0000","last_undegraded":"2023-10-09T12:57:22.601003+0000","last_fullsized":"2023-10-09T12:57:22.601003+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619423+0000","last_change":"2023-10-09T12:57:22.618476+0000","last_active":"2023-10-09T12:57:22.619423+0000","last_peered":"2023-10-09T12:57:22.619423+0000","last_clean":"2023-10-09T12:57:22.619423+0000","last_became_active":"2023-10-09T12:57:22.618207+0000","last_became_peered":"2023-10-09T12:57:22.618207+0000","last_unstale":"2023-10-09T12:57:22.619423+0000","last_undegraded":"2023-10-09T12:57:22.619423+0000","last_fullsized":"2023-10-09T12:57:22.619423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:00.884319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606622+0000","last_change":"2023-10-09T12:57:21.600975+0000","last_active":"2023-10-09T12:57:22.606622+0000","last_peered":"2023-10-09T12:57:22.606622+0000","last_clean":"2023-10-09T12:57:22.606622+0000","last_became_active":"2023-10-09T12:57:21.600264+0000","last_became_peered":"2023-10-09T12:57:21.600264+0000","last_unstale":"2023-10-09T12:57:22.606622+0000","last_undegraded":"2023-10-09T12:57:22.606622+0000","last_fullsized":"2023-10-09T12:57:22.606622+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:12.067958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.584501+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:14.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586617+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:47.959787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T12:57:21.577164+0000","last_change":"2023-10-09T12:57:21.577164+0000","last_active":"2023-10-09T12:57:21.577164+0000","last_peered":"2023-10-09T12:57:21.577164+0000","last_clean":"2023-10-09T12:57:21.577164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:21.577164+0000","last_undegraded":"2023-10-09T12:57:21.577164+0000","last_fullsized":"2023-10-09T12:57:21.577164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.603409+0000","last_change":"2023-10-09T12:57:21.609638+0000","last_active":"2023-10-09T12:57:22.603409+0000","last_peered":"2023-10-09T12:57:22.603409+0000","last_clean":"2023-10-09T12:57:22.603409+0000","last_became_active":"2023-10-09T12:57:21.609342+0000","last_became_peered":"2023-10-09T12:57:21.609342+0000","last_unstale":"2023-10-09T12:57:22.603409+0000","last_undegraded":"2023-10-09T12:57:22.603409+0000","last_fullsized":"2023-10-09T12:57:22.603409+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:47.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616422+0000","last_change":"2023-10-09T12:57:22.613537+0000","last_active":"2023-10-09T12:57:22.616422+0000","last_peered":"2023-10-09T12:57:22.616422+0000","last_clean":"2023-10-09T12:57:22.616422+0000","last_became_active":"2023-10-09T12:57:22.613287+0000","last_became_peered":"2023-10-09T12:57:22.613287+0000","last_unstale":"2023-10-09T12:57:22.616422+0000","last_undegraded":"2023-10-09T12:57:22.616422+0000","last_fullsized":"2023-10-09T12:57:22.616422+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:38.765063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T12:57:20.571710+0000","last_change":"2023-10-09T12:57:20.586117+0000","last_active":"2023-10-09T12:57:20.571710+0000","last_peered":"2023-10-09T12:57:20.571710+0000","last_clean":"2023-10-09T12:57:20.571710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T12:57:20.571710+0000","last_undegraded":"2023-10-09T12:57:20.571710+0000","last_fullsized":"2023-10-09T12:57:20.571710+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"167'293","reported_seq":916,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-09T12:57:19.410936+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:57:19.410936+0000","last_peered":"2023-10-09T12:57:19.410936+0000","last_clean":"2023-10-09T12:57:19.410936+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:57:19.410936+0000","last_undegraded":"2023-10-09T12:57:19.410936+0000","last_fullsized":"2023-10-09T12:57:19.410936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":62,"acting":62,"num_store_stats":4},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1606,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477641,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308180,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063660,"statfs":{"total":96636764160,"available":96321187840,"internally_reserved":0,"allocated":2764800,"data_stored":1670544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.61499999999999999,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.0720000000000001,"5min":1.204,"15min":1.204},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.6060000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.93100000000000005,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.206},"last":0.82699999999999996}]},{"osd":4,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.90900000000000003,"15min":1.645},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41099999999999998},"max":{"1min":0.84299999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.99099999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.754,"5min":0.999,"15min":1.0720000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.48999999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.86599999999999999,"5min":1.032,"15min":1.5549999999999999},"last":0.754}]},{"osd":6,"last update":"Mon Oct 9 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.46200000000000002},"max":{"1min":0.96499999999999997,"5min":1.179,"15min":1.8100000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":1.008,"15min":1.2090000000000001},"last":1.036}]}]},{"osd":6,"up_from":16,"seq":68719477642,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.85299999999999998}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.77400000000000002}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.876}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":1.0609999999999999}]}]},{"osd":1,"up_from":15,"seq":64424510347,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307640,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064200,"statfs":{"total":96636764160,"available":96321740800,"internally_reserved":0,"allocated":2211840,"data_stored":1101388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.879}]}]},{"osd":0,"up_from":14,"seq":60129543050,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308232,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063608,"statfs":{"total":96636764160,"available":96321134592,"internally_reserved":0,"allocated":2818048,"data_stored":1692772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.628,"5min":1.008,"15min":1.008},"last":0.308},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.83199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95899999999999996,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97399999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.79800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":1.105,"15min":1.1639999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.1990000000000001},"last":0.747}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.004,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.208,"15min":1.208},"last":0.59299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311748,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060092,"statfs":{"total":96636764160,"available":96317534208,"internally_reserved":0,"allocated":2224128,"data_stored":1102440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73499999999999999,"5min":0.753,"15min":0.89400000000000002},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":1.038},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78200000000000003,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46999999999999997},"max":{"1min":1.139,"5min":1.194,"15min":1.1990000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.254},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2270000000000001,"5min":1.357,"15min":1.357},"last":0.69199999999999995}]},{"osd":7,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.373},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.66700000000000004}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1100924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.66800000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.317},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.88100000000000001,"15min":0.97199999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69299999999999995,"5min":0.876,"15min":0.876},"last":0.502},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.374},"max":{"1min":0.65400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.83199999999999996,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.083,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.121,"5min":1.321,"15min":1.321},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0129999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.623},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.96299999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"max":{"1min":1.002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76400000000000001}]}]},{"osd":4,"up_from":16,"seq":68719477641,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072432,"statfs":{"total":96636764160,"available":96330170368,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52100000000000002},"max":{"1min":0.94499999999999995,"5min":1.052,"15min":1.052},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.753,"15min":0.748},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.999,"15min":1.006},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.0469999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96199999999999997,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.61499999999999999,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":1.0369999999999999},"last":0.752},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.59499999999999997,"5min":0.56899999999999995,"15min":0.51500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.0880000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.93700000000000006,"15min":1.071},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0960000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":0.96199999999999997,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93799999999999994,"15min":1.204},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.55300000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89300000000000002,"5min":1.022,"15min":1.169},"last":0.81699999999999995}]}]},{"osd":5,"up_from":16,"seq":68719477641,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311696,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060144,"statfs":{"total":96636764160,"available":96317587456,"internally_reserved":0,"allocated":2170880,"data_stored":1080176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.95999999999999996}]},{"osd":1,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.44800000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.01},"last":0.97199999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.55000000000000004,"5min":0.496,"15min":0.48799999999999999},"max":{"1min":0.92700000000000005,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.077},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55000000000000004},"max":{"1min":0.96399999999999997,"5min":1.121,"15min":1.121},"last":1.0009999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0109999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.05},"last":0.873}]},{"osd":7,"last update":"Mon Oct 9 12:56:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.95199999999999996,"5min":1.083,"15min":1.083},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":1.069,"15min":1.069},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:57:27.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-10-09T12:57:27.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-10-09T12:57:27.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-10-09T12:57:27.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-10-09T12:57:27.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.585504+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:11:43.822255+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.584709+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.583077+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-10-09T12:57:27.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.583077+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.583139+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.585927+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:19:08.548490+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.585363+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:39:45.912841+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.586602+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:47:23.670504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.583227+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-10-09T12:57:27.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.585115+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:49:24.386174+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.584417+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:23:19.707482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.585821+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:16:33.139158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-10-09T12:57:27.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.584933+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:04:32.085056+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.584501+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:55:14.955552+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-10-09T12:57:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.586617+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:07:47.959787+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T12:57:27.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-10-09T12:57:27.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T12:57:21.577164+0000', 'last_change': '2023-10-09T12:57:21.577164+0000', 'last_active': '2023-10-09T12:57:21.577164+0000', 'last_peered': '2023-10-09T12:57:21.577164+0000', 'last_clean': '2023-10-09T12:57:21.577164+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:21.577164+0000', 'last_undegraded': '2023-10-09T12:57:21.577164+0000', 'last_fullsized': '2023-10-09T12:57:21.577164+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:21.577164+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T12:57:27.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-10-09T12:57:27.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T12:57:20.571710+0000', 'last_change': '2023-10-09T12:57:20.586117+0000', 'last_active': '2023-10-09T12:57:20.571710+0000', 'last_peered': '2023-10-09T12:57:20.571710+0000', 'last_clean': '2023-10-09T12:57:20.571710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T12:57:20.571710+0000', 'last_undegraded': '2023-10-09T12:57:20.571710+0000', 'last_fullsized': '2023-10-09T12:57:20.571710+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'last_clean_scrub_stamp': '2023-10-09T12:57:20.571710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:29:40.155749+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T12:57:27.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T12:57:28.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.048+0000 7fe287fff700 1 Processor -- start 2023-10-09T12:57:28.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.048+0000 7fe287fff700 1 -- start start 2023-10-09T12:57:28.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.049+0000 7fe287fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2800cacb0 0x7fe2800afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.049+0000 7fe287fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2800c9810 con 0x7fe280156770 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.049+0000 7fe287fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2800adf80 con 0x7fe2800b12e0 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.049+0000 7fe287fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2800c9680 con 0x7fe2800cacb0 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe28659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2800cacb0 0x7fe2800afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe28659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2800cacb0 0x7fe2800afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52324/0 (socket says 172.21.15.86:52324) 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe28659c700 1 -- 172.21.15.86:0/3560662897 learned_addr learned my addr 172.21.15.86:0/3560662897 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe28659c700 1 -- 172.21.15.86:0/3560662897 >> v1:172.21.15.135:6789/0 conn(0x7fe2800b12e0 legacy=0x7fe2800af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe28659c700 1 -- 172.21.15.86:0/3560662897 >> v1:172.21.15.86:6789/0 conn(0x7fe280156770 legacy=0x7fe2800b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe28659c700 1 -- 172.21.15.86:0/3560662897 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800ae260 con 0x7fe2800cacb0 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe284d99700 1 -- 172.21.15.86:0/3560662897 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924901285 0 0) 0x7fe2800c9810 con 0x7fe280156770 2023-10-09T12:57:28.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.050+0000 7fe28659c700 1 --2- 172.21.15.86:0/3560662897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800afa00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe278009f20 tx=0x7fe278009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0220eec37a3fb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:28.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe284d99700 1 -- 172.21.15.86:0/3560662897 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800e070 con 0x7fe2800cacb0 2023-10-09T12:57:28.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe284d99700 1 -- 172.21.15.86:0/3560662897 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800ba80 con 0x7fe2800cacb0 2023-10-09T12:57:28.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe284d99700 1 -- 172.21.15.86:0/3560662897 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2780092e0 con 0x7fe2800cacb0 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe287fff700 1 -- 172.21.15.86:0/3560662897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 msgr2=0x7fe2800afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe287fff700 1 --2- 172.21.15.86:0/3560662897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800afa00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe278009f20 tx=0x7fe278009840 comp rx=0 tx=0).stop 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe287fff700 1 -- 172.21.15.86:0/3560662897 shutdown_connections 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe287fff700 1 --2- 172.21.15.86:0/3560662897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800afa00 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe287fff700 1 -- 172.21.15.86:0/3560662897 >> 172.21.15.86:0/3560662897 conn(0x7fe28006a310 msgr2=0x7fe2800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe287fff700 1 -- 172.21.15.86:0/3560662897 shutdown_connections 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.051+0000 7fe287fff700 1 -- 172.21.15.86:0/3560662897 wait complete. 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.053+0000 7fe287fff700 1 Processor -- start 2023-10-09T12:57:28.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.053+0000 7fe287fff700 1 -- start start 2023-10-09T12:57:28.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe287fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2800b12e0 0x7fe28014a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe287fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe287fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe280156770 0x7fe28016b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe287fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28016bf00 con 0x7fe2800cacb0 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe287fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800c2450 con 0x7fe2800b12e0 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe287fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800aaed0 con 0x7fe280156770 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52340/0 (socket says 172.21.15.86:52340) 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 -- 172.21.15.86:0/486078961 learned_addr learned my addr 172.21.15.86:0/486078961 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28659c700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe280156770 0x7fe28016b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe285d9b700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2800b12e0 0x7fe28014a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 -- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe280156770 msgr2=0x7fe28016b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe280156770 0x7fe28016b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 -- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2800b12e0 msgr2=0x7fe28014a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2800b12e0 0x7fe28014a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe28559a700 1 -- 172.21.15.86:0/486078961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009ae0 con 0x7fe2800cacb0 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.054+0000 7fe285d9b700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2800b12e0 0x7fe28014a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.055+0000 7fe28559a700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800aa990 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe27000c7f0 tx=0x7fe270007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.055+0000 7fe275ffb700 1 -- 172.21.15.86:0/486078961 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011590 con 0x7fe2800cacb0 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.055+0000 7fe275ffb700 1 -- 172.21.15.86:0/486078961 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270011710 con 0x7fe2800cacb0 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.055+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2800c1840 con 0x7fe2800cacb0 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.055+0000 7fe275ffb700 1 -- 172.21.15.86:0/486078961 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011ad0 con 0x7fe2800cacb0 2023-10-09T12:57:28.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.055+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2800c1e00 con 0x7fe2800cacb0 2023-10-09T12:57:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.056+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2800c25e0 con 0x7fe2800cacb0 2023-10-09T12:57:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.057+0000 7fe275ffb700 1 -- 172.21.15.86:0/486078961 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe27001b3b0 con 0x7fe2800cacb0 2023-10-09T12:57:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.058+0000 7fe275ffb700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe264066f30 0x7fe2640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.058+0000 7fe275ffb700 1 -- 172.21.15.86:0/486078961 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fe270083c50 con 0x7fe2800cacb0 2023-10-09T12:57:28.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.058+0000 7fe285d9b700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe264066f30 0x7fe2640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.059+0000 7fe285d9b700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe264066f30 0x7fe2640693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe27c007fd0 tx=0x7fe27c009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:28.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.062+0000 7fe275ffb700 1 -- 172.21.15.86:0/486078961 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe270050c60 con 0x7fe2800cacb0 2023-10-09T12:57:28.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.325+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe28004c3c0 con 0x7fe2800cacb0 2023-10-09T12:57:28.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.325+0000 7fe275ffb700 1 -- 172.21.15.86:0/486078961 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1181 (secure 0 0 0) 0x7fe270017020 con 0x7fe2800cacb0 2023-10-09T12:57:28.326 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:28.326 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4601,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":178,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":48},{"state_name":"unknown","count":33},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":591974,"bytes_used":2529624064,"bytes_avail":770564489216,"bytes_total":773094113280,"unknown_pgs_ratio":0.34020617604255676,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":686,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":78,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":9081}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-09T12:46:46.297146+0000","services":{}},"progress_events":{}} 2023-10-09T12:57:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe264066f30 msgr2=0x7fe2640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe264066f30 0x7fe2640693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe27c007fd0 tx=0x7fe27c009040 comp rx=0 tx=0).stop 2023-10-09T12:57:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 msgr2=0x7fe2800aa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800aa990 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe27000c7f0 tx=0x7fe270007f50 comp rx=0 tx=0).stop 2023-10-09T12:57:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 shutdown_connections 2023-10-09T12:57:28.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe280156770 0x7fe28016b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2800b12e0 0x7fe28014a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe264066f30 0x7fe2640693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 --2- 172.21.15.86:0/486078961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2800cacb0 0x7fe2800aa990 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 >> 172.21.15.86:0/486078961 conn(0x7fe28006a310 msgr2=0x7fe2800b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:28.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 shutdown_connections 2023-10-09T12:57:28.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.328+0000 7fe287fff700 1 -- 172.21.15.86:0/486078961 wait complete. 2023-10-09T12:57:28.345 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T12:57:28.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:57:28.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.527+0000 7fc14adff700 1 Processor -- start 2023-10-09T12:57:28.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.527+0000 7fc14adff700 1 -- start start 2023-10-09T12:57:28.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.528+0000 7fc14adff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1440b1420 0x7fc1440ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.528+0000 7fc14adff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440cc300 con 0x7fc1440ccf90 2023-10-09T12:57:28.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.528+0000 7fc14adff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440ad370 con 0x7fc1440cbf30 2023-10-09T12:57:28.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.528+0000 7fc14adff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc144156bf0 con 0x7fc1440b1420 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc14939c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc1440ccf90 0x7fc1440c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47146/0 (socket says 172.21.15.86:47146) 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc14939c700 1 -- 172.21.15.86:0/2139280485 learned_addr learned my addr 172.21.15.86:0/2139280485 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc143fff700 1 --2- 172.21.15.86:0/2139280485 >> v2:172.21.15.135:3300/0 conn(0x7fc1440b1420 0x7fc1440ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc1437fe700 1 -- 172.21.15.86:0/2139280485 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206821131 0 0) 0x7fc1440cc300 con 0x7fc1440ccf90 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc1437fe700 1 -- 172.21.15.86:0/2139280485 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc134003570 con 0x7fc1440ccf90 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc143fff700 1 -- 172.21.15.86:0/2139280485 >> v1:172.21.15.135:6789/0 conn(0x7fc1440cbf30 legacy=0x7fc1440b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc143fff700 1 -- 172.21.15.86:0/2139280485 >> v1:172.21.15.86:6789/0 conn(0x7fc1440ccf90 legacy=0x7fc1440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc1437fe700 1 -- 172.21.15.86:0/2139280485 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684827541 0 0) 0x7fc134003570 con 0x7fc1440ccf90 2023-10-09T12:57:28.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.529+0000 7fc143fff700 1 -- 172.21.15.86:0/2139280485 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1440ad650 con 0x7fc1440b1420 2023-10-09T12:57:28.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.530+0000 7fc143fff700 1 --2- 172.21.15.86:0/2139280485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440b1420 0x7fc1440ae410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098e0 tx=0x7fc1300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5516735a1585c3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:28.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.530+0000 7fc1437fe700 1 -- 172.21.15.86:0/2139280485 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000b640 con 0x7fc1440b1420 2023-10-09T12:57:28.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.530+0000 7fc1437fe700 1 -- 172.21.15.86:0/2139280485 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13000b7a0 con 0x7fc1440b1420 2023-10-09T12:57:28.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.530+0000 7fc1437fe700 1 -- 172.21.15.86:0/2139280485 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000bb40 con 0x7fc1440b1420 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.530+0000 7fc14adff700 1 -- 172.21.15.86:0/2139280485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440b1420 msgr2=0x7fc1440ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.530+0000 7fc14adff700 1 --2- 172.21.15.86:0/2139280485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440b1420 0x7fc1440ae410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098e0 tx=0x7fc1300091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.531+0000 7fc14adff700 1 -- 172.21.15.86:0/2139280485 shutdown_connections 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.531+0000 7fc14adff700 1 --2- 172.21.15.86:0/2139280485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440b1420 0x7fc1440ae410 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.531+0000 7fc14adff700 1 -- 172.21.15.86:0/2139280485 >> 172.21.15.86:0/2139280485 conn(0x7fc14406a320 msgr2=0x7fc1440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.531+0000 7fc14adff700 1 -- 172.21.15.86:0/2139280485 shutdown_connections 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.531+0000 7fc14adff700 1 -- 172.21.15.86:0/2139280485 wait complete. 2023-10-09T12:57:28.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.532+0000 7fc14adff700 1 Processor -- start 2023-10-09T12:57:28.533 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.532+0000 7fc14adff700 1 -- start start 2023-10-09T12:57:28.534 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc14adff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1440b1420 0x7fc144168050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc14adff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1440cbf30 0x7fc14406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc14adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440ccf90 0x7fc1440a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc14adff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440a58a0 con 0x7fc1440cbf30 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc14adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440a5b80 con 0x7fc1440ccf90 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc14adff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440a5e60 con 0x7fc1440b1420 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc143fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1440cbf30 0x7fc14406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc143fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1440cbf30 0x7fc14406e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52342/0 (socket says 172.21.15.86:52342) 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.533+0000 7fc143fff700 1 -- 172.21.15.86:0/2686138898 learned_addr learned my addr 172.21.15.86:0/2686138898 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc143fff700 1 -- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1440b1420 msgr2=0x7fc144168050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc143fff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1440b1420 0x7fc144168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc143fff700 1 -- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440ccf90 msgr2=0x7fc1440a68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc14939c700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440ccf90 0x7fc1440a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc143fff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440ccf90 0x7fc1440a68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc143fff700 1 -- 172.21.15.86:0/2686138898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc130009420 con 0x7fc1440cbf30 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc14939c700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440ccf90 0x7fc1440a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc143fff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1440cbf30 0x7fc14406e370 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fc130013000 tx=0x7fc130017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc140ff9700 1 -- 172.21.15.86:0/2686138898 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13001f070 con 0x7fc1440cbf30 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc140ff9700 1 -- 172.21.15.86:0/2686138898 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130000c90 con 0x7fc1440cbf30 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1440a6140 con 0x7fc1440cbf30 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc140ff9700 1 -- 172.21.15.86:0/2686138898 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000bb40 con 0x7fc1440cbf30 2023-10-09T12:57:28.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.534+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1440a54c0 con 0x7fc1440cbf30 2023-10-09T12:57:28.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.535+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14404c3c0 con 0x7fc1440cbf30 2023-10-09T12:57:28.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.536+0000 7fc140ff9700 1 -- 172.21.15.86:0/2686138898 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc130023070 con 0x7fc1440cbf30 2023-10-09T12:57:28.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.537+0000 7fc140ff9700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc128066f30 0x7fc1280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:28.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.537+0000 7fc140ff9700 1 -- 172.21.15.86:0/2686138898 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fc130085b60 con 0x7fc1440cbf30 2023-10-09T12:57:28.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.537+0000 7fc148b9b700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc128066f30 0x7fc1280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:28.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.538+0000 7fc148b9b700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc128066f30 0x7fc1280693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc138001730 tx=0x7fc138007b40 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:28.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.541+0000 7fc140ff9700 1 -- 172.21.15.86:0/2686138898 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc130052bf0 con 0x7fc1440cbf30 2023-10-09T12:57:28.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.726+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1440a5cf0 con 0x7fc128066f30 2023-10-09T12:57:28.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.734+0000 7fc140ff9700 1 -- 172.21.15.86:0/2686138898 <== mgr.8883 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289591 (secure 0 0 0) 0x7fc1440a5cf0 con 0x7fc128066f30 2023-10-09T12:57:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:28.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc128066f30 msgr2=0x7fc1280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc128066f30 0x7fc1280693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc138001730 tx=0x7fc138007b40 comp rx=0 tx=0).stop 2023-10-09T12:57:28.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1440cbf30 msgr2=0x7fc14406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1440cbf30 0x7fc14406e370 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fc130013000 tx=0x7fc130017000 comp rx=0 tx=0).stop 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 shutdown_connections 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1440ccf90 0x7fc1440a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1440b1420 0x7fc144168050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fc128066f30 0x7fc1280693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 --2- 172.21.15.86:0/2686138898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1440cbf30 0x7fc14406e370 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 >> 172.21.15.86:0/2686138898 conn(0x7fc14406a320 msgr2=0x7fc1440cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 shutdown_connections 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:28.739+0000 7fc14adff700 1 -- 172.21.15.86:0/2686138898 wait complete. 2023-10-09T12:57:28.741 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:57:28.756 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T12:57:28.546578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470504,"kb_used_data":18472,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504216,"statfs":{"total":773094113280,"available":770564317184,"internally_reserved":0,"allocated":18915328,"data_stored":9992020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.965935"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638747+0000","last_change":"2023-10-09T12:57:22.636031+0000","last_active":"2023-10-09T12:57:22.638747+0000","last_peered":"2023-10-09T12:57:22.638747+0000","last_clean":"2023-10-09T12:57:22.638747+0000","last_became_active":"2023-10-09T12:57:22.635750+0000","last_became_peered":"2023-10-09T12:57:22.635750+0000","last_unstale":"2023-10-09T12:57:22.638747+0000","last_undegraded":"2023-10-09T12:57:22.638747+0000","last_fullsized":"2023-10-09T12:57:22.638747+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:36.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614061+0000","last_change":"2023-10-09T12:57:22.611976+0000","last_active":"2023-10-09T12:57:22.614061+0000","last_peered":"2023-10-09T12:57:22.614061+0000","last_clean":"2023-10-09T12:57:22.614061+0000","last_became_active":"2023-10-09T12:57:22.611701+0000","last_became_peered":"2023-10-09T12:57:22.611701+0000","last_unstale":"2023-10-09T12:57:22.614061+0000","last_undegraded":"2023-10-09T12:57:22.614061+0000","last_fullsized":"2023-10-09T12:57:22.614061+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625321+0000","last_change":"2023-10-09T12:57:22.621839+0000","last_active":"2023-10-09T12:57:22.625321+0000","last_peered":"2023-10-09T12:57:22.625321+0000","last_clean":"2023-10-09T12:57:22.625321+0000","last_became_active":"2023-10-09T12:57:22.620601+0000","last_became_peered":"2023-10-09T12:57:22.620601+0000","last_unstale":"2023-10-09T12:57:22.625321+0000","last_undegraded":"2023-10-09T12:57:22.625321+0000","last_fullsized":"2023-10-09T12:57:22.625321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:59.433830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.629548+0000","last_change":"2023-10-09T12:57:22.626605+0000","last_active":"2023-10-09T12:57:22.629548+0000","last_peered":"2023-10-09T12:57:22.629548+0000","last_clean":"2023-10-09T12:57:22.629548+0000","last_became_active":"2023-10-09T12:57:22.626267+0000","last_became_peered":"2023-10-09T12:57:22.626267+0000","last_unstale":"2023-10-09T12:57:22.629548+0000","last_undegraded":"2023-10-09T12:57:22.629548+0000","last_fullsized":"2023-10-09T12:57:22.629548+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:21.985977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639495+0000","last_change":"2023-10-09T12:57:22.638432+0000","last_active":"2023-10-09T12:57:22.639495+0000","last_peered":"2023-10-09T12:57:22.639495+0000","last_clean":"2023-10-09T12:57:22.639495+0000","last_became_active":"2023-10-09T12:57:22.638179+0000","last_became_peered":"2023-10-09T12:57:22.638179+0000","last_unstale":"2023-10-09T12:57:22.639495+0000","last_undegraded":"2023-10-09T12:57:22.639495+0000","last_fullsized":"2023-10-09T12:57:22.639495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:26.255875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625495+0000","last_change":"2023-10-09T12:57:22.622355+0000","last_active":"2023-10-09T12:57:22.625495+0000","last_peered":"2023-10-09T12:57:22.625495+0000","last_clean":"2023-10-09T12:57:22.625495+0000","last_became_active":"2023-10-09T12:57:22.622088+0000","last_became_peered":"2023-10-09T12:57:22.622088+0000","last_unstale":"2023-10-09T12:57:22.625495+0000","last_undegraded":"2023-10-09T12:57:22.625495+0000","last_fullsized":"2023-10-09T12:57:22.625495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:11:58.040597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625337+0000","last_change":"2023-10-09T12:57:22.621443+0000","last_active":"2023-10-09T12:57:22.625337+0000","last_peered":"2023-10-09T12:57:22.625337+0000","last_clean":"2023-10-09T12:57:22.625337+0000","last_became_active":"2023-10-09T12:57:22.621180+0000","last_became_peered":"2023-10-09T12:57:22.621180+0000","last_unstale":"2023-10-09T12:57:22.625337+0000","last_undegraded":"2023-10-09T12:57:22.625337+0000","last_fullsized":"2023-10-09T12:57:22.625337+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630227+0000","last_change":"2023-10-09T12:57:22.627728+0000","last_active":"2023-10-09T12:57:22.630227+0000","last_peered":"2023-10-09T12:57:22.630227+0000","last_clean":"2023-10-09T12:57:22.630227+0000","last_became_active":"2023-10-09T12:57:22.627440+0000","last_became_peered":"2023-10-09T12:57:22.627440+0000","last_unstale":"2023-10-09T12:57:22.630227+0000","last_undegraded":"2023-10-09T12:57:22.630227+0000","last_fullsized":"2023-10-09T12:57:22.630227+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:55.583107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614035+0000","last_change":"2023-10-09T12:57:22.611974+0000","last_active":"2023-10-09T12:57:22.614035+0000","last_peered":"2023-10-09T12:57:22.614035+0000","last_clean":"2023-10-09T12:57:22.614035+0000","last_became_active":"2023-10-09T12:57:22.611699+0000","last_became_peered":"2023-10-09T12:57:22.611699+0000","last_unstale":"2023-10-09T12:57:22.614035+0000","last_undegraded":"2023-10-09T12:57:22.614035+0000","last_fullsized":"2023-10-09T12:57:22.614035+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:39.982603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637468+0000","last_change":"2023-10-09T12:57:22.631071+0000","last_active":"2023-10-09T12:57:22.637468+0000","last_peered":"2023-10-09T12:57:22.637468+0000","last_clean":"2023-10-09T12:57:22.637468+0000","last_became_active":"2023-10-09T12:57:22.630787+0000","last_became_peered":"2023-10-09T12:57:22.630787+0000","last_unstale":"2023-10-09T12:57:22.637468+0000","last_undegraded":"2023-10-09T12:57:22.637468+0000","last_fullsized":"2023-10-09T12:57:22.637468+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:42.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627919+0000","last_change":"2023-10-09T12:57:22.624085+0000","last_active":"2023-10-09T12:57:22.627919+0000","last_peered":"2023-10-09T12:57:22.627919+0000","last_clean":"2023-10-09T12:57:22.627919+0000","last_became_active":"2023-10-09T12:57:22.623822+0000","last_became_peered":"2023-10-09T12:57:22.623822+0000","last_unstale":"2023-10-09T12:57:22.627919+0000","last_undegraded":"2023-10-09T12:57:22.627919+0000","last_fullsized":"2023-10-09T12:57:22.627919+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:26.255875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638636+0000","last_change":"2023-10-09T12:57:22.634884+0000","last_active":"2023-10-09T12:57:22.638636+0000","last_peered":"2023-10-09T12:57:22.638636+0000","last_clean":"2023-10-09T12:57:22.638636+0000","last_became_active":"2023-10-09T12:57:22.634210+0000","last_became_peered":"2023-10-09T12:57:22.634210+0000","last_unstale":"2023-10-09T12:57:22.638636+0000","last_undegraded":"2023-10-09T12:57:22.638636+0000","last_fullsized":"2023-10-09T12:57:22.638636+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.975232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639477+0000","last_change":"2023-10-09T12:57:22.638407+0000","last_active":"2023-10-09T12:57:22.639477+0000","last_peered":"2023-10-09T12:57:22.639477+0000","last_clean":"2023-10-09T12:57:22.639477+0000","last_became_active":"2023-10-09T12:57:22.637815+0000","last_became_peered":"2023-10-09T12:57:22.637815+0000","last_unstale":"2023-10-09T12:57:22.639477+0000","last_undegraded":"2023-10-09T12:57:22.639477+0000","last_fullsized":"2023-10-09T12:57:22.639477+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:11.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627201+0000","last_change":"2023-10-09T12:57:22.622165+0000","last_active":"2023-10-09T12:57:22.627201+0000","last_peered":"2023-10-09T12:57:22.627201+0000","last_clean":"2023-10-09T12:57:22.627201+0000","last_became_active":"2023-10-09T12:57:22.621823+0000","last_became_peered":"2023-10-09T12:57:22.621823+0000","last_unstale":"2023-10-09T12:57:22.627201+0000","last_undegraded":"2023-10-09T12:57:22.627201+0000","last_fullsized":"2023-10-09T12:57:22.627201+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:47.039631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.623215+0000","last_change":"2023-10-09T12:57:22.616731+0000","last_active":"2023-10-09T12:57:22.623215+0000","last_peered":"2023-10-09T12:57:22.623215+0000","last_clean":"2023-10-09T12:57:22.623215+0000","last_became_active":"2023-10-09T12:57:22.616443+0000","last_became_peered":"2023-10-09T12:57:22.616443+0000","last_unstale":"2023-10-09T12:57:22.623215+0000","last_undegraded":"2023-10-09T12:57:22.623215+0000","last_fullsized":"2023-10-09T12:57:22.623215+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:19.428017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615271+0000","last_change":"2023-10-09T12:57:22.610213+0000","last_active":"2023-10-09T12:57:22.615271+0000","last_peered":"2023-10-09T12:57:22.615271+0000","last_clean":"2023-10-09T12:57:22.615271+0000","last_became_active":"2023-10-09T12:57:22.609967+0000","last_became_peered":"2023-10-09T12:57:22.609967+0000","last_unstale":"2023-10-09T12:57:22.615271+0000","last_undegraded":"2023-10-09T12:57:22.615271+0000","last_fullsized":"2023-10-09T12:57:22.615271+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:28:10.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637803+0000","last_change":"2023-10-09T12:57:22.633075+0000","last_active":"2023-10-09T12:57:22.637803+0000","last_peered":"2023-10-09T12:57:22.637803+0000","last_clean":"2023-10-09T12:57:22.637803+0000","last_became_active":"2023-10-09T12:57:22.632460+0000","last_became_peered":"2023-10-09T12:57:22.632460+0000","last_unstale":"2023-10-09T12:57:22.637803+0000","last_undegraded":"2023-10-09T12:57:22.637803+0000","last_fullsized":"2023-10-09T12:57:22.637803+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:43.686289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.624502+0000","last_change":"2023-10-09T12:57:22.621609+0000","last_active":"2023-10-09T12:57:22.624502+0000","last_peered":"2023-10-09T12:57:22.624502+0000","last_clean":"2023-10-09T12:57:22.624502+0000","last_became_active":"2023-10-09T12:57:22.621106+0000","last_became_peered":"2023-10-09T12:57:22.621106+0000","last_unstale":"2023-10-09T12:57:22.624502+0000","last_undegraded":"2023-10-09T12:57:22.624502+0000","last_fullsized":"2023-10-09T12:57:22.624502+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:21.985977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619071+0000","last_change":"2023-10-09T12:57:22.613666+0000","last_active":"2023-10-09T12:57:22.619071+0000","last_peered":"2023-10-09T12:57:22.619071+0000","last_clean":"2023-10-09T12:57:22.619071+0000","last_became_active":"2023-10-09T12:57:22.613331+0000","last_became_peered":"2023-10-09T12:57:22.613331+0000","last_unstale":"2023-10-09T12:57:22.619071+0000","last_undegraded":"2023-10-09T12:57:22.619071+0000","last_fullsized":"2023-10-09T12:57:22.619071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:14.886124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.618816+0000","last_change":"2023-10-09T12:57:22.617496+0000","last_active":"2023-10-09T12:57:22.618816+0000","last_peered":"2023-10-09T12:57:22.618816+0000","last_clean":"2023-10-09T12:57:22.618816+0000","last_became_active":"2023-10-09T12:57:22.617196+0000","last_became_peered":"2023-10-09T12:57:22.617196+0000","last_unstale":"2023-10-09T12:57:22.618816+0000","last_undegraded":"2023-10-09T12:57:22.618816+0000","last_fullsized":"2023-10-09T12:57:22.618816+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:29.620453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.623044+0000","last_change":"2023-10-09T12:57:22.615006+0000","last_active":"2023-10-09T12:57:22.623044+0000","last_peered":"2023-10-09T12:57:22.623044+0000","last_clean":"2023-10-09T12:57:22.623044+0000","last_became_active":"2023-10-09T12:57:22.614724+0000","last_became_peered":"2023-10-09T12:57:22.614724+0000","last_unstale":"2023-10-09T12:57:22.623044+0000","last_undegraded":"2023-10-09T12:57:22.623044+0000","last_fullsized":"2023-10-09T12:57:22.623044+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:05.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.622055+0000","last_change":"2023-10-09T12:57:22.616435+0000","last_active":"2023-10-09T12:57:22.622055+0000","last_peered":"2023-10-09T12:57:22.622055+0000","last_clean":"2023-10-09T12:57:22.622055+0000","last_became_active":"2023-10-09T12:57:22.616172+0000","last_became_peered":"2023-10-09T12:57:22.616172+0000","last_unstale":"2023-10-09T12:57:22.622055+0000","last_undegraded":"2023-10-09T12:57:22.622055+0000","last_fullsized":"2023-10-09T12:57:22.622055+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:21.035079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615615+0000","last_change":"2023-10-09T12:57:22.611649+0000","last_active":"2023-10-09T12:57:22.615615+0000","last_peered":"2023-10-09T12:57:22.615615+0000","last_clean":"2023-10-09T12:57:22.615615+0000","last_became_active":"2023-10-09T12:57:22.611379+0000","last_became_peered":"2023-10-09T12:57:22.611379+0000","last_unstale":"2023-10-09T12:57:22.615615+0000","last_undegraded":"2023-10-09T12:57:22.615615+0000","last_fullsized":"2023-10-09T12:57:22.615615+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:20.712936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.631028+0000","last_change":"2023-10-09T12:57:22.623266+0000","last_active":"2023-10-09T12:57:22.631028+0000","last_peered":"2023-10-09T12:57:22.631028+0000","last_clean":"2023-10-09T12:57:22.631028+0000","last_became_active":"2023-10-09T12:57:22.619979+0000","last_became_peered":"2023-10-09T12:57:22.619979+0000","last_unstale":"2023-10-09T12:57:22.631028+0000","last_undegraded":"2023-10-09T12:57:22.631028+0000","last_fullsized":"2023-10-09T12:57:22.631028+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:37.565328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.617901+0000","last_change":"2023-10-09T12:57:22.615483+0000","last_active":"2023-10-09T12:57:22.617901+0000","last_peered":"2023-10-09T12:57:22.617901+0000","last_clean":"2023-10-09T12:57:22.617901+0000","last_became_active":"2023-10-09T12:57:22.615223+0000","last_became_peered":"2023-10-09T12:57:22.615223+0000","last_unstale":"2023-10-09T12:57:22.617901+0000","last_undegraded":"2023-10-09T12:57:22.617901+0000","last_fullsized":"2023-10-09T12:57:22.617901+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:05.692178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619083+0000","last_change":"2023-10-09T12:57:22.613737+0000","last_active":"2023-10-09T12:57:22.619083+0000","last_peered":"2023-10-09T12:57:22.619083+0000","last_clean":"2023-10-09T12:57:22.619083+0000","last_became_active":"2023-10-09T12:57:22.613227+0000","last_became_peered":"2023-10-09T12:57:22.613227+0000","last_unstale":"2023-10-09T12:57:22.619083+0000","last_undegraded":"2023-10-09T12:57:22.619083+0000","last_fullsized":"2023-10-09T12:57:22.619083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:51.856277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630735+0000","last_change":"2023-10-09T12:57:22.626583+0000","last_active":"2023-10-09T12:57:22.630735+0000","last_peered":"2023-10-09T12:57:22.630735+0000","last_clean":"2023-10-09T12:57:22.630735+0000","last_became_active":"2023-10-09T12:57:22.626327+0000","last_became_peered":"2023-10-09T12:57:22.626327+0000","last_unstale":"2023-10-09T12:57:22.630735+0000","last_undegraded":"2023-10-09T12:57:22.630735+0000","last_fullsized":"2023-10-09T12:57:22.630735+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:20.275237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627649+0000","last_change":"2023-10-09T12:57:22.624916+0000","last_active":"2023-10-09T12:57:22.627649+0000","last_peered":"2023-10-09T12:57:22.627649+0000","last_clean":"2023-10-09T12:57:22.627649+0000","last_became_active":"2023-10-09T12:57:22.624661+0000","last_became_peered":"2023-10-09T12:57:22.624661+0000","last_unstale":"2023-10-09T12:57:22.627649+0000","last_undegraded":"2023-10-09T12:57:22.627649+0000","last_fullsized":"2023-10-09T12:57:22.627649+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625458+0000","last_change":"2023-10-09T12:57:22.622049+0000","last_active":"2023-10-09T12:57:22.625458+0000","last_peered":"2023-10-09T12:57:22.625458+0000","last_clean":"2023-10-09T12:57:22.625458+0000","last_became_active":"2023-10-09T12:57:22.621769+0000","last_became_peered":"2023-10-09T12:57:22.621769+0000","last_unstale":"2023-10-09T12:57:22.625458+0000","last_undegraded":"2023-10-09T12:57:22.625458+0000","last_fullsized":"2023-10-09T12:57:22.625458+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:50.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.622016+0000","last_change":"2023-10-09T12:57:22.613379+0000","last_active":"2023-10-09T12:57:22.622016+0000","last_peered":"2023-10-09T12:57:22.622016+0000","last_clean":"2023-10-09T12:57:22.622016+0000","last_became_active":"2023-10-09T12:57:22.612885+0000","last_became_peered":"2023-10-09T12:57:22.612885+0000","last_unstale":"2023-10-09T12:57:22.622016+0000","last_undegraded":"2023-10-09T12:57:22.622016+0000","last_fullsized":"2023-10-09T12:57:22.622016+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:59.433830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630955+0000","last_change":"2023-10-09T12:57:22.627678+0000","last_active":"2023-10-09T12:57:22.630955+0000","last_peered":"2023-10-09T12:57:22.630955+0000","last_clean":"2023-10-09T12:57:22.630955+0000","last_became_active":"2023-10-09T12:57:22.627139+0000","last_became_peered":"2023-10-09T12:57:22.627139+0000","last_unstale":"2023-10-09T12:57:22.630955+0000","last_undegraded":"2023-10-09T12:57:22.630955+0000","last_fullsized":"2023-10-09T12:57:22.630955+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:58.263529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628975+0000","last_change":"2023-10-09T12:57:22.624700+0000","last_active":"2023-10-09T12:57:22.628975+0000","last_peered":"2023-10-09T12:57:22.628975+0000","last_clean":"2023-10-09T12:57:22.628975+0000","last_became_active":"2023-10-09T12:57:22.624369+0000","last_became_peered":"2023-10-09T12:57:22.624369+0000","last_unstale":"2023-10-09T12:57:22.628975+0000","last_undegraded":"2023-10-09T12:57:22.628975+0000","last_fullsized":"2023-10-09T12:57:22.628975+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:15.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638764+0000","last_change":"2023-10-09T12:57:22.635058+0000","last_active":"2023-10-09T12:57:22.638764+0000","last_peered":"2023-10-09T12:57:22.638764+0000","last_clean":"2023-10-09T12:57:22.638764+0000","last_became_active":"2023-10-09T12:57:22.634780+0000","last_became_peered":"2023-10-09T12:57:22.634780+0000","last_unstale":"2023-10-09T12:57:22.638764+0000","last_undegraded":"2023-10-09T12:57:22.638764+0000","last_fullsized":"2023-10-09T12:57:22.638764+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:30.941363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.641857+0000","last_change":"2023-10-09T12:57:21.609381+0000","last_active":"2023-10-09T12:57:22.641857+0000","last_peered":"2023-10-09T12:57:22.641857+0000","last_clean":"2023-10-09T12:57:22.641857+0000","last_became_active":"2023-10-09T12:57:21.609098+0000","last_became_peered":"2023-10-09T12:57:21.609098+0000","last_unstale":"2023-10-09T12:57:22.641857+0000","last_undegraded":"2023-10-09T12:57:22.641857+0000","last_fullsized":"2023-10-09T12:57:22.641857+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:58.428377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614017+0000","last_change":"2023-10-09T12:57:22.611789+0000","last_active":"2023-10-09T12:57:22.614017+0000","last_peered":"2023-10-09T12:57:22.614017+0000","last_clean":"2023-10-09T12:57:22.614017+0000","last_became_active":"2023-10-09T12:57:22.611456+0000","last_became_peered":"2023-10-09T12:57:22.611456+0000","last_unstale":"2023-10-09T12:57:22.614017+0000","last_undegraded":"2023-10-09T12:57:22.614017+0000","last_fullsized":"2023-10-09T12:57:22.614017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:35.215673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635479+0000","last_change":"2023-10-09T12:57:21.609699+0000","last_active":"2023-10-09T12:57:22.635479+0000","last_peered":"2023-10-09T12:57:22.635479+0000","last_clean":"2023-10-09T12:57:22.635479+0000","last_became_active":"2023-10-09T12:57:21.609416+0000","last_became_peered":"2023-10-09T12:57:21.609416+0000","last_unstale":"2023-10-09T12:57:22.635479+0000","last_undegraded":"2023-10-09T12:57:22.635479+0000","last_fullsized":"2023-10-09T12:57:22.635479+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:28.632953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619875+0000","last_change":"2023-10-09T12:57:22.617329+0000","last_active":"2023-10-09T12:57:22.619875+0000","last_peered":"2023-10-09T12:57:22.619875+0000","last_clean":"2023-10-09T12:57:22.619875+0000","last_became_active":"2023-10-09T12:57:22.615838+0000","last_became_peered":"2023-10-09T12:57:22.615838+0000","last_unstale":"2023-10-09T12:57:22.619875+0000","last_undegraded":"2023-10-09T12:57:22.619875+0000","last_fullsized":"2023-10-09T12:57:22.619875+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:11.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635180+0000","last_change":"2023-10-09T12:57:21.595787+0000","last_active":"2023-10-09T12:57:22.635180+0000","last_peered":"2023-10-09T12:57:22.635180+0000","last_clean":"2023-10-09T12:57:22.635180+0000","last_became_active":"2023-10-09T12:57:21.595470+0000","last_became_peered":"2023-10-09T12:57:21.595470+0000","last_unstale":"2023-10-09T12:57:22.635180+0000","last_undegraded":"2023-10-09T12:57:22.635180+0000","last_fullsized":"2023-10-09T12:57:22.635180+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:31.346858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638565+0000","last_change":"2023-10-09T12:57:22.633923+0000","last_active":"2023-10-09T12:57:22.638565+0000","last_peered":"2023-10-09T12:57:22.638565+0000","last_clean":"2023-10-09T12:57:22.638565+0000","last_became_active":"2023-10-09T12:57:22.633607+0000","last_became_peered":"2023-10-09T12:57:22.633607+0000","last_unstale":"2023-10-09T12:57:22.638565+0000","last_undegraded":"2023-10-09T12:57:22.638565+0000","last_fullsized":"2023-10-09T12:57:22.638565+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:25.123907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.634627+0000","last_change":"2023-10-09T12:57:21.597270+0000","last_active":"2023-10-09T12:57:22.634627+0000","last_peered":"2023-10-09T12:57:22.634627+0000","last_clean":"2023-10-09T12:57:22.634627+0000","last_became_active":"2023-10-09T12:57:21.596964+0000","last_became_peered":"2023-10-09T12:57:21.596964+0000","last_unstale":"2023-10-09T12:57:22.634627+0000","last_undegraded":"2023-10-09T12:57:22.634627+0000","last_fullsized":"2023-10-09T12:57:22.634627+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:56.349875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630886+0000","last_change":"2023-10-09T12:57:22.627451+0000","last_active":"2023-10-09T12:57:22.630886+0000","last_peered":"2023-10-09T12:57:22.630886+0000","last_clean":"2023-10-09T12:57:22.630886+0000","last_became_active":"2023-10-09T12:57:22.627150+0000","last_became_peered":"2023-10-09T12:57:22.627150+0000","last_unstale":"2023-10-09T12:57:22.630886+0000","last_undegraded":"2023-10-09T12:57:22.630886+0000","last_fullsized":"2023-10-09T12:57:22.630886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:40.741655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637597+0000","last_change":"2023-10-09T12:57:21.601324+0000","last_active":"2023-10-09T12:57:22.637597+0000","last_peered":"2023-10-09T12:57:22.637597+0000","last_clean":"2023-10-09T12:57:22.637597+0000","last_became_active":"2023-10-09T12:57:21.601065+0000","last_became_peered":"2023-10-09T12:57:21.601065+0000","last_unstale":"2023-10-09T12:57:22.637597+0000","last_undegraded":"2023-10-09T12:57:22.637597+0000","last_fullsized":"2023-10-09T12:57:22.637597+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:29.021722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630744+0000","last_change":"2023-10-09T12:57:22.627203+0000","last_active":"2023-10-09T12:57:22.630744+0000","last_peered":"2023-10-09T12:57:22.630744+0000","last_clean":"2023-10-09T12:57:22.630744+0000","last_became_active":"2023-10-09T12:57:22.626926+0000","last_became_peered":"2023-10-09T12:57:22.626926+0000","last_unstale":"2023-10-09T12:57:22.630744+0000","last_undegraded":"2023-10-09T12:57:22.630744+0000","last_fullsized":"2023-10-09T12:57:22.630744+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:09.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639166+0000","last_change":"2023-10-09T12:57:21.601270+0000","last_active":"2023-10-09T12:57:22.639166+0000","last_peered":"2023-10-09T12:57:22.639166+0000","last_clean":"2023-10-09T12:57:22.639166+0000","last_became_active":"2023-10-09T12:57:21.600971+0000","last_became_peered":"2023-10-09T12:57:21.600971+0000","last_unstale":"2023-10-09T12:57:22.639166+0000","last_undegraded":"2023-10-09T12:57:22.639166+0000","last_fullsized":"2023-10-09T12:57:22.639166+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:04.329182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633755+0000","last_change":"2023-10-09T12:57:22.629636+0000","last_active":"2023-10-09T12:57:22.633755+0000","last_peered":"2023-10-09T12:57:22.633755+0000","last_clean":"2023-10-09T12:57:22.633755+0000","last_became_active":"2023-10-09T12:57:22.629297+0000","last_became_peered":"2023-10-09T12:57:22.629297+0000","last_unstale":"2023-10-09T12:57:22.633755+0000","last_undegraded":"2023-10-09T12:57:22.633755+0000","last_fullsized":"2023-10-09T12:57:22.633755+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.605892+0000","last_change":"2023-10-09T12:57:21.597160+0000","last_active":"2023-10-09T12:57:22.605892+0000","last_peered":"2023-10-09T12:57:22.605892+0000","last_clean":"2023-10-09T12:57:22.605892+0000","last_became_active":"2023-10-09T12:57:21.596858+0000","last_became_peered":"2023-10-09T12:57:21.596858+0000","last_unstale":"2023-10-09T12:57:22.605892+0000","last_undegraded":"2023-10-09T12:57:22.605892+0000","last_fullsized":"2023-10-09T12:57:22.605892+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:39.389828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635765+0000","last_change":"2023-10-09T12:57:22.632972+0000","last_active":"2023-10-09T12:57:22.635765+0000","last_peered":"2023-10-09T12:57:22.635765+0000","last_clean":"2023-10-09T12:57:22.635765+0000","last_became_active":"2023-10-09T12:57:22.632678+0000","last_became_peered":"2023-10-09T12:57:22.632678+0000","last_unstale":"2023-10-09T12:57:22.635765+0000","last_undegraded":"2023-10-09T12:57:22.635765+0000","last_fullsized":"2023-10-09T12:57:22.635765+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:51.856277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.603332+0000","last_change":"2023-10-09T12:57:21.603721+0000","last_active":"2023-10-09T12:57:22.603332+0000","last_peered":"2023-10-09T12:57:22.603332+0000","last_clean":"2023-10-09T12:57:22.603332+0000","last_became_active":"2023-10-09T12:57:21.603422+0000","last_became_peered":"2023-10-09T12:57:21.603422+0000","last_unstale":"2023-10-09T12:57:22.603332+0000","last_undegraded":"2023-10-09T12:57:22.603332+0000","last_fullsized":"2023-10-09T12:57:22.603332+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:47.959787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635684+0000","last_change":"2023-10-09T12:57:22.633186+0000","last_active":"2023-10-09T12:57:22.635684+0000","last_peered":"2023-10-09T12:57:22.635684+0000","last_clean":"2023-10-09T12:57:22.635684+0000","last_became_active":"2023-10-09T12:57:22.627827+0000","last_became_peered":"2023-10-09T12:57:22.627827+0000","last_unstale":"2023-10-09T12:57:22.635684+0000","last_undegraded":"2023-10-09T12:57:22.635684+0000","last_fullsized":"2023-10-09T12:57:22.635684+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:37.346312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604011+0000","last_change":"2023-10-09T12:57:21.603114+0000","last_active":"2023-10-09T12:57:22.604011+0000","last_peered":"2023-10-09T12:57:22.604011+0000","last_clean":"2023-10-09T12:57:22.604011+0000","last_became_active":"2023-10-09T12:57:21.602848+0000","last_became_peered":"2023-10-09T12:57:21.602848+0000","last_unstale":"2023-10-09T12:57:22.604011+0000","last_undegraded":"2023-10-09T12:57:22.604011+0000","last_fullsized":"2023-10-09T12:57:22.604011+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:47.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637822+0000","last_change":"2023-10-09T12:57:22.633273+0000","last_active":"2023-10-09T12:57:22.637822+0000","last_peered":"2023-10-09T12:57:22.637822+0000","last_clean":"2023-10-09T12:57:22.637822+0000","last_became_active":"2023-10-09T12:57:22.632802+0000","last_became_peered":"2023-10-09T12:57:22.632802+0000","last_unstale":"2023-10-09T12:57:22.637822+0000","last_undegraded":"2023-10-09T12:57:22.637822+0000","last_fullsized":"2023-10-09T12:57:22.637822+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:20.161343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606337+0000","last_change":"2023-10-09T12:57:21.610337+0000","last_active":"2023-10-09T12:57:22.606337+0000","last_peered":"2023-10-09T12:57:22.606337+0000","last_clean":"2023-10-09T12:57:22.606337+0000","last_became_active":"2023-10-09T12:57:21.609865+0000","last_became_peered":"2023-10-09T12:57:21.609865+0000","last_unstale":"2023-10-09T12:57:22.606337+0000","last_undegraded":"2023-10-09T12:57:22.606337+0000","last_fullsized":"2023-10-09T12:57:22.606337+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:25.891075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615217+0000","last_change":"2023-10-09T12:57:22.612914+0000","last_active":"2023-10-09T12:57:22.615217+0000","last_peered":"2023-10-09T12:57:22.615217+0000","last_clean":"2023-10-09T12:57:22.615217+0000","last_became_active":"2023-10-09T12:57:22.612654+0000","last_became_peered":"2023-10-09T12:57:22.612654+0000","last_unstale":"2023-10-09T12:57:22.615217+0000","last_undegraded":"2023-10-09T12:57:22.615217+0000","last_fullsized":"2023-10-09T12:57:22.615217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:28.372635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"177'6","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.642564+0000","last_change":"2023-10-09T12:57:21.594239+0000","last_active":"2023-10-09T12:57:22.642564+0000","last_peered":"2023-10-09T12:57:22.642564+0000","last_clean":"2023-10-09T12:57:22.642564+0000","last_became_active":"2023-10-09T12:57:21.593748+0000","last_became_peered":"2023-10-09T12:57:21.593748+0000","last_unstale":"2023-10-09T12:57:22.642564+0000","last_undegraded":"2023-10-09T12:57:22.642564+0000","last_fullsized":"2023-10-09T12:57:22.642564+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:09.926296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.624486+0000","last_change":"2023-10-09T12:57:22.621629+0000","last_active":"2023-10-09T12:57:22.624486+0000","last_peered":"2023-10-09T12:57:22.624486+0000","last_clean":"2023-10-09T12:57:22.624486+0000","last_became_active":"2023-10-09T12:57:22.621355+0000","last_became_peered":"2023-10-09T12:57:22.621355+0000","last_unstale":"2023-10-09T12:57:22.624486+0000","last_undegraded":"2023-10-09T12:57:22.624486+0000","last_fullsized":"2023-10-09T12:57:22.624486+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:09.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.641897+0000","last_change":"2023-10-09T12:57:21.601302+0000","last_active":"2023-10-09T12:57:22.641897+0000","last_peered":"2023-10-09T12:57:22.641897+0000","last_clean":"2023-10-09T12:57:22.641897+0000","last_became_active":"2023-10-09T12:57:21.601034+0000","last_became_peered":"2023-10-09T12:57:21.601034+0000","last_unstale":"2023-10-09T12:57:22.641897+0000","last_undegraded":"2023-10-09T12:57:22.641897+0000","last_fullsized":"2023-10-09T12:57:22.641897+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:52.122092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.613966+0000","last_change":"2023-10-09T12:57:22.611664+0000","last_active":"2023-10-09T12:57:22.613966+0000","last_peered":"2023-10-09T12:57:22.613966+0000","last_clean":"2023-10-09T12:57:22.613966+0000","last_became_active":"2023-10-09T12:57:22.611336+0000","last_became_peered":"2023-10-09T12:57:22.611336+0000","last_unstale":"2023-10-09T12:57:22.613966+0000","last_undegraded":"2023-10-09T12:57:22.613966+0000","last_fullsized":"2023-10-09T12:57:22.613966+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:27.112437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614806+0000","last_change":"2023-10-09T12:57:21.599053+0000","last_active":"2023-10-09T12:57:22.614806+0000","last_peered":"2023-10-09T12:57:22.614806+0000","last_clean":"2023-10-09T12:57:22.614806+0000","last_became_active":"2023-10-09T12:57:21.598808+0000","last_became_peered":"2023-10-09T12:57:21.598808+0000","last_unstale":"2023-10-09T12:57:22.614806+0000","last_undegraded":"2023-10-09T12:57:22.614806+0000","last_fullsized":"2023-10-09T12:57:22.614806+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:56.349875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637249+0000","last_change":"2023-10-09T12:57:22.636304+0000","last_active":"2023-10-09T12:57:22.637249+0000","last_peered":"2023-10-09T12:57:22.637249+0000","last_clean":"2023-10-09T12:57:22.637249+0000","last_became_active":"2023-10-09T12:57:22.635732+0000","last_became_peered":"2023-10-09T12:57:22.635732+0000","last_unstale":"2023-10-09T12:57:22.637249+0000","last_undegraded":"2023-10-09T12:57:22.637249+0000","last_fullsized":"2023-10-09T12:57:22.637249+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:44.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.600525+0000","last_change":"2023-10-09T12:57:21.597869+0000","last_active":"2023-10-09T12:57:22.600525+0000","last_peered":"2023-10-09T12:57:22.600525+0000","last_clean":"2023-10-09T12:57:22.600525+0000","last_became_active":"2023-10-09T12:57:21.597615+0000","last_became_peered":"2023-10-09T12:57:21.597615+0000","last_unstale":"2023-10-09T12:57:22.600525+0000","last_undegraded":"2023-10-09T12:57:22.600525+0000","last_fullsized":"2023-10-09T12:57:22.600525+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625201+0000","last_change":"2023-10-09T12:57:22.621208+0000","last_active":"2023-10-09T12:57:22.625201+0000","last_peered":"2023-10-09T12:57:22.625201+0000","last_clean":"2023-10-09T12:57:22.625201+0000","last_became_active":"2023-10-09T12:57:22.620851+0000","last_became_peered":"2023-10-09T12:57:22.620851+0000","last_unstale":"2023-10-09T12:57:22.625201+0000","last_undegraded":"2023-10-09T12:57:22.625201+0000","last_fullsized":"2023-10-09T12:57:22.625201+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:25.391627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"177'8","reported_seq":18,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635696+0000","last_change":"2023-10-09T12:57:21.597629+0000","last_active":"2023-10-09T12:57:22.635696+0000","last_peered":"2023-10-09T12:57:22.635696+0000","last_clean":"2023-10-09T12:57:22.635696+0000","last_became_active":"2023-10-09T12:57:21.597355+0000","last_became_peered":"2023-10-09T12:57:21.597355+0000","last_unstale":"2023-10-09T12:57:22.635696+0000","last_undegraded":"2023-10-09T12:57:22.635696+0000","last_fullsized":"2023-10-09T12:57:22.635696+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:23.097372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.631244+0000","last_change":"2023-10-09T12:57:22.624678+0000","last_active":"2023-10-09T12:57:22.631244+0000","last_peered":"2023-10-09T12:57:22.631244+0000","last_clean":"2023-10-09T12:57:22.631244+0000","last_became_active":"2023-10-09T12:57:22.624396+0000","last_became_peered":"2023-10-09T12:57:22.624396+0000","last_unstale":"2023-10-09T12:57:22.631244+0000","last_undegraded":"2023-10-09T12:57:22.631244+0000","last_fullsized":"2023-10-09T12:57:22.631244+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:28.938350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.636599+0000","last_change":"2023-10-09T12:57:21.596337+0000","last_active":"2023-10-09T12:57:22.636599+0000","last_peered":"2023-10-09T12:57:22.636599+0000","last_clean":"2023-10-09T12:57:22.636599+0000","last_became_active":"2023-10-09T12:57:21.595954+0000","last_became_peered":"2023-10-09T12:57:21.595954+0000","last_unstale":"2023-10-09T12:57:22.636599+0000","last_undegraded":"2023-10-09T12:57:22.636599+0000","last_fullsized":"2023-10-09T12:57:22.636599+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:57.308111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.636307+0000","last_change":"2023-10-09T12:57:22.632816+0000","last_active":"2023-10-09T12:57:22.636307+0000","last_peered":"2023-10-09T12:57:22.636307+0000","last_clean":"2023-10-09T12:57:22.636307+0000","last_became_active":"2023-10-09T12:57:22.632525+0000","last_became_peered":"2023-10-09T12:57:22.632525+0000","last_unstale":"2023-10-09T12:57:22.636307+0000","last_undegraded":"2023-10-09T12:57:22.636307+0000","last_fullsized":"2023-10-09T12:57:22.636307+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:31.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628132+0000","last_change":"2023-10-09T12:57:21.606002+0000","last_active":"2023-10-09T12:57:22.628132+0000","last_peered":"2023-10-09T12:57:22.628132+0000","last_clean":"2023-10-09T12:57:22.628132+0000","last_became_active":"2023-10-09T12:57:21.605728+0000","last_became_peered":"2023-10-09T12:57:21.605728+0000","last_unstale":"2023-10-09T12:57:22.628132+0000","last_undegraded":"2023-10-09T12:57:22.628132+0000","last_fullsized":"2023-10-09T12:57:22.628132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.996883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.623109+0000","last_change":"2023-10-09T12:57:22.619636+0000","last_active":"2023-10-09T12:57:22.623109+0000","last_peered":"2023-10-09T12:57:22.623109+0000","last_clean":"2023-10-09T12:57:22.623109+0000","last_became_active":"2023-10-09T12:57:22.618193+0000","last_became_peered":"2023-10-09T12:57:22.618193+0000","last_unstale":"2023-10-09T12:57:22.623109+0000","last_undegraded":"2023-10-09T12:57:22.623109+0000","last_fullsized":"2023-10-09T12:57:22.623109+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:47.039631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637660+0000","last_change":"2023-10-09T12:57:21.599422+0000","last_active":"2023-10-09T12:57:22.637660+0000","last_peered":"2023-10-09T12:57:22.637660+0000","last_clean":"2023-10-09T12:57:22.637660+0000","last_became_active":"2023-10-09T12:57:21.599151+0000","last_became_peered":"2023-10-09T12:57:21.599151+0000","last_unstale":"2023-10-09T12:57:22.637660+0000","last_undegraded":"2023-10-09T12:57:22.637660+0000","last_fullsized":"2023-10-09T12:57:22.637660+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:45.965489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625242+0000","last_change":"2023-10-09T12:57:22.622000+0000","last_active":"2023-10-09T12:57:22.625242+0000","last_peered":"2023-10-09T12:57:22.625242+0000","last_clean":"2023-10-09T12:57:22.625242+0000","last_became_active":"2023-10-09T12:57:22.621737+0000","last_became_peered":"2023-10-09T12:57:22.621737+0000","last_unstale":"2023-10-09T12:57:22.625242+0000","last_undegraded":"2023-10-09T12:57:22.625242+0000","last_fullsized":"2023-10-09T12:57:22.625242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:43.225188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604091+0000","last_change":"2023-10-09T12:57:21.605816+0000","last_active":"2023-10-09T12:57:22.604091+0000","last_peered":"2023-10-09T12:57:22.604091+0000","last_clean":"2023-10-09T12:57:22.604091+0000","last_became_active":"2023-10-09T12:57:21.605528+0000","last_became_peered":"2023-10-09T12:57:21.605528+0000","last_unstale":"2023-10-09T12:57:22.604091+0000","last_undegraded":"2023-10-09T12:57:22.604091+0000","last_fullsized":"2023-10-09T12:57:22.604091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:17.071923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.622035+0000","last_change":"2023-10-09T12:57:22.613524+0000","last_active":"2023-10-09T12:57:22.622035+0000","last_peered":"2023-10-09T12:57:22.622035+0000","last_clean":"2023-10-09T12:57:22.622035+0000","last_became_active":"2023-10-09T12:57:22.613257+0000","last_became_peered":"2023-10-09T12:57:22.613257+0000","last_unstale":"2023-10-09T12:57:22.622035+0000","last_undegraded":"2023-10-09T12:57:22.622035+0000","last_fullsized":"2023-10-09T12:57:22.622035+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:44.827709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633437+0000","last_change":"2023-10-09T12:57:21.599237+0000","last_active":"2023-10-09T12:57:22.633437+0000","last_peered":"2023-10-09T12:57:22.633437+0000","last_clean":"2023-10-09T12:57:22.633437+0000","last_became_active":"2023-10-09T12:57:21.598939+0000","last_became_peered":"2023-10-09T12:57:21.598939+0000","last_unstale":"2023-10-09T12:57:22.633437+0000","last_undegraded":"2023-10-09T12:57:22.633437+0000","last_fullsized":"2023-10-09T12:57:22.633437+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:26.106984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616131+0000","last_change":"2023-10-09T12:57:22.615086+0000","last_active":"2023-10-09T12:57:22.616131+0000","last_peered":"2023-10-09T12:57:22.616131+0000","last_clean":"2023-10-09T12:57:22.616131+0000","last_became_active":"2023-10-09T12:57:22.614828+0000","last_became_peered":"2023-10-09T12:57:22.614828+0000","last_unstale":"2023-10-09T12:57:22.616131+0000","last_undegraded":"2023-10-09T12:57:22.616131+0000","last_fullsized":"2023-10-09T12:57:22.616131+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:46.019043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.607618+0000","last_change":"2023-10-09T12:57:21.608914+0000","last_active":"2023-10-09T12:57:22.607618+0000","last_peered":"2023-10-09T12:57:22.607618+0000","last_clean":"2023-10-09T12:57:22.607618+0000","last_became_active":"2023-10-09T12:57:21.607432+0000","last_became_peered":"2023-10-09T12:57:21.607432+0000","last_unstale":"2023-10-09T12:57:22.607618+0000","last_undegraded":"2023-10-09T12:57:22.607618+0000","last_fullsized":"2023-10-09T12:57:22.607618+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:46.034178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615643+0000","last_change":"2023-10-09T12:57:22.612235+0000","last_active":"2023-10-09T12:57:22.615643+0000","last_peered":"2023-10-09T12:57:22.615643+0000","last_clean":"2023-10-09T12:57:22.615643+0000","last_became_active":"2023-10-09T12:57:22.611945+0000","last_became_peered":"2023-10-09T12:57:22.611945+0000","last_unstale":"2023-10-09T12:57:22.615643+0000","last_undegraded":"2023-10-09T12:57:22.615643+0000","last_fullsized":"2023-10-09T12:57:22.615643+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:09.847955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606227+0000","last_change":"2023-10-09T12:57:21.608734+0000","last_active":"2023-10-09T12:57:22.606227+0000","last_peered":"2023-10-09T12:57:22.606227+0000","last_clean":"2023-10-09T12:57:22.606227+0000","last_became_active":"2023-10-09T12:57:21.607327+0000","last_became_peered":"2023-10-09T12:57:21.607327+0000","last_unstale":"2023-10-09T12:57:22.606227+0000","last_undegraded":"2023-10-09T12:57:22.606227+0000","last_fullsized":"2023-10-09T12:57:22.606227+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:21:40.010860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616086+0000","last_change":"2023-10-09T12:57:22.615055+0000","last_active":"2023-10-09T12:57:22.616086+0000","last_peered":"2023-10-09T12:57:22.616086+0000","last_clean":"2023-10-09T12:57:22.616086+0000","last_became_active":"2023-10-09T12:57:22.614806+0000","last_became_peered":"2023-10-09T12:57:22.614806+0000","last_unstale":"2023-10-09T12:57:22.616086+0000","last_undegraded":"2023-10-09T12:57:22.616086+0000","last_fullsized":"2023-10-09T12:57:22.616086+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614277+0000","last_change":"2023-10-09T12:57:21.608126+0000","last_active":"2023-10-09T12:57:22.614277+0000","last_peered":"2023-10-09T12:57:22.614277+0000","last_clean":"2023-10-09T12:57:22.614277+0000","last_became_active":"2023-10-09T12:57:21.607849+0000","last_became_peered":"2023-10-09T12:57:21.607849+0000","last_unstale":"2023-10-09T12:57:22.614277+0000","last_undegraded":"2023-10-09T12:57:22.614277+0000","last_fullsized":"2023-10-09T12:57:22.614277+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:31.346858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639458+0000","last_change":"2023-10-09T12:57:22.638208+0000","last_active":"2023-10-09T12:57:22.639458+0000","last_peered":"2023-10-09T12:57:22.639458+0000","last_clean":"2023-10-09T12:57:22.639458+0000","last_became_active":"2023-10-09T12:57:22.637944+0000","last_became_peered":"2023-10-09T12:57:22.637944+0000","last_unstale":"2023-10-09T12:57:22.639458+0000","last_undegraded":"2023-10-09T12:57:22.639458+0000","last_fullsized":"2023-10-09T12:57:22.639458+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:50.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637329+0000","last_change":"2023-10-09T12:57:21.609193+0000","last_active":"2023-10-09T12:57:22.637329+0000","last_peered":"2023-10-09T12:57:22.637329+0000","last_clean":"2023-10-09T12:57:22.637329+0000","last_became_active":"2023-10-09T12:57:21.608925+0000","last_became_peered":"2023-10-09T12:57:21.608925+0000","last_unstale":"2023-10-09T12:57:22.637329+0000","last_undegraded":"2023-10-09T12:57:22.637329+0000","last_fullsized":"2023-10-09T12:57:22.637329+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:20.029626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625440+0000","last_change":"2023-10-09T12:57:22.624135+0000","last_active":"2023-10-09T12:57:22.625440+0000","last_peered":"2023-10-09T12:57:22.625440+0000","last_clean":"2023-10-09T12:57:22.625440+0000","last_became_active":"2023-10-09T12:57:22.621946+0000","last_became_peered":"2023-10-09T12:57:22.621946+0000","last_unstale":"2023-10-09T12:57:22.625440+0000","last_undegraded":"2023-10-09T12:57:22.625440+0000","last_fullsized":"2023-10-09T12:57:22.625440+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:44.827709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601006+0000","last_change":"2023-10-09T12:57:21.604265+0000","last_active":"2023-10-09T12:57:22.601006+0000","last_peered":"2023-10-09T12:57:22.601006+0000","last_clean":"2023-10-09T12:57:22.601006+0000","last_became_active":"2023-10-09T12:57:21.603970+0000","last_became_peered":"2023-10-09T12:57:21.603970+0000","last_unstale":"2023-10-09T12:57:22.601006+0000","last_undegraded":"2023-10-09T12:57:22.601006+0000","last_fullsized":"2023-10-09T12:57:22.601006+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:04.329182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614593+0000","last_change":"2023-10-09T12:57:22.611673+0000","last_active":"2023-10-09T12:57:22.614593+0000","last_peered":"2023-10-09T12:57:22.614593+0000","last_clean":"2023-10-09T12:57:22.614593+0000","last_became_active":"2023-10-09T12:57:22.611426+0000","last_became_peered":"2023-10-09T12:57:22.611426+0000","last_unstale":"2023-10-09T12:57:22.614593+0000","last_undegraded":"2023-10-09T12:57:22.614593+0000","last_fullsized":"2023-10-09T12:57:22.614593+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:03:40.616620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.602023+0000","last_change":"2023-10-09T12:57:21.595696+0000","last_active":"2023-10-09T12:57:22.602023+0000","last_peered":"2023-10-09T12:57:22.602023+0000","last_clean":"2023-10-09T12:57:22.602023+0000","last_became_active":"2023-10-09T12:57:21.595435+0000","last_became_peered":"2023-10-09T12:57:21.595435+0000","last_unstale":"2023-10-09T12:57:22.602023+0000","last_undegraded":"2023-10-09T12:57:22.602023+0000","last_fullsized":"2023-10-09T12:57:22.602023+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:30.351371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619850+0000","last_change":"2023-10-09T12:57:22.617179+0000","last_active":"2023-10-09T12:57:22.619850+0000","last_peered":"2023-10-09T12:57:22.619850+0000","last_clean":"2023-10-09T12:57:22.619850+0000","last_became_active":"2023-10-09T12:57:22.616900+0000","last_became_peered":"2023-10-09T12:57:22.616900+0000","last_unstale":"2023-10-09T12:57:22.619850+0000","last_undegraded":"2023-10-09T12:57:22.619850+0000","last_fullsized":"2023-10-09T12:57:22.619850+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:44.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601003+0000","last_change":"2023-10-09T12:57:21.596493+0000","last_active":"2023-10-09T12:57:22.601003+0000","last_peered":"2023-10-09T12:57:22.601003+0000","last_clean":"2023-10-09T12:57:22.601003+0000","last_became_active":"2023-10-09T12:57:21.596245+0000","last_became_peered":"2023-10-09T12:57:21.596245+0000","last_unstale":"2023-10-09T12:57:22.601003+0000","last_undegraded":"2023-10-09T12:57:22.601003+0000","last_fullsized":"2023-10-09T12:57:22.601003+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619423+0000","last_change":"2023-10-09T12:57:22.618476+0000","last_active":"2023-10-09T12:57:22.619423+0000","last_peered":"2023-10-09T12:57:22.619423+0000","last_clean":"2023-10-09T12:57:22.619423+0000","last_became_active":"2023-10-09T12:57:22.618207+0000","last_became_peered":"2023-10-09T12:57:22.618207+0000","last_unstale":"2023-10-09T12:57:22.619423+0000","last_undegraded":"2023-10-09T12:57:22.619423+0000","last_fullsized":"2023-10-09T12:57:22.619423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:00.884319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606622+0000","last_change":"2023-10-09T12:57:21.600975+0000","last_active":"2023-10-09T12:57:22.606622+0000","last_peered":"2023-10-09T12:57:22.606622+0000","last_clean":"2023-10-09T12:57:22.606622+0000","last_became_active":"2023-10-09T12:57:21.600264+0000","last_became_peered":"2023-10-09T12:57:21.600264+0000","last_unstale":"2023-10-09T12:57:22.606622+0000","last_undegraded":"2023-10-09T12:57:22.606622+0000","last_fullsized":"2023-10-09T12:57:22.606622+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:12.067958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630597+0000","last_change":"2023-10-09T12:57:22.626479+0000","last_active":"2023-10-09T12:57:22.630597+0000","last_peered":"2023-10-09T12:57:22.630597+0000","last_clean":"2023-10-09T12:57:22.630597+0000","last_became_active":"2023-10-09T12:57:22.626205+0000","last_became_peered":"2023-10-09T12:57:22.626205+0000","last_unstale":"2023-10-09T12:57:22.630597+0000","last_undegraded":"2023-10-09T12:57:22.630597+0000","last_fullsized":"2023-10-09T12:57:22.630597+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:14.886124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.607728+0000","last_change":"2023-10-09T12:57:21.609165+0000","last_active":"2023-10-09T12:57:22.607728+0000","last_peered":"2023-10-09T12:57:22.607728+0000","last_clean":"2023-10-09T12:57:22.607728+0000","last_became_active":"2023-10-09T12:57:21.608881+0000","last_became_peered":"2023-10-09T12:57:21.608881+0000","last_unstale":"2023-10-09T12:57:22.607728+0000","last_undegraded":"2023-10-09T12:57:22.607728+0000","last_fullsized":"2023-10-09T12:57:22.607728+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:20.980524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.631048+0000","last_change":"2023-10-09T12:57:22.623274+0000","last_active":"2023-10-09T12:57:22.631048+0000","last_peered":"2023-10-09T12:57:22.631048+0000","last_clean":"2023-10-09T12:57:22.631048+0000","last_became_active":"2023-10-09T12:57:22.620168+0000","last_became_peered":"2023-10-09T12:57:22.620168+0000","last_unstale":"2023-10-09T12:57:22.631048+0000","last_undegraded":"2023-10-09T12:57:22.631048+0000","last_fullsized":"2023-10-09T12:57:22.631048+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:25.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614576+0000","last_change":"2023-10-09T12:57:21.597063+0000","last_active":"2023-10-09T12:57:22.614576+0000","last_peered":"2023-10-09T12:57:22.614576+0000","last_clean":"2023-10-09T12:57:22.614576+0000","last_became_active":"2023-10-09T12:57:21.596693+0000","last_became_peered":"2023-10-09T12:57:21.596693+0000","last_unstale":"2023-10-09T12:57:22.614576+0000","last_undegraded":"2023-10-09T12:57:22.614576+0000","last_fullsized":"2023-10-09T12:57:22.614576+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:52.392598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635786+0000","last_change":"2023-10-09T12:57:22.633182+0000","last_active":"2023-10-09T12:57:22.635786+0000","last_peered":"2023-10-09T12:57:22.635786+0000","last_clean":"2023-10-09T12:57:22.635786+0000","last_became_active":"2023-10-09T12:57:22.627239+0000","last_became_peered":"2023-10-09T12:57:22.627239+0000","last_unstale":"2023-10-09T12:57:22.635786+0000","last_undegraded":"2023-10-09T12:57:22.635786+0000","last_fullsized":"2023-10-09T12:57:22.635786+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:55.583107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.603409+0000","last_change":"2023-10-09T12:57:21.609638+0000","last_active":"2023-10-09T12:57:22.603409+0000","last_peered":"2023-10-09T12:57:22.603409+0000","last_clean":"2023-10-09T12:57:22.603409+0000","last_became_active":"2023-10-09T12:57:21.609342+0000","last_became_peered":"2023-10-09T12:57:21.609342+0000","last_unstale":"2023-10-09T12:57:22.603409+0000","last_undegraded":"2023-10-09T12:57:22.603409+0000","last_fullsized":"2023-10-09T12:57:22.603409+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:47.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616422+0000","last_change":"2023-10-09T12:57:22.613537+0000","last_active":"2023-10-09T12:57:22.616422+0000","last_peered":"2023-10-09T12:57:22.616422+0000","last_clean":"2023-10-09T12:57:22.616422+0000","last_became_active":"2023-10-09T12:57:22.613287+0000","last_became_peered":"2023-10-09T12:57:22.613287+0000","last_unstale":"2023-10-09T12:57:22.616422+0000","last_undegraded":"2023-10-09T12:57:22.616422+0000","last_fullsized":"2023-10-09T12:57:22.616422+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:38.765063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"177'3","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638082+0000","last_change":"2023-10-09T12:57:21.607248+0000","last_active":"2023-10-09T12:57:22.638082+0000","last_peered":"2023-10-09T12:57:22.638082+0000","last_clean":"2023-10-09T12:57:22.638082+0000","last_became_active":"2023-10-09T12:57:21.606990+0000","last_became_peered":"2023-10-09T12:57:21.606990+0000","last_unstale":"2023-10-09T12:57:22.638082+0000","last_undegraded":"2023-10-09T12:57:22.638082+0000","last_fullsized":"2023-10-09T12:57:22.638082+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:25.956452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"167'293","reported_seq":919,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.607809+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:57:22.607809+0000","last_peered":"2023-10-09T12:57:22.607809+0000","last_clean":"2023-10-09T12:57:22.607809+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:57:22.607809+0000","last_undegraded":"2023-10-09T12:57:22.607809+0000","last_fullsized":"2023-10-09T12:57:22.607809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477642,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308224,"kb_used_data":2744,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063616,"statfs":{"total":96636764160,"available":96321142784,"internally_reserved":0,"allocated":2809856,"data_stored":1691826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35999999999999999},"max":{"1min":0.85599999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82499999999999996,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86399999999999999,"5min":1.204,"15min":1.204},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85199999999999998,"5min":1.165,"15min":1.6060000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.073},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.54700000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.1679999999999999,"15min":1.206},"last":0.77200000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.373},"max":{"1min":1.171,"5min":1.171,"15min":1.645},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.98799999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.0720000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.5549999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.752},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":1.179,"15min":1.8100000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.03}]}]},{"osd":6,"up_from":16,"seq":68719477643,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311744,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060096,"statfs":{"total":96636764160,"available":96317538304,"internally_reserved":0,"allocated":2220032,"data_stored":1100980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.749}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.627}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.59499999999999997}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":0.69999999999999996}]}]},{"osd":1,"up_from":15,"seq":64424510347,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307640,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064200,"statfs":{"total":96636764160,"available":96321740800,"internally_reserved":0,"allocated":2211840,"data_stored":1101388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.879}]}]},{"osd":0,"up_from":14,"seq":60129543050,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308232,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063608,"statfs":{"total":96636764160,"available":96321134592,"internally_reserved":0,"allocated":2818048,"data_stored":1692772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.628,"5min":1.008,"15min":1.008},"last":0.308},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.83199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95899999999999996,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97399999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.79800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":1.105,"15min":1.1639999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.1990000000000001},"last":0.747}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.004,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.208,"15min":1.208},"last":0.59299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311748,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060092,"statfs":{"total":96636764160,"available":96317534208,"internally_reserved":0,"allocated":2224128,"data_stored":1102440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73499999999999999,"5min":0.753,"15min":0.89400000000000002},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":1.038},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78200000000000003,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46999999999999997},"max":{"1min":1.139,"5min":1.194,"15min":1.1990000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.254},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2270000000000001,"5min":1.357,"15min":1.357},"last":0.69199999999999995}]},{"osd":7,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.373},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.66700000000000004}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1100924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.66800000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.317},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.88100000000000001,"15min":0.97199999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69299999999999995,"5min":0.876,"15min":0.876},"last":0.502},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.374},"max":{"1min":0.65400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.83199999999999996,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.083,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.121,"5min":1.321,"15min":1.321},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0129999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.623},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.96299999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"max":{"1min":1.002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76400000000000001}]}]},{"osd":4,"up_from":16,"seq":68719477642,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299444,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072396,"statfs":{"total":96636764160,"available":96330133504,"internally_reserved":0,"allocated":2207744,"data_stored":1100834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.38400000000000001},"max":{"1min":0.79900000000000004,"5min":0.96599999999999997,"15min":1.0669999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.74299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":0.96899999999999997,"15min":0.999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.92800000000000005,"5min":0.95999999999999996,"15min":1.0469999999999999},"last":0.92800000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73499999999999999,"15min":0.75800000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94999999999999996,"5min":0.98399999999999999,"15min":1.01},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.755},"min":{"1min":0.501,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93500000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55800000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.498},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.77300000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.51500000000000001},"max":{"1min":1,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.626,"5min":0.623,"15min":0.629},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.071},"last":0.83099999999999996}]},{"osd":6,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.44,"15min":0.41599999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.0960000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.49099999999999999,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":1.036,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.97099999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.204},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.47099999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.98799999999999999}]}]},{"osd":5,"up_from":16,"seq":68719477642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1100856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.88900000000000001,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.97499999999999998,"15min":1.0109999999999999},"last":0.66100000000000003}]},{"osd":1,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92700000000000005,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.01},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90400000000000003,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.497},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.3109999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.077},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0009999999999999,"5min":1.012,"15min":1.121},"last":0.73699999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0109999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64400000000000002,"15min":0.624},"min":{"1min":0.38,"5min":0.38,"15min":0.36699999999999999},"max":{"1min":1.008,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51800000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.0700000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.754,"15min":0.745},"min":{"1min":0.52000000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.71799999999999997,"15min":0.70499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0329999999999999,"5min":1.083,"15min":1.083},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.46600000000000003},"max":{"1min":0.98899999999999999,"5min":1.069,"15min":1.069},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:57:29.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:57:29.275 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:57:31.763 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T12:57:31.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.954+0000 7f23f759e700 1 Processor -- start 2023-10-09T12:57:31.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.954+0000 7f23f759e700 1 -- start start 2023-10-09T12:57:31.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f759e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23f8142ea0 0x7f23f80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:31.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23f80ad870 0x7f23f806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:31.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80b40f0 con 0x7f23f80b3b70 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f8069640 con 0x7f23f80ad870 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f759e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f8069920 con 0x7f23f8142ea0 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f5d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23f80ad870 0x7f23f806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f5d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23f80ad870 0x7f23f806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52354/0 (socket says 172.21.15.86:52354) 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.955+0000 7f23f5d9b700 1 -- 172.21.15.86:0/1799010589 learned_addr learned my addr 172.21.15.86:0/1799010589 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f659c700 1 --2- 172.21.15.86:0/1799010589 >> v2:172.21.15.135:3300/0 conn(0x7f23f8142ea0 0x7f23f80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f5d9b700 1 -- 172.21.15.86:0/1799010589 >> v2:172.21.15.135:3300/0 conn(0x7f23f8142ea0 msgr2=0x7f23f80b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f5d9b700 1 --2- 172.21.15.86:0/1799010589 >> v2:172.21.15.135:3300/0 conn(0x7f23f8142ea0 0x7f23f80b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f5d9b700 1 -- 172.21.15.86:0/1799010589 >> v1:172.21.15.135:6789/0 conn(0x7f23f80b3b70 legacy=0x7f23f806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f5d9b700 1 -- 172.21.15.86:0/1799010589 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8069c00 con 0x7f23f80ad870 2023-10-09T12:57:31.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f659c700 1 --2- 172.21.15.86:0/1799010589 >> v2:172.21.15.135:3300/0 conn(0x7f23f8142ea0 0x7f23f80b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:31.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f5d9b700 1 --2- 172.21.15.86:0/1799010589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f80ad870 0x7f23f806b9e0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f23f8071240 tx=0x7f23ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dd9ac48c451aaf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:31.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f559a700 1 -- 172.21.15.86:0/1799010589 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00b820 con 0x7f23f80ad870 2023-10-09T12:57:31.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f559a700 1 -- 172.21.15.86:0/1799010589 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec00b980 con 0x7f23f80ad870 2023-10-09T12:57:31.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.956+0000 7f23f559a700 1 -- 172.21.15.86:0/1799010589 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00bd20 con 0x7f23f80ad870 2023-10-09T12:57:31.960 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 -- 172.21.15.86:0/1799010589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f80ad870 msgr2=0x7f23f806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 --2- 172.21.15.86:0/1799010589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f80ad870 0x7f23f806b9e0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f23f8071240 tx=0x7f23ec009250 comp rx=0 tx=0).stop 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 -- 172.21.15.86:0/1799010589 shutdown_connections 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 --2- 172.21.15.86:0/1799010589 >> v2:172.21.15.135:3300/0 conn(0x7f23f8142ea0 0x7f23f80b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 --2- 172.21.15.86:0/1799010589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f80ad870 0x7f23f806b9e0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 -- 172.21.15.86:0/1799010589 >> 172.21.15.86:0/1799010589 conn(0x7f23f80ce430 msgr2=0x7f23f80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 -- 172.21.15.86:0/1799010589 shutdown_connections 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.957+0000 7f23f759e700 1 -- 172.21.15.86:0/1799010589 wait complete. 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.958+0000 7f23f759e700 1 Processor -- start 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.959+0000 7f23f759e700 1 -- start start 2023-10-09T12:57:31.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.959+0000 7f23f759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f80b3b70 0x7f23f80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.959+0000 7f23f759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f8142ea0 0x7f23f8158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.959+0000 7f23f759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f80c9710 0x7f23f80b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.959+0000 7f23f759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f816a080 con 0x7f23f8142ea0 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.959+0000 7f23f759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f816a360 con 0x7f23f80b3b70 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.959+0000 7f23f759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f816a640 con 0x7f23f80c9710 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f8142ea0 0x7f23f8158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f8142ea0 0x7f23f8158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52370/0 (socket says 172.21.15.86:52370) 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 -- 172.21.15.86:0/3053642200 learned_addr learned my addr 172.21.15.86:0/3053642200 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f659c700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f80b3b70 0x7f23f80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:31.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f6d9d700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f80c9710 0x7f23f80b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 -- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f80c9710 msgr2=0x7f23f80b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f80c9710 0x7f23f80b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 -- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f80b3b70 msgr2=0x7f23f80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f80b3b70 0x7f23f80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 -- 172.21.15.86:0/3053642200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0094f0 con 0x7f23f8142ea0 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f6d9d700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f80c9710 0x7f23f80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23f5d9b700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f8142ea0 0x7f23f8158e50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0030c0 tx=0x7f23ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23e67fc700 1 -- 172.21.15.86:0/3053642200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec011e60 con 0x7f23f8142ea0 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.960+0000 7f23e67fc700 1 -- 172.21.15.86:0/3053642200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec020070 con 0x7f23f8142ea0 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.961+0000 7f23e67fc700 1 -- 172.21.15.86:0/3053642200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec01b6a0 con 0x7f23f8142ea0 2023-10-09T12:57:31.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.961+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f816a920 con 0x7f23f8142ea0 2023-10-09T12:57:31.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.961+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f8169c50 con 0x7f23f8142ea0 2023-10-09T12:57:31.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.962+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f804c3c0 con 0x7f23f8142ea0 2023-10-09T12:57:31.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.962+0000 7f23e67fc700 1 -- 172.21.15.86:0/3053642200 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23ec022030 con 0x7f23f8142ea0 2023-10-09T12:57:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.964+0000 7f23e67fc700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23d8066f30 0x7f23d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.964+0000 7f23e67fc700 1 -- 172.21.15.86:0/3053642200 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f23ec0867b0 con 0x7f23f8142ea0 2023-10-09T12:57:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.964+0000 7f23f659c700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23d8066f30 0x7f23d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:31.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.965+0000 7f23f659c700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23d8066f30 0x7f23d80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23f8141da0 tx=0x7f23e8007670 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:31.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:31.968+0000 7f23e67fc700 1 -- 172.21.15.86:0/3053642200 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23ec0537c0 con 0x7f23f8142ea0 2023-10-09T12:57:32.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.156+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23f80b2d80 con 0x7f23d8066f30 2023-10-09T12:57:32.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.164+0000 7f23e67fc700 1 -- 172.21.15.86:0/3053642200 <== mgr.8883 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289591 (secure 0 0 0) 0x7f23f80b2d80 con 0x7f23d8066f30 2023-10-09T12:57:32.168 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:32.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23d8066f30 msgr2=0x7f23d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23d8066f30 0x7f23d80693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23f8141da0 tx=0x7f23e8007670 comp rx=0 tx=0).stop 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f8142ea0 msgr2=0x7f23f8158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f8142ea0 0x7f23f8158e50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0030c0 tx=0x7f23ec016000 comp rx=0 tx=0).stop 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 shutdown_connections 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23f80c9710 0x7f23f80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23f80b3b70 0x7f23f80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f23d8066f30 0x7f23d80693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 --2- 172.21.15.86:0/3053642200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f8142ea0 0x7f23f8158e50 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 >> 172.21.15.86:0/3053642200 conn(0x7f23f80ce430 msgr2=0x7f23f806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 shutdown_connections 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.169+0000 7f23f759e700 1 -- 172.21.15.86:0/3053642200 wait complete. 2023-10-09T12:57:32.171 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T12:57:32.186 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T12:57:30.547036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470504,"kb_used_data":18472,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752504216,"statfs":{"total":773094113280,"available":770564317184,"internally_reserved":0,"allocated":18915328,"data_stored":9992020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001796"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638747+0000","last_change":"2023-10-09T12:57:22.636031+0000","last_active":"2023-10-09T12:57:22.638747+0000","last_peered":"2023-10-09T12:57:22.638747+0000","last_clean":"2023-10-09T12:57:22.638747+0000","last_became_active":"2023-10-09T12:57:22.635750+0000","last_became_peered":"2023-10-09T12:57:22.635750+0000","last_unstale":"2023-10-09T12:57:22.638747+0000","last_undegraded":"2023-10-09T12:57:22.638747+0000","last_fullsized":"2023-10-09T12:57:22.638747+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:36.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614061+0000","last_change":"2023-10-09T12:57:22.611976+0000","last_active":"2023-10-09T12:57:22.614061+0000","last_peered":"2023-10-09T12:57:22.614061+0000","last_clean":"2023-10-09T12:57:22.614061+0000","last_became_active":"2023-10-09T12:57:22.611701+0000","last_became_peered":"2023-10-09T12:57:22.611701+0000","last_unstale":"2023-10-09T12:57:22.614061+0000","last_undegraded":"2023-10-09T12:57:22.614061+0000","last_fullsized":"2023-10-09T12:57:22.614061+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625321+0000","last_change":"2023-10-09T12:57:22.621839+0000","last_active":"2023-10-09T12:57:22.625321+0000","last_peered":"2023-10-09T12:57:22.625321+0000","last_clean":"2023-10-09T12:57:22.625321+0000","last_became_active":"2023-10-09T12:57:22.620601+0000","last_became_peered":"2023-10-09T12:57:22.620601+0000","last_unstale":"2023-10-09T12:57:22.625321+0000","last_undegraded":"2023-10-09T12:57:22.625321+0000","last_fullsized":"2023-10-09T12:57:22.625321+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:59.433830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.629548+0000","last_change":"2023-10-09T12:57:22.626605+0000","last_active":"2023-10-09T12:57:22.629548+0000","last_peered":"2023-10-09T12:57:22.629548+0000","last_clean":"2023-10-09T12:57:22.629548+0000","last_became_active":"2023-10-09T12:57:22.626267+0000","last_became_peered":"2023-10-09T12:57:22.626267+0000","last_unstale":"2023-10-09T12:57:22.629548+0000","last_undegraded":"2023-10-09T12:57:22.629548+0000","last_fullsized":"2023-10-09T12:57:22.629548+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:21.985977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639495+0000","last_change":"2023-10-09T12:57:22.638432+0000","last_active":"2023-10-09T12:57:22.639495+0000","last_peered":"2023-10-09T12:57:22.639495+0000","last_clean":"2023-10-09T12:57:22.639495+0000","last_became_active":"2023-10-09T12:57:22.638179+0000","last_became_peered":"2023-10-09T12:57:22.638179+0000","last_unstale":"2023-10-09T12:57:22.639495+0000","last_undegraded":"2023-10-09T12:57:22.639495+0000","last_fullsized":"2023-10-09T12:57:22.639495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:26.255875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625495+0000","last_change":"2023-10-09T12:57:22.622355+0000","last_active":"2023-10-09T12:57:22.625495+0000","last_peered":"2023-10-09T12:57:22.625495+0000","last_clean":"2023-10-09T12:57:22.625495+0000","last_became_active":"2023-10-09T12:57:22.622088+0000","last_became_peered":"2023-10-09T12:57:22.622088+0000","last_unstale":"2023-10-09T12:57:22.625495+0000","last_undegraded":"2023-10-09T12:57:22.625495+0000","last_fullsized":"2023-10-09T12:57:22.625495+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:11:58.040597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625337+0000","last_change":"2023-10-09T12:57:22.621443+0000","last_active":"2023-10-09T12:57:22.625337+0000","last_peered":"2023-10-09T12:57:22.625337+0000","last_clean":"2023-10-09T12:57:22.625337+0000","last_became_active":"2023-10-09T12:57:22.621180+0000","last_became_peered":"2023-10-09T12:57:22.621180+0000","last_unstale":"2023-10-09T12:57:22.625337+0000","last_undegraded":"2023-10-09T12:57:22.625337+0000","last_fullsized":"2023-10-09T12:57:22.625337+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:44.967325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630227+0000","last_change":"2023-10-09T12:57:22.627728+0000","last_active":"2023-10-09T12:57:22.630227+0000","last_peered":"2023-10-09T12:57:22.630227+0000","last_clean":"2023-10-09T12:57:22.630227+0000","last_became_active":"2023-10-09T12:57:22.627440+0000","last_became_peered":"2023-10-09T12:57:22.627440+0000","last_unstale":"2023-10-09T12:57:22.630227+0000","last_undegraded":"2023-10-09T12:57:22.630227+0000","last_fullsized":"2023-10-09T12:57:22.630227+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:55.583107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614035+0000","last_change":"2023-10-09T12:57:22.611974+0000","last_active":"2023-10-09T12:57:22.614035+0000","last_peered":"2023-10-09T12:57:22.614035+0000","last_clean":"2023-10-09T12:57:22.614035+0000","last_became_active":"2023-10-09T12:57:22.611699+0000","last_became_peered":"2023-10-09T12:57:22.611699+0000","last_unstale":"2023-10-09T12:57:22.614035+0000","last_undegraded":"2023-10-09T12:57:22.614035+0000","last_fullsized":"2023-10-09T12:57:22.614035+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:39.982603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637468+0000","last_change":"2023-10-09T12:57:22.631071+0000","last_active":"2023-10-09T12:57:22.637468+0000","last_peered":"2023-10-09T12:57:22.637468+0000","last_clean":"2023-10-09T12:57:22.637468+0000","last_became_active":"2023-10-09T12:57:22.630787+0000","last_became_peered":"2023-10-09T12:57:22.630787+0000","last_unstale":"2023-10-09T12:57:22.637468+0000","last_undegraded":"2023-10-09T12:57:22.637468+0000","last_fullsized":"2023-10-09T12:57:22.637468+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:42.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627919+0000","last_change":"2023-10-09T12:57:22.624085+0000","last_active":"2023-10-09T12:57:22.627919+0000","last_peered":"2023-10-09T12:57:22.627919+0000","last_clean":"2023-10-09T12:57:22.627919+0000","last_became_active":"2023-10-09T12:57:22.623822+0000","last_became_peered":"2023-10-09T12:57:22.623822+0000","last_unstale":"2023-10-09T12:57:22.627919+0000","last_undegraded":"2023-10-09T12:57:22.627919+0000","last_fullsized":"2023-10-09T12:57:22.627919+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:26.255875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638636+0000","last_change":"2023-10-09T12:57:22.634884+0000","last_active":"2023-10-09T12:57:22.638636+0000","last_peered":"2023-10-09T12:57:22.638636+0000","last_clean":"2023-10-09T12:57:22.638636+0000","last_became_active":"2023-10-09T12:57:22.634210+0000","last_became_peered":"2023-10-09T12:57:22.634210+0000","last_unstale":"2023-10-09T12:57:22.638636+0000","last_undegraded":"2023-10-09T12:57:22.638636+0000","last_fullsized":"2023-10-09T12:57:22.638636+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:47.975232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639477+0000","last_change":"2023-10-09T12:57:22.638407+0000","last_active":"2023-10-09T12:57:22.639477+0000","last_peered":"2023-10-09T12:57:22.639477+0000","last_clean":"2023-10-09T12:57:22.639477+0000","last_became_active":"2023-10-09T12:57:22.637815+0000","last_became_peered":"2023-10-09T12:57:22.637815+0000","last_unstale":"2023-10-09T12:57:22.639477+0000","last_undegraded":"2023-10-09T12:57:22.639477+0000","last_fullsized":"2023-10-09T12:57:22.639477+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:11.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627201+0000","last_change":"2023-10-09T12:57:22.622165+0000","last_active":"2023-10-09T12:57:22.627201+0000","last_peered":"2023-10-09T12:57:22.627201+0000","last_clean":"2023-10-09T12:57:22.627201+0000","last_became_active":"2023-10-09T12:57:22.621823+0000","last_became_peered":"2023-10-09T12:57:22.621823+0000","last_unstale":"2023-10-09T12:57:22.627201+0000","last_undegraded":"2023-10-09T12:57:22.627201+0000","last_fullsized":"2023-10-09T12:57:22.627201+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:47.039631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.623215+0000","last_change":"2023-10-09T12:57:22.616731+0000","last_active":"2023-10-09T12:57:22.623215+0000","last_peered":"2023-10-09T12:57:22.623215+0000","last_clean":"2023-10-09T12:57:22.623215+0000","last_became_active":"2023-10-09T12:57:22.616443+0000","last_became_peered":"2023-10-09T12:57:22.616443+0000","last_unstale":"2023-10-09T12:57:22.623215+0000","last_undegraded":"2023-10-09T12:57:22.623215+0000","last_fullsized":"2023-10-09T12:57:22.623215+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:19.428017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615271+0000","last_change":"2023-10-09T12:57:22.610213+0000","last_active":"2023-10-09T12:57:22.615271+0000","last_peered":"2023-10-09T12:57:22.615271+0000","last_clean":"2023-10-09T12:57:22.615271+0000","last_became_active":"2023-10-09T12:57:22.609967+0000","last_became_peered":"2023-10-09T12:57:22.609967+0000","last_unstale":"2023-10-09T12:57:22.615271+0000","last_undegraded":"2023-10-09T12:57:22.615271+0000","last_fullsized":"2023-10-09T12:57:22.615271+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:28:10.517439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637803+0000","last_change":"2023-10-09T12:57:22.633075+0000","last_active":"2023-10-09T12:57:22.637803+0000","last_peered":"2023-10-09T12:57:22.637803+0000","last_clean":"2023-10-09T12:57:22.637803+0000","last_became_active":"2023-10-09T12:57:22.632460+0000","last_became_peered":"2023-10-09T12:57:22.632460+0000","last_unstale":"2023-10-09T12:57:22.637803+0000","last_undegraded":"2023-10-09T12:57:22.637803+0000","last_fullsized":"2023-10-09T12:57:22.637803+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:43.686289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.624502+0000","last_change":"2023-10-09T12:57:22.621609+0000","last_active":"2023-10-09T12:57:22.624502+0000","last_peered":"2023-10-09T12:57:22.624502+0000","last_clean":"2023-10-09T12:57:22.624502+0000","last_became_active":"2023-10-09T12:57:22.621106+0000","last_became_peered":"2023-10-09T12:57:22.621106+0000","last_unstale":"2023-10-09T12:57:22.624502+0000","last_undegraded":"2023-10-09T12:57:22.624502+0000","last_fullsized":"2023-10-09T12:57:22.624502+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:21.985977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619071+0000","last_change":"2023-10-09T12:57:22.613666+0000","last_active":"2023-10-09T12:57:22.619071+0000","last_peered":"2023-10-09T12:57:22.619071+0000","last_clean":"2023-10-09T12:57:22.619071+0000","last_became_active":"2023-10-09T12:57:22.613331+0000","last_became_peered":"2023-10-09T12:57:22.613331+0000","last_unstale":"2023-10-09T12:57:22.619071+0000","last_undegraded":"2023-10-09T12:57:22.619071+0000","last_fullsized":"2023-10-09T12:57:22.619071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:14.886124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.618816+0000","last_change":"2023-10-09T12:57:22.617496+0000","last_active":"2023-10-09T12:57:22.618816+0000","last_peered":"2023-10-09T12:57:22.618816+0000","last_clean":"2023-10-09T12:57:22.618816+0000","last_became_active":"2023-10-09T12:57:22.617196+0000","last_became_peered":"2023-10-09T12:57:22.617196+0000","last_unstale":"2023-10-09T12:57:22.618816+0000","last_undegraded":"2023-10-09T12:57:22.618816+0000","last_fullsized":"2023-10-09T12:57:22.618816+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:29.620453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.623044+0000","last_change":"2023-10-09T12:57:22.615006+0000","last_active":"2023-10-09T12:57:22.623044+0000","last_peered":"2023-10-09T12:57:22.623044+0000","last_clean":"2023-10-09T12:57:22.623044+0000","last_became_active":"2023-10-09T12:57:22.614724+0000","last_became_peered":"2023-10-09T12:57:22.614724+0000","last_unstale":"2023-10-09T12:57:22.623044+0000","last_undegraded":"2023-10-09T12:57:22.623044+0000","last_fullsized":"2023-10-09T12:57:22.623044+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:05.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.622055+0000","last_change":"2023-10-09T12:57:22.616435+0000","last_active":"2023-10-09T12:57:22.622055+0000","last_peered":"2023-10-09T12:57:22.622055+0000","last_clean":"2023-10-09T12:57:22.622055+0000","last_became_active":"2023-10-09T12:57:22.616172+0000","last_became_peered":"2023-10-09T12:57:22.616172+0000","last_unstale":"2023-10-09T12:57:22.622055+0000","last_undegraded":"2023-10-09T12:57:22.622055+0000","last_fullsized":"2023-10-09T12:57:22.622055+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:21.035079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615615+0000","last_change":"2023-10-09T12:57:22.611649+0000","last_active":"2023-10-09T12:57:22.615615+0000","last_peered":"2023-10-09T12:57:22.615615+0000","last_clean":"2023-10-09T12:57:22.615615+0000","last_became_active":"2023-10-09T12:57:22.611379+0000","last_became_peered":"2023-10-09T12:57:22.611379+0000","last_unstale":"2023-10-09T12:57:22.615615+0000","last_undegraded":"2023-10-09T12:57:22.615615+0000","last_fullsized":"2023-10-09T12:57:22.615615+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:23:20.712936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.631028+0000","last_change":"2023-10-09T12:57:22.623266+0000","last_active":"2023-10-09T12:57:22.631028+0000","last_peered":"2023-10-09T12:57:22.631028+0000","last_clean":"2023-10-09T12:57:22.631028+0000","last_became_active":"2023-10-09T12:57:22.619979+0000","last_became_peered":"2023-10-09T12:57:22.619979+0000","last_unstale":"2023-10-09T12:57:22.631028+0000","last_undegraded":"2023-10-09T12:57:22.631028+0000","last_fullsized":"2023-10-09T12:57:22.631028+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:37.565328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.617901+0000","last_change":"2023-10-09T12:57:22.615483+0000","last_active":"2023-10-09T12:57:22.617901+0000","last_peered":"2023-10-09T12:57:22.617901+0000","last_clean":"2023-10-09T12:57:22.617901+0000","last_became_active":"2023-10-09T12:57:22.615223+0000","last_became_peered":"2023-10-09T12:57:22.615223+0000","last_unstale":"2023-10-09T12:57:22.617901+0000","last_undegraded":"2023-10-09T12:57:22.617901+0000","last_fullsized":"2023-10-09T12:57:22.617901+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:05.692178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619083+0000","last_change":"2023-10-09T12:57:22.613737+0000","last_active":"2023-10-09T12:57:22.619083+0000","last_peered":"2023-10-09T12:57:22.619083+0000","last_clean":"2023-10-09T12:57:22.619083+0000","last_became_active":"2023-10-09T12:57:22.613227+0000","last_became_peered":"2023-10-09T12:57:22.613227+0000","last_unstale":"2023-10-09T12:57:22.619083+0000","last_undegraded":"2023-10-09T12:57:22.619083+0000","last_fullsized":"2023-10-09T12:57:22.619083+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:51.856277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630735+0000","last_change":"2023-10-09T12:57:22.626583+0000","last_active":"2023-10-09T12:57:22.630735+0000","last_peered":"2023-10-09T12:57:22.630735+0000","last_clean":"2023-10-09T12:57:22.630735+0000","last_became_active":"2023-10-09T12:57:22.626327+0000","last_became_peered":"2023-10-09T12:57:22.626327+0000","last_unstale":"2023-10-09T12:57:22.630735+0000","last_undegraded":"2023-10-09T12:57:22.630735+0000","last_fullsized":"2023-10-09T12:57:22.630735+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:20.275237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.627649+0000","last_change":"2023-10-09T12:57:22.624916+0000","last_active":"2023-10-09T12:57:22.627649+0000","last_peered":"2023-10-09T12:57:22.627649+0000","last_clean":"2023-10-09T12:57:22.627649+0000","last_became_active":"2023-10-09T12:57:22.624661+0000","last_became_peered":"2023-10-09T12:57:22.624661+0000","last_unstale":"2023-10-09T12:57:22.627649+0000","last_undegraded":"2023-10-09T12:57:22.627649+0000","last_fullsized":"2023-10-09T12:57:22.627649+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625458+0000","last_change":"2023-10-09T12:57:22.622049+0000","last_active":"2023-10-09T12:57:22.625458+0000","last_peered":"2023-10-09T12:57:22.625458+0000","last_clean":"2023-10-09T12:57:22.625458+0000","last_became_active":"2023-10-09T12:57:22.621769+0000","last_became_peered":"2023-10-09T12:57:22.621769+0000","last_unstale":"2023-10-09T12:57:22.625458+0000","last_undegraded":"2023-10-09T12:57:22.625458+0000","last_fullsized":"2023-10-09T12:57:22.625458+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:50.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.622016+0000","last_change":"2023-10-09T12:57:22.613379+0000","last_active":"2023-10-09T12:57:22.622016+0000","last_peered":"2023-10-09T12:57:22.622016+0000","last_clean":"2023-10-09T12:57:22.622016+0000","last_became_active":"2023-10-09T12:57:22.612885+0000","last_became_peered":"2023-10-09T12:57:22.612885+0000","last_unstale":"2023-10-09T12:57:22.622016+0000","last_undegraded":"2023-10-09T12:57:22.622016+0000","last_fullsized":"2023-10-09T12:57:22.622016+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:59.433830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630955+0000","last_change":"2023-10-09T12:57:22.627678+0000","last_active":"2023-10-09T12:57:22.630955+0000","last_peered":"2023-10-09T12:57:22.630955+0000","last_clean":"2023-10-09T12:57:22.630955+0000","last_became_active":"2023-10-09T12:57:22.627139+0000","last_became_peered":"2023-10-09T12:57:22.627139+0000","last_unstale":"2023-10-09T12:57:22.630955+0000","last_undegraded":"2023-10-09T12:57:22.630955+0000","last_fullsized":"2023-10-09T12:57:22.630955+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:58.263529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628975+0000","last_change":"2023-10-09T12:57:22.624700+0000","last_active":"2023-10-09T12:57:22.628975+0000","last_peered":"2023-10-09T12:57:22.628975+0000","last_clean":"2023-10-09T12:57:22.628975+0000","last_became_active":"2023-10-09T12:57:22.624369+0000","last_became_peered":"2023-10-09T12:57:22.624369+0000","last_unstale":"2023-10-09T12:57:22.628975+0000","last_undegraded":"2023-10-09T12:57:22.628975+0000","last_fullsized":"2023-10-09T12:57:22.628975+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:15.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638764+0000","last_change":"2023-10-09T12:57:22.635058+0000","last_active":"2023-10-09T12:57:22.638764+0000","last_peered":"2023-10-09T12:57:22.638764+0000","last_clean":"2023-10-09T12:57:22.638764+0000","last_became_active":"2023-10-09T12:57:22.634780+0000","last_became_peered":"2023-10-09T12:57:22.634780+0000","last_unstale":"2023-10-09T12:57:22.638764+0000","last_undegraded":"2023-10-09T12:57:22.638764+0000","last_fullsized":"2023-10-09T12:57:22.638764+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:30.941363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.641857+0000","last_change":"2023-10-09T12:57:21.609381+0000","last_active":"2023-10-09T12:57:22.641857+0000","last_peered":"2023-10-09T12:57:22.641857+0000","last_clean":"2023-10-09T12:57:22.641857+0000","last_became_active":"2023-10-09T12:57:21.609098+0000","last_became_peered":"2023-10-09T12:57:21.609098+0000","last_unstale":"2023-10-09T12:57:22.641857+0000","last_undegraded":"2023-10-09T12:57:22.641857+0000","last_fullsized":"2023-10-09T12:57:22.641857+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:58.428377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614017+0000","last_change":"2023-10-09T12:57:22.611789+0000","last_active":"2023-10-09T12:57:22.614017+0000","last_peered":"2023-10-09T12:57:22.614017+0000","last_clean":"2023-10-09T12:57:22.614017+0000","last_became_active":"2023-10-09T12:57:22.611456+0000","last_became_peered":"2023-10-09T12:57:22.611456+0000","last_unstale":"2023-10-09T12:57:22.614017+0000","last_undegraded":"2023-10-09T12:57:22.614017+0000","last_fullsized":"2023-10-09T12:57:22.614017+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:35.215673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635479+0000","last_change":"2023-10-09T12:57:21.609699+0000","last_active":"2023-10-09T12:57:22.635479+0000","last_peered":"2023-10-09T12:57:22.635479+0000","last_clean":"2023-10-09T12:57:22.635479+0000","last_became_active":"2023-10-09T12:57:21.609416+0000","last_became_peered":"2023-10-09T12:57:21.609416+0000","last_unstale":"2023-10-09T12:57:22.635479+0000","last_undegraded":"2023-10-09T12:57:22.635479+0000","last_fullsized":"2023-10-09T12:57:22.635479+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:28.632953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619875+0000","last_change":"2023-10-09T12:57:22.617329+0000","last_active":"2023-10-09T12:57:22.619875+0000","last_peered":"2023-10-09T12:57:22.619875+0000","last_clean":"2023-10-09T12:57:22.619875+0000","last_became_active":"2023-10-09T12:57:22.615838+0000","last_became_peered":"2023-10-09T12:57:22.615838+0000","last_unstale":"2023-10-09T12:57:22.619875+0000","last_undegraded":"2023-10-09T12:57:22.619875+0000","last_fullsized":"2023-10-09T12:57:22.619875+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:11.672062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635180+0000","last_change":"2023-10-09T12:57:21.595787+0000","last_active":"2023-10-09T12:57:22.635180+0000","last_peered":"2023-10-09T12:57:22.635180+0000","last_clean":"2023-10-09T12:57:22.635180+0000","last_became_active":"2023-10-09T12:57:21.595470+0000","last_became_peered":"2023-10-09T12:57:21.595470+0000","last_unstale":"2023-10-09T12:57:22.635180+0000","last_undegraded":"2023-10-09T12:57:22.635180+0000","last_fullsized":"2023-10-09T12:57:22.635180+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:31.346858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638565+0000","last_change":"2023-10-09T12:57:22.633923+0000","last_active":"2023-10-09T12:57:22.638565+0000","last_peered":"2023-10-09T12:57:22.638565+0000","last_clean":"2023-10-09T12:57:22.638565+0000","last_became_active":"2023-10-09T12:57:22.633607+0000","last_became_peered":"2023-10-09T12:57:22.633607+0000","last_unstale":"2023-10-09T12:57:22.638565+0000","last_undegraded":"2023-10-09T12:57:22.638565+0000","last_fullsized":"2023-10-09T12:57:22.638565+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:25.123907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.634627+0000","last_change":"2023-10-09T12:57:21.597270+0000","last_active":"2023-10-09T12:57:22.634627+0000","last_peered":"2023-10-09T12:57:22.634627+0000","last_clean":"2023-10-09T12:57:22.634627+0000","last_became_active":"2023-10-09T12:57:21.596964+0000","last_became_peered":"2023-10-09T12:57:21.596964+0000","last_unstale":"2023-10-09T12:57:22.634627+0000","last_undegraded":"2023-10-09T12:57:22.634627+0000","last_fullsized":"2023-10-09T12:57:22.634627+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:56.349875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630886+0000","last_change":"2023-10-09T12:57:22.627451+0000","last_active":"2023-10-09T12:57:22.630886+0000","last_peered":"2023-10-09T12:57:22.630886+0000","last_clean":"2023-10-09T12:57:22.630886+0000","last_became_active":"2023-10-09T12:57:22.627150+0000","last_became_peered":"2023-10-09T12:57:22.627150+0000","last_unstale":"2023-10-09T12:57:22.630886+0000","last_undegraded":"2023-10-09T12:57:22.630886+0000","last_fullsized":"2023-10-09T12:57:22.630886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:40.741655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637597+0000","last_change":"2023-10-09T12:57:21.601324+0000","last_active":"2023-10-09T12:57:22.637597+0000","last_peered":"2023-10-09T12:57:22.637597+0000","last_clean":"2023-10-09T12:57:22.637597+0000","last_became_active":"2023-10-09T12:57:21.601065+0000","last_became_peered":"2023-10-09T12:57:21.601065+0000","last_unstale":"2023-10-09T12:57:22.637597+0000","last_undegraded":"2023-10-09T12:57:22.637597+0000","last_fullsized":"2023-10-09T12:57:22.637597+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:29.021722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630744+0000","last_change":"2023-10-09T12:57:22.627203+0000","last_active":"2023-10-09T12:57:22.630744+0000","last_peered":"2023-10-09T12:57:22.630744+0000","last_clean":"2023-10-09T12:57:22.630744+0000","last_became_active":"2023-10-09T12:57:22.626926+0000","last_became_peered":"2023-10-09T12:57:22.626926+0000","last_unstale":"2023-10-09T12:57:22.630744+0000","last_undegraded":"2023-10-09T12:57:22.630744+0000","last_fullsized":"2023-10-09T12:57:22.630744+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:09.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639166+0000","last_change":"2023-10-09T12:57:21.601270+0000","last_active":"2023-10-09T12:57:22.639166+0000","last_peered":"2023-10-09T12:57:22.639166+0000","last_clean":"2023-10-09T12:57:22.639166+0000","last_became_active":"2023-10-09T12:57:21.600971+0000","last_became_peered":"2023-10-09T12:57:21.600971+0000","last_unstale":"2023-10-09T12:57:22.639166+0000","last_undegraded":"2023-10-09T12:57:22.639166+0000","last_fullsized":"2023-10-09T12:57:22.639166+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:04.329182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633755+0000","last_change":"2023-10-09T12:57:22.629636+0000","last_active":"2023-10-09T12:57:22.633755+0000","last_peered":"2023-10-09T12:57:22.633755+0000","last_clean":"2023-10-09T12:57:22.633755+0000","last_became_active":"2023-10-09T12:57:22.629297+0000","last_became_peered":"2023-10-09T12:57:22.629297+0000","last_unstale":"2023-10-09T12:57:22.633755+0000","last_undegraded":"2023-10-09T12:57:22.633755+0000","last_fullsized":"2023-10-09T12:57:22.633755+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.605892+0000","last_change":"2023-10-09T12:57:21.597160+0000","last_active":"2023-10-09T12:57:22.605892+0000","last_peered":"2023-10-09T12:57:22.605892+0000","last_clean":"2023-10-09T12:57:22.605892+0000","last_became_active":"2023-10-09T12:57:21.596858+0000","last_became_peered":"2023-10-09T12:57:21.596858+0000","last_unstale":"2023-10-09T12:57:22.605892+0000","last_undegraded":"2023-10-09T12:57:22.605892+0000","last_fullsized":"2023-10-09T12:57:22.605892+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:39.389828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635765+0000","last_change":"2023-10-09T12:57:22.632972+0000","last_active":"2023-10-09T12:57:22.635765+0000","last_peered":"2023-10-09T12:57:22.635765+0000","last_clean":"2023-10-09T12:57:22.635765+0000","last_became_active":"2023-10-09T12:57:22.632678+0000","last_became_peered":"2023-10-09T12:57:22.632678+0000","last_unstale":"2023-10-09T12:57:22.635765+0000","last_undegraded":"2023-10-09T12:57:22.635765+0000","last_fullsized":"2023-10-09T12:57:22.635765+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:51.856277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.603332+0000","last_change":"2023-10-09T12:57:21.603721+0000","last_active":"2023-10-09T12:57:22.603332+0000","last_peered":"2023-10-09T12:57:22.603332+0000","last_clean":"2023-10-09T12:57:22.603332+0000","last_became_active":"2023-10-09T12:57:21.603422+0000","last_became_peered":"2023-10-09T12:57:21.603422+0000","last_unstale":"2023-10-09T12:57:22.603332+0000","last_undegraded":"2023-10-09T12:57:22.603332+0000","last_fullsized":"2023-10-09T12:57:22.603332+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:47.959787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635684+0000","last_change":"2023-10-09T12:57:22.633186+0000","last_active":"2023-10-09T12:57:22.635684+0000","last_peered":"2023-10-09T12:57:22.635684+0000","last_clean":"2023-10-09T12:57:22.635684+0000","last_became_active":"2023-10-09T12:57:22.627827+0000","last_became_peered":"2023-10-09T12:57:22.627827+0000","last_unstale":"2023-10-09T12:57:22.635684+0000","last_undegraded":"2023-10-09T12:57:22.635684+0000","last_fullsized":"2023-10-09T12:57:22.635684+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:37.346312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604011+0000","last_change":"2023-10-09T12:57:21.603114+0000","last_active":"2023-10-09T12:57:22.604011+0000","last_peered":"2023-10-09T12:57:22.604011+0000","last_clean":"2023-10-09T12:57:22.604011+0000","last_became_active":"2023-10-09T12:57:21.602848+0000","last_became_peered":"2023-10-09T12:57:21.602848+0000","last_unstale":"2023-10-09T12:57:22.604011+0000","last_undegraded":"2023-10-09T12:57:22.604011+0000","last_fullsized":"2023-10-09T12:57:22.604011+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:47.302201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637822+0000","last_change":"2023-10-09T12:57:22.633273+0000","last_active":"2023-10-09T12:57:22.637822+0000","last_peered":"2023-10-09T12:57:22.637822+0000","last_clean":"2023-10-09T12:57:22.637822+0000","last_became_active":"2023-10-09T12:57:22.632802+0000","last_became_peered":"2023-10-09T12:57:22.632802+0000","last_unstale":"2023-10-09T12:57:22.637822+0000","last_undegraded":"2023-10-09T12:57:22.637822+0000","last_fullsized":"2023-10-09T12:57:22.637822+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:20.161343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606337+0000","last_change":"2023-10-09T12:57:21.610337+0000","last_active":"2023-10-09T12:57:22.606337+0000","last_peered":"2023-10-09T12:57:22.606337+0000","last_clean":"2023-10-09T12:57:22.606337+0000","last_became_active":"2023-10-09T12:57:21.609865+0000","last_became_peered":"2023-10-09T12:57:21.609865+0000","last_unstale":"2023-10-09T12:57:22.606337+0000","last_undegraded":"2023-10-09T12:57:22.606337+0000","last_fullsized":"2023-10-09T12:57:22.606337+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:25.891075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615217+0000","last_change":"2023-10-09T12:57:22.612914+0000","last_active":"2023-10-09T12:57:22.615217+0000","last_peered":"2023-10-09T12:57:22.615217+0000","last_clean":"2023-10-09T12:57:22.615217+0000","last_became_active":"2023-10-09T12:57:22.612654+0000","last_became_peered":"2023-10-09T12:57:22.612654+0000","last_unstale":"2023-10-09T12:57:22.615217+0000","last_undegraded":"2023-10-09T12:57:22.615217+0000","last_fullsized":"2023-10-09T12:57:22.615217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:28.372635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"177'6","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.642564+0000","last_change":"2023-10-09T12:57:21.594239+0000","last_active":"2023-10-09T12:57:22.642564+0000","last_peered":"2023-10-09T12:57:22.642564+0000","last_clean":"2023-10-09T12:57:22.642564+0000","last_became_active":"2023-10-09T12:57:21.593748+0000","last_became_peered":"2023-10-09T12:57:21.593748+0000","last_unstale":"2023-10-09T12:57:22.642564+0000","last_undegraded":"2023-10-09T12:57:22.642564+0000","last_fullsized":"2023-10-09T12:57:22.642564+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:50:09.926296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.624486+0000","last_change":"2023-10-09T12:57:22.621629+0000","last_active":"2023-10-09T12:57:22.624486+0000","last_peered":"2023-10-09T12:57:22.624486+0000","last_clean":"2023-10-09T12:57:22.624486+0000","last_became_active":"2023-10-09T12:57:22.621355+0000","last_became_peered":"2023-10-09T12:57:22.621355+0000","last_unstale":"2023-10-09T12:57:22.624486+0000","last_undegraded":"2023-10-09T12:57:22.624486+0000","last_fullsized":"2023-10-09T12:57:22.624486+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:19:09.553943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.641897+0000","last_change":"2023-10-09T12:57:21.601302+0000","last_active":"2023-10-09T12:57:22.641897+0000","last_peered":"2023-10-09T12:57:22.641897+0000","last_clean":"2023-10-09T12:57:22.641897+0000","last_became_active":"2023-10-09T12:57:21.601034+0000","last_became_peered":"2023-10-09T12:57:21.601034+0000","last_unstale":"2023-10-09T12:57:22.641897+0000","last_undegraded":"2023-10-09T12:57:22.641897+0000","last_fullsized":"2023-10-09T12:57:22.641897+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:52.122092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.613966+0000","last_change":"2023-10-09T12:57:22.611664+0000","last_active":"2023-10-09T12:57:22.613966+0000","last_peered":"2023-10-09T12:57:22.613966+0000","last_clean":"2023-10-09T12:57:22.613966+0000","last_became_active":"2023-10-09T12:57:22.611336+0000","last_became_peered":"2023-10-09T12:57:22.611336+0000","last_unstale":"2023-10-09T12:57:22.613966+0000","last_undegraded":"2023-10-09T12:57:22.613966+0000","last_fullsized":"2023-10-09T12:57:22.613966+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:27.112437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614806+0000","last_change":"2023-10-09T12:57:21.599053+0000","last_active":"2023-10-09T12:57:22.614806+0000","last_peered":"2023-10-09T12:57:22.614806+0000","last_clean":"2023-10-09T12:57:22.614806+0000","last_became_active":"2023-10-09T12:57:21.598808+0000","last_became_peered":"2023-10-09T12:57:21.598808+0000","last_unstale":"2023-10-09T12:57:22.614806+0000","last_undegraded":"2023-10-09T12:57:22.614806+0000","last_fullsized":"2023-10-09T12:57:22.614806+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:56.349875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637249+0000","last_change":"2023-10-09T12:57:22.636304+0000","last_active":"2023-10-09T12:57:22.637249+0000","last_peered":"2023-10-09T12:57:22.637249+0000","last_clean":"2023-10-09T12:57:22.637249+0000","last_became_active":"2023-10-09T12:57:22.635732+0000","last_became_peered":"2023-10-09T12:57:22.635732+0000","last_unstale":"2023-10-09T12:57:22.637249+0000","last_undegraded":"2023-10-09T12:57:22.637249+0000","last_fullsized":"2023-10-09T12:57:22.637249+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:44.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.600525+0000","last_change":"2023-10-09T12:57:21.597869+0000","last_active":"2023-10-09T12:57:22.600525+0000","last_peered":"2023-10-09T12:57:22.600525+0000","last_clean":"2023-10-09T12:57:22.600525+0000","last_became_active":"2023-10-09T12:57:21.597615+0000","last_became_peered":"2023-10-09T12:57:21.597615+0000","last_unstale":"2023-10-09T12:57:22.600525+0000","last_undegraded":"2023-10-09T12:57:22.600525+0000","last_fullsized":"2023-10-09T12:57:22.600525+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:30:03.683964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625201+0000","last_change":"2023-10-09T12:57:22.621208+0000","last_active":"2023-10-09T12:57:22.625201+0000","last_peered":"2023-10-09T12:57:22.625201+0000","last_clean":"2023-10-09T12:57:22.625201+0000","last_became_active":"2023-10-09T12:57:22.620851+0000","last_became_peered":"2023-10-09T12:57:22.620851+0000","last_unstale":"2023-10-09T12:57:22.625201+0000","last_undegraded":"2023-10-09T12:57:22.625201+0000","last_fullsized":"2023-10-09T12:57:22.625201+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:25.391627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"177'8","reported_seq":18,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635696+0000","last_change":"2023-10-09T12:57:21.597629+0000","last_active":"2023-10-09T12:57:22.635696+0000","last_peered":"2023-10-09T12:57:22.635696+0000","last_clean":"2023-10-09T12:57:22.635696+0000","last_became_active":"2023-10-09T12:57:21.597355+0000","last_became_peered":"2023-10-09T12:57:21.597355+0000","last_unstale":"2023-10-09T12:57:22.635696+0000","last_undegraded":"2023-10-09T12:57:22.635696+0000","last_fullsized":"2023-10-09T12:57:22.635696+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:23.097372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.631244+0000","last_change":"2023-10-09T12:57:22.624678+0000","last_active":"2023-10-09T12:57:22.631244+0000","last_peered":"2023-10-09T12:57:22.631244+0000","last_clean":"2023-10-09T12:57:22.631244+0000","last_became_active":"2023-10-09T12:57:22.624396+0000","last_became_peered":"2023-10-09T12:57:22.624396+0000","last_unstale":"2023-10-09T12:57:22.631244+0000","last_undegraded":"2023-10-09T12:57:22.631244+0000","last_fullsized":"2023-10-09T12:57:22.631244+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:28.938350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.636599+0000","last_change":"2023-10-09T12:57:21.596337+0000","last_active":"2023-10-09T12:57:22.636599+0000","last_peered":"2023-10-09T12:57:22.636599+0000","last_clean":"2023-10-09T12:57:22.636599+0000","last_became_active":"2023-10-09T12:57:21.595954+0000","last_became_peered":"2023-10-09T12:57:21.595954+0000","last_unstale":"2023-10-09T12:57:22.636599+0000","last_undegraded":"2023-10-09T12:57:22.636599+0000","last_fullsized":"2023-10-09T12:57:22.636599+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:57.308111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.636307+0000","last_change":"2023-10-09T12:57:22.632816+0000","last_active":"2023-10-09T12:57:22.636307+0000","last_peered":"2023-10-09T12:57:22.636307+0000","last_clean":"2023-10-09T12:57:22.636307+0000","last_became_active":"2023-10-09T12:57:22.632525+0000","last_became_peered":"2023-10-09T12:57:22.632525+0000","last_unstale":"2023-10-09T12:57:22.636307+0000","last_undegraded":"2023-10-09T12:57:22.636307+0000","last_fullsized":"2023-10-09T12:57:22.636307+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:31.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.628132+0000","last_change":"2023-10-09T12:57:21.606002+0000","last_active":"2023-10-09T12:57:22.628132+0000","last_peered":"2023-10-09T12:57:22.628132+0000","last_clean":"2023-10-09T12:57:22.628132+0000","last_became_active":"2023-10-09T12:57:21.605728+0000","last_became_peered":"2023-10-09T12:57:21.605728+0000","last_unstale":"2023-10-09T12:57:22.628132+0000","last_undegraded":"2023-10-09T12:57:22.628132+0000","last_fullsized":"2023-10-09T12:57:22.628132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:04.996883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.623109+0000","last_change":"2023-10-09T12:57:22.619636+0000","last_active":"2023-10-09T12:57:22.623109+0000","last_peered":"2023-10-09T12:57:22.623109+0000","last_clean":"2023-10-09T12:57:22.623109+0000","last_became_active":"2023-10-09T12:57:22.618193+0000","last_became_peered":"2023-10-09T12:57:22.618193+0000","last_unstale":"2023-10-09T12:57:22.623109+0000","last_undegraded":"2023-10-09T12:57:22.623109+0000","last_fullsized":"2023-10-09T12:57:22.623109+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:47.039631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637660+0000","last_change":"2023-10-09T12:57:21.599422+0000","last_active":"2023-10-09T12:57:22.637660+0000","last_peered":"2023-10-09T12:57:22.637660+0000","last_clean":"2023-10-09T12:57:22.637660+0000","last_became_active":"2023-10-09T12:57:21.599151+0000","last_became_peered":"2023-10-09T12:57:21.599151+0000","last_unstale":"2023-10-09T12:57:22.637660+0000","last_undegraded":"2023-10-09T12:57:22.637660+0000","last_fullsized":"2023-10-09T12:57:22.637660+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:45.965489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625242+0000","last_change":"2023-10-09T12:57:22.622000+0000","last_active":"2023-10-09T12:57:22.625242+0000","last_peered":"2023-10-09T12:57:22.625242+0000","last_clean":"2023-10-09T12:57:22.625242+0000","last_became_active":"2023-10-09T12:57:22.621737+0000","last_became_peered":"2023-10-09T12:57:22.621737+0000","last_unstale":"2023-10-09T12:57:22.625242+0000","last_undegraded":"2023-10-09T12:57:22.625242+0000","last_fullsized":"2023-10-09T12:57:22.625242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:43.225188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.604091+0000","last_change":"2023-10-09T12:57:21.605816+0000","last_active":"2023-10-09T12:57:22.604091+0000","last_peered":"2023-10-09T12:57:22.604091+0000","last_clean":"2023-10-09T12:57:22.604091+0000","last_became_active":"2023-10-09T12:57:21.605528+0000","last_became_peered":"2023-10-09T12:57:21.605528+0000","last_unstale":"2023-10-09T12:57:22.604091+0000","last_undegraded":"2023-10-09T12:57:22.604091+0000","last_fullsized":"2023-10-09T12:57:22.604091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:17.071923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.622035+0000","last_change":"2023-10-09T12:57:22.613524+0000","last_active":"2023-10-09T12:57:22.622035+0000","last_peered":"2023-10-09T12:57:22.622035+0000","last_clean":"2023-10-09T12:57:22.622035+0000","last_became_active":"2023-10-09T12:57:22.613257+0000","last_became_peered":"2023-10-09T12:57:22.613257+0000","last_unstale":"2023-10-09T12:57:22.622035+0000","last_undegraded":"2023-10-09T12:57:22.622035+0000","last_fullsized":"2023-10-09T12:57:22.622035+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:44.827709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.633437+0000","last_change":"2023-10-09T12:57:21.599237+0000","last_active":"2023-10-09T12:57:22.633437+0000","last_peered":"2023-10-09T12:57:22.633437+0000","last_clean":"2023-10-09T12:57:22.633437+0000","last_became_active":"2023-10-09T12:57:21.598939+0000","last_became_peered":"2023-10-09T12:57:21.598939+0000","last_unstale":"2023-10-09T12:57:22.633437+0000","last_undegraded":"2023-10-09T12:57:22.633437+0000","last_fullsized":"2023-10-09T12:57:22.633437+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:26.106984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616131+0000","last_change":"2023-10-09T12:57:22.615086+0000","last_active":"2023-10-09T12:57:22.616131+0000","last_peered":"2023-10-09T12:57:22.616131+0000","last_clean":"2023-10-09T12:57:22.616131+0000","last_became_active":"2023-10-09T12:57:22.614828+0000","last_became_peered":"2023-10-09T12:57:22.614828+0000","last_unstale":"2023-10-09T12:57:22.616131+0000","last_undegraded":"2023-10-09T12:57:22.616131+0000","last_fullsized":"2023-10-09T12:57:22.616131+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:46.019043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.607618+0000","last_change":"2023-10-09T12:57:21.608914+0000","last_active":"2023-10-09T12:57:22.607618+0000","last_peered":"2023-10-09T12:57:22.607618+0000","last_clean":"2023-10-09T12:57:22.607618+0000","last_became_active":"2023-10-09T12:57:21.607432+0000","last_became_peered":"2023-10-09T12:57:21.607432+0000","last_unstale":"2023-10-09T12:57:22.607618+0000","last_undegraded":"2023-10-09T12:57:22.607618+0000","last_fullsized":"2023-10-09T12:57:22.607618+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:46.034178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.615643+0000","last_change":"2023-10-09T12:57:22.612235+0000","last_active":"2023-10-09T12:57:22.615643+0000","last_peered":"2023-10-09T12:57:22.615643+0000","last_clean":"2023-10-09T12:57:22.615643+0000","last_became_active":"2023-10-09T12:57:22.611945+0000","last_became_peered":"2023-10-09T12:57:22.611945+0000","last_unstale":"2023-10-09T12:57:22.615643+0000","last_undegraded":"2023-10-09T12:57:22.615643+0000","last_fullsized":"2023-10-09T12:57:22.615643+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:09.847955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606227+0000","last_change":"2023-10-09T12:57:21.608734+0000","last_active":"2023-10-09T12:57:22.606227+0000","last_peered":"2023-10-09T12:57:22.606227+0000","last_clean":"2023-10-09T12:57:22.606227+0000","last_became_active":"2023-10-09T12:57:21.607327+0000","last_became_peered":"2023-10-09T12:57:21.607327+0000","last_unstale":"2023-10-09T12:57:22.606227+0000","last_undegraded":"2023-10-09T12:57:22.606227+0000","last_fullsized":"2023-10-09T12:57:22.606227+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:21:40.010860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616086+0000","last_change":"2023-10-09T12:57:22.615055+0000","last_active":"2023-10-09T12:57:22.616086+0000","last_peered":"2023-10-09T12:57:22.616086+0000","last_clean":"2023-10-09T12:57:22.616086+0000","last_became_active":"2023-10-09T12:57:22.614806+0000","last_became_peered":"2023-10-09T12:57:22.614806+0000","last_unstale":"2023-10-09T12:57:22.616086+0000","last_undegraded":"2023-10-09T12:57:22.616086+0000","last_fullsized":"2023-10-09T12:57:22.616086+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:32.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614277+0000","last_change":"2023-10-09T12:57:21.608126+0000","last_active":"2023-10-09T12:57:22.614277+0000","last_peered":"2023-10-09T12:57:22.614277+0000","last_clean":"2023-10-09T12:57:22.614277+0000","last_became_active":"2023-10-09T12:57:21.607849+0000","last_became_peered":"2023-10-09T12:57:21.607849+0000","last_unstale":"2023-10-09T12:57:22.614277+0000","last_undegraded":"2023-10-09T12:57:22.614277+0000","last_fullsized":"2023-10-09T12:57:22.614277+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:31.346858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.639458+0000","last_change":"2023-10-09T12:57:22.638208+0000","last_active":"2023-10-09T12:57:22.639458+0000","last_peered":"2023-10-09T12:57:22.639458+0000","last_clean":"2023-10-09T12:57:22.639458+0000","last_became_active":"2023-10-09T12:57:22.637944+0000","last_became_peered":"2023-10-09T12:57:22.637944+0000","last_unstale":"2023-10-09T12:57:22.639458+0000","last_undegraded":"2023-10-09T12:57:22.639458+0000","last_fullsized":"2023-10-09T12:57:22.639458+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:50.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.637329+0000","last_change":"2023-10-09T12:57:21.609193+0000","last_active":"2023-10-09T12:57:22.637329+0000","last_peered":"2023-10-09T12:57:22.637329+0000","last_clean":"2023-10-09T12:57:22.637329+0000","last_became_active":"2023-10-09T12:57:21.608925+0000","last_became_peered":"2023-10-09T12:57:21.608925+0000","last_unstale":"2023-10-09T12:57:22.637329+0000","last_undegraded":"2023-10-09T12:57:22.637329+0000","last_fullsized":"2023-10-09T12:57:22.637329+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:20.029626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.625440+0000","last_change":"2023-10-09T12:57:22.624135+0000","last_active":"2023-10-09T12:57:22.625440+0000","last_peered":"2023-10-09T12:57:22.625440+0000","last_clean":"2023-10-09T12:57:22.625440+0000","last_became_active":"2023-10-09T12:57:22.621946+0000","last_became_peered":"2023-10-09T12:57:22.621946+0000","last_unstale":"2023-10-09T12:57:22.625440+0000","last_undegraded":"2023-10-09T12:57:22.625440+0000","last_fullsized":"2023-10-09T12:57:22.625440+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:44.827709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601006+0000","last_change":"2023-10-09T12:57:21.604265+0000","last_active":"2023-10-09T12:57:22.601006+0000","last_peered":"2023-10-09T12:57:22.601006+0000","last_clean":"2023-10-09T12:57:22.601006+0000","last_became_active":"2023-10-09T12:57:21.603970+0000","last_became_peered":"2023-10-09T12:57:21.603970+0000","last_unstale":"2023-10-09T12:57:22.601006+0000","last_undegraded":"2023-10-09T12:57:22.601006+0000","last_fullsized":"2023-10-09T12:57:22.601006+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:04.329182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614593+0000","last_change":"2023-10-09T12:57:22.611673+0000","last_active":"2023-10-09T12:57:22.614593+0000","last_peered":"2023-10-09T12:57:22.614593+0000","last_clean":"2023-10-09T12:57:22.614593+0000","last_became_active":"2023-10-09T12:57:22.611426+0000","last_became_peered":"2023-10-09T12:57:22.611426+0000","last_unstale":"2023-10-09T12:57:22.614593+0000","last_undegraded":"2023-10-09T12:57:22.614593+0000","last_fullsized":"2023-10-09T12:57:22.614593+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:03:40.616620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.602023+0000","last_change":"2023-10-09T12:57:21.595696+0000","last_active":"2023-10-09T12:57:22.602023+0000","last_peered":"2023-10-09T12:57:22.602023+0000","last_clean":"2023-10-09T12:57:22.602023+0000","last_became_active":"2023-10-09T12:57:21.595435+0000","last_became_peered":"2023-10-09T12:57:21.595435+0000","last_unstale":"2023-10-09T12:57:22.602023+0000","last_undegraded":"2023-10-09T12:57:22.602023+0000","last_fullsized":"2023-10-09T12:57:22.602023+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:30.351371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619850+0000","last_change":"2023-10-09T12:57:22.617179+0000","last_active":"2023-10-09T12:57:22.619850+0000","last_peered":"2023-10-09T12:57:22.619850+0000","last_clean":"2023-10-09T12:57:22.619850+0000","last_became_active":"2023-10-09T12:57:22.616900+0000","last_became_peered":"2023-10-09T12:57:22.616900+0000","last_unstale":"2023-10-09T12:57:22.619850+0000","last_undegraded":"2023-10-09T12:57:22.619850+0000","last_fullsized":"2023-10-09T12:57:22.619850+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:44.819717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.601003+0000","last_change":"2023-10-09T12:57:21.596493+0000","last_active":"2023-10-09T12:57:22.601003+0000","last_peered":"2023-10-09T12:57:22.601003+0000","last_clean":"2023-10-09T12:57:22.601003+0000","last_became_active":"2023-10-09T12:57:21.596245+0000","last_became_peered":"2023-10-09T12:57:21.596245+0000","last_unstale":"2023-10-09T12:57:22.601003+0000","last_undegraded":"2023-10-09T12:57:22.601003+0000","last_fullsized":"2023-10-09T12:57:22.601003+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:21.049044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.619423+0000","last_change":"2023-10-09T12:57:22.618476+0000","last_active":"2023-10-09T12:57:22.619423+0000","last_peered":"2023-10-09T12:57:22.619423+0000","last_clean":"2023-10-09T12:57:22.619423+0000","last_became_active":"2023-10-09T12:57:22.618207+0000","last_became_peered":"2023-10-09T12:57:22.618207+0000","last_unstale":"2023-10-09T12:57:22.619423+0000","last_undegraded":"2023-10-09T12:57:22.619423+0000","last_fullsized":"2023-10-09T12:57:22.619423+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:00.884319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.606622+0000","last_change":"2023-10-09T12:57:21.600975+0000","last_active":"2023-10-09T12:57:22.606622+0000","last_peered":"2023-10-09T12:57:22.606622+0000","last_clean":"2023-10-09T12:57:22.606622+0000","last_became_active":"2023-10-09T12:57:21.600264+0000","last_became_peered":"2023-10-09T12:57:21.600264+0000","last_unstale":"2023-10-09T12:57:22.606622+0000","last_undegraded":"2023-10-09T12:57:22.606622+0000","last_fullsized":"2023-10-09T12:57:22.606622+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:12.067958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.630597+0000","last_change":"2023-10-09T12:57:22.626479+0000","last_active":"2023-10-09T12:57:22.630597+0000","last_peered":"2023-10-09T12:57:22.630597+0000","last_clean":"2023-10-09T12:57:22.630597+0000","last_became_active":"2023-10-09T12:57:22.626205+0000","last_became_peered":"2023-10-09T12:57:22.626205+0000","last_unstale":"2023-10-09T12:57:22.630597+0000","last_undegraded":"2023-10-09T12:57:22.630597+0000","last_fullsized":"2023-10-09T12:57:22.630597+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:14.886124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.607728+0000","last_change":"2023-10-09T12:57:21.609165+0000","last_active":"2023-10-09T12:57:22.607728+0000","last_peered":"2023-10-09T12:57:22.607728+0000","last_clean":"2023-10-09T12:57:22.607728+0000","last_became_active":"2023-10-09T12:57:21.608881+0000","last_became_peered":"2023-10-09T12:57:21.608881+0000","last_unstale":"2023-10-09T12:57:22.607728+0000","last_undegraded":"2023-10-09T12:57:22.607728+0000","last_fullsized":"2023-10-09T12:57:22.607728+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:20.980524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.631048+0000","last_change":"2023-10-09T12:57:22.623274+0000","last_active":"2023-10-09T12:57:22.631048+0000","last_peered":"2023-10-09T12:57:22.631048+0000","last_clean":"2023-10-09T12:57:22.631048+0000","last_became_active":"2023-10-09T12:57:22.620168+0000","last_became_peered":"2023-10-09T12:57:22.620168+0000","last_unstale":"2023-10-09T12:57:22.631048+0000","last_undegraded":"2023-10-09T12:57:22.631048+0000","last_fullsized":"2023-10-09T12:57:22.631048+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:25.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.614576+0000","last_change":"2023-10-09T12:57:21.597063+0000","last_active":"2023-10-09T12:57:22.614576+0000","last_peered":"2023-10-09T12:57:22.614576+0000","last_clean":"2023-10-09T12:57:22.614576+0000","last_became_active":"2023-10-09T12:57:21.596693+0000","last_became_peered":"2023-10-09T12:57:21.596693+0000","last_unstale":"2023-10-09T12:57:22.614576+0000","last_undegraded":"2023-10-09T12:57:22.614576+0000","last_fullsized":"2023-10-09T12:57:22.614576+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:52.392598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.635786+0000","last_change":"2023-10-09T12:57:22.633182+0000","last_active":"2023-10-09T12:57:22.635786+0000","last_peered":"2023-10-09T12:57:22.635786+0000","last_clean":"2023-10-09T12:57:22.635786+0000","last_became_active":"2023-10-09T12:57:22.627239+0000","last_became_peered":"2023-10-09T12:57:22.627239+0000","last_unstale":"2023-10-09T12:57:22.635786+0000","last_undegraded":"2023-10-09T12:57:22.635786+0000","last_fullsized":"2023-10-09T12:57:22.635786+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:55.583107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.603409+0000","last_change":"2023-10-09T12:57:21.609638+0000","last_active":"2023-10-09T12:57:22.603409+0000","last_peered":"2023-10-09T12:57:22.603409+0000","last_clean":"2023-10-09T12:57:22.603409+0000","last_became_active":"2023-10-09T12:57:21.609342+0000","last_became_peered":"2023-10-09T12:57:21.609342+0000","last_unstale":"2023-10-09T12:57:22.603409+0000","last_undegraded":"2023-10-09T12:57:22.603409+0000","last_fullsized":"2023-10-09T12:57:22.603409+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:47.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.616422+0000","last_change":"2023-10-09T12:57:22.613537+0000","last_active":"2023-10-09T12:57:22.616422+0000","last_peered":"2023-10-09T12:57:22.616422+0000","last_clean":"2023-10-09T12:57:22.616422+0000","last_became_active":"2023-10-09T12:57:22.613287+0000","last_became_peered":"2023-10-09T12:57:22.613287+0000","last_unstale":"2023-10-09T12:57:22.616422+0000","last_undegraded":"2023-10-09T12:57:22.616422+0000","last_fullsized":"2023-10-09T12:57:22.616422+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:21.577164+0000","last_clean_scrub_stamp":"2023-10-09T12:57:21.577164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:38.765063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"177'3","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.638082+0000","last_change":"2023-10-09T12:57:21.607248+0000","last_active":"2023-10-09T12:57:22.638082+0000","last_peered":"2023-10-09T12:57:22.638082+0000","last_clean":"2023-10-09T12:57:22.638082+0000","last_became_active":"2023-10-09T12:57:21.606990+0000","last_became_peered":"2023-10-09T12:57:21.606990+0000","last_unstale":"2023-10-09T12:57:22.638082+0000","last_undegraded":"2023-10-09T12:57:22.638082+0000","last_fullsized":"2023-10-09T12:57:22.638082+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T12:57:20.571710+0000","last_clean_scrub_stamp":"2023-10-09T12:57:20.571710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:25.956452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"167'293","reported_seq":919,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T12:57:22.607809+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T12:57:22.607809+0000","last_peered":"2023-10-09T12:57:22.607809+0000","last_clean":"2023-10-09T12:57:22.607809+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T12:57:22.607809+0000","last_undegraded":"2023-10-09T12:57:22.607809+0000","last_fullsized":"2023-10-09T12:57:22.607809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477642,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308224,"kb_used_data":2744,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063616,"statfs":{"total":96636764160,"available":96321142784,"internally_reserved":0,"allocated":2809856,"data_stored":1691826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35999999999999999},"max":{"1min":0.85599999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82499999999999996,"5min":0.99399999999999999,"15min":1.0820000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86399999999999999,"5min":1.204,"15min":1.204},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85199999999999998,"5min":1.165,"15min":1.6060000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.073},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.54700000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.1679999999999999,"15min":1.206},"last":0.77200000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.373},"max":{"1min":1.171,"5min":1.171,"15min":1.645},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.98799999999999999}]},{"osd":5,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.0720000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.5549999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Mon Oct 9 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.752},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":1.179,"15min":1.8100000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.03}]}]},{"osd":6,"up_from":16,"seq":68719477643,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311744,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060096,"statfs":{"total":96636764160,"available":96317538304,"internally_reserved":0,"allocated":2220032,"data_stored":1100980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.745},"min":{"1min":0.505,"5min":0.505,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.94499999999999995,"15min":1.02},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.749}]},{"osd":1,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.90800000000000003,"15min":1.0649999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.751,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":1.083},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.56999999999999995,"15min":0.46800000000000003},"max":{"1min":0.89100000000000001,"5min":0.95899999999999996,"15min":1.1259999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.96599999999999997,"15min":1.3799999999999999},"last":0.627}]},{"osd":3,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.495},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.026},"last":0.59499999999999997}]},{"osd":4,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.41299999999999998},"max":{"1min":0.83799999999999997,"5min":0.997,"15min":1.04},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44500000000000001,"15min":0.438},"max":{"1min":0.877,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.0980000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.0109999999999999,"15min":1.1200000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 9 12:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.52200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":0.997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.329},"last":0.69999999999999996}]}]},{"osd":1,"up_from":15,"seq":64424510347,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307640,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064200,"statfs":{"total":96636764160,"available":96321740800,"internally_reserved":0,"allocated":2211840,"data_stored":1101388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.84699999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.81299999999999994},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.86099999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.64700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41299999999999998},"max":{"1min":0.753,"5min":0.877,"15min":0.97299999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79800000000000004,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.22,"15min":1.22},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.501},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82599999999999996,"15min":0.81100000000000005},"min":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.22},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.56399999999999995},"max":{"1min":1.163,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.85399999999999998,"15min":0.84999999999999998},"min":{"1min":0.71199999999999997,"5min":0.64100000000000001,"15min":0.57599999999999996},"max":{"1min":1.153,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Oct 9 12:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.88,"15min":0.86399999999999999},"min":{"1min":0.69099999999999995,"5min":0.66100000000000003,"15min":0.58799999999999997},"max":{"1min":1.2310000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.49299999999999999},"max":{"1min":1.1379999999999999,"5min":1.177,"15min":1.353},"last":0.879}]}]},{"osd":0,"up_from":14,"seq":60129543050,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308232,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063608,"statfs":{"total":96636764160,"available":96321134592,"internally_reserved":0,"allocated":2818048,"data_stored":1692772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.628,"5min":1.008,"15min":1.008},"last":0.308},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.83199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.82599999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.78400000000000003,"15min":0.88400000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.83399999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95899999999999996,"5min":1.1799999999999999,"15min":1.2310000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97399999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.79800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80100000000000005,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":1.105,"15min":1.1639999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":1.1970000000000001,"15min":1.2290000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.1990000000000001},"last":0.747}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.004,"5min":1.2230000000000001,"15min":1.2709999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.208,"15min":1.208},"last":0.59299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311748,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060092,"statfs":{"total":96636764160,"available":96317534208,"internally_reserved":0,"allocated":2224128,"data_stored":1102440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":0.88600000000000001,"15min":0.91200000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73499999999999999,"5min":0.753,"15min":0.89400000000000002},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.34200000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":1.038},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.0229999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78200000000000003,"5min":0.82599999999999996,"15min":0.89800000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81200000000000006,"15min":0.80700000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46999999999999997},"max":{"1min":1.139,"5min":1.194,"15min":1.1990000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.254},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2270000000000001,"5min":1.357,"15min":1.357},"last":0.69199999999999995}]},{"osd":7,"last update":"Mon Oct 9 12:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.85699999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.373},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.66700000000000004}]}]},{"osd":3,"up_from":15,"seq":64424510347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1100924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29299999999999998},"max":{"1min":0.66800000000000004,"5min":0.75,"15min":0.82799999999999996},"last":0.317},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.88100000000000001,"15min":0.97199999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69299999999999995,"5min":0.876,"15min":0.876},"last":0.502},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42899999999999999}]},{"osd":2,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.374},"max":{"1min":0.65400000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.83199999999999996,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.083,"5min":1.2290000000000001,"15min":1.3580000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.121,"5min":1.321,"15min":1.321},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0129999999999999,"5min":1.2010000000000001,"15min":1.258},"last":0.623},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.96299999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.129,"15min":1.3200000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.1659999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.81499999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.52700000000000002},"max":{"1min":1.002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76400000000000001}]}]},{"osd":4,"up_from":16,"seq":68719477642,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299444,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072396,"statfs":{"total":96636764160,"available":96330133504,"internally_reserved":0,"allocated":2207744,"data_stored":1100834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.38400000000000001},"max":{"1min":0.79900000000000004,"5min":0.96599999999999997,"15min":1.0669999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.74299999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88500000000000001,"5min":0.96899999999999997,"15min":0.999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.92800000000000005,"5min":0.95999999999999996,"15min":1.0469999999999999},"last":0.92800000000000005}]},{"osd":2,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73499999999999999,"15min":0.75800000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94999999999999996,"5min":0.98399999999999999,"15min":1.01},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.755},"min":{"1min":0.501,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93500000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55800000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.498},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.77300000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.51500000000000001},"max":{"1min":1,"5min":1.0089999999999999,"15min":1.0329999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.374},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.626,"5min":0.623,"15min":0.629},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.071},"last":0.83099999999999996}]},{"osd":6,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.44,"15min":0.41599999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.0960000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.49099999999999999,"5min":0.46700000000000003,"15min":0.43099999999999999},"max":{"1min":1.036,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.97099999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.204},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.47099999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.98799999999999999}]}]},{"osd":5,"up_from":16,"seq":68719477642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311736,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060104,"statfs":{"total":96636764160,"available":96317546496,"internally_reserved":0,"allocated":2211840,"data_stored":1100856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.39100000000000001},"max":{"1min":0.88900000000000001,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.97499999999999998,"15min":1.0109999999999999},"last":0.66100000000000003}]},{"osd":1,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92700000000000005,"5min":0.93100000000000005,"15min":1.0800000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.01},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90400000000000003,"5min":0.98099999999999998,"15min":1.0620000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.497},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.3109999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.077},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0009999999999999,"5min":1.012,"15min":1.121},"last":0.73699999999999999}]},{"osd":4,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0109999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64400000000000002,"15min":0.624},"min":{"1min":0.38,"5min":0.38,"15min":0.36699999999999999},"max":{"1min":1.008,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51800000000000002}]},{"osd":6,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.0700000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.754,"15min":0.745},"min":{"1min":0.52000000000000002,"5min":0.49199999999999999,"15min":0.47199999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Mon Oct 9 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.71799999999999997,"15min":0.70499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0329999999999999,"5min":1.083,"15min":1.083},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.46600000000000003},"max":{"1min":0.98899999999999999,"5min":1.069,"15min":1.069},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T12:57:32.193 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T12:57:32.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T12:57:32.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.415+0000 7fe64a59d700 1 Processor -- start 2023-10-09T12:57:32.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.416+0000 7fe64a59d700 1 -- start start 2023-10-09T12:57:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.417+0000 7fe64a59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe6440caee0 0x7fe6440ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.417+0000 7fe64a59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440cbe50 con 0x7fe6441563b0 2023-10-09T12:57:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.417+0000 7fe64a59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440cb370 con 0x7fe644156780 2023-10-09T12:57:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.417+0000 7fe64a59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440cb650 con 0x7fe6440caee0 2023-10-09T12:57:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.417+0000 7fe64959b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe6441563b0 0x7fe6440ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47154/0 (socket says 172.21.15.86:47154) 2023-10-09T12:57:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.417+0000 7fe64959b700 1 -- 172.21.15.86:0/2000939098 learned_addr learned my addr 172.21.15.86:0/2000939098 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:32.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.417+0000 7fe648d9a700 1 --2- 172.21.15.86:0/2000939098 >> v2:172.21.15.135:3300/0 conn(0x7fe6440caee0 0x7fe6440ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe63bfff700 1 -- 172.21.15.86:0/2000939098 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343094595 0 0) 0x7fe6440cbe50 con 0x7fe6441563b0 2023-10-09T12:57:32.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe63bfff700 1 -- 172.21.15.86:0/2000939098 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe630003570 con 0x7fe6441563b0 2023-10-09T12:57:32.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe648d9a700 1 -- 172.21.15.86:0/2000939098 >> v1:172.21.15.135:6789/0 conn(0x7fe644156780 legacy=0x7fe6440c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe648d9a700 1 -- 172.21.15.86:0/2000939098 >> v1:172.21.15.86:6789/0 conn(0x7fe6441563b0 legacy=0x7fe6440ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe648d9a700 1 -- 172.21.15.86:0/2000939098 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440c6860 con 0x7fe6440caee0 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe648d9a700 1 --2- 172.21.15.86:0/2000939098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6440caee0 0x7fe6440ae2b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe6340098e0 tx=0x7fe6340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75d9a21e6f1c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe63bfff700 1 -- 172.21.15.86:0/2000939098 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400b640 con 0x7fe6440caee0 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe63bfff700 1 -- 172.21.15.86:0/2000939098 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63400b7a0 con 0x7fe6440caee0 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.418+0000 7fe63bfff700 1 -- 172.21.15.86:0/2000939098 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400bb40 con 0x7fe6440caee0 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.419+0000 7fe64a59d700 1 -- 172.21.15.86:0/2000939098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6440caee0 msgr2=0x7fe6440ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.419+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2000939098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6440caee0 0x7fe6440ae2b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe6340098e0 tx=0x7fe6340091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.419+0000 7fe64a59d700 1 -- 172.21.15.86:0/2000939098 shutdown_connections 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.419+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2000939098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6440caee0 0x7fe6440ae2b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.419+0000 7fe64a59d700 1 -- 172.21.15.86:0/2000939098 >> 172.21.15.86:0/2000939098 conn(0x7fe644068e20 msgr2=0x7fe6440cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.419+0000 7fe64a59d700 1 -- 172.21.15.86:0/2000939098 shutdown_connections 2023-10-09T12:57:32.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.419+0000 7fe64a59d700 1 -- 172.21.15.86:0/2000939098 wait complete. 2023-10-09T12:57:32.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.420+0000 7fe64a59d700 1 Processor -- start 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.420+0000 7fe64a59d700 1 -- start start 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.421+0000 7fe64a59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6440caee0 0x7fe6440b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.421+0000 7fe64a59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6441563b0 0x7fe64416a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.421+0000 7fe64a59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe644156780 0x7fe6440c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.421+0000 7fe64a59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe644144590 con 0x7fe644156780 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.421+0000 7fe64a59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe644169e40 con 0x7fe6441563b0 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.421+0000 7fe64a59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440b17a0 con 0x7fe6440caee0 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe644156780 0x7fe6440c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe644156780 0x7fe6440c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52372/0 (socket says 172.21.15.86:52372) 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 -- 172.21.15.86:0/2798809509 learned_addr learned my addr 172.21.15.86:0/2798809509 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:32.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe64959b700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6440caee0 0x7fe6440b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe648d9a700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6441563b0 0x7fe64416a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 -- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6440caee0 msgr2=0x7fe6440b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6440caee0 0x7fe6440b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 -- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6441563b0 msgr2=0x7fe64416a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6441563b0 0x7fe64416a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 -- 172.21.15.86:0/2798809509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe634009420 con 0x7fe644156780 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe649d9c700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe644156780 0x7fe6440c8c20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c840 tx=0x7fe63c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe6397fa700 1 -- 172.21.15.86:0/2798809509 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c012630 con 0x7fe644156780 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.422+0000 7fe6397fa700 1 -- 172.21.15.86:0/2798809509 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c0127b0 con 0x7fe644156780 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.423+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6440b1a80 con 0x7fe644156780 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.423+0000 7fe6397fa700 1 -- 172.21.15.86:0/2798809509 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c012b70 con 0x7fe644156780 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.423+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe644169b30 con 0x7fe644156780 2023-10-09T12:57:32.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.424+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6440c8990 con 0x7fe644156780 2023-10-09T12:57:32.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.424+0000 7fe6397fa700 1 -- 172.21.15.86:0/2798809509 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe63c003030 con 0x7fe644156780 2023-10-09T12:57:32.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.426+0000 7fe6397fa700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe628066f30 0x7fe6280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.426+0000 7fe6397fa700 1 -- 172.21.15.86:0/2798809509 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fe63c0847b0 con 0x7fe644156780 2023-10-09T12:57:32.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.426+0000 7fe64959b700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe628066f30 0x7fe6280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.427+0000 7fe64959b700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe628066f30 0x7fe6280693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6400058d0 tx=0x7fe640009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:32.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.430+0000 7fe6397fa700 1 -- 172.21.15.86:0/2798809509 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe63c0517c0 con 0x7fe644156780 2023-10-09T12:57:32.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.698+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe6440c2990 con 0x7fe644156780 2023-10-09T12:57:32.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.702+0000 7fe6397fa700 1 -- 172.21.15.86:0/2798809509 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v46) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe63c054de0 con 0x7fe644156780 2023-10-09T12:57:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.704+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe628066f30 msgr2=0x7fe6280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.704+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe628066f30 0x7fe6280693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6400058d0 tx=0x7fe640009040 comp rx=0 tx=0).stop 2023-10-09T12:57:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.704+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe644156780 msgr2=0x7fe6440c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.704+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe644156780 0x7fe6440c8c20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c840 tx=0x7fe63c001670 comp rx=0 tx=0).stop 2023-10-09T12:57:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 shutdown_connections 2023-10-09T12:57:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe628066f30 0x7fe6280693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe644156780 0x7fe6440c8c20 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6440caee0 0x7fe6440b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 --2- 172.21.15.86:0/2798809509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6441563b0 0x7fe64416a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 >> 172.21.15.86:0/2798809509 conn(0x7fe644068e20 msgr2=0x7fe644155540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 shutdown_connections 2023-10-09T12:57:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.705+0000 7fe64a59d700 1 -- 172.21.15.86:0/2798809509 wait complete. 2023-10-09T12:57:32.706 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T12:57:32.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T12:57:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.902+0000 7fd0b91ff700 1 Processor -- start 2023-10-09T12:57:32.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.902+0000 7fd0b91ff700 1 -- start start 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b91ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0b41578b0 0x7fd0b4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b91ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0b40af2f0 0x7fd0b40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b91ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b40ad930 con 0x7fd0b4155c10 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b91ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b40b0c80 con 0x7fd0b40af2f0 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b91ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b40acd20 con 0x7fd0b41578b0 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0b40af2f0 0x7fd0b40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0b40af2f0 0x7fd0b40af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52386/0 (socket says 172.21.15.86:52386) 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b359e700 1 -- 172.21.15.86:0/2260178925 learned_addr learned my addr 172.21.15.86:0/2260178925 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:32.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b2d9d700 1 --1- 172.21.15.86:0/2260178925 >> v1:172.21.15.86:6789/0 conn(0x7fd0b4155c10 0x7fd0b40ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47168/0 (socket says 172.21.15.86:47168) 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0abfff700 1 --2- 172.21.15.86:0/2260178925 >> v2:172.21.15.135:3300/0 conn(0x7fd0b41578b0 0x7fd0b4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b359e700 1 -- 172.21.15.86:0/2260178925 >> v2:172.21.15.135:3300/0 conn(0x7fd0b41578b0 msgr2=0x7fd0b4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b359e700 1 --2- 172.21.15.86:0/2260178925 >> v2:172.21.15.135:3300/0 conn(0x7fd0b41578b0 0x7fd0b4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b359e700 1 -- 172.21.15.86:0/2260178925 >> v1:172.21.15.86:6789/0 conn(0x7fd0b4155c10 legacy=0x7fd0b40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b359e700 1 -- 172.21.15.86:0/2260178925 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40ad000 con 0x7fd0b40af2f0 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.904+0000 7fd0b259c700 1 -- 172.21.15.86:0/2260178925 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772322132 0 0) 0x7fd0b40ad930 con 0x7fd0b4155c10 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.905+0000 7fd0b359e700 1 --2- 172.21.15.86:0/2260178925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b40af2f0 0x7fd0b40af730 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40c8c60 tx=0x7fd0ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc217fcc264e97a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.905+0000 7fd0b259c700 1 -- 172.21.15.86:0/2260178925 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00e070 con 0x7fd0b40af2f0 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.905+0000 7fd0b259c700 1 -- 172.21.15.86:0/2260178925 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac00ba50 con 0x7fd0b40af2f0 2023-10-09T12:57:32.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.905+0000 7fd0b259c700 1 -- 172.21.15.86:0/2260178925 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0092e0 con 0x7fd0b40af2f0 2023-10-09T12:57:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.905+0000 7fd0b91ff700 1 -- 172.21.15.86:0/2260178925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b40af2f0 msgr2=0x7fd0b40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.905+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/2260178925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b40af2f0 0x7fd0b40af730 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40c8c60 tx=0x7fd0ac009840 comp rx=0 tx=0).stop 2023-10-09T12:57:32.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.906+0000 7fd0b91ff700 1 -- 172.21.15.86:0/2260178925 shutdown_connections 2023-10-09T12:57:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.906+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/2260178925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b40af2f0 0x7fd0b40af730 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.906+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/2260178925 >> v2:172.21.15.135:3300/0 conn(0x7fd0b41578b0 0x7fd0b4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.906+0000 7fd0b91ff700 1 -- 172.21.15.86:0/2260178925 >> 172.21.15.86:0/2260178925 conn(0x7fd0b406a320 msgr2=0x7fd0b40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.906+0000 7fd0b91ff700 1 -- 172.21.15.86:0/2260178925 shutdown_connections 2023-10-09T12:57:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.906+0000 7fd0b91ff700 1 -- 172.21.15.86:0/2260178925 wait complete. 2023-10-09T12:57:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.907+0000 7fd0b91ff700 1 Processor -- start 2023-10-09T12:57:32.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.907+0000 7fd0b91ff700 1 -- start start 2023-10-09T12:57:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0b91ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0b40af2f0 0x7fd0b41461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0b91ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b4155c10 0x7fd0b4144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0b91ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b41578b0 0x7fd0b41428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0b91ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b414dec0 con 0x7fd0b4155c10 2023-10-09T12:57:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0b91ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b41466e0 con 0x7fd0b40af2f0 2023-10-09T12:57:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0b91ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40aa0c0 con 0x7fd0b41578b0 2023-10-09T12:57:32.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0abfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b4155c10 0x7fd0b4144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0abfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b4155c10 0x7fd0b4144710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52394/0 (socket says 172.21.15.86:52394) 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.908+0000 7fd0abfff700 1 -- 172.21.15.86:0/1573789807 learned_addr learned my addr 172.21.15.86:0/1573789807 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0b2d9d700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0b40af2f0 0x7fd0b41461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0b359e700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b41578b0 0x7fd0b41428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0abfff700 1 -- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b41578b0 msgr2=0x7fd0b41428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0abfff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b41578b0 0x7fd0b41428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0abfff700 1 -- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0b40af2f0 msgr2=0x7fd0b41461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0abfff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0b40af2f0 0x7fd0b41461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0abfff700 1 -- 172.21.15.86:0/1573789807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac009ae0 con 0x7fd0b4155c10 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0b2d9d700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0b40af2f0 0x7fd0b41461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0b359e700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b41578b0 0x7fd0b41428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:32.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0abfff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b4155c10 0x7fd0b4144710 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00d860 tx=0x7fd09c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0aaffd700 1 -- 172.21.15.86:0/1573789807 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c009610 con 0x7fd0b4155c10 2023-10-09T12:57:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0aaffd700 1 -- 172.21.15.86:0/1573789807 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c009770 con 0x7fd0b4155c10 2023-10-09T12:57:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0aaffd700 1 -- 172.21.15.86:0/1573789807 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c009b30 con 0x7fd0b4155c10 2023-10-09T12:57:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b4144c50 con 0x7fd0b4155c10 2023-10-09T12:57:32.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.909+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b40a9a70 con 0x7fd0b4155c10 2023-10-09T12:57:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.910+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b404c3c0 con 0x7fd0b4155c10 2023-10-09T12:57:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.911+0000 7fd0aaffd700 1 -- 172.21.15.86:0/1573789807 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd09c01e460 con 0x7fd0b4155c10 2023-10-09T12:57:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.912+0000 7fd0aaffd700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f30 0x7fd0940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.912+0000 7fd0aaffd700 1 -- 172.21.15.86:0/1573789807 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fd09c084dc0 con 0x7fd0b4155c10 2023-10-09T12:57:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.912+0000 7fd0b2d9d700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f30 0x7fd0940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:32.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.913+0000 7fd0b2d9d700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f30 0x7fd0940693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4145f90 tx=0x7fd0a4007cb0 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:32.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:32.916+0000 7fd0aaffd700 1 -- 172.21.15.86:0/1573789807 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd09c051dd0 con 0x7fd0b4155c10 2023-10-09T12:57:33.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.147+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0b40a98d0 con 0x7fd0b4155c10 2023-10-09T12:57:33.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.147+0000 7fd0aaffd700 1 -- 172.21.15.86:0/1573789807 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fd0b40a98d0 con 0x7fd0b4155c10 2023-10-09T12:57:33.147 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T12:57:33.148 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7391,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3278560114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3278560114},{"type":"v1","addr":"172.21.15.135:6834","nonce":3278560114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/740435858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":740435858},{"type":"v1","addr":"172.21.15.86:6833","nonce":740435858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1073483795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1073483795},{"type":"v1","addr":"172.21.15.86:6835","nonce":1073483795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:57:22.056332+0000","modified":"2023-10-09T12:57:25.626438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"d","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3750723208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3750723208},{"type":"v1","addr":"172.21.15.135:6835","nonce":3750723208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T12:57:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f30 msgr2=0x7fd0940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f30 0x7fd0940693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4145f90 tx=0x7fd0a4007cb0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b4155c10 msgr2=0x7fd0b4144710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b4155c10 0x7fd0b4144710 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00d860 tx=0x7fd09c008040 comp rx=0 tx=0).stop 2023-10-09T12:57:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 shutdown_connections 2023-10-09T12:57:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0b41578b0 0x7fd0b41428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0b40af2f0 0x7fd0b41461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fd094066f30 0x7fd0940693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 --2- 172.21.15.86:0/1573789807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0b4155c10 0x7fd0b4144710 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.149+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 >> 172.21.15.86:0/1573789807 conn(0x7fd0b406a320 msgr2=0x7fd0b40ac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.150+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 shutdown_connections 2023-10-09T12:57:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.150+0000 7fd0b91ff700 1 -- 172.21.15.86:0/1573789807 wait complete. 2023-10-09T12:57:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 78 2023-10-09T12:57:33.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T12:57:22.056332+0000', 'modified': '2023-10-09T12:57:25.626438+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9081}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9081': {'gid': 9081, 'name': 'd', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6835/3750723208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6833', 'nonce': 3750723208}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3750723208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T12:57:33.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T12:57:33.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T12:57:33.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.754+0000 7f27cb1ff700 1 Processor -- start 2023-10-09T12:57:33.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.754+0000 7f27cb1ff700 1 -- start start 2023-10-09T12:57:33.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.755+0000 7f27cb1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40cbf30 0x7f27c40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.755+0000 7f27cb1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f27c40b1420 0x7f27c40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.755+0000 7f27cb1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c40cc300 con 0x7f27c40ccf90 2023-10-09T12:57:33.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.755+0000 7f27cb1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c4156bf0 con 0x7f27c40b1420 2023-10-09T12:57:33.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.755+0000 7f27cb1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40ae950 con 0x7f27c40cbf30 2023-10-09T12:57:33.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.756+0000 7f27c8f9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40cbf30 0x7f27c40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.756+0000 7f27c979c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f27c40b1420 0x7f27c40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.756+0000 7f27c3fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f27c40ccf90 0x7f27c40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:39792/0 (socket says 172.21.15.86:39792) 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.756+0000 7f27c8f9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40cbf30 0x7f27c40ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38440/0 (socket says 172.21.15.86:38440) 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.756+0000 7f27c3fff700 1 -- 172.21.15.86:0/698322258 learned_addr learned my addr 172.21.15.86:0/698322258 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.757+0000 7f27c979c700 1 -- 172.21.15.86:0/698322258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40cbf30 msgr2=0x7f27c40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.757+0000 7f27c979c700 1 --2- 172.21.15.86:0/698322258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40cbf30 0x7f27c40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.757+0000 7f27c979c700 1 -- 172.21.15.86:0/698322258 >> v1:172.21.15.135:6789/0 conn(0x7f27c40ccf90 legacy=0x7f27c40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.757+0000 7f27c37fe700 1 -- 172.21.15.86:0/698322258 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777244833 0 0) 0x7f27c40cc300 con 0x7f27c40ccf90 2023-10-09T12:57:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.757+0000 7f27c979c700 1 -- 172.21.15.86:0/698322258 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40ad370 con 0x7f27c40b1420 2023-10-09T12:57:33.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.757+0000 7f27c979c700 1 --2- 172.21.15.86:0/698322258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40b1420 0x7f27c40c9740 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00d100 tx=0x7f27bc00b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f222aab4bb63c1d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:33.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.757+0000 7f27c37fe700 1 -- 172.21.15.86:0/698322258 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc010070 con 0x7f27c40b1420 2023-10-09T12:57:33.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27c37fe700 1 -- 172.21.15.86:0/698322258 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc00b2e0 con 0x7f27c40b1420 2023-10-09T12:57:33.759 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27c37fe700 1 -- 172.21.15.86:0/698322258 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00dd70 con 0x7f27c40b1420 2023-10-09T12:57:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 -- 172.21.15.86:0/698322258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40b1420 msgr2=0x7f27c40c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/698322258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40b1420 0x7f27c40c9740 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00d100 tx=0x7f27bc00b990 comp rx=0 tx=0).stop 2023-10-09T12:57:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 -- 172.21.15.86:0/698322258 shutdown_connections 2023-10-09T12:57:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/698322258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40cbf30 0x7f27c40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/698322258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40b1420 0x7f27c40c9740 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 -- 172.21.15.86:0/698322258 >> 172.21.15.86:0/698322258 conn(0x7f27c406a320 msgr2=0x7f27c40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:33.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 -- 172.21.15.86:0/698322258 shutdown_connections 2023-10-09T12:57:33.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.758+0000 7f27cb1ff700 1 -- 172.21.15.86:0/698322258 wait complete. 2023-10-09T12:57:33.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.760+0000 7f27cb1ff700 1 Processor -- start 2023-10-09T12:57:33.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.760+0000 7f27cb1ff700 1 -- start start 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27cb1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40b1420 0x7f27c4143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27cb1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40cbf30 0x7f27c4155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27cb1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c40ccf90 0x7f27c41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27cb1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40ace10 con 0x7f27c40ccf90 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27cb1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40ac200 con 0x7f27c40cbf30 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27cb1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40ac4e0 con 0x7f27c40b1420 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c40ccf90 0x7f27c41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c40ccf90 0x7f27c41561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52398/0 (socket says 172.21.15.86:52398) 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 -- 172.21.15.86:0/4142890948 learned_addr learned my addr 172.21.15.86:0/4142890948 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40b1420 0x7f27c4143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c3fff700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40cbf30 0x7f27c4155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 -- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40b1420 msgr2=0x7f27c4143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40b1420 0x7f27c4143e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 -- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40cbf30 msgr2=0x7f27c4155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40cbf30 0x7f27c4155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.761+0000 7f27c979c700 1 -- 172.21.15.86:0/4142890948 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc00bc30 con 0x7f27c40ccf90 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.762+0000 7f27c979c700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c40ccf90 0x7f27c41561b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f27c4064290 tx=0x7f27bc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.762+0000 7f27c0ff9700 1 -- 172.21.15.86:0/4142890948 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00dea0 con 0x7f27c40ccf90 2023-10-09T12:57:33.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.762+0000 7f27c0ff9700 1 -- 172.21.15.86:0/4142890948 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc00ae00 con 0x7f27c40ccf90 2023-10-09T12:57:33.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.762+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c40ac7c0 con 0x7f27c40ccf90 2023-10-09T12:57:33.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.762+0000 7f27c0ff9700 1 -- 172.21.15.86:0/4142890948 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc01f860 con 0x7f27c40ccf90 2023-10-09T12:57:33.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.762+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c4144370 con 0x7f27c40ccf90 2023-10-09T12:57:33.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.764+0000 7f27c0ff9700 1 -- 172.21.15.86:0/4142890948 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27bc003040 con 0x7f27c40ccf90 2023-10-09T12:57:33.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.765+0000 7f27c0ff9700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27a8066f30 0x7f27a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.765+0000 7f27c0ff9700 1 -- 172.21.15.86:0/4142890948 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f27bc088350 con 0x7f27c40ccf90 2023-10-09T12:57:33.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.765+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27a8066f30 0x7f27a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.766+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27a8066f30 0x7f27a80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009cb0 tx=0x7f27b8008040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:33.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.767+0000 7f27d98edb80 1 Processor -- start 2023-10-09T12:57:33.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.767+0000 7f27d98edb80 1 -- start start 2023-10-09T12:57:33.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681c1b050 0x55e681c1b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681bf1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681bf21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27d98edb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681b48a70 con 0x55e681bf2f80 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681b46270 con 0x55e681bf1dc0 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e681b42060 con 0x55e681c1b050 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681bf1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681bf1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52404/0 (socket says 172.21.15.86:52404) 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 -- 172.21.15.86:0/892891703 learned_addr learned my addr 172.21.15.86:0/892891703 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c979c700 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681bf21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681c1b050 0x55e681c1b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 -- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681c1b050 msgr2=0x55e681c1b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681c1b050 0x55e681c1b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 -- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 msgr2=0x55e681bf21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681bf21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.768+0000 7f27c3fff700 1 -- 172.21.15.86:0/892891703 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6819dc270 con 0x55e681bf2f80 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.769+0000 7f27c3fff700 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681bf1880 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c760 tx=0x7f27b0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fe336867c9ba3a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.769+0000 7f27adffb700 1 -- 172.21.15.86:0/892891703 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0005ab0 con 0x55e681bf2f80 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.769+0000 7f27adffb700 1 -- 172.21.15.86:0/892891703 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b0005c10 con 0x55e681bf2f80 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.769+0000 7f27adffb700 1 -- 172.21.15.86:0/892891703 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b00070d0 con 0x55e681bf2f80 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.769+0000 7f27d98edb80 1 -- 172.21.15.86:0/892891703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 msgr2=0x55e681bf1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.769+0000 7f27d98edb80 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681bf1880 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c760 tx=0x7f27b0009040 comp rx=0 tx=0).stop 2023-10-09T12:57:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 -- 172.21.15.86:0/892891703 shutdown_connections 2023-10-09T12:57:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681bf21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681c1b050 0x55e681c1b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 --2- 172.21.15.86:0/892891703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681bf1880 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 -- 172.21.15.86:0/892891703 >> 172.21.15.86:0/892891703 conn(0x55e681bf3370 msgr2=0x55e681bf3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 -- 172.21.15.86:0/892891703 shutdown_connections 2023-10-09T12:57:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 -- 172.21.15.86:0/892891703 wait complete. 2023-10-09T12:57:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.770+0000 7f27d98edb80 1 -- start start 2023-10-09T12:57:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.771+0000 7f27d98edb80 1 Processor -- start 2023-10-09T12:57:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681c31e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 0x55e681c1c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681c1b050 0x55e681c1ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27d98edb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681aed890 con 0x55e681c1b050 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681b08ea0 con 0x55e681bf1dc0 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6819c4e30 con 0x55e681bf2f80 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27d98edb80 10 client.0 _ll_register_callbacks cb 0x55e681bb5110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681c1b050 0x55e681c1ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681c1b050 0x55e681c1ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52414/0 (socket says 172.21.15.86:52414) 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 -- 172.21.15.86:0/2903639287 learned_addr learned my addr 172.21.15.86:0/2903639287 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c3fff700 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 0x55e681c1c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681c31e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 -- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 msgr2=0x55e681c1c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 0x55e681c1c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 -- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 msgr2=0x55e681c31e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681c31e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.772+0000 7f27c979c700 1 -- 172.21.15.86:0/2903639287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b000f040 con 0x55e681c1b050 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27c979c700 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681c1b050 0x55e681c1ca30 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f27bc058fb0 tx=0x7f27bc088040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b546a895915b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27a2ffd700 1 -- 172.21.15.86:0/2903639287 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc010040 con 0x55e681c1b050 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27a2ffd700 1 -- 172.21.15.86:0/2903639287 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f27bc05c270 con 0x55e681c1b050 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e681be6b70 con 0x55e681c1b050 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27a2ffd700 1 -- 172.21.15.86:0/2903639287 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27bc0093a0 con 0x55e681c1b050 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 10 client.9237 fetch_fsmap learned FSMap version 78 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e68197efe0 con 0x55e681c1b050 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27a2ffd700 1 -- 172.21.15.86:0/2903639287 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e681be6b70 con 0x55e681c1b050 2023-10-09T12:57:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27a2ffd700 1 -- 172.21.15.86:0/2903639287 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27bc059280 con 0x55e681c1b050 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 10 client.9237 fetch_fsmap finished waiting for FSMap version 78 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 10 client.9237 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 20 client.9237 populate_metadata read hostname 'smithi086' 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c14860 0x55e681c5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 4 client.9237 mds_command: new command op to 9081 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.773+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 --> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e681bc3aa0 con 0x55e681c14860 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.774+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c14860 0x55e681c5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.774+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c14860 0x55e681c5a170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84969c2ee577447c server_cookie=f867794640fbf2d1 in_seq=0 out_seq=0 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.774+0000 7f27a2ffd700 10 client.9237 ms_handle_connect on v2:172.21.15.135:6833/3750723208 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.775+0000 7f27a2ffd700 1 -- 172.21.15.86:0/2903639287 <== mds.0 v2:172.21.15.135:6833/3750723208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e681bc3aa0 con 0x55e681c14860 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.775+0000 7f27a2ffd700 10 client.9237 handle_command_reply: tid=0 2023-10-09T12:57:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.775+0000 7f27d98edb80 1 client.9237 shutdown 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681c1b050 msgr2=0x55e681c1ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681c1b050 0x55e681c1ca30 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f27bc058fb0 tx=0x7f27bc088040 comp rx=0 tx=0).stop 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 shutdown_connections 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681c1b050 0x55e681c1ca30 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c14860 0x55e681c5a170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681bf1dc0 0x55e681c31e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 --2- 172.21.15.86:0/2903639287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 0x55e681c1c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 >> 172.21.15.86:0/2903639287 conn(0x55e681bf3370 msgr2=0x55e681becc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27a2ffd700 0 client.9237 ms_handle_reset on v2:172.21.15.135:6833/3750723208 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 shutdown_connections 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 1 -- 172.21.15.86:0/2903639287 wait complete. 2023-10-09T12:57:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.776+0000 7f27d98edb80 20 client.9237 trim_cache size 0 max 16384 2023-10-09T12:57:33.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.793+0000 7f27d98edb80 1 Processor -- start 2023-10-09T12:57:33.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.793+0000 7f27d98edb80 1 -- start start 2023-10-09T12:57:33.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf1dc0 0x55e681c2fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681c300f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681c12770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27d98edb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681c32c80 con 0x55e681bf2f80 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681c21e00 con 0x55e681c1b050 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e681c1b420 con 0x55e681bf1dc0 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681c300f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681c300f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52418/0 (socket says 172.21.15.86:52418) 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c3fff700 1 -- 172.21.15.86:0/3656207520 learned_addr learned my addr 172.21.15.86:0/3656207520 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf1dc0 0x55e681c2fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c979c700 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681c12770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c3fff700 1 -- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf1dc0 msgr2=0x55e681c2fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c3fff700 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf1dc0 0x55e681c2fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.794+0000 7f27c3fff700 1 -- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 msgr2=0x55e681c12770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27c3fff700 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681c12770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27c3fff700 1 -- 172.21.15.86:0/3656207520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e681b10780 con 0x55e681bf2f80 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27c3fff700 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681c300f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f27b0014000 tx=0x7f27b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aba1b26b5b18dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27ae7fc700 1 -- 172.21.15.86:0/3656207520 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000c1c0 con 0x55e681bf2f80 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27ae7fc700 1 -- 172.21.15.86:0/3656207520 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b0007500 con 0x55e681bf2f80 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27ae7fc700 1 -- 172.21.15.86:0/3656207520 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0027480 con 0x55e681bf2f80 2023-10-09T12:57:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27d98edb80 1 -- 172.21.15.86:0/3656207520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 msgr2=0x55e681c300f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.795+0000 7f27d98edb80 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681c300f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f27b0014000 tx=0x7f27b001a000 comp rx=0 tx=0).stop 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 -- 172.21.15.86:0/3656207520 shutdown_connections 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681c12770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf1dc0 0x55e681c2fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 --2- 172.21.15.86:0/3656207520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf2f80 0x55e681c300f0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 -- 172.21.15.86:0/3656207520 >> 172.21.15.86:0/3656207520 conn(0x55e681bf3370 msgr2=0x55e681befc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 -- 172.21.15.86:0/3656207520 shutdown_connections 2023-10-09T12:57:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 -- 172.21.15.86:0/3656207520 wait complete. 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 -- start start 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.796+0000 7f27d98edb80 1 Processor -- start 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.797+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf1dc0 0x55e681c389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.797+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 0x55e681ca1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.797+0000 7f27d98edb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681ca2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.797+0000 7f27d98edb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681c38f20 con 0x55e681bf1dc0 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.797+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e681c14c50 con 0x55e681c1b050 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.797+0000 7f27d98edb80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e681ca2d10 con 0x55e681bf2f80 2023-10-09T12:57:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27d98edb80 10 client.0 _ll_register_callbacks cb 0x55e681bb5110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf1dc0 0x55e681c389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf1dc0 0x55e681c389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52434/0 (socket says 172.21.15.86:52434) 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 -- 172.21.15.86:0/839106992 learned_addr learned my addr 172.21.15.86:0/839106992 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 -- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 msgr2=0x55e681ca1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 0x55e681ca1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 -- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 msgr2=0x55e681ca2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c979c700 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681ca2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681ca2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 -- 172.21.15.86:0/839106992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6819dc270 con 0x55e681bf1dc0 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c979c700 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681ca2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27c8f9b700 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf1dc0 0x55e681c389e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f27b8015520 tx=0x7f27b8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a92c53a8999c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.798+0000 7f27a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27a2ffd700 1 -- 172.21.15.86:0/839106992 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8028040 con 0x55e681bf1dc0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27c40a5d30 con 0x55e681bf1dc0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27a2ffd700 1 -- 172.21.15.86:0/839106992 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f27b8015e20 con 0x55e681bf1dc0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27a2ffd700 1 -- 172.21.15.86:0/839106992 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27b802c830 con 0x55e681bf1dc0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 10 client.9243 fetch_fsmap learned FSMap version 78 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e681af7470 con 0x55e681bf1dc0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27a2ffd700 1 -- 172.21.15.86:0/839106992 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40a5d30 con 0x55e681bf1dc0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27a2ffd700 1 -- 172.21.15.86:0/839106992 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27b802c990 con 0x55e681bf1dc0 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 10 client.9243 fetch_fsmap finished waiting for FSMap version 78 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 10 client.9243 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T12:57:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 20 client.9243 populate_metadata read hostname 'smithi086' 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c2fc70 0x55e681c30060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 4 client.9243 mds_command: new command op to 9081 tid=0[{"prefix": "status"}] 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.799+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 --> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f27b0005c10 con 0x55e681c2fc70 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.800+0000 7f27c3fff700 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c2fc70 0x55e681c30060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.800+0000 7f27a2ffd700 10 client.9243 ms_handle_connect on v2:172.21.15.135:6833/3750723208 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.800+0000 7f27c3fff700 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c2fc70 0x55e681c30060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f7be9fd42c78ae server_cookie=463aefc375bba7a6 in_seq=0 out_seq=0 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.800+0000 7f27a2ffd700 1 -- 172.21.15.86:0/839106992 <== mds.0 v2:172.21.15.135:6833/3750723208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f27b0005c10 con 0x55e681c2fc70 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.800+0000 7f27a2ffd700 10 client.9243 handle_command_reply: tid=0 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.800+0000 7f27d98edb80 1 client.9243 shutdown 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf1dc0 msgr2=0x55e681c389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf1dc0 0x55e681c389e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f27b8015520 tx=0x7f27b8018000 comp rx=0 tx=0).stop 2023-10-09T12:57:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 shutdown_connections 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e681bf1dc0 0x55e681c389e0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:6833/3750723208,v1:172.21.15.135:6835/3750723208] conn(0x55e681c2fc70 0x55e681c30060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e681c1b050 0x55e681ca2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 --2- 172.21.15.86:0/839106992 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55e681bf2f80 0x55e681ca1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27a2ffd700 0 client.9243 ms_handle_reset on v2:172.21.15.135:6833/3750723208 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 >> 172.21.15.86:0/839106992 conn(0x55e681bf3370 msgr2=0x55e681c324d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 shutdown_connections 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 1 -- 172.21.15.86:0/839106992 wait complete. 2023-10-09T12:57:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27d98edb80 20 client.9243 trim_cache size 0 max 16384 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 9081, 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.192551228999999, 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 78, 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 178, 2023-10-09T12:57:33.808 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 178, 2023-10-09T12:57:33.809 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 16.987293364999999 2023-10-09T12:57:33.809 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T12:57:33.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27a8066f30 msgr2=0x7f27a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27a8066f30 0x7f27a80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009cb0 tx=0x7f27b8008040 comp rx=0 tx=0).stop 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c40ccf90 msgr2=0x7f27c41561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.801+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c40ccf90 0x7f27c41561b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f27c4064290 tx=0x7f27bc01a000 comp rx=0 tx=0).stop 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 shutdown_connections 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f27a8066f30 0x7f27a80693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27c40ccf90 0x7f27c41561b0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27c40b1420 0x7f27c4143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 --2- 172.21.15.86:0/4142890948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27c40cbf30 0x7f27c4155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 >> 172.21.15.86:0/4142890948 conn(0x7f27c406a320 msgr2=0x7f27c40caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 shutdown_connections 2023-10-09T12:57:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.802+0000 7f27cb1ff700 1 -- 172.21.15.86:0/4142890948 wait complete. 2023-10-09T12:57:33.819 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T12:57:33.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.998+0000 7f1b0139d700 1 Processor -- start 2023-10-09T12:57:33.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.998+0000 7f1b0139d700 1 -- start start 2023-10-09T12:57:33.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.999+0000 7f1b0139d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc159420 0x7f1afc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:34.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.999+0000 7f1b0139d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1afc15d230 0x7f1afc15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:34.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.999+0000 7f1b0139d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc15dbd0 con 0x7f1afc1597f0 2023-10-09T12:57:34.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.999+0000 7f1b0139d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc0b2980 con 0x7f1afc15d230 2023-10-09T12:57:34.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:33.999+0000 7f1b0139d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0b11d0 con 0x7f1afc159420 2023-10-09T12:57:34.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1b00b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1afc15d230 0x7f1afc15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:34.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1afbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc159420 0x7f1afc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:34.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1b00b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1afc15d230 0x7f1afc15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:41662/0 (socket says 172.21.15.86:41662) 2023-10-09T12:57:34.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1afbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc159420 0x7f1afc0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38488/0 (socket says 172.21.15.86:38488) 2023-10-09T12:57:34.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1b00b9c700 1 -- 172.21.15.86:0/1791672504 learned_addr learned my addr 172.21.15.86:0/1791672504 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:34.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1b00b9c700 1 -- 172.21.15.86:0/1791672504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc159420 msgr2=0x7f1afc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1b00b9c700 1 --2- 172.21.15.86:0/1791672504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc159420 0x7f1afc0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1b00b9c700 1 -- 172.21.15.86:0/1791672504 >> v1:172.21.15.135:6789/0 conn(0x7f1afc1597f0 legacy=0x7f1afc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.001+0000 7f1b00b9c700 1 -- 172.21.15.86:0/1791672504 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0b14b0 con 0x7f1afc15d230 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.000+0000 7f1afaffd700 1 -- 172.21.15.86:0/1791672504 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374071853 0 0) 0x7f1af0001110 con 0x7f1afc1597f0 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.001+0000 7f1b00b9c700 1 --2- 172.21.15.86:0/1791672504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc15d230 0x7f1afc15d690 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009f20 tx=0x7f1af4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f028b6744230d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.001+0000 7f1afaffd700 1 -- 172.21.15.86:0/1791672504 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400e070 con 0x7f1afc15d230 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.001+0000 7f1afaffd700 1 -- 172.21.15.86:0/1791672504 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af400b9d0 con 0x7f1afc15d230 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.001+0000 7f1afaffd700 1 -- 172.21.15.86:0/1791672504 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af40092e0 con 0x7f1afc15d230 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 -- 172.21.15.86:0/1791672504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc15d230 msgr2=0x7f1afc15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 --2- 172.21.15.86:0/1791672504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc15d230 0x7f1afc15d690 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009f20 tx=0x7f1af4009840 comp rx=0 tx=0).stop 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 -- 172.21.15.86:0/1791672504 shutdown_connections 2023-10-09T12:57:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 --2- 172.21.15.86:0/1791672504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc159420 0x7f1afc0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 --2- 172.21.15.86:0/1791672504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc15d230 0x7f1afc15d690 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 -- 172.21.15.86:0/1791672504 >> 172.21.15.86:0/1791672504 conn(0x7f1afc0d0660 msgr2=0x7f1afc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:34.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 -- 172.21.15.86:0/1791672504 shutdown_connections 2023-10-09T12:57:34.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.002+0000 7f1b0139d700 1 -- 172.21.15.86:0/1791672504 wait complete. 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.003+0000 7f1b0139d700 1 Processor -- start 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.003+0000 7f1b0139d700 1 -- start start 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1b0139d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1afc159420 0x7f1afc15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1b0139d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc1597f0 0x7f1afc0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1b0139d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc15d230 0x7f1afc069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1b0139d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c64d0 con 0x7f1afc159420 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1b0139d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c58c0 con 0x7f1afc1597f0 2023-10-09T12:57:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1b0139d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c5ba0 con 0x7f1afc15d230 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1afbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1afc159420 0x7f1afc15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1afbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1afc159420 0x7f1afc15bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52442/0 (socket says 172.21.15.86:52442) 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.004+0000 7f1afbfff700 1 -- 172.21.15.86:0/669832686 learned_addr learned my addr 172.21.15.86:0/669832686 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1b00b9c700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc15d230 0x7f1afc069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afbfff700 1 -- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc15d230 msgr2=0x7f1afc069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afbfff700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc15d230 0x7f1afc069510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afbfff700 1 -- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc1597f0 msgr2=0x7f1afc0c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afb7fe700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc1597f0 0x7f1afc0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afbfff700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc1597f0 0x7f1afc0c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afbfff700 1 -- 172.21.15.86:0/669832686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4009ae0 con 0x7f1afc159420 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1b00b9c700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc15d230 0x7f1afc069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afb7fe700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc1597f0 0x7f1afc0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1afbfff700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1afc159420 0x7f1afc15bd10 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00ec80 tx=0x7f1aec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1ae3fff700 1 -- 172.21.15.86:0/669832686 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00c9d0 con 0x7f1afc159420 2023-10-09T12:57:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.005+0000 7f1ae3fff700 1 -- 172.21.15.86:0/669832686 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00cb30 con 0x7f1afc159420 2023-10-09T12:57:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.006+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc0c5e80 con 0x7f1afc159420 2023-10-09T12:57:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.006+0000 7f1ae3fff700 1 -- 172.21.15.86:0/669832686 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec013470 con 0x7f1afc159420 2023-10-09T12:57:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.006+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc15c250 con 0x7f1afc159420 2023-10-09T12:57:34.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.007+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc04c3c0 con 0x7f1afc159420 2023-10-09T12:57:34.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.007+0000 7f1ae3fff700 1 -- 172.21.15.86:0/669832686 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1aec013820 con 0x7f1afc159420 2023-10-09T12:57:34.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.008+0000 7f1ae3fff700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae8066f30 0x7f1ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:34.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.008+0000 7f1ae3fff700 1 -- 172.21.15.86:0/669832686 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f1aec084aa0 con 0x7f1afc159420 2023-10-09T12:57:34.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.009+0000 7f1afb7fe700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae8066f30 0x7f1ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:34.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.009+0000 7f1afb7fe700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae8066f30 0x7f1ae80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0d1540 tx=0x7f1af0009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:34.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.012+0000 7f1ae3fff700 1 -- 172.21.15.86:0/669832686 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aec051b30 con 0x7f1afc159420 2023-10-09T12:57:34.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.248+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1afc0b1790 con 0x7f1afc159420 2023-10-09T12:57:34.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.248+0000 7f1ae3fff700 1 -- 172.21.15.86:0/669832686 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1aec055150 con 0x7f1afc159420 2023-10-09T12:57:34.249 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T12:57:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae8066f30 msgr2=0x7f1ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae8066f30 0x7f1ae80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0d1540 tx=0x7f1af0009040 comp rx=0 tx=0).stop 2023-10-09T12:57:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1afc159420 msgr2=0x7f1afc15bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1afc159420 0x7f1afc15bd10 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00ec80 tx=0x7f1aec0091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 shutdown_connections 2023-10-09T12:57:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f1ae8066f30 0x7f1ae80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1afc159420 0x7f1afc15bd10 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1afc15d230 0x7f1afc069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 --2- 172.21.15.86:0/669832686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1afc1597f0 0x7f1afc0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:34.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 >> 172.21.15.86:0/669832686 conn(0x7f1afc0d0660 msgr2=0x7f1afc156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:34.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 shutdown_connections 2023-10-09T12:57:34.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:34.251+0000 7f1b0139d700 1 -- 172.21.15.86:0/669832686 wait complete. 2023-10-09T12:57:34.268 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T12:57:34.268 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T12:57:34.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T12:57:34.268 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T12:57:34.268 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T12:57:34.268 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T12:57:34.269 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T12:57:34.269 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T12:57:34.269 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:57:34.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:34.269 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T12:57:34.305 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T12:57:34.305 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T12:57:34.305 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T12:57:34.305 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:57:34.305 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:57:34.306 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 37689sec preferred_lft 37689sec 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T12:57:34.307 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T12:57:34.308 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:57:34.308 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T12:57:34.308 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T12:57:34.308 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T12:57:34.308 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T12:57:34.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:34.308 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T12:57:34.405 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T12:57:34.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:34.408 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T12:57:34.445 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T12:57:34.445 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T12:57:34.445 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T12:57:34.445 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T12:57:34.445 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T12:57:34.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:34.447 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T12:57:34.447 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T12:57:34.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T12:57:34.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T12:57:34.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T12:57:34.447 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T12:57:34.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:34.642 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T12:57:34.677 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T12:57:34.677 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T12:57:34.678 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:57:34.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:34.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T12:57:34.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T12:57:34.778 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T12:57:34.814 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T12:57:34.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T12:57:34.815 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T12:57:34.889 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T12:57:34.890 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T12:57:34.890 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:57:35.020 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:57:35.020 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T12:57:35.050 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T12:57:35.050 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T12:57:35.051 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T12:57:35.051 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T12:57:35.051 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T12:57:35.056 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T12:57:35.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T12:57:35.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T12:57:35.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T12:57:35.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.300+0000 7fa99b3ff700 1 Processor -- start 2023-10-09T12:57:35.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.300+0000 7fa99b3ff700 1 -- start start 2023-10-09T12:57:35.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.301+0000 7fa99b3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9940ccf90 0x7fa9940ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.301+0000 7fa99b3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9940cc300 con 0x7fa9940b1420 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.301+0000 7fa99b3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9940ad370 con 0x7fa9940cbf30 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.301+0000 7fa99b3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa994156bf0 con 0x7fa9940ccf90 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa99999c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9940ccf90 0x7fa9940ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa99899a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa9940b1420 0x7fa9940c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43718/0 (socket says 172.21.15.86:43718) 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa99899a700 1 -- 172.21.15.86:0/152776628 learned_addr learned my addr 172.21.15.86:0/152776628 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa99999c700 1 -- 172.21.15.86:0/152776628 >> v1:172.21.15.135:6789/0 conn(0x7fa9940cbf30 legacy=0x7fa9940b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa99999c700 1 -- 172.21.15.86:0/152776628 >> v1:172.21.15.86:6789/0 conn(0x7fa9940b1420 legacy=0x7fa9940c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa99999c700 1 -- 172.21.15.86:0/152776628 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9940ad650 con 0x7fa9940ccf90 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa98bfff700 1 -- 172.21.15.86:0/152776628 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610488430 0 0) 0x7fa9940cc300 con 0x7fa9940b1420 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa99999c700 1 --2- 172.21.15.86:0/152776628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940ae410 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009e60 tx=0x7fa98c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57655e8722ae09ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:35.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.302+0000 7fa98bfff700 1 -- 172.21.15.86:0/152776628 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c00e070 con 0x7fa9940ccf90 2023-10-09T12:57:35.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa98bfff700 1 -- 172.21.15.86:0/152776628 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c00bc30 con 0x7fa9940ccf90 2023-10-09T12:57:35.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa98bfff700 1 -- 172.21.15.86:0/152776628 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c012430 con 0x7fa9940ccf90 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa99b3ff700 1 -- 172.21.15.86:0/152776628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 msgr2=0x7fa9940ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/152776628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940ae410 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009e60 tx=0x7fa98c009780 comp rx=0 tx=0).stop 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa99b3ff700 1 -- 172.21.15.86:0/152776628 shutdown_connections 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/152776628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940ae410 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa99b3ff700 1 -- 172.21.15.86:0/152776628 >> 172.21.15.86:0/152776628 conn(0x7fa99406a320 msgr2=0x7fa9940cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa99b3ff700 1 -- 172.21.15.86:0/152776628 shutdown_connections 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.303+0000 7fa99b3ff700 1 -- 172.21.15.86:0/152776628 wait complete. 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.305+0000 7fa99b3ff700 1 Processor -- start 2023-10-09T12:57:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.305+0000 7fa99b3ff700 1 -- start start 2023-10-09T12:57:35.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.305+0000 7fa99b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9940b1420 0x7fa9940c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.305+0000 7fa99b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9940cbf30 0x7fa9940c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99b3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99b3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940c5950 con 0x7fa9940ccf90 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940c72a0 con 0x7fa9940cbf30 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940c7540 con 0x7fa9940b1420 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35182/0 (socket says 172.21.15.86:35182) 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 -- 172.21.15.86:0/1482147691 learned_addr learned my addr 172.21.15.86:0/1482147691 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99919b700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9940b1420 0x7fa9940c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 -- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9940b1420 msgr2=0x7fa9940c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9940b1420 0x7fa9940c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 -- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9940cbf30 msgr2=0x7fa9940c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.308 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99899a700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9940cbf30 0x7fa9940c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9940cbf30 0x7fa9940c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 -- 172.21.15.86:0/1482147691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c009a20 con 0x7fa9940ccf90 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99919b700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9940b1420 0x7fa9940c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99899a700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9940cbf30 0x7fa9940c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.306+0000 7fa99999c700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940c85e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa994064290 tx=0x7fa98c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.307+0000 7fa9897fa700 1 -- 172.21.15.86:0/1482147691 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c01b630 con 0x7fa9940ccf90 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.307+0000 7fa9897fa700 1 -- 172.21.15.86:0/1482147691 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c01b790 con 0x7fa9940ccf90 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.307+0000 7fa9897fa700 1 -- 172.21.15.86:0/1482147691 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c01bb50 con 0x7fa9940ccf90 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.307+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9940c7820 con 0x7fa9940ccf90 2023-10-09T12:57:35.309 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.307+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9940c80c0 con 0x7fa9940ccf90 2023-10-09T12:57:35.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.308+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9940c82e0 con 0x7fa9940ccf90 2023-10-09T12:57:35.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.309+0000 7fa9897fa700 1 -- 172.21.15.86:0/1482147691 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa98c01c400 con 0x7fa9940ccf90 2023-10-09T12:57:35.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.309+0000 7fa9897fa700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.310+0000 7fa9897fa700 1 -- 172.21.15.86:0/1482147691 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fa98c086770 con 0x7fa9940ccf90 2023-10-09T12:57:35.310 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.310+0000 7fa99919b700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.311 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.310+0000 7fa99919b700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa978066f30 0x7fa9780693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa990001840 tx=0x7fa990009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:35.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.314+0000 7fa9897fa700 1 -- 172.21.15.86:0/1482147691 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa98c053780 con 0x7fa9940ccf90 2023-10-09T12:57:35.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.531+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa99404c3c0 con 0x7fa978066f30 2023-10-09T12:57:35.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.533+0000 7fa9897fa700 1 -- 172.21.15.86:0/1482147691 <== mgr.8883 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa99404c3c0 con 0x7fa978066f30 2023-10-09T12:57:35.533 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T12:57:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T12:57:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T12:57:35.533 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T12:57:35.533 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T12:57:35.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa978066f30 msgr2=0x7fa9780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa978066f30 0x7fa9780693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa990001840 tx=0x7fa990009040 comp rx=0 tx=0).stop 2023-10-09T12:57:35.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 msgr2=0x7fa9940c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940c85e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa994064290 tx=0x7fa98c019000 comp rx=0 tx=0).stop 2023-10-09T12:57:35.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 shutdown_connections 2023-10-09T12:57:35.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9940ccf90 0x7fa9940c85e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9940b1420 0x7fa9940c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 --2- 172.21.15.86:0/1482147691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9940cbf30 0x7fa9940c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 >> 172.21.15.86:0/1482147691 conn(0x7fa99406a320 msgr2=0x7fa99406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:35.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 shutdown_connections 2023-10-09T12:57:35.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.535+0000 7fa99b3ff700 1 -- 172.21.15.86:0/1482147691 wait complete. 2023-10-09T12:57:35.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T12:57:35.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.734+0000 7fe518dff700 1 Processor -- start 2023-10-09T12:57:35.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.735+0000 7fe518dff700 1 -- start start 2023-10-09T12:57:35.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe518dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5140ccee0 0x7fe5141561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe518dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51415b0d0 con 0x7fe5140c87c0 2023-10-09T12:57:35.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe518dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51415a4c0 con 0x7fe5140c83f0 2023-10-09T12:57:35.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe518dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51415a7a0 con 0x7fe5140ccee0 2023-10-09T12:57:35.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe511d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5140ccee0 0x7fe5141561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe511d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5140ccee0 0x7fe5141561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35194/0 (socket says 172.21.15.86:35194) 2023-10-09T12:57:35.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe511d9b700 1 -- 172.21.15.86:0/1687251410 learned_addr learned my addr 172.21.15.86:0/1687251410 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:35.737 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.736+0000 7fe512d9d700 1 --1- 172.21.15.86:0/1687251410 >> v1:172.21.15.86:6789/0 conn(0x7fe5140c87c0 0x7fe5140ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43734/0 (socket says 172.21.15.86:43734) 2023-10-09T12:57:35.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.737+0000 7fe511d9b700 1 -- 172.21.15.86:0/1687251410 >> v1:172.21.15.135:6789/0 conn(0x7fe5140c83f0 legacy=0x7fe5140c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.737+0000 7fe511d9b700 1 -- 172.21.15.86:0/1687251410 >> v1:172.21.15.86:6789/0 conn(0x7fe5140c87c0 legacy=0x7fe5140ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.737+0000 7fe511d9b700 1 -- 172.21.15.86:0/1687251410 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51415aa80 con 0x7fe5140ccee0 2023-10-09T12:57:35.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.737+0000 7fe511d9b700 1 --2- 172.21.15.86:0/1687251410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5141561d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe5080099b0 tx=0x7fe508009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0ef9975c0f067a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:35.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.737+0000 7fe51159a700 1 -- 172.21.15.86:0/1687251410 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800b860 con 0x7fe5140ccee0 2023-10-09T12:57:35.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.737+0000 7fe51159a700 1 -- 172.21.15.86:0/1687251410 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50800b9c0 con 0x7fe5140ccee0 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.737+0000 7fe51159a700 1 -- 172.21.15.86:0/1687251410 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800bd60 con 0x7fe5140ccee0 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.738+0000 7fe518dff700 1 -- 172.21.15.86:0/1687251410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 msgr2=0x7fe5141561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.738+0000 7fe518dff700 1 --2- 172.21.15.86:0/1687251410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5141561d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe5080099b0 tx=0x7fe508009250 comp rx=0 tx=0).stop 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.738+0000 7fe518dff700 1 -- 172.21.15.86:0/1687251410 shutdown_connections 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.738+0000 7fe518dff700 1 --2- 172.21.15.86:0/1687251410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5141561d0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.738+0000 7fe518dff700 1 -- 172.21.15.86:0/1687251410 >> 172.21.15.86:0/1687251410 conn(0x7fe514068e10 msgr2=0x7fe5140cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.738+0000 7fe518dff700 1 -- 172.21.15.86:0/1687251410 shutdown_connections 2023-10-09T12:57:35.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.738+0000 7fe518dff700 1 -- 172.21.15.86:0/1687251410 wait complete. 2023-10-09T12:57:35.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.739+0000 7fe518dff700 1 Processor -- start 2023-10-09T12:57:35.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.739+0000 7fe518dff700 1 -- start start 2023-10-09T12:57:35.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.740+0000 7fe518dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5140c83f0 0x7fe51414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.740+0000 7fe518dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5140c87c0 0x7fe514153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.740+0000 7fe518dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5140c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.740+0000 7fe518dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514166040 con 0x7fe5140ccee0 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.740+0000 7fe518dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514166880 con 0x7fe5140c87c0 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.740+0000 7fe518dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe514153b00 con 0x7fe5140c83f0 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.740+0000 7fe512d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5140c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5140c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35210/0 (socket says 172.21.15.86:35210) 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 -- 172.21.15.86:0/424804252 learned_addr learned my addr 172.21.15.86:0/424804252 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe511d9b700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5140c87c0 0x7fe514153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.742 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe51259c700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5140c83f0 0x7fe51414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 -- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5140c83f0 msgr2=0x7fe51414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5140c83f0 0x7fe51414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 -- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5140c87c0 msgr2=0x7fe514153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5140c87c0 0x7fe514153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 -- 172.21.15.86:0/424804252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080094f0 con 0x7fe5140ccee0 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe511d9b700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5140c87c0 0x7fe514153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe51259c700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5140c83f0 0x7fe51414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe512d9d700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5140c5860 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00cd00 tx=0x7fe50c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c005df0 con 0x7fe5140ccee0 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c00a960 con 0x7fe5140ccee0 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00ad00 con 0x7fe5140ccee0 2023-10-09T12:57:35.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.741+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe514166230 con 0x7fe5140ccee0 2023-10-09T12:57:35.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.742+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51414e870 con 0x7fe5140ccee0 2023-10-09T12:57:35.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.743+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5141669f0 con 0x7fe5140ccee0 2023-10-09T12:57:35.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.743+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 83) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe50c007300 con 0x7fe5140ccee0 2023-10-09T12:57:35.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.744+0000 7fe5027fc700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe4f4066f30 0x7fe4f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:35.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.745+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7fe50c0848e0 con 0x7fe5140ccee0 2023-10-09T12:57:35.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.745+0000 7fe51259c700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe4f4066f30 0x7fe4f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:35.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.745+0000 7fe51259c700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe4f4066f30 0x7fe4f40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5040017d0 tx=0x7fe504009040 comp rx=0 tx=0).ready entity=mgr.8883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:35.748 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.748+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe50c051970 con 0x7fe5140ccee0 2023-10-09T12:57:35.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:35.991+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe51404c3c0 con 0x7fe5140ccee0 2023-10-09T12:57:36.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.219+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 84) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fe50c051d40 con 0x7fe5140ccee0 2023-10-09T12:57:36.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.220+0000 7fe5027fc700 1 -- 172.21.15.86:0/424804252 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v84) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe50c051970 con 0x7fe5140ccee0 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe4f4066f30 msgr2=0x7fe4f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe4f4066f30 0x7fe4f40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5040017d0 tx=0x7fe504009040 comp rx=0 tx=0).stop 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 msgr2=0x7fe5140c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5140c5860 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00cd00 tx=0x7fe50c001b10 comp rx=0 tx=0).stop 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 shutdown_connections 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7fe4f4066f30 0x7fe4f40693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5140ccee0 0x7fe5140c5860 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5140c83f0 0x7fe51414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 --2- 172.21.15.86:0/424804252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5140c87c0 0x7fe514153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 >> 172.21.15.86:0/424804252 conn(0x7fe514068e10 msgr2=0x7fe51414eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 shutdown_connections 2023-10-09T12:57:36.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.223+0000 7fe518dff700 1 -- 172.21.15.86:0/424804252 wait complete. 2023-10-09T12:57:36.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T12:57:36.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.433+0000 7f5aebfff700 1 Processor -- start 2023-10-09T12:57:36.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.433+0000 7f5aebfff700 1 -- start start 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.434+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec0b4e70 0x7f5aec0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.434+0000 7f5aebfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5aec0b16d0 0x7f5aec0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.434+0000 7f5aebfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec0b2080 con 0x7f5aec15d240 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.434+0000 7f5aebfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aec0cfb00 con 0x7f5aec0b16d0 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.434+0000 7f5aebfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0b5c40 con 0x7f5aec0b4e70 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aea7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5aec0b16d0 0x7f5aec0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aea7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5aec0b16d0 0x7f5aec0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35236/0 (socket says 172.21.15.86:35236) 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aeaffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec0b4e70 0x7f5aec0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aea7fc700 1 -- 172.21.15.86:0/1849938963 learned_addr learned my addr 172.21.15.86:0/1849938963 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aeaffd700 1 -- 172.21.15.86:0/1849938963 >> v2:172.21.15.86:3300/0 conn(0x7f5aec0b16d0 msgr2=0x7f5aec0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:36.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aeaffd700 1 --2- 172.21.15.86:0/1849938963 >> v2:172.21.15.86:3300/0 conn(0x7f5aec0b16d0 0x7f5aec0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aeaffd700 1 -- 172.21.15.86:0/1849938963 >> v1:172.21.15.135:6789/0 conn(0x7f5aec15d240 legacy=0x7f5aec15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aeaffd700 1 -- 172.21.15.86:0/1849938963 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec0b5f20 con 0x7f5aec0b4e70 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aea7fc700 1 --2- 172.21.15.86:0/1849938963 >> v2:172.21.15.86:3300/0 conn(0x7f5aec0b16d0 0x7f5aec0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5ae9ffb700 1 -- 172.21.15.86:0/1849938963 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616986433 0 0) 0x7f5aec0b2080 con 0x7f5aec15d240 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.435+0000 7f5aeaffd700 1 --2- 172.21.15.86:0/1849938963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec0b4e70 0x7f5aec0ccff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0098e0 tx=0x7f5adc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86f11101dd6504e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5ae9ffb700 1 -- 172.21.15.86:0/1849938963 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00b640 con 0x7f5aec0b4e70 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5ae9ffb700 1 -- 172.21.15.86:0/1849938963 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc00b7a0 con 0x7f5aec0b4e70 2023-10-09T12:57:36.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5ae9ffb700 1 -- 172.21.15.86:0/1849938963 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00bb40 con 0x7f5aec0b4e70 2023-10-09T12:57:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 -- 172.21.15.86:0/1849938963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec0b4e70 msgr2=0x7f5aec0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 --2- 172.21.15.86:0/1849938963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec0b4e70 0x7f5aec0ccff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0098e0 tx=0x7f5adc0091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 -- 172.21.15.86:0/1849938963 shutdown_connections 2023-10-09T12:57:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 --2- 172.21.15.86:0/1849938963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec0b4e70 0x7f5aec0ccff0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 --2- 172.21.15.86:0/1849938963 >> v2:172.21.15.86:3300/0 conn(0x7f5aec0b16d0 0x7f5aec0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 -- 172.21.15.86:0/1849938963 >> 172.21.15.86:0/1849938963 conn(0x7f5aec0d10c0 msgr2=0x7f5aec0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 -- 172.21.15.86:0/1849938963 shutdown_connections 2023-10-09T12:57:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.436+0000 7f5aebfff700 1 -- 172.21.15.86:0/1849938963 wait complete. 2023-10-09T12:57:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.438+0000 7f5aebfff700 1 Processor -- start 2023-10-09T12:57:36.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.438+0000 7f5aebfff700 1 -- start start 2023-10-09T12:57:36.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5aec0b16d0 0x7f5aec0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aec0b4e70 0x7f5aec1449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec15d240 0x7f5aec0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aebfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0cbf60 con 0x7f5aec0b16d0 2023-10-09T12:57:36.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aebfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0cc240 con 0x7f5aec0b4e70 2023-10-09T12:57:36.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aebfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec15d920 con 0x7f5aec15d240 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5aec0b16d0 0x7f5aec0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5aec0b16d0 0x7f5aec0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35246/0 (socket says 172.21.15.86:35246) 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 -- 172.21.15.86:0/3436588330 learned_addr learned my addr 172.21.15.86:0/3436588330 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aea7fc700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aec0b4e70 0x7f5aec1449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeb7fe700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec15d240 0x7f5aec0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 -- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec15d240 msgr2=0x7f5aec0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec15d240 0x7f5aec0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 -- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aec0b4e70 msgr2=0x7f5aec1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aec0b4e70 0x7f5aec1449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.439+0000 7f5aeaffd700 1 -- 172.21.15.86:0/3436588330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00094f0 con 0x7f5aec0b16d0 2023-10-09T12:57:36.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.440+0000 7f5aeaffd700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5aec0b16d0 0x7f5aec0cb6c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0093f0 tx=0x7f5adc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.440+0000 7f5ad2ffd700 1 -- 172.21.15.86:0/3436588330 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc01f070 con 0x7f5aec0b16d0 2023-10-09T12:57:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.440+0000 7f5ad2ffd700 1 -- 172.21.15.86:0/3436588330 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc00b910 con 0x7f5aec0b16d0 2023-10-09T12:57:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.440+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc009420 con 0x7f5aec0b16d0 2023-10-09T12:57:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.440+0000 7f5ad2ffd700 1 -- 172.21.15.86:0/3436588330 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc011420 con 0x7f5aec0b16d0 2023-10-09T12:57:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.440+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec15dee0 con 0x7f5aec0b16d0 2023-10-09T12:57:36.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.441+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec088990 con 0x7f5aec0b16d0 2023-10-09T12:57:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.442+0000 7f5ad2ffd700 1 -- 172.21.15.86:0/3436588330 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 84) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f5adc0117d0 con 0x7f5aec0b16d0 2023-10-09T12:57:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.443+0000 7f5ad2ffd700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 0x7f5ad8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.443+0000 7f5aea7fc700 1 -- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 msgr2=0x7f5ad8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.444+0000 7f5ad2ffd700 1 -- 172.21.15.86:0/3436588330 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f5adc085b30 con 0x7f5aec0b16d0 2023-10-09T12:57:36.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.444+0000 7f5aea7fc700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 0x7f5ad8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:36.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.448+0000 7f5ad2ffd700 1 -- 172.21.15.86:0/3436588330 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5adc052b40 con 0x7f5aec0b16d0 2023-10-09T12:57:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.645+0000 7f5aea7fc700 1 -- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 msgr2=0x7f5ad8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:36.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.645+0000 7f5aea7fc700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 0x7f5ad8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:36.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.648+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5aec04bb80 con 0x7f5aec0b16d0 2023-10-09T12:57:36.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.654+0000 7f5ad2ffd700 1 -- 172.21.15.86:0/3436588330 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5adc056160 con 0x7f5aec0b16d0 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 msgr2=0x7f5ad8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 0x7f5ad8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5aec0b16d0 msgr2=0x7f5aec0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5aec0b16d0 0x7f5aec0cb6c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0093f0 tx=0x7f5adc017000 comp rx=0 tx=0).stop 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 shutdown_connections 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f5ad8066f80 0x7f5ad8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5aec0b16d0 0x7f5aec0cb6c0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aec15d240 0x7f5aec0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 --2- 172.21.15.86:0/3436588330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aec0b4e70 0x7f5aec1449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.656+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 >> 172.21.15.86:0/3436588330 conn(0x7f5aec0d10c0 msgr2=0x7f5aec069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:36.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.657+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 shutdown_connections 2023-10-09T12:57:36.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.657+0000 7f5aebfff700 1 -- 172.21.15.86:0/3436588330 wait complete. 2023-10-09T12:57:36.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T12:57:36.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.864+0000 7f656f1ff700 1 Processor -- start 2023-10-09T12:57:36.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.864+0000 7f656f1ff700 1 -- start start 2023-10-09T12:57:36.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.865+0000 7f656f1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6568159c60 0x7f656815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.865+0000 7f656f1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656815a160 con 0x7f656815db10 2023-10-09T12:57:36.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.865+0000 7f656f1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65680d13a0 con 0x7f6568159890 2023-10-09T12:57:36.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.865+0000 7f656f1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656815df50 con 0x7f6568159c60 2023-10-09T12:57:36.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.865+0000 7f656d79c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f656815db10 0x7f6568069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43738/0 (socket says 172.21.15.86:43738) 2023-10-09T12:57:36.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.865+0000 7f656d79c700 1 -- 172.21.15.86:0/3980607957 learned_addr learned my addr 172.21.15.86:0/3980607957 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:36.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.865+0000 7f6567fff700 1 --2- 172.21.15.86:0/3980607957 >> v2:172.21.15.135:3300/0 conn(0x7f6568159c60 0x7f656815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f65677fe700 1 -- 172.21.15.86:0/3980607957 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450390144 0 0) 0x7f656815a160 con 0x7f656815db10 2023-10-09T12:57:36.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f65677fe700 1 -- 172.21.15.86:0/3980607957 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6558003570 con 0x7f656815db10 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f6567fff700 1 -- 172.21.15.86:0/3980607957 >> v1:172.21.15.135:6789/0 conn(0x7f6568159890 legacy=0x7f656815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f6567fff700 1 -- 172.21.15.86:0/3980607957 >> v1:172.21.15.86:6789/0 conn(0x7f656815db10 legacy=0x7f6568069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f6567fff700 1 -- 172.21.15.86:0/3980607957 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656815e140 con 0x7f6568159c60 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f6567fff700 1 --2- 172.21.15.86:0/3980607957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 0x7f656815d5d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f65540098e0 tx=0x7f65540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5386e2c42b0934ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f65677fe700 1 -- 172.21.15.86:0/3980607957 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400b640 con 0x7f6568159c60 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f65677fe700 1 -- 172.21.15.86:0/3980607957 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655400b7a0 con 0x7f6568159c60 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.866+0000 7f65677fe700 1 -- 172.21.15.86:0/3980607957 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400bb40 con 0x7f6568159c60 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.867+0000 7f656f1ff700 1 -- 172.21.15.86:0/3980607957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 msgr2=0x7f656815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.867+0000 7f656f1ff700 1 --2- 172.21.15.86:0/3980607957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 0x7f656815d5d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f65540098e0 tx=0x7f65540091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.867+0000 7f656f1ff700 1 -- 172.21.15.86:0/3980607957 shutdown_connections 2023-10-09T12:57:36.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.867+0000 7f656f1ff700 1 --2- 172.21.15.86:0/3980607957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 0x7f656815d5d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.867+0000 7f656f1ff700 1 -- 172.21.15.86:0/3980607957 >> 172.21.15.86:0/3980607957 conn(0x7f6568068e20 msgr2=0x7f65680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:36.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.867+0000 7f656f1ff700 1 -- 172.21.15.86:0/3980607957 shutdown_connections 2023-10-09T12:57:36.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.867+0000 7f656f1ff700 1 -- 172.21.15.86:0/3980607957 wait complete. 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.868+0000 7f656f1ff700 1 Processor -- start 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.869+0000 7f656f1ff700 1 -- start start 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.869+0000 7f656f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6568159890 0x7f656813eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.869+0000 7f656f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 0x7f65680cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656f1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656815db10 0x7f65680ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656f1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65680ce520 con 0x7f656815db10 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656813f0b0 con 0x7f6568159c60 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65680cd640 con 0x7f6568159890 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656815db10 0x7f65680ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656815db10 0x7f65680ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35258/0 (socket says 172.21.15.86:35258) 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 -- 172.21.15.86:0/1319160570 learned_addr learned my addr 172.21.15.86:0/1319160570 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656cf9b700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6568159890 0x7f656813eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f6567fff700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 0x7f65680cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 -- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6568159890 msgr2=0x7f656813eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6568159890 0x7f656813eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 -- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 msgr2=0x7f65680cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 0x7f65680cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 -- 172.21.15.86:0/1319160570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6554009420 con 0x7f656815db10 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.870+0000 7f656d79c700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656815db10 0x7f65680ce9b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f6560001460 tx=0x7f6560001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.871+0000 7f6564ff9700 1 -- 172.21.15.86:0/1319160570 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000a870 con 0x7f656815db10 2023-10-09T12:57:36.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.871+0000 7f6564ff9700 1 -- 172.21.15.86:0/1319160570 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000a9d0 con 0x7f656815db10 2023-10-09T12:57:36.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.871+0000 7f6564ff9700 1 -- 172.21.15.86:0/1319160570 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000ad50 con 0x7f656815db10 2023-10-09T12:57:36.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.871+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65680cd910 con 0x7f656815db10 2023-10-09T12:57:36.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.871+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65680cded0 con 0x7f656815db10 2023-10-09T12:57:36.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.872+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65680ce690 con 0x7f656815db10 2023-10-09T12:57:36.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.873+0000 7f6564ff9700 1 -- 172.21.15.86:0/1319160570 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 84) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6560007300 con 0x7f656815db10 2023-10-09T12:57:36.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.874+0000 7f6564ff9700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 0x7f654c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:36.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.874+0000 7f6564ff9700 1 -- 172.21.15.86:0/1319160570 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f6560084b00 con 0x7f656815db10 2023-10-09T12:57:36.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.874+0000 7f656cf9b700 1 -- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 msgr2=0x7f654c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:36.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.874+0000 7f656cf9b700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 0x7f654c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:36.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:36.878+0000 7f6564ff9700 1 -- 172.21.15.86:0/1319160570 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6560086e60 con 0x7f656815db10 2023-10-09T12:57:37.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.074+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f656804c3c0 con 0x7f656815db10 2023-10-09T12:57:37.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.075+0000 7f656cf9b700 1 -- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 msgr2=0x7f654c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:37.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.075+0000 7f656cf9b700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 0x7f654c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:37.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.080+0000 7f6564ff9700 1 -- 172.21.15.86:0/1319160570 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6560055650 con 0x7f656815db10 2023-10-09T12:57:37.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 msgr2=0x7f654c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:37.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 0x7f654c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656815db10 msgr2=0x7f65680ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656815db10 0x7f65680ce9b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f6560001460 tx=0x7f6560001a40 comp rx=0 tx=0).stop 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 shutdown_connections 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f654c066f80 0x7f654c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656815db10 0x7f65680ce9b0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6568159890 0x7f656813eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 --2- 172.21.15.86:0/1319160570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6568159c60 0x7f65680cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 >> 172.21.15.86:0/1319160570 conn(0x7f6568068e20 msgr2=0x7f656815aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 shutdown_connections 2023-10-09T12:57:37.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.083+0000 7f656f1ff700 1 -- 172.21.15.86:0/1319160570 wait complete. 2023-10-09T12:57:37.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:57:37.101 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T12:57:37.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T12:57:37.142 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-10-09T12:57:37.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T12:57:37.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.450+0000 7f07ee39d700 1 Processor -- start 2023-10-09T12:57:37.450 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.450+0000 7f07ee39d700 1 -- start start 2023-10-09T12:57:37.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ee39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07e80b0790 0x7f07e80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:37.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ee39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e81591e0 0x7f07e8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:37.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ee39d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e80cfa00 con 0x7f07e80b03c0 2023-10-09T12:57:37.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ee39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80cb580 con 0x7f07e80b0790 2023-10-09T12:57:37.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ee39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80cf160 con 0x7f07e81591e0 2023-10-09T12:57:37.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ed39b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f07e80b03c0 0x7f07e80b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:43754/0 (socket says 172.21.15.86:43754) 2023-10-09T12:57:37.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ed39b700 1 -- 172.21.15.86:0/3384371225 learned_addr learned my addr 172.21.15.86:0/3384371225 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T12:57:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07ecb9a700 1 --2- 172.21.15.86:0/3384371225 >> v2:172.21.15.135:3300/0 conn(0x7f07e80b0790 0x7f07e80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.451+0000 7f07edb9c700 1 --2- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e81591e0 0x7f07e8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:37.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07dffff700 1 -- 172.21.15.86:0/3384371225 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125666981 0 0) 0x7f07e80cfa00 con 0x7f07e80b03c0 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07dffff700 1 -- 172.21.15.86:0/3384371225 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d4003570 con 0x7f07e80b03c0 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07ecb9a700 1 -- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e81591e0 msgr2=0x7f07e8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07ecb9a700 1 --2- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e81591e0 0x7f07e8159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07ecb9a700 1 -- 172.21.15.86:0/3384371225 >> v1:172.21.15.86:6789/0 conn(0x7f07e80b03c0 legacy=0x7f07e80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07ecb9a700 1 -- 172.21.15.86:0/3384371225 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80cf440 con 0x7f07e80b0790 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07ecb9a700 1 --2- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 0x7f07e80cea70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009910 tx=0x7f07d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed95840d2fce9898 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07dffff700 1 -- 172.21.15.86:0/3384371225 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8011630 con 0x7f07e80b0790 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07dffff700 1 -- 172.21.15.86:0/3384371225 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8011790 con 0x7f07e80b0790 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.452+0000 7f07dffff700 1 -- 172.21.15.86:0/3384371225 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8011b30 con 0x7f07e80b0790 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 -- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 msgr2=0x7f07e80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:37.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 0x7f07e80cea70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009910 tx=0x7f07d80091a0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 -- 172.21.15.86:0/3384371225 shutdown_connections 2023-10-09T12:57:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e81591e0 0x7f07e8159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3384371225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 0x7f07e80cea70 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 -- 172.21.15.86:0/3384371225 >> 172.21.15.86:0/3384371225 conn(0x7f07e8063230 msgr2=0x7f07e8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 -- 172.21.15.86:0/3384371225 shutdown_connections 2023-10-09T12:57:37.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.453+0000 7f07ee39d700 1 -- 172.21.15.86:0/3384371225 wait complete. 2023-10-09T12:57:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.454+0000 7f07ee39d700 1 Processor -- start 2023-10-09T12:57:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.455+0000 7f07ee39d700 1 -- start start 2023-10-09T12:57:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.455+0000 7f07ee39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e80b03c0 0x7f07e80c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.455+0000 7f07ee39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 0x7f07e8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.455+0000 7f07ee39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07e81591e0 0x7f07e80c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.455+0000 7f07ee39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c9a90 con 0x7f07e81591e0 2023-10-09T12:57:37.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.455+0000 7f07ee39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80ca460 con 0x7f07e80b0790 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.455+0000 7f07ee39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c8e80 con 0x7f07e80b03c0 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07e81591e0 0x7f07e80c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07e81591e0 0x7f07e80c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35270/0 (socket says 172.21.15.86:35270) 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 -- 172.21.15.86:0/3397460324 learned_addr learned my addr 172.21.15.86:0/3397460324 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07ecb9a700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 0x7f07e8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e80b03c0 0x7f07e80c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e80b03c0 msgr2=0x7f07e80c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e80b03c0 0x7f07e80c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 msgr2=0x7f07e8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 0x7f07e8157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:37.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 -- 172.21.15.86:0/3397460324 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8009420 con 0x7f07e81591e0 2023-10-09T12:57:37.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.456+0000 7f07edb9c700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07e81591e0 0x7f07e80c67a0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009e90 tx=0x7f07e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:37.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.457+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e000cb70 con 0x7f07e81591e0 2023-10-09T12:57:37.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.457+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e000f040 con 0x7f07e81591e0 2023-10-09T12:57:37.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.457+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0014480 con 0x7f07e81591e0 2023-10-09T12:57:37.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.457+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e80c9160 con 0x7f07e81591e0 2023-10-09T12:57:37.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.457+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e80c9720 con 0x7f07e81591e0 2023-10-09T12:57:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.458+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e80c9c40 con 0x7f07e81591e0 2023-10-09T12:57:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.459+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 84) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f07e0014830 con 0x7f07e81591e0 2023-10-09T12:57:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.460+0000 7f07dd7fa700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.460+0000 7f07ed39b700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 msgr2=0x7f07cc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.460+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6153+0+0 (secure 0 0 0) 0x7f07e00851c0 con 0x7f07e81591e0 2023-10-09T12:57:37.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.460+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T12:57:37.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.468+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07e80c9c40 con 0x7f07e81591e0 2023-10-09T12:57:37.494 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:37.494+0000 7fec13462180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:57:37.550 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:37.551+0000 7f1d5ec8d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T12:57:37.658 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:37.658+0000 7fec13462180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:37.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.661+0000 7f07ed39b700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 msgr2=0x7f07cc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:37.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.661+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T12:57:37.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:37.696+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f07e80c9c40 con 0x7f07cc066f80 2023-10-09T12:57:37.720 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:37.721+0000 7f1d5ec8d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:37.743 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:37.743+0000 7fec13462180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:57:37.806 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:37.806+0000 7f1d5ec8d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T12:57:37.967 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:37.967+0000 7fec13462180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:38.032 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:38.032+0000 7f1d5ec8d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:38.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:38.062+0000 7f07ed39b700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 msgr2=0x7f07cc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:38.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:38.062+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T12:57:38.142 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:38.141+0000 7fec13462180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:57:38.209 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:38.209+0000 7f1d5ec8d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T12:57:38.234 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:38.234+0000 7fec13462180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:57:38.301 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:38.302+0000 7f1d5ec8d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T12:57:38.396 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:38.396+0000 7fec13462180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:57:38.463 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:38.463+0000 7f1d5ec8d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T12:57:38.494 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:38.494+0000 7fec13462180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:38.562 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:38.562+0000 7f1d5ec8d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T12:57:38.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:38.863+0000 7f07ed39b700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 msgr2=0x7f07cc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:38.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:38.863+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T12:57:38.980 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:38.980+0000 7fec13462180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:57:39.051 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:39.051+0000 7f1d5ec8d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T12:57:39.073 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:39.072+0000 7fec13462180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:57:39.144 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:39.144+0000 7f1d5ec8d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T12:57:39.161 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:39.161+0000 7fec13462180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:57:39.235 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:39.235+0000 7f1d5ec8d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T12:57:39.782 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:39.781+0000 7fec13462180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:57:39.860 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:39.860+0000 7f1d5ec8d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T12:57:39.954 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:39.954+0000 7fec13462180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:40.032 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:40.032+0000 7f1d5ec8d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T12:57:40.048 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:40.048+0000 7fec13462180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:57:40.126 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:40.126+0000 7f1d5ec8d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T12:57:40.341 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:40.341+0000 7fec13462180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:57:40.420 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:40.420+0000 7f1d5ec8d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T12:57:40.436 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:40.436+0000 7fec13462180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:57:40.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:40.465+0000 7f07ed39b700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 msgr2=0x7f07cc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/85490 2023-10-09T12:57:40.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:40.465+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T12:57:40.516 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:40.517+0000 7f1d5ec8d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T12:57:41.131 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:41.131+0000 7fec13462180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:57:41.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:41.219+0000 7f1d5ec8d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T12:57:41.416 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:41.416+0000 7fec13462180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:57:41.504 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:41.504+0000 7f1d5ec8d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T12:57:41.508 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:41.508+0000 7fec13462180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:57:41.597 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:41.596+0000 7f1d5ec8d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T12:57:41.661 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:41.661+0000 7fec13462180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:57:41.749 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:41.749+0000 7f1d5ec8d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T12:57:41.765 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:41.764+0000 7fec13462180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:57:41.854 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:41.854+0000 7f1d5ec8d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T12:57:41.954 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:41.954+0000 7fec13462180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:57:42.043 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.043+0000 7f1d5ec8d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T12:57:42.046 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:42.046+0000 7fec13462180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:57:42.136 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.136+0000 7f1d5ec8d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T12:57:42.137 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:42.137+0000 7fec13462180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:57:42.228 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T12:57:42.228+0000 7fec13462180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:57:42.229 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.229+0000 7f1d5ec8d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T12:57:42.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:42.288+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 85) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f07e00525a0 con 0x7f07e81591e0 2023-10-09T12:57:42.326 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.327+0000 7f1d5ec8d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T12:57:42.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:42.338+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 86) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f07e001a2c0 con 0x7f07e81591e0 2023-10-09T12:57:42.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:42.338+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 msgr2=0x7f07cc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T12:57:42.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:42.338+0000 7f07dd7fa700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:42.466 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.466+0000 7f1cd0f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.466 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.466+0000 7f1cd0f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.466 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.466+0000 7f1cd0f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.466 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.466+0000 7f1cd0f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.466 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.466+0000 7f1cd0f71700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.467 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.467+0000 7f1cd3776700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.467 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.467+0000 7f1cd3776700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.467 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.467+0000 7f1cd3776700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.467 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.467+0000 7f1cd3776700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:42.467 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:57:42.467+0000 7f1cd3776700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:57:43.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.341+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mon.0 v2:172.21.15.86:3300/0 9 ==== mgrmap(e 87) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f07e0052e70 con 0x7f07e81591e0 2023-10-09T12:57:43.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.342+0000 7f07dd7fa700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:43.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.342+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f07e80c9c40 con 0x7f07cc066f80 2023-10-09T12:57:43.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.346+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:43.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.349+0000 7f07ed39b700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc0693b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07e4007fd0 tx=0x7f07e4009040 comp rx=0 tx=0).ready entity=mgr.9276 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:43.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.406+0000 7f07dd7fa700 1 -- 172.21.15.86:0/3397460324 <== mgr.9276 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f07e80c9c40 con 0x7f07cc066f80 2023-10-09T12:57:43.406 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.408+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 msgr2=0x7f07cc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.408+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc0693b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07e4007fd0 tx=0x7f07e4009040 comp rx=0 tx=0).stop 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.408+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07e81591e0 msgr2=0x7f07e80c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.408+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07e81591e0 0x7f07e80c67a0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009e90 tx=0x7f07e000b040 comp rx=0 tx=0).stop 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 shutdown_connections 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f07cc066f80 0x7f07cc0693b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07e81591e0 0x7f07e80c67a0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07e80b03c0 0x7f07e80c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 --2- 172.21.15.86:0/3397460324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e80b0790 0x7f07e8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 >> 172.21.15.86:0/3397460324 conn(0x7f07e8063230 msgr2=0x7f07e80b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:43.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 shutdown_connections 2023-10-09T12:57:43.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.409+0000 7f07ee39d700 1 -- 172.21.15.86:0/3397460324 wait complete. 2023-10-09T12:57:43.427 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-10-09T12:57:43.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T12:57:43.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.615+0000 7f957159d700 1 Processor -- start 2023-10-09T12:57:43.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.615+0000 7f957159d700 1 -- start start 2023-10-09T12:57:43.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.616+0000 7f957159d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f956c156350 0x7f956c157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:43.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.616+0000 7f957159d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f956c0b0760 0x7f956c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:43.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.616+0000 7f957159d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c0b0570 con 0x7f956c159f20 2023-10-09T12:57:43.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.616+0000 7f957159d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956c0b1140 con 0x7f956c0b0760 2023-10-09T12:57:43.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.616+0000 7f957159d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956c1578b0 con 0x7f956c156350 2023-10-09T12:57:43.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.616+0000 7f9563fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f956c0b0760 0x7f956c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:43.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f9563fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f956c0b0760 0x7f956c0b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35392/0 (socket says 172.21.15.86:35392) 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f9563fff700 1 -- 172.21.15.86:0/2686091469 learned_addr learned my addr 172.21.15.86:0/2686091469 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f956bfff700 1 --2- 172.21.15.86:0/2686091469 >> v2:172.21.15.135:3300/0 conn(0x7f956c156350 0x7f956c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f9563fff700 1 -- 172.21.15.86:0/2686091469 >> v2:172.21.15.135:3300/0 conn(0x7f956c156350 msgr2=0x7f956c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f9563fff700 1 --2- 172.21.15.86:0/2686091469 >> v2:172.21.15.135:3300/0 conn(0x7f956c156350 0x7f956c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f9563fff700 1 -- 172.21.15.86:0/2686091469 >> v1:172.21.15.135:6789/0 conn(0x7f956c159f20 legacy=0x7f956c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f9563fff700 1 -- 172.21.15.86:0/2686091469 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0af4d0 con 0x7f956c0b0760 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f956bfff700 1 --2- 172.21.15.86:0/2686091469 >> v2:172.21.15.135:3300/0 conn(0x7f956c156350 0x7f956c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T12:57:43.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f9563fff700 1 --2- 172.21.15.86:0/2686091469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c0b0760 0x7f956c0b0c00 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f956c065950 tx=0x7f9554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3290ee4c47d6bec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:43.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.617+0000 7f956b7fe700 1 -- 172.21.15.86:0/2686091469 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400b860 con 0x7f956c0b0760 2023-10-09T12:57:43.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f956b7fe700 1 -- 172.21.15.86:0/2686091469 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955400b9c0 con 0x7f956c0b0760 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f956b7fe700 1 -- 172.21.15.86:0/2686091469 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400bd60 con 0x7f956c0b0760 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 -- 172.21.15.86:0/2686091469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c0b0760 msgr2=0x7f956c0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 --2- 172.21.15.86:0/2686091469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c0b0760 0x7f956c0b0c00 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f956c065950 tx=0x7f9554009250 comp rx=0 tx=0).stop 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 -- 172.21.15.86:0/2686091469 shutdown_connections 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 --2- 172.21.15.86:0/2686091469 >> v2:172.21.15.135:3300/0 conn(0x7f956c156350 0x7f956c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 --2- 172.21.15.86:0/2686091469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c0b0760 0x7f956c0b0c00 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 -- 172.21.15.86:0/2686091469 >> 172.21.15.86:0/2686091469 conn(0x7f956c068e20 msgr2=0x7f956c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 -- 172.21.15.86:0/2686091469 shutdown_connections 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.618+0000 7f957159d700 1 -- 172.21.15.86:0/2686091469 wait complete. 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.620+0000 7f957159d700 1 Processor -- start 2023-10-09T12:57:43.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.620+0000 7f957159d700 1 -- start start 2023-10-09T12:57:43.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f957159d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f956c0b0760 0x7f956c141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f957159d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c156350 0x7f956c0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f957159d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c159f20 0x7f956c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f957159d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0ad260 con 0x7f956c156350 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f957159d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0ac650 con 0x7f956c159f20 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f957159d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0ac930 con 0x7f956c0b0760 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c156350 0x7f956c0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c156350 0x7f956c0abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35396/0 (socket says 172.21.15.86:35396) 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 -- 172.21.15.86:0/1218517801 learned_addr learned my addr 172.21.15.86:0/1218517801 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f956bfff700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f956c0b0760 0x7f956c141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9570d9c700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c159f20 0x7f956c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:43.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 -- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f956c0b0760 msgr2=0x7f956c141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f956c0b0760 0x7f956c141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 -- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c159f20 msgr2=0x7f956c150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c159f20 0x7f956c150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 -- 172.21.15.86:0/1218517801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540094f0 con 0x7f956c156350 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f956bfff700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f956c0b0760 0x7f956c141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9570d9c700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c159f20 0x7f956c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.621+0000 7f9563fff700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c156350 0x7f956c0abd50 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f9554009290 tx=0x7f9554017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.622+0000 7f9568ff9700 1 -- 172.21.15.86:0/1218517801 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554011e60 con 0x7f956c156350 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.622+0000 7f9568ff9700 1 -- 172.21.15.86:0/1218517801 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955401f070 con 0x7f956c156350 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.622+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c0acc10 con 0x7f956c156350 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.622+0000 7f9568ff9700 1 -- 172.21.15.86:0/1218517801 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955401a870 con 0x7f956c156350 2023-10-09T12:57:43.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.622+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c1420f0 con 0x7f956c156350 2023-10-09T12:57:43.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.623+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c04c3c0 con 0x7f956c156350 2023-10-09T12:57:43.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.624+0000 7f9568ff9700 1 -- 172.21.15.86:0/1218517801 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 87) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f955401abe0 con 0x7f956c156350 2023-10-09T12:57:43.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.625+0000 7f9568ff9700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f954c066dd0 0x7f954c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T12:57:43.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.625+0000 7f9568ff9700 1 -- 172.21.15.86:0/1218517801 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f9554021070 con 0x7f956c156350 2023-10-09T12:57:43.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.625+0000 7f956bfff700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f954c066dd0 0x7f954c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T12:57:43.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.626+0000 7f956bfff700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f954c066dd0 0x7f954c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f955c006f00 tx=0x7f955c008040 comp rx=0 tx=0).ready entity=mgr.9276 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T12:57:43.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.629+0000 7f9568ff9700 1 -- 172.21.15.86:0/1218517801 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9554053620 con 0x7f956c156350 2023-10-09T12:57:43.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.846+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f956c0af7b0 con 0x7f954c066dd0 2023-10-09T12:57:43.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.892+0000 7f9568ff9700 1 -- 172.21.15.86:0/1218517801 <== mgr.9276 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f956c0af7b0 con 0x7f954c066dd0 2023-10-09T12:57:43.892 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-10-09T12:57:43.894 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f954c066dd0 msgr2=0x7f954c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f954c066dd0 0x7f954c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f955c006f00 tx=0x7f955c008040 comp rx=0 tx=0).stop 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c156350 msgr2=0x7f956c0abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c156350 0x7f956c0abd50 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f9554009290 tx=0x7f9554017000 comp rx=0 tx=0).stop 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 shutdown_connections 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c159f20 0x7f956c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f956c0b0760 0x7f956c141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f954c066dd0 0x7f954c069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 --2- 172.21.15.86:0/1218517801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c156350 0x7f956c0abd50 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 >> 172.21.15.86:0/1218517801 conn(0x7f956c068e20 msgr2=0x7f956c151fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.894+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 shutdown_connections 2023-10-09T12:57:43.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T12:57:43.895+0000 7f957159d700 1 -- 172.21.15.86:0/1218517801 wait complete. 2023-10-09T12:57:43.912 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-10-09T12:57:59.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:57:59.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:58:00.905 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:58:00.904+0000 7f1cc2f55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:58:00.905 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:58:00.904+0000 7f1cc2f55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:58:00.905 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:58:00.904+0000 7f1cc2f55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:58:00.905 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:58:00.904+0000 7f1cc2f55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:58:00.905 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T12:58:00.904+0000 7f1cc2f55700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T12:58:29.631 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:58:29.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:58:59.845 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:58:59.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:59:30.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T12:59:30.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:00:00.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:00:00.245 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:00:30.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:00:30.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:01:00.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:01:00.617 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:01:30.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:01:30.791 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:02:00.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:02:00.978 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:02:31.136 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:02:31.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:03:01.320 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:03:01.325 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:03:31.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:03:31.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:04:01.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:04:01.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:04:31.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:04:31.840 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:05:02.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:05:02.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:05:32.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:05:32.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:06:02.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:06:02.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:06:32.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:06:32.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:07:02.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:07:02.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:07:32.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:07:32.807 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:08:03.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:08:03.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:08:15.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:08:15.913 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-09T13:08:15.957 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_58_00_UTC 2023-10-09T13:08:15.957 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_59_00_UTC 2023-10-09T13:08:15.957 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_00_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_01_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_02_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_03_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_04_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_05_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_06_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_07_00_UTC 2023-10-09T13:08:15.958 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_08_00_UTC 2023-10-09T13:08:15.959 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-12_58_00_UTC', 'scheduled-2023-10-09-12_59_00_UTC', 'scheduled-2023-10-09-13_00_00_UTC', 'scheduled-2023-10-09-13_01_00_UTC', 'scheduled-2023-10-09-13_02_00_UTC', 'scheduled-2023-10-09-13_03_00_UTC', 'scheduled-2023-10-09-13_04_00_UTC', 'scheduled-2023-10-09-13_05_00_UTC', 'scheduled-2023-10-09-13_06_00_UTC', 'scheduled-2023-10-09-13_07_00_UTC', 'scheduled-2023-10-09-13_08_00_UTC'] 2023-10-09T13:08:15.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-09T13:08:16.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.187+0000 7f251a79d700 1 Processor -- start 2023-10-09T13:08:16.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.188+0000 7f251a79d700 1 -- start start 2023-10-09T13:08:16.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.189+0000 7f251a79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f251415b050 0x7f25140ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.189+0000 7f251a79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2514157a50 con 0x7f251415bb30 2023-10-09T13:08:16.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.189+0000 7f251a79d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2514158f10 con 0x7f25140cc8d0 2023-10-09T13:08:16.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.189+0000 7f251a79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25141591b0 con 0x7f251415b050 2023-10-09T13:08:16.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.189+0000 7f251979b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f251415b050 0x7f25140ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.189+0000 7f2519f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f251415bb30 0x7f25140ada30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59904/0 (socket says 172.21.15.86:59904) 2023-10-09T13:08:16.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.189+0000 7f2519f9c700 1 -- 172.21.15.86:0/2762850220 learned_addr learned my addr 172.21.15.86:0/2762850220 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:08:16.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f251979b700 1 -- 172.21.15.86:0/2762850220 >> v1:172.21.15.135:6789/0 conn(0x7f25140cc8d0 legacy=0x7f251415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f251979b700 1 -- 172.21.15.86:0/2762850220 >> v1:172.21.15.86:6789/0 conn(0x7f251415bb30 legacy=0x7f25140ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f251979b700 1 -- 172.21.15.86:0/2762850220 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140ca9e0 con 0x7f251415b050 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f250bfff700 1 -- 172.21.15.86:0/2762850220 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058022222 0 0) 0x7f2514157a50 con 0x7f251415bb30 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f251979b700 1 --2- 172.21.15.86:0/2762850220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415b050 0x7f25140ca100 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f25100098e0 tx=0x7f25100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa53fe6e577dea5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f250bfff700 1 -- 172.21.15.86:0/2762850220 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510009e80 con 0x7f251415b050 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f250bfff700 1 -- 172.21.15.86:0/2762850220 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251000b860 con 0x7f251415b050 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.190+0000 7f250bfff700 1 -- 172.21.15.86:0/2762850220 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000bbe0 con 0x7f251415b050 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.191+0000 7f251a79d700 1 -- 172.21.15.86:0/2762850220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415b050 msgr2=0x7f25140ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.191+0000 7f251a79d700 1 --2- 172.21.15.86:0/2762850220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415b050 0x7f25140ca100 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f25100098e0 tx=0x7f25100091a0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.191+0000 7f251a79d700 1 -- 172.21.15.86:0/2762850220 shutdown_connections 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.191+0000 7f251a79d700 1 --2- 172.21.15.86:0/2762850220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415b050 0x7f25140ca100 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.191+0000 7f251a79d700 1 -- 172.21.15.86:0/2762850220 >> 172.21.15.86:0/2762850220 conn(0x7f2514068e20 msgr2=0x7f25140cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:08:16.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.191+0000 7f251a79d700 1 -- 172.21.15.86:0/2762850220 shutdown_connections 2023-10-09T13:08:16.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.191+0000 7f251a79d700 1 -- 172.21.15.86:0/2762850220 wait complete. 2023-10-09T13:08:16.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.192+0000 7f251a79d700 1 Processor -- start 2023-10-09T13:08:16.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.193+0000 7f251a79d700 1 -- start start 2023-10-09T13:08:16.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.193+0000 7f251a79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25140cc8d0 0x7f251414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f251a79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251415b050 0x7f251416df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f251a79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415bb30 0x7f251414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f251a79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251416e4b0 con 0x7f251415bb30 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f251a79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25140af5d0 con 0x7f25140cc8d0 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f251a79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140af8b0 con 0x7f251415b050 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415bb30 0x7f251414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415bb30 0x7f251414ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40646/0 (socket says 172.21.15.86:40646) 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 -- 172.21.15.86:0/270768706 learned_addr learned my addr 172.21.15.86:0/270768706 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f251979b700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25140cc8d0 0x7f251414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 -- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251415b050 msgr2=0x7f251416df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2518f9a700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251415b050 0x7f251416df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251415b050 0x7f251416df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 -- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25140cc8d0 msgr2=0x7f251414ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25140cc8d0 0x7f251414ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 -- 172.21.15.86:0/270768706 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009420 con 0x7f251415bb30 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2518f9a700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251415b050 0x7f251416df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.194+0000 7f2519f9c700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415bb30 0x7f251414ab10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f250c00cc90 tx=0x7f250c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.195+0000 7f25097fa700 1 -- 172.21.15.86:0/270768706 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00cea0 con 0x7f251415bb30 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.195+0000 7f25097fa700 1 -- 172.21.15.86:0/270768706 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00ab30 con 0x7f251415bb30 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.195+0000 7f25097fa700 1 -- 172.21.15.86:0/270768706 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0070f0 con 0x7f251415bb30 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.195+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25140afb90 con 0x7f251415bb30 2023-10-09T13:08:16.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.195+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25140b0150 con 0x7f251415bb30 2023-10-09T13:08:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.196+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251404c3c0 con 0x7f251415bb30 2023-10-09T13:08:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.197+0000 7f25097fa700 1 -- 172.21.15.86:0/270768706 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 90) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f250c0074a0 con 0x7f251415bb30 2023-10-09T13:08:16.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.197+0000 7f25097fa700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f24f80670a0 0x7f24f8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.198+0000 7f25097fa700 1 -- 172.21.15.86:0/270768706 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f250c084eb0 con 0x7f251415bb30 2023-10-09T13:08:16.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.198+0000 7f251979b700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f24f80670a0 0x7f24f8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.198+0000 7f251979b700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f24f80670a0 0x7f24f8069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25100093f0 tx=0x7f2510017000 comp rx=0 tx=0).ready entity=mgr.9276 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:08:16.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.202+0000 7f25097fa700 1 -- 172.21.15.86:0/270768706 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f250c051d10 con 0x7f251415bb30 2023-10-09T13:08:16.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.419+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 --> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25140cacc0 con 0x7f24f80670a0 2023-10-09T13:08:16.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.426+0000 7f25097fa700 1 -- 172.21.15.86:0/270768706 <== mgr.9276 v2:172.21.15.86:6836/85490 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f25140cacc0 con 0x7f24f80670a0 2023-10-09T13:08:16.427 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:08:16.427 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T12:57:43", "first": "2023-10-09T12:58:00", "last": "2023-10-09T13:08:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-09T13:08:16.429 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f24f80670a0 msgr2=0x7f24f8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f24f80670a0 0x7f24f8069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25100093f0 tx=0x7f2510017000 comp rx=0 tx=0).stop 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415bb30 msgr2=0x7f251414ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415bb30 0x7f251414ab10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f250c00cc90 tx=0x7f250c001a20 comp rx=0 tx=0).stop 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 shutdown_connections 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f24f80670a0 0x7f24f8069550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f251415bb30 0x7f251414ab10 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25140cc8d0 0x7f251414ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 --2- 172.21.15.86:0/270768706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f251415b050 0x7f251416df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 >> 172.21.15.86:0/270768706 conn(0x7f2514068e20 msgr2=0x7f251406db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 shutdown_connections 2023-10-09T13:08:16.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.429+0000 7f251a79d700 1 -- 172.21.15.86:0/270768706 wait complete. 2023-10-09T13:08:16.447 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T12:57:43", "first": "2023-10-09T12:58:00", "last": "2023-10-09T13:08:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-09T13:08:16.447 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T12:57:43', 'first': '2023-10-09T12:58:00', 'last': '2023-10-09T13:08:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-10-09T13:08:16.447 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-09T13:08:16.447 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-09T13:08:16.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T13:08:16.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.629+0000 7f0381b9d700 1 Processor -- start 2023-10-09T13:08:16.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.630+0000 7f0381b9d700 1 -- start start 2023-10-09T13:08:16.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f0381b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c1566e0 0x7f037c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f0381b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f037c0cb900 0x7f037c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f0381b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0ca860 con 0x7f037c156310 2023-10-09T13:08:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f0381b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0cab40 con 0x7f037c0cb900 2023-10-09T13:08:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f0381b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cae20 con 0x7f037c1566e0 2023-10-09T13:08:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f038139c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f037c0cb900 0x7f037c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f0380b9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f037c156310 0x7f037c0c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:59916/0 (socket says 172.21.15.86:59916) 2023-10-09T13:08:16.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.631+0000 7f0380b9b700 1 -- 172.21.15.86:0/1930679855 learned_addr learned my addr 172.21.15.86:0/1930679855 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:08:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f038139c700 1 -- 172.21.15.86:0/1930679855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c1566e0 msgr2=0x7f037c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:08:16.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f038139c700 1 --2- 172.21.15.86:0/1930679855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c1566e0 0x7f037c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f038139c700 1 -- 172.21.15.86:0/1930679855 >> v1:172.21.15.86:6789/0 conn(0x7f037c156310 legacy=0x7f037c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f038139c700 1 -- 172.21.15.86:0/1930679855 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0cb100 con 0x7f037c0cb900 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f037b7fe700 1 -- 172.21.15.86:0/1930679855 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541390983 0 0) 0x7f037c0ca860 con 0x7f037c156310 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f038139c700 1 --2- 172.21.15.86:0/1930679855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c0ae540 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f0374009e60 tx=0x7f0374009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202e3e8cf7609e6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f037b7fe700 1 -- 172.21.15.86:0/1930679855 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400e070 con 0x7f037c0cb900 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f037b7fe700 1 -- 172.21.15.86:0/1930679855 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400bc30 con 0x7f037c0cb900 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.632+0000 7f037b7fe700 1 -- 172.21.15.86:0/1930679855 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374012430 con 0x7f037c0cb900 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 -- 172.21.15.86:0/1930679855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 msgr2=0x7f037c0ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 --2- 172.21.15.86:0/1930679855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c0ae540 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f0374009e60 tx=0x7f0374009780 comp rx=0 tx=0).stop 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 -- 172.21.15.86:0/1930679855 shutdown_connections 2023-10-09T13:08:16.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 --2- 172.21.15.86:0/1930679855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c0ae540 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 --2- 172.21.15.86:0/1930679855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c1566e0 0x7f037c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 -- 172.21.15.86:0/1930679855 >> 172.21.15.86:0/1930679855 conn(0x7f037c0cc1f0 msgr2=0x7f037c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:08:16.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 -- 172.21.15.86:0/1930679855 shutdown_connections 2023-10-09T13:08:16.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.633+0000 7f0381b9d700 1 -- 172.21.15.86:0/1930679855 wait complete. 2023-10-09T13:08:16.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.634+0000 7f0381b9d700 1 Processor -- start 2023-10-09T13:08:16.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.634+0000 7f0381b9d700 1 -- start start 2023-10-09T13:08:16.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.635+0000 7f0381b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.635+0000 7f0381b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c156310 0x7f037c0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.635+0000 7f0381b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c1566e0 0x7f037c146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.635+0000 7f0381b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0c8220 con 0x7f037c0cb900 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.635+0000 7f0381b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0c7c60 con 0x7f037c1566e0 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.635+0000 7f0381b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0c7f40 con 0x7f037c156310 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.635+0000 7f0380b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40660/0 (socket says 172.21.15.86:40660) 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 -- 172.21.15.86:0/2870502333 learned_addr learned my addr 172.21.15.86:0/2870502333 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f037bfff700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c156310 0x7f037c0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f038139c700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c1566e0 0x7f037c146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 -- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c156310 msgr2=0x7f037c0c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c156310 0x7f037c0c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 -- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c1566e0 msgr2=0x7f037c146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c1566e0 0x7f037c146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 -- 172.21.15.86:0/2870502333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374009a20 con 0x7f037c0cb900 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f037bfff700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c156310 0x7f037c0c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f038139c700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c1566e0 0x7f037c146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0380b9b700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c159ff0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f037000c7e0 tx=0x7f0370007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0378ff9700 1 -- 172.21.15.86:0/2870502333 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370005b30 con 0x7f037c0cb900 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0378ff9700 1 -- 172.21.15.86:0/2870502333 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370005c90 con 0x7f037c0cb900 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c0c33d0 con 0x7f037c0cb900 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.636+0000 7f0378ff9700 1 -- 172.21.15.86:0/2870502333 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370007300 con 0x7f037c0cb900 2023-10-09T13:08:16.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.637+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c0c7940 con 0x7f037c0cb900 2023-10-09T13:08:16.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.638+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c0c38f0 con 0x7f037c0cb900 2023-10-09T13:08:16.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.638+0000 7f0378ff9700 1 -- 172.21.15.86:0/2870502333 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 90) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f037001b400 con 0x7f037c0cb900 2023-10-09T13:08:16.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.640+0000 7f0378ff9700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f03600670a0 0x7f0360069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:08:16.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.640+0000 7f0378ff9700 1 -- 172.21.15.86:0/2870502333 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0370084570 con 0x7f037c0cb900 2023-10-09T13:08:16.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.640+0000 7f037bfff700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f03600670a0 0x7f0360069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:08:16.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.641+0000 7f037bfff700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f03600670a0 0x7f0360069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ca750 tx=0x7f0368008040 comp rx=0 tx=0).ready entity=mgr.9276 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:08:16.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.644+0000 7f0378ff9700 1 -- 172.21.15.86:0/2870502333 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f037c0c38f0 con 0x7f037c0cb900 2023-10-09T13:08:16.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.889+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f037c0c38f0 con 0x7f037c0cb900 2023-10-09T13:08:16.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.892+0000 7f0378ff9700 1 -- 172.21.15.86:0/2870502333 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v90) v1 ==== 74+0+163905 (secure 0 0 0) 0x7f037c0c38f0 con 0x7f037c0cb900 2023-10-09T13:08:16.894 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f03600670a0 msgr2=0x7f0360069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f03600670a0 0x7f0360069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ca750 tx=0x7f0368008040 comp rx=0 tx=0).stop 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 msgr2=0x7f037c159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c159ff0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f037000c7e0 tx=0x7f0370007df0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 shutdown_connections 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:6836/85490,v1:172.21.15.86:6837/85490] conn(0x7f03600670a0 0x7f0360069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037c0cb900 0x7f037c159ff0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c1566e0 0x7f037c146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 --2- 172.21.15.86:0/2870502333 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c156310 0x7f037c0c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:08:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 >> 172.21.15.86:0/2870502333 conn(0x7f037c0cc1f0 msgr2=0x7f037c151d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:08:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 shutdown_connections 2023-10-09T13:08:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:08:16.895+0000 7f0381b9d700 1 -- 172.21.15.86:0/2870502333 wait complete. 2023-10-09T13:08:16.913 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":90,"active_gid":9276,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":85490},{"type":"v1","addr":"172.21.15.86:6837","nonce":85490}]},"active_addr":"172.21.15.86:6837/85490","active_change":"2023-10-09T12:57:42.329261+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":8716,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":179,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2904761160}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":686933348}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1475286588}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3426244752}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1588237341}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3806596904}]}]} 2023-10-09T13:08:16.917 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-10-09T13:08:16.917 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-09T13:08:16.917 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-10-09T13:08:16.917 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-09T13:08:16.917 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:08:16.985 INFO:tasks.ceph.mgr.y:Stopped 2023-10-09T13:08:16.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-09T13:08:16.990 INFO:tasks.ceph.mgr.y:Started 2023-10-09T13:08:18.299 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:18.299+0000 7f2e5e988180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:08:18.464 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:18.464+0000 7f2e5e988180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:08:18.549 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:18.549+0000 7f2e5e988180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:08:18.782 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:18.782+0000 7f2e5e988180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:08:18.960 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:18.959+0000 7f2e5e988180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:08:19.051 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:19.051+0000 7f2e5e988180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:08:19.212 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:19.212+0000 7f2e5e988180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:08:19.312 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:19.312+0000 7f2e5e988180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:08:19.795 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:19.795+0000 7f2e5e988180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:08:19.889 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:19.889+0000 7f2e5e988180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:08:19.979 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:19.979+0000 7f2e5e988180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:08:20.596 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:20.596+0000 7f2e5e988180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:08:20.769 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:20.769+0000 7f2e5e988180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:08:20.865 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:20.865+0000 7f2e5e988180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:08:21.158 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:21.158+0000 7f2e5e988180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:08:21.253 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:21.253+0000 7f2e5e988180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:08:21.955 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:21.955+0000 7f2e5e988180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:08:22.240 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:22.240+0000 7f2e5e988180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:08:22.333 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:22.333+0000 7f2e5e988180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:08:22.487 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:22.487+0000 7f2e5e988180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:08:22.591 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:22.591+0000 7f2e5e988180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:08:22.781 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:22.781+0000 7f2e5e988180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:08:22.874 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:22.874+0000 7f2e5e988180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:08:22.966 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:22.964+0000 7f2e5e988180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:08:23.059 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.058+0000 7f2e5e988180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:08:23.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd04b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd04b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd04b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd04b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd04b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd34b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.219 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd34b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.220 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd34b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.220 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd34b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:23.220 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:08:23.217+0000 7f2dd34b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:08:33.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:08:33.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:09:00.215 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:09:00.215+0000 7f2ddb4c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:09:00.216 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:09:00.215+0000 7f2ddb4c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:09:00.216 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:09:00.215+0000 7f2ddb4c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:09:00.216 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:09:00.215+0000 7f2ddb4c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:09:00.216 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:09:00.215+0000 7f2ddb4c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:09:03.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:09:03.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:09:33.479 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:09:33.485 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:10:03.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:10:03.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:10:33.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:10:33.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:11:04.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:11:04.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:11:34.262 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:11:34.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:12:04.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:12:04.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:12:34.621 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:12:34.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:13:04.819 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:13:04.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:13:16.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T13:13:17.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.187+0000 7fcb8359e700 1 Processor -- start 2023-10-09T13:13:17.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.187+0000 7fcb8359e700 1 -- start start 2023-10-09T13:13:17.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb8359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcb84153850 0x7fcb841596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb8359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb84159bf0 0x7fcb84157280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb8359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8415a030 con 0x7fcb84153480 2023-10-09T13:13:17.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb8359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8415a480 con 0x7fcb84159bf0 2023-10-09T13:13:17.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb8359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb840afb40 con 0x7fcb84153850 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb82d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb84159bf0 0x7fcb84157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb82d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcb84159bf0 0x7fcb84157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42776/0 (socket says 172.21.15.86:42776) 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.188+0000 7fcb82d9d700 1 -- 172.21.15.86:0/735274052 learned_addr learned my addr 172.21.15.86:0/735274052 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb81d9b700 1 --2- 172.21.15.86:0/735274052 >> v2:172.21.15.135:3300/0 conn(0x7fcb84153850 0x7fcb841596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb82d9d700 1 -- 172.21.15.86:0/735274052 >> v2:172.21.15.135:3300/0 conn(0x7fcb84153850 msgr2=0x7fcb841596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb82d9d700 1 --2- 172.21.15.86:0/735274052 >> v2:172.21.15.135:3300/0 conn(0x7fcb84153850 0x7fcb841596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb82d9d700 1 -- 172.21.15.86:0/735274052 >> v1:172.21.15.135:6789/0 conn(0x7fcb84153480 legacy=0x7fcb840ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb82d9d700 1 -- 172.21.15.86:0/735274052 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb840afe20 con 0x7fcb84159bf0 2023-10-09T13:13:17.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb82d9d700 1 --2- 172.21.15.86:0/735274052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb84157280 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fcb84064f60 tx=0x7fcb7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b602c0e0058335e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb8159a700 1 -- 172.21.15.86:0/735274052 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00e070 con 0x7fcb84159bf0 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb8159a700 1 -- 172.21.15.86:0/735274052 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00ba50 con 0x7fcb84159bf0 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.189+0000 7fcb8159a700 1 -- 172.21.15.86:0/735274052 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0092e0 con 0x7fcb84159bf0 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 -- 172.21.15.86:0/735274052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 msgr2=0x7fcb84157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 --2- 172.21.15.86:0/735274052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb84157280 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fcb84064f60 tx=0x7fcb7c009840 comp rx=0 tx=0).stop 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 -- 172.21.15.86:0/735274052 shutdown_connections 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 --2- 172.21.15.86:0/735274052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb84157280 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 --2- 172.21.15.86:0/735274052 >> v2:172.21.15.135:3300/0 conn(0x7fcb84153850 0x7fcb841596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 -- 172.21.15.86:0/735274052 >> 172.21.15.86:0/735274052 conn(0x7fcb84068e20 msgr2=0x7fcb840cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 -- 172.21.15.86:0/735274052 shutdown_connections 2023-10-09T13:13:17.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.190+0000 7fcb8359e700 1 -- 172.21.15.86:0/735274052 wait complete. 2023-10-09T13:13:17.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.191+0000 7fcb8359e700 1 Processor -- start 2023-10-09T13:13:17.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.192+0000 7fcb8359e700 1 -- start start 2023-10-09T13:13:17.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.192+0000 7fcb8359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb84153480 0x7fcb841680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.192+0000 7fcb8359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb84153850 0x7fcb840ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.192+0000 7fcb8359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb840c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.192+0000 7fcb8359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840c6960 con 0x7fcb84159bf0 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.192+0000 7fcb8359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840c64d0 con 0x7fcb84153850 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.192+0000 7fcb8359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84168620 con 0x7fcb84153480 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb840c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb840c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42790/0 (socket says 172.21.15.86:42790) 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 -- 172.21.15.86:0/2973476960 learned_addr learned my addr 172.21.15.86:0/2973476960 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb8259c700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb84153480 0x7fcb841680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb81d9b700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb84153850 0x7fcb840ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 -- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb84153480 msgr2=0x7fcb841680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb84153480 0x7fcb841680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 -- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb84153850 msgr2=0x7fcb840ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb84153850 0x7fcb840ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 -- 172.21.15.86:0/2973476960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c009ae0 con 0x7fcb84159bf0 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb82d9d700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb840c7260 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fcb840714a0 tx=0x7fcb7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.193+0000 7fcb727fc700 1 -- 172.21.15.86:0/2973476960 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c008e40 con 0x7fcb84159bf0 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.194+0000 7fcb727fc700 1 -- 172.21.15.86:0/2973476960 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c025460 con 0x7fcb84159bf0 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.194+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb840c58c0 con 0x7fcb84159bf0 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.194+0000 7fcb727fc700 1 -- 172.21.15.86:0/2973476960 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c025820 con 0x7fcb84159bf0 2023-10-09T13:13:17.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.194+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb840c5e80 con 0x7fcb84159bf0 2023-10-09T13:13:17.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.195+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8404c3c0 con 0x7fcb84159bf0 2023-10-09T13:13:17.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.195+0000 7fcb727fc700 1 -- 172.21.15.86:0/2973476960 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 95) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fcb7c003040 con 0x7fcb84159bf0 2023-10-09T13:13:17.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.197+0000 7fcb727fc700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcb640670a0 0x7fcb64069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.197+0000 7fcb727fc700 1 -- 172.21.15.86:0/2973476960 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fcb7c0869f0 con 0x7fcb84159bf0 2023-10-09T13:13:17.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.197+0000 7fcb8259c700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcb640670a0 0x7fcb64069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.197+0000 7fcb8259c700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcb640670a0 0x7fcb64069550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb84070ec0 tx=0x7fcb74009040 comp rx=0 tx=0).ready entity=mgr.9372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:17.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.202+0000 7fcb727fc700 1 -- 172.21.15.86:0/2973476960 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb7c0535c0 con 0x7fcb84159bf0 2023-10-09T13:13:17.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.422+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb840b0100 con 0x7fcb640670a0 2023-10-09T13:13:17.483 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.482+0000 7fcb727fc700 1 -- 172.21.15.86:0/2973476960 <== mgr.9372 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fcb840b0100 con 0x7fcb640670a0 2023-10-09T13:13:17.484 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-09T13:13:17.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.484+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcb640670a0 msgr2=0x7fcb64069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcb640670a0 0x7fcb64069550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb84070ec0 tx=0x7fcb74009040 comp rx=0 tx=0).stop 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 msgr2=0x7fcb840c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb840c7260 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fcb840714a0 tx=0x7fcb7c018000 comp rx=0 tx=0).stop 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 shutdown_connections 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcb640670a0 0x7fcb64069550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb84159bf0 0x7fcb840c7260 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb84153480 0x7fcb841680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 --2- 172.21.15.86:0/2973476960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb84153850 0x7fcb840ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 >> 172.21.15.86:0/2973476960 conn(0x7fcb84068e20 msgr2=0x7fcb840694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 shutdown_connections 2023-10-09T13:13:17.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.485+0000 7fcb8359e700 1 -- 172.21.15.86:0/2973476960 wait complete. 2023-10-09T13:13:17.503 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-09T13:13:17.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:17.504 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_58_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_59_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_00_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_01_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_02_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_03_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_04_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_05_00_UTC 2023-10-09T13:13:17.542 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_06_00_UTC 2023-10-09T13:13:17.543 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_07_00_UTC 2023-10-09T13:13:17.543 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_08_00_UTC 2023-10-09T13:13:17.543 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_09_00_UTC 2023-10-09T13:13:17.543 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_10_00_UTC 2023-10-09T13:13:17.543 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_11_00_UTC 2023-10-09T13:13:17.543 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_12_00_UTC 2023-10-09T13:13:17.543 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_13_00_UTC 2023-10-09T13:13:17.544 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-09-12_58_00_UTC', 'scheduled-2023-10-09-12_59_00_UTC', 'scheduled-2023-10-09-13_00_00_UTC', 'scheduled-2023-10-09-13_01_00_UTC', 'scheduled-2023-10-09-13_02_00_UTC', 'scheduled-2023-10-09-13_03_00_UTC', 'scheduled-2023-10-09-13_04_00_UTC', 'scheduled-2023-10-09-13_05_00_UTC', 'scheduled-2023-10-09-13_06_00_UTC', 'scheduled-2023-10-09-13_07_00_UTC', 'scheduled-2023-10-09-13_08_00_UTC', 'scheduled-2023-10-09-13_09_00_UTC', 'scheduled-2023-10-09-13_10_00_UTC', 'scheduled-2023-10-09-13_11_00_UTC', 'scheduled-2023-10-09-13_12_00_UTC', 'scheduled-2023-10-09-13_13_00_UTC'] 2023-10-09T13:13:17.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-09T13:13:17.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.770+0000 7ff8b07ff700 1 Processor -- start 2023-10-09T13:13:17.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.770+0000 7ff8b07ff700 1 -- start start 2023-10-09T13:13:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.771+0000 7ff8b07ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a815ab80 0x7ff8a806a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.771+0000 7ff8b07ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff8a80cab50 0x7ff8a815d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.771+0000 7ff8b07ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a806a1a0 con 0x7ff8a81597a0 2023-10-09T13:13:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.771+0000 7ff8b07ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a80cb3a0 con 0x7ff8a80cab50 2023-10-09T13:13:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.771+0000 7ff8b07ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80cb0c0 con 0x7ff8a815ab80 2023-10-09T13:13:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff8a80cab50 0x7ff8a815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff8a80cab50 0x7ff8a815d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42794/0 (socket says 172.21.15.86:42794) 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 -- 172.21.15.86:0/3111520745 learned_addr learned my addr 172.21.15.86:0/3111520745 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8ae59b700 1 --1- 172.21.15.86:0/3111520745 >> v1:172.21.15.86:6789/0 conn(0x7ff8a81597a0 0x7ff8a806e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41954/0 (socket says 172.21.15.86:41954) 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8add9a700 1 --2- 172.21.15.86:0/3111520745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a815ab80 0x7ff8a806a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 -- 172.21.15.86:0/3111520745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a815ab80 msgr2=0x7ff8a806a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 --2- 172.21.15.86:0/3111520745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a815ab80 0x7ff8a806a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 -- 172.21.15.86:0/3111520745 >> v1:172.21.15.86:6789/0 conn(0x7ff8a81597a0 legacy=0x7ff8a806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 -- 172.21.15.86:0/3111520745 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8069b50 con 0x7ff8a80cab50 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8ad599700 1 -- 172.21.15.86:0/3111520745 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523008023 0 0) 0x7ff8a806a1a0 con 0x7ff8a81597a0 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8add9a700 1 --2- 172.21.15.86:0/3111520745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a815ab80 0x7ff8a806a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.772+0000 7ff8aed9c700 1 --2- 172.21.15.86:0/3111520745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a80cab50 0x7ff8a815d550 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009f20 tx=0x7ff8a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468ec8e776192de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:17.775 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8ad599700 1 -- 172.21.15.86:0/3111520745 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000e070 con 0x7ff8a80cab50 2023-10-09T13:13:17.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8ad599700 1 -- 172.21.15.86:0/3111520745 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a000ba80 con 0x7ff8a80cab50 2023-10-09T13:13:17.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8ad599700 1 -- 172.21.15.86:0/3111520745 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00092e0 con 0x7ff8a80cab50 2023-10-09T13:13:17.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 -- 172.21.15.86:0/3111520745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a80cab50 msgr2=0x7ff8a815d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/3111520745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a80cab50 0x7ff8a815d550 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009f20 tx=0x7ff8a0009840 comp rx=0 tx=0).stop 2023-10-09T13:13:17.778 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 -- 172.21.15.86:0/3111520745 shutdown_connections 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/3111520745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a80cab50 0x7ff8a815d550 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/3111520745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a815ab80 0x7ff8a806a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 -- 172.21.15.86:0/3111520745 >> 172.21.15.86:0/3111520745 conn(0x7ff8a8068390 msgr2=0x7ff8a8068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 -- 172.21.15.86:0/3111520745 shutdown_connections 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.773+0000 7ff8b07ff700 1 -- 172.21.15.86:0/3111520745 wait complete. 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.775+0000 7ff8b07ff700 1 Processor -- start 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.775+0000 7ff8b07ff700 1 -- start start 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8b07ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a80cab50 0x7ff8a81568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8b07ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a81597a0 0x7ff8a8158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8b07ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a815ab80 0x7ff8a80b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8b07ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8154520 con 0x7ff8a81597a0 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8b07ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8156df0 con 0x7ff8a815ab80 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8b07ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8153bf0 con 0x7ff8a80cab50 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a81597a0 0x7ff8a8158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a81597a0 0x7ff8a8158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42804/0 (socket says 172.21.15.86:42804) 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 -- 172.21.15.86:0/1617092914 learned_addr learned my addr 172.21.15.86:0/1617092914 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8ae59b700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a80cab50 0x7ff8a81568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8aed9c700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a815ab80 0x7ff8a80b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 -- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a80cab50 msgr2=0x7ff8a81568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a80cab50 0x7ff8a81568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.780 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 -- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a815ab80 msgr2=0x7ff8a80b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a815ab80 0x7ff8a80b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8add9a700 1 -- 172.21.15.86:0/1617092914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0009ae0 con 0x7ff8a81597a0 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.776+0000 7ff8aed9c700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a815ab80 0x7ff8a80b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.777+0000 7ff8add9a700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a81597a0 0x7ff8a8158240 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c880 tx=0x7ff898008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.777+0000 7ff89e7fc700 1 -- 172.21.15.86:0/1617092914 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898011600 con 0x7ff8a81597a0 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.777+0000 7ff89e7fc700 1 -- 172.21.15.86:0/1617092914 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff898011760 con 0x7ff8a81597a0 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.777+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a8153ed0 con 0x7ff8a81597a0 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.777+0000 7ff89e7fc700 1 -- 172.21.15.86:0/1617092914 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898011b00 con 0x7ff8a81597a0 2023-10-09T13:13:17.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.777+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a8158780 con 0x7ff8a81597a0 2023-10-09T13:13:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.778+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a81546d0 con 0x7ff8a81597a0 2023-10-09T13:13:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.779+0000 7ff89e7fc700 1 -- 172.21.15.86:0/1617092914 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 95) v1 ==== 84871+0+0 (secure 0 0 0) 0x7ff898018350 con 0x7ff8a81597a0 2023-10-09T13:13:17.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.780+0000 7ff89e7fc700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff88c0670a0 0x7ff88c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.780+0000 7ff89e7fc700 1 -- 172.21.15.86:0/1617092914 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7ff898084c20 con 0x7ff8a81597a0 2023-10-09T13:13:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.780+0000 7ff8ae59b700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff88c0670a0 0x7ff88c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:17.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.781+0000 7ff8ae59b700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff88c0670a0 0x7ff88c069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4007fd0 tx=0x7ff8a4007d50 comp rx=0 tx=0).ready entity=mgr.9372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:17.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.784+0000 7ff89e7fc700 1 -- 172.21.15.86:0/1617092914 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8a81546d0 con 0x7ff8a81597a0 2023-10-09T13:13:17.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:17.998+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8a81546d0 con 0x7ff88c0670a0 2023-10-09T13:13:18.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.006+0000 7ff89e7fc700 1 -- 172.21.15.86:0/1617092914 <== mgr.9372 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7ff8a81546d0 con 0x7ff88c0670a0 2023-10-09T13:13:18.007 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:18.007 INFO:teuthology.orchestra.run.smithi086.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T12:57:43", "first": "2023-10-09T12:58:00", "last": "2023-10-09T13:13:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff88c0670a0 msgr2=0x7ff88c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff88c0670a0 0x7ff88c069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4007fd0 tx=0x7ff8a4007d50 comp rx=0 tx=0).stop 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a81597a0 msgr2=0x7ff8a8158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a81597a0 0x7ff8a8158240 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c880 tx=0x7ff898008040 comp rx=0 tx=0).stop 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 shutdown_connections 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff88c0670a0 0x7ff88c069550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a815ab80 0x7ff8a80b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.010 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a80cab50 0x7ff8a81568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 --2- 172.21.15.86:0/1617092914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8a81597a0 0x7ff8a8158240 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 >> 172.21.15.86:0/1617092914 conn(0x7ff8a8068390 msgr2=0x7ff8a80c1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:18.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 shutdown_connections 2023-10-09T13:13:18.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.008+0000 7ff8b07ff700 1 -- 172.21.15.86:0/1617092914 wait complete. 2023-10-09T13:13:18.027 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-09T00:00:00", "created": "2023-10-09T12:57:43", "first": "2023-10-09T12:58:00", "last": "2023-10-09T13:13:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-09T13:13:18.027 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-09T00:00:00', 'created': '2023-10-09T12:57:43', 'first': '2023-10-09T12:58:00', 'last': '2023-10-09T13:13:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-10-09T13:13:18.027 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-10-09T13:13:18.027 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-10-09T13:13:18.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-09T13:13:18.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.212+0000 7f33133ff700 1 Processor -- start 2023-10-09T13:13:18.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.212+0000 7f33133ff700 1 -- start start 2023-10-09T13:13:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f33133ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f330c1563b0 0x7f330c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f33133ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f330c15a440 0x7f330c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:18.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f33133ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c068890 0x7f330c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f33133ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c15a9b0 con 0x7f330c1563b0 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f33133ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c15ac90 con 0x7f330c15a440 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f33133ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c15af70 con 0x7f330c068890 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331119b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f330c1563b0 0x7f330c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331119b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f330c1563b0 0x7f330c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42808/0 (socket says 172.21.15.86:42808) 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331119b700 1 -- 172.21.15.86:0/2424174901 learned_addr learned my addr 172.21.15.86:0/2424174901 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331199c700 1 --2- 172.21.15.86:0/2424174901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c068890 0x7f330c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331099a700 1 --2- 172.21.15.86:0/2424174901 >> v2:172.21.15.135:3300/0 conn(0x7f330c15a440 0x7f330c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331119b700 1 -- 172.21.15.86:0/2424174901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c068890 msgr2=0x7f330c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:18.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331119b700 1 --2- 172.21.15.86:0/2424174901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c068890 0x7f330c0c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331119b700 1 -- 172.21.15.86:0/2424174901 >> v2:172.21.15.135:3300/0 conn(0x7f330c15a440 msgr2=0x7f330c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.214+0000 7f331119b700 1 --2- 172.21.15.86:0/2424174901 >> v2:172.21.15.135:3300/0 conn(0x7f330c15a440 0x7f330c0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.215+0000 7f331119b700 1 -- 172.21.15.86:0/2424174901 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c15b250 con 0x7f330c1563b0 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.215+0000 7f331199c700 1 --2- 172.21.15.86:0/2424174901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c068890 0x7f330c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.215+0000 7f331099a700 1 --2- 172.21.15.86:0/2424174901 >> v2:172.21.15.135:3300/0 conn(0x7f330c15a440 0x7f330c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.215+0000 7f331119b700 1 --2- 172.21.15.86:0/2424174901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c1563b0 0x7f330c156780 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f330c06fb10 tx=0x7f3308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1999d2ba1d4cb553 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.215+0000 7f3303fff700 1 -- 172.21.15.86:0/2424174901 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800b860 con 0x7f330c1563b0 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.215+0000 7f3303fff700 1 -- 172.21.15.86:0/2424174901 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330800b9c0 con 0x7f330c1563b0 2023-10-09T13:13:18.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.215+0000 7f3303fff700 1 -- 172.21.15.86:0/2424174901 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800bd60 con 0x7f330c1563b0 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 -- 172.21.15.86:0/2424174901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c1563b0 msgr2=0x7f330c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 --2- 172.21.15.86:0/2424174901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c1563b0 0x7f330c156780 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f330c06fb10 tx=0x7f3308009250 comp rx=0 tx=0).stop 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 -- 172.21.15.86:0/2424174901 shutdown_connections 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 --2- 172.21.15.86:0/2424174901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c068890 0x7f330c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 --2- 172.21.15.86:0/2424174901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c1563b0 0x7f330c156780 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 --2- 172.21.15.86:0/2424174901 >> v2:172.21.15.135:3300/0 conn(0x7f330c15a440 0x7f330c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 -- 172.21.15.86:0/2424174901 >> 172.21.15.86:0/2424174901 conn(0x7f330c0c8f90 msgr2=0x7f330c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 -- 172.21.15.86:0/2424174901 shutdown_connections 2023-10-09T13:13:18.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.216+0000 7f33133ff700 1 -- 172.21.15.86:0/2424174901 wait complete. 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.217+0000 7f33133ff700 1 Processor -- start 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.217+0000 7f33133ff700 1 -- start start 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f33133ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c068890 0x7f330c14cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f33133ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c1563b0 0x7f330c06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f33133ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c15a440 0x7f330c15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f33133ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c155b30 con 0x7f330c15a440 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f33133ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c16cfb0 con 0x7f330c068890 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f33133ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c16d570 con 0x7f330c1563b0 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f331199c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c15a440 0x7f330c15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:18.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.218+0000 7f331199c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c15a440 0x7f330c15bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42824/0 (socket says 172.21.15.86:42824) 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331199c700 1 -- 172.21.15.86:0/1178417199 learned_addr learned my addr 172.21.15.86:0/1178417199 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331099a700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c1563b0 0x7f330c06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331119b700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c068890 0x7f330c14cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331199c700 1 -- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c1563b0 msgr2=0x7f330c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331199c700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c1563b0 0x7f330c06e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331199c700 1 -- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c068890 msgr2=0x7f330c14cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331199c700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c068890 0x7f330c14cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331199c700 1 -- 172.21.15.86:0/1178417199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33080094f0 con 0x7f330c15a440 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f331199c700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c15a440 0x7f330c15bec0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3304009fc0 tx=0x7f33040099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:18.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f33017fa700 1 -- 172.21.15.86:0/1178417199 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400dbe0 con 0x7f330c15a440 2023-10-09T13:13:18.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f33017fa700 1 -- 172.21.15.86:0/1178417199 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400f040 con 0x7f330c15a440 2023-10-09T13:13:18.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f33017fa700 1 -- 172.21.15.86:0/1178417199 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304015440 con 0x7f330c15a440 2023-10-09T13:13:18.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.219+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c155d40 con 0x7f330c15a440 2023-10-09T13:13:18.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.220+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c14c760 con 0x7f330c15a440 2023-10-09T13:13:18.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.220+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c0718b0 con 0x7f330c15a440 2023-10-09T13:13:18.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.221+0000 7f33017fa700 1 -- 172.21.15.86:0/1178417199 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 95) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f330401e3b0 con 0x7f330c15a440 2023-10-09T13:13:18.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.222+0000 7f33017fa700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32f00670a0 0x7f32f0069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:18.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.222+0000 7f33017fa700 1 -- 172.21.15.86:0/1178417199 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f33040850c0 con 0x7f330c15a440 2023-10-09T13:13:18.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.222+0000 7f331119b700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32f00670a0 0x7f32f0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:18.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.223+0000 7f331119b700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32f00670a0 0x7f32f0069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f330c06fb10 tx=0x7f3308017000 comp rx=0 tx=0).ready entity=mgr.9372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:18.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.226+0000 7f33017fa700 1 -- 172.21.15.86:0/1178417199 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3304051c90 con 0x7f330c15a440 2023-10-09T13:13:18.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.440+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f330c16d6b0 con 0x7f32f00670a0 2023-10-09T13:13:18.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.507+0000 7f33017fa700 1 -- 172.21.15.86:0/1178417199 <== mgr.9372 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f330c16d6b0 con 0x7f32f00670a0 2023-10-09T13:13:18.509 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-10-09T13:13:18.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32f00670a0 msgr2=0x7f32f0069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:18.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32f00670a0 0x7f32f0069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f330c06fb10 tx=0x7f3308017000 comp rx=0 tx=0).stop 2023-10-09T13:13:18.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c15a440 msgr2=0x7f330c15bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c15a440 0x7f330c15bec0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3304009fc0 tx=0x7f33040099b0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 shutdown_connections 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32f00670a0 0x7f32f0069550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f330c15a440 0x7f330c15bec0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c068890 0x7f330c14cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 --2- 172.21.15.86:0/1178417199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f330c1563b0 0x7f330c06e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 >> 172.21.15.86:0/1178417199 conn(0x7f330c0c8f90 msgr2=0x7f330c157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 shutdown_connections 2023-10-09T13:13:18.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:18.510+0000 7f33133ff700 1 -- 172.21.15.86:0/1178417199 wait complete. 2023-10-09T13:13:18.528 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-10-09T13:13:18.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:18.529 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-09T13:13:18.566 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_58_00_UTC 2023-10-09T13:13:18.566 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-12_59_00_UTC 2023-10-09T13:13:18.566 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_00_00_UTC 2023-10-09T13:13:18.566 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_01_00_UTC 2023-10-09T13:13:18.566 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_02_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_03_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_04_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_05_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_06_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_07_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_08_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_09_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_10_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_11_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_12_00_UTC 2023-10-09T13:13:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_13_00_UTC 2023-10-09T13:13:18.568 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-12_58_00_UTC 2023-10-09T13:13:18.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:18.569 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-12_58_00_UTC) 2023-10-09T13:13:18.652 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-12_59_00_UTC 2023-10-09T13:13:18.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:18.653 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-12_59_00_UTC) 2023-10-09T13:13:18.736 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_00_00_UTC 2023-10-09T13:13:18.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:18.736 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_00_00_UTC) 2023-10-09T13:13:18.818 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_01_00_UTC 2023-10-09T13:13:18.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:18.819 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_01_00_UTC) 2023-10-09T13:13:18.903 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_02_00_UTC 2023-10-09T13:13:18.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:18.903 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_02_00_UTC) 2023-10-09T13:13:18.986 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_03_00_UTC 2023-10-09T13:13:18.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:18.986 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_03_00_UTC) 2023-10-09T13:13:19.068 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_04_00_UTC 2023-10-09T13:13:19.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.069 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_04_00_UTC) 2023-10-09T13:13:19.152 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_05_00_UTC 2023-10-09T13:13:19.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.153 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_05_00_UTC) 2023-10-09T13:13:19.236 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_06_00_UTC 2023-10-09T13:13:19.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.236 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_06_00_UTC) 2023-10-09T13:13:19.320 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_07_00_UTC 2023-10-09T13:13:19.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.320 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_07_00_UTC) 2023-10-09T13:13:19.403 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_08_00_UTC 2023-10-09T13:13:19.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.403 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_08_00_UTC) 2023-10-09T13:13:19.486 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_09_00_UTC 2023-10-09T13:13:19.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.486 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_09_00_UTC) 2023-10-09T13:13:19.569 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_10_00_UTC 2023-10-09T13:13:19.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.569 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_10_00_UTC) 2023-10-09T13:13:19.652 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_11_00_UTC 2023-10-09T13:13:19.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.652 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_11_00_UTC) 2023-10-09T13:13:19.734 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_12_00_UTC 2023-10-09T13:13:19.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.735 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_12_00_UTC) 2023-10-09T13:13:19.818 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_13_00_UTC 2023-10-09T13:13:19.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.818 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-09-13_13_00_UTC) 2023-10-09T13:13:19.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:19.901 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-10-09T13:13:19.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T13:13:20.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.204+0000 7fee57dff700 1 Processor -- start 2023-10-09T13:13:20.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.204+0000 7fee57dff700 1 -- start start 2023-10-09T13:13:20.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.205+0000 7fee57dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c83f0 0x7fee500c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.205+0000 7fee57dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee500ccee0 0x7fee501561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.205+0000 7fee57dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fee500c87c0 0x7fee50156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.205+0000 7fee57dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee50156c50 con 0x7fee500ccee0 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.205+0000 7fee57dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5015b0d0 con 0x7fee500c87c0 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.205+0000 7fee57dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500c7a60 con 0x7fee500c83f0 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee500ccee0 0x7fee501561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee500ccee0 0x7fee501561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42838/0 (socket says 172.21.15.86:42838) 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 -- 172.21.15.86:0/804874233 learned_addr learned my addr 172.21.15.86:0/804874233 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee55b9b700 1 --2- 172.21.15.86:0/804874233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c83f0 0x7fee500c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5639c700 1 --2- 172.21.15.86:0/804874233 >> v2:172.21.15.135:3300/0 conn(0x7fee500c87c0 0x7fee50156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:20.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 -- 172.21.15.86:0/804874233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c83f0 msgr2=0x7fee500c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 --2- 172.21.15.86:0/804874233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c83f0 0x7fee500c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 -- 172.21.15.86:0/804874233 >> v2:172.21.15.135:3300/0 conn(0x7fee500c87c0 msgr2=0x7fee50156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 --2- 172.21.15.86:0/804874233 >> v2:172.21.15.135:3300/0 conn(0x7fee500c87c0 0x7fee50156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 -- 172.21.15.86:0/804874233 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5015a4c0 con 0x7fee500ccee0 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5639c700 1 --2- 172.21.15.86:0/804874233 >> v2:172.21.15.135:3300/0 conn(0x7fee500c87c0 0x7fee50156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.206+0000 7fee5539a700 1 --2- 172.21.15.86:0/804874233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee501561d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fee500cc340 tx=0x7fee40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09eb5cf04ece151 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee54b99700 1 -- 172.21.15.86:0/804874233 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000b860 con 0x7fee500ccee0 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee54b99700 1 -- 172.21.15.86:0/804874233 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4000b9c0 con 0x7fee500ccee0 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee54b99700 1 -- 172.21.15.86:0/804874233 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000bd60 con 0x7fee500ccee0 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 -- 172.21.15.86:0/804874233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 msgr2=0x7fee501561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 --2- 172.21.15.86:0/804874233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee501561d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fee500cc340 tx=0x7fee40009250 comp rx=0 tx=0).stop 2023-10-09T13:13:20.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 -- 172.21.15.86:0/804874233 shutdown_connections 2023-10-09T13:13:20.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 --2- 172.21.15.86:0/804874233 >> v2:172.21.15.135:3300/0 conn(0x7fee500c87c0 0x7fee50156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 --2- 172.21.15.86:0/804874233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c83f0 0x7fee500c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 --2- 172.21.15.86:0/804874233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee501561d0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 -- 172.21.15.86:0/804874233 >> 172.21.15.86:0/804874233 conn(0x7fee50068e10 msgr2=0x7fee500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:20.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 -- 172.21.15.86:0/804874233 shutdown_connections 2023-10-09T13:13:20.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.207+0000 7fee57dff700 1 -- 172.21.15.86:0/804874233 wait complete. 2023-10-09T13:13:20.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.209+0000 7fee57dff700 1 Processor -- start 2023-10-09T13:13:20.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.209+0000 7fee57dff700 1 -- start start 2023-10-09T13:13:20.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee57dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500c83f0 0x7fee50151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:20.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee57dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c87c0 0x7fee501508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee57dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee500c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee57dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50159c00 con 0x7fee500ccee0 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee57dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50157f00 con 0x7fee500c83f0 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee57dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee501581e0 con 0x7fee500c87c0 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee500c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee500c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42854/0 (socket says 172.21.15.86:42854) 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 -- 172.21.15.86:0/3904909998 learned_addr learned my addr 172.21.15.86:0/3904909998 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5539a700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c87c0 0x7fee501508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee55b9b700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500c83f0 0x7fee50151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 -- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c87c0 msgr2=0x7fee501508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c87c0 0x7fee501508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 -- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500c83f0 msgr2=0x7fee50151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500c83f0 0x7fee50151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee5639c700 1 -- 172.21.15.86:0/3904909998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400094f0 con 0x7fee500ccee0 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.210+0000 7fee55b9b700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500c83f0 0x7fee50151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.211+0000 7fee5639c700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee500c9c10 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fee4800d180 tx=0x7fee48009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.211+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800dd70 con 0x7fee500ccee0 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.211+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800f040 con 0x7fee500ccee0 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.211+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee501584c0 con 0x7fee500ccee0 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.211+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48015690 con 0x7fee500ccee0 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.211+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee50150df0 con 0x7fee500ccee0 2023-10-09T13:13:20.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.212+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee501589c0 con 0x7fee500ccee0 2023-10-09T13:13:20.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.213+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 95) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fee4801e3b0 con 0x7fee500ccee0 2023-10-09T13:13:20.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.213+0000 7fee45ffb700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee340670a0 0x7fee34069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:20.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.214+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fee480851d0 con 0x7fee500ccee0 2023-10-09T13:13:20.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.214+0000 7fee55b9b700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee340670a0 0x7fee34069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:20.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.214+0000 7fee55b9b700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee340670a0 0x7fee34069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee4c006fd0 tx=0x7fee4c008040 comp rx=0 tx=0).ready entity=mgr.9372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:20.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.218+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee48051da0 con 0x7fee500ccee0 2023-10-09T13:13:20.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.463+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fee5004c3c0 con 0x7fee500ccee0 2023-10-09T13:13:20.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.523+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fee48052170 con 0x7fee500ccee0 2023-10-09T13:13:20.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.524+0000 7fee45ffb700 1 -- 172.21.15.86:0/3904909998 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v96) v1 ==== 93+0+0 (secure 0 0 0) 0x7fee48051da0 con 0x7fee500ccee0 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee340670a0 msgr2=0x7fee34069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee340670a0 0x7fee34069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee4c006fd0 tx=0x7fee4c008040 comp rx=0 tx=0).stop 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 msgr2=0x7fee500c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee500c9c10 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fee4800d180 tx=0x7fee48009a50 comp rx=0 tx=0).stop 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 shutdown_connections 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee340670a0 0x7fee34069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee500ccee0 0x7fee500c9c10 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee500c83f0 0x7fee50151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 --2- 172.21.15.86:0/3904909998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee500c87c0 0x7fee501508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:20.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 >> 172.21.15.86:0/3904909998 conn(0x7fee50068e10 msgr2=0x7fee500cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:20.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 shutdown_connections 2023-10-09T13:13:20.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:20.527+0000 7fee57dff700 1 -- 172.21.15.86:0/3904909998 wait complete. 2023-10-09T13:13:20.546 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T13:13:20.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:13:20.624 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:13:20.708 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T13:13:20.708 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T13:13:20.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:20.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T13:13:20.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:13:20.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:20.794 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T13:13:20.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:13:21.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.058+0000 7f08feb9d700 1 Processor -- start 2023-10-09T13:13:21.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.059+0000 7f08feb9d700 1 -- start start 2023-10-09T13:13:21.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08feb9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08f8157770 0x7f08f8150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08feb9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08f80c6d00 0x7f08f80c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08feb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08feb9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f806e2a0 con 0x7f08f8157770 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08feb9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f8157b40 con 0x7f08f80c6d00 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08feb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80c7690 con 0x7f08f806e730 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08fdb9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08f8157770 0x7f08f8150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08fdb9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08f8157770 0x7f08f8150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42876/0 (socket says 172.21.15.86:42876) 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08fdb9b700 1 -- 172.21.15.86:0/166876147 learned_addr learned my addr 172.21.15.86:0/166876147 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08fd39a700 1 --2- 172.21.15.86:0/166876147 >> v2:172.21.15.135:3300/0 conn(0x7f08f80c6d00 0x7f08f80c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.060+0000 7f08fe39c700 1 --2- 172.21.15.86:0/166876147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fdb9b700 1 -- 172.21.15.86:0/166876147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 msgr2=0x7f08f806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fdb9b700 1 --2- 172.21.15.86:0/166876147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f806ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fdb9b700 1 -- 172.21.15.86:0/166876147 >> v2:172.21.15.135:3300/0 conn(0x7f08f80c6d00 msgr2=0x7f08f80c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fdb9b700 1 --2- 172.21.15.86:0/166876147 >> v2:172.21.15.135:3300/0 conn(0x7f08f80c6d00 0x7f08f80c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fdb9b700 1 -- 172.21.15.86:0/166876147 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f806b2e0 con 0x7f08f8157770 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fdb9b700 1 --2- 172.21.15.86:0/166876147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f8157770 0x7f08f8150180 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f08f806d1e0 tx=0x7f08f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2668d2b63e20b54e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fcb99700 1 -- 172.21.15.86:0/166876147 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400b640 con 0x7f08f8157770 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fcb99700 1 -- 172.21.15.86:0/166876147 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400b7a0 con 0x7f08f8157770 2023-10-09T13:13:21.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.061+0000 7f08fcb99700 1 -- 172.21.15.86:0/166876147 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400bb60 con 0x7f08f8157770 2023-10-09T13:13:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 -- 172.21.15.86:0/166876147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f8157770 msgr2=0x7f08f8150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 --2- 172.21.15.86:0/166876147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f8157770 0x7f08f8150180 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f08f806d1e0 tx=0x7f08f4009250 comp rx=0 tx=0).stop 2023-10-09T13:13:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 -- 172.21.15.86:0/166876147 shutdown_connections 2023-10-09T13:13:21.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 --2- 172.21.15.86:0/166876147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f806ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 --2- 172.21.15.86:0/166876147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f8157770 0x7f08f8150180 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 --2- 172.21.15.86:0/166876147 >> v2:172.21.15.135:3300/0 conn(0x7f08f80c6d00 0x7f08f80c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 -- 172.21.15.86:0/166876147 >> 172.21.15.86:0/166876147 conn(0x7f08f80cc1f0 msgr2=0x7f08f80cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 -- 172.21.15.86:0/166876147 shutdown_connections 2023-10-09T13:13:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.062+0000 7f08feb9d700 1 -- 172.21.15.86:0/166876147 wait complete. 2023-10-09T13:13:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.063+0000 7f08feb9d700 1 Processor -- start 2023-10-09T13:13:21.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.064+0000 7f08feb9d700 1 -- start start 2023-10-09T13:13:21.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.064+0000 7f08feb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f80ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.064+0000 7f08feb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f80c6d00 0x7f08f80c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.064+0000 7f08feb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f8157770 0x7f08f80c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08feb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f816aad0 con 0x7f08f80c6d00 2023-10-09T13:13:21.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08feb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80ae680 con 0x7f08f8157770 2023-10-09T13:13:21.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08feb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80adde0 con 0x7f08f806e730 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f80c6d00 0x7f08f80c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f80c6d00 0x7f08f80c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42880/0 (socket says 172.21.15.86:42880) 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 -- 172.21.15.86:0/2667445753 learned_addr learned my addr 172.21.15.86:0/2667445753 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fdb9b700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f80ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fe39c700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f8157770 0x7f08f80c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 -- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 msgr2=0x7f08f80ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f80ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 -- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f8157770 msgr2=0x7f08f80c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f8157770 0x7f08f80c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fd39a700 1 -- 172.21.15.86:0/2667445753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40094f0 con 0x7f08f80c6d00 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fdb9b700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f80ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.065+0000 7f08fe39c700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f8157770 0x7f08f80c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.066+0000 7f08fd39a700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f80c6d00 0x7f08f80c32a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ec80 tx=0x7f08e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.066+0000 7f08edffb700 1 -- 172.21.15.86:0/2667445753 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800c850 con 0x7f08f80c6d00 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.066+0000 7f08edffb700 1 -- 172.21.15.86:0/2667445753 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800c9b0 con 0x7f08f80c6d00 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.066+0000 7f08edffb700 1 -- 172.21.15.86:0/2667445753 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800cd50 con 0x7f08f80c6d00 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.066+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f80ae0c0 con 0x7f08f80c6d00 2023-10-09T13:13:21.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.066+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f80ad980 con 0x7f08f80c6d00 2023-10-09T13:13:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.067+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f816ac40 con 0x7f08f80c6d00 2023-10-09T13:13:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.068+0000 7f08edffb700 1 -- 172.21.15.86:0/2667445753 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f08e8013680 con 0x7f08f80c6d00 2023-10-09T13:13:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.069+0000 7f08edffb700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 0x7f08dc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.069+0000 7f08edffb700 1 -- 172.21.15.86:0/2667445753 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f08e8084db0 con 0x7f08f80c6d00 2023-10-09T13:13:21.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.069+0000 7f08fdb9b700 1 -- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 msgr2=0x7f08dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:21.071 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.069+0000 7f08fdb9b700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 0x7f08dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:21.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.073+0000 7f08edffb700 1 -- 172.21.15.86:0/2667445753 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08f816ac40 con 0x7f08f80c6d00 2023-10-09T13:13:21.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.270+0000 7f08fdb9b700 1 -- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 msgr2=0x7f08dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:21.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.270+0000 7f08fdb9b700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 0x7f08dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.332+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08f816ac40 con 0x7f08f80c6d00 2023-10-09T13:13:21.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.332+0000 7f08edffb700 1 -- 172.21.15.86:0/2667445753 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f08f816ac40 con 0x7f08f80c6d00 2023-10-09T13:13:21.333 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:21.333 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7391,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3278560114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3278560114},{"type":"v1","addr":"172.21.15.135:6834","nonce":3278560114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/740435858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":740435858},{"type":"v1","addr":"172.21.15.86:6833","nonce":740435858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1073483795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1073483795},{"type":"v1","addr":"172.21.15.86:6835","nonce":1073483795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:57:22.056332+0000","modified":"2023-10-09T12:57:25.626438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"d","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3750723208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3750723208},{"type":"v1","addr":"172.21.15.135:6835","nonce":3750723208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T13:13:21.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 msgr2=0x7f08dc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:21.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 0x7f08dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f80c6d00 msgr2=0x7f08f80c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f80c6d00 0x7f08f80c32a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ec80 tx=0x7f08e80091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 shutdown_connections 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08dc067050 0x7f08dc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f8157770 0x7f08f80c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f806e730 0x7f08f80ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 --2- 172.21.15.86:0/2667445753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f80c6d00 0x7f08f80c32a0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 >> 172.21.15.86:0/2667445753 conn(0x7f08f80cc1f0 msgr2=0x7f08f80aa260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 shutdown_connections 2023-10-09T13:13:21.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.335+0000 7f08feb9d700 1 -- 172.21.15.86:0/2667445753 wait complete. 2023-10-09T13:13:21.337 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 78 2023-10-09T13:13:21.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:13:21.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.540+0000 7ff3f359e700 1 Processor -- start 2023-10-09T13:13:21.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.540+0000 7ff3f359e700 1 -- start start 2023-10-09T13:13:21.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff3f41597f0 0x7ff3f40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3f415d230 0x7ff3f415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f415db70 con 0x7ff3f4159420 2023-10-09T13:13:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40b11d0 con 0x7ff3f415d230 2023-10-09T13:13:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40b14b0 con 0x7ff3f41597f0 2023-10-09T13:13:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff3f4159420 0x7ff3f40b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41962/0 (socket says 172.21.15.86:41962) 2023-10-09T13:13:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f259c700 1 -- 172.21.15.86:0/3311433721 learned_addr learned my addr 172.21.15.86:0/3311433721 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f2d9d700 1 --2- 172.21.15.86:0/3311433721 >> v2:172.21.15.86:3300/0 conn(0x7ff3f415d230 0x7ff3f415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f1d9b700 1 --2- 172.21.15.86:0/3311433721 >> v2:172.21.15.135:3300/0 conn(0x7ff3f41597f0 0x7ff3f40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f1d9b700 1 -- 172.21.15.86:0/3311433721 >> v2:172.21.15.86:3300/0 conn(0x7ff3f415d230 msgr2=0x7ff3f415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f1d9b700 1 --2- 172.21.15.86:0/3311433721 >> v2:172.21.15.86:3300/0 conn(0x7ff3f415d230 0x7ff3f415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.542+0000 7ff3f159a700 1 -- 172.21.15.86:0/3311433721 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183849375 0 0) 0x7ff3f415db70 con 0x7ff3f4159420 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f1d9b700 1 -- 172.21.15.86:0/3311433721 >> v1:172.21.15.86:6789/0 conn(0x7ff3f4159420 legacy=0x7ff3f40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f1d9b700 1 -- 172.21.15.86:0/3311433721 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f40b1790 con 0x7ff3f41597f0 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f1d9b700 1 --2- 172.21.15.86:0/3311433721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f41597f0 0x7ff3f40b2270 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4089750 tx=0x7ff3e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d6a6047b010760 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f159a700 1 -- 172.21.15.86:0/3311433721 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8011630 con 0x7ff3f41597f0 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f159a700 1 -- 172.21.15.86:0/3311433721 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8011790 con 0x7ff3f41597f0 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.543+0000 7ff3f159a700 1 -- 172.21.15.86:0/3311433721 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8011b30 con 0x7ff3f41597f0 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 -- 172.21.15.86:0/3311433721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f41597f0 msgr2=0x7ff3f40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 --2- 172.21.15.86:0/3311433721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f41597f0 0x7ff3f40b2270 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4089750 tx=0x7ff3e80091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.545 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 -- 172.21.15.86:0/3311433721 shutdown_connections 2023-10-09T13:13:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 --2- 172.21.15.86:0/3311433721 >> v2:172.21.15.86:3300/0 conn(0x7ff3f415d230 0x7ff3f415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 --2- 172.21.15.86:0/3311433721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f41597f0 0x7ff3f40b2270 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 -- 172.21.15.86:0/3311433721 >> 172.21.15.86:0/3311433721 conn(0x7ff3f40d0660 msgr2=0x7ff3f40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 -- 172.21.15.86:0/3311433721 shutdown_connections 2023-10-09T13:13:21.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.544+0000 7ff3f359e700 1 -- 172.21.15.86:0/3311433721 wait complete. 2023-10-09T13:13:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.545+0000 7ff3f359e700 1 Processor -- start 2023-10-09T13:13:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.545+0000 7ff3f359e700 1 -- start start 2023-10-09T13:13:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.546+0000 7ff3f359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f4159420 0x7ff3f40cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.546+0000 7ff3f359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3f41597f0 0x7ff3f40c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.548 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.546+0000 7ff3f359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f415d230 0x7ff3f40c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.546+0000 7ff3f359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40c8690 con 0x7ff3f41597f0 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.546+0000 7ff3f359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40c9060 con 0x7ff3f415d230 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.546+0000 7ff3f359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40c7a80 con 0x7ff3f4159420 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3f41597f0 0x7ff3f40c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3f41597f0 0x7ff3f40c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42896/0 (socket says 172.21.15.86:42896) 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 -- 172.21.15.86:0/4191734779 learned_addr learned my addr 172.21.15.86:0/4191734779 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f259c700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f4159420 0x7ff3f40cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f2d9d700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f415d230 0x7ff3f40c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 -- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f4159420 msgr2=0x7ff3f40cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f4159420 0x7ff3f40cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 -- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f415d230 msgr2=0x7ff3f40c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f415d230 0x7ff3f40c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 -- 172.21.15.86:0/4191734779 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009420 con 0x7ff3f41597f0 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.547+0000 7ff3f1d9b700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3f41597f0 0x7ff3f40c8b20 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8013000 tx=0x7ff3e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.548+0000 7ff3e27fc700 1 -- 172.21.15.86:0/4191734779 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8000d10 con 0x7ff3f41597f0 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.548+0000 7ff3e27fc700 1 -- 172.21.15.86:0/4191734779 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8011b10 con 0x7ff3f41597f0 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.548+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f40c7d60 con 0x7ff3f41597f0 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.548+0000 7ff3e27fc700 1 -- 172.21.15.86:0/4191734779 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8025640 con 0x7ff3f41597f0 2023-10-09T13:13:21.550 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.548+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f40c8320 con 0x7ff3f41597f0 2023-10-09T13:13:21.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.549+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f404c3c0 con 0x7ff3f41597f0 2023-10-09T13:13:21.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.550+0000 7ff3e27fc700 1 -- 172.21.15.86:0/4191734779 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff3e8025a30 con 0x7ff3f41597f0 2023-10-09T13:13:21.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.551+0000 7ff3e27fc700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.551+0000 7ff3e27fc700 1 -- 172.21.15.86:0/4191734779 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7ff3e8086600 con 0x7ff3f41597f0 2023-10-09T13:13:21.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.551+0000 7ff3f259c700 1 -- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 msgr2=0x7ff3d4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:21.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.551+0000 7ff3f259c700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:21.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.558+0000 7ff3e27fc700 1 -- 172.21.15.86:0/4191734779 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3e8053360 con 0x7ff3f41597f0 2023-10-09T13:13:21.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.752+0000 7ff3f259c700 1 -- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 msgr2=0x7ff3d4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:21.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.752+0000 7ff3f259c700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:21.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.761+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3f40b1a70 con 0x7ff3f41597f0 2023-10-09T13:13:21.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.763+0000 7ff3e27fc700 1 -- 172.21.15.86:0/4191734779 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+16886 (secure 0 0 0) 0x7ff3e8056980 con 0x7ff3f41597f0 2023-10-09T13:13:21.763 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:21.763 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":182,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:08:23.061661+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:57:20.160700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T12:57:21.037369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:0/1475286588":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/3806596904":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/3426244752":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/1588237341":"2023-10-10T13:08:23.061623+0000","172.21.15.86:6836/85490":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/686933348":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/2006161390":"2023-10-10T12:57:42.329104+0000","172.21.15.86:6837/85490":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/4106571671":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/2904761160":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/379673730":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/1454267236":"2023-10-10T12:57:42.329104+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:13:21.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 msgr2=0x7ff3d4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3f41597f0 msgr2=0x7ff3f40c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3f41597f0 0x7ff3f40c8b20 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8013000 tx=0x7ff3e8017000 comp rx=0 tx=0).stop 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 shutdown_connections 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff3d4067050 0x7ff3d4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3f415d230 0x7ff3f40c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3f4159420 0x7ff3f40cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 --2- 172.21.15.86:0/4191734779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3f41597f0 0x7ff3f40c8b20 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 >> 172.21.15.86:0/4191734779 conn(0x7ff3f40d0660 msgr2=0x7ff3f4069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:21.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 shutdown_connections 2023-10-09T13:13:21.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.765+0000 7ff3f359e700 1 -- 172.21.15.86:0/4191734779 wait complete. 2023-10-09T13:13:21.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T12:57:20.160700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T12:57:21.037369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T13:13:21.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T13:13:21.810 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:21.810+0000 7f4d8f2e8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:13:21.874 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:21.874+0000 7fc8bc523180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:13:21.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.972+0000 7ff5de79d700 1 Processor -- start 2023-10-09T13:13:21.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.972+0000 7ff5de79d700 1 -- start start 2023-10-09T13:13:21.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5de79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d80aef00 0x7ff5d815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5de79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5d806e470 0x7ff5d806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5de79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80aea70 con 0x7ff5d815a3b0 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5de79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d806ee00 con 0x7ff5d806e470 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5de79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80ae480 con 0x7ff5d80aef00 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5ddf9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5d806e470 0x7ff5d806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5ddf9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5d806e470 0x7ff5d806e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42904/0 (socket says 172.21.15.86:42904) 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5ddf9c700 1 -- 172.21.15.86:0/3212059622 learned_addr learned my addr 172.21.15.86:0/3212059622 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5dd79b700 1 --1- 172.21.15.86:0/3212059622 >> v1:172.21.15.86:6789/0 conn(0x7ff5d815a3b0 0x7ff5d815a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41970/0 (socket says 172.21.15.86:41970) 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5dcf9a700 1 --2- 172.21.15.86:0/3212059622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d80aef00 0x7ff5d815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5ddf9c700 1 -- 172.21.15.86:0/3212059622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d80aef00 msgr2=0x7ff5d815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5ddf9c700 1 --2- 172.21.15.86:0/3212059622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d80aef00 0x7ff5d815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5ddf9c700 1 -- 172.21.15.86:0/3212059622 >> v1:172.21.15.86:6789/0 conn(0x7ff5d815a3b0 legacy=0x7ff5d815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5ddf9c700 1 -- 172.21.15.86:0/3212059622 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d815dd30 con 0x7ff5d806e470 2023-10-09T13:13:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.974+0000 7ff5cffff700 1 -- 172.21.15.86:0/3212059622 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825828708 0 0) 0x7ff5d80aea70 con 0x7ff5d815a3b0 2023-10-09T13:13:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.975+0000 7ff5ddf9c700 1 --2- 172.21.15.86:0/3212059622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d806e8c0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009f20 tx=0x7ff5d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbe8d4747633af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.975+0000 7ff5cffff700 1 -- 172.21.15.86:0/3212059622 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000e070 con 0x7ff5d806e470 2023-10-09T13:13:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.975+0000 7ff5cffff700 1 -- 172.21.15.86:0/3212059622 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d000b9d0 con 0x7ff5d806e470 2023-10-09T13:13:21.977 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.975+0000 7ff5cffff700 1 -- 172.21.15.86:0/3212059622 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00092e0 con 0x7ff5d806e470 2023-10-09T13:13:21.978 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:21.974+0000 7f4d8f2e8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 -- 172.21.15.86:0/3212059622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 msgr2=0x7ff5d806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 --2- 172.21.15.86:0/3212059622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d806e8c0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009f20 tx=0x7ff5d0009840 comp rx=0 tx=0).stop 2023-10-09T13:13:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 -- 172.21.15.86:0/3212059622 shutdown_connections 2023-10-09T13:13:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 --2- 172.21.15.86:0/3212059622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d806e8c0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 --2- 172.21.15.86:0/3212059622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d80aef00 0x7ff5d815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 -- 172.21.15.86:0/3212059622 >> 172.21.15.86:0/3212059622 conn(0x7ff5d80c9f70 msgr2=0x7ff5d806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 -- 172.21.15.86:0/3212059622 shutdown_connections 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.976+0000 7ff5de79d700 1 -- 172.21.15.86:0/3212059622 wait complete. 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.977+0000 7ff5de79d700 1 Processor -- start 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.977+0000 7ff5de79d700 1 -- start start 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.978+0000 7ff5de79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d8152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.978+0000 7ff5de79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80aef00 0x7ff5d8169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.978+0000 7ff5de79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d815a3b0 0x7ff5d80c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.978+0000 7ff5de79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8152a60 con 0x7ff5d806e470 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.978+0000 7ff5de79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80c49d0 con 0x7ff5d80aef00 2023-10-09T13:13:21.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.978+0000 7ff5de79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d816a290 con 0x7ff5d815a3b0 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d8152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d8152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42914/0 (socket says 172.21.15.86:42914) 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 -- 172.21.15.86:0/26826645 learned_addr learned my addr 172.21.15.86:0/26826645 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5ddf9c700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d815a3b0 0x7ff5d80c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dcf9a700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80aef00 0x7ff5d8169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 -- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d815a3b0 msgr2=0x7ff5d80c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d815a3b0 0x7ff5d80c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 -- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80aef00 msgr2=0x7ff5d8169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80aef00 0x7ff5d8169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:21.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 -- 172.21.15.86:0/26826645 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009ae0 con 0x7ff5d806e470 2023-10-09T13:13:21.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dcf9a700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80aef00 0x7ff5d8169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:21.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5dd79b700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d8152520 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c5e0 tx=0x7ff5d4001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:21.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.979+0000 7ff5cd7fa700 1 -- 172.21.15.86:0/26826645 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4005a70 con 0x7ff5d806e470 2023-10-09T13:13:21.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.980+0000 7ff5cd7fa700 1 -- 172.21.15.86:0/26826645 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4005bd0 con 0x7ff5d806e470 2023-10-09T13:13:21.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.980+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d80c3ae0 con 0x7ff5d806e470 2023-10-09T13:13:21.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.980+0000 7ff5cd7fa700 1 -- 172.21.15.86:0/26826645 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40070d0 con 0x7ff5d806e470 2023-10-09T13:13:21.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.980+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d80c40a0 con 0x7ff5d806e470 2023-10-09T13:13:21.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.981+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d80c4cb0 con 0x7ff5d806e470 2023-10-09T13:13:21.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.982+0000 7ff5cd7fa700 1 -- 172.21.15.86:0/26826645 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff5d4007480 con 0x7ff5d806e470 2023-10-09T13:13:21.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.982+0000 7ff5cd7fa700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 0x7ff5bc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:21.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.983+0000 7ff5cd7fa700 1 -- 172.21.15.86:0/26826645 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7ff5d4083f00 con 0x7ff5d806e470 2023-10-09T13:13:21.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.983+0000 7ff5dcf9a700 1 -- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 msgr2=0x7ff5bc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:21.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.983+0000 7ff5dcf9a700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 0x7ff5bc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:21.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:21.987+0000 7ff5cd7fa700 1 -- 172.21.15.86:0/26826645 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5d4050c80 con 0x7ff5d806e470 2023-10-09T13:13:22.044 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:22.043+0000 7fc8bc523180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:22.061 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:22.060+0000 7f4d8f2e8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:13:22.129 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:22.129+0000 7fc8bc523180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:13:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.184+0000 7ff5dcf9a700 1 -- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 msgr2=0x7ff5bc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:22.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.184+0000 7ff5dcf9a700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 0x7ff5bc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:22.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.185+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5d815e010 con 0x7ff5d806e470 2023-10-09T13:13:22.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.186+0000 7ff5cd7fa700 1 -- 172.21.15.86:0/26826645 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5d4017020 con 0x7ff5d806e470 2023-10-09T13:13:22.186 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T13:13:22.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 msgr2=0x7ff5bc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:22.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 0x7ff5bc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 msgr2=0x7ff5d8152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d8152520 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c5e0 tx=0x7ff5d4001040 comp rx=0 tx=0).stop 2023-10-09T13:13:22.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 shutdown_connections 2023-10-09T13:13:22.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5bc067050 0x7ff5bc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d806e470 0x7ff5d8152520 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d815a3b0 0x7ff5d80c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 --2- 172.21.15.86:0/26826645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80aef00 0x7ff5d8169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 >> 172.21.15.86:0/26826645 conn(0x7ff5d80c9f70 msgr2=0x7ff5d815d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:22.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 shutdown_connections 2023-10-09T13:13:22.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.188+0000 7ff5de79d700 1 -- 172.21.15.86:0/26826645 wait complete. 2023-10-09T13:13:22.208 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T13:13:22.287 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:22.286+0000 7f4d8f2e8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:22.361 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:22.360+0000 7fc8bc523180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:22.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.394+0000 7fcff0d9d700 1 Processor -- start 2023-10-09T13:13:22.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.394+0000 7fcff0d9d700 1 -- start start 2023-10-09T13:13:22.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcff0d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcff0d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0b2080 con 0x7fcfec0b4e70 2023-10-09T13:13:22.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcff0d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0cfb00 con 0x7fcfec0b33b0 2023-10-09T13:13:22.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcff0d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec0b5c40 con 0x7fcfec0b16d0 2023-10-09T13:13:22.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcfeb7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcfec0b4e70 0x7fcfec0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41972/0 (socket says 172.21.15.86:41972) 2023-10-09T13:13:22.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcfeb7fe700 1 -- 172.21.15.86:0/2731447321 learned_addr learned my addr 172.21.15.86:0/2731447321 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:22.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcfeaffd700 1 --2- 172.21.15.86:0/2731447321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267650250 0 0) 0x7fcfec0b2080 con 0x7fcfec0b4e70 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd4003570 con 0x7fcfec0b4e70 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865385093 0 0) 0x7fcfec0cfb00 con 0x7fcfec0b33b0 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.396+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfec0b2080 con 0x7fcfec0b33b0 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfeaffd700 1 -- 172.21.15.86:0/2731447321 >> v1:172.21.15.135:6789/0 conn(0x7fcfec0b33b0 legacy=0x7fcfec0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185963043 0 0) 0x7fcfd4003570 con 0x7fcfec0b4e70 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfeaffd700 1 -- 172.21.15.86:0/2731447321 >> v1:172.21.15.86:6789/0 conn(0x7fcfec0b4e70 legacy=0x7fcfec0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfeaffd700 1 -- 172.21.15.86:0/2731447321 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0b5f20 con 0x7fcfec0b16d0 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfeaffd700 1 --2- 172.21.15.86:0/2731447321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec0b1b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009910 tx=0x7fcfe00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3811ea71605aa4d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc001470 con 0x7fcfec0b16d0 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0011420 con 0x7fcfec0b16d0 2023-10-09T13:13:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.397+0000 7fcfea7fc700 1 -- 172.21.15.86:0/2731447321 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00117c0 con 0x7fcfec0b16d0 2023-10-09T13:13:22.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.398+0000 7fcff0d9d700 1 -- 172.21.15.86:0/2731447321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 msgr2=0x7fcfec0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.398+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/2731447321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec0b1b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009910 tx=0x7fcfe00091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.398+0000 7fcff0d9d700 1 -- 172.21.15.86:0/2731447321 shutdown_connections 2023-10-09T13:13:22.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.398+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/2731447321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec0b1b40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.398+0000 7fcff0d9d700 1 -- 172.21.15.86:0/2731447321 >> 172.21.15.86:0/2731447321 conn(0x7fcfec0d10c0 msgr2=0x7fcfec0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:22.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.398+0000 7fcff0d9d700 1 -- 172.21.15.86:0/2731447321 shutdown_connections 2023-10-09T13:13:22.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.398+0000 7fcff0d9d700 1 -- 172.21.15.86:0/2731447321 wait complete. 2023-10-09T13:13:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.399+0000 7fcff0d9d700 1 Processor -- start 2023-10-09T13:13:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.400+0000 7fcff0d9d700 1 -- start start 2023-10-09T13:13:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.400+0000 7fcff0d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.400+0000 7fcff0d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec0b33b0 0x7fcfec15e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.400+0000 7fcff0d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec0b4e70 0x7fcfec0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.400+0000 7fcff0d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec156960 con 0x7fcfec0b33b0 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.400+0000 7fcff0d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec0c8260 con 0x7fcfec0b4e70 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.400+0000 7fcff0d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec0c7370 con 0x7fcfec0b16d0 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec0b33b0 0x7fcfec15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec0b33b0 0x7fcfec15e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42920/0 (socket says 172.21.15.86:42920) 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 -- 172.21.15.86:0/1570469405 learned_addr learned my addr 172.21.15.86:0/1570469405 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeb7fe700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfebfff700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec0b4e70 0x7fcfec0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 -- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 msgr2=0x7fcfec156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 -- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec0b4e70 msgr2=0x7fcfec0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec0b4e70 0x7fcfec0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 -- 172.21.15.86:0/1570469405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0009420 con 0x7fcfec0b33b0 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.401+0000 7fcfeaffd700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec0b33b0 0x7fcfec15e570 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00030c0 tx=0x7fcfe0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.402+0000 7fcfd37fe700 1 -- 172.21.15.86:0/1570469405 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0000d10 con 0x7fcfec0b33b0 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.402+0000 7fcfd37fe700 1 -- 172.21.15.86:0/1570469405 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe001cba0 con 0x7fcfec0b33b0 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.402+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec0c7650 con 0x7fcfec0b33b0 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.402+0000 7fcfd37fe700 1 -- 172.21.15.86:0/1570469405 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe001a450 con 0x7fcfec0b33b0 2023-10-09T13:13:22.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.402+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec0c7c10 con 0x7fcfec0b33b0 2023-10-09T13:13:22.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.403+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec088990 con 0x7fcfec0b33b0 2023-10-09T13:13:22.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.404+0000 7fcfd37fe700 1 -- 172.21.15.86:0/1570469405 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fcfe001a880 con 0x7fcfec0b33b0 2023-10-09T13:13:22.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.405+0000 7fcfd37fe700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 0x7fcfd8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.405+0000 7fcfd37fe700 1 -- 172.21.15.86:0/1570469405 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fcfe00862e0 con 0x7fcfec0b33b0 2023-10-09T13:13:22.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.405+0000 7fcfeb7fe700 1 -- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 msgr2=0x7fcfd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:22.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.405+0000 7fcfeb7fe700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 0x7fcfd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:22.409 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.409+0000 7fcfd37fe700 1 -- 172.21.15.86:0/1570469405 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfe0053060 con 0x7fcfec0b33b0 2023-10-09T13:13:22.466 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:22.465+0000 7f4d8f2e8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:13:22.553 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:22.553+0000 7fc8bc523180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:13:22.584 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:22.583+0000 7f4d8f2e8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:13:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.606+0000 7fcfeb7fe700 1 -- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 msgr2=0x7fcfd8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.606+0000 7fcfeb7fe700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 0x7fcfd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:22.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.628+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfec0c83a0 con 0x7fcfec0b33b0 2023-10-09T13:13:22.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.629+0000 7fcfd37fe700 1 -- 172.21.15.86:0/1570469405 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfe0056680 con 0x7fcfec0b33b0 2023-10-09T13:13:22.629 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T13:13:22.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 msgr2=0x7fcfd8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:22.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 0x7fcfd8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec0b33b0 msgr2=0x7fcfec15e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec0b33b0 0x7fcfec15e570 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00030c0 tx=0x7fcfe0016000 comp rx=0 tx=0).stop 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 shutdown_connections 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcfd8067050 0x7fcfd8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfec0b4e70 0x7fcfec0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfec0b16d0 0x7fcfec156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 --2- 172.21.15.86:0/1570469405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec0b33b0 0x7fcfec15e570 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 >> 172.21.15.86:0/1570469405 conn(0x7fcfec0d10c0 msgr2=0x7fcfec159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.631+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 shutdown_connections 2023-10-09T13:13:22.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.632+0000 7fcff0d9d700 1 -- 172.21.15.86:0/1570469405 wait complete. 2023-10-09T13:13:22.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T13:13:22.663 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:22.663+0000 7fc8bc523180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:13:22.804 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:22.804+0000 7f4d8f2e8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:13:22.880 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:22.880+0000 7fc8bc523180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:13:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.900+0000 7f8b1ab9d700 1 Processor -- start 2023-10-09T13:13:22.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.900+0000 7f8b1ab9d700 1 -- start start 2023-10-09T13:13:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.901+0000 7f8b1ab9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b16d0 0x7f8b140b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.901+0000 7f8b1ab9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b140b2080 con 0x7f8b140b33b0 2023-10-09T13:13:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.901+0000 7f8b1ab9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b140cfb00 con 0x7f8b140b4e70 2023-10-09T13:13:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.901+0000 7f8b1ab9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140b5c40 con 0x7f8b140b16d0 2023-10-09T13:13:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b1a39c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8b140b33b0 0x7f8b140b3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41984/0 (socket says 172.21.15.86:41984) 2023-10-09T13:13:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b1a39c700 1 -- 172.21.15.86:0/1372918539 learned_addr learned my addr 172.21.15.86:0/1372918539 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:22.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b1939a700 1 --2- 172.21.15.86:0/1372918539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b16d0 0x7f8b140b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557596094 0 0) 0x7f8b140b2080 con 0x7f8b140b33b0 2023-10-09T13:13:22.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b00003570 con 0x7f8b140b33b0 2023-10-09T13:13:22.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005302040 0 0) 0x7f8b140cfb00 con 0x7f8b140b4e70 2023-10-09T13:13:22.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b140b2080 con 0x7f8b140b4e70 2023-10-09T13:13:22.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b1939a700 1 -- 172.21.15.86:0/1372918539 >> v1:172.21.15.135:6789/0 conn(0x7f8b140b4e70 legacy=0x7f8b140ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2240727855 0 0) 0x7f8b00003570 con 0x7f8b140b33b0 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b1939a700 1 -- 172.21.15.86:0/1372918539 >> v1:172.21.15.86:6789/0 conn(0x7f8b140b33b0 legacy=0x7f8b140b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.902+0000 7f8b1939a700 1 -- 172.21.15.86:0/1372918539 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140b5f20 con 0x7f8b140b16d0 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.903+0000 7f8b1939a700 1 --2- 172.21.15.86:0/1372918539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b16d0 0x7f8b140b1b40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009910 tx=0x7f8b040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b0608aae646bc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.903+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0017f0 con 0x7f8b140b16d0 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.903+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04011420 con 0x7f8b140b16d0 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.903+0000 7f8b18b99700 1 -- 172.21.15.86:0/1372918539 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040117c0 con 0x7f8b140b16d0 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.904+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/1372918539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b16d0 msgr2=0x7f8b140b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.904+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/1372918539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b16d0 0x7f8b140b1b40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009910 tx=0x7f8b040091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.904+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/1372918539 shutdown_connections 2023-10-09T13:13:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.904+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/1372918539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b16d0 0x7f8b140b1b40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.904+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/1372918539 >> 172.21.15.86:0/1372918539 conn(0x7f8b140d10c0 msgr2=0x7f8b140affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.904+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/1372918539 shutdown_connections 2023-10-09T13:13:22.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.904+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/1372918539 wait complete. 2023-10-09T13:13:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.905+0000 7f8b1ab9d700 1 Processor -- start 2023-10-09T13:13:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.905+0000 7f8b1ab9d700 1 -- start start 2023-10-09T13:13:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.906+0000 7f8b1ab9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b140b16d0 0x7f8b1414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.906+0000 7f8b1ab9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b33b0 0x7f8b140a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.906+0000 7f8b1ab9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b140b4e70 0x7f8b140a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.906+0000 7f8b1ab9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140c8840 con 0x7f8b140b16d0 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.906+0000 7f8b1ab9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140c8b20 con 0x7f8b140b4e70 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.906+0000 7f8b1ab9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140c8e00 con 0x7f8b140b33b0 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b19b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b140b16d0 0x7f8b1414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1a39c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b140b4e70 0x7f8b140a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1939a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b33b0 0x7f8b140a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b19b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b140b16d0 0x7f8b1414af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42936/0 (socket says 172.21.15.86:42936) 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b19b9b700 1 -- 172.21.15.86:0/543364849 learned_addr learned my addr 172.21.15.86:0/543364849 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:22.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1a39c700 1 -- 172.21.15.86:0/543364849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b33b0 msgr2=0x7f8b140a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1a39c700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b33b0 0x7f8b140a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1a39c700 1 -- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b140b16d0 msgr2=0x7f8b1414af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1a39c700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b140b16d0 0x7f8b1414af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1a39c700 1 -- 172.21.15.86:0/543364849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04009420 con 0x7f8b140b4e70 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b19b9b700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b140b16d0 0x7f8b1414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.907+0000 7f8b1a39c700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b140b4e70 0x7f8b140a7440 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00cb90 tx=0x7f8b0c007c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.908+0000 7f8b09ffb700 1 -- 172.21.15.86:0/543364849 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c004dc0 con 0x7f8b140b4e70 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.908+0000 7f8b09ffb700 1 -- 172.21.15.86:0/543364849 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c007150 con 0x7f8b140b4e70 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.908+0000 7f8b09ffb700 1 -- 172.21.15.86:0/543364849 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c007510 con 0x7f8b140b4e70 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.908+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b140c90e0 con 0x7f8b140b4e70 2023-10-09T13:13:22.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.908+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b140c7ad0 con 0x7f8b140b4e70 2023-10-09T13:13:22.911 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:22.909+0000 7f4d8f2e8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:22.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.909+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b14088990 con 0x7f8b140b4e70 2023-10-09T13:13:22.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.910+0000 7f8b09ffb700 1 -- 172.21.15.86:0/543364849 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f8b0c007900 con 0x7f8b140b4e70 2023-10-09T13:13:22.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.910+0000 7f8b09ffb700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 0x7f8af8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:22.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.911+0000 7f8b19b9b700 1 -- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 msgr2=0x7f8af8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:22.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.911+0000 7f8b09ffb700 1 -- 172.21.15.86:0/543364849 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f8b0c084170 con 0x7f8b140b4e70 2023-10-09T13:13:22.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.911+0000 7f8b19b9b700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 0x7f8af8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:22.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:22.915+0000 7f8b09ffb700 1 -- 172.21.15.86:0/543364849 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b0c050e90 con 0x7f8b140b4e70 2023-10-09T13:13:22.987 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:22.987+0000 7fc8bc523180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:23.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.112+0000 7f8b19b9b700 1 -- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 msgr2=0x7f8af8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:23.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.112+0000 7f8b19b9b700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 0x7f8af8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:23.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.114+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b140cd860 con 0x7f8b140b4e70 2023-10-09T13:13:23.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.115+0000 7f8b09ffb700 1 -- 172.21.15.86:0/543364849 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b0c0544b0 con 0x7f8b140b4e70 2023-10-09T13:13:23.115 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T13:13:23.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 msgr2=0x7f8af8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:23.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 0x7f8af8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b140b4e70 msgr2=0x7f8b140a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b140b4e70 0x7f8b140a7440 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00cb90 tx=0x7f8b0c007c70 comp rx=0 tx=0).stop 2023-10-09T13:13:23.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 shutdown_connections 2023-10-09T13:13:23.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8af8067050 0x7f8af8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b140b16d0 0x7f8b1414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b140b4e70 0x7f8b140a7440 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 --2- 172.21.15.86:0/543364849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b140b33b0 0x7f8b140a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 >> 172.21.15.86:0/543364849 conn(0x7f8b140d10c0 msgr2=0x7f8b14158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:23.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 shutdown_connections 2023-10-09T13:13:23.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.117+0000 7f8b1ab9d700 1 -- 172.21.15.86:0/543364849 wait complete. 2023-10-09T13:13:23.136 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:13:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.364+0000 7f241279d700 1 Processor -- start 2023-10-09T13:13:23.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.364+0000 7f241279d700 1 -- start start 2023-10-09T13:13:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.365+0000 7f241279d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f240c1595a0 0x7f240c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.365+0000 7f241279d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c0c6c60 0x7f240c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241279d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0b1410 con 0x7f240c0b1de0 2023-10-09T13:13:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241279d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0b2b90 con 0x7f240c1595a0 2023-10-09T13:13:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241279d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c063230 con 0x7f240c0c6c60 2023-10-09T13:13:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241179b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f240c1595a0 0x7f240c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f2411f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f240c0b1de0 0x7f240c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:41994/0 (socket says 172.21.15.86:41994) 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f2411f9c700 1 -- 172.21.15.86:0/3115133776 learned_addr learned my addr 172.21.15.86:0/3115133776 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f2410f9a700 1 --2- 172.21.15.86:0/3115133776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c0c6c60 0x7f240c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241179b700 1 -- 172.21.15.86:0/3115133776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c0c6c60 msgr2=0x7f240c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241179b700 1 --2- 172.21.15.86:0/3115133776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c0c6c60 0x7f240c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241179b700 1 -- 172.21.15.86:0/3115133776 >> v1:172.21.15.86:6789/0 conn(0x7f240c0b1de0 legacy=0x7f240c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f241179b700 1 -- 172.21.15.86:0/3115133776 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0634f0 con 0x7f240c1595a0 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.366+0000 7f2403fff700 1 -- 172.21.15.86:0/3115133776 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691311744 0 0) 0x7f240c0b1410 con 0x7f240c0b1de0 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.367+0000 7f241179b700 1 --2- 172.21.15.86:0/3115133776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c1595a0 0x7f240c0b18a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f24080098e0 tx=0x7f24080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1539a558a2466c81 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.367+0000 7f2403fff700 1 -- 172.21.15.86:0/3115133776 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800b640 con 0x7f240c1595a0 2023-10-09T13:13:23.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.367+0000 7f2403fff700 1 -- 172.21.15.86:0/3115133776 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240800b7a0 con 0x7f240c1595a0 2023-10-09T13:13:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.367+0000 7f2403fff700 1 -- 172.21.15.86:0/3115133776 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800bb40 con 0x7f240c1595a0 2023-10-09T13:13:23.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.367+0000 7f241279d700 1 -- 172.21.15.86:0/3115133776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c1595a0 msgr2=0x7f240c0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.367+0000 7f241279d700 1 --2- 172.21.15.86:0/3115133776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c1595a0 0x7f240c0b18a0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f24080098e0 tx=0x7f24080091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.367+0000 7f241279d700 1 -- 172.21.15.86:0/3115133776 shutdown_connections 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.368+0000 7f241279d700 1 --2- 172.21.15.86:0/3115133776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c1595a0 0x7f240c0b18a0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.368+0000 7f241279d700 1 --2- 172.21.15.86:0/3115133776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c0c6c60 0x7f240c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.368+0000 7f241279d700 1 -- 172.21.15.86:0/3115133776 >> 172.21.15.86:0/3115133776 conn(0x7f240c06ddb0 msgr2=0x7f240c06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.368+0000 7f241279d700 1 -- 172.21.15.86:0/3115133776 shutdown_connections 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.368+0000 7f241279d700 1 -- 172.21.15.86:0/3115133776 wait complete. 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.369+0000 7f241279d700 1 Processor -- start 2023-10-09T13:13:23.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.369+0000 7f241279d700 1 -- start start 2023-10-09T13:13:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f241279d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0b1de0 0x7f240c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f241279d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c0c6c60 0x7f240c152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f241279d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c1595a0 0x7f240c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f241279d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c153ba0 con 0x7f240c0c6c60 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f241279d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c14b470 con 0x7f240c0b1de0 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f241279d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c152f90 con 0x7f240c1595a0 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f2410f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c0c6c60 0x7f240c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f2410f9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c0c6c60 0x7f240c152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42948/0 (socket says 172.21.15.86:42948) 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f2410f9a700 1 -- 172.21.15.86:0/2541443663 learned_addr learned my addr 172.21.15.86:0/2541443663 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f2411f9c700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c1595a0 0x7f240c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.370+0000 7f241179b700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0b1de0 0x7f240c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f2410f9a700 1 -- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c1595a0 msgr2=0x7f240c14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f2410f9a700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c1595a0 0x7f240c14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f2410f9a700 1 -- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0b1de0 msgr2=0x7f240c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f2410f9a700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0b1de0 0x7f240c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f2410f9a700 1 -- 172.21.15.86:0/2541443663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408009420 con 0x7f240c0c6c60 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f2410f9a700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c0c6c60 0x7f240c152520 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00ecb0 tx=0x7f23fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f24017fa700 1 -- 172.21.15.86:0/2541443663 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00c850 con 0x7f240c0c6c60 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f24017fa700 1 -- 172.21.15.86:0/2541443663 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc00c9b0 con 0x7f240c0c6c60 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f24017fa700 1 -- 172.21.15.86:0/2541443663 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00cd50 con 0x7f240c0c6c60 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.371+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c153270 con 0x7f240c0c6c60 2023-10-09T13:13:23.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.372+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c153830 con 0x7f240c0c6c60 2023-10-09T13:13:23.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.372+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c04c3c0 con 0x7f240c0c6c60 2023-10-09T13:13:23.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.374+0000 7f24017fa700 1 -- 172.21.15.86:0/2541443663 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f23fc013680 con 0x7f240c0c6c60 2023-10-09T13:13:23.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.375+0000 7f24017fa700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 0x7f23f0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.375+0000 7f24017fa700 1 -- 172.21.15.86:0/2541443663 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f23fc084dd0 con 0x7f240c0c6c60 2023-10-09T13:13:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.375+0000 7f241179b700 1 -- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 msgr2=0x7f23f0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:23.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.375+0000 7f241179b700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 0x7f23f0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:23.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.379+0000 7f24017fa700 1 -- 172.21.15.86:0/2541443663 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23fc051a70 con 0x7f240c0c6c60 2023-10-09T13:13:23.390 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:23.389+0000 7f4d8f2e8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:13:23.483 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:23.483+0000 7f4d8f2e8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:13:23.494 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:23.494+0000 7fc8bc523180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:13:23.574 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:23.574+0000 7f4d8f2e8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:13:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.576+0000 7f241179b700 1 -- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 msgr2=0x7f23f0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:23.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.576+0000 7f241179b700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 0x7f23f0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:23.592 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:23.592+0000 7fc8bc523180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:13:23.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.623+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f240c153ce0 con 0x7f240c0c6c60 2023-10-09T13:13:23.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.623+0000 7f24017fa700 1 -- 172.21.15.86:0/2541443663 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f23fc055090 con 0x7f240c0c6c60 2023-10-09T13:13:23.624 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:23.624 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7391,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3278560114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3278560114},{"type":"v1","addr":"172.21.15.135:6834","nonce":3278560114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/740435858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":740435858},{"type":"v1","addr":"172.21.15.86:6833","nonce":740435858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1073483795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1073483795},{"type":"v1","addr":"172.21.15.86:6835","nonce":1073483795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:57:22.056332+0000","modified":"2023-10-09T12:57:25.626438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"d","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3750723208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3750723208},{"type":"v1","addr":"172.21.15.135:6835","nonce":3750723208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 msgr2=0x7f23f0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 0x7f23f0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c0c6c60 msgr2=0x7f240c152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c0c6c60 0x7f240c152520 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00ecb0 tx=0x7f23fc0091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 shutdown_connections 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f23f0067050 0x7f23f0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f240c1595a0 0x7f240c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0b1de0 0x7f240c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 --2- 172.21.15.86:0/2541443663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f240c0c6c60 0x7f240c152520 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 >> 172.21.15.86:0/2541443663 conn(0x7f240c06ddb0 msgr2=0x7f240c15c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:23.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 shutdown_connections 2023-10-09T13:13:23.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.626+0000 7f241279d700 1 -- 172.21.15.86:0/2541443663 wait complete. 2023-10-09T13:13:23.628 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 78 2023-10-09T13:13:23.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:13:23.688 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:23.688+0000 7fc8bc523180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:13:23.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.830+0000 7f2af619d700 1 Processor -- start 2023-10-09T13:13:23.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.831+0000 7f2af619d700 1 -- start start 2023-10-09T13:13:23.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.832+0000 7f2af619d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2af01597f0 0x7f2af00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.832 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.832+0000 7f2af619d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af00b11d0 con 0x7f2af015d230 2023-10-09T13:13:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.832+0000 7f2af619d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af00b14b0 con 0x7f2af0159420 2023-10-09T13:13:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.832+0000 7f2af619d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af00b1790 con 0x7f2af01597f0 2023-10-09T13:13:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.832+0000 7f2af599c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2af015d230 0x7f2af015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42006/0 (socket says 172.21.15.86:42006) 2023-10-09T13:13:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.832+0000 7f2af599c700 1 -- 172.21.15.86:0/524616404 learned_addr learned my addr 172.21.15.86:0/524616404 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:23.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.832+0000 7f2af499a700 1 --2- 172.21.15.86:0/524616404 >> v2:172.21.15.135:3300/0 conn(0x7f2af01597f0 0x7f2af00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2ae7fff700 1 -- 172.21.15.86:0/524616404 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630208876 0 0) 0x7f2af00b11d0 con 0x7f2af015d230 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2ae7fff700 1 -- 172.21.15.86:0/524616404 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc003570 con 0x7f2af015d230 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2af499a700 1 -- 172.21.15.86:0/524616404 >> v1:172.21.15.135:6789/0 conn(0x7f2af0159420 legacy=0x7f2af00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2af499a700 1 -- 172.21.15.86:0/524616404 >> v1:172.21.15.86:6789/0 conn(0x7f2af015d230 legacy=0x7f2af015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2af499a700 1 -- 172.21.15.86:0/524616404 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af00b1a70 con 0x7f2af01597f0 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2af499a700 1 --2- 172.21.15.86:0/524616404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af01597f0 0x7f2af00b2270 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00098e0 tx=0x7f2ae00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=572f14a14b2bfb36 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2ae7fff700 1 -- 172.21.15.86:0/524616404 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000b640 con 0x7f2af01597f0 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2ae7fff700 1 -- 172.21.15.86:0/524616404 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae000b7a0 con 0x7f2af01597f0 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.833+0000 7f2ae7fff700 1 -- 172.21.15.86:0/524616404 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000bb40 con 0x7f2af01597f0 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.834+0000 7f2af619d700 1 -- 172.21.15.86:0/524616404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af01597f0 msgr2=0x7f2af00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.834+0000 7f2af619d700 1 --2- 172.21.15.86:0/524616404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af01597f0 0x7f2af00b2270 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00098e0 tx=0x7f2ae00091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.834+0000 7f2af619d700 1 -- 172.21.15.86:0/524616404 shutdown_connections 2023-10-09T13:13:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.834+0000 7f2af619d700 1 --2- 172.21.15.86:0/524616404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af01597f0 0x7f2af00b2270 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.834+0000 7f2af619d700 1 -- 172.21.15.86:0/524616404 >> 172.21.15.86:0/524616404 conn(0x7f2af00d0660 msgr2=0x7f2af00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.834+0000 7f2af619d700 1 -- 172.21.15.86:0/524616404 shutdown_connections 2023-10-09T13:13:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.834+0000 7f2af619d700 1 -- 172.21.15.86:0/524616404 wait complete. 2023-10-09T13:13:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.836+0000 7f2af619d700 1 Processor -- start 2023-10-09T13:13:23.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.836+0000 7f2af619d700 1 -- start start 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2af0159420 0x7f2af0154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af619d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2af01597f0 0x7f2af0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af619d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af015d230 0x7f2af00c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af619d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af016adf0 con 0x7f2af01597f0 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af619d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00c58a0 con 0x7f2af015d230 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af016a830 con 0x7f2af0159420 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2af01597f0 0x7f2af0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.838 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2af01597f0 0x7f2af0159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42962/0 (socket says 172.21.15.86:42962) 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 -- 172.21.15.86:0/419174016 learned_addr learned my addr 172.21.15.86:0/419174016 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af599c700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af015d230 0x7f2af00c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af519b700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2af0159420 0x7f2af0154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 -- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2af0159420 msgr2=0x7f2af0154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2af0159420 0x7f2af0154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 -- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af015d230 msgr2=0x7f2af00c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af015d230 0x7f2af00c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af499a700 1 -- 172.21.15.86:0/419174016 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009420 con 0x7f2af01597f0 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.837+0000 7f2af599c700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af015d230 0x7f2af00c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:23.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.838+0000 7f2af499a700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2af01597f0 0x7f2af0159ca0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0013000 tx=0x7f2ae0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.838+0000 7f2ae57fa700 1 -- 172.21.15.86:0/419174016 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0000d10 con 0x7f2af01597f0 2023-10-09T13:13:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.838+0000 7f2ae57fa700 1 -- 172.21.15.86:0/419174016 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae000bb20 con 0x7f2af01597f0 2023-10-09T13:13:23.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.838+0000 7f2ae57fa700 1 -- 172.21.15.86:0/419174016 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0011670 con 0x7f2af01597f0 2023-10-09T13:13:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.838+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af016ab10 con 0x7f2af01597f0 2023-10-09T13:13:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.838+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af015a1e0 con 0x7f2af01597f0 2023-10-09T13:13:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.839+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af00c5a10 con 0x7f2af01597f0 2023-10-09T13:13:23.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.840+0000 7f2ae57fa700 1 -- 172.21.15.86:0/419174016 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f2ae00119e0 con 0x7f2af01597f0 2023-10-09T13:13:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.841+0000 7f2ae57fa700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 0x7f2ad4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.842+0000 7f2af519b700 1 -- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 msgr2=0x7f2ad4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.842+0000 7f2ae57fa700 1 -- 172.21.15.86:0/419174016 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f2ae0086140 con 0x7f2af01597f0 2023-10-09T13:13:23.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.842+0000 7f2af519b700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 0x7f2ad4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:23.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:23.846+0000 7f2ae57fa700 1 -- 172.21.15.86:0/419174016 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ae0052de0 con 0x7f2af01597f0 2023-10-09T13:13:24.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.043+0000 7f2af519b700 1 -- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 msgr2=0x7f2ad4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:24.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.043+0000 7f2af519b700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 0x7f2ad4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:24.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.046+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2af004c3c0 con 0x7f2af01597f0 2023-10-09T13:13:24.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.047+0000 7f2ae57fa700 1 -- 172.21.15.86:0/419174016 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+17001 (secure 0 0 0) 0x7f2ae0056400 con 0x7f2af01597f0 2023-10-09T13:13:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:24.048 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":183,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:13:22.527517+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:57:20.160700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T12:57:21.037369+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":183,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:0/1475286588":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/3806596904":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/3426244752":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/1588237341":"2023-10-10T13:08:23.061623+0000","172.21.15.86:6836/85490":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/686933348":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/2006161390":"2023-10-10T12:57:42.329104+0000","172.21.15.86:6837/85490":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/4106571671":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/2904761160":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/379673730":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/1454267236":"2023-10-10T12:57:42.329104+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:13:24.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 msgr2=0x7f2ad4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:24.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 0x7f2ad4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2af01597f0 msgr2=0x7f2af0159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2af01597f0 0x7f2af0159ca0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0013000 tx=0x7f2ae0017000 comp rx=0 tx=0).stop 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 shutdown_connections 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ad4067050 0x7f2ad4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af015d230 0x7f2af00c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2af0159420 0x7f2af0154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 --2- 172.21.15.86:0/419174016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2af01597f0 0x7f2af0159ca0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 >> 172.21.15.86:0/419174016 conn(0x7f2af00d0660 msgr2=0x7f2af00b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 shutdown_connections 2023-10-09T13:13:24.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.050+0000 7f2af619d700 1 -- 172.21.15.86:0/419174016 wait complete. 2023-10-09T13:13:24.068 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T13:13:24.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:13:24.195 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:24.195+0000 7f4d8f2e8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:13:24.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.321+0000 7fa95ffff700 1 Processor -- start 2023-10-09T13:13:24.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.321+0000 7fa95ffff700 1 -- start start 2023-10-09T13:13:24.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.322+0000 7fa95ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa96015d230 0x7fa96015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.322+0000 7fa95ffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600b2980 con 0x7fa960159420 2023-10-09T13:13:24.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.322+0000 7fa95ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96015dbb0 con 0x7fa9601597f0 2023-10-09T13:13:24.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.322+0000 7fa95ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600b11d0 con 0x7fa96015d230 2023-10-09T13:13:24.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95effd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa960159420 0x7fa9600b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42014/0 (socket says 172.21.15.86:42014) 2023-10-09T13:13:24.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95effd700 1 -- 172.21.15.86:0/2824064231 learned_addr learned my addr 172.21.15.86:0/2824064231 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:24.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95f7fe700 1 --2- 172.21.15.86:0/2824064231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa96015d230 0x7fa96015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988023666 0 0) 0x7fa9600b2980 con 0x7fa960159420 2023-10-09T13:13:24.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa948003570 con 0x7fa960159420 2023-10-09T13:13:24.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231826638 0 0) 0x7fa96015dbb0 con 0x7fa9601597f0 2023-10-09T13:13:24.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9600b2980 con 0x7fa9601597f0 2023-10-09T13:13:24.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95f7fe700 1 -- 172.21.15.86:0/2824064231 >> v1:172.21.15.135:6789/0 conn(0x7fa9601597f0 legacy=0x7fa9600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95f7fe700 1 -- 172.21.15.86:0/2824064231 >> v1:172.21.15.86:6789/0 conn(0x7fa960159420 legacy=0x7fa9600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3973658881 0 0) 0x7fa948003570 con 0x7fa960159420 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.323+0000 7fa95f7fe700 1 -- 172.21.15.86:0/2824064231 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600b14b0 con 0x7fa96015d230 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.324+0000 7fa95f7fe700 1 --2- 172.21.15.86:0/2824064231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa96015d230 0x7fa96015d670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa958009e90 tx=0x7fa958009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1ee37e3357803e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.324+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800e070 con 0x7fa96015d230 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.324+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800b870 con 0x7fa96015d230 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.324+0000 7fa95dffb700 1 -- 172.21.15.86:0/2824064231 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950001470 con 0x7fa96015d230 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.324+0000 7fa95ffff700 1 -- 172.21.15.86:0/2824064231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa96015d230 msgr2=0x7fa96015d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.324+0000 7fa95ffff700 1 --2- 172.21.15.86:0/2824064231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa96015d230 0x7fa96015d670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa958009e90 tx=0x7fa958009780 comp rx=0 tx=0).stop 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.325+0000 7fa95ffff700 1 -- 172.21.15.86:0/2824064231 shutdown_connections 2023-10-09T13:13:24.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.325+0000 7fa95ffff700 1 --2- 172.21.15.86:0/2824064231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa96015d230 0x7fa96015d670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.325+0000 7fa95ffff700 1 -- 172.21.15.86:0/2824064231 >> 172.21.15.86:0/2824064231 conn(0x7fa9600d0660 msgr2=0x7fa9600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:24.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.325+0000 7fa95ffff700 1 -- 172.21.15.86:0/2824064231 shutdown_connections 2023-10-09T13:13:24.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.325+0000 7fa95ffff700 1 -- 172.21.15.86:0/2824064231 wait complete. 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.326+0000 7fa95ffff700 1 Processor -- start 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.326+0000 7fa95ffff700 1 -- start start 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa960159420 0x7fa960169fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9601597f0 0x7fa9600b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa96015d230 0x7fa9601544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96014fc70 con 0x7fa9601597f0 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600b53d0 con 0x7fa96015d230 2023-10-09T13:13:24.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600b47c0 con 0x7fa960159420 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95effd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa960159420 0x7fa960169fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9601597f0 0x7fa9600b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95effd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa960159420 0x7fa960169fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38178/0 (socket says 172.21.15.86:38178) 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95effd700 1 -- 172.21.15.86:0/1306036250 learned_addr learned my addr 172.21.15.86:0/1306036250 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.327+0000 7fa95f7fe700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa96015d230 0x7fa9601544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa95effd700 1 -- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa96015d230 msgr2=0x7fa9601544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa95effd700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa96015d230 0x7fa9601544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa95effd700 1 -- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9601597f0 msgr2=0x7fa9600b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa95effd700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9601597f0 0x7fa9600b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa95effd700 1 -- 172.21.15.86:0/1306036250 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958009a20 con 0x7fa960159420 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa95effd700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa960159420 0x7fa960169fb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa95000cb90 tx=0x7fa950001ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:24.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa946ffd700 1 -- 172.21.15.86:0/1306036250 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950007150 con 0x7fa960159420 2023-10-09T13:13:24.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa946ffd700 1 -- 172.21.15.86:0/1306036250 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9500072f0 con 0x7fa960159420 2023-10-09T13:13:24.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9600b4aa0 con 0x7fa960159420 2023-10-09T13:13:24.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.328+0000 7fa946ffd700 1 -- 172.21.15.86:0/1306036250 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500076b0 con 0x7fa960159420 2023-10-09T13:13:24.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.329+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600b5060 con 0x7fa960159420 2023-10-09T13:13:24.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.329+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96004c3c0 con 0x7fa960159420 2023-10-09T13:13:24.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.330+0000 7fa946ffd700 1 -- 172.21.15.86:0/1306036250 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa950004a40 con 0x7fa960159420 2023-10-09T13:13:24.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.331+0000 7fa946ffd700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 0x7fa94c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.331+0000 7fa95e7fc700 1 -- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 msgr2=0x7fa94c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:24.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.331+0000 7fa946ffd700 1 -- 172.21.15.86:0/1306036250 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fa950084160 con 0x7fa960159420 2023-10-09T13:13:24.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.331+0000 7fa95e7fc700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 0x7fa94c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:24.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.336+0000 7fa946ffd700 1 -- 172.21.15.86:0/1306036250 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa95004c5a0 con 0x7fa960159420 2023-10-09T13:13:24.337 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:24.337+0000 7fc8bc523180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:13:24.369 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:24.368+0000 7f4d8f2e8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:24.464 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:24.464+0000 7f4d8f2e8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:13:24.513 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:24.513+0000 7fc8bc523180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:24.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.532+0000 7fa95e7fc700 1 -- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 msgr2=0x7fa94c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:24.532 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.532+0000 7fa95e7fc700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 0x7fa94c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:24.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.574+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9600b1790 con 0x7fa960159420 2023-10-09T13:13:24.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.574+0000 7fa946ffd700 1 -- 172.21.15.86:0/1306036250 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fa950050f30 con 0x7fa960159420 2023-10-09T13:13:24.575 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:24.575 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7391,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3278560114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3278560114},{"type":"v1","addr":"172.21.15.135:6834","nonce":3278560114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/740435858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":740435858},{"type":"v1","addr":"172.21.15.86:6833","nonce":740435858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1073483795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1073483795},{"type":"v1","addr":"172.21.15.86:6835","nonce":1073483795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:57:22.056332+0000","modified":"2023-10-09T12:57:25.626438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"d","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3750723208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3750723208},{"type":"v1","addr":"172.21.15.135:6835","nonce":3750723208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 msgr2=0x7fa94c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 0x7fa94c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa960159420 msgr2=0x7fa960169fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa960159420 0x7fa960169fb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa95000cb90 tx=0x7fa950001ab0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 shutdown_connections 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa94c067050 0x7fa94c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa96015d230 0x7fa9601544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa960159420 0x7fa960169fb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 --2- 172.21.15.86:0/1306036250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9601597f0 0x7fa9600b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 >> 172.21.15.86:0/1306036250 conn(0x7fa9600d0660 msgr2=0x7fa960157190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:24.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 shutdown_connections 2023-10-09T13:13:24.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.577+0000 7fa95ffff700 1 -- 172.21.15.86:0/1306036250 wait complete. 2023-10-09T13:13:24.579 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 78 2023-10-09T13:13:24.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:13:24.613 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:24.613+0000 7fc8bc523180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:13:24.759 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:24.758+0000 7f4d8f2e8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:13:24.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.785+0000 7f7dbb59e700 1 Processor -- start 2023-10-09T13:13:24.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.785+0000 7f7dbb59e700 1 -- start start 2023-10-09T13:13:24.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.786+0000 7f7dbb59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7dbc1593b0 0x7f7dbc159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.786+0000 7f7dbb59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.786+0000 7f7dbb59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0b6570 con 0x7f7dbc0ceaa0 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.786+0000 7f7dbb59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc0cfe20 con 0x7f7dbc1593b0 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.786+0000 7f7dbb59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0cf210 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7dbc1593b0 0x7f7dbc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7dbc1593b0 0x7f7dbc159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42974/0 (socket says 172.21.15.86:42974) 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 -- 172.21.15.86:0/3539715600 learned_addr learned my addr 172.21.15.86:0/3539715600 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7db9d9b700 1 --1- 172.21.15.86:0/3539715600 >> v1:172.21.15.86:6789/0 conn(0x7f7dbc0ceaa0 0x7f7dbc0b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42020/0 (socket says 172.21.15.86:42020) 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dbad9d700 1 --2- 172.21.15.86:0/3539715600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 -- 172.21.15.86:0/3539715600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0b1e50 msgr2=0x7f7dbc0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:24.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 --2- 172.21.15.86:0/3539715600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 -- 172.21.15.86:0/3539715600 >> v1:172.21.15.86:6789/0 conn(0x7f7dbc0ceaa0 legacy=0x7f7dbc0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 -- 172.21.15.86:0/3539715600 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0cf4f0 con 0x7f7dbc1593b0 2023-10-09T13:13:24.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.787+0000 7f7dba59c700 1 --2- 172.21.15.86:0/3539715600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc1593b0 0x7f7dbc159780 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0099b0 tx=0x7f7dac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486f1bd9cb5faa44 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:24.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7db959a700 1 -- 172.21.15.86:0/3539715600 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac009ea0 con 0x7f7dbc1593b0 2023-10-09T13:13:24.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7db959a700 1 -- 172.21.15.86:0/3539715600 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00b860 con 0x7f7dbc1593b0 2023-10-09T13:13:24.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7db959a700 1 -- 172.21.15.86:0/3539715600 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00bc00 con 0x7f7dbc1593b0 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7dbb59e700 1 -- 172.21.15.86:0/3539715600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc1593b0 msgr2=0x7f7dbc159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/3539715600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc1593b0 0x7f7dbc159780 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0099b0 tx=0x7f7dac009250 comp rx=0 tx=0).stop 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7dbb59e700 1 -- 172.21.15.86:0/3539715600 shutdown_connections 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/3539715600 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.788+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/3539715600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc1593b0 0x7f7dbc159780 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.789+0000 7f7dbb59e700 1 -- 172.21.15.86:0/3539715600 >> 172.21.15.86:0/3539715600 conn(0x7f7dbc0d1130 msgr2=0x7f7dbc0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.789+0000 7f7dbb59e700 1 -- 172.21.15.86:0/3539715600 shutdown_connections 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.789+0000 7f7dbb59e700 1 -- 172.21.15.86:0/3539715600 wait complete. 2023-10-09T13:13:24.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.790+0000 7f7dbb59e700 1 Processor -- start 2023-10-09T13:13:24.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.790+0000 7f7dbb59e700 1 -- start start 2023-10-09T13:13:24.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dbb59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dbb59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0ceaa0 0x7f7dbc156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dbb59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dbc1593b0 0x7f7dbc157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dbb59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc16da80 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dbb59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0c6f10 con 0x7f7dbc1593b0 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dbb59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0cc180 con 0x7f7dbc0ceaa0 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dba59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dba59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42976/0 (socket says 172.21.15.86:42976) 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.791+0000 7f7dba59c700 1 -- 172.21.15.86:0/2241011232 learned_addr learned my addr 172.21.15.86:0/2241011232 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7db9d9b700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0ceaa0 0x7f7dbc156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dbad9d700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dbc1593b0 0x7f7dbc157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dba59c700 1 -- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0ceaa0 msgr2=0x7f7dbc156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dba59c700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0ceaa0 0x7f7dbc156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dba59c700 1 -- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dbc1593b0 msgr2=0x7f7dbc157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dba59c700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dbc1593b0 0x7f7dbc157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dba59c700 1 -- 172.21.15.86:0/2241011232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0094f0 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dba59c700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b4060 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc06fe00 tx=0x7f7dac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7daa7fc700 1 -- 172.21.15.86:0/2241011232 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac000d10 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc16d150 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.792+0000 7f7daa7fc700 1 -- 172.21.15.86:0/2241011232 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00bbe0 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.793+0000 7f7daa7fc700 1 -- 172.21.15.86:0/2241011232 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac011670 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.793+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc16d710 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.794+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc04c3c0 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.794+0000 7f7daa7fc700 1 -- 172.21.15.86:0/2241011232 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f7dac011aa0 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.795+0000 7f7daa7fc700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 0x7f7d9c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:24.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.795+0000 7f7daa7fc700 1 -- 172.21.15.86:0/2241011232 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f7dac0862e0 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.795+0000 7f7db9d9b700 1 -- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 msgr2=0x7f7d9c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:24.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.795+0000 7f7db9d9b700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 0x7f7d9c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:24.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.800+0000 7f7daa7fc700 1 -- 172.21.15.86:0/2241011232 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dac052f80 con 0x7f7dbc0b1e50 2023-10-09T13:13:24.856 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:24.855+0000 7f4d8f2e8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:13:24.917 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:24.917+0000 7fc8bc523180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:13:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.996+0000 7f7db9d9b700 1 -- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 msgr2=0x7f7d9c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:24.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:24.996+0000 7f7db9d9b700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 0x7f7d9c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:25.016 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:25.016+0000 7fc8bc523180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:13:25.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.040+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dbc0cf7d0 con 0x7f7dbc0b1e50 2023-10-09T13:13:25.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.041+0000 7f7daa7fc700 1 -- 172.21.15.86:0/2241011232 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f7dac0565a0 con 0x7f7dbc0b1e50 2023-10-09T13:13:25.041 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:25.041 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7391,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3278560114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3278560114},{"type":"v1","addr":"172.21.15.135:6834","nonce":3278560114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/740435858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":740435858},{"type":"v1","addr":"172.21.15.86:6833","nonce":740435858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1073483795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1073483795},{"type":"v1","addr":"172.21.15.86:6835","nonce":1073483795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T12:57:22.056332+0000","modified":"2023-10-09T12:57:25.626438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9081},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9081":{"gid":9081,"name":"d","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/3750723208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3750723208},{"type":"v1","addr":"172.21.15.135:6835","nonce":3750723208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T13:13:25.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 msgr2=0x7f7d9c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:25.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 0x7f7d9c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc0b1e50 msgr2=0x7f7dbc0b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b4060 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc06fe00 tx=0x7f7dac017000 comp rx=0 tx=0).stop 2023-10-09T13:13:25.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 shutdown_connections 2023-10-09T13:13:25.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7d9c067050 0x7f7d9c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dbc0b1e50 0x7f7dbc0b4060 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dbc1593b0 0x7f7dbc157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 --2- 172.21.15.86:0/2241011232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dbc0ceaa0 0x7f7dbc156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 >> 172.21.15.86:0/2241011232 conn(0x7f7dbc0d1130 msgr2=0x7f7dbc068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:25.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.043+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 shutdown_connections 2023-10-09T13:13:25.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.044+0000 7f7dbb59e700 1 -- 172.21.15.86:0/2241011232 wait complete. 2023-10-09T13:13:25.046 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 78 2023-10-09T13:13:25.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:13:25.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.286+0000 7f447d79d700 1 Processor -- start 2023-10-09T13:13:25.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.286+0000 7f447d79d700 1 -- start start 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f447d79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44780b02a0 0x7f447815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f447d79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447806ae70 con 0x7f447806d950 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f447d79d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780c8a60 con 0x7f447806a0a0 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f447d79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447806a540 con 0x7f44780b02a0 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f447cf9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44780b02a0 0x7f447815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f447cf9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44780b02a0 0x7f447815bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51096/0 (socket says 172.21.15.86:51096) 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f447cf9c700 1 -- 172.21.15.86:0/2968938340 learned_addr learned my addr 172.21.15.86:0/2968938340 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.287+0000 7f4477fff700 1 --1- 172.21.15.86:0/2968938340 >> v1:172.21.15.86:6789/0 conn(0x7f447806d950 0x7f44780c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42166/0 (socket says 172.21.15.86:42166) 2023-10-09T13:13:25.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f447cf9c700 1 -- 172.21.15.86:0/2968938340 >> v1:172.21.15.135:6789/0 conn(0x7f447806a0a0 legacy=0x7f447815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f447cf9c700 1 -- 172.21.15.86:0/2968938340 >> v1:172.21.15.86:6789/0 conn(0x7f447806d950 legacy=0x7f44780c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f447cf9c700 1 -- 172.21.15.86:0/2968938340 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447806a820 con 0x7f44780b02a0 2023-10-09T13:13:25.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f4476ffd700 1 -- 172.21.15.86:0/2968938340 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523987476 0 0) 0x7f447806ae70 con 0x7f447806d950 2023-10-09T13:13:25.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f447cf9c700 1 --2- 172.21.15.86:0/2968938340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447815bb20 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4470009f20 tx=0x7f4470009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925eb3114504193e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:25.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f4476ffd700 1 -- 172.21.15.86:0/2968938340 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000e070 con 0x7f44780b02a0 2023-10-09T13:13:25.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f4476ffd700 1 -- 172.21.15.86:0/2968938340 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000ba80 con 0x7f44780b02a0 2023-10-09T13:13:25.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.288+0000 7f4476ffd700 1 -- 172.21.15.86:0/2968938340 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700092e0 con 0x7f44780b02a0 2023-10-09T13:13:25.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.289+0000 7f447d79d700 1 -- 172.21.15.86:0/2968938340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 msgr2=0x7f447815bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.289+0000 7f447d79d700 1 --2- 172.21.15.86:0/2968938340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447815bb20 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4470009f20 tx=0x7f4470009840 comp rx=0 tx=0).stop 2023-10-09T13:13:25.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.289+0000 7f447d79d700 1 -- 172.21.15.86:0/2968938340 shutdown_connections 2023-10-09T13:13:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.289+0000 7f447d79d700 1 --2- 172.21.15.86:0/2968938340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447815bb20 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.289+0000 7f447d79d700 1 -- 172.21.15.86:0/2968938340 >> 172.21.15.86:0/2968938340 conn(0x7f44780cc1f0 msgr2=0x7f44780cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.289+0000 7f447d79d700 1 -- 172.21.15.86:0/2968938340 shutdown_connections 2023-10-09T13:13:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.289+0000 7f447d79d700 1 -- 172.21.15.86:0/2968938340 wait complete. 2023-10-09T13:13:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.290+0000 7f447d79d700 1 Processor -- start 2023-10-09T13:13:25.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.291+0000 7f447d79d700 1 -- start start 2023-10-09T13:13:25.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.291+0000 7f447d79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447806a0a0 0x7f44780b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.291+0000 7f447d79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f447806d950 0x7f447814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.291+0000 7f447d79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447814c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.291+0000 7f447d79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780c9ff0 con 0x7f44780b02a0 2023-10-09T13:13:25.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447d79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780c5210 con 0x7f447806a0a0 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447d79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780c54f0 con 0x7f447806d950 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447814c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447814c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51108/0 (socket says 172.21.15.86:51108) 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f4477fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447806a0a0 0x7f44780b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 -- 172.21.15.86:0/1516276239 learned_addr learned my addr 172.21.15.86:0/1516276239 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f44777fe700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f447806d950 0x7f447814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 -- 172.21.15.86:0/1516276239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f447806d950 msgr2=0x7f447814bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f447806d950 0x7f447814bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 -- 172.21.15.86:0/1516276239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447806a0a0 msgr2=0x7f44780b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447806a0a0 0x7f44780b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 -- 172.21.15.86:0/1516276239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470009ae0 con 0x7f44780b02a0 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.292+0000 7f447cf9c700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447814c230 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f447806fe40 tx=0x7f4470018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.293+0000 7f445ffff700 1 -- 172.21.15.86:0/1516276239 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470007cd0 con 0x7f44780b02a0 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.293+0000 7f445ffff700 1 -- 172.21.15.86:0/1516276239 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470007e70 con 0x7f44780b02a0 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.293+0000 7f445ffff700 1 -- 172.21.15.86:0/1516276239 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470026690 con 0x7f44780b02a0 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.293+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44780c57d0 con 0x7f44780b02a0 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.293+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44780c44c0 con 0x7f44780b02a0 2023-10-09T13:13:25.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.294+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44780c5a10 con 0x7f44780b02a0 2023-10-09T13:13:25.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.295+0000 7f445ffff700 1 -- 172.21.15.86:0/1516276239 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f447001d420 con 0x7f44780b02a0 2023-10-09T13:13:25.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.295+0000 7f445ffff700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 0x7f4464069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.296+0000 7f445ffff700 1 -- 172.21.15.86:0/1516276239 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f4470086700 con 0x7f44780b02a0 2023-10-09T13:13:25.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.296+0000 7f4477fff700 1 -- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 msgr2=0x7f4464069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:25.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.296+0000 7f4477fff700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 0x7f4464069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:25.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.300+0000 7f445ffff700 1 -- 172.21.15.86:0/1516276239 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44780c5a10 con 0x7f44780b02a0 2023-10-09T13:13:25.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.497+0000 7f4477fff700 1 -- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 msgr2=0x7f4464069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:25.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.497+0000 7f4477fff700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 0x7f4464069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:25.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.498+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44780c9dc0 con 0x7f44780b02a0 2023-10-09T13:13:25.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.500+0000 7f445ffff700 1 -- 172.21.15.86:0/1516276239 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+17001 (secure 0 0 0) 0x7f44780c9dc0 con 0x7f44780b02a0 2023-10-09T13:13:25.500 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:25.500 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":183,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:13:22.527517+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T12:57:20.160700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T12:57:21.037369+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":183,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:0/1475286588":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/3806596904":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/3426244752":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/1588237341":"2023-10-10T13:08:23.061623+0000","172.21.15.86:6836/85490":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/686933348":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/2006161390":"2023-10-10T12:57:42.329104+0000","172.21.15.86:6837/85490":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/4106571671":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/2904761160":"2023-10-10T13:08:23.061623+0000","172.21.15.86:0/379673730":"2023-10-10T12:57:42.329104+0000","172.21.15.86:0/1454267236":"2023-10-10T12:57:42.329104+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:13:25.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 msgr2=0x7f4464069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 0x7f4464069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 msgr2=0x7f447814c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447814c230 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f447806fe40 tx=0x7f4470018000 comp rx=0 tx=0).stop 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 shutdown_connections 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4464067050 0x7f4464069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44780b02a0 0x7f447814c230 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f447806a0a0 0x7f44780b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 --2- 172.21.15.86:0/1516276239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f447806d950 0x7f447814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 >> 172.21.15.86:0/1516276239 conn(0x7f44780cc1f0 msgr2=0x7f44780c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:25.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 shutdown_connections 2023-10-09T13:13:25.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.502+0000 7f447d79d700 1 -- 172.21.15.86:0/1516276239 wait complete. 2023-10-09T13:13:25.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T13:13:25.562 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:25.561+0000 7f4d8f2e8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:13:25.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.709+0000 7fdbbe19d700 1 Processor -- start 2023-10-09T13:13:25.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.709+0000 7fdbbe19d700 1 -- start start 2023-10-09T13:13:25.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.710+0000 7fdbbe19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb81593b0 0x7fdbb8159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.710+0000 7fdbbe19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdbb80ceaa0 0x7fdbb80b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.710+0000 7fdbbe19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb80b6570 con 0x7fdbb80b1740 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.710+0000 7fdbbe19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80cfe20 con 0x7fdbb80ceaa0 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.710+0000 7fdbbe19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80cf210 con 0x7fdbb81593b0 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdbb80ceaa0 0x7fdbb80b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdbb80ceaa0 0x7fdbb80b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51112/0 (socket says 172.21.15.86:51112) 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 -- 172.21.15.86:0/3435469148 learned_addr learned my addr 172.21.15.86:0/3435469148 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbd19b700 1 --2- 172.21.15.86:0/3435469148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb81593b0 0x7fdbb8159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 -- 172.21.15.86:0/3435469148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb81593b0 msgr2=0x7fdbb8159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 --2- 172.21.15.86:0/3435469148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb81593b0 0x7fdbb8159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 -- 172.21.15.86:0/3435469148 >> v1:172.21.15.135:6789/0 conn(0x7fdbb80b1740 legacy=0x7fdbb815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 -- 172.21.15.86:0/3435469148 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb80cf4f0 con 0x7fdbb80ceaa0 2023-10-09T13:13:25.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.711+0000 7fdbbc99a700 1 --2- 172.21.15.86:0/3435469148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb80ceaa0 0x7fdbb80b6030 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fdba80099b0 tx=0x7fdba8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9793c8427071dd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbaffff700 1 -- 172.21.15.86:0/3435469148 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8009ea0 con 0x7fdbb80ceaa0 2023-10-09T13:13:25.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbaffff700 1 -- 172.21.15.86:0/3435469148 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba800b860 con 0x7fdbb80ceaa0 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbaffff700 1 -- 172.21.15.86:0/3435469148 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800bc00 con 0x7fdbb80ceaa0 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbbe19d700 1 -- 172.21.15.86:0/3435469148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb80ceaa0 msgr2=0x7fdbb80b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/3435469148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb80ceaa0 0x7fdbb80b6030 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fdba80099b0 tx=0x7fdba8009250 comp rx=0 tx=0).stop 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbbe19d700 1 -- 172.21.15.86:0/3435469148 shutdown_connections 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/3435469148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb81593b0 0x7fdbb8159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/3435469148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb80ceaa0 0x7fdbb80b6030 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.712+0000 7fdbbe19d700 1 -- 172.21.15.86:0/3435469148 >> 172.21.15.86:0/3435469148 conn(0x7fdbb80d1130 msgr2=0x7fdbb80b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.713+0000 7fdbbe19d700 1 -- 172.21.15.86:0/3435469148 shutdown_connections 2023-10-09T13:13:25.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.713+0000 7fdbbe19d700 1 -- 172.21.15.86:0/3435469148 wait complete. 2023-10-09T13:13:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.714+0000 7fdbbe19d700 1 Processor -- start 2023-10-09T13:13:25.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.714+0000 7fdbbe19d700 1 -- start start 2023-10-09T13:13:25.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbe19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb80b1740 0x7fdbb8150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbe19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb80ceaa0 0x7fdbb814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbe19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb81593b0 0x7fdbb814e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbe19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8150a10 con 0x7fdbb81593b0 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbe19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81513e0 con 0x7fdbb80b1740 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbe19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb814fe00 con 0x7fdbb80ceaa0 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbd99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb81593b0 0x7fdbb814e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbd99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb81593b0 0x7fdbb814e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51126/0 (socket says 172.21.15.86:51126) 2023-10-09T13:13:25.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbd99c700 1 -- 172.21.15.86:0/1280752817 learned_addr learned my addr 172.21.15.86:0/1280752817 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbc99a700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb80ceaa0 0x7fdbb814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.715+0000 7fdbbd19b700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb80b1740 0x7fdbb8150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbd99c700 1 -- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb80ceaa0 msgr2=0x7fdbb814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbd99c700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb80ceaa0 0x7fdbb814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbd99c700 1 -- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb80b1740 msgr2=0x7fdbb8150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbd99c700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb80b1740 0x7fdbb8150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbd99c700 1 -- 172.21.15.86:0/1280752817 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80094f0 con 0x7fdbb81593b0 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbd99c700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb81593b0 0x7fdbb814e030 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c8e0 tx=0x7fdbb0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:25.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbad7fa700 1 -- 172.21.15.86:0/1280752817 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0012630 con 0x7fdbb81593b0 2023-10-09T13:13:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbad7fa700 1 -- 172.21.15.86:0/1280752817 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0012790 con 0x7fdbb81593b0 2023-10-09T13:13:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbad7fa700 1 -- 172.21.15.86:0/1280752817 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0012b50 con 0x7fdbb81593b0 2023-10-09T13:13:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb81500e0 con 0x7fdbb81593b0 2023-10-09T13:13:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.716+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81506a0 con 0x7fdbb81593b0 2023-10-09T13:13:25.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.718+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb8150b80 con 0x7fdbb81593b0 2023-10-09T13:13:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.718+0000 7fdbad7fa700 1 -- 172.21.15.86:0/1280752817 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fdbb001a3a0 con 0x7fdbb81593b0 2023-10-09T13:13:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.719+0000 7fdbad7fa700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 0x7fdb9c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.719+0000 7fdbad7fa700 1 -- 172.21.15.86:0/1280752817 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fdbb0084ab0 con 0x7fdbb81593b0 2023-10-09T13:13:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.719+0000 7fdbbd19b700 1 -- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 msgr2=0x7fdb9c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:25.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.719+0000 7fdbbd19b700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 0x7fdb9c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:25.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.723+0000 7fdbad7fa700 1 -- 172.21.15.86:0/1280752817 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbb0055280 con 0x7fdbb81593b0 2023-10-09T13:13:25.773 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:25.773+0000 7fc8bc523180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:13:25.849 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:25.848+0000 7f4d8f2e8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:13:25.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.920+0000 7fdbbd19b700 1 -- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 msgr2=0x7fdb9c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:25.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.920+0000 7fdbbd19b700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 0x7fdb9c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:25.941 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:25.940+0000 7f4d8f2e8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:13:25.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.983+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdbb80b6570 con 0x7fdbb81593b0 2023-10-09T13:13:25.984 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T13:13:25.984+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T13:13:25.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.988+0000 7fdbad7fa700 1 -- 172.21.15.86:0/1280752817 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdbb80b6570 con 0x7fdbb81593b0 2023-10-09T13:13:25.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.990+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 msgr2=0x7fdb9c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:25.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.990+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 0x7fdb9c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.990+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb81593b0 msgr2=0x7fdbb814e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.990+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb81593b0 0x7fdbb814e030 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c8e0 tx=0x7fdbb0001710 comp rx=0 tx=0).stop 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 shutdown_connections 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdb9c067050 0x7fdb9c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbb81593b0 0x7fdbb814e030 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb80b1740 0x7fdbb8150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 --2- 172.21.15.86:0/1280752817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbb80ceaa0 0x7fdbb814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 >> 172.21.15.86:0/1280752817 conn(0x7fdbb80d1130 msgr2=0x7fdbb815e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 shutdown_connections 2023-10-09T13:13:25.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:25.991+0000 7fdbbe19d700 1 -- 172.21.15.86:0/1280752817 wait complete. 2023-10-09T13:13:25.993 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T13:13:26.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T13:13:26.049 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T13:13:26.074 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.074+0000 7fc8bc523180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:13:26.102 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:26.101+0000 7f4d8f2e8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:13:26.172 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.172+0000 7fc8bc523180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:13:26.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.201+0000 7fb17519d700 1 Processor -- start 2023-10-09T13:13:26.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.201+0000 7fb17519d700 1 -- start start 2023-10-09T13:13:26.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:26.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17519d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1700b1b40 0x7fb17015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:26.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17519d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700cfb00 con 0x7fb1700b16d0 2023-10-09T13:13:26.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17519d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700b5c40 con 0x7fb1700b1b40 2023-10-09T13:13:26.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700b5f20 con 0x7fb1700b4e70 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17499c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1700b1b40 0x7fb17015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17499c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1700b1b40 0x7fb17015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51130/0 (socket says 172.21.15.86:51130) 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17499c700 1 -- 172.21.15.86:0/3282555767 learned_addr learned my addr 172.21.15.86:0/3282555767 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb16ffff700 1 --2- 172.21.15.86:0/3282555767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17499c700 1 -- 172.21.15.86:0/3282555767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 msgr2=0x7fb1700ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17499c700 1 --2- 172.21.15.86:0/3282555767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17499c700 1 -- 172.21.15.86:0/3282555767 >> v1:172.21.15.86:6789/0 conn(0x7fb1700b16d0 legacy=0x7fb17015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.203+0000 7fb17499c700 1 -- 172.21.15.86:0/3282555767 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700b6200 con 0x7fb1700b1b40 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.204+0000 7fb17499c700 1 --2- 172.21.15.86:0/3282555767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b1b40 0x7fb17015d950 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fb168009f20 tx=0x7fb168009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3edbbdb89dc554a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:26.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.204+0000 7fb16effd700 1 -- 172.21.15.86:0/3282555767 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16800e070 con 0x7fb1700b1b40 2023-10-09T13:13:26.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.204+0000 7fb16effd700 1 -- 172.21.15.86:0/3282555767 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16800ba80 con 0x7fb1700b1b40 2023-10-09T13:13:26.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.204+0000 7fb16effd700 1 -- 172.21.15.86:0/3282555767 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680092e0 con 0x7fb1700b1b40 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.204+0000 7fb17519d700 1 -- 172.21.15.86:0/3282555767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b1b40 msgr2=0x7fb17015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.204+0000 7fb17519d700 1 --2- 172.21.15.86:0/3282555767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b1b40 0x7fb17015d950 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fb168009f20 tx=0x7fb168009840 comp rx=0 tx=0).stop 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.205+0000 7fb17519d700 1 -- 172.21.15.86:0/3282555767 shutdown_connections 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.205+0000 7fb17519d700 1 --2- 172.21.15.86:0/3282555767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b1b40 0x7fb17015d950 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.205+0000 7fb17519d700 1 --2- 172.21.15.86:0/3282555767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.205+0000 7fb17519d700 1 -- 172.21.15.86:0/3282555767 >> 172.21.15.86:0/3282555767 conn(0x7fb1700d10c0 msgr2=0x7fb1700affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.205+0000 7fb17519d700 1 -- 172.21.15.86:0/3282555767 shutdown_connections 2023-10-09T13:13:26.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.205+0000 7fb17519d700 1 -- 172.21.15.86:0/3282555767 wait complete. 2023-10-09T13:13:26.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.206+0000 7fb17519d700 1 Processor -- start 2023-10-09T13:13:26.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.206+0000 7fb17519d700 1 -- start start 2023-10-09T13:13:26.208 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:26.206+0000 7f4d8f2e8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:13:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb17519d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b16d0 0x7fb1700c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb17519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700b1b40 0x7fb170156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb17519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb17519d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170144be0 con 0x7fb1700b16d0 2023-10-09T13:13:26.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb17519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700c7060 con 0x7fb1700b1b40 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb17519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700c6730 con 0x7fb1700b4e70 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b16d0 0x7fb1700c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b16d0 0x7fb1700c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51140/0 (socket says 172.21.15.86:51140) 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb16ffff700 1 -- 172.21.15.86:0/3608595991 learned_addr learned my addr 172.21.15.86:0/3608595991 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb17499c700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.207+0000 7fb16f7fe700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700b1b40 0x7fb170156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb16ffff700 1 -- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 msgr2=0x7fb1700cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb16ffff700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb16ffff700 1 -- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700b1b40 msgr2=0x7fb170156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb16ffff700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700b1b40 0x7fb170156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb16ffff700 1 -- 172.21.15.86:0/3608595991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168009ae0 con 0x7fb1700b16d0 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb16ffff700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b16d0 0x7fb1700c9760 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fb16000d860 tx=0x7fb160008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600125f0 con 0x7fb1700b16d0 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160012750 con 0x7fb1700b16d0 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160012b10 con 0x7fb1700b16d0 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1700c6a10 con 0x7fb1700b16d0 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.208+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1700cbfb0 con 0x7fb1700b16d0 2023-10-09T13:13:26.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.210+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1700c7340 con 0x7fb1700b16d0 2023-10-09T13:13:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.210+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 96) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fb16001e460 con 0x7fb1700b16d0 2023-10-09T13:13:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.211+0000 7fb157fff700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 0x7fb15c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:26.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.211+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6812+0+0 (secure 0 0 0) 0x7fb160085030 con 0x7fb1700b16d0 2023-10-09T13:13:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.211+0000 7fb16f7fe700 1 -- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 msgr2=0x7fb15c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:26.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.211+0000 7fb16f7fe700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 0x7fb15c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.219+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1600557d0 con 0x7fb1700b16d0 2023-10-09T13:13:26.335 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.335+0000 7fc8bc523180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:13:26.397 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:26.397+0000 7f4d8f2e8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:13:26.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.412+0000 7fb16f7fe700 1 -- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 msgr2=0x7fb15c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:26.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.412+0000 7fb16f7fe700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 0x7fb15c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:26.441 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.441+0000 7fc8bc523180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:13:26.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.459+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb17004bb80 con 0x7fb1700b16d0 2023-10-09T13:13:26.491 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:26.490+0000 7f4d8f2e8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:13:26.585 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:26.584+0000 7f4d8f2e8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:13:26.634 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.634+0000 7fc8bc523180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:13:26.679 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:26.678+0000 7f4d8f2e8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:13:26.728 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.727+0000 7fc8bc523180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:13:26.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.813+0000 7fb16f7fe700 1 -- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 msgr2=0x7fb15c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:26.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.813+0000 7fb16f7fe700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 0x7fb15c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T13:13:26.820 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.820+0000 7fc8bc523180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:13:26.915 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.915+0000 7fc8bc523180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:13:26.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.923+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 97) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fb160052110 con 0x7fb1700b16d0 2023-10-09T13:13:26.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.924+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 msgr2=0x7fb15c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:26.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.924+0000 7fb157fff700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 0x7fb15c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.990+0000 7fb157fff700 1 -- 172.21.15.86:0/3608595991 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb160070290 con 0x7fb1700b16d0 2023-10-09T13:13:26.990 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.990+0000 7fc836901700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.991 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.990+0000 7fc836901700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.992 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.990+0000 7fc836901700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.992 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.990+0000 7fc836901700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.992 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.990+0000 7fc836901700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.992 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.991+0000 7fc839907700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.993 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.991+0000 7fc839907700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.993 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.991+0000 7fc839907700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.993 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.991+0000 7fc839907700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.993 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.991+0000 7fc839907700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b16d0 msgr2=0x7fb1700c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b16d0 0x7fb1700c9760 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fb16000d860 tx=0x7fb160008040 comp rx=0 tx=0).stop 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 shutdown_connections 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb15c067050 0x7fb15c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1700b16d0 0x7fb1700c9760 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1700b4e70 0x7fb1700cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 --2- 172.21.15.86:0/3608595991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700b1b40 0x7fb170156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:26.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.993+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 >> 172.21.15.86:0/3608595991 conn(0x7fb1700d10c0 msgr2=0x7fb170159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:26.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.994+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 shutdown_connections 2023-10-09T13:13:26.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:26.994+0000 7fb17519d700 1 -- 172.21.15.86:0/3608595991 wait complete. 2023-10-09T13:13:26.995 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.994+0000 7fc839907700 -1 client.9591 mdsmap subscription failed: (2) No such file or directory 2023-10-09T13:13:26.995 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:26.994+0000 7fc836901700 -1 client.9588 mdsmap subscription failed: (2) No such file or directory 2023-10-09T13:13:27.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T13:13:27.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.208+0000 7ff87759e700 1 Processor -- start 2023-10-09T13:13:27.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.208+0000 7ff87759e700 1 -- start start 2023-10-09T13:13:27.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.209+0000 7ff87759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff8780ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:27.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.209+0000 7ff87759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780aec90 con 0x7ff878159dc0 2023-10-09T13:13:27.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.209+0000 7ff87759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87815a480 con 0x7ff878153850 2023-10-09T13:13:27.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.209+0000 7ff87759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780afb40 con 0x7ff878153480 2023-10-09T13:13:27.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff876d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff878159dc0 0x7ff878157280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42180/0 (socket says 172.21.15.86:42180) 2023-10-09T13:13:27.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff876d9d700 1 -- 172.21.15.86:0/1669268445 learned_addr learned my addr 172.21.15.86:0/1669268445 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:27.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87659c700 1 --2- 172.21.15.86:0/1669268445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff8780ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:27.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87559a700 1 -- 172.21.15.86:0/1669268445 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181119503 0 0) 0x7ff8780aec90 con 0x7ff878159dc0 2023-10-09T13:13:27.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87559a700 1 -- 172.21.15.86:0/1669268445 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff860004680 con 0x7ff878159dc0 2023-10-09T13:13:27.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87559a700 1 -- 172.21.15.86:0/1669268445 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138876025 0 0) 0x7ff87815a480 con 0x7ff878153850 2023-10-09T13:13:27.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87559a700 1 -- 172.21.15.86:0/1669268445 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8780aec90 con 0x7ff878153850 2023-10-09T13:13:27.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87659c700 1 -- 172.21.15.86:0/1669268445 >> v1:172.21.15.135:6789/0 conn(0x7ff878153850 legacy=0x7ff8781596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:27.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87659c700 1 -- 172.21.15.86:0/1669268445 >> v1:172.21.15.86:6789/0 conn(0x7ff878159dc0 legacy=0x7ff878157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.210+0000 7ff87659c700 1 -- 172.21.15.86:0/1669268445 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780afe20 con 0x7ff878153480 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87659c700 1 --2- 172.21.15.86:0/1669268445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff8780ae750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff868009910 tx=0x7ff8680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd863b80f95b628 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87559a700 1 -- 172.21.15.86:0/1669268445 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868011630 con 0x7ff878153480 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87559a700 1 -- 172.21.15.86:0/1669268445 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868011790 con 0x7ff878153480 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87559a700 1 -- 172.21.15.86:0/1669268445 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868011b30 con 0x7ff878153480 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87759e700 1 -- 172.21.15.86:0/1669268445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 msgr2=0x7ff8780ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87759e700 1 --2- 172.21.15.86:0/1669268445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff8780ae750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff868009910 tx=0x7ff8680091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87759e700 1 -- 172.21.15.86:0/1669268445 shutdown_connections 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87759e700 1 --2- 172.21.15.86:0/1669268445 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff8780ae750 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.211+0000 7ff87759e700 1 -- 172.21.15.86:0/1669268445 >> 172.21.15.86:0/1669268445 conn(0x7ff878068e20 msgr2=0x7ff8780cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.212+0000 7ff87759e700 1 -- 172.21.15.86:0/1669268445 shutdown_connections 2023-10-09T13:13:27.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.212+0000 7ff87759e700 1 -- 172.21.15.86:0/1669268445 wait complete. 2023-10-09T13:13:27.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.213+0000 7ff87759e700 1 Processor -- start 2023-10-09T13:13:27.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.213+0000 7ff87759e700 1 -- start start 2023-10-09T13:13:27.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff87759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff878151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:27.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff87759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff878153850 0x7ff8780a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:27.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff87759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff878159dc0 0x7ff87815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:27.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff87759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780abaa0 con 0x7ff878153850 2023-10-09T13:13:27.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff87759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780abd80 con 0x7ff878159dc0 2023-10-09T13:13:27.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff87759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780ac060 con 0x7ff878153480 2023-10-09T13:13:27.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff875d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff878153850 0x7ff8780a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:27.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff875d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff878153850 0x7ff8780a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51286/0 (socket says 172.21.15.86:51286) 2023-10-09T13:13:27.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.214+0000 7ff875d9b700 1 -- 172.21.15.86:0/1365268302 learned_addr learned my addr 172.21.15.86:0/1365268302 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff87659c700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff878151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff876d9d700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff878159dc0 0x7ff87815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff875d9b700 1 -- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 msgr2=0x7ff878151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff875d9b700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff878151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff875d9b700 1 -- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff878159dc0 msgr2=0x7ff87815e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff875d9b700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff878159dc0 0x7ff87815e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff875d9b700 1 -- 172.21.15.86:0/1365268302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff868009420 con 0x7ff878153850 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff87659c700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff878151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff876d9d700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff878159dc0 0x7ff87815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:27.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff875d9b700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff878153850 0x7ff8780a6580 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c7c0 tx=0x7ff86c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:27.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c010510 con 0x7ff878153850 2023-10-09T13:13:27.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c010690 con 0x7ff878153850 2023-10-09T13:13:27.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c010a50 con 0x7ff878153850 2023-10-09T13:13:27.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8780ac340 con 0x7ff878153850 2023-10-09T13:13:27.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.215+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8780a6ac0 con 0x7ff878153850 2023-10-09T13:13:27.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.216+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8780ac860 con 0x7ff878153850 2023-10-09T13:13:27.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.217+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 97) v1 ==== 84451+0+0 (secure 0 0 0) 0x7ff86c01b400 con 0x7ff878153850 2023-10-09T13:13:27.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.218+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 7156+0+0 (secure 0 0 0) 0x7ff86c0844a0 con 0x7ff878153850 2023-10-09T13:13:27.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.222+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8780ac860 con 0x7ff878153850 2023-10-09T13:13:27.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.414+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8780ac860 con 0x7ff878153850 2023-10-09T13:13:27.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.929+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 98) v1 ==== 84578+0+0 (secure 0 0 0) 0x7ff86c084120 con 0x7ff878153850 2023-10-09T13:13:27.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.930+0000 7ff8667fc700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff85806ce80 0x7ff85806f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:27.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.931+0000 7ff87659c700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff85806ce80 0x7ff85806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:27.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.933+0000 7ff87659c700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff85806ce80 0x7ff85806f260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff868009860 tx=0x7ff868017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:27.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:27.995+0000 7ff8667fc700 1 -- 172.21.15.86:0/1365268302 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v186) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff86c06f960 con 0x7ff878153850 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff85806ce80 msgr2=0x7ff85806f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff85806ce80 0x7ff85806f260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff868009860 tx=0x7ff868017000 comp rx=0 tx=0).stop 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff878153850 msgr2=0x7ff8780a6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff878153850 0x7ff8780a6580 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c7c0 tx=0x7ff86c007de0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 shutdown_connections 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff85806ce80 0x7ff85806f260 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff878159dc0 0x7ff87815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff878153480 0x7ff878151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 --2- 172.21.15.86:0/1365268302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff878153850 0x7ff8780a6580 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.001 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.000+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 >> 172.21.15.86:0/1365268302 conn(0x7ff878068e20 msgr2=0x7ff878157c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:28.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.001+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 shutdown_connections 2023-10-09T13:13:28.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.001+0000 7ff87759e700 1 -- 172.21.15.86:0/1365268302 wait complete. 2023-10-09T13:13:28.002 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T13:13:28.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T13:13:28.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.206+0000 7f9b9d1ff700 1 Processor -- start 2023-10-09T13:13:28.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.206+0000 7f9b9d1ff700 1 -- start start 2023-10-09T13:13:28.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.207+0000 7f9b9d1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b98154320 0x7f9b9806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:28.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.207+0000 7f9b9d1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980b4570 con 0x7f9b98153f50 2023-10-09T13:13:28.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.207+0000 7f9b9d1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980b2710 con 0x7f9b9815a190 2023-10-09T13:13:28.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.207+0000 7f9b9d1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9815a730 con 0x7f9b98154320 2023-10-09T13:13:28.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b9659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b98154320 0x7f9b9806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:28.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b9659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b98154320 0x7f9b9806d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51292/0 (socket says 172.21.15.86:51292) 2023-10-09T13:13:28.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b9659c700 1 -- 172.21.15.86:0/1224724192 learned_addr learned my addr 172.21.15.86:0/1224724192 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:28.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b9659c700 1 -- 172.21.15.86:0/1224724192 >> v1:172.21.15.135:6789/0 conn(0x7f9b9815a190 legacy=0x7f9b98069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:28.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b9659c700 1 -- 172.21.15.86:0/1224724192 >> v1:172.21.15.86:6789/0 conn(0x7f9b98153f50 legacy=0x7f9b980b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b9659c700 1 -- 172.21.15.86:0/1224724192 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9815aa10 con 0x7f9b98154320 2023-10-09T13:13:28.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b9659c700 1 --2- 172.21.15.86:0/1224724192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b9806d130 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0099b0 tx=0x7f9b8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bdd77e4227c923 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:28.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.208+0000 7f9b95d9b700 1 -- 172.21.15.86:0/1224724192 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00b820 con 0x7f9b98154320 2023-10-09T13:13:28.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b95d9b700 1 -- 172.21.15.86:0/1224724192 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00b980 con 0x7f9b98154320 2023-10-09T13:13:28.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b95d9b700 1 -- 172.21.15.86:0/1224724192 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00bd20 con 0x7f9b98154320 2023-10-09T13:13:28.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/1224724192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 msgr2=0x7f9b9806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/1224724192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b9806d130 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0099b0 tx=0x7f9b8c009250 comp rx=0 tx=0).stop 2023-10-09T13:13:28.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/1224724192 shutdown_connections 2023-10-09T13:13:28.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/1224724192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b9806d130 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/1224724192 >> 172.21.15.86:0/1224724192 conn(0x7f9b9806baf0 msgr2=0x7f9b9806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:28.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/1224724192 shutdown_connections 2023-10-09T13:13:28.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.209+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/1224724192 wait complete. 2023-10-09T13:13:28.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.211+0000 7f9b9d1ff700 1 Processor -- start 2023-10-09T13:13:28.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.211+0000 7f9b9d1ff700 1 -- start start 2023-10-09T13:13:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9d1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b98153f50 0x7f9b981595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:28.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9d1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b980caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9d1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9815a190 0x7f9b980cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9d1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9816e970 con 0x7f9b98154320 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9d1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98147bb0 con 0x7f9b9815a190 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9d1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9816dd60 con 0x7f9b98153f50 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b980caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b980caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51308/0 (socket says 172.21.15.86:51308) 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 -- 172.21.15.86:0/3368942256 learned_addr learned my addr 172.21.15.86:0/3368942256 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 -- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b98153f50 msgr2=0x7f9b981595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b98153f50 0x7f9b981595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 -- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9815a190 msgr2=0x7f9b980cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9759e700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9815a190 0x7f9b980cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9815a190 0x7f9b980cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9659c700 1 -- 172.21.15.86:0/3368942256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c0094f0 con 0x7f9b98154320 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.212+0000 7f9b9759e700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9815a190 0x7f9b980cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.213+0000 7f9b9659c700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b980caa10 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c010 tx=0x7f9b8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.213+0000 7f9b7effd700 1 -- 172.21.15.86:0/3368942256 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c011e10 con 0x7f9b98154320 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.213+0000 7f9b7effd700 1 -- 172.21.15.86:0/3368942256 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c020070 con 0x7f9b98154320 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.213+0000 7f9b7effd700 1 -- 172.21.15.86:0/3368942256 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c01b6a0 con 0x7f9b98154320 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.213+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9816e040 con 0x7f9b98154320 2023-10-09T13:13:28.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.213+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9816e600 con 0x7f9b98154320 2023-10-09T13:13:28.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.214+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b98152910 con 0x7f9b98154320 2023-10-09T13:13:28.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.215+0000 7f9b7effd700 1 -- 172.21.15.86:0/3368942256 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 98) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f9b8c022030 con 0x7f9b98154320 2023-10-09T13:13:28.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.216+0000 7f9b7effd700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b84066d80 0x7f9b84069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:28.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.216+0000 7f9b7effd700 1 -- 172.21.15.86:0/3368942256 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6718+0+0 (secure 0 0 0) 0x7f9b8c0866a0 con 0x7f9b98154320 2023-10-09T13:13:28.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.216+0000 7f9b96d9d700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b84066d80 0x7f9b84069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:28.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.217+0000 7f9b96d9d700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b84066d80 0x7f9b84069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b980ccbb0 tx=0x7f9b88007b40 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:28.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.220+0000 7f9b7effd700 1 -- 172.21.15.86:0/3368942256 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b8c053700 con 0x7f9b98154320 2023-10-09T13:13:28.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.411+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b98152910 con 0x7f9b98154320 2023-10-09T13:13:28.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.994+0000 7f9b7effd700 1 -- 172.21.15.86:0/3368942256 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v187) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9b8c056d20 con 0x7f9b98154320 2023-10-09T13:13:28.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b84066d80 msgr2=0x7f9b84069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b84066d80 0x7f9b84069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b980ccbb0 tx=0x7f9b88007b40 comp rx=0 tx=0).stop 2023-10-09T13:13:28.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 msgr2=0x7f9b980caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:28.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b980caa10 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c010 tx=0x7f9b8c016000 comp rx=0 tx=0).stop 2023-10-09T13:13:28.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 shutdown_connections 2023-10-09T13:13:28.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b84066d80 0x7f9b84069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:28.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9815a190 0x7f9b980cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b98153f50 0x7f9b981595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 --2- 172.21.15.86:0/3368942256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b98154320 0x7f9b980caa10 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.998+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 >> 172.21.15.86:0/3368942256 conn(0x7f9b9806baf0 msgr2=0x7f9b9806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:29.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.999+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 shutdown_connections 2023-10-09T13:13:29.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:28.999+0000 7f9b9d1ff700 1 -- 172.21.15.86:0/3368942256 wait complete. 2023-10-09T13:13:29.000 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T13:13:29.018 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T13:13:29.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.203+0000 7fedb9bff700 1 Processor -- start 2023-10-09T13:13:29.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.204+0000 7fedb9bff700 1 -- start start 2023-10-09T13:13:29.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.205+0000 7fedb9bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 0x7fedb406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.205+0000 7fedb9bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb406eb90 con 0x7fedb40c70b0 2023-10-09T13:13:29.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.205+0000 7fedb9bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb406ee70 con 0x7fedb4069e80 2023-10-09T13:13:29.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.205+0000 7fedb9bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb406f150 con 0x7fedb4155eb0 2023-10-09T13:13:29.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.205+0000 7fedb2ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fedb40c70b0 0x7fedb4069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42204/0 (socket says 172.21.15.86:42204) 2023-10-09T13:13:29.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.205+0000 7fedb2ffd700 1 -- 172.21.15.86:0/3240698200 learned_addr learned my addr 172.21.15.86:0/3240698200 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb37fe700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 0x7fedb406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637397470 0 0) 0x7fedb406eb90 con 0x7fedb40c70b0 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed9c003570 con 0x7fedb40c70b0 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1998339041 0 0) 0x7fed9c003570 con 0x7fedb40c70b0 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 msgr2=0x7fedb406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 0x7fedb406e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 >> v1:172.21.15.135:6789/0 conn(0x7fedb4069e80 legacy=0x7fedb40ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb406f430 con 0x7fedb40c70b0 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7feda8001470 con 0x7fedb40c70b0 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 >> v1:172.21.15.86:6789/0 conn(0x7fedb40c70b0 legacy=0x7fedb4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 0x7fed9c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9c004060 0x7fed9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fed9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb406f150 con 0x7fed9c004d50 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c00bc20 con 0x7fed9c004060 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c00bde0 con 0x7fedb4155eb0 2023-10-09T13:13:29.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb3fff700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fed9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb37fe700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 0x7fed9c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.206+0000 7fedb2ffd700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9c004060 0x7fed9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb3fff700 1 -- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 msgr2=0x7fed9c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb3fff700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb4155eb0 0x7fed9c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb3fff700 1 -- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9c004060 msgr2=0x7fed9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb3fff700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9c004060 0x7fed9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb3fff700 1 -- 172.21.15.86:0/3240698200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c003570 con 0x7fed9c004d50 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb3fff700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fed9c0051c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fedac001f90 tx=0x7fedac001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a2c2e816c9b6ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac001950 con 0x7fed9c004d50 2023-10-09T13:13:29.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00c8b0 con 0x7fed9c004d50 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.207+0000 7fedb27fc700 1 -- 172.21.15.86:0/3240698200 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00cc50 con 0x7fed9c004d50 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.208+0000 7fedb9bff700 1 -- 172.21.15.86:0/3240698200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 msgr2=0x7fed9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.208+0000 7fedb9bff700 1 --2- 172.21.15.86:0/3240698200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fed9c0051c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fedac001f90 tx=0x7fedac001640 comp rx=0 tx=0).stop 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.208+0000 7fedb3fff700 1 -- 172.21.15.86:0/3240698200 reap_dead start 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.208+0000 7fedb9bff700 1 -- 172.21.15.86:0/3240698200 shutdown_connections 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.208+0000 7fedb9bff700 1 -- 172.21.15.86:0/3240698200 >> 172.21.15.86:0/3240698200 conn(0x7fedb4068e10 msgr2=0x7fedb40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.208+0000 7fedb9bff700 1 -- 172.21.15.86:0/3240698200 shutdown_connections 2023-10-09T13:13:29.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.208+0000 7fedb9bff700 1 -- 172.21.15.86:0/3240698200 wait complete. 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.209+0000 7fedb9bff700 1 Processor -- start 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.209+0000 7fedb9bff700 1 -- start start 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.210+0000 7fedb9bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fedb415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.210+0000 7fedb9bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb415ba50 0x7fedb4167f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.210+0000 7fedb9bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb41684a0 0x7fedb415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.210+0000 7fedb9bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb4156970 con 0x7fed9c004d50 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.210+0000 7fedb9bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415cdd0 con 0x7fedb41684a0 2023-10-09T13:13:29.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.210+0000 7fedb9bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415c1c0 con 0x7fedb415ba50 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fedb415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fedb415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51334/0 (socket says 172.21.15.86:51334) 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 -- 172.21.15.86:0/1128380134 learned_addr learned my addr 172.21.15.86:0/1128380134 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb2ffd700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb415ba50 0x7fedb4167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 -- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb415ba50 msgr2=0x7fedb4167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb3fff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb41684a0 0x7fedb415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb415ba50 0x7fedb4167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 -- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb41684a0 msgr2=0x7fedb415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb41684a0 0x7fedb415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 -- 172.21.15.86:0/1128380134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb415c4a0 con 0x7fed9c004d50 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb2ffd700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb415ba50 0x7fedb4167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb3fff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb41684a0 0x7fedb415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb37fe700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fedb415e550 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7feda4011a90 tx=0x7feda400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fed9b7fe700 1 -- 172.21.15.86:0/1128380134 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400fb10 con 0x7fed9c004d50 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fed9b7fe700 1 -- 172.21.15.86:0/1128380134 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda400fc70 con 0x7fed9c004d50 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fed9b7fe700 1 -- 172.21.15.86:0/1128380134 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4013440 con 0x7fed9c004d50 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.211+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb415c780 con 0x7fed9c004d50 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.212+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb41545d0 con 0x7fed9c004d50 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.213+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb404c3c0 con 0x7fed9c004d50 2023-10-09T13:13:29.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.213+0000 7fed9b7fe700 1 -- 172.21.15.86:0/1128380134 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 98) v1 ==== 84578+0+0 (secure 0 0 0) 0x7feda40137b0 con 0x7fed9c004d50 2023-10-09T13:13:29.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.214+0000 7fed9b7fe700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feda0066d80 0x7feda0069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.214+0000 7fed9b7fe700 1 -- 172.21.15.86:0/1128380134 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7feda4017030 con 0x7fed9c004d50 2023-10-09T13:13:29.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.215+0000 7fedb2ffd700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feda0066d80 0x7feda0069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.215+0000 7fedb2ffd700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feda0066d80 0x7feda0069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feda80015a0 tx=0x7feda8009040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:29.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.219+0000 7fed9b7fe700 1 -- 172.21.15.86:0/1128380134 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feda4055c20 con 0x7fed9c004d50 2023-10-09T13:13:29.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.408+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fedb4156280 con 0x7fed9c004d50 2023-10-09T13:13:29.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.412+0000 7fed9b7fe700 1 -- 172.21.15.86:0/1128380134 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v61) v1 ==== 115+0+0 (secure 0 0 0) 0x7feda40557b0 con 0x7fed9c004d50 2023-10-09T13:13:29.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.414+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feda0066d80 msgr2=0x7feda0069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.414+0000 7fedb9bff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feda0066d80 0x7feda0069230 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feda80015a0 tx=0x7feda8009040 comp rx=0 tx=0).stop 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 msgr2=0x7fedb415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fedb415e550 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7feda4011a90 tx=0x7feda400a330 comp rx=0 tx=0).stop 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 shutdown_connections 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feda0066d80 0x7feda0069230 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed9c004d50 0x7fedb415e550 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb41684a0 0x7fedb415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 --2- 172.21.15.86:0/1128380134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedb415ba50 0x7fedb4167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 >> 172.21.15.86:0/1128380134 conn(0x7fedb4068e10 msgr2=0x7fedb40c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:29.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 shutdown_connections 2023-10-09T13:13:29.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.415+0000 7fedb9bff700 1 -- 172.21.15.86:0/1128380134 wait complete. 2023-10-09T13:13:29.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T13:13:29.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.618+0000 7fca59bff700 1 Processor -- start 2023-10-09T13:13:29.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.619+0000 7fca59bff700 1 -- start start 2023-10-09T13:13:29.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca59bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fca540c83f0 0x7fca540c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca59bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 0x7fca541561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca59bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5415b0d0 con 0x7fca540c87c0 2023-10-09T13:13:29.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca59bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540c7a60 con 0x7fca540c83f0 2023-10-09T13:13:29.622 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca59bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415a4c0 con 0x7fca540ccee0 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca537fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fca540c83f0 0x7fca540c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca537fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fca540c83f0 0x7fca540c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51348/0 (socket says 172.21.15.86:51348) 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.620+0000 7fca537fe700 1 -- 172.21.15.86:0/360432903 learned_addr learned my addr 172.21.15.86:0/360432903 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca537fe700 1 -- 172.21.15.86:0/360432903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 msgr2=0x7fca541561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca537fe700 1 --2- 172.21.15.86:0/360432903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 0x7fca541561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca537fe700 1 -- 172.21.15.86:0/360432903 >> v1:172.21.15.135:6789/0 conn(0x7fca540c87c0 legacy=0x7fca5406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca537fe700 1 -- 172.21.15.86:0/360432903 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5415a7a0 con 0x7fca540c83f0 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca537fe700 1 --2- 172.21.15.86:0/360432903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c83f0 0x7fca540c7520 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fca440099b0 tx=0x7fca44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efaee4b7c7b3e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca527fc700 1 -- 172.21.15.86:0/360432903 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400b820 con 0x7fca540c83f0 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca527fc700 1 -- 172.21.15.86:0/360432903 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400b980 con 0x7fca540c83f0 2023-10-09T13:13:29.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca527fc700 1 -- 172.21.15.86:0/360432903 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400bd20 con 0x7fca540c83f0 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca59bff700 1 -- 172.21.15.86:0/360432903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c83f0 msgr2=0x7fca540c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.621+0000 7fca59bff700 1 --2- 172.21.15.86:0/360432903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c83f0 0x7fca540c7520 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fca440099b0 tx=0x7fca44009250 comp rx=0 tx=0).stop 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.622+0000 7fca59bff700 1 -- 172.21.15.86:0/360432903 shutdown_connections 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.622+0000 7fca59bff700 1 --2- 172.21.15.86:0/360432903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c83f0 0x7fca540c7520 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.622+0000 7fca59bff700 1 --2- 172.21.15.86:0/360432903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 0x7fca541561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.622+0000 7fca59bff700 1 -- 172.21.15.86:0/360432903 >> 172.21.15.86:0/360432903 conn(0x7fca54068e10 msgr2=0x7fca540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.622+0000 7fca59bff700 1 -- 172.21.15.86:0/360432903 shutdown_connections 2023-10-09T13:13:29.624 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.622+0000 7fca59bff700 1 -- 172.21.15.86:0/360432903 wait complete. 2023-10-09T13:13:29.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.623+0000 7fca59bff700 1 Processor -- start 2023-10-09T13:13:29.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.623+0000 7fca59bff700 1 -- start start 2023-10-09T13:13:29.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca59bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca540c83f0 0x7fca540b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca59bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c87c0 0x7fca5414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca59bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 0x7fca540b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca59bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca54169d60 con 0x7fca540c87c0 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca59bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541504a0 con 0x7fca540c83f0 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca59bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540b0880 con 0x7fca540ccee0 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca52ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c87c0 0x7fca5414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.624+0000 7fca52ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c87c0 0x7fca5414ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51356/0 (socket says 172.21.15.86:51356) 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca52ffd700 1 -- 172.21.15.86:0/2625366723 learned_addr learned my addr 172.21.15.86:0/2625366723 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca53fff700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 0x7fca540b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca537fe700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca540c83f0 0x7fca540b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca52ffd700 1 -- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 msgr2=0x7fca540b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca52ffd700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 0x7fca540b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca52ffd700 1 -- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca540c83f0 msgr2=0x7fca540b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca52ffd700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca540c83f0 0x7fca540b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca52ffd700 1 -- 172.21.15.86:0/2625366723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440094f0 con 0x7fca540c87c0 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca537fe700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca540c83f0 0x7fca540b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca52ffd700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c87c0 0x7fca5414ff60 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fca4800b810 tx=0x7fca480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca3b7fe700 1 -- 172.21.15.86:0/2625366723 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800f570 con 0x7fca540c87c0 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca3b7fe700 1 -- 172.21.15.86:0/2625366723 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4800f6d0 con 0x7fca540c87c0 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540b0b60 con 0x7fca540c87c0 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.625+0000 7fca3b7fe700 1 -- 172.21.15.86:0/2625366723 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800fa90 con 0x7fca540c87c0 2023-10-09T13:13:29.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.626+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca540b1120 con 0x7fca540c87c0 2023-10-09T13:13:29.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.626+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca54169f40 con 0x7fca540c87c0 2023-10-09T13:13:29.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.627+0000 7fca3b7fe700 1 -- 172.21.15.86:0/2625366723 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca4801a460 con 0x7fca540c87c0 2023-10-09T13:13:29.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.628+0000 7fca3b7fe700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fca40066f30 0x7fca400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:29.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.628+0000 7fca3b7fe700 1 -- 172.21.15.86:0/2625366723 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7fca48084450 con 0x7fca540c87c0 2023-10-09T13:13:29.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.628+0000 7fca537fe700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fca40066f30 0x7fca400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:29.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.629+0000 7fca537fe700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fca40066f30 0x7fca400693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca440099b0 tx=0x7fca44016000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:29.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.632+0000 7fca3b7fe700 1 -- 172.21.15.86:0/2625366723 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca54169f40 con 0x7fca540c87c0 2023-10-09T13:13:29.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.824+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fca54169f40 con 0x7fca540c87c0 2023-10-09T13:13:29.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.830+0000 7fca3b7fe700 1 -- 172.21.15.86:0/2625366723 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v62) v1 ==== 120+0+0 (secure 0 0 0) 0x7fca54169f40 con 0x7fca540c87c0 2023-10-09T13:13:29.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fca40066f30 msgr2=0x7fca400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fca40066f30 0x7fca400693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca440099b0 tx=0x7fca44016000 comp rx=0 tx=0).stop 2023-10-09T13:13:29.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c87c0 msgr2=0x7fca5414ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:29.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c87c0 0x7fca5414ff60 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fca4800b810 tx=0x7fca480091d0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 shutdown_connections 2023-10-09T13:13:29.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fca40066f30 0x7fca400693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fca540ccee0 0x7fca540b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca540c83f0 0x7fca540b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 --2- 172.21.15.86:0/2625366723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca540c87c0 0x7fca5414ff60 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:29.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.832+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 >> 172.21.15.86:0/2625366723 conn(0x7fca54068e10 msgr2=0x7fca540c1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:29.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.833+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 shutdown_connections 2023-10-09T13:13:29.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:29.833+0000 7fca59bff700 1 -- 172.21.15.86:0/2625366723 wait complete. 2023-10-09T13:13:29.850 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T13:13:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.037+0000 7fc43e59d700 1 Processor -- start 2023-10-09T13:13:30.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.037+0000 7fc43e59d700 1 -- start start 2023-10-09T13:13:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.038+0000 7fc43e59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4380b16d0 0x7fc4380b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.038+0000 7fc43e59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4380b33b0 0x7fc4380b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.038+0000 7fc43e59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4380b2080 con 0x7fc4380b4e70 2023-10-09T13:13:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.038+0000 7fc43e59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4380cfb00 con 0x7fc4380b16d0 2023-10-09T13:13:30.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.038+0000 7fc43e59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4380b5c40 con 0x7fc4380b33b0 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.038+0000 7fc43cd9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4380b16d0 0x7fc4380b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43cd9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4380b16d0 0x7fc4380b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51370/0 (socket says 172.21.15.86:51370) 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43cd9a700 1 -- 172.21.15.86:0/3226522620 learned_addr learned my addr 172.21.15.86:0/3226522620 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43dd9c700 1 --2- 172.21.15.86:0/3226522620 >> v2:172.21.15.135:3300/0 conn(0x7fc4380b33b0 0x7fc4380b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43cd9a700 1 -- 172.21.15.86:0/3226522620 >> v2:172.21.15.135:3300/0 conn(0x7fc4380b33b0 msgr2=0x7fc4380b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43cd9a700 1 --2- 172.21.15.86:0/3226522620 >> v2:172.21.15.135:3300/0 conn(0x7fc4380b33b0 0x7fc4380b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43cd9a700 1 -- 172.21.15.86:0/3226522620 >> v1:172.21.15.135:6789/0 conn(0x7fc4380b4e70 legacy=0x7fc4380ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43cd9a700 1 -- 172.21.15.86:0/3226522620 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380b5f20 con 0x7fc4380b16d0 2023-10-09T13:13:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.039+0000 7fc43cd9a700 1 --2- 172.21.15.86:0/3226522620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380b1b40 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fc438071380 tx=0x7fc428009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fd1e1e4b94b9f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc42ffff700 1 -- 172.21.15.86:0/3226522620 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800b860 con 0x7fc4380b16d0 2023-10-09T13:13:30.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc42ffff700 1 -- 172.21.15.86:0/3226522620 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800b9c0 con 0x7fc4380b16d0 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc42ffff700 1 -- 172.21.15.86:0/3226522620 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800bd80 con 0x7fc4380b16d0 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 -- 172.21.15.86:0/3226522620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 msgr2=0x7fc4380b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 --2- 172.21.15.86:0/3226522620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380b1b40 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fc438071380 tx=0x7fc428009250 comp rx=0 tx=0).stop 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 -- 172.21.15.86:0/3226522620 shutdown_connections 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 --2- 172.21.15.86:0/3226522620 >> v2:172.21.15.135:3300/0 conn(0x7fc4380b33b0 0x7fc4380b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 --2- 172.21.15.86:0/3226522620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380b1b40 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 -- 172.21.15.86:0/3226522620 >> 172.21.15.86:0/3226522620 conn(0x7fc4380d10c0 msgr2=0x7fc4380affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 -- 172.21.15.86:0/3226522620 shutdown_connections 2023-10-09T13:13:30.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.040+0000 7fc43e59d700 1 -- 172.21.15.86:0/3226522620 wait complete. 2023-10-09T13:13:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.042+0000 7fc43e59d700 1 Processor -- start 2023-10-09T13:13:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.042+0000 7fc43e59d700 1 -- start start 2023-10-09T13:13:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43e59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43e59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4380b33b0 0x7fc438158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43e59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4380b4e70 0x7fc43815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43e59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380cc680 con 0x7fc4380b16d0 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43e59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438169d70 con 0x7fc4380b33b0 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43e59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc438169fc0 con 0x7fc4380b4e70 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51374/0 (socket says 172.21.15.86:51374) 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 -- 172.21.15.86:0/2377205432 learned_addr learned my addr 172.21.15.86:0/2377205432 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43cd9a700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4380b33b0 0x7fc438158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43dd9c700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4380b4e70 0x7fc43815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 -- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4380b4e70 msgr2=0x7fc43815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.045 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4380b4e70 0x7fc43815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 -- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4380b33b0 msgr2=0x7fc438158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4380b33b0 0x7fc438158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43d59b700 1 -- 172.21.15.86:0/2377205432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280094f0 con 0x7fc4380b16d0 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.043+0000 7fc43cd9a700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4380b33b0 0x7fc438158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.044+0000 7fc43d59b700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380cb5d0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fc43400cb10 tx=0x7fc4340017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.044+0000 7fc42d7fa700 1 -- 172.21.15.86:0/2377205432 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400a760 con 0x7fc4380b16d0 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.044+0000 7fc42d7fa700 1 -- 172.21.15.86:0/2377205432 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400a8e0 con 0x7fc4380b16d0 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.044+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4380cbb10 con 0x7fc4380b16d0 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.044+0000 7fc42d7fa700 1 -- 172.21.15.86:0/2377205432 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400aca0 con 0x7fc4380b16d0 2023-10-09T13:13:30.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.044+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4380cc3a0 con 0x7fc4380b16d0 2023-10-09T13:13:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.045+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc438088990 con 0x7fc4380b16d0 2023-10-09T13:13:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.046+0000 7fc42d7fa700 1 -- 172.21.15.86:0/2377205432 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc434003030 con 0x7fc4380b16d0 2023-10-09T13:13:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.046+0000 7fc42d7fa700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c066f30 0x7fc41c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.047+0000 7fc42d7fa700 1 -- 172.21.15.86:0/2377205432 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7fc434084810 con 0x7fc4380b16d0 2023-10-09T13:13:30.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.047+0000 7fc43cd9a700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c066f30 0x7fc41c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.047+0000 7fc43cd9a700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c066f30 0x7fc41c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc438071380 tx=0x7fc428017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:30.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.051+0000 7fc42d7fa700 1 -- 172.21.15.86:0/2377205432 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc434051840 con 0x7fc4380b16d0 2023-10-09T13:13:30.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.247+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc43804bb80 con 0x7fc4380b16d0 2023-10-09T13:13:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.251+0000 7fc42d7fa700 1 -- 172.21.15.86:0/2377205432 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc434054e60 con 0x7fc4380b16d0 2023-10-09T13:13:30.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c066f30 msgr2=0x7fc41c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c066f30 0x7fc41c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc438071380 tx=0x7fc428017000 comp rx=0 tx=0).stop 2023-10-09T13:13:30.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 msgr2=0x7fc4380cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380cb5d0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fc43400cb10 tx=0x7fc4340017b0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 shutdown_connections 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c066f30 0x7fc41c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4380b16d0 0x7fc4380cb5d0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4380b4e70 0x7fc43815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 --2- 172.21.15.86:0/2377205432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4380b33b0 0x7fc438158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 >> 172.21.15.86:0/2377205432 conn(0x7fc4380d10c0 msgr2=0x7fc4380c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 shutdown_connections 2023-10-09T13:13:30.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.254+0000 7fc43e59d700 1 -- 172.21.15.86:0/2377205432 wait complete. 2023-10-09T13:13:30.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-09T13:13:30.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.451+0000 7ff0c89ff700 1 Processor -- start 2023-10-09T13:13:30.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.451+0000 7ff0c89ff700 1 -- start start 2023-10-09T13:13:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.452+0000 7ff0c89ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 0x7ff0c4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.452+0000 7ff0c89ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c40ad930 con 0x7ff0c4155c10 2023-10-09T13:13:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.452+0000 7ff0c89ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c40acd20 con 0x7ff0c41578b0 2023-10-09T13:13:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.452+0000 7ff0c89ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40ad000 con 0x7ff0c40b0a10 2023-10-09T13:13:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff0c4155c10 0x7ff0c40ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42216/0 (socket says 172.21.15.86:42216) 2023-10-09T13:13:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c259c700 1 -- 172.21.15.86:0/1064702825 learned_addr learned my addr 172.21.15.86:0/1064702825 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:30.453 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c2d9d700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 0x7ff0c4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513790296 0 0) 0x7ff0c40ad930 con 0x7ff0c4155c10 2023-10-09T13:13:30.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0ac003570 con 0x7ff0c4155c10 2023-10-09T13:13:30.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924748117 0 0) 0x7ff0c40acd20 con 0x7ff0c41578b0 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c40ad930 con 0x7ff0c41578b0 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 542797418 0 0) 0x7ff0ac003570 con 0x7ff0c4155c10 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 msgr2=0x7ff0c4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 0x7ff0c4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 >> v1:172.21.15.135:6789/0 conn(0x7ff0c41578b0 legacy=0x7ff0c40af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40ad2e0 con 0x7ff0c4155c10 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.453+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7ff0b4001470 con 0x7ff0c4155c10 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 >> v1:172.21.15.86:6789/0 conn(0x7ff0c4155c10 legacy=0x7ff0c40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c159a700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0ac003c20 0x7ff0ac004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c159a700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac004810 0x7ff0ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c159a700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 0x7ff0ac005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40ad000 con 0x7ff0ac003c20 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac00bbf0 con 0x7ff0ac004810 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac00bdb0 con 0x7ff0c40b0a10 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c259c700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0ac003c20 0x7ff0ac004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c1d9b700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac004810 0x7ff0ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c2d9d700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 0x7ff0ac005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c259c700 1 -- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 msgr2=0x7ff0ac005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c259c700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c40b0a10 0x7ff0ac005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c259c700 1 -- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac004810 msgr2=0x7ff0ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c259c700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac004810 0x7ff0ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c259c700 1 -- 172.21.15.86:0/1064702825 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac003570 con 0x7ff0ac003c20 2023-10-09T13:13:30.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.454+0000 7ff0c259c700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0ac003c20 0x7ff0ac004010 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4007bb0 tx=0x7ff0c40ad8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ebc0e0bbdb56b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b400cbb0 con 0x7ff0ac003c20 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b400cd30 con 0x7ff0ac003c20 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c159a700 1 -- 172.21.15.86:0/1064702825 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b400cea0 con 0x7ff0ac003c20 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1064702825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0ac003c20 msgr2=0x7ff0ac004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c89ff700 1 --2- 172.21.15.86:0/1064702825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0ac003c20 0x7ff0ac004010 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4007bb0 tx=0x7ff0c40ad8a0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c2d9d700 1 -- 172.21.15.86:0/1064702825 reap_dead start 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1064702825 shutdown_connections 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1064702825 >> 172.21.15.86:0/1064702825 conn(0x7ff0c406a320 msgr2=0x7ff0c40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1064702825 shutdown_connections 2023-10-09T13:13:30.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.455+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1064702825 wait complete. 2023-10-09T13:13:30.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.457+0000 7ff0c89ff700 1 Processor -- start 2023-10-09T13:13:30.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.457+0000 7ff0c89ff700 1 -- start start 2023-10-09T13:13:30.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c89ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac003c20 0x7ff0c413a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c89ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c416ca40 0x7ff0c416ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c89ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c416b390 0x7ff0c40ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c89ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c416c5b0 con 0x7ff0c416b390 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c89ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4169f90 con 0x7ff0ac003c20 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c89ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c416b9a0 con 0x7ff0c416ca40 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c416b390 0x7ff0c40ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c416b390 0x7ff0c40ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51402/0 (socket says 172.21.15.86:51402) 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 -- 172.21.15.86:0/1175989039 learned_addr learned my addr 172.21.15.86:0/1175989039 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c1d9b700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c416ca40 0x7ff0c416ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c259c700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac003c20 0x7ff0c413a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 -- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c416ca40 msgr2=0x7ff0c416ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c416ca40 0x7ff0c416ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 -- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac003c20 msgr2=0x7ff0c413a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac003c20 0x7ff0c413a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.458+0000 7ff0c2d9d700 1 -- 172.21.15.86:0/1175989039 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c416bc80 con 0x7ff0c416b390 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.459+0000 7ff0c2d9d700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c416b390 0x7ff0c40ab730 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4069550 tx=0x7ff0bc00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.459+0000 7ff0b27fc700 1 -- 172.21.15.86:0/1175989039 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00f040 con 0x7ff0c416b390 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.459+0000 7ff0b27fc700 1 -- 172.21.15.86:0/1175989039 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc00a2e0 con 0x7ff0c416b390 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.459+0000 7ff0b27fc700 1 -- 172.21.15.86:0/1175989039 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc010c50 con 0x7ff0c416b390 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.459+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c416bf60 con 0x7ff0c416b390 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.459+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c416ceb0 con 0x7ff0c416b390 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.460+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c404c3c0 con 0x7ff0c416b390 2023-10-09T13:13:30.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.461+0000 7ff0b27fc700 1 -- 172.21.15.86:0/1175989039 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0bc015660 con 0x7ff0c416b390 2023-10-09T13:13:30.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.462+0000 7ff0b27fc700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff0a4066f30 0x7ff0a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:30.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.462+0000 7ff0b27fc700 1 -- 172.21.15.86:0/1175989039 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7ff0bc084c20 con 0x7ff0c416b390 2023-10-09T13:13:30.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.462+0000 7ff0c259c700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff0a4066f30 0x7ff0a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:30.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.463+0000 7ff0c259c700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff0a4066f30 0x7ff0a40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4001e20 tx=0x7ff0b4017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:30.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.466+0000 7ff0b27fc700 1 -- 172.21.15.86:0/1175989039 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0bc051bb0 con 0x7ff0c416b390 2023-10-09T13:13:30.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.733+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7ff0c40ad5c0 con 0x7ff0c416b390 2023-10-09T13:13:30.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:30.999+0000 7ff0b27fc700 1 -- 172.21.15.86:0/1175989039 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2970) v1 ==== 165+0+0 (secure 0 0 0) 0x7ff0bc0551d0 con 0x7ff0c416b390 2023-10-09T13:13:31.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff0a4066f30 msgr2=0x7ff0a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:31.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff0a4066f30 0x7ff0a40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4001e20 tx=0x7ff0b4017000 comp rx=0 tx=0).stop 2023-10-09T13:13:31.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c416b390 msgr2=0x7ff0c40ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:31.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c416b390 0x7ff0c40ab730 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4069550 tx=0x7ff0bc00c040 comp rx=0 tx=0).stop 2023-10-09T13:13:31.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 shutdown_connections 2023-10-09T13:13:31.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff0a4066f30 0x7ff0a40693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c416b390 0x7ff0c40ab730 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0ac003c20 0x7ff0c413a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 --2- 172.21.15.86:0/1175989039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0c416ca40 0x7ff0c416ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 >> 172.21.15.86:0/1175989039 conn(0x7ff0c406a320 msgr2=0x7ff0c414ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:31.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 shutdown_connections 2023-10-09T13:13:31.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.001+0000 7ff0c89ff700 1 -- 172.21.15.86:0/1175989039 wait complete. 2023-10-09T13:13:31.019 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-10-09T13:13:31.020 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-10-09T13:13:31.020 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-09T13:13:31.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-09T13:13:31.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.199+0000 7f8c99fff700 1 Processor -- start 2023-10-09T13:13:31.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.199+0000 7f8c99fff700 1 -- start start 2023-10-09T13:13:31.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.200+0000 7f8c99fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:31.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.200+0000 7f8c99fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:31.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.200+0000 7f8c99fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9415a160 con 0x7f8c9415db10 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.200+0000 7f8c99fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940d13a0 con 0x7f8c94159c60 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.200+0000 7f8c99fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9415e140 con 0x7f8c94159890 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.200+0000 7f8c92ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c92ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51404/0 (socket says 172.21.15.86:51404) 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c92ffd700 1 -- 172.21.15.86:0/1132783168 learned_addr learned my addr 172.21.15.86:0/1132783168 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c937fe700 1 --2- 172.21.15.86:0/1132783168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c92ffd700 1 -- 172.21.15.86:0/1132783168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159890 msgr2=0x7f8c9415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c92ffd700 1 --2- 172.21.15.86:0/1132783168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c92ffd700 1 -- 172.21.15.86:0/1132783168 >> v1:172.21.15.135:6789/0 conn(0x7f8c9415db10 legacy=0x7f8c94069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c92ffd700 1 -- 172.21.15.86:0/1132783168 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9415a3d0 con 0x7f8c94159c60 2023-10-09T13:13:31.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.201+0000 7f8c92ffd700 1 --2- 172.21.15.86:0/1132783168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159c60 0x7f8c9415d5d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8c880099b0 tx=0x7f8c88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9a135cfc75923e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c927fc700 1 -- 172.21.15.86:0/1132783168 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800b860 con 0x7f8c94159c60 2023-10-09T13:13:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c927fc700 1 -- 172.21.15.86:0/1132783168 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800b9c0 con 0x7f8c94159c60 2023-10-09T13:13:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c927fc700 1 -- 172.21.15.86:0/1132783168 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800bd60 con 0x7f8c94159c60 2023-10-09T13:13:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 -- 172.21.15.86:0/1132783168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159c60 msgr2=0x7f8c9415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 --2- 172.21.15.86:0/1132783168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159c60 0x7f8c9415d5d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8c880099b0 tx=0x7f8c88009250 comp rx=0 tx=0).stop 2023-10-09T13:13:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 -- 172.21.15.86:0/1132783168 shutdown_connections 2023-10-09T13:13:31.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 --2- 172.21.15.86:0/1132783168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 --2- 172.21.15.86:0/1132783168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 -- 172.21.15.86:0/1132783168 >> 172.21.15.86:0/1132783168 conn(0x7f8c94068e20 msgr2=0x7f8c940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 -- 172.21.15.86:0/1132783168 shutdown_connections 2023-10-09T13:13:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.202+0000 7f8c99fff700 1 -- 172.21.15.86:0/1132783168 wait complete. 2023-10-09T13:13:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.204+0000 7f8c99fff700 1 Processor -- start 2023-10-09T13:13:31.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.204+0000 7f8c99fff700 1 -- start start 2023-10-09T13:13:31.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c99fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159890 0x7f8c94141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:31.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c99fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159c60 0x7f8c940cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:31.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c99fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c9415db10 0x7f8c940cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:31.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c99fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940ce840 con 0x7f8c94159890 2023-10-09T13:13:31.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c99fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940ca020 con 0x7f8c9415db10 2023-10-09T13:13:31.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c99fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940cdc30 con 0x7f8c94159c60 2023-10-09T13:13:31.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159890 0x7f8c94141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c937fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159890 0x7f8c94141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51418/0 (socket says 172.21.15.86:51418) 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c937fe700 1 -- 172.21.15.86:0/3877843829 learned_addr learned my addr 172.21.15.86:0/3877843829 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c92ffd700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159c60 0x7f8c940cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.205+0000 7f8c93fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c9415db10 0x7f8c940cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c937fe700 1 -- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159c60 msgr2=0x7f8c940cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c937fe700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159c60 0x7f8c940cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c937fe700 1 -- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c9415db10 msgr2=0x7f8c940cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c937fe700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c9415db10 0x7f8c940cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c937fe700 1 -- 172.21.15.86:0/3877843829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c880094f0 con 0x7f8c94159890 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c93fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c9415db10 0x7f8c940cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:31.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c937fe700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159890 0x7f8c94141100 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400d890 tx=0x7f8c84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:31.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c7b7fe700 1 -- 172.21.15.86:0/3877843829 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c840125f0 con 0x7f8c94159890 2023-10-09T13:13:31.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c7b7fe700 1 -- 172.21.15.86:0/3877843829 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84012770 con 0x7f8c94159890 2023-10-09T13:13:31.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c7b7fe700 1 -- 172.21.15.86:0/3877843829 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84012b30 con 0x7f8c94159890 2023-10-09T13:13:31.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c940cdf10 con 0x7f8c94159890 2023-10-09T13:13:31.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.206+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c940ce4d0 con 0x7f8c94159890 2023-10-09T13:13:31.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.207+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9404c3c0 con 0x7f8c94159890 2023-10-09T13:13:31.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.208+0000 7f8c7b7fe700 1 -- 172.21.15.86:0/3877843829 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c8401e460 con 0x7f8c94159890 2023-10-09T13:13:31.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.209+0000 7f8c7b7fe700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8c80066f60 0x7f8c80069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:31.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.210+0000 7f8c7b7fe700 1 -- 172.21.15.86:0/3877843829 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7f8c84084db0 con 0x7f8c94159890 2023-10-09T13:13:31.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.210+0000 7f8c92ffd700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8c80066f60 0x7f8c80069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:31.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.210+0000 7f8c92ffd700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8c80066f60 0x7f8c80069410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c880099b0 tx=0x7f8c88017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:31.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.214+0000 7f8c7b7fe700 1 -- 172.21.15.86:0/3877843829 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c84051de0 con 0x7f8c94159890 2023-10-09T13:13:31.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:31.479+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f8c9406a5b0 con 0x7f8c94159890 2023-10-09T13:13:32.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.000+0000 7f8c7b7fe700 1 -- 172.21.15.86:0/3877843829 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2971) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8c84055400 con 0x7f8c94159890 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8c80066f60 msgr2=0x7f8c80069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8c80066f60 0x7f8c80069410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c880099b0 tx=0x7f8c88017000 comp rx=0 tx=0).stop 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159890 msgr2=0x7f8c94141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159890 0x7f8c94141100 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400d890 tx=0x7f8c84008040 comp rx=0 tx=0).stop 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 shutdown_connections 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8c80066f60 0x7f8c80069410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c94159890 0x7f8c94141100 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c9415db10 0x7f8c940cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.004 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 --2- 172.21.15.86:0/3877843829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c94159c60 0x7f8c940cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 >> 172.21.15.86:0/3877843829 conn(0x7f8c94068e20 msgr2=0x7f8c940b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:32.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 shutdown_connections 2023-10-09T13:13:32.005 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.003+0000 7f8c99fff700 1 -- 172.21.15.86:0/3877843829 wait complete. 2023-10-09T13:13:32.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T13:13:32.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.206+0000 7f20e4bff700 1 Processor -- start 2023-10-09T13:13:32.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.207+0000 7f20e4bff700 1 -- start start 2023-10-09T13:13:32.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.208+0000 7f20e4bff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20e0155eb0 0x7f20e006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.208+0000 7f20e4bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e006eb90 con 0x7f20e0069e80 2023-10-09T13:13:32.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.208+0000 7f20e4bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e006ee70 con 0x7f20e00c70b0 2023-10-09T13:13:32.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.208+0000 7f20e4bff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e006f150 con 0x7f20e0155eb0 2023-10-09T13:13:32.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.208+0000 7f20de59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20e0155eb0 0x7f20e006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.208+0000 7f20de59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20e0155eb0 0x7f20e006e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51434/0 (socket says 172.21.15.86:51434) 2023-10-09T13:13:32.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.208+0000 7f20de59c700 1 -- 172.21.15.86:0/1066569272 learned_addr learned my addr 172.21.15.86:0/1066569272 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.209+0000 7f20de59c700 1 -- 172.21.15.86:0/1066569272 >> v1:172.21.15.135:6789/0 conn(0x7f20e00c70b0 legacy=0x7f20e0069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.209+0000 7f20de59c700 1 -- 172.21.15.86:0/1066569272 >> v1:172.21.15.86:6789/0 conn(0x7f20e0069e80 legacy=0x7f20e00ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.210 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.209+0000 7f20de59c700 1 -- 172.21.15.86:0/1066569272 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e006f430 con 0x7f20e0155eb0 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.209+0000 7f20de59c700 1 --2- 172.21.15.86:0/1066569272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e006e240 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f20d00099b0 tx=0x7f20d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad4ba297cc25fda server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.209+0000 7f20ddd9b700 1 -- 172.21.15.86:0/1066569272 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000b860 con 0x7f20e0155eb0 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.209+0000 7f20ddd9b700 1 -- 172.21.15.86:0/1066569272 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000b9c0 con 0x7f20e0155eb0 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.209+0000 7f20ddd9b700 1 -- 172.21.15.86:0/1066569272 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000bd60 con 0x7f20e0155eb0 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.210+0000 7f20e4bff700 1 -- 172.21.15.86:0/1066569272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 msgr2=0x7f20e006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.210+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1066569272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e006e240 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f20d00099b0 tx=0x7f20d0009250 comp rx=0 tx=0).stop 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.210+0000 7f20e4bff700 1 -- 172.21.15.86:0/1066569272 shutdown_connections 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.210+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1066569272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e006e240 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.210+0000 7f20e4bff700 1 -- 172.21.15.86:0/1066569272 >> 172.21.15.86:0/1066569272 conn(0x7f20e0068e10 msgr2=0x7f20e00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.210+0000 7f20e4bff700 1 -- 172.21.15.86:0/1066569272 shutdown_connections 2023-10-09T13:13:32.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.210+0000 7f20e4bff700 1 -- 172.21.15.86:0/1066569272 wait complete. 2023-10-09T13:13:32.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.211+0000 7f20e4bff700 1 Processor -- start 2023-10-09T13:13:32.212 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.212+0000 7f20e4bff700 1 -- start start 2023-10-09T13:13:32.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.212+0000 7f20e4bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20e0069e80 0x7f20e00ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.213 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.212+0000 7f20e4bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e00c70b0 0x7f20e014e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20e4bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20e4bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00abb20 con 0x7f20e0155eb0 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20e4bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e01526f0 con 0x7f20e00c70b0 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20e4bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e01529d0 con 0x7f20e0069e80 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e014ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51436/0 (socket says 172.21.15.86:51436) 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 -- 172.21.15.86:0/1363341643 learned_addr learned my addr 172.21.15.86:0/1363341643 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20de59c700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20e0069e80 0x7f20e00ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20d7fff700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e00c70b0 0x7f20e014e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 -- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20e0069e80 msgr2=0x7f20e00ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20e0069e80 0x7f20e00ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 -- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e00c70b0 msgr2=0x7f20e014e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e00c70b0 0x7f20e014e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 -- 172.21.15.86:0/1363341643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00094f0 con 0x7f20e0155eb0 2023-10-09T13:13:32.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.213+0000 7f20ded9d700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e014ec90 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c860 tx=0x7f20d8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:32.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.214+0000 7f20d67fc700 1 -- 172.21.15.86:0/1363341643 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8012630 con 0x7f20e0155eb0 2023-10-09T13:13:32.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.214+0000 7f20d67fc700 1 -- 172.21.15.86:0/1363341643 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8012790 con 0x7f20e0155eb0 2023-10-09T13:13:32.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.214+0000 7f20d67fc700 1 -- 172.21.15.86:0/1363341643 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8012b30 con 0x7f20e0155eb0 2023-10-09T13:13:32.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.214+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e0152cb0 con 0x7f20e0155eb0 2023-10-09T13:13:32.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.214+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e0151e10 con 0x7f20e0155eb0 2023-10-09T13:13:32.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.215+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e004c3c0 con 0x7f20e0155eb0 2023-10-09T13:13:32.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.216+0000 7f20d67fc700 1 -- 172.21.15.86:0/1363341643 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20d800a3f0 con 0x7f20e0155eb0 2023-10-09T13:13:32.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.216+0000 7f20d67fc700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f20c0066f30 0x7f20c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.216+0000 7f20d67fc700 1 -- 172.21.15.86:0/1363341643 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7f20d80849e0 con 0x7f20e0155eb0 2023-10-09T13:13:32.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.217+0000 7f20de59c700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f20c0066f30 0x7f20c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.217+0000 7f20de59c700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f20c0066f30 0x7f20c00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f20d00099b0 tx=0x7f20d0018000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:32.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.221+0000 7f20d67fc700 1 -- 172.21.15.86:0/1363341643 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20d8051a10 con 0x7f20e0155eb0 2023-10-09T13:13:32.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.408+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f20e0156280 con 0x7f20e0155eb0 2023-10-09T13:13:32.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.413+0000 7f20d67fc700 1 -- 172.21.15.86:0/1363341643 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f20d8055030 con 0x7f20e0155eb0 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f20c0066f30 msgr2=0x7f20c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f20c0066f30 0x7f20c00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f20d00099b0 tx=0x7f20d0018000 comp rx=0 tx=0).stop 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 msgr2=0x7f20e014ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e014ec90 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c860 tx=0x7f20d8001690 comp rx=0 tx=0).stop 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 shutdown_connections 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f20c0066f30 0x7f20c00693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20e0155eb0 0x7f20e014ec90 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20e0069e80 0x7f20e00ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 --2- 172.21.15.86:0/1363341643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e00c70b0 0x7f20e014e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 >> 172.21.15.86:0/1363341643 conn(0x7f20e0068e10 msgr2=0x7f20e00b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 shutdown_connections 2023-10-09T13:13:32.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.415+0000 7f20e4bff700 1 -- 172.21.15.86:0/1363341643 wait complete. 2023-10-09T13:13:32.433 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T13:13:32.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:13:32.514 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:13:32.598 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T13:13:32.598 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T13:13:32.598 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:13:32.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.779+0000 7f9e1a99d700 1 Processor -- start 2023-10-09T13:13:32.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.779+0000 7f9e1a99d700 1 -- start start 2023-10-09T13:13:32.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.780+0000 7f9e1a99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9e14159420 0x7f9e140b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.780+0000 7f9e1a99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e141597f0 0x7f9e140b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.780+0000 7f9e1a99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140b11d0 con 0x7f9e1415d230 2023-10-09T13:13:32.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.780+0000 7f9e1a99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e140b14b0 con 0x7f9e14159420 2023-10-09T13:13:32.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.780+0000 7f9e1a99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140b1790 con 0x7f9e141597f0 2023-10-09T13:13:32.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.780+0000 7f9e1a19c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9e1415d230 0x7f9e140b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42246/0 (socket says 172.21.15.86:42246) 2023-10-09T13:13:32.781 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.780+0000 7f9e1a19c700 1 -- 172.21.15.86:0/4290787963 learned_addr learned my addr 172.21.15.86:0/4290787963 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e1919a700 1 --2- 172.21.15.86:0/4290787963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e141597f0 0x7f9e140b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e1999b700 1 --2- 172.21.15.86:0/4290787963 >> v2:172.21.15.135:3300/0 conn(0x7f9e14159420 0x7f9e140b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e18999700 1 -- 172.21.15.86:0/4290787963 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159351811 0 0) 0x7f9e140b11d0 con 0x7f9e1415d230 2023-10-09T13:13:32.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e18999700 1 -- 172.21.15.86:0/4290787963 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e00003570 con 0x7f9e1415d230 2023-10-09T13:13:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e18999700 1 -- 172.21.15.86:0/4290787963 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003619702 0 0) 0x7f9e00003570 con 0x7f9e1415d230 2023-10-09T13:13:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e1919a700 1 -- 172.21.15.86:0/4290787963 >> v2:172.21.15.135:3300/0 conn(0x7f9e14159420 msgr2=0x7f9e140b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e1919a700 1 --2- 172.21.15.86:0/4290787963 >> v2:172.21.15.135:3300/0 conn(0x7f9e14159420 0x7f9e140b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e1919a700 1 -- 172.21.15.86:0/4290787963 >> v1:172.21.15.86:6789/0 conn(0x7f9e1415d230 legacy=0x7f9e140b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e1919a700 1 -- 172.21.15.86:0/4290787963 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140b1a70 con 0x7f9e141597f0 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.781+0000 7f9e1999b700 1 --2- 172.21.15.86:0/4290787963 >> v2:172.21.15.135:3300/0 conn(0x7f9e14159420 0x7f9e140b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e1919a700 1 --2- 172.21.15.86:0/4290787963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e141597f0 0x7f9e140b2270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e040098e0 tx=0x7f9e040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f41b60c112708751 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e18999700 1 -- 172.21.15.86:0/4290787963 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0017f0 con 0x7f9e141597f0 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e18999700 1 -- 172.21.15.86:0/4290787963 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04011420 con 0x7f9e141597f0 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e18999700 1 -- 172.21.15.86:0/4290787963 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040117c0 con 0x7f9e141597f0 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4290787963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e141597f0 msgr2=0x7f9e140b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4290787963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e141597f0 0x7f9e140b2270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e040098e0 tx=0x7f9e040091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4290787963 shutdown_connections 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4290787963 >> v2:172.21.15.135:3300/0 conn(0x7f9e14159420 0x7f9e140b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4290787963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e141597f0 0x7f9e140b2270 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.784 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.782+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4290787963 >> 172.21.15.86:0/4290787963 conn(0x7f9e140d0660 msgr2=0x7f9e140d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:32.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.783+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4290787963 shutdown_connections 2023-10-09T13:13:32.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.783+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4290787963 wait complete. 2023-10-09T13:13:32.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.784+0000 7f9e1a99d700 1 Processor -- start 2023-10-09T13:13:32.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.784+0000 7f9e1a99d700 1 -- start start 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1a99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e14159420 0x7f9e141586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1a99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e141597f0 0x7f9e14152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1a99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e1415d230 0x7f9e140c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1a99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14159d30 con 0x7f9e141597f0 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1a99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14153540 con 0x7f9e14159420 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1a99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e141537e0 con 0x7f9e1415d230 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1919a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e141597f0 0x7f9e14152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1919a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e141597f0 0x7f9e14152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51440/0 (socket says 172.21.15.86:51440) 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1919a700 1 -- 172.21.15.86:0/4121247643 learned_addr learned my addr 172.21.15.86:0/4121247643 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1999b700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e14159420 0x7f9e141586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.785+0000 7f9e1a19c700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e1415d230 0x7f9e140c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1919a700 1 -- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e1415d230 msgr2=0x7f9e140c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1919a700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e1415d230 0x7f9e140c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1919a700 1 -- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e14159420 msgr2=0x7f9e141586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1919a700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e14159420 0x7f9e141586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1919a700 1 -- 172.21.15.86:0/4121247643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10009420 con 0x7f9e141597f0 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1919a700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e141597f0 0x7f9e14152210 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f9e040093f0 tx=0x7f9e04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e09ffb700 1 -- 172.21.15.86:0/4121247643 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0401cb30 con 0x7f9e141597f0 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e09ffb700 1 -- 172.21.15.86:0/4121247643 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0401cc90 con 0x7f9e141597f0 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04009420 con 0x7f9e141597f0 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e09ffb700 1 -- 172.21.15.86:0/4121247643 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0401a660 con 0x7f9e141597f0 2023-10-09T13:13:32.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.786+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e14153da0 con 0x7f9e141597f0 2023-10-09T13:13:32.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.788+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e14159ee0 con 0x7f9e141597f0 2023-10-09T13:13:32.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.788+0000 7f9e09ffb700 1 -- 172.21.15.86:0/4121247643 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e0401aa90 con 0x7f9e141597f0 2023-10-09T13:13:32.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.789+0000 7f9e09ffb700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9df8066f30 0x7f9df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:32.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.789+0000 7f9e09ffb700 1 -- 172.21.15.86:0/4121247643 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7f9e04085ec0 con 0x7f9e141597f0 2023-10-09T13:13:32.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.789+0000 7f9e1999b700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9df8066f30 0x7f9df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:32.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.790+0000 7f9e1999b700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9df8066f30 0x7f9df80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9e140c7f40 tx=0x7f9e100091a0 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:32.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:32.794+0000 7f9e09ffb700 1 -- 172.21.15.86:0/4121247643 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e14159ee0 con 0x7f9e141597f0 2023-10-09T13:13:33.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.029+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e1404c3c0 con 0x7f9e141597f0 2023-10-09T13:13:33.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.029+0000 7f9e09ffb700 1 -- 172.21.15.86:0/4121247643 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f9e04029090 con 0x7f9e141597f0 2023-10-09T13:13:33.030 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:33.030 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7391,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3278560114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3278560114},{"type":"v1","addr":"172.21.15.135:6834","nonce":3278560114}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/875288736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":875288736},{"type":"v1","addr":"172.21.15.135:6835","nonce":875288736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":9063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/740435858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":740435858},{"type":"v1","addr":"172.21.15.86:6833","nonce":740435858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1073483795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1073483795},{"type":"v1","addr":"172.21.15.86:6835","nonce":1073483795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[]} 2023-10-09T13:13:33.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9df8066f30 msgr2=0x7f9df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:33.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9df8066f30 0x7f9df80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9e140c7f40 tx=0x7f9e100091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e141597f0 msgr2=0x7f9e14152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e141597f0 0x7f9e14152210 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f9e040093f0 tx=0x7f9e04016000 comp rx=0 tx=0).stop 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 shutdown_connections 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9df8066f30 0x7f9df80693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e1415d230 0x7f9e140c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e14159420 0x7f9e141586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 --2- 172.21.15.86:0/4121247643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e141597f0 0x7f9e14152210 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 >> 172.21.15.86:0/4121247643 conn(0x7f9e140d0660 msgr2=0x7f9e140b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 shutdown_connections 2023-10-09T13:13:33.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.032+0000 7f9e1a99d700 1 -- 172.21.15.86:0/4121247643 wait complete. 2023-10-09T13:13:33.034 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 80 2023-10-09T13:13:33.050 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T13:13:33.050 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T13:13:33.050 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T13:13:33.050 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:13:33.050 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T13:13:33.050 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T13:13:33.051 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T13:13:33.051 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:13:33.051 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T13:13:33.051 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T13:13:33.051 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T13:13:33.051 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:13:33.051 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T13:13:33.052 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T13:13:33.052 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T13:13:33.052 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:13:33.065 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T13:13:33.065 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T13:13:33.066 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T13:13:33.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T13:13:33.071 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T13:13:33.071 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T13:13:33.072 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T13:13:33.072 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T13:13:33.111 INFO:tasks.ceph.mds.a:Started 2023-10-09T13:13:33.111 DEBUG:teuthology.parallel:result is None 2023-10-09T13:13:33.113 INFO:tasks.ceph.mds.c:Started 2023-10-09T13:13:33.114 DEBUG:teuthology.parallel:result is None 2023-10-09T13:13:33.115 INFO:tasks.ceph.mds.d:Started 2023-10-09T13:13:33.116 DEBUG:teuthology.parallel:result is None 2023-10-09T13:13:33.118 INFO:tasks.ceph.mds.b:Started 2023-10-09T13:13:33.119 DEBUG:teuthology.parallel:result is None 2023-10-09T13:13:33.119 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T13:13:33.247 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T13:13:33.247 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T13:13:33.251 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T13:13:33.252 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T13:13:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.312+0000 7f5d235ff700 1 Processor -- start 2023-10-09T13:13:33.312 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.312+0000 7f5d235ff700 1 -- start start 2023-10-09T13:13:33.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.313+0000 7f5d235ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5d1c068550 0x7f5d1c068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:33.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.313+0000 7f5d235ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d1c15e010 0x7f5d1c06f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:33.314 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.313+0000 7f5d235ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c06ec70 con 0x7f5d1c06f640 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.313+0000 7f5d235ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1c0b3430 con 0x7f5d1c15e010 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.313+0000 7f5d235ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1c0b2e70 con 0x7f5d1c068550 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d1c15e010 0x7f5d1c06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d1c15e010 0x7f5d1c06f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51480/0 (socket says 172.21.15.86:51480) 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 -- 172.21.15.86:0/2543005302 learned_addr learned my addr 172.21.15.86:0/2543005302 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d2139b700 1 --2- 172.21.15.86:0/2543005302 >> v2:172.21.15.135:3300/0 conn(0x7f5d1c068550 0x7f5d1c068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 -- 172.21.15.86:0/2543005302 >> v2:172.21.15.135:3300/0 conn(0x7f5d1c068550 msgr2=0x7f5d1c068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 --2- 172.21.15.86:0/2543005302 >> v2:172.21.15.135:3300/0 conn(0x7f5d1c068550 0x7f5d1c068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 -- 172.21.15.86:0/2543005302 >> v1:172.21.15.135:6789/0 conn(0x7f5d1c06f640 legacy=0x7f5d1c06a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 -- 172.21.15.86:0/2543005302 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0b3150 con 0x7f5d1c15e010 2023-10-09T13:13:33.315 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.314+0000 7f5d20b9a700 1 --2- 172.21.15.86:0/2543005302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c15e010 0x7f5d1c06f100 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c06e170 tx=0x7f5d0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad64e4e8c057d6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:33.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d13fff700 1 -- 172.21.15.86:0/2543005302 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00b820 con 0x7f5d1c15e010 2023-10-09T13:13:33.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d13fff700 1 -- 172.21.15.86:0/2543005302 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c00b980 con 0x7f5d1c15e010 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d13fff700 1 -- 172.21.15.86:0/2543005302 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00bd20 con 0x7f5d1c15e010 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 -- 172.21.15.86:0/2543005302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c15e010 msgr2=0x7f5d1c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 --2- 172.21.15.86:0/2543005302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c15e010 0x7f5d1c06f100 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c06e170 tx=0x7f5d0c009250 comp rx=0 tx=0).stop 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 -- 172.21.15.86:0/2543005302 shutdown_connections 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 --2- 172.21.15.86:0/2543005302 >> v2:172.21.15.135:3300/0 conn(0x7f5d1c068550 0x7f5d1c068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 --2- 172.21.15.86:0/2543005302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c15e010 0x7f5d1c06f100 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 -- 172.21.15.86:0/2543005302 >> 172.21.15.86:0/2543005302 conn(0x7f5d1c0cd480 msgr2=0x7f5d1c0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 -- 172.21.15.86:0/2543005302 shutdown_connections 2023-10-09T13:13:33.317 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.315+0000 7f5d235ff700 1 -- 172.21.15.86:0/2543005302 wait complete. 2023-10-09T13:13:33.319 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.317+0000 7f5d235ff700 1 Processor -- start 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.317+0000 7f5d235ff700 1 -- start start 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d235ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d1c068550 0x7f5d1c144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d235ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c06f640 0x7f5d1c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d235ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d1c15e010 0x7f5d1c155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d235ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c16b100 con 0x7f5d1c06f640 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d235ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c15a700 con 0x7f5d1c15e010 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d235ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c16ae20 con 0x7f5d1c068550 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d20b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c06f640 0x7f5d1c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d20b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c06f640 0x7f5d1c154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51492/0 (socket says 172.21.15.86:51492) 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d20b9a700 1 -- 172.21.15.86:0/3304905377 learned_addr learned my addr 172.21.15.86:0/3304905377 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:33.320 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d2139b700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d1c068550 0x7f5d1c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d21b9c700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d1c15e010 0x7f5d1c155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d20b9a700 1 -- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d1c068550 msgr2=0x7f5d1c144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d20b9a700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d1c068550 0x7f5d1c144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d20b9a700 1 -- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d1c15e010 msgr2=0x7f5d1c155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.318+0000 7f5d20b9a700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d1c15e010 0x7f5d1c155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d20b9a700 1 -- 172.21.15.86:0/3304905377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c0094f0 con 0x7f5d1c06f640 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d2139b700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d1c068550 0x7f5d1c144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d20b9a700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c06f640 0x7f5d1c154e40 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009290 tx=0x7f5d0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d117fa700 1 -- 172.21.15.86:0/3304905377 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c01c460 con 0x7f5d1c06f640 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d117fa700 1 -- 172.21.15.86:0/3304905377 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c01c5c0 con 0x7f5d1c06f640 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c159dd0 con 0x7f5d1c06f640 2023-10-09T13:13:33.321 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d117fa700 1 -- 172.21.15.86:0/3304905377 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c01c980 con 0x7f5d1c06f640 2023-10-09T13:13:33.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.319+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1c15a390 con 0x7f5d1c06f640 2023-10-09T13:13:33.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.320+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c04c3c0 con 0x7f5d1c06f640 2023-10-09T13:13:33.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.321+0000 7f5d117fa700 1 -- 172.21.15.86:0/3304905377 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d0c01a450 con 0x7f5d1c06f640 2023-10-09T13:13:33.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.322+0000 7f5d117fa700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5d00066f30 0x7f5d000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:33.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.322+0000 7f5d117fa700 1 -- 172.21.15.86:0/3304905377 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6275+0+0 (secure 0 0 0) 0x7f5d0c086cf0 con 0x7f5d1c06f640 2023-10-09T13:13:33.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.322+0000 7f5d2139b700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5d00066f30 0x7f5d000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:33.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.323+0000 7f5d2139b700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5d00066f30 0x7f5d000693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d18006fd0 tx=0x7f5d18008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:33.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.326+0000 7f5d117fa700 1 -- 172.21.15.86:0/3304905377 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d0c053c80 con 0x7f5d1c06f640 2023-10-09T13:13:33.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:33.538+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5d1c04c3c0 con 0x7f5d1c06f640 2023-10-09T13:13:34.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.428+0000 7f5d117fa700 1 -- 172.21.15.86:0/3304905377 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v192) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5d0c0572a0 con 0x7f5d1c06f640 2023-10-09T13:13:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5d00066f30 msgr2=0x7f5d000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5d00066f30 0x7f5d000693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d18006fd0 tx=0x7f5d18008040 comp rx=0 tx=0).stop 2023-10-09T13:13:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c06f640 msgr2=0x7f5d1c154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c06f640 0x7f5d1c154e40 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009290 tx=0x7f5d0c016000 comp rx=0 tx=0).stop 2023-10-09T13:13:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 shutdown_connections 2023-10-09T13:13:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5d00066f30 0x7f5d000693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d1c15e010 0x7f5d1c155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d1c068550 0x7f5d1c144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 --2- 172.21.15.86:0/3304905377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d1c06f640 0x7f5d1c154e40 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.431+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 >> 172.21.15.86:0/3304905377 conn(0x7f5d1c0cd480 msgr2=0x7f5d1c1571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:34.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.432+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 shutdown_connections 2023-10-09T13:13:34.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.432+0000 7f5d235ff700 1 -- 172.21.15.86:0/3304905377 wait complete. 2023-10-09T13:13:34.433 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T13:13:34.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T13:13:34.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.640+0000 7f7aab3ff700 1 Processor -- start 2023-10-09T13:13:34.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.640+0000 7f7aab3ff700 1 -- start start 2023-10-09T13:13:34.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.641+0000 7f7aab3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406bcd0 0x7f7aa4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:34.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.641+0000 7f7aab3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7aa40c9510 0x7f7aa4141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:34.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.641+0000 7f7aab3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa415c2a0 con 0x7f7aa406c0a0 2023-10-09T13:13:34.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.641+0000 7f7aab3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa415b690 con 0x7f7aa40c9510 2023-10-09T13:13:34.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.641+0000 7f7aab3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa415b970 con 0x7f7aa406bcd0 2023-10-09T13:13:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa999c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7aa40c9510 0x7f7aa4141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:34.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa919b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406bcd0 0x7f7aa4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa899a700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7aa406c0a0 0x7f7aa40c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:33560/0 (socket says 172.21.15.86:33560) 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa899a700 1 -- 172.21.15.86:0/2849546002 learned_addr learned my addr 172.21.15.86:0/2849546002 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa999c700 1 -- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406bcd0 msgr2=0x7f7aa4140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa999c700 1 --2- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406bcd0 0x7f7aa4140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa999c700 1 -- 172.21.15.86:0/2849546002 >> v1:172.21.15.135:6789/0 conn(0x7f7aa406c0a0 legacy=0x7f7aa40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa999c700 1 -- 172.21.15.86:0/2849546002 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa415bc50 con 0x7f7aa40c9510 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7aa919b700 1 --2- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406bcd0 0x7f7aa4140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.642+0000 7f7a9bfff700 1 -- 172.21.15.86:0/2849546002 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371972947 0 0) 0x7f7aa415c2a0 con 0x7f7aa406c0a0 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.643+0000 7f7aa999c700 1 --2- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa4141330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009e60 tx=0x7f7a9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1b5fc835efb72e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.643+0000 7f7a9bfff700 1 -- 172.21.15.86:0/2849546002 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00e070 con 0x7f7aa40c9510 2023-10-09T13:13:34.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.643+0000 7f7a9bfff700 1 -- 172.21.15.86:0/2849546002 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00bb60 con 0x7f7aa40c9510 2023-10-09T13:13:34.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.643+0000 7f7a9bfff700 1 -- 172.21.15.86:0/2849546002 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c012430 con 0x7f7aa40c9510 2023-10-09T13:13:34.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 -- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 msgr2=0x7f7aa4141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa4141330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009e60 tx=0x7f7a9c009780 comp rx=0 tx=0).stop 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 -- 172.21.15.86:0/2849546002 shutdown_connections 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406bcd0 0x7f7aa4140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/2849546002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa4141330 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 -- 172.21.15.86:0/2849546002 >> 172.21.15.86:0/2849546002 conn(0x7f7aa40ce600 msgr2=0x7f7aa40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 -- 172.21.15.86:0/2849546002 shutdown_connections 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.644+0000 7f7aab3ff700 1 -- 172.21.15.86:0/2849546002 wait complete. 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.645+0000 7f7aab3ff700 1 Processor -- start 2023-10-09T13:13:34.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.645+0000 7f7aab3ff700 1 -- start start 2023-10-09T13:13:34.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.646+0000 7f7aab3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aa406bcd0 0x7f7aa413bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:34.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.646+0000 7f7aab3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406c0a0 0x7f7aa4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:34.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.646+0000 7f7aab3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa41541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.646+0000 7f7aab3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c5ea0 con 0x7f7aa406bcd0 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.646+0000 7f7aab3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c66d0 con 0x7f7aa40c9510 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.646+0000 7f7aab3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa41546e0 con 0x7f7aa406c0a0 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aa406bcd0 0x7f7aa413bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aa406bcd0 0x7f7aa413bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51502/0 (socket says 172.21.15.86:51502) 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 -- 172.21.15.86:0/799517368 learned_addr learned my addr 172.21.15.86:0/799517368 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa999c700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa41541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa899a700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406c0a0 0x7f7aa4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 -- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406c0a0 msgr2=0x7f7aa4153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406c0a0 0x7f7aa4153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 -- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 msgr2=0x7f7aa41541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa41541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 -- 172.21.15.86:0/799517368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0009420 con 0x7f7aa406bcd0 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa999c700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa41541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7aa919b700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aa406bcd0 0x7f7aa413bdb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000ec80 tx=0x7f7aa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.647+0000 7f7a997fa700 1 -- 172.21.15.86:0/799517368 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000c9d0 con 0x7f7aa406bcd0 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.648+0000 7f7a997fa700 1 -- 172.21.15.86:0/799517368 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa000cb30 con 0x7f7aa406bcd0 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.648+0000 7f7a997fa700 1 -- 172.21.15.86:0/799517368 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000ceb0 con 0x7f7aa406bcd0 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.648+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9c009a20 con 0x7f7aa406bcd0 2023-10-09T13:13:34.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.648+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa40b3570 con 0x7f7aa406bcd0 2023-10-09T13:13:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.649+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa404c3c0 con 0x7f7aa406bcd0 2023-10-09T13:13:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.649+0000 7f7a997fa700 1 -- 172.21.15.86:0/799517368 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7aa0013680 con 0x7f7aa406bcd0 2023-10-09T13:13:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.650+0000 7f7a997fa700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7a88066f30 0x7f7a880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.650+0000 7f7a997fa700 1 -- 172.21.15.86:0/799517368 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5329+0+0 (secure 0 0 0) 0x7f7aa00847a0 con 0x7f7aa406bcd0 2023-10-09T13:13:34.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.651+0000 7f7aa899a700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7a88066f30 0x7f7a880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:34.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.651+0000 7f7aa899a700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7a88066f30 0x7f7a880693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7aa416d4d0 tx=0x7f7a94009040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:34.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.654+0000 7f7a997fa700 1 -- 172.21.15.86:0/799517368 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7aa0051b80 con 0x7f7aa406bcd0 2023-10-09T13:13:34.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.918+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7aa406c9d0 con 0x7f7aa406bcd0 2023-10-09T13:13:34.919 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.919+0000 7f7a997fa700 1 -- 172.21.15.86:0/799517368 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v52) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7aa00551a0 con 0x7f7aa406bcd0 2023-10-09T13:13:34.919 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:34.919 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:13:34.919 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T13:13:34.921 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T13:13:34.922 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.923 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T13:13:34.925 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.926 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.928 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.929 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T13:13:34.930 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T13:13:34.932 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T13:13:34.933 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:13:34.934 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.935 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:34.935 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T13:13:34.935 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7a88066f30 msgr2=0x7f7a880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7a88066f30 0x7f7a880693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7aa416d4d0 tx=0x7f7a94009040 comp rx=0 tx=0).stop 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aa406bcd0 msgr2=0x7f7aa413bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aa406bcd0 0x7f7aa413bdb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000ec80 tx=0x7f7aa00091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 shutdown_connections 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7a88066f30 0x7f7a880693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7aa406bcd0 0x7f7aa413bdb0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aa40c9510 0x7f7aa41541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 --2- 172.21.15.86:0/799517368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7aa406c0a0 0x7f7aa4153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:34.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 >> 172.21.15.86:0/799517368 conn(0x7f7aa40ce600 msgr2=0x7f7aa40cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:34.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 shutdown_connections 2023-10-09T13:13:34.937 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:34.921+0000 7f7aab3ff700 1 -- 172.21.15.86:0/799517368 wait complete. 2023-10-09T13:13:34.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:13:35.000 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:13:35.005 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:13:35.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.126+0000 7fa226dff700 1 Processor -- start 2023-10-09T13:13:35.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.126+0000 7fa226dff700 1 -- start start 2023-10-09T13:13:35.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.127+0000 7fa226dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 0x7fa22015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.127+0000 7fa226dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22015a160 con 0x7fa220069560 2023-10-09T13:13:35.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.127+0000 7fa226dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2200d13a0 con 0x7fa220159c60 2023-10-09T13:13:35.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.127+0000 7fa226dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22015e140 con 0x7fa220159890 2023-10-09T13:13:35.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.127+0000 7fa22539c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa220069560 0x7fa2200ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52606/0 (socket says 172.21.15.86:52606) 2023-10-09T13:13:35.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.127+0000 7fa22539c700 1 -- 172.21.15.86:0/2342778839 learned_addr learned my addr 172.21.15.86:0/2342778839 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:35.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa224b9b700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 0x7fa22015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853389336 0 0) 0x7fa22015a160 con 0x7fa220069560 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa210003570 con 0x7fa220069560 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 989718943 0 0) 0x7fa210003570 con 0x7fa220069560 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 msgr2=0x7fa22015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 0x7fa22015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 >> v1:172.21.15.135:6789/0 conn(0x7fa220159c60 legacy=0x7fa22015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22015a3d0 con 0x7fa220069560 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa218001470 con 0x7fa220069560 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 >> v1:172.21.15.86:6789/0 conn(0x7fa220069560 legacy=0x7fa2200ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa210003a90 0x7fa210003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa210004810 0x7fa210004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 0x7fa2100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22015e140 con 0x7fa210004810 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21000bb40 con 0x7fa210003a90 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.128+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21000bd00 con 0x7fa220159890 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21ffff700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa210004810 0x7fa210004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa224b9b700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa210003a90 0x7fa210003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa22539c700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 0x7fa2100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21ffff700 1 -- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 msgr2=0x7fa2100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21ffff700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 0x7fa2100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21ffff700 1 -- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa210003a90 msgr2=0x7fa210003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21ffff700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa210003a90 0x7fa210003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21ffff700 1 -- 172.21.15.86:0/2342778839 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa210003570 con 0x7fa210004810 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa22539c700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa220159890 0x7fa2100051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21ffff700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa210004810 0x7fa210004c80 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fa20c001970 tx=0x7fa20c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8abe68cd8ae9cf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00c5d0 con 0x7fa210004810 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00c750 con 0x7fa210004810 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.129+0000 7fa21f7fe700 1 -- 172.21.15.86:0/2342778839 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00cb10 con 0x7fa210004810 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.130+0000 7fa226dff700 1 -- 172.21.15.86:0/2342778839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa210004810 msgr2=0x7fa210004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.130+0000 7fa226dff700 1 --2- 172.21.15.86:0/2342778839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa210004810 0x7fa210004c80 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fa20c001970 tx=0x7fa20c007d10 comp rx=0 tx=0).stop 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.130+0000 7fa22539c700 1 -- 172.21.15.86:0/2342778839 reap_dead start 2023-10-09T13:13:35.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.130+0000 7fa226dff700 1 -- 172.21.15.86:0/2342778839 shutdown_connections 2023-10-09T13:13:35.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.130+0000 7fa226dff700 1 -- 172.21.15.86:0/2342778839 >> 172.21.15.86:0/2342778839 conn(0x7fa220068e20 msgr2=0x7fa2200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:35.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.130+0000 7fa226dff700 1 -- 172.21.15.86:0/2342778839 shutdown_connections 2023-10-09T13:13:35.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.130+0000 7fa226dff700 1 -- 172.21.15.86:0/2342778839 wait complete. 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.131+0000 7fa226dff700 1 Processor -- start 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.132+0000 7fa226dff700 1 -- start start 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.132+0000 7fa226dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa210004810 0x7fa220156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.132+0000 7fa226dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2200c7ff0 0x7fa220169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.132+0000 7fa226dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa22016a100 0x7fa22016a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.132+0000 7fa226dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2201586b0 con 0x7fa22016a100 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.132+0000 7fa226dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22016aac0 con 0x7fa2200c7ff0 2023-10-09T13:13:35.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.132+0000 7fa226dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa220157610 con 0x7fa210004810 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa22016a100 0x7fa22016a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa22016a100 0x7fa22016a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49504/0 (socket says 172.21.15.86:49504) 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 -- 172.21.15.86:0/2496755401 learned_addr learned my addr 172.21.15.86:0/2496755401 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa21ffff700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2200c7ff0 0x7fa220169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa224b9b700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa210004810 0x7fa220156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 -- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa210004810 msgr2=0x7fa220156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa210004810 0x7fa220156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 -- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2200c7ff0 msgr2=0x7fa220169bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2200c7ff0 0x7fa220169bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 -- 172.21.15.86:0/2496755401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2201578f0 con 0x7fa22016a100 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa22539c700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa22016a100 0x7fa22016a580 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fa2200b67f0 tx=0x7fa218001430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa21cff9700 1 -- 172.21.15.86:0/2496755401 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800c600 con 0x7fa22016a100 2023-10-09T13:13:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa21cff9700 1 -- 172.21.15.86:0/2496755401 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21800c760 con 0x7fa22016a100 2023-10-09T13:13:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.133+0000 7fa21cff9700 1 -- 172.21.15.86:0/2496755401 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800cb20 con 0x7fa22016a100 2023-10-09T13:13:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.134+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa220157bd0 con 0x7fa22016a100 2023-10-09T13:13:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.134+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa220158190 con 0x7fa22016a100 2023-10-09T13:13:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.135+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa220158380 con 0x7fa22016a100 2023-10-09T13:13:35.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.135+0000 7fa21cff9700 1 -- 172.21.15.86:0/2496755401 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2180133e0 con 0x7fa22016a100 2023-10-09T13:13:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.136+0000 7fa21cff9700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa204066f30 0x7fa2040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.136+0000 7fa21cff9700 1 -- 172.21.15.86:0/2496755401 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5329+0+0 (secure 0 0 0) 0x7fa218083da0 con 0x7fa22016a100 2023-10-09T13:13:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.137+0000 7fa224b9b700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa204066f30 0x7fa2040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.137+0000 7fa224b9b700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa204066f30 0x7fa2040693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa2200b6630 tx=0x7fa21400b040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.140+0000 7fa21cff9700 1 -- 172.21.15.86:0/2496755401 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa218051160 con 0x7fa22016a100 2023-10-09T13:13:35.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.331+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa22004c3c0 con 0x7fa22016a100 2023-10-09T13:13:35.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.332+0000 7fa21cff9700 1 -- 172.21.15.86:0/2496755401 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+12925 (secure 0 0 0) 0x7fa218054780 con 0x7fa22016a100 2023-10-09T13:13:35.333 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:35.333 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":192,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:13:34.423388+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:13:35.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.334+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa204066f30 msgr2=0x7fa2040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.334+0000 7fa226dff700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa204066f30 0x7fa2040693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa2200b6630 tx=0x7fa21400b040 comp rx=0 tx=0).stop 2023-10-09T13:13:35.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa22016a100 msgr2=0x7fa22016a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa22016a100 0x7fa22016a580 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fa2200b67f0 tx=0x7fa218001430 comp rx=0 tx=0).stop 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 shutdown_connections 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa204066f30 0x7fa2040693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa22016a100 0x7fa22016a580 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa210004810 0x7fa220156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 --2- 172.21.15.86:0/2496755401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2200c7ff0 0x7fa220169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 >> 172.21.15.86:0/2496755401 conn(0x7fa220068e20 msgr2=0x7fa22015be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 shutdown_connections 2023-10-09T13:13:35.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.335+0000 7fa226dff700 1 -- 172.21.15.86:0/2496755401 wait complete. 2023-10-09T13:13:35.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T13:13:35.353 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T13:13:35.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.576+0000 7fb293fff700 1 Processor -- start 2023-10-09T13:13:35.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.577+0000 7fb293fff700 1 -- start start 2023-10-09T13:13:35.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb293fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb294153900 0x7fb2940c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb293fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb2940c9db0 0x7fb29406a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb293fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29406e150 con 0x7fb294157130 2023-10-09T13:13:35.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb293fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940c7800 con 0x7fb2940c9db0 2023-10-09T13:13:35.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb293fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940c7ae0 con 0x7fb294153900 2023-10-09T13:13:35.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb292ffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb294153900 0x7fb2940c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb2927fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb2940c9db0 0x7fb29406a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb292ffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb294153900 0x7fb2940c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:54142/0 (socket says 172.21.15.86:54142) 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb292ffd700 1 -- 172.21.15.86:0/1145553828 learned_addr learned my addr 172.21.15.86:0/1145553828 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.578+0000 7fb2937fe700 1 --1- 172.21.15.86:0/1145553828 >> v1:172.21.15.135:6789/0 conn(0x7fb294157130 0x7fb294159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:52092/0 (socket says 172.21.15.86:52092) 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb292ffd700 1 -- 172.21.15.86:0/1145553828 >> v2:172.21.15.135:3300/0 conn(0x7fb2940c9db0 msgr2=0x7fb29406a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb292ffd700 1 --2- 172.21.15.86:0/1145553828 >> v2:172.21.15.135:3300/0 conn(0x7fb2940c9db0 0x7fb29406a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb292ffd700 1 -- 172.21.15.86:0/1145553828 >> v1:172.21.15.135:6789/0 conn(0x7fb294157130 legacy=0x7fb294159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb292ffd700 1 -- 172.21.15.86:0/1145553828 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940c7dc0 con 0x7fb294153900 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb2927fc700 1 --2- 172.21.15.86:0/1145553828 >> v2:172.21.15.135:3300/0 conn(0x7fb2940c9db0 0x7fb29406a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:35.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb292ffd700 1 --2- 172.21.15.86:0/1145553828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb294153900 0x7fb2940c6f00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb28400aa50 tx=0x7fb28400a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f92d7d0f4e28e6b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb291ffb700 1 -- 172.21.15.86:0/1145553828 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400b750 con 0x7fb294153900 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb291ffb700 1 -- 172.21.15.86:0/1145553828 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400b8b0 con 0x7fb294153900 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.579+0000 7fb291ffb700 1 -- 172.21.15.86:0/1145553828 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400bc50 con 0x7fb294153900 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 -- 172.21.15.86:0/1145553828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb294153900 msgr2=0x7fb2940c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 --2- 172.21.15.86:0/1145553828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb294153900 0x7fb2940c6f00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb28400aa50 tx=0x7fb28400a330 comp rx=0 tx=0).stop 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 -- 172.21.15.86:0/1145553828 shutdown_connections 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 --2- 172.21.15.86:0/1145553828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb294153900 0x7fb2940c6f00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 --2- 172.21.15.86:0/1145553828 >> v2:172.21.15.135:3300/0 conn(0x7fb2940c9db0 0x7fb29406a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 -- 172.21.15.86:0/1145553828 >> 172.21.15.86:0/1145553828 conn(0x7fb2940cc1e0 msgr2=0x7fb2940cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:35.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 -- 172.21.15.86:0/1145553828 shutdown_connections 2023-10-09T13:13:35.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.580+0000 7fb293fff700 1 -- 172.21.15.86:0/1145553828 wait complete. 2023-10-09T13:13:35.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.581+0000 7fb293fff700 1 Processor -- start 2023-10-09T13:13:35.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.582+0000 7fb293fff700 1 -- start start 2023-10-09T13:13:35.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.582+0000 7fb293fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2940c9db0 0x7fb29414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.582+0000 7fb293fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb294153900 0x7fb29415fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.582+0000 7fb293fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb294157130 0x7fb2941603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.582+0000 7fb293fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29416b110 con 0x7fb294153900 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.582+0000 7fb293fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29416e260 con 0x7fb294157130 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.582+0000 7fb293fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940ad0d0 con 0x7fb2940c9db0 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb294153900 0x7fb29415fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb294153900 0x7fb29415fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49518/0 (socket says 172.21.15.86:49518) 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 -- 172.21.15.86:0/1067827178 learned_addr learned my addr 172.21.15.86:0/1067827178 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb292ffd700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2940c9db0 0x7fb29414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2937fe700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb294157130 0x7fb2941603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 -- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2940c9db0 msgr2=0x7fb29414eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2940c9db0 0x7fb29414eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 -- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb294157130 msgr2=0x7fb2941603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb294157130 0x7fb2941603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 -- 172.21.15.86:0/1067827178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288009420 con 0x7fb294153900 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.583+0000 7fb2927fc700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb294153900 0x7fb29415fe70 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb28800ec80 tx=0x7fb2880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.584+0000 7fb27affd700 1 -- 172.21.15.86:0/1067827178 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800c850 con 0x7fb294153900 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.584+0000 7fb27affd700 1 -- 172.21.15.86:0/1067827178 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800c9b0 con 0x7fb294153900 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.584+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28400a590 con 0x7fb294153900 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.584+0000 7fb27affd700 1 -- 172.21.15.86:0/1067827178 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800cd30 con 0x7fb294153900 2023-10-09T13:13:35.586 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.584+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29416dc10 con 0x7fb294153900 2023-10-09T13:13:35.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.585+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29416e3f0 con 0x7fb294153900 2023-10-09T13:13:35.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.586+0000 7fb27affd700 1 -- 172.21.15.86:0/1067827178 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb288013680 con 0x7fb294153900 2023-10-09T13:13:35.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.586+0000 7fb27affd700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb280066f30 0x7fb2800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.587+0000 7fb27affd700 1 -- 172.21.15.86:0/1067827178 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5329+0+0 (secure 0 0 0) 0x7fb288084930 con 0x7fb294153900 2023-10-09T13:13:35.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.587+0000 7fb292ffd700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb280066f30 0x7fb2800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.588 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.587+0000 7fb292ffd700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb280066f30 0x7fb2800693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb28400aa50 tx=0x7fb284019000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.591+0000 7fb27affd700 1 -- 172.21.15.86:0/1067827178 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2880557a0 con 0x7fb294153900 2023-10-09T13:13:35.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.779+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb29406dd20 con 0x7fb294153900 2023-10-09T13:13:35.779 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.779+0000 7fb27affd700 1 -- 172.21.15.86:0/1067827178 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2880170a0 con 0x7fb294153900 2023-10-09T13:13:35.780 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T13:13:35.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.781+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb280066f30 msgr2=0x7fb2800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.781+0000 7fb293fff700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb280066f30 0x7fb2800693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb28400aa50 tx=0x7fb284019000 comp rx=0 tx=0).stop 2023-10-09T13:13:35.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.781+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb294153900 msgr2=0x7fb29415fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.782 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.781+0000 7fb293fff700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb294153900 0x7fb29415fe70 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb28800ec80 tx=0x7fb2880091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.781+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 shutdown_connections 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.781+0000 7fb293fff700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb280066f30 0x7fb2800693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.781+0000 7fb293fff700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb294157130 0x7fb2941603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.782+0000 7fb293fff700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2940c9db0 0x7fb29414eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.782+0000 7fb293fff700 1 --2- 172.21.15.86:0/1067827178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb294153900 0x7fb29415fe70 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.782+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 >> 172.21.15.86:0/1067827178 conn(0x7fb2940cc1e0 msgr2=0x7fb2940c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.782+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 shutdown_connections 2023-10-09T13:13:35.783 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.782+0000 7fb293fff700 1 -- 172.21.15.86:0/1067827178 wait complete. 2023-10-09T13:13:35.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T13:13:35.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.979+0000 7f7fed39d700 1 Processor -- start 2023-10-09T13:13:35.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.979+0000 7f7fed39d700 1 -- start start 2023-10-09T13:13:35.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fed39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7fe8157270 0x7f7fe8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fed39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fe80b0bd0 0x7f7fe815d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fed39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe815a980 con 0x7f7fe80688d0 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fed39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe8068d50 con 0x7f7fe80b0bd0 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fed39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe815a050 con 0x7f7fe8157270 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fecb9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fe80b0bd0 0x7f7fe815d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fecb9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fe80b0bd0 0x7f7fe815d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49528/0 (socket says 172.21.15.86:49528) 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.980+0000 7f7fecb9c700 1 -- 172.21.15.86:0/500931397 learned_addr learned my addr 172.21.15.86:0/500931397 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fe7fff700 1 --2- 172.21.15.86:0/500931397 >> v2:172.21.15.135:3300/0 conn(0x7f7fe8157270 0x7f7fe8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fecb9c700 1 -- 172.21.15.86:0/500931397 >> v2:172.21.15.135:3300/0 conn(0x7f7fe8157270 msgr2=0x7f7fe8068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fecb9c700 1 --2- 172.21.15.86:0/500931397 >> v2:172.21.15.135:3300/0 conn(0x7f7fe8157270 0x7f7fe8068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fecb9c700 1 -- 172.21.15.86:0/500931397 >> v1:172.21.15.135:6789/0 conn(0x7f7fe80688d0 legacy=0x7f7fe80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fecb9c700 1 -- 172.21.15.86:0/500931397 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe815a330 con 0x7f7fe80b0bd0 2023-10-09T13:13:35.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fe7fff700 1 --2- 172.21.15.86:0/500931397 >> v2:172.21.15.135:3300/0 conn(0x7f7fe8157270 0x7f7fe8068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:35.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fecb9c700 1 --2- 172.21.15.86:0/500931397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe80b0bd0 0x7f7fe815d300 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80b3360 tx=0x7f7fe0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f6f1c7851bafb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fe6ffd700 1 -- 172.21.15.86:0/500931397 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000e070 con 0x7f7fe80b0bd0 2023-10-09T13:13:35.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fe6ffd700 1 -- 172.21.15.86:0/500931397 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000ba50 con 0x7f7fe80b0bd0 2023-10-09T13:13:35.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.981+0000 7f7fe6ffd700 1 -- 172.21.15.86:0/500931397 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00092e0 con 0x7f7fe80b0bd0 2023-10-09T13:13:35.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 -- 172.21.15.86:0/500931397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe80b0bd0 msgr2=0x7f7fe815d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 --2- 172.21.15.86:0/500931397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe80b0bd0 0x7f7fe815d300 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80b3360 tx=0x7f7fe0009840 comp rx=0 tx=0).stop 2023-10-09T13:13:35.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 -- 172.21.15.86:0/500931397 shutdown_connections 2023-10-09T13:13:35.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 --2- 172.21.15.86:0/500931397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe80b0bd0 0x7f7fe815d300 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 --2- 172.21.15.86:0/500931397 >> v2:172.21.15.135:3300/0 conn(0x7f7fe8157270 0x7f7fe8068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 -- 172.21.15.86:0/500931397 >> 172.21.15.86:0/500931397 conn(0x7f7fe80cd310 msgr2=0x7f7fe80cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:35.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 -- 172.21.15.86:0/500931397 shutdown_connections 2023-10-09T13:13:35.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.982+0000 7f7fed39d700 1 -- 172.21.15.86:0/500931397 wait complete. 2023-10-09T13:13:35.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.983+0000 7f7fed39d700 1 Processor -- start 2023-10-09T13:13:35.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.984+0000 7f7fed39d700 1 -- start start 2023-10-09T13:13:35.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.984+0000 7f7fed39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fe80688d0 0x7f7fe80af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.984+0000 7f7fed39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fe80b0bd0 0x7f7fe815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fed39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe8157270 0x7f7fe81549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fed39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8152680 con 0x7f7fe8157270 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fed39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe815f050 con 0x7f7fe80688d0 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fed39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80ae0b0 con 0x7f7fe80b0bd0 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe8157270 0x7f7fe81549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe8157270 0x7f7fe81549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49536/0 (socket says 172.21.15.86:49536) 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 -- 172.21.15.86:0/960299120 learned_addr learned my addr 172.21.15.86:0/960299120 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fe7fff700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fe80688d0 0x7f7fe80af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fe77fe700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fe80b0bd0 0x7f7fe815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 -- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fe80b0bd0 msgr2=0x7f7fe815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fe80b0bd0 0x7f7fe815b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 -- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fe80688d0 msgr2=0x7f7fe80af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fe80688d0 0x7f7fe80af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 -- 172.21.15.86:0/960299120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0009ae0 con 0x7f7fe8157270 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fe7fff700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fe80688d0 0x7f7fe80af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.985+0000 7f7fecb9c700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe8157270 0x7f7fe81549c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8068ed0 tx=0x7f7fe0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.986+0000 7f7fcffff700 1 -- 172.21.15.86:0/960299120 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0008e40 con 0x7f7fe8157270 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.986+0000 7f7fcffff700 1 -- 172.21.15.86:0/960299120 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000be60 con 0x7f7fe8157270 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.986+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe80ae300 con 0x7f7fe8157270 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.986+0000 7f7fcffff700 1 -- 172.21.15.86:0/960299120 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00266b0 con 0x7f7fe8157270 2023-10-09T13:13:35.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.986+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe80aeba0 con 0x7f7fe8157270 2023-10-09T13:13:35.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.987+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe80ae6f0 con 0x7f7fe8157270 2023-10-09T13:13:35.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.988+0000 7f7fcffff700 1 -- 172.21.15.86:0/960299120 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fe0003040 con 0x7f7fe8157270 2023-10-09T13:13:35.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.989+0000 7f7fcffff700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7fd4066f30 0x7f7fd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:35.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.989+0000 7f7fcffff700 1 -- 172.21.15.86:0/960299120 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5329+0+0 (secure 0 0 0) 0x7f7fe0086500 con 0x7f7fe8157270 2023-10-09T13:13:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.989+0000 7f7fe7fff700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7fd4066f30 0x7f7fd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:35.990 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.989+0000 7f7fe7fff700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7fd4066f30 0x7f7fd40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8006f00 tx=0x7f7fd8008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:35.993 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:35.993+0000 7f7fcffff700 1 -- 172.21.15.86:0/960299120 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fe00538f0 con 0x7f7fe8157270 2023-10-09T13:13:36.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.184+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7fe815a640 con 0x7f7fe8157270 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.185+0000 7f7fcffff700 1 -- 172.21.15.86:0/960299120 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v192) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7fe0056f10 con 0x7f7fe8157270 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:36.185 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7fd4066f30 msgr2=0x7f7fd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7fd4066f30 0x7f7fd40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8006f00 tx=0x7f7fd8008040 comp rx=0 tx=0).stop 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe8157270 msgr2=0x7f7fe81549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe8157270 0x7f7fe81549c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8068ed0 tx=0x7f7fe0018000 comp rx=0 tx=0).stop 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 shutdown_connections 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7fd4066f30 0x7f7fd40693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fe8157270 0x7f7fe81549c0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fe80688d0 0x7f7fe80af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 --2- 172.21.15.86:0/960299120 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fe80b0bd0 0x7f7fe815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 >> 172.21.15.86:0/960299120 conn(0x7f7fe80cd310 msgr2=0x7f7fe806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:36.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 shutdown_connections 2023-10-09T13:13:36.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.187+0000 7f7fed39d700 1 -- 172.21.15.86:0/960299120 wait complete. 2023-10-09T13:13:36.205 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T13:13:36.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T13:13:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.389+0000 7f56b49fe700 1 Processor -- start 2023-10-09T13:13:36.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.389+0000 7f56b49fe700 1 -- start start 2023-10-09T13:13:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.390+0000 7f56b49fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f56b0156350 0x7f56b0157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.390+0000 7f56b49fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b00b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.390+0000 7f56b49fe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b00b1110 con 0x7f56b0159f20 2023-10-09T13:13:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.390+0000 7f56b49fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b00b0570 con 0x7f56b0156350 2023-10-09T13:13:36.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.390+0000 7f56b49fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b01578b0 con 0x7f56b00b0760 2023-10-09T13:13:36.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56aed9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f56b0156350 0x7f56b0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:36.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56af59e700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f56b0159f20 0x7f56b015a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:52096/0 (socket says 172.21.15.86:52096) 2023-10-09T13:13:36.392 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56aed9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f56b0156350 0x7f56b0157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:45466/0 (socket says 172.21.15.86:45466) 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56af59e700 1 -- 172.21.15.86:0/1788532815 learned_addr learned my addr 172.21.15.86:0/1788532815 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56ae59c700 1 --2- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b00b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56aed9d700 1 -- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 msgr2=0x7f56b00b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56aed9d700 1 --2- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b00b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56aed9d700 1 -- 172.21.15.86:0/1788532815 >> v1:172.21.15.135:6789/0 conn(0x7f56b0159f20 legacy=0x7f56b015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56aed9d700 1 -- 172.21.15.86:0/1788532815 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00af4d0 con 0x7f56b0156350 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.391+0000 7f56ae59c700 1 --2- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b00b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.392+0000 7f56aed9d700 1 --2- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0156350 0x7f56b0157370 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f56a00098e0 tx=0x7f56a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d611574ec2df06 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.392+0000 7f56add9b700 1 -- 172.21.15.86:0/1788532815 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000b640 con 0x7f56b0156350 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.392+0000 7f56add9b700 1 -- 172.21.15.86:0/1788532815 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000b7a0 con 0x7f56b0156350 2023-10-09T13:13:36.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.392+0000 7f56add9b700 1 -- 172.21.15.86:0/1788532815 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000bb40 con 0x7f56b0156350 2023-10-09T13:13:36.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 -- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0156350 msgr2=0x7f56b0157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:36.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0156350 0x7f56b0157370 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f56a00098e0 tx=0x7f56a00091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 -- 172.21.15.86:0/1788532815 shutdown_connections 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0156350 0x7f56b0157370 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1788532815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b00b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 -- 172.21.15.86:0/1788532815 >> 172.21.15.86:0/1788532815 conn(0x7f56b0068e20 msgr2=0x7f56b00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 -- 172.21.15.86:0/1788532815 shutdown_connections 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.393+0000 7f56b49fe700 1 -- 172.21.15.86:0/1788532815 wait complete. 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.394+0000 7f56b49fe700 1 Processor -- start 2023-10-09T13:13:36.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.394+0000 7f56b49fe700 1 -- start start 2023-10-09T13:13:36.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.395+0000 7f56b49fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:36.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.395+0000 7f56b49fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56b0156350 0x7f56b00ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:36.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.395+0000 7f56b49fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0159f20 0x7f56b0169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:36.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.395+0000 7f56b49fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b016e800 con 0x7f56b0156350 2023-10-09T13:13:36.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.395+0000 7f56b49fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00ad480 con 0x7f56b0159f20 2023-10-09T13:13:36.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.395+0000 7f56b49fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b016e520 con 0x7f56b00b0760 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56b0156350 0x7f56b00ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56b0156350 0x7f56b00ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49544/0 (socket says 172.21.15.86:49544) 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 -- 172.21.15.86:0/1385615514 learned_addr learned my addr 172.21.15.86:0/1385615514 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56aed9d700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56af59e700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0159f20 0x7f56b0169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 -- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 msgr2=0x7f56b006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b006d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 -- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0159f20 msgr2=0x7f56b0169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0159f20 0x7f56b0169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 -- 172.21.15.86:0/1385615514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a400ba20 con 0x7f56b0156350 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56ae59c700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56b0156350 0x7f56b00ca3c0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f56a4008b00 tx=0x7f56a400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:36.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f5696ffd700 1 -- 172.21.15.86:0/1385615514 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4010040 con 0x7f56b0156350 2023-10-09T13:13:36.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f5696ffd700 1 -- 172.21.15.86:0/1385615514 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4009d20 con 0x7f56b0156350 2023-10-09T13:13:36.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.396+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a0009420 con 0x7f56b0156350 2023-10-09T13:13:36.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.397+0000 7f5696ffd700 1 -- 172.21.15.86:0/1385615514 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400bea0 con 0x7f56b0156350 2023-10-09T13:13:36.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.397+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b00ad110 con 0x7f56b0156350 2023-10-09T13:13:36.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.398+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b004c3c0 con 0x7f56b0156350 2023-10-09T13:13:36.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.399+0000 7f5696ffd700 1 -- 172.21.15.86:0/1385615514 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56a40168b0 con 0x7f56b0156350 2023-10-09T13:13:36.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.399+0000 7f5696ffd700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f569c066f30 0x7f569c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:36.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.400+0000 7f5696ffd700 1 -- 172.21.15.86:0/1385615514 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5329+0+0 (secure 0 0 0) 0x7f56a4084490 con 0x7f56b0156350 2023-10-09T13:13:36.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.400+0000 7f56aed9d700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f569c066f30 0x7f569c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:36.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.400+0000 7f56aed9d700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f569c066f30 0x7f569c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f56a00093f0 tx=0x7f56a0017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:36.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.404+0000 7f5696ffd700 1 -- 172.21.15.86:0/1385615514 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56a404f5a0 con 0x7f56b0156350 2023-10-09T13:13:36.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:36.593+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f56b00af7b0 con 0x7f56b0156350 2023-10-09T13:13:37.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.024+0000 7f5696ffd700 1 -- 172.21.15.86:0/1385615514 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v193) v1 ==== 138+0+0 (secure 0 0 0) 0x7f56a4051880 con 0x7f56b0156350 2023-10-09T13:13:37.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f569c066f30 msgr2=0x7f569c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:37.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f569c066f30 0x7f569c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f56a00093f0 tx=0x7f56a0017000 comp rx=0 tx=0).stop 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56b0156350 msgr2=0x7f56b00ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56b0156350 0x7f56b00ca3c0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f56a4008b00 tx=0x7f56a400b780 comp rx=0 tx=0).stop 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 shutdown_connections 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f569c066f30 0x7f569c0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b0159f20 0x7f56b0169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b00b0760 0x7f56b006d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 --2- 172.21.15.86:0/1385615514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56b0156350 0x7f56b00ca3c0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 >> 172.21.15.86:0/1385615514 conn(0x7f56b0068e20 msgr2=0x7f56b0151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 shutdown_connections 2023-10-09T13:13:37.029 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.028+0000 7f56b49fe700 1 -- 172.21.15.86:0/1385615514 wait complete. 2023-10-09T13:13:37.030 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T13:13:37.046 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T13:13:37.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.235+0000 7fe2cc7ff700 1 Processor -- start 2023-10-09T13:13:37.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.235+0000 7fe2cc7ff700 1 -- start start 2023-10-09T13:13:37.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2cc7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe2c40c85c0 0x7fe2c406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:37.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2cc7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2c4156ee0 0x7fe2c4069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:37.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2cc7ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c4156340 con 0x7fe2c4069dd0 2023-10-09T13:13:37.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2cc7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c40c8990 con 0x7fe2c4156ee0 2023-10-09T13:13:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2cc7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c406a1d0 con 0x7fe2c40c85c0 2023-10-09T13:13:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2c9d9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2c4156ee0 0x7fe2c4069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2cad9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe2c4069dd0 0x7fe2c4159ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52620/0 (socket says 172.21.15.86:52620) 2023-10-09T13:13:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2cad9c700 1 -- 172.21.15.86:0/1495497514 learned_addr learned my addr 172.21.15.86:0/1495497514 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:37.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2ca59b700 1 --2- 172.21.15.86:0/1495497514 >> v2:172.21.15.135:3300/0 conn(0x7fe2c40c85c0 0x7fe2c406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:37.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2c9d9a700 1 -- 172.21.15.86:0/1495497514 >> v2:172.21.15.135:3300/0 conn(0x7fe2c40c85c0 msgr2=0x7fe2c406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2c9d9a700 1 --2- 172.21.15.86:0/1495497514 >> v2:172.21.15.135:3300/0 conn(0x7fe2c40c85c0 0x7fe2c406d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2c9d9a700 1 -- 172.21.15.86:0/1495497514 >> v1:172.21.15.86:6789/0 conn(0x7fe2c4069dd0 legacy=0x7fe2c4159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2c9d9a700 1 -- 172.21.15.86:0/1495497514 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c406ee20 con 0x7fe2c4156ee0 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.237+0000 7fe2c9599700 1 -- 172.21.15.86:0/1495497514 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473697675 0 0) 0x7fe2c4156340 con 0x7fe2c4069dd0 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.238+0000 7fe2c9d9a700 1 --2- 172.21.15.86:0/1495497514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c4156ee0 0x7fe2c4069890 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fe2c406b9d0 tx=0x7fe2b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a57acb11abb475 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.238+0000 7fe2c9599700 1 -- 172.21.15.86:0/1495497514 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400b6b0 con 0x7fe2c4156ee0 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.238+0000 7fe2c9599700 1 -- 172.21.15.86:0/1495497514 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b400b810 con 0x7fe2c4156ee0 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.238+0000 7fe2c9599700 1 -- 172.21.15.86:0/1495497514 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400bbb0 con 0x7fe2c4156ee0 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.238+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/1495497514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c4156ee0 msgr2=0x7fe2c4069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.238+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/1495497514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c4156ee0 0x7fe2c4069890 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fe2c406b9d0 tx=0x7fe2b40091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.239+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/1495497514 shutdown_connections 2023-10-09T13:13:37.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.239+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/1495497514 >> v2:172.21.15.135:3300/0 conn(0x7fe2c40c85c0 0x7fe2c406d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.239+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/1495497514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c4156ee0 0x7fe2c4069890 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.239+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/1495497514 >> 172.21.15.86:0/1495497514 conn(0x7fe2c40cc540 msgr2=0x7fe2c40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:37.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.239+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/1495497514 shutdown_connections 2023-10-09T13:13:37.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.239+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/1495497514 wait complete. 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.240+0000 7fe2cc7ff700 1 Processor -- start 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.240+0000 7fe2cc7ff700 1 -- start start 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2cc7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c4069dd0 0x7fe2c414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2cc7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c40c85c0 0x7fe2c40c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2cc7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2c4156ee0 0x7fe2c40b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2cc7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c414bad0 con 0x7fe2c40c85c0 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2cc7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c414def0 con 0x7fe2c4069dd0 2023-10-09T13:13:37.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2cc7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40c2ea0 con 0x7fe2c4156ee0 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2c9d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c40c85c0 0x7fe2c40c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2c9d9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c40c85c0 0x7fe2c40c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49574/0 (socket says 172.21.15.86:49574) 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.241+0000 7fe2c9d9a700 1 -- 172.21.15.86:0/2474407738 learned_addr learned my addr 172.21.15.86:0/2474407738 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2c9d9a700 1 -- 172.21.15.86:0/2474407738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2c4156ee0 msgr2=0x7fe2c40b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2c9d9a700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2c4156ee0 0x7fe2c40b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2c9d9a700 1 -- 172.21.15.86:0/2474407738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c4069dd0 msgr2=0x7fe2c414b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2c9d9a700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c4069dd0 0x7fe2c414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2c9d9a700 1 -- 172.21.15.86:0/2474407738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4009420 con 0x7fe2c40c85c0 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2c9d9a700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c40c85c0 0x7fe2c40c23c0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe2c406ab50 tx=0x7fe2b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2ba7fc700 1 -- 172.21.15.86:0/2474407738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011420 con 0x7fe2c40c85c0 2023-10-09T13:13:37.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2ba7fc700 1 -- 172.21.15.86:0/2474407738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4011580 con 0x7fe2c40c85c0 2023-10-09T13:13:37.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c40c3180 con 0x7fe2c40c85c0 2023-10-09T13:13:37.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2ba7fc700 1 -- 172.21.15.86:0/2474407738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011940 con 0x7fe2c40c85c0 2023-10-09T13:13:37.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.242+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c414db80 con 0x7fe2c40c85c0 2023-10-09T13:13:37.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.244+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c40718b0 con 0x7fe2c40c85c0 2023-10-09T13:13:37.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.245+0000 7fe2ba7fc700 1 -- 172.21.15.86:0/2474407738 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2b4011d30 con 0x7fe2c40c85c0 2023-10-09T13:13:37.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.245+0000 7fe2ba7fc700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe2a8066f30 0x7fe2a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:37.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.245+0000 7fe2ba7fc700 1 -- 172.21.15.86:0/2474407738 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fe2b4085a30 con 0x7fe2c40c85c0 2023-10-09T13:13:37.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.246+0000 7fe2ca59b700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe2a8066f30 0x7fe2a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:37.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.246+0000 7fe2ca59b700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe2a8066f30 0x7fe2a80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009a60 tx=0x7fe2c0008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:37.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.250+0000 7fe2ba7fc700 1 -- 172.21.15.86:0/2474407738 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2b4052c00 con 0x7fe2c40c85c0 2023-10-09T13:13:37.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:37.441+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe2c414e060 con 0x7fe2c40c85c0 2023-10-09T13:13:38.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.027+0000 7fe2ba7fc700 1 -- 172.21.15.86:0/2474407738 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v194) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe2b4015020 con 0x7fe2c40c85c0 2023-10-09T13:13:38.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.038+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe2a8066f30 msgr2=0x7fe2a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:38.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.038+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe2a8066f30 0x7fe2a80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009a60 tx=0x7fe2c0008040 comp rx=0 tx=0).stop 2023-10-09T13:13:38.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.038+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c40c85c0 msgr2=0x7fe2c40c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:38.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.038+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c40c85c0 0x7fe2c40c23c0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe2c406ab50 tx=0x7fe2b4017000 comp rx=0 tx=0).stop 2023-10-09T13:13:38.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.041+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 shutdown_connections 2023-10-09T13:13:38.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.041+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe2a8066f30 0x7fe2a80693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.041+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2c4156ee0 0x7fe2c40b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.041+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c4069dd0 0x7fe2c414b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.041+0000 7fe2cc7ff700 1 --2- 172.21.15.86:0/2474407738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2c40c85c0 0x7fe2c40c23c0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.041+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 >> 172.21.15.86:0/2474407738 conn(0x7fe2c40cc540 msgr2=0x7fe2c4157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:38.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.042+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 shutdown_connections 2023-10-09T13:13:38.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.042+0000 7fe2cc7ff700 1 -- 172.21.15.86:0/2474407738 wait complete. 2023-10-09T13:13:38.045 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T13:13:38.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T13:13:38.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.248+0000 7f500ddff700 1 Processor -- start 2023-10-09T13:13:38.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.248+0000 7f500ddff700 1 -- start start 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.249+0000 7f500ddff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080c83f0 0x7f50080c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.249+0000 7f500ddff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50081568e0 0x7f50080ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.249+0000 7f500ddff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500815b0d0 con 0x7f50080ccee0 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.249+0000 7f500ddff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080c7a60 con 0x7f50081568e0 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.249+0000 7f500ddff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500815a4c0 con 0x7f50080c83f0 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50081568e0 0x7f50080ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50081568e0 0x7f50080ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49588/0 (socket says 172.21.15.86:49588) 2023-10-09T13:13:38.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 -- 172.21.15.86:0/823467457 learned_addr learned my addr 172.21.15.86:0/823467457 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:38.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f50077fe700 1 --2- 172.21.15.86:0/823467457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080c83f0 0x7f50080c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:38.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 -- 172.21.15.86:0/823467457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080c83f0 msgr2=0x7f50080c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:38.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 --2- 172.21.15.86:0/823467457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080c83f0 0x7f50080c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 -- 172.21.15.86:0/823467457 >> v1:172.21.15.135:6789/0 conn(0x7f50080ccee0 legacy=0x7f50081561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:38.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 -- 172.21.15.86:0/823467457 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500815a7a0 con 0x7f50081568e0 2023-10-09T13:13:38.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.250+0000 7f5007fff700 1 --2- 172.21.15.86:0/823467457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50081568e0 0x7f50080ca1e0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f5000009f20 tx=0x7f5000009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb65d049c53f8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f50067fc700 1 -- 172.21.15.86:0/823467457 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000e070 con 0x7f50081568e0 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f50067fc700 1 -- 172.21.15.86:0/823467457 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000ba80 con 0x7f50081568e0 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f50067fc700 1 -- 172.21.15.86:0/823467457 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000092e0 con 0x7f50081568e0 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 -- 172.21.15.86:0/823467457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50081568e0 msgr2=0x7f50080ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 --2- 172.21.15.86:0/823467457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50081568e0 0x7f50080ca1e0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f5000009f20 tx=0x7f5000009840 comp rx=0 tx=0).stop 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 -- 172.21.15.86:0/823467457 shutdown_connections 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 --2- 172.21.15.86:0/823467457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50081568e0 0x7f50080ca1e0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 --2- 172.21.15.86:0/823467457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080c83f0 0x7f50080c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 -- 172.21.15.86:0/823467457 >> 172.21.15.86:0/823467457 conn(0x7f5008068e10 msgr2=0x7f50080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 -- 172.21.15.86:0/823467457 shutdown_connections 2023-10-09T13:13:38.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.251+0000 7f500ddff700 1 -- 172.21.15.86:0/823467457 wait complete. 2023-10-09T13:13:38.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.253+0000 7f500ddff700 1 Processor -- start 2023-10-09T13:13:38.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.253+0000 7f500ddff700 1 -- start start 2023-10-09T13:13:38.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f500ddff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50080c83f0 0x7f5008157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f500ddff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080ccee0 0x7f50080c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f500ddff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50081568e0 0x7f500814bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f500ddff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500816da30 con 0x7f50080c83f0 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f500ddff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c27d0 con 0x7f50081568e0 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f500ddff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c2ab0 con 0x7f50080ccee0 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50080c83f0 0x7f5008157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50080c83f0 0x7f5008157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49590/0 (socket says 172.21.15.86:49590) 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 -- 172.21.15.86:0/3548499892 learned_addr learned my addr 172.21.15.86:0/3548499892 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f5007fff700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50081568e0 0x7f500814bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f5006ffd700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080ccee0 0x7f50080c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:38.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 -- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080ccee0 msgr2=0x7f50080c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080ccee0 0x7f50080c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 -- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50081568e0 msgr2=0x7f500814bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50081568e0 0x7f500814bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.254+0000 7f50077fe700 1 -- 172.21.15.86:0/3548499892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009ae0 con 0x7f50080c83f0 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.255+0000 7f50077fe700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50080c83f0 0x7f5008157c90 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800d890 tx=0x7f4ff8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.255+0000 7f4fef7fe700 1 -- 172.21.15.86:0/3548499892 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80125f0 con 0x7f50080c83f0 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.255+0000 7f4fef7fe700 1 -- 172.21.15.86:0/3548499892 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8012770 con 0x7f50080c83f0 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.255+0000 7f4fef7fe700 1 -- 172.21.15.86:0/3548499892 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8012b30 con 0x7f50080c83f0 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.255+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500816d3e0 con 0x7f50080c83f0 2023-10-09T13:13:38.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.255+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080c2450 con 0x7f50080c83f0 2023-10-09T13:13:38.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.256+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500804c3c0 con 0x7f50080c83f0 2023-10-09T13:13:38.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.258+0000 7f4fef7fe700 1 -- 172.21.15.86:0/3548499892 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ff801e460 con 0x7f50080c83f0 2023-10-09T13:13:38.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.258+0000 7f4fef7fe700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ff4066f30 0x7f4ff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:38.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.258+0000 7f4fef7fe700 1 -- 172.21.15.86:0/3548499892 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6081+0+0 (secure 0 0 0) 0x7f4ff80857c0 con 0x7f50080c83f0 2023-10-09T13:13:38.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.259+0000 7f5006ffd700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ff4066f30 0x7f4ff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:38.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.259+0000 7f5006ffd700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ff4066f30 0x7f4ff40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f500806d390 tx=0x7f4ffc007ec0 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:38.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.262+0000 7f4fef7fe700 1 -- 172.21.15.86:0/3548499892 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ff8052890 con 0x7f50080c83f0 2023-10-09T13:13:38.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:38.497+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f500815aa80 con 0x7f50080c83f0 2023-10-09T13:13:39.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.426+0000 7f4fef7fe700 1 -- 172.21.15.86:0/3548499892 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4ff8055eb0 con 0x7f50080c83f0 2023-10-09T13:13:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ff4066f30 msgr2=0x7f4ff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ff4066f30 0x7f4ff40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f500806d390 tx=0x7f4ffc007ec0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50080c83f0 msgr2=0x7f5008157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50080c83f0 0x7f5008157c90 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800d890 tx=0x7f4ff8008040 comp rx=0 tx=0).stop 2023-10-09T13:13:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 shutdown_connections 2023-10-09T13:13:39.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ff4066f30 0x7f4ff40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50080c83f0 0x7f5008157c90 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50081568e0 0x7f500814bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 --2- 172.21.15.86:0/3548499892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50080ccee0 0x7f50080c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.429+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 >> 172.21.15.86:0/3548499892 conn(0x7f5008068e10 msgr2=0x7f50080c13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.430+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 shutdown_connections 2023-10-09T13:13:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.430+0000 7f500ddff700 1 -- 172.21.15.86:0/3548499892 wait complete. 2023-10-09T13:13:39.431 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 22 and data pool 23 2023-10-09T13:13:39.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:13:39.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.637+0000 7f868ffff700 1 Processor -- start 2023-10-09T13:13:39.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.637+0000 7f868ffff700 1 -- start start 2023-10-09T13:13:39.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f86880b1850 0x7f86880b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:39.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86881579f0 0x7f86880abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:39.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880cb300 con 0x7f86880ae680 2023-10-09T13:13:39.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868ffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868806fc30 con 0x7f86880b1850 2023-10-09T13:13:39.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880cc260 con 0x7f86881579f0 2023-10-09T13:13:39.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868dd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f86880b1850 0x7f86880b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868dd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f86880b1850 0x7f86880b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49606/0 (socket says 172.21.15.86:49606) 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868dd9b700 1 -- 172.21.15.86:0/2233214069 learned_addr learned my addr 172.21.15.86:0/2233214069 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868e59c700 1 --2- 172.21.15.86:0/2233214069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86881579f0 0x7f86880abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868dd9b700 1 -- 172.21.15.86:0/2233214069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86881579f0 msgr2=0x7f86880abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868dd9b700 1 --2- 172.21.15.86:0/2233214069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86881579f0 0x7f86880abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868dd9b700 1 -- 172.21.15.86:0/2233214069 >> v1:172.21.15.135:6789/0 conn(0x7f86880ae680 legacy=0x7f86881572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.639+0000 7f868dd9b700 1 -- 172.21.15.86:0/2233214069 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880cb5e0 con 0x7f86880b1850 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.640+0000 7f868dd9b700 1 --2- 172.21.15.86:0/2233214069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86880b1850 0x7f86880b1c20 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f86840099e0 tx=0x7f8684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3463b2ec2d3e8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.640+0000 7f868cd99700 1 -- 172.21.15.86:0/2233214069 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400b7e0 con 0x7f86880b1850 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.640+0000 7f868cd99700 1 -- 172.21.15.86:0/2233214069 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868400b940 con 0x7f86880b1850 2023-10-09T13:13:39.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.640+0000 7f868cd99700 1 -- 172.21.15.86:0/2233214069 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400bce0 con 0x7f86880b1850 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.640+0000 7f868ffff700 1 -- 172.21.15.86:0/2233214069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86880b1850 msgr2=0x7f86880b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.640+0000 7f868ffff700 1 --2- 172.21.15.86:0/2233214069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86880b1850 0x7f86880b1c20 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f86840099e0 tx=0x7f8684009250 comp rx=0 tx=0).stop 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.641+0000 7f868ffff700 1 -- 172.21.15.86:0/2233214069 shutdown_connections 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.641+0000 7f868ffff700 1 --2- 172.21.15.86:0/2233214069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86881579f0 0x7f86880abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.641+0000 7f868ffff700 1 --2- 172.21.15.86:0/2233214069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86880b1850 0x7f86880b1c20 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.641+0000 7f868ffff700 1 -- 172.21.15.86:0/2233214069 >> 172.21.15.86:0/2233214069 conn(0x7f868806a320 msgr2=0x7f86880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.641+0000 7f868ffff700 1 -- 172.21.15.86:0/2233214069 shutdown_connections 2023-10-09T13:13:39.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.641+0000 7f868ffff700 1 -- 172.21.15.86:0/2233214069 wait complete. 2023-10-09T13:13:39.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.642+0000 7f868ffff700 1 Processor -- start 2023-10-09T13:13:39.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.642+0000 7f868ffff700 1 -- start start 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86880ae680 0x7f8688150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86880b1850 0x7f86881675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86881579f0 0x7f8688158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86881581a0 con 0x7f86881579f0 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868815aa60 con 0x7f86880ae680 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868815ad40 con 0x7f86880b1850 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86881579f0 0x7f8688158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868e59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86881579f0 0x7f8688158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49622/0 (socket says 172.21.15.86:49622) 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868e59c700 1 -- 172.21.15.86:0/3872227277 learned_addr learned my addr 172.21.15.86:0/3872227277 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868dd9b700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86880ae680 0x7f8688150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:39.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.643+0000 7f868d59a700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86880b1850 0x7f86881675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868e59c700 1 -- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86880b1850 msgr2=0x7f86881675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868e59c700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86880b1850 0x7f86881675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868e59c700 1 -- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86880ae680 msgr2=0x7f8688150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868e59c700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86880ae680 0x7f8688150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868e59c700 1 -- 172.21.15.86:0/3872227277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840094f0 con 0x7f86881579f0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868e59c700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86881579f0 0x7f8688158d70 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f8680007f20 tx=0x7f8680009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f867dffb700 1 -- 172.21.15.86:0/3872227277 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000eb90 con 0x7f86881579f0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f867dffb700 1 -- 172.21.15.86:0/3872227277 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868000ed10 con 0x7f86881579f0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868815b020 con 0x7f86881579f0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f867dffb700 1 -- 172.21.15.86:0/3872227277 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680014670 con 0x7f86881579f0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.644+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868815b5e0 con 0x7f86881579f0 2023-10-09T13:13:39.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.645+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868804c3c0 con 0x7f86881579f0 2023-10-09T13:13:39.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.646+0000 7f867dffb700 1 -- 172.21.15.86:0/3872227277 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86800149e0 con 0x7f86881579f0 2023-10-09T13:13:39.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.647+0000 7f867dffb700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f866c066f30 0x7f866c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:39.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.648+0000 7f867dffb700 1 -- 172.21.15.86:0/3872227277 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f8680084d30 con 0x7f86881579f0 2023-10-09T13:13:39.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.648+0000 7f868dd9b700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f866c066f30 0x7f866c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:39.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.648+0000 7f868dd9b700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f866c066f30 0x7f866c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86840099e0 tx=0x7f8684016000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:39.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.652+0000 7f867dffb700 1 -- 172.21.15.86:0/3872227277 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8680051d20 con 0x7f86881579f0 2023-10-09T13:13:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.844+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86880cb8c0 con 0x7f86881579f0 2023-10-09T13:13:39.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.845+0000 7f867dffb700 1 -- 172.21.15.86:0/3872227277 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+16158 (secure 0 0 0) 0x7f8680055340 con 0x7f86881579f0 2023-10-09T13:13:39.846 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:39.846 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":195,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:13:38.498942+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:13:36.634243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T13:13:37.482960+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:13:39.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.847+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f866c066f30 msgr2=0x7f866c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:39.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.847+0000 7f868ffff700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f866c066f30 0x7f866c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86840099e0 tx=0x7f8684016000 comp rx=0 tx=0).stop 2023-10-09T13:13:39.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86881579f0 msgr2=0x7f8688158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:39.848 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86881579f0 0x7f8688158d70 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f8680007f20 tx=0x7f8680009860 comp rx=0 tx=0).stop 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 shutdown_connections 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f866c066f30 0x7f866c0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86881579f0 0x7f8688158d70 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86880ae680 0x7f8688150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 --2- 172.21.15.86:0/3872227277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86880b1850 0x7f86881675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 >> 172.21.15.86:0/3872227277 conn(0x7f868806a320 msgr2=0x7f8688152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 shutdown_connections 2023-10-09T13:13:39.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:39.848+0000 7f868ffff700 1 -- 172.21.15.86:0/3872227277 wait complete. 2023-10-09T13:13:39.866 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:13:40.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.047+0000 7f2ba239d700 1 Processor -- start 2023-10-09T13:13:40.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.047+0000 7f2ba239d700 1 -- start start 2023-10-09T13:13:40.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.048+0000 7f2ba239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.048+0000 7f2ba239d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2b9c0c7410 0x7f2b9c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.048+0000 7f2ba239d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9c06e2a0 con 0x7f2b9c150550 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.048+0000 7f2ba239d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9c06b2e0 con 0x7f2b9c0c7410 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.048+0000 7f2ba239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0c78e0 con 0x7f2b9c150180 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba1b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2b9c0c7410 0x7f2b9c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba0b9a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2b9c150550 0x7f2b9c0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52624/0 (socket says 172.21.15.86:52624) 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba0b9a700 1 -- 172.21.15.86:0/3064236752 learned_addr learned my addr 172.21.15.86:0/3064236752 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba139b700 1 --2- 172.21.15.86:0/3064236752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2b93fff700 1 -- 172.21.15.86:0/3064236752 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683919791 0 0) 0x7f2b9c06e2a0 con 0x7f2b9c150550 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2b93fff700 1 -- 172.21.15.86:0/3064236752 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b88003570 con 0x7f2b9c150550 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba1b9c700 1 -- 172.21.15.86:0/3064236752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 msgr2=0x7f2b9c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba1b9c700 1 --2- 172.21.15.86:0/3064236752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba1b9c700 1 -- 172.21.15.86:0/3064236752 >> v1:172.21.15.86:6789/0 conn(0x7f2b9c150550 legacy=0x7f2b9c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.051 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.049+0000 7f2ba1b9c700 1 -- 172.21.15.86:0/3064236752 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c0c7bc0 con 0x7f2b9c0c7410 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba1b9c700 1 --2- 172.21.15.86:0/3064236752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c0c7410 0x7f2b9c069f50 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009e60 tx=0x7f2b94009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e98c8ca270ec74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2b93fff700 1 -- 172.21.15.86:0/3064236752 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400e070 con 0x7f2b9c0c7410 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2b93fff700 1 -- 172.21.15.86:0/3064236752 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9400bab0 con 0x7f2b9c0c7410 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2b93fff700 1 -- 172.21.15.86:0/3064236752 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400be30 con 0x7f2b9c0c7410 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 -- 172.21.15.86:0/3064236752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c0c7410 msgr2=0x7f2b9c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3064236752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c0c7410 0x7f2b9c069f50 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009e60 tx=0x7f2b94009780 comp rx=0 tx=0).stop 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 -- 172.21.15.86:0/3064236752 shutdown_connections 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3064236752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c0c7410 0x7f2b9c069f50 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3064236752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 -- 172.21.15.86:0/3064236752 >> 172.21.15.86:0/3064236752 conn(0x7f2b9c0cc1f0 msgr2=0x7f2b9c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:40.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 -- 172.21.15.86:0/3064236752 shutdown_connections 2023-10-09T13:13:40.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.050+0000 7f2ba239d700 1 -- 172.21.15.86:0/3064236752 wait complete. 2023-10-09T13:13:40.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.052+0000 7f2ba239d700 1 Processor -- start 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.052+0000 7f2ba239d700 1 -- start start 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9c0c7410 0x7f2b9c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba239d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c150550 0x7f2b9c169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba239d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0cb6d0 con 0x7f2b9c150550 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c16a5b0 con 0x7f2b9c0c7410 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c16a890 con 0x7f2b9c150180 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c150550 0x7f2b9c169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c150550 0x7f2b9c169fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49636/0 (socket says 172.21.15.86:49636) 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 -- 172.21.15.86:0/3695323086 learned_addr learned my addr 172.21.15.86:0/3695323086 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba0b9a700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba139b700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9c0c7410 0x7f2b9c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 -- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 msgr2=0x7f2b9c169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c169a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 -- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9c0c7410 msgr2=0x7f2b9c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9c0c7410 0x7f2b9c0cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.053+0000 7f2ba1b9c700 1 -- 172.21.15.86:0/3695323086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94009a20 con 0x7f2b9c150550 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.054+0000 7f2ba1b9c700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c150550 0x7f2b9c169fc0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f2b94013000 tx=0x7f2b94019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.054+0000 7f2b917fa700 1 -- 172.21.15.86:0/3695323086 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94027470 con 0x7f2b9c150550 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.054+0000 7f2b917fa700 1 -- 172.21.15.86:0/3695323086 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94027610 con 0x7f2b9c150550 2023-10-09T13:13:40.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.054+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c16ae70 con 0x7f2b9c150550 2023-10-09T13:13:40.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.054+0000 7f2b917fa700 1 -- 172.21.15.86:0/3695323086 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b940279d0 con 0x7f2b9c150550 2023-10-09T13:13:40.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.054+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c16ab70 con 0x7f2b9c150550 2023-10-09T13:13:40.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.055+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9c16b390 con 0x7f2b9c150550 2023-10-09T13:13:40.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.056+0000 7f2b917fa700 1 -- 172.21.15.86:0/3695323086 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b94024070 con 0x7f2b9c150550 2023-10-09T13:13:40.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.057+0000 7f2b917fa700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2b80066f30 0x7f2b800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.057+0000 7f2b917fa700 1 -- 172.21.15.86:0/3695323086 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f2b940870e0 con 0x7f2b9c150550 2023-10-09T13:13:40.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.057+0000 7f2ba139b700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2b80066f30 0x7f2b800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.058+0000 7f2ba139b700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2b80066f30 0x7f2b800693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c06deb0 tx=0x7f2b98008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:40.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.061+0000 7f2b917fa700 1 -- 172.21.15.86:0/3695323086 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b9c16b390 con 0x7f2b9c150550 2023-10-09T13:13:40.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.256+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b9c16b390 con 0x7f2b9c150550 2023-10-09T13:13:40.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.257+0000 7f2b917fa700 1 -- 172.21.15.86:0/3695323086 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16145 (secure 0 0 0) 0x7f2b9c16b390 con 0x7f2b9c150550 2023-10-09T13:13:40.258 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:40.258 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":196,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:13:40.034635+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:13:36.634243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T13:13:37.482960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:13:40.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.259+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2b80066f30 msgr2=0x7f2b800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.259+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2b80066f30 0x7f2b800693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c06deb0 tx=0x7f2b98008040 comp rx=0 tx=0).stop 2023-10-09T13:13:40.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.259+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c150550 msgr2=0x7f2b9c169fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.259+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c150550 0x7f2b9c169fc0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f2b94013000 tx=0x7f2b94019000 comp rx=0 tx=0).stop 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.259+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 shutdown_connections 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.260+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2b80066f30 0x7f2b800693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.260+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b9c150550 0x7f2b9c169fc0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.260+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9c0c7410 0x7f2b9c0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.260+0000 7f2ba239d700 1 --2- 172.21.15.86:0/3695323086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9c150180 0x7f2b9c169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.260+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 >> 172.21.15.86:0/3695323086 conn(0x7f2b9c0cc1f0 msgr2=0x7f2b9c0c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.260+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 shutdown_connections 2023-10-09T13:13:40.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.260+0000 7f2ba239d700 1 -- 172.21.15.86:0/3695323086 wait complete. 2023-10-09T13:13:40.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T13:13:40.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.462+0000 7f068a9ff700 1 Processor -- start 2023-10-09T13:13:40.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.462+0000 7f068a9ff700 1 -- start start 2023-10-09T13:13:40.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f068a9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f068415de50 0x7f06840ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f068a9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f06840cb9f0 0x7f06840c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f068a9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068406ea40 con 0x7f068415e220 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f068a9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06840ca950 con 0x7f06840cb9f0 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f068a9ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06840cac30 con 0x7f068415de50 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f067bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f06840cb9f0 0x7f06840c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f0688f9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f068415e220 0x7f0684161bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52630/0 (socket says 172.21.15.86:52630) 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.464+0000 7f0688f9c700 1 -- 172.21.15.86:0/3664611198 learned_addr learned my addr 172.21.15.86:0/3664611198 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f0683fff700 1 --2- 172.21.15.86:0/3664611198 >> v2:172.21.15.135:3300/0 conn(0x7f068415de50 0x7f06840ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f06837fe700 1 -- 172.21.15.86:0/3664611198 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863485863 0 0) 0x7f067c001490 con 0x7f068415e220 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f067bfff700 1 -- 172.21.15.86:0/3664611198 >> v2:172.21.15.135:3300/0 conn(0x7f068415de50 msgr2=0x7f06840ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f067bfff700 1 --2- 172.21.15.86:0/3664611198 >> v2:172.21.15.135:3300/0 conn(0x7f068415de50 0x7f06840ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f067bfff700 1 -- 172.21.15.86:0/3664611198 >> v1:172.21.15.86:6789/0 conn(0x7f068415e220 legacy=0x7f0684161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f067bfff700 1 -- 172.21.15.86:0/3664611198 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840caf10 con 0x7f06840cb9f0 2023-10-09T13:13:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f0683fff700 1 --2- 172.21.15.86:0/3664611198 >> v2:172.21.15.135:3300/0 conn(0x7f068415de50 0x7f06840ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f067bfff700 1 --2- 172.21.15.86:0/3664611198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f06840c7270 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f068406d1d0 tx=0x7f066c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd284be10c7dc707 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f06837fe700 1 -- 172.21.15.86:0/3664611198 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c00b6b0 con 0x7f06840cb9f0 2023-10-09T13:13:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f06837fe700 1 -- 172.21.15.86:0/3664611198 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c00b810 con 0x7f06840cb9f0 2023-10-09T13:13:40.467 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.465+0000 7f06837fe700 1 -- 172.21.15.86:0/3664611198 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c00bbb0 con 0x7f06840cb9f0 2023-10-09T13:13:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 -- 172.21.15.86:0/3664611198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 msgr2=0x7f06840c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3664611198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f06840c7270 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f068406d1d0 tx=0x7f066c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 -- 172.21.15.86:0/3664611198 shutdown_connections 2023-10-09T13:13:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3664611198 >> v2:172.21.15.135:3300/0 conn(0x7f068415de50 0x7f06840ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3664611198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f06840c7270 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 -- 172.21.15.86:0/3664611198 >> 172.21.15.86:0/3664611198 conn(0x7f0684068e10 msgr2=0x7f06840cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:40.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 -- 172.21.15.86:0/3664611198 shutdown_connections 2023-10-09T13:13:40.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.466+0000 7f068a9ff700 1 -- 172.21.15.86:0/3664611198 wait complete. 2023-10-09T13:13:40.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.467+0000 7f068a9ff700 1 Processor -- start 2023-10-09T13:13:40.469 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.467+0000 7f068a9ff700 1 -- start start 2023-10-09T13:13:40.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.468+0000 7f068a9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f0684172380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.468+0000 7f068a9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f068415de50 0x7f068416edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.468+0000 7f068a9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f068415e220 0x7f0684161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.468+0000 7f068a9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840ac210 con 0x7f06840cb9f0 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.468+0000 7f068a9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068416e3d0 con 0x7f068415de50 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.468+0000 7f068a9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06841728c0 con 0x7f068415e220 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.468+0000 7f0683fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f0684172380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f0684172380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49662/0 (socket says 172.21.15.86:49662) 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 -- 172.21.15.86:0/3067172484 learned_addr learned my addr 172.21.15.86:0/3067172484 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f067bfff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f068415de50 0x7f068416edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0688f9c700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f068415e220 0x7f0684161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.471 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 -- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f068415e220 msgr2=0x7f0684161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f068415e220 0x7f0684161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 -- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f068415de50 msgr2=0x7f068416edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f068415de50 0x7f068416edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 -- 172.21.15.86:0/3067172484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c009420 con 0x7f06840cb9f0 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0683fff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f0684172380 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f067400c830 tx=0x7f0674008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.469+0000 7f0680ff9700 1 -- 172.21.15.86:0/3067172484 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674011600 con 0x7f06840cb9f0 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.470+0000 7f0680ff9700 1 -- 172.21.15.86:0/3067172484 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674011760 con 0x7f06840cb9f0 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.470+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068416e940 con 0x7f06840cb9f0 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.470+0000 7f0680ff9700 1 -- 172.21.15.86:0/3067172484 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674011b20 con 0x7f06840cb9f0 2023-10-09T13:13:40.472 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.470+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06840abf30 con 0x7f06840cb9f0 2023-10-09T13:13:40.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.471+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068416ec20 con 0x7f06840cb9f0 2023-10-09T13:13:40.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.471+0000 7f0680ff9700 1 -- 172.21.15.86:0/3067172484 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f067400a3e0 con 0x7f06840cb9f0 2023-10-09T13:13:40.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.473+0000 7f0680ff9700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0664066f30 0x7f06640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:40.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.473+0000 7f0680ff9700 1 -- 172.21.15.86:0/3067172484 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f0674084c70 con 0x7f06840cb9f0 2023-10-09T13:13:40.473 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.473+0000 7f067bfff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0664066f30 0x7f06640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:40.474 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.474+0000 7f067bfff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0664066f30 0x7f06640693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f066c0093f0 tx=0x7f066c017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:40.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.477+0000 7f0680ff9700 1 -- 172.21.15.86:0/3067172484 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0674051c60 con 0x7f06840cb9f0 2023-10-09T13:13:40.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:40.711+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f068404c3c0 con 0x7f06840cb9f0 2023-10-09T13:13:41.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.437+0000 7f0680ff9700 1 -- 172.21.15.86:0/3067172484 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7f06740150b0 con 0x7f06840cb9f0 2023-10-09T13:13:41.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0664066f30 msgr2=0x7f06640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:41.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0664066f30 0x7f06640693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f066c0093f0 tx=0x7f066c017000 comp rx=0 tx=0).stop 2023-10-09T13:13:41.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 msgr2=0x7f0684172380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:41.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f0684172380 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f067400c830 tx=0x7f0674008040 comp rx=0 tx=0).stop 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 shutdown_connections 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0664066f30 0x7f06640693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06840cb9f0 0x7f0684172380 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f068415e220 0x7f0684161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 --2- 172.21.15.86:0/3067172484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f068415de50 0x7f068416edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.439+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 >> 172.21.15.86:0/3067172484 conn(0x7f0684068e10 msgr2=0x7f068415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.440+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 shutdown_connections 2023-10-09T13:13:41.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.440+0000 7f068a9ff700 1 -- 172.21.15.86:0/3067172484 wait complete. 2023-10-09T13:13:41.458 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T13:13:41.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.642+0000 7f470e3ff700 1 Processor -- start 2023-10-09T13:13:41.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.642+0000 7f470e3ff700 1 -- start start 2023-10-09T13:13:41.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f470e3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4708155eb0 0x7f470806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:41.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f470e3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47080c70b0 0x7f4708069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f470e3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f470e3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470806a130 con 0x7f47080c70b0 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f470e3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470806eb90 con 0x7f4708155eb0 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f470e3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470806ee70 con 0x7f4708069cb0 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f46fffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47080c70b0 0x7f4708069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f46fffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47080c70b0 0x7f4708069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49674/0 (socket says 172.21.15.86:49674) 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f46fffff700 1 -- 172.21.15.86:0/2099217345 learned_addr learned my addr 172.21.15.86:0/2099217345 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f4707fff700 1 --2- 172.21.15.86:0/2099217345 >> v2:172.21.15.135:3300/0 conn(0x7f4708155eb0 0x7f470806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.644+0000 7f470c99c700 1 --2- 172.21.15.86:0/2099217345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f46fffff700 1 -- 172.21.15.86:0/2099217345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 msgr2=0x7f47080ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:41.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f46fffff700 1 --2- 172.21.15.86:0/2099217345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f46fffff700 1 -- 172.21.15.86:0/2099217345 >> v2:172.21.15.135:3300/0 conn(0x7f4708155eb0 msgr2=0x7f470806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f46fffff700 1 --2- 172.21.15.86:0/2099217345 >> v2:172.21.15.135:3300/0 conn(0x7f4708155eb0 0x7f470806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f46fffff700 1 -- 172.21.15.86:0/2099217345 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470806f150 con 0x7f47080c70b0 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f4707fff700 1 --2- 172.21.15.86:0/2099217345 >> v2:172.21.15.135:3300/0 conn(0x7f4708155eb0 0x7f470806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f46fffff700 1 --2- 172.21.15.86:0/2099217345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080c70b0 0x7f4708069770 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4708065160 tx=0x7f46f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aedde1ee16d656b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f47077fe700 1 -- 172.21.15.86:0/2099217345 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000b860 con 0x7f47080c70b0 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f47077fe700 1 -- 172.21.15.86:0/2099217345 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000b9c0 con 0x7f47080c70b0 2023-10-09T13:13:41.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.645+0000 7f47077fe700 1 -- 172.21.15.86:0/2099217345 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000bd60 con 0x7f47080c70b0 2023-10-09T13:13:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 -- 172.21.15.86:0/2099217345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080c70b0 msgr2=0x7f4708069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 --2- 172.21.15.86:0/2099217345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080c70b0 0x7f4708069770 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4708065160 tx=0x7f46f0009250 comp rx=0 tx=0).stop 2023-10-09T13:13:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 -- 172.21.15.86:0/2099217345 shutdown_connections 2023-10-09T13:13:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 --2- 172.21.15.86:0/2099217345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 --2- 172.21.15.86:0/2099217345 >> v2:172.21.15.135:3300/0 conn(0x7f4708155eb0 0x7f470806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 --2- 172.21.15.86:0/2099217345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080c70b0 0x7f4708069770 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 -- 172.21.15.86:0/2099217345 >> 172.21.15.86:0/2099217345 conn(0x7f4708068e10 msgr2=0x7f47080cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 -- 172.21.15.86:0/2099217345 shutdown_connections 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.646+0000 7f470e3ff700 1 -- 172.21.15.86:0/2099217345 wait complete. 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.647+0000 7f470e3ff700 1 Processor -- start 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.647+0000 7f470e3ff700 1 -- start start 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.648+0000 7f470e3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.648+0000 7f470e3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47080c70b0 0x7f4708147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.648+0000 7f470e3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4708155eb0 0x7f47080c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.648+0000 7f470e3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b1840 con 0x7f4708155eb0 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.648+0000 7f470e3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4708147540 con 0x7f47080c70b0 2023-10-09T13:13:41.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.648+0000 7f470e3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b0e30 con 0x7f4708069cb0 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4708155eb0 0x7f47080c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4708155eb0 0x7f47080c2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49690/0 (socket says 172.21.15.86:49690) 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 -- 172.21.15.86:0/3753055637 learned_addr learned my addr 172.21.15.86:0/3753055637 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f46fffff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47080c70b0 0x7f4708147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f4707fff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 -- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 msgr2=0x7f47080b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 -- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47080c70b0 msgr2=0x7f4708147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47080c70b0 0x7f4708147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 -- 172.21.15.86:0/3753055637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00094f0 con 0x7f4708155eb0 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f4707fff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:41.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470c99c700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4708155eb0 0x7f47080c2740 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4700009fd0 tx=0x7f4700009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:41.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f4704ff9700 1 -- 172.21.15.86:0/3753055637 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000eca0 con 0x7f4708155eb0 2023-10-09T13:13:41.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f4704ff9700 1 -- 172.21.15.86:0/3753055637 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470000ee00 con 0x7f4708155eb0 2023-10-09T13:13:41.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f4704ff9700 1 -- 172.21.15.86:0/3753055637 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700014670 con 0x7f4708155eb0 2023-10-09T13:13:41.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.649+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47080af7d0 con 0x7f4708155eb0 2023-10-09T13:13:41.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.650+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47080afd90 con 0x7f4708155eb0 2023-10-09T13:13:41.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.650+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470804c3c0 con 0x7f4708155eb0 2023-10-09T13:13:41.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.651+0000 7f4704ff9700 1 -- 172.21.15.86:0/3753055637 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47000149e0 con 0x7f4708155eb0 2023-10-09T13:13:41.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.652+0000 7f4704ff9700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f46e8066f30 0x7f46e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:41.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.652+0000 7f4704ff9700 1 -- 172.21.15.86:0/3753055637 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f4700084f30 con 0x7f4708155eb0 2023-10-09T13:13:41.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.652+0000 7f4707fff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f46e8066f30 0x7f46e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:41.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.653+0000 7f4707fff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f46e8066f30 0x7f46e80693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46f8006f00 tx=0x7f46f8008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:41.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.656+0000 7f4704ff9700 1 -- 172.21.15.86:0/3753055637 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4700051f20 con 0x7f4708155eb0 2023-10-09T13:13:41.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:41.887+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f470806f430 con 0x7f4708155eb0 2023-10-09T13:13:42.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.439+0000 7f4704ff9700 1 -- 172.21.15.86:0/3753055637 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4700055540 con 0x7f4708155eb0 2023-10-09T13:13:42.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.441+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f46e8066f30 msgr2=0x7f46e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.441+0000 7f470e3ff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f46e8066f30 0x7f46e80693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46f8006f00 tx=0x7f46f8008040 comp rx=0 tx=0).stop 2023-10-09T13:13:42.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.441+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4708155eb0 msgr2=0x7f47080c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.441+0000 7f470e3ff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4708155eb0 0x7f47080c2740 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4700009fd0 tx=0x7f4700009900 comp rx=0 tx=0).stop 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.441+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 shutdown_connections 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.442+0000 7f470e3ff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f46e8066f30 0x7f46e80693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.442+0000 7f470e3ff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4708155eb0 0x7f47080c2740 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.442+0000 7f470e3ff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4708069cb0 0x7f47080b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.442+0000 7f470e3ff700 1 --2- 172.21.15.86:0/3753055637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47080c70b0 0x7f4708147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.442+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 >> 172.21.15.86:0/3753055637 conn(0x7f4708068e10 msgr2=0x7f47080aa470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.442+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 shutdown_connections 2023-10-09T13:13:42.443 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.442+0000 7f470e3ff700 1 -- 172.21.15.86:0/3753055637 wait complete. 2023-10-09T13:13:42.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:13:42.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.643+0000 7f84c59ff700 1 Processor -- start 2023-10-09T13:13:42.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.643+0000 7f84c59ff700 1 -- start start 2023-10-09T13:13:42.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.644+0000 7f84c59ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84c00b1850 0x7f84c00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84c59ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c00cb300 con 0x7f84c00ae680 2023-10-09T13:13:42.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84c59ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c00cb5e0 con 0x7f84c01579f0 2023-10-09T13:13:42.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84c59ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c006fc30 con 0x7f84c00b1850 2023-10-09T13:13:42.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84b7fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f84c00ae680 0x7f84c01572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52632/0 (socket says 172.21.15.86:52632) 2023-10-09T13:13:42.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84b7fff700 1 -- 172.21.15.86:0/821042050 learned_addr learned my addr 172.21.15.86:0/821042050 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:42.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84beffd700 1 --2- 172.21.15.86:0/821042050 >> v2:172.21.15.135:3300/0 conn(0x7f84c00b1850 0x7f84c00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641668135 0 0) 0x7f84c00cb300 con 0x7f84c00ae680 2023-10-09T13:13:42.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ac003570 con 0x7f84c00ae680 2023-10-09T13:13:42.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156884409 0 0) 0x7f84c00cb5e0 con 0x7f84c01579f0 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.645+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c00cb300 con 0x7f84c01579f0 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3935481384 0 0) 0x7f84ac003570 con 0x7f84c00ae680 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 >> v2:172.21.15.135:3300/0 conn(0x7f84c00b1850 msgr2=0x7f84c00b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 --2- 172.21.15.86:0/821042050 >> v2:172.21.15.135:3300/0 conn(0x7f84c00b1850 0x7f84c00b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 >> v1:172.21.15.135:6789/0 conn(0x7f84c01579f0 legacy=0x7f84c00abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00cb8c0 con 0x7f84c00ae680 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f84a8001470 con 0x7f84c00ae680 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 >> v1:172.21.15.86:6789/0 conn(0x7f84c00ae680 legacy=0x7f84c01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84ac003c40 0x7f84ac004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84ac004810 0x7f84ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c006fc30 con 0x7f84ac005210 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac00c130 con 0x7f84ac003c40 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac00c2c0 con 0x7f84ac004810 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84bf7fe700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84b7fff700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84ac004810 0x7f84ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84beffd700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84ac003c40 0x7f84ac004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84bf7fe700 1 -- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84ac004810 msgr2=0x7f84ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84bf7fe700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84ac004810 0x7f84ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84bf7fe700 1 -- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84ac003c40 msgr2=0x7f84ac004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84bf7fe700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84ac003c40 0x7f84ac004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.646+0000 7f84bf7fe700 1 -- 172.21.15.86:0/821042050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac003570 con 0x7f84ac005210 2023-10-09T13:13:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84bf7fe700 1 -- 172.21.15.86:0/821042050 reap_dead start 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84bf7fe700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84ac00ba60 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f84b8002190 tx=0x7f84b80017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19a73fa00024eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8001af0 con 0x7f84ac005210 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b800c940 con 0x7f84ac005210 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84be7fc700 1 -- 172.21.15.86:0/821042050 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800ccc0 con 0x7f84ac005210 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84c59ff700 1 -- 172.21.15.86:0/821042050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 msgr2=0x7f84ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84c59ff700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84ac00ba60 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f84b8002190 tx=0x7f84b80017e0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84c59ff700 1 -- 172.21.15.86:0/821042050 shutdown_connections 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84c59ff700 1 --2- 172.21.15.86:0/821042050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84ac00ba60 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.647+0000 7f84c59ff700 1 -- 172.21.15.86:0/821042050 >> 172.21.15.86:0/821042050 conn(0x7f84c006a320 msgr2=0x7f84c00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.648+0000 7f84c59ff700 1 -- 172.21.15.86:0/821042050 shutdown_connections 2023-10-09T13:13:42.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.648+0000 7f84c59ff700 1 -- 172.21.15.86:0/821042050 wait complete. 2023-10-09T13:13:42.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.649+0000 7f84c59ff700 1 Processor -- start 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.649+0000 7f84c59ff700 1 -- start start 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84c59ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84c01504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84c59ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c0150c00 0x7f84c016c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84c59ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84c016cc20 0x7f84c016d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84c59ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c00cc260 con 0x7f84ac005210 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84c59ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c0155f50 con 0x7f84c0150c00 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84c59ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c0155740 con 0x7f84c016cc20 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84beffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84c01504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84beffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84c01504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49706/0 (socket says 172.21.15.86:49706) 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84beffd700 1 -- 172.21.15.86:0/985919654 learned_addr learned my addr 172.21.15.86:0/985919654 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:42.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84bf7fe700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84c016cc20 0x7f84c016d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.650+0000 7f84b7fff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c0150c00 0x7f84c016c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84beffd700 1 -- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84c016cc20 msgr2=0x7f84c016d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84beffd700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84c016cc20 0x7f84c016d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84beffd700 1 -- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c0150c00 msgr2=0x7f84c016c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84beffd700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c0150c00 0x7f84c016c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84beffd700 1 -- 172.21.15.86:0/985919654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c016c250 con 0x7f84ac005210 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84beffd700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84c01504c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f84b0011b10 tx=0x7f84b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84b6ffd700 1 -- 172.21.15.86:0/985919654 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000f940 con 0x7f84ac005210 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84b6ffd700 1 -- 172.21.15.86:0/985919654 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000faa0 con 0x7f84ac005210 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84b6ffd700 1 -- 172.21.15.86:0/985919654 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000fe20 con 0x7f84ac005210 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c0150a00 con 0x7f84ac005210 2023-10-09T13:13:42.655 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.651+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c0155c70 con 0x7f84ac005210 2023-10-09T13:13:42.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.652+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c016c530 con 0x7f84ac005210 2023-10-09T13:13:42.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.653+0000 7f84b6ffd700 1 -- 172.21.15.86:0/985919654 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84b0014650 con 0x7f84ac005210 2023-10-09T13:13:42.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.654+0000 7f84b6ffd700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:42.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.654+0000 7f84b6ffd700 1 -- 172.21.15.86:0/985919654 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f84b0018030 con 0x7f84ac005210 2023-10-09T13:13:42.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.654+0000 7f84b7fff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:42.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.655+0000 7f84b7fff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f84a0066f30 0x7f84a00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84a8001120 tx=0x7f84a8001d20 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:42.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.658+0000 7f84b6ffd700 1 -- 172.21.15.86:0/985919654 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84b0052080 con 0x7f84ac005210 2023-10-09T13:13:42.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.893+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84c004c3c0 con 0x7f84ac005210 2023-10-09T13:13:42.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.893+0000 7f84b6ffd700 1 -- 172.21.15.86:0/985919654 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f84b0022090 con 0x7f84ac005210 2023-10-09T13:13:42.893 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:42.894 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/768026503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":768026503},{"type":"v1","addr":"172.21.15.86:6834","nonce":768026503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3188349803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3188349803},{"type":"v1","addr":"172.21.15.135:6835","nonce":3188349803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9666,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2491463129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2491463129},{"type":"v1","addr":"172.21.15.86:6835","nonce":2491463129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:13:38.499330+0000","modified":"2023-10-09T13:13:42.436468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9672},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9672":{"gid":9672,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3006026738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3006026738},{"type":"v1","addr":"172.21.15.135:6834","nonce":3006026738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T13:13:42.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f84a0066f30 msgr2=0x7f84a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f84a0066f30 0x7f84a00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84a8001120 tx=0x7f84a8001d20 comp rx=0 tx=0).stop 2023-10-09T13:13:42.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 msgr2=0x7f84c01504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:42.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84c01504c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f84b0011b10 tx=0x7f84b00091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 shutdown_connections 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac005210 0x7f84c01504c0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84c016cc20 0x7f84c016d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 --2- 172.21.15.86:0/985919654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c0150c00 0x7f84c016c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.895+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 >> 172.21.15.86:0/985919654 conn(0x7f84c006a320 msgr2=0x7f84c00b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.896+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 shutdown_connections 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:42.896+0000 7f84c59ff700 1 -- 172.21.15.86:0/985919654 wait complete. 2023-10-09T13:13:42.897 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 86 2023-10-09T13:13:42.913 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:13:43.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.092+0000 7f09065ff700 1 Processor -- start 2023-10-09T13:13:43.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.092+0000 7f09065ff700 1 -- start start 2023-10-09T13:13:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.093+0000 7f09065ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0900155c10 0x7f0900155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.093+0000 7f09065ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09000ac230 0x7f09000ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.093+0000 7f09065ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09001568a0 0x7f0900156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.093+0000 7f09065ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000ad930 con 0x7f09000ac230 2023-10-09T13:13:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.093+0000 7f09065ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000acd20 con 0x7f0900155c10 2023-10-09T13:13:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.093+0000 7f09065ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000ad000 con 0x7f09001568a0 2023-10-09T13:13:43.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09000ac230 0x7f09000ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09000ac230 0x7f09000ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49720/0 (socket says 172.21.15.86:49720) 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 -- 172.21.15.86:0/133775727 learned_addr learned my addr 172.21.15.86:0/133775727 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f0904b9c700 1 --2- 172.21.15.86:0/133775727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09001568a0 0x7f0900156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08fffff700 1 --2- 172.21.15.86:0/133775727 >> v2:172.21.15.135:3300/0 conn(0x7f0900155c10 0x7f0900155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 -- 172.21.15.86:0/133775727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09001568a0 msgr2=0x7f0900156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 --2- 172.21.15.86:0/133775727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09001568a0 0x7f0900156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 -- 172.21.15.86:0/133775727 >> v2:172.21.15.135:3300/0 conn(0x7f0900155c10 msgr2=0x7f0900155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 --2- 172.21.15.86:0/133775727 >> v2:172.21.15.135:3300/0 conn(0x7f0900155c10 0x7f0900155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 -- 172.21.15.86:0/133775727 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000ad2e0 con 0x7f09000ac230 2023-10-09T13:13:43.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08ff7fe700 1 --2- 172.21.15.86:0/133775727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f09000ac6d0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f0900063d40 tx=0x7f08f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb99a176d80c659d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.094+0000 7f08feffd700 1 -- 172.21.15.86:0/133775727 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400b860 con 0x7f09000ac230 2023-10-09T13:13:43.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f08feffd700 1 -- 172.21.15.86:0/133775727 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400b9c0 con 0x7f09000ac230 2023-10-09T13:13:43.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f08feffd700 1 -- 172.21.15.86:0/133775727 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400bd60 con 0x7f09000ac230 2023-10-09T13:13:43.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 -- 172.21.15.86:0/133775727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 msgr2=0x7f09000ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 --2- 172.21.15.86:0/133775727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f09000ac6d0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f0900063d40 tx=0x7f08f4009250 comp rx=0 tx=0).stop 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 -- 172.21.15.86:0/133775727 shutdown_connections 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 --2- 172.21.15.86:0/133775727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09001568a0 0x7f0900156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 --2- 172.21.15.86:0/133775727 >> v2:172.21.15.135:3300/0 conn(0x7f0900155c10 0x7f0900155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 --2- 172.21.15.86:0/133775727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f09000ac6d0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 -- 172.21.15.86:0/133775727 >> 172.21.15.86:0/133775727 conn(0x7f090006a320 msgr2=0x7f09000cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 -- 172.21.15.86:0/133775727 shutdown_connections 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.095+0000 7f09065ff700 1 -- 172.21.15.86:0/133775727 wait complete. 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.097+0000 7f09065ff700 1 Processor -- start 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.097+0000 7f09065ff700 1 -- start start 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f09065ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f0900169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f09065ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0900155c10 0x7f0900158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f09065ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09001568a0 0x7f09001527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f09065ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090006f900 con 0x7f09000ac230 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f09065ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090016a210 con 0x7f09001568a0 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f09065ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090006dac0 con 0x7f0900155c10 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f0900169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f0900169cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49724/0 (socket says 172.21.15.86:49724) 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 -- 172.21.15.86:0/1553135984 learned_addr learned my addr 172.21.15.86:0/1553135984 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08ff7fe700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0900155c10 0x7f0900158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f0904b9c700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09001568a0 0x7f09001527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 -- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0900155c10 msgr2=0x7f0900158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0900155c10 0x7f0900158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 -- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09001568a0 msgr2=0x7f09001527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09001568a0 0x7f09001527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.098+0000 7f08fffff700 1 -- 172.21.15.86:0/1553135984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40094f0 con 0x7f09000ac230 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.099+0000 7f08fffff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f0900169cd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f08f000d890 tx=0x7f08f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.099+0000 7f08e7fff700 1 -- 172.21.15.86:0/1553135984 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00125f0 con 0x7f09000ac230 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.099+0000 7f08e7fff700 1 -- 172.21.15.86:0/1553135984 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0012750 con 0x7f09000ac230 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.099+0000 7f08e7fff700 1 -- 172.21.15.86:0/1553135984 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0012af0 con 0x7f09000ac230 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.099+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0900159c70 con 0x7f09000ac230 2023-10-09T13:13:43.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.099+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0900159990 con 0x7f09000ac230 2023-10-09T13:13:43.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.100+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090004c3c0 con 0x7f09000ac230 2023-10-09T13:13:43.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.101+0000 7f08e7fff700 1 -- 172.21.15.86:0/1553135984 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08f001e460 con 0x7f09000ac230 2023-10-09T13:13:43.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.102+0000 7f08e7fff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.102+0000 7f08e7fff700 1 -- 172.21.15.86:0/1553135984 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f08f0084d20 con 0x7f09000ac230 2023-10-09T13:13:43.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.102+0000 7f08ff7fe700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.103+0000 7f08ff7fe700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0900063d40 tx=0x7f08f4017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.106+0000 7f08e7fff700 1 -- 172.21.15.86:0/1553135984 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08f0051d10 con 0x7f09000ac230 2023-10-09T13:13:43.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.299+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09000ad5c0 con 0x7f09000ac230 2023-10-09T13:13:43.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.300+0000 7f08e7fff700 1 -- 172.21.15.86:0/1553135984 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16145 (secure 0 0 0) 0x7f08f0055330 con 0x7f09000ac230 2023-10-09T13:13:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:43.301 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":196,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:13:40.034635+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:13:36.634243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T13:13:37.482960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:13:43.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08ec066f30 msgr2=0x7f08ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0900063d40 tx=0x7f08f4017000 comp rx=0 tx=0).stop 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 msgr2=0x7f0900169cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f0900169cd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f08f000d890 tx=0x7f08f0008040 comp rx=0 tx=0).stop 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 shutdown_connections 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09000ac230 0x7f0900169cd0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09001568a0 0x7f09001527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 --2- 172.21.15.86:0/1553135984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0900155c10 0x7f0900158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 >> 172.21.15.86:0/1553135984 conn(0x7f090006a320 msgr2=0x7f09000c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:43.304 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 shutdown_connections 2023-10-09T13:13:43.305 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.302+0000 7f09065ff700 1 -- 172.21.15.86:0/1553135984 wait complete. 2023-10-09T13:13:43.321 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T13:13:43.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:13:43.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.504+0000 7f0c529ff700 1 Processor -- start 2023-10-09T13:13:43.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.504+0000 7f0c529ff700 1 -- start start 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.505+0000 7f0c529ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0c4c1578b0 0x7f0c4c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.505+0000 7f0c529ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 0x7f0c4c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.505+0000 7f0c529ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0ad930 con 0x7f0c4c155c10 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.505+0000 7f0c529ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b0c80 con 0x7f0c4c1578b0 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.505+0000 7f0c529ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0acd20 con 0x7f0c4c0af2f0 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0c4c155c10 0x7f0c4c0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52648/0 (socket says 172.21.15.86:52648) 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4bfff700 1 -- 172.21.15.86:0/2667642841 learned_addr learned my addr 172.21.15.86:0/2667642841 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074034793 0 0) 0x7f0c4c0ad930 con 0x7f0c4c155c10 2023-10-09T13:13:43.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c34003570 con 0x7f0c4c155c10 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4b7fe700 1 --2- 172.21.15.86:0/2667642841 >> v2:172.21.15.135:3300/0 conn(0x7f0c4c1578b0 0x7f0c4c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 0x7f0c4c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1269016761 0 0) 0x7f0c34003570 con 0x7f0c4c155c10 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 msgr2=0x7f0c4c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 0x7f0c4c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 >> v2:172.21.15.135:3300/0 conn(0x7f0c4c1578b0 msgr2=0x7f0c4c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 --2- 172.21.15.86:0/2667642841 >> v2:172.21.15.135:3300/0 conn(0x7f0c4c1578b0 0x7f0c4c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0ad000 con 0x7f0c4c155c10 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f0c3c001470 con 0x7f0c4c155c10 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.506+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 0x7f0c4c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:43.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 >> v1:172.21.15.86:6789/0 conn(0x7f0c4c155c10 legacy=0x7f0c4c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4affd700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 0x7f0c34003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4affd700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c34004120 0x7f0c34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4affd700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c34004d50 0x7f0c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b0c80 con 0x7f0c34004d50 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0acd20 con 0x7f0c34004120 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3400de80 con 0x7f0c4c0af2f0 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4bfff700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 0x7f0c34003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c34004d50 0x7f0c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c4b7fe700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c34004120 0x7f0c34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c50f9c700 1 -- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 msgr2=0x7f0c34003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c0af2f0 0x7f0c34003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c50f9c700 1 -- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c34004120 msgr2=0x7f0c34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:43.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c34004120 0x7f0c34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.507+0000 7f0c50f9c700 1 -- 172.21.15.86:0/2667642841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34003570 con 0x7f0c34004d50 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c34004d50 0x7f0c340051c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0c44007580 tx=0x7f0c440097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce837954791ab43f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44009ae0 con 0x7f0c34004d50 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44007dd0 con 0x7f0c34004d50 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c4affd700 1 -- 172.21.15.86:0/2667642841 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44014630 con 0x7f0c34004d50 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c529ff700 1 -- 172.21.15.86:0/2667642841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c34004d50 msgr2=0x7f0c340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c529ff700 1 --2- 172.21.15.86:0/2667642841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c34004d50 0x7f0c340051c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0c44007580 tx=0x7f0c440097d0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c50f9c700 1 -- 172.21.15.86:0/2667642841 reap_dead start 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c529ff700 1 -- 172.21.15.86:0/2667642841 shutdown_connections 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.508+0000 7f0c529ff700 1 -- 172.21.15.86:0/2667642841 >> 172.21.15.86:0/2667642841 conn(0x7f0c4c06a320 msgr2=0x7f0c4c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.509+0000 7f0c529ff700 1 -- 172.21.15.86:0/2667642841 shutdown_connections 2023-10-09T13:13:43.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.509+0000 7f0c529ff700 1 -- 172.21.15.86:0/2667642841 wait complete. 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.510+0000 7f0c529ff700 1 Processor -- start 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.510+0000 7f0c529ff700 1 -- start start 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c529ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c4c0af940 0x7f0c4c14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c529ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c14ee40 0x7f0c4c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c529ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c4c165580 0x7f0c4c14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c529ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14aaa0 con 0x7f0c4c0af940 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c529ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14c890 con 0x7f0c4c165580 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c529ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14f370 con 0x7f0c4c14ee40 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c4bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c4c0af940 0x7f0c4c14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c4bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c4c0af940 0x7f0c4c14e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49732/0 (socket says 172.21.15.86:49732) 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.511+0000 7f0c4bfff700 1 -- 172.21.15.86:0/184343314 learned_addr learned my addr 172.21.15.86:0/184343314 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4b7fe700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c14ee40 0x7f0c4c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c4c165580 0x7f0c4c14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4bfff700 1 -- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c14ee40 msgr2=0x7f0c4c14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4bfff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c14ee40 0x7f0c4c14a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4bfff700 1 -- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c4c165580 msgr2=0x7f0c4c14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4bfff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c4c165580 0x7f0c4c14a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4bfff700 1 -- 172.21.15.86:0/184343314 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c14f650 con 0x7f0c4c0af940 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c50f9c700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c4c165580 0x7f0c4c14a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4b7fe700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c14ee40 0x7f0c4c14a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c4bfff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c4c0af940 0x7f0c4c14e480 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0073c0 tx=0x7f0c3c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c33fff700 1 -- 172.21.15.86:0/184343314 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c018030 con 0x7f0c4c0af940 2023-10-09T13:13:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c33fff700 1 -- 172.21.15.86:0/184343314 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00f8d0 con 0x7f0c4c0af940 2023-10-09T13:13:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c14c520 con 0x7f0c4c0af940 2023-10-09T13:13:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c33fff700 1 -- 172.21.15.86:0/184343314 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00fc90 con 0x7f0c4c0af940 2023-10-09T13:13:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.512+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c0afd10 con 0x7f0c4c0af940 2023-10-09T13:13:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.513+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c14c380 con 0x7f0c4c0af940 2023-10-09T13:13:43.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.514+0000 7f0c33fff700 1 -- 172.21.15.86:0/184343314 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c3c01b070 con 0x7f0c4c0af940 2023-10-09T13:13:43.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.515+0000 7f0c33fff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0c38066f60 0x7f0c38069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.515+0000 7f0c33fff700 1 -- 172.21.15.86:0/184343314 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f0c3c019070 con 0x7f0c4c0af940 2023-10-09T13:13:43.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.516+0000 7f0c4b7fe700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0c38066f60 0x7f0c38069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.516+0000 7f0c4b7fe700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0c38066f60 0x7f0c38069410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0ac7f0 tx=0x7f0c40008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.520+0000 7f0c33fff700 1 -- 172.21.15.86:0/184343314 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c4c14c380 con 0x7f0c4c0af940 2023-10-09T13:13:43.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.709+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c4c14c9d0 con 0x7f0c38066f60 2023-10-09T13:13:43.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.719+0000 7f0c33fff700 1 -- 172.21.15.86:0/184343314 <== mgr.9462 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282721 (secure 0 0 0) 0x7f0c4000adb0 con 0x7f0c38066f60 2023-10-09T13:13:43.723 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:43.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0c38066f60 msgr2=0x7f0c38069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0c38066f60 0x7f0c38069410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0ac7f0 tx=0x7f0c40008040 comp rx=0 tx=0).stop 2023-10-09T13:13:43.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c4c0af940 msgr2=0x7f0c4c14e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c4c0af940 0x7f0c4c14e480 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0073c0 tx=0x7f0c3c001dc0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 shutdown_connections 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0c38066f60 0x7f0c38069410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c4c0af940 0x7f0c4c14e480 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c4c165580 0x7f0c4c14a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 --2- 172.21.15.86:0/184343314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c4c14ee40 0x7f0c4c14a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 >> 172.21.15.86:0/184343314 conn(0x7f0c4c06a320 msgr2=0x7f0c4c06db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 shutdown_connections 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.723+0000 7f0c529ff700 1 -- 172.21.15.86:0/184343314 wait complete. 2023-10-09T13:13:43.727 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:13:43.742 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T13:13:42.937624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590492,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":553,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476144,"kb_used_data":20016,"kb_used_omap":0,"kb_used_meta":2456064,"kb_avail":752498576,"statfs":{"total":773094113280,"available":770558541824,"internally_reserved":0,"allocated":20496384,"data_stored":10861437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2515009536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.918075"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059582+0000","last_change":"2023-10-09T13:13:39.052976+0000","last_active":"2023-10-09T13:13:39.059582+0000","last_peered":"2023-10-09T13:13:39.059582+0000","last_clean":"2023-10-09T13:13:39.059582+0000","last_became_active":"2023-10-09T13:13:39.052731+0000","last_became_peered":"2023-10-09T13:13:39.052731+0000","last_unstale":"2023-10-09T13:13:39.059582+0000","last_undegraded":"2023-10-09T13:13:39.059582+0000","last_fullsized":"2023-10-09T13:13:39.059582+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:57.794933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059269+0000","last_change":"2023-10-09T13:13:39.054489+0000","last_active":"2023-10-09T13:13:39.059269+0000","last_peered":"2023-10-09T13:13:39.059269+0000","last_clean":"2023-10-09T13:13:39.059269+0000","last_became_active":"2023-10-09T13:13:39.054222+0000","last_became_peered":"2023-10-09T13:13:39.054222+0000","last_unstale":"2023-10-09T13:13:39.059269+0000","last_undegraded":"2023-10-09T13:13:39.059269+0000","last_fullsized":"2023-10-09T13:13:39.059269+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:33.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063435+0000","last_change":"2023-10-09T13:13:39.060449+0000","last_active":"2023-10-09T13:13:39.063435+0000","last_peered":"2023-10-09T13:13:39.063435+0000","last_clean":"2023-10-09T13:13:39.063435+0000","last_became_active":"2023-10-09T13:13:39.059646+0000","last_became_peered":"2023-10-09T13:13:39.059646+0000","last_unstale":"2023-10-09T13:13:39.063435+0000","last_undegraded":"2023-10-09T13:13:39.063435+0000","last_fullsized":"2023-10-09T13:13:39.063435+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:46.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.054529+0000","last_change":"2023-10-09T13:13:39.051097+0000","last_active":"2023-10-09T13:13:39.054529+0000","last_peered":"2023-10-09T13:13:39.054529+0000","last_clean":"2023-10-09T13:13:39.054529+0000","last_became_active":"2023-10-09T13:13:39.050849+0000","last_became_peered":"2023-10-09T13:13:39.050849+0000","last_unstale":"2023-10-09T13:13:39.054529+0000","last_undegraded":"2023-10-09T13:13:39.054529+0000","last_fullsized":"2023-10-09T13:13:39.054529+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:57.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047721+0000","last_change":"2023-10-09T13:13:39.045335+0000","last_active":"2023-10-09T13:13:39.047721+0000","last_peered":"2023-10-09T13:13:39.047721+0000","last_clean":"2023-10-09T13:13:39.047721+0000","last_became_active":"2023-10-09T13:13:39.045012+0000","last_became_peered":"2023-10-09T13:13:39.045012+0000","last_unstale":"2023-10-09T13:13:39.047721+0000","last_undegraded":"2023-10-09T13:13:39.047721+0000","last_fullsized":"2023-10-09T13:13:39.047721+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:53.421996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.050776+0000","last_change":"2023-10-09T13:13:39.047770+0000","last_active":"2023-10-09T13:13:39.050776+0000","last_peered":"2023-10-09T13:13:39.050776+0000","last_clean":"2023-10-09T13:13:39.050776+0000","last_became_active":"2023-10-09T13:13:39.047485+0000","last_became_peered":"2023-10-09T13:13:39.047485+0000","last_unstale":"2023-10-09T13:13:39.050776+0000","last_undegraded":"2023-10-09T13:13:39.050776+0000","last_fullsized":"2023-10-09T13:13:39.050776+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:32.687561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046746+0000","last_change":"2023-10-09T13:13:39.044650+0000","last_active":"2023-10-09T13:13:39.046746+0000","last_peered":"2023-10-09T13:13:39.046746+0000","last_clean":"2023-10-09T13:13:39.046746+0000","last_became_active":"2023-10-09T13:13:39.044230+0000","last_became_peered":"2023-10-09T13:13:39.044230+0000","last_unstale":"2023-10-09T13:13:39.046746+0000","last_undegraded":"2023-10-09T13:13:39.046746+0000","last_fullsized":"2023-10-09T13:13:39.046746+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:13.117007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063289+0000","last_change":"2023-10-09T13:13:39.060979+0000","last_active":"2023-10-09T13:13:39.063289+0000","last_peered":"2023-10-09T13:13:39.063289+0000","last_clean":"2023-10-09T13:13:39.063289+0000","last_became_active":"2023-10-09T13:13:39.060695+0000","last_became_peered":"2023-10-09T13:13:39.060695+0000","last_unstale":"2023-10-09T13:13:39.063289+0000","last_undegraded":"2023-10-09T13:13:39.063289+0000","last_fullsized":"2023-10-09T13:13:39.063289+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:03.435693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060171+0000","last_change":"2023-10-09T13:13:39.056226+0000","last_active":"2023-10-09T13:13:39.060171+0000","last_peered":"2023-10-09T13:13:39.060171+0000","last_clean":"2023-10-09T13:13:39.060171+0000","last_became_active":"2023-10-09T13:13:39.055652+0000","last_became_peered":"2023-10-09T13:13:39.055652+0000","last_unstale":"2023-10-09T13:13:39.060171+0000","last_undegraded":"2023-10-09T13:13:39.060171+0000","last_fullsized":"2023-10-09T13:13:39.060171+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:43.352357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063042+0000","last_change":"2023-10-09T13:13:39.059455+0000","last_active":"2023-10-09T13:13:39.063042+0000","last_peered":"2023-10-09T13:13:39.063042+0000","last_clean":"2023-10-09T13:13:39.063042+0000","last_became_active":"2023-10-09T13:13:39.058865+0000","last_became_peered":"2023-10-09T13:13:39.058865+0000","last_unstale":"2023-10-09T13:13:39.063042+0000","last_undegraded":"2023-10-09T13:13:39.063042+0000","last_fullsized":"2023-10-09T13:13:39.063042+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:23.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058088+0000","last_change":"2023-10-09T13:13:39.054890+0000","last_active":"2023-10-09T13:13:39.058088+0000","last_peered":"2023-10-09T13:13:39.058088+0000","last_clean":"2023-10-09T13:13:39.058088+0000","last_became_active":"2023-10-09T13:13:39.054491+0000","last_became_peered":"2023-10-09T13:13:39.054491+0000","last_unstale":"2023-10-09T13:13:39.058088+0000","last_undegraded":"2023-10-09T13:13:39.058088+0000","last_fullsized":"2023-10-09T13:13:39.058088+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:31.565289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025352+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:45:12.639364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020976+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:31.909920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.057051+0000","last_change":"2023-10-09T13:13:39.052087+0000","last_active":"2023-10-09T13:13:39.057051+0000","last_peered":"2023-10-09T13:13:39.057051+0000","last_clean":"2023-10-09T13:13:39.057051+0000","last_became_active":"2023-10-09T13:13:39.051831+0000","last_became_peered":"2023-10-09T13:13:39.051831+0000","last_unstale":"2023-10-09T13:13:39.057051+0000","last_undegraded":"2023-10-09T13:13:39.057051+0000","last_fullsized":"2023-10-09T13:13:39.057051+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:12.871127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439619+0000","last_change":"2023-10-09T13:13:38.043827+0000","last_active":"2023-10-09T13:13:39.439619+0000","last_peered":"2023-10-09T13:13:39.439619+0000","last_clean":"2023-10-09T13:13:39.439619+0000","last_became_active":"2023-10-09T13:13:38.043580+0000","last_became_peered":"2023-10-09T13:13:38.043580+0000","last_unstale":"2023-10-09T13:13:39.439619+0000","last_undegraded":"2023-10-09T13:13:39.439619+0000","last_fullsized":"2023-10-09T13:13:39.439619+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:03.497163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437959+0000","last_change":"2023-10-09T13:13:38.042462+0000","last_active":"2023-10-09T13:13:39.437959+0000","last_peered":"2023-10-09T13:13:39.437959+0000","last_clean":"2023-10-09T13:13:39.437959+0000","last_became_active":"2023-10-09T13:13:38.041868+0000","last_became_peered":"2023-10-09T13:13:38.041868+0000","last_unstale":"2023-10-09T13:13:39.437959+0000","last_undegraded":"2023-10-09T13:13:39.437959+0000","last_fullsized":"2023-10-09T13:13:39.437959+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:37.362698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055977+0000","last_change":"2023-10-09T13:13:39.051631+0000","last_active":"2023-10-09T13:13:39.055977+0000","last_peered":"2023-10-09T13:13:39.055977+0000","last_clean":"2023-10-09T13:13:39.055977+0000","last_became_active":"2023-10-09T13:13:39.051379+0000","last_became_peered":"2023-10-09T13:13:39.051379+0000","last_unstale":"2023-10-09T13:13:39.055977+0000","last_undegraded":"2023-10-09T13:13:39.055977+0000","last_fullsized":"2023-10-09T13:13:39.055977+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:09.176798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023091+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:56.326258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060214+0000","last_change":"2023-10-09T13:13:39.055627+0000","last_active":"2023-10-09T13:13:39.060214+0000","last_peered":"2023-10-09T13:13:39.060214+0000","last_clean":"2023-10-09T13:13:39.060214+0000","last_became_active":"2023-10-09T13:13:39.055356+0000","last_became_peered":"2023-10-09T13:13:39.055356+0000","last_unstale":"2023-10-09T13:13:39.060214+0000","last_undegraded":"2023-10-09T13:13:39.060214+0000","last_fullsized":"2023-10-09T13:13:39.060214+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:49.286094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436660+0000","last_change":"2023-10-09T13:13:38.038204+0000","last_active":"2023-10-09T13:13:39.436660+0000","last_peered":"2023-10-09T13:13:39.436660+0000","last_clean":"2023-10-09T13:13:39.436660+0000","last_became_active":"2023-10-09T13:13:38.037962+0000","last_became_peered":"2023-10-09T13:13:38.037962+0000","last_unstale":"2023-10-09T13:13:39.436660+0000","last_undegraded":"2023-10-09T13:13:39.436660+0000","last_fullsized":"2023-10-09T13:13:39.436660+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:40.996599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055126+0000","last_change":"2023-10-09T13:13:39.048480+0000","last_active":"2023-10-09T13:13:39.055126+0000","last_peered":"2023-10-09T13:13:39.055126+0000","last_clean":"2023-10-09T13:13:39.055126+0000","last_became_active":"2023-10-09T13:13:39.048230+0000","last_became_peered":"2023-10-09T13:13:39.048230+0000","last_unstale":"2023-10-09T13:13:39.055126+0000","last_undegraded":"2023-10-09T13:13:39.055126+0000","last_fullsized":"2023-10-09T13:13:39.055126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:32.917517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.024649+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:56.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059456+0000","last_change":"2023-10-09T13:13:39.055277+0000","last_active":"2023-10-09T13:13:39.059456+0000","last_peered":"2023-10-09T13:13:39.059456+0000","last_clean":"2023-10-09T13:13:39.059456+0000","last_became_active":"2023-10-09T13:13:39.054981+0000","last_became_peered":"2023-10-09T13:13:39.054981+0000","last_unstale":"2023-10-09T13:13:39.059456+0000","last_undegraded":"2023-10-09T13:13:39.059456+0000","last_fullsized":"2023-10-09T13:13:39.059456+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:58.227515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.049142+0000","last_change":"2023-10-09T13:13:38.038128+0000","last_active":"2023-10-09T13:13:39.049142+0000","last_peered":"2023-10-09T13:13:39.049142+0000","last_clean":"2023-10-09T13:13:39.049142+0000","last_became_active":"2023-10-09T13:13:38.037818+0000","last_became_peered":"2023-10-09T13:13:38.037818+0000","last_unstale":"2023-10-09T13:13:39.049142+0000","last_undegraded":"2023-10-09T13:13:39.049142+0000","last_fullsized":"2023-10-09T13:13:39.049142+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:28.307900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.037732+0000","last_change":"2023-10-09T13:13:38.043104+0000","last_active":"2023-10-09T13:13:39.037732+0000","last_peered":"2023-10-09T13:13:39.037732+0000","last_clean":"2023-10-09T13:13:39.037732+0000","last_became_active":"2023-10-09T13:13:38.042789+0000","last_became_peered":"2023-10-09T13:13:38.042789+0000","last_unstale":"2023-10-09T13:13:39.037732+0000","last_undegraded":"2023-10-09T13:13:39.037732+0000","last_fullsized":"2023-10-09T13:13:39.037732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:36.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437745+0000","last_change":"2023-10-09T13:13:38.031271+0000","last_active":"2023-10-09T13:13:39.437745+0000","last_peered":"2023-10-09T13:13:39.437745+0000","last_clean":"2023-10-09T13:13:39.437745+0000","last_became_active":"2023-10-09T13:13:38.030990+0000","last_became_peered":"2023-10-09T13:13:38.030990+0000","last_unstale":"2023-10-09T13:13:39.437745+0000","last_undegraded":"2023-10-09T13:13:39.437745+0000","last_fullsized":"2023-10-09T13:13:39.437745+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:40.953726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.021236+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437568+0000","last_change":"2023-10-09T13:13:38.046197+0000","last_active":"2023-10-09T13:13:39.437568+0000","last_peered":"2023-10-09T13:13:39.437568+0000","last_clean":"2023-10-09T13:13:39.437568+0000","last_became_active":"2023-10-09T13:13:38.045927+0000","last_became_peered":"2023-10-09T13:13:38.045927+0000","last_unstale":"2023-10-09T13:13:39.437568+0000","last_undegraded":"2023-10-09T13:13:39.437568+0000","last_fullsized":"2023-10-09T13:13:39.437568+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:02.576133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063462+0000","last_change":"2023-10-09T13:13:39.061875+0000","last_active":"2023-10-09T13:13:39.063462+0000","last_peered":"2023-10-09T13:13:39.063462+0000","last_clean":"2023-10-09T13:13:39.063462+0000","last_became_active":"2023-10-09T13:13:39.061604+0000","last_became_peered":"2023-10-09T13:13:39.061604+0000","last_unstale":"2023-10-09T13:13:39.063462+0000","last_undegraded":"2023-10-09T13:13:39.063462+0000","last_fullsized":"2023-10-09T13:13:39.063462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:13.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020126+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:54:15.148803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.052772+0000","last_change":"2023-10-09T13:13:39.047476+0000","last_active":"2023-10-09T13:13:39.052772+0000","last_peered":"2023-10-09T13:13:39.052772+0000","last_clean":"2023-10-09T13:13:39.052772+0000","last_became_active":"2023-10-09T13:13:39.047198+0000","last_became_peered":"2023-10-09T13:13:39.047198+0000","last_unstale":"2023-10-09T13:13:39.052772+0000","last_undegraded":"2023-10-09T13:13:39.052772+0000","last_fullsized":"2023-10-09T13:13:39.052772+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:45:13.046752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042122+0000","last_change":"2023-10-09T13:13:38.044962+0000","last_active":"2023-10-09T13:13:39.042122+0000","last_peered":"2023-10-09T13:13:39.042122+0000","last_clean":"2023-10-09T13:13:39.042122+0000","last_became_active":"2023-10-09T13:13:38.044699+0000","last_became_peered":"2023-10-09T13:13:38.044699+0000","last_unstale":"2023-10-09T13:13:39.042122+0000","last_undegraded":"2023-10-09T13:13:39.042122+0000","last_fullsized":"2023-10-09T13:13:39.042122+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:35.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.022322+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055747+0000","last_change":"2023-10-09T13:13:39.052251+0000","last_active":"2023-10-09T13:13:39.055747+0000","last_peered":"2023-10-09T13:13:39.055747+0000","last_clean":"2023-10-09T13:13:39.055747+0000","last_became_active":"2023-10-09T13:13:39.051540+0000","last_became_peered":"2023-10-09T13:13:39.051540+0000","last_unstale":"2023-10-09T13:13:39.055747+0000","last_undegraded":"2023-10-09T13:13:39.055747+0000","last_fullsized":"2023-10-09T13:13:39.055747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:23.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023218+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:04.103531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023929+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:06.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059602+0000","last_change":"2023-10-09T13:13:39.053683+0000","last_active":"2023-10-09T13:13:39.059602+0000","last_peered":"2023-10-09T13:13:39.059602+0000","last_clean":"2023-10-09T13:13:39.059602+0000","last_became_active":"2023-10-09T13:13:39.053405+0000","last_became_peered":"2023-10-09T13:13:39.053405+0000","last_unstale":"2023-10-09T13:13:39.059602+0000","last_undegraded":"2023-10-09T13:13:39.059602+0000","last_fullsized":"2023-10-09T13:13:39.059602+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:36.554982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025236+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:55.782519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051841+0000","last_change":"2023-10-09T13:13:39.048395+0000","last_active":"2023-10-09T13:13:39.051841+0000","last_peered":"2023-10-09T13:13:39.051841+0000","last_clean":"2023-10-09T13:13:39.051841+0000","last_became_active":"2023-10-09T13:13:39.048135+0000","last_became_peered":"2023-10-09T13:13:39.048135+0000","last_unstale":"2023-10-09T13:13:39.051841+0000","last_undegraded":"2023-10-09T13:13:39.051841+0000","last_fullsized":"2023-10-09T13:13:39.051841+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:14.058985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025526+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:58.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439720+0000","last_change":"2023-10-09T13:13:38.044372+0000","last_active":"2023-10-09T13:13:39.439720+0000","last_peered":"2023-10-09T13:13:39.439720+0000","last_clean":"2023-10-09T13:13:39.439720+0000","last_became_active":"2023-10-09T13:13:38.044133+0000","last_became_peered":"2023-10-09T13:13:38.044133+0000","last_unstale":"2023-10-09T13:13:39.439720+0000","last_undegraded":"2023-10-09T13:13:39.439720+0000","last_fullsized":"2023-10-09T13:13:39.439720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:06:40.825909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055907+0000","last_change":"2023-10-09T13:13:39.053545+0000","last_active":"2023-10-09T13:13:39.055907+0000","last_peered":"2023-10-09T13:13:39.055907+0000","last_clean":"2023-10-09T13:13:39.055907+0000","last_became_active":"2023-10-09T13:13:39.053183+0000","last_became_peered":"2023-10-09T13:13:39.053183+0000","last_unstale":"2023-10-09T13:13:39.055907+0000","last_undegraded":"2023-10-09T13:13:39.055907+0000","last_fullsized":"2023-10-09T13:13:39.055907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:37.301381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025355+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:15.172872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.043012+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.042753+0000","last_became_peered":"2023-10-09T13:13:38.042753+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:26.638250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062583+0000","last_change":"2023-10-09T13:13:39.057491+0000","last_active":"2023-10-09T13:13:39.062583+0000","last_peered":"2023-10-09T13:13:39.062583+0000","last_clean":"2023-10-09T13:13:39.062583+0000","last_became_active":"2023-10-09T13:13:39.057245+0000","last_became_peered":"2023-10-09T13:13:39.057245+0000","last_unstale":"2023-10-09T13:13:39.062583+0000","last_undegraded":"2023-10-09T13:13:39.062583+0000","last_fullsized":"2023-10-09T13:13:39.062583+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:52.359359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025405+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:50.682969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020207+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:14.281736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063897+0000","last_change":"2023-10-09T13:13:39.062987+0000","last_active":"2023-10-09T13:13:39.063897+0000","last_peered":"2023-10-09T13:13:39.063897+0000","last_clean":"2023-10-09T13:13:39.063897+0000","last_became_active":"2023-10-09T13:13:39.062714+0000","last_became_peered":"2023-10-09T13:13:39.062714+0000","last_unstale":"2023-10-09T13:13:39.063897+0000","last_undegraded":"2023-10-09T13:13:39.063897+0000","last_fullsized":"2023-10-09T13:13:39.063897+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:57.858815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023164+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:20.666091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051413+0000","last_change":"2023-10-09T13:13:39.050681+0000","last_active":"2023-10-09T13:13:39.051413+0000","last_peered":"2023-10-09T13:13:39.051413+0000","last_clean":"2023-10-09T13:13:39.051413+0000","last_became_active":"2023-10-09T13:13:39.050420+0000","last_became_peered":"2023-10-09T13:13:39.050420+0000","last_unstale":"2023-10-09T13:13:39.051413+0000","last_undegraded":"2023-10-09T13:13:39.051413+0000","last_fullsized":"2023-10-09T13:13:39.051413+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:24.808179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023969+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020209+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:03.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020886+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:48.278497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.046306+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.046042+0000","last_became_peered":"2023-10-09T13:13:38.046042+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:20.380175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058354+0000","last_change":"2023-10-09T13:13:39.055019+0000","last_active":"2023-10-09T13:13:39.058354+0000","last_peered":"2023-10-09T13:13:39.058354+0000","last_clean":"2023-10-09T13:13:39.058354+0000","last_became_active":"2023-10-09T13:13:39.054711+0000","last_became_peered":"2023-10-09T13:13:39.054711+0000","last_unstale":"2023-10-09T13:13:39.058354+0000","last_undegraded":"2023-10-09T13:13:39.058354+0000","last_fullsized":"2023-10-09T13:13:39.058354+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:36.954416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023496+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020872+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:22.402491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.021034+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:50.861295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"185'326","reported_seq":1047,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-09T13:13:34.434261+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:13:34.434261+0000","last_peered":"2023-10-09T13:13:34.434261+0000","last_clean":"2023-10-09T13:13:34.434261+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:13:34.434261+0000","last_undegraded":"2023-10-09T13:13:34.434261+0000","last_fullsized":"2023-10-09T13:13:34.434261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":124,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312500,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059340,"statfs":{"total":96636764160,"available":96316764160,"internally_reserved":0,"allocated":2994176,"data_stored":1793447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94899999999999995,"5min":1.004,"15min":1.008},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.46200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":1.022,"15min":1.022},"last":0.46999999999999997}]},{"osd":1,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.71899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.995,"5min":0.995,"15min":1.02},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":0.97899999999999998,"15min":1.073},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":1.097,"15min":1.097},"last":0.747}]},{"osd":3,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58999999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":1.208},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":1.2410000000000001},"last":0.70199999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.74399999999999999,"5min":1.089,"15min":1.089},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.85499999999999998,"15min":1.0780000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.40899999999999997,"15min":0.35699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.64700000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.45800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.2070000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":1.038,"15min":1.3200000000000001},"last":0.83199999999999996}]}]},{"osd":6,"up_from":16,"seq":68719477834,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.026},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.80200000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":1.014},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77900000000000003,"15min":0.75800000000000001},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.503},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.47699999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.032,"15min":1.05},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.501},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77700000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.754},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.90900000000000003,"15min":1.0449999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.76000000000000001,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.034},"last":0.82799999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.89300000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":1.0329999999999999,"15min":1.0469999999999999},"last":0.876}]}]},{"osd":1,"up_from":15,"seq":64424510539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307864,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063976,"statfs":{"total":96636764160,"available":96321511424,"internally_reserved":0,"allocated":2441216,"data_stored":1223855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.312},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.25800000000000001},"max":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.89700000000000002},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.315},"max":{"1min":0.75,"5min":0.77600000000000002,"15min":0.92700000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.438,"5min":0.374,"15min":0.36299999999999999},"max":{"1min":0.78500000000000003,"5min":0.80400000000000005,"15min":0.872},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":1.052,"15min":1.052},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.501}]},{"osd":4,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.56999999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.123,"15min":1.149},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.68500000000000005,"5min":0.56699999999999995,"15min":0.43099999999999999},"max":{"1min":1.0820000000000001,"5min":1.1639999999999999,"15min":1.2849999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.63400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.226},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.44400000000000001},"max":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2250000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.212,"5min":1.24,"15min":1.24},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.86399999999999999},"min":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.3220000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.47599999999999998},"max":{"1min":1.1559999999999999,"5min":1.1830000000000001,"15min":1.202},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.75,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.244,"5min":1.2569999999999999,"15min":1.266},"last":0.69399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543242,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308440,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063400,"statfs":{"total":96636764160,"available":96320921600,"internally_reserved":0,"allocated":3031040,"data_stored":1814189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.28699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.316},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.83599999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.32400000000000001},"max":{"1min":0.70399999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33700000000000002},"max":{"1min":0.68799999999999994,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.135,"15min":1.135},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83999999999999997,"15min":0.83399999999999996},"min":{"1min":0.67000000000000004,"5min":0.55500000000000005,"15min":0.54400000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84299999999999997,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.48199999999999998},"max":{"1min":1.1000000000000001,"5min":1.147,"15min":1.147},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.63700000000000001,"5min":0.626,"15min":0.496},"max":{"1min":1.099,"5min":1.099,"15min":1.212},"last":0.747}]},{"osd":6,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83099999999999996,"15min":0.81299999999999994},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.51200000000000001},"max":{"1min":1.1779999999999999,"5min":1.194,"15min":1.194},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.55800000000000005},"max":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.1479999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83799999999999997},"min":{"1min":0.70199999999999996,"5min":0.629,"15min":0.54600000000000004},"max":{"1min":1.091,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.85599999999999998,"15min":0.83399999999999996},"min":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.46400000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79800000000000004}]}]},{"osd":2,"up_from":14,"seq":60129543242,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.90000000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83799999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":0.78500000000000003,"15min":0.877},"last":0.372},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.91600000000000004,"15min":0.96699999999999997},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.1180000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.83799999999999997,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.58799999999999997,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.1559999999999999,"15min":1.337},"last":1.117}]},{"osd":5,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.84699999999999998,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0800000000000001,"5min":1.2170000000000001,"15min":1.3460000000000001},"last":1.046},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.1499999999999999,"5min":1.1759999999999999,"15min":1.2310000000000001},"last":1.1000000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.878,"15min":0.871},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.55700000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.3180000000000001},"last":1},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.874,"15min":0.86399999999999999},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.161,"5min":1.161,"15min":1.2629999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.87,"15min":0.87},"min":{"1min":0.70999999999999996,"5min":0.58899999999999997,"15min":0.58599999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.4490000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.89700000000000002,"15min":0.89300000000000002},"min":{"1min":0.66700000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.3779999999999999},"last":0.78500000000000003}]}]},{"osd":3,"up_from":15,"seq":64424510538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311908,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059932,"statfs":{"total":96636764160,"available":96317370368,"internally_reserved":0,"allocated":2387968,"data_stored":1196798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.27900000000000003},"max":{"1min":0.69099999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.26100000000000001},"max":{"1min":0.65100000000000002,"5min":1.399,"15min":1.399},"last":0.39400000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.32700000000000001},"max":{"1min":0.71299999999999997,"5min":0.72599999999999998,"15min":0.84699999999999998},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.80400000000000005,"5min":1.024,"15min":1.024},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":0.87,"15min":0.87},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.37},"max":{"1min":1.145,"5min":1.1759999999999999,"15min":1.3380000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.747,"5min":0.58399999999999996,"15min":0.48299999999999998},"max":{"1min":1.169,"5min":1.274,"15min":1.274},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.67600000000000005,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.48099999999999998},"max":{"1min":1.0489999999999999,"5min":1.204,"15min":1.204},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83999999999999997,"15min":0.82699999999999996},"min":{"1min":0.66000000000000003,"5min":0.57799999999999996,"15min":0.504},"max":{"1min":1.111,"5min":1.262,"15min":1.262},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.64700000000000002,"5min":0.56200000000000006,"15min":0.53800000000000003},"max":{"1min":1.087,"5min":1.1859999999999999,"15min":1.2110000000000001},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84199999999999997},"min":{"1min":0.622,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88,"15min":0.85899999999999999},"min":{"1min":0.70399999999999996,"5min":0.61799999999999999,"15min":0.46800000000000003},"max":{"1min":1.1100000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":16,"seq":68719477833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299632,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072208,"statfs":{"total":96636764160,"available":96329940992,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.98999999999999999,"15min":1.0109999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92400000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.75600000000000001},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.036},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":1.018,"15min":1.018},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95599999999999996,"5min":0.995,"15min":1.0429999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":1.052,"15min":1.079},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.63,"5min":0.499,"15min":0.499},"max":{"1min":0.95699999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.68000000000000005,"5min":0.53500000000000003,"15min":0.50800000000000001},"max":{"1min":0.89400000000000002,"5min":1.173,"15min":1.214},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":1.026,"15min":1.026},"last":0.621},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.439,"15min":0.39500000000000002},"max":{"1min":0.92500000000000004,"5min":0.999,"15min":1.0049999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.056,"15min":1.056},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":1.1759999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93600000000000005,"5min":1.032,"15min":1.1020000000000001},"last":0.75900000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.371},"max":{"1min":0.96399999999999997,"5min":1.075,"15min":1.075},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58399999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.026,"15min":1.026},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92900000000000005,"5min":0.95399999999999996,"15min":0.97799999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.44400000000000001},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.68300000000000005}]},{"osd":2,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.91700000000000004,"5min":0.999,"15min":1.008},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86499999999999999,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0009999999999999,"5min":1.018,"15min":1.115},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.65500000000000003,"5min":0.625,"15min":0.58999999999999997},"max":{"1min":0.98399999999999999,"5min":1.0029999999999999,"15min":1.03},"last":0.70099999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.40200000000000002,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":1.038,"15min":1.038},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.434,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.93600000000000005,"15min":1.0209999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":1.002,"15min":1.0800000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.747},"min":{"1min":0.626,"5min":0.55300000000000005,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.1100000000000001},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:13:43.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:13:43.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.960+0000 7fae399ff700 1 Processor -- start 2023-10-09T13:13:43.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.961+0000 7fae399ff700 1 -- start start 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae399ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fae34159c60 0x7fae3415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae399ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae3415db10 0x7fae34069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae399ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3415a160 con 0x7fae34159890 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae399ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3415df50 con 0x7fae34159c60 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae399ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340d13a0 con 0x7fae3415db10 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae32ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fae34159890 0x7fae3415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:52658/0 (socket says 172.21.15.86:52658) 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae32ffd700 1 -- 172.21.15.86:0/2802726864 learned_addr learned my addr 172.21.15.86:0/2802726864 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:43.964 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae327fc700 1 --2- 172.21.15.86:0/2802726864 >> v2:172.21.15.86:3300/0 conn(0x7fae34159c60 0x7fae3415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.962+0000 7fae337fe700 1 --2- 172.21.15.86:0/2802726864 >> v2:172.21.15.135:3300/0 conn(0x7fae3415db10 0x7fae34069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae31ffb700 1 -- 172.21.15.86:0/2802726864 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869715437 0 0) 0x7fae3415a160 con 0x7fae34159890 2023-10-09T13:13:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae31ffb700 1 -- 172.21.15.86:0/2802726864 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae1c003570 con 0x7fae34159890 2023-10-09T13:13:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae327fc700 1 -- 172.21.15.86:0/2802726864 >> v2:172.21.15.135:3300/0 conn(0x7fae3415db10 msgr2=0x7fae34069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae327fc700 1 --2- 172.21.15.86:0/2802726864 >> v2:172.21.15.135:3300/0 conn(0x7fae3415db10 0x7fae34069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae327fc700 1 -- 172.21.15.86:0/2802726864 >> v1:172.21.15.86:6789/0 conn(0x7fae34159890 legacy=0x7fae3415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae327fc700 1 -- 172.21.15.86:0/2802726864 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3415e140 con 0x7fae34159c60 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae327fc700 1 --2- 172.21.15.86:0/2802726864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34159c60 0x7fae3415d5d0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fae3406a890 tx=0x7fae280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07c6d9c30124be8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae31ffb700 1 -- 172.21.15.86:0/2802726864 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28011630 con 0x7fae34159c60 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae31ffb700 1 -- 172.21.15.86:0/2802726864 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280117b0 con 0x7fae34159c60 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.963+0000 7fae31ffb700 1 -- 172.21.15.86:0/2802726864 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28011b70 con 0x7fae34159c60 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 -- 172.21.15.86:0/2802726864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34159c60 msgr2=0x7fae3415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 --2- 172.21.15.86:0/2802726864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34159c60 0x7fae3415d5d0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fae3406a890 tx=0x7fae280091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 -- 172.21.15.86:0/2802726864 shutdown_connections 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 --2- 172.21.15.86:0/2802726864 >> v2:172.21.15.135:3300/0 conn(0x7fae3415db10 0x7fae34069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 --2- 172.21.15.86:0/2802726864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae34159c60 0x7fae3415d5d0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 -- 172.21.15.86:0/2802726864 >> 172.21.15.86:0/2802726864 conn(0x7fae34068e20 msgr2=0x7fae340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 -- 172.21.15.86:0/2802726864 shutdown_connections 2023-10-09T13:13:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.964+0000 7fae399ff700 1 -- 172.21.15.86:0/2802726864 wait complete. 2023-10-09T13:13:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.965+0000 7fae399ff700 1 Processor -- start 2023-10-09T13:13:43.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.965+0000 7fae399ff700 1 -- start start 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.966+0000 7fae399ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae34159890 0x7fae340cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.966+0000 7fae399ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae34159c60 0x7fae340c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.966+0000 7fae399ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae3415db10 0x7fae3416d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.966+0000 7fae399ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340ce3b0 con 0x7fae3415db10 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.966+0000 7fae399ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340b4a50 con 0x7fae34159890 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.966+0000 7fae399ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340b4d30 con 0x7fae34159c60 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae3415db10 0x7fae3416d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae3415db10 0x7fae3416d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49748/0 (socket says 172.21.15.86:49748) 2023-10-09T13:13:43.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 -- 172.21.15.86:0/1258821477 learned_addr learned my addr 172.21.15.86:0/1258821477 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae32ffd700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae34159890 0x7fae340cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae327fc700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae34159c60 0x7fae340c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 -- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae34159c60 msgr2=0x7fae340c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae34159c60 0x7fae340c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 -- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae34159890 msgr2=0x7fae340cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae34159890 0x7fae340cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 -- 172.21.15.86:0/1258821477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009420 con 0x7fae3415db10 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae32ffd700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae34159890 0x7fae340cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae327fc700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae34159c60 0x7fae340c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae337fe700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae3415db10 0x7fae3416d0e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00e8d0 tx=0x7fae2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae1affd700 1 -- 172.21.15.86:0/1258821477 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00ee70 con 0x7fae3415db10 2023-10-09T13:13:43.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae1affd700 1 -- 172.21.15.86:0/1258821477 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00c850 con 0x7fae3415db10 2023-10-09T13:13:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340b5010 con 0x7fae3415db10 2023-10-09T13:13:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.967+0000 7fae1affd700 1 -- 172.21.15.86:0/1258821477 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00cc50 con 0x7fae3415db10 2023-10-09T13:13:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.968+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae340ce0a0 con 0x7fae3415db10 2023-10-09T13:13:43.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.969+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3404c3c0 con 0x7fae3415db10 2023-10-09T13:13:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.969+0000 7fae1affd700 1 -- 172.21.15.86:0/1258821477 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae2c013680 con 0x7fae3415db10 2023-10-09T13:13:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.970+0000 7fae1affd700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fae20066f30 0x7fae200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.970+0000 7fae1affd700 1 -- 172.21.15.86:0/1258821477 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fae2c084970 con 0x7fae3415db10 2023-10-09T13:13:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.970+0000 7fae32ffd700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fae20066f30 0x7fae200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:43.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.971+0000 7fae32ffd700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fae20066f30 0x7fae200693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae24005c50 tx=0x7fae24009040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:43.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:43.974+0000 7fae1affd700 1 -- 172.21.15.86:0/1258821477 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae2c051960 con 0x7fae3415db10 2023-10-09T13:13:44.013 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-10-09T13:13:44.011+0000 7f42541f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T13:13:44.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.162+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae3406a5b0 con 0x7fae20066f30 2023-10-09T13:13:44.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.170+0000 7fae1affd700 1 -- 172.21.15.86:0/1258821477 <== mgr.9462 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282721 (secure 0 0 0) 0x7fae3406a5b0 con 0x7fae20066f30 2023-10-09T13:13:44.175 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:44.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fae20066f30 msgr2=0x7fae200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fae20066f30 0x7fae200693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae24005c50 tx=0x7fae24009040 comp rx=0 tx=0).stop 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae3415db10 msgr2=0x7fae3416d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae3415db10 0x7fae3416d0e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00e8d0 tx=0x7fae2c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 shutdown_connections 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fae20066f30 0x7fae200693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae3415db10 0x7fae3416d0e0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae34159890 0x7fae340cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 --2- 172.21.15.86:0/1258821477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae34159c60 0x7fae340c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 >> 172.21.15.86:0/1258821477 conn(0x7fae34068e20 msgr2=0x7fae3415aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 shutdown_connections 2023-10-09T13:13:44.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.174+0000 7fae399ff700 1 -- 172.21.15.86:0/1258821477 wait complete. 2023-10-09T13:13:44.179 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:13:44.194 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T13:13:42.937624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590492,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":553,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476144,"kb_used_data":20016,"kb_used_omap":0,"kb_used_meta":2456064,"kb_avail":752498576,"statfs":{"total":773094113280,"available":770558541824,"internally_reserved":0,"allocated":20496384,"data_stored":10861437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2515009536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.918075"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059582+0000","last_change":"2023-10-09T13:13:39.052976+0000","last_active":"2023-10-09T13:13:39.059582+0000","last_peered":"2023-10-09T13:13:39.059582+0000","last_clean":"2023-10-09T13:13:39.059582+0000","last_became_active":"2023-10-09T13:13:39.052731+0000","last_became_peered":"2023-10-09T13:13:39.052731+0000","last_unstale":"2023-10-09T13:13:39.059582+0000","last_undegraded":"2023-10-09T13:13:39.059582+0000","last_fullsized":"2023-10-09T13:13:39.059582+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:57.794933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059269+0000","last_change":"2023-10-09T13:13:39.054489+0000","last_active":"2023-10-09T13:13:39.059269+0000","last_peered":"2023-10-09T13:13:39.059269+0000","last_clean":"2023-10-09T13:13:39.059269+0000","last_became_active":"2023-10-09T13:13:39.054222+0000","last_became_peered":"2023-10-09T13:13:39.054222+0000","last_unstale":"2023-10-09T13:13:39.059269+0000","last_undegraded":"2023-10-09T13:13:39.059269+0000","last_fullsized":"2023-10-09T13:13:39.059269+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:33.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063435+0000","last_change":"2023-10-09T13:13:39.060449+0000","last_active":"2023-10-09T13:13:39.063435+0000","last_peered":"2023-10-09T13:13:39.063435+0000","last_clean":"2023-10-09T13:13:39.063435+0000","last_became_active":"2023-10-09T13:13:39.059646+0000","last_became_peered":"2023-10-09T13:13:39.059646+0000","last_unstale":"2023-10-09T13:13:39.063435+0000","last_undegraded":"2023-10-09T13:13:39.063435+0000","last_fullsized":"2023-10-09T13:13:39.063435+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:46.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.054529+0000","last_change":"2023-10-09T13:13:39.051097+0000","last_active":"2023-10-09T13:13:39.054529+0000","last_peered":"2023-10-09T13:13:39.054529+0000","last_clean":"2023-10-09T13:13:39.054529+0000","last_became_active":"2023-10-09T13:13:39.050849+0000","last_became_peered":"2023-10-09T13:13:39.050849+0000","last_unstale":"2023-10-09T13:13:39.054529+0000","last_undegraded":"2023-10-09T13:13:39.054529+0000","last_fullsized":"2023-10-09T13:13:39.054529+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:57.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047721+0000","last_change":"2023-10-09T13:13:39.045335+0000","last_active":"2023-10-09T13:13:39.047721+0000","last_peered":"2023-10-09T13:13:39.047721+0000","last_clean":"2023-10-09T13:13:39.047721+0000","last_became_active":"2023-10-09T13:13:39.045012+0000","last_became_peered":"2023-10-09T13:13:39.045012+0000","last_unstale":"2023-10-09T13:13:39.047721+0000","last_undegraded":"2023-10-09T13:13:39.047721+0000","last_fullsized":"2023-10-09T13:13:39.047721+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:53.421996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.050776+0000","last_change":"2023-10-09T13:13:39.047770+0000","last_active":"2023-10-09T13:13:39.050776+0000","last_peered":"2023-10-09T13:13:39.050776+0000","last_clean":"2023-10-09T13:13:39.050776+0000","last_became_active":"2023-10-09T13:13:39.047485+0000","last_became_peered":"2023-10-09T13:13:39.047485+0000","last_unstale":"2023-10-09T13:13:39.050776+0000","last_undegraded":"2023-10-09T13:13:39.050776+0000","last_fullsized":"2023-10-09T13:13:39.050776+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:32.687561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046746+0000","last_change":"2023-10-09T13:13:39.044650+0000","last_active":"2023-10-09T13:13:39.046746+0000","last_peered":"2023-10-09T13:13:39.046746+0000","last_clean":"2023-10-09T13:13:39.046746+0000","last_became_active":"2023-10-09T13:13:39.044230+0000","last_became_peered":"2023-10-09T13:13:39.044230+0000","last_unstale":"2023-10-09T13:13:39.046746+0000","last_undegraded":"2023-10-09T13:13:39.046746+0000","last_fullsized":"2023-10-09T13:13:39.046746+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:13.117007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063289+0000","last_change":"2023-10-09T13:13:39.060979+0000","last_active":"2023-10-09T13:13:39.063289+0000","last_peered":"2023-10-09T13:13:39.063289+0000","last_clean":"2023-10-09T13:13:39.063289+0000","last_became_active":"2023-10-09T13:13:39.060695+0000","last_became_peered":"2023-10-09T13:13:39.060695+0000","last_unstale":"2023-10-09T13:13:39.063289+0000","last_undegraded":"2023-10-09T13:13:39.063289+0000","last_fullsized":"2023-10-09T13:13:39.063289+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:03.435693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060171+0000","last_change":"2023-10-09T13:13:39.056226+0000","last_active":"2023-10-09T13:13:39.060171+0000","last_peered":"2023-10-09T13:13:39.060171+0000","last_clean":"2023-10-09T13:13:39.060171+0000","last_became_active":"2023-10-09T13:13:39.055652+0000","last_became_peered":"2023-10-09T13:13:39.055652+0000","last_unstale":"2023-10-09T13:13:39.060171+0000","last_undegraded":"2023-10-09T13:13:39.060171+0000","last_fullsized":"2023-10-09T13:13:39.060171+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:43.352357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063042+0000","last_change":"2023-10-09T13:13:39.059455+0000","last_active":"2023-10-09T13:13:39.063042+0000","last_peered":"2023-10-09T13:13:39.063042+0000","last_clean":"2023-10-09T13:13:39.063042+0000","last_became_active":"2023-10-09T13:13:39.058865+0000","last_became_peered":"2023-10-09T13:13:39.058865+0000","last_unstale":"2023-10-09T13:13:39.063042+0000","last_undegraded":"2023-10-09T13:13:39.063042+0000","last_fullsized":"2023-10-09T13:13:39.063042+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:23.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058088+0000","last_change":"2023-10-09T13:13:39.054890+0000","last_active":"2023-10-09T13:13:39.058088+0000","last_peered":"2023-10-09T13:13:39.058088+0000","last_clean":"2023-10-09T13:13:39.058088+0000","last_became_active":"2023-10-09T13:13:39.054491+0000","last_became_peered":"2023-10-09T13:13:39.054491+0000","last_unstale":"2023-10-09T13:13:39.058088+0000","last_undegraded":"2023-10-09T13:13:39.058088+0000","last_fullsized":"2023-10-09T13:13:39.058088+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:31.565289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025352+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:45:12.639364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020976+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:31.909920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.057051+0000","last_change":"2023-10-09T13:13:39.052087+0000","last_active":"2023-10-09T13:13:39.057051+0000","last_peered":"2023-10-09T13:13:39.057051+0000","last_clean":"2023-10-09T13:13:39.057051+0000","last_became_active":"2023-10-09T13:13:39.051831+0000","last_became_peered":"2023-10-09T13:13:39.051831+0000","last_unstale":"2023-10-09T13:13:39.057051+0000","last_undegraded":"2023-10-09T13:13:39.057051+0000","last_fullsized":"2023-10-09T13:13:39.057051+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:12.871127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439619+0000","last_change":"2023-10-09T13:13:38.043827+0000","last_active":"2023-10-09T13:13:39.439619+0000","last_peered":"2023-10-09T13:13:39.439619+0000","last_clean":"2023-10-09T13:13:39.439619+0000","last_became_active":"2023-10-09T13:13:38.043580+0000","last_became_peered":"2023-10-09T13:13:38.043580+0000","last_unstale":"2023-10-09T13:13:39.439619+0000","last_undegraded":"2023-10-09T13:13:39.439619+0000","last_fullsized":"2023-10-09T13:13:39.439619+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:03.497163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437959+0000","last_change":"2023-10-09T13:13:38.042462+0000","last_active":"2023-10-09T13:13:39.437959+0000","last_peered":"2023-10-09T13:13:39.437959+0000","last_clean":"2023-10-09T13:13:39.437959+0000","last_became_active":"2023-10-09T13:13:38.041868+0000","last_became_peered":"2023-10-09T13:13:38.041868+0000","last_unstale":"2023-10-09T13:13:39.437959+0000","last_undegraded":"2023-10-09T13:13:39.437959+0000","last_fullsized":"2023-10-09T13:13:39.437959+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:37.362698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055977+0000","last_change":"2023-10-09T13:13:39.051631+0000","last_active":"2023-10-09T13:13:39.055977+0000","last_peered":"2023-10-09T13:13:39.055977+0000","last_clean":"2023-10-09T13:13:39.055977+0000","last_became_active":"2023-10-09T13:13:39.051379+0000","last_became_peered":"2023-10-09T13:13:39.051379+0000","last_unstale":"2023-10-09T13:13:39.055977+0000","last_undegraded":"2023-10-09T13:13:39.055977+0000","last_fullsized":"2023-10-09T13:13:39.055977+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:09.176798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023091+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:56.326258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060214+0000","last_change":"2023-10-09T13:13:39.055627+0000","last_active":"2023-10-09T13:13:39.060214+0000","last_peered":"2023-10-09T13:13:39.060214+0000","last_clean":"2023-10-09T13:13:39.060214+0000","last_became_active":"2023-10-09T13:13:39.055356+0000","last_became_peered":"2023-10-09T13:13:39.055356+0000","last_unstale":"2023-10-09T13:13:39.060214+0000","last_undegraded":"2023-10-09T13:13:39.060214+0000","last_fullsized":"2023-10-09T13:13:39.060214+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:49.286094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436660+0000","last_change":"2023-10-09T13:13:38.038204+0000","last_active":"2023-10-09T13:13:39.436660+0000","last_peered":"2023-10-09T13:13:39.436660+0000","last_clean":"2023-10-09T13:13:39.436660+0000","last_became_active":"2023-10-09T13:13:38.037962+0000","last_became_peered":"2023-10-09T13:13:38.037962+0000","last_unstale":"2023-10-09T13:13:39.436660+0000","last_undegraded":"2023-10-09T13:13:39.436660+0000","last_fullsized":"2023-10-09T13:13:39.436660+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:40.996599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055126+0000","last_change":"2023-10-09T13:13:39.048480+0000","last_active":"2023-10-09T13:13:39.055126+0000","last_peered":"2023-10-09T13:13:39.055126+0000","last_clean":"2023-10-09T13:13:39.055126+0000","last_became_active":"2023-10-09T13:13:39.048230+0000","last_became_peered":"2023-10-09T13:13:39.048230+0000","last_unstale":"2023-10-09T13:13:39.055126+0000","last_undegraded":"2023-10-09T13:13:39.055126+0000","last_fullsized":"2023-10-09T13:13:39.055126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:32.917517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.024649+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:56.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059456+0000","last_change":"2023-10-09T13:13:39.055277+0000","last_active":"2023-10-09T13:13:39.059456+0000","last_peered":"2023-10-09T13:13:39.059456+0000","last_clean":"2023-10-09T13:13:39.059456+0000","last_became_active":"2023-10-09T13:13:39.054981+0000","last_became_peered":"2023-10-09T13:13:39.054981+0000","last_unstale":"2023-10-09T13:13:39.059456+0000","last_undegraded":"2023-10-09T13:13:39.059456+0000","last_fullsized":"2023-10-09T13:13:39.059456+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:58.227515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.049142+0000","last_change":"2023-10-09T13:13:38.038128+0000","last_active":"2023-10-09T13:13:39.049142+0000","last_peered":"2023-10-09T13:13:39.049142+0000","last_clean":"2023-10-09T13:13:39.049142+0000","last_became_active":"2023-10-09T13:13:38.037818+0000","last_became_peered":"2023-10-09T13:13:38.037818+0000","last_unstale":"2023-10-09T13:13:39.049142+0000","last_undegraded":"2023-10-09T13:13:39.049142+0000","last_fullsized":"2023-10-09T13:13:39.049142+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:28.307900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.037732+0000","last_change":"2023-10-09T13:13:38.043104+0000","last_active":"2023-10-09T13:13:39.037732+0000","last_peered":"2023-10-09T13:13:39.037732+0000","last_clean":"2023-10-09T13:13:39.037732+0000","last_became_active":"2023-10-09T13:13:38.042789+0000","last_became_peered":"2023-10-09T13:13:38.042789+0000","last_unstale":"2023-10-09T13:13:39.037732+0000","last_undegraded":"2023-10-09T13:13:39.037732+0000","last_fullsized":"2023-10-09T13:13:39.037732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:36.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437745+0000","last_change":"2023-10-09T13:13:38.031271+0000","last_active":"2023-10-09T13:13:39.437745+0000","last_peered":"2023-10-09T13:13:39.437745+0000","last_clean":"2023-10-09T13:13:39.437745+0000","last_became_active":"2023-10-09T13:13:38.030990+0000","last_became_peered":"2023-10-09T13:13:38.030990+0000","last_unstale":"2023-10-09T13:13:39.437745+0000","last_undegraded":"2023-10-09T13:13:39.437745+0000","last_fullsized":"2023-10-09T13:13:39.437745+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:40.953726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.021236+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437568+0000","last_change":"2023-10-09T13:13:38.046197+0000","last_active":"2023-10-09T13:13:39.437568+0000","last_peered":"2023-10-09T13:13:39.437568+0000","last_clean":"2023-10-09T13:13:39.437568+0000","last_became_active":"2023-10-09T13:13:38.045927+0000","last_became_peered":"2023-10-09T13:13:38.045927+0000","last_unstale":"2023-10-09T13:13:39.437568+0000","last_undegraded":"2023-10-09T13:13:39.437568+0000","last_fullsized":"2023-10-09T13:13:39.437568+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:02.576133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063462+0000","last_change":"2023-10-09T13:13:39.061875+0000","last_active":"2023-10-09T13:13:39.063462+0000","last_peered":"2023-10-09T13:13:39.063462+0000","last_clean":"2023-10-09T13:13:39.063462+0000","last_became_active":"2023-10-09T13:13:39.061604+0000","last_became_peered":"2023-10-09T13:13:39.061604+0000","last_unstale":"2023-10-09T13:13:39.063462+0000","last_undegraded":"2023-10-09T13:13:39.063462+0000","last_fullsized":"2023-10-09T13:13:39.063462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:13.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020126+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:54:15.148803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.052772+0000","last_change":"2023-10-09T13:13:39.047476+0000","last_active":"2023-10-09T13:13:39.052772+0000","last_peered":"2023-10-09T13:13:39.052772+0000","last_clean":"2023-10-09T13:13:39.052772+0000","last_became_active":"2023-10-09T13:13:39.047198+0000","last_became_peered":"2023-10-09T13:13:39.047198+0000","last_unstale":"2023-10-09T13:13:39.052772+0000","last_undegraded":"2023-10-09T13:13:39.052772+0000","last_fullsized":"2023-10-09T13:13:39.052772+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:45:13.046752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042122+0000","last_change":"2023-10-09T13:13:38.044962+0000","last_active":"2023-10-09T13:13:39.042122+0000","last_peered":"2023-10-09T13:13:39.042122+0000","last_clean":"2023-10-09T13:13:39.042122+0000","last_became_active":"2023-10-09T13:13:38.044699+0000","last_became_peered":"2023-10-09T13:13:38.044699+0000","last_unstale":"2023-10-09T13:13:39.042122+0000","last_undegraded":"2023-10-09T13:13:39.042122+0000","last_fullsized":"2023-10-09T13:13:39.042122+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:35.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.022322+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055747+0000","last_change":"2023-10-09T13:13:39.052251+0000","last_active":"2023-10-09T13:13:39.055747+0000","last_peered":"2023-10-09T13:13:39.055747+0000","last_clean":"2023-10-09T13:13:39.055747+0000","last_became_active":"2023-10-09T13:13:39.051540+0000","last_became_peered":"2023-10-09T13:13:39.051540+0000","last_unstale":"2023-10-09T13:13:39.055747+0000","last_undegraded":"2023-10-09T13:13:39.055747+0000","last_fullsized":"2023-10-09T13:13:39.055747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:23.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023218+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:04.103531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023929+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:06.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059602+0000","last_change":"2023-10-09T13:13:39.053683+0000","last_active":"2023-10-09T13:13:39.059602+0000","last_peered":"2023-10-09T13:13:39.059602+0000","last_clean":"2023-10-09T13:13:39.059602+0000","last_became_active":"2023-10-09T13:13:39.053405+0000","last_became_peered":"2023-10-09T13:13:39.053405+0000","last_unstale":"2023-10-09T13:13:39.059602+0000","last_undegraded":"2023-10-09T13:13:39.059602+0000","last_fullsized":"2023-10-09T13:13:39.059602+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:36.554982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025236+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:55.782519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051841+0000","last_change":"2023-10-09T13:13:39.048395+0000","last_active":"2023-10-09T13:13:39.051841+0000","last_peered":"2023-10-09T13:13:39.051841+0000","last_clean":"2023-10-09T13:13:39.051841+0000","last_became_active":"2023-10-09T13:13:39.048135+0000","last_became_peered":"2023-10-09T13:13:39.048135+0000","last_unstale":"2023-10-09T13:13:39.051841+0000","last_undegraded":"2023-10-09T13:13:39.051841+0000","last_fullsized":"2023-10-09T13:13:39.051841+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:14.058985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025526+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:58.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439720+0000","last_change":"2023-10-09T13:13:38.044372+0000","last_active":"2023-10-09T13:13:39.439720+0000","last_peered":"2023-10-09T13:13:39.439720+0000","last_clean":"2023-10-09T13:13:39.439720+0000","last_became_active":"2023-10-09T13:13:38.044133+0000","last_became_peered":"2023-10-09T13:13:38.044133+0000","last_unstale":"2023-10-09T13:13:39.439720+0000","last_undegraded":"2023-10-09T13:13:39.439720+0000","last_fullsized":"2023-10-09T13:13:39.439720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:06:40.825909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055907+0000","last_change":"2023-10-09T13:13:39.053545+0000","last_active":"2023-10-09T13:13:39.055907+0000","last_peered":"2023-10-09T13:13:39.055907+0000","last_clean":"2023-10-09T13:13:39.055907+0000","last_became_active":"2023-10-09T13:13:39.053183+0000","last_became_peered":"2023-10-09T13:13:39.053183+0000","last_unstale":"2023-10-09T13:13:39.055907+0000","last_undegraded":"2023-10-09T13:13:39.055907+0000","last_fullsized":"2023-10-09T13:13:39.055907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:37.301381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025355+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:15.172872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.043012+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.042753+0000","last_became_peered":"2023-10-09T13:13:38.042753+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:26.638250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062583+0000","last_change":"2023-10-09T13:13:39.057491+0000","last_active":"2023-10-09T13:13:39.062583+0000","last_peered":"2023-10-09T13:13:39.062583+0000","last_clean":"2023-10-09T13:13:39.062583+0000","last_became_active":"2023-10-09T13:13:39.057245+0000","last_became_peered":"2023-10-09T13:13:39.057245+0000","last_unstale":"2023-10-09T13:13:39.062583+0000","last_undegraded":"2023-10-09T13:13:39.062583+0000","last_fullsized":"2023-10-09T13:13:39.062583+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:52.359359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025405+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:50.682969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020207+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:14.281736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063897+0000","last_change":"2023-10-09T13:13:39.062987+0000","last_active":"2023-10-09T13:13:39.063897+0000","last_peered":"2023-10-09T13:13:39.063897+0000","last_clean":"2023-10-09T13:13:39.063897+0000","last_became_active":"2023-10-09T13:13:39.062714+0000","last_became_peered":"2023-10-09T13:13:39.062714+0000","last_unstale":"2023-10-09T13:13:39.063897+0000","last_undegraded":"2023-10-09T13:13:39.063897+0000","last_fullsized":"2023-10-09T13:13:39.063897+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:57.858815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023164+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:20.666091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051413+0000","last_change":"2023-10-09T13:13:39.050681+0000","last_active":"2023-10-09T13:13:39.051413+0000","last_peered":"2023-10-09T13:13:39.051413+0000","last_clean":"2023-10-09T13:13:39.051413+0000","last_became_active":"2023-10-09T13:13:39.050420+0000","last_became_peered":"2023-10-09T13:13:39.050420+0000","last_unstale":"2023-10-09T13:13:39.051413+0000","last_undegraded":"2023-10-09T13:13:39.051413+0000","last_fullsized":"2023-10-09T13:13:39.051413+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:24.808179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023969+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020209+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:03.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020886+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:48.278497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.046306+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.046042+0000","last_became_peered":"2023-10-09T13:13:38.046042+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:20.380175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058354+0000","last_change":"2023-10-09T13:13:39.055019+0000","last_active":"2023-10-09T13:13:39.058354+0000","last_peered":"2023-10-09T13:13:39.058354+0000","last_clean":"2023-10-09T13:13:39.058354+0000","last_became_active":"2023-10-09T13:13:39.054711+0000","last_became_peered":"2023-10-09T13:13:39.054711+0000","last_unstale":"2023-10-09T13:13:39.058354+0000","last_undegraded":"2023-10-09T13:13:39.058354+0000","last_fullsized":"2023-10-09T13:13:39.058354+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:36.954416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023496+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020872+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:22.402491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.021034+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:50.861295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"185'326","reported_seq":1047,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-09T13:13:34.434261+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:13:34.434261+0000","last_peered":"2023-10-09T13:13:34.434261+0000","last_clean":"2023-10-09T13:13:34.434261+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:13:34.434261+0000","last_undegraded":"2023-10-09T13:13:34.434261+0000","last_fullsized":"2023-10-09T13:13:34.434261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":124,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312500,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059340,"statfs":{"total":96636764160,"available":96316764160,"internally_reserved":0,"allocated":2994176,"data_stored":1793447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94899999999999995,"5min":1.004,"15min":1.008},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.46200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":1.022,"15min":1.022},"last":0.46999999999999997}]},{"osd":1,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.71899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.995,"5min":0.995,"15min":1.02},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":0.97899999999999998,"15min":1.073},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":1.097,"15min":1.097},"last":0.747}]},{"osd":3,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58999999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":1.208},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":1.2410000000000001},"last":0.70199999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.74399999999999999,"5min":1.089,"15min":1.089},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.85499999999999998,"15min":1.0780000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.40899999999999997,"15min":0.35699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.64700000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.45800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.2070000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":1.038,"15min":1.3200000000000001},"last":0.83199999999999996}]}]},{"osd":6,"up_from":16,"seq":68719477834,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.026},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.80200000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":1.014},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77900000000000003,"15min":0.75800000000000001},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.503},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.47699999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.032,"15min":1.05},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.501},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77700000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.754},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.90900000000000003,"15min":1.0449999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.76000000000000001,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.034},"last":0.82799999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.89300000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":1.0329999999999999,"15min":1.0469999999999999},"last":0.876}]}]},{"osd":1,"up_from":15,"seq":64424510539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307864,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063976,"statfs":{"total":96636764160,"available":96321511424,"internally_reserved":0,"allocated":2441216,"data_stored":1223855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.312},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.25800000000000001},"max":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.89700000000000002},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.315},"max":{"1min":0.75,"5min":0.77600000000000002,"15min":0.92700000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.438,"5min":0.374,"15min":0.36299999999999999},"max":{"1min":0.78500000000000003,"5min":0.80400000000000005,"15min":0.872},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":1.052,"15min":1.052},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.501}]},{"osd":4,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.56999999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.123,"15min":1.149},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.68500000000000005,"5min":0.56699999999999995,"15min":0.43099999999999999},"max":{"1min":1.0820000000000001,"5min":1.1639999999999999,"15min":1.2849999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.63400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.226},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.44400000000000001},"max":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2250000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.212,"5min":1.24,"15min":1.24},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.86399999999999999},"min":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.3220000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.47599999999999998},"max":{"1min":1.1559999999999999,"5min":1.1830000000000001,"15min":1.202},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.75,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.244,"5min":1.2569999999999999,"15min":1.266},"last":0.69399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543242,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308440,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063400,"statfs":{"total":96636764160,"available":96320921600,"internally_reserved":0,"allocated":3031040,"data_stored":1814189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.28699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.316},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.83599999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.32400000000000001},"max":{"1min":0.70399999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33700000000000002},"max":{"1min":0.68799999999999994,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.135,"15min":1.135},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83999999999999997,"15min":0.83399999999999996},"min":{"1min":0.67000000000000004,"5min":0.55500000000000005,"15min":0.54400000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84299999999999997,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.48199999999999998},"max":{"1min":1.1000000000000001,"5min":1.147,"15min":1.147},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.63700000000000001,"5min":0.626,"15min":0.496},"max":{"1min":1.099,"5min":1.099,"15min":1.212},"last":0.747}]},{"osd":6,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83099999999999996,"15min":0.81299999999999994},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.51200000000000001},"max":{"1min":1.1779999999999999,"5min":1.194,"15min":1.194},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.55800000000000005},"max":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.1479999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83799999999999997},"min":{"1min":0.70199999999999996,"5min":0.629,"15min":0.54600000000000004},"max":{"1min":1.091,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.85599999999999998,"15min":0.83399999999999996},"min":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.46400000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79800000000000004}]}]},{"osd":2,"up_from":14,"seq":60129543242,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.90000000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83799999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":0.78500000000000003,"15min":0.877},"last":0.372},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.91600000000000004,"15min":0.96699999999999997},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.1180000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.83799999999999997,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.58799999999999997,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.1559999999999999,"15min":1.337},"last":1.117}]},{"osd":5,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.84699999999999998,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0800000000000001,"5min":1.2170000000000001,"15min":1.3460000000000001},"last":1.046},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.1499999999999999,"5min":1.1759999999999999,"15min":1.2310000000000001},"last":1.1000000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.878,"15min":0.871},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.55700000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.3180000000000001},"last":1},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.874,"15min":0.86399999999999999},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.161,"5min":1.161,"15min":1.2629999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.87,"15min":0.87},"min":{"1min":0.70999999999999996,"5min":0.58899999999999997,"15min":0.58599999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.4490000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.89700000000000002,"15min":0.89300000000000002},"min":{"1min":0.66700000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.3779999999999999},"last":0.78500000000000003}]}]},{"osd":3,"up_from":15,"seq":64424510538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311908,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059932,"statfs":{"total":96636764160,"available":96317370368,"internally_reserved":0,"allocated":2387968,"data_stored":1196798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.27900000000000003},"max":{"1min":0.69099999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.26100000000000001},"max":{"1min":0.65100000000000002,"5min":1.399,"15min":1.399},"last":0.39400000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.32700000000000001},"max":{"1min":0.71299999999999997,"5min":0.72599999999999998,"15min":0.84699999999999998},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.80400000000000005,"5min":1.024,"15min":1.024},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":0.87,"15min":0.87},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.37},"max":{"1min":1.145,"5min":1.1759999999999999,"15min":1.3380000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.747,"5min":0.58399999999999996,"15min":0.48299999999999998},"max":{"1min":1.169,"5min":1.274,"15min":1.274},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.67600000000000005,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.48099999999999998},"max":{"1min":1.0489999999999999,"5min":1.204,"15min":1.204},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83999999999999997,"15min":0.82699999999999996},"min":{"1min":0.66000000000000003,"5min":0.57799999999999996,"15min":0.504},"max":{"1min":1.111,"5min":1.262,"15min":1.262},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.64700000000000002,"5min":0.56200000000000006,"15min":0.53800000000000003},"max":{"1min":1.087,"5min":1.1859999999999999,"15min":1.2110000000000001},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84199999999999997},"min":{"1min":0.622,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88,"15min":0.85899999999999999},"min":{"1min":0.70399999999999996,"5min":0.61799999999999999,"15min":0.46800000000000003},"max":{"1min":1.1100000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":16,"seq":68719477833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299632,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072208,"statfs":{"total":96636764160,"available":96329940992,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.98999999999999999,"15min":1.0109999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92400000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.75600000000000001},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.036},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":1.018,"15min":1.018},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95599999999999996,"5min":0.995,"15min":1.0429999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":1.052,"15min":1.079},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.63,"5min":0.499,"15min":0.499},"max":{"1min":0.95699999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.68000000000000005,"5min":0.53500000000000003,"15min":0.50800000000000001},"max":{"1min":0.89400000000000002,"5min":1.173,"15min":1.214},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":1.026,"15min":1.026},"last":0.621},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.439,"15min":0.39500000000000002},"max":{"1min":0.92500000000000004,"5min":0.999,"15min":1.0049999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.056,"15min":1.056},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":1.1759999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93600000000000005,"5min":1.032,"15min":1.1020000000000001},"last":0.75900000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.371},"max":{"1min":0.96399999999999997,"5min":1.075,"15min":1.075},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58399999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.026,"15min":1.026},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92900000000000005,"5min":0.95399999999999996,"15min":0.97799999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.44400000000000001},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.68300000000000005}]},{"osd":2,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.91700000000000004,"5min":0.999,"15min":1.008},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86499999999999999,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0009999999999999,"5min":1.018,"15min":1.115},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.65500000000000003,"5min":0.625,"15min":0.58999999999999997},"max":{"1min":0.98399999999999999,"5min":1.0029999999999999,"15min":1.03},"last":0.70099999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.40200000000000002,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":1.038,"15min":1.038},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.434,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.93600000000000005,"15min":1.0209999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":1.002,"15min":1.0800000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.747},"min":{"1min":0.626,"5min":0.55300000000000005,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.1100000000000001},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:13:44.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:13:44.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.413+0000 7f4f1339d700 1 Processor -- start 2023-10-09T13:13:44.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.413+0000 7f4f1339d700 1 -- start start 2023-10-09T13:13:44.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.414+0000 7f4f1339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.414+0000 7f4f1339d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f0c15d230 0x7f4f0c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.414+0000 7f4f1339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c15dbd0 con 0x7f4f0c1597f0 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.414+0000 7f4f1339d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0b2980 con 0x7f4f0c15d230 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.414+0000 7f4f1339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0b11d0 con 0x7f4f0c159420 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f0c15d230 0x7f4f0c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f0c15d230 0x7f4f0c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49754/0 (socket says 172.21.15.86:49754) 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 -- 172.21.15.86:0/3345726249 learned_addr learned my addr 172.21.15.86:0/3345726249 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f1239b700 1 --2- 172.21.15.86:0/3345726249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 -- 172.21.15.86:0/3345726249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 msgr2=0x7f4f0c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:44.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 --2- 172.21.15.86:0/3345726249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 -- 172.21.15.86:0/3345726249 >> v1:172.21.15.135:6789/0 conn(0x7f4f0c1597f0 legacy=0x7f4f0c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 -- 172.21.15.86:0/3345726249 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0b14b0 con 0x7f4f0c15d230 2023-10-09T13:13:44.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.415+0000 7f4f12b9c700 1 --2- 172.21.15.86:0/3345726249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c15d230 0x7f4f0c15d690 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009f20 tx=0x7f4f04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8451617964696b3e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:44.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f11399700 1 -- 172.21.15.86:0/3345726249 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400e070 con 0x7f4f0c15d230 2023-10-09T13:13:44.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f11399700 1 -- 172.21.15.86:0/3345726249 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400b9d0 con 0x7f4f0c15d230 2023-10-09T13:13:44.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f11399700 1 -- 172.21.15.86:0/3345726249 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040092e0 con 0x7f4f0c15d230 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 -- 172.21.15.86:0/3345726249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c15d230 msgr2=0x7f4f0c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 --2- 172.21.15.86:0/3345726249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c15d230 0x7f4f0c15d690 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009f20 tx=0x7f4f04009840 comp rx=0 tx=0).stop 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 -- 172.21.15.86:0/3345726249 shutdown_connections 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 --2- 172.21.15.86:0/3345726249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c15d230 0x7f4f0c15d690 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 --2- 172.21.15.86:0/3345726249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 -- 172.21.15.86:0/3345726249 >> 172.21.15.86:0/3345726249 conn(0x7f4f0c0d0660 msgr2=0x7f4f0c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 -- 172.21.15.86:0/3345726249 shutdown_connections 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.416+0000 7f4f1339d700 1 -- 172.21.15.86:0/3345726249 wait complete. 2023-10-09T13:13:44.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.418+0000 7f4f1339d700 1 Processor -- start 2023-10-09T13:13:44.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.418+0000 7f4f1339d700 1 -- start start 2023-10-09T13:13:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f1339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f1339d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c1597f0 0x7f4f0c069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f1339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0c15d230 0x7f4f0c069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f1339d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0c5d10 con 0x7f4f0c1597f0 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f1339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0c5400 con 0x7f4f0c15d230 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f1339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c15baf0 con 0x7f4f0c159420 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f11b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c1597f0 0x7f4f0c069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f11b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c1597f0 0x7f4f0c069510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49758/0 (socket says 172.21.15.86:49758) 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f11b9a700 1 -- 172.21.15.86:0/2234169887 learned_addr learned my addr 172.21.15.86:0/2234169887 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f1239b700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.419+0000 7f4f12b9c700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0c15d230 0x7f4f0c069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f11b9a700 1 -- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 msgr2=0x7f4f0c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f11b9a700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f11b9a700 1 -- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0c15d230 msgr2=0x7f4f0c069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f11b9a700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0c15d230 0x7f4f0c069a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f11b9a700 1 -- 172.21.15.86:0/2234169887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009ae0 con 0x7f4f0c1597f0 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f11b9a700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c1597f0 0x7f4f0c069510 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c590 tx=0x7f4efc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f027fc700 1 -- 172.21.15.86:0/2234169887 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011590 con 0x7f4f0c1597f0 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f027fc700 1 -- 172.21.15.86:0/2234169887 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc011710 con 0x7f4f0c1597f0 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f027fc700 1 -- 172.21.15.86:0/2234169887 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011ad0 con 0x7f4f0c1597f0 2023-10-09T13:13:44.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c0c56c0 con 0x7f4f0c1597f0 2023-10-09T13:13:44.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.420+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c153920 con 0x7f4f0c1597f0 2023-10-09T13:13:44.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.421+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c04c3c0 con 0x7f4f0c1597f0 2023-10-09T13:13:44.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.422+0000 7f4f027fc700 1 -- 172.21.15.86:0/2234169887 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4efc01b3b0 con 0x7f4f0c1597f0 2023-10-09T13:13:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.423+0000 7f4f027fc700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ef0066f30 0x7f4ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.423+0000 7f4f027fc700 1 -- 172.21.15.86:0/2234169887 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f4efc083990 con 0x7f4f0c1597f0 2023-10-09T13:13:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.423+0000 7f4f1239b700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ef0066f30 0x7f4ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.424+0000 7f4f1239b700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ef0066f30 0x7f4ef00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009db0 tx=0x7f4f080091a0 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:44.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.427+0000 7f4f027fc700 1 -- 172.21.15.86:0/2234169887 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4efc050a20 con 0x7f4f0c1597f0 2023-10-09T13:13:44.615 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.613+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f0c15dbd0 con 0x7f4ef0066f30 2023-10-09T13:13:44.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.622+0000 7f4f027fc700 1 -- 172.21.15.86:0/2234169887 <== mgr.9462 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282721 (secure 0 0 0) 0x7f4f0c15dbd0 con 0x7f4ef0066f30 2023-10-09T13:13:44.627 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ef0066f30 msgr2=0x7f4ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ef0066f30 0x7f4ef00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009db0 tx=0x7f4f080091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c1597f0 msgr2=0x7f4f0c069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c1597f0 0x7f4f0c069510 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c590 tx=0x7f4efc00c8a0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 shutdown_connections 2023-10-09T13:13:44.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4ef0066f30 0x7f4ef00693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f0c15d230 0x7f4f0c069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f0c159420 0x7f4f0c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 --2- 172.21.15.86:0/2234169887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f0c1597f0 0x7f4f0c069510 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 >> 172.21.15.86:0/2234169887 conn(0x7f4f0c0d0660 msgr2=0x7f4f0c158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 shutdown_connections 2023-10-09T13:13:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.626+0000 7f4f1339d700 1 -- 172.21.15.86:0/2234169887 wait complete. 2023-10-09T13:13:44.630 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:13:44.645 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T13:13:42.937624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590492,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":553,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476144,"kb_used_data":20016,"kb_used_omap":0,"kb_used_meta":2456064,"kb_avail":752498576,"statfs":{"total":773094113280,"available":770558541824,"internally_reserved":0,"allocated":20496384,"data_stored":10861437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2515009536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.918075"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059582+0000","last_change":"2023-10-09T13:13:39.052976+0000","last_active":"2023-10-09T13:13:39.059582+0000","last_peered":"2023-10-09T13:13:39.059582+0000","last_clean":"2023-10-09T13:13:39.059582+0000","last_became_active":"2023-10-09T13:13:39.052731+0000","last_became_peered":"2023-10-09T13:13:39.052731+0000","last_unstale":"2023-10-09T13:13:39.059582+0000","last_undegraded":"2023-10-09T13:13:39.059582+0000","last_fullsized":"2023-10-09T13:13:39.059582+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:57.794933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059269+0000","last_change":"2023-10-09T13:13:39.054489+0000","last_active":"2023-10-09T13:13:39.059269+0000","last_peered":"2023-10-09T13:13:39.059269+0000","last_clean":"2023-10-09T13:13:39.059269+0000","last_became_active":"2023-10-09T13:13:39.054222+0000","last_became_peered":"2023-10-09T13:13:39.054222+0000","last_unstale":"2023-10-09T13:13:39.059269+0000","last_undegraded":"2023-10-09T13:13:39.059269+0000","last_fullsized":"2023-10-09T13:13:39.059269+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:33.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063435+0000","last_change":"2023-10-09T13:13:39.060449+0000","last_active":"2023-10-09T13:13:39.063435+0000","last_peered":"2023-10-09T13:13:39.063435+0000","last_clean":"2023-10-09T13:13:39.063435+0000","last_became_active":"2023-10-09T13:13:39.059646+0000","last_became_peered":"2023-10-09T13:13:39.059646+0000","last_unstale":"2023-10-09T13:13:39.063435+0000","last_undegraded":"2023-10-09T13:13:39.063435+0000","last_fullsized":"2023-10-09T13:13:39.063435+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:46.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.054529+0000","last_change":"2023-10-09T13:13:39.051097+0000","last_active":"2023-10-09T13:13:39.054529+0000","last_peered":"2023-10-09T13:13:39.054529+0000","last_clean":"2023-10-09T13:13:39.054529+0000","last_became_active":"2023-10-09T13:13:39.050849+0000","last_became_peered":"2023-10-09T13:13:39.050849+0000","last_unstale":"2023-10-09T13:13:39.054529+0000","last_undegraded":"2023-10-09T13:13:39.054529+0000","last_fullsized":"2023-10-09T13:13:39.054529+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:57.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047721+0000","last_change":"2023-10-09T13:13:39.045335+0000","last_active":"2023-10-09T13:13:39.047721+0000","last_peered":"2023-10-09T13:13:39.047721+0000","last_clean":"2023-10-09T13:13:39.047721+0000","last_became_active":"2023-10-09T13:13:39.045012+0000","last_became_peered":"2023-10-09T13:13:39.045012+0000","last_unstale":"2023-10-09T13:13:39.047721+0000","last_undegraded":"2023-10-09T13:13:39.047721+0000","last_fullsized":"2023-10-09T13:13:39.047721+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:53.421996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.050776+0000","last_change":"2023-10-09T13:13:39.047770+0000","last_active":"2023-10-09T13:13:39.050776+0000","last_peered":"2023-10-09T13:13:39.050776+0000","last_clean":"2023-10-09T13:13:39.050776+0000","last_became_active":"2023-10-09T13:13:39.047485+0000","last_became_peered":"2023-10-09T13:13:39.047485+0000","last_unstale":"2023-10-09T13:13:39.050776+0000","last_undegraded":"2023-10-09T13:13:39.050776+0000","last_fullsized":"2023-10-09T13:13:39.050776+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:32.687561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046746+0000","last_change":"2023-10-09T13:13:39.044650+0000","last_active":"2023-10-09T13:13:39.046746+0000","last_peered":"2023-10-09T13:13:39.046746+0000","last_clean":"2023-10-09T13:13:39.046746+0000","last_became_active":"2023-10-09T13:13:39.044230+0000","last_became_peered":"2023-10-09T13:13:39.044230+0000","last_unstale":"2023-10-09T13:13:39.046746+0000","last_undegraded":"2023-10-09T13:13:39.046746+0000","last_fullsized":"2023-10-09T13:13:39.046746+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:13.117007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063289+0000","last_change":"2023-10-09T13:13:39.060979+0000","last_active":"2023-10-09T13:13:39.063289+0000","last_peered":"2023-10-09T13:13:39.063289+0000","last_clean":"2023-10-09T13:13:39.063289+0000","last_became_active":"2023-10-09T13:13:39.060695+0000","last_became_peered":"2023-10-09T13:13:39.060695+0000","last_unstale":"2023-10-09T13:13:39.063289+0000","last_undegraded":"2023-10-09T13:13:39.063289+0000","last_fullsized":"2023-10-09T13:13:39.063289+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:03.435693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060171+0000","last_change":"2023-10-09T13:13:39.056226+0000","last_active":"2023-10-09T13:13:39.060171+0000","last_peered":"2023-10-09T13:13:39.060171+0000","last_clean":"2023-10-09T13:13:39.060171+0000","last_became_active":"2023-10-09T13:13:39.055652+0000","last_became_peered":"2023-10-09T13:13:39.055652+0000","last_unstale":"2023-10-09T13:13:39.060171+0000","last_undegraded":"2023-10-09T13:13:39.060171+0000","last_fullsized":"2023-10-09T13:13:39.060171+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:43.352357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063042+0000","last_change":"2023-10-09T13:13:39.059455+0000","last_active":"2023-10-09T13:13:39.063042+0000","last_peered":"2023-10-09T13:13:39.063042+0000","last_clean":"2023-10-09T13:13:39.063042+0000","last_became_active":"2023-10-09T13:13:39.058865+0000","last_became_peered":"2023-10-09T13:13:39.058865+0000","last_unstale":"2023-10-09T13:13:39.063042+0000","last_undegraded":"2023-10-09T13:13:39.063042+0000","last_fullsized":"2023-10-09T13:13:39.063042+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:23.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058088+0000","last_change":"2023-10-09T13:13:39.054890+0000","last_active":"2023-10-09T13:13:39.058088+0000","last_peered":"2023-10-09T13:13:39.058088+0000","last_clean":"2023-10-09T13:13:39.058088+0000","last_became_active":"2023-10-09T13:13:39.054491+0000","last_became_peered":"2023-10-09T13:13:39.054491+0000","last_unstale":"2023-10-09T13:13:39.058088+0000","last_undegraded":"2023-10-09T13:13:39.058088+0000","last_fullsized":"2023-10-09T13:13:39.058088+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:31.565289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025352+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:45:12.639364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020976+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:31.909920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.057051+0000","last_change":"2023-10-09T13:13:39.052087+0000","last_active":"2023-10-09T13:13:39.057051+0000","last_peered":"2023-10-09T13:13:39.057051+0000","last_clean":"2023-10-09T13:13:39.057051+0000","last_became_active":"2023-10-09T13:13:39.051831+0000","last_became_peered":"2023-10-09T13:13:39.051831+0000","last_unstale":"2023-10-09T13:13:39.057051+0000","last_undegraded":"2023-10-09T13:13:39.057051+0000","last_fullsized":"2023-10-09T13:13:39.057051+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:12.871127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439619+0000","last_change":"2023-10-09T13:13:38.043827+0000","last_active":"2023-10-09T13:13:39.439619+0000","last_peered":"2023-10-09T13:13:39.439619+0000","last_clean":"2023-10-09T13:13:39.439619+0000","last_became_active":"2023-10-09T13:13:38.043580+0000","last_became_peered":"2023-10-09T13:13:38.043580+0000","last_unstale":"2023-10-09T13:13:39.439619+0000","last_undegraded":"2023-10-09T13:13:39.439619+0000","last_fullsized":"2023-10-09T13:13:39.439619+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:03.497163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437959+0000","last_change":"2023-10-09T13:13:38.042462+0000","last_active":"2023-10-09T13:13:39.437959+0000","last_peered":"2023-10-09T13:13:39.437959+0000","last_clean":"2023-10-09T13:13:39.437959+0000","last_became_active":"2023-10-09T13:13:38.041868+0000","last_became_peered":"2023-10-09T13:13:38.041868+0000","last_unstale":"2023-10-09T13:13:39.437959+0000","last_undegraded":"2023-10-09T13:13:39.437959+0000","last_fullsized":"2023-10-09T13:13:39.437959+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:37.362698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055977+0000","last_change":"2023-10-09T13:13:39.051631+0000","last_active":"2023-10-09T13:13:39.055977+0000","last_peered":"2023-10-09T13:13:39.055977+0000","last_clean":"2023-10-09T13:13:39.055977+0000","last_became_active":"2023-10-09T13:13:39.051379+0000","last_became_peered":"2023-10-09T13:13:39.051379+0000","last_unstale":"2023-10-09T13:13:39.055977+0000","last_undegraded":"2023-10-09T13:13:39.055977+0000","last_fullsized":"2023-10-09T13:13:39.055977+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:09.176798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023091+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:56.326258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060214+0000","last_change":"2023-10-09T13:13:39.055627+0000","last_active":"2023-10-09T13:13:39.060214+0000","last_peered":"2023-10-09T13:13:39.060214+0000","last_clean":"2023-10-09T13:13:39.060214+0000","last_became_active":"2023-10-09T13:13:39.055356+0000","last_became_peered":"2023-10-09T13:13:39.055356+0000","last_unstale":"2023-10-09T13:13:39.060214+0000","last_undegraded":"2023-10-09T13:13:39.060214+0000","last_fullsized":"2023-10-09T13:13:39.060214+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:49.286094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436660+0000","last_change":"2023-10-09T13:13:38.038204+0000","last_active":"2023-10-09T13:13:39.436660+0000","last_peered":"2023-10-09T13:13:39.436660+0000","last_clean":"2023-10-09T13:13:39.436660+0000","last_became_active":"2023-10-09T13:13:38.037962+0000","last_became_peered":"2023-10-09T13:13:38.037962+0000","last_unstale":"2023-10-09T13:13:39.436660+0000","last_undegraded":"2023-10-09T13:13:39.436660+0000","last_fullsized":"2023-10-09T13:13:39.436660+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:40.996599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055126+0000","last_change":"2023-10-09T13:13:39.048480+0000","last_active":"2023-10-09T13:13:39.055126+0000","last_peered":"2023-10-09T13:13:39.055126+0000","last_clean":"2023-10-09T13:13:39.055126+0000","last_became_active":"2023-10-09T13:13:39.048230+0000","last_became_peered":"2023-10-09T13:13:39.048230+0000","last_unstale":"2023-10-09T13:13:39.055126+0000","last_undegraded":"2023-10-09T13:13:39.055126+0000","last_fullsized":"2023-10-09T13:13:39.055126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:32.917517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.024649+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:56.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059456+0000","last_change":"2023-10-09T13:13:39.055277+0000","last_active":"2023-10-09T13:13:39.059456+0000","last_peered":"2023-10-09T13:13:39.059456+0000","last_clean":"2023-10-09T13:13:39.059456+0000","last_became_active":"2023-10-09T13:13:39.054981+0000","last_became_peered":"2023-10-09T13:13:39.054981+0000","last_unstale":"2023-10-09T13:13:39.059456+0000","last_undegraded":"2023-10-09T13:13:39.059456+0000","last_fullsized":"2023-10-09T13:13:39.059456+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:58.227515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.049142+0000","last_change":"2023-10-09T13:13:38.038128+0000","last_active":"2023-10-09T13:13:39.049142+0000","last_peered":"2023-10-09T13:13:39.049142+0000","last_clean":"2023-10-09T13:13:39.049142+0000","last_became_active":"2023-10-09T13:13:38.037818+0000","last_became_peered":"2023-10-09T13:13:38.037818+0000","last_unstale":"2023-10-09T13:13:39.049142+0000","last_undegraded":"2023-10-09T13:13:39.049142+0000","last_fullsized":"2023-10-09T13:13:39.049142+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:28.307900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.037732+0000","last_change":"2023-10-09T13:13:38.043104+0000","last_active":"2023-10-09T13:13:39.037732+0000","last_peered":"2023-10-09T13:13:39.037732+0000","last_clean":"2023-10-09T13:13:39.037732+0000","last_became_active":"2023-10-09T13:13:38.042789+0000","last_became_peered":"2023-10-09T13:13:38.042789+0000","last_unstale":"2023-10-09T13:13:39.037732+0000","last_undegraded":"2023-10-09T13:13:39.037732+0000","last_fullsized":"2023-10-09T13:13:39.037732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:36.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437745+0000","last_change":"2023-10-09T13:13:38.031271+0000","last_active":"2023-10-09T13:13:39.437745+0000","last_peered":"2023-10-09T13:13:39.437745+0000","last_clean":"2023-10-09T13:13:39.437745+0000","last_became_active":"2023-10-09T13:13:38.030990+0000","last_became_peered":"2023-10-09T13:13:38.030990+0000","last_unstale":"2023-10-09T13:13:39.437745+0000","last_undegraded":"2023-10-09T13:13:39.437745+0000","last_fullsized":"2023-10-09T13:13:39.437745+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:40.953726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.021236+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437568+0000","last_change":"2023-10-09T13:13:38.046197+0000","last_active":"2023-10-09T13:13:39.437568+0000","last_peered":"2023-10-09T13:13:39.437568+0000","last_clean":"2023-10-09T13:13:39.437568+0000","last_became_active":"2023-10-09T13:13:38.045927+0000","last_became_peered":"2023-10-09T13:13:38.045927+0000","last_unstale":"2023-10-09T13:13:39.437568+0000","last_undegraded":"2023-10-09T13:13:39.437568+0000","last_fullsized":"2023-10-09T13:13:39.437568+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:02.576133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063462+0000","last_change":"2023-10-09T13:13:39.061875+0000","last_active":"2023-10-09T13:13:39.063462+0000","last_peered":"2023-10-09T13:13:39.063462+0000","last_clean":"2023-10-09T13:13:39.063462+0000","last_became_active":"2023-10-09T13:13:39.061604+0000","last_became_peered":"2023-10-09T13:13:39.061604+0000","last_unstale":"2023-10-09T13:13:39.063462+0000","last_undegraded":"2023-10-09T13:13:39.063462+0000","last_fullsized":"2023-10-09T13:13:39.063462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:13.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020126+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:54:15.148803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.052772+0000","last_change":"2023-10-09T13:13:39.047476+0000","last_active":"2023-10-09T13:13:39.052772+0000","last_peered":"2023-10-09T13:13:39.052772+0000","last_clean":"2023-10-09T13:13:39.052772+0000","last_became_active":"2023-10-09T13:13:39.047198+0000","last_became_peered":"2023-10-09T13:13:39.047198+0000","last_unstale":"2023-10-09T13:13:39.052772+0000","last_undegraded":"2023-10-09T13:13:39.052772+0000","last_fullsized":"2023-10-09T13:13:39.052772+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:45:13.046752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042122+0000","last_change":"2023-10-09T13:13:38.044962+0000","last_active":"2023-10-09T13:13:39.042122+0000","last_peered":"2023-10-09T13:13:39.042122+0000","last_clean":"2023-10-09T13:13:39.042122+0000","last_became_active":"2023-10-09T13:13:38.044699+0000","last_became_peered":"2023-10-09T13:13:38.044699+0000","last_unstale":"2023-10-09T13:13:39.042122+0000","last_undegraded":"2023-10-09T13:13:39.042122+0000","last_fullsized":"2023-10-09T13:13:39.042122+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:35.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.022322+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055747+0000","last_change":"2023-10-09T13:13:39.052251+0000","last_active":"2023-10-09T13:13:39.055747+0000","last_peered":"2023-10-09T13:13:39.055747+0000","last_clean":"2023-10-09T13:13:39.055747+0000","last_became_active":"2023-10-09T13:13:39.051540+0000","last_became_peered":"2023-10-09T13:13:39.051540+0000","last_unstale":"2023-10-09T13:13:39.055747+0000","last_undegraded":"2023-10-09T13:13:39.055747+0000","last_fullsized":"2023-10-09T13:13:39.055747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:23.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023218+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:24:04.103531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023929+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:06.398914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059602+0000","last_change":"2023-10-09T13:13:39.053683+0000","last_active":"2023-10-09T13:13:39.059602+0000","last_peered":"2023-10-09T13:13:39.059602+0000","last_clean":"2023-10-09T13:13:39.059602+0000","last_became_active":"2023-10-09T13:13:39.053405+0000","last_became_peered":"2023-10-09T13:13:39.053405+0000","last_unstale":"2023-10-09T13:13:39.059602+0000","last_undegraded":"2023-10-09T13:13:39.059602+0000","last_fullsized":"2023-10-09T13:13:39.059602+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:36.554982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025236+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:55.782519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051841+0000","last_change":"2023-10-09T13:13:39.048395+0000","last_active":"2023-10-09T13:13:39.051841+0000","last_peered":"2023-10-09T13:13:39.051841+0000","last_clean":"2023-10-09T13:13:39.051841+0000","last_became_active":"2023-10-09T13:13:39.048135+0000","last_became_peered":"2023-10-09T13:13:39.048135+0000","last_unstale":"2023-10-09T13:13:39.051841+0000","last_undegraded":"2023-10-09T13:13:39.051841+0000","last_fullsized":"2023-10-09T13:13:39.051841+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:14.058985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025526+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:58.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439720+0000","last_change":"2023-10-09T13:13:38.044372+0000","last_active":"2023-10-09T13:13:39.439720+0000","last_peered":"2023-10-09T13:13:39.439720+0000","last_clean":"2023-10-09T13:13:39.439720+0000","last_became_active":"2023-10-09T13:13:38.044133+0000","last_became_peered":"2023-10-09T13:13:38.044133+0000","last_unstale":"2023-10-09T13:13:39.439720+0000","last_undegraded":"2023-10-09T13:13:39.439720+0000","last_fullsized":"2023-10-09T13:13:39.439720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:06:40.825909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055907+0000","last_change":"2023-10-09T13:13:39.053545+0000","last_active":"2023-10-09T13:13:39.055907+0000","last_peered":"2023-10-09T13:13:39.055907+0000","last_clean":"2023-10-09T13:13:39.055907+0000","last_became_active":"2023-10-09T13:13:39.053183+0000","last_became_peered":"2023-10-09T13:13:39.053183+0000","last_unstale":"2023-10-09T13:13:39.055907+0000","last_undegraded":"2023-10-09T13:13:39.055907+0000","last_fullsized":"2023-10-09T13:13:39.055907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:37.301381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025355+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:15.172872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.043012+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.042753+0000","last_became_peered":"2023-10-09T13:13:38.042753+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:26.638250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062583+0000","last_change":"2023-10-09T13:13:39.057491+0000","last_active":"2023-10-09T13:13:39.062583+0000","last_peered":"2023-10-09T13:13:39.062583+0000","last_clean":"2023-10-09T13:13:39.062583+0000","last_became_active":"2023-10-09T13:13:39.057245+0000","last_became_peered":"2023-10-09T13:13:39.057245+0000","last_unstale":"2023-10-09T13:13:39.062583+0000","last_undegraded":"2023-10-09T13:13:39.062583+0000","last_fullsized":"2023-10-09T13:13:39.062583+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:52.359359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.025405+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:50.682969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020207+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:14.281736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063897+0000","last_change":"2023-10-09T13:13:39.062987+0000","last_active":"2023-10-09T13:13:39.063897+0000","last_peered":"2023-10-09T13:13:39.063897+0000","last_clean":"2023-10-09T13:13:39.063897+0000","last_became_active":"2023-10-09T13:13:39.062714+0000","last_became_peered":"2023-10-09T13:13:39.062714+0000","last_unstale":"2023-10-09T13:13:39.063897+0000","last_undegraded":"2023-10-09T13:13:39.063897+0000","last_fullsized":"2023-10-09T13:13:39.063897+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:57.858815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023164+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:20.666091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051413+0000","last_change":"2023-10-09T13:13:39.050681+0000","last_active":"2023-10-09T13:13:39.051413+0000","last_peered":"2023-10-09T13:13:39.051413+0000","last_clean":"2023-10-09T13:13:39.051413+0000","last_became_active":"2023-10-09T13:13:39.050420+0000","last_became_peered":"2023-10-09T13:13:39.050420+0000","last_unstale":"2023-10-09T13:13:39.051413+0000","last_undegraded":"2023-10-09T13:13:39.051413+0000","last_fullsized":"2023-10-09T13:13:39.051413+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:24.808179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023969+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020209+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:03.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020886+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:48.278497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.046306+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.046042+0000","last_became_peered":"2023-10-09T13:13:38.046042+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:20.380175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058354+0000","last_change":"2023-10-09T13:13:39.055019+0000","last_active":"2023-10-09T13:13:39.058354+0000","last_peered":"2023-10-09T13:13:39.058354+0000","last_clean":"2023-10-09T13:13:39.058354+0000","last_became_active":"2023-10-09T13:13:39.054711+0000","last_became_peered":"2023-10-09T13:13:39.054711+0000","last_unstale":"2023-10-09T13:13:39.058354+0000","last_undegraded":"2023-10-09T13:13:39.058354+0000","last_fullsized":"2023-10-09T13:13:39.058354+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:36.954416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.023496+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.020872+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:22.402491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:13:38.017047+0000","last_change":"2023-10-09T13:13:38.017047+0000","last_active":"2023-10-09T13:13:38.017047+0000","last_peered":"2023-10-09T13:13:38.017047+0000","last_clean":"2023-10-09T13:13:38.017047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:38.017047+0000","last_undegraded":"2023-10-09T13:13:38.017047+0000","last_fullsized":"2023-10-09T13:13:38.017047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:13:37.009450+0000","last_change":"2023-10-09T13:13:37.021034+0000","last_active":"2023-10-09T13:13:37.009450+0000","last_peered":"2023-10-09T13:13:37.009450+0000","last_clean":"2023-10-09T13:13:37.009450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:13:37.009450+0000","last_undegraded":"2023-10-09T13:13:37.009450+0000","last_fullsized":"2023-10-09T13:13:37.009450+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:50.861295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"185'326","reported_seq":1047,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-09T13:13:34.434261+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:13:34.434261+0000","last_peered":"2023-10-09T13:13:34.434261+0000","last_clean":"2023-10-09T13:13:34.434261+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:13:34.434261+0000","last_undegraded":"2023-10-09T13:13:34.434261+0000","last_fullsized":"2023-10-09T13:13:34.434261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":124,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312500,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059340,"statfs":{"total":96636764160,"available":96316764160,"internally_reserved":0,"allocated":2994176,"data_stored":1793447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94899999999999995,"5min":1.004,"15min":1.008},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.46200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":1.022,"15min":1.022},"last":0.46999999999999997}]},{"osd":1,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.71899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.995,"5min":0.995,"15min":1.02},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":0.97899999999999998,"15min":1.073},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":1.097,"15min":1.097},"last":0.747}]},{"osd":3,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58999999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":1.208},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":1.2410000000000001},"last":0.70199999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.74399999999999999,"5min":1.089,"15min":1.089},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.85499999999999998,"15min":1.0780000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.40899999999999997,"15min":0.35699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.64700000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.45800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.2070000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":1.038,"15min":1.3200000000000001},"last":0.83199999999999996}]}]},{"osd":6,"up_from":16,"seq":68719477834,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.026},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.80200000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":1.014},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77900000000000003,"15min":0.75800000000000001},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.503},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.47699999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.032,"15min":1.05},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.501},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77700000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.754},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.90900000000000003,"15min":1.0449999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.76000000000000001,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.034},"last":0.82799999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.89300000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":1.0329999999999999,"15min":1.0469999999999999},"last":0.876}]}]},{"osd":1,"up_from":15,"seq":64424510539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307864,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063976,"statfs":{"total":96636764160,"available":96321511424,"internally_reserved":0,"allocated":2441216,"data_stored":1223855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.312},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.25800000000000001},"max":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.89700000000000002},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.315},"max":{"1min":0.75,"5min":0.77600000000000002,"15min":0.92700000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.438,"5min":0.374,"15min":0.36299999999999999},"max":{"1min":0.78500000000000003,"5min":0.80400000000000005,"15min":0.872},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":1.052,"15min":1.052},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.501}]},{"osd":4,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.56999999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.123,"15min":1.149},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.68500000000000005,"5min":0.56699999999999995,"15min":0.43099999999999999},"max":{"1min":1.0820000000000001,"5min":1.1639999999999999,"15min":1.2849999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.63400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.226},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.44400000000000001},"max":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2250000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.212,"5min":1.24,"15min":1.24},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.86399999999999999},"min":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.3220000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.47599999999999998},"max":{"1min":1.1559999999999999,"5min":1.1830000000000001,"15min":1.202},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.75,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.244,"5min":1.2569999999999999,"15min":1.266},"last":0.69399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543242,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308440,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063400,"statfs":{"total":96636764160,"available":96320921600,"internally_reserved":0,"allocated":3031040,"data_stored":1814189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.28699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.316},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.83599999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.32400000000000001},"max":{"1min":0.70399999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33700000000000002},"max":{"1min":0.68799999999999994,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.135,"15min":1.135},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83999999999999997,"15min":0.83399999999999996},"min":{"1min":0.67000000000000004,"5min":0.55500000000000005,"15min":0.54400000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84299999999999997,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.48199999999999998},"max":{"1min":1.1000000000000001,"5min":1.147,"15min":1.147},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.63700000000000001,"5min":0.626,"15min":0.496},"max":{"1min":1.099,"5min":1.099,"15min":1.212},"last":0.747}]},{"osd":6,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83099999999999996,"15min":0.81299999999999994},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.51200000000000001},"max":{"1min":1.1779999999999999,"5min":1.194,"15min":1.194},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.55800000000000005},"max":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.1479999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83799999999999997},"min":{"1min":0.70199999999999996,"5min":0.629,"15min":0.54600000000000004},"max":{"1min":1.091,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.85599999999999998,"15min":0.83399999999999996},"min":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.46400000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79800000000000004}]}]},{"osd":2,"up_from":14,"seq":60129543242,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.90000000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83799999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":0.78500000000000003,"15min":0.877},"last":0.372},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.91600000000000004,"15min":0.96699999999999997},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.1180000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.83799999999999997,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.58799999999999997,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.1559999999999999,"15min":1.337},"last":1.117}]},{"osd":5,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.84699999999999998,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0800000000000001,"5min":1.2170000000000001,"15min":1.3460000000000001},"last":1.046},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.1499999999999999,"5min":1.1759999999999999,"15min":1.2310000000000001},"last":1.1000000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.878,"15min":0.871},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.55700000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.3180000000000001},"last":1},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.874,"15min":0.86399999999999999},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.161,"5min":1.161,"15min":1.2629999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.87,"15min":0.87},"min":{"1min":0.70999999999999996,"5min":0.58899999999999997,"15min":0.58599999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.4490000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.89700000000000002,"15min":0.89300000000000002},"min":{"1min":0.66700000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.3779999999999999},"last":0.78500000000000003}]}]},{"osd":3,"up_from":15,"seq":64424510538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311908,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059932,"statfs":{"total":96636764160,"available":96317370368,"internally_reserved":0,"allocated":2387968,"data_stored":1196798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.27900000000000003},"max":{"1min":0.69099999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.26100000000000001},"max":{"1min":0.65100000000000002,"5min":1.399,"15min":1.399},"last":0.39400000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.32700000000000001},"max":{"1min":0.71299999999999997,"5min":0.72599999999999998,"15min":0.84699999999999998},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.80400000000000005,"5min":1.024,"15min":1.024},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":0.87,"15min":0.87},"last":0.498}]},{"osd":4,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85699999999999998,"15min":0.85199999999999998},"min":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.37},"max":{"1min":1.145,"5min":1.1759999999999999,"15min":1.3380000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.747,"5min":0.58399999999999996,"15min":0.48299999999999998},"max":{"1min":1.169,"5min":1.274,"15min":1.274},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.67600000000000005,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.48099999999999998},"max":{"1min":1.0489999999999999,"5min":1.204,"15min":1.204},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83999999999999997,"15min":0.82699999999999996},"min":{"1min":0.66000000000000003,"5min":0.57799999999999996,"15min":0.504},"max":{"1min":1.111,"5min":1.262,"15min":1.262},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.64700000000000002,"5min":0.56200000000000006,"15min":0.53800000000000003},"max":{"1min":1.087,"5min":1.1859999999999999,"15min":1.2110000000000001},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84199999999999997},"min":{"1min":0.622,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88,"15min":0.85899999999999999},"min":{"1min":0.70399999999999996,"5min":0.61799999999999999,"15min":0.46800000000000003},"max":{"1min":1.1100000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":16,"seq":68719477833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299632,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072208,"statfs":{"total":96636764160,"available":96329940992,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.98999999999999999,"15min":1.0109999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92400000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.75600000000000001},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.036},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":1.018,"15min":1.018},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95599999999999996,"5min":0.995,"15min":1.0429999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":1.052,"15min":1.079},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.63,"5min":0.499,"15min":0.499},"max":{"1min":0.95699999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.68000000000000005,"5min":0.53500000000000003,"15min":0.50800000000000001},"max":{"1min":0.89400000000000002,"5min":1.173,"15min":1.214},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":1.026,"15min":1.026},"last":0.621},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.439,"15min":0.39500000000000002},"max":{"1min":0.92500000000000004,"5min":0.999,"15min":1.0049999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.056,"15min":1.056},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":1.1759999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93600000000000005,"5min":1.032,"15min":1.1020000000000001},"last":0.75900000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2400256,"data_stored":1203079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.371},"max":{"1min":0.96399999999999997,"5min":1.075,"15min":1.075},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58399999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.026,"15min":1.026},"last":0.63900000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92900000000000005,"5min":0.95399999999999996,"15min":0.97799999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.44400000000000001},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.68300000000000005}]},{"osd":2,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.91700000000000004,"5min":0.999,"15min":1.008},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86499999999999999,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.64700000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0009999999999999,"5min":1.018,"15min":1.115},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.65500000000000003,"5min":0.625,"15min":0.58999999999999997},"max":{"1min":0.98399999999999999,"5min":1.0029999999999999,"15min":1.03},"last":0.70099999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.40200000000000002,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":1.038,"15min":1.038},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.434,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.93600000000000005,"15min":1.0209999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":1.002,"15min":1.0800000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.747},"min":{"1min":0.626,"5min":0.55300000000000005,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.1100000000000001},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:13:44.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3f is not active+clean 2023-10-09T13:13:44.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2023-10-09T13:13:44.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-10-09T13:13:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.31 is not active+clean 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2e is not active+clean 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.20 is not active+clean 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.025352+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:45:12.639364+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-10-09T13:13:44.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.020976+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:31:31.909920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.023091+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:06:56.326258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.024649+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:31:56.787336+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.17 is not active+clean 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.14 is not active+clean 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.021236+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.12 is not active+clean 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-10-09T13:13:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.020126+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:54:15.148803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.022322+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.023218+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:24:04.103531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.f is not active+clean 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-10-09T13:13:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.023929+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:44:06.398914+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.025236+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:30:55.782519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.025526+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:43:58.532658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.025355+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:24:15.172872+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:13:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.025405+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:48:50.682969+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.6 is not active+clean 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.020207+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:09:14.281736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-10-09T13:13:44.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.023164+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:51:20.666091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.023969+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:37:09.623897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.5 is not active+clean 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.020209+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:03:03.889776+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2 is not active+clean 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.020886+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:58:48.278497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.023496+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:12:22.902744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-10-09T13:13:44.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.020872+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:24:22.402491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:13:44.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.16 is not active+clean 2023-10-09T13:13:44.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:13:38.017047+0000', 'last_change': '2023-10-09T13:13:38.017047+0000', 'last_active': '2023-10-09T13:13:38.017047+0000', 'last_peered': '2023-10-09T13:13:38.017047+0000', 'last_clean': '2023-10-09T13:13:38.017047+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:38.017047+0000', 'last_undegraded': '2023-10-09T13:13:38.017047+0000', 'last_fullsized': '2023-10-09T13:13:38.017047+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:38.017047+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:13:44.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-10-09T13:13:44.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:13:37.009450+0000', 'last_change': '2023-10-09T13:13:37.021034+0000', 'last_active': '2023-10-09T13:13:37.009450+0000', 'last_peered': '2023-10-09T13:13:37.009450+0000', 'last_clean': '2023-10-09T13:13:37.009450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:13:37.009450+0000', 'last_undegraded': '2023-10-09T13:13:37.009450+0000', 'last_fullsized': '2023-10-09T13:13:37.009450+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'last_clean_scrub_stamp': '2023-10-09T13:13:37.009450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:07:50.861295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:13:44.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T13:13:44.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.865+0000 7f32e4dff700 1 Processor -- start 2023-10-09T13:13:44.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.865+0000 7f32e4dff700 1 -- start start 2023-10-09T13:13:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.866+0000 7f32e4dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32e00b21f0 0x7f32e015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.866+0000 7f32e4dff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f32e0154320 0x7f32e0069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.866+0000 7f32e4dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e015b130 con 0x7f32e0153f50 2023-10-09T13:13:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.866+0000 7f32e4dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e015db50 con 0x7f32e00b21f0 2023-10-09T13:13:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.866+0000 7f32e4dff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e015de30 con 0x7f32e0154320 2023-10-09T13:13:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32e00b21f0 0x7f32e015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32e00b21f0 0x7f32e015abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49766/0 (socket says 172.21.15.86:49766) 2023-10-09T13:13:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 -- 172.21.15.86:0/2215451060 learned_addr learned my addr 172.21.15.86:0/2215451060 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:44.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ded9d700 1 --2- 172.21.15.86:0/2215451060 >> v2:172.21.15.135:3300/0 conn(0x7f32e0154320 0x7f32e0069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 -- 172.21.15.86:0/2215451060 >> v2:172.21.15.135:3300/0 conn(0x7f32e0154320 msgr2=0x7f32e0069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:44.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 --2- 172.21.15.86:0/2215451060 >> v2:172.21.15.135:3300/0 conn(0x7f32e0154320 0x7f32e0069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 -- 172.21.15.86:0/2215451060 >> v1:172.21.15.135:6789/0 conn(0x7f32e0153f50 legacy=0x7f32e00b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 -- 172.21.15.86:0/2215451060 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e015e110 con 0x7f32e00b21f0 2023-10-09T13:13:44.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.867+0000 7f32ddd9b700 1 --2- 172.21.15.86:0/2215451060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e00b21f0 0x7f32e015abf0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f32e00b46c0 tx=0x7f32d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5886ff7cac013ae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32dd59a700 1 -- 172.21.15.86:0/2215451060 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4009e70 con 0x7f32e00b21f0 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32dd59a700 1 -- 172.21.15.86:0/2215451060 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d400b860 con 0x7f32e00b21f0 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32dd59a700 1 -- 172.21.15.86:0/2215451060 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400bc00 con 0x7f32e00b21f0 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 -- 172.21.15.86:0/2215451060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e00b21f0 msgr2=0x7f32e015abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 --2- 172.21.15.86:0/2215451060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e00b21f0 0x7f32e015abf0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f32e00b46c0 tx=0x7f32d4009250 comp rx=0 tx=0).stop 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 -- 172.21.15.86:0/2215451060 shutdown_connections 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 --2- 172.21.15.86:0/2215451060 >> v2:172.21.15.135:3300/0 conn(0x7f32e0154320 0x7f32e0069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 --2- 172.21.15.86:0/2215451060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e00b21f0 0x7f32e015abf0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 -- 172.21.15.86:0/2215451060 >> 172.21.15.86:0/2215451060 conn(0x7f32e006baf0 msgr2=0x7f32e006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 -- 172.21.15.86:0/2215451060 shutdown_connections 2023-10-09T13:13:44.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.868+0000 7f32e4dff700 1 -- 172.21.15.86:0/2215451060 wait complete. 2023-10-09T13:13:44.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.870+0000 7f32e4dff700 1 Processor -- start 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.870+0000 7f32e4dff700 1 -- start start 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32e4dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32e00b21f0 0x7f32e00b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32e4dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e0153f50 0x7f32e0142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32e4dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32e0154320 0x7f32e00ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32e4dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00cd860 con 0x7f32e0153f50 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32e4dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01516f0 con 0x7f32e00b21f0 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32e4dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00b0700 con 0x7f32e0154320 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e0153f50 0x7f32e0142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e0153f50 0x7f32e0142220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:49778/0 (socket says 172.21.15.86:49778) 2023-10-09T13:13:44.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 -- 172.21.15.86:0/1523404796 learned_addr learned my addr 172.21.15.86:0/1523404796 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ded9d700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32e0154320 0x7f32e00ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32de59c700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32e00b21f0 0x7f32e00b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 -- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32e0154320 msgr2=0x7f32e00ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32e0154320 0x7f32e00ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 -- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32e00b21f0 msgr2=0x7f32e00b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32e00b21f0 0x7f32e00b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ddd9b700 1 -- 172.21.15.86:0/1523404796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40094f0 con 0x7f32e0153f50 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32ded9d700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32e0154320 0x7f32e00ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.871+0000 7f32de59c700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32e00b21f0 0x7f32e00b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.872+0000 7f32ddd9b700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e0153f50 0x7f32e0142220 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f32e006f610 tx=0x7f32d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:44.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.872+0000 7f32ce7fc700 1 -- 172.21.15.86:0/1523404796 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4011420 con 0x7f32e0153f50 2023-10-09T13:13:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.872+0000 7f32ce7fc700 1 -- 172.21.15.86:0/1523404796 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4011580 con 0x7f32e0153f50 2023-10-09T13:13:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.872+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e00afaf0 con 0x7f32e0153f50 2023-10-09T13:13:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.872+0000 7f32ce7fc700 1 -- 172.21.15.86:0/1523404796 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4011940 con 0x7f32e0153f50 2023-10-09T13:13:44.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.872+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e00b00b0 con 0x7f32e0153f50 2023-10-09T13:13:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.873+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e00b0890 con 0x7f32e0153f50 2023-10-09T13:13:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.874+0000 7f32ce7fc700 1 -- 172.21.15.86:0/1523404796 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32d402c3b0 con 0x7f32e0153f50 2023-10-09T13:13:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.875+0000 7f32ce7fc700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32c0066f30 0x7f32c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.875+0000 7f32ce7fc700 1 -- 172.21.15.86:0/1523404796 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f32d4085d80 con 0x7f32e0153f50 2023-10-09T13:13:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.875+0000 7f32de59c700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32c0066f30 0x7f32c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:44.877 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.876+0000 7f32de59c700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32c0066f30 0x7f32c00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32d0001840 tx=0x7f32d0009040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:44.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:44.879+0000 7f32ce7fc700 1 -- 172.21.15.86:0/1523404796 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32d4052d70 con 0x7f32e0153f50 2023-10-09T13:13:45.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.151+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f32e004c420 con 0x7f32e0153f50 2023-10-09T13:13:45.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.151+0000 7f32ce7fc700 1 -- 172.21.15.86:0/1523404796 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1180 (secure 0 0 0) 0x7f32d40154b0 con 0x7f32e0153f50 2023-10-09T13:13:45.153 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:45.153 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5577,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":196,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":38},{"state_name":"unknown","count":38},{"state_name":"creating+peering","count":21}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":590492,"bytes_used":2535571456,"bytes_avail":770558541824,"bytes_total":773094113280,"unknown_pgs_ratio":0.39175257086753845,"inactive_pgs_ratio":0.2164948433637619,"write_bytes_sec":1211,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":86,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"b","status":"up:active","gid":9672}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-10-09T13:09:25.098676+0000","services":{}},"progress_events":{}} 2023-10-09T13:13:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32c0066f30 msgr2=0x7f32c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32c0066f30 0x7f32c00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32d0001840 tx=0x7f32d0009040 comp rx=0 tx=0).stop 2023-10-09T13:13:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e0153f50 msgr2=0x7f32e0142220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e0153f50 0x7f32e0142220 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f32e006f610 tx=0x7f32d4017000 comp rx=0 tx=0).stop 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 shutdown_connections 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f32c0066f30 0x7f32c00693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32e0154320 0x7f32e00ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32e00b21f0 0x7f32e00b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 --2- 172.21.15.86:0/1523404796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32e0153f50 0x7f32e0142220 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.153+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 >> 172.21.15.86:0/1523404796 conn(0x7f32e006baf0 msgr2=0x7f32e015b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.154+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 shutdown_connections 2023-10-09T13:13:45.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.154+0000 7f32e4dff700 1 -- 172.21.15.86:0/1523404796 wait complete. 2023-10-09T13:13:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T13:13:45.173 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:13:45.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.352+0000 7fcfa81ff700 1 Processor -- start 2023-10-09T13:13:45.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.352+0000 7fcfa81ff700 1 -- start start 2023-10-09T13:13:45.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.353+0000 7fcfa81ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcfa0155c10 0x7fcfa0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:45.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.353+0000 7fcfa81ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00acac0 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.353+0000 7fcfa81ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00ad930 con 0x7fcfa00ac230 2023-10-09T13:13:45.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.353+0000 7fcfa81ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00acd20 con 0x7fcfa0155c10 2023-10-09T13:13:45.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa679c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcfa00ac6d0 0x7fcfa00b0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55956/0 (socket says 172.21.15.86:55956) 2023-10-09T13:13:45.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa679c700 1 -- 172.21.15.86:0/1435532728 learned_addr learned my addr 172.21.15.86:0/1435532728 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:45.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa5f9b700 1 --2- 172.21.15.86:0/1435532728 >> v2:172.21.15.135:3300/0 conn(0x7fcfa0155c10 0x7fcfa0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:45.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa4f99700 1 -- 172.21.15.86:0/1435532728 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765678608 0 0) 0x7fcfa00acac0 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa4f99700 1 -- 172.21.15.86:0/1435532728 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf8c004680 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa5f9b700 1 -- 172.21.15.86:0/1435532728 >> v1:172.21.15.135:6789/0 conn(0x7fcfa00ac230 legacy=0x7fcfa01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa4f99700 1 -- 172.21.15.86:0/1435532728 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539070717 0 0) 0x7fcfa00ad930 con 0x7fcfa00ac230 2023-10-09T13:13:45.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa5f9b700 1 -- 172.21.15.86:0/1435532728 >> v1:172.21.15.86:6789/0 conn(0x7fcfa00ac6d0 legacy=0x7fcfa00b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.354+0000 7fcfa5f9b700 1 -- 172.21.15.86:0/1435532728 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00ad000 con 0x7fcfa0155c10 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.355+0000 7fcfa5f9b700 1 --2- 172.21.15.86:0/1435532728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa0155c10 0x7fcfa0155fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0098e0 tx=0x7fcf9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac7c603781364a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.355+0000 7fcfa4f99700 1 -- 172.21.15.86:0/1435532728 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00b640 con 0x7fcfa0155c10 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.355+0000 7fcfa4f99700 1 -- 172.21.15.86:0/1435532728 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00b7a0 con 0x7fcfa0155c10 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.355+0000 7fcfa4f99700 1 -- 172.21.15.86:0/1435532728 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00bb40 con 0x7fcfa0155c10 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.355+0000 7fcfa81ff700 1 -- 172.21.15.86:0/1435532728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa0155c10 msgr2=0x7fcfa0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.355+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/1435532728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa0155c10 0x7fcfa0155fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0098e0 tx=0x7fcf9c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.356+0000 7fcfa81ff700 1 -- 172.21.15.86:0/1435532728 shutdown_connections 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.356+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/1435532728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa0155c10 0x7fcfa0155fe0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.356+0000 7fcfa81ff700 1 -- 172.21.15.86:0/1435532728 >> 172.21.15.86:0/1435532728 conn(0x7fcfa006a320 msgr2=0x7fcfa00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:45.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.356+0000 7fcfa81ff700 1 -- 172.21.15.86:0/1435532728 shutdown_connections 2023-10-09T13:13:45.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.356+0000 7fcfa81ff700 1 -- 172.21.15.86:0/1435532728 wait complete. 2023-10-09T13:13:45.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.357+0000 7fcfa81ff700 1 Processor -- start 2023-10-09T13:13:45.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.357+0000 7fcfa81ff700 1 -- start start 2023-10-09T13:13:45.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa81ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa00ac230 0x7fcfa00caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:45.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa81ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa00ac6d0 0x7fcfa015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:45.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa81ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa0155c10 0x7fcfa014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:45.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa81ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa016b6e0 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa81ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00cba20 con 0x7fcfa00ac230 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa81ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00cb740 con 0x7fcfa0155c10 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa579a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa00ac6d0 0x7fcfa015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa5f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa00ac230 0x7fcfa00caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa579a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa00ac6d0 0x7fcfa015b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55260/0 (socket says 172.21.15.86:55260) 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.358+0000 7fcfa579a700 1 -- 172.21.15.86:0/339313312 learned_addr learned my addr 172.21.15.86:0/339313312 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa679c700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa0155c10 0x7fcfa014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa579a700 1 -- 172.21.15.86:0/339313312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa0155c10 msgr2=0x7fcfa014dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa579a700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa0155c10 0x7fcfa014dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa579a700 1 -- 172.21.15.86:0/339313312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa00ac230 msgr2=0x7fcfa00caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa579a700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa00ac230 0x7fcfa00caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa579a700 1 -- 172.21.15.86:0/339313312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c009420 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa579a700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa00ac6d0 0x7fcfa015b150 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c7e0 tx=0x7fcf90007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:45.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcf95ffb700 1 -- 172.21.15.86:0/339313312 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900105c0 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcf95ffb700 1 -- 172.21.15.86:0/339313312 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90010740 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcf95ffb700 1 -- 172.21.15.86:0/339313312 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90010b00 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa016b090 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.359+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa00cb430 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.360+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa016b890 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.361+0000 7fcf95ffb700 1 -- 172.21.15.86:0/339313312 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf9001b3b0 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.363+0000 7fcf95ffb700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcf84066f30 0x7fcf840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:45.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.363+0000 7fcf95ffb700 1 -- 172.21.15.86:0/339313312 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fcf90083d00 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.363+0000 7fcfa5f9b700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcf84066f30 0x7fcf840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:45.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.364+0000 7fcfa5f9b700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcf84066f30 0x7fcf840693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0093f0 tx=0x7fcf9c017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:45.368 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.367+0000 7fcf95ffb700 1 -- 172.21.15.86:0/339313312 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfa016b890 con 0x7fcfa00ac6d0 2023-10-09T13:13:45.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.555+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfa004c3c0 con 0x7fcf84066f30 2023-10-09T13:13:45.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.563+0000 7fcf95ffb700 1 -- 172.21.15.86:0/339313312 <== mgr.9462 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289405 (secure 0 0 0) 0x7fcfa004c3c0 con 0x7fcf84066f30 2023-10-09T13:13:45.568 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcf84066f30 msgr2=0x7fcf840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcf84066f30 0x7fcf840693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0093f0 tx=0x7fcf9c017000 comp rx=0 tx=0).stop 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa00ac6d0 msgr2=0x7fcfa015b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa00ac6d0 0x7fcfa015b150 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c7e0 tx=0x7fcf90007df0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 shutdown_connections 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fcf84066f30 0x7fcf840693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcfa0155c10 0x7fcfa014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfa00ac230 0x7fcfa00caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 --2- 172.21.15.86:0/339313312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfa00ac6d0 0x7fcfa015b150 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:45.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 >> 172.21.15.86:0/339313312 conn(0x7fcfa006a320 msgr2=0x7fcfa0154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:45.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 shutdown_connections 2023-10-09T13:13:45.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:45.568+0000 7fcfa81ff700 1 -- 172.21.15.86:0/339313312 wait complete. 2023-10-09T13:13:45.572 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:13:45.587 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T13:13:44.938004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476392,"kb_used_data":20264,"kb_used_omap":0,"kb_used_meta":2456064,"kb_avail":752498328,"statfs":{"total":773094113280,"available":770558287872,"internally_reserved":0,"allocated":20750336,"data_stored":10975916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2515009536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.915051"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055077+0000","last_change":"2023-10-09T13:13:39.051803+0000","last_active":"2023-10-09T13:13:39.055077+0000","last_peered":"2023-10-09T13:13:39.055077+0000","last_clean":"2023-10-09T13:13:39.055077+0000","last_became_active":"2023-10-09T13:13:39.051538+0000","last_became_peered":"2023-10-09T13:13:39.051538+0000","last_unstale":"2023-10-09T13:13:39.055077+0000","last_undegraded":"2023-10-09T13:13:39.055077+0000","last_fullsized":"2023-10-09T13:13:39.055077+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:17.828958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062311+0000","last_change":"2023-10-09T13:13:39.058242+0000","last_active":"2023-10-09T13:13:39.062311+0000","last_peered":"2023-10-09T13:13:39.062311+0000","last_clean":"2023-10-09T13:13:39.062311+0000","last_became_active":"2023-10-09T13:13:39.057927+0000","last_became_peered":"2023-10-09T13:13:39.057927+0000","last_unstale":"2023-10-09T13:13:39.062311+0000","last_undegraded":"2023-10-09T13:13:39.062311+0000","last_fullsized":"2023-10-09T13:13:39.062311+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:15.509723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047554+0000","last_change":"2023-10-09T13:13:39.045451+0000","last_active":"2023-10-09T13:13:39.047554+0000","last_peered":"2023-10-09T13:13:39.047554+0000","last_clean":"2023-10-09T13:13:39.047554+0000","last_became_active":"2023-10-09T13:13:39.045025+0000","last_became_peered":"2023-10-09T13:13:39.045025+0000","last_unstale":"2023-10-09T13:13:39.047554+0000","last_undegraded":"2023-10-09T13:13:39.047554+0000","last_fullsized":"2023-10-09T13:13:39.047554+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:47.848709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059582+0000","last_change":"2023-10-09T13:13:39.052976+0000","last_active":"2023-10-09T13:13:39.059582+0000","last_peered":"2023-10-09T13:13:39.059582+0000","last_clean":"2023-10-09T13:13:39.059582+0000","last_became_active":"2023-10-09T13:13:39.052731+0000","last_became_peered":"2023-10-09T13:13:39.052731+0000","last_unstale":"2023-10-09T13:13:39.059582+0000","last_undegraded":"2023-10-09T13:13:39.059582+0000","last_fullsized":"2023-10-09T13:13:39.059582+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:57.794933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063449+0000","last_change":"2023-10-09T13:13:39.059734+0000","last_active":"2023-10-09T13:13:39.063449+0000","last_peered":"2023-10-09T13:13:39.063449+0000","last_clean":"2023-10-09T13:13:39.063449+0000","last_became_active":"2023-10-09T13:13:39.059388+0000","last_became_peered":"2023-10-09T13:13:39.059388+0000","last_unstale":"2023-10-09T13:13:39.063449+0000","last_undegraded":"2023-10-09T13:13:39.063449+0000","last_fullsized":"2023-10-09T13:13:39.063449+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:47.507277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059269+0000","last_change":"2023-10-09T13:13:39.054489+0000","last_active":"2023-10-09T13:13:39.059269+0000","last_peered":"2023-10-09T13:13:39.059269+0000","last_clean":"2023-10-09T13:13:39.059269+0000","last_became_active":"2023-10-09T13:13:39.054222+0000","last_became_peered":"2023-10-09T13:13:39.054222+0000","last_unstale":"2023-10-09T13:13:39.059269+0000","last_undegraded":"2023-10-09T13:13:39.059269+0000","last_fullsized":"2023-10-09T13:13:39.059269+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:33.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063435+0000","last_change":"2023-10-09T13:13:39.060449+0000","last_active":"2023-10-09T13:13:39.063435+0000","last_peered":"2023-10-09T13:13:39.063435+0000","last_clean":"2023-10-09T13:13:39.063435+0000","last_became_active":"2023-10-09T13:13:39.059646+0000","last_became_peered":"2023-10-09T13:13:39.059646+0000","last_unstale":"2023-10-09T13:13:39.063435+0000","last_undegraded":"2023-10-09T13:13:39.063435+0000","last_fullsized":"2023-10-09T13:13:39.063435+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:46.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.064277+0000","last_change":"2023-10-09T13:13:39.061682+0000","last_active":"2023-10-09T13:13:39.064277+0000","last_peered":"2023-10-09T13:13:39.064277+0000","last_clean":"2023-10-09T13:13:39.064277+0000","last_became_active":"2023-10-09T13:13:39.061330+0000","last_became_peered":"2023-10-09T13:13:39.061330+0000","last_unstale":"2023-10-09T13:13:39.064277+0000","last_undegraded":"2023-10-09T13:13:39.064277+0000","last_fullsized":"2023-10-09T13:13:39.064277+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:11.397075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062165+0000","last_change":"2023-10-09T13:13:39.057496+0000","last_active":"2023-10-09T13:13:39.062165+0000","last_peered":"2023-10-09T13:13:39.062165+0000","last_clean":"2023-10-09T13:13:39.062165+0000","last_became_active":"2023-10-09T13:13:39.057228+0000","last_became_peered":"2023-10-09T13:13:39.057228+0000","last_unstale":"2023-10-09T13:13:39.062165+0000","last_undegraded":"2023-10-09T13:13:39.062165+0000","last_fullsized":"2023-10-09T13:13:39.062165+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:55.140436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063611+0000","last_change":"2023-10-09T13:13:39.060458+0000","last_active":"2023-10-09T13:13:39.063611+0000","last_peered":"2023-10-09T13:13:39.063611+0000","last_clean":"2023-10-09T13:13:39.063611+0000","last_became_active":"2023-10-09T13:13:39.059067+0000","last_became_peered":"2023-10-09T13:13:39.059067+0000","last_unstale":"2023-10-09T13:13:39.063611+0000","last_undegraded":"2023-10-09T13:13:39.063611+0000","last_fullsized":"2023-10-09T13:13:39.063611+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:12.859119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.064194+0000","last_change":"2023-10-09T13:13:39.062872+0000","last_active":"2023-10-09T13:13:39.064194+0000","last_peered":"2023-10-09T13:13:39.064194+0000","last_clean":"2023-10-09T13:13:39.064194+0000","last_became_active":"2023-10-09T13:13:39.062529+0000","last_became_peered":"2023-10-09T13:13:39.062529+0000","last_unstale":"2023-10-09T13:13:39.064194+0000","last_undegraded":"2023-10-09T13:13:39.064194+0000","last_fullsized":"2023-10-09T13:13:39.064194+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:29.881735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062356+0000","last_change":"2023-10-09T13:13:39.058305+0000","last_active":"2023-10-09T13:13:39.062356+0000","last_peered":"2023-10-09T13:13:39.062356+0000","last_clean":"2023-10-09T13:13:39.062356+0000","last_became_active":"2023-10-09T13:13:39.057981+0000","last_became_peered":"2023-10-09T13:13:39.057981+0000","last_unstale":"2023-10-09T13:13:39.062356+0000","last_undegraded":"2023-10-09T13:13:39.062356+0000","last_fullsized":"2023-10-09T13:13:39.062356+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:47.493217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058685+0000","last_change":"2023-10-09T13:13:39.053561+0000","last_active":"2023-10-09T13:13:39.058685+0000","last_peered":"2023-10-09T13:13:39.058685+0000","last_clean":"2023-10-09T13:13:39.058685+0000","last_became_active":"2023-10-09T13:13:39.053302+0000","last_became_peered":"2023-10-09T13:13:39.053302+0000","last_unstale":"2023-10-09T13:13:39.058685+0000","last_undegraded":"2023-10-09T13:13:39.058685+0000","last_fullsized":"2023-10-09T13:13:39.058685+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:52:45.664285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058241+0000","last_change":"2023-10-09T13:13:39.051566+0000","last_active":"2023-10-09T13:13:39.058241+0000","last_peered":"2023-10-09T13:13:39.058241+0000","last_clean":"2023-10-09T13:13:39.058241+0000","last_became_active":"2023-10-09T13:13:39.051211+0000","last_became_peered":"2023-10-09T13:13:39.051211+0000","last_unstale":"2023-10-09T13:13:39.058241+0000","last_undegraded":"2023-10-09T13:13:39.058241+0000","last_fullsized":"2023-10-09T13:13:39.058241+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:46.695644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.057126+0000","last_change":"2023-10-09T13:13:39.055152+0000","last_active":"2023-10-09T13:13:39.057126+0000","last_peered":"2023-10-09T13:13:39.057126+0000","last_clean":"2023-10-09T13:13:39.057126+0000","last_became_active":"2023-10-09T13:13:39.054838+0000","last_became_peered":"2023-10-09T13:13:39.054838+0000","last_unstale":"2023-10-09T13:13:39.057126+0000","last_undegraded":"2023-10-09T13:13:39.057126+0000","last_fullsized":"2023-10-09T13:13:39.057126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:20.377531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.054529+0000","last_change":"2023-10-09T13:13:39.051097+0000","last_active":"2023-10-09T13:13:39.054529+0000","last_peered":"2023-10-09T13:13:39.054529+0000","last_clean":"2023-10-09T13:13:39.054529+0000","last_became_active":"2023-10-09T13:13:39.050849+0000","last_became_peered":"2023-10-09T13:13:39.050849+0000","last_unstale":"2023-10-09T13:13:39.054529+0000","last_undegraded":"2023-10-09T13:13:39.054529+0000","last_fullsized":"2023-10-09T13:13:39.054529+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:57.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047721+0000","last_change":"2023-10-09T13:13:39.045335+0000","last_active":"2023-10-09T13:13:39.047721+0000","last_peered":"2023-10-09T13:13:39.047721+0000","last_clean":"2023-10-09T13:13:39.047721+0000","last_became_active":"2023-10-09T13:13:39.045012+0000","last_became_peered":"2023-10-09T13:13:39.045012+0000","last_unstale":"2023-10-09T13:13:39.047721+0000","last_undegraded":"2023-10-09T13:13:39.047721+0000","last_fullsized":"2023-10-09T13:13:39.047721+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:53.421996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061377+0000","last_change":"2023-10-09T13:13:39.058050+0000","last_active":"2023-10-09T13:13:39.061377+0000","last_peered":"2023-10-09T13:13:39.061377+0000","last_clean":"2023-10-09T13:13:39.061377+0000","last_became_active":"2023-10-09T13:13:39.057663+0000","last_became_peered":"2023-10-09T13:13:39.057663+0000","last_unstale":"2023-10-09T13:13:39.061377+0000","last_undegraded":"2023-10-09T13:13:39.061377+0000","last_fullsized":"2023-10-09T13:13:39.061377+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:57.858815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.050776+0000","last_change":"2023-10-09T13:13:39.047770+0000","last_active":"2023-10-09T13:13:39.050776+0000","last_peered":"2023-10-09T13:13:39.050776+0000","last_clean":"2023-10-09T13:13:39.050776+0000","last_became_active":"2023-10-09T13:13:39.047485+0000","last_became_peered":"2023-10-09T13:13:39.047485+0000","last_unstale":"2023-10-09T13:13:39.050776+0000","last_undegraded":"2023-10-09T13:13:39.050776+0000","last_fullsized":"2023-10-09T13:13:39.050776+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:32.687561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058099+0000","last_change":"2023-10-09T13:13:39.051563+0000","last_active":"2023-10-09T13:13:39.058099+0000","last_peered":"2023-10-09T13:13:39.058099+0000","last_clean":"2023-10-09T13:13:39.058099+0000","last_became_active":"2023-10-09T13:13:39.051261+0000","last_became_peered":"2023-10-09T13:13:39.051261+0000","last_unstale":"2023-10-09T13:13:39.058099+0000","last_undegraded":"2023-10-09T13:13:39.058099+0000","last_fullsized":"2023-10-09T13:13:39.058099+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:16.440128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046746+0000","last_change":"2023-10-09T13:13:39.044650+0000","last_active":"2023-10-09T13:13:39.046746+0000","last_peered":"2023-10-09T13:13:39.046746+0000","last_clean":"2023-10-09T13:13:39.046746+0000","last_became_active":"2023-10-09T13:13:39.044230+0000","last_became_peered":"2023-10-09T13:13:39.044230+0000","last_unstale":"2023-10-09T13:13:39.046746+0000","last_undegraded":"2023-10-09T13:13:39.046746+0000","last_fullsized":"2023-10-09T13:13:39.046746+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:13.117007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061926+0000","last_change":"2023-10-09T13:13:39.056593+0000","last_active":"2023-10-09T13:13:39.061926+0000","last_peered":"2023-10-09T13:13:39.061926+0000","last_clean":"2023-10-09T13:13:39.061926+0000","last_became_active":"2023-10-09T13:13:39.056335+0000","last_became_peered":"2023-10-09T13:13:39.056335+0000","last_unstale":"2023-10-09T13:13:39.061926+0000","last_undegraded":"2023-10-09T13:13:39.061926+0000","last_fullsized":"2023-10-09T13:13:39.061926+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:39.680179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063289+0000","last_change":"2023-10-09T13:13:39.060979+0000","last_active":"2023-10-09T13:13:39.063289+0000","last_peered":"2023-10-09T13:13:39.063289+0000","last_clean":"2023-10-09T13:13:39.063289+0000","last_became_active":"2023-10-09T13:13:39.060695+0000","last_became_peered":"2023-10-09T13:13:39.060695+0000","last_unstale":"2023-10-09T13:13:39.063289+0000","last_undegraded":"2023-10-09T13:13:39.063289+0000","last_fullsized":"2023-10-09T13:13:39.063289+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:03.435693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.064295+0000","last_change":"2023-10-09T13:13:39.061989+0000","last_active":"2023-10-09T13:13:39.064295+0000","last_peered":"2023-10-09T13:13:39.064295+0000","last_clean":"2023-10-09T13:13:39.064295+0000","last_became_active":"2023-10-09T13:13:39.061697+0000","last_became_peered":"2023-10-09T13:13:39.061697+0000","last_unstale":"2023-10-09T13:13:39.064295+0000","last_undegraded":"2023-10-09T13:13:39.064295+0000","last_fullsized":"2023-10-09T13:13:39.064295+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.710649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047373+0000","last_change":"2023-10-09T13:13:39.045857+0000","last_active":"2023-10-09T13:13:39.047373+0000","last_peered":"2023-10-09T13:13:39.047373+0000","last_clean":"2023-10-09T13:13:39.047373+0000","last_became_active":"2023-10-09T13:13:39.045564+0000","last_became_peered":"2023-10-09T13:13:39.045564+0000","last_unstale":"2023-10-09T13:13:39.047373+0000","last_undegraded":"2023-10-09T13:13:39.047373+0000","last_fullsized":"2023-10-09T13:13:39.047373+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:02.187523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060171+0000","last_change":"2023-10-09T13:13:39.056226+0000","last_active":"2023-10-09T13:13:39.060171+0000","last_peered":"2023-10-09T13:13:39.060171+0000","last_clean":"2023-10-09T13:13:39.060171+0000","last_became_active":"2023-10-09T13:13:39.055652+0000","last_became_peered":"2023-10-09T13:13:39.055652+0000","last_unstale":"2023-10-09T13:13:39.060171+0000","last_undegraded":"2023-10-09T13:13:39.060171+0000","last_fullsized":"2023-10-09T13:13:39.060171+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:43.352357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051709+0000","last_change":"2023-10-09T13:13:39.047726+0000","last_active":"2023-10-09T13:13:39.051709+0000","last_peered":"2023-10-09T13:13:39.051709+0000","last_clean":"2023-10-09T13:13:39.051709+0000","last_became_active":"2023-10-09T13:13:39.047362+0000","last_became_peered":"2023-10-09T13:13:39.047362+0000","last_unstale":"2023-10-09T13:13:39.051709+0000","last_undegraded":"2023-10-09T13:13:39.051709+0000","last_fullsized":"2023-10-09T13:13:39.051709+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:06:41.833506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063042+0000","last_change":"2023-10-09T13:13:39.059455+0000","last_active":"2023-10-09T13:13:39.063042+0000","last_peered":"2023-10-09T13:13:39.063042+0000","last_clean":"2023-10-09T13:13:39.063042+0000","last_became_active":"2023-10-09T13:13:39.058865+0000","last_became_peered":"2023-10-09T13:13:39.058865+0000","last_unstale":"2023-10-09T13:13:39.063042+0000","last_undegraded":"2023-10-09T13:13:39.063042+0000","last_fullsized":"2023-10-09T13:13:39.063042+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:23.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058667+0000","last_change":"2023-10-09T13:13:39.049187+0000","last_active":"2023-10-09T13:13:39.058667+0000","last_peered":"2023-10-09T13:13:39.058667+0000","last_clean":"2023-10-09T13:13:39.058667+0000","last_became_active":"2023-10-09T13:13:39.048933+0000","last_became_peered":"2023-10-09T13:13:39.048933+0000","last_unstale":"2023-10-09T13:13:39.058667+0000","last_undegraded":"2023-10-09T13:13:39.058667+0000","last_fullsized":"2023-10-09T13:13:39.058667+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:21.387772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.056267+0000","last_change":"2023-10-09T13:13:39.048521+0000","last_active":"2023-10-09T13:13:39.056267+0000","last_peered":"2023-10-09T13:13:39.056267+0000","last_clean":"2023-10-09T13:13:39.056267+0000","last_became_active":"2023-10-09T13:13:39.048269+0000","last_became_peered":"2023-10-09T13:13:39.048269+0000","last_unstale":"2023-10-09T13:13:39.056267+0000","last_undegraded":"2023-10-09T13:13:39.056267+0000","last_fullsized":"2023-10-09T13:13:39.056267+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:15.509723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058312+0000","last_change":"2023-10-09T13:13:39.053663+0000","last_active":"2023-10-09T13:13:39.058312+0000","last_peered":"2023-10-09T13:13:39.058312+0000","last_clean":"2023-10-09T13:13:39.058312+0000","last_became_active":"2023-10-09T13:13:39.053405+0000","last_became_peered":"2023-10-09T13:13:39.053405+0000","last_unstale":"2023-10-09T13:13:39.058312+0000","last_undegraded":"2023-10-09T13:13:39.058312+0000","last_fullsized":"2023-10-09T13:13:39.058312+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:33.878986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.056295+0000","last_change":"2023-10-09T13:13:39.053269+0000","last_active":"2023-10-09T13:13:39.056295+0000","last_peered":"2023-10-09T13:13:39.056295+0000","last_clean":"2023-10-09T13:13:39.056295+0000","last_became_active":"2023-10-09T13:13:39.052973+0000","last_became_peered":"2023-10-09T13:13:39.052973+0000","last_unstale":"2023-10-09T13:13:39.056295+0000","last_undegraded":"2023-10-09T13:13:39.056295+0000","last_fullsized":"2023-10-09T13:13:39.056295+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:50.679131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058088+0000","last_change":"2023-10-09T13:13:39.054890+0000","last_active":"2023-10-09T13:13:39.058088+0000","last_peered":"2023-10-09T13:13:39.058088+0000","last_clean":"2023-10-09T13:13:39.058088+0000","last_became_active":"2023-10-09T13:13:39.054491+0000","last_became_peered":"2023-10-09T13:13:39.054491+0000","last_unstale":"2023-10-09T13:13:39.058088+0000","last_undegraded":"2023-10-09T13:13:39.058088+0000","last_fullsized":"2023-10-09T13:13:39.058088+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:31.565289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.438086+0000","last_change":"2023-10-09T13:13:38.039309+0000","last_active":"2023-10-09T13:13:39.438086+0000","last_peered":"2023-10-09T13:13:39.438086+0000","last_clean":"2023-10-09T13:13:39.438086+0000","last_became_active":"2023-10-09T13:13:38.038996+0000","last_became_peered":"2023-10-09T13:13:38.038996+0000","last_unstale":"2023-10-09T13:13:39.438086+0000","last_undegraded":"2023-10-09T13:13:39.438086+0000","last_fullsized":"2023-10-09T13:13:39.438086+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:10.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058314+0000","last_change":"2023-10-09T13:13:39.054226+0000","last_active":"2023-10-09T13:13:39.058314+0000","last_peered":"2023-10-09T13:13:39.058314+0000","last_clean":"2023-10-09T13:13:39.058314+0000","last_became_active":"2023-10-09T13:13:39.053973+0000","last_became_peered":"2023-10-09T13:13:39.053973+0000","last_unstale":"2023-10-09T13:13:39.058314+0000","last_undegraded":"2023-10-09T13:13:39.058314+0000","last_fullsized":"2023-10-09T13:13:39.058314+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.710649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436285+0000","last_change":"2023-10-09T13:13:38.039171+0000","last_active":"2023-10-09T13:13:39.436285+0000","last_peered":"2023-10-09T13:13:39.436285+0000","last_clean":"2023-10-09T13:13:39.436285+0000","last_became_active":"2023-10-09T13:13:38.038933+0000","last_became_peered":"2023-10-09T13:13:38.038933+0000","last_unstale":"2023-10-09T13:13:39.436285+0000","last_undegraded":"2023-10-09T13:13:39.436285+0000","last_fullsized":"2023-10-09T13:13:39.436285+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:47.407733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.057051+0000","last_change":"2023-10-09T13:13:39.052087+0000","last_active":"2023-10-09T13:13:39.057051+0000","last_peered":"2023-10-09T13:13:39.057051+0000","last_clean":"2023-10-09T13:13:39.057051+0000","last_became_active":"2023-10-09T13:13:39.051831+0000","last_became_peered":"2023-10-09T13:13:39.051831+0000","last_unstale":"2023-10-09T13:13:39.057051+0000","last_undegraded":"2023-10-09T13:13:39.057051+0000","last_fullsized":"2023-10-09T13:13:39.057051+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:12.871127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439619+0000","last_change":"2023-10-09T13:13:38.043827+0000","last_active":"2023-10-09T13:13:39.439619+0000","last_peered":"2023-10-09T13:13:39.439619+0000","last_clean":"2023-10-09T13:13:39.439619+0000","last_became_active":"2023-10-09T13:13:38.043580+0000","last_became_peered":"2023-10-09T13:13:38.043580+0000","last_unstale":"2023-10-09T13:13:39.439619+0000","last_undegraded":"2023-10-09T13:13:39.439619+0000","last_fullsized":"2023-10-09T13:13:39.439619+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:03.497163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046781+0000","last_change":"2023-10-09T13:13:39.043245+0000","last_active":"2023-10-09T13:13:39.046781+0000","last_peered":"2023-10-09T13:13:39.046781+0000","last_clean":"2023-10-09T13:13:39.046781+0000","last_became_active":"2023-10-09T13:13:39.042948+0000","last_became_peered":"2023-10-09T13:13:39.042948+0000","last_unstale":"2023-10-09T13:13:39.046781+0000","last_undegraded":"2023-10-09T13:13:39.046781+0000","last_fullsized":"2023-10-09T13:13:39.046781+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:38.370295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437959+0000","last_change":"2023-10-09T13:13:38.042462+0000","last_active":"2023-10-09T13:13:39.437959+0000","last_peered":"2023-10-09T13:13:39.437959+0000","last_clean":"2023-10-09T13:13:39.437959+0000","last_became_active":"2023-10-09T13:13:38.041868+0000","last_became_peered":"2023-10-09T13:13:38.041868+0000","last_unstale":"2023-10-09T13:13:39.437959+0000","last_undegraded":"2023-10-09T13:13:39.437959+0000","last_fullsized":"2023-10-09T13:13:39.437959+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:37.362698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055977+0000","last_change":"2023-10-09T13:13:39.051631+0000","last_active":"2023-10-09T13:13:39.055977+0000","last_peered":"2023-10-09T13:13:39.055977+0000","last_clean":"2023-10-09T13:13:39.055977+0000","last_became_active":"2023-10-09T13:13:39.051379+0000","last_became_peered":"2023-10-09T13:13:39.051379+0000","last_unstale":"2023-10-09T13:13:39.055977+0000","last_undegraded":"2023-10-09T13:13:39.055977+0000","last_fullsized":"2023-10-09T13:13:39.055977+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:09.176798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437439+0000","last_change":"2023-10-09T13:13:38.044192+0000","last_active":"2023-10-09T13:13:39.437439+0000","last_peered":"2023-10-09T13:13:39.437439+0000","last_clean":"2023-10-09T13:13:39.437439+0000","last_became_active":"2023-10-09T13:13:38.043798+0000","last_became_peered":"2023-10-09T13:13:38.043798+0000","last_unstale":"2023-10-09T13:13:39.437439+0000","last_undegraded":"2023-10-09T13:13:39.437439+0000","last_fullsized":"2023-10-09T13:13:39.437439+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:23.864556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060214+0000","last_change":"2023-10-09T13:13:39.055627+0000","last_active":"2023-10-09T13:13:39.060214+0000","last_peered":"2023-10-09T13:13:39.060214+0000","last_clean":"2023-10-09T13:13:39.060214+0000","last_became_active":"2023-10-09T13:13:39.055356+0000","last_became_peered":"2023-10-09T13:13:39.055356+0000","last_unstale":"2023-10-09T13:13:39.060214+0000","last_undegraded":"2023-10-09T13:13:39.060214+0000","last_fullsized":"2023-10-09T13:13:39.060214+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:49.286094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436660+0000","last_change":"2023-10-09T13:13:38.038204+0000","last_active":"2023-10-09T13:13:39.436660+0000","last_peered":"2023-10-09T13:13:39.436660+0000","last_clean":"2023-10-09T13:13:39.436660+0000","last_became_active":"2023-10-09T13:13:38.037962+0000","last_became_peered":"2023-10-09T13:13:38.037962+0000","last_unstale":"2023-10-09T13:13:39.436660+0000","last_undegraded":"2023-10-09T13:13:39.436660+0000","last_fullsized":"2023-10-09T13:13:39.436660+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:40.996599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055126+0000","last_change":"2023-10-09T13:13:39.048480+0000","last_active":"2023-10-09T13:13:39.055126+0000","last_peered":"2023-10-09T13:13:39.055126+0000","last_clean":"2023-10-09T13:13:39.055126+0000","last_became_active":"2023-10-09T13:13:39.048230+0000","last_became_peered":"2023-10-09T13:13:39.048230+0000","last_unstale":"2023-10-09T13:13:39.055126+0000","last_undegraded":"2023-10-09T13:13:39.055126+0000","last_fullsized":"2023-10-09T13:13:39.055126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:32.917517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.053446+0000","last_change":"2023-10-09T13:13:38.045460+0000","last_active":"2023-10-09T13:13:39.053446+0000","last_peered":"2023-10-09T13:13:39.053446+0000","last_clean":"2023-10-09T13:13:39.053446+0000","last_became_active":"2023-10-09T13:13:38.045187+0000","last_became_peered":"2023-10-09T13:13:38.045187+0000","last_unstale":"2023-10-09T13:13:39.053446+0000","last_undegraded":"2023-10-09T13:13:39.053446+0000","last_fullsized":"2023-10-09T13:13:39.053446+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:53.236078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059456+0000","last_change":"2023-10-09T13:13:39.055277+0000","last_active":"2023-10-09T13:13:39.059456+0000","last_peered":"2023-10-09T13:13:39.059456+0000","last_clean":"2023-10-09T13:13:39.059456+0000","last_became_active":"2023-10-09T13:13:39.054981+0000","last_became_peered":"2023-10-09T13:13:39.054981+0000","last_unstale":"2023-10-09T13:13:39.059456+0000","last_undegraded":"2023-10-09T13:13:39.059456+0000","last_fullsized":"2023-10-09T13:13:39.059456+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:58.227515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.049142+0000","last_change":"2023-10-09T13:13:38.038128+0000","last_active":"2023-10-09T13:13:39.049142+0000","last_peered":"2023-10-09T13:13:39.049142+0000","last_clean":"2023-10-09T13:13:39.049142+0000","last_became_active":"2023-10-09T13:13:38.037818+0000","last_became_peered":"2023-10-09T13:13:38.037818+0000","last_unstale":"2023-10-09T13:13:39.049142+0000","last_undegraded":"2023-10-09T13:13:39.049142+0000","last_fullsized":"2023-10-09T13:13:39.049142+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:28.307900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061545+0000","last_change":"2023-10-09T13:13:39.056626+0000","last_active":"2023-10-09T13:13:39.061545+0000","last_peered":"2023-10-09T13:13:39.061545+0000","last_clean":"2023-10-09T13:13:39.061545+0000","last_became_active":"2023-10-09T13:13:39.056354+0000","last_became_peered":"2023-10-09T13:13:39.056354+0000","last_unstale":"2023-10-09T13:13:39.061545+0000","last_undegraded":"2023-10-09T13:13:39.061545+0000","last_fullsized":"2023-10-09T13:13:39.061545+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:43.352357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.037732+0000","last_change":"2023-10-09T13:13:38.043104+0000","last_active":"2023-10-09T13:13:39.037732+0000","last_peered":"2023-10-09T13:13:39.037732+0000","last_clean":"2023-10-09T13:13:39.037732+0000","last_became_active":"2023-10-09T13:13:38.042789+0000","last_became_peered":"2023-10-09T13:13:38.042789+0000","last_unstale":"2023-10-09T13:13:39.037732+0000","last_undegraded":"2023-10-09T13:13:39.037732+0000","last_fullsized":"2023-10-09T13:13:39.037732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:36.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061685+0000","last_change":"2023-10-09T13:13:39.057524+0000","last_active":"2023-10-09T13:13:39.061685+0000","last_peered":"2023-10-09T13:13:39.061685+0000","last_clean":"2023-10-09T13:13:39.061685+0000","last_became_active":"2023-10-09T13:13:39.057280+0000","last_became_peered":"2023-10-09T13:13:39.057280+0000","last_unstale":"2023-10-09T13:13:39.061685+0000","last_undegraded":"2023-10-09T13:13:39.061685+0000","last_fullsized":"2023-10-09T13:13:39.061685+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:50.728455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437745+0000","last_change":"2023-10-09T13:13:38.031271+0000","last_active":"2023-10-09T13:13:39.437745+0000","last_peered":"2023-10-09T13:13:39.437745+0000","last_clean":"2023-10-09T13:13:39.437745+0000","last_became_active":"2023-10-09T13:13:38.030990+0000","last_became_peered":"2023-10-09T13:13:38.030990+0000","last_unstale":"2023-10-09T13:13:39.437745+0000","last_undegraded":"2023-10-09T13:13:39.437745+0000","last_fullsized":"2023-10-09T13:13:39.437745+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:40.953726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.049449+0000","last_change":"2023-10-09T13:13:39.047608+0000","last_active":"2023-10-09T13:13:39.049449+0000","last_peered":"2023-10-09T13:13:39.049449+0000","last_clean":"2023-10-09T13:13:39.049449+0000","last_became_active":"2023-10-09T13:13:39.047047+0000","last_became_peered":"2023-10-09T13:13:39.047047+0000","last_unstale":"2023-10-09T13:13:39.049449+0000","last_undegraded":"2023-10-09T13:13:39.049449+0000","last_fullsized":"2023-10-09T13:13:39.049449+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:47.493217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"195'6","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.441932+0000","last_change":"2023-10-09T13:13:38.038975+0000","last_active":"2023-10-09T13:13:39.441932+0000","last_peered":"2023-10-09T13:13:39.441932+0000","last_clean":"2023-10-09T13:13:39.441932+0000","last_became_active":"2023-10-09T13:13:38.038260+0000","last_became_peered":"2023-10-09T13:13:38.038260+0000","last_unstale":"2023-10-09T13:13:39.441932+0000","last_undegraded":"2023-10-09T13:13:39.441932+0000","last_fullsized":"2023-10-09T13:13:39.441932+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:26.791024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061583+0000","last_change":"2023-10-09T13:13:39.057010+0000","last_active":"2023-10-09T13:13:39.061583+0000","last_peered":"2023-10-09T13:13:39.061583+0000","last_clean":"2023-10-09T13:13:39.061583+0000","last_became_active":"2023-10-09T13:13:39.056765+0000","last_became_peered":"2023-10-09T13:13:39.056765+0000","last_unstale":"2023-10-09T13:13:39.061583+0000","last_undegraded":"2023-10-09T13:13:39.061583+0000","last_fullsized":"2023-10-09T13:13:39.061583+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:25.197922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437568+0000","last_change":"2023-10-09T13:13:38.046197+0000","last_active":"2023-10-09T13:13:39.437568+0000","last_peered":"2023-10-09T13:13:39.437568+0000","last_clean":"2023-10-09T13:13:39.437568+0000","last_became_active":"2023-10-09T13:13:38.045927+0000","last_became_peered":"2023-10-09T13:13:38.045927+0000","last_unstale":"2023-10-09T13:13:39.437568+0000","last_undegraded":"2023-10-09T13:13:39.437568+0000","last_fullsized":"2023-10-09T13:13:39.437568+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:02.576133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063462+0000","last_change":"2023-10-09T13:13:39.061875+0000","last_active":"2023-10-09T13:13:39.063462+0000","last_peered":"2023-10-09T13:13:39.063462+0000","last_clean":"2023-10-09T13:13:39.063462+0000","last_became_active":"2023-10-09T13:13:39.061604+0000","last_became_peered":"2023-10-09T13:13:39.061604+0000","last_unstale":"2023-10-09T13:13:39.063462+0000","last_undegraded":"2023-10-09T13:13:39.063462+0000","last_fullsized":"2023-10-09T13:13:39.063462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:13.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.045175+0000","last_change":"2023-10-09T13:13:38.043953+0000","last_active":"2023-10-09T13:13:39.045175+0000","last_peered":"2023-10-09T13:13:39.045175+0000","last_clean":"2023-10-09T13:13:39.045175+0000","last_became_active":"2023-10-09T13:13:38.043274+0000","last_became_peered":"2023-10-09T13:13:38.043274+0000","last_unstale":"2023-10-09T13:13:39.045175+0000","last_undegraded":"2023-10-09T13:13:39.045175+0000","last_fullsized":"2023-10-09T13:13:39.045175+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:36.338149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.052772+0000","last_change":"2023-10-09T13:13:39.047476+0000","last_active":"2023-10-09T13:13:39.052772+0000","last_peered":"2023-10-09T13:13:39.052772+0000","last_clean":"2023-10-09T13:13:39.052772+0000","last_became_active":"2023-10-09T13:13:39.047198+0000","last_became_peered":"2023-10-09T13:13:39.047198+0000","last_unstale":"2023-10-09T13:13:39.052772+0000","last_undegraded":"2023-10-09T13:13:39.052772+0000","last_fullsized":"2023-10-09T13:13:39.052772+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:45:13.046752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042122+0000","last_change":"2023-10-09T13:13:38.044962+0000","last_active":"2023-10-09T13:13:39.042122+0000","last_peered":"2023-10-09T13:13:39.042122+0000","last_clean":"2023-10-09T13:13:39.042122+0000","last_became_active":"2023-10-09T13:13:38.044699+0000","last_became_peered":"2023-10-09T13:13:38.044699+0000","last_unstale":"2023-10-09T13:13:39.042122+0000","last_undegraded":"2023-10-09T13:13:39.042122+0000","last_fullsized":"2023-10-09T13:13:39.042122+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:35.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060653+0000","last_change":"2023-10-09T13:13:39.059899+0000","last_active":"2023-10-09T13:13:39.060653+0000","last_peered":"2023-10-09T13:13:39.060653+0000","last_clean":"2023-10-09T13:13:39.060653+0000","last_became_active":"2023-10-09T13:13:39.059609+0000","last_became_peered":"2023-10-09T13:13:39.059609+0000","last_unstale":"2023-10-09T13:13:39.060653+0000","last_undegraded":"2023-10-09T13:13:39.060653+0000","last_fullsized":"2023-10-09T13:13:39.060653+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:04.504760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"195'8","reported_seq":18,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.440430+0000","last_change":"2023-10-09T13:13:38.035371+0000","last_active":"2023-10-09T13:13:39.440430+0000","last_peered":"2023-10-09T13:13:39.440430+0000","last_clean":"2023-10-09T13:13:39.440430+0000","last_became_active":"2023-10-09T13:13:38.035103+0000","last_became_peered":"2023-10-09T13:13:38.035103+0000","last_unstale":"2023-10-09T13:13:39.440430+0000","last_undegraded":"2023-10-09T13:13:39.440430+0000","last_fullsized":"2023-10-09T13:13:39.440430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:44:54.809689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055747+0000","last_change":"2023-10-09T13:13:39.052251+0000","last_active":"2023-10-09T13:13:39.055747+0000","last_peered":"2023-10-09T13:13:39.055747+0000","last_clean":"2023-10-09T13:13:39.055747+0000","last_became_active":"2023-10-09T13:13:39.051540+0000","last_became_peered":"2023-10-09T13:13:39.051540+0000","last_unstale":"2023-10-09T13:13:39.055747+0000","last_undegraded":"2023-10-09T13:13:39.055747+0000","last_fullsized":"2023-10-09T13:13:39.055747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:23.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437592+0000","last_change":"2023-10-09T13:13:38.043037+0000","last_active":"2023-10-09T13:13:39.437592+0000","last_peered":"2023-10-09T13:13:39.437592+0000","last_clean":"2023-10-09T13:13:39.437592+0000","last_became_active":"2023-10-09T13:13:38.042743+0000","last_became_peered":"2023-10-09T13:13:38.042743+0000","last_unstale":"2023-10-09T13:13:39.437592+0000","last_undegraded":"2023-10-09T13:13:39.437592+0000","last_fullsized":"2023-10-09T13:13:39.437592+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:41.470190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062178+0000","last_change":"2023-10-09T13:13:39.059709+0000","last_active":"2023-10-09T13:13:39.062178+0000","last_peered":"2023-10-09T13:13:39.062178+0000","last_clean":"2023-10-09T13:13:39.062178+0000","last_became_active":"2023-10-09T13:13:39.059455+0000","last_became_peered":"2023-10-09T13:13:39.059455+0000","last_unstale":"2023-10-09T13:13:39.062178+0000","last_undegraded":"2023-10-09T13:13:39.062178+0000","last_fullsized":"2023-10-09T13:13:39.062178+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:13.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436624+0000","last_change":"2023-10-09T13:13:38.048103+0000","last_active":"2023-10-09T13:13:39.436624+0000","last_peered":"2023-10-09T13:13:39.436624+0000","last_clean":"2023-10-09T13:13:39.436624+0000","last_became_active":"2023-10-09T13:13:38.047724+0000","last_became_peered":"2023-10-09T13:13:38.047724+0000","last_unstale":"2023-10-09T13:13:39.436624+0000","last_undegraded":"2023-10-09T13:13:39.436624+0000","last_fullsized":"2023-10-09T13:13:39.436624+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:37.297856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059602+0000","last_change":"2023-10-09T13:13:39.053683+0000","last_active":"2023-10-09T13:13:39.059602+0000","last_peered":"2023-10-09T13:13:39.059602+0000","last_clean":"2023-10-09T13:13:39.059602+0000","last_became_active":"2023-10-09T13:13:39.053405+0000","last_became_peered":"2023-10-09T13:13:39.053405+0000","last_unstale":"2023-10-09T13:13:39.059602+0000","last_undegraded":"2023-10-09T13:13:39.059602+0000","last_fullsized":"2023-10-09T13:13:39.059602+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:36.554982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436315+0000","last_change":"2023-10-09T13:13:38.041999+0000","last_active":"2023-10-09T13:13:39.436315+0000","last_peered":"2023-10-09T13:13:39.436315+0000","last_clean":"2023-10-09T13:13:39.436315+0000","last_became_active":"2023-10-09T13:13:38.041730+0000","last_became_peered":"2023-10-09T13:13:38.041730+0000","last_unstale":"2023-10-09T13:13:39.436315+0000","last_undegraded":"2023-10-09T13:13:39.436315+0000","last_fullsized":"2023-10-09T13:13:39.436315+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:50:58.185602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051841+0000","last_change":"2023-10-09T13:13:39.048395+0000","last_active":"2023-10-09T13:13:39.051841+0000","last_peered":"2023-10-09T13:13:39.051841+0000","last_clean":"2023-10-09T13:13:39.051841+0000","last_became_active":"2023-10-09T13:13:39.048135+0000","last_became_peered":"2023-10-09T13:13:39.048135+0000","last_unstale":"2023-10-09T13:13:39.051841+0000","last_undegraded":"2023-10-09T13:13:39.051841+0000","last_fullsized":"2023-10-09T13:13:39.051841+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:14.058985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046121+0000","last_change":"2023-10-09T13:13:38.047326+0000","last_active":"2023-10-09T13:13:39.046121+0000","last_peered":"2023-10-09T13:13:39.046121+0000","last_clean":"2023-10-09T13:13:39.046121+0000","last_became_active":"2023-10-09T13:13:38.047009+0000","last_became_peered":"2023-10-09T13:13:38.047009+0000","last_unstale":"2023-10-09T13:13:39.046121+0000","last_undegraded":"2023-10-09T13:13:39.046121+0000","last_fullsized":"2023-10-09T13:13:39.046121+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:26.157313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058268+0000","last_change":"2023-10-09T13:13:39.053092+0000","last_active":"2023-10-09T13:13:39.058268+0000","last_peered":"2023-10-09T13:13:39.058268+0000","last_clean":"2023-10-09T13:13:39.058268+0000","last_became_active":"2023-10-09T13:13:39.052836+0000","last_became_peered":"2023-10-09T13:13:39.052836+0000","last_unstale":"2023-10-09T13:13:39.058268+0000","last_undegraded":"2023-10-09T13:13:39.058268+0000","last_fullsized":"2023-10-09T13:13:39.058268+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:42.004196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439720+0000","last_change":"2023-10-09T13:13:38.044372+0000","last_active":"2023-10-09T13:13:39.439720+0000","last_peered":"2023-10-09T13:13:39.439720+0000","last_clean":"2023-10-09T13:13:39.439720+0000","last_became_active":"2023-10-09T13:13:38.044133+0000","last_became_peered":"2023-10-09T13:13:38.044133+0000","last_unstale":"2023-10-09T13:13:39.439720+0000","last_undegraded":"2023-10-09T13:13:39.439720+0000","last_fullsized":"2023-10-09T13:13:39.439720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:06:40.825909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055907+0000","last_change":"2023-10-09T13:13:39.053545+0000","last_active":"2023-10-09T13:13:39.055907+0000","last_peered":"2023-10-09T13:13:39.055907+0000","last_clean":"2023-10-09T13:13:39.055907+0000","last_became_active":"2023-10-09T13:13:39.053183+0000","last_became_peered":"2023-10-09T13:13:39.053183+0000","last_unstale":"2023-10-09T13:13:39.055907+0000","last_undegraded":"2023-10-09T13:13:39.055907+0000","last_fullsized":"2023-10-09T13:13:39.055907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:37.301381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.045809+0000","last_change":"2023-10-09T13:13:38.032150+0000","last_active":"2023-10-09T13:13:39.045809+0000","last_peered":"2023-10-09T13:13:39.045809+0000","last_clean":"2023-10-09T13:13:39.045809+0000","last_became_active":"2023-10-09T13:13:38.031867+0000","last_became_peered":"2023-10-09T13:13:38.031867+0000","last_unstale":"2023-10-09T13:13:39.045809+0000","last_undegraded":"2023-10-09T13:13:39.045809+0000","last_fullsized":"2023-10-09T13:13:39.045809+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:47.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061570+0000","last_change":"2023-10-09T13:13:39.060114+0000","last_active":"2023-10-09T13:13:39.061570+0000","last_peered":"2023-10-09T13:13:39.061570+0000","last_clean":"2023-10-09T13:13:39.061570+0000","last_became_active":"2023-10-09T13:13:39.059138+0000","last_became_peered":"2023-10-09T13:13:39.059138+0000","last_unstale":"2023-10-09T13:13:39.061570+0000","last_undegraded":"2023-10-09T13:13:39.061570+0000","last_fullsized":"2023-10-09T13:13:39.061570+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:42.743455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.043012+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.042753+0000","last_became_peered":"2023-10-09T13:13:38.042753+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:26.638250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062583+0000","last_change":"2023-10-09T13:13:39.057491+0000","last_active":"2023-10-09T13:13:39.062583+0000","last_peered":"2023-10-09T13:13:39.062583+0000","last_clean":"2023-10-09T13:13:39.062583+0000","last_became_active":"2023-10-09T13:13:39.057245+0000","last_became_peered":"2023-10-09T13:13:39.057245+0000","last_unstale":"2023-10-09T13:13:39.062583+0000","last_undegraded":"2023-10-09T13:13:39.062583+0000","last_fullsized":"2023-10-09T13:13:39.062583+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:52.359359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.044640+0000","last_change":"2023-10-09T13:13:38.042947+0000","last_active":"2023-10-09T13:13:39.044640+0000","last_peered":"2023-10-09T13:13:39.044640+0000","last_clean":"2023-10-09T13:13:39.044640+0000","last_became_active":"2023-10-09T13:13:38.042688+0000","last_became_peered":"2023-10-09T13:13:38.042688+0000","last_unstale":"2023-10-09T13:13:39.044640+0000","last_undegraded":"2023-10-09T13:13:39.044640+0000","last_fullsized":"2023-10-09T13:13:39.044640+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:53:26.687484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061358+0000","last_change":"2023-10-09T13:13:39.057902+0000","last_active":"2023-10-09T13:13:39.061358+0000","last_peered":"2023-10-09T13:13:39.061358+0000","last_clean":"2023-10-09T13:13:39.061358+0000","last_became_active":"2023-10-09T13:13:39.057326+0000","last_became_peered":"2023-10-09T13:13:39.057326+0000","last_unstale":"2023-10-09T13:13:39.061358+0000","last_undegraded":"2023-10-09T13:13:39.061358+0000","last_fullsized":"2023-10-09T13:13:39.061358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:53.270329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439542+0000","last_change":"2023-10-09T13:13:38.047384+0000","last_active":"2023-10-09T13:13:39.439542+0000","last_peered":"2023-10-09T13:13:39.439542+0000","last_clean":"2023-10-09T13:13:39.439542+0000","last_became_active":"2023-10-09T13:13:38.046973+0000","last_became_peered":"2023-10-09T13:13:38.046973+0000","last_unstale":"2023-10-09T13:13:39.439542+0000","last_undegraded":"2023-10-09T13:13:39.439542+0000","last_fullsized":"2023-10-09T13:13:39.439542+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:46.573124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063897+0000","last_change":"2023-10-09T13:13:39.062987+0000","last_active":"2023-10-09T13:13:39.063897+0000","last_peered":"2023-10-09T13:13:39.063897+0000","last_clean":"2023-10-09T13:13:39.063897+0000","last_became_active":"2023-10-09T13:13:39.062714+0000","last_became_peered":"2023-10-09T13:13:39.062714+0000","last_unstale":"2023-10-09T13:13:39.063897+0000","last_undegraded":"2023-10-09T13:13:39.063897+0000","last_fullsized":"2023-10-09T13:13:39.063897+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:57.858815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.038311+0000","last_change":"2023-10-09T13:13:38.043557+0000","last_active":"2023-10-09T13:13:39.038311+0000","last_peered":"2023-10-09T13:13:39.038311+0000","last_clean":"2023-10-09T13:13:39.038311+0000","last_became_active":"2023-10-09T13:13:38.043248+0000","last_became_peered":"2023-10-09T13:13:38.043248+0000","last_unstale":"2023-10-09T13:13:39.038311+0000","last_undegraded":"2023-10-09T13:13:39.038311+0000","last_fullsized":"2023-10-09T13:13:39.038311+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:38.573477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051413+0000","last_change":"2023-10-09T13:13:39.050681+0000","last_active":"2023-10-09T13:13:39.051413+0000","last_peered":"2023-10-09T13:13:39.051413+0000","last_clean":"2023-10-09T13:13:39.051413+0000","last_became_active":"2023-10-09T13:13:39.050420+0000","last_became_peered":"2023-10-09T13:13:39.050420+0000","last_unstale":"2023-10-09T13:13:39.051413+0000","last_undegraded":"2023-10-09T13:13:39.051413+0000","last_fullsized":"2023-10-09T13:13:39.051413+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:24.808179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.053077+0000","last_change":"2023-10-09T13:13:38.047884+0000","last_active":"2023-10-09T13:13:39.053077+0000","last_peered":"2023-10-09T13:13:39.053077+0000","last_clean":"2023-10-09T13:13:39.053077+0000","last_became_active":"2023-10-09T13:13:38.047590+0000","last_became_peered":"2023-10-09T13:13:38.047590+0000","last_unstale":"2023-10-09T13:13:39.053077+0000","last_undegraded":"2023-10-09T13:13:39.053077+0000","last_fullsized":"2023-10-09T13:13:39.053077+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:04.634105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.052107+0000","last_change":"2023-10-09T13:13:39.051089+0000","last_active":"2023-10-09T13:13:39.052107+0000","last_peered":"2023-10-09T13:13:39.052107+0000","last_clean":"2023-10-09T13:13:39.052107+0000","last_became_active":"2023-10-09T13:13:39.050166+0000","last_became_peered":"2023-10-09T13:13:39.050166+0000","last_unstale":"2023-10-09T13:13:39.052107+0000","last_undegraded":"2023-10-09T13:13:39.052107+0000","last_fullsized":"2023-10-09T13:13:39.052107+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:37.301381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.045755+0000","last_change":"2023-10-09T13:13:38.046911+0000","last_active":"2023-10-09T13:13:39.045755+0000","last_peered":"2023-10-09T13:13:39.045755+0000","last_clean":"2023-10-09T13:13:39.045755+0000","last_became_active":"2023-10-09T13:13:38.046554+0000","last_became_peered":"2023-10-09T13:13:38.046554+0000","last_unstale":"2023-10-09T13:13:39.045755+0000","last_undegraded":"2023-10-09T13:13:39.045755+0000","last_fullsized":"2023-10-09T13:13:39.045755+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:02.369855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058752+0000","last_change":"2023-10-09T13:13:39.054429+0000","last_active":"2023-10-09T13:13:39.058752+0000","last_peered":"2023-10-09T13:13:39.058752+0000","last_clean":"2023-10-09T13:13:39.058752+0000","last_became_active":"2023-10-09T13:13:39.054170+0000","last_became_peered":"2023-10-09T13:13:39.054170+0000","last_unstale":"2023-10-09T13:13:39.058752+0000","last_undegraded":"2023-10-09T13:13:39.058752+0000","last_fullsized":"2023-10-09T13:13:39.058752+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:32.299144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.040056+0000","last_change":"2023-10-09T13:13:38.046349+0000","last_active":"2023-10-09T13:13:39.040056+0000","last_peered":"2023-10-09T13:13:39.040056+0000","last_clean":"2023-10-09T13:13:39.040056+0000","last_became_active":"2023-10-09T13:13:38.045977+0000","last_became_peered":"2023-10-09T13:13:38.045977+0000","last_unstale":"2023-10-09T13:13:39.040056+0000","last_undegraded":"2023-10-09T13:13:39.040056+0000","last_fullsized":"2023-10-09T13:13:39.040056+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:56.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058493+0000","last_change":"2023-10-09T13:13:39.056812+0000","last_active":"2023-10-09T13:13:39.058493+0000","last_peered":"2023-10-09T13:13:39.058493+0000","last_clean":"2023-10-09T13:13:39.058493+0000","last_became_active":"2023-10-09T13:13:39.054693+0000","last_became_peered":"2023-10-09T13:13:39.054693+0000","last_unstale":"2023-10-09T13:13:39.058493+0000","last_undegraded":"2023-10-09T13:13:39.058493+0000","last_fullsized":"2023-10-09T13:13:39.058493+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:21.005504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.046306+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.046042+0000","last_became_peered":"2023-10-09T13:13:38.046042+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:20.380175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058354+0000","last_change":"2023-10-09T13:13:39.055019+0000","last_active":"2023-10-09T13:13:39.058354+0000","last_peered":"2023-10-09T13:13:39.058354+0000","last_clean":"2023-10-09T13:13:39.058354+0000","last_became_active":"2023-10-09T13:13:39.054711+0000","last_became_peered":"2023-10-09T13:13:39.054711+0000","last_unstale":"2023-10-09T13:13:39.058354+0000","last_undegraded":"2023-10-09T13:13:39.058354+0000","last_fullsized":"2023-10-09T13:13:39.058354+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:36.954416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.053541+0000","last_change":"2023-10-09T13:13:38.048493+0000","last_active":"2023-10-09T13:13:39.053541+0000","last_peered":"2023-10-09T13:13:39.053541+0000","last_clean":"2023-10-09T13:13:39.053541+0000","last_became_active":"2023-10-09T13:13:38.048252+0000","last_became_peered":"2023-10-09T13:13:38.048252+0000","last_unstale":"2023-10-09T13:13:39.053541+0000","last_undegraded":"2023-10-09T13:13:39.053541+0000","last_fullsized":"2023-10-09T13:13:39.053541+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:47.407733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047721+0000","last_change":"2023-10-09T13:13:39.043801+0000","last_active":"2023-10-09T13:13:39.047721+0000","last_peered":"2023-10-09T13:13:39.047721+0000","last_clean":"2023-10-09T13:13:39.047721+0000","last_became_active":"2023-10-09T13:13:39.043513+0000","last_became_peered":"2023-10-09T13:13:39.043513+0000","last_unstale":"2023-10-09T13:13:39.047721+0000","last_undegraded":"2023-10-09T13:13:39.047721+0000","last_fullsized":"2023-10-09T13:13:39.047721+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:36.727014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.039716+0000","last_change":"2023-10-09T13:13:38.035413+0000","last_active":"2023-10-09T13:13:39.039716+0000","last_peered":"2023-10-09T13:13:39.039716+0000","last_clean":"2023-10-09T13:13:39.039716+0000","last_became_active":"2023-10-09T13:13:38.035171+0000","last_became_peered":"2023-10-09T13:13:38.035171+0000","last_unstale":"2023-10-09T13:13:39.039716+0000","last_undegraded":"2023-10-09T13:13:39.039716+0000","last_fullsized":"2023-10-09T13:13:39.039716+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:53.236078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061394+0000","last_change":"2023-10-09T13:13:39.058646+0000","last_active":"2023-10-09T13:13:39.061394+0000","last_peered":"2023-10-09T13:13:39.061394+0000","last_clean":"2023-10-09T13:13:39.061394+0000","last_became_active":"2023-10-09T13:13:39.058387+0000","last_became_peered":"2023-10-09T13:13:39.058387+0000","last_unstale":"2023-10-09T13:13:39.061394+0000","last_undegraded":"2023-10-09T13:13:39.061394+0000","last_fullsized":"2023-10-09T13:13:39.061394+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:31.565289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.040591+0000","last_change":"2023-10-09T13:13:38.040428+0000","last_active":"2023-10-09T13:13:39.040591+0000","last_peered":"2023-10-09T13:13:39.040591+0000","last_clean":"2023-10-09T13:13:39.040591+0000","last_became_active":"2023-10-09T13:13:38.040158+0000","last_became_peered":"2023-10-09T13:13:38.040158+0000","last_unstale":"2023-10-09T13:13:39.040591+0000","last_undegraded":"2023-10-09T13:13:39.040591+0000","last_fullsized":"2023-10-09T13:13:39.040591+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:04.634105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"185'326","reported_seq":1050,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.044769+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:13:39.044769+0000","last_peered":"2023-10-09T13:13:39.044769+0000","last_clean":"2023-10-09T13:13:39.044769+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:13:39.044769+0000","last_undegraded":"2023-10-09T13:13:39.044769+0000","last_fullsized":"2023-10-09T13:13:39.044769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477834,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312560,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059280,"statfs":{"total":96636764160,"available":96316702720,"internally_reserved":0,"allocated":3055616,"data_stored":1816439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94899999999999995,"5min":1.004,"15min":1.008},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.46200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":1.022,"15min":1.022},"last":0.81999999999999995}]},{"osd":1,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.71899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.995,"5min":0.995,"15min":1.02},"last":0.753},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":0.97899999999999998,"15min":1.073},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":1.097,"15min":1.097},"last":0.80000000000000004}]},{"osd":3,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58999999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":1.208},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":1.2410000000000001},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.74399999999999999,"5min":1.089,"15min":1.089},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.85499999999999998,"15min":1.0780000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.40899999999999997,"15min":0.35699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.73699999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.45800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.2070000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":1.038,"15min":1.3200000000000001},"last":0.76800000000000002}]}]},{"osd":6,"up_from":16,"seq":68719477835,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.026},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":1.014},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77900000000000003,"15min":0.75800000000000001},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.503},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.47699999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.032,"15min":1.05},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.501},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82999999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.90900000000000003,"15min":1.0449999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.76000000000000001,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.754},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.034},"last":0.84799999999999998}]},{"osd":7,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.89300000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.874},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":1.0329999999999999,"15min":1.0469999999999999},"last":0.86399999999999999}]}]},{"osd":1,"up_from":15,"seq":64424510539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307864,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063976,"statfs":{"total":96636764160,"available":96321511424,"internally_reserved":0,"allocated":2441216,"data_stored":1223855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.312},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.25800000000000001},"max":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.89700000000000002},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.315},"max":{"1min":0.75,"5min":0.77600000000000002,"15min":0.92700000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.438,"5min":0.374,"15min":0.36299999999999999},"max":{"1min":0.78500000000000003,"5min":0.80400000000000005,"15min":0.872},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":1.052,"15min":1.052},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.501}]},{"osd":4,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.56999999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.123,"15min":1.149},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.68500000000000005,"5min":0.56699999999999995,"15min":0.43099999999999999},"max":{"1min":1.0820000000000001,"5min":1.1639999999999999,"15min":1.2849999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.63400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.226},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.44400000000000001},"max":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2250000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.212,"5min":1.24,"15min":1.24},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.86399999999999999},"min":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.3220000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.47599999999999998},"max":{"1min":1.1559999999999999,"5min":1.1830000000000001,"15min":1.202},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.75,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.244,"5min":1.2569999999999999,"15min":1.266},"last":0.69399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543242,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308440,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063400,"statfs":{"total":96636764160,"available":96320921600,"internally_reserved":0,"allocated":3031040,"data_stored":1814189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.31,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.28699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.35699999999999998,"15min":0.316},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.83599999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.32400000000000001},"max":{"1min":0.70399999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33700000000000002},"max":{"1min":0.68799999999999994,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.40300000000000002},"max":{"1min":0.79900000000000004,"5min":1.135,"15min":1.135},"last":0.495}]},{"osd":4,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83999999999999997,"15min":0.83399999999999996},"min":{"1min":0.67000000000000004,"5min":0.55500000000000005,"15min":0.54400000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84299999999999997,"15min":0.83399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.48199999999999998},"max":{"1min":1.1000000000000001,"5min":1.147,"15min":1.147},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.63700000000000001,"5min":0.626,"15min":0.496},"max":{"1min":1.099,"5min":1.099,"15min":1.212},"last":0.747}]},{"osd":6,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83099999999999996,"15min":0.81299999999999994},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.51200000000000001},"max":{"1min":1.1779999999999999,"5min":1.194,"15min":1.194},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.55800000000000005},"max":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.1479999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85099999999999998,"15min":0.83799999999999997},"min":{"1min":0.70199999999999996,"5min":0.629,"15min":0.54600000000000004},"max":{"1min":1.091,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.85599999999999998,"15min":0.83399999999999996},"min":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.46400000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79800000000000004}]}]},{"osd":2,"up_from":14,"seq":60129543242,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.90000000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83799999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":0.78500000000000003,"15min":0.877},"last":0.372},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.91600000000000004,"15min":0.96699999999999997},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.1180000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.83799999999999997,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.58799999999999997,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.1559999999999999,"15min":1.337},"last":1.117}]},{"osd":5,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.84699999999999998,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0800000000000001,"5min":1.2170000000000001,"15min":1.3460000000000001},"last":1.046},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.1499999999999999,"5min":1.1759999999999999,"15min":1.2310000000000001},"last":1.1000000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.878,"15min":0.871},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.55700000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.3180000000000001},"last":1},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.874,"15min":0.86399999999999999},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.161,"5min":1.161,"15min":1.2629999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.87,"15min":0.87},"min":{"1min":0.70999999999999996,"5min":0.58899999999999997,"15min":0.58599999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.4490000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.89700000000000002,"15min":0.89300000000000002},"min":{"1min":0.66700000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.3779999999999999},"last":0.78500000000000003}]}]},{"osd":3,"up_from":15,"seq":64424510539,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.48199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88700000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.318},"max":{"1min":0.71399999999999997,"5min":1.399,"15min":1.399},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.497},{"interface":"front","average":{"1min":0.503,"5min":0.53300000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.84699999999999998},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.65600000000000003,"15min":0.61499999999999999},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":6.9880000000000004,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.56000000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90300000000000002,"15min":0.88700000000000001},"min":{"1min":0.629,"5min":0.624,"15min":0.58399999999999996},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.63,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1339999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.63},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.84599999999999997},"min":{"1min":0.64000000000000001,"5min":0.61099999999999999,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.204,"15min":1.204},"last":0.65800000000000003}]},{"osd":6,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83899999999999997,"15min":0.82899999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.53800000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85399999999999998,"15min":0.84899999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.145,"15min":1.4610000000000001},"last":0.749},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2130000000000001,"5min":1.304,"15min":1.5349999999999999},"last":0.61499999999999999}]}]},{"osd":4,"up_from":16,"seq":68719477834,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072156,"statfs":{"total":96636764160,"available":96329887744,"internally_reserved":0,"allocated":2453504,"data_stored":1225427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.98999999999999999,"15min":1.0109999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92400000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51700000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.75600000000000001},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.036},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":1.018,"15min":1.018},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95599999999999996,"5min":0.995,"15min":1.0429999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":1.052,"15min":1.079},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.63,"5min":0.499,"15min":0.499},"max":{"1min":0.95699999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.68000000000000005,"5min":0.53500000000000003,"15min":0.50800000000000001},"max":{"1min":0.89400000000000002,"5min":1.173,"15min":1.214},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":1.026,"15min":1.026},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.439,"15min":0.39500000000000002},"max":{"1min":0.92500000000000004,"5min":0.999,"15min":1.0049999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.056,"15min":1.056},"last":0.64400000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":1.1759999999999999},"last":0.628},{"interface":"front","average":{"1min":0.753,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93600000000000005,"5min":1.032,"15min":1.1020000000000001},"last":0.76500000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477834,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311964,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059876,"statfs":{"total":96636764160,"available":96317313024,"internally_reserved":0,"allocated":2445312,"data_stored":1224397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.371},"max":{"1min":0.96399999999999997,"5min":1.075,"15min":1.075},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58399999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.026,"15min":1.026},"last":0.74099999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92900000000000005,"5min":0.95399999999999996,"15min":0.97799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.44400000000000001},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.77700000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.91700000000000004,"5min":0.999,"15min":1.008},"last":0.62},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86499999999999999,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0009999999999999,"5min":1.018,"15min":1.115},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.65500000000000003,"5min":0.625,"15min":0.58999999999999997},"max":{"1min":0.98399999999999999,"5min":1.0029999999999999,"15min":1.03},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.40200000000000002,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":1.038,"15min":1.038},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.434,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.93600000000000005,"15min":1.0209999999999999},"last":0.48499999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":1.002,"15min":1.0800000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.747},"min":{"1min":0.626,"5min":0.55300000000000005,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.1100000000000001},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:13:48.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:13:48.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.783+0000 7f687359e700 1 Processor -- start 2023-10-09T13:13:48.785 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.784+0000 7f687359e700 1 -- start start 2023-10-09T13:13:48.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6874156310 0x7f68740c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:48.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f68741566e0 0x7f68740ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:48.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 0x7f68740ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:48.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68740ca860 con 0x7f6874156310 2023-10-09T13:13:48.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68740cab40 con 0x7f68741566e0 2023-10-09T13:13:48.787 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740cae20 con 0x7f68740ca300 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6874156310 0x7f68740c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6874156310 0x7f68740c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55264/0 (socket says 172.21.15.86:55264) 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f687259c700 1 -- 172.21.15.86:0/1477849127 learned_addr learned my addr 172.21.15.86:0/1477849127 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f6872d9d700 1 --2- 172.21.15.86:0/1477849127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 0x7f68740ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.785+0000 7f6871d9b700 1 --2- 172.21.15.86:0/1477849127 >> v2:172.21.15.135:3300/0 conn(0x7f68741566e0 0x7f68740ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687259c700 1 -- 172.21.15.86:0/1477849127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 msgr2=0x7f68740ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687259c700 1 --2- 172.21.15.86:0/1477849127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 0x7f68740ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687259c700 1 -- 172.21.15.86:0/1477849127 >> v2:172.21.15.135:3300/0 conn(0x7f68741566e0 msgr2=0x7f68740ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687259c700 1 --2- 172.21.15.86:0/1477849127 >> v2:172.21.15.135:3300/0 conn(0x7f68741566e0 0x7f68740ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687259c700 1 -- 172.21.15.86:0/1477849127 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740cb100 con 0x7f6874156310 2023-10-09T13:13:48.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687259c700 1 --2- 172.21.15.86:0/1477849127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6874156310 0x7f68740c9dc0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f687406c000 tx=0x7f6864009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aae87d5a61cec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687159a700 1 -- 172.21.15.86:0/1477849127 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400b640 con 0x7f6874156310 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687159a700 1 -- 172.21.15.86:0/1477849127 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686400b7a0 con 0x7f6874156310 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.786+0000 7f687159a700 1 -- 172.21.15.86:0/1477849127 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400bb60 con 0x7f6874156310 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 -- 172.21.15.86:0/1477849127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6874156310 msgr2=0x7f68740c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 --2- 172.21.15.86:0/1477849127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6874156310 0x7f68740c9dc0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f687406c000 tx=0x7f6864009250 comp rx=0 tx=0).stop 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 -- 172.21.15.86:0/1477849127 shutdown_connections 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 --2- 172.21.15.86:0/1477849127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 0x7f68740ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 --2- 172.21.15.86:0/1477849127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6874156310 0x7f68740c9dc0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 --2- 172.21.15.86:0/1477849127 >> v2:172.21.15.135:3300/0 conn(0x7f68741566e0 0x7f68740ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:48.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 -- 172.21.15.86:0/1477849127 >> 172.21.15.86:0/1477849127 conn(0x7f68740cc1f0 msgr2=0x7f68740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:48.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 -- 172.21.15.86:0/1477849127 shutdown_connections 2023-10-09T13:13:48.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.787+0000 7f687359e700 1 -- 172.21.15.86:0/1477849127 wait complete. 2023-10-09T13:13:48.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.789+0000 7f687359e700 1 Processor -- start 2023-10-09T13:13:48.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.789+0000 7f687359e700 1 -- start start 2023-10-09T13:13:48.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f687359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 0x7f68740c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:48.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f687359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874156310 0x7f68741467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:48.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f687359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68741566e0 0x7f6874146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f687359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6874147260 con 0x7f68741566e0 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f687359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68740c9370 con 0x7f6874156310 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f687359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740c9650 con 0x7f68740ca300 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68741566e0 0x7f6874146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68741566e0 0x7f6874146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55268/0 (socket says 172.21.15.86:55268) 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 -- 172.21.15.86:0/491455179 learned_addr learned my addr 172.21.15.86:0/491455179 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 -- 172.21.15.86:0/491455179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 msgr2=0x7f68740c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 0x7f68740c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 -- 172.21.15.86:0/491455179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874156310 msgr2=0x7f68741467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874156310 0x7f68741467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 -- 172.21.15.86:0/491455179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640094f0 con 0x7f68741566e0 2023-10-09T13:13:48.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.790+0000 7f6872d9d700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68741566e0 0x7f6874146d20 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f686c009e90 tx=0x7f686c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:48.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.791+0000 7f68627fc700 1 -- 172.21.15.86:0/491455179 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00cc20 con 0x7f68741566e0 2023-10-09T13:13:48.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.791+0000 7f68627fc700 1 -- 172.21.15.86:0/491455179 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c00f040 con 0x7f68741566e0 2023-10-09T13:13:48.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.791+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68740c9930 con 0x7f68741566e0 2023-10-09T13:13:48.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.791+0000 7f68627fc700 1 -- 172.21.15.86:0/491455179 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c014480 con 0x7f68741566e0 2023-10-09T13:13:48.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.791+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6874158800 con 0x7f68741566e0 2023-10-09T13:13:48.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.792+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68741589f0 con 0x7f68741566e0 2023-10-09T13:13:48.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.793+0000 7f68627fc700 1 -- 172.21.15.86:0/491455179 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f686c014830 con 0x7f68741566e0 2023-10-09T13:13:48.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.793+0000 7f68627fc700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6854066f30 0x7f68540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:48.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.794+0000 7f68627fc700 1 -- 172.21.15.86:0/491455179 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f686c085460 con 0x7f68741566e0 2023-10-09T13:13:48.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.794+0000 7f687259c700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6854066f30 0x7f68540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:48.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.794+0000 7f687259c700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6854066f30 0x7f68540693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f687406c000 tx=0x7f6864017000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:48.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.798+0000 7f68627fc700 1 -- 172.21.15.86:0/491455179 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f686c055ee0 con 0x7f68741566e0 2023-10-09T13:13:48.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.990+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f687404c3c0 con 0x7f6854066f30 2023-10-09T13:13:49.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:48.999+0000 7f68627fc700 1 -- 172.21.15.86:0/491455179 <== mgr.9462 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289443 (secure 0 0 0) 0x7f687404c3c0 con 0x7f6854066f30 2023-10-09T13:13:49.004 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:49.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6854066f30 msgr2=0x7f68540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6854066f30 0x7f68540693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f687406c000 tx=0x7f6864017000 comp rx=0 tx=0).stop 2023-10-09T13:13:49.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68741566e0 msgr2=0x7f6874146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68741566e0 0x7f6874146d20 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f686c009e90 tx=0x7f686c00b040 comp rx=0 tx=0).stop 2023-10-09T13:13:49.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 shutdown_connections 2023-10-09T13:13:49.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6854066f30 0x7f68540693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68741566e0 0x7f6874146d20 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68740ca300 0x7f68740c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 --2- 172.21.15.86:0/491455179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874156310 0x7f68741467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 >> 172.21.15.86:0/491455179 conn(0x7f68740cc1f0 msgr2=0x7f68740adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:49.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.003+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 shutdown_connections 2023-10-09T13:13:49.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.004+0000 7f687359e700 1 -- 172.21.15.86:0/491455179 wait complete. 2023-10-09T13:13:49.007 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:13:49.022 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-09T13:13:48.938903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2476392,"kb_used_data":20264,"kb_used_omap":0,"kb_used_meta":2456064,"kb_avail":752498328,"statfs":{"total":773094113280,"available":770558287872,"internally_reserved":0,"allocated":20750336,"data_stored":10975916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2515009536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.904159"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055077+0000","last_change":"2023-10-09T13:13:39.051803+0000","last_active":"2023-10-09T13:13:39.055077+0000","last_peered":"2023-10-09T13:13:39.055077+0000","last_clean":"2023-10-09T13:13:39.055077+0000","last_became_active":"2023-10-09T13:13:39.051538+0000","last_became_peered":"2023-10-09T13:13:39.051538+0000","last_unstale":"2023-10-09T13:13:39.055077+0000","last_undegraded":"2023-10-09T13:13:39.055077+0000","last_fullsized":"2023-10-09T13:13:39.055077+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:17.828958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062311+0000","last_change":"2023-10-09T13:13:39.058242+0000","last_active":"2023-10-09T13:13:39.062311+0000","last_peered":"2023-10-09T13:13:39.062311+0000","last_clean":"2023-10-09T13:13:39.062311+0000","last_became_active":"2023-10-09T13:13:39.057927+0000","last_became_peered":"2023-10-09T13:13:39.057927+0000","last_unstale":"2023-10-09T13:13:39.062311+0000","last_undegraded":"2023-10-09T13:13:39.062311+0000","last_fullsized":"2023-10-09T13:13:39.062311+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:15.509723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047554+0000","last_change":"2023-10-09T13:13:39.045451+0000","last_active":"2023-10-09T13:13:39.047554+0000","last_peered":"2023-10-09T13:13:39.047554+0000","last_clean":"2023-10-09T13:13:39.047554+0000","last_became_active":"2023-10-09T13:13:39.045025+0000","last_became_peered":"2023-10-09T13:13:39.045025+0000","last_unstale":"2023-10-09T13:13:39.047554+0000","last_undegraded":"2023-10-09T13:13:39.047554+0000","last_fullsized":"2023-10-09T13:13:39.047554+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:47.848709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059582+0000","last_change":"2023-10-09T13:13:39.052976+0000","last_active":"2023-10-09T13:13:39.059582+0000","last_peered":"2023-10-09T13:13:39.059582+0000","last_clean":"2023-10-09T13:13:39.059582+0000","last_became_active":"2023-10-09T13:13:39.052731+0000","last_became_peered":"2023-10-09T13:13:39.052731+0000","last_unstale":"2023-10-09T13:13:39.059582+0000","last_undegraded":"2023-10-09T13:13:39.059582+0000","last_fullsized":"2023-10-09T13:13:39.059582+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:57.794933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063449+0000","last_change":"2023-10-09T13:13:39.059734+0000","last_active":"2023-10-09T13:13:39.063449+0000","last_peered":"2023-10-09T13:13:39.063449+0000","last_clean":"2023-10-09T13:13:39.063449+0000","last_became_active":"2023-10-09T13:13:39.059388+0000","last_became_peered":"2023-10-09T13:13:39.059388+0000","last_unstale":"2023-10-09T13:13:39.063449+0000","last_undegraded":"2023-10-09T13:13:39.063449+0000","last_fullsized":"2023-10-09T13:13:39.063449+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:15:47.507277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059269+0000","last_change":"2023-10-09T13:13:39.054489+0000","last_active":"2023-10-09T13:13:39.059269+0000","last_peered":"2023-10-09T13:13:39.059269+0000","last_clean":"2023-10-09T13:13:39.059269+0000","last_became_active":"2023-10-09T13:13:39.054222+0000","last_became_peered":"2023-10-09T13:13:39.054222+0000","last_unstale":"2023-10-09T13:13:39.059269+0000","last_undegraded":"2023-10-09T13:13:39.059269+0000","last_fullsized":"2023-10-09T13:13:39.059269+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:33.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063435+0000","last_change":"2023-10-09T13:13:39.060449+0000","last_active":"2023-10-09T13:13:39.063435+0000","last_peered":"2023-10-09T13:13:39.063435+0000","last_clean":"2023-10-09T13:13:39.063435+0000","last_became_active":"2023-10-09T13:13:39.059646+0000","last_became_peered":"2023-10-09T13:13:39.059646+0000","last_unstale":"2023-10-09T13:13:39.063435+0000","last_undegraded":"2023-10-09T13:13:39.063435+0000","last_fullsized":"2023-10-09T13:13:39.063435+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:46.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.064277+0000","last_change":"2023-10-09T13:13:39.061682+0000","last_active":"2023-10-09T13:13:39.064277+0000","last_peered":"2023-10-09T13:13:39.064277+0000","last_clean":"2023-10-09T13:13:39.064277+0000","last_became_active":"2023-10-09T13:13:39.061330+0000","last_became_peered":"2023-10-09T13:13:39.061330+0000","last_unstale":"2023-10-09T13:13:39.064277+0000","last_undegraded":"2023-10-09T13:13:39.064277+0000","last_fullsized":"2023-10-09T13:13:39.064277+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:11.397075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062165+0000","last_change":"2023-10-09T13:13:39.057496+0000","last_active":"2023-10-09T13:13:39.062165+0000","last_peered":"2023-10-09T13:13:39.062165+0000","last_clean":"2023-10-09T13:13:39.062165+0000","last_became_active":"2023-10-09T13:13:39.057228+0000","last_became_peered":"2023-10-09T13:13:39.057228+0000","last_unstale":"2023-10-09T13:13:39.062165+0000","last_undegraded":"2023-10-09T13:13:39.062165+0000","last_fullsized":"2023-10-09T13:13:39.062165+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:55.140436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063611+0000","last_change":"2023-10-09T13:13:39.060458+0000","last_active":"2023-10-09T13:13:39.063611+0000","last_peered":"2023-10-09T13:13:39.063611+0000","last_clean":"2023-10-09T13:13:39.063611+0000","last_became_active":"2023-10-09T13:13:39.059067+0000","last_became_peered":"2023-10-09T13:13:39.059067+0000","last_unstale":"2023-10-09T13:13:39.063611+0000","last_undegraded":"2023-10-09T13:13:39.063611+0000","last_fullsized":"2023-10-09T13:13:39.063611+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:12.859119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.064194+0000","last_change":"2023-10-09T13:13:39.062872+0000","last_active":"2023-10-09T13:13:39.064194+0000","last_peered":"2023-10-09T13:13:39.064194+0000","last_clean":"2023-10-09T13:13:39.064194+0000","last_became_active":"2023-10-09T13:13:39.062529+0000","last_became_peered":"2023-10-09T13:13:39.062529+0000","last_unstale":"2023-10-09T13:13:39.064194+0000","last_undegraded":"2023-10-09T13:13:39.064194+0000","last_fullsized":"2023-10-09T13:13:39.064194+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:29.881735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062356+0000","last_change":"2023-10-09T13:13:39.058305+0000","last_active":"2023-10-09T13:13:39.062356+0000","last_peered":"2023-10-09T13:13:39.062356+0000","last_clean":"2023-10-09T13:13:39.062356+0000","last_became_active":"2023-10-09T13:13:39.057981+0000","last_became_peered":"2023-10-09T13:13:39.057981+0000","last_unstale":"2023-10-09T13:13:39.062356+0000","last_undegraded":"2023-10-09T13:13:39.062356+0000","last_fullsized":"2023-10-09T13:13:39.062356+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:47.493217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058685+0000","last_change":"2023-10-09T13:13:39.053561+0000","last_active":"2023-10-09T13:13:39.058685+0000","last_peered":"2023-10-09T13:13:39.058685+0000","last_clean":"2023-10-09T13:13:39.058685+0000","last_became_active":"2023-10-09T13:13:39.053302+0000","last_became_peered":"2023-10-09T13:13:39.053302+0000","last_unstale":"2023-10-09T13:13:39.058685+0000","last_undegraded":"2023-10-09T13:13:39.058685+0000","last_fullsized":"2023-10-09T13:13:39.058685+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:52:45.664285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058241+0000","last_change":"2023-10-09T13:13:39.051566+0000","last_active":"2023-10-09T13:13:39.058241+0000","last_peered":"2023-10-09T13:13:39.058241+0000","last_clean":"2023-10-09T13:13:39.058241+0000","last_became_active":"2023-10-09T13:13:39.051211+0000","last_became_peered":"2023-10-09T13:13:39.051211+0000","last_unstale":"2023-10-09T13:13:39.058241+0000","last_undegraded":"2023-10-09T13:13:39.058241+0000","last_fullsized":"2023-10-09T13:13:39.058241+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:46.695644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.057126+0000","last_change":"2023-10-09T13:13:39.055152+0000","last_active":"2023-10-09T13:13:39.057126+0000","last_peered":"2023-10-09T13:13:39.057126+0000","last_clean":"2023-10-09T13:13:39.057126+0000","last_became_active":"2023-10-09T13:13:39.054838+0000","last_became_peered":"2023-10-09T13:13:39.054838+0000","last_unstale":"2023-10-09T13:13:39.057126+0000","last_undegraded":"2023-10-09T13:13:39.057126+0000","last_fullsized":"2023-10-09T13:13:39.057126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:53:20.377531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.054529+0000","last_change":"2023-10-09T13:13:39.051097+0000","last_active":"2023-10-09T13:13:39.054529+0000","last_peered":"2023-10-09T13:13:39.054529+0000","last_clean":"2023-10-09T13:13:39.054529+0000","last_became_active":"2023-10-09T13:13:39.050849+0000","last_became_peered":"2023-10-09T13:13:39.050849+0000","last_unstale":"2023-10-09T13:13:39.054529+0000","last_undegraded":"2023-10-09T13:13:39.054529+0000","last_fullsized":"2023-10-09T13:13:39.054529+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:57.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047721+0000","last_change":"2023-10-09T13:13:39.045335+0000","last_active":"2023-10-09T13:13:39.047721+0000","last_peered":"2023-10-09T13:13:39.047721+0000","last_clean":"2023-10-09T13:13:39.047721+0000","last_became_active":"2023-10-09T13:13:39.045012+0000","last_became_peered":"2023-10-09T13:13:39.045012+0000","last_unstale":"2023-10-09T13:13:39.047721+0000","last_undegraded":"2023-10-09T13:13:39.047721+0000","last_fullsized":"2023-10-09T13:13:39.047721+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:53.421996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061377+0000","last_change":"2023-10-09T13:13:39.058050+0000","last_active":"2023-10-09T13:13:39.061377+0000","last_peered":"2023-10-09T13:13:39.061377+0000","last_clean":"2023-10-09T13:13:39.061377+0000","last_became_active":"2023-10-09T13:13:39.057663+0000","last_became_peered":"2023-10-09T13:13:39.057663+0000","last_unstale":"2023-10-09T13:13:39.061377+0000","last_undegraded":"2023-10-09T13:13:39.061377+0000","last_fullsized":"2023-10-09T13:13:39.061377+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:57.858815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.050776+0000","last_change":"2023-10-09T13:13:39.047770+0000","last_active":"2023-10-09T13:13:39.050776+0000","last_peered":"2023-10-09T13:13:39.050776+0000","last_clean":"2023-10-09T13:13:39.050776+0000","last_became_active":"2023-10-09T13:13:39.047485+0000","last_became_peered":"2023-10-09T13:13:39.047485+0000","last_unstale":"2023-10-09T13:13:39.050776+0000","last_undegraded":"2023-10-09T13:13:39.050776+0000","last_fullsized":"2023-10-09T13:13:39.050776+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:32.687561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058099+0000","last_change":"2023-10-09T13:13:39.051563+0000","last_active":"2023-10-09T13:13:39.058099+0000","last_peered":"2023-10-09T13:13:39.058099+0000","last_clean":"2023-10-09T13:13:39.058099+0000","last_became_active":"2023-10-09T13:13:39.051261+0000","last_became_peered":"2023-10-09T13:13:39.051261+0000","last_unstale":"2023-10-09T13:13:39.058099+0000","last_undegraded":"2023-10-09T13:13:39.058099+0000","last_fullsized":"2023-10-09T13:13:39.058099+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:23:16.440128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046746+0000","last_change":"2023-10-09T13:13:39.044650+0000","last_active":"2023-10-09T13:13:39.046746+0000","last_peered":"2023-10-09T13:13:39.046746+0000","last_clean":"2023-10-09T13:13:39.046746+0000","last_became_active":"2023-10-09T13:13:39.044230+0000","last_became_peered":"2023-10-09T13:13:39.044230+0000","last_unstale":"2023-10-09T13:13:39.046746+0000","last_undegraded":"2023-10-09T13:13:39.046746+0000","last_fullsized":"2023-10-09T13:13:39.046746+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:13.117007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061926+0000","last_change":"2023-10-09T13:13:39.056593+0000","last_active":"2023-10-09T13:13:39.061926+0000","last_peered":"2023-10-09T13:13:39.061926+0000","last_clean":"2023-10-09T13:13:39.061926+0000","last_became_active":"2023-10-09T13:13:39.056335+0000","last_became_peered":"2023-10-09T13:13:39.056335+0000","last_unstale":"2023-10-09T13:13:39.061926+0000","last_undegraded":"2023-10-09T13:13:39.061926+0000","last_fullsized":"2023-10-09T13:13:39.061926+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:39.680179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063289+0000","last_change":"2023-10-09T13:13:39.060979+0000","last_active":"2023-10-09T13:13:39.063289+0000","last_peered":"2023-10-09T13:13:39.063289+0000","last_clean":"2023-10-09T13:13:39.063289+0000","last_became_active":"2023-10-09T13:13:39.060695+0000","last_became_peered":"2023-10-09T13:13:39.060695+0000","last_unstale":"2023-10-09T13:13:39.063289+0000","last_undegraded":"2023-10-09T13:13:39.063289+0000","last_fullsized":"2023-10-09T13:13:39.063289+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:03.435693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.064295+0000","last_change":"2023-10-09T13:13:39.061989+0000","last_active":"2023-10-09T13:13:39.064295+0000","last_peered":"2023-10-09T13:13:39.064295+0000","last_clean":"2023-10-09T13:13:39.064295+0000","last_became_active":"2023-10-09T13:13:39.061697+0000","last_became_peered":"2023-10-09T13:13:39.061697+0000","last_unstale":"2023-10-09T13:13:39.064295+0000","last_undegraded":"2023-10-09T13:13:39.064295+0000","last_fullsized":"2023-10-09T13:13:39.064295+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.710649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047373+0000","last_change":"2023-10-09T13:13:39.045857+0000","last_active":"2023-10-09T13:13:39.047373+0000","last_peered":"2023-10-09T13:13:39.047373+0000","last_clean":"2023-10-09T13:13:39.047373+0000","last_became_active":"2023-10-09T13:13:39.045564+0000","last_became_peered":"2023-10-09T13:13:39.045564+0000","last_unstale":"2023-10-09T13:13:39.047373+0000","last_undegraded":"2023-10-09T13:13:39.047373+0000","last_fullsized":"2023-10-09T13:13:39.047373+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:02.187523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060171+0000","last_change":"2023-10-09T13:13:39.056226+0000","last_active":"2023-10-09T13:13:39.060171+0000","last_peered":"2023-10-09T13:13:39.060171+0000","last_clean":"2023-10-09T13:13:39.060171+0000","last_became_active":"2023-10-09T13:13:39.055652+0000","last_became_peered":"2023-10-09T13:13:39.055652+0000","last_unstale":"2023-10-09T13:13:39.060171+0000","last_undegraded":"2023-10-09T13:13:39.060171+0000","last_fullsized":"2023-10-09T13:13:39.060171+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:43.352357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051709+0000","last_change":"2023-10-09T13:13:39.047726+0000","last_active":"2023-10-09T13:13:39.051709+0000","last_peered":"2023-10-09T13:13:39.051709+0000","last_clean":"2023-10-09T13:13:39.051709+0000","last_became_active":"2023-10-09T13:13:39.047362+0000","last_became_peered":"2023-10-09T13:13:39.047362+0000","last_unstale":"2023-10-09T13:13:39.051709+0000","last_undegraded":"2023-10-09T13:13:39.051709+0000","last_fullsized":"2023-10-09T13:13:39.051709+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:06:41.833506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063042+0000","last_change":"2023-10-09T13:13:39.059455+0000","last_active":"2023-10-09T13:13:39.063042+0000","last_peered":"2023-10-09T13:13:39.063042+0000","last_clean":"2023-10-09T13:13:39.063042+0000","last_became_active":"2023-10-09T13:13:39.058865+0000","last_became_peered":"2023-10-09T13:13:39.058865+0000","last_unstale":"2023-10-09T13:13:39.063042+0000","last_undegraded":"2023-10-09T13:13:39.063042+0000","last_fullsized":"2023-10-09T13:13:39.063042+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:23.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058667+0000","last_change":"2023-10-09T13:13:39.049187+0000","last_active":"2023-10-09T13:13:39.058667+0000","last_peered":"2023-10-09T13:13:39.058667+0000","last_clean":"2023-10-09T13:13:39.058667+0000","last_became_active":"2023-10-09T13:13:39.048933+0000","last_became_peered":"2023-10-09T13:13:39.048933+0000","last_unstale":"2023-10-09T13:13:39.058667+0000","last_undegraded":"2023-10-09T13:13:39.058667+0000","last_fullsized":"2023-10-09T13:13:39.058667+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:21.387772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.056267+0000","last_change":"2023-10-09T13:13:39.048521+0000","last_active":"2023-10-09T13:13:39.056267+0000","last_peered":"2023-10-09T13:13:39.056267+0000","last_clean":"2023-10-09T13:13:39.056267+0000","last_became_active":"2023-10-09T13:13:39.048269+0000","last_became_peered":"2023-10-09T13:13:39.048269+0000","last_unstale":"2023-10-09T13:13:39.056267+0000","last_undegraded":"2023-10-09T13:13:39.056267+0000","last_fullsized":"2023-10-09T13:13:39.056267+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:15.509723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058312+0000","last_change":"2023-10-09T13:13:39.053663+0000","last_active":"2023-10-09T13:13:39.058312+0000","last_peered":"2023-10-09T13:13:39.058312+0000","last_clean":"2023-10-09T13:13:39.058312+0000","last_became_active":"2023-10-09T13:13:39.053405+0000","last_became_peered":"2023-10-09T13:13:39.053405+0000","last_unstale":"2023-10-09T13:13:39.058312+0000","last_undegraded":"2023-10-09T13:13:39.058312+0000","last_fullsized":"2023-10-09T13:13:39.058312+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:33.878986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.056295+0000","last_change":"2023-10-09T13:13:39.053269+0000","last_active":"2023-10-09T13:13:39.056295+0000","last_peered":"2023-10-09T13:13:39.056295+0000","last_clean":"2023-10-09T13:13:39.056295+0000","last_became_active":"2023-10-09T13:13:39.052973+0000","last_became_peered":"2023-10-09T13:13:39.052973+0000","last_unstale":"2023-10-09T13:13:39.056295+0000","last_undegraded":"2023-10-09T13:13:39.056295+0000","last_fullsized":"2023-10-09T13:13:39.056295+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:50.679131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058088+0000","last_change":"2023-10-09T13:13:39.054890+0000","last_active":"2023-10-09T13:13:39.058088+0000","last_peered":"2023-10-09T13:13:39.058088+0000","last_clean":"2023-10-09T13:13:39.058088+0000","last_became_active":"2023-10-09T13:13:39.054491+0000","last_became_peered":"2023-10-09T13:13:39.054491+0000","last_unstale":"2023-10-09T13:13:39.058088+0000","last_undegraded":"2023-10-09T13:13:39.058088+0000","last_fullsized":"2023-10-09T13:13:39.058088+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:31.565289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"195'4","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.438086+0000","last_change":"2023-10-09T13:13:38.039309+0000","last_active":"2023-10-09T13:13:39.438086+0000","last_peered":"2023-10-09T13:13:39.438086+0000","last_clean":"2023-10-09T13:13:39.438086+0000","last_became_active":"2023-10-09T13:13:38.038996+0000","last_became_peered":"2023-10-09T13:13:38.038996+0000","last_unstale":"2023-10-09T13:13:39.438086+0000","last_undegraded":"2023-10-09T13:13:39.438086+0000","last_fullsized":"2023-10-09T13:13:39.438086+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:10.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058314+0000","last_change":"2023-10-09T13:13:39.054226+0000","last_active":"2023-10-09T13:13:39.058314+0000","last_peered":"2023-10-09T13:13:39.058314+0000","last_clean":"2023-10-09T13:13:39.058314+0000","last_became_active":"2023-10-09T13:13:39.053973+0000","last_became_peered":"2023-10-09T13:13:39.053973+0000","last_unstale":"2023-10-09T13:13:39.058314+0000","last_undegraded":"2023-10-09T13:13:39.058314+0000","last_fullsized":"2023-10-09T13:13:39.058314+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:43.710649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436285+0000","last_change":"2023-10-09T13:13:38.039171+0000","last_active":"2023-10-09T13:13:39.436285+0000","last_peered":"2023-10-09T13:13:39.436285+0000","last_clean":"2023-10-09T13:13:39.436285+0000","last_became_active":"2023-10-09T13:13:38.038933+0000","last_became_peered":"2023-10-09T13:13:38.038933+0000","last_unstale":"2023-10-09T13:13:39.436285+0000","last_undegraded":"2023-10-09T13:13:39.436285+0000","last_fullsized":"2023-10-09T13:13:39.436285+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:47.407733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.057051+0000","last_change":"2023-10-09T13:13:39.052087+0000","last_active":"2023-10-09T13:13:39.057051+0000","last_peered":"2023-10-09T13:13:39.057051+0000","last_clean":"2023-10-09T13:13:39.057051+0000","last_became_active":"2023-10-09T13:13:39.051831+0000","last_became_peered":"2023-10-09T13:13:39.051831+0000","last_unstale":"2023-10-09T13:13:39.057051+0000","last_undegraded":"2023-10-09T13:13:39.057051+0000","last_fullsized":"2023-10-09T13:13:39.057051+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:12.871127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439619+0000","last_change":"2023-10-09T13:13:38.043827+0000","last_active":"2023-10-09T13:13:39.439619+0000","last_peered":"2023-10-09T13:13:39.439619+0000","last_clean":"2023-10-09T13:13:39.439619+0000","last_became_active":"2023-10-09T13:13:38.043580+0000","last_became_peered":"2023-10-09T13:13:38.043580+0000","last_unstale":"2023-10-09T13:13:39.439619+0000","last_undegraded":"2023-10-09T13:13:39.439619+0000","last_fullsized":"2023-10-09T13:13:39.439619+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:03.497163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046781+0000","last_change":"2023-10-09T13:13:39.043245+0000","last_active":"2023-10-09T13:13:39.046781+0000","last_peered":"2023-10-09T13:13:39.046781+0000","last_clean":"2023-10-09T13:13:39.046781+0000","last_became_active":"2023-10-09T13:13:39.042948+0000","last_became_peered":"2023-10-09T13:13:39.042948+0000","last_unstale":"2023-10-09T13:13:39.046781+0000","last_undegraded":"2023-10-09T13:13:39.046781+0000","last_fullsized":"2023-10-09T13:13:39.046781+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:38.370295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437959+0000","last_change":"2023-10-09T13:13:38.042462+0000","last_active":"2023-10-09T13:13:39.437959+0000","last_peered":"2023-10-09T13:13:39.437959+0000","last_clean":"2023-10-09T13:13:39.437959+0000","last_became_active":"2023-10-09T13:13:38.041868+0000","last_became_peered":"2023-10-09T13:13:38.041868+0000","last_unstale":"2023-10-09T13:13:39.437959+0000","last_undegraded":"2023-10-09T13:13:39.437959+0000","last_fullsized":"2023-10-09T13:13:39.437959+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:37.362698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055977+0000","last_change":"2023-10-09T13:13:39.051631+0000","last_active":"2023-10-09T13:13:39.055977+0000","last_peered":"2023-10-09T13:13:39.055977+0000","last_clean":"2023-10-09T13:13:39.055977+0000","last_became_active":"2023-10-09T13:13:39.051379+0000","last_became_peered":"2023-10-09T13:13:39.051379+0000","last_unstale":"2023-10-09T13:13:39.055977+0000","last_undegraded":"2023-10-09T13:13:39.055977+0000","last_fullsized":"2023-10-09T13:13:39.055977+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:09.176798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437439+0000","last_change":"2023-10-09T13:13:38.044192+0000","last_active":"2023-10-09T13:13:39.437439+0000","last_peered":"2023-10-09T13:13:39.437439+0000","last_clean":"2023-10-09T13:13:39.437439+0000","last_became_active":"2023-10-09T13:13:38.043798+0000","last_became_peered":"2023-10-09T13:13:38.043798+0000","last_unstale":"2023-10-09T13:13:39.437439+0000","last_undegraded":"2023-10-09T13:13:39.437439+0000","last_fullsized":"2023-10-09T13:13:39.437439+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:23.864556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060214+0000","last_change":"2023-10-09T13:13:39.055627+0000","last_active":"2023-10-09T13:13:39.060214+0000","last_peered":"2023-10-09T13:13:39.060214+0000","last_clean":"2023-10-09T13:13:39.060214+0000","last_became_active":"2023-10-09T13:13:39.055356+0000","last_became_peered":"2023-10-09T13:13:39.055356+0000","last_unstale":"2023-10-09T13:13:39.060214+0000","last_undegraded":"2023-10-09T13:13:39.060214+0000","last_fullsized":"2023-10-09T13:13:39.060214+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:49.286094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436660+0000","last_change":"2023-10-09T13:13:38.038204+0000","last_active":"2023-10-09T13:13:39.436660+0000","last_peered":"2023-10-09T13:13:39.436660+0000","last_clean":"2023-10-09T13:13:39.436660+0000","last_became_active":"2023-10-09T13:13:38.037962+0000","last_became_peered":"2023-10-09T13:13:38.037962+0000","last_unstale":"2023-10-09T13:13:39.436660+0000","last_undegraded":"2023-10-09T13:13:39.436660+0000","last_fullsized":"2023-10-09T13:13:39.436660+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:40.996599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055126+0000","last_change":"2023-10-09T13:13:39.048480+0000","last_active":"2023-10-09T13:13:39.055126+0000","last_peered":"2023-10-09T13:13:39.055126+0000","last_clean":"2023-10-09T13:13:39.055126+0000","last_became_active":"2023-10-09T13:13:39.048230+0000","last_became_peered":"2023-10-09T13:13:39.048230+0000","last_unstale":"2023-10-09T13:13:39.055126+0000","last_undegraded":"2023-10-09T13:13:39.055126+0000","last_fullsized":"2023-10-09T13:13:39.055126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:32.917517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.053446+0000","last_change":"2023-10-09T13:13:38.045460+0000","last_active":"2023-10-09T13:13:39.053446+0000","last_peered":"2023-10-09T13:13:39.053446+0000","last_clean":"2023-10-09T13:13:39.053446+0000","last_became_active":"2023-10-09T13:13:38.045187+0000","last_became_peered":"2023-10-09T13:13:38.045187+0000","last_unstale":"2023-10-09T13:13:39.053446+0000","last_undegraded":"2023-10-09T13:13:39.053446+0000","last_fullsized":"2023-10-09T13:13:39.053446+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:53.236078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059456+0000","last_change":"2023-10-09T13:13:39.055277+0000","last_active":"2023-10-09T13:13:39.059456+0000","last_peered":"2023-10-09T13:13:39.059456+0000","last_clean":"2023-10-09T13:13:39.059456+0000","last_became_active":"2023-10-09T13:13:39.054981+0000","last_became_peered":"2023-10-09T13:13:39.054981+0000","last_unstale":"2023-10-09T13:13:39.059456+0000","last_undegraded":"2023-10-09T13:13:39.059456+0000","last_fullsized":"2023-10-09T13:13:39.059456+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:58.227515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.049142+0000","last_change":"2023-10-09T13:13:38.038128+0000","last_active":"2023-10-09T13:13:39.049142+0000","last_peered":"2023-10-09T13:13:39.049142+0000","last_clean":"2023-10-09T13:13:39.049142+0000","last_became_active":"2023-10-09T13:13:38.037818+0000","last_became_peered":"2023-10-09T13:13:38.037818+0000","last_unstale":"2023-10-09T13:13:39.049142+0000","last_undegraded":"2023-10-09T13:13:39.049142+0000","last_fullsized":"2023-10-09T13:13:39.049142+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:28.307900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061545+0000","last_change":"2023-10-09T13:13:39.056626+0000","last_active":"2023-10-09T13:13:39.061545+0000","last_peered":"2023-10-09T13:13:39.061545+0000","last_clean":"2023-10-09T13:13:39.061545+0000","last_became_active":"2023-10-09T13:13:39.056354+0000","last_became_peered":"2023-10-09T13:13:39.056354+0000","last_unstale":"2023-10-09T13:13:39.061545+0000","last_undegraded":"2023-10-09T13:13:39.061545+0000","last_fullsized":"2023-10-09T13:13:39.061545+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:43.352357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.037732+0000","last_change":"2023-10-09T13:13:38.043104+0000","last_active":"2023-10-09T13:13:39.037732+0000","last_peered":"2023-10-09T13:13:39.037732+0000","last_clean":"2023-10-09T13:13:39.037732+0000","last_became_active":"2023-10-09T13:13:38.042789+0000","last_became_peered":"2023-10-09T13:13:38.042789+0000","last_unstale":"2023-10-09T13:13:39.037732+0000","last_undegraded":"2023-10-09T13:13:39.037732+0000","last_fullsized":"2023-10-09T13:13:39.037732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:36.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061685+0000","last_change":"2023-10-09T13:13:39.057524+0000","last_active":"2023-10-09T13:13:39.061685+0000","last_peered":"2023-10-09T13:13:39.061685+0000","last_clean":"2023-10-09T13:13:39.061685+0000","last_became_active":"2023-10-09T13:13:39.057280+0000","last_became_peered":"2023-10-09T13:13:39.057280+0000","last_unstale":"2023-10-09T13:13:39.061685+0000","last_undegraded":"2023-10-09T13:13:39.061685+0000","last_fullsized":"2023-10-09T13:13:39.061685+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:50.728455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"195'3","reported_seq":13,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437745+0000","last_change":"2023-10-09T13:13:38.031271+0000","last_active":"2023-10-09T13:13:39.437745+0000","last_peered":"2023-10-09T13:13:39.437745+0000","last_clean":"2023-10-09T13:13:39.437745+0000","last_became_active":"2023-10-09T13:13:38.030990+0000","last_became_peered":"2023-10-09T13:13:38.030990+0000","last_unstale":"2023-10-09T13:13:39.437745+0000","last_undegraded":"2023-10-09T13:13:39.437745+0000","last_fullsized":"2023-10-09T13:13:39.437745+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:40.953726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.049449+0000","last_change":"2023-10-09T13:13:39.047608+0000","last_active":"2023-10-09T13:13:39.049449+0000","last_peered":"2023-10-09T13:13:39.049449+0000","last_clean":"2023-10-09T13:13:39.049449+0000","last_became_active":"2023-10-09T13:13:39.047047+0000","last_became_peered":"2023-10-09T13:13:39.047047+0000","last_unstale":"2023-10-09T13:13:39.049449+0000","last_undegraded":"2023-10-09T13:13:39.049449+0000","last_fullsized":"2023-10-09T13:13:39.049449+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:38:47.493217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"195'6","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.441932+0000","last_change":"2023-10-09T13:13:38.038975+0000","last_active":"2023-10-09T13:13:39.441932+0000","last_peered":"2023-10-09T13:13:39.441932+0000","last_clean":"2023-10-09T13:13:39.441932+0000","last_became_active":"2023-10-09T13:13:38.038260+0000","last_became_peered":"2023-10-09T13:13:38.038260+0000","last_unstale":"2023-10-09T13:13:39.441932+0000","last_undegraded":"2023-10-09T13:13:39.441932+0000","last_fullsized":"2023-10-09T13:13:39.441932+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:26.791024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061583+0000","last_change":"2023-10-09T13:13:39.057010+0000","last_active":"2023-10-09T13:13:39.061583+0000","last_peered":"2023-10-09T13:13:39.061583+0000","last_clean":"2023-10-09T13:13:39.061583+0000","last_became_active":"2023-10-09T13:13:39.056765+0000","last_became_peered":"2023-10-09T13:13:39.056765+0000","last_unstale":"2023-10-09T13:13:39.061583+0000","last_undegraded":"2023-10-09T13:13:39.061583+0000","last_fullsized":"2023-10-09T13:13:39.061583+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:29:25.197922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437568+0000","last_change":"2023-10-09T13:13:38.046197+0000","last_active":"2023-10-09T13:13:39.437568+0000","last_peered":"2023-10-09T13:13:39.437568+0000","last_clean":"2023-10-09T13:13:39.437568+0000","last_became_active":"2023-10-09T13:13:38.045927+0000","last_became_peered":"2023-10-09T13:13:38.045927+0000","last_unstale":"2023-10-09T13:13:39.437568+0000","last_undegraded":"2023-10-09T13:13:39.437568+0000","last_fullsized":"2023-10-09T13:13:39.437568+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:02.576133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063462+0000","last_change":"2023-10-09T13:13:39.061875+0000","last_active":"2023-10-09T13:13:39.063462+0000","last_peered":"2023-10-09T13:13:39.063462+0000","last_clean":"2023-10-09T13:13:39.063462+0000","last_became_active":"2023-10-09T13:13:39.061604+0000","last_became_peered":"2023-10-09T13:13:39.061604+0000","last_unstale":"2023-10-09T13:13:39.063462+0000","last_undegraded":"2023-10-09T13:13:39.063462+0000","last_fullsized":"2023-10-09T13:13:39.063462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:13.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.045175+0000","last_change":"2023-10-09T13:13:38.043953+0000","last_active":"2023-10-09T13:13:39.045175+0000","last_peered":"2023-10-09T13:13:39.045175+0000","last_clean":"2023-10-09T13:13:39.045175+0000","last_became_active":"2023-10-09T13:13:38.043274+0000","last_became_peered":"2023-10-09T13:13:38.043274+0000","last_unstale":"2023-10-09T13:13:39.045175+0000","last_undegraded":"2023-10-09T13:13:39.045175+0000","last_fullsized":"2023-10-09T13:13:39.045175+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:36.338149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.052772+0000","last_change":"2023-10-09T13:13:39.047476+0000","last_active":"2023-10-09T13:13:39.052772+0000","last_peered":"2023-10-09T13:13:39.052772+0000","last_clean":"2023-10-09T13:13:39.052772+0000","last_became_active":"2023-10-09T13:13:39.047198+0000","last_became_peered":"2023-10-09T13:13:39.047198+0000","last_unstale":"2023-10-09T13:13:39.052772+0000","last_undegraded":"2023-10-09T13:13:39.052772+0000","last_fullsized":"2023-10-09T13:13:39.052772+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:45:13.046752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042122+0000","last_change":"2023-10-09T13:13:38.044962+0000","last_active":"2023-10-09T13:13:39.042122+0000","last_peered":"2023-10-09T13:13:39.042122+0000","last_clean":"2023-10-09T13:13:39.042122+0000","last_became_active":"2023-10-09T13:13:38.044699+0000","last_became_peered":"2023-10-09T13:13:38.044699+0000","last_unstale":"2023-10-09T13:13:39.042122+0000","last_undegraded":"2023-10-09T13:13:39.042122+0000","last_fullsized":"2023-10-09T13:13:39.042122+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:35.719418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.060653+0000","last_change":"2023-10-09T13:13:39.059899+0000","last_active":"2023-10-09T13:13:39.060653+0000","last_peered":"2023-10-09T13:13:39.060653+0000","last_clean":"2023-10-09T13:13:39.060653+0000","last_became_active":"2023-10-09T13:13:39.059609+0000","last_became_peered":"2023-10-09T13:13:39.059609+0000","last_unstale":"2023-10-09T13:13:39.060653+0000","last_undegraded":"2023-10-09T13:13:39.060653+0000","last_fullsized":"2023-10-09T13:13:39.060653+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:01:04.504760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"195'8","reported_seq":18,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.440430+0000","last_change":"2023-10-09T13:13:38.035371+0000","last_active":"2023-10-09T13:13:39.440430+0000","last_peered":"2023-10-09T13:13:39.440430+0000","last_clean":"2023-10-09T13:13:39.440430+0000","last_became_active":"2023-10-09T13:13:38.035103+0000","last_became_peered":"2023-10-09T13:13:38.035103+0000","last_unstale":"2023-10-09T13:13:39.440430+0000","last_undegraded":"2023-10-09T13:13:39.440430+0000","last_fullsized":"2023-10-09T13:13:39.440430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:44:54.809689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055747+0000","last_change":"2023-10-09T13:13:39.052251+0000","last_active":"2023-10-09T13:13:39.055747+0000","last_peered":"2023-10-09T13:13:39.055747+0000","last_clean":"2023-10-09T13:13:39.055747+0000","last_became_active":"2023-10-09T13:13:39.051540+0000","last_became_peered":"2023-10-09T13:13:39.051540+0000","last_unstale":"2023-10-09T13:13:39.055747+0000","last_undegraded":"2023-10-09T13:13:39.055747+0000","last_fullsized":"2023-10-09T13:13:39.055747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:23.410088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.437592+0000","last_change":"2023-10-09T13:13:38.043037+0000","last_active":"2023-10-09T13:13:39.437592+0000","last_peered":"2023-10-09T13:13:39.437592+0000","last_clean":"2023-10-09T13:13:39.437592+0000","last_became_active":"2023-10-09T13:13:38.042743+0000","last_became_peered":"2023-10-09T13:13:38.042743+0000","last_unstale":"2023-10-09T13:13:39.437592+0000","last_undegraded":"2023-10-09T13:13:39.437592+0000","last_fullsized":"2023-10-09T13:13:39.437592+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:41.470190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062178+0000","last_change":"2023-10-09T13:13:39.059709+0000","last_active":"2023-10-09T13:13:39.062178+0000","last_peered":"2023-10-09T13:13:39.062178+0000","last_clean":"2023-10-09T13:13:39.062178+0000","last_became_active":"2023-10-09T13:13:39.059455+0000","last_became_peered":"2023-10-09T13:13:39.059455+0000","last_unstale":"2023-10-09T13:13:39.062178+0000","last_undegraded":"2023-10-09T13:13:39.062178+0000","last_fullsized":"2023-10-09T13:13:39.062178+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:13.908798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436624+0000","last_change":"2023-10-09T13:13:38.048103+0000","last_active":"2023-10-09T13:13:39.436624+0000","last_peered":"2023-10-09T13:13:39.436624+0000","last_clean":"2023-10-09T13:13:39.436624+0000","last_became_active":"2023-10-09T13:13:38.047724+0000","last_became_peered":"2023-10-09T13:13:38.047724+0000","last_unstale":"2023-10-09T13:13:39.436624+0000","last_undegraded":"2023-10-09T13:13:39.436624+0000","last_fullsized":"2023-10-09T13:13:39.436624+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:55:37.297856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.059602+0000","last_change":"2023-10-09T13:13:39.053683+0000","last_active":"2023-10-09T13:13:39.059602+0000","last_peered":"2023-10-09T13:13:39.059602+0000","last_clean":"2023-10-09T13:13:39.059602+0000","last_became_active":"2023-10-09T13:13:39.053405+0000","last_became_peered":"2023-10-09T13:13:39.053405+0000","last_unstale":"2023-10-09T13:13:39.059602+0000","last_undegraded":"2023-10-09T13:13:39.059602+0000","last_fullsized":"2023-10-09T13:13:39.059602+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:36.554982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"195'1","reported_seq":11,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.436315+0000","last_change":"2023-10-09T13:13:38.041999+0000","last_active":"2023-10-09T13:13:39.436315+0000","last_peered":"2023-10-09T13:13:39.436315+0000","last_clean":"2023-10-09T13:13:39.436315+0000","last_became_active":"2023-10-09T13:13:38.041730+0000","last_became_peered":"2023-10-09T13:13:38.041730+0000","last_unstale":"2023-10-09T13:13:39.436315+0000","last_undegraded":"2023-10-09T13:13:39.436315+0000","last_fullsized":"2023-10-09T13:13:39.436315+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:50:58.185602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051841+0000","last_change":"2023-10-09T13:13:39.048395+0000","last_active":"2023-10-09T13:13:39.051841+0000","last_peered":"2023-10-09T13:13:39.051841+0000","last_clean":"2023-10-09T13:13:39.051841+0000","last_became_active":"2023-10-09T13:13:39.048135+0000","last_became_peered":"2023-10-09T13:13:39.048135+0000","last_unstale":"2023-10-09T13:13:39.051841+0000","last_undegraded":"2023-10-09T13:13:39.051841+0000","last_fullsized":"2023-10-09T13:13:39.051841+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:14.058985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.046121+0000","last_change":"2023-10-09T13:13:38.047326+0000","last_active":"2023-10-09T13:13:39.046121+0000","last_peered":"2023-10-09T13:13:39.046121+0000","last_clean":"2023-10-09T13:13:39.046121+0000","last_became_active":"2023-10-09T13:13:38.047009+0000","last_became_peered":"2023-10-09T13:13:38.047009+0000","last_unstale":"2023-10-09T13:13:39.046121+0000","last_undegraded":"2023-10-09T13:13:39.046121+0000","last_fullsized":"2023-10-09T13:13:39.046121+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:26.157313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058268+0000","last_change":"2023-10-09T13:13:39.053092+0000","last_active":"2023-10-09T13:13:39.058268+0000","last_peered":"2023-10-09T13:13:39.058268+0000","last_clean":"2023-10-09T13:13:39.058268+0000","last_became_active":"2023-10-09T13:13:39.052836+0000","last_became_peered":"2023-10-09T13:13:39.052836+0000","last_unstale":"2023-10-09T13:13:39.058268+0000","last_undegraded":"2023-10-09T13:13:39.058268+0000","last_fullsized":"2023-10-09T13:13:39.058268+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:13:42.004196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439720+0000","last_change":"2023-10-09T13:13:38.044372+0000","last_active":"2023-10-09T13:13:39.439720+0000","last_peered":"2023-10-09T13:13:39.439720+0000","last_clean":"2023-10-09T13:13:39.439720+0000","last_became_active":"2023-10-09T13:13:38.044133+0000","last_became_peered":"2023-10-09T13:13:38.044133+0000","last_unstale":"2023-10-09T13:13:39.439720+0000","last_undegraded":"2023-10-09T13:13:39.439720+0000","last_fullsized":"2023-10-09T13:13:39.439720+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:06:40.825909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.055907+0000","last_change":"2023-10-09T13:13:39.053545+0000","last_active":"2023-10-09T13:13:39.055907+0000","last_peered":"2023-10-09T13:13:39.055907+0000","last_clean":"2023-10-09T13:13:39.055907+0000","last_became_active":"2023-10-09T13:13:39.053183+0000","last_became_peered":"2023-10-09T13:13:39.053183+0000","last_unstale":"2023-10-09T13:13:39.055907+0000","last_undegraded":"2023-10-09T13:13:39.055907+0000","last_fullsized":"2023-10-09T13:13:39.055907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:37.301381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.045809+0000","last_change":"2023-10-09T13:13:38.032150+0000","last_active":"2023-10-09T13:13:39.045809+0000","last_peered":"2023-10-09T13:13:39.045809+0000","last_clean":"2023-10-09T13:13:39.045809+0000","last_became_active":"2023-10-09T13:13:38.031867+0000","last_became_peered":"2023-10-09T13:13:38.031867+0000","last_unstale":"2023-10-09T13:13:39.045809+0000","last_undegraded":"2023-10-09T13:13:39.045809+0000","last_fullsized":"2023-10-09T13:13:39.045809+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:47.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061570+0000","last_change":"2023-10-09T13:13:39.060114+0000","last_active":"2023-10-09T13:13:39.061570+0000","last_peered":"2023-10-09T13:13:39.061570+0000","last_clean":"2023-10-09T13:13:39.061570+0000","last_became_active":"2023-10-09T13:13:39.059138+0000","last_became_peered":"2023-10-09T13:13:39.059138+0000","last_unstale":"2023-10-09T13:13:39.061570+0000","last_undegraded":"2023-10-09T13:13:39.061570+0000","last_fullsized":"2023-10-09T13:13:39.061570+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:28:42.743455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.043012+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.042753+0000","last_became_peered":"2023-10-09T13:13:38.042753+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:26.638250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.062583+0000","last_change":"2023-10-09T13:13:39.057491+0000","last_active":"2023-10-09T13:13:39.062583+0000","last_peered":"2023-10-09T13:13:39.062583+0000","last_clean":"2023-10-09T13:13:39.062583+0000","last_became_active":"2023-10-09T13:13:39.057245+0000","last_became_peered":"2023-10-09T13:13:39.057245+0000","last_unstale":"2023-10-09T13:13:39.062583+0000","last_undegraded":"2023-10-09T13:13:39.062583+0000","last_fullsized":"2023-10-09T13:13:39.062583+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:52.359359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.044640+0000","last_change":"2023-10-09T13:13:38.042947+0000","last_active":"2023-10-09T13:13:39.044640+0000","last_peered":"2023-10-09T13:13:39.044640+0000","last_clean":"2023-10-09T13:13:39.044640+0000","last_became_active":"2023-10-09T13:13:38.042688+0000","last_became_peered":"2023-10-09T13:13:38.042688+0000","last_unstale":"2023-10-09T13:13:39.044640+0000","last_undegraded":"2023-10-09T13:13:39.044640+0000","last_fullsized":"2023-10-09T13:13:39.044640+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:53:26.687484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061358+0000","last_change":"2023-10-09T13:13:39.057902+0000","last_active":"2023-10-09T13:13:39.061358+0000","last_peered":"2023-10-09T13:13:39.061358+0000","last_clean":"2023-10-09T13:13:39.061358+0000","last_became_active":"2023-10-09T13:13:39.057326+0000","last_became_peered":"2023-10-09T13:13:39.057326+0000","last_unstale":"2023-10-09T13:13:39.061358+0000","last_undegraded":"2023-10-09T13:13:39.061358+0000","last_fullsized":"2023-10-09T13:13:39.061358+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:53.270329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"195'2","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.439542+0000","last_change":"2023-10-09T13:13:38.047384+0000","last_active":"2023-10-09T13:13:39.439542+0000","last_peered":"2023-10-09T13:13:39.439542+0000","last_clean":"2023-10-09T13:13:39.439542+0000","last_became_active":"2023-10-09T13:13:38.046973+0000","last_became_peered":"2023-10-09T13:13:38.046973+0000","last_unstale":"2023-10-09T13:13:39.439542+0000","last_undegraded":"2023-10-09T13:13:39.439542+0000","last_fullsized":"2023-10-09T13:13:39.439542+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:46.573124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.063897+0000","last_change":"2023-10-09T13:13:39.062987+0000","last_active":"2023-10-09T13:13:39.063897+0000","last_peered":"2023-10-09T13:13:39.063897+0000","last_clean":"2023-10-09T13:13:39.063897+0000","last_became_active":"2023-10-09T13:13:39.062714+0000","last_became_peered":"2023-10-09T13:13:39.062714+0000","last_unstale":"2023-10-09T13:13:39.063897+0000","last_undegraded":"2023-10-09T13:13:39.063897+0000","last_fullsized":"2023-10-09T13:13:39.063897+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:57.858815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"196'1","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-10-09T13:13:40.044664+0000","last_change":"2023-10-09T13:13:38.043557+0000","last_active":"2023-10-09T13:13:40.044664+0000","last_peered":"2023-10-09T13:13:40.044664+0000","last_clean":"2023-10-09T13:13:40.044664+0000","last_became_active":"2023-10-09T13:13:38.043248+0000","last_became_peered":"2023-10-09T13:13:38.043248+0000","last_unstale":"2023-10-09T13:13:40.044664+0000","last_undegraded":"2023-10-09T13:13:40.044664+0000","last_fullsized":"2023-10-09T13:13:40.044664+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:38.573477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.051413+0000","last_change":"2023-10-09T13:13:39.050681+0000","last_active":"2023-10-09T13:13:39.051413+0000","last_peered":"2023-10-09T13:13:39.051413+0000","last_clean":"2023-10-09T13:13:39.051413+0000","last_became_active":"2023-10-09T13:13:39.050420+0000","last_became_peered":"2023-10-09T13:13:39.050420+0000","last_unstale":"2023-10-09T13:13:39.051413+0000","last_undegraded":"2023-10-09T13:13:39.051413+0000","last_fullsized":"2023-10-09T13:13:39.051413+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:24.808179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.053077+0000","last_change":"2023-10-09T13:13:38.047884+0000","last_active":"2023-10-09T13:13:39.053077+0000","last_peered":"2023-10-09T13:13:39.053077+0000","last_clean":"2023-10-09T13:13:39.053077+0000","last_became_active":"2023-10-09T13:13:38.047590+0000","last_became_peered":"2023-10-09T13:13:38.047590+0000","last_unstale":"2023-10-09T13:13:39.053077+0000","last_undegraded":"2023-10-09T13:13:39.053077+0000","last_fullsized":"2023-10-09T13:13:39.053077+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:04.634105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.052107+0000","last_change":"2023-10-09T13:13:39.051089+0000","last_active":"2023-10-09T13:13:39.052107+0000","last_peered":"2023-10-09T13:13:39.052107+0000","last_clean":"2023-10-09T13:13:39.052107+0000","last_became_active":"2023-10-09T13:13:39.050166+0000","last_became_peered":"2023-10-09T13:13:39.050166+0000","last_unstale":"2023-10-09T13:13:39.052107+0000","last_undegraded":"2023-10-09T13:13:39.052107+0000","last_fullsized":"2023-10-09T13:13:39.052107+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:37.301381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.045755+0000","last_change":"2023-10-09T13:13:38.046911+0000","last_active":"2023-10-09T13:13:39.045755+0000","last_peered":"2023-10-09T13:13:39.045755+0000","last_clean":"2023-10-09T13:13:39.045755+0000","last_became_active":"2023-10-09T13:13:38.046554+0000","last_became_peered":"2023-10-09T13:13:38.046554+0000","last_unstale":"2023-10-09T13:13:39.045755+0000","last_undegraded":"2023-10-09T13:13:39.045755+0000","last_fullsized":"2023-10-09T13:13:39.045755+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:02.369855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058752+0000","last_change":"2023-10-09T13:13:39.054429+0000","last_active":"2023-10-09T13:13:39.058752+0000","last_peered":"2023-10-09T13:13:39.058752+0000","last_clean":"2023-10-09T13:13:39.058752+0000","last_became_active":"2023-10-09T13:13:39.054170+0000","last_became_peered":"2023-10-09T13:13:39.054170+0000","last_unstale":"2023-10-09T13:13:39.058752+0000","last_undegraded":"2023-10-09T13:13:39.058752+0000","last_fullsized":"2023-10-09T13:13:39.058752+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:32.299144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.040056+0000","last_change":"2023-10-09T13:13:38.046349+0000","last_active":"2023-10-09T13:13:39.040056+0000","last_peered":"2023-10-09T13:13:39.040056+0000","last_clean":"2023-10-09T13:13:39.040056+0000","last_became_active":"2023-10-09T13:13:38.045977+0000","last_became_peered":"2023-10-09T13:13:38.045977+0000","last_unstale":"2023-10-09T13:13:39.040056+0000","last_undegraded":"2023-10-09T13:13:39.040056+0000","last_fullsized":"2023-10-09T13:13:39.040056+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:31:56.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058493+0000","last_change":"2023-10-09T13:13:39.056812+0000","last_active":"2023-10-09T13:13:39.058493+0000","last_peered":"2023-10-09T13:13:39.058493+0000","last_clean":"2023-10-09T13:13:39.058493+0000","last_became_active":"2023-10-09T13:13:39.054693+0000","last_became_peered":"2023-10-09T13:13:39.054693+0000","last_unstale":"2023-10-09T13:13:39.058493+0000","last_undegraded":"2023-10-09T13:13:39.058493+0000","last_fullsized":"2023-10-09T13:13:39.058493+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:21.005504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.042217+0000","last_change":"2023-10-09T13:13:38.046306+0000","last_active":"2023-10-09T13:13:39.042217+0000","last_peered":"2023-10-09T13:13:39.042217+0000","last_clean":"2023-10-09T13:13:39.042217+0000","last_became_active":"2023-10-09T13:13:38.046042+0000","last_became_peered":"2023-10-09T13:13:38.046042+0000","last_unstale":"2023-10-09T13:13:39.042217+0000","last_undegraded":"2023-10-09T13:13:39.042217+0000","last_fullsized":"2023-10-09T13:13:39.042217+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:20.380175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.058354+0000","last_change":"2023-10-09T13:13:39.055019+0000","last_active":"2023-10-09T13:13:39.058354+0000","last_peered":"2023-10-09T13:13:39.058354+0000","last_clean":"2023-10-09T13:13:39.058354+0000","last_became_active":"2023-10-09T13:13:39.054711+0000","last_became_peered":"2023-10-09T13:13:39.054711+0000","last_unstale":"2023-10-09T13:13:39.058354+0000","last_undegraded":"2023-10-09T13:13:39.058354+0000","last_fullsized":"2023-10-09T13:13:39.058354+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:36.954416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.053541+0000","last_change":"2023-10-09T13:13:38.048493+0000","last_active":"2023-10-09T13:13:39.053541+0000","last_peered":"2023-10-09T13:13:39.053541+0000","last_clean":"2023-10-09T13:13:39.053541+0000","last_became_active":"2023-10-09T13:13:38.048252+0000","last_became_peered":"2023-10-09T13:13:38.048252+0000","last_unstale":"2023-10-09T13:13:39.053541+0000","last_undegraded":"2023-10-09T13:13:39.053541+0000","last_fullsized":"2023-10-09T13:13:39.053541+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:47.407733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.047721+0000","last_change":"2023-10-09T13:13:39.043801+0000","last_active":"2023-10-09T13:13:39.047721+0000","last_peered":"2023-10-09T13:13:39.047721+0000","last_clean":"2023-10-09T13:13:39.047721+0000","last_became_active":"2023-10-09T13:13:39.043513+0000","last_became_peered":"2023-10-09T13:13:39.043513+0000","last_unstale":"2023-10-09T13:13:39.047721+0000","last_undegraded":"2023-10-09T13:13:39.047721+0000","last_fullsized":"2023-10-09T13:13:39.047721+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:36.727014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.039716+0000","last_change":"2023-10-09T13:13:38.035413+0000","last_active":"2023-10-09T13:13:39.039716+0000","last_peered":"2023-10-09T13:13:39.039716+0000","last_clean":"2023-10-09T13:13:39.039716+0000","last_became_active":"2023-10-09T13:13:38.035171+0000","last_became_peered":"2023-10-09T13:13:38.035171+0000","last_unstale":"2023-10-09T13:13:39.039716+0000","last_undegraded":"2023-10-09T13:13:39.039716+0000","last_fullsized":"2023-10-09T13:13:39.039716+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:53.236078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.061394+0000","last_change":"2023-10-09T13:13:39.058646+0000","last_active":"2023-10-09T13:13:39.061394+0000","last_peered":"2023-10-09T13:13:39.061394+0000","last_clean":"2023-10-09T13:13:39.061394+0000","last_became_active":"2023-10-09T13:13:39.058387+0000","last_became_peered":"2023-10-09T13:13:39.058387+0000","last_unstale":"2023-10-09T13:13:39.061394+0000","last_undegraded":"2023-10-09T13:13:39.061394+0000","last_fullsized":"2023-10-09T13:13:39.061394+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:38.017047+0000","last_clean_scrub_stamp":"2023-10-09T13:13:38.017047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:31.565289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.040591+0000","last_change":"2023-10-09T13:13:38.040428+0000","last_active":"2023-10-09T13:13:39.040591+0000","last_peered":"2023-10-09T13:13:39.040591+0000","last_clean":"2023-10-09T13:13:39.040591+0000","last_became_active":"2023-10-09T13:13:38.040158+0000","last_became_peered":"2023-10-09T13:13:38.040158+0000","last_unstale":"2023-10-09T13:13:39.040591+0000","last_undegraded":"2023-10-09T13:13:39.040591+0000","last_fullsized":"2023-10-09T13:13:39.040591+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:13:37.009450+0000","last_clean_scrub_stamp":"2023-10-09T13:13:37.009450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:43:04.634105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"185'326","reported_seq":1050,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-09T13:13:39.044769+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:13:39.044769+0000","last_peered":"2023-10-09T13:13:39.044769+0000","last_clean":"2023-10-09T13:13:39.044769+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:13:39.044769+0000","last_undegraded":"2023-10-09T13:13:39.044769+0000","last_fullsized":"2023-10-09T13:13:39.044769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477835,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312560,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059280,"statfs":{"total":96636764160,"available":96316702720,"internally_reserved":0,"allocated":3055616,"data_stored":1816439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94899999999999995,"5min":1.004,"15min":1.008},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.46200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":1.022,"15min":1.022},"last":0.72799999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.71899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.995,"5min":0.995,"15min":1.02},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.64500000000000002,"5min":0.54900000000000004,"15min":0.443},"max":{"1min":0.88800000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67100000000000004}]},{"osd":2,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.51100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":0.97899999999999998,"15min":1.073},"last":0.755},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":1.097,"15min":1.097},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58999999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":1.208},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":1.2410000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.36399999999999999},"max":{"1min":0.74399999999999999,"5min":1.089,"15min":1.089},"last":0.433},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81799999999999995,"5min":0.85499999999999998,"15min":1.0780000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.40899999999999997,"15min":0.35699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Oct 9 13:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.45800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.2070000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":1.038,"15min":1.3200000000000001},"last":0.69999999999999996}]}]},{"osd":6,"up_from":16,"seq":68719477836,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.026},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.83199999999999996}]},{"osd":1,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.99399999999999999,"15min":1.014},"last":0.623},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77900000000000003,"15min":0.75800000000000001},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.503},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.753}]},{"osd":2,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.47699999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.871}]},{"osd":3,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.48299999999999998},"max":{"1min":0.95499999999999996,"5min":1.032,"15min":1.05},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.501},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72399999999999998}]},{"osd":4,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.504},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.88900000000000001,"5min":0.90900000000000003,"15min":1.0449999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.76000000000000001,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.034},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.89300000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91900000000000004,"5min":1.0329999999999999,"15min":1.0469999999999999},"last":0.57199999999999995}]}]},{"osd":1,"up_from":15,"seq":64424510540,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307864,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063976,"statfs":{"total":96636764160,"available":96321511424,"internally_reserved":0,"allocated":2441216,"data_stored":1223855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68300000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.27200000000000002,"15min":0.25800000000000001},"max":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.89700000000000002},"last":0.63900000000000001}]},{"osd":2,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.315},"max":{"1min":0.75,"5min":0.77600000000000002,"15min":0.92700000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.438,"5min":0.374,"15min":0.36299999999999999},"max":{"1min":0.78500000000000003,"5min":0.80400000000000005,"15min":0.872},"last":0.499}]},{"osd":3,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76000000000000001,"5min":1.052,"15min":1.052},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.56999999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.123,"15min":1.149},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.68500000000000005,"5min":0.56699999999999995,"15min":0.43099999999999999},"max":{"1min":1.0820000000000001,"5min":1.1639999999999999,"15min":1.2849999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.63400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.226},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.44400000000000001},"max":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2250000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.212,"5min":1.24,"15min":1.24},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.86399999999999999},"min":{"1min":0.71599999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.177,"5min":1.177,"15min":1.3220000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 13:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.60199999999999998,"5min":0.503,"15min":0.47599999999999998},"max":{"1min":1.1559999999999999,"5min":1.1830000000000001,"15min":1.202},"last":0.752},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88800000000000001,"15min":0.88700000000000001},"min":{"1min":0.75,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.244,"5min":1.2569999999999999,"15min":1.266},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129543243,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308440,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063400,"statfs":{"total":96636764160,"available":96320921600,"internally_reserved":0,"allocated":3031040,"data_stored":1814189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.30099999999999999},"max":{"1min":0.64100000000000001,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71199999999999997,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.35699999999999998,"15min":0.35199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.504},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.72799999999999998,"5min":1.135,"15min":1.135},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83499999999999996,"15min":0.83599999999999997},"min":{"1min":0.59999999999999998,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.1220000000000001,"5min":1.171,"15min":1.171},"last":0.99199999999999999}]},{"osd":5,"last update":"Mon Oct 9 13:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.54800000000000004},"max":{"1min":1.046,"5min":1.099,"15min":1.212},"last":0.98099999999999998}]},{"osd":6,"last update":"Mon Oct 9 13:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.81599999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":0.93000000000000005,"5min":1.1779999999999999,"15min":1.194},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82099999999999995,"15min":0.82799999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.94599999999999995}]},{"osd":7,"last update":"Mon Oct 9 13:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84199999999999997,"15min":0.83899999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.83799999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.46800000000000003},"max":{"1min":1.004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.91000000000000003}]}]},{"osd":2,"up_from":14,"seq":60129543243,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.72699999999999998,"15min":0.90000000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.83799999999999997},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":0.78500000000000003,"15min":0.877},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.72499999999999998,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.751,"5min":0.91600000000000004,"15min":0.96699999999999997},"last":0.50600000000000001}]},{"osd":4,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82499999999999996,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.1180000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.83799999999999997,"15min":0.82699999999999996},"min":{"1min":0.66400000000000003,"5min":0.58799999999999997,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.1559999999999999,"15min":1.337},"last":0.751}]},{"osd":5,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.84699999999999998,"15min":0.84099999999999997},"min":{"1min":0.63500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0800000000000001,"5min":1.2170000000000001,"15min":1.3460000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83499999999999996},"min":{"1min":0.65200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.1499999999999999,"5min":1.1759999999999999,"15min":1.2310000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.878,"15min":0.871},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.55700000000000005},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.3180000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.874,"15min":0.86399999999999999},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.161,"5min":1.161,"15min":1.2629999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:13:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.87,"15min":0.87},"min":{"1min":0.70999999999999996,"5min":0.58899999999999997,"15min":0.58599999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.4490000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.89700000000000002,"15min":0.89300000000000002},"min":{"1min":0.66700000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.3779999999999999},"last":0.76700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424510540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1223855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.48199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88700000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.318},"max":{"1min":0.71399999999999997,"5min":1.399,"15min":1.399},"last":0.48799999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.53300000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.84699999999999998},"last":0.61799999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.65600000000000003,"15min":0.61499999999999999},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":6.9880000000000004,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.56000000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.877},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90300000000000002,"15min":0.88700000000000001},"min":{"1min":0.629,"5min":0.624,"15min":0.58399999999999996},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.82099999999999995}]},{"osd":5,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.63,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1339999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.84599999999999997},"min":{"1min":0.64000000000000001,"5min":0.61099999999999999,"15min":0.57399999999999995},"max":{"1min":1.177,"5min":1.204,"15min":1.204},"last":0.84199999999999997}]},{"osd":6,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83899999999999997,"15min":0.82899999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.53800000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.68999999999999995}]},{"osd":7,"last update":"Mon Oct 9 13:13:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85399999999999998,"15min":0.84899999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.121,"5min":1.145,"15min":1.4610000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2130000000000001,"5min":1.304,"15min":1.5349999999999999},"last":0.90700000000000003}]}]},{"osd":4,"up_from":16,"seq":68719477835,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072156,"statfs":{"total":96636764160,"available":96329887744,"internally_reserved":0,"allocated":2453504,"data_stored":1225427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.98999999999999999,"15min":1.0109999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92400000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.62}]},{"osd":1,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.75600000000000001},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.036},"last":0.748},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":1.018,"15min":1.018},"last":0.65000000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.76700000000000002},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95599999999999996,"5min":0.995,"15min":1.0429999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":1.052,"15min":1.079},"last":0.75900000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.63,"5min":0.499,"15min":0.499},"max":{"1min":0.95699999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.68000000000000005,"5min":0.53500000000000003,"15min":0.50800000000000001},"max":{"1min":0.89400000000000002,"5min":1.173,"15min":1.214},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.80600000000000005,"5min":1.026,"15min":1.026},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.439,"15min":0.39500000000000002},"max":{"1min":0.92500000000000004,"5min":0.999,"15min":1.0049999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.056,"15min":1.056},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.70399999999999996},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":1.1759999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.73099999999999998,"15min":0.73699999999999999},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93600000000000005,"5min":1.032,"15min":1.1020000000000001},"last":0.58199999999999996}]}]},{"osd":5,"up_from":16,"seq":68719477835,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311964,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059876,"statfs":{"total":96636764160,"available":96317313024,"internally_reserved":0,"allocated":2445312,"data_stored":1224397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.371},"max":{"1min":0.96399999999999997,"5min":1.075,"15min":1.075},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.58399999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.026,"15min":1.026},"last":0.80500000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92900000000000005,"5min":0.95399999999999996,"15min":0.97799999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.44400000000000001},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.749,"15min":0.749},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.91700000000000004,"5min":0.999,"15min":1.008},"last":0.753},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86499999999999999,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0009999999999999,"5min":1.018,"15min":1.115},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.65500000000000003,"5min":0.625,"15min":0.58999999999999997},"max":{"1min":0.98399999999999999,"5min":1.0029999999999999,"15min":1.03},"last":0.84799999999999998}]},{"osd":4,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.46999999999999997,"5min":0.40200000000000002,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":1.038,"15min":1.038},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.45000000000000001,"5min":0.434,"15min":0.39900000000000002},"max":{"1min":0.85199999999999998,"5min":0.93600000000000005,"15min":1.0209999999999999},"last":0.46700000000000003}]},{"osd":6,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":1.002,"15min":1.0800000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.747},"min":{"1min":0.626,"5min":0.55300000000000005,"15min":0.47399999999999998},"max":{"1min":0.92700000000000005,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":1.0269999999999999,"15min":1.1100000000000001},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:13:49.029 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T13:13:49.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T13:13:49.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.250+0000 7f0ffe19d700 1 Processor -- start 2023-10-09T13:13:49.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.250+0000 7f0ffe19d700 1 -- start start 2023-10-09T13:13:49.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffe19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff80caee0 0x7f0ff80ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffe19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0ff8156780 0x7f0ff80ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffe19d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80cbe50 con 0x7f0ff81563b0 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffe19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80cb370 con 0x7f0ff8156780 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffe19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80cb650 con 0x7f0ff80caee0 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffd99c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0ff8156780 0x7f0ff80ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffd19b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0ff81563b0 0x7f0ff80ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55970/0 (socket says 172.21.15.86:55970) 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.251+0000 7f0ffd19b700 1 -- 172.21.15.86:0/3282302700 learned_addr learned my addr 172.21.15.86:0/3282302700 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0ffc99a700 1 --2- 172.21.15.86:0/3282302700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff80caee0 0x7f0ff80ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0ffd99c700 1 -- 172.21.15.86:0/3282302700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff80caee0 msgr2=0x7f0ff80ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0ffd99c700 1 --2- 172.21.15.86:0/3282302700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff80caee0 0x7f0ff80ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.254 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0ffd99c700 1 -- 172.21.15.86:0/3282302700 >> v1:172.21.15.86:6789/0 conn(0x7f0ff81563b0 legacy=0x7f0ff80ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0ffd99c700 1 -- 172.21.15.86:0/3282302700 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80c6860 con 0x7f0ff8156780 2023-10-09T13:13:49.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0ffc99a700 1 --2- 172.21.15.86:0/3282302700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff80caee0 0x7f0ff80ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:49.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0feffff700 1 -- 172.21.15.86:0/3282302700 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439068364 0 0) 0x7f0ff80cbe50 con 0x7f0ff81563b0 2023-10-09T13:13:49.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0ffd99c700 1 --2- 172.21.15.86:0/3282302700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80ae7f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009e90 tx=0x7f0ff0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdc1144327528c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:49.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0feffff700 1 -- 172.21.15.86:0/3282302700 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000e070 con 0x7f0ff8156780 2023-10-09T13:13:49.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0feffff700 1 -- 172.21.15.86:0/3282302700 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000bbf0 con 0x7f0ff8156780 2023-10-09T13:13:49.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.252+0000 7f0feffff700 1 -- 172.21.15.86:0/3282302700 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0012430 con 0x7f0ff8156780 2023-10-09T13:13:49.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3282302700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 msgr2=0x7f0ff80ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3282302700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80ae7f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009e90 tx=0x7f0ff0009780 comp rx=0 tx=0).stop 2023-10-09T13:13:49.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3282302700 shutdown_connections 2023-10-09T13:13:49.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3282302700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80ae7f0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3282302700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff80caee0 0x7f0ff80ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3282302700 >> 172.21.15.86:0/3282302700 conn(0x7f0ff8068e20 msgr2=0x7f0ff80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:49.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3282302700 shutdown_connections 2023-10-09T13:13:49.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.253+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3282302700 wait complete. 2023-10-09T13:13:49.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.254+0000 7f0ffe19d700 1 Processor -- start 2023-10-09T13:13:49.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.255+0000 7f0ffe19d700 1 -- start start 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.255+0000 7f0ffe19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ff80caee0 0x7f0ff814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.255+0000 7f0ffe19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff81563b0 0x7f0ff80c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffe19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffe19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80c60f0 con 0x7f0ff8156780 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffe19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80af2b0 con 0x7f0ff80caee0 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffe19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814f100 con 0x7f0ff81563b0 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55282/0 (socket says 172.21.15.86:55282) 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 -- 172.21.15.86:0/3428786175 learned_addr learned my addr 172.21.15.86:0/3428786175 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffc99a700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff81563b0 0x7f0ff80c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd19b700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ff80caee0 0x7f0ff814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 -- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff81563b0 msgr2=0x7f0ff80c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff81563b0 0x7f0ff80c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 -- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ff80caee0 msgr2=0x7f0ff814ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ff80caee0 0x7f0ff814ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 -- 172.21.15.86:0/3428786175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009a20 con 0x7f0ff8156780 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.256+0000 7f0ffd99c700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80c7d40 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8064f90 tx=0x7f0ff0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.257+0000 7f0fed7fa700 1 -- 172.21.15.86:0/3428786175 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0027470 con 0x7f0ff8156780 2023-10-09T13:13:49.260 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.257+0000 7f0fed7fa700 1 -- 172.21.15.86:0/3428786175 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00275d0 con 0x7f0ff8156780 2023-10-09T13:13:49.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.257+0000 7f0fed7fa700 1 -- 172.21.15.86:0/3428786175 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0027990 con 0x7f0ff8156780 2023-10-09T13:13:49.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.257+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80c5850 con 0x7f0ff8156780 2023-10-09T13:13:49.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.257+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff80c5e10 con 0x7f0ff8156780 2023-10-09T13:13:49.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.258+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff80af420 con 0x7f0ff8156780 2023-10-09T13:13:49.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.259+0000 7f0fed7fa700 1 -- 172.21.15.86:0/3428786175 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ff0024070 con 0x7f0ff8156780 2023-10-09T13:13:49.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.259+0000 7f0fed7fa700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0fdc066f30 0x7f0fdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.259+0000 7f0fed7fa700 1 -- 172.21.15.86:0/3428786175 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f0ff0086de0 con 0x7f0ff8156780 2023-10-09T13:13:49.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.260+0000 7f0ffd19b700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0fdc066f30 0x7f0fdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.260+0000 7f0ffd19b700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0fdc066f30 0x7f0fdc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4007fd0 tx=0x7f0ff4007d30 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:49.265 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.264+0000 7f0fed7fa700 1 -- 172.21.15.86:0/3428786175 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ff0053e70 con 0x7f0ff8156780 2023-10-09T13:13:49.531 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.530+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0ff804c3c0 con 0x7f0ff8156780 2023-10-09T13:13:49.535 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.534+0000 7f0fed7fa700 1 -- 172.21.15.86:0/3428786175 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v53) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0ff002c020 con 0x7f0ff8156780 2023-10-09T13:13:49.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0fdc066f30 msgr2=0x7f0fdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0fdc066f30 0x7f0fdc0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4007fd0 tx=0x7f0ff4007d30 comp rx=0 tx=0).stop 2023-10-09T13:13:49.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 msgr2=0x7f0ff80c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80c7d40 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8064f90 tx=0x7f0ff0019000 comp rx=0 tx=0).stop 2023-10-09T13:13:49.538 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 shutdown_connections 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0fdc066f30 0x7f0fdc0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ff8156780 0x7f0ff80c7d40 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ff80caee0 0x7f0ff814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 --2- 172.21.15.86:0/3428786175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff81563b0 0x7f0ff80c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.536+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 >> 172.21.15.86:0/3428786175 conn(0x7f0ff8068e20 msgr2=0x7f0ff80cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.537+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 shutdown_connections 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.537+0000 7f0ffe19d700 1 -- 172.21.15.86:0/3428786175 wait complete. 2023-10-09T13:13:49.539 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T13:13:49.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:13:49.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.734+0000 7f07171ff700 1 Processor -- start 2023-10-09T13:13:49.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.734+0000 7f07171ff700 1 -- start start 2023-10-09T13:13:49.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f07171ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0710159720 0x7f0710159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f07171ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07100ab4e0 0x7f07100a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f07171ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100ab980 con 0x7f07100a9e10 2023-10-09T13:13:49.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f07171ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07100aa230 con 0x7f0710159720 2023-10-09T13:13:49.738 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f07171ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07100ac020 con 0x7f07100ab4e0 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f0714f9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0710159720 0x7f0710159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f071579c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f07100a9e10 0x7f07100ad250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55974/0 (socket says 172.21.15.86:55974) 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f071579c700 1 -- 172.21.15.86:0/3318807367 learned_addr learned my addr 172.21.15.86:0/3318807367 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f0714f9b700 1 -- 172.21.15.86:0/3318807367 >> v2:172.21.15.135:3300/0 conn(0x7f07100ab4e0 msgr2=0x7f07100a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f0714f9b700 1 --2- 172.21.15.86:0/3318807367 >> v2:172.21.15.135:3300/0 conn(0x7f07100ab4e0 0x7f07100a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f0714f9b700 1 -- 172.21.15.86:0/3318807367 >> v1:172.21.15.86:6789/0 conn(0x7f07100a9e10 legacy=0x7f07100ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.736+0000 7f0714f9b700 1 -- 172.21.15.86:0/3318807367 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100aa440 con 0x7f0710159720 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.737+0000 7f0714f9b700 1 --2- 172.21.15.86:0/3318807367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0710159720 0x7f0710159af0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f071006fa20 tx=0x7f07040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1e5394398986f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.737+0000 7f070f7fe700 1 -- 172.21.15.86:0/3318807367 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070400b6b0 con 0x7f0710159720 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.737+0000 7f070f7fe700 1 -- 172.21.15.86:0/3318807367 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070400b810 con 0x7f0710159720 2023-10-09T13:13:49.739 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.737+0000 7f070f7fe700 1 -- 172.21.15.86:0/3318807367 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070400bbb0 con 0x7f0710159720 2023-10-09T13:13:49.740 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.737+0000 7f07171ff700 1 -- 172.21.15.86:0/3318807367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0710159720 msgr2=0x7f0710159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.737+0000 7f07171ff700 1 --2- 172.21.15.86:0/3318807367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0710159720 0x7f0710159af0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f071006fa20 tx=0x7f07040091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.738+0000 7f07171ff700 1 -- 172.21.15.86:0/3318807367 shutdown_connections 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.738+0000 7f07171ff700 1 --2- 172.21.15.86:0/3318807367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0710159720 0x7f0710159af0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.738+0000 7f07171ff700 1 --2- 172.21.15.86:0/3318807367 >> v2:172.21.15.135:3300/0 conn(0x7f07100ab4e0 0x7f07100a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.738+0000 7f07171ff700 1 -- 172.21.15.86:0/3318807367 >> 172.21.15.86:0/3318807367 conn(0x7f071006a320 msgr2=0x7f07100cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.738+0000 7f07171ff700 1 -- 172.21.15.86:0/3318807367 shutdown_connections 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.738+0000 7f07171ff700 1 -- 172.21.15.86:0/3318807367 wait complete. 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.739+0000 7f07171ff700 1 Processor -- start 2023-10-09T13:13:49.741 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.739+0000 7f07171ff700 1 -- start start 2023-10-09T13:13:49.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f07171ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07100a9e10 0x7f0710158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f07171ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100ab4e0 0x7f0710155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f07171ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0710159720 0x7f07101560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f07171ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071015a7a0 con 0x7f07100a9e10 2023-10-09T13:13:49.743 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f07171ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071014cba0 con 0x7f07100ab4e0 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f07171ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0710159b90 con 0x7f0710159720 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f0714f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07100a9e10 0x7f0710158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f0714f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07100a9e10 0x7f0710158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55286/0 (socket says 172.21.15.86:55286) 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.740+0000 7f0714f9b700 1 -- 172.21.15.86:0/1145953842 learned_addr learned my addr 172.21.15.86:0/1145953842 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f070ffff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100ab4e0 0x7f0710155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f071579c700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0710159720 0x7f07101560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f0714f9b700 1 -- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0710159720 msgr2=0x7f07101560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f0714f9b700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0710159720 0x7f07101560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f0714f9b700 1 -- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100ab4e0 msgr2=0x7f0710155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.744 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f0714f9b700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100ab4e0 0x7f0710155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f0714f9b700 1 -- 172.21.15.86:0/1145953842 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704009420 con 0x7f07100a9e10 2023-10-09T13:13:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f0714f9b700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07100a9e10 0x7f0710158610 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f0710064290 tx=0x7f0704017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f070cff9700 1 -- 172.21.15.86:0/1145953842 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704011420 con 0x7f07100a9e10 2023-10-09T13:13:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f070cff9700 1 -- 172.21.15.86:0/1145953842 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704011580 con 0x7f07100a9e10 2023-10-09T13:13:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0710159e70 con 0x7f07100a9e10 2023-10-09T13:13:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.741+0000 7f070cff9700 1 -- 172.21.15.86:0/1145953842 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704011940 con 0x7f07100a9e10 2023-10-09T13:13:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.742+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071015a430 con 0x7f07100a9e10 2023-10-09T13:13:49.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.743+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071004c3c0 con 0x7f07100a9e10 2023-10-09T13:13:49.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.743+0000 7f070cff9700 1 -- 172.21.15.86:0/1145953842 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0704011cb0 con 0x7f07100a9e10 2023-10-09T13:13:49.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.744+0000 7f070cff9700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f06f4066f30 0x7f06f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:49.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.744+0000 7f070cff9700 1 -- 172.21.15.86:0/1145953842 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f0704086070 con 0x7f07100a9e10 2023-10-09T13:13:49.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.744+0000 7f070ffff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f06f4066f30 0x7f06f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:49.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.745+0000 7f070ffff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f06f4066f30 0x7f06f40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06fc006fd0 tx=0x7f06fc008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:49.749 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.748+0000 7f070cff9700 1 -- 172.21.15.86:0/1145953842 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0704053100 con 0x7f07100a9e10 2023-10-09T13:13:49.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.980+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07100aa720 con 0x7f07100a9e10 2023-10-09T13:13:49.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.980+0000 7f070cff9700 1 -- 172.21.15.86:0/1145953842 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f0704006cb0 con 0x7f07100a9e10 2023-10-09T13:13:49.982 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:13:49.982 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/768026503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":768026503},{"type":"v1","addr":"172.21.15.86:6834","nonce":768026503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3188349803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3188349803},{"type":"v1","addr":"172.21.15.135:6835","nonce":3188349803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9666,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2491463129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2491463129},{"type":"v1","addr":"172.21.15.86:6835","nonce":2491463129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:13:38.499330+0000","modified":"2023-10-09T13:13:42.436468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9672},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9672":{"gid":9672,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3006026738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3006026738},{"type":"v1","addr":"172.21.15.135:6834","nonce":3006026738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T13:13:49.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f06f4066f30 msgr2=0x7f06f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f06f4066f30 0x7f06f40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06fc006fd0 tx=0x7f06fc008040 comp rx=0 tx=0).stop 2023-10-09T13:13:49.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07100a9e10 msgr2=0x7f0710158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:49.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07100a9e10 0x7f0710158610 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f0710064290 tx=0x7f0704017000 comp rx=0 tx=0).stop 2023-10-09T13:13:49.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 shutdown_connections 2023-10-09T13:13:49.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f06f4066f30 0x7f06f40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07100a9e10 0x7f0710158610 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0710159720 0x7f07101560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.982+0000 7f07171ff700 1 --2- 172.21.15.86:0/1145953842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07100ab4e0 0x7f0710155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.983+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 >> 172.21.15.86:0/1145953842 conn(0x7f071006a320 msgr2=0x7f07100b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.983+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 shutdown_connections 2023-10-09T13:13:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:49.983+0000 7f07171ff700 1 -- 172.21.15.86:0/1145953842 wait complete. 2023-10-09T13:13:49.985 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 86 2023-10-09T13:13:50.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T13:13:38.499330+0000', 'modified': '2023-10-09T13:13:42.436468+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9672}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9672': {'gid': 9672, 'name': 'b', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6834/3006026738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 3006026738}, {'type': 'v1', 'addr': '172.21.15.135:6834', 'nonce': 3006026738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T13:13:50.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T13:13:50.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T13:13:50.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.586+0000 7f41e499d700 1 Processor -- start 2023-10-09T13:13:50.587 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.586+0000 7f41e499d700 1 -- start start 2023-10-09T13:13:50.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.587+0000 7f41e499d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41e00ad870 0x7f41e006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.587+0000 7f41e499d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41e006bf20 0x7f41e006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.589 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.587+0000 7f41e499d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00b40f0 con 0x7f41e0142ea0 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.587+0000 7f41e499d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e006c3a0 con 0x7f41e006bf20 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.587+0000 7f41e499d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e0069640 con 0x7f41e00ad870 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41e006bf20 0x7f41e006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41e006bf20 0x7f41e006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55288/0 (socket says 172.21.15.86:55288) 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 -- 172.21.15.86:0/3168662352 learned_addr learned my addr 172.21.15.86:0/3168662352 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41deffd700 1 --2- 172.21.15.86:0/3168662352 >> v2:172.21.15.135:3300/0 conn(0x7f41e00ad870 0x7f41e006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 -- 172.21.15.86:0/3168662352 >> v2:172.21.15.135:3300/0 conn(0x7f41e00ad870 msgr2=0x7f41e006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 --2- 172.21.15.86:0/3168662352 >> v2:172.21.15.135:3300/0 conn(0x7f41e00ad870 0x7f41e006b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 -- 172.21.15.86:0/3168662352 >> v1:172.21.15.135:6789/0 conn(0x7f41e0142ea0 legacy=0x7f41e00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 -- 172.21.15.86:0/3168662352 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0069920 con 0x7f41e006bf20 2023-10-09T13:13:50.590 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41dffff700 1 --2- 172.21.15.86:0/3168662352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e006bf20 0x7f41e006a120 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f41e00b0e10 tx=0x7f41d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b899fcea2ab914 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.588+0000 7f41de7fc700 1 -- 172.21.15.86:0/3168662352 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800e070 con 0x7f41e006bf20 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41de7fc700 1 -- 172.21.15.86:0/3168662352 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800ba10 con 0x7f41e006bf20 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41de7fc700 1 -- 172.21.15.86:0/3168662352 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80092e0 con 0x7f41e006bf20 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 -- 172.21.15.86:0/3168662352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e006bf20 msgr2=0x7f41e006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 --2- 172.21.15.86:0/3168662352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e006bf20 0x7f41e006a120 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f41e00b0e10 tx=0x7f41d8009840 comp rx=0 tx=0).stop 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 -- 172.21.15.86:0/3168662352 shutdown_connections 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 --2- 172.21.15.86:0/3168662352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e006bf20 0x7f41e006a120 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 --2- 172.21.15.86:0/3168662352 >> v2:172.21.15.135:3300/0 conn(0x7f41e00ad870 0x7f41e006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 -- 172.21.15.86:0/3168662352 >> 172.21.15.86:0/3168662352 conn(0x7f41e00ce430 msgr2=0x7f41e00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:50.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 -- 172.21.15.86:0/3168662352 shutdown_connections 2023-10-09T13:13:50.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.589+0000 7f41e499d700 1 -- 172.21.15.86:0/3168662352 wait complete. 2023-10-09T13:13:50.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.591+0000 7f41e499d700 1 Processor -- start 2023-10-09T13:13:50.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.591+0000 7f41e499d700 1 -- start start 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.591+0000 7f41e499d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e006bf20 0x7f41e00c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41e499d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41e0142ea0 0x7f41e015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41e499d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e015e930 0x7f41e01583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41e499d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e015a350 con 0x7f41e015e930 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41e499d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00c8bb0 con 0x7f41e006bf20 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41e499d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00c8e90 con 0x7f41e0142ea0 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e015e930 0x7f41e01583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e015e930 0x7f41e01583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55292/0 (socket says 172.21.15.86:55292) 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 -- 172.21.15.86:0/3933668802 learned_addr learned my addr 172.21.15.86:0/3933668802 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:50.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41deffd700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41e0142ea0 0x7f41e015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e006bf20 0x7f41e00c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 -- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41e0142ea0 msgr2=0x7f41e015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41e0142ea0 0x7f41e015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 -- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e006bf20 msgr2=0x7f41e00c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e006bf20 0x7f41e00c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 -- 172.21.15.86:0/3933668802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009ae0 con 0x7f41e015e930 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.592+0000 7f41dffff700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e015e930 0x7f41e01583c0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f41e006f0d0 tx=0x7f41d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.593+0000 7f41c77fe700 1 -- 172.21.15.86:0/3933668802 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800bee0 con 0x7f41e015e930 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.593+0000 7f41c77fe700 1 -- 172.21.15.86:0/3933668802 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80032f0 con 0x7f41e015e930 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.593+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e00c9170 con 0x7f41e015e930 2023-10-09T13:13:50.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.593+0000 7f41c77fe700 1 -- 172.21.15.86:0/3933668802 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d801d650 con 0x7f41e015e930 2023-10-09T13:13:50.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.593+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00c87f0 con 0x7f41e015e930 2023-10-09T13:13:50.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.595+0000 7f41c77fe700 1 -- 172.21.15.86:0/3933668802 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41d801da80 con 0x7f41e015e930 2023-10-09T13:13:50.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.596+0000 7f41c77fe700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f41cc066f30 0x7f41cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.596+0000 7f41c77fe700 1 -- 172.21.15.86:0/3933668802 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f41d8085ff0 con 0x7f41e015e930 2023-10-09T13:13:50.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.596+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f41cc066f30 0x7f41cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.596+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f41cc066f30 0x7f41cc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006fd0 tx=0x7f41d0008040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.597+0000 7f41f4327b80 1 Processor -- start 2023-10-09T13:13:50.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.598+0000 7f41f4327b80 1 -- start start 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.598+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.598+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2508850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.598+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.598+0000 7f41f4327b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e2414a70 con 0x5562e2508480 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.598+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e2412270 con 0x5562e24bdb80 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.598+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562e240e060 con 0x5562e24bb5f0 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24e77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55306/0 (socket says 172.21.15.86:55306) 2023-10-09T13:13:50.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 -- 172.21.15.86:0/3440902848 learned_addr learned my addr 172.21.15.86:0/3440902848 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41deffd700 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2508850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41dffff700 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 -- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 msgr2=0x5562e2508850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2508850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 -- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 msgr2=0x5562e24bdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 -- 172.21.15.86:0/3440902848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e22a8270 con 0x5562e2508480 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41deffd700 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2508850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41dffff700 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24e77d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f41d000d940 tx=0x7f41d0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa826f1728caeaf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41c4ff9700 1 -- 172.21.15.86:0/3440902848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0014110 con 0x5562e2508480 2023-10-09T13:13:50.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41c4ff9700 1 -- 172.21.15.86:0/3440902848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0014270 con 0x5562e2508480 2023-10-09T13:13:50.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.599+0000 7f41c4ff9700 1 -- 172.21.15.86:0/3440902848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0014ae0 con 0x5562e2508480 2023-10-09T13:13:50.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 -- 172.21.15.86:0/3440902848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 msgr2=0x5562e24e77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24e77d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f41d000d940 tx=0x7f41d0012000 comp rx=0 tx=0).stop 2023-10-09T13:13:50.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 -- 172.21.15.86:0/3440902848 shutdown_connections 2023-10-09T13:13:50.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24e77d0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3440902848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2508850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 -- 172.21.15.86:0/3440902848 >> 172.21.15.86:0/3440902848 conn(0x5562e24bf0c0 msgr2=0x5562e24bf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 -- 172.21.15.86:0/3440902848 shutdown_connections 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.600+0000 7f41f4327b80 1 -- 172.21.15.86:0/3440902848 wait complete. 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.601+0000 7f41f4327b80 1 -- start start 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.601+0000 7f41f4327b80 1 Processor -- start 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2505350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24be530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41f4327b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e23b9890 con 0x5562e2508480 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e23d4ea0 con 0x5562e24bdb80 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562e2290e30 con 0x5562e24bb5f0 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41f4327b80 10 client.0 _ll_register_callbacks cb 0x5562e24812c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41dffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41dffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24be530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55318/0 (socket says 172.21.15.86:55318) 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41dffff700 1 -- 172.21.15.86:0/3422308967 learned_addr learned my addr 172.21.15.86:0/3422308967 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41deffd700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.602+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2505350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41dffff700 1 -- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 msgr2=0x5562e2505350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41dffff700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2505350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41dffff700 1 -- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 msgr2=0x5562e24bdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41dffff700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41dffff700 1 -- 172.21.15.86:0/3422308967 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d000e040 con 0x5562e2508480 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41deffd700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41dffff700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24be530 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009ab0 tx=0x7f41d801d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e13c5642fc17e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41bdffb700 1 -- 172.21.15.86:0/3422308967 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800e040 con 0x5562e2508480 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41bdffb700 1 -- 172.21.15.86:0/3422308967 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f41d8059f30 con 0x5562e2508480 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562e24b2cd0 con 0x5562e2508480 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41bdffb700 1 -- 172.21.15.86:0/3422308967 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41d8053020 con 0x5562e2508480 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41f4327b80 10 client.9828 fetch_fsmap learned FSMap version 86 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x5562e224afe0 con 0x5562e2508480 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41bdffb700 1 -- 172.21.15.86:0/3422308967 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562e24b2cd0 con 0x5562e2508480 2023-10-09T13:13:50.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.603+0000 7f41bdffb700 1 -- 172.21.15.86:0/3422308967 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f41d8052ad0 con 0x5562e2508480 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.604+0000 7f41f4327b80 10 client.9828 fetch_fsmap finished waiting for FSMap version 86 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.604+0000 7f41f4327b80 10 client.9828 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.604+0000 7f41f4327b80 20 client.9828 populate_metadata read hostname 'smithi086' 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.604+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e95f0 0x5562e24e99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.604+0000 7f41f4327b80 4 client.9828 mds_command: new command op to 9672 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.604+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 --> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562e248faa0 con 0x5562e24e95f0 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.604+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e95f0 0x5562e24e99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.605+0000 7f41bdffb700 10 client.9828 ms_handle_connect on v2:172.21.15.135:6832/3006026738 2023-10-09T13:13:50.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.605+0000 7f41df7fe700 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e95f0 0x5562e24e99c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb74f43568c9bb9f server_cookie=6f1188b71408e412 in_seq=0 out_seq=0 2023-10-09T13:13:50.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41bdffb700 1 -- 172.21.15.86:0/3422308967 <== mds.0 v2:172.21.15.135:6832/3006026738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5562e248faa0 con 0x5562e24e95f0 2023-10-09T13:13:50.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41bdffb700 10 client.9828 handle_command_reply: tid=0 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 client.9828 shutdown 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 msgr2=0x5562e24be530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24be530 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009ab0 tx=0x7f41d801d800 comp rx=0 tx=0).stop 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 shutdown_connections 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e95f0 0x5562e24e99c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e24be530 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bb5f0 0x5562e2505350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3422308967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bdb80 0x5562e24bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41bdffb700 0 client.9828 ms_handle_reset on v2:172.21.15.135:6832/3006026738 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 >> 172.21.15.86:0/3422308967 conn(0x5562e24bf0c0 msgr2=0x5562e24e3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 shutdown_connections 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 1 -- 172.21.15.86:0/3422308967 wait complete. 2023-10-09T13:13:50.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.606+0000 7f41f4327b80 20 client.9828 trim_cache size 0 max 16384 2023-10-09T13:13:50.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.623+0000 7f41f4327b80 1 Processor -- start 2023-10-09T13:13:50.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.623+0000 7f41f4327b80 1 -- start start 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.624+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 0x5562e2507470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.624+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bdb80 0x5562e24c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.624+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e25136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.624+0000 7f41f4327b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e24bd9f0 con 0x5562e2508480 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.624+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e24eac20 con 0x5562e24bb5f0 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.624+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562e24964b0 con 0x5562e24bdb80 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e25136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e25136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55322/0 (socket says 172.21.15.86:55322) 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 -- 172.21.15.86:0/3819891554 learned_addr learned my addr 172.21.15.86:0/3819891554 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 -- 172.21.15.86:0/3819891554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bdb80 msgr2=0x5562e24c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 --2- 172.21.15.86:0/3819891554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bdb80 0x5562e24c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 -- 172.21.15.86:0/3819891554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 msgr2=0x5562e2507470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 --2- 172.21.15.86:0/3819891554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 0x5562e2507470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 -- 172.21.15.86:0/3819891554 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e23dc780 con 0x5562e2508480 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41dffff700 1 --2- 172.21.15.86:0/3819891554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e25136b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f41d8055030 tx=0x7f41d806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29641e5832b47cf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41c57fa700 1 -- 172.21.15.86:0/3819891554 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800e040 con 0x5562e2508480 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41c57fa700 1 -- 172.21.15.86:0/3819891554 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800b890 con 0x5562e2508480 2023-10-09T13:13:50.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.625+0000 7f41c57fa700 1 -- 172.21.15.86:0/3819891554 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8053020 con 0x5562e2508480 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 -- 172.21.15.86:0/3819891554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 msgr2=0x5562e25136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3819891554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e25136b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f41d8055030 tx=0x7f41d806a000 comp rx=0 tx=0).stop 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 -- 172.21.15.86:0/3819891554 shutdown_connections 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3819891554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e2508480 0x5562e25136b0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3819891554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 0x5562e2507470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 --2- 172.21.15.86:0/3819891554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e24bdb80 0x5562e24c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 -- 172.21.15.86:0/3819891554 >> 172.21.15.86:0/3819891554 conn(0x5562e24bf0c0 msgr2=0x5562e24bfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 -- 172.21.15.86:0/3819891554 shutdown_connections 2023-10-09T13:13:50.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.626+0000 7f41f4327b80 1 -- 172.21.15.86:0/3819891554 wait complete. 2023-10-09T13:13:50.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.627+0000 7f41f4327b80 1 -- start start 2023-10-09T13:13:50.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.627+0000 7f41f4327b80 1 Processor -- start 2023-10-09T13:13:50.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 0x5562e25136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e24bdb80 0x5562e2569570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41f4327b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e2508480 0x5562e2504dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41f4327b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e24e3420 con 0x5562e24bdb80 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e2513dd0 con 0x5562e24bb5f0 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41f4327b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562e251d210 con 0x5562e2508480 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41f4327b80 10 client.0 _ll_register_callbacks cb 0x5562e24812c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e24bdb80 0x5562e2569570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e24bdb80 0x5562e2569570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55328/0 (socket says 172.21.15.86:55328) 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 -- 172.21.15.86:0/784719705 learned_addr learned my addr 172.21.15.86:0/784719705 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41dffff700 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e2508480 0x5562e2504dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41df7fe700 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 0x5562e25136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 -- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e2508480 msgr2=0x5562e2504dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e2508480 0x5562e2504dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 -- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 msgr2=0x5562e25136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 0x5562e25136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.628+0000 7f41deffd700 1 -- 172.21.15.86:0/784719705 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562e224afe0 con 0x5562e24bdb80 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41deffd700 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e24bdb80 0x5562e2569570 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f41d40030c0 tx=0x7f41d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54fe3decab6c93a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41bdffb700 1 -- 172.21.15.86:0/784719705 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4012d10 con 0x5562e24bdb80 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f41d0014270 con 0x5562e24bdb80 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41bdffb700 1 -- 172.21.15.86:0/784719705 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f41d4012e70 con 0x5562e24bdb80 2023-10-09T13:13:50.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41bdffb700 1 -- 172.21.15.86:0/784719705 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41d4015600 con 0x5562e24bdb80 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 10 client.9834 fetch_fsmap learned FSMap version 86 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x5562e23c3470 con 0x5562e24bdb80 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41bdffb700 1 -- 172.21.15.86:0/784719705 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0014270 con 0x5562e24bdb80 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41bdffb700 1 -- 172.21.15.86:0/784719705 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f41d4015760 con 0x5562e24bdb80 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 10 client.9834 fetch_fsmap finished waiting for FSMap version 86 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 10 client.9834 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 20 client.9834 populate_metadata read hostname 'smithi086' 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e2490 0x5562e24e2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 4 client.9834 mds_command: new command op to 9672 tid=0[{"prefix": "status"}] 2023-10-09T13:13:50.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.629+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 --> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5562e23b0e00 con 0x5562e24e2490 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.630+0000 7f41df7fe700 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e2490 0x5562e24e2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41bdffb700 10 client.9834 ms_handle_connect on v2:172.21.15.135:6832/3006026738 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41df7fe700 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e2490 0x5562e24e2860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c493d70c79e0b56 server_cookie=dc51fd41244f2beb in_seq=0 out_seq=0 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41bdffb700 1 -- 172.21.15.86:0/784719705 <== mds.0 v2:172.21.15.135:6832/3006026738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5562e23b0e00 con 0x5562e24e2490 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41bdffb700 10 client.9834 handle_command_reply: tid=0 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 client.9834 shutdown 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e24bdb80 msgr2=0x5562e2569570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e24bdb80 0x5562e2569570 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f41d40030c0 tx=0x7f41d4008040 comp rx=0 tx=0).stop 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 shutdown_connections 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:6832/3006026738,v1:172.21.15.135:6834/3006026738] conn(0x5562e24e2490 0x5562e24e2860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5562e2508480 0x5562e2504dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5562e24bb5f0 0x5562e25136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41bdffb700 0 client.9834 ms_handle_reset on v2:172.21.15.135:6832/3006026738 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 --2- 172.21.15.86:0/784719705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5562e24bdb80 0x5562e2569570 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 >> 172.21.15.86:0/784719705 conn(0x5562e24bf0c0 msgr2=0x5562e24babb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 shutdown_connections 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.631+0000 7f41f4327b80 1 -- 172.21.15.86:0/784719705 wait complete. 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41f4327b80 20 client.9834 trim_cache size 0 max 16384 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T13:13:50.639 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 9672, 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.206762723000001, 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 86, 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 196, 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 196, 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 17.377295208 2023-10-09T13:13:50.640 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:13:50.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f41cc066f30 msgr2=0x7f41cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f41cc066f30 0x7f41cc0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006fd0 tx=0x7f41d0008040 comp rx=0 tx=0).stop 2023-10-09T13:13:50.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e015e930 msgr2=0x7f41e01583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e015e930 0x7f41e01583c0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f41e006f0d0 tx=0x7f41d8017000 comp rx=0 tx=0).stop 2023-10-09T13:13:50.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 shutdown_connections 2023-10-09T13:13:50.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f41cc066f30 0x7f41cc0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41e015e930 0x7f41e01583c0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e006bf20 0x7f41e00c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 --2- 172.21.15.86:0/3933668802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41e0142ea0 0x7f41e015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 >> 172.21.15.86:0/3933668802 conn(0x7f41e00ce430 msgr2=0x7f41e0141f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:50.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 shutdown_connections 2023-10-09T13:13:50.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.632+0000 7f41e499d700 1 -- 172.21.15.86:0/3933668802 wait complete. 2023-10-09T13:13:50.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T13:13:50.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.829+0000 7fd6f33ff700 1 Processor -- start 2023-10-09T13:13:50.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.829+0000 7fd6f33ff700 1 -- start start 2023-10-09T13:13:50.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f33ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6ec1578b0 0x7fd6ec155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f33ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd6ec0af2f0 0x7fd6ec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f33ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec0ad930 con 0x7fd6ec155c10 2023-10-09T13:13:50.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f33ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec0acd20 con 0x7fd6ec1578b0 2023-10-09T13:13:50.833 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f33ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec0ad000 con 0x7fd6ec0af2f0 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f099a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6ec1578b0 0x7fd6ec155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f119b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd6ec155c10 0x7fd6ec0ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55976/0 (socket says 172.21.15.86:55976) 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f119b700 1 -- 172.21.15.86:0/1337413719 learned_addr learned my addr 172.21.15.86:0/1337413719 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f199c700 1 --2- 172.21.15.86:0/1337413719 >> v2:172.21.15.135:3300/0 conn(0x7fd6ec0af2f0 0x7fd6ec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f099a700 1 -- 172.21.15.86:0/1337413719 >> v2:172.21.15.135:3300/0 conn(0x7fd6ec0af2f0 msgr2=0x7fd6ec0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f099a700 1 --2- 172.21.15.86:0/1337413719 >> v2:172.21.15.135:3300/0 conn(0x7fd6ec0af2f0 0x7fd6ec0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6f099a700 1 -- 172.21.15.86:0/1337413719 >> v1:172.21.15.86:6789/0 conn(0x7fd6ec155c10 legacy=0x7fd6ec0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.832+0000 7fd6f099a700 1 -- 172.21.15.86:0/1337413719 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0ad2e0 con 0x7fd6ec1578b0 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.831+0000 7fd6e3fff700 1 -- 172.21.15.86:0/1337413719 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361419670 0 0) 0x7fd6ec0ad930 con 0x7fd6ec155c10 2023-10-09T13:13:50.834 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.832+0000 7fd6f099a700 1 --2- 172.21.15.86:0/1337413719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec1578b0 0x7fd6ec155fe0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec065be0 tx=0x7fd6dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2deb5fdab817370f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.832+0000 7fd6e3fff700 1 -- 172.21.15.86:0/1337413719 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00b6b0 con 0x7fd6ec1578b0 2023-10-09T13:13:50.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.832+0000 7fd6e3fff700 1 -- 172.21.15.86:0/1337413719 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00b810 con 0x7fd6ec1578b0 2023-10-09T13:13:50.835 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.832+0000 7fd6e3fff700 1 -- 172.21.15.86:0/1337413719 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00bbb0 con 0x7fd6ec1578b0 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.832+0000 7fd6f33ff700 1 -- 172.21.15.86:0/1337413719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec1578b0 msgr2=0x7fd6ec155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.832+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/1337413719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec1578b0 0x7fd6ec155fe0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec065be0 tx=0x7fd6dc0091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.833+0000 7fd6f33ff700 1 -- 172.21.15.86:0/1337413719 shutdown_connections 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.833+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/1337413719 >> v2:172.21.15.135:3300/0 conn(0x7fd6ec0af2f0 0x7fd6ec0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.833+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/1337413719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec1578b0 0x7fd6ec155fe0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.833+0000 7fd6f33ff700 1 -- 172.21.15.86:0/1337413719 >> 172.21.15.86:0/1337413719 conn(0x7fd6ec06a320 msgr2=0x7fd6ec0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.833+0000 7fd6f33ff700 1 -- 172.21.15.86:0/1337413719 shutdown_connections 2023-10-09T13:13:50.836 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.833+0000 7fd6f33ff700 1 -- 172.21.15.86:0/1337413719 wait complete. 2023-10-09T13:13:50.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.834+0000 7fd6f33ff700 1 Processor -- start 2023-10-09T13:13:50.837 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.834+0000 7fd6f33ff700 1 -- start start 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f33ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6ec0af2f0 0x7fd6ec16a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f33ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec155c10 0x7fd6ec14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f33ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6ec1578b0 0x7fd6ec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f33ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec159960 con 0x7fd6ec155c10 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f33ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec16a980 con 0x7fd6ec1578b0 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f33ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0b0c20 con 0x7fd6ec0af2f0 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f099a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec155c10 0x7fd6ec14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f099a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec155c10 0x7fd6ec14d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55340/0 (socket says 172.21.15.86:55340) 2023-10-09T13:13:50.839 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f099a700 1 -- 172.21.15.86:0/3262931110 learned_addr learned my addr 172.21.15.86:0/3262931110 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f119b700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6ec0af2f0 0x7fd6ec16a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.835+0000 7fd6f199c700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6ec1578b0 0x7fd6ec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6f099a700 1 -- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6ec0af2f0 msgr2=0x7fd6ec16a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6f099a700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6ec0af2f0 0x7fd6ec16a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6f099a700 1 -- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6ec1578b0 msgr2=0x7fd6ec0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6f099a700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6ec1578b0 0x7fd6ec0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6f099a700 1 -- 172.21.15.86:0/3262931110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc009420 con 0x7fd6ec155c10 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6f099a700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec155c10 0x7fd6ec14d630 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec064290 tx=0x7fd6dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6e17fa700 1 -- 172.21.15.86:0/3262931110 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00bb90 con 0x7fd6ec155c10 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6e17fa700 1 -- 172.21.15.86:0/3262931110 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc011420 con 0x7fd6ec155c10 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec14db70 con 0x7fd6ec155c10 2023-10-09T13:13:50.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.836+0000 7fd6e17fa700 1 -- 172.21.15.86:0/3262931110 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0117c0 con 0x7fd6ec155c10 2023-10-09T13:13:50.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.837+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec0b0940 con 0x7fd6ec155c10 2023-10-09T13:13:50.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.837+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec04c3c0 con 0x7fd6ec155c10 2023-10-09T13:13:50.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.838+0000 7fd6e17fa700 1 -- 172.21.15.86:0/3262931110 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6dc011bb0 con 0x7fd6ec155c10 2023-10-09T13:13:50.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.839+0000 7fd6e17fa700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd6d0066f30 0x7fd6d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:50.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.839+0000 7fd6e17fa700 1 -- 172.21.15.86:0/3262931110 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fd6dc085fe0 con 0x7fd6ec155c10 2023-10-09T13:13:50.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.839+0000 7fd6f119b700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd6d0066f30 0x7fd6d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:50.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.840+0000 7fd6f119b700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd6d0066f30 0x7fd6d00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8007fd0 tx=0x7fd6e8007d30 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:50.844 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:50.843+0000 7fd6e17fa700 1 -- 172.21.15.86:0/3262931110 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6dc052fd0 con 0x7fd6ec155c10 2023-10-09T13:13:51.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.079+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6ec0678d0 con 0x7fd6ec155c10 2023-10-09T13:13:51.080 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.079+0000 7fd6e17fa700 1 -- 172.21.15.86:0/3262931110 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd6dc011e60 con 0x7fd6ec155c10 2023-10-09T13:13:51.081 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T13:13:51.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd6d0066f30 msgr2=0x7fd6d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:51.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd6d0066f30 0x7fd6d00693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8007fd0 tx=0x7fd6e8007d30 comp rx=0 tx=0).stop 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec155c10 msgr2=0x7fd6ec14d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec155c10 0x7fd6ec14d630 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec064290 tx=0x7fd6dc017000 comp rx=0 tx=0).stop 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 shutdown_connections 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd6d0066f30 0x7fd6d00693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6ec1578b0 0x7fd6ec0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd6ec0af2f0 0x7fd6ec16a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 --2- 172.21.15.86:0/3262931110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec155c10 0x7fd6ec14d630 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 >> 172.21.15.86:0/3262931110 conn(0x7fd6ec06a320 msgr2=0x7fd6ec14e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 shutdown_connections 2023-10-09T13:13:51.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:51.082+0000 7fd6f33ff700 1 -- 172.21.15.86:0/3262931110 wait complete. 2023-10-09T13:13:51.100 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T13:13:51.101 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T13:13:51.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:51.101 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T13:13:51.138 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 36712sec preferred_lft 36712sec 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T13:13:51.139 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T13:13:51.140 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T13:13:51.141 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:13:51.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:51.141 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T13:13:51.237 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T13:13:51.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:51.240 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T13:13:51.278 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T13:13:51.278 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T13:13:51.278 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T13:13:51.279 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T13:13:51.279 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T13:13:51.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:51.279 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T13:13:51.279 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T13:13:51.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T13:13:51.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T13:13:51.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T13:13:51.280 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T13:13:51.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:51.474 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T13:13:51.511 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T13:13:51.511 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T13:13:51.511 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T13:13:51.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:51.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T13:13:51.612 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T13:13:51.612 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T13:13:51.648 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T13:13:51.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T13:13:51.648 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T13:13:51.724 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T13:13:51.724 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T13:13:51.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T13:13:51.855 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T13:13:51.855 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T13:13:51.884 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T13:13:51.884 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T13:13:51.884 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T13:13:51.884 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T13:13:51.884 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T13:13:51.889 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T13:13:51.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:13:51.889 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T13:13:51.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T13:13:52.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.132+0000 7f818e3ff700 1 Processor -- start 2023-10-09T13:13:52.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.132+0000 7f818e3ff700 1 -- start start 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.133+0000 7f818e3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81880caa90 0x7f81880c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.133+0000 7f818e3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818815d7e0 con 0x7f818806bcd0 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.133+0000 7f818e3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818815dac0 con 0x7f818806c0a0 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.133+0000 7f818e3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880caef0 con 0x7f81880caa90 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f818c99c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81880caa90 0x7f81880c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f8187fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f818806bcd0 0x7f818815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55990/0 (socket says 172.21.15.86:55990) 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f8187fff700 1 -- 172.21.15.86:0/4025994778 learned_addr learned my addr 172.21.15.86:0/4025994778 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:52.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f818c99c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81880caa90 0x7f81880c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55354/0 (socket says 172.21.15.86:55354) 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f818c99c700 1 -- 172.21.15.86:0/4025994778 >> v1:172.21.15.135:6789/0 conn(0x7f818806c0a0 legacy=0x7f818815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f818c99c700 1 -- 172.21.15.86:0/4025994778 >> v1:172.21.15.86:6789/0 conn(0x7f818806bcd0 legacy=0x7f818815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f818c99c700 1 -- 172.21.15.86:0/4025994778 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818815aa30 con 0x7f81880caa90 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f818c99c700 1 --2- 172.21.15.86:0/4025994778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81880caa90 0x7f81880c8c40 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e60 tx=0x7f8180009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b296f0aedcd0748 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.134+0000 7f8186ffd700 1 -- 172.21.15.86:0/4025994778 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000e070 con 0x7f81880caa90 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f8186ffd700 1 -- 172.21.15.86:0/4025994778 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818000bc30 con 0x7f81880caa90 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f8186ffd700 1 -- 172.21.15.86:0/4025994778 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180012430 con 0x7f81880caa90 2023-10-09T13:13:52.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f818e3ff700 1 -- 172.21.15.86:0/4025994778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81880caa90 msgr2=0x7f81880c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f818e3ff700 1 --2- 172.21.15.86:0/4025994778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81880caa90 0x7f81880c8c40 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e60 tx=0x7f8180009780 comp rx=0 tx=0).stop 2023-10-09T13:13:52.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f818e3ff700 1 -- 172.21.15.86:0/4025994778 shutdown_connections 2023-10-09T13:13:52.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f818e3ff700 1 --2- 172.21.15.86:0/4025994778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81880caa90 0x7f81880c8c40 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f818e3ff700 1 -- 172.21.15.86:0/4025994778 >> 172.21.15.86:0/4025994778 conn(0x7f81880ce600 msgr2=0x7f81880cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:52.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f818e3ff700 1 -- 172.21.15.86:0/4025994778 shutdown_connections 2023-10-09T13:13:52.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.135+0000 7f818e3ff700 1 -- 172.21.15.86:0/4025994778 wait complete. 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.137+0000 7f818e3ff700 1 Processor -- start 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.137+0000 7f818e3ff700 1 -- start start 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f818e3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f818806bcd0 0x7f8188155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f818e3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f818806c0a0 0x7f81880b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f818e3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880caa90 0x7f81880b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f818e3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880b3470 con 0x7f818806c0a0 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f818e3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880c7160 con 0x7f818806bcd0 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f818e3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8188155a70 con 0x7f81880caa90 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f818806c0a0 0x7f81880b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f818806c0a0 0x7f81880b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55356/0 (socket says 172.21.15.86:55356) 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 -- 172.21.15.86:0/2259435066 learned_addr learned my addr 172.21.15.86:0/2259435066 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f8187fff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f818806bcd0 0x7f8188155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f818c99c700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880caa90 0x7f81880b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 -- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880caa90 msgr2=0x7f81880b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880caa90 0x7f81880b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 -- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f818806bcd0 msgr2=0x7f8188155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f818806bcd0 0x7f8188155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.138+0000 7f81877fe700 1 -- 172.21.15.86:0/2259435066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009a20 con 0x7f818806c0a0 2023-10-09T13:13:52.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.139+0000 7f81877fe700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f818806c0a0 0x7f81880b3900 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c590 tx=0x7f817c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:52.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.139+0000 7f816ffff700 1 -- 172.21.15.86:0/2259435066 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c011590 con 0x7f818806c0a0 2023-10-09T13:13:52.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.139+0000 7f816ffff700 1 -- 172.21.15.86:0/2259435066 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c011730 con 0x7f818806c0a0 2023-10-09T13:13:52.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.139+0000 7f816ffff700 1 -- 172.21.15.86:0/2259435066 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c011af0 con 0x7f818806c0a0 2023-10-09T13:13:52.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.139+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81880b2b40 con 0x7f818806c0a0 2023-10-09T13:13:52.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.139+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81880b3180 con 0x7f818806c0a0 2023-10-09T13:13:52.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.140+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818804c3c0 con 0x7f818806c0a0 2023-10-09T13:13:52.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.141+0000 7f816ffff700 1 -- 172.21.15.86:0/2259435066 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f817c012420 con 0x7f818806c0a0 2023-10-09T13:13:52.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.142+0000 7f816ffff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8174066f30 0x7f81740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.142+0000 7f816ffff700 1 -- 172.21.15.86:0/2259435066 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f817c0838e0 con 0x7f818806c0a0 2023-10-09T13:13:52.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.142+0000 7f8187fff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8174066f30 0x7f81740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.143+0000 7f8187fff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8174066f30 0x7f81740693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8178001950 tx=0x7f8178009040 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:52.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.146+0000 7f816ffff700 1 -- 172.21.15.86:0/2259435066 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f817c04b5a0 con 0x7f818806c0a0 2023-10-09T13:13:52.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.364+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f818815ad10 con 0x7f8174066f30 2023-10-09T13:13:52.367 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.366+0000 7f816ffff700 1 -- 172.21.15.86:0/2259435066 <== mgr.9462 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f818815ad10 con 0x7f8174066f30 2023-10-09T13:13:52.367 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T13:13:52.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:13:52.367 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T13:13:52.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:13:52.368 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8174066f30 msgr2=0x7f81740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8174066f30 0x7f81740693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8178001950 tx=0x7f8178009040 comp rx=0 tx=0).stop 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f818806c0a0 msgr2=0x7f81880b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f818806c0a0 0x7f81880b3900 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c590 tx=0x7f817c007f30 comp rx=0 tx=0).stop 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 shutdown_connections 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8174066f30 0x7f81740693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880caa90 0x7f81880b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.370 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f818806bcd0 0x7f8188155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 --2- 172.21.15.86:0/2259435066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f818806c0a0 0x7f81880b3900 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 >> 172.21.15.86:0/2259435066 conn(0x7f81880ce600 msgr2=0x7f8188156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:52.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.368+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 shutdown_connections 2023-10-09T13:13:52.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.369+0000 7f818e3ff700 1 -- 172.21.15.86:0/2259435066 wait complete. 2023-10-09T13:13:52.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T13:13:52.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.570+0000 7feeb619d700 1 Processor -- start 2023-10-09T13:13:52.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.570+0000 7feeb619d700 1 -- start start 2023-10-09T13:13:52.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb619d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feeb00c9db0 0x7feeb0153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb619d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb006e150 con 0x7feeb0157130 2023-10-09T13:13:52.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb619d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00c7610 con 0x7feeb00c9db0 2023-10-09T13:13:52.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0153e40 con 0x7feeb006e5e0 2023-10-09T13:13:52.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb519b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feeb00c9db0 0x7feeb0153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb519b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feeb00c9db0 0x7feeb0153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55358/0 (socket says 172.21.15.86:55358) 2023-10-09T13:13:52.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.571+0000 7feeb519b700 1 -- 172.21.15.86:0/2745777078 learned_addr learned my addr 172.21.15.86:0/2745777078 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feeb599c700 1 --2- 172.21.15.86:0/2745777078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feeb519b700 1 -- 172.21.15.86:0/2745777078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 msgr2=0x7feeb006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feeb519b700 1 --2- 172.21.15.86:0/2745777078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feeb519b700 1 -- 172.21.15.86:0/2745777078 >> v1:172.21.15.135:6789/0 conn(0x7feeb0157130 legacy=0x7feeb00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feeb519b700 1 -- 172.21.15.86:0/2745777078 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00c7800 con 0x7feeb00c9db0 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feeb599c700 1 --2- 172.21.15.86:0/2745777078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb006ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feeb519b700 1 --2- 172.21.15.86:0/2745777078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb0153900 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7feeac0099b0 tx=0x7feeac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea5853acf077e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feea7fff700 1 -- 172.21.15.86:0/2745777078 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac00b820 con 0x7feeb00c9db0 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feea7fff700 1 -- 172.21.15.86:0/2745777078 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac00b980 con 0x7feeb00c9db0 2023-10-09T13:13:52.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.572+0000 7feea7fff700 1 -- 172.21.15.86:0/2745777078 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac00bd20 con 0x7feeb00c9db0 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 -- 172.21.15.86:0/2745777078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 msgr2=0x7feeb0153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 --2- 172.21.15.86:0/2745777078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb0153900 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7feeac0099b0 tx=0x7feeac009250 comp rx=0 tx=0).stop 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 -- 172.21.15.86:0/2745777078 shutdown_connections 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 --2- 172.21.15.86:0/2745777078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb006ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 --2- 172.21.15.86:0/2745777078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb0153900 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 -- 172.21.15.86:0/2745777078 >> 172.21.15.86:0/2745777078 conn(0x7feeb00cc1e0 msgr2=0x7feeb00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 -- 172.21.15.86:0/2745777078 shutdown_connections 2023-10-09T13:13:52.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.573+0000 7feeb619d700 1 -- 172.21.15.86:0/2745777078 wait complete. 2023-10-09T13:13:52.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.574+0000 7feeb619d700 1 Processor -- start 2023-10-09T13:13:52.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.575+0000 7feeb619d700 1 -- start start 2023-10-09T13:13:52.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.575+0000 7feeb619d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb0144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.575+0000 7feeb619d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb00acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.575+0000 7feeb619d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb0157130 0x7feeb00ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.575+0000 7feeb619d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c5d00 con 0x7feeb00c9db0 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.575+0000 7feeb619d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c6190 con 0x7feeb0157130 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.575+0000 7feeb619d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c50f0 con 0x7feeb006e5e0 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb00acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb00acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55374/0 (socket says 172.21.15.86:55374) 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 -- 172.21.15.86:0/2500304374 learned_addr learned my addr 172.21.15.86:0/2500304374 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb519b700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb0144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb599c700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb0157130 0x7feeb00ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 -- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 msgr2=0x7feeb0144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb0144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.579 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 -- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb0157130 msgr2=0x7feeb00ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb0157130 0x7feeb00ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 -- 172.21.15.86:0/2500304374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0094f0 con 0x7feeb00c9db0 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.576+0000 7feeb499a700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb00acef0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7feea000c5d0 tx=0x7feea0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.577+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0011590 con 0x7feeb00c9db0 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.577+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0011710 con 0x7feeb00c9db0 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.577+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb00c53d0 con 0x7feeb00c9db0 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.577+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0011ad0 con 0x7feeb00c9db0 2023-10-09T13:13:52.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.577+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00c5990 con 0x7feeb00c9db0 2023-10-09T13:13:52.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.578+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb006c450 con 0x7feeb00c9db0 2023-10-09T13:13:52.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.579+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 99) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feea001c460 con 0x7feeb00c9db0 2023-10-09T13:13:52.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.580+0000 7feea57fa700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:52.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.580+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7feea00843d0 con 0x7feeb00c9db0 2023-10-09T13:13:52.581 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.580+0000 7feeb519b700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:52.582 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.580+0000 7feeb519b700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee94066f30 0x7fee940693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feeac0099b0 tx=0x7feeac016000 comp rx=0 tx=0).ready entity=mgr.9462 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:52.585 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.584+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea0051460 con 0x7feeb00c9db0 2023-10-09T13:13:52.831 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:52.830+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7feeb00c7ae0 con 0x7feeb00c9db0 2023-10-09T13:13:53.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.480+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7feea00840c0 con 0x7feeb00c9db0 2023-10-09T13:13:53.482 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.481+0000 7feea57fa700 1 -- 172.21.15.86:0/2500304374 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v100) v1 ==== 92+0+0 (secure 0 0 0) 0x7feea0054ef0 con 0x7feeb00c9db0 2023-10-09T13:13:53.485 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee94066f30 msgr2=0x7fee940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee94066f30 0x7fee940693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feeac0099b0 tx=0x7feeac016000 comp rx=0 tx=0).stop 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 msgr2=0x7feeb00acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb00acef0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7feea000c5d0 tx=0x7feea0007f60 comp rx=0 tx=0).stop 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 shutdown_connections 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb0157130 0x7feeb00ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feeb006e5e0 0x7feeb0144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 --2- 172.21.15.86:0/2500304374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feeb00c9db0 0x7feeb00acef0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 >> 172.21.15.86:0/2500304374 conn(0x7feeb00cc1e0 msgr2=0x7feeb0158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:53.486 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 shutdown_connections 2023-10-09T13:13:53.487 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.484+0000 7feeb619d700 1 -- 172.21.15.86:0/2500304374 wait complete. 2023-10-09T13:13:53.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T13:13:53.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.702+0000 7fb5fe79d700 1 Processor -- start 2023-10-09T13:13:53.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.702+0000 7fb5fe79d700 1 -- start start 2023-10-09T13:13:53.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.703+0000 7fb5fe79d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5f80b4e70 0x7fb5f80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:53.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.703+0000 7fb5fe79d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5f80b16d0 0x7fb5f80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:53.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fe79d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80b2080 con 0x7fb5f815d240 2023-10-09T13:13:53.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fe79d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80cfb00 con 0x7fb5f80b16d0 2023-10-09T13:13:53.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fe79d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80b5c40 con 0x7fb5f80b4e70 2023-10-09T13:13:53.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fcf9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5f80b16d0 0x7fb5f80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:53.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fdf9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb5f815d240 0x7fb5f815d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56008/0 (socket says 172.21.15.86:56008) 2023-10-09T13:13:53.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fdf9c700 1 -- 172.21.15.86:0/684614016 learned_addr learned my addr 172.21.15.86:0/684614016 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:53.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fd79b700 1 --2- 172.21.15.86:0/684614016 >> v2:172.21.15.135:3300/0 conn(0x7fb5f80b4e70 0x7fb5f80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:53.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fcf9a700 1 -- 172.21.15.86:0/684614016 >> v2:172.21.15.135:3300/0 conn(0x7fb5f80b4e70 msgr2=0x7fb5f80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:53.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fcf9a700 1 --2- 172.21.15.86:0/684614016 >> v2:172.21.15.135:3300/0 conn(0x7fb5f80b4e70 0x7fb5f80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fcf9a700 1 -- 172.21.15.86:0/684614016 >> v1:172.21.15.86:6789/0 conn(0x7fb5f815d240 legacy=0x7fb5f815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5fcf9a700 1 -- 172.21.15.86:0/684614016 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80b5f20 con 0x7fb5f80b16d0 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.704+0000 7fb5effff700 1 -- 172.21.15.86:0/684614016 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022543037 0 0) 0x7fb5f80b2080 con 0x7fb5f815d240 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.705+0000 7fb5fcf9a700 1 --2- 172.21.15.86:0/684614016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f80b16d0 0x7fb5f80b1b40 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8064910 tx=0x7fb5e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec979b51f878dcc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.705+0000 7fb5effff700 1 -- 172.21.15.86:0/684614016 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8011630 con 0x7fb5f80b16d0 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.705+0000 7fb5effff700 1 -- 172.21.15.86:0/684614016 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8011790 con 0x7fb5f80b16d0 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.705+0000 7fb5effff700 1 -- 172.21.15.86:0/684614016 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8011b30 con 0x7fb5f80b16d0 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.705+0000 7fb5fe79d700 1 -- 172.21.15.86:0/684614016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f80b16d0 msgr2=0x7fb5f80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.705+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/684614016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f80b16d0 0x7fb5f80b1b40 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8064910 tx=0x7fb5e80091a0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.706+0000 7fb5fe79d700 1 -- 172.21.15.86:0/684614016 shutdown_connections 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.706+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/684614016 >> v2:172.21.15.135:3300/0 conn(0x7fb5f80b4e70 0x7fb5f80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.706+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/684614016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f80b16d0 0x7fb5f80b1b40 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.706+0000 7fb5fe79d700 1 -- 172.21.15.86:0/684614016 >> 172.21.15.86:0/684614016 conn(0x7fb5f80d10c0 msgr2=0x7fb5f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:53.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.706+0000 7fb5fe79d700 1 -- 172.21.15.86:0/684614016 shutdown_connections 2023-10-09T13:13:53.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.706+0000 7fb5fe79d700 1 -- 172.21.15.86:0/684614016 wait complete. 2023-10-09T13:13:53.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.707+0000 7fb5fe79d700 1 Processor -- start 2023-10-09T13:13:53.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.707+0000 7fb5fe79d700 1 -- start start 2023-10-09T13:13:53.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fe79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f80b16d0 0x7fb5f80c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:53.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fe79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5f80b4e70 0x7fb5f8169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:53.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fe79d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f815d240 0x7fb5f815e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:53.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fe79d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f816ac80 con 0x7fb5f815d240 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fe79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f816d750 con 0x7fb5f80b16d0 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fe79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f816a6c0 con 0x7fb5f80b4e70 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fdf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f815d240 0x7fb5f815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fdf9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f815d240 0x7fb5f815e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55400/0 (socket says 172.21.15.86:55400) 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fdf9c700 1 -- 172.21.15.86:0/726853936 learned_addr learned my addr 172.21.15.86:0/726853936 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.708+0000 7fb5fd79b700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f80b16d0 0x7fb5f80c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fcf9a700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5f80b4e70 0x7fb5f8169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fdf9c700 1 -- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5f80b4e70 msgr2=0x7fb5f8169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fdf9c700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5f80b4e70 0x7fb5f8169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fdf9c700 1 -- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f80b16d0 msgr2=0x7fb5f80c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fdf9c700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f80b16d0 0x7fb5f80c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fdf9c700 1 -- 172.21.15.86:0/726853936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8009420 con 0x7fb5f815d240 2023-10-09T13:13:53.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fdf9c700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f815d240 0x7fb5f815e630 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000cbf0 tx=0x7fb5f00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:53.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5ed7fa700 1 -- 172.21.15.86:0/726853936 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000a8b0 con 0x7fb5f815d240 2023-10-09T13:13:53.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5ed7fa700 1 -- 172.21.15.86:0/726853936 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f000aa10 con 0x7fb5f815d240 2023-10-09T13:13:53.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5ed7fa700 1 -- 172.21.15.86:0/726853936 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000add0 con 0x7fb5f815d240 2023-10-09T13:13:53.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.709+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f816a9a0 con 0x7fb5f815d240 2023-10-09T13:13:53.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.710+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80c86f0 con 0x7fb5f815d240 2023-10-09T13:13:53.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.711+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f816d240 con 0x7fb5f815d240 2023-10-09T13:13:53.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.712+0000 7fb5ed7fa700 1 -- 172.21.15.86:0/726853936 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb5f0007300 con 0x7fb5f815d240 2023-10-09T13:13:53.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.712+0000 7fb5ed7fa700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 0x7fb5dc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:53.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.713+0000 7fb5ed7fa700 1 -- 172.21.15.86:0/726853936 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7fb5f0084a80 con 0x7fb5f815d240 2023-10-09T13:13:53.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.713+0000 7fb5fd79b700 1 -- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 msgr2=0x7fb5dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:53.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.713+0000 7fb5fd79b700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 0x7fb5dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:53.718 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.717+0000 7fb5ed7fa700 1 -- 172.21.15.86:0/726853936 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5f816d240 con 0x7fb5f815d240 2023-10-09T13:13:53.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.914+0000 7fb5fd79b700 1 -- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 msgr2=0x7fb5dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:53.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.914+0000 7fb5fd79b700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 0x7fb5dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:53.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.917+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb5f816d240 con 0x7fb5f815d240 2023-10-09T13:13:53.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.921+0000 7fb5ed7fa700 1 -- 172.21.15.86:0/726853936 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb5f816d240 con 0x7fb5f815d240 2023-10-09T13:13:53.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 msgr2=0x7fb5dc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:53.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 0x7fb5dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f815d240 msgr2=0x7fb5f815e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:53.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f815d240 0x7fb5f815e630 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000cbf0 tx=0x7fb5f00019b0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 shutdown_connections 2023-10-09T13:13:53.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb5dc066f80 0x7fb5dc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5f815d240 0x7fb5f815e630 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f80b16d0 0x7fb5f80c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 --2- 172.21.15.86:0/726853936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5f80b4e70 0x7fb5f8169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:53.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.923+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 >> 172.21.15.86:0/726853936 conn(0x7fb5f80d10c0 msgr2=0x7fb5f80b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:53.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.924+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 shutdown_connections 2023-10-09T13:13:53.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:53.924+0000 7fb5fe79d700 1 -- 172.21.15.86:0/726853936 wait complete. 2023-10-09T13:13:53.943 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T13:13:54.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.131+0000 7f6c82d9d700 1 Processor -- start 2023-10-09T13:13:54.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.131+0000 7f6c82d9d700 1 -- start start 2023-10-09T13:13:54.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.132+0000 7f6c82d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6c7c06bfa0 0x7f6c7c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.132+0000 7f6c82d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c068d30 con 0x7f6c7c159a70 2023-10-09T13:13:54.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.132+0000 7f6c82d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0ca920 con 0x7f6c7c0688d0 2023-10-09T13:13:54.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.132+0000 7f6c82d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c06af00 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c81d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6c7c159a70 0x7f6c7c0c82f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56012/0 (socket says 172.21.15.86:56012) 2023-10-09T13:13:54.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c81d9b700 1 -- 172.21.15.86:0/2721255003 learned_addr learned my addr 172.21.15.86:0/2721255003 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:54.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c8159a700 1 --2- 172.21.15.86:0/2721255003 >> v2:172.21.15.135:3300/0 conn(0x7f6c7c06bfa0 0x7f6c7c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c80d99700 1 -- 172.21.15.86:0/2721255003 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655503261 0 0) 0x7f6c78001490 con 0x7f6c7c159a70 2023-10-09T13:13:54.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c80d99700 1 -- 172.21.15.86:0/2721255003 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c68003570 con 0x7f6c7c159a70 2023-10-09T13:13:54.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c80d99700 1 -- 172.21.15.86:0/2721255003 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780756113 0 0) 0x7f6c7c0ca920 con 0x7f6c7c0688d0 2023-10-09T13:13:54.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c80d99700 1 -- 172.21.15.86:0/2721255003 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c78001490 con 0x7f6c7c0688d0 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c8159a700 1 -- 172.21.15.86:0/2721255003 >> v1:172.21.15.135:6789/0 conn(0x7f6c7c0688d0 legacy=0x7f6c7c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c8159a700 1 -- 172.21.15.86:0/2721255003 >> v1:172.21.15.86:6789/0 conn(0x7f6c7c159a70 legacy=0x7f6c7c0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.133+0000 7f6c8159a700 1 -- 172.21.15.86:0/2721255003 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c06b1e0 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c8159a700 1 --2- 172.21.15.86:0/2721255003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c068390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0098d0 tx=0x7f6c6c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d9c0e836aa27ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c80d99700 1 -- 172.21.15.86:0/2721255003 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c005c10 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c80d99700 1 -- 172.21.15.86:0/2721255003 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c005d70 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c80d99700 1 -- 172.21.15.86:0/2721255003 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c006280 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c82d9d700 1 -- 172.21.15.86:0/2721255003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c06bfa0 msgr2=0x7f6c7c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/2721255003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c068390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0098d0 tx=0x7f6c6c009120 comp rx=0 tx=0).stop 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c82d9d700 1 -- 172.21.15.86:0/2721255003 shutdown_connections 2023-10-09T13:13:54.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/2721255003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c068390 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.134+0000 7f6c82d9d700 1 -- 172.21.15.86:0/2721255003 >> 172.21.15.86:0/2721255003 conn(0x7f6c7c0cddc0 msgr2=0x7f6c7c0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:54.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.135+0000 7f6c82d9d700 1 -- 172.21.15.86:0/2721255003 shutdown_connections 2023-10-09T13:13:54.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.135+0000 7f6c82d9d700 1 -- 172.21.15.86:0/2721255003 wait complete. 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.136+0000 7f6c82d9d700 1 Processor -- start 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.136+0000 7f6c82d9d700 1 -- start start 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c82d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c7c0688d0 0x7f6c7c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c82d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c82d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c159a70 0x7f6c7c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c82d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c5240 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c82d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c154d20 con 0x7f6c7c159a70 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c82d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c155000 con 0x7f6c7c0688d0 2023-10-09T13:13:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c8159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c8159a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c0b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55408/0 (socket says 172.21.15.86:55408) 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c8159a700 1 -- 172.21.15.86:0/4257560885 learned_addr learned my addr 172.21.15.86:0/4257560885 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c81d9b700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c7c0688d0 0x7f6c7c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.137+0000 7f6c8259c700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c159a70 0x7f6c7c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c8159a700 1 -- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c7c0688d0 msgr2=0x7f6c7c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c8159a700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c7c0688d0 0x7f6c7c1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c8159a700 1 -- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c159a70 msgr2=0x7f6c7c1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c8159a700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c159a70 0x7f6c7c1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c8159a700 1 -- 172.21.15.86:0/4257560885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0093c0 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c8259c700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c159a70 0x7f6c7c1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:13:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c8159a700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c0b2750 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ec0 tx=0x7f6c6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:54.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c71ffb700 1 -- 172.21.15.86:0/4257560885 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c005c10 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c71ffb700 1 -- 172.21.15.86:0/4257560885 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c01d6b0 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c71ffb700 1 -- 172.21.15.86:0/4257560885 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c01da90 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c1552e0 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.138+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c1549e0 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.139+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c0c5750 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.140+0000 7f6c71ffb700 1 -- 172.21.15.86:0/4257560885 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6c6c01b480 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.141+0000 7f6c71ffb700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 0x7f6c60069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.141+0000 7f6c71ffb700 1 -- 172.21.15.86:0/4257560885 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f6c6c086340 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.141+0000 7f6c81d9b700 1 -- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 msgr2=0x7f6c60069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:54.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.141+0000 7f6c81d9b700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 0x7f6c60069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:54.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.145+0000 7f6c71ffb700 1 -- 172.21.15.86:0/4257560885 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c7c0c5750 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.342+0000 7f6c81d9b700 1 -- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 msgr2=0x7f6c60069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:54.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.342+0000 7f6c81d9b700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 0x7f6c60069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:54.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.345+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f6c7c063d10 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.349+0000 7f6c71ffb700 1 -- 172.21.15.86:0/4257560885 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6c6c053330 con 0x7f6c7c06bfa0 2023-10-09T13:13:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 msgr2=0x7f6c60069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 0x7f6c60069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7c06bfa0 msgr2=0x7f6c7c0b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c0b2750 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ec0 tx=0x7f6c6c016000 comp rx=0 tx=0).stop 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 shutdown_connections 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c60066f80 0x7f6c60069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c7c159a70 0x7f6c7c1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c7c0688d0 0x7f6c7c1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 --2- 172.21.15.86:0/4257560885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7c06bfa0 0x7f6c7c0b2750 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 >> 172.21.15.86:0/4257560885 conn(0x7f6c7c0cddc0 msgr2=0x7f6c7c1523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 shutdown_connections 2023-10-09T13:13:54.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.352+0000 7f6c82d9d700 1 -- 172.21.15.86:0/4257560885 wait complete. 2023-10-09T13:13:54.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:13:54.371 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T13:13:54.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T13:13:54.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.641+0000 7f9c3f39d700 1 Processor -- start 2023-10-09T13:13:54.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.641+0000 7f9c3f39d700 1 -- start start 2023-10-09T13:13:54.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.642+0000 7f9c3f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c380cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.642+0000 7f9c3f39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c381591e0 0x7f9c38159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.642+0000 7f9c3f39d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c380cfa00 con 0x7f9c380b03c0 2023-10-09T13:13:54.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3f39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c380cb580 con 0x7f9c381591e0 2023-10-09T13:13:54.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c380cf160 con 0x7f9c380b0790 2023-10-09T13:13:54.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3e39b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9c380b03c0 0x7f9c380b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56022/0 (socket says 172.21.15.86:56022) 2023-10-09T13:13:54.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3e39b700 1 -- 172.21.15.86:0/1839926577 learned_addr learned my addr 172.21.15.86:0/1839926577 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:13:54.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3eb9c700 1 --2- 172.21.15.86:0/1839926577 >> v2:172.21.15.135:3300/0 conn(0x7f9c381591e0 0x7f9c38159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.645 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c380cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3d399700 1 -- 172.21.15.86:0/1839926577 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644416389 0 0) 0x7f9c380cfa00 con 0x7f9c380b03c0 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3d399700 1 -- 172.21.15.86:0/1839926577 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c24003570 con 0x7f9c380b03c0 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3eb9c700 1 -- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 msgr2=0x7f9c380cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3eb9c700 1 --2- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c380cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3eb9c700 1 -- 172.21.15.86:0/1839926577 >> v1:172.21.15.86:6789/0 conn(0x7f9c380b03c0 legacy=0x7f9c380b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.643+0000 7f9c3eb9c700 1 -- 172.21.15.86:0/1839926577 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380cf440 con 0x7f9c381591e0 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.644+0000 7f9c3eb9c700 1 --2- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 0x7f9c38159620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009e60 tx=0x7f9c30009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12755e6c653f2573 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.644+0000 7f9c3d399700 1 -- 172.21.15.86:0/1839926577 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000e070 con 0x7f9c381591e0 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.644+0000 7f9c3d399700 1 -- 172.21.15.86:0/1839926577 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3000bab0 con 0x7f9c381591e0 2023-10-09T13:13:54.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.644+0000 7f9c3d399700 1 -- 172.21.15.86:0/1839926577 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000be70 con 0x7f9c381591e0 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 -- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 msgr2=0x7f9c38159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 0x7f9c38159620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009e60 tx=0x7f9c30009780 comp rx=0 tx=0).stop 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 -- 172.21.15.86:0/1839926577 shutdown_connections 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 0x7f9c38159620 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/1839926577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c380cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 -- 172.21.15.86:0/1839926577 >> 172.21.15.86:0/1839926577 conn(0x7f9c38063230 msgr2=0x7f9c38063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 -- 172.21.15.86:0/1839926577 shutdown_connections 2023-10-09T13:13:54.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.645+0000 7f9c3f39d700 1 -- 172.21.15.86:0/1839926577 wait complete. 2023-10-09T13:13:54.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.646+0000 7f9c3f39d700 1 Processor -- start 2023-10-09T13:13:54.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.646+0000 7f9c3f39d700 1 -- start start 2023-10-09T13:13:54.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.647+0000 7f9c3f39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c380b03c0 0x7f9c38157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.650 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.647+0000 7f9c3f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c3815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.647+0000 7f9c3f39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 0x7f9c3815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.647+0000 7f9c3f39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3815c4b0 con 0x7f9c380b03c0 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.647+0000 7f9c3f39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3815cd10 con 0x7f9c381591e0 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.647+0000 7f9c3f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c38157960 con 0x7f9c380b0790 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c380b03c0 0x7f9c38157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c380b03c0 0x7f9c38157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55410/0 (socket says 172.21.15.86:55410) 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 -- 172.21.15.86:0/2452096653 learned_addr learned my addr 172.21.15.86:0/2452096653 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3eb9c700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 0x7f9c3815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c3815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 msgr2=0x7f9c3815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c3815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 msgr2=0x7f9c3815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 0x7f9c3815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 -- 172.21.15.86:0/2452096653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30009a20 con 0x7f9c380b03c0 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.648+0000 7f9c3e39b700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c380b03c0 0x7f9c38157420 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c590 tx=0x7f9c34007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.649+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34005b30 con 0x7f9c380b03c0 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.649+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34005cb0 con 0x7f9c380b03c0 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.649+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3815ace0 con 0x7f9c380b03c0 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.649+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34007320 con 0x7f9c380b03c0 2023-10-09T13:13:54.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.649+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3815c9a0 con 0x7f9c380b03c0 2023-10-09T13:13:54.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.650+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3804c3c0 con 0x7f9c380b03c0 2023-10-09T13:13:54.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.651+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 100) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f9c3401b3b0 con 0x7f9c380b03c0 2023-10-09T13:13:54.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.651+0000 7f9c2e7fc700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:13:54.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.651+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6181+0+0 (secure 0 0 0) 0x7f9c34083cc0 con 0x7f9c380b03c0 2023-10-09T13:13:54.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.651+0000 7f9c3db9a700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 msgr2=0x7f9c1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:54.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.651+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:13:54.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.655+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c3408a080 con 0x7f9c380b03c0 2023-10-09T13:13:54.761 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:54.760+0000 7f97a538d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:13:54.816 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:54.815+0000 7fd088981180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:13:54.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.853+0000 7f9c3db9a700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 msgr2=0x7f9c1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:54.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.853+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:13:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:54.874+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3815ce50 con 0x7f9c1c066f80 2023-10-09T13:13:54.924 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:54.924+0000 7f97a538d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:54.983 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:54.982+0000 7fd088981180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:55.010 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:55.009+0000 7f97a538d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:13:55.071 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:55.070+0000 7fd088981180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:13:55.236 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:55.235+0000 7f97a538d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:55.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:55.254+0000 7f9c3db9a700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 msgr2=0x7f9c1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:55.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:55.254+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T13:13:55.297 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:55.296+0000 7fd088981180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:55.413 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:55.413+0000 7f97a538d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:13:55.473 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:55.472+0000 7fd088981180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:13:55.505 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:55.505+0000 7f97a538d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:13:55.565 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:55.564+0000 7fd088981180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:13:55.667 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:55.666+0000 7f97a538d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:13:55.725 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:55.724+0000 7fd088981180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:13:55.766 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:55.766+0000 7f97a538d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:55.825 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:55.824+0000 7fd088981180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:13:56.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:56.055+0000 7f9c3db9a700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 msgr2=0x7f9c1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:56.056 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:56.055+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T13:13:56.247 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:56.247+0000 7f97a538d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:13:56.310 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:56.309+0000 7fd088981180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:13:56.341 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:56.341+0000 7f97a538d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:13:56.404 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:56.403+0000 7fd088981180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:13:56.431 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:56.430+0000 7f97a538d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:13:56.494 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:56.493+0000 7fd088981180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:13:57.050 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:57.050+0000 7f97a538d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:13:57.115 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:57.114+0000 7fd088981180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:13:57.222 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:57.222+0000 7f97a538d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:57.289 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:57.288+0000 7fd088981180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:13:57.319 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:57.319+0000 7f97a538d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:13:57.385 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:57.384+0000 7fd088981180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:13:57.614 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:57.614+0000 7f97a538d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:13:57.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:57.656+0000 7f9c3db9a700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 msgr2=0x7f9c1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:13:57.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:57.656+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T13:13:57.679 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:57.678+0000 7fd088981180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:13:57.709 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:57.709+0000 7f97a538d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:13:57.776 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:57.775+0000 7fd088981180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:13:58.410 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:58.410+0000 7f97a538d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:13:58.483 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:58.482+0000 7fd088981180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:13:58.698 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:58.698+0000 7f97a538d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:13:58.770 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:58.769+0000 7fd088981180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:13:58.791 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:58.790+0000 7f97a538d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:13:58.865 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:58.864+0000 7fd088981180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:13:58.945 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:58.945+0000 7f97a538d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:13:59.019 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.018+0000 7fd088981180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:13:59.054 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:59.053+0000 7f97a538d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:13:59.124 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.123+0000 7fd088981180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:13:59.244 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:59.243+0000 7f97a538d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:13:59.314 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.313+0000 7fd088981180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:13:59.335 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:59.335+0000 7f97a538d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:13:59.407 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.405+0000 7fd088981180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:13:59.431 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:59.430+0000 7f97a538d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:13:59.501 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.499+0000 7fd088981180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:13:59.525 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:13:59.524+0000 7f97a538d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:13:59.584 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:59.583+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 101) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f9c34051080 con 0x7f9c380b03c0 2023-10-09T13:13:59.598 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.597+0000 7fd088981180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:13:59.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:59.609+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 102) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f9c34053e60 con 0x7f9c380b03c0 2023-10-09T13:13:59.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:59.609+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 msgr2=0x7f9c1c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:13:59.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:13:59.609+0000 7f9c2e7fc700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:13:59.734 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffa4b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffa4b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffa4b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffa4b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffa4b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffdcb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffdcb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffdcb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffdcb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:13:59.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:13:59.733+0000 7fcffdcb7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:14:00.612 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.611+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mon.0 v2:172.21.15.86:3300/0 9 ==== mgrmap(e 103) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f9c3407c350 con 0x7f9c380b03c0 2023-10-09T13:14:00.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.611+0000 7f9c2e7fc700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.613 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.611+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c1c033140 con 0x7f9c1c066f80 2023-10-09T13:14:00.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.613+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.618+0000 7f9c3db9a700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c0693b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c38071110 tx=0x7f9c280091a0 comp rx=0 tx=0).ready entity=mgr.9873 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:14:00.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.687+0000 7f9c2e7fc700 1 -- 172.21.15.86:0/2452096653 <== mgr.9873 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9c1c033140 con 0x7f9c1c066f80 2023-10-09T13:14:00.689 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path snap_test_dir1 2023-10-09T13:14:00.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 msgr2=0x7f9c1c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c0693b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c38071110 tx=0x7f9c280091a0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c380b03c0 msgr2=0x7f9c38157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c380b03c0 0x7f9c38157420 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c590 tx=0x7f9c34007e00 comp rx=0 tx=0).stop 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 shutdown_connections 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c1c066f80 0x7f9c1c0693b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c380b03c0 0x7f9c38157420 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c381591e0 0x7f9c3815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 --2- 172.21.15.86:0/2452096653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c380b0790 0x7f9c3815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 >> 172.21.15.86:0/2452096653 conn(0x7f9c38063230 msgr2=0x7f9c380b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 shutdown_connections 2023-10-09T13:14:00.692 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.690+0000 7f9c3f39d700 1 -- 172.21.15.86:0/2452096653 wait complete. 2023-10-09T13:14:00.711 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T13:14:00.711 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-09T13:14:00.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.897+0000 7f02b099d700 1 Processor -- start 2023-10-09T13:14:00.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.897+0000 7f02b099d700 1 -- start start 2023-10-09T13:14:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.898+0000 7f02b099d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 0x7f02ac15d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.898+0000 7f02b099d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ac0b10f0 con 0x7f02ac1595d0 2023-10-09T13:14:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.898+0000 7f02b099d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ac15e000 con 0x7f02ac15d760 2023-10-09T13:14:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.898+0000 7f02b099d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac15dbe0 con 0x7f02ac0cf480 2023-10-09T13:14:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.898+0000 7f02ab7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f02ac1595d0 0x7f02ac0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:45488/0 (socket says 172.21.15.86:45488) 2023-10-09T13:14:00.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.898+0000 7f02ab7fe700 1 -- 172.21.15.86:0/1613649782 learned_addr learned my addr 172.21.15.86:0/1613649782 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:14:00.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02a3fff700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 0x7f02ac15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253948940 0 0) 0x7f02ac0b10f0 con 0x7f02ac1595d0 2023-10-09T13:14:00.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0298003570 con 0x7f02ac1595d0 2023-10-09T13:14:00.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058589291 0 0) 0x7f0298003570 con 0x7f02ac1595d0 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 msgr2=0x7f02ac15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 0x7f02ac15d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 >> v1:172.21.15.135:6789/0 conn(0x7f02ac15d760 legacy=0x7f02ac0b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0cf990 con 0x7f02ac1595d0 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f029c0015f0 con 0x7f02ac1595d0 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 >> v1:172.21.15.86:6789/0 conn(0x7f02ac1595d0 legacy=0x7f02ac0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0298003a90 0x7f0298003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 0x7f0298004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298004d50 0x7f02980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac15dbe0 con 0x7f0298003a90 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029800bb10 con 0x7f0298004d50 2023-10-09T13:14:00.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.899+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029800bcd0 con 0x7f02ac0cf480 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0298003a90 0x7f0298003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02a3fff700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 0x7f0298004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02abfff700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298004d50 0x7f02980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02ab7fe700 1 -- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 msgr2=0x7f0298004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac0cf480 0x7f0298004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02ab7fe700 1 -- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298004d50 msgr2=0x7f02980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298004d50 0x7f02980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02ab7fe700 1 -- 172.21.15.86:0/1613649782 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298003570 con 0x7f0298003a90 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02abfff700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298004d50 0x7f02980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.900+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0298003a90 0x7f0298003e60 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c2d0 tx=0x7f029c0078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2a1caa06da03e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c00cc00 con 0x7f0298003a90 2023-10-09T13:14:00.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c00cd60 con 0x7f0298003a90 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02aaffd700 1 -- 172.21.15.86:0/1613649782 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c007300 con 0x7f0298003a90 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02b099d700 1 -- 172.21.15.86:0/1613649782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0298003a90 msgr2=0x7f0298003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02b099d700 1 --2- 172.21.15.86:0/1613649782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0298003a90 0x7f0298003e60 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c2d0 tx=0x7f029c0078a0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02abfff700 1 -- 172.21.15.86:0/1613649782 reap_dead start 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02b099d700 1 -- 172.21.15.86:0/1613649782 shutdown_connections 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02b099d700 1 -- 172.21.15.86:0/1613649782 >> 172.21.15.86:0/1613649782 conn(0x7f02ac0d05f0 msgr2=0x7f02ac0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02b099d700 1 -- 172.21.15.86:0/1613649782 shutdown_connections 2023-10-09T13:14:00.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.901+0000 7f02b099d700 1 -- 172.21.15.86:0/1613649782 wait complete. 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.903+0000 7f02b099d700 1 Processor -- start 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.903+0000 7f02b099d700 1 -- start start 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.903+0000 7f02b099d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298003a90 0x7f02ac0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02b099d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ac16a190 0x7f02ac14c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02b099d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac1599a0 0x7f02ac159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02b099d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac15a360 con 0x7f02ac16a190 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02b099d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0b4430 con 0x7f0298003a90 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02b099d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac14cbc0 con 0x7f02ac1599a0 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ac16a190 0x7f02ac14c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ac16a190 0x7f02ac14c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56410/0 (socket says 172.21.15.86:56410) 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 -- 172.21.15.86:0/223285256 learned_addr learned my addr 172.21.15.86:0/223285256 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298003a90 0x7f02ac0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02abfff700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac1599a0 0x7f02ac159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 -- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac1599a0 msgr2=0x7f02ac159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac1599a0 0x7f02ac159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 -- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298003a90 msgr2=0x7f02ac0b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298003a90 0x7f02ac0b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 -- 172.21.15.86:0/223285256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0b5500 con 0x7f02ac16a190 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298003a90 0x7f02ac0b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02abfff700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac1599a0 0x7f02ac159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.904+0000 7f02a3fff700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ac16a190 0x7f02ac14c680 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f0294011d40 tx=0x7f02940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:14:00.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.905+0000 7f02a37fe700 1 -- 172.21.15.86:0/223285256 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400fac0 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.905+0000 7f02a37fe700 1 -- 172.21.15.86:0/223285256 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400fc20 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.905+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac0b57e0 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.905+0000 7f02a37fe700 1 -- 172.21.15.86:0/223285256 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294014440 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.905+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac0b40c0 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.906+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac0b45a0 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.907+0000 7f02a37fe700 1 -- 172.21.15.86:0/223285256 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 103) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0294014a80 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.907+0000 7f02a37fe700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f028c066dd0 0x7f028c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.908+0000 7f02a37fe700 1 -- 172.21.15.86:0/223285256 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f0294018030 con 0x7f02ac16a190 2023-10-09T13:14:00.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.908+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f028c066dd0 0x7f028c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:00.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.908+0000 7f02ab7fe700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f028c066dd0 0x7f028c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f029c000ef0 tx=0x7f029c015000 comp rx=0 tx=0).ready entity=mgr.9873 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:14:00.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:00.912+0000 7f02a37fe700 1 -- 172.21.15.86:0/223285256 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0294052410 con 0x7f02ac16a190 2023-10-09T13:14:01.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.127+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f02ac04c3c0 con 0x7f028c066dd0 2023-10-09T13:14:01.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.187+0000 7f02a37fe700 1 -- 172.21.15.86:0/223285256 <== mgr.9873 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f02ac04c3c0 con 0x7f028c066dd0 2023-10-09T13:14:01.188 INFO:teuthology.orchestra.run.smithi086.stdout:Retention added to path snap_test_dir1 2023-10-09T13:14:01.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f028c066dd0 msgr2=0x7f028c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f028c066dd0 0x7f028c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f029c000ef0 tx=0x7f029c015000 comp rx=0 tx=0).stop 2023-10-09T13:14:01.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ac16a190 msgr2=0x7f02ac14c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ac16a190 0x7f02ac14c680 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f0294011d40 tx=0x7f02940091a0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 shutdown_connections 2023-10-09T13:14:01.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f028c066dd0 0x7f028c069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02ac1599a0 0x7f02ac159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0298003a90 0x7f02ac0b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 --2- 172.21.15.86:0/223285256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ac16a190 0x7f02ac14c680 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 >> 172.21.15.86:0/223285256 conn(0x7f02ac0d05f0 msgr2=0x7f02ac153290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:14:01.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 shutdown_connections 2023-10-09T13:14:01.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.189+0000 7f02b099d700 1 -- 172.21.15.86:0/223285256 wait complete. 2023-10-09T13:14:01.208 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-09T13:14:01.208 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-13_15_00 in ~59s... 2023-10-09T13:14:01.209 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-09T13:14:01.209 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T13:14:01.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.393+0000 7fe7aa3ff700 1 Processor -- start 2023-10-09T13:14:01.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.393+0000 7fe7aa3ff700 1 -- start start 2023-10-09T13:14:01.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.394+0000 7fe7aa3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe7a415a440 0x7fe7a40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:01.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.394+0000 7fe7aa3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a415a9b0 con 0x7fe7a4068890 2023-10-09T13:14:01.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.394+0000 7fe7aa3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a415ac90 con 0x7fe7a41563b0 2023-10-09T13:14:01.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.394+0000 7fe7aa3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a415af70 con 0x7fe7a415a440 2023-10-09T13:14:01.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.394+0000 7fe7a899c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe7a4068890 0x7fe7a40c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:45502/0 (socket says 172.21.15.86:45502) 2023-10-09T13:14:01.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.394+0000 7fe7a899c700 1 -- 172.21.15.86:0/3365993474 learned_addr learned my addr 172.21.15.86:0/3365993474 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:14:01.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a37fe700 1 --2- 172.21.15.86:0/3365993474 >> v2:172.21.15.135:3300/0 conn(0x7fe7a415a440 0x7fe7a40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a2ffd700 1 -- 172.21.15.86:0/3365993474 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103398910 0 0) 0x7fe7a415a9b0 con 0x7fe7a4068890 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a2ffd700 1 -- 172.21.15.86:0/3365993474 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe78c003570 con 0x7fe7a4068890 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a2ffd700 1 -- 172.21.15.86:0/3365993474 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214842361 0 0) 0x7fe7a415ac90 con 0x7fe7a41563b0 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a2ffd700 1 -- 172.21.15.86:0/3365993474 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a415a9b0 con 0x7fe7a41563b0 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a37fe700 1 -- 172.21.15.86:0/3365993474 >> v1:172.21.15.135:6789/0 conn(0x7fe7a41563b0 legacy=0x7fe7a4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a37fe700 1 -- 172.21.15.86:0/3365993474 >> v1:172.21.15.86:6789/0 conn(0x7fe7a4068890 legacy=0x7fe7a40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a37fe700 1 -- 172.21.15.86:0/3365993474 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a415b250 con 0x7fe7a415a440 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.395+0000 7fe7a37fe700 1 --2- 172.21.15.86:0/3365993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a415a440 0x7fe7a40acf30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe7980098e0 tx=0x7fe7980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b127a31f7df10883 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7a2ffd700 1 -- 172.21.15.86:0/3365993474 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798011630 con 0x7fe7a415a440 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7a2ffd700 1 -- 172.21.15.86:0/3365993474 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798011790 con 0x7fe7a415a440 2023-10-09T13:14:01.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7a2ffd700 1 -- 172.21.15.86:0/3365993474 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798011b30 con 0x7fe7a415a440 2023-10-09T13:14:01.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/3365993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a415a440 msgr2=0x7fe7a40acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/3365993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a415a440 0x7fe7a40acf30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe7980098e0 tx=0x7fe7980091a0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/3365993474 shutdown_connections 2023-10-09T13:14:01.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/3365993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a415a440 0x7fe7a40acf30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/3365993474 >> 172.21.15.86:0/3365993474 conn(0x7fe7a40c8f90 msgr2=0x7fe7a40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:14:01.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/3365993474 shutdown_connections 2023-10-09T13:14:01.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.396+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/3365993474 wait complete. 2023-10-09T13:14:01.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.398+0000 7fe7aa3ff700 1 Processor -- start 2023-10-09T13:14:01.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.398+0000 7fe7aa3ff700 1 -- start start 2023-10-09T13:14:01.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7aa3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a4068890 0x7fe7a40b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:01.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7aa3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7a41563b0 0x7fe7a4159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:01.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7aa3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a415a440 0x7fe7a414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:01.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7aa3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40b1640 con 0x7fe7a415a440 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7aa3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40b0a30 con 0x7fe7a4068890 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7aa3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40b0d10 con 0x7fe7a41563b0 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a415a440 0x7fe7a414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a415a440 0x7fe7a414b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56414/0 (socket says 172.21.15.86:56414) 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 -- 172.21.15.86:0/2445794783 learned_addr learned my addr 172.21.15.86:0/2445794783 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a37fe700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7a41563b0 0x7fe7a4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a3fff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a4068890 0x7fe7a40b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 -- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7a41563b0 msgr2=0x7fe7a4159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7a41563b0 0x7fe7a4159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 -- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a4068890 msgr2=0x7fe7a40b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a4068890 0x7fe7a40b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.399+0000 7fe7a899c700 1 -- 172.21.15.86:0/2445794783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798009420 con 0x7fe7a415a440 2023-10-09T13:14:01.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.400+0000 7fe7a899c700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a415a440 0x7fe7a414b8b0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00cc60 tx=0x7fe79c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:14:01.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.400+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00a910 con 0x7fe7a415a440 2023-10-09T13:14:01.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.400+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00aa90 con 0x7fe7a415a440 2023-10-09T13:14:01.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.400+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00ae50 con 0x7fe7a415a440 2023-10-09T13:14:01.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.400+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a40b0ff0 con 0x7fe7a415a440 2023-10-09T13:14:01.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.400+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a40ab3f0 con 0x7fe7a415a440 2023-10-09T13:14:01.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.401+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a40b17b0 con 0x7fe7a415a440 2023-10-09T13:14:01.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.402+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 103) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fe79c007300 con 0x7fe7a415a440 2023-10-09T13:14:01.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.403+0000 7fe78bfff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe790066dd0 0x7fe790069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:14:01.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.403+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6439+0+0 (secure 0 0 0) 0x7fe79c0849f0 con 0x7fe7a415a440 2023-10-09T13:14:01.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.403+0000 7fe7a3fff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe790066dd0 0x7fe790069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:14:01.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.404+0000 7fe7a3fff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe790066dd0 0x7fe790069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe794007fd0 tx=0x7fe794007d50 comp rx=0 tx=0).ready entity=mgr.9873 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:14:01.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.407+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe79c051be0 con 0x7fe7a415a440 2023-10-09T13:14:01.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.619+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 104) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fe79c086d50 con 0x7fe7a415a440 2023-10-09T13:14:01.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.632+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7a40718b0 con 0x7fe790066dd0 2023-10-09T13:14:01.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.641+0000 7fe78bfff700 1 -- 172.21.15.86:0/2445794783 <== mgr.9873 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fe7a40718b0 con 0x7fe790066dd0 2023-10-09T13:14:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:14:01.642 INFO:teuthology.orchestra.run.smithi086.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe790066dd0 msgr2=0x7fe790069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe790066dd0 0x7fe790069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe794007fd0 tx=0x7fe794007d50 comp rx=0 tx=0).stop 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a415a440 msgr2=0x7fe7a414b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a415a440 0x7fe7a414b8b0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00cc60 tx=0x7fe79c001ae0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 shutdown_connections 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe790066dd0 0x7fe790069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a415a440 0x7fe7a414b8b0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7a4068890 0x7fe7a40b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 --2- 172.21.15.86:0/2445794783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7a41563b0 0x7fe7a4159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:14:01.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 >> 172.21.15.86:0/2445794783 conn(0x7fe7a40c8f90 msgr2=0x7fe7a4155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:14:01.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 shutdown_connections 2023-10-09T13:14:01.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:14:01.644+0000 7fe7aa3ff700 1 -- 172.21.15.86:0/2445794783 wait complete. 2023-10-09T13:14:01.668 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T13:14:01.668 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-09T13:14:01.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:01.668 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:01.707 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:01.707 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:01.707 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:02.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:02.708 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:02.751 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:02.751 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:02.751 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:03.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:03.752 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:03.795 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:03.795 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:03.795 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:04.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:04.797 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:04.839 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:04.840 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:04.840 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:05.174 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:14:05.179 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:14:05.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:05.841 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:05.884 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:05.884 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:05.884 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:06.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:06.885 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:06.928 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:06.928 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:06.928 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:07.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:07.929 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:07.973 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:07.973 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:07.973 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:08.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:08.974 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:09.017 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:09.017 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:09.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:10.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:10.018 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:10.062 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:10.063 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:10.063 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:11.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:11.064 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:11.106 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:11.106 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:11.106 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:12.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:12.107 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:12.149 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:12.149 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:12.149 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:13.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:13.151 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:13.193 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:13.193 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:13.193 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:14.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:14.195 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:14.238 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:14.238 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:14.238 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:15.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:15.239 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:15.282 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:15.282 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:15.282 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:16.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:16.283 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:16.326 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:16.326 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:16.326 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:17.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:17.327 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:17.370 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:17.370 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:17.370 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:18.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:18.371 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:18.414 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:18.414 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:18.414 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:19.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:19.415 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:19.458 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:19.458 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:19.458 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:20.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:20.459 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:20.501 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:20.501 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:20.502 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:21.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:21.503 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:21.545 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:21.545 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:21.545 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:22.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:22.546 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:22.588 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:22.589 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:22.589 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:23.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:23.589 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:23.632 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:23.633 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:23.633 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:24.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:24.633 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:24.676 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:24.676 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:24.676 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:25.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:25.677 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:25.720 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:25.720 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:25.720 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:26.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:26.721 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:26.764 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:26.764 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:26.764 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:27.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:27.765 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:27.809 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:27.809 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:27.809 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:28.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:28.810 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:28.853 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:28.853 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:28.853 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:29.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:29.855 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:29.897 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:29.897 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:29.897 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:30.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:30.898 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:30.941 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:30.941 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:30.941 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:31.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:31.942 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:31.985 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:31.985 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:31.985 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:32.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:32.986 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:33.029 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:33.029 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:33.030 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:34.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:34.031 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:34.074 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:34.074 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:34.074 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:35.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:35.076 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:35.118 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:35.118 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:35.118 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:35.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:14:35.344 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:14:36.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:36.120 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:36.163 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:36.163 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:36.163 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:37.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:37.165 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:37.207 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:37.207 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:37.207 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:38.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:38.209 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:38.252 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:38.252 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:38.252 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:39.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:39.254 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:39.297 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:39.297 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:39.297 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:40.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:40.298 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:40.340 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:40.341 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:40.341 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:41.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:41.341 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:41.384 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:41.384 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:41.385 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:42.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:42.386 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:42.429 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:42.429 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:42.429 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:43.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:43.430 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:43.472 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:43.472 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:43.472 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:44.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:44.473 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:44.516 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:44.516 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:44.516 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:45.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:45.517 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:45.560 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:45.560 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:45.560 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:46.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:46.561 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:46.604 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:46.604 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:46.604 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:47.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:47.605 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:47.648 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:47.648 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:47.649 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:48.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:48.649 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:48.692 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:48.692 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:48.693 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:49.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:49.694 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:49.737 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:49.737 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:49.737 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:50.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:50.738 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:50.781 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:50.781 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:50.781 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:51.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:51.782 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:51.825 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:51.826 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:51.826 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:52.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:52.826 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:52.869 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:52.869 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:52.869 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:53.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:53.870 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:53.913 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:53.913 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:53.913 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:54.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:54.915 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:54.957 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:54.957 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:54.957 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:55.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:55.959 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:56.002 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:56.002 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:56.002 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:57.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:57.003 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:57.046 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:57.046 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:57.046 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:58.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:58.047 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:58.089 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:58.089 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:58.089 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:14:59.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:14:59.090 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:14:59.132 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:14:59.133 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:14:59.133 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:00.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:00.134 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:00.176 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-09T13:15:00.176 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:00.176 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:00.200 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:15:00.200+0000 7fcfecc95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:15:00.200 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:15:00.200+0000 7fcfecc95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:15:00.200 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:15:00.200+0000 7fcfecc95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:15:00.200 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:15:00.200+0000 7fcfecc95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:15:00.200 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:15:00.200+0000 7fcfecc95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:15:01.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:01.177 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:01.221 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:01.223 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:01.223 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:01.223 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:01.223 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-09-13_15_00_UTC'] 2023-10-09T13:15:01.223 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696857241.208845, now = 1696857301.223752, timo = 59 2023-10-09T13:15:02.224 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-10-09-13_15_00 in ~119s... 2023-10-09T13:15:02.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:02.225 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:02.267 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:02.268 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:02.268 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:02.268 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:03.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:03.269 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:03.311 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:03.312 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:03.312 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:03.312 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:04.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:04.313 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:04.354 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:04.355 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:04.355 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:04.356 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:05.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:05.357 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:05.399 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:05.400 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:05.400 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:05.400 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:05.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:15:05.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:15:06.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:06.401 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:06.442 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:06.443 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:06.444 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:06.444 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:07.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:07.445 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:07.487 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:07.488 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:07.488 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:07.488 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:08.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:08.488 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:08.528 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:08.530 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:08.530 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:08.530 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:09.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:09.531 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:09.572 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:09.573 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:09.573 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:09.573 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:10.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:10.574 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:10.616 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:10.617 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:10.617 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:10.617 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:11.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:11.618 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:11.661 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:11.662 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:11.662 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:11.662 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:12.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:12.663 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:12.705 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:12.706 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:12.706 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:12.706 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:13.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:13.708 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:13.750 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:13.751 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:13.751 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:13.751 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:14.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:14.752 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:14.795 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:14.796 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:14.796 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:14.796 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:15.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:15.797 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:15.839 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:15.840 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:15.840 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:15.840 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:16.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:16.841 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:16.883 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:16.884 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:16.884 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:16.884 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:17.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:17.885 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:17.927 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:17.928 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:17.928 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:17.928 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:18.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:18.929 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:18.971 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:18.972 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:18.972 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:18.973 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:19.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:19.974 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:20.015 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:20.016 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:20.016 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:20.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:21.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:21.018 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:21.059 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:21.060 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:21.060 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:21.061 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:22.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:22.061 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:22.103 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:22.104 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:22.104 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:22.104 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:23.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:23.105 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:23.146 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:23.147 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:23.147 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:23.147 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:24.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:24.148 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:24.189 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:24.190 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:24.190 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:24.190 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:25.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:25.192 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:25.234 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:25.235 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:25.235 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:25.235 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:26.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:26.237 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:26.278 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:26.279 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:26.279 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:26.280 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:27.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:27.281 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:27.322 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:27.324 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:27.324 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:27.324 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:28.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:28.325 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:28.367 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:28.368 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:28.368 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:28.368 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:29.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:29.369 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:29.410 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:29.411 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:29.411 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:29.411 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:30.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:30.412 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:30.454 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:30.455 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:30.455 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:30.455 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:31.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:31.456 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:31.499 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:31.500 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:31.500 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:31.500 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:32.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:32.501 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:32.541 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:32.542 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:32.542 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:32.542 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:33.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:33.543 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:33.584 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:33.585 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:33.585 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:33.585 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:34.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:34.586 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:34.630 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:34.631 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:34.631 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:34.631 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:35.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:35.633 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:35.674 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:35.675 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:35.675 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:35.675 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:35.693 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:15:35.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:15:36.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:36.676 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:36.718 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:36.719 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:36.719 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:36.719 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:37.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:37.720 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:37.761 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:37.762 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:37.762 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:37.763 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:38.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:38.764 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:38.805 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:38.806 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:38.806 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:38.806 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:39.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:39.807 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:39.850 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:39.851 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:39.851 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:39.851 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:40.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:40.852 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:40.894 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:40.895 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:40.895 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:40.895 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:41.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:41.896 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:41.938 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:41.939 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:41.939 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:41.939 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:42.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:42.940 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:42.982 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:42.982 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:42.983 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:43.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:43.984 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:44.025 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:44.026 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:44.026 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:44.026 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:45.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:45.027 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:45.069 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:45.070 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:45.071 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:45.071 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:46.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:46.072 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:46.113 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:46.114 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:46.115 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:46.115 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:47.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:47.116 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:47.157 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:47.158 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:47.158 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:47.158 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:48.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:48.159 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:48.201 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:48.202 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:48.202 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:48.202 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:49.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:49.204 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:49.245 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:49.246 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:49.246 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:49.247 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:50.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:50.247 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:50.289 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:50.290 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:50.291 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:50.291 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:51.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:51.292 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:51.333 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:51.334 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:51.334 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:51.334 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:52.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:52.336 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:52.378 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:52.379 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:52.379 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:52.379 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:53.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:53.379 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:53.421 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:53.422 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:53.423 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:53.423 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:54.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:54.424 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:54.466 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:54.467 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:54.467 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:54.467 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:55.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:55.468 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:55.510 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:55.511 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:55.511 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:55.511 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:56.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:56.513 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:56.555 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:56.556 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:56.556 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:56.556 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:57.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:57.557 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:57.599 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:57.600 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:57.600 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:57.600 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:58.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:58.602 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:58.642 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:58.643 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:58.643 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:58.643 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:15:59.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:15:59.644 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:15:59.686 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_15_00_UTC 2023-10-09T13:15:59.687 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:15:59.687 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-09T13:15:59.687 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-09T13:16:00.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:00.688 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:16:00.730 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_16_00_UTC 2023-10-09T13:16:00.731 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-09-13_16_00_UTC'} 2023-10-09T13:16:00.731 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-09-13_16_00_UTC'} 2023-10-09T13:16:00.731 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-10-09-13_15_00_UTC'} 2023-10-09T13:16:00.731 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-10-09-13_15_00_UTC'] 2023-10-09T13:16:00.731 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696857241.208845, now = 1696857360.731606, timo = 119 2023-10-09T13:16:01.732 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T13:16:01.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.924+0000 7f9ec7fff700 1 Processor -- start 2023-10-09T13:16:01.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.924+0000 7f9ec7fff700 1 -- start start 2023-10-09T13:16:01.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155d40 0x7f9ec806a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:01.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ec80c6c60 0x7f9ec806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:01.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec7fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec806f210 con 0x7f9ec8155970 2023-10-09T13:16:01.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec7fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec806e600 con 0x7f9ec80c6c60 2023-10-09T13:16:01.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec806e8e0 con 0x7f9ec8155d40 2023-10-09T13:16:01.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ec80c6c60 0x7f9ec806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec6ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9ec8155970 0x7f9ec806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:46356/0 (socket says 172.21.15.86:46356) 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec6ffd700 1 -- 172.21.15.86:0/91416362 learned_addr learned my addr 172.21.15.86:0/91416362 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec67fc700 1 --2- 172.21.15.86:0/91416362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155d40 0x7f9ec806a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec5ffb700 1 -- 172.21.15.86:0/91416362 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874429003 0 0) 0x7f9ec806f210 con 0x7f9ec8155970 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec5ffb700 1 -- 172.21.15.86:0/91416362 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb0003570 con 0x7f9ec8155970 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec77fe700 1 -- 172.21.15.86:0/91416362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155d40 msgr2=0x7f9ec806a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec77fe700 1 --2- 172.21.15.86:0/91416362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155d40 0x7f9ec806a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec77fe700 1 -- 172.21.15.86:0/91416362 >> v1:172.21.15.86:6789/0 conn(0x7f9ec8155970 legacy=0x7f9ec806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.926+0000 7f9ec77fe700 1 -- 172.21.15.86:0/91416362 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec806ebc0 con 0x7f9ec80c6c60 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.927+0000 7f9ec77fe700 1 --2- 172.21.15.86:0/91416362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec806a640 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00098e0 tx=0x7f9ec00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681d49ac952c4467 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.927+0000 7f9ec5ffb700 1 -- 172.21.15.86:0/91416362 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000b640 con 0x7f9ec80c6c60 2023-10-09T13:16:01.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.927+0000 7f9ec5ffb700 1 -- 172.21.15.86:0/91416362 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000b7a0 con 0x7f9ec80c6c60 2023-10-09T13:16:01.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.927+0000 7f9ec5ffb700 1 -- 172.21.15.86:0/91416362 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000bb40 con 0x7f9ec80c6c60 2023-10-09T13:16:01.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.927+0000 7f9ec7fff700 1 -- 172.21.15.86:0/91416362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 msgr2=0x7f9ec806a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.927+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/91416362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec806a640 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00098e0 tx=0x7f9ec00091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.928+0000 7f9ec7fff700 1 -- 172.21.15.86:0/91416362 shutdown_connections 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.928+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/91416362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec806a640 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.928+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/91416362 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155d40 0x7f9ec806a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.928+0000 7f9ec7fff700 1 -- 172.21.15.86:0/91416362 >> 172.21.15.86:0/91416362 conn(0x7f9ec80c8be0 msgr2=0x7f9ec80c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.928+0000 7f9ec7fff700 1 -- 172.21.15.86:0/91416362 shutdown_connections 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.928+0000 7f9ec7fff700 1 -- 172.21.15.86:0/91416362 wait complete. 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.929+0000 7f9ec7fff700 1 Processor -- start 2023-10-09T13:16:01.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.929+0000 7f9ec7fff700 1 -- start start 2023-10-09T13:16:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec8158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155970 0x7f9ec8159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec8155d40 0x7f9ec8150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8159440 con 0x7f9ec80c6c60 2023-10-09T13:16:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8152210 con 0x7f9ec8155d40 2023-10-09T13:16:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81591e0 con 0x7f9ec8155970 2023-10-09T13:16:01.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec8158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec8158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40812/0 (socket says 172.21.15.86:40812) 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.930+0000 7f9ec6ffd700 1 -- 172.21.15.86:0/277617794 learned_addr learned my addr 172.21.15.86:0/277617794 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec67fc700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155970 0x7f9ec8159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec77fe700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec8155d40 0x7f9ec8150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec6ffd700 1 -- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155970 msgr2=0x7f9ec8159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec6ffd700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155970 0x7f9ec8159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec6ffd700 1 -- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec8155d40 msgr2=0x7f9ec8150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec6ffd700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec8155d40 0x7f9ec8150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec6ffd700 1 -- 172.21.15.86:0/277617794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0009420 con 0x7f9ec80c6c60 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec77fe700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec8155d40 0x7f9ec8150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:01.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec6ffd700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec8158ca0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800cd30 tx=0x7f9eb8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9eaeffd700 1 -- 172.21.15.86:0/277617794 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800ab70 con 0x7f9ec80c6c60 2023-10-09T13:16:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9eaeffd700 1 -- 172.21.15.86:0/277617794 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb800acf0 con 0x7f9ec80c6c60 2023-10-09T13:16:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9eaeffd700 1 -- 172.21.15.86:0/277617794 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8007340 con 0x7f9ec80c6c60 2023-10-09T13:16:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80af200 con 0x7f9ec80c6c60 2023-10-09T13:16:01.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.931+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec80af7c0 con 0x7f9ec80c6c60 2023-10-09T13:16:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.932+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec815a4e0 con 0x7f9ec80c6c60 2023-10-09T13:16:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.933+0000 7f9eaeffd700 1 -- 172.21.15.86:0/277617794 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 106) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f9eb8007770 con 0x7f9ec80c6c60 2023-10-09T13:16:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.934+0000 7f9eaeffd700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9eb40670a0 0x7f9eb4069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.934+0000 7f9eaeffd700 1 -- 172.21.15.86:0/277617794 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f9eb8084f90 con 0x7f9ec80c6c60 2023-10-09T13:16:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.934+0000 7f9ec67fc700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9eb40670a0 0x7f9eb4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:01.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.935+0000 7f9ec67fc700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9eb40670a0 0x7f9eb4069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80ca670 tx=0x7f9ebc008040 comp rx=0 tx=0).ready entity=mgr.9873 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:01.939 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:01.938+0000 7f9eaeffd700 1 -- 172.21.15.86:0/277617794 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9eb8051df0 con 0x7f9ec80c6c60 2023-10-09T13:16:02.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.154+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ec806b810 con 0x7f9eb40670a0 2023-10-09T13:16:02.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.234+0000 7f9eaeffd700 1 -- 172.21.15.86:0/277617794 <== mgr.9873 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9ec806b810 con 0x7f9eb40670a0 2023-10-09T13:16:02.237 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path snap_test_dir1 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9eb40670a0 msgr2=0x7f9eb4069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9eb40670a0 0x7f9eb4069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80ca670 tx=0x7f9ebc008040 comp rx=0 tx=0).stop 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 msgr2=0x7f9ec8158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec8158ca0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800cd30 tx=0x7f9eb8001b10 comp rx=0 tx=0).stop 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 shutdown_connections 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9eb40670a0 0x7f9eb4069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec80c6c60 0x7f9ec8158ca0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec8155d40 0x7f9ec8150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 --2- 172.21.15.86:0/277617794 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec8155970 0x7f9ec8159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 >> 172.21.15.86:0/277617794 conn(0x7f9ec80c8be0 msgr2=0x7f9ec806a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 shutdown_connections 2023-10-09T13:16:02.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.237+0000 7f9ec7fff700 1 -- 172.21.15.86:0/277617794 wait complete. 2023-10-09T13:16:02.255 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T13:16:02.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:02.256 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:16:02.293 INFO:teuthology.orchestra.run.smithi086.stdout:scheduled-2023-10-09-13_16_00_UTC 2023-10-09T13:16:02.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-09-13_16_00_UTC 2023-10-09T13:16:02.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:02.295 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-09-13_16_00_UTC) 2023-10-09T13:16:02.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:02.377 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T13:16:02.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T13:16:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.680+0000 7fa5fb59e700 1 Processor -- start 2023-10-09T13:16:02.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.680+0000 7fa5fb59e700 1 -- start start 2023-10-09T13:16:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.681+0000 7fa5fb59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5fc153880 0x7fa5fc1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.681+0000 7fa5fb59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5fc153c50 0x7fa5fc0b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.681+0000 7fa5fb59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 0x7fa5fc06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:02.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.681+0000 7fa5fb59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc158640 con 0x7fa5fc153c50 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.681+0000 7fa5fb59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc157a30 con 0x7fa5fc153880 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.681+0000 7fa5fb59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc157d10 con 0x7fa5fc0b07d0 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.681+0000 7fa5f3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5fc153c50 0x7fa5fc0b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5fc153c50 0x7fa5fc0b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40820/0 (socket says 172.21.15.86:40820) 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 -- 172.21.15.86:0/703893242 learned_addr learned my addr 172.21.15.86:0/703893242 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5fa59c700 1 --2- 172.21.15.86:0/703893242 >> v2:172.21.15.135:3300/0 conn(0x7fa5fc153880 0x7fa5fc1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5fad9d700 1 --2- 172.21.15.86:0/703893242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 0x7fa5fc06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 -- 172.21.15.86:0/703893242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 msgr2=0x7fa5fc06a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 --2- 172.21.15.86:0/703893242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 0x7fa5fc06a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 -- 172.21.15.86:0/703893242 >> v2:172.21.15.135:3300/0 conn(0x7fa5fc153880 msgr2=0x7fa5fc1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 --2- 172.21.15.86:0/703893242 >> v2:172.21.15.135:3300/0 conn(0x7fa5fc153880 0x7fa5fc1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 -- 172.21.15.86:0/703893242 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc157ff0 con 0x7fa5fc153c50 2023-10-09T13:16:02.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f3fff700 1 --2- 172.21.15.86:0/703893242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153c50 0x7fa5fc0b0290 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc06c080 tx=0x7fa5e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd11d7c088935265 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.682+0000 7fa5f9d9b700 1 -- 172.21.15.86:0/703893242 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400b820 con 0x7fa5fc153c50 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5f9d9b700 1 -- 172.21.15.86:0/703893242 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400b980 con 0x7fa5fc153c50 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5f9d9b700 1 -- 172.21.15.86:0/703893242 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400bd20 con 0x7fa5fc153c50 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 -- 172.21.15.86:0/703893242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153c50 msgr2=0x7fa5fc0b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/703893242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153c50 0x7fa5fc0b0290 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc06c080 tx=0x7fa5e4009250 comp rx=0 tx=0).stop 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 -- 172.21.15.86:0/703893242 shutdown_connections 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/703893242 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 0x7fa5fc06a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/703893242 >> v2:172.21.15.135:3300/0 conn(0x7fa5fc153880 0x7fa5fc1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/703893242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153c50 0x7fa5fc0b0290 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 -- 172.21.15.86:0/703893242 >> 172.21.15.86:0/703893242 conn(0x7fa5fc068390 msgr2=0x7fa5fc068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 -- 172.21.15.86:0/703893242 shutdown_connections 2023-10-09T13:16:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.683+0000 7fa5fb59e700 1 -- 172.21.15.86:0/703893242 wait complete. 2023-10-09T13:16:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.685+0000 7fa5fb59e700 1 Processor -- start 2023-10-09T13:16:02.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.685+0000 7fa5fb59e700 1 -- start start 2023-10-09T13:16:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5fb59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 0x7fa5fc1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:02.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5fb59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153880 0x7fa5fc141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5fb59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5fc153c50 0x7fa5fc149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5fb59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc143da0 con 0x7fa5fc153880 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5fb59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0cbb40 con 0x7fa5fc153c50 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5fb59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0cb6b0 con 0x7fa5fc0b07d0 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153880 0x7fa5fc141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153880 0x7fa5fc141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40836/0 (socket says 172.21.15.86:40836) 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 -- 172.21.15.86:0/3008851903 learned_addr learned my addr 172.21.15.86:0/3008851903 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 -- 172.21.15.86:0/3008851903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 msgr2=0x7fa5fc1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 0x7fa5fc1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 -- 172.21.15.86:0/3008851903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5fc153c50 msgr2=0x7fa5fc149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5fc153c50 0x7fa5fc149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:02.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 -- 172.21.15.86:0/3008851903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40094f0 con 0x7fa5fc153880 2023-10-09T13:16:02.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.686+0000 7fa5f3fff700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153880 0x7fa5fc141070 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009290 tx=0x7fa5e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:02.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.687+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e401a450 con 0x7fa5fc153880 2023-10-09T13:16:02.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.687+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e401a5b0 con 0x7fa5fc153880 2023-10-09T13:16:02.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.687+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc0caaa0 con 0x7fa5fc153880 2023-10-09T13:16:02.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.687+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e401a950 con 0x7fa5fc153880 2023-10-09T13:16:02.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.687+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc0cb0e0 con 0x7fa5fc153880 2023-10-09T13:16:02.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.688+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5fc0cb460 con 0x7fa5fc153880 2023-10-09T13:16:02.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.689+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 106) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fa5e401ad40 con 0x7fa5fc153880 2023-10-09T13:16:02.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.690+0000 7fa5f27fc700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa5dc0670a0 0x7fa5dc069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:02.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.690+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6439+0+0 (secure 0 0 0) 0x7fa5e40864c0 con 0x7fa5fc153880 2023-10-09T13:16:02.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.690+0000 7fa5fa59c700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa5dc0670a0 0x7fa5dc069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:02.691 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.690+0000 7fa5fa59c700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa5dc0670a0 0x7fa5dc069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009a60 tx=0x7fa5ec008040 comp rx=0 tx=0).ready entity=mgr.9873 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:02.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.694+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5e4053320 con 0x7fa5fc153880 2023-10-09T13:16:02.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:02.935+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa5fc1582d0 con 0x7fa5fc153880 2023-10-09T13:16:03.541 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.539+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa5e40536f0 con 0x7fa5fc153880 2023-10-09T13:16:03.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.541+0000 7fa5f27fc700 1 -- 172.21.15.86:0/3008851903 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v107) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa5e4055380 con 0x7fa5fc153880 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa5dc0670a0 msgr2=0x7fa5dc069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa5dc0670a0 0x7fa5dc069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009a60 tx=0x7fa5ec008040 comp rx=0 tx=0).stop 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153880 msgr2=0x7fa5fc141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153880 0x7fa5fc141070 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009290 tx=0x7fa5e4017000 comp rx=0 tx=0).stop 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 shutdown_connections 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa5dc0670a0 0x7fa5dc069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5fc153c50 0x7fa5fc149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:03.546 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5fc0b07d0 0x7fa5fc1446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:03.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 --2- 172.21.15.86:0/3008851903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5fc153880 0x7fa5fc141070 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:03.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 >> 172.21.15.86:0/3008851903 conn(0x7fa5fc068390 msgr2=0x7fa5fc06de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:03.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 shutdown_connections 2023-10-09T13:16:03.547 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:03.544+0000 7fa5fb59e700 1 -- 172.21.15.86:0/3008851903 wait complete. 2023-10-09T13:16:03.564 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T13:16:03.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:16:03.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:16:03.741 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T13:16:03.741 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T13:16:03.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:03.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T13:16:03.823 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:16:03.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:03.824 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T13:16:03.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:04.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.089+0000 7f367239d700 1 Processor -- start 2023-10-09T13:16:04.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.089+0000 7f367239d700 1 -- start start 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f367239d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f366c159420 0x7f366c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f367239d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f366c15d230 0x7f366c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f367239d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c0b2980 con 0x7f366c1597f0 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f367239d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c15db70 con 0x7f366c15d230 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f367239d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0b11d0 con 0x7f366c159420 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f3671b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f366c15d230 0x7f366c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f3671b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f366c15d230 0x7f366c15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40848/0 (socket says 172.21.15.86:40848) 2023-10-09T13:16:04.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f3671b9c700 1 -- 172.21.15.86:0/910875388 learned_addr learned my addr 172.21.15.86:0/910875388 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:04.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.091+0000 7f367139b700 1 --2- 172.21.15.86:0/910875388 >> v2:172.21.15.135:3300/0 conn(0x7f366c159420 0x7f366c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3671b9c700 1 -- 172.21.15.86:0/910875388 >> v2:172.21.15.135:3300/0 conn(0x7f366c159420 msgr2=0x7f366c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:04.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3671b9c700 1 --2- 172.21.15.86:0/910875388 >> v2:172.21.15.135:3300/0 conn(0x7f366c159420 0x7f366c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3671b9c700 1 -- 172.21.15.86:0/910875388 >> v1:172.21.15.135:6789/0 conn(0x7f366c1597f0 legacy=0x7f366c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3671b9c700 1 -- 172.21.15.86:0/910875388 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0b14b0 con 0x7f366c15d230 2023-10-09T13:16:04.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3671b9c700 1 --2- 172.21.15.86:0/910875388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c15d230 0x7f366c15d630 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f366c0b2f20 tx=0x7f3664009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43656dd8628ba80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:04.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3663fff700 1 -- 172.21.15.86:0/910875388 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400e070 con 0x7f366c15d230 2023-10-09T13:16:04.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3663fff700 1 -- 172.21.15.86:0/910875388 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366400ba20 con 0x7f366c15d230 2023-10-09T13:16:04.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.092+0000 7f3663fff700 1 -- 172.21.15.86:0/910875388 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640092e0 con 0x7f366c15d230 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 -- 172.21.15.86:0/910875388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c15d230 msgr2=0x7f366c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 --2- 172.21.15.86:0/910875388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c15d230 0x7f366c15d630 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f366c0b2f20 tx=0x7f3664009840 comp rx=0 tx=0).stop 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 -- 172.21.15.86:0/910875388 shutdown_connections 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 --2- 172.21.15.86:0/910875388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c15d230 0x7f366c15d630 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 --2- 172.21.15.86:0/910875388 >> v2:172.21.15.135:3300/0 conn(0x7f366c159420 0x7f366c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 -- 172.21.15.86:0/910875388 >> 172.21.15.86:0/910875388 conn(0x7f366c0d0660 msgr2=0x7f366c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 -- 172.21.15.86:0/910875388 shutdown_connections 2023-10-09T13:16:04.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.093+0000 7f367239d700 1 -- 172.21.15.86:0/910875388 wait complete. 2023-10-09T13:16:04.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.094+0000 7f367239d700 1 Processor -- start 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.095+0000 7f367239d700 1 -- start start 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.095+0000 7f367239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f366c159420 0x7f366c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.095+0000 7f367239d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c1597f0 0x7f366c14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.095+0000 7f367239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f366c15d230 0x7f366c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.095+0000 7f367239d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15b0e0 con 0x7f366c1597f0 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.095+0000 7f367239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15a4d0 con 0x7f366c159420 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.095+0000 7f367239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15a7b0 con 0x7f366c15d230 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f366c159420 0x7f366c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f3670b9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c1597f0 0x7f366c14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f366c159420 0x7f366c159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:49216/0 (socket says 172.21.15.86:49216) 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 -- 172.21.15.86:0/3163700151 learned_addr learned my addr 172.21.15.86:0/3163700151 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f3671b9c700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f366c15d230 0x7f366c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 -- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f366c15d230 msgr2=0x7f366c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f366c15d230 0x7f366c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 -- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c1597f0 msgr2=0x7f366c14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c1597f0 0x7f366c14f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 -- 172.21.15.86:0/3163700151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009ae0 con 0x7f366c159420 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.096+0000 7f367139b700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f366c159420 0x7f366c159ca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f366800ec80 tx=0x7f36680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:04.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.097+0000 7f36617fa700 1 -- 172.21.15.86:0/3163700151 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800c850 con 0x7f366c159420 2023-10-09T13:16:04.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.097+0000 7f36617fa700 1 -- 172.21.15.86:0/3163700151 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800c9b0 con 0x7f366c159420 2023-10-09T13:16:04.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.097+0000 7f36617fa700 1 -- 172.21.15.86:0/3163700151 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800cd50 con 0x7f366c159420 2023-10-09T13:16:04.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.097+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c15aa90 con 0x7f366c159420 2023-10-09T13:16:04.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.097+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c15a1e0 con 0x7f366c159420 2023-10-09T13:16:04.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.098+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c15b3c0 con 0x7f366c159420 2023-10-09T13:16:04.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.099+0000 7f36617fa700 1 -- 172.21.15.86:0/3163700151 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f3668013680 con 0x7f366c159420 2023-10-09T13:16:04.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.100+0000 7f36617fa700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.100+0000 7f36617fa700 1 -- 172.21.15.86:0/3163700151 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f3668084d00 con 0x7f366c159420 2023-10-09T13:16:04.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.100+0000 7f3670b9a700 1 -- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 msgr2=0x7f3650069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:04.102 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.100+0000 7f3670b9a700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:04.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.104+0000 7f36617fa700 1 -- 172.21.15.86:0/3163700151 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3668051a90 con 0x7f366c159420 2023-10-09T13:16:04.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.301+0000 7f3670b9a700 1 -- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 msgr2=0x7f3650069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:04.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.301+0000 7f3670b9a700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:04.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.350+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f366c04c3c0 con 0x7f366c159420 2023-10-09T13:16:04.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.351+0000 7f36617fa700 1 -- 172.21.15.86:0/3163700151 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f36680550b0 con 0x7f366c159420 2023-10-09T13:16:04.353 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:04.353 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/768026503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":768026503},{"type":"v1","addr":"172.21.15.86:6834","nonce":768026503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3188349803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3188349803},{"type":"v1","addr":"172.21.15.135:6835","nonce":3188349803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9666,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2491463129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2491463129},{"type":"v1","addr":"172.21.15.86:6835","nonce":2491463129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:13:38.499330+0000","modified":"2023-10-09T13:13:42.436468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9672},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9672":{"gid":9672,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3006026738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3006026738},{"type":"v1","addr":"172.21.15.135:6834","nonce":3006026738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T13:16:04.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 msgr2=0x7f3650069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:04.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f366c159420 msgr2=0x7f366c159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f366c159420 0x7f366c159ca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f366800ec80 tx=0x7f36680091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 shutdown_connections 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f366c15d230 0x7f366c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f366c159420 0x7f366c159ca0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 --2- 172.21.15.86:0/3163700151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f366c1597f0 0x7f366c14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 >> 172.21.15.86:0/3163700151 conn(0x7f366c0d0660 msgr2=0x7f366c0cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 shutdown_connections 2023-10-09T13:16:04.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.354+0000 7f367239d700 1 -- 172.21.15.86:0/3163700151 wait complete. 2023-10-09T13:16:04.357 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 86 2023-10-09T13:16:04.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:04.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.563+0000 7f3d88f9d700 1 Processor -- start 2023-10-09T13:16:04.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.564+0000 7f3d88f9d700 1 -- start start 2023-10-09T13:16:04.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d88f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d841597f0 0x7f3d840b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d88f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d840b11d0 con 0x7f3d8415d230 2023-10-09T13:16:04.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d88f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d840b14b0 con 0x7f3d84159420 2023-10-09T13:16:04.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d88f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840b1790 con 0x7f3d841597f0 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d82ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d841597f0 0x7f3d840b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d82ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d841597f0 0x7f3d840b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40864/0 (socket says 172.21.15.86:40864) 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d82ffd700 1 -- 172.21.15.86:0/172595728 learned_addr learned my addr 172.21.15.86:0/172595728 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.565+0000 7f3d827fc700 1 -- 172.21.15.86:0/172595728 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109825977 0 0) 0x7f3d840b14b0 con 0x7f3d84159420 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d827fc700 1 -- 172.21.15.86:0/172595728 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c003570 con 0x7f3d84159420 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d82ffd700 1 -- 172.21.15.86:0/172595728 >> v1:172.21.15.135:6789/0 conn(0x7f3d84159420 legacy=0x7f3d840b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d82ffd700 1 -- 172.21.15.86:0/172595728 >> v1:172.21.15.86:6789/0 conn(0x7f3d8415d230 legacy=0x7f3d8415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d82ffd700 1 -- 172.21.15.86:0/172595728 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840b1a70 con 0x7f3d841597f0 2023-10-09T13:16:04.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d82ffd700 1 --2- 172.21.15.86:0/172595728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d840b2270 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f3d780099b0 tx=0x7f3d78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81e36dd0ed1ac85 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:04.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d827fc700 1 -- 172.21.15.86:0/172595728 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78009ea0 con 0x7f3d841597f0 2023-10-09T13:16:04.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d827fc700 1 -- 172.21.15.86:0/172595728 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800b820 con 0x7f3d841597f0 2023-10-09T13:16:04.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.566+0000 7f3d827fc700 1 -- 172.21.15.86:0/172595728 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800bba0 con 0x7f3d841597f0 2023-10-09T13:16:04.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.567+0000 7f3d88f9d700 1 -- 172.21.15.86:0/172595728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 msgr2=0x7f3d840b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.567+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/172595728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d840b2270 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f3d780099b0 tx=0x7f3d78009250 comp rx=0 tx=0).stop 2023-10-09T13:16:04.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.567+0000 7f3d88f9d700 1 -- 172.21.15.86:0/172595728 shutdown_connections 2023-10-09T13:16:04.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.567+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/172595728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d840b2270 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.567+0000 7f3d88f9d700 1 -- 172.21.15.86:0/172595728 >> 172.21.15.86:0/172595728 conn(0x7f3d840d0660 msgr2=0x7f3d840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:04.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.567+0000 7f3d88f9d700 1 -- 172.21.15.86:0/172595728 shutdown_connections 2023-10-09T13:16:04.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.567+0000 7f3d88f9d700 1 -- 172.21.15.86:0/172595728 wait complete. 2023-10-09T13:16:04.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.568+0000 7f3d88f9d700 1 Processor -- start 2023-10-09T13:16:04.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.568+0000 7f3d88f9d700 1 -- start start 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.569+0000 7f3d88f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d84159420 0x7f3d840c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.569+0000 7f3d88f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d84154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.569+0000 7f3d88f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d8415d230 0x7f3d840cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.569+0000 7f3d88f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d841548a0 con 0x7f3d841597f0 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.569+0000 7f3d88f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840c6010 con 0x7f3d8415d230 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.569+0000 7f3d88f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840c5400 con 0x7f3d84159420 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d84154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d84154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:40870/0 (socket says 172.21.15.86:40870) 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 -- 172.21.15.86:0/4100235631 learned_addr learned my addr 172.21.15.86:0/4100235631 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d837fe700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d84159420 0x7f3d840c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d83fff700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d8415d230 0x7f3d840cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 -- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d84159420 msgr2=0x7f3d840c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d84159420 0x7f3d840c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 -- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d8415d230 msgr2=0x7f3d840cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d8415d230 0x7f3d840cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 -- 172.21.15.86:0/4100235631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d780094f0 con 0x7f3d841597f0 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d837fe700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d84159420 0x7f3d840c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:04.574 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d82ffd700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d84154360 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f3d780094c0 tx=0x7f3d78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.570+0000 7f3d6b7fe700 1 -- 172.21.15.86:0/4100235631 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800b990 con 0x7f3d841597f0 2023-10-09T13:16:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.571+0000 7f3d6b7fe700 1 -- 172.21.15.86:0/4100235631 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78020070 con 0x7f3d841597f0 2023-10-09T13:16:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.571+0000 7f3d6b7fe700 1 -- 172.21.15.86:0/4100235631 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7801b450 con 0x7f3d841597f0 2023-10-09T13:16:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.571+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d840c56e0 con 0x7f3d841597f0 2023-10-09T13:16:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.571+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d840c5ca0 con 0x7f3d841597f0 2023-10-09T13:16:04.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.572+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8404c3c0 con 0x7f3d841597f0 2023-10-09T13:16:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.573+0000 7f3d6b7fe700 1 -- 172.21.15.86:0/4100235631 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f3d78022030 con 0x7f3d841597f0 2023-10-09T13:16:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.573+0000 7f3d6b7fe700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 0x7f3d70069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.573+0000 7f3d6b7fe700 1 -- 172.21.15.86:0/4100235631 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f3d780868d0 con 0x7f3d841597f0 2023-10-09T13:16:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.574+0000 7f3d837fe700 1 -- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 msgr2=0x7f3d70069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:04.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.574+0000 7f3d837fe700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 0x7f3d70069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:04.583 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.582+0000 7f3d6b7fe700 1 -- 172.21.15.86:0/4100235631 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d78053670 con 0x7f3d841597f0 2023-10-09T13:16:04.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.775+0000 7f3d837fe700 1 -- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 msgr2=0x7f3d70069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:04.776 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.775+0000 7f3d837fe700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 0x7f3d70069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:04.789 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.788+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d8404c3c0 con 0x7f3d841597f0 2023-10-09T13:16:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.789+0000 7f3d6b7fe700 1 -- 172.21.15.86:0/4100235631 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16649 (secure 0 0 0) 0x7f3d78056c90 con 0x7f3d841597f0 2023-10-09T13:16:04.791 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:04.791 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":199,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:04.529284+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:13:36.634243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T13:13:37.482960+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":199,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/133360":"2023-10-10T13:13:59.600731+0000","172.21.15.86:6836/133360":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/2064280795":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3008613817":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3036672640":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3101391875":"2023-10-10T13:13:59.600731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.791+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 msgr2=0x7f3d70069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.791+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 0x7f3d70069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.791+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 msgr2=0x7f3d84154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:04.793 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.791+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d84154360 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f3d780094c0 tx=0x7f3d78016000 comp rx=0 tx=0).stop 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 shutdown_connections 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d70067050 0x7f3d70069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d8415d230 0x7f3d840cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d84159420 0x7f3d840c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 --2- 172.21.15.86:0/4100235631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d841597f0 0x7f3d84154360 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 >> 172.21.15.86:0/4100235631 conn(0x7f3d840d0660 msgr2=0x7f3d84155220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 shutdown_connections 2023-10-09T13:16:04.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:04.792+0000 7f3d88f9d700 1 -- 172.21.15.86:0/4100235631 wait complete. 2023-10-09T13:16:04.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T13:13:36.634243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T13:13:37.482960+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '199', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 199, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T13:16:04.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T13:16:04.841 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:04.839+0000 7fa14c941180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:16:04.900 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:04.899+0000 7f0931ef8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:16:05.002 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.001+0000 7efe0539d700 1 Processor -- start 2023-10-09T13:16:05.003 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.001+0000 7efe0539d700 1 -- start start 2023-10-09T13:16:05.004 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:05.002+0000 7fa14c941180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:05.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efe0539d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b4e70 0x7efe000ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efe0539d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efe000b16d0 0x7efe000b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efe0539d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000b2080 con 0x7efe0015d240 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efe0539d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000cfb00 con 0x7efe000b16d0 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efe0539d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b5c40 con 0x7efe000b4e70 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efdff7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efe000b16d0 0x7efe000b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efdfffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b4e70 0x7efe000ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efdff7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efe000b16d0 0x7efe000b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42430/0 (socket says 172.21.15.86:42430) 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efdff7fe700 1 -- 172.21.15.86:0/3364163369 learned_addr learned my addr 172.21.15.86:0/3364163369 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efe04b9c700 1 --1- 172.21.15.86:0/3364163369 >> v1:172.21.15.86:6789/0 conn(0x7efe0015d240 0x7efe0015d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49310/0 (socket says 172.21.15.86:49310) 2023-10-09T13:16:05.007 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efdfffff700 1 -- 172.21.15.86:0/3364163369 >> v2:172.21.15.86:3300/0 conn(0x7efe000b16d0 msgr2=0x7efe000b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.003+0000 7efdfffff700 1 --2- 172.21.15.86:0/3364163369 >> v2:172.21.15.86:3300/0 conn(0x7efe000b16d0 0x7efe000b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.004+0000 7efdfffff700 1 -- 172.21.15.86:0/3364163369 >> v1:172.21.15.86:6789/0 conn(0x7efe0015d240 legacy=0x7efe0015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.004+0000 7efdfffff700 1 -- 172.21.15.86:0/3364163369 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000b5f20 con 0x7efe000b4e70 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.004+0000 7efdfffff700 1 --2- 172.21.15.86:0/3364163369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b4e70 0x7efe000ccff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efdf00098e0 tx=0x7efdf00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6f5274f9611b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.004+0000 7efdfeffd700 1 -- 172.21.15.86:0/3364163369 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000b640 con 0x7efe000b4e70 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.004+0000 7efdfeffd700 1 -- 172.21.15.86:0/3364163369 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000b7a0 con 0x7efe000b4e70 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.004+0000 7efdfeffd700 1 -- 172.21.15.86:0/3364163369 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000bb40 con 0x7efe000b4e70 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 -- 172.21.15.86:0/3364163369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b4e70 msgr2=0x7efe000ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 --2- 172.21.15.86:0/3364163369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b4e70 0x7efe000ccff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efdf00098e0 tx=0x7efdf00091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.008 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 -- 172.21.15.86:0/3364163369 shutdown_connections 2023-10-09T13:16:05.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 --2- 172.21.15.86:0/3364163369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b4e70 0x7efe000ccff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 --2- 172.21.15.86:0/3364163369 >> v2:172.21.15.86:3300/0 conn(0x7efe000b16d0 0x7efe000b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 -- 172.21.15.86:0/3364163369 >> 172.21.15.86:0/3364163369 conn(0x7efe000d10c0 msgr2=0x7efe000affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:05.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 -- 172.21.15.86:0/3364163369 shutdown_connections 2023-10-09T13:16:05.009 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.005+0000 7efe0539d700 1 -- 172.21.15.86:0/3364163369 wait complete. 2023-10-09T13:16:05.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.006+0000 7efe0539d700 1 Processor -- start 2023-10-09T13:16:05.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.006+0000 7efe0539d700 1 -- start start 2023-10-09T13:16:05.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.007+0000 7efe0539d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b16d0 0x7efe001457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.007+0000 7efe0539d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000b4e70 0x7efe0015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.007+0000 7efe0539d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe0015d240 0x7efe0015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.007+0000 7efe0539d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0016bcd0 con 0x7efe0015d240 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.007+0000 7efe0539d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0016b100 con 0x7efe000b4e70 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.007+0000 7efe0539d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c7810 con 0x7efe000b16d0 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe0015d240 0x7efe0015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe0015d240 0x7efe0015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42442/0 (socket says 172.21.15.86:42442) 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efdff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000b4e70 0x7efe0015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 -- 172.21.15.86:0/34131299 learned_addr learned my addr 172.21.15.86:0/34131299 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efdfffff700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b16d0 0x7efe001457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 -- 172.21.15.86:0/34131299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b16d0 msgr2=0x7efe001457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b16d0 0x7efe001457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 -- 172.21.15.86:0/34131299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000b4e70 msgr2=0x7efe0015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000b4e70 0x7efe0015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 -- 172.21.15.86:0/34131299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0009420 con 0x7efe0015d240 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.008+0000 7efe04b9c700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe0015d240 0x7efe0015f190 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7efdf800cc70 tx=0x7efdf8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.009+0000 7efde7fff700 1 -- 172.21.15.86:0/34131299 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8005df0 con 0x7efe0015d240 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.009+0000 7efde7fff700 1 -- 172.21.15.86:0/34131299 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800a5b0 con 0x7efe0015d240 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.009+0000 7efde7fff700 1 -- 172.21.15.86:0/34131299 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800a930 con 0x7efe0015d240 2023-10-09T13:16:05.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.009+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0016b3a0 con 0x7efe0015d240 2023-10-09T13:16:05.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.009+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0016b960 con 0x7efe0015d240 2023-10-09T13:16:05.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.010+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0016be80 con 0x7efe0015d240 2023-10-09T13:16:05.014 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.011+0000 7efde7fff700 1 -- 172.21.15.86:0/34131299 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7efdf800ace0 con 0x7efe0015d240 2023-10-09T13:16:05.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.012+0000 7efde7fff700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 0x7efdec069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.012+0000 7efde7fff700 1 -- 172.21.15.86:0/34131299 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7efdf8084980 con 0x7efe0015d240 2023-10-09T13:16:05.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.012+0000 7efdfffff700 1 -- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 msgr2=0x7efdec069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:05.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.012+0000 7efdfffff700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 0x7efdec069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:05.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.016+0000 7efde7fff700 1 -- 172.21.15.86:0/34131299 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe0016be80 con 0x7efe0015d240 2023-10-09T13:16:05.070 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:05.069+0000 7f0931ef8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:05.091 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:05.089+0000 7fa14c941180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:16:05.157 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:05.156+0000 7f0931ef8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:16:05.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.213+0000 7efdfffff700 1 -- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 msgr2=0x7efdec069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:05.214 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.213+0000 7efdfffff700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 0x7efdec069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:05.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.214+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe0016be10 con 0x7efe0015d240 2023-10-09T13:16:05.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.215+0000 7efde7fff700 1 -- 172.21.15.86:0/34131299 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v199) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdf80517a0 con 0x7efe0015d240 2023-10-09T13:16:05.216 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T13:16:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 msgr2=0x7efdec069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:05.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 0x7efdec069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe0015d240 msgr2=0x7efe0015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe0015d240 0x7efe0015f190 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7efdf800cc70 tx=0x7efdf8001a70 comp rx=0 tx=0).stop 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 shutdown_connections 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efdec067050 0x7efdec069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe0015d240 0x7efe0015f190 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000b16d0 0x7efe001457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 --2- 172.21.15.86:0/34131299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000b4e70 0x7efe0015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 >> 172.21.15.86:0/34131299 conn(0x7efe000d10c0 msgr2=0x7efe0015c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 shutdown_connections 2023-10-09T13:16:05.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.218+0000 7efe0539d700 1 -- 172.21.15.86:0/34131299 wait complete. 2023-10-09T13:16:05.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T13:16:05.320 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:05.319+0000 7fa14c941180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:05.391 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:05.390+0000 7f0931ef8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:05.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.427+0000 7f92449fe700 1 Processor -- start 2023-10-09T13:16:05.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.427+0000 7f92449fe700 1 -- start start 2023-10-09T13:16:05.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.428+0000 7f92449fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f92400ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.428+0000 7f92449fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92400b16d0 0x7f92400b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.428+0000 7f92449fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f924015d240 0x7f924015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.428+0000 7f92449fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400b2080 con 0x7f924015d240 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f92449fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400cfb00 con 0x7f92400b16d0 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f92449fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b5c40 con 0x7f92400b4e70 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f924015d240 0x7f924015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f924015d240 0x7f924015d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42456/0 (socket says 172.21.15.86:42456) 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 -- 172.21.15.86:0/4280867817 learned_addr learned my addr 172.21.15.86:0/4280867817 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923e59c700 1 --2- 172.21.15.86:0/4280867817 >> v2:172.21.15.135:3300/0 conn(0x7f92400b16d0 0x7f92400b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923ed9d700 1 --2- 172.21.15.86:0/4280867817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f92400ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 -- 172.21.15.86:0/4280867817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 msgr2=0x7f92400ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:05.432 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 --2- 172.21.15.86:0/4280867817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f92400ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 -- 172.21.15.86:0/4280867817 >> v2:172.21.15.135:3300/0 conn(0x7f92400b16d0 msgr2=0x7f92400b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:05.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 --2- 172.21.15.86:0/4280867817 >> v2:172.21.15.135:3300/0 conn(0x7f92400b16d0 0x7f92400b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.429+0000 7f923f59e700 1 -- 172.21.15.86:0/4280867817 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400b5f20 con 0x7f924015d240 2023-10-09T13:16:05.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f923f59e700 1 --2- 172.21.15.86:0/4280867817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f924015d6c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9240089440 tx=0x7f9238009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff190ced8edf5e9a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:05.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f923dd9b700 1 -- 172.21.15.86:0/4280867817 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800e070 con 0x7f924015d240 2023-10-09T13:16:05.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f923dd9b700 1 -- 172.21.15.86:0/4280867817 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800b970 con 0x7f924015d240 2023-10-09T13:16:05.433 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f923dd9b700 1 -- 172.21.15.86:0/4280867817 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380092e0 con 0x7f924015d240 2023-10-09T13:16:05.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f92449fe700 1 -- 172.21.15.86:0/4280867817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 msgr2=0x7f924015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f92449fe700 1 --2- 172.21.15.86:0/4280867817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f924015d6c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9240089440 tx=0x7f9238009840 comp rx=0 tx=0).stop 2023-10-09T13:16:05.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f92449fe700 1 -- 172.21.15.86:0/4280867817 shutdown_connections 2023-10-09T13:16:05.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f92449fe700 1 --2- 172.21.15.86:0/4280867817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f924015d6c0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f92449fe700 1 --2- 172.21.15.86:0/4280867817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f92400ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f92449fe700 1 --2- 172.21.15.86:0/4280867817 >> v2:172.21.15.135:3300/0 conn(0x7f92400b16d0 0x7f92400b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.430+0000 7f92449fe700 1 -- 172.21.15.86:0/4280867817 >> 172.21.15.86:0/4280867817 conn(0x7f92400d10c0 msgr2=0x7f92400affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.431+0000 7f92449fe700 1 -- 172.21.15.86:0/4280867817 shutdown_connections 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.431+0000 7f92449fe700 1 -- 172.21.15.86:0/4280867817 wait complete. 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.432+0000 7f92449fe700 1 Processor -- start 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.433+0000 7f92449fe700 1 -- start start 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.433+0000 7f92449fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92400b16d0 0x7f92400cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.433+0000 7f92449fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f9240169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.433+0000 7f92449fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f9240158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.433+0000 7f92449fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400c8dd0 con 0x7f924015d240 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.433+0000 7f92449fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400c90b0 con 0x7f92400b16d0 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.433+0000 7f92449fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924016a120 con 0x7f92400b4e70 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f9240158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f9240158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42472/0 (socket says 172.21.15.86:42472) 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 -- 172.21.15.86:0/4276610336 learned_addr learned my addr 172.21.15.86:0/4276610336 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923ed9d700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92400b16d0 0x7f92400cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923e59c700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f9240169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 -- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 msgr2=0x7f9240169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.438 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f9240169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 -- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92400b16d0 msgr2=0x7f92400cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92400b16d0 0x7f92400cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 -- 172.21.15.86:0/4276610336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238009ae0 con 0x7f924015d240 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923e59c700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f9240169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923ed9d700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92400b16d0 0x7f92400cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.434+0000 7f923f59e700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f9240158190 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f9240070dd0 tx=0x7f9238018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.435+0000 7f9226ffd700 1 -- 172.21.15.86:0/4276610336 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238008b80 con 0x7f924015d240 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.435+0000 7f9226ffd700 1 -- 172.21.15.86:0/4276610336 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238008ce0 con 0x7f924015d240 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.435+0000 7f9226ffd700 1 -- 172.21.15.86:0/4276610336 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380256b0 con 0x7f924015d240 2023-10-09T13:16:05.439 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.435+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924016a3c0 con 0x7f924015d240 2023-10-09T13:16:05.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.435+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924016a980 con 0x7f924015d240 2023-10-09T13:16:05.440 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.436+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92400c9260 con 0x7f924015d240 2023-10-09T13:16:05.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.437+0000 7f9226ffd700 1 -- 172.21.15.86:0/4276610336 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f9238003040 con 0x7f924015d240 2023-10-09T13:16:05.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.438+0000 7f9226ffd700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 0x7f922c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.439+0000 7f9226ffd700 1 -- 172.21.15.86:0/4276610336 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f9238086680 con 0x7f924015d240 2023-10-09T13:16:05.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.439+0000 7f923ed9d700 1 -- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 msgr2=0x7f922c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:05.441 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.439+0000 7f923ed9d700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 0x7f922c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:05.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.443+0000 7f9226ffd700 1 -- 172.21.15.86:0/4276610336 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92400c9260 con 0x7f924015d240 2023-10-09T13:16:05.500 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:05.499+0000 7fa14c941180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:16:05.578 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:05.576+0000 7f0931ef8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:16:05.594 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:05.593+0000 7fa14c941180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:16:05.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.640+0000 7f923ed9d700 1 -- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 msgr2=0x7f922c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:05.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.640+0000 7f923ed9d700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 0x7f922c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:05.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.642+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92400c9220 con 0x7f924015d240 2023-10-09T13:16:05.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.643+0000 7f9226ffd700 1 -- 172.21.15.86:0/4276610336 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v199) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92380533c0 con 0x7f924015d240 2023-10-09T13:16:05.644 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T13:16:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 msgr2=0x7f922c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 0x7f922c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 msgr2=0x7f9240158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f9240158190 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f9240070dd0 tx=0x7f9238018000 comp rx=0 tx=0).stop 2023-10-09T13:16:05.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 shutdown_connections 2023-10-09T13:16:05.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f922c067050 0x7f922c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f924015d240 0x7f9240158190 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92400b16d0 0x7f92400cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 --2- 172.21.15.86:0/4276610336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92400b4e70 0x7f9240169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 >> 172.21.15.86:0/4276610336 conn(0x7f92400d10c0 msgr2=0x7f92400698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:05.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 shutdown_connections 2023-10-09T13:16:05.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.646+0000 7f92449fe700 1 -- 172.21.15.86:0/4276610336 wait complete. 2023-10-09T13:16:05.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T13:16:05.681 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:05.680+0000 7f0931ef8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:16:05.757 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:05.755+0000 7fa14c941180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:16:05.850 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:05.849+0000 7f0931ef8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:16:05.857 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:05.856+0000 7fa14c941180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:05.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.861+0000 7f1db9f9d700 1 Processor -- start 2023-10-09T13:16:05.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.862+0000 7f1db9f9d700 1 -- start start 2023-10-09T13:16:05.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db9f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b4e70 0x7f1db40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db9f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1db40b1b40 0x7f1db415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db9f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40cfb00 con 0x7f1db40b16d0 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db9f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db40b5c40 con 0x7f1db40b1b40 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db9f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40b5f20 con 0x7f1db40b4e70 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db979c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1db40b1b40 0x7f1db415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db979c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1db40b1b40 0x7f1db415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42476/0 (socket says 172.21.15.86:42476) 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db979c700 1 -- 172.21.15.86:0/3701722124 learned_addr learned my addr 172.21.15.86:0/3701722124 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.863+0000 7f1db8f9b700 1 --2- 172.21.15.86:0/3701722124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b4e70 0x7f1db40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db979c700 1 -- 172.21.15.86:0/3701722124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b4e70 msgr2=0x7f1db40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db979c700 1 --2- 172.21.15.86:0/3701722124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b4e70 0x7f1db40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db979c700 1 -- 172.21.15.86:0/3701722124 >> v1:172.21.15.135:6789/0 conn(0x7f1db40b16d0 legacy=0x7f1db415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db979c700 1 -- 172.21.15.86:0/3701722124 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40b6200 con 0x7f1db40b1b40 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db8f9b700 1 --2- 172.21.15.86:0/3701722124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b4e70 0x7f1db40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db979c700 1 --2- 172.21.15.86:0/3701722124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b1b40 0x7f1db415d950 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009f20 tx=0x7f1dac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e70331036919bbd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db37fe700 1 -- 172.21.15.86:0/3701722124 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00e070 con 0x7f1db40b1b40 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db37fe700 1 -- 172.21.15.86:0/3701722124 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00ba80 con 0x7f1db40b1b40 2023-10-09T13:16:05.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.864+0000 7f1db37fe700 1 -- 172.21.15.86:0/3701722124 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0092e0 con 0x7f1db40b1b40 2023-10-09T13:16:05.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 -- 172.21.15.86:0/3701722124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b1b40 msgr2=0x7f1db415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/3701722124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b1b40 0x7f1db415d950 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009f20 tx=0x7f1dac009840 comp rx=0 tx=0).stop 2023-10-09T13:16:05.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 -- 172.21.15.86:0/3701722124 shutdown_connections 2023-10-09T13:16:05.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/3701722124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b1b40 0x7f1db415d950 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/3701722124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b4e70 0x7f1db40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 -- 172.21.15.86:0/3701722124 >> 172.21.15.86:0/3701722124 conn(0x7f1db40d10c0 msgr2=0x7f1db40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 -- 172.21.15.86:0/3701722124 shutdown_connections 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.865+0000 7f1db9f9d700 1 -- 172.21.15.86:0/3701722124 wait complete. 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.866+0000 7f1db9f9d700 1 Processor -- start 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.867+0000 7f1db9f9d700 1 -- start start 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.867+0000 7f1db9f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b16d0 0x7f1db40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.867+0000 7f1db9f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b1b40 0x7f1db416ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.867+0000 7f1db9f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1db40b4e70 0x7f1db41459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.867+0000 7f1db9f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c9d10 con 0x7f1db40b16d0 2023-10-09T13:16:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.867+0000 7f1db9f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db416d350 con 0x7f1db40b4e70 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.867+0000 7f1db9f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4145f20 con 0x7f1db40b1b40 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b16d0 0x7f1db40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b16d0 0x7f1db40cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42486/0 (socket says 172.21.15.86:42486) 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 -- 172.21.15.86:0/2440959114 learned_addr learned my addr 172.21.15.86:0/2440959114 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db979c700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1db40b4e70 0x7f1db41459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db3fff700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b1b40 0x7f1db416ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 -- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b1b40 msgr2=0x7f1db416ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b1b40 0x7f1db416ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 -- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1db40b4e70 msgr2=0x7f1db41459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1db40b4e70 0x7f1db41459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 -- 172.21.15.86:0/2440959114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac009ae0 con 0x7f1db40b16d0 2023-10-09T13:16:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.868+0000 7f1db8f9b700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b16d0 0x7f1db40cbea0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f1da800e8d0 tx=0x7f1da8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.869+0000 7f1db0ff9700 1 -- 172.21.15.86:0/2440959114 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8013410 con 0x7f1db40b16d0 2023-10-09T13:16:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.869+0000 7f1db0ff9700 1 -- 172.21.15.86:0/2440959114 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da8013570 con 0x7f1db40b16d0 2023-10-09T13:16:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.869+0000 7f1db0ff9700 1 -- 172.21.15.86:0/2440959114 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8013910 con 0x7f1db40b16d0 2023-10-09T13:16:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.869+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db416d560 con 0x7f1db40b16d0 2023-10-09T13:16:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.869+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db416db20 con 0x7f1db40b16d0 2023-10-09T13:16:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.870+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db40c79a0 con 0x7f1db40b16d0 2023-10-09T13:16:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.871+0000 7f1db0ff9700 1 -- 172.21.15.86:0/2440959114 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f1da8013d00 con 0x7f1db40b16d0 2023-10-09T13:16:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.872+0000 7f1db0ff9700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 0x7f1d98069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.872+0000 7f1db0ff9700 1 -- 172.21.15.86:0/2440959114 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f1da80848f0 con 0x7f1db40b16d0 2023-10-09T13:16:05.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.872+0000 7f1db3fff700 1 -- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 msgr2=0x7f1d98069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:05.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.872+0000 7f1db3fff700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 0x7f1d98069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:05.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:05.877+0000 7f1db0ff9700 1 -- 172.21.15.86:0/2440959114 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1da8051580 con 0x7f1db40b16d0 2023-10-09T13:16:05.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:16:05.957 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:05.955+0000 7f0931ef8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:05.961 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:16:06.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.074+0000 7f1db3fff700 1 -- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 msgr2=0x7f1d98069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:06.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.074+0000 7f1db3fff700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 0x7f1d98069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:06.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.078+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1db404bb80 con 0x7f1db40b16d0 2023-10-09T13:16:06.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.078+0000 7f1db0ff9700 1 -- 172.21.15.86:0/2440959114 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v199) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1da8054ba0 con 0x7f1db40b16d0 2023-10-09T13:16:06.080 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 msgr2=0x7f1d98069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 0x7f1d98069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b16d0 msgr2=0x7f1db40cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b16d0 0x7f1db40cbea0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f1da800e8d0 tx=0x7f1da8008040 comp rx=0 tx=0).stop 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 shutdown_connections 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1d98067050 0x7f1d98069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1db40b16d0 0x7f1db40cbea0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1db40b4e70 0x7f1db41459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 --2- 172.21.15.86:0/2440959114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1db40b1b40 0x7f1db416ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 >> 172.21.15.86:0/2440959114 conn(0x7f1db40d10c0 msgr2=0x7f1db4159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:06.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 shutdown_connections 2023-10-09T13:16:06.084 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.081+0000 7f1db9f9d700 1 -- 172.21.15.86:0/2440959114 wait complete. 2023-10-09T13:16:06.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:06.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.287+0000 7f3e42d9d700 1 Processor -- start 2023-10-09T13:16:06.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.287+0000 7f3e42d9d700 1 -- start start 2023-10-09T13:16:06.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.288+0000 7f3e42d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e3c156310 0x7f3e3c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.288+0000 7f3e42d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e3c1566e0 0x7f3e3c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.288+0000 7f3e42d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0ca860 con 0x7f3e3c0ca300 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.288+0000 7f3e42d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0cab40 con 0x7f3e3c1566e0 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.288+0000 7f3e42d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0cae20 con 0x7f3e3c156310 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4159a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e3c1566e0 0x7f3e3c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4159a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e3c1566e0 0x7f3e3c0ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42498/0 (socket says 172.21.15.86:42498) 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3e3c0ca300 0x7f3e3c0c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49312/0 (socket says 172.21.15.86:49312) 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4159a700 1 -- 172.21.15.86:0/142519488 learned_addr learned my addr 172.21.15.86:0/142519488 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e41d9b700 1 --2- 172.21.15.86:0/142519488 >> v2:172.21.15.135:3300/0 conn(0x7f3e3c156310 0x7f3e3c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4159a700 1 -- 172.21.15.86:0/142519488 >> v2:172.21.15.135:3300/0 conn(0x7f3e3c156310 msgr2=0x7f3e3c0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4159a700 1 --2- 172.21.15.86:0/142519488 >> v2:172.21.15.135:3300/0 conn(0x7f3e3c156310 0x7f3e3c0c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4159a700 1 -- 172.21.15.86:0/142519488 >> v1:172.21.15.86:6789/0 conn(0x7f3e3c0ca300 legacy=0x7f3e3c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e4159a700 1 -- 172.21.15.86:0/142519488 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0cb100 con 0x7f3e3c1566e0 2023-10-09T13:16:06.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.289+0000 7f3e40d99700 1 -- 172.21.15.86:0/142519488 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116787944 0 0) 0x7f3e3c0ca860 con 0x7f3e3c0ca300 2023-10-09T13:16:06.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.290+0000 7f3e4159a700 1 --2- 172.21.15.86:0/142519488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0ae000 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0cce20 tx=0x7f3e2c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b87c90f71247177 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:06.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.290+0000 7f3e40d99700 1 -- 172.21.15.86:0/142519488 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00dba0 con 0x7f3e3c1566e0 2023-10-09T13:16:06.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.290+0000 7f3e40d99700 1 -- 172.21.15.86:0/142519488 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c00dd00 con 0x7f3e3c1566e0 2023-10-09T13:16:06.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.290+0000 7f3e40d99700 1 -- 172.21.15.86:0/142519488 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0196d0 con 0x7f3e3c1566e0 2023-10-09T13:16:06.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.290+0000 7f3e42d9d700 1 -- 172.21.15.86:0/142519488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 msgr2=0x7f3e3c0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.290+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/142519488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0ae000 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0cce20 tx=0x7f3e2c00b4f0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.290+0000 7f3e42d9d700 1 -- 172.21.15.86:0/142519488 shutdown_connections 2023-10-09T13:16:06.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.291+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/142519488 >> v2:172.21.15.135:3300/0 conn(0x7f3e3c156310 0x7f3e3c0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.291+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/142519488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0ae000 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.291+0000 7f3e42d9d700 1 -- 172.21.15.86:0/142519488 >> 172.21.15.86:0/142519488 conn(0x7f3e3c0cc1f0 msgr2=0x7f3e3c0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.291+0000 7f3e42d9d700 1 -- 172.21.15.86:0/142519488 shutdown_connections 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.291+0000 7f3e42d9d700 1 -- 172.21.15.86:0/142519488 wait complete. 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.292+0000 7f3e42d9d700 1 Processor -- start 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.292+0000 7f3e42d9d700 1 -- start start 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e42d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e3c0ca300 0x7f3e3c0b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e42d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e3c156310 0x7f3e3c0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e42d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e42d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c148630 con 0x7f3e3c1566e0 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e42d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b1e60 con 0x7f3e3c156310 2023-10-09T13:16:06.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e42d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c16a350 con 0x7f3e3c0ca300 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e4259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e4259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42508/0 (socket says 172.21.15.86:42508) 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e4259c700 1 -- 172.21.15.86:0/248419287 learned_addr learned my addr 172.21.15.86:0/248419287 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e4159a700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e3c156310 0x7f3e3c0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.293+0000 7f3e41d9b700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e3c0ca300 0x7f3e3c0b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e4259c700 1 -- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e3c0ca300 msgr2=0x7f3e3c0b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e4259c700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e3c0ca300 0x7f3e3c0b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e4259c700 1 -- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e3c156310 msgr2=0x7f3e3c0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e4259c700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e3c156310 0x7f3e3c0afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e4259c700 1 -- 172.21.15.86:0/248419287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c00b790 con 0x7f3e3c1566e0 2023-10-09T13:16:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e4259c700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0c76b0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400cd80 tx=0x7f3e34001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e31ffb700 1 -- 172.21.15.86:0/248419287 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34005df0 con 0x7f3e3c1566e0 2023-10-09T13:16:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e31ffb700 1 -- 172.21.15.86:0/248419287 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400a870 con 0x7f3e3c1566e0 2023-10-09T13:16:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e31ffb700 1 -- 172.21.15.86:0/248419287 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400ac30 con 0x7f3e3c1566e0 2023-10-09T13:16:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.294+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c0b0090 con 0x7f3e3c1566e0 2023-10-09T13:16:06.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.295+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c0b1b80 con 0x7f3e3c1566e0 2023-10-09T13:16:06.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.296+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c16a4e0 con 0x7f3e3c1566e0 2023-10-09T13:16:06.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.297+0000 7f3e31ffb700 1 -- 172.21.15.86:0/248419287 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f3e340070f0 con 0x7f3e3c1566e0 2023-10-09T13:16:06.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.298+0000 7f3e31ffb700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 0x7f3e20069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.298+0000 7f3e31ffb700 1 -- 172.21.15.86:0/248419287 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f3e34084b10 con 0x7f3e3c1566e0 2023-10-09T13:16:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.298+0000 7f3e41d9b700 1 -- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 msgr2=0x7f3e20069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:06.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.298+0000 7f3e41d9b700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 0x7f3e20069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:06.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.302+0000 7f3e31ffb700 1 -- 172.21.15.86:0/248419287 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e34051930 con 0x7f3e3c1566e0 2023-10-09T13:16:06.350 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:06.349+0000 7fa14c941180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:16:06.444 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:06.442+0000 7fa14c941180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:16:06.461 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:06.460+0000 7f0931ef8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:16:06.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.499+0000 7f3e41d9b700 1 -- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 msgr2=0x7f3e20069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:06.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.499+0000 7f3e41d9b700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 0x7f3e20069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:06.533 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:06.532+0000 7fa14c941180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:16:06.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.548+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e3c04c3c0 con 0x7f3e3c1566e0 2023-10-09T13:16:06.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.548+0000 7f3e31ffb700 1 -- 172.21.15.86:0/248419287 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f3e34054f50 con 0x7f3e3c1566e0 2023-10-09T13:16:06.550 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:06.550 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/768026503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":768026503},{"type":"v1","addr":"172.21.15.86:6834","nonce":768026503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3188349803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3188349803},{"type":"v1","addr":"172.21.15.135:6835","nonce":3188349803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9666,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2491463129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2491463129},{"type":"v1","addr":"172.21.15.86:6835","nonce":2491463129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:13:38.499330+0000","modified":"2023-10-09T13:13:42.436468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9672},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9672":{"gid":9672,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3006026738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3006026738},{"type":"v1","addr":"172.21.15.135:6834","nonce":3006026738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T13:16:06.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 msgr2=0x7f3e20069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 0x7f3e20069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 msgr2=0x7f3e3c0c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0c76b0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400cd80 tx=0x7f3e34001b10 comp rx=0 tx=0).stop 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 shutdown_connections 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3e20067050 0x7f3e20069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e3c1566e0 0x7f3e3c0c76b0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e3c0ca300 0x7f3e3c0b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 --2- 172.21.15.86:0/248419287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e3c156310 0x7f3e3c0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 >> 172.21.15.86:0/248419287 conn(0x7f3e3c0cc1f0 msgr2=0x7f3e3c06ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:06.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 shutdown_connections 2023-10-09T13:16:06.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.551+0000 7f3e42d9d700 1 -- 172.21.15.86:0/248419287 wait complete. 2023-10-09T13:16:06.554 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 86 2023-10-09T13:16:06.559 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:06.558+0000 7f0931ef8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:16:06.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:06.655 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:06.654+0000 7f0931ef8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:16:06.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.756+0000 7fa9f4f9d700 1 Processor -- start 2023-10-09T13:16:06.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.757+0000 7fa9f4f9d700 1 -- start start 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9f4f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa9f0142ea0 0x7fa9f00b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9f4f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9f4f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f00b40f0 con 0x7fa9f00ad870 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9f4f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f0069640 con 0x7fa9f0142ea0 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9f4f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0069920 con 0x7fa9f006c0f0 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9eeffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa9f00ad870 0x7fa9f006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49322/0 (socket says 172.21.15.86:49322) 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9eeffd700 1 -- 172.21.15.86:0/3555505618 learned_addr learned my addr 172.21.15.86:0/3555505618 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:06.760 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9effff700 1 --2- 172.21.15.86:0/3555505618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.758+0000 7fa9ef7fe700 1 --2- 172.21.15.86:0/3555505618 >> v2:172.21.15.135:3300/0 conn(0x7fa9f0142ea0 0x7fa9f00b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9ee7fc700 1 -- 172.21.15.86:0/3555505618 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257139897 0 0) 0x7fa9f00b40f0 con 0x7fa9f00ad870 2023-10-09T13:16:06.761 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9ee7fc700 1 -- 172.21.15.86:0/3555505618 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d8003570 con 0x7fa9f00ad870 2023-10-09T13:16:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9effff700 1 -- 172.21.15.86:0/3555505618 >> v2:172.21.15.135:3300/0 conn(0x7fa9f0142ea0 msgr2=0x7fa9f00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9effff700 1 --2- 172.21.15.86:0/3555505618 >> v2:172.21.15.135:3300/0 conn(0x7fa9f0142ea0 0x7fa9f00b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9effff700 1 -- 172.21.15.86:0/3555505618 >> v1:172.21.15.86:6789/0 conn(0x7fa9f00ad870 legacy=0x7fa9f006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9effff700 1 -- 172.21.15.86:0/3555505618 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0069c00 con 0x7fa9f006c0f0 2023-10-09T13:16:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9ef7fe700 1 --2- 172.21.15.86:0/3555505618 >> v2:172.21.15.135:3300/0 conn(0x7fa9f0142ea0 0x7fa9f00b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:06.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.759+0000 7fa9effff700 1 --2- 172.21.15.86:0/3555505618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f006a120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009e60 tx=0x7fa9e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843fba8d56e466f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9ee7fc700 1 -- 172.21.15.86:0/3555505618 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e800e070 con 0x7fa9f006c0f0 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9ee7fc700 1 -- 172.21.15.86:0/3555505618 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e800bab0 con 0x7fa9f006c0f0 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9ee7fc700 1 -- 172.21.15.86:0/3555505618 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e800be70 con 0x7fa9f006c0f0 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3555505618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 msgr2=0x7fa9f006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3555505618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f006a120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009e60 tx=0x7fa9e8009780 comp rx=0 tx=0).stop 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3555505618 shutdown_connections 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3555505618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f006a120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3555505618 >> v2:172.21.15.135:3300/0 conn(0x7fa9f0142ea0 0x7fa9f00b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3555505618 >> 172.21.15.86:0/3555505618 conn(0x7fa9f00ce430 msgr2=0x7fa9f00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3555505618 shutdown_connections 2023-10-09T13:16:06.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.760+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3555505618 wait complete. 2023-10-09T13:16:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.762+0000 7fa9f4f9d700 1 Processor -- start 2023-10-09T13:16:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.762+0000 7fa9f4f9d700 1 -- start start 2023-10-09T13:16:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9f4f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f015d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9f4f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f0142ea0 0x7fa9f015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9f4f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f016aad0 0x7fa9f00aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9f4f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015c5c0 con 0x7fa9f016aad0 2023-10-09T13:16:06.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9f4f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015c8a0 con 0x7fa9f0142ea0 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9f4f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015cb80 con 0x7fa9f006c0f0 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9effff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f016aad0 0x7fa9f00aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9ef7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f015d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35564/0 (socket says 172.21.15.86:35564) 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9eeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f0142ea0 0x7fa9f015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.763+0000 7fa9ef7fe700 1 -- 172.21.15.86:0/3840398193 learned_addr learned my addr 172.21.15.86:0/3840398193 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9eeffd700 1 -- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 msgr2=0x7fa9f015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9eeffd700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f015d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9eeffd700 1 -- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f016aad0 msgr2=0x7fa9f00aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9eeffd700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f016aad0 0x7fa9f00aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9eeffd700 1 -- 172.21.15.86:0/3840398193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009420 con 0x7fa9f0142ea0 2023-10-09T13:16:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9ef7fe700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9eeffd700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f0142ea0 0x7fa9f015a470 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00b12a0 tx=0x7fa9e4007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9d77fe700 1 -- 172.21.15.86:0/3840398193 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4005b30 con 0x7fa9f0142ea0 2023-10-09T13:16:06.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9d77fe700 1 -- 172.21.15.86:0/3840398193 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e4005cb0 con 0x7fa9f0142ea0 2023-10-09T13:16:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9d77fe700 1 -- 172.21.15.86:0/3840398193 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4007320 con 0x7fa9f0142ea0 2023-10-09T13:16:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e8009a20 con 0x7fa9f0142ea0 2023-10-09T13:16:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.764+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f015d140 con 0x7fa9f0142ea0 2023-10-09T13:16:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.766+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f015d2d0 con 0x7fa9f0142ea0 2023-10-09T13:16:06.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.766+0000 7fa9d77fe700 1 -- 172.21.15.86:0/3840398193 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa9e401b3b0 con 0x7fa9f0142ea0 2023-10-09T13:16:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.767+0000 7fa9d77fe700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 0x7fa9dc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.767+0000 7fa9ef7fe700 1 -- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 msgr2=0x7fa9dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.767+0000 7fa9d77fe700 1 -- 172.21.15.86:0/3840398193 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fa9e4083e50 con 0x7fa9f0142ea0 2023-10-09T13:16:06.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.767+0000 7fa9ef7fe700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 0x7fa9dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:06.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.771+0000 7fa9d77fe700 1 -- 172.21.15.86:0/3840398193 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9e4050bf0 con 0x7fa9f0142ea0 2023-10-09T13:16:06.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.968+0000 7fa9ef7fe700 1 -- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 msgr2=0x7fa9dc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:06.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.968+0000 7fa9ef7fe700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 0x7fa9dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:06.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.994+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9f015c9e0 con 0x7fa9f0142ea0 2023-10-09T13:16:06.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.995+0000 7fa9d77fe700 1 -- 172.21.15.86:0/3840398193 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16649 (secure 0 0 0) 0x7fa9f015c9e0 con 0x7fa9f0142ea0 2023-10-09T13:16:06.996 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:06.997 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":199,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:04.529284+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:13:36.634243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T13:13:37.482960+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":199,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/133360":"2023-10-10T13:13:59.600731+0000","172.21.15.86:6836/133360":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/2064280795":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3008613817":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3036672640":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3101391875":"2023-10-10T13:13:59.600731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 msgr2=0x7fa9dc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 0x7fa9dc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f0142ea0 msgr2=0x7fa9f015a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f0142ea0 0x7fa9f015a470 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00b12a0 tx=0x7fa9e4007d50 comp rx=0 tx=0).stop 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 shutdown_connections 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa9dc067050 0x7fa9dc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f016aad0 0x7fa9f00aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:06.999 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa9f006c0f0 0x7fa9f015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 --2- 172.21.15.86:0/3840398193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9f0142ea0 0x7fa9f015a470 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 >> 172.21.15.86:0/3840398193 conn(0x7fa9f00ce430 msgr2=0x7fa9f00cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:07.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 shutdown_connections 2023-10-09T13:16:07.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:06.997+0000 7fa9f4f9d700 1 -- 172.21.15.86:0/3840398193 wait complete. 2023-10-09T13:16:07.017 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T13:16:07.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:07.157 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:07.156+0000 7fa14c941180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:16:07.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.216+0000 7fdf1359e700 1 Processor -- start 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.216+0000 7fdf1359e700 1 -- start start 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.218+0000 7fdf1359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf1415de70 0x7fdf1406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.218+0000 7fdf1359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1406e8c0 con 0x7fdf1415daa0 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.218+0000 7fdf1359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf140ca740 con 0x7fdf140696c0 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.218+0000 7fdf1359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1406e5e0 con 0x7fdf1415de70 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.219+0000 7fdf12d9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fdf140696c0 0x7fdf1406ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:57402/0 (socket says 172.21.15.86:57402) 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.219+0000 7fdf12d9d700 1 -- 172.21.15.86:0/1717911257 learned_addr learned my addr 172.21.15.86:0/1717911257 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.219+0000 7fdf11d9b700 1 --2- 172.21.15.86:0/1717911257 >> v2:172.21.15.86:3300/0 conn(0x7fdf1415de70 0x7fdf1406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.219+0000 7fdf1159a700 1 -- 172.21.15.86:0/1717911257 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990691842 0 0) 0x7fdf140ca740 con 0x7fdf140696c0 2023-10-09T13:16:07.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.219+0000 7fdf1159a700 1 -- 172.21.15.86:0/1717911257 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf00003570 con 0x7fdf140696c0 2023-10-09T13:16:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.220+0000 7fdf11d9b700 1 -- 172.21.15.86:0/1717911257 >> v1:172.21.15.135:6789/0 conn(0x7fdf140696c0 legacy=0x7fdf1406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.220+0000 7fdf11d9b700 1 -- 172.21.15.86:0/1717911257 >> v1:172.21.15.86:6789/0 conn(0x7fdf1415daa0 legacy=0x7fdf140c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.220+0000 7fdf11d9b700 1 -- 172.21.15.86:0/1717911257 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140ca0f0 con 0x7fdf1415de70 2023-10-09T13:16:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.220+0000 7fdf11d9b700 1 --2- 172.21.15.86:0/1717911257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf1415de70 0x7fdf1406e000 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009e60 tx=0x7fdf04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bb08ae2b8337c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.221+0000 7fdf1159a700 1 -- 172.21.15.86:0/1717911257 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400e070 con 0x7fdf1415de70 2023-10-09T13:16:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.221+0000 7fdf1159a700 1 -- 172.21.15.86:0/1717911257 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0400bb60 con 0x7fdf1415de70 2023-10-09T13:16:07.223 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.221+0000 7fdf1159a700 1 -- 172.21.15.86:0/1717911257 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04012430 con 0x7fdf1415de70 2023-10-09T13:16:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.222+0000 7fdf1359e700 1 -- 172.21.15.86:0/1717911257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf1415de70 msgr2=0x7fdf1406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.222+0000 7fdf1359e700 1 --2- 172.21.15.86:0/1717911257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf1415de70 0x7fdf1406e000 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009e60 tx=0x7fdf04009780 comp rx=0 tx=0).stop 2023-10-09T13:16:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.222+0000 7fdf1359e700 1 -- 172.21.15.86:0/1717911257 shutdown_connections 2023-10-09T13:16:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.222+0000 7fdf1359e700 1 --2- 172.21.15.86:0/1717911257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf1415de70 0x7fdf1406e000 secure :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009e60 tx=0x7fdf04009780 comp rx=0 tx=0).stop 2023-10-09T13:16:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.222+0000 7fdf1359e700 1 -- 172.21.15.86:0/1717911257 >> 172.21.15.86:0/1717911257 conn(0x7fdf140cc1f0 msgr2=0x7fdf140cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:07.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.222+0000 7fdf1359e700 1 -- 172.21.15.86:0/1717911257 shutdown_connections 2023-10-09T13:16:07.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.223+0000 7fdf1359e700 1 -- 172.21.15.86:0/1717911257 wait complete. 2023-10-09T13:16:07.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.225+0000 7fdf1359e700 1 Processor -- start 2023-10-09T13:16:07.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.225+0000 7fdf1359e700 1 -- start start 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.226+0000 7fdf1359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf140696c0 0x7fdf140c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.226+0000 7fdf1359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1415daa0 0x7fdf14136300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.226+0000 7fdf1359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf140b1350 0x7fdf140b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf1359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14136840 con 0x7fdf140696c0 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf1359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140b1d10 con 0x7fdf140b1350 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf1359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14136a30 con 0x7fdf1415daa0 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf12d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf140b1350 0x7fdf140b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf1259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf140696c0 0x7fdf140c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf12d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf140b1350 0x7fdf140b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:39494/0 (socket says 172.21.15.86:39494) 2023-10-09T13:16:07.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf12d9d700 1 -- 172.21.15.86:0/578714682 learned_addr learned my addr 172.21.15.86:0/578714682 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.227+0000 7fdf11d9b700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1415daa0 0x7fdf14136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf12d9d700 1 -- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1415daa0 msgr2=0x7fdf14136300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf12d9d700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1415daa0 0x7fdf14136300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf12d9d700 1 -- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf140696c0 msgr2=0x7fdf140c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf12d9d700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf140696c0 0x7fdf140c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf12d9d700 1 -- 172.21.15.86:0/578714682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009a20 con 0x7fdf140b1350 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf1259c700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf140696c0 0x7fdf140c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf12d9d700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf140b1350 0x7fdf140b17d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0010e0 tx=0x7fdefc007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.228+0000 7fdf0a7fc700 1 -- 172.21.15.86:0/578714682 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc005c00 con 0x7fdf140b1350 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.229+0000 7fdf0a7fc700 1 -- 172.21.15.86:0/578714682 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc005d60 con 0x7fdf140b1350 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.229+0000 7fdf0a7fc700 1 -- 172.21.15.86:0/578714682 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0072e0 con 0x7fdf140b1350 2023-10-09T13:16:07.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.229+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf14136d10 con 0x7fdf140b1350 2023-10-09T13:16:07.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.230+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf141372d0 con 0x7fdf140b1350 2023-10-09T13:16:07.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.231+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1404c3c0 con 0x7fdf140b1350 2023-10-09T13:16:07.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.232+0000 7fdf0a7fc700 1 -- 172.21.15.86:0/578714682 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fdefc007690 con 0x7fdf140b1350 2023-10-09T13:16:07.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.234+0000 7fdf0a7fc700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 0x7fdef4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.234+0000 7fdf0a7fc700 1 -- 172.21.15.86:0/578714682 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fdefc083d90 con 0x7fdf140b1350 2023-10-09T13:16:07.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.234+0000 7fdf1259c700 1 -- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 msgr2=0x7fdef4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:07.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.234+0000 7fdf1259c700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 0x7fdef4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:07.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.237+0000 7fdf0a7fc700 1 -- 172.21.15.86:0/578714682 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdefc04b5a0 con 0x7fdf140b1350 2023-10-09T13:16:07.322 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:07.321+0000 7f0931ef8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:16:07.330 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:07.329+0000 7fa14c941180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:07.427 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:07.425+0000 7fa14c941180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:16:07.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.435+0000 7fdf1259c700 1 -- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 msgr2=0x7fdef4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:07.436 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.435+0000 7fdf1259c700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 0x7fdef4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:07.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.490+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf140ca3d0 con 0x7fdf140b1350 2023-10-09T13:16:07.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.491+0000 7fdf0a7fc700 1 -- 172.21.15.86:0/578714682 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fdefc017070 con 0x7fdf140b1350 2023-10-09T13:16:07.492 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:07.492 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/768026503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":768026503},{"type":"v1","addr":"172.21.15.86:6834","nonce":768026503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3188349803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3188349803},{"type":"v1","addr":"172.21.15.135:6835","nonce":3188349803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9666,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2491463129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2491463129},{"type":"v1","addr":"172.21.15.86:6835","nonce":2491463129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:13:38.499330+0000","modified":"2023-10-09T13:13:42.436468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9672},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9672":{"gid":9672,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3006026738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3006026738},{"type":"v1","addr":"172.21.15.135:6834","nonce":3006026738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T13:16:07.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 msgr2=0x7fdef4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:07.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 0x7fdef4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf140b1350 msgr2=0x7fdf140b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf140b1350 0x7fdf140b17d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0010e0 tx=0x7fdefc007dd0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 shutdown_connections 2023-10-09T13:16:07.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fdef4067050 0x7fdef4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf140696c0 0x7fdf140c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf140b1350 0x7fdf140b17d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 --2- 172.21.15.86:0/578714682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1415daa0 0x7fdf14136300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.493+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 >> 172.21.15.86:0/578714682 conn(0x7fdf140cc1f0 msgr2=0x7fdf140cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.494+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 shutdown_connections 2023-10-09T13:16:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.494+0000 7fdf1359e700 1 -- 172.21.15.86:0/578714682 wait complete. 2023-10-09T13:16:07.496 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 86 2023-10-09T13:16:07.500 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:07.499+0000 7f0931ef8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:07.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:07.605 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:07.604+0000 7f0931ef8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:16:07.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.701+0000 7fb31719d700 1 Processor -- start 2023-10-09T13:16:07.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.701+0000 7fb31719d700 1 -- start start 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.702+0000 7fb31719d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3101566e0 0x7fb3100ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.702+0000 7fb31719d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3100cb900 0x7fb3100ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.702+0000 7fb31719d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100ca860 con 0x7fb310156310 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.702+0000 7fb31719d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3100cab40 con 0x7fb3101566e0 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.702+0000 7fb31719d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100cae20 con 0x7fb3100cb900 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31699c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3100cb900 0x7fb3100ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31599a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3101566e0 0x7fb3100ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31699c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3100cb900 0x7fb3100ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35578/0 (socket says 172.21.15.86:35578) 2023-10-09T13:16:07.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31599a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3101566e0 0x7fb3100ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:39498/0 (socket says 172.21.15.86:39498) 2023-10-09T13:16:07.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31699c700 1 -- 172.21.15.86:0/1984496360 learned_addr learned my addr 172.21.15.86:0/1984496360 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:07.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31619b700 1 --1- 172.21.15.86:0/1984496360 >> v1:172.21.15.135:6789/0 conn(0x7fb310156310 0x7fb3100c9dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:57412/0 (socket says 172.21.15.86:57412) 2023-10-09T13:16:07.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb315199700 1 -- 172.21.15.86:0/1984496360 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649747975 0 0) 0x7fb3100ca860 con 0x7fb310156310 2023-10-09T13:16:07.706 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb315199700 1 -- 172.21.15.86:0/1984496360 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2fc003570 con 0x7fb310156310 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31599a700 1 -- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3100cb900 msgr2=0x7fb3100ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31599a700 1 --2- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3100cb900 0x7fb3100ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31599a700 1 -- 172.21.15.86:0/1984496360 >> v1:172.21.15.135:6789/0 conn(0x7fb310156310 legacy=0x7fb3100c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31599a700 1 -- 172.21.15.86:0/1984496360 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100cb100 con 0x7fb3101566e0 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31699c700 1 --2- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3100cb900 0x7fb3100ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.703+0000 7fb31599a700 1 --2- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101566e0 0x7fb3100ae000 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb3000098e0 tx=0x7fb3000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f60fa221241b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb315199700 1 -- 172.21.15.86:0/1984496360 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300011630 con 0x7fb3101566e0 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb315199700 1 -- 172.21.15.86:0/1984496360 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb300011790 con 0x7fb3101566e0 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb315199700 1 -- 172.21.15.86:0/1984496360 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300011b30 con 0x7fb3101566e0 2023-10-09T13:16:07.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb31719d700 1 -- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101566e0 msgr2=0x7fb3100ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb31719d700 1 --2- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101566e0 0x7fb3100ae000 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb3000098e0 tx=0x7fb3000091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb31719d700 1 -- 172.21.15.86:0/1984496360 shutdown_connections 2023-10-09T13:16:07.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb31719d700 1 --2- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3100cb900 0x7fb3100ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb31719d700 1 --2- 172.21.15.86:0/1984496360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101566e0 0x7fb3100ae000 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb31719d700 1 -- 172.21.15.86:0/1984496360 >> 172.21.15.86:0/1984496360 conn(0x7fb3100cc1f0 msgr2=0x7fb3100cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:07.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.704+0000 7fb31719d700 1 -- 172.21.15.86:0/1984496360 shutdown_connections 2023-10-09T13:16:07.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.705+0000 7fb31719d700 1 -- 172.21.15.86:0/1984496360 wait complete. 2023-10-09T13:16:07.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.706+0000 7fb31719d700 1 Processor -- start 2023-10-09T13:16:07.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.706+0000 7fb31719d700 1 -- start start 2023-10-09T13:16:07.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31719d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3100cb900 0x7fb31016ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31719d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb310156310 0x7fb31015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31719d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3101566e0 0x7fb3100b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31719d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101516c0 con 0x7fb3100cb900 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31719d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31015c0d0 con 0x7fb310156310 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31719d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31015c3b0 con 0x7fb3101566e0 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31619b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3100cb900 0x7fb31016ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31619b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3100cb900 0x7fb31016ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42544/0 (socket says 172.21.15.86:42544) 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31619b700 1 -- 172.21.15.86:0/436869897 learned_addr learned my addr 172.21.15.86:0/436869897 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31599a700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb310156310 0x7fb31015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.707+0000 7fb31699c700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3101566e0 0x7fb3100b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31619b700 1 -- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3101566e0 msgr2=0x7fb3100b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31619b700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3101566e0 0x7fb3100b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31619b700 1 -- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb310156310 msgr2=0x7fb31015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.711 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31619b700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb310156310 0x7fb31015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31619b700 1 -- 172.21.15.86:0/436869897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308009ae0 con 0x7fb3100cb900 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31599a700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb310156310 0x7fb31015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31619b700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3100cb900 0x7fb31016ca80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c7c0 tx=0x7fb30c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb3067fc700 1 -- 172.21.15.86:0/436869897 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c005c10 con 0x7fb3100cb900 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb3067fc700 1 -- 172.21.15.86:0/436869897 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c005d70 con 0x7fb3100cb900 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb3067fc700 1 -- 172.21.15.86:0/436869897 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c007320 con 0x7fb3100cb900 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb300009420 con 0x7fb3100cb900 2023-10-09T13:16:07.712 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.708+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31015c970 con 0x7fb3100cb900 2023-10-09T13:16:07.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.710+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31004c3c0 con 0x7fb3100cb900 2023-10-09T13:16:07.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.711+0000 7fb3067fc700 1 -- 172.21.15.86:0/436869897 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fb30c01b3b0 con 0x7fb3100cb900 2023-10-09T13:16:07.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.711+0000 7fb3067fc700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 0x7fb2f4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:07.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.711+0000 7fb3067fc700 1 -- 172.21.15.86:0/436869897 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fb30c084060 con 0x7fb3100cb900 2023-10-09T13:16:07.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.712+0000 7fb31599a700 1 -- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 msgr2=0x7fb2f4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:07.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.712+0000 7fb31599a700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 0x7fb2f4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:07.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.716+0000 7fb3067fc700 1 -- 172.21.15.86:0/436869897 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb30c050ea0 con 0x7fb3100cb900 2023-10-09T13:16:07.723 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:07.722+0000 7fa14c941180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:16:07.818 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:07.817+0000 7fa14c941180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:16:07.908 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:07.907+0000 7f0931ef8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:16:07.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.913+0000 7fb31599a700 1 -- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 msgr2=0x7fb2f4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:07.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.913+0000 7fb31599a700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 0x7fb2f4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:07.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.953+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3100cd0b0 con 0x7fb3100cb900 2023-10-09T13:16:07.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.954+0000 7fb3067fc700 1 -- 172.21.15.86:0/436869897 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fb30c017090 con 0x7fb3100cb900 2023-10-09T13:16:07.956 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:07.956 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/768026503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":768026503},{"type":"v1","addr":"172.21.15.86:6834","nonce":768026503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3188349803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3188349803},{"type":"v1","addr":"172.21.15.135:6835","nonce":3188349803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9666,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2491463129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2491463129},{"type":"v1","addr":"172.21.15.86:6835","nonce":2491463129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:13:38.499330+0000","modified":"2023-10-09T13:13:42.436468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9672},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9672":{"gid":9672,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6834/3006026738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3006026738},{"type":"v1","addr":"172.21.15.135:6834","nonce":3006026738}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T13:16:07.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 msgr2=0x7fb2f4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:07.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 0x7fb2f4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3100cb900 msgr2=0x7fb31016ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3100cb900 0x7fb31016ca80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c7c0 tx=0x7fb30c007e00 comp rx=0 tx=0).stop 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 shutdown_connections 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb2f4067050 0x7fb2f4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3100cb900 0x7fb31016ca80 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3101566e0 0x7fb3100b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 --2- 172.21.15.86:0/436869897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb310156310 0x7fb31015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 >> 172.21.15.86:0/436869897 conn(0x7fb3100cc1f0 msgr2=0x7fb3100c2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 shutdown_connections 2023-10-09T13:16:07.959 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:07.957+0000 7fb31719d700 1 -- 172.21.15.86:0/436869897 wait complete. 2023-10-09T13:16:07.960 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 86 2023-10-09T13:16:07.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:08.008 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:08.007+0000 7f0931ef8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:16:08.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.161+0000 7f73349fe700 1 Processor -- start 2023-10-09T13:16:08.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.161+0000 7f73349fe700 1 -- start start 2023-10-09T13:16:08.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f73349fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7330142ea0 0x7f73300b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f73349fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733006c0f0 0x7f733006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f73349fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73300b40f0 con 0x7f73300ad870 2023-10-09T13:16:08.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f73349fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7330069640 con 0x7f7330142ea0 2023-10-09T13:16:08.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f73349fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7330069920 con 0x7f733006c0f0 2023-10-09T13:16:08.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f732e59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f73300ad870 0x7f733006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49342/0 (socket says 172.21.15.86:49342) 2023-10-09T13:16:08.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f732e59c700 1 -- 172.21.15.86:0/1380341604 learned_addr learned my addr 172.21.15.86:0/1380341604 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:08.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f732ed9d700 1 --2- 172.21.15.86:0/1380341604 >> v2:172.21.15.135:3300/0 conn(0x7f7330142ea0 0x7f73300b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f732f59e700 1 --2- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733006c0f0 0x7f733006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f732dd9b700 1 -- 172.21.15.86:0/1380341604 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221351669 0 0) 0x7f73300b40f0 con 0x7f73300ad870 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.163+0000 7f732dd9b700 1 -- 172.21.15.86:0/1380341604 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7318003570 con 0x7f73300ad870 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732ed9d700 1 -- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733006c0f0 msgr2=0x7f733006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732ed9d700 1 --2- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733006c0f0 0x7f733006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732ed9d700 1 -- 172.21.15.86:0/1380341604 >> v1:172.21.15.86:6789/0 conn(0x7f73300ad870 legacy=0x7f733006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732ed9d700 1 -- 172.21.15.86:0/1380341604 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330069c00 con 0x7f7330142ea0 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732ed9d700 1 --2- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330142ea0 0x7f73300b3630 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f73200098e0 tx=0x7f73200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ae23474263c3b69 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732dd9b700 1 -- 172.21.15.86:0/1380341604 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011630 con 0x7f7330142ea0 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732dd9b700 1 -- 172.21.15.86:0/1380341604 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320011790 con 0x7f7330142ea0 2023-10-09T13:16:08.167 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.164+0000 7f732dd9b700 1 -- 172.21.15.86:0/1380341604 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011b30 con 0x7f7330142ea0 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 -- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330142ea0 msgr2=0x7f73300b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 --2- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330142ea0 0x7f73300b3630 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f73200098e0 tx=0x7f73200091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 -- 172.21.15.86:0/1380341604 shutdown_connections 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 --2- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f733006c0f0 0x7f733006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 --2- 172.21.15.86:0/1380341604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330142ea0 0x7f73300b3630 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 -- 172.21.15.86:0/1380341604 >> 172.21.15.86:0/1380341604 conn(0x7f73300ce430 msgr2=0x7f73300ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 -- 172.21.15.86:0/1380341604 shutdown_connections 2023-10-09T13:16:08.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.165+0000 7f73349fe700 1 -- 172.21.15.86:0/1380341604 wait complete. 2023-10-09T13:16:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.166+0000 7f73349fe700 1 Processor -- start 2023-10-09T13:16:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.167+0000 7f73349fe700 1 -- start start 2023-10-09T13:16:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.167+0000 7f73349fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733006c0f0 0x7f73300c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.167+0000 7f73349fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7330142ea0 0x7f73300c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f73349fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7330169ad0 0x7f7330169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f73349fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733016b740 con 0x7f7330169ad0 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f73349fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73301403a0 con 0x7f733006c0f0 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f73349fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73300c9ef0 con 0x7f7330142ea0 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7330169ad0 0x7f7330169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7330169ad0 0x7f7330169f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42550/0 (socket says 172.21.15.86:42550) 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 -- 172.21.15.86:0/1924138986 learned_addr learned my addr 172.21.15.86:0/1924138986 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732ed9d700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733006c0f0 0x7f73300c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732e59c700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7330142ea0 0x7f73300c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 -- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7330142ea0 msgr2=0x7f73300c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7330142ea0 0x7f73300c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 -- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733006c0f0 msgr2=0x7f73300c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733006c0f0 0x7f73300c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 -- 172.21.15.86:0/1924138986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009420 con 0x7f7330169ad0 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732ed9d700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733006c0f0 0x7f73300c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.168+0000 7f732f59e700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7330169ad0 0x7f7330169f70 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f7328009f20 tx=0x7f732800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.169+0000 7f7316ffd700 1 -- 172.21.15.86:0/1924138986 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800cb70 con 0x7f7330169ad0 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.169+0000 7f7316ffd700 1 -- 172.21.15.86:0/1924138986 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732800f040 con 0x7f7330169ad0 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.169+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733016ae10 con 0x7f7330169ad0 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.169+0000 7f7316ffd700 1 -- 172.21.15.86:0/1924138986 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328014480 con 0x7f7330169ad0 2023-10-09T13:16:08.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.169+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733016b3d0 con 0x7f7330169ad0 2023-10-09T13:16:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.170+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733004c3c0 con 0x7f7330169ad0 2023-10-09T13:16:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.171+0000 7f7316ffd700 1 -- 172.21.15.86:0/1924138986 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f7328014830 con 0x7f7330169ad0 2023-10-09T13:16:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.172+0000 7f7316ffd700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 0x7f731c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.172+0000 7f7316ffd700 1 -- 172.21.15.86:0/1924138986 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7f7328085890 con 0x7f7330169ad0 2023-10-09T13:16:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.172+0000 7f732ed9d700 1 -- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 msgr2=0x7f731c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:08.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.172+0000 7f732ed9d700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 0x7f731c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:08.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.176+0000 7f7316ffd700 1 -- 172.21.15.86:0/1924138986 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7328052520 con 0x7f7330169ad0 2023-10-09T13:16:08.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.373+0000 7f732ed9d700 1 -- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 msgr2=0x7f731c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:08.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.373+0000 7f732ed9d700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 0x7f731c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:08.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.376+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f733016b880 con 0x7f7330169ad0 2023-10-09T13:16:08.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.377+0000 7f7316ffd700 1 -- 172.21.15.86:0/1924138986 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16649 (secure 0 0 0) 0x7f732805b030 con 0x7f7330169ad0 2023-10-09T13:16:08.379 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:08.379 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":199,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:04.529284+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:13:36.634243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T13:13:37.482960+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":199,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/133360":"2023-10-10T13:13:59.600731+0000","172.21.15.86:6836/133360":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/2064280795":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3008613817":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3036672640":"2023-10-10T13:13:59.600731+0000","172.21.15.86:0/3101391875":"2023-10-10T13:13:59.600731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:08.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 msgr2=0x7f731c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 0x7f731c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7330169ad0 msgr2=0x7f7330169f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7330169ad0 0x7f7330169f70 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f7328009f20 tx=0x7f732800b040 comp rx=0 tx=0).stop 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 shutdown_connections 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f731c067050 0x7f731c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7330169ad0 0x7f7330169f70 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f733006c0f0 0x7f73300c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 --2- 172.21.15.86:0/1924138986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7330142ea0 0x7f73300c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 >> 172.21.15.86:0/1924138986 conn(0x7f73300ce430 msgr2=0x7f733006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 shutdown_connections 2023-10-09T13:16:08.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.380+0000 7f73349fe700 1 -- 172.21.15.86:0/1924138986 wait complete. 2023-10-09T13:16:08.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T13:16:08.522 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:08.521+0000 7fa14c941180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:16:08.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.627+0000 7fbb4bfff700 1 Processor -- start 2023-10-09T13:16:08.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.627+0000 7fbb4bfff700 1 -- start start 2023-10-09T13:16:08.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.628+0000 7fbb4bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb4c142ea0 0x7fbb4c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.628+0000 7fbb4bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c06c0f0 0x7fbb4c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.628+0000 7fbb4bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c0b40f0 con 0x7fbb4c0ad870 2023-10-09T13:16:08.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.628+0000 7fbb4bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4c069640 con 0x7fbb4c142ea0 2023-10-09T13:16:08.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.628+0000 7fbb4bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c069920 con 0x7fbb4c06c0f0 2023-10-09T13:16:08.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4a7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbb4c0ad870 0x7fbb4c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49348/0 (socket says 172.21.15.86:49348) 2023-10-09T13:16:08.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4a7fc700 1 -- 172.21.15.86:0/1483433689 learned_addr learned my addr 172.21.15.86:0/1483433689 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:08.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4affd700 1 --2- 172.21.15.86:0/1483433689 >> v2:172.21.15.135:3300/0 conn(0x7fbb4c142ea0 0x7fbb4c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4b7fe700 1 --2- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c06c0f0 0x7fbb4c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb49ffb700 1 -- 172.21.15.86:0/1483433689 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592423115 0 0) 0x7fbb4c0b40f0 con 0x7fbb4c0ad870 2023-10-09T13:16:08.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb49ffb700 1 -- 172.21.15.86:0/1483433689 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb34003570 con 0x7fbb4c0ad870 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4affd700 1 -- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c06c0f0 msgr2=0x7fbb4c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4affd700 1 --2- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c06c0f0 0x7fbb4c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4affd700 1 -- 172.21.15.86:0/1483433689 >> v1:172.21.15.86:6789/0 conn(0x7fbb4c0ad870 legacy=0x7fbb4c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.629+0000 7fbb4affd700 1 -- 172.21.15.86:0/1483433689 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c069c00 con 0x7fbb4c142ea0 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.630+0000 7fbb4affd700 1 --2- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c142ea0 0x7fbb4c0b3630 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0098e0 tx=0x7fbb3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f073555086247d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.630+0000 7fbb49ffb700 1 -- 172.21.15.86:0/1483433689 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c011630 con 0x7fbb4c142ea0 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.630+0000 7fbb49ffb700 1 -- 172.21.15.86:0/1483433689 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c011790 con 0x7fbb4c142ea0 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.630+0000 7fbb49ffb700 1 -- 172.21.15.86:0/1483433689 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c011b30 con 0x7fbb4c142ea0 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 -- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c142ea0 msgr2=0x7fbb4c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c142ea0 0x7fbb4c0b3630 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0098e0 tx=0x7fbb3c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.633 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 -- 172.21.15.86:0/1483433689 shutdown_connections 2023-10-09T13:16:08.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c06c0f0 0x7fbb4c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/1483433689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c142ea0 0x7fbb4c0b3630 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 -- 172.21.15.86:0/1483433689 >> 172.21.15.86:0/1483433689 conn(0x7fbb4c0ce430 msgr2=0x7fbb4c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:08.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 -- 172.21.15.86:0/1483433689 shutdown_connections 2023-10-09T13:16:08.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.631+0000 7fbb4bfff700 1 -- 172.21.15.86:0/1483433689 wait complete. 2023-10-09T13:16:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.632+0000 7fbb4bfff700 1 Processor -- start 2023-10-09T13:16:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.632+0000 7fbb4bfff700 1 -- start start 2023-10-09T13:16:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.633+0000 7fbb4bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c06c0f0 0x7fbb4c140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.633+0000 7fbb4bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c142ea0 0x7fbb4c16c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.633+0000 7fbb4bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb4c16ac80 0x7fbb4c16ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.633+0000 7fbb4bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c0c89c0 con 0x7fbb4c16ac80 2023-10-09T13:16:08.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.633+0000 7fbb4bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c15b270 con 0x7fbb4c06c0f0 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.633+0000 7fbb4bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c15a9d0 con 0x7fbb4c142ea0 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb4c16ac80 0x7fbb4c16ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb4c16ac80 0x7fbb4c16ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42560/0 (socket says 172.21.15.86:42560) 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c06c0f0 0x7fbb4c140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 -- 172.21.15.86:0/472775345 learned_addr learned my addr 172.21.15.86:0/472775345 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4a7fc700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c142ea0 0x7fbb4c16c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 -- 172.21.15.86:0/472775345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c142ea0 msgr2=0x7fbb4c16c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c142ea0 0x7fbb4c16c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 -- 172.21.15.86:0/472775345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c06c0f0 msgr2=0x7fbb4c140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c06c0f0 0x7fbb4c140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 -- 172.21.15.86:0/472775345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c009420 con 0x7fbb4c16ac80 2023-10-09T13:16:08.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb4b7fe700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb4c16ac80 0x7fbb4c16ca10 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009ef0 tx=0x7fbb4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.634+0000 7fbb32ffd700 1 -- 172.21.15.86:0/472775345 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400cb70 con 0x7fbb4c16ac80 2023-10-09T13:16:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.635+0000 7fbb32ffd700 1 -- 172.21.15.86:0/472775345 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4400f040 con 0x7fbb4c16ac80 2023-10-09T13:16:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.635+0000 7fbb32ffd700 1 -- 172.21.15.86:0/472775345 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44014480 con 0x7fbb4c16ac80 2023-10-09T13:16:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.635+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c15acb0 con 0x7fbb4c16ac80 2023-10-09T13:16:08.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.635+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c141310 con 0x7fbb4c16ac80 2023-10-09T13:16:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.636+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c0c8820 con 0x7fbb4c16ac80 2023-10-09T13:16:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.637+0000 7fbb32ffd700 1 -- 172.21.15.86:0/472775345 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fbb44014830 con 0x7fbb4c16ac80 2023-10-09T13:16:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.638+0000 7fbb32ffd700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 0x7fbb38069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.638+0000 7fbb4affd700 1 -- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 msgr2=0x7fbb38069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.638+0000 7fbb32ffd700 1 -- 172.21.15.86:0/472775345 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6511+0+0 (secure 0 0 0) 0x7fbb44085810 con 0x7fbb4c16ac80 2023-10-09T13:16:08.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.638+0000 7fbb4affd700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 0x7fbb38069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:08.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.646+0000 7fbb32ffd700 1 -- 172.21.15.86:0/472775345 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb4c0c8820 con 0x7fbb4c16ac80 2023-10-09T13:16:08.751 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:08.750+0000 7f0931ef8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:16:08.812 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:08.810+0000 7fa14c941180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:16:08.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.839+0000 7fbb4affd700 1 -- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 msgr2=0x7fbb38069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:08.840 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.839+0000 7fbb4affd700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 0x7fbb38069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:08.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.883+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbb4c0c8820 con 0x7fbb4c16ac80 2023-10-09T13:16:08.885 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T13:16:08.884+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T13:16:08.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.892+0000 7fbb32ffd700 1 -- 172.21.15.86:0/472775345 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbb4c0c8820 con 0x7fbb4c16ac80 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 msgr2=0x7fbb38069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 0x7fbb38069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb4c16ac80 msgr2=0x7fbb4c16ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb4c16ac80 0x7fbb4c16ca10 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009ef0 tx=0x7fbb4400b040 comp rx=0 tx=0).stop 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 shutdown_connections 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbb38067050 0x7fbb38069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb4c16ac80 0x7fbb4c16ca10 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb4c06c0f0 0x7fbb4c140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 --2- 172.21.15.86:0/472775345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb4c142ea0 0x7fbb4c16c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:08.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 >> 172.21.15.86:0/472775345 conn(0x7fbb4c0ce430 msgr2=0x7fbb4c06ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:08.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 shutdown_connections 2023-10-09T13:16:08.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:08.895+0000 7fbb4bfff700 1 -- 172.21.15.86:0/472775345 wait complete. 2023-10-09T13:16:08.898 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T13:16:08.908 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:08.906+0000 7fa14c941180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:16:08.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T13:16:08.951 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T13:16:09.047 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.046+0000 7f0931ef8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:16:09.068 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:09.067+0000 7fa14c941180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:16:09.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.104+0000 7f366f59e700 1 Processor -- start 2023-10-09T13:16:09.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.104+0000 7f366f59e700 1 -- start start 2023-10-09T13:16:09.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366f59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f36700b16d0 0x7f36700b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:09.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366f59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f36700b33b0 0x7f36700b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:09.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366f59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700b2080 con 0x7f36700b4e70 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366f59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700cfb00 con 0x7f36700b33b0 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366f59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700b5c40 con 0x7f36700b16d0 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f36700b33b0 0x7f36700b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f36700b33b0 0x7f36700b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42572/0 (socket says 172.21.15.86:42572) 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.105+0000 7f366ed9d700 1 -- 172.21.15.86:0/295939908 learned_addr learned my addr 172.21.15.86:0/295939908 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.106+0000 7f366dd9b700 1 --2- 172.21.15.86:0/295939908 >> v2:172.21.15.135:3300/0 conn(0x7f36700b16d0 0x7f36700b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.106+0000 7f366ed9d700 1 -- 172.21.15.86:0/295939908 >> v2:172.21.15.135:3300/0 conn(0x7f36700b16d0 msgr2=0x7f36700b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.106+0000 7f366ed9d700 1 --2- 172.21.15.86:0/295939908 >> v2:172.21.15.135:3300/0 conn(0x7f36700b16d0 0x7f36700b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.106+0000 7f366ed9d700 1 -- 172.21.15.86:0/295939908 >> v1:172.21.15.86:6789/0 conn(0x7f36700b4e70 legacy=0x7f36700ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:09.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.106+0000 7f366ed9d700 1 -- 172.21.15.86:0/295939908 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700b5f20 con 0x7f36700b33b0 2023-10-09T13:16:09.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.106+0000 7f366ed9d700 1 --2- 172.21.15.86:0/295939908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b33b0 0x7f36700b37d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f3670089830 tx=0x7f3668009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8062ce2dad51b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:09.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.106+0000 7f366d59a700 1 -- 172.21.15.86:0/295939908 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800e070 con 0x7f36700b33b0 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366d59a700 1 -- 172.21.15.86:0/295939908 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800ba20 con 0x7f36700b33b0 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366d59a700 1 -- 172.21.15.86:0/295939908 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36680092e0 con 0x7f36700b33b0 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 -- 172.21.15.86:0/295939908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b33b0 msgr2=0x7f36700b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 --2- 172.21.15.86:0/295939908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b33b0 0x7f36700b37d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f3670089830 tx=0x7f3668009840 comp rx=0 tx=0).stop 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 -- 172.21.15.86:0/295939908 shutdown_connections 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 --2- 172.21.15.86:0/295939908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b33b0 0x7f36700b37d0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 --2- 172.21.15.86:0/295939908 >> v2:172.21.15.135:3300/0 conn(0x7f36700b16d0 0x7f36700b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 -- 172.21.15.86:0/295939908 >> 172.21.15.86:0/295939908 conn(0x7f36700d10c0 msgr2=0x7f36700affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 -- 172.21.15.86:0/295939908 shutdown_connections 2023-10-09T13:16:09.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.107+0000 7f366f59e700 1 -- 172.21.15.86:0/295939908 wait complete. 2023-10-09T13:16:09.112 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.109+0000 7f366f59e700 1 Processor -- start 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.109+0000 7f366f59e700 1 -- start start 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36700b16d0 0x7f3670145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36700b33b0 0x7f367015e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366f59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b4e70 0x7f367015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366f59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670148d10 con 0x7f36700b4e70 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366f59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670148100 con 0x7f36700b16d0 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36701483e0 con 0x7f36700b33b0 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b4e70 0x7f367015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36700b16d0 0x7f3670145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366ed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b4e70 0x7f367015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42584/0 (socket says 172.21.15.86:42584) 2023-10-09T13:16:09.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36700b16d0 0x7f3670145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:39554/0 (socket says 172.21.15.86:39554) 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366ed9d700 1 -- 172.21.15.86:0/3724296264 learned_addr learned my addr 172.21.15.86:0/3724296264 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366dd9b700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36700b33b0 0x7f367015e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366e59c700 1 -- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36700b33b0 msgr2=0x7f367015e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.110+0000 7f366e59c700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36700b33b0 0x7f367015e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f366e59c700 1 -- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b4e70 msgr2=0x7f367015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f366e59c700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b4e70 0x7f367015e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f366e59c700 1 -- 172.21.15.86:0/3724296264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009ae0 con 0x7f36700b16d0 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f366ed9d700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b4e70 0x7f367015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f366e59c700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36700b16d0 0x7f3670145cb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f366000c590 tx=0x7f3660007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011590 con 0x7f36700b16d0 2023-10-09T13:16:09.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660011710 con 0x7f36700b16d0 2023-10-09T13:16:09.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36701486c0 con 0x7f36700b16d0 2023-10-09T13:16:09.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011ad0 con 0x7f36700b16d0 2023-10-09T13:16:09.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.111+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36701461f0 con 0x7f36700b16d0 2023-10-09T13:16:09.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.112+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3670088990 con 0x7f36700b16d0 2023-10-09T13:16:09.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.113+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 107) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f366001b3b0 con 0x7f36700b16d0 2023-10-09T13:16:09.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.114+0000 7f365e7fc700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:09.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.114+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6553+0+0 (secure 0 0 0) 0x7f3660083e50 con 0x7f36700b16d0 2023-10-09T13:16:09.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.114+0000 7f366dd9b700 1 -- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 msgr2=0x7f3650069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:09.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.114+0000 7f366dd9b700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:09.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.118+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3660050bc0 con 0x7f36700b16d0 2023-10-09T13:16:09.145 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.144+0000 7f0931ef8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:16:09.176 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:09.174+0000 7fa14c941180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:16:09.304 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.303+0000 7f0931ef8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:16:09.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.315+0000 7f366dd9b700 1 -- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 msgr2=0x7f3650069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:09.316 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.315+0000 7f366dd9b700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:09.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.362+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f36700cf330 con 0x7f36700b16d0 2023-10-09T13:16:09.364 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:09.363+0000 7fa14c941180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:16:09.410 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.409+0000 7f0931ef8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:16:09.458 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:09.456+0000 7fa14c941180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:16:09.552 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:09.550+0000 7fa14c941180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:16:09.600 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.599+0000 7f0931ef8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:16:09.647 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:09.645+0000 7fa14c941180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:16:09.693 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.692+0000 7f0931ef8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:16:09.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.716+0000 7f366dd9b700 1 -- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 msgr2=0x7f3650069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:09.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.716+0000 7f366dd9b700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T13:16:09.786 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.784+0000 7f0931ef8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:16:09.880 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:09.878+0000 7f0931ef8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:16:09.892 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.891+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 108) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f3660050f90 con 0x7f36700b16d0 2023-10-09T13:16:09.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.891+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 msgr2=0x7f3650069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:09.893 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.891+0000 7f365e7fc700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.898+0000 7f365e7fc700 1 -- 172.21.15.86:0/3724296264 <== mon.1 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7f366006e650 con 0x7f36700b16d0 2023-10-09T13:16:09.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36700b16d0 msgr2=0x7f3670145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:09.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36700b16d0 0x7f3670145cb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f366000c590 tx=0x7f3660007ec0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 shutdown_connections 2023-10-09T13:16:09.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3650067050 0x7f3650069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36700b4e70 0x7f367015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36700b16d0 0x7f3670145cb0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 --2- 172.21.15.86:0/3724296264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36700b33b0 0x7f367015e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:09.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 >> 172.21.15.86:0/3724296264 conn(0x7f36700d10c0 msgr2=0x7f367015c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:09.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 shutdown_connections 2023-10-09T13:16:09.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:09.902+0000 7f366f59e700 1 -- 172.21.15.86:0/3724296264 wait complete. 2023-10-09T13:16:09.928 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T13:16:10.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.124+0000 7fa8571ff700 1 Processor -- start 2023-10-09T13:16:10.125 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.124+0000 7fa8571ff700 1 -- start start 2023-10-09T13:16:10.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.125+0000 7fa8571ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa850153f50 0x7fa8500b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:10.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.125+0000 7fa8571ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa85006d840 0x7fa850069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:10.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.125+0000 7fa8571ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8500b4570 con 0x7fa850154320 2023-10-09T13:16:10.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.125+0000 7fa8571ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85015a730 con 0x7fa85006d840 2023-10-09T13:16:10.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.125+0000 7fa8571ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85015aa10 con 0x7fa850153f50 2023-10-09T13:16:10.127 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa84ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa850154320 0x7fa85006d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49370/0 (socket says 172.21.15.86:49370) 2023-10-09T13:16:10.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa85579c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa85006d840 0x7fa850069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:10.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa84ffff700 1 -- 172.21.15.86:0/2654938397 learned_addr learned my addr 172.21.15.86:0/2654938397 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:10.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa854f9b700 1 --2- 172.21.15.86:0/2654938397 >> v2:172.21.15.135:3300/0 conn(0x7fa850153f50 0x7fa8500b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:10.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa85579c700 1 -- 172.21.15.86:0/2654938397 >> v2:172.21.15.135:3300/0 conn(0x7fa850153f50 msgr2=0x7fa8500b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:10.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa85579c700 1 --2- 172.21.15.86:0/2654938397 >> v2:172.21.15.135:3300/0 conn(0x7fa850153f50 0x7fa8500b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa85579c700 1 -- 172.21.15.86:0/2654938397 >> v1:172.21.15.86:6789/0 conn(0x7fa850154320 legacy=0x7fa85006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:10.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa85579c700 1 -- 172.21.15.86:0/2654938397 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85015acf0 con 0x7fa85006d840 2023-10-09T13:16:10.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa84f7fe700 1 -- 172.21.15.86:0/2654938397 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421430665 0 0) 0x7fa8500b4570 con 0x7fa850154320 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.126+0000 7fa85579c700 1 --2- 172.21.15.86:0/2654938397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa85006d840 0x7fa850069e30 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fa848009e60 tx=0x7fa848009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccd3f039a96121 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa84f7fe700 1 -- 172.21.15.86:0/2654938397 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800e070 con 0x7fa85006d840 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa84f7fe700 1 -- 172.21.15.86:0/2654938397 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84800bb20 con 0x7fa85006d840 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa84f7fe700 1 -- 172.21.15.86:0/2654938397 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848012430 con 0x7fa85006d840 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 -- 172.21.15.86:0/2654938397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa85006d840 msgr2=0x7fa850069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 --2- 172.21.15.86:0/2654938397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa85006d840 0x7fa850069e30 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fa848009e60 tx=0x7fa848009780 comp rx=0 tx=0).stop 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 -- 172.21.15.86:0/2654938397 shutdown_connections 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 --2- 172.21.15.86:0/2654938397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa85006d840 0x7fa850069e30 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 --2- 172.21.15.86:0/2654938397 >> v2:172.21.15.135:3300/0 conn(0x7fa850153f50 0x7fa8500b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 -- 172.21.15.86:0/2654938397 >> 172.21.15.86:0/2654938397 conn(0x7fa85006baf0 msgr2=0x7fa85006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:10.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 -- 172.21.15.86:0/2654938397 shutdown_connections 2023-10-09T13:16:10.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.127+0000 7fa8571ff700 1 -- 172.21.15.86:0/2654938397 wait complete. 2023-10-09T13:16:10.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.129+0000 7fa8571ff700 1 Processor -- start 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.129+0000 7fa8571ff700 1 -- start start 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa8571ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa85006d840 0x7fa85015e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa8571ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa850153f50 0x7fa85015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa8571ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa850154320 0x7fa85015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa8571ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85015e980 con 0x7fa850153f50 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa8571ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85013ede0 con 0x7fa85006d840 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa8571ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85015d460 con 0x7fa850154320 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa850153f50 0x7fa85015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa850153f50 0x7fa85015bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42676/0 (socket says 172.21.15.86:42676) 2023-10-09T13:16:10.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 -- 172.21.15.86:0/1205793811 learned_addr learned my addr 172.21.15.86:0/1205793811 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa854f9b700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa85006d840 0x7fa85015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa85579c700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa850154320 0x7fa85015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 -- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa850154320 msgr2=0x7fa85015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa850154320 0x7fa85015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 -- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa85006d840 msgr2=0x7fa85015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa85006d840 0x7fa85015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.130+0000 7fa84ffff700 1 -- 172.21.15.86:0/1205793811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa848009a20 con 0x7fa850153f50 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.131+0000 7fa84ffff700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa850153f50 0x7fa85015bd00 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00c5b0 tx=0x7fa83c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.131+0000 7fa84cff9700 1 -- 172.21.15.86:0/1205793811 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c005b30 con 0x7fa850153f50 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.131+0000 7fa84cff9700 1 -- 172.21.15.86:0/1205793811 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c005c90 con 0x7fa850153f50 2023-10-09T13:16:10.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.131+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85015b650 con 0x7fa850153f50 2023-10-09T13:16:10.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.131+0000 7fa84cff9700 1 -- 172.21.15.86:0/1205793811 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c007300 con 0x7fa850153f50 2023-10-09T13:16:10.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.131+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85015ce10 con 0x7fa850153f50 2023-10-09T13:16:10.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.132+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8500cf1f0 con 0x7fa850153f50 2023-10-09T13:16:10.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.133+0000 7fa84cff9700 1 -- 172.21.15.86:0/1205793811 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 108) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fa83c0076b0 con 0x7fa850153f50 2023-10-09T13:16:10.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.134+0000 7fa84cff9700 1 -- 172.21.15.86:0/1205793811 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6811+0+0 (secure 0 0 0) 0x7fa83c083a30 con 0x7fa850153f50 2023-10-09T13:16:10.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.138+0000 7fa84cff9700 1 -- 172.21.15.86:0/1205793811 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa83c050b20 con 0x7fa850153f50 2023-10-09T13:16:10.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.326+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa85015d5d0 con 0x7fa850153f50 2023-10-09T13:16:10.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.904+0000 7fa84cff9700 1 -- 172.21.15.86:0/1205793811 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v202) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa83c0170d0 con 0x7fa850153f50 2023-10-09T13:16:10.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.908+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa850153f50 msgr2=0x7fa85015bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:10.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.908+0000 7fa8571ff700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa850153f50 0x7fa85015bd00 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00c5b0 tx=0x7fa83c001070 comp rx=0 tx=0).stop 2023-10-09T13:16:10.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.909+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 shutdown_connections 2023-10-09T13:16:10.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.909+0000 7fa8571ff700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa850154320 0x7fa85015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.909+0000 7fa8571ff700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa85006d840 0x7fa85015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.909+0000 7fa8571ff700 1 --2- 172.21.15.86:0/1205793811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa850153f50 0x7fa85015bd00 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:10.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.909+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 >> 172.21.15.86:0/1205793811 conn(0x7fa85006baf0 msgr2=0x7fa8501531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:10.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.910+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 shutdown_connections 2023-10-09T13:16:10.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:10.910+0000 7fa8571ff700 1 -- 172.21.15.86:0/1205793811 wait complete. 2023-10-09T13:16:10.913 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T13:16:10.937 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T13:16:11.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.125+0000 7fde2219d700 1 Processor -- start 2023-10-09T13:16:11.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.125+0000 7fde2219d700 1 -- start start 2023-10-09T13:16:11.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.126+0000 7fde2219d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde1c153480 0x7fde1c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.126+0000 7fde2219d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c0aec90 con 0x7fde1c153850 2023-10-09T13:16:11.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.126+0000 7fde2219d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c15a480 con 0x7fde1c159dc0 2023-10-09T13:16:11.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.126+0000 7fde2219d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c0afb40 con 0x7fde1c153480 2023-10-09T13:16:11.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde2099a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fde1c153850 0x7fde1c1596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49376/0 (socket says 172.21.15.86:49376) 2023-10-09T13:16:11.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde2099a700 1 -- 172.21.15.86:0/339165455 learned_addr learned my addr 172.21.15.86:0/339165455 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:11.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde2119b700 1 --2- 172.21.15.86:0/339165455 >> v2:172.21.15.135:3300/0 conn(0x7fde1c153480 0x7fde1c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924117233 0 0) 0x7fde1c0aec90 con 0x7fde1c153850 2023-10-09T13:16:11.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde08003570 con 0x7fde1c153850 2023-10-09T13:16:11.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1091583022 0 0) 0x7fde08003570 con 0x7fde1c153850 2023-10-09T13:16:11.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 >> v2:172.21.15.135:3300/0 conn(0x7fde1c153480 msgr2=0x7fde1c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 --2- 172.21.15.86:0/339165455 >> v2:172.21.15.135:3300/0 conn(0x7fde1c153480 0x7fde1c0ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 >> v1:172.21.15.135:6789/0 conn(0x7fde1c159dc0 legacy=0x7fde1c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0afe20 con 0x7fde1c153850 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.127+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fde0c001470 con 0x7fde1c153850 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 >> v1:172.21.15.86:6789/0 conn(0x7fde1c153850 legacy=0x7fde1c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde13fff700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde08003ab0 0x7fde08003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde13fff700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08004810 0x7fde08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde13fff700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde08005210 0x7fde0800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0afb40 con 0x7fde08003ab0 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0800c130 con 0x7fde08005210 2023-10-09T13:16:11.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0800c2f0 con 0x7fde08004810 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2119b700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde08003ab0 0x7fde08003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2099a700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08004810 0x7fde08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2199c700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde08005210 0x7fde0800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2119b700 1 -- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08004810 msgr2=0x7fde08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2119b700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08004810 0x7fde08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2119b700 1 -- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde08005210 msgr2=0x7fde0800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2119b700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde08005210 0x7fde0800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2119b700 1 -- 172.21.15.86:0/339165455 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08003570 con 0x7fde08003ab0 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.128+0000 7fde2199c700 1 -- 172.21.15.86:0/339165455 reap_dead start 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2119b700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde08003ab0 0x7fde08003ec0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fde1800adb0 tx=0x7fde1800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8309aca1d44e683 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:11.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800a760 con 0x7fde08003ab0 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800fa30 con 0x7fde08003ab0 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde13fff700 1 -- 172.21.15.86:0/339165455 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800fba0 con 0x7fde08003ab0 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2219d700 1 -- 172.21.15.86:0/339165455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde08003ab0 msgr2=0x7fde08003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2219d700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde08003ab0 0x7fde08003ec0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fde1800adb0 tx=0x7fde1800a330 comp rx=0 tx=0).stop 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2219d700 1 -- 172.21.15.86:0/339165455 shutdown_connections 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2219d700 1 --2- 172.21.15.86:0/339165455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde08003ab0 0x7fde08003ec0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2219d700 1 -- 172.21.15.86:0/339165455 >> 172.21.15.86:0/339165455 conn(0x7fde1c068e20 msgr2=0x7fde1c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2219d700 1 -- 172.21.15.86:0/339165455 shutdown_connections 2023-10-09T13:16:11.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.129+0000 7fde2219d700 1 -- 172.21.15.86:0/339165455 wait complete. 2023-10-09T13:16:11.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.131+0000 7fde2219d700 1 Processor -- start 2023-10-09T13:16:11.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.131+0000 7fde2219d700 1 -- start start 2023-10-09T13:16:11.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08003ab0 0x7fde1c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2219d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1c1505f0 0x7fde1c150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2219d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde1c155bd0 0x7fde1c156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2219d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c150f80 con 0x7fde1c155bd0 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2219d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c147720 con 0x7fde1c1505f0 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c156900 con 0x7fde08003ab0 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2199c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde1c155bd0 0x7fde1c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2119b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08003ab0 0x7fde1c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2199c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde1c155bd0 0x7fde1c156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42706/0 (socket says 172.21.15.86:42706) 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2199c700 1 -- 172.21.15.86:0/267734158 learned_addr learned my addr 172.21.15.86:0/267734158 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2099a700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1c1505f0 0x7fde1c150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.132+0000 7fde2199c700 1 -- 172.21.15.86:0/267734158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08003ab0 msgr2=0x7fde1c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde2199c700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08003ab0 0x7fde1c154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde2199c700 1 -- 172.21.15.86:0/267734158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1c1505f0 msgr2=0x7fde1c150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde2199c700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1c1505f0 0x7fde1c150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde2199c700 1 -- 172.21.15.86:0/267734158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c147990 con 0x7fde1c155bd0 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde2199c700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde1c155bd0 0x7fde1c156030 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fde1c064670 tx=0x7fde14001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14006db0 con 0x7fde1c155bd0 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1400c5d0 con 0x7fde1c155bd0 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c147c70 con 0x7fde1c155bd0 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400c990 con 0x7fde1c155bd0 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.133+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c156be0 con 0x7fde1c155bd0 2023-10-09T13:16:11.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.135+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c147e60 con 0x7fde1c155bd0 2023-10-09T13:16:11.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.136+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 109) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fde140133e0 con 0x7fde1c155bd0 2023-10-09T13:16:11.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.137+0000 7fde117fa700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fde00066db0 0x7fde00069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:11.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.137+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6373+0+0 (secure 0 0 0) 0x7fde14083e60 con 0x7fde1c155bd0 2023-10-09T13:16:11.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.137+0000 7fde2119b700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fde00066db0 0x7fde00069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:11.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.138+0000 7fde2119b700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fde00066db0 0x7fde00069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde1800a370 tx=0x7fde1801d000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:11.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.141+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde14051090 con 0x7fde1c155bd0 2023-10-09T13:16:11.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.335+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde1c04c3c0 con 0x7fde1c155bd0 2023-10-09T13:16:11.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.928+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde14051460 con 0x7fde1c155bd0 2023-10-09T13:16:11.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.929+0000 7fde117fa700 1 -- 172.21.15.86:0/267734158 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v203) v1 ==== 169+0+0 (secure 0 0 0) 0x7fde1404af60 con 0x7fde1c155bd0 2023-10-09T13:16:11.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.932+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fde00066db0 msgr2=0x7fde00069260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:11.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.932+0000 7fde2219d700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fde00066db0 0x7fde00069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde1800a370 tx=0x7fde1801d000 comp rx=0 tx=0).stop 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.932+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde1c155bd0 msgr2=0x7fde1c156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.932+0000 7fde2219d700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde1c155bd0 0x7fde1c156030 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fde1c064670 tx=0x7fde14001640 comp rx=0 tx=0).stop 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 shutdown_connections 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fde00066db0 0x7fde00069260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde1c155bd0 0x7fde1c156030 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde08003ab0 0x7fde1c154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 --2- 172.21.15.86:0/267734158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde1c1505f0 0x7fde1c150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 >> 172.21.15.86:0/267734158 conn(0x7fde1c068e20 msgr2=0x7fde1c152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:11.935 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 shutdown_connections 2023-10-09T13:16:11.936 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:11.933+0000 7fde2219d700 1 -- 172.21.15.86:0/267734158 wait complete. 2023-10-09T13:16:11.936 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T13:16:11.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T13:16:12.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.136+0000 7ff1481ff700 1 Processor -- start 2023-10-09T13:16:12.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.136+0000 7ff1481ff700 1 -- start start 2023-10-09T13:16:12.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff1481ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff1400699c0 0x7ff14006f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff1481ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff140159de0 0x7ff1400ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff1481ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14006de10 con 0x7ff14006f750 2023-10-09T13:16:12.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff1481ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14006e0f0 con 0x7ff1400699c0 2023-10-09T13:16:12.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff1481ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14006e3d0 con 0x7ff140159de0 2023-10-09T13:16:12.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff145f9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff1400699c0 0x7ff14006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff14679c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff140159de0 0x7ff1400ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff145f9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff1400699c0 0x7ff14006f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:39732/0 (socket says 172.21.15.86:39732) 2023-10-09T13:16:12.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.138+0000 7ff145f9b700 1 -- 172.21.15.86:0/3639241467 learned_addr learned my addr 172.21.15.86:0/3639241467 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:12.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff145f9b700 1 -- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff140159de0 msgr2=0x7ff1400ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:12.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff145f9b700 1 --2- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff140159de0 0x7ff1400ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff145f9b700 1 -- 172.21.15.86:0/3639241467 >> v1:172.21.15.135:6789/0 conn(0x7ff14006f750 legacy=0x7ff1401596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff145f9b700 1 -- 172.21.15.86:0/3639241467 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14006e6b0 con 0x7ff1400699c0 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff14679c700 1 --2- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff140159de0 0x7ff1400ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff145f9b700 1 --2- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1400699c0 0x7ff14006f210 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0099b0 tx=0x7ff13c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b94fa3bd51db959 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff144f99700 1 -- 172.21.15.86:0/3639241467 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c009ea0 con 0x7ff1400699c0 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff144f99700 1 -- 172.21.15.86:0/3639241467 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c00b860 con 0x7ff1400699c0 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.139+0000 7ff144f99700 1 -- 172.21.15.86:0/3639241467 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00bc00 con 0x7ff1400699c0 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 -- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1400699c0 msgr2=0x7ff14006f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 --2- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1400699c0 0x7ff14006f210 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0099b0 tx=0x7ff13c009250 comp rx=0 tx=0).stop 2023-10-09T13:16:12.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 -- 172.21.15.86:0/3639241467 shutdown_connections 2023-10-09T13:16:12.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 --2- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff140159de0 0x7ff1400ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 --2- 172.21.15.86:0/3639241467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1400699c0 0x7ff14006f210 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 -- 172.21.15.86:0/3639241467 >> 172.21.15.86:0/3639241467 conn(0x7ff140068e10 msgr2=0x7ff1400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:12.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 -- 172.21.15.86:0/3639241467 shutdown_connections 2023-10-09T13:16:12.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.140+0000 7ff1481ff700 1 -- 172.21.15.86:0/3639241467 wait complete. 2023-10-09T13:16:12.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.141+0000 7ff1481ff700 1 Processor -- start 2023-10-09T13:16:12.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.141+0000 7ff1481ff700 1 -- start start 2023-10-09T13:16:12.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff1481ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1400699c0 0x7ff14016aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff1481ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14006f750 0x7ff1400ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff1481ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff140159de0 0x7ff1401574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff1481ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400cab50 con 0x7ff140159de0 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff1481ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140157c60 con 0x7ff14006f750 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff1481ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff140156770 con 0x7ff1400699c0 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff14679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff140159de0 0x7ff1401574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.142+0000 7ff14679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff140159de0 0x7ff1401574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42718/0 (socket says 172.21.15.86:42718) 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14679c700 1 -- 172.21.15.86:0/2556920047 learned_addr learned my addr 172.21.15.86:0/2556920047 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff145f9b700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1400699c0 0x7ff14016aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14679c700 1 -- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1400699c0 msgr2=0x7ff14016aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14679c700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1400699c0 0x7ff14016aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14679c700 1 -- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14006f750 msgr2=0x7ff1400ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14579a700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14006f750 0x7ff1400ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14679c700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14006f750 0x7ff1400ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14679c700 1 -- 172.21.15.86:0/2556920047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009a20 con 0x7ff140159de0 2023-10-09T13:16:12.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff145f9b700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1400699c0 0x7ff14016aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:12.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14579a700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14006f750 0x7ff1400ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:12.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff14679c700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff140159de0 0x7ff1401574a0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ff138009f50 tx=0x7ff13800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff135ffb700 1 -- 172.21.15.86:0/2556920047 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800ccb0 con 0x7ff140159de0 2023-10-09T13:16:12.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff135ffb700 1 -- 172.21.15.86:0/2556920047 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800f040 con 0x7ff140159de0 2023-10-09T13:16:12.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0094f0 con 0x7ff140159de0 2023-10-09T13:16:12.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.143+0000 7ff135ffb700 1 -- 172.21.15.86:0/2556920047 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138014480 con 0x7ff140159de0 2023-10-09T13:16:12.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.144+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff140155e80 con 0x7ff140159de0 2023-10-09T13:16:12.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.145+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14004c3c0 con 0x7ff140159de0 2023-10-09T13:16:12.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.145+0000 7ff135ffb700 1 -- 172.21.15.86:0/2556920047 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff138003020 con 0x7ff140159de0 2023-10-09T13:16:12.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.146+0000 7ff135ffb700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff124066f30 0x7ff1240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.146+0000 7ff135ffb700 1 -- 172.21.15.86:0/2556920047 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7ff1380850a0 con 0x7ff140159de0 2023-10-09T13:16:12.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.147+0000 7ff145f9b700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff124066f30 0x7ff1240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.147+0000 7ff145f9b700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff124066f30 0x7ff1240693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0099b0 tx=0x7ff13c017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.151+0000 7ff135ffb700 1 -- 172.21.15.86:0/2556920047 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff138052170 con 0x7ff140159de0 2023-10-09T13:16:12.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.341+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7ff1401568b0 con 0x7ff140159de0 2023-10-09T13:16:12.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.345+0000 7ff135ffb700 1 -- 172.21.15.86:0/2556920047 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v67) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff138055790 con 0x7ff140159de0 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff124066f30 msgr2=0x7ff1240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff124066f30 0x7ff1240693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0099b0 tx=0x7ff13c017000 comp rx=0 tx=0).stop 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff140159de0 msgr2=0x7ff1401574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff140159de0 0x7ff1401574a0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ff138009f50 tx=0x7ff13800b040 comp rx=0 tx=0).stop 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 shutdown_connections 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff124066f30 0x7ff1240693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff140159de0 0x7ff1401574a0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1400699c0 0x7ff14016aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 --2- 172.21.15.86:0/2556920047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff14006f750 0x7ff1400ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 >> 172.21.15.86:0/2556920047 conn(0x7ff140068e10 msgr2=0x7ff1400cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:12.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.348+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 shutdown_connections 2023-10-09T13:16:12.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.349+0000 7ff1481ff700 1 -- 172.21.15.86:0/2556920047 wait complete. 2023-10-09T13:16:12.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T13:16:12.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.558+0000 7ff5d49ff700 1 Processor -- start 2023-10-09T13:16:12.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.559+0000 7ff5d49ff700 1 -- start start 2023-10-09T13:16:12.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5d49ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d0155eb0 0x7ff5d006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.561 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5d49ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff5d00c70b0 0x7ff5d0069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5d49ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d006eb90 con 0x7ff5d0069cb0 2023-10-09T13:16:12.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5d49ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d006a130 con 0x7ff5d00c70b0 2023-10-09T13:16:12.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5d49ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d006ee70 con 0x7ff5d0155eb0 2023-10-09T13:16:12.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5ce59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d0155eb0 0x7ff5d006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5c7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff5d00c70b0 0x7ff5d0069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5ce59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d0155eb0 0x7ff5d006e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:35770/0 (socket says 172.21.15.86:35770) 2023-10-09T13:16:12.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.560+0000 7ff5ce59c700 1 -- 172.21.15.86:0/2071529746 learned_addr learned my addr 172.21.15.86:0/2071529746 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5c7fff700 1 -- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d0155eb0 msgr2=0x7ff5d006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5c7fff700 1 --2- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d0155eb0 0x7ff5d006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5c7fff700 1 -- 172.21.15.86:0/2071529746 >> v1:172.21.15.135:6789/0 conn(0x7ff5d0069cb0 legacy=0x7ff5d0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5c7fff700 1 -- 172.21.15.86:0/2071529746 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d006f150 con 0x7ff5d00c70b0 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5ce59c700 1 --2- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d0155eb0 0x7ff5d006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5c7fff700 1 --2- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d00c70b0 0x7ff5d0069770 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009910 tx=0x7ff5b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e768c72582487ae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5cdd9b700 1 -- 172.21.15.86:0/2071529746 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800b640 con 0x7ff5d00c70b0 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5cdd9b700 1 -- 172.21.15.86:0/2071529746 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800b7a0 con 0x7ff5d00c70b0 2023-10-09T13:16:12.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.561+0000 7ff5cdd9b700 1 -- 172.21.15.86:0/2071529746 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800bb60 con 0x7ff5d00c70b0 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 -- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d00c70b0 msgr2=0x7ff5d0069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d00c70b0 0x7ff5d0069770 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009910 tx=0x7ff5b80091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 -- 172.21.15.86:0/2071529746 shutdown_connections 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d0155eb0 0x7ff5d006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/2071529746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d00c70b0 0x7ff5d0069770 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 -- 172.21.15.86:0/2071529746 >> 172.21.15.86:0/2071529746 conn(0x7ff5d0068e10 msgr2=0x7ff5d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 -- 172.21.15.86:0/2071529746 shutdown_connections 2023-10-09T13:16:12.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.562+0000 7ff5d49ff700 1 -- 172.21.15.86:0/2071529746 wait complete. 2023-10-09T13:16:12.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.564+0000 7ff5d49ff700 1 Processor -- start 2023-10-09T13:16:12.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.564+0000 7ff5d49ff700 1 -- start start 2023-10-09T13:16:12.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5d49ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d0069cb0 0x7ff5d0149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5d49ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d00c70b0 0x7ff5d00c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5d49ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0155eb0 0x7ff5d00c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5d49ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00a98d0 con 0x7ff5d0069cb0 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5d49ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00a9b40 con 0x7ff5d0155eb0 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5d49ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00c6160 con 0x7ff5d00c70b0 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d0069cb0 0x7ff5d0149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d0069cb0 0x7ff5d0149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42726/0 (socket says 172.21.15.86:42726) 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 -- 172.21.15.86:0/3295982134 learned_addr learned my addr 172.21.15.86:0/3295982134 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5c7fff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d00c70b0 0x7ff5d00c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ced9d700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0155eb0 0x7ff5d00c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 -- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d00c70b0 msgr2=0x7ff5d00c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d00c70b0 0x7ff5d00c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 -- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0155eb0 msgr2=0x7ff5d00c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0155eb0 0x7ff5d00c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5ce59c700 1 -- 172.21.15.86:0/3295982134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00094f0 con 0x7ff5d0069cb0 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.565+0000 7ff5c7fff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d00c70b0 0x7ff5d00c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.566+0000 7ff5ce59c700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d0069cb0 0x7ff5d0149090 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000ec50 tx=0x7ff5c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.566+0000 7ff5c67fc700 1 -- 172.21.15.86:0/3295982134 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000c9d0 con 0x7ff5d0069cb0 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.566+0000 7ff5c67fc700 1 -- 172.21.15.86:0/3295982134 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000cb30 con 0x7ff5d0069cb0 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.566+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b8009420 con 0x7ff5d0069cb0 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.566+0000 7ff5c67fc700 1 -- 172.21.15.86:0/3295982134 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0013470 con 0x7ff5d0069cb0 2023-10-09T13:16:12.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.566+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d00c6720 con 0x7ff5d0069cb0 2023-10-09T13:16:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.567+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d004c3c0 con 0x7ff5d0069cb0 2023-10-09T13:16:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.568+0000 7ff5c67fc700 1 -- 172.21.15.86:0/3295982134 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5c0013860 con 0x7ff5d0069cb0 2023-10-09T13:16:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.568+0000 7ff5c67fc700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5b0066f30 0x7ff5b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.569+0000 7ff5c67fc700 1 -- 172.21.15.86:0/3295982134 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7ff5c0084a20 con 0x7ff5d0069cb0 2023-10-09T13:16:12.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.569+0000 7ff5c7fff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5b0066f30 0x7ff5b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.569+0000 7ff5c7fff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5b0066f30 0x7ff5b00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009860 tx=0x7ff5b8017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.572+0000 7ff5c67fc700 1 -- 172.21.15.86:0/3295982134 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5c0051af0 con 0x7ff5d0069cb0 2023-10-09T13:16:12.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.763+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff5d006f430 con 0x7ff5d0069cb0 2023-10-09T13:16:12.768 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.767+0000 7ff5c67fc700 1 -- 172.21.15.86:0/3295982134 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v68) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff5c0055110 con 0x7ff5d0069cb0 2023-10-09T13:16:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5b0066f30 msgr2=0x7ff5b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5b0066f30 0x7ff5b00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009860 tx=0x7ff5b8017000 comp rx=0 tx=0).stop 2023-10-09T13:16:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d0069cb0 msgr2=0x7ff5d0149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d0069cb0 0x7ff5d0149090 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000ec50 tx=0x7ff5c0009250 comp rx=0 tx=0).stop 2023-10-09T13:16:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 shutdown_connections 2023-10-09T13:16:12.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7ff5b0066f30 0x7ff5b00693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d0069cb0 0x7ff5d0149090 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0155eb0 0x7ff5d00c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 --2- 172.21.15.86:0/3295982134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5d00c70b0 0x7ff5d00c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.769+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 >> 172.21.15.86:0/3295982134 conn(0x7ff5d0068e10 msgr2=0x7ff5d00c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.770+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 shutdown_connections 2023-10-09T13:16:12.772 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.770+0000 7ff5d49ff700 1 -- 172.21.15.86:0/3295982134 wait complete. 2023-10-09T13:16:12.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T13:16:12.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.972+0000 7f9cb85ff700 1 Processor -- start 2023-10-09T13:16:12.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.972+0000 7f9cb85ff700 1 -- start start 2023-10-09T13:16:12.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.973+0000 7f9cb85ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9cb0155eb0 0x7f9cb006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb85ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb0156320 con 0x7f9cb00c70b0 2023-10-09T13:16:12.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb85ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb006eb90 con 0x7f9cb0069770 2023-10-09T13:16:12.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb85ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00cd350 con 0x7f9cb0155eb0 2023-10-09T13:16:12.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb639b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9cb00c70b0 0x7f9cb00ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49378/0 (socket says 172.21.15.86:49378) 2023-10-09T13:16:12.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb639b700 1 -- 172.21.15.86:0/801010505 learned_addr learned my addr 172.21.15.86:0/801010505 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:12.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5b9a700 1 --2- 172.21.15.86:0/801010505 >> v2:172.21.15.135:3300/0 conn(0x7f9cb0155eb0 0x7f9cb006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519839062 0 0) 0x7f9cb0156320 con 0x7f9cb00c70b0 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c9c003570 con 0x7f9cb00c70b0 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131798777 0 0) 0x7f9c9c003570 con 0x7f9cb00c70b0 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 >> v2:172.21.15.135:3300/0 conn(0x7f9cb0155eb0 msgr2=0x7f9cb006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 --2- 172.21.15.86:0/801010505 >> v2:172.21.15.135:3300/0 conn(0x7f9cb0155eb0 0x7f9cb006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 >> v1:172.21.15.135:6789/0 conn(0x7f9cb0069770 legacy=0x7f9cb0160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb006ee70 con 0x7f9cb00c70b0 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.974+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f9cac001470 con 0x7f9cb00c70b0 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 >> v1:172.21.15.86:6789/0 conn(0x7f9cb00c70b0 legacy=0x7f9cb00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5399700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c9c003a60 0x7f9c9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5399700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c004810 0x7f9c9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5399700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c9c0051c0 0x7f9c9c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00cd350 con 0x7f9c9c003a60 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c00c0d0 con 0x7f9c9c004810 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c00c290 con 0x7f9c9c0051c0 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb639b700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c9c003a60 0x7f9c9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb5b9a700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c004810 0x7f9c9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb6b9c700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c9c0051c0 0x7f9c9c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb639b700 1 -- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c9c0051c0 msgr2=0x7f9c9c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb639b700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c9c0051c0 0x7f9c9c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb639b700 1 -- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c004810 msgr2=0x7f9c9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb639b700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c004810 0x7f9c9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.980 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb639b700 1 -- 172.21.15.86:0/801010505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c003570 con 0x7f9c9c003a60 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.975+0000 7f9cb6b9c700 1 -- 172.21.15.86:0/801010505 reap_dead start 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb639b700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c9c003a60 0x7f9c9c003e70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c390 tx=0x7f9cb006f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7963f1293b4db742 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00cc60 con 0x7f9c9c003a60 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac00cdc0 con 0x7f9c9c003a60 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb5399700 1 -- 172.21.15.86:0/801010505 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac005b70 con 0x7f9c9c003a60 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb85ff700 1 -- 172.21.15.86:0/801010505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c9c003a60 msgr2=0x7f9c9c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c9c003a60 0x7f9c9c003e70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c390 tx=0x7f9cb006f710 comp rx=0 tx=0).stop 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb85ff700 1 -- 172.21.15.86:0/801010505 shutdown_connections 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/801010505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c9c003a60 0x7f9c9c003e70 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb85ff700 1 -- 172.21.15.86:0/801010505 >> 172.21.15.86:0/801010505 conn(0x7f9cb0068e10 msgr2=0x7f9cb00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:12.981 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb85ff700 1 -- 172.21.15.86:0/801010505 shutdown_connections 2023-10-09T13:16:12.982 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.976+0000 7f9cb85ff700 1 -- 172.21.15.86:0/801010505 wait complete. 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.978+0000 7f9cb85ff700 1 Processor -- start 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.978+0000 7f9cb85ff700 1 -- start start 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb85ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c003a60 0x7f9cb015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb85ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cb0153020 0x7f9cb0154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb85ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb0154850 0x7f9cb0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb85ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb015e0c0 con 0x7f9cb0154850 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb85ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb015d820 con 0x7f9c9c003a60 2023-10-09T13:16:12.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb85ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb015db00 con 0x7f9cb0153020 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb0154850 0x7f9cb0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb0154850 0x7f9cb0150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42754/0 (socket says 172.21.15.86:42754) 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 -- 172.21.15.86:0/383324417 learned_addr learned my addr 172.21.15.86:0/383324417 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb639b700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c003a60 0x7f9cb015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 -- 172.21.15.86:0/383324417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cb0153020 msgr2=0x7f9cb0154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cb0153020 0x7f9cb0154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 -- 172.21.15.86:0/383324417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c003a60 msgr2=0x7f9cb015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c003a60 0x7f9cb015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.979+0000 7f9cb6b9c700 1 -- 172.21.15.86:0/383324417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb015dde0 con 0x7f9cb0154850 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.980+0000 7f9cb6b9c700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb0154850 0x7f9cb0150de0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0069490 tx=0x7f9ca8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.980+0000 7f9ca67fc700 1 -- 172.21.15.86:0/383324417 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80032e0 con 0x7f9cb0154850 2023-10-09T13:16:12.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.980+0000 7f9ca67fc700 1 -- 172.21.15.86:0/383324417 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca8003440 con 0x7f9cb0154850 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.980+0000 7f9ca67fc700 1 -- 172.21.15.86:0/383324417 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80017d0 con 0x7f9cb0154850 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.980+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb0167df0 con 0x7f9cb0154850 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.980+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb0151320 con 0x7f9cb0154850 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.981+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb0167fe0 con 0x7f9cb0154850 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.982+0000 7f9ca67fc700 1 -- 172.21.15.86:0/383324417 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ca8001c00 con 0x7f9cb0154850 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.983+0000 7f9ca67fc700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c94066f30 0x7f9c940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.983+0000 7f9ca67fc700 1 -- 172.21.15.86:0/383324417 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7f9ca80845c0 con 0x7f9cb0154850 2023-10-09T13:16:12.986 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.983+0000 7f9cb639b700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c94066f30 0x7f9c940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:12.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.983+0000 7f9cb639b700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c94066f30 0x7f9c940693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c390 tx=0x7f9cac015000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:12.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:12.986+0000 7f9ca67fc700 1 -- 172.21.15.86:0/383324417 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ca8051690 con 0x7f9cb0154850 2023-10-09T13:16:13.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.178+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9cb004c3c0 con 0x7f9cb0154850 2023-10-09T13:16:13.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.182+0000 7f9ca67fc700 1 -- 172.21.15.86:0/383324417 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ca8054cb0 con 0x7f9cb0154850 2023-10-09T13:16:13.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c94066f30 msgr2=0x7f9c940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c94066f30 0x7f9c940693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00c390 tx=0x7f9cac015000 comp rx=0 tx=0).stop 2023-10-09T13:16:13.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb0154850 msgr2=0x7f9cb0150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb0154850 0x7f9cb0150de0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0069490 tx=0x7f9ca8009040 comp rx=0 tx=0).stop 2023-10-09T13:16:13.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 shutdown_connections 2023-10-09T13:16:13.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9c94066f30 0x7f9c940693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb0154850 0x7f9cb0150de0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c9c003a60 0x7f9cb015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 --2- 172.21.15.86:0/383324417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9cb0153020 0x7f9cb0154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.184+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 >> 172.21.15.86:0/383324417 conn(0x7f9cb0068e10 msgr2=0x7f9cb00c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:13.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.185+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 shutdown_connections 2023-10-09T13:16:13.187 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.185+0000 7f9cb85ff700 1 -- 172.21.15.86:0/383324417 wait complete. 2023-10-09T13:16:13.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-09T13:16:13.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.381+0000 7f6a8cfff700 1 Processor -- start 2023-10-09T13:16:13.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.382+0000 7f6a8cfff700 1 -- start start 2023-10-09T13:16:13.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.383+0000 7f6a8cfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 0x7f6a880ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.383+0000 7f6a8cfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a880cc300 con 0x7f6a880ccf90 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.383+0000 7f6a8cfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a880ad370 con 0x7f6a880b1420 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.383+0000 7f6a8cfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88156bf0 con 0x7f6a880cbf30 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.383+0000 7f6a7ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6a880ccf90 0x7f6a880b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49390/0 (socket says 172.21.15.86:49390) 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.383+0000 7f6a7ffff700 1 -- 172.21.15.86:0/2846136470 learned_addr learned my addr 172.21.15.86:0/2846136470 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.383+0000 7f6a8659c700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 0x7f6a880ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530559834 0 0) 0x7f6a880cc300 con 0x7f6a880ccf90 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a74003570 con 0x7f6a880ccf90 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276522622 0 0) 0x7f6a880ad370 con 0x7f6a880b1420 2023-10-09T13:16:13.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a880cc300 con 0x7f6a880b1420 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 35757395 0 0) 0x7f6a74003570 con 0x7f6a880ccf90 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 msgr2=0x7f6a880ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 0x7f6a880ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 >> v1:172.21.15.135:6789/0 conn(0x7f6a880b1420 legacy=0x7f6a880c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880ad650 con 0x7f6a880ccf90 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f6a70001470 con 0x7f6a880ccf90 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 >> v1:172.21.15.86:6789/0 conn(0x7f6a880ccf90 legacy=0x7f6a880b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 0x7f6a74003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a74004180 0x7f6a74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a74004d50 0x7f6a740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88156bf0 con 0x7f6a74004d50 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7400bba0 con 0x7f6a74004180 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7400bd60 con 0x7f6a880cbf30 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a86d9d700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a74004d50 0x7f6a740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a8659c700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 0x7f6a74003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.384+0000 7f6a7ffff700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a74004180 0x7f6a74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a86d9d700 1 -- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 msgr2=0x7f6a74003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a86d9d700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a880cbf30 0x7f6a74003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a86d9d700 1 -- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a74004180 msgr2=0x7f6a74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:13.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a86d9d700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a74004180 0x7f6a74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a86d9d700 1 -- 172.21.15.86:0/2846136470 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a74003570 con 0x7f6a74004d50 2023-10-09T13:16:13.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a86d9d700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a74004d50 0x7f6a740051c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f6a800020f0 tx=0x7f6a800017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932fa9416f65d3f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:13.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000c8b0 con 0x7f6a74004d50 2023-10-09T13:16:13.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000ca10 con 0x7f6a74004d50 2023-10-09T13:16:13.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.385+0000 7f6a85d9b700 1 -- 172.21.15.86:0/2846136470 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000cdb0 con 0x7f6a74004d50 2023-10-09T13:16:13.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.386+0000 7f6a8cfff700 1 -- 172.21.15.86:0/2846136470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a74004d50 msgr2=0x7f6a740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.386+0000 7f6a8cfff700 1 --2- 172.21.15.86:0/2846136470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a74004d50 0x7f6a740051c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f6a800020f0 tx=0x7f6a800017a0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.393 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.386+0000 7f6a86d9d700 1 -- 172.21.15.86:0/2846136470 reap_dead start 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.386+0000 7f6a8cfff700 1 -- 172.21.15.86:0/2846136470 shutdown_connections 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.386+0000 7f6a8cfff700 1 -- 172.21.15.86:0/2846136470 >> 172.21.15.86:0/2846136470 conn(0x7f6a8806a320 msgr2=0x7f6a880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.386+0000 7f6a8cfff700 1 -- 172.21.15.86:0/2846136470 shutdown_connections 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.386+0000 7f6a8cfff700 1 -- 172.21.15.86:0/2846136470 wait complete. 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.387+0000 7f6a8cfff700 1 Processor -- start 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.387+0000 7f6a8cfff700 1 -- start start 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.388+0000 7f6a8cfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a74004d50 0x7f6a880c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.388+0000 7f6a8cfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88156000 0x7f6a8814f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.388+0000 7f6a8cfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a880ab830 0x7f6a8814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.388+0000 7f6a8cfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880c5430 con 0x7f6a88156000 2023-10-09T13:16:13.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.388+0000 7f6a8cfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8814f7b0 con 0x7f6a880ab830 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.388+0000 7f6a8cfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88156500 con 0x7f6a74004d50 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.388+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88156000 0x7f6a8814f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88156000 0x7f6a8814f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42766/0 (socket says 172.21.15.86:42766) 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 -- 172.21.15.86:0/340523382 learned_addr learned my addr 172.21.15.86:0/340523382 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a86d9d700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a880ab830 0x7f6a8814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a8659c700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a74004d50 0x7f6a880c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 -- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a74004d50 msgr2=0x7f6a880c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a74004d50 0x7f6a880c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 -- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a880ab830 msgr2=0x7f6a8814c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a880ab830 0x7f6a8814c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 -- 172.21.15.86:0/340523382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880c5640 con 0x7f6a88156000 2023-10-09T13:16:13.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a86d9d700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a880ab830 0x7f6a8814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7ffff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88156000 0x7f6a8814f270 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f6a70007390 tx=0x7f6a70001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7e7fc700 1 -- 172.21.15.86:0/340523382 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a70018030 con 0x7f6a88156000 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7e7fc700 1 -- 172.21.15.86:0/340523382 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a70007800 con 0x7f6a88156000 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a7e7fc700 1 -- 172.21.15.86:0/340523382 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000fb00 con 0x7f6a88156000 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a880c5920 con 0x7f6a88156000 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.389+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a880c7b50 con 0x7f6a88156000 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.391+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a880c5e40 con 0x7f6a88156000 2023-10-09T13:16:13.396 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.391+0000 7f6a7e7fc700 1 -- 172.21.15.86:0/340523382 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a7001b070 con 0x7f6a88156000 2023-10-09T13:16:13.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.393+0000 7f6a7e7fc700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6a68066f30 0x7f6a680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:13.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.393+0000 7f6a7e7fc700 1 -- 172.21.15.86:0/340523382 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7f6a70019070 con 0x7f6a88156000 2023-10-09T13:16:13.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.393+0000 7f6a8659c700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6a68066f30 0x7f6a680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:13.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.393+0000 7f6a8659c700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6a68066f30 0x7f6a680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a78006f00 tx=0x7f6a78008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:13.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.397+0000 7f6a7e7fc700 1 -- 172.21.15.86:0/340523382 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a880c5e40 con 0x7f6a88156000 2023-10-09T13:16:13.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.666+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f6a880c5e40 con 0x7f6a88156000 2023-10-09T13:16:13.927 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.926+0000 7f6a7e7fc700 1 -- 172.21.15.86:0/340523382 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3065) v1 ==== 163+0+0 (secure 0 0 0) 0x7f6a880c5e40 con 0x7f6a88156000 2023-10-09T13:16:13.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.928+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6a68066f30 msgr2=0x7f6a680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.928+0000 7f6a8cfff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6a68066f30 0x7f6a680693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a78006f00 tx=0x7f6a78008040 comp rx=0 tx=0).stop 2023-10-09T13:16:13.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.928+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88156000 msgr2=0x7f6a8814f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:13.930 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.928+0000 7f6a8cfff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88156000 0x7f6a8814f270 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f6a70007390 tx=0x7f6a70001df0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 shutdown_connections 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6a68066f30 0x7f6a680693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a880ab830 0x7f6a8814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a74004d50 0x7f6a880c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 --2- 172.21.15.86:0/340523382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a88156000 0x7f6a8814f270 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 >> 172.21.15.86:0/340523382 conn(0x7f6a8806a320 msgr2=0x7f6a880c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 shutdown_connections 2023-10-09T13:16:13.931 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:13.929+0000 7f6a8cfff700 1 -- 172.21.15.86:0/340523382 wait complete. 2023-10-09T13:16:13.947 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-10-09T13:16:13.948 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-10-09T13:16:13.948 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-10-09T13:16:13.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-09T13:16:14.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.127+0000 7f4cd01ff700 1 Processor -- start 2023-10-09T13:16:14.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.127+0000 7f4cd01ff700 1 -- start start 2023-10-09T13:16:14.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cd01ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc81578b0 0x7f4cc8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:14.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cd01ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4cc80af2f0 0x7f4cc80af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:14.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cd01ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc80ad930 con 0x7f4cc8155c10 2023-10-09T13:16:14.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cd01ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc80b0c60 con 0x7f4cc80af2f0 2023-10-09T13:16:14.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cd01ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc80acd20 con 0x7f4cc81578b0 2023-10-09T13:16:14.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cce79c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4cc80af2f0 0x7f4cc80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:14.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4ccdf9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4cc8155c10 0x7f4cc80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:49394/0 (socket says 172.21.15.86:49394) 2023-10-09T13:16:14.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4ccdf9b700 1 -- 172.21.15.86:0/1029964563 learned_addr learned my addr 172.21.15.86:0/1029964563 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:14.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4ccd79a700 1 --2- 172.21.15.86:0/1029964563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc81578b0 0x7f4cc8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:14.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cce79c700 1 -- 172.21.15.86:0/1029964563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc81578b0 msgr2=0x7f4cc8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:14.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cce79c700 1 --2- 172.21.15.86:0/1029964563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc81578b0 0x7f4cc8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cce79c700 1 -- 172.21.15.86:0/1029964563 >> v1:172.21.15.86:6789/0 conn(0x7f4cc8155c10 legacy=0x7f4cc80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cce79c700 1 -- 172.21.15.86:0/1029964563 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc80ad000 con 0x7f4cc80af2f0 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4ccd79a700 1 --2- 172.21.15.86:0/1029964563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc81578b0 0x7f4cc8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.129+0000 7f4cccf99700 1 -- 172.21.15.86:0/1029964563 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836607404 0 0) 0x7f4cc80ad930 con 0x7f4cc8155c10 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.130+0000 7f4cce79c700 1 --2- 172.21.15.86:0/1029964563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc80af2f0 0x7f4cc80af710 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009e60 tx=0x7f4cc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18cdc2de766f934 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.130+0000 7f4cccf99700 1 -- 172.21.15.86:0/1029964563 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000e070 con 0x7f4cc80af2f0 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.130+0000 7f4cccf99700 1 -- 172.21.15.86:0/1029964563 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc000bc30 con 0x7f4cc80af2f0 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.130+0000 7f4cccf99700 1 -- 172.21.15.86:0/1029964563 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0012430 con 0x7f4cc80af2f0 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.130+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1029964563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc80af2f0 msgr2=0x7f4cc80af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.130+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1029964563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc80af2f0 0x7f4cc80af710 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009e60 tx=0x7f4cc0009780 comp rx=0 tx=0).stop 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.131+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1029964563 shutdown_connections 2023-10-09T13:16:14.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.131+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1029964563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc80af2f0 0x7f4cc80af710 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.131+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1029964563 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc81578b0 0x7f4cc8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.131+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1029964563 >> 172.21.15.86:0/1029964563 conn(0x7f4cc806a320 msgr2=0x7f4cc80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:14.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.131+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1029964563 shutdown_connections 2023-10-09T13:16:14.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.131+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1029964563 wait complete. 2023-10-09T13:16:14.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.132+0000 7f4cd01ff700 1 Processor -- start 2023-10-09T13:16:14.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.132+0000 7f4cd01ff700 1 -- start start 2023-10-09T13:16:14.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cd01ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc80af2f0 0x7f4cc80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:14.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cd01ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc8155c10 0x7f4cc8157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:14.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cd01ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc81578b0 0x7f4cc816b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cd01ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8151920 con 0x7f4cc81578b0 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cd01ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8150d10 con 0x7f4cc80af2f0 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cd01ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8150ff0 con 0x7f4cc8155c10 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cce79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc81578b0 0x7f4cc816b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.133+0000 7f4cce79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc81578b0 0x7f4cc816b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:42780/0 (socket says 172.21.15.86:42780) 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4ccdf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc80af2f0 0x7f4cc80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cce79c700 1 -- 172.21.15.86:0/1428803975 learned_addr learned my addr 172.21.15.86:0/1428803975 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4ccd79a700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc8155c10 0x7f4cc8157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cce79c700 1 -- 172.21.15.86:0/1428803975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc8155c10 msgr2=0x7f4cc8157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cce79c700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc8155c10 0x7f4cc8157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cce79c700 1 -- 172.21.15.86:0/1428803975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc80af2f0 msgr2=0x7f4cc80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:14.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cce79c700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc80af2f0 0x7f4cc80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cce79c700 1 -- 172.21.15.86:0/1428803975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc0009a20 con 0x7f4cc81578b0 2023-10-09T13:16:14.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cce79c700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc81578b0 0x7f4cc816b000 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8064290 tx=0x7f4cc0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:14.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cbdffb700 1 -- 172.21.15.86:0/1428803975 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0027470 con 0x7f4cc81578b0 2023-10-09T13:16:14.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cbdffb700 1 -- 172.21.15.86:0/1428803975 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc00275f0 con 0x7f4cc81578b0 2023-10-09T13:16:14.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cbdffb700 1 -- 172.21.15.86:0/1428803975 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00279b0 con 0x7f4cc81578b0 2023-10-09T13:16:14.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.134+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc81512d0 con 0x7f4cc81578b0 2023-10-09T13:16:14.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.135+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc80b06e0 con 0x7f4cc81578b0 2023-10-09T13:16:14.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.136+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc80b0900 con 0x7f4cc81578b0 2023-10-09T13:16:14.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.136+0000 7f4cbdffb700 1 -- 172.21.15.86:0/1428803975 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cc0024070 con 0x7f4cc81578b0 2023-10-09T13:16:14.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.137+0000 7f4cbdffb700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4cac066f30 0x7f4cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:14.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.137+0000 7f4cbdffb700 1 -- 172.21.15.86:0/1428803975 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7f4cc0086e50 con 0x7f4cc81578b0 2023-10-09T13:16:14.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.137+0000 7f4ccdf9b700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4cac066f30 0x7f4cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:14.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.138+0000 7f4ccdf9b700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4cac066f30 0x7f4cac0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4007fd0 tx=0x7f4cc4007d30 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:14.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.142+0000 7f4cbdffb700 1 -- 172.21.15.86:0/1428803975 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cc0053fc0 con 0x7f4cc81578b0 2023-10-09T13:16:14.406 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.405+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f4cc804c3c0 con 0x7f4cc81578b0 2023-10-09T13:16:14.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.927+0000 7f4cbdffb700 1 -- 172.21.15.86:0/1428803975 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3066) v1 ==== 158+0+0 (secure 0 0 0) 0x7f4cc00575e0 con 0x7f4cc81578b0 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4cac066f30 msgr2=0x7f4cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4cac066f30 0x7f4cac0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4007fd0 tx=0x7f4cc4007d30 comp rx=0 tx=0).stop 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc81578b0 msgr2=0x7f4cc816b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc81578b0 0x7f4cc816b000 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8064290 tx=0x7f4cc0019000 comp rx=0 tx=0).stop 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 shutdown_connections 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4cac066f30 0x7f4cac0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc81578b0 0x7f4cc816b000 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc80af2f0 0x7f4cc80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 --2- 172.21.15.86:0/1428803975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cc8155c10 0x7f4cc8157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 >> 172.21.15.86:0/1428803975 conn(0x7f4cc806a320 msgr2=0x7f4cc80cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:14.932 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 shutdown_connections 2023-10-09T13:16:14.933 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:14.930+0000 7f4cd01ff700 1 -- 172.21.15.86:0/1428803975 wait complete. 2023-10-09T13:16:14.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T13:16:15.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.132+0000 7f67555ff700 1 Processor -- start 2023-10-09T13:16:15.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.132+0000 7f67555ff700 1 -- start start 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.133+0000 7f67555ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67500c70b0 0x7f6750069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.133+0000 7f67555ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675006e950 con 0x7f6750069cb0 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.133+0000 7f67555ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675006eb90 con 0x7f6750155eb0 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.133+0000 7f67555ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675006a130 con 0x7f67500c70b0 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674e7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67500c70b0 0x7f6750069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6750069cb0 0x7f67500ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47094/0 (socket says 172.21.15.86:47094) 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674e7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67500c70b0 0x7f6750069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60610/0 (socket says 172.21.15.86:60610) 2023-10-09T13:16:15.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674f7fe700 1 -- 172.21.15.86:0/1730387090 learned_addr learned my addr 172.21.15.86:0/1730387090 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:15.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674e7fc700 1 -- 172.21.15.86:0/1730387090 >> v1:172.21.15.135:6789/0 conn(0x7f6750155eb0 legacy=0x7f675006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674e7fc700 1 -- 172.21.15.86:0/1730387090 >> v1:172.21.15.86:6789/0 conn(0x7f6750069cb0 legacy=0x7f67500ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674e7fc700 1 -- 172.21.15.86:0/1730387090 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675006ee70 con 0x7f67500c70b0 2023-10-09T13:16:15.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674dffb700 1 -- 172.21.15.86:0/1730387090 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235467739 0 0) 0x7f6748001490 con 0x7f6750069cb0 2023-10-09T13:16:15.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.134+0000 7f674e7fc700 1 --2- 172.21.15.86:0/1730387090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f6750069770 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f674400aa90 tx=0x7f674400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf6a3108abe5bab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:15.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f674dffb700 1 -- 172.21.15.86:0/1730387090 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674400ca00 con 0x7f67500c70b0 2023-10-09T13:16:15.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f674dffb700 1 -- 172.21.15.86:0/1730387090 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674400cb60 con 0x7f67500c70b0 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f674dffb700 1 -- 172.21.15.86:0/1730387090 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67440183f0 con 0x7f67500c70b0 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f67555ff700 1 -- 172.21.15.86:0/1730387090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 msgr2=0x7f6750069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f67555ff700 1 --2- 172.21.15.86:0/1730387090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f6750069770 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f674400aa90 tx=0x7f674400a330 comp rx=0 tx=0).stop 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f67555ff700 1 -- 172.21.15.86:0/1730387090 shutdown_connections 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f67555ff700 1 --2- 172.21.15.86:0/1730387090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f6750069770 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f67555ff700 1 -- 172.21.15.86:0/1730387090 >> 172.21.15.86:0/1730387090 conn(0x7f6750068e10 msgr2=0x7f67500cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f67555ff700 1 -- 172.21.15.86:0/1730387090 shutdown_connections 2023-10-09T13:16:15.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.135+0000 7f67555ff700 1 -- 172.21.15.86:0/1730387090 wait complete. 2023-10-09T13:16:15.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.137+0000 7f67555ff700 1 Processor -- start 2023-10-09T13:16:15.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.137+0000 7f67555ff700 1 -- start start 2023-10-09T13:16:15.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f67555ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6750069cb0 0x7f6750152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f67555ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f67500c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f67555ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6750155eb0 0x7f67500cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f67555ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500aa580 con 0x7f67500c70b0 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f67555ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750153240 con 0x7f6750155eb0 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f67555ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500a9970 con 0x7f6750069cb0 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f67500c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f67500c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60622/0 (socket says 172.21.15.86:60622) 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 -- 172.21.15.86:0/2995224284 learned_addr learned my addr 172.21.15.86:0/2995224284 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674f7fe700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6750155eb0 0x7f67500cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 -- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6750069cb0 msgr2=0x7f6750152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674effd700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6750069cb0 0x7f6750152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6750069cb0 0x7f6750152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 -- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6750155eb0 msgr2=0x7f67500cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6750155eb0 0x7f67500cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674e7fc700 1 -- 172.21.15.86:0/2995224284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674400a5d0 con 0x7f67500c70b0 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674effd700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6750069cb0 0x7f6750152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.138+0000 7f674f7fe700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6750155eb0 0x7f67500cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.139+0000 7f674e7fc700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f67500c3e90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f674400a5a0 tx=0x7f6744019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.139+0000 7f6736ffd700 1 -- 172.21.15.86:0/2995224284 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67440106d0 con 0x7f67500c70b0 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.139+0000 7f6736ffd700 1 -- 172.21.15.86:0/2995224284 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6744010830 con 0x7f67500c70b0 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.139+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67500a9c50 con 0x7f67500c70b0 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.139+0000 7f6736ffd700 1 -- 172.21.15.86:0/2995224284 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744010bf0 con 0x7f67500c70b0 2023-10-09T13:16:15.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.139+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67500aa210 con 0x7f67500c70b0 2023-10-09T13:16:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.140+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675004c3c0 con 0x7f67500c70b0 2023-10-09T13:16:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.141+0000 7f6736ffd700 1 -- 172.21.15.86:0/2995224284 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f674402a3b0 con 0x7f67500c70b0 2023-10-09T13:16:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.141+0000 7f6736ffd700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f673c066f30 0x7f673c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.142+0000 7f6736ffd700 1 -- 172.21.15.86:0/2995224284 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7f6744086110 con 0x7f67500c70b0 2023-10-09T13:16:15.143 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.142+0000 7f674effd700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f673c066f30 0x7f673c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.143+0000 7f674effd700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f673c066f30 0x7f673c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6740002790 tx=0x7f6740009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:15.147 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.146+0000 7f6736ffd700 1 -- 172.21.15.86:0/2995224284 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67440531e0 con 0x7f67500c70b0 2023-10-09T13:16:15.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.337+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f675006f150 con 0x7f67500c70b0 2023-10-09T13:16:15.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.341+0000 7f6736ffd700 1 -- 172.21.15.86:0/2995224284 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v70)=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6744056800 con 0x7f67500c70b0 2023-10-09T13:16:15.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f673c066f30 msgr2=0x7f673c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f673c066f30 0x7f673c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6740002790 tx=0x7f6740009040 comp rx=0 tx=0).stop 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 msgr2=0x7f67500c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f67500c3e90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f674400a5a0 tx=0x7f6744019000 comp rx=0 tx=0).stop 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 shutdown_connections 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f673c066f30 0x7f673c0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6750155eb0 0x7f67500cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6750069cb0 0x7f6750152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 --2- 172.21.15.86:0/2995224284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67500c70b0 0x7f67500c3e90 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 >> 172.21.15.86:0/2995224284 conn(0x7f6750068e10 msgr2=0x7f6750154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 shutdown_connections 2023-10-09T13:16:15.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.344+0000 7f67555ff700 1 -- 172.21.15.86:0/2995224284 wait complete. 2023-10-09T13:16:15.362 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T13:16:15.363 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:16:15.446 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:16:15.537 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T13:16:15.537 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T13:16:15.538 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:15.719 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.718+0000 7fe9c4bff700 1 Processor -- start 2023-10-09T13:16:15.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.718+0000 7fe9c4bff700 1 -- start start 2023-10-09T13:16:15.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.719+0000 7fe9c4bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9c0155c10 0x7fe9c0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.719+0000 7fe9c4bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c00ac230 0x7fe9c00ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9c4bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c00ad930 con 0x7fe9c01568a0 2023-10-09T13:16:15.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9c4bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c00acd20 con 0x7fe9c0155c10 2023-10-09T13:16:15.721 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9c4bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00ad000 con 0x7fe9c00ac230 2023-10-09T13:16:15.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9be59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9c0155c10 0x7fe9c0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9b7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c00ac230 0x7fe9c00ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9b7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c00ac230 0x7fe9c00ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:57574/0 (socket says 172.21.15.86:57574) 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9be59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9c0155c10 0x7fe9c0155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:51932/0 (socket says 172.21.15.86:51932) 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.720+0000 7fe9b7fff700 1 -- 172.21.15.86:0/1253022011 learned_addr learned my addr 172.21.15.86:0/1253022011 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9be59c700 1 -- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c00ac230 msgr2=0x7fe9c00ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9be59c700 1 --2- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c00ac230 0x7fe9c00ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9be59c700 1 -- 172.21.15.86:0/1253022011 >> v1:172.21.15.135:6789/0 conn(0x7fe9c01568a0 legacy=0x7fe9c0156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9be59c700 1 -- 172.21.15.86:0/1253022011 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00ad2e0 con 0x7fe9c0155c10 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9b7fff700 1 --2- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c00ac230 0x7fe9c00ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9be59c700 1 --2- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0155c10 0x7fe9c0155fe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00098e0 tx=0x7fe9b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9030272d51f9fb19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:15.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9bdd9b700 1 -- 172.21.15.86:0/1253022011 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b000b640 con 0x7fe9c0155c10 2023-10-09T13:16:15.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9bdd9b700 1 -- 172.21.15.86:0/1253022011 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b000b7a0 con 0x7fe9c0155c10 2023-10-09T13:16:15.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.721+0000 7fe9bdd9b700 1 -- 172.21.15.86:0/1253022011 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b000bb40 con 0x7fe9c0155c10 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 -- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0155c10 msgr2=0x7fe9c0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0155c10 0x7fe9c0155fe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00098e0 tx=0x7fe9b00091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 -- 172.21.15.86:0/1253022011 shutdown_connections 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0155c10 0x7fe9c0155fe0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/1253022011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c00ac230 0x7fe9c00ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 -- 172.21.15.86:0/1253022011 >> 172.21.15.86:0/1253022011 conn(0x7fe9c006a320 msgr2=0x7fe9c00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 -- 172.21.15.86:0/1253022011 shutdown_connections 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.722+0000 7fe9c4bff700 1 -- 172.21.15.86:0/1253022011 wait complete. 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.723+0000 7fe9c4bff700 1 Processor -- start 2023-10-09T13:16:15.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.724+0000 7fe9c4bff700 1 -- start start 2023-10-09T13:16:15.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9c4bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c00ac230 0x7fe9c0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9c4bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c0155c10 0x7fe9c016db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9c4bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c01568a0 0x7fe9c00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9c4bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00cc910 con 0x7fe9c01568a0 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9c4bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c016d690 con 0x7fe9c00ac230 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9c4bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c016e060 con 0x7fe9c0155c10 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c01568a0 0x7fe9c00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c01568a0 0x7fe9c00c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60624/0 (socket says 172.21.15.86:60624) 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 -- 172.21.15.86:0/3352429976 learned_addr learned my addr 172.21.15.86:0/3352429976 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9be59c700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c00ac230 0x7fe9c0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9b7fff700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c0155c10 0x7fe9c016db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 -- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c0155c10 msgr2=0x7fe9c016db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c0155c10 0x7fe9c016db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 -- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c00ac230 msgr2=0x7fe9c0151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c00ac230 0x7fe9c0151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.725+0000 7fe9bed9d700 1 -- 172.21.15.86:0/3352429976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a800b780 con 0x7fe9c01568a0 2023-10-09T13:16:15.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.726+0000 7fe9bed9d700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c01568a0 0x7fe9c00c7c00 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c840 tx=0x7fe9b8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:15.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.726+0000 7fe9b67fc700 1 -- 172.21.15.86:0/3352429976 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8012630 con 0x7fe9c01568a0 2023-10-09T13:16:15.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.726+0000 7fe9b67fc700 1 -- 172.21.15.86:0/3352429976 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b80127b0 con 0x7fe9c01568a0 2023-10-09T13:16:15.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.726+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b0009420 con 0x7fe9c01568a0 2023-10-09T13:16:15.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.726+0000 7fe9b67fc700 1 -- 172.21.15.86:0/3352429976 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8012b70 con 0x7fe9c01568a0 2023-10-09T13:16:15.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.726+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c00cc350 con 0x7fe9c01568a0 2023-10-09T13:16:15.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.727+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c016d800 con 0x7fe9c01568a0 2023-10-09T13:16:15.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.728+0000 7fe9b67fc700 1 -- 172.21.15.86:0/3352429976 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9b801a3a0 con 0x7fe9c01568a0 2023-10-09T13:16:15.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.729+0000 7fe9b67fc700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe9a0066f30 0x7fe9a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:15.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.729+0000 7fe9b67fc700 1 -- 172.21.15.86:0/3352429976 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7fe9b80847b0 con 0x7fe9c01568a0 2023-10-09T13:16:15.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.729+0000 7fe9be59c700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe9a0066f30 0x7fe9a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:15.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.729+0000 7fe9be59c700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe9a0066f30 0x7fe9a00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00093f0 tx=0x7fe9b0017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:15.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.733+0000 7fe9b67fc700 1 -- 172.21.15.86:0/3352429976 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9b8051880 con 0x7fe9c01568a0 2023-10-09T13:16:15.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.967+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9c004c3c0 con 0x7fe9c01568a0 2023-10-09T13:16:15.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.968+0000 7fe9b67fc700 1 -- 172.21.15.86:0/3352429976 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fe9b8054ea0 con 0x7fe9c01568a0 2023-10-09T13:16:15.970 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:15.970 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":88,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6834/768026503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6833","nonce":768026503},{"type":"v1","addr":"172.21.15.86:6834","nonce":768026503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/3285800945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3285800945},{"type":"v1","addr":"172.21.15.135:6834","nonce":3285800945}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9067,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3188349803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":3188349803},{"type":"v1","addr":"172.21.15.135:6835","nonce":3188349803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9666,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2491463129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2491463129},{"type":"v1","addr":"172.21.15.86:6835","nonce":2491463129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[]} 2023-10-09T13:16:15.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.970+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe9a0066f30 msgr2=0x7fe9a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.970+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe9a0066f30 0x7fe9a00693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00093f0 tx=0x7fe9b0017000 comp rx=0 tx=0).stop 2023-10-09T13:16:15.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.970+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c01568a0 msgr2=0x7fe9c00c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:15.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.970+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c01568a0 0x7fe9c00c7c00 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c840 tx=0x7fe9b8001670 comp rx=0 tx=0).stop 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 shutdown_connections 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe9a0066f30 0x7fe9a00693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c01568a0 0x7fe9c00c7c00 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c00ac230 0x7fe9c0151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 --2- 172.21.15.86:0/3352429976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9c0155c10 0x7fe9c016db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 >> 172.21.15.86:0/3352429976 conn(0x7fe9c006a320 msgr2=0x7fe9c00b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 shutdown_connections 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:15.971+0000 7fe9c4bff700 1 -- 172.21.15.86:0/3352429976 wait complete. 2023-10-09T13:16:15.973 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 88 2023-10-09T13:16:15.990 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T13:16:15.990 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T13:16:15.990 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T13:16:15.990 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:16:15.990 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T13:16:15.991 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T13:16:15.991 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T13:16:15.991 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:16:15.991 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T13:16:15.991 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T13:16:15.991 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T13:16:15.991 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:16:15.992 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T13:16:15.992 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T13:16:15.992 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T13:16:15.992 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:16:16.003 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T13:16:16.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T13:16:16.005 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T13:16:16.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T13:16:16.011 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T13:16:16.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T13:16:16.012 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T13:16:16.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T13:16:16.049 INFO:tasks.ceph.mds.a:Started 2023-10-09T13:16:16.049 DEBUG:teuthology.parallel:result is None 2023-10-09T13:16:16.052 INFO:tasks.ceph.mds.c:Started 2023-10-09T13:16:16.052 DEBUG:teuthology.parallel:result is None 2023-10-09T13:16:16.056 INFO:tasks.ceph.mds.b:Started 2023-10-09T13:16:16.057 DEBUG:teuthology.parallel:result is None 2023-10-09T13:16:16.059 INFO:tasks.ceph.mds.d:Started 2023-10-09T13:16:16.059 DEBUG:teuthology.parallel:result is None 2023-10-09T13:16:16.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T13:16:16.182 INFO:tasks.ceph.mds.a.smithi086.stdout:starting mds.a at 2023-10-09T13:16:16.186 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T13:16:16.196 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-09T13:16:16.196 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-09T13:16:16.198 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-10-09T13:16:16.197+0000 7f68c43fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-09T13:16:16.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.252+0000 7f896cdff700 1 Processor -- start 2023-10-09T13:16:16.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.252+0000 7f896cdff700 1 -- start start 2023-10-09T13:16:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.253+0000 7f896cdff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f89680cbf30 0x7f89680ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.253+0000 7f896cdff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89680ccf90 0x7f89680b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.253+0000 7f896cdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f896815a270 0x7f89680b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.253+0000 7f896cdff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8968156bf0 con 0x7f89680ccf90 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.253+0000 7f896cdff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89680ae950 con 0x7f89680cbf30 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.253+0000 7f896cdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89680cc300 con 0x7f896815a270 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.253+0000 7f8965d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89680ccf90 0x7f89680b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f8965d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89680ccf90 0x7f89680b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60666/0 (socket says 172.21.15.86:60666) 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896659c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f89680cbf30 0x7f89680ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f8965d9b700 1 -- 172.21.15.86:0/19411534 learned_addr learned my addr 172.21.15.86:0/19411534 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f8966d9d700 1 --2- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f896815a270 0x7f89680b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896659c700 1 -- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f896815a270 msgr2=0x7f89680b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896659c700 1 --2- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f896815a270 0x7f89680b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896659c700 1 -- 172.21.15.86:0/19411534 >> v2:172.21.15.86:3300/0 conn(0x7f89680ccf90 msgr2=0x7f89680b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:16.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896659c700 1 --2- 172.21.15.86:0/19411534 >> v2:172.21.15.86:3300/0 conn(0x7f89680ccf90 0x7f89680b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896659c700 1 -- 172.21.15.86:0/19411534 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89680ad370 con 0x7f89680cbf30 2023-10-09T13:16:16.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f8965d9b700 1 --2- 172.21.15.86:0/19411534 >> v2:172.21.15.86:3300/0 conn(0x7f89680ccf90 0x7f89680b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:16.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896659c700 1 --2- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89680cbf30 0x7f89680ae410 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8968063d40 tx=0x7f89580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c847162644e536e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.254+0000 7f896559a700 1 -- 172.21.15.86:0/19411534 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800f6b0 con 0x7f89680cbf30 2023-10-09T13:16:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896559a700 1 -- 172.21.15.86:0/19411534 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800f830 con 0x7f89680cbf30 2023-10-09T13:16:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896559a700 1 -- 172.21.15.86:0/19411534 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800fbf0 con 0x7f89680cbf30 2023-10-09T13:16:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 -- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89680cbf30 msgr2=0x7f89680ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 --2- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89680cbf30 0x7f89680ae410 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8968063d40 tx=0x7f89580091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 -- 172.21.15.86:0/19411534 shutdown_connections 2023-10-09T13:16:16.258 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 --2- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f896815a270 0x7f89680b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 --2- 172.21.15.86:0/19411534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89680cbf30 0x7f89680ae410 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 --2- 172.21.15.86:0/19411534 >> v2:172.21.15.86:3300/0 conn(0x7f89680ccf90 0x7f89680b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 -- 172.21.15.86:0/19411534 >> 172.21.15.86:0/19411534 conn(0x7f896806a320 msgr2=0x7f89680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:16.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 -- 172.21.15.86:0/19411534 shutdown_connections 2023-10-09T13:16:16.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.255+0000 7f896cdff700 1 -- 172.21.15.86:0/19411534 wait complete. 2023-10-09T13:16:16.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.257+0000 7f896cdff700 1 Processor -- start 2023-10-09T13:16:16.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.257+0000 7f896cdff700 1 -- start start 2023-10-09T13:16:16.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.257+0000 7f896cdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89680cbf30 0x7f8968153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:16.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.257+0000 7f896cdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89680ccf90 0x7f89680aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:16.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.257+0000 7f896cdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f896815a270 0x7f89680a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:16.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f896cdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680a9940 con 0x7f89680ccf90 2023-10-09T13:16:16.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f896cdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680aa7a0 con 0x7f896815a270 2023-10-09T13:16:16.261 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f896cdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89680a8d40 con 0x7f89680cbf30 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89680ccf90 0x7f89680aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89680ccf90 0x7f89680aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60680/0 (socket says 172.21.15.86:60680) 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 -- 172.21.15.86:0/4061233459 learned_addr learned my addr 172.21.15.86:0/4061233459 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8966d9d700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f896815a270 0x7f89680a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f896659c700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89680cbf30 0x7f8968153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 -- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89680cbf30 msgr2=0x7f8968153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89680cbf30 0x7f8968153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 -- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f896815a270 msgr2=0x7f89680a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f896815a270 0x7f89680a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 -- 172.21.15.86:0/4061233459 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c0094f0 con 0x7f89680ccf90 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f896659c700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89680cbf30 0x7f8968153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:16.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8966d9d700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f896815a270 0x7f89680a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.258+0000 7f8965d9b700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89680ccf90 0x7f89680aca40 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f895c00ec50 tx=0x7f895c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.259+0000 7f89567fc700 1 -- 172.21.15.86:0/4061233459 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00c850 con 0x7f89680ccf90 2023-10-09T13:16:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.259+0000 7f89567fc700 1 -- 172.21.15.86:0/4061233459 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00c9b0 con 0x7f89680ccf90 2023-10-09T13:16:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.259+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8958009420 con 0x7f89680ccf90 2023-10-09T13:16:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.259+0000 7f89567fc700 1 -- 172.21.15.86:0/4061233459 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00cd50 con 0x7f89680ccf90 2023-10-09T13:16:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.259+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89680a9e70 con 0x7f89680ccf90 2023-10-09T13:16:16.263 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.260+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89680aa910 con 0x7f89680ccf90 2023-10-09T13:16:16.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.261+0000 7f89567fc700 1 -- 172.21.15.86:0/4061233459 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f895c013680 con 0x7f89680ccf90 2023-10-09T13:16:16.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.262+0000 7f89567fc700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:16.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.262+0000 7f89567fc700 1 -- 172.21.15.86:0/4061233459 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5959+0+0 (secure 0 0 0) 0x7f895c084750 con 0x7f89680ccf90 2023-10-09T13:16:16.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.262+0000 7f896659c700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:16.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.263+0000 7f896659c700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8948066f30 0x7f89480693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89580093f0 tx=0x7f8958019000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:16.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.266+0000 7f89567fc700 1 -- 172.21.15.86:0/4061233459 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f895c051820 con 0x7f89680ccf90 2023-10-09T13:16:16.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:16.476+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f896804c3c0 con 0x7f89680ccf90 2023-10-09T13:16:17.362 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.360+0000 7f89567fc700 1 -- 172.21.15.86:0/4061233459 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v208) v1 ==== 97+0+0 (secure 0 0 0) 0x7f895c054e40 con 0x7f89680ccf90 2023-10-09T13:16:17.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8948066f30 msgr2=0x7f89480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8948066f30 0x7f89480693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89580093f0 tx=0x7f8958019000 comp rx=0 tx=0).stop 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89680ccf90 msgr2=0x7f89680aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89680ccf90 0x7f89680aca40 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f895c00ec50 tx=0x7f895c009250 comp rx=0 tx=0).stop 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 shutdown_connections 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f896815a270 0x7f89680a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89680cbf30 0x7f8968153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 --2- 172.21.15.86:0/4061233459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89680ccf90 0x7f89680aca40 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 >> 172.21.15.86:0/4061233459 conn(0x7f896806a320 msgr2=0x7f89680c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 shutdown_connections 2023-10-09T13:16:17.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.363+0000 7f896cdff700 1 -- 172.21.15.86:0/4061233459 wait complete. 2023-10-09T13:16:17.366 INFO:teuthology.orchestra.run.smithi086.stderr: removed all blocklist entries 2023-10-09T13:16:17.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T13:16:17.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.564+0000 7f71821ff700 1 Processor -- start 2023-10-09T13:16:17.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.564+0000 7f71821ff700 1 -- start start 2023-10-09T13:16:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.565+0000 7f71821ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 0x7f717c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.565+0000 7f71821ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f717c0ac230 0x7f717c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.565+0000 7f71821ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0ad930 con 0x7f717c1568a0 2023-10-09T13:16:17.567 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.565+0000 7f71821ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c0acd20 con 0x7f717c0ac230 2023-10-09T13:16:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.565+0000 7f71821ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0ad000 con 0x7f717c155c10 2023-10-09T13:16:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f717c1568a0 0x7f717c156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47118/0 (socket says 172.21.15.86:47118) 2023-10-09T13:16:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717bfff700 1 -- 172.21.15.86:0/1712666646 learned_addr learned my addr 172.21.15.86:0/1712666646 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717b7fe700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 0x7f717c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f7173fff700 1 --2- 172.21.15.86:0/1712666646 >> v2:172.21.15.135:3300/0 conn(0x7f717c0ac230 0x7f717c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731696418 0 0) 0x7f717c0ad930 con 0x7f717c1568a0 2023-10-09T13:16:17.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7168003570 con 0x7f717c1568a0 2023-10-09T13:16:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173431198 0 0) 0x7f7168003570 con 0x7f717c1568a0 2023-10-09T13:16:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 msgr2=0x7f717c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:17.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.566+0000 7f717affd700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 0x7f717c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 >> v2:172.21.15.135:3300/0 conn(0x7f717c0ac230 msgr2=0x7f717c0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 --2- 172.21.15.86:0/1712666646 >> v2:172.21.15.135:3300/0 conn(0x7f717c0ac230 0x7f717c0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0ad2e0 con 0x7f717c1568a0 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f71740017f0 con 0x7f717c1568a0 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 >> v1:172.21.15.86:6789/0 conn(0x7f717c1568a0 legacy=0x7f717c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 0x7f7168003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7168004010 0x7f7168004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004d50 0x7f71680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0acd20 con 0x7f7168004010 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0ad000 con 0x7f7168004d50 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716800dcc0 con 0x7f717c155c10 2023-10-09T13:16:17.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f7173fff700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7168004010 0x7f7168004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717bfff700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004d50 0x7f71680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717b7fe700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 0x7f7168003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f7173fff700 1 -- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 msgr2=0x7f7168003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f7173fff700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 0x7f7168003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f7173fff700 1 -- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004d50 msgr2=0x7f71680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f7173fff700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004d50 0x7f71680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f7173fff700 1 -- 172.21.15.86:0/1712666646 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168003570 con 0x7f7168004010 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717bfff700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004d50 0x7f71680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.567+0000 7f717b7fe700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c155c10 0x7f7168003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f7173fff700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7168004010 0x7f7168004810 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f7164009c00 tx=0x7f71640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389b6af7e4aa910d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400e710 con 0x7f7168004010 2023-10-09T13:16:17.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400e870 con 0x7f7168004010 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f717affd700 1 -- 172.21.15.86:0/1712666646 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400ec30 con 0x7f7168004010 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f71821ff700 1 -- 172.21.15.86:0/1712666646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7168004010 msgr2=0x7f7168004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f71821ff700 1 --2- 172.21.15.86:0/1712666646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7168004010 0x7f7168004810 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f7164009c00 tx=0x7f71640091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f717bfff700 1 -- 172.21.15.86:0/1712666646 reap_dead start 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f71821ff700 1 -- 172.21.15.86:0/1712666646 shutdown_connections 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f71821ff700 1 -- 172.21.15.86:0/1712666646 >> 172.21.15.86:0/1712666646 conn(0x7f717c06a320 msgr2=0x7f717c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f71821ff700 1 -- 172.21.15.86:0/1712666646 shutdown_connections 2023-10-09T13:16:17.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.568+0000 7f71821ff700 1 -- 172.21.15.86:0/1712666646 wait complete. 2023-10-09T13:16:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.570+0000 7f71821ff700 1 Processor -- start 2023-10-09T13:16:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.570+0000 7f71821ff700 1 -- start start 2023-10-09T13:16:17.575 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f71821ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004010 0x7f717c13d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f71821ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c1596b0 0x7f717c157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f71821ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f717c158040 0x7f717c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f71821ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c159220 con 0x7f717c158040 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f71821ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c158610 con 0x7f7168004010 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f71821ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c1588f0 con 0x7f717c1596b0 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f717c158040 0x7f717c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f717c158040 0x7f717c154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60702/0 (socket says 172.21.15.86:60702) 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 -- 172.21.15.86:0/3284441129 learned_addr learned my addr 172.21.15.86:0/3284441129 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717b7fe700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004010 0x7f717c13d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f7173fff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c1596b0 0x7f717c157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 -- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c1596b0 msgr2=0x7f717c157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.576 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c1596b0 0x7f717c157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 -- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004010 msgr2=0x7f717c13d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004010 0x7f717c13d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.571+0000 7f717bfff700 1 -- 172.21.15.86:0/3284441129 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c158bd0 con 0x7f717c158040 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.572+0000 7f717bfff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f717c158040 0x7f717c154570 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f7174002250 tx=0x7f717c0ad8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.572+0000 7f71737fe700 1 -- 172.21.15.86:0/3284441129 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174007b60 con 0x7f717c158040 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.572+0000 7f71737fe700 1 -- 172.21.15.86:0/3284441129 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717400ebc0 con 0x7f717c158040 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.572+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c158eb0 con 0x7f717c158040 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.572+0000 7f71737fe700 1 -- 172.21.15.86:0/3284441129 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174013420 con 0x7f717c158040 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.572+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c159d60 con 0x7f717c158040 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.573+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c06bad0 con 0x7f717c158040 2023-10-09T13:16:17.577 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.574+0000 7f71737fe700 1 -- 172.21.15.86:0/3284441129 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7174013850 con 0x7f717c158040 2023-10-09T13:16:17.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.575+0000 7f71737fe700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f715c066f30 0x7f715c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:17.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.575+0000 7f71737fe700 1 -- 172.21.15.86:0/3284441129 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f7174084870 con 0x7f717c158040 2023-10-09T13:16:17.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.575+0000 7f717b7fe700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f715c066f30 0x7f715c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:17.578 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.575+0000 7f717b7fe700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f715c066f30 0x7f715c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f716c009d70 tx=0x7f716c008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:17.580 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.579+0000 7f71737fe700 1 -- 172.21.15.86:0/3284441129 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7174051c60 con 0x7f717c158040 2023-10-09T13:16:17.841 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.840+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f717c04c3c0 con 0x7f717c158040 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.840+0000 7f71737fe700 1 -- 172.21.15.86:0/3284441129 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v53) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7174055280 con 0x7f717c158040 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stdout: "auth_dump": [ 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.a", 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlq+9MFxAAU0kHLImks0/nP9G+t2T0Sw==", 2023-10-09T13:16:17.842 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.b", 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlTp9MLBAAX/hDsRKAHJK5Dnvz7u7EyQ==", 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.843 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.c", 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlNwOdIRAAtGRbGk+a2LlVpFSultzN/w==", 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mds.d", 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlrW58NxAASpX0X5NFfOnMT+wz0O81tg==", 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.0", 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCe5iNl05MMLRAAaZeVbhX0HsvPRBMb5B7prA==", 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.1", 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCh5iNlVNXILxAA3q7wfUvBhlGQEAsFJ3dClg==", 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.846 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.2", 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCk5iNlf6t8MRAAqN31AowG1qhyx8dAU6aumQ==", 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.3", 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCn5iNl+aA3NxAA7tYLv8yp+KxZAIiji2ke1Q==", 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.4", 2023-10-09T13:16:17.848 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCu5iNla2qhCRAAp4bmLDbPQIKW1vMj4HeunA==", 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.5", 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCx5iNlWVrJDxAAj+wpk35mE+qemko4tSBvBQ==", 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.849 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.6", 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC05iNlOeqKFRAAbjYD483vDgcWkMxbJodJiQ==", 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "osd.7", 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQC35iNlZeJrGxAAqvncCfhnbi3dh3DpiNJS4Q==", 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow profile osd", 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile osd", 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.0", 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlV7DRBBAAbpcMSgs51cdRjtWRcya+gw==", 2023-10-09T13:16:17.851 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow r", 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.1", 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlFh9xEhAAw7WT3y1Go9XEGSmvHb85Pw==", 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T13:16:17.852 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.2", 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlhJ6NCxAAKgHaoSbhaX+xi1ru8ajC9Q==", 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.3", 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCb5iNlBKBMGRAAF/lPSsq62/i41K6OtIvfdA==", 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow", 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow r", 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow rw", 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow rwx" 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.854 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "client.admin", 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCZ5iNl+8sfIRAAhfOs7kFIdfDhoxFpW4wrHA==", 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "mgr": "allow *", 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow *", 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.x", 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNlk35bEBAAxcQOkeUI1fT4kVrQfGSpGg==", 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.855 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": "mgr.y", 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "key": "AQCa5iNl9GPGCBAASC/2Ye05WDUD2uj1WsJskQ==", 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": { 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": "allow *", 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "mon": "allow profile mgr", 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: "osd": "allow *" 2023-10-09T13:16:17.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.857 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:17.857 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-09T13:16:17.857 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f715c066f30 msgr2=0x7f715c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f715c066f30 0x7f715c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f716c009d70 tx=0x7f716c008040 comp rx=0 tx=0).stop 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f717c158040 msgr2=0x7f717c154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f717c158040 0x7f717c154570 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f7174002250 tx=0x7f717c0ad8a0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 shutdown_connections 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f715c066f30 0x7f715c0693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f717c158040 0x7f717c154570 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7168004010 0x7f717c13d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 --2- 172.21.15.86:0/3284441129 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f717c1596b0 0x7f717c157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:17.858 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 >> 172.21.15.86:0/3284441129 conn(0x7f717c06a320 msgr2=0x7f717c06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:17.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 shutdown_connections 2023-10-09T13:16:17.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:17.843+0000 7f71821ff700 1 -- 172.21.15.86:0/3284441129 wait complete. 2023-10-09T13:16:17.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:18.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.043+0000 7fe43db9d700 1 Processor -- start 2023-10-09T13:16:18.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.043+0000 7fe43db9d700 1 -- start start 2023-10-09T13:16:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43db9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe438157270 0x7fe438068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.046 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43db9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380688d0 0x7fe4380b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43db9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4380b0a00 0x7fe43806a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43db9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43815a980 con 0x7fe4380b0a00 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43db9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe438068d20 con 0x7fe438157270 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43db9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43815a050 con 0x7fe4380688d0 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43d39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4380b0a00 0x7fe43806a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43d39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4380b0a00 0x7fe43806a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60716/0 (socket says 172.21.15.86:60716) 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.044+0000 7fe43d39c700 1 -- 172.21.15.86:0/4274196947 learned_addr learned my addr 172.21.15.86:0/4274196947 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe437fff700 1 --2- 172.21.15.86:0/4274196947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380688d0 0x7fe4380b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe43cb9b700 1 --2- 172.21.15.86:0/4274196947 >> v2:172.21.15.135:3300/0 conn(0x7fe438157270 0x7fe438068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe43d39c700 1 -- 172.21.15.86:0/4274196947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380688d0 msgr2=0x7fe4380b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:18.047 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe43d39c700 1 --2- 172.21.15.86:0/4274196947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380688d0 0x7fe4380b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe43d39c700 1 -- 172.21.15.86:0/4274196947 >> v2:172.21.15.135:3300/0 conn(0x7fe438157270 msgr2=0x7fe438068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe43d39c700 1 --2- 172.21.15.86:0/4274196947 >> v2:172.21.15.135:3300/0 conn(0x7fe438157270 0x7fe438068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe43d39c700 1 -- 172.21.15.86:0/4274196947 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43815a330 con 0x7fe4380b0a00 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe437fff700 1 --2- 172.21.15.86:0/4274196947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380688d0 0x7fe4380b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe43d39c700 1 --2- 172.21.15.86:0/4274196947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380b0a00 0x7fe43806a7e0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b3360 tx=0x7fe430009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73b87466d71fd9d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe4377fe700 1 -- 172.21.15.86:0/4274196947 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000e070 con 0x7fe4380b0a00 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe4377fe700 1 -- 172.21.15.86:0/4274196947 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000ba50 con 0x7fe4380b0a00 2023-10-09T13:16:18.048 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.045+0000 7fe4377fe700 1 -- 172.21.15.86:0/4274196947 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4300092e0 con 0x7fe4380b0a00 2023-10-09T13:16:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 -- 172.21.15.86:0/4274196947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380b0a00 msgr2=0x7fe43806a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 --2- 172.21.15.86:0/4274196947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380b0a00 0x7fe43806a7e0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b3360 tx=0x7fe430009840 comp rx=0 tx=0).stop 2023-10-09T13:16:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 -- 172.21.15.86:0/4274196947 shutdown_connections 2023-10-09T13:16:18.049 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 --2- 172.21.15.86:0/4274196947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380b0a00 0x7fe43806a7e0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 --2- 172.21.15.86:0/4274196947 >> v2:172.21.15.135:3300/0 conn(0x7fe438157270 0x7fe438068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 --2- 172.21.15.86:0/4274196947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380688d0 0x7fe4380b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 -- 172.21.15.86:0/4274196947 >> 172.21.15.86:0/4274196947 conn(0x7fe4380cd310 msgr2=0x7fe4380cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:18.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 -- 172.21.15.86:0/4274196947 shutdown_connections 2023-10-09T13:16:18.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.046+0000 7fe43db9d700 1 -- 172.21.15.86:0/4274196947 wait complete. 2023-10-09T13:16:18.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.048+0000 7fe43db9d700 1 Processor -- start 2023-10-09T13:16:18.050 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.048+0000 7fe43db9d700 1 -- start start 2023-10-09T13:16:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43db9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380688d0 0x7fe4381698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43db9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380b0a00 0x7fe4381510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43db9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe438157270 0x7fe438155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43db9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43815bc60 con 0x7fe4380688d0 2023-10-09T13:16:18.052 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43db9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380aa720 con 0x7fe438157270 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43db9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380aaa00 con 0x7fe4380b0a00 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380688d0 0x7fe4381698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380688d0 0x7fe4381698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60728/0 (socket says 172.21.15.86:60728) 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 -- 172.21.15.86:0/744274815 learned_addr learned my addr 172.21.15.86:0/744274815 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe437fff700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380b0a00 0x7fe4381510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43d39c700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe438157270 0x7fe438155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 -- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380b0a00 msgr2=0x7fe4381510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380b0a00 0x7fe4381510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 -- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe438157270 msgr2=0x7fe438155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe438157270 0x7fe438155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 -- 172.21.15.86:0/744274815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009ae0 con 0x7fe4380688d0 2023-10-09T13:16:18.053 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.049+0000 7fe43cb9b700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380688d0 0x7fe4381698b0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00d890 tx=0x7fe42c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.050+0000 7fe434ff9700 1 -- 172.21.15.86:0/744274815 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c009610 con 0x7fe4380688d0 2023-10-09T13:16:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.050+0000 7fe434ff9700 1 -- 172.21.15.86:0/744274815 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c009770 con 0x7fe4380688d0 2023-10-09T13:16:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.050+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43815d090 con 0x7fe4380688d0 2023-10-09T13:16:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.050+0000 7fe434ff9700 1 -- 172.21.15.86:0/744274815 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c009b30 con 0x7fe4380688d0 2023-10-09T13:16:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.050+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43816a190 con 0x7fe4380688d0 2023-10-09T13:16:18.054 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.051+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4380aace0 con 0x7fe4380688d0 2023-10-09T13:16:18.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.052+0000 7fe434ff9700 1 -- 172.21.15.86:0/744274815 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe42c01e460 con 0x7fe4380688d0 2023-10-09T13:16:18.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.052+0000 7fe434ff9700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe41c066f30 0x7fe41c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.052+0000 7fe434ff9700 1 -- 172.21.15.86:0/744274815 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fe42c084a70 con 0x7fe4380688d0 2023-10-09T13:16:18.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.053+0000 7fe437fff700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe41c066f30 0x7fe41c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.055 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.053+0000 7fe437fff700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe41c066f30 0x7fe41c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe424006f00 tx=0x7fe424008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.057 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.056+0000 7fe434ff9700 1 -- 172.21.15.86:0/744274815 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe42c051da0 con 0x7fe4380688d0 2023-10-09T13:16:18.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.247+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe43804c3c0 con 0x7fe4380688d0 2023-10-09T13:16:18.249 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.248+0000 7fe434ff9700 1 -- 172.21.15.86:0/744274815 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+12970 (secure 0 0 0) 0x7fe42c0553c0 con 0x7fe4380688d0 2023-10-09T13:16:18.249 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:18.250 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":208,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:17.355657+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:18.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe41c066f30 msgr2=0x7fe41c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe41c066f30 0x7fe41c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe424006f00 tx=0x7fe424008040 comp rx=0 tx=0).stop 2023-10-09T13:16:18.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380688d0 msgr2=0x7fe4381698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380688d0 0x7fe4381698b0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00d890 tx=0x7fe42c008040 comp rx=0 tx=0).stop 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 shutdown_connections 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe41c066f30 0x7fe41c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4380688d0 0x7fe4381698b0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe438157270 0x7fe438155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 --2- 172.21.15.86:0/744274815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4380b0a00 0x7fe4381510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 >> 172.21.15.86:0/744274815 conn(0x7fe4380cd310 msgr2=0x7fe438152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 shutdown_connections 2023-10-09T13:16:18.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.251+0000 7fe43db9d700 1 -- 172.21.15.86:0/744274815 wait complete. 2023-10-09T13:16:18.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T13:16:18.270 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T13:16:18.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.454+0000 7f2ad2fff700 1 Processor -- start 2023-10-09T13:16:18.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.454+0000 7f2ad2fff700 1 -- start start 2023-10-09T13:16:18.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.455+0000 7f2ad2fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2acc0c83f0 0x7f2acc0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.455+0000 7f2ad2fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2acc0ccee0 0x7f2acc1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.457 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.455+0000 7f2ad2fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc15b0d0 con 0x7f2acc0c87c0 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.455+0000 7f2ad2fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc0c7a60 con 0x7f2acc0ccee0 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.455+0000 7f2ad2fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc15a4c0 con 0x7f2acc0c83f0 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2acbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2acc0ccee0 0x7f2acc1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2acbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2acc0ccee0 0x7f2acc1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60734/0 (socket says 172.21.15.86:60734) 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2acbfff700 1 -- 172.21.15.86:0/1400609628 learned_addr learned my addr 172.21.15.86:0/1400609628 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2ad0d9b700 1 --2- 172.21.15.86:0/1400609628 >> v2:172.21.15.135:3300/0 conn(0x7f2acc0c83f0 0x7f2acc0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2acbfff700 1 -- 172.21.15.86:0/1400609628 >> v2:172.21.15.135:3300/0 conn(0x7f2acc0c83f0 msgr2=0x7f2acc0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2acbfff700 1 --2- 172.21.15.86:0/1400609628 >> v2:172.21.15.135:3300/0 conn(0x7f2acc0c83f0 0x7f2acc0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2acbfff700 1 -- 172.21.15.86:0/1400609628 >> v1:172.21.15.135:6789/0 conn(0x7f2acc0c87c0 legacy=0x7f2acc06eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:18.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.456+0000 7f2acbfff700 1 -- 172.21.15.86:0/1400609628 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc15a7a0 con 0x7f2acc0ccee0 2023-10-09T13:16:18.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2acbfff700 1 --2- 172.21.15.86:0/1400609628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc1561d0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0c9fd0 tx=0x7f2ab8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824d4627b53ecf1e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2acb7fe700 1 -- 172.21.15.86:0/1400609628 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8009e70 con 0x7f2acc0ccee0 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2acb7fe700 1 -- 172.21.15.86:0/1400609628 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800b860 con 0x7f2acc0ccee0 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2acb7fe700 1 -- 172.21.15.86:0/1400609628 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800bc00 con 0x7f2acc0ccee0 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1400609628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 msgr2=0x7f2acc1561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1400609628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc1561d0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0c9fd0 tx=0x7f2ab8009250 comp rx=0 tx=0).stop 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1400609628 shutdown_connections 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1400609628 >> v2:172.21.15.135:3300/0 conn(0x7f2acc0c83f0 0x7f2acc0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1400609628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc1561d0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.457+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1400609628 >> 172.21.15.86:0/1400609628 conn(0x7f2acc068e10 msgr2=0x7f2acc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.458+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1400609628 shutdown_connections 2023-10-09T13:16:18.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.458+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1400609628 wait complete. 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.459+0000 7f2ad2fff700 1 Processor -- start 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.459+0000 7f2ad2fff700 1 -- start start 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad2fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2acc0c83f0 0x7f2acc0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad2fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2acc0c87c0 0x7f2acc0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad2fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad2fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0c4860 con 0x7f2acc0ccee0 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad2fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc1533f0 con 0x7f2acc0c83f0 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad2fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0c3ce0 con 0x7f2acc0c87c0 2023-10-09T13:16:18.462 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60738/0 (socket says 172.21.15.86:60738) 2023-10-09T13:16:18.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.460+0000 7f2ad159c700 1 -- 172.21.15.86:0/1504900064 learned_addr learned my addr 172.21.15.86:0/1504900064 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:18.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ad0d9b700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2acc0c83f0 0x7f2acc0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2acbfff700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2acc0c87c0 0x7f2acc0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ad159c700 1 -- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2acc0c87c0 msgr2=0x7f2acc0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ad159c700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2acc0c87c0 0x7f2acc0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ad159c700 1 -- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2acc0c83f0 msgr2=0x7f2acc0c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ad159c700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2acc0c83f0 0x7f2acc0c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ad159c700 1 -- 172.21.15.86:0/1504900064 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80094f0 con 0x7f2acc0ccee0 2023-10-09T13:16:18.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ad159c700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc150030 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c8e0 tx=0x7f2ac4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.461+0000 7f2ac8ff9700 1 -- 172.21.15.86:0/1504900064 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4012630 con 0x7f2acc0ccee0 2023-10-09T13:16:18.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.462+0000 7f2ac8ff9700 1 -- 172.21.15.86:0/1504900064 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4012790 con 0x7f2acc0ccee0 2023-10-09T13:16:18.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.462+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc0c3fc0 con 0x7f2acc0ccee0 2023-10-09T13:16:18.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.462+0000 7f2ac8ff9700 1 -- 172.21.15.86:0/1504900064 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4012b50 con 0x7f2acc0ccee0 2023-10-09T13:16:18.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.462+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc0c4580 con 0x7f2acc0ccee0 2023-10-09T13:16:18.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.463+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc04c3c0 con 0x7f2acc0ccee0 2023-10-09T13:16:18.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.464+0000 7f2ac8ff9700 1 -- 172.21.15.86:0/1504900064 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ac401a3a0 con 0x7f2acc0ccee0 2023-10-09T13:16:18.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.464+0000 7f2ac8ff9700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ab0066f30 0x7f2ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.465+0000 7f2ac8ff9700 1 -- 172.21.15.86:0/1504900064 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f2ac4084680 con 0x7f2acc0ccee0 2023-10-09T13:16:18.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.465+0000 7f2ad0d9b700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ab0066f30 0x7f2ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.465+0000 7f2ad0d9b700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ab0066f30 0x7f2ab00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009d10 tx=0x7f2ac00091a0 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.470 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.469+0000 7f2ac8ff9700 1 -- 172.21.15.86:0/1504900064 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ac40519b0 con 0x7f2acc0ccee0 2023-10-09T13:16:18.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.658+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2acc0cbd90 con 0x7f2acc0ccee0 2023-10-09T13:16:18.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.658+0000 7f2ac8ff9700 1 -- 172.21.15.86:0/1504900064 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v208) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ac4054fd0 con 0x7f2acc0ccee0 2023-10-09T13:16:18.659 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T13:16:18.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.660+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ab0066f30 msgr2=0x7f2ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.660+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ab0066f30 0x7f2ab00693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009d10 tx=0x7f2ac00091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.660+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 msgr2=0x7f2acc150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.660+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc150030 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c8e0 tx=0x7f2ac4001710 comp rx=0 tx=0).stop 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 shutdown_connections 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2ab0066f30 0x7f2ab00693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2acc0ccee0 0x7f2acc150030 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2acc0c83f0 0x7f2acc0c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 --2- 172.21.15.86:0/1504900064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2acc0c87c0 0x7f2acc0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 >> 172.21.15.86:0/1504900064 conn(0x7f2acc068e10 msgr2=0x7f2acc0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 shutdown_connections 2023-10-09T13:16:18.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.661+0000 7f2ad2fff700 1 -- 172.21.15.86:0/1504900064 wait complete. 2023-10-09T13:16:18.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T13:16:18.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.859+0000 7f2c5339d700 1 Processor -- start 2023-10-09T13:16:18.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.859+0000 7f2c5339d700 1 -- start start 2023-10-09T13:16:18.862 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.860+0000 7f2c5339d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2c4c142ea0 0x7f2c4c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.860+0000 7f2c5339d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2c4c06c0f0 0x7f2c4c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.860+0000 7f2c5339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c0b40f0 con 0x7f2c4c0ad870 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.860+0000 7f2c5339d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c069640 con 0x7f2c4c142ea0 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.860+0000 7f2c5339d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c069920 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.860+0000 7f2c5239b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2c4c142ea0 0x7f2c4c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c5239b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2c4c142ea0 0x7f2c4c0b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60742/0 (socket says 172.21.15.86:60742) 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c5239b700 1 -- 172.21.15.86:0/3731454225 learned_addr learned my addr 172.21.15.86:0/3731454225 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:18.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c52b9c700 1 --2- 172.21.15.86:0/3731454225 >> v2:172.21.15.135:3300/0 conn(0x7f2c4c06c0f0 0x7f2c4c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c5239b700 1 -- 172.21.15.86:0/3731454225 >> v2:172.21.15.135:3300/0 conn(0x7f2c4c06c0f0 msgr2=0x7f2c4c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:18.867 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c5239b700 1 --2- 172.21.15.86:0/3731454225 >> v2:172.21.15.135:3300/0 conn(0x7f2c4c06c0f0 0x7f2c4c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c5239b700 1 -- 172.21.15.86:0/3731454225 >> v1:172.21.15.135:6789/0 conn(0x7f2c4c0ad870 legacy=0x7f2c4c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c5239b700 1 -- 172.21.15.86:0/3731454225 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c069c00 con 0x7f2c4c142ea0 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c5239b700 1 --2- 172.21.15.86:0/3731454225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c0b3630 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c071330 tx=0x7f2c48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04a7048ecfd46a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.861+0000 7f2c51399700 1 -- 172.21.15.86:0/3731454225 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48009e70 con 0x7f2c4c142ea0 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c51399700 1 -- 172.21.15.86:0/3731454225 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4800b860 con 0x7f2c4c142ea0 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c51399700 1 -- 172.21.15.86:0/3731454225 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4800bc00 con 0x7f2c4c142ea0 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 -- 172.21.15.86:0/3731454225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c142ea0 msgr2=0x7f2c4c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 --2- 172.21.15.86:0/3731454225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c0b3630 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c071330 tx=0x7f2c48009250 comp rx=0 tx=0).stop 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 -- 172.21.15.86:0/3731454225 shutdown_connections 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 --2- 172.21.15.86:0/3731454225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c0b3630 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 --2- 172.21.15.86:0/3731454225 >> v2:172.21.15.135:3300/0 conn(0x7f2c4c06c0f0 0x7f2c4c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 -- 172.21.15.86:0/3731454225 >> 172.21.15.86:0/3731454225 conn(0x7f2c4c0ce430 msgr2=0x7f2c4c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 -- 172.21.15.86:0/3731454225 shutdown_connections 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.862+0000 7f2c5339d700 1 -- 172.21.15.86:0/3731454225 wait complete. 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.864+0000 7f2c5339d700 1 Processor -- start 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.864+0000 7f2c5339d700 1 -- start start 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5339d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c06c0f0 0x7f2c4c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c4c140150 0x7f2c4c158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5339d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0c75e0 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0c78c0 con 0x7f2c4c142ea0 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0c7ba0 con 0x7f2c4c140150 2023-10-09T13:16:18.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c06c0f0 0x7f2c4c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c06c0f0 0x7f2c4c15ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60752/0 (socket says 172.21.15.86:60752) 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 -- 172.21.15.86:0/4015534886 learned_addr learned my addr 172.21.15.86:0/4015534886 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c51b9a700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 -- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c4c140150 msgr2=0x7f2c4c158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c4c140150 0x7f2c4c158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 -- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c4c142ea0 msgr2=0x7f2c4c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 -- 172.21.15.86:0/4015534886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480094f0 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c51b9a700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.865+0000 7f2c5239b700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c06c0f0 0x7f2c4c15ebd0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c06f0d0 tx=0x7f2c48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.866+0000 7f2c427fc700 1 -- 172.21.15.86:0/4015534886 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48011420 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.866+0000 7f2c427fc700 1 -- 172.21.15.86:0/4015534886 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c480115a0 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.866+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c0c7e80 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.866+0000 7f2c427fc700 1 -- 172.21.15.86:0/4015534886 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48011960 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.866+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c15f110 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.867+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c0c83a0 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.868+0000 7f2c427fc700 1 -- 172.21.15.86:0/4015534886 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c480253f0 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.869+0000 7f2c427fc700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2c30066f30 0x7f2c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:18.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.869+0000 7f2c427fc700 1 -- 172.21.15.86:0/4015534886 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f2c48085dc0 con 0x7f2c4c06c0f0 2023-10-09T13:16:18.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.869+0000 7f2c51b9a700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2c30066f30 0x7f2c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:18.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.870+0000 7f2c51b9a700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2c30066f30 0x7f2c300693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0cd420 tx=0x7f2c3c009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:18.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:18.873+0000 7f2c427fc700 1 -- 172.21.15.86:0/4015534886 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c4c0c83a0 con 0x7f2c4c06c0f0 2023-10-09T13:16:19.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.068+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2c4c0c83a0 con 0x7f2c4c06c0f0 2023-10-09T13:16:19.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.069+0000 7f2c427fc700 1 -- 172.21.15.86:0/4015534886 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v208) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2c48015060 con 0x7f2c4c06c0f0 2023-10-09T13:16:19.070 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:19.070 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T13:16:19.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:19.071 INFO:teuthology.orchestra.run.smithi086.stdout: "poolnum": 1, 2023-10-09T13:16:19.071 INFO:teuthology.orchestra.run.smithi086.stdout: "poolname": ".mgr" 2023-10-09T13:16:19.071 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:19.071 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T13:16:19.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2c30066f30 msgr2=0x7f2c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2c30066f30 0x7f2c300693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0cd420 tx=0x7f2c3c009040 comp rx=0 tx=0).stop 2023-10-09T13:16:19.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c06c0f0 msgr2=0x7f2c4c15ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c06c0f0 0x7f2c4c15ebd0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c06f0d0 tx=0x7f2c48017000 comp rx=0 tx=0).stop 2023-10-09T13:16:19.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 shutdown_connections 2023-10-09T13:16:19.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2c30066f30 0x7f2c300693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c4c06c0f0 0x7f2c4c15ebd0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c4c140150 0x7f2c4c158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 --2- 172.21.15.86:0/4015534886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c4c142ea0 0x7f2c4c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 >> 172.21.15.86:0/4015534886 conn(0x7f2c4c0ce430 msgr2=0x7f2c4c1420a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:19.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 shutdown_connections 2023-10-09T13:16:19.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.071+0000 7f2c5339d700 1 -- 172.21.15.86:0/4015534886 wait complete. 2023-10-09T13:16:19.090 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T13:16:19.090 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T13:16:19.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.273+0000 7fda28b9d700 1 Processor -- start 2023-10-09T13:16:19.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.273+0000 7fda28b9d700 1 -- start start 2023-10-09T13:16:19.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.274+0000 7fda28b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda240b03c0 0x7fda240cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:19.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.274+0000 7fda28b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b0790 0x7fda240b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:19.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.274+0000 7fda28b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240cfa00 con 0x7fda241591e0 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.274+0000 7fda28b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240cb580 con 0x7fda240b03c0 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.274+0000 7fda28b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240b2de0 con 0x7fda240b0790 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.274+0000 7fda237fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda240b03c0 0x7fda240cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda237fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda240b03c0 0x7fda240cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60760/0 (socket says 172.21.15.86:60760) 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda237fe700 1 -- 172.21.15.86:0/4054080363 learned_addr learned my addr 172.21.15.86:0/4054080363 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda22ffd700 1 --2- 172.21.15.86:0/4054080363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b0790 0x7fda240b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda237fe700 1 -- 172.21.15.86:0/4054080363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b0790 msgr2=0x7fda240b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda237fe700 1 --2- 172.21.15.86:0/4054080363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b0790 0x7fda240b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda237fe700 1 -- 172.21.15.86:0/4054080363 >> v1:172.21.15.135:6789/0 conn(0x7fda241591e0 legacy=0x7fda24159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda237fe700 1 -- 172.21.15.86:0/4054080363 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240cf160 con 0x7fda240b03c0 2023-10-09T13:16:19.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.275+0000 7fda237fe700 1 --2- 172.21.15.86:0/4054080363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b03c0 0x7fda240cea70 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fda140099b0 tx=0x7fda14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334751a651668587 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:19.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda227fc700 1 -- 172.21.15.86:0/4054080363 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400b860 con 0x7fda240b03c0 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda227fc700 1 -- 172.21.15.86:0/4054080363 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1400b9c0 con 0x7fda240b03c0 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda227fc700 1 -- 172.21.15.86:0/4054080363 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400bd60 con 0x7fda240b03c0 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 -- 172.21.15.86:0/4054080363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b03c0 msgr2=0x7fda240cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 --2- 172.21.15.86:0/4054080363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b03c0 0x7fda240cea70 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fda140099b0 tx=0x7fda14009250 comp rx=0 tx=0).stop 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 -- 172.21.15.86:0/4054080363 shutdown_connections 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 --2- 172.21.15.86:0/4054080363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b03c0 0x7fda240cea70 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 --2- 172.21.15.86:0/4054080363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b0790 0x7fda240b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 -- 172.21.15.86:0/4054080363 >> 172.21.15.86:0/4054080363 conn(0x7fda24063230 msgr2=0x7fda24063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 -- 172.21.15.86:0/4054080363 shutdown_connections 2023-10-09T13:16:19.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.276+0000 7fda28b9d700 1 -- 172.21.15.86:0/4054080363 wait complete. 2023-10-09T13:16:19.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.278+0000 7fda28b9d700 1 Processor -- start 2023-10-09T13:16:19.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.278+0000 7fda28b9d700 1 -- start start 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda28b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b03c0 0x7fda2415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda28b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b0790 0x7fda2415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda28b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda241591e0 0x7fda24069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda28b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240c8240 con 0x7fda240b0790 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda28b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240c8520 con 0x7fda241591e0 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda28b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415cf20 con 0x7fda240b03c0 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda22ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b0790 0x7fda2415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda22ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b0790 0x7fda2415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60770/0 (socket says 172.21.15.86:60770) 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda22ffd700 1 -- 172.21.15.86:0/3864369143 learned_addr learned my addr 172.21.15.86:0/3864369143 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda237fe700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b03c0 0x7fda2415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.279+0000 7fda23fff700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda241591e0 0x7fda24069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:19.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda22ffd700 1 -- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b03c0 msgr2=0x7fda2415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda22ffd700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b03c0 0x7fda2415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda22ffd700 1 -- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda241591e0 msgr2=0x7fda24069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda22ffd700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda241591e0 0x7fda24069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda22ffd700 1 -- 172.21.15.86:0/3864369143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140094f0 con 0x7fda240b0790 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda22ffd700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b0790 0x7fda2415da00 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fda1800d890 tx=0x7fda18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda0b7fe700 1 -- 172.21.15.86:0/3864369143 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180125f0 con 0x7fda240b0790 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda0b7fe700 1 -- 172.21.15.86:0/3864369143 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18012770 con 0x7fda240b0790 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda0b7fe700 1 -- 172.21.15.86:0/3864369143 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18012b30 con 0x7fda240b0790 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2415d200 con 0x7fda240b0790 2023-10-09T13:16:19.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.280+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2415b830 con 0x7fda240b0790 2023-10-09T13:16:19.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.281+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2415cd80 con 0x7fda240b0790 2023-10-09T13:16:19.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.282+0000 7fda0b7fe700 1 -- 172.21.15.86:0/3864369143 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda1801e460 con 0x7fda240b0790 2023-10-09T13:16:19.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.283+0000 7fda0b7fe700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fda10066f30 0x7fda100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:19.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.283+0000 7fda0b7fe700 1 -- 172.21.15.86:0/3864369143 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fda18084b20 con 0x7fda240b0790 2023-10-09T13:16:19.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.283+0000 7fda237fe700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fda10066f30 0x7fda100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:19.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.284+0000 7fda237fe700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fda10066f30 0x7fda100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda140099b0 tx=0x7fda14017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:19.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.287+0000 7fda0b7fe700 1 -- 172.21.15.86:0/3864369143 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda2415cd80 con 0x7fda240b0790 2023-10-09T13:16:19.479 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.478+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fda2415d720 con 0x7fda240b0790 2023-10-09T13:16:19.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.948+0000 7fda0b7fe700 1 -- 172.21.15.86:0/3864369143 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v209) v1 ==== 138+0+0 (secure 0 0 0) 0x7fda2415d720 con 0x7fda240b0790 2023-10-09T13:16:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.953+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fda10066f30 msgr2=0x7fda100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.953+0000 7fda28b9d700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fda10066f30 0x7fda100693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda140099b0 tx=0x7fda14017000 comp rx=0 tx=0).stop 2023-10-09T13:16:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.953+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b0790 msgr2=0x7fda2415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:19.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.953+0000 7fda28b9d700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b0790 0x7fda2415da00 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fda1800d890 tx=0x7fda18008040 comp rx=0 tx=0).stop 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.954+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 shutdown_connections 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.954+0000 7fda28b9d700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fda10066f30 0x7fda100693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.954+0000 7fda28b9d700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda241591e0 0x7fda24069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.954+0000 7fda28b9d700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda240b03c0 0x7fda2415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.954+0000 7fda28b9d700 1 --2- 172.21.15.86:0/3864369143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda240b0790 0x7fda2415da00 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.954+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 >> 172.21.15.86:0/3864369143 conn(0x7fda24063230 msgr2=0x7fda241579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.954+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 shutdown_connections 2023-10-09T13:16:19.956 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:19.955+0000 7fda28b9d700 1 -- 172.21.15.86:0/3864369143 wait complete. 2023-10-09T13:16:19.958 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' created 2023-10-09T13:16:19.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T13:16:20.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.163+0000 7f3d3bfff700 1 Processor -- start 2023-10-09T13:16:20.164 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.163+0000 7f3d3bfff700 1 -- start start 2023-10-09T13:16:20.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d3c1563b0 0x7f3d3c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:20.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3d3c0ae9c0 0x7f3d3c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:20.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3c0cbe50 con 0x7f3d3c156780 2023-10-09T13:16:20.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3bfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c0cb370 con 0x7f3d3c1563b0 2023-10-09T13:16:20.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c0cb650 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d3c1563b0 0x7f3d3c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:20.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3a7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3d3c156780 0x7f3d3c0ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47132/0 (socket says 172.21.15.86:47132) 2023-10-09T13:16:20.166 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.164+0000 7f3d3a7fc700 1 -- 172.21.15.86:0/613739856 learned_addr learned my addr 172.21.15.86:0/613739856 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:20.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d3b7fe700 1 --2- 172.21.15.86:0/613739856 >> v2:172.21.15.135:3300/0 conn(0x7f3d3c0ae9c0 0x7f3d3c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:20.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d3affd700 1 -- 172.21.15.86:0/613739856 >> v2:172.21.15.135:3300/0 conn(0x7f3d3c0ae9c0 msgr2=0x7f3d3c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:20.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d3affd700 1 --2- 172.21.15.86:0/613739856 >> v2:172.21.15.135:3300/0 conn(0x7f3d3c0ae9c0 0x7f3d3c0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d3affd700 1 -- 172.21.15.86:0/613739856 >> v1:172.21.15.86:6789/0 conn(0x7f3d3c156780 legacy=0x7f3d3c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:20.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d3affd700 1 -- 172.21.15.86:0/613739856 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c0c6860 con 0x7f3d3c1563b0 2023-10-09T13:16:20.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d3b7fe700 1 --2- 172.21.15.86:0/613739856 >> v2:172.21.15.135:3300/0 conn(0x7f3d3c0ae9c0 0x7f3d3c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:20.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d39ffb700 1 -- 172.21.15.86:0/613739856 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859473036 0 0) 0x7f3d3c0cbe50 con 0x7f3d3c156780 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d3affd700 1 --2- 172.21.15.86:0/613739856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c1563b0 0x7f3d3c0ca7d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c156c20 tx=0x7f3d2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941d6278d9e4c573 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d39ffb700 1 -- 172.21.15.86:0/613739856 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00b6b0 con 0x7f3d3c1563b0 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d39ffb700 1 -- 172.21.15.86:0/613739856 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00b810 con 0x7f3d3c1563b0 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.165+0000 7f3d39ffb700 1 -- 172.21.15.86:0/613739856 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00bbb0 con 0x7f3d3c1563b0 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 -- 172.21.15.86:0/613739856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c1563b0 msgr2=0x7f3d3c0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/613739856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c1563b0 0x7f3d3c0ca7d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c156c20 tx=0x7f3d2c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 -- 172.21.15.86:0/613739856 shutdown_connections 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/613739856 >> v2:172.21.15.135:3300/0 conn(0x7f3d3c0ae9c0 0x7f3d3c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/613739856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c1563b0 0x7f3d3c0ca7d0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 -- 172.21.15.86:0/613739856 >> 172.21.15.86:0/613739856 conn(0x7f3d3c068e20 msgr2=0x7f3d3c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 -- 172.21.15.86:0/613739856 shutdown_connections 2023-10-09T13:16:20.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.166+0000 7f3d3bfff700 1 -- 172.21.15.86:0/613739856 wait complete. 2023-10-09T13:16:20.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.167+0000 7f3d3bfff700 1 Processor -- start 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.168+0000 7f3d3bfff700 1 -- start start 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.168+0000 7f3d3bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c0ae9c0 0x7f3d3c153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.168+0000 7f3d3bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d3c1563b0 0x7f3d3c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.168+0000 7f3d3bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d3c156780 0x7f3d3c16d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.168+0000 7f3d3bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c48e0 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.168+0000 7f3d3bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c16dbe0 con 0x7f3d3c156780 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.168+0000 7f3d3bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0af220 con 0x7f3d3c1563b0 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c0ae9c0 0x7f3d3c153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c0ae9c0 0x7f3d3c153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60800/0 (socket says 172.21.15.86:60800) 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 -- 172.21.15.86:0/1892379717 learned_addr learned my addr 172.21.15.86:0/1892379717 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:20.172 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3b7fe700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d3c156780 0x7f3d3c16d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3a7fc700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d3c1563b0 0x7f3d3c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 -- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d3c1563b0 msgr2=0x7f3d3c0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d3c1563b0 0x7f3d3c0c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 -- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d3c156780 msgr2=0x7f3d3c16d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d3c156780 0x7f3d3c16d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 -- 172.21.15.86:0/1892379717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c009420 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3a7fc700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d3c1563b0 0x7f3d3c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d3affd700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c0ae9c0 0x7f3d3c153720 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00b0e0 tx=0x7f3d2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.169+0000 7f3d22ffd700 1 -- 172.21.15.86:0/1892379717 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c011420 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.170+0000 7f3d22ffd700 1 -- 172.21.15.86:0/1892379717 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c0115a0 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.170+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3c153e20 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.170+0000 7f3d22ffd700 1 -- 172.21.15.86:0/1892379717 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c011960 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.170+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c1543e0 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.171+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c04c3c0 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.171+0000 7f3d22ffd700 1 -- 172.21.15.86:0/1892379717 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d2c011d50 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.173+0000 7f3d22ffd700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d28066f30 0x7f3d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:20.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.173+0000 7f3d22ffd700 1 -- 172.21.15.86:0/1892379717 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5727+0+0 (secure 0 0 0) 0x7f3d2c086140 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.173+0000 7f3d3a7fc700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d28066f30 0x7f3d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:20.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.173+0000 7f3d3a7fc700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d28066f30 0x7f3d280693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0c28b0 tx=0x7f3d30009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:20.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.178+0000 7f3d22ffd700 1 -- 172.21.15.86:0/1892379717 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d2c053300 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.371 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.369+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3d3c0c6b40 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.955 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.954+0000 7f3d22ffd700 1 -- 172.21.15.86:0/1892379717 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v210) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3d2c056920 con 0x7f3d3c0ae9c0 2023-10-09T13:16:20.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.967+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d28066f30 msgr2=0x7f3d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:20.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.967+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d28066f30 0x7f3d280693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0c28b0 tx=0x7f3d30009040 comp rx=0 tx=0).stop 2023-10-09T13:16:20.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.967+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c0ae9c0 msgr2=0x7f3d3c153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:20.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.967+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c0ae9c0 0x7f3d3c153720 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00b0e0 tx=0x7f3d2c017000 comp rx=0 tx=0).stop 2023-10-09T13:16:20.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.968+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 shutdown_connections 2023-10-09T13:16:20.970 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.968+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3d28066f30 0x7f3d280693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.968+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d3c0ae9c0 0x7f3d3c153720 secure :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00b0e0 tx=0x7f3d2c017000 comp rx=0 tx=0).stop 2023-10-09T13:16:20.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.968+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d3c156780 0x7f3d3c16d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.968+0000 7f3d3bfff700 1 --2- 172.21.15.86:0/1892379717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3d3c1563b0 0x7f3d3c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:20.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.968+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 >> 172.21.15.86:0/1892379717 conn(0x7f3d3c068e20 msgr2=0x7f3d3c152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:20.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.970+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 shutdown_connections 2023-10-09T13:16:20.971 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:20.970+0000 7f3d3bfff700 1 -- 172.21.15.86:0/1892379717 wait complete. 2023-10-09T13:16:20.977 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' created 2023-10-09T13:16:20.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T13:16:21.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.179+0000 7f42703ff700 1 Processor -- start 2023-10-09T13:16:21.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.179+0000 7f42703ff700 1 -- start start 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f42703ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4268155eb0 0x7f426806e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f42703ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4268069e80 0x7f42680ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f42703ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426806eb90 con 0x7f42680c70b0 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f42703ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426806ee70 con 0x7f4268155eb0 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f42703ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426806f150 con 0x7f4268069e80 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f426e19b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4268155eb0 0x7f426806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f426e19b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4268155eb0 0x7f426806e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60808/0 (socket says 172.21.15.86:60808) 2023-10-09T13:16:21.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f426e19b700 1 -- 172.21.15.86:0/180040225 learned_addr learned my addr 172.21.15.86:0/180040225 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:21.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f426e99c700 1 --2- 172.21.15.86:0/180040225 >> v2:172.21.15.135:3300/0 conn(0x7f4268069e80 0x7f42680ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:21.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f426e19b700 1 -- 172.21.15.86:0/180040225 >> v2:172.21.15.135:3300/0 conn(0x7f4268069e80 msgr2=0x7f42680ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:21.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f426e19b700 1 --2- 172.21.15.86:0/180040225 >> v2:172.21.15.135:3300/0 conn(0x7f4268069e80 0x7f42680ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.181+0000 7f426e19b700 1 -- 172.21.15.86:0/180040225 >> v1:172.21.15.135:6789/0 conn(0x7f42680c70b0 legacy=0x7f4268069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:21.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.182+0000 7f426e19b700 1 -- 172.21.15.86:0/180040225 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426806f430 con 0x7f4268155eb0 2023-10-09T13:16:21.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.182+0000 7f426e19b700 1 --2- 172.21.15.86:0/180040225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f426806e240 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f426806d270 tx=0x7f4264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511e84c010c1f94e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:21.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.182+0000 7f426d199700 1 -- 172.21.15.86:0/180040225 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400b860 con 0x7f4268155eb0 2023-10-09T13:16:21.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.182+0000 7f426d199700 1 -- 172.21.15.86:0/180040225 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400b9c0 con 0x7f4268155eb0 2023-10-09T13:16:21.185 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.182+0000 7f426d199700 1 -- 172.21.15.86:0/180040225 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400bd60 con 0x7f4268155eb0 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 -- 172.21.15.86:0/180040225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 msgr2=0x7f426806e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 --2- 172.21.15.86:0/180040225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f426806e240 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f426806d270 tx=0x7f4264009250 comp rx=0 tx=0).stop 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 -- 172.21.15.86:0/180040225 shutdown_connections 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 --2- 172.21.15.86:0/180040225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f426806e240 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 --2- 172.21.15.86:0/180040225 >> v2:172.21.15.135:3300/0 conn(0x7f4268069e80 0x7f42680ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 -- 172.21.15.86:0/180040225 >> 172.21.15.86:0/180040225 conn(0x7f4268068e10 msgr2=0x7f42680cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 -- 172.21.15.86:0/180040225 shutdown_connections 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.183+0000 7f42703ff700 1 -- 172.21.15.86:0/180040225 wait complete. 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.184+0000 7f42703ff700 1 Processor -- start 2023-10-09T13:16:21.186 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.184+0000 7f42703ff700 1 -- start start 2023-10-09T13:16:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f42703ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4268069e80 0x7f42680ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:21.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f42703ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42680c70b0 0x7f42680c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f42703ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f4268152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f42703ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680cd4a0 con 0x7f4268155eb0 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f42703ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680c63c0 con 0x7f42680c70b0 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f42703ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42680c5560 con 0x7f4268069e80 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f426e99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f4268152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f426e99c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f4268152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60818/0 (socket says 172.21.15.86:60818) 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.185+0000 7f426e99c700 1 -- 172.21.15.86:0/1375928778 learned_addr learned my addr 172.21.15.86:0/1375928778 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426e19b700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4268069e80 0x7f42680ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426d99a700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42680c70b0 0x7f42680c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426e99c700 1 -- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4268069e80 msgr2=0x7f42680ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:21.189 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426e99c700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4268069e80 0x7f42680ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426e99c700 1 -- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42680c70b0 msgr2=0x7f42680c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426e99c700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42680c70b0 0x7f42680c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426e99c700 1 -- 172.21.15.86:0/1375928778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640094f0 con 0x7f4268155eb0 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f426e99c700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f4268152ef0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f4260007e70 tx=0x7f42600097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f425e7fc700 1 -- 172.21.15.86:0/1375928778 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000eb90 con 0x7f4268155eb0 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f425e7fc700 1 -- 172.21.15.86:0/1375928778 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000ed10 con 0x7f4268155eb0 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42680c57b0 con 0x7f4268155eb0 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f425e7fc700 1 -- 172.21.15.86:0/1375928778 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260014670 con 0x7f4268155eb0 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.186+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42680c5d70 con 0x7f4268155eb0 2023-10-09T13:16:21.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.187+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42680c6570 con 0x7f4268155eb0 2023-10-09T13:16:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.189+0000 7f425e7fc700 1 -- 172.21.15.86:0/1375928778 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4260014aa0 con 0x7f4268155eb0 2023-10-09T13:16:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.189+0000 7f425e7fc700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f424c066f30 0x7f424c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.190+0000 7f425e7fc700 1 -- 172.21.15.86:0/1375928778 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f4260085650 con 0x7f4268155eb0 2023-10-09T13:16:21.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.190+0000 7f426e19b700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f424c066f30 0x7f424c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:21.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.190+0000 7f426e19b700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f424c066f30 0x7f424c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f426806d270 tx=0x7f4264017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:21.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.193+0000 7f425e7fc700 1 -- 172.21.15.86:0/1375928778 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4260052710 con 0x7f4268155eb0 2023-10-09T13:16:21.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.424+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f426804c3c0 con 0x7f4268155eb0 2023-10-09T13:16:21.979 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.977+0000 7f425e7fc700 1 -- 172.21.15.86:0/1375928778 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v90) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4260055d30 con 0x7f4268155eb0 2023-10-09T13:16:21.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.992+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f424c066f30 msgr2=0x7f424c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:21.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.993+0000 7f42703ff700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f424c066f30 0x7f424c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f426806d270 tx=0x7f4264017000 comp rx=0 tx=0).stop 2023-10-09T13:16:21.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.993+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 msgr2=0x7f4268152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:21.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.993+0000 7f42703ff700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f4268152ef0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f4260007e70 tx=0x7f42600097e0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 shutdown_connections 2023-10-09T13:16:21.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f424c066f30 0x7f424c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4268155eb0 0x7f4268152ef0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4268069e80 0x7f42680ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 --2- 172.21.15.86:0/1375928778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42680c70b0 0x7f42680c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:21.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 >> 172.21.15.86:0/1375928778 conn(0x7f4268068e10 msgr2=0x7f4268154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:21.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 shutdown_connections 2023-10-09T13:16:21.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:21.995+0000 7f42703ff700 1 -- 172.21.15.86:0/1375928778 wait complete. 2023-10-09T13:16:21.998 INFO:teuthology.orchestra.run.smithi086.stderr:new fs with metadata pool 24 and data pool 25 2023-10-09T13:16:22.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.194+0000 7f09d85ff700 1 Processor -- start 2023-10-09T13:16:22.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.194+0000 7f09d85ff700 1 -- start start 2023-10-09T13:16:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.195+0000 7f09d85ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09d00cd010 0x7f09d00ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.195+0000 7f09d85ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f09d00ac770 0x7f09d00b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.195+0000 7f09d85ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d00ad930 con 0x7f09d00ccc40 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d85ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00acd20 con 0x7f09d00cd010 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d85ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00ad000 con 0x7f09d00ac770 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d5b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09d00cd010 0x7f09d00ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d639b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f09d00ccc40 0x7f09d0155c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47140/0 (socket says 172.21.15.86:47140) 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d639b700 1 -- 172.21.15.86:0/1835709229 learned_addr learned my addr 172.21.15.86:0/1835709229 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d6b9c700 1 --2- 172.21.15.86:0/1835709229 >> v2:172.21.15.135:3300/0 conn(0x7f09d00ac770 0x7f09d00b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d5b9a700 1 -- 172.21.15.86:0/1835709229 >> v2:172.21.15.135:3300/0 conn(0x7f09d00ac770 msgr2=0x7f09d00b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d5b9a700 1 --2- 172.21.15.86:0/1835709229 >> v2:172.21.15.135:3300/0 conn(0x7f09d00ac770 0x7f09d00b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d5b9a700 1 -- 172.21.15.86:0/1835709229 >> v1:172.21.15.86:6789/0 conn(0x7f09d00ccc40 legacy=0x7f09d0155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d5b9a700 1 -- 172.21.15.86:0/1835709229 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00ad2e0 con 0x7f09d00cd010 2023-10-09T13:16:22.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.196+0000 7f09d5399700 1 -- 172.21.15.86:0/1835709229 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232139903 0 0) 0x7f09d00ad930 con 0x7f09d00ccc40 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d5b9a700 1 --2- 172.21.15.86:0/1835709229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00cd010 0x7f09d00ac230 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f09d0065be0 tx=0x7f09c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ec51ee7842461 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d5399700 1 -- 172.21.15.86:0/1835709229 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c000b6b0 con 0x7f09d00cd010 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d5399700 1 -- 172.21.15.86:0/1835709229 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000b810 con 0x7f09d00cd010 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d5399700 1 -- 172.21.15.86:0/1835709229 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c000bbb0 con 0x7f09d00cd010 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 -- 172.21.15.86:0/1835709229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00cd010 msgr2=0x7f09d00ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1835709229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00cd010 0x7f09d00ac230 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f09d0065be0 tx=0x7f09c00091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 -- 172.21.15.86:0/1835709229 shutdown_connections 2023-10-09T13:16:22.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1835709229 >> v2:172.21.15.135:3300/0 conn(0x7f09d00ac770 0x7f09d00b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1835709229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00cd010 0x7f09d00ac230 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 -- 172.21.15.86:0/1835709229 >> 172.21.15.86:0/1835709229 conn(0x7f09d006a320 msgr2=0x7f09d00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:22.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 -- 172.21.15.86:0/1835709229 shutdown_connections 2023-10-09T13:16:22.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.197+0000 7f09d85ff700 1 -- 172.21.15.86:0/1835709229 wait complete. 2023-10-09T13:16:22.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.199+0000 7f09d85ff700 1 Processor -- start 2023-10-09T13:16:22.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.199+0000 7f09d85ff700 1 -- start start 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d85ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00ac770 0x7f09d014f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d85ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d00ccc40 0x7f09d015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d85ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d00cd010 0x7f09d015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d85ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0153390 con 0x7f09d00ac770 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d85ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014f960 con 0x7f09d00ccc40 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d85ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0152780 con 0x7f09d00cd010 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00ac770 0x7f09d014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00ac770 0x7f09d014f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60828/0 (socket says 172.21.15.86:60828) 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 -- 172.21.15.86:0/1935546555 learned_addr learned my addr 172.21.15.86:0/1935546555 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d5b9a700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d00ccc40 0x7f09d015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d6b9c700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d00cd010 0x7f09d015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 -- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d00cd010 msgr2=0x7f09d015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d00cd010 0x7f09d015c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 -- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d00ccc40 msgr2=0x7f09d015c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d00ccc40 0x7f09d015c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.200+0000 7f09d639b700 1 -- 172.21.15.86:0/1935546555 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c0009420 con 0x7f09d00ac770 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.201+0000 7f09d639b700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00ac770 0x7f09d014f420 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c7e0 tx=0x7f09cc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.201+0000 7f09c67fc700 1 -- 172.21.15.86:0/1935546555 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc005b30 con 0x7f09d00ac770 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.201+0000 7f09c67fc700 1 -- 172.21.15.86:0/1935546555 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc005c90 con 0x7f09d00ac770 2023-10-09T13:16:22.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.201+0000 7f09c67fc700 1 -- 172.21.15.86:0/1935546555 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc007300 con 0x7f09d00ac770 2023-10-09T13:16:22.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.201+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d0152a60 con 0x7f09d00ac770 2023-10-09T13:16:22.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.201+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d0153020 con 0x7f09d00ac770 2023-10-09T13:16:22.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.202+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d004c3c0 con 0x7f09d00ac770 2023-10-09T13:16:22.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.203+0000 7f09c67fc700 1 -- 172.21.15.86:0/1935546555 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09cc01b400 con 0x7f09d00ac770 2023-10-09T13:16:22.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.204+0000 7f09c67fc700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f09b4066f30 0x7f09b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.204+0000 7f09c67fc700 1 -- 172.21.15.86:0/1935546555 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f09cc084340 con 0x7f09d00ac770 2023-10-09T13:16:22.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.204+0000 7f09d5b9a700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f09b4066f30 0x7f09b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.204+0000 7f09d5b9a700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f09b4066f30 0x7f09b40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f09c00093f0 tx=0x7f09c0017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:22.209 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.209+0000 7f09c67fc700 1 -- 172.21.15.86:0/1935546555 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09cc051390 con 0x7f09d00ac770 2023-10-09T13:16:22.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.397+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09d00ad5c0 con 0x7f09d00ac770 2023-10-09T13:16:22.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.397+0000 7f09c67fc700 1 -- 172.21.15.86:0/1935546555 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) v1 ==== 74+0+16203 (secure 0 0 0) 0x7f09cc0549b0 con 0x7f09d00ac770 2023-10-09T13:16:22.399 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:22.399 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":211,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:21.426685+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:16:19.520774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T13:16:20.411921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f09b4066f30 msgr2=0x7f09b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f09b4066f30 0x7f09b40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f09c00093f0 tx=0x7f09c0017000 comp rx=0 tx=0).stop 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00ac770 msgr2=0x7f09d014f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00ac770 0x7f09d014f420 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c7e0 tx=0x7f09cc007df0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 shutdown_connections 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f09b4066f30 0x7f09b40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09d00ac770 0x7f09d014f420 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09d00cd010 0x7f09d015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 --2- 172.21.15.86:0/1935546555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09d00ccc40 0x7f09d015c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 >> 172.21.15.86:0/1935546555 conn(0x7f09d006a320 msgr2=0x7f09d014fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 shutdown_connections 2023-10-09T13:16:22.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.401+0000 7f09d85ff700 1 -- 172.21.15.86:0/1935546555 wait complete. 2023-10-09T13:16:22.419 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:22.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.599+0000 7f6cd15ff700 1 Processor -- start 2023-10-09T13:16:22.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.599+0000 7f6cd15ff700 1 -- start start 2023-10-09T13:16:22.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ccc0ac230 0x7f6ccc0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ccc0ccc40 0x7f6ccc0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ad930 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0acd20 con 0x7f6ccc0ac230 2023-10-09T13:16:22.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ad000 con 0x7f6ccc155c10 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ccc0ccc40 0x7f6ccc0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ccc0ccc40 0x7f6ccc0af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60842/0 (socket says 172.21.15.86:60842) 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 -- 172.21.15.86:0/1823740519 learned_addr learned my addr 172.21.15.86:0/1823740519 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cc3fff700 1 --2- 172.21.15.86:0/1823740519 >> v2:172.21.15.135:3300/0 conn(0x7f6ccc0ac230 0x7f6ccc0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccaffd700 1 --2- 172.21.15.86:0/1823740519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 -- 172.21.15.86:0/1823740519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 msgr2=0x7f6ccc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 --2- 172.21.15.86:0/1823740519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 -- 172.21.15.86:0/1823740519 >> v2:172.21.15.135:3300/0 conn(0x7f6ccc0ac230 msgr2=0x7f6ccc0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 --2- 172.21.15.86:0/1823740519 >> v2:172.21.15.135:3300/0 conn(0x7f6ccc0ac230 0x7f6ccc0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 -- 172.21.15.86:0/1823740519 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0ad2e0 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6ccb7fe700 1 --2- 172.21.15.86:0/1823740519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0af2f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc064210 tx=0x7f6cc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45237c19a4c43963 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:22.604 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cca7fc700 1 -- 172.21.15.86:0/1823740519 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400e070 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cca7fc700 1 -- 172.21.15.86:0/1823740519 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400b970 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cca7fc700 1 -- 172.21.15.86:0/1823740519 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40092e0 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1823740519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 msgr2=0x7f6ccc0af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.602+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1823740519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0af2f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc064210 tx=0x7f6cc4009840 comp rx=0 tx=0).stop 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.603+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1823740519 shutdown_connections 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.603+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1823740519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0af2f0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.603+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1823740519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.603+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1823740519 >> v2:172.21.15.135:3300/0 conn(0x7f6ccc0ac230 0x7f6ccc0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.603+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1823740519 >> 172.21.15.86:0/1823740519 conn(0x7f6ccc06a320 msgr2=0x7f6ccc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.603+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1823740519 shutdown_connections 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.603+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1823740519 wait complete. 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.604+0000 7f6cd15ff700 1 Processor -- start 2023-10-09T13:16:22.606 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.604+0000 7f6cd15ff700 1 -- start start 2023-10-09T13:16:22.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cd15ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ccc0ac230 0x7f6ccc153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cd15ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cd15ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cd15ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0c9f20 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.608 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cd15ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ca780 con 0x7f6ccc0ac230 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cd15ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc151670 con 0x7f6ccc155c10 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cc3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cc3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60844/0 (socket says 172.21.15.86:60844) 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6cc3fff700 1 -- 172.21.15.86:0/1300353734 learned_addr learned my addr 172.21.15.86:0/1300353734 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6ccaffd700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ccc0ac230 0x7f6ccc153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.605+0000 7f6ccb7fe700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc3fff700 1 -- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 msgr2=0x7f6ccc0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc3fff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc3fff700 1 -- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ccc0ac230 msgr2=0x7f6ccc153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc3fff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ccc0ac230 0x7f6ccc153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc3fff700 1 -- 172.21.15.86:0/1300353734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4009ae0 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.609 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6ccaffd700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ccc0ac230 0x7f6ccc153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc3fff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0cac10 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400ecb0 tx=0x7f6cb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc2ffd700 1 -- 172.21.15.86:0/1300353734 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400c970 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc2ffd700 1 -- 172.21.15.86:0/1300353734 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb400cad0 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc0ca130 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cc2ffd700 1 -- 172.21.15.86:0/1300353734 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400ce70 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.606+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc151290 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.610 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.607+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc04c3c0 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.608+0000 7f6cc2ffd700 1 -- 172.21.15.86:0/1300353734 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cb4013680 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.609+0000 7f6cc2ffd700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6cac066f30 0x7f6cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:22.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.609+0000 7f6cc2ffd700 1 -- 172.21.15.86:0/1300353734 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f6cb4084ae0 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.609+0000 7f6ccaffd700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6cac066f30 0x7f6cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:22.611 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.610+0000 7f6ccaffd700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6cac066f30 0x7f6cac0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009ce0 tx=0x7f6cbc008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:22.614 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.613+0000 7f6cc2ffd700 1 -- 172.21.15.86:0/1300353734 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cb4051b50 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.805+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ccc0ca8c0 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.806 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.806+0000 7f6cc2ffd700 1 -- 172.21.15.86:0/1300353734 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) v1 ==== 74+0+16203 (secure 0 0 0) 0x7f6cb4055170 con 0x7f6ccc0ccc40 2023-10-09T13:16:22.806 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:22.806 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":211,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:21.426685+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:16:19.520774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T13:16:20.411921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:22.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6cac066f30 msgr2=0x7f6cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6cac066f30 0x7f6cac0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009ce0 tx=0x7f6cbc008040 comp rx=0 tx=0).stop 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 msgr2=0x7f6ccc0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0cac10 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400ecb0 tx=0x7f6cb40091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 shutdown_connections 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6cac066f30 0x7f6cac0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ccc155c10 0x7f6ccc0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ccc0ac230 0x7f6ccc153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 --2- 172.21.15.86:0/1300353734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ccc0ccc40 0x7f6ccc0cac10 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 >> 172.21.15.86:0/1300353734 conn(0x7f6ccc06a320 msgr2=0x7f6ccc06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 shutdown_connections 2023-10-09T13:16:22.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:22.808+0000 7f6cd15ff700 1 -- 172.21.15.86:0/1300353734 wait complete. 2023-10-09T13:16:22.826 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T13:16:23.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.012+0000 7efc4319d700 1 Processor -- start 2023-10-09T13:16:23.013 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.013+0000 7efc4319d700 1 -- start start 2023-10-09T13:16:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4319d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c15a3b0 0x7efc3c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:23.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4319d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc3c0aef00 0x7efc3c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4319d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c0aea70 con 0x7efc3c06e470 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4319d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0ae480 con 0x7efc3c0aef00 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4319d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c15acc0 con 0x7efc3c15a3b0 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4199a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc3c0aef00 0x7efc3c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4199a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc3c0aef00 0x7efc3c15d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60860/0 (socket says 172.21.15.86:60860) 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4199a700 1 -- 172.21.15.86:0/524147398 learned_addr learned my addr 172.21.15.86:0/524147398 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4299c700 1 --1- 172.21.15.86:0/524147398 >> v1:172.21.15.86:6789/0 conn(0x7efc3c06e470 0x7efc3c0c7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:47144/0 (socket says 172.21.15.86:47144) 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.014+0000 7efc4219b700 1 --2- 172.21.15.86:0/524147398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c15a3b0 0x7efc3c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc4199a700 1 -- 172.21.15.86:0/524147398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c15a3b0 msgr2=0x7efc3c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc4199a700 1 --2- 172.21.15.86:0/524147398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c15a3b0 0x7efc3c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc4199a700 1 -- 172.21.15.86:0/524147398 >> v1:172.21.15.86:6789/0 conn(0x7efc3c06e470 legacy=0x7efc3c0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc41199700 1 -- 172.21.15.86:0/524147398 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709495343 0 0) 0x7efc3c0aea70 con 0x7efc3c06e470 2023-10-09T13:16:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc4199a700 1 -- 172.21.15.86:0/524147398 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c15dd30 con 0x7efc3c0aef00 2023-10-09T13:16:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc4199a700 1 --2- 172.21.15.86:0/524147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c0aef00 0x7efc3c15d3c0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0099b0 tx=0x7efc2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421a93ad35418169 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc41199700 1 -- 172.21.15.86:0/524147398 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c009ea0 con 0x7efc3c0aef00 2023-10-09T13:16:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc41199700 1 -- 172.21.15.86:0/524147398 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00b860 con 0x7efc3c0aef00 2023-10-09T13:16:23.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.015+0000 7efc41199700 1 -- 172.21.15.86:0/524147398 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00bc00 con 0x7efc3c0aef00 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 -- 172.21.15.86:0/524147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c0aef00 msgr2=0x7efc3c15d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 --2- 172.21.15.86:0/524147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c0aef00 0x7efc3c15d3c0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0099b0 tx=0x7efc2c009250 comp rx=0 tx=0).stop 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 -- 172.21.15.86:0/524147398 shutdown_connections 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 --2- 172.21.15.86:0/524147398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c15a3b0 0x7efc3c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 --2- 172.21.15.86:0/524147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c0aef00 0x7efc3c15d3c0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 -- 172.21.15.86:0/524147398 >> 172.21.15.86:0/524147398 conn(0x7efc3c0c9f70 msgr2=0x7efc3c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 -- 172.21.15.86:0/524147398 shutdown_connections 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.016+0000 7efc4319d700 1 -- 172.21.15.86:0/524147398 wait complete. 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.017+0000 7efc4319d700 1 Processor -- start 2023-10-09T13:16:23.020 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.017+0000 7efc4319d700 1 -- start start 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.018+0000 7efc4319d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c06e470 0x7efc3c146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.018+0000 7efc4319d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc3c0aef00 0x7efc3c153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.018+0000 7efc4319d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c15a3b0 0x7efc3c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.018+0000 7efc4319d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0c61b0 con 0x7efc3c15a3b0 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.018+0000 7efc4319d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0c55a0 con 0x7efc3c0aef00 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.018+0000 7efc4319d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0c5880 con 0x7efc3c06e470 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c15a3b0 0x7efc3c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c15a3b0 0x7efc3c153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60872/0 (socket says 172.21.15.86:60872) 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 -- 172.21.15.86:0/651251626 learned_addr learned my addr 172.21.15.86:0/651251626 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4219b700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c06e470 0x7efc3c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4199a700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc3c0aef00 0x7efc3c153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:23.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 -- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c06e470 msgr2=0x7efc3c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c06e470 0x7efc3c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 -- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc3c0aef00 msgr2=0x7efc3c153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc3c0aef00 0x7efc3c153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 -- 172.21.15.86:0/651251626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0094f0 con 0x7efc3c15a3b0 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc4299c700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c15a3b0 0x7efc3c153550 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7efc3400cd50 tx=0x7efc34001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc327fc700 1 -- 172.21.15.86:0/651251626 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34005df0 con 0x7efc3c15a3b0 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc327fc700 1 -- 172.21.15.86:0/651251626 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3400a960 con 0x7efc3c15a3b0 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.019+0000 7efc327fc700 1 -- 172.21.15.86:0/651251626 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3400ad20 con 0x7efc3c15a3b0 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.020+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c0c5b60 con 0x7efc3c15a3b0 2023-10-09T13:16:23.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.020+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c1469c0 con 0x7efc3c15a3b0 2023-10-09T13:16:23.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.021+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c15c720 con 0x7efc3c15a3b0 2023-10-09T13:16:23.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.021+0000 7efc327fc700 1 -- 172.21.15.86:0/651251626 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc34007300 con 0x7efc3c15a3b0 2023-10-09T13:16:23.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.022+0000 7efc327fc700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efc20066f30 0x7efc200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:23.023 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.022+0000 7efc327fc700 1 -- 172.21.15.86:0/651251626 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7efc34084880 con 0x7efc3c15a3b0 2023-10-09T13:16:23.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.023+0000 7efc4219b700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efc20066f30 0x7efc200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:23.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.023+0000 7efc4219b700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efc20066f30 0x7efc200693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc38009d10 tx=0x7efc380091a0 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:23.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.026+0000 7efc327fc700 1 -- 172.21.15.86:0/651251626 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc34051970 con 0x7efc3c15a3b0 2023-10-09T13:16:23.259 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.259+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc3c0c62f0 con 0x7efc3c15a3b0 2023-10-09T13:16:23.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.984+0000 7efc327fc700 1 -- 172.21.15.86:0/651251626 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v93) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc34054f90 con 0x7efc3c15a3b0 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efc20066f30 msgr2=0x7efc200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efc20066f30 0x7efc200693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc38009d10 tx=0x7efc380091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c15a3b0 msgr2=0x7efc3c153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c15a3b0 0x7efc3c153550 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7efc3400cd50 tx=0x7efc34001b10 comp rx=0 tx=0).stop 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 shutdown_connections 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efc20066f30 0x7efc200693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc3c15a3b0 0x7efc3c153550 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efc3c06e470 0x7efc3c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 --2- 172.21.15.86:0/651251626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc3c0aef00 0x7efc3c153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 >> 172.21.15.86:0/651251626 conn(0x7efc3c0c9f70 msgr2=0x7efc3c152560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:23.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 shutdown_connections 2023-10-09T13:16:23.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:23.987+0000 7efc4319d700 1 -- 172.21.15.86:0/651251626 wait complete. 2023-10-09T13:16:24.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T13:16:24.190 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.190+0000 7fa5b2dff700 1 Processor -- start 2023-10-09T13:16:24.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.190+0000 7fa5b2dff700 1 -- start start 2023-10-09T13:16:24.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b2dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5ac0c83f0 0x7fa5ac0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:24.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b2dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:24.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b2dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac15b0d0 con 0x7fa5ac0c87c0 2023-10-09T13:16:24.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b2dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c7a60 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b2dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac15a4c0 con 0x7fa5ac0ccee0 2023-10-09T13:16:24.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b0b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5ac0c83f0 0x7fa5ac0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b0b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5ac0c83f0 0x7fa5ac0c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60884/0 (socket says 172.21.15.86:60884) 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/3470149802 learned_addr learned my addr 172.21.15.86:0/3470149802 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5abfff700 1 --2- 172.21.15.86:0/3470149802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/3470149802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 msgr2=0x7fa5ac1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b0b9b700 1 --2- 172.21.15.86:0/3470149802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/3470149802 >> v1:172.21.15.86:6789/0 conn(0x7fa5ac0c87c0 legacy=0x7fa5ac06eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/3470149802 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac15a7a0 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.192+0000 7fa5abfff700 1 --2- 172.21.15.86:0/3470149802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.193+0000 7fa5b0b9b700 1 --2- 172.21.15.86:0/3470149802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac0c7520 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00099b0 tx=0x7fa5a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836c36a45d4009c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.193+0000 7fa5ab7fe700 1 -- 172.21.15.86:0/3470149802 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000b860 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.193+0000 7fa5ab7fe700 1 -- 172.21.15.86:0/3470149802 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000b9c0 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.193+0000 7fa5ab7fe700 1 -- 172.21.15.86:0/3470149802 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000bd60 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.193+0000 7fa5b2dff700 1 -- 172.21.15.86:0/3470149802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 msgr2=0x7fa5ac0c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.193+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/3470149802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac0c7520 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00099b0 tx=0x7fa5a0009250 comp rx=0 tx=0).stop 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.194+0000 7fa5b2dff700 1 -- 172.21.15.86:0/3470149802 shutdown_connections 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.194+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/3470149802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac0c7520 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.194+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/3470149802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.194+0000 7fa5b2dff700 1 -- 172.21.15.86:0/3470149802 >> 172.21.15.86:0/3470149802 conn(0x7fa5ac068e10 msgr2=0x7fa5ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.194+0000 7fa5b2dff700 1 -- 172.21.15.86:0/3470149802 shutdown_connections 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.194+0000 7fa5b2dff700 1 -- 172.21.15.86:0/3470149802 wait complete. 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.195+0000 7fa5b2dff700 1 Processor -- start 2023-10-09T13:16:24.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.195+0000 7fa5b2dff700 1 -- start start 2023-10-09T13:16:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b2dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b2dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac0c87c0 0x7fa5ac149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b2dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b2dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac14f030 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b2dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac14fe90 con 0x7fa5ac0c87c0 2023-10-09T13:16:24.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b2dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac14f280 con 0x7fa5ac0ccee0 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b0b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b0b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:60894/0 (socket says 172.21.15.86:60894) 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.196+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/1197192938 learned_addr learned my addr 172.21.15.86:0/1197192938 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5abfff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac0c87c0 0x7fa5ac149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b139c700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 msgr2=0x7fa5ac0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b0b9b700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac0c87c0 msgr2=0x7fa5ac149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b0b9b700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac0c87c0 0x7fa5ac149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b0b9b700 1 -- 172.21.15.86:0/1197192938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00094f0 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5abfff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac0c87c0 0x7fa5ac149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:24.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b139c700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:24.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b0b9b700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac150bd0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009290 tx=0x7fa5a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:24.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5a8ff9700 1 -- 172.21.15.86:0/1197192938 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0024440 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5a8ff9700 1 -- 172.21.15.86:0/1197192938 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a00245a0 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5a8ff9700 1 -- 172.21.15.86:0/1197192938 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0024960 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.197+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac14f560 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.198+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac14fb20 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.199+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac06a260 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.199+0000 7fa5a8ff9700 1 -- 172.21.15.86:0/1197192938 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5a001a420 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.200+0000 7fa5a8ff9700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa590066f30 0x7fa5900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.200+0000 7fa5a8ff9700 1 -- 172.21.15.86:0/1197192938 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fa5a0086680 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.200+0000 7fa5abfff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa590066f30 0x7fa5900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:24.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.201+0000 7fa5abfff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa590066f30 0x7fa5900693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa598006fd0 tx=0x7fa598008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:24.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.205+0000 7fa5a8ff9700 1 -- 172.21.15.86:0/1197192938 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5a00536f0 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.437 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.437+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa5ac04c3c0 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.994+0000 7fa5a8ff9700 1 -- 172.21.15.86:0/1197192938 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v94) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5a0056d10 con 0x7fa5ac0c83f0 2023-10-09T13:16:24.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa590066f30 msgr2=0x7fa5900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:24.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa590066f30 0x7fa5900693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa598006fd0 tx=0x7fa598008040 comp rx=0 tx=0).stop 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 msgr2=0x7fa5ac150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac150bd0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009290 tx=0x7fa5a0017000 comp rx=0 tx=0).stop 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 shutdown_connections 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa590066f30 0x7fa5900693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5ac0c83f0 0x7fa5ac150bd0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5ac0ccee0 0x7fa5ac0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 --2- 172.21.15.86:0/1197192938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5ac0c87c0 0x7fa5ac149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 >> 172.21.15.86:0/1197192938 conn(0x7fa5ac068e10 msgr2=0x7fa5ac14b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 shutdown_connections 2023-10-09T13:16:24.998 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:24.997+0000 7fa5b2dff700 1 -- 172.21.15.86:0/1197192938 wait complete. 2023-10-09T13:16:25.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:25.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.197+0000 7fed671ff700 1 Processor -- start 2023-10-09T13:16:25.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.197+0000 7fed671ff700 1 -- start start 2023-10-09T13:16:25.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.198+0000 7fed671ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed600b1c20 0x7fed601572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed671ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed60157820 0x7fed600abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed671ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed60157c80 con 0x7fed600b1850 2023-10-09T13:16:25.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed671ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6006fc30 con 0x7fed600b1c20 2023-10-09T13:16:25.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed671ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600cc260 con 0x7fed60157820 2023-10-09T13:16:25.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed5ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed600b1c20 0x7fed601572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed5ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fed600b1c20 0x7fed601572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58770/0 (socket says 172.21.15.86:58770) 2023-10-09T13:16:25.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed5ffff700 1 -- 172.21.15.86:0/1416394546 learned_addr learned my addr 172.21.15.86:0/1416394546 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:25.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed6579c700 1 --2- 172.21.15.86:0/1416394546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed60157820 0x7fed600abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed5ffff700 1 -- 172.21.15.86:0/1416394546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed60157820 msgr2=0x7fed600abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:25.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed5ffff700 1 --2- 172.21.15.86:0/1416394546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed60157820 0x7fed600abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed5ffff700 1 -- 172.21.15.86:0/1416394546 >> v1:172.21.15.135:6789/0 conn(0x7fed600b1850 legacy=0x7fed600ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.199+0000 7fed5ffff700 1 -- 172.21.15.86:0/1416394546 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600cb300 con 0x7fed600b1c20 2023-10-09T13:16:25.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed5ffff700 1 --2- 172.21.15.86:0/1416394546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed600b1c20 0x7fed601572e0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0099b0 tx=0x7fed4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b648b865e76447a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed5f7fe700 1 -- 172.21.15.86:0/1416394546 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00b860 con 0x7fed600b1c20 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed5f7fe700 1 -- 172.21.15.86:0/1416394546 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00b9c0 con 0x7fed600b1c20 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed5f7fe700 1 -- 172.21.15.86:0/1416394546 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00bd60 con 0x7fed600b1c20 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed671ff700 1 -- 172.21.15.86:0/1416394546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed600b1c20 msgr2=0x7fed601572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed671ff700 1 --2- 172.21.15.86:0/1416394546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed600b1c20 0x7fed601572e0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0099b0 tx=0x7fed4c009250 comp rx=0 tx=0).stop 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed671ff700 1 -- 172.21.15.86:0/1416394546 shutdown_connections 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed671ff700 1 --2- 172.21.15.86:0/1416394546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed60157820 0x7fed600abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed671ff700 1 --2- 172.21.15.86:0/1416394546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed600b1c20 0x7fed601572e0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.200+0000 7fed671ff700 1 -- 172.21.15.86:0/1416394546 >> 172.21.15.86:0/1416394546 conn(0x7fed6006a320 msgr2=0x7fed600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.201+0000 7fed671ff700 1 -- 172.21.15.86:0/1416394546 shutdown_connections 2023-10-09T13:16:25.202 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.201+0000 7fed671ff700 1 -- 172.21.15.86:0/1416394546 wait complete. 2023-10-09T13:16:25.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.202+0000 7fed671ff700 1 Processor -- start 2023-10-09T13:16:25.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.202+0000 7fed671ff700 1 -- start start 2023-10-09T13:16:25.204 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed671ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed600b1850 0x7fed600a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed671ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed600b1c20 0x7fed6015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed671ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed60157820 0x7fed60144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed671ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6016be70 con 0x7fed60157820 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed671ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6016af80 con 0x7fed600b1850 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed671ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6016b260 con 0x7fed600b1c20 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed6579c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed60157820 0x7fed60144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed6579c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed60157820 0x7fed60144eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58778/0 (socket says 172.21.15.86:58778) 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed6579c700 1 -- 172.21.15.86:0/993745101 learned_addr learned my addr 172.21.15.86:0/993745101 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed5ffff700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed600b1c20 0x7fed6015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.203+0000 7fed64f9b700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed600b1850 0x7fed600a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.205 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed6579c700 1 -- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed600b1c20 msgr2=0x7fed6015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed6579c700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed600b1c20 0x7fed6015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed6579c700 1 -- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed600b1850 msgr2=0x7fed600a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed6579c700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed600b1850 0x7fed600a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed6579c700 1 -- 172.21.15.86:0/993745101 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0094f0 con 0x7fed60157820 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed6579c700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed60157820 0x7fed60144eb0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fed58007f20 tx=0x7fed58009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed5cff9700 1 -- 172.21.15.86:0/993745101 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5800eca0 con 0x7fed60157820 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed5cff9700 1 -- 172.21.15.86:0/993745101 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5800ee20 con 0x7fed60157820 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed5cff9700 1 -- 172.21.15.86:0/993745101 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58014670 con 0x7fed60157820 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6016b540 con 0x7fed60157820 2023-10-09T13:16:25.206 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.204+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6016bb00 con 0x7fed60157820 2023-10-09T13:16:25.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.205+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6004c3c0 con 0x7fed60157820 2023-10-09T13:16:25.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.206+0000 7fed5cff9700 1 -- 172.21.15.86:0/993745101 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed580149e0 con 0x7fed60157820 2023-10-09T13:16:25.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.207+0000 7fed5cff9700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.207+0000 7fed5cff9700 1 -- 172.21.15.86:0/993745101 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fed58084e20 con 0x7fed60157820 2023-10-09T13:16:25.207 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.207+0000 7fed64f9b700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.208 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.208+0000 7fed64f9b700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed54003860 tx=0x7fed54009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:25.211 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.211+0000 7fed5cff9700 1 -- 172.21.15.86:0/993745101 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed58051e90 con 0x7fed60157820 2023-10-09T13:16:25.444 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.444+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed600cb5e0 con 0x7fed60157820 2023-10-09T13:16:25.445 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.445+0000 7fed5cff9700 1 -- 172.21.15.86:0/993745101 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fed580554b0 con 0x7fed60157820 2023-10-09T13:16:25.445 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:25.445 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4046429451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4046429451},{"type":"v1","addr":"172.21.15.135:6834","nonce":4046429451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1310718495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1310718495},{"type":"v1","addr":"172.21.15.135:6835","nonce":1310718495}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3009333325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3009333325},{"type":"v1","addr":"172.21.15.86:6833","nonce":3009333325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:16:21.427143+0000","modified":"2023-10-09T13:16:24.986894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/903379396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":903379396},{"type":"v1","addr":"172.21.15.86:6835","nonce":903379396}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fed44066f30 msgr2=0x7fed440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed54003860 tx=0x7fed54009040 comp rx=0 tx=0).stop 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed60157820 msgr2=0x7fed60144eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed60157820 0x7fed60144eb0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fed58007f20 tx=0x7fed58009860 comp rx=0 tx=0).stop 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 shutdown_connections 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed60157820 0x7fed60144eb0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed600b1850 0x7fed600a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 --2- 172.21.15.86:0/993745101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fed600b1c20 0x7fed6015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 >> 172.21.15.86:0/993745101 conn(0x7fed6006a320 msgr2=0x7fed6006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 shutdown_connections 2023-10-09T13:16:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.447+0000 7fed671ff700 1 -- 172.21.15.86:0/993745101 wait complete. 2023-10-09T13:16:25.449 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 94 2023-10-09T13:16:25.465 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:25.646 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.646+0000 7f6e2e3ff700 1 Processor -- start 2023-10-09T13:16:25.647 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.646+0000 7f6e2e3ff700 1 -- start start 2023-10-09T13:16:25.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.648+0000 7f6e2e3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e28155c10 0x7f6e28155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.648+0000 7f6e2e3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e280acac0 con 0x7f6e280ac230 2023-10-09T13:16:25.648 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.648+0000 7f6e2e3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e280ad930 con 0x7f6e280ac6d0 2023-10-09T13:16:25.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.648+0000 7f6e2e3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e280acd20 con 0x7f6e28155c10 2023-10-09T13:16:25.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.648+0000 7f6e1ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6e280ac230 0x7f6e281568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56908/0 (socket says 172.21.15.86:56908) 2023-10-09T13:16:25.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.648+0000 7f6e1ffff700 1 -- 172.21.15.86:0/4197239670 learned_addr learned my addr 172.21.15.86:0/4197239670 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:25.649 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.648+0000 7f6e27fff700 1 --2- 172.21.15.86:0/4197239670 >> v2:172.21.15.135:3300/0 conn(0x7f6e28155c10 0x7f6e28155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310119355 0 0) 0x7f6e280acac0 con 0x7f6e280ac230 2023-10-09T13:16:25.651 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e14003570 con 0x7f6e280ac230 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3839464234 0 0) 0x7f6e14003570 con 0x7f6e280ac230 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 >> v2:172.21.15.135:3300/0 conn(0x7f6e28155c10 msgr2=0x7f6e28155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 --2- 172.21.15.86:0/4197239670 >> v2:172.21.15.135:3300/0 conn(0x7f6e28155c10 0x7f6e28155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 >> v1:172.21.15.135:6789/0 conn(0x7f6e280ac6d0 legacy=0x7f6e280b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280ad000 con 0x7f6e280ac230 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f6e10001470 con 0x7f6e280ac230 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 >> v1:172.21.15.86:6789/0 conn(0x7f6e280ac230 legacy=0x7f6e281568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14003a60 0x7f6e14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e14004810 0x7f6e14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.652 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e140051c0 0x7f6e1400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280acd20 con 0x7f6e14004810 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1400e2e0 con 0x7f6e14003a60 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1400e4a0 con 0x7f6e140051c0 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e1ffff700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e14004810 0x7f6e14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.649+0000 7f6e27fff700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14003a60 0x7f6e14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e2c99c700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e140051c0 0x7f6e1400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e1ffff700 1 -- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e140051c0 msgr2=0x7f6e1400dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e1ffff700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e140051c0 0x7f6e1400dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e1ffff700 1 -- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14003a60 msgr2=0x7f6e14003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e1ffff700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14003a60 0x7f6e14003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e1ffff700 1 -- 172.21.15.86:0/4197239670 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14003570 con 0x7f6e14004810 2023-10-09T13:16:25.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e2c99c700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e140051c0 0x7f6e1400dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e2c99c700 1 -- 172.21.15.86:0/4197239670 reap_dead start 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e1ffff700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e14004810 0x7f6e14004c80 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c3c0 tx=0x7f6e10001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9db0da2b156021 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000cc90 con 0x7f6e14004810 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000ce10 con 0x7f6e14004810 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.650+0000 7f6e277fe700 1 -- 172.21.15.86:0/4197239670 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10005b70 con 0x7f6e14004810 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.651+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/4197239670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e14004810 msgr2=0x7f6e14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.651+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e14004810 0x7f6e14004c80 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c3c0 tx=0x7f6e10001e50 comp rx=0 tx=0).stop 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.651+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/4197239670 shutdown_connections 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.651+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/4197239670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e14004810 0x7f6e14004c80 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.651+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/4197239670 >> 172.21.15.86:0/4197239670 conn(0x7f6e2806a320 msgr2=0x7f6e280cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.651+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/4197239670 shutdown_connections 2023-10-09T13:16:25.654 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.651+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/4197239670 wait complete. 2023-10-09T13:16:25.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.652+0000 7f6e2e3ff700 1 Processor -- start 2023-10-09T13:16:25.656 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.652+0000 7f6e2e3ff700 1 -- start start 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.653+0000 7f6e2e3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14004810 0x7f6e280a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.653+0000 7f6e2e3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e2814b160 0x7f6e280a8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.653+0000 7f6e2e3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e2806e310 0x7f6e2806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.653+0000 7f6e2e3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280aa2f0 con 0x7f6e2814b160 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.653+0000 7f6e2e3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2806ecf0 con 0x7f6e14004810 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.653+0000 7f6e2e3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2814b5d0 con 0x7f6e2806e310 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e2814b160 0x7f6e280a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e2814b160 0x7f6e280a8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58802/0 (socket says 172.21.15.86:58802) 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 -- 172.21.15.86:0/2438000307 learned_addr learned my addr 172.21.15.86:0/2438000307 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e27fff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14004810 0x7f6e280a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e2c99c700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e2806e310 0x7f6e2806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 -- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e2806e310 msgr2=0x7f6e2806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e2806e310 0x7f6e2806e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 -- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14004810 msgr2=0x7f6e280a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14004810 0x7f6e280a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 -- 172.21.15.86:0/2438000307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280a88c0 con 0x7f6e2814b160 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e1ffff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e2814b160 0x7f6e280a8380 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c9b0 tx=0x7f6e10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e24ff9700 1 -- 172.21.15.86:0/2438000307 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10001640 con 0x7f6e2814b160 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e24ff9700 1 -- 172.21.15.86:0/2438000307 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e100017a0 con 0x7f6e2814b160 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e24ff9700 1 -- 172.21.15.86:0/2438000307 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10007300 con 0x7f6e2814b160 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.654+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e280a9e60 con 0x7f6e2814b160 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.655+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e280a9530 con 0x7f6e2814b160 2023-10-09T13:16:25.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.655+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e280a9ff0 con 0x7f6e2814b160 2023-10-09T13:16:25.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.657+0000 7f6e24ff9700 1 -- 172.21.15.86:0/2438000307 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e10007670 con 0x7f6e2814b160 2023-10-09T13:16:25.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.658+0000 7f6e24ff9700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6e08066f30 0x7f6e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:25.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.658+0000 7f6e24ff9700 1 -- 172.21.15.86:0/2438000307 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f6e100867f0 con 0x7f6e2814b160 2023-10-09T13:16:25.659 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.658+0000 7f6e27fff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6e08066f30 0x7f6e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:25.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.659+0000 7f6e27fff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6e08066f30 0x7f6e080693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006f00 tx=0x7f6e18008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:25.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.661+0000 7f6e24ff9700 1 -- 172.21.15.86:0/2438000307 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e100537c0 con 0x7f6e2814b160 2023-10-09T13:16:25.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.855+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e280a88c0 con 0x7f6e2814b160 2023-10-09T13:16:25.857 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.856+0000 7f6e24ff9700 1 -- 172.21.15.86:0/2438000307 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+16190 (secure 0 0 0) 0x7f6e280a88c0 con 0x7f6e2814b160 2023-10-09T13:16:25.857 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:25.857 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":212,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:22.974843+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:16:19.520774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T13:16:20.411921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:25.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6e08066f30 msgr2=0x7f6e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6e08066f30 0x7f6e080693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006f00 tx=0x7f6e18008040 comp rx=0 tx=0).stop 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e2814b160 msgr2=0x7f6e280a8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e2814b160 0x7f6e280a8380 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c9b0 tx=0x7f6e10015000 comp rx=0 tx=0).stop 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 shutdown_connections 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6e08066f30 0x7f6e080693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e2806e310 0x7f6e2806e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e14004810 0x7f6e280a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 --2- 172.21.15.86:0/2438000307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e2814b160 0x7f6e280a8380 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 >> 172.21.15.86:0/2438000307 conn(0x7f6e2806a320 msgr2=0x7f6e28154a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 shutdown_connections 2023-10-09T13:16:25.860 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:25.859+0000 7f6e2e3ff700 1 -- 172.21.15.86:0/2438000307 wait complete. 2023-10-09T13:16:25.877 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T13:16:25.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:26.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.059+0000 7f6036f9d700 1 Processor -- start 2023-10-09T13:16:26.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.059+0000 7f6036f9d700 1 -- start start 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.060+0000 7f6036f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f60300c6d00 0x7f60300c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.060+0000 7f6036f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f603006e730 0x7f603006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.060+0000 7f6036f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603006e2a0 con 0x7f6030157770 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.060+0000 7f6036f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6030157b40 con 0x7f60300c6d00 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.060+0000 7f6036f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60300c7690 con 0x7f603006e730 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f60300c6d00 0x7f60300c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f60300c6d00 0x7f60300c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58816/0 (socket says 172.21.15.86:58816) 2023-10-09T13:16:26.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 -- 172.21.15.86:0/1588977795 learned_addr learned my addr 172.21.15.86:0/1588977795 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:26.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603679c700 1 --2- 172.21.15.86:0/1588977795 >> v2:172.21.15.135:3300/0 conn(0x7f603006e730 0x7f603006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 -- 172.21.15.86:0/1588977795 >> v2:172.21.15.135:3300/0 conn(0x7f603006e730 msgr2=0x7f603006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 --2- 172.21.15.86:0/1588977795 >> v2:172.21.15.135:3300/0 conn(0x7f603006e730 0x7f603006eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 -- 172.21.15.86:0/1588977795 >> v1:172.21.15.135:6789/0 conn(0x7f6030157770 legacy=0x7f6030150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 -- 172.21.15.86:0/1588977795 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603006b2e0 con 0x7f60300c6d00 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.061+0000 7f603579a700 1 --2- 172.21.15.86:0/1588977795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60300c6d00 0x7f60300c7150 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f60300c67c0 tx=0x7f6020009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67144a162dc85e56 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6034f99700 1 -- 172.21.15.86:0/1588977795 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020009e70 con 0x7f60300c6d00 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6034f99700 1 -- 172.21.15.86:0/1588977795 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602000b860 con 0x7f60300c6d00 2023-10-09T13:16:26.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6034f99700 1 -- 172.21.15.86:0/1588977795 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602000bc00 con 0x7f60300c6d00 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 -- 172.21.15.86:0/1588977795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60300c6d00 msgr2=0x7f60300c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 --2- 172.21.15.86:0/1588977795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60300c6d00 0x7f60300c7150 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f60300c67c0 tx=0x7f6020009250 comp rx=0 tx=0).stop 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 -- 172.21.15.86:0/1588977795 shutdown_connections 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 --2- 172.21.15.86:0/1588977795 >> v2:172.21.15.135:3300/0 conn(0x7f603006e730 0x7f603006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 --2- 172.21.15.86:0/1588977795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60300c6d00 0x7f60300c7150 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 -- 172.21.15.86:0/1588977795 >> 172.21.15.86:0/1588977795 conn(0x7f60300cc1f0 msgr2=0x7f60300cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 -- 172.21.15.86:0/1588977795 shutdown_connections 2023-10-09T13:16:26.064 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.062+0000 7f6036f9d700 1 -- 172.21.15.86:0/1588977795 wait complete. 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.064+0000 7f6036f9d700 1 Processor -- start 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.064+0000 7f6036f9d700 1 -- start start 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f6036f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603006e730 0x7f603014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f6036f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60300c6d00 0x7f60300c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f6036f9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030157770 0x7f60300b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f6036f9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300c6250 con 0x7f6030157770 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f6036f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300cb290 con 0x7f60300c6d00 2023-10-09T13:16:26.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f6036f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60300b10e0 con 0x7f603006e730 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f603679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030157770 0x7f60300b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f603679c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030157770 0x7f60300b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58824/0 (socket says 172.21.15.86:58824) 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f603679c700 1 -- 172.21.15.86:0/945042949 learned_addr learned my addr 172.21.15.86:0/945042949 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f603579a700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60300c6d00 0x7f60300c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.065+0000 7f6035f9b700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603006e730 0x7f603014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f603679c700 1 -- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603006e730 msgr2=0x7f603014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f603679c700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603006e730 0x7f603014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f603679c700 1 -- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60300c6d00 msgr2=0x7f60300c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f603679c700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60300c6d00 0x7f60300c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f603679c700 1 -- 172.21.15.86:0/945042949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200094f0 con 0x7f6030157770 2023-10-09T13:16:26.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f603679c700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030157770 0x7f60300b0ba0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f6028009df0 tx=0x7f602800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f6025ffb700 1 -- 172.21.15.86:0/945042949 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800caa0 con 0x7f6030157770 2023-10-09T13:16:26.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f6025ffb700 1 -- 172.21.15.86:0/945042949 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800f040 con 0x7f6030157770 2023-10-09T13:16:26.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60300ca680 con 0x7f6030157770 2023-10-09T13:16:26.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f6025ffb700 1 -- 172.21.15.86:0/945042949 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800ce70 con 0x7f6030157770 2023-10-09T13:16:26.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.066+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60300cac40 con 0x7f6030157770 2023-10-09T13:16:26.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.067+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60300cb400 con 0x7f6030157770 2023-10-09T13:16:26.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.068+0000 7f6025ffb700 1 -- 172.21.15.86:0/945042949 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6028014690 con 0x7f6030157770 2023-10-09T13:16:26.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.069+0000 7f6025ffb700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.069+0000 7f6025ffb700 1 -- 172.21.15.86:0/945042949 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f6028084f60 con 0x7f6030157770 2023-10-09T13:16:26.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.069+0000 7f6035f9b700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.070 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.070+0000 7f6035f9b700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6014066f30 0x7f60140693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f602c0039f0 tx=0x7f602c007ec0 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.073+0000 7f6025ffb700 1 -- 172.21.15.86:0/945042949 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6028055a60 con 0x7f6030157770 2023-10-09T13:16:26.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.262+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f603004c3c0 con 0x7f6014066f30 2023-10-09T13:16:26.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.272+0000 7f6025ffb700 1 -- 172.21.15.86:0/945042949 <== mgr.9981 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278474 (secure 0 0 0) 0x7f603004c3c0 con 0x7f6014066f30 2023-10-09T13:16:26.276 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:26.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6014066f30 msgr2=0x7f60140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6014066f30 0x7f60140693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f602c0039f0 tx=0x7f602c007ec0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030157770 msgr2=0x7f60300b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030157770 0x7f60300b0ba0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f6028009df0 tx=0x7f602800b040 comp rx=0 tx=0).stop 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 shutdown_connections 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030157770 0x7f60300b0ba0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f603006e730 0x7f603014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 --2- 172.21.15.86:0/945042949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60300c6d00 0x7f60300c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 >> 172.21.15.86:0/945042949 conn(0x7f60300cc1f0 msgr2=0x7f60301590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 shutdown_connections 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.276+0000 7f6036f9d700 1 -- 172.21.15.86:0/945042949 wait complete. 2023-10-09T13:16:26.279 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:26.294 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T13:16:25.905587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2481724,"kb_used_data":21500,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752492996,"statfs":{"total":773094113280,"available":770552827904,"internally_reserved":0,"allocated":22016000,"data_stored":11652155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.958034"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953960+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:47.330448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960255+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:53.053681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.952909+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:04.272147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.957290+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:27.259915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954653+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:33.587854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956985+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956999+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:49.826627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955731+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:08:53.411195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953244+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:19.179351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953871+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:15.858692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953094+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:37.338491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955185+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:12.947853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.950824+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956624+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:55.416653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955627+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:48.462899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954366+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:40.867024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956873+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955270+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:10.235495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955466+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:49.373975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953652+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:35.137627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954782+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:30.340591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953413+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:02.462297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.959825+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:49.632681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956487+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:53.737403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.951042+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.950800+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956720+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960193+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:45.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960057+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:53.788441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.957676+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:21.527930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.952935+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:01.781501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955289+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:59.096199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"201'348","reported_seq":1138,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-09T13:16:18.315497+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:18.315497+0000","last_peered":"2023-10-09T13:16:18.315497+0000","last_clean":"2023-10-09T13:16:18.315497+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:18.315497+0000","last_undegraded":"2023-10-09T13:16:18.315497+0000","last_fullsized":"2023-10-09T13:16:18.315497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312700,"kb_used_data":3124,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059140,"statfs":{"total":96636764160,"available":96316559360,"internally_reserved":0,"allocated":3198976,"data_stored":1900084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86499999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82399999999999995}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.80100000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.503},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":16,"seq":68719477865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.0029999999999999,"15min":1.026},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.069},"last":0.89900000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.879,"5min":0.99399999999999999,"15min":1.014},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.65800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.755,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.875,"5min":1.032,"15min":1.032},"last":0.878},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74199999999999999,"15min":0.745},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.501},"max":{"1min":0.92100000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.82599999999999996,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.77100000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.435,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.028,"15min":1.028},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.90100000000000002,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.68500000000000005}]}]},{"osd":1,"up_from":15,"seq":64424510569,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308012,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063828,"statfs":{"total":96636764160,"available":96321359872,"internally_reserved":0,"allocated":2592768,"data_stored":1303407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.748}]}]},{"osd":0,"up_from":14,"seq":60129543272,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308604,"kb_used_data":3124,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063236,"statfs":{"total":96636764160,"available":96320753664,"internally_reserved":0,"allocated":3198976,"data_stored":1900084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.44},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.78200000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.745},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.93100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.437},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":0.745},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":0.93300000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":0.86799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61899999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68200000000000005,"5min":1.399,"15min":1.399},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.68000000000000005,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.84699999999999998},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.65000000000000002,"15min":0.61299999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.78800000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69699999999999995,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0269999999999999,"5min":1.169,"15min":1.1759999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58399999999999996},"max":{"1min":1.081,"5min":1.298,"15min":1.298},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82799999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.0549999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.204},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.038,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.63},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98899999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.753}]},{"osd":7,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":1.155,"15min":1.4610000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.288,"15min":1.5349999999999999},"last":0.76800000000000002}]}]},{"osd":4,"up_from":16,"seq":68719477864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303928,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067912,"statfs":{"total":96636764160,"available":96325541888,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":0.80500000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.79300000000000004}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.84599999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.73299999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.434}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:26.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.513+0000 7f25a7dff700 1 Processor -- start 2023-10-09T13:16:26.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.513+0000 7f25a7dff700 1 -- start start 2023-10-09T13:16:26.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a7dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f25a01578b0 0x7f25a0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a7dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00ad930 con 0x7f25a0155c10 2023-10-09T13:16:26.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a7dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00acd20 con 0x7f25a00af2f0 2023-10-09T13:16:26.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a7dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a00ad000 con 0x7f25a01578b0 2023-10-09T13:16:26.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a539a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f25a01578b0 0x7f25a0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a539a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f25a01578b0 0x7f25a0155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58838/0 (socket says 172.21.15.86:58838) 2023-10-09T13:16:26.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a539a700 1 -- 172.21.15.86:0/4125203059 learned_addr learned my addr 172.21.15.86:0/4125203059 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:26.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a539a700 1 -- 172.21.15.86:0/4125203059 >> v1:172.21.15.135:6789/0 conn(0x7f25a00af2f0 legacy=0x7f25a00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:26.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a539a700 1 -- 172.21.15.86:0/4125203059 >> v1:172.21.15.86:6789/0 conn(0x7f25a0155c10 legacy=0x7f25a00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a4b99700 1 -- 172.21.15.86:0/4125203059 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305768918 0 0) 0x7f25a00ad930 con 0x7f25a0155c10 2023-10-09T13:16:26.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.515+0000 7f25a539a700 1 -- 172.21.15.86:0/4125203059 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00ad2e0 con 0x7f25a01578b0 2023-10-09T13:16:26.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a539a700 1 --2- 172.21.15.86:0/4125203059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a01578b0 0x7f25a0155fe0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f25900099b0 tx=0x7f2590009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a77c12f0e799372 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a4b99700 1 -- 172.21.15.86:0/4125203059 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000b860 con 0x7f25a01578b0 2023-10-09T13:16:26.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a4b99700 1 -- 172.21.15.86:0/4125203059 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000b9c0 con 0x7f25a01578b0 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a4b99700 1 -- 172.21.15.86:0/4125203059 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000bd60 con 0x7f25a01578b0 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a7dff700 1 -- 172.21.15.86:0/4125203059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a01578b0 msgr2=0x7f25a0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a7dff700 1 --2- 172.21.15.86:0/4125203059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a01578b0 0x7f25a0155fe0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f25900099b0 tx=0x7f2590009250 comp rx=0 tx=0).stop 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a7dff700 1 -- 172.21.15.86:0/4125203059 shutdown_connections 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a7dff700 1 --2- 172.21.15.86:0/4125203059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a01578b0 0x7f25a0155fe0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.516+0000 7f25a7dff700 1 -- 172.21.15.86:0/4125203059 >> 172.21.15.86:0/4125203059 conn(0x7f25a006a320 msgr2=0x7f25a00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.517+0000 7f25a7dff700 1 -- 172.21.15.86:0/4125203059 shutdown_connections 2023-10-09T13:16:26.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.517+0000 7f25a7dff700 1 -- 172.21.15.86:0/4125203059 wait complete. 2023-10-09T13:16:26.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.518+0000 7f25a7dff700 1 Processor -- start 2023-10-09T13:16:26.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.518+0000 7f25a7dff700 1 -- start start 2023-10-09T13:16:26.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a7dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25a00af2f0 0x7f25a0159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a7dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a0155c10 0x7f25a015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a7dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25a01578b0 0x7f25a016dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a7dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a015ab60 con 0x7f25a0155c10 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a7dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a014e4c0 con 0x7f25a01578b0 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a7dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00c90e0 con 0x7f25a00af2f0 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a0155c10 0x7f25a015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a539a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a0155c10 0x7f25a015a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58842/0 (socket says 172.21.15.86:58842) 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a539a700 1 -- 172.21.15.86:0/2012529667 learned_addr learned my addr 172.21.15.86:0/2012529667 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a639c700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25a01578b0 0x7f25a016dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.519+0000 7f25a5b9b700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25a00af2f0 0x7f25a0159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a539a700 1 -- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25a00af2f0 msgr2=0x7f25a0159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a539a700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25a00af2f0 0x7f25a0159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a539a700 1 -- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25a01578b0 msgr2=0x7f25a016dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a539a700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25a01578b0 0x7f25a016dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a539a700 1 -- 172.21.15.86:0/2012529667 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25900094f0 con 0x7f25a0155c10 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a5b9b700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25a00af2f0 0x7f25a0159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a639c700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25a01578b0 0x7f25a016dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a539a700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a0155c10 0x7f25a015a620 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f25a0064290 tx=0x7f2590019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f2595ffb700 1 -- 172.21.15.86:0/2012529667 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590019d70 con 0x7f25a0155c10 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f2595ffb700 1 -- 172.21.15.86:0/2012529667 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590010470 con 0x7f25a0155c10 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a015a2c0 con 0x7f25a0155c10 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f2595ffb700 1 -- 172.21.15.86:0/2012529667 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590010830 con 0x7f25a0155c10 2023-10-09T13:16:26.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.520+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a014de70 con 0x7f25a0155c10 2023-10-09T13:16:26.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.521+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a014e630 con 0x7f25a0155c10 2023-10-09T13:16:26.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.522+0000 7f2595ffb700 1 -- 172.21.15.86:0/2012529667 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2590021070 con 0x7f25a0155c10 2023-10-09T13:16:26.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.523+0000 7f2595ffb700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2584066f30 0x7f25840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.523+0000 7f2595ffb700 1 -- 172.21.15.86:0/2012529667 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f2590014070 con 0x7f25a0155c10 2023-10-09T13:16:26.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.523+0000 7f25a5b9b700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2584066f30 0x7f25840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.524+0000 7f25a5b9b700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2584066f30 0x7f25840693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f259c007fd0 tx=0x7f259c009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.527+0000 7f2595ffb700 1 -- 172.21.15.86:0/2012529667 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2590052b90 con 0x7f25a0155c10 2023-10-09T13:16:26.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.714+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25a004c3f0 con 0x7f2584066f30 2023-10-09T13:16:26.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.722+0000 7f2595ffb700 1 -- 172.21.15.86:0/2012529667 <== mgr.9981 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278474 (secure 0 0 0) 0x7f25a004c3f0 con 0x7f2584066f30 2023-10-09T13:16:26.726 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2584066f30 msgr2=0x7f25840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2584066f30 0x7f25840693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f259c007fd0 tx=0x7f259c009040 comp rx=0 tx=0).stop 2023-10-09T13:16:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a0155c10 msgr2=0x7f25a015a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a0155c10 0x7f25a015a620 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f25a0064290 tx=0x7f2590019000 comp rx=0 tx=0).stop 2023-10-09T13:16:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 shutdown_connections 2023-10-09T13:16:26.728 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2584066f30 0x7f25840693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25a01578b0 0x7f25a016dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25a00af2f0 0x7f25a0159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 --2- 172.21.15.86:0/2012529667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25a0155c10 0x7f25a015a620 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.726+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 >> 172.21.15.86:0/2012529667 conn(0x7f25a006a320 msgr2=0x7f25a00b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.727+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 shutdown_connections 2023-10-09T13:16:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.727+0000 7f25a7dff700 1 -- 172.21.15.86:0/2012529667 wait complete. 2023-10-09T13:16:26.729 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:26.744 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T13:16:25.905587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2481724,"kb_used_data":21500,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752492996,"statfs":{"total":773094113280,"available":770552827904,"internally_reserved":0,"allocated":22016000,"data_stored":11652155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.958034"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953960+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:47.330448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960255+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:53.053681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.952909+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:04.272147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.957290+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:27.259915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954653+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:33.587854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956985+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956999+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:49.826627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955731+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:08:53.411195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953244+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:19.179351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953871+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:15.858692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953094+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:37.338491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955185+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:12.947853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.950824+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956624+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:55.416653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955627+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:48.462899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954366+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:40.867024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956873+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955270+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:10.235495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955466+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:49.373975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953652+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:35.137627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954782+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:30.340591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953413+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:02.462297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.959825+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:49.632681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956487+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:53.737403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.951042+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.950800+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956720+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960193+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:45.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960057+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:53.788441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.957676+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:21.527930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.952935+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:01.781501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955289+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:59.096199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"201'348","reported_seq":1138,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-09T13:16:18.315497+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:18.315497+0000","last_peered":"2023-10-09T13:16:18.315497+0000","last_clean":"2023-10-09T13:16:18.315497+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:18.315497+0000","last_undegraded":"2023-10-09T13:16:18.315497+0000","last_fullsized":"2023-10-09T13:16:18.315497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312700,"kb_used_data":3124,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059140,"statfs":{"total":96636764160,"available":96316559360,"internally_reserved":0,"allocated":3198976,"data_stored":1900084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86499999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82399999999999995}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.80100000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.503},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":16,"seq":68719477865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.0029999999999999,"15min":1.026},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.069},"last":0.89900000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.879,"5min":0.99399999999999999,"15min":1.014},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.65800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.755,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.875,"5min":1.032,"15min":1.032},"last":0.878},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74199999999999999,"15min":0.745},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.501},"max":{"1min":0.92100000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.82599999999999996,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.77100000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.435,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.028,"15min":1.028},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.90100000000000002,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.68500000000000005}]}]},{"osd":1,"up_from":15,"seq":64424510569,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308012,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063828,"statfs":{"total":96636764160,"available":96321359872,"internally_reserved":0,"allocated":2592768,"data_stored":1303407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.748}]}]},{"osd":0,"up_from":14,"seq":60129543272,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308604,"kb_used_data":3124,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063236,"statfs":{"total":96636764160,"available":96320753664,"internally_reserved":0,"allocated":3198976,"data_stored":1900084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.44},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.78200000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.745},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.93100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.437},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":0.745},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":0.93300000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":0.86799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61899999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68200000000000005,"5min":1.399,"15min":1.399},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.68000000000000005,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.84699999999999998},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.65000000000000002,"15min":0.61299999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.78800000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69699999999999995,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0269999999999999,"5min":1.169,"15min":1.1759999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58399999999999996},"max":{"1min":1.081,"5min":1.298,"15min":1.298},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82799999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.0549999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.204},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.038,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.63},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98899999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.753}]},{"osd":7,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":1.155,"15min":1.4610000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.288,"15min":1.5349999999999999},"last":0.76800000000000002}]}]},{"osd":4,"up_from":16,"seq":68719477864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303928,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067912,"statfs":{"total":96636764160,"available":96325541888,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":0.80500000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.79300000000000004}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.84599999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.73299999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.434}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:26.750 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:26.942 INFO:tasks.ceph.mds.c.smithi086.stderr:2023-10-09T13:16:26.942+0000 7ff5eddf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T13:16:26.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.964+0000 7f7c981ff700 1 Processor -- start 2023-10-09T13:16:26.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.965+0000 7f7c981ff700 1 -- start start 2023-10-09T13:16:26.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c981ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c900cbf30 0x7f7c900ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c981ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c900ccf90 0x7f7c900b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c981ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c9015a270 0x7f7c900b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c981ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c90156bf0 con 0x7f7c900ccf90 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c981ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c900ae950 con 0x7f7c9015a270 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c981ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900cc300 con 0x7f7c900cbf30 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c9579a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c900ccf90 0x7f7c900b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c9579a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c900ccf90 0x7f7c900b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58858/0 (socket says 172.21.15.86:58858) 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c9579a700 1 -- 172.21.15.86:0/126618590 learned_addr learned my addr 172.21.15.86:0/126618590 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c9679c700 1 --2- 172.21.15.86:0/126618590 >> v2:172.21.15.135:3300/0 conn(0x7f7c9015a270 0x7f7c900b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.966+0000 7f7c95f9b700 1 --2- 172.21.15.86:0/126618590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c900cbf30 0x7f7c900ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c9579a700 1 -- 172.21.15.86:0/126618590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c900cbf30 msgr2=0x7f7c900ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c9579a700 1 --2- 172.21.15.86:0/126618590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c900cbf30 0x7f7c900ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c9579a700 1 -- 172.21.15.86:0/126618590 >> v2:172.21.15.135:3300/0 conn(0x7f7c9015a270 msgr2=0x7f7c900b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:26.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c9579a700 1 --2- 172.21.15.86:0/126618590 >> v2:172.21.15.135:3300/0 conn(0x7f7c9015a270 0x7f7c900b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c9579a700 1 -- 172.21.15.86:0/126618590 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900ad370 con 0x7f7c900ccf90 2023-10-09T13:16:26.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c9579a700 1 --2- 172.21.15.86:0/126618590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900ccf90 0x7f7c900b0d10 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b25e0 tx=0x7f7c80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95680f857033ca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c94f99700 1 -- 172.21.15.86:0/126618590 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000b820 con 0x7f7c900ccf90 2023-10-09T13:16:26.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c94f99700 1 -- 172.21.15.86:0/126618590 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8000b980 con 0x7f7c900ccf90 2023-10-09T13:16:26.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.967+0000 7f7c94f99700 1 -- 172.21.15.86:0/126618590 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000bd20 con 0x7f7c900ccf90 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 -- 172.21.15.86:0/126618590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900ccf90 msgr2=0x7f7c900b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 --2- 172.21.15.86:0/126618590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900ccf90 0x7f7c900b0d10 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b25e0 tx=0x7f7c80009250 comp rx=0 tx=0).stop 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 -- 172.21.15.86:0/126618590 shutdown_connections 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 --2- 172.21.15.86:0/126618590 >> v2:172.21.15.135:3300/0 conn(0x7f7c9015a270 0x7f7c900b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 --2- 172.21.15.86:0/126618590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c900cbf30 0x7f7c900ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 --2- 172.21.15.86:0/126618590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900ccf90 0x7f7c900b0d10 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 -- 172.21.15.86:0/126618590 >> 172.21.15.86:0/126618590 conn(0x7f7c9006a320 msgr2=0x7f7c900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 -- 172.21.15.86:0/126618590 shutdown_connections 2023-10-09T13:16:26.972 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.968+0000 7f7c981ff700 1 -- 172.21.15.86:0/126618590 wait complete. 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.969+0000 7f7c981ff700 1 Processor -- start 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.969+0000 7f7c981ff700 1 -- start start 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c981ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900cbf30 0x7f7c9014a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c981ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c900ccf90 0x7f7c901560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c981ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c9015a270 0x7f7c9006d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c981ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9014e8d0 con 0x7f7c900cbf30 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c981ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9014ebb0 con 0x7f7c900ccf90 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c981ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9014ee90 con 0x7f7c9015a270 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c95f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900cbf30 0x7f7c9014a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c95f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900cbf30 0x7f7c9014a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58870/0 (socket says 172.21.15.86:58870) 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.970+0000 7f7c95f9b700 1 -- 172.21.15.86:0/3586215282 learned_addr learned my addr 172.21.15.86:0/3586215282 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:26.973 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c9579a700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c900ccf90 0x7f7c901560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c95f9b700 1 -- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c9015a270 msgr2=0x7f7c9006d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c9679c700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c9015a270 0x7f7c9006d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c95f9b700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c9015a270 0x7f7c9006d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c95f9b700 1 -- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c900ccf90 msgr2=0x7f7c901560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c95f9b700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c900ccf90 0x7f7c901560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c95f9b700 1 -- 172.21.15.86:0/3586215282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800094f0 con 0x7f7c900cbf30 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c9579a700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c900ccf90 0x7f7c901560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c9679c700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c9015a270 0x7f7c9006d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c95f9b700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900cbf30 0x7f7c9014a9b0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00d860 tx=0x7f7c8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c85ffb700 1 -- 172.21.15.86:0/3586215282 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0125f0 con 0x7f7c900cbf30 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c85ffb700 1 -- 172.21.15.86:0/3586215282 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c012750 con 0x7f7c900cbf30 2023-10-09T13:16:26.974 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c85ffb700 1 -- 172.21.15.86:0/3586215282 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c012b10 con 0x7f7c900cbf30 2023-10-09T13:16:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9014f170 con 0x7f7c900cbf30 2023-10-09T13:16:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.971+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c901565e0 con 0x7f7c900cbf30 2023-10-09T13:16:26.975 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.972+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9004c3c0 con 0x7f7c900cbf30 2023-10-09T13:16:26.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.973+0000 7f7c85ffb700 1 -- 172.21.15.86:0/3586215282 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c8c01e460 con 0x7f7c900cbf30 2023-10-09T13:16:26.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.974+0000 7f7c85ffb700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:26.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.974+0000 7f7c85ffb700 1 -- 172.21.15.86:0/3586215282 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f7c8c084df0 con 0x7f7c900cbf30 2023-10-09T13:16:26.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.974+0000 7f7c9579a700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:26.976 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.975+0000 7f7c9579a700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c74066f30 0x7f7c740693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b25e0 tx=0x7f7c80017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:26.978 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:26.978+0000 7f7c85ffb700 1 -- 172.21.15.86:0/3586215282 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c8c0558f0 con 0x7f7c900cbf30 2023-10-09T13:16:27.165 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.165+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c9014ed20 con 0x7f7c74066f30 2023-10-09T13:16:27.173 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.173+0000 7f7c85ffb700 1 -- 172.21.15.86:0/3586215282 <== mgr.9981 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278474 (secure 0 0 0) 0x7f7c9014ed20 con 0x7f7c74066f30 2023-10-09T13:16:27.177 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.177+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c74066f30 msgr2=0x7f7c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.177+0000 7f7c981ff700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c74066f30 0x7f7c740693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b25e0 tx=0x7f7c80017000 comp rx=0 tx=0).stop 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.177+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900cbf30 msgr2=0x7f7c9014a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.177+0000 7f7c981ff700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900cbf30 0x7f7c9014a9b0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00d860 tx=0x7f7c8c008040 comp rx=0 tx=0).stop 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 shutdown_connections 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c900cbf30 0x7f7c9014a9b0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c9015a270 0x7f7c9006d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 --2- 172.21.15.86:0/3586215282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c900ccf90 0x7f7c901560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 >> 172.21.15.86:0/3586215282 conn(0x7f7c9006a320 msgr2=0x7f7c900c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:27.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 shutdown_connections 2023-10-09T13:16:27.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.178+0000 7f7c981ff700 1 -- 172.21.15.86:0/3586215282 wait complete. 2023-10-09T13:16:27.180 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:27.196 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T13:16:25.905587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2481724,"kb_used_data":21500,"kb_used_omap":0,"kb_used_meta":2460160,"kb_avail":752492996,"statfs":{"total":773094113280,"available":770552827904,"internally_reserved":0,"allocated":22016000,"data_stored":11652155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2519203840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.958034"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953960+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:47.330448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960255+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:19:53.053681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.952909+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:04.272147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.957290+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:27.259915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954653+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:33.587854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956985+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956999+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:49.826627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955731+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:08:53.411195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953244+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:29:19.179351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953871+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:15.858692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953094+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:37.338491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955185+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:12.947853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.950824+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956624+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:55.416653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955627+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:48.462899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954366+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:02:40.867024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956873+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955270+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:10.235495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955466+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:49.373975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953652+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:35.137627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.954782+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:30.340591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.953413+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:02.462297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.959825+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:49.632681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956487+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:53.737403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.951042+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.950800+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.956720+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960193+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:05:45.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.960057+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:53.788441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.957676+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:21.527930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.952935+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:01.781501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T13:16:20.947153+0000","last_change":"2023-10-09T13:16:20.947153+0000","last_active":"2023-10-09T13:16:20.947153+0000","last_peered":"2023-10-09T13:16:20.947153+0000","last_clean":"2023-10-09T13:16:20.947153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:20.947153+0000","last_undegraded":"2023-10-09T13:16:20.947153+0000","last_fullsized":"2023-10-09T13:16:20.947153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T13:16:19.939701+0000","last_change":"2023-10-09T13:16:19.955289+0000","last_active":"2023-10-09T13:16:19.939701+0000","last_peered":"2023-10-09T13:16:19.939701+0000","last_clean":"2023-10-09T13:16:19.939701+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T13:16:19.939701+0000","last_undegraded":"2023-10-09T13:16:19.939701+0000","last_fullsized":"2023-10-09T13:16:19.939701+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:59.096199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"201'348","reported_seq":1138,"reported_epoch":208,"state":"active+clean","last_fresh":"2023-10-09T13:16:18.315497+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:18.315497+0000","last_peered":"2023-10-09T13:16:18.315497+0000","last_clean":"2023-10-09T13:16:18.315497+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:18.315497+0000","last_undegraded":"2023-10-09T13:16:18.315497+0000","last_fullsized":"2023-10-09T13:16:18.315497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312700,"kb_used_data":3124,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059140,"statfs":{"total":96636764160,"available":96316559360,"internally_reserved":0,"allocated":3198976,"data_stored":1900084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86499999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82399999999999995}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.80100000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.503},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":16,"seq":68719477865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.0029999999999999,"15min":1.026},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.069},"last":0.89900000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71699999999999997,"15min":0.73199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.879,"5min":0.99399999999999999,"15min":1.014},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.65800000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.755,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.875,"5min":1.032,"15min":1.032},"last":0.878},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74199999999999999,"15min":0.745},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.501},"max":{"1min":0.92100000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":0.82599999999999996,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.77100000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.435,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.028,"15min":1.028},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.90100000000000002,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.68500000000000005}]}]},{"osd":1,"up_from":15,"seq":64424510569,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308012,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063828,"statfs":{"total":96636764160,"available":96321359872,"internally_reserved":0,"allocated":2592768,"data_stored":1303407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.748}]}]},{"osd":0,"up_from":14,"seq":60129543272,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308604,"kb_used_data":3124,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063236,"statfs":{"total":96636764160,"available":96320753664,"internally_reserved":0,"allocated":3198976,"data_stored":1900084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.44},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.78200000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.745},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.93100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.437},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":0.745},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":0.93300000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":0.86799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61899999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68200000000000005,"5min":1.399,"15min":1.399},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.68000000000000005,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.84699999999999998},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.65000000000000002,"15min":0.61299999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.78800000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69699999999999995,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0269999999999999,"5min":1.169,"15min":1.1759999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58399999999999996},"max":{"1min":1.081,"5min":1.298,"15min":1.298},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82799999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.0549999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.204},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.038,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.63},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98899999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.753}]},{"osd":7,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":1.155,"15min":1.4610000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.288,"15min":1.5349999999999999},"last":0.76800000000000002}]}]},{"osd":4,"up_from":16,"seq":68719477864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303928,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067912,"statfs":{"total":96636764160,"available":96325541888,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":0.80500000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.79300000000000004}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.84599999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.73299999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312120,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059720,"statfs":{"total":96636764160,"available":96317153280,"internally_reserved":0,"allocated":2605056,"data_stored":1309716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.434}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:27.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2023-10-09T13:16:27.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-10-09T13:16:27.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2023-10-09T13:16:27.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2023-10-09T13:16:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-10-09T13:16:27.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2023-10-09T13:16:27.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2023-10-09T13:16:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.953960+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:23:47.330448+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.960255+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:19:53.053681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.952909+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:13:04.272147+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.957290+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:07:27.259915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.954653+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:55:33.587854+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T13:16:27.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.956985+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.956999+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:59:49.826627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2023-10-09T13:16:27.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.955731+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:08:53.411195+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.953244+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:29:19.179351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-10-09T13:16:27.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.953871+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:06:15.858692+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.953094+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:55:37.338491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.955185+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:41:12.947853+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.950824+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.956624+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:33:55.416653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-10-09T13:16:27.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.955627+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:39:48.462899+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.954366+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:02:40.867024+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.956873+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.955270+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:28:10.235495+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.955466+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:30:49.373975+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-10-09T13:16:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.953652+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:31:35.137627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.954782+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:28:30.340591+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.953413+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:35:02.462297+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T13:16:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.959825+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:52:49.632681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.956487+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:12:53.737403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2023-10-09T13:16:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.951042+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:20:55.987265+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.950800+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:41:33.477479+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-10-09T13:16:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.956720+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:16:37.122103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.960193+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:05:45.143756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.960057+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:14:53.788441+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-10-09T13:16:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.957676+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:27:21.527930+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.952935+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:52:01.781501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T13:16:20.947153+0000', 'last_change': '2023-10-09T13:16:20.947153+0000', 'last_active': '2023-10-09T13:16:20.947153+0000', 'last_peered': '2023-10-09T13:16:20.947153+0000', 'last_clean': '2023-10-09T13:16:20.947153+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:20.947153+0000', 'last_undegraded': '2023-10-09T13:16:20.947153+0000', 'last_fullsized': '2023-10-09T13:16:20.947153+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:20.947153+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T13:16:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-10-09T13:16:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T13:16:19.939701+0000', 'last_change': '2023-10-09T13:16:19.955289+0000', 'last_active': '2023-10-09T13:16:19.939701+0000', 'last_peered': '2023-10-09T13:16:19.939701+0000', 'last_clean': '2023-10-09T13:16:19.939701+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T13:16:19.939701+0000', 'last_undegraded': '2023-10-09T13:16:19.939701+0000', 'last_fullsized': '2023-10-09T13:16:19.939701+0000', 'mapping_epoch': 209, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 209, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'last_clean_scrub_stamp': '2023-10-09T13:16:19.939701+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:57:59.096199+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T13:16:27.222 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T13:16:27.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.415+0000 7f2471bff700 1 Processor -- start 2023-10-09T13:16:27.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.415+0000 7f2471bff700 1 -- start start 2023-10-09T13:16:27.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f2471bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f246c0acf10 0x7f246c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f2471bff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c153f10 con 0x7f246c156510 2023-10-09T13:16:27.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f2471bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0af800 con 0x7f246c0b0ca0 2023-10-09T13:16:27.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f2471bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0ad9d0 con 0x7f246c0acf10 2023-10-09T13:16:27.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f246b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f246c156510 0x7f246c0ac800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56934/0 (socket says 172.21.15.86:56934) 2023-10-09T13:16:27.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f246b7fe700 1 -- 172.21.15.86:0/1230786920 learned_addr learned my addr 172.21.15.86:0/1230786920 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:27.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f246bfff700 1 --2- 172.21.15.86:0/1230786920 >> v2:172.21.15.135:3300/0 conn(0x7f246c0acf10 0x7f246c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f246affd700 1 -- 172.21.15.86:0/1230786920 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531899254 0 0) 0x7f246c153f10 con 0x7f246c156510 2023-10-09T13:16:27.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f246affd700 1 -- 172.21.15.86:0/1230786920 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2458003570 con 0x7f246c156510 2023-10-09T13:16:27.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.417+0000 7f246bfff700 1 -- 172.21.15.86:0/1230786920 >> v1:172.21.15.135:6789/0 conn(0x7f246c0b0ca0 legacy=0x7f246c1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.419 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.418+0000 7f246bfff700 1 -- 172.21.15.86:0/1230786920 >> v1:172.21.15.86:6789/0 conn(0x7f246c156510 legacy=0x7f246c0ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.418+0000 7f246affd700 1 -- 172.21.15.86:0/1230786920 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1618161640 0 0) 0x7f2458003570 con 0x7f246c156510 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.418+0000 7f246bfff700 1 -- 172.21.15.86:0/1230786920 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0ad410 con 0x7f246c0acf10 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.418+0000 7f246bfff700 1 --2- 172.21.15.86:0/1230786920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 0x7f246c160ae0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f246400af70 tx=0x7f246400a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c451fda0b5b9f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.418+0000 7f246affd700 1 -- 172.21.15.86:0/1230786920 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400f070 con 0x7f246c0acf10 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.418+0000 7f246affd700 1 -- 172.21.15.86:0/1230786920 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400a0d0 con 0x7f246c0acf10 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.418+0000 7f246affd700 1 -- 172.21.15.86:0/1230786920 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c001470 con 0x7f246c0acf10 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.419+0000 7f2471bff700 1 -- 172.21.15.86:0/1230786920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 msgr2=0x7f246c160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.419+0000 7f2471bff700 1 --2- 172.21.15.86:0/1230786920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 0x7f246c160ae0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f246400af70 tx=0x7f246400a890 comp rx=0 tx=0).stop 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.419+0000 7f2471bff700 1 -- 172.21.15.86:0/1230786920 shutdown_connections 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.419+0000 7f2471bff700 1 --2- 172.21.15.86:0/1230786920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 0x7f246c160ae0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.419+0000 7f2471bff700 1 -- 172.21.15.86:0/1230786920 >> 172.21.15.86:0/1230786920 conn(0x7f246c06a310 msgr2=0x7f246c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:27.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.419+0000 7f2471bff700 1 -- 172.21.15.86:0/1230786920 shutdown_connections 2023-10-09T13:16:27.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.419+0000 7f2471bff700 1 -- 172.21.15.86:0/1230786920 wait complete. 2023-10-09T13:16:27.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.420+0000 7f2471bff700 1 Processor -- start 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.420+0000 7f2471bff700 1 -- start start 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.421+0000 7f2471bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 0x7f246c167110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.421+0000 7f2471bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f246c0b0ca0 0x7f246c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.421+0000 7f2471bff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f246c156510 0x7f246c0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.421+0000 7f2471bff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c155c10 con 0x7f246c156510 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.421+0000 7f2471bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c14a0e0 con 0x7f246c0acf10 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.421+0000 7f2471bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1552e0 con 0x7f246c0b0ca0 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.421+0000 7f246bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f246c156510 0x7f246c0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f246c156510 0x7f246c0afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58886/0 (socket says 172.21.15.86:58886) 2023-10-09T13:16:27.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 -- 172.21.15.86:0/1420685160 learned_addr learned my addr 172.21.15.86:0/1420685160 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 -- 172.21.15.86:0/1420685160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f246c0b0ca0 msgr2=0x7f246c149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f246c0b0ca0 0x7f246c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 -- 172.21.15.86:0/1420685160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 msgr2=0x7f246c167110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 0x7f246c167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 -- 172.21.15.86:0/1420685160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246400ab30 con 0x7f246c156510 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f246bfff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f246c156510 0x7f246c0afc90 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f246400a8d0 tx=0x7f2464017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f24637fe700 1 -- 172.21.15.86:0/1420685160 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400a2c0 con 0x7f246c156510 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f24637fe700 1 -- 172.21.15.86:0/1420685160 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2464009d00 con 0x7f246c156510 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f24637fe700 1 -- 172.21.15.86:0/1420685160 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246401e660 con 0x7f246c156510 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.422+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c1555c0 con 0x7f246c156510 2023-10-09T13:16:27.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.423+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c167650 con 0x7f246c156510 2023-10-09T13:16:27.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.423+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c04c3c0 con 0x7f246c156510 2023-10-09T13:16:27.425 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.424+0000 7f24637fe700 1 -- 172.21.15.86:0/1420685160 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f246401ea50 con 0x7f246c156510 2023-10-09T13:16:27.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.425+0000 7f24637fe700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f244c066f30 0x7f244c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.425+0000 7f24637fe700 1 -- 172.21.15.86:0/1420685160 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f24640861f0 con 0x7f246c156510 2023-10-09T13:16:27.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.425+0000 7f246b7fe700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f244c066f30 0x7f244c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.426+0000 7f246b7fe700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f244c066f30 0x7f244c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f245c0011e0 tx=0x7f245c000f60 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:27.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.429+0000 7f24637fe700 1 -- 172.21.15.86:0/1420685160 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2464053260 con 0x7f246c156510 2023-10-09T13:16:27.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.695+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f246c155d50 con 0x7f246c156510 2023-10-09T13:16:27.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.695+0000 7f24637fe700 1 -- 172.21.15.86:0/1420685160 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1117 (secure 0 0 0) 0x7f2464056880 con 0x7f246c156510 2023-10-09T13:16:27.696 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:27.696 INFO:teuthology.orchestra.run.smithi086.stdout:{"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5740,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":212,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851660,"num_in_osds":8,"osd_in_since":1696851650,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2541285376,"bytes_avail":770552827904,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":94,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"c","status":"up:active","gid":10167}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-09T13:15:01.634740+0000","services":{}},"progress_events":{}} 2023-10-09T13:16:27.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.697+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f244c066f30 msgr2=0x7f244c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.697+0000 7f2471bff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f244c066f30 0x7f244c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f245c0011e0 tx=0x7f245c000f60 comp rx=0 tx=0).stop 2023-10-09T13:16:27.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.697+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f246c156510 msgr2=0x7f246c0afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.697+0000 7f2471bff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f246c156510 0x7f246c0afc90 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f246400a8d0 tx=0x7f2464017000 comp rx=0 tx=0).stop 2023-10-09T13:16:27.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 shutdown_connections 2023-10-09T13:16:27.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f244c066f30 0x7f244c0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f246c156510 0x7f246c0afc90 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f246c0acf10 0x7f246c167110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 --2- 172.21.15.86:0/1420685160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f246c0b0ca0 0x7f246c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 >> 172.21.15.86:0/1420685160 conn(0x7f246c06a310 msgr2=0x7f246c0ac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:27.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 shutdown_connections 2023-10-09T13:16:27.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.698+0000 7f2471bff700 1 -- 172.21.15.86:0/1420685160 wait complete. 2023-10-09T13:16:27.716 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T13:16:27.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.895+0000 7fa3c49ff700 1 Processor -- start 2023-10-09T13:16:27.896 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.895+0000 7fa3c49ff700 1 -- start start 2023-10-09T13:16:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3c49ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa3c00afc40 0x7fa3c00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3c49ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b0010 0x7fa3c015df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3c49ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c00b0750 con 0x7fa3c00b2140 2023-10-09T13:16:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3c49ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00aca70 con 0x7fa3c00afc40 2023-10-09T13:16:27.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3c49ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00acd50 con 0x7fa3c00b0010 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3be59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa3c00afc40 0x7fa3c00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3b7fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa3c00b2140 0x7fa3c015d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56946/0 (socket says 172.21.15.86:56946) 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3b7fff700 1 -- 172.21.15.86:0/2823517037 learned_addr learned my addr 172.21.15.86:0/2823517037 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3bed9d700 1 --2- 172.21.15.86:0/2823517037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b0010 0x7fa3c015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3be59c700 1 -- 172.21.15.86:0/2823517037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b0010 msgr2=0x7fa3c015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3bdd9b700 1 -- 172.21.15.86:0/2823517037 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20711214 0 0) 0x7fa3c00b0750 con 0x7fa3c00b2140 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3be59c700 1 --2- 172.21.15.86:0/2823517037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b0010 0x7fa3c015df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3be59c700 1 -- 172.21.15.86:0/2823517037 >> v1:172.21.15.86:6789/0 conn(0x7fa3c00b2140 legacy=0x7fa3c015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.897+0000 7fa3be59c700 1 -- 172.21.15.86:0/2823517037 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00ad030 con 0x7fa3c00afc40 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.898+0000 7fa3be59c700 1 --2- 172.21.15.86:0/2823517037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c00b1c00 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00098e0 tx=0x7fa3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed38ebe6b3488e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.898+0000 7fa3bdd9b700 1 -- 172.21.15.86:0/2823517037 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0009e80 con 0x7fa3c00afc40 2023-10-09T13:16:27.899 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.898+0000 7fa3bdd9b700 1 -- 172.21.15.86:0/2823517037 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b000b860 con 0x7fa3c00afc40 2023-10-09T13:16:27.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.898+0000 7fa3bdd9b700 1 -- 172.21.15.86:0/2823517037 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000bbe0 con 0x7fa3c00afc40 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.898+0000 7fa3c49ff700 1 -- 172.21.15.86:0/2823517037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 msgr2=0x7fa3c00b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.898+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/2823517037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c00b1c00 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00098e0 tx=0x7fa3b00091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.899+0000 7fa3c49ff700 1 -- 172.21.15.86:0/2823517037 shutdown_connections 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.899+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/2823517037 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b0010 0x7fa3c015df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.899+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/2823517037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c00b1c00 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.899+0000 7fa3c49ff700 1 -- 172.21.15.86:0/2823517037 >> 172.21.15.86:0/2823517037 conn(0x7fa3c006a320 msgr2=0x7fa3c00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.899+0000 7fa3c49ff700 1 -- 172.21.15.86:0/2823517037 shutdown_connections 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.899+0000 7fa3c49ff700 1 -- 172.21.15.86:0/2823517037 wait complete. 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.900+0000 7fa3c49ff700 1 Processor -- start 2023-10-09T13:16:27.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.900+0000 7fa3c49ff700 1 -- start start 2023-10-09T13:16:27.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3c49ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3c49ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3c00b0010 0x7fa3c0160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3c49ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b2140 0x7fa3c01517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3c49ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01620d0 con 0x7fa3c00afc40 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3c49ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01614c0 con 0x7fa3c00b0010 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3c49ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01617a0 con 0x7fa3c00b2140 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3be59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3be59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c0154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58914/0 (socket says 172.21.15.86:58914) 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.901+0000 7fa3be59c700 1 -- 172.21.15.86:0/1449677693 learned_addr learned my addr 172.21.15.86:0/1449677693 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3bed9d700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b2140 0x7fa3c01517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3b7fff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3c00b0010 0x7fa3c0160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3be59c700 1 -- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b2140 msgr2=0x7fa3c01517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3be59c700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b2140 0x7fa3c01517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3be59c700 1 -- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3c00b0010 msgr2=0x7fa3c0160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:27.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3be59c700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3c00b0010 0x7fa3c0160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3be59c700 1 -- 172.21.15.86:0/1449677693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009420 con 0x7fa3c00afc40 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3b7fff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3c00b0010 0x7fa3c0160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3be59c700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c0154970 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0064290 tx=0x7fa3b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3b67fc700 1 -- 172.21.15.86:0/1449677693 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000bbe0 con 0x7fa3c00afc40 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3b67fc700 1 -- 172.21.15.86:0/1449677693 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0011420 con 0x7fa3c00afc40 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c0161a80 con 0x7fa3c00afc40 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3b67fc700 1 -- 172.21.15.86:0/1449677693 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00117e0 con 0x7fa3c00afc40 2023-10-09T13:16:27.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.902+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c0151ce0 con 0x7fa3c00afc40 2023-10-09T13:16:27.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.903+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c004c3c0 con 0x7fa3c00afc40 2023-10-09T13:16:27.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.904+0000 7fa3b67fc700 1 -- 172.21.15.86:0/1449677693 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3b0011bd0 con 0x7fa3c00afc40 2023-10-09T13:16:27.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.905+0000 7fa3b67fc700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa3a0066f30 0x7fa3a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:27.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.906+0000 7fa3b67fc700 1 -- 172.21.15.86:0/1449677693 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fa3b0086240 con 0x7fa3c00afc40 2023-10-09T13:16:27.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.906+0000 7fa3b7fff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa3a0066f30 0x7fa3a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:27.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.906+0000 7fa3b7fff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa3a0066f30 0x7fa3a00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3c006dd90 tx=0x7fa3a8009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:27.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:27.910+0000 7fa3b67fc700 1 -- 172.21.15.86:0/1449677693 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3b0053210 con 0x7fa3c00afc40 2023-10-09T13:16:28.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.098+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3c0162210 con 0x7fa3a0066f30 2023-10-09T13:16:28.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.107+0000 7fa3b67fc700 1 -- 172.21.15.86:0/1449677693 <== mgr.9981 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289463 (secure 0 0 0) 0x7fa3a8001c50 con 0x7fa3a0066f30 2023-10-09T13:16:28.111 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa3a0066f30 msgr2=0x7fa3a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa3a0066f30 0x7fa3a00693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3c006dd90 tx=0x7fa3a8009040 comp rx=0 tx=0).stop 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 msgr2=0x7fa3c0154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c0154970 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0064290 tx=0x7fa3b0017000 comp rx=0 tx=0).stop 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 shutdown_connections 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa3a0066f30 0x7fa3a00693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c00afc40 0x7fa3c0154970 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3c00b2140 0x7fa3c01517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 --2- 172.21.15.86:0/1449677693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3c00b0010 0x7fa3c0160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 >> 172.21.15.86:0/1449677693 conn(0x7fa3c006a320 msgr2=0x7fa3c015a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:28.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 shutdown_connections 2023-10-09T13:16:28.114 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:28.111+0000 7fa3c49ff700 1 -- 172.21.15.86:0/1449677693 wait complete. 2023-10-09T13:16:28.114 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:28.129 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T13:16:27.905950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2486184,"kb_used_data":21864,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752488536,"statfs":{"total":773094113280,"available":770548260864,"internally_reserved":0,"allocated":22388736,"data_stored":11829684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.954862"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996549+0000","last_change":"2023-10-09T13:16:21.994742+0000","last_active":"2023-10-09T13:16:21.996549+0000","last_peered":"2023-10-09T13:16:21.996549+0000","last_clean":"2023-10-09T13:16:21.996549+0000","last_became_active":"2023-10-09T13:16:21.994312+0000","last_became_peered":"2023-10-09T13:16:21.994312+0000","last_unstale":"2023-10-09T13:16:21.996549+0000","last_undegraded":"2023-10-09T13:16:21.996549+0000","last_fullsized":"2023-10-09T13:16:21.996549+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:02.715967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985880+0000","last_change":"2023-10-09T13:16:21.979770+0000","last_active":"2023-10-09T13:16:21.985880+0000","last_peered":"2023-10-09T13:16:21.985880+0000","last_clean":"2023-10-09T13:16:21.985880+0000","last_became_active":"2023-10-09T13:16:21.979525+0000","last_became_peered":"2023-10-09T13:16:21.979525+0000","last_unstale":"2023-10-09T13:16:21.985880+0000","last_undegraded":"2023-10-09T13:16:21.985880+0000","last_fullsized":"2023-10-09T13:16:21.985880+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:00.103652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990690+0000","last_change":"2023-10-09T13:16:21.986243+0000","last_active":"2023-10-09T13:16:21.990690+0000","last_peered":"2023-10-09T13:16:21.990690+0000","last_clean":"2023-10-09T13:16:21.990690+0000","last_became_active":"2023-10-09T13:16:21.985977+0000","last_became_peered":"2023-10-09T13:16:21.985977+0000","last_unstale":"2023-10-09T13:16:21.990690+0000","last_undegraded":"2023-10-09T13:16:21.990690+0000","last_fullsized":"2023-10-09T13:16:21.990690+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:28.092352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985776+0000","last_change":"2023-10-09T13:16:21.980718+0000","last_active":"2023-10-09T13:16:21.985776+0000","last_peered":"2023-10-09T13:16:21.985776+0000","last_clean":"2023-10-09T13:16:21.985776+0000","last_became_active":"2023-10-09T13:16:21.980110+0000","last_became_peered":"2023-10-09T13:16:21.980110+0000","last_unstale":"2023-10-09T13:16:21.985776+0000","last_undegraded":"2023-10-09T13:16:21.985776+0000","last_fullsized":"2023-10-09T13:16:21.985776+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:54.744855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.988975+0000","last_change":"2023-10-09T13:16:21.986185+0000","last_active":"2023-10-09T13:16:21.988975+0000","last_peered":"2023-10-09T13:16:21.988975+0000","last_clean":"2023-10-09T13:16:21.988975+0000","last_became_active":"2023-10-09T13:16:21.985954+0000","last_became_peered":"2023-10-09T13:16:21.985954+0000","last_unstale":"2023-10-09T13:16:21.988975+0000","last_undegraded":"2023-10-09T13:16:21.988975+0000","last_fullsized":"2023-10-09T13:16:21.988975+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:56.151834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.980751+0000","last_change":"2023-10-09T13:16:21.978534+0000","last_active":"2023-10-09T13:16:21.980751+0000","last_peered":"2023-10-09T13:16:21.980751+0000","last_clean":"2023-10-09T13:16:21.980751+0000","last_became_active":"2023-10-09T13:16:21.978290+0000","last_became_peered":"2023-10-09T13:16:21.978290+0000","last_unstale":"2023-10-09T13:16:21.980751+0000","last_undegraded":"2023-10-09T13:16:21.980751+0000","last_fullsized":"2023-10-09T13:16:21.980751+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:29.603158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983212+0000","last_change":"2023-10-09T13:16:21.977349+0000","last_active":"2023-10-09T13:16:21.983212+0000","last_peered":"2023-10-09T13:16:21.983212+0000","last_clean":"2023-10-09T13:16:21.983212+0000","last_became_active":"2023-10-09T13:16:21.977084+0000","last_became_peered":"2023-10-09T13:16:21.977084+0000","last_unstale":"2023-10-09T13:16:21.983212+0000","last_undegraded":"2023-10-09T13:16:21.983212+0000","last_fullsized":"2023-10-09T13:16:21.983212+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:32.028004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.982403+0000","last_change":"2023-10-09T13:16:21.978113+0000","last_active":"2023-10-09T13:16:21.982403+0000","last_peered":"2023-10-09T13:16:21.982403+0000","last_clean":"2023-10-09T13:16:21.982403+0000","last_became_active":"2023-10-09T13:16:21.977860+0000","last_became_peered":"2023-10-09T13:16:21.977860+0000","last_unstale":"2023-10-09T13:16:21.982403+0000","last_undegraded":"2023-10-09T13:16:21.982403+0000","last_fullsized":"2023-10-09T13:16:21.982403+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:31.743144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986820+0000","last_change":"2023-10-09T13:16:21.984537+0000","last_active":"2023-10-09T13:16:21.986820+0000","last_peered":"2023-10-09T13:16:21.986820+0000","last_clean":"2023-10-09T13:16:21.986820+0000","last_became_active":"2023-10-09T13:16:21.984246+0000","last_became_peered":"2023-10-09T13:16:21.984246+0000","last_unstale":"2023-10-09T13:16:21.986820+0000","last_undegraded":"2023-10-09T13:16:21.986820+0000","last_fullsized":"2023-10-09T13:16:21.986820+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:42.763306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993546+0000","last_change":"2023-10-09T13:16:21.980089+0000","last_active":"2023-10-09T13:16:21.993546+0000","last_peered":"2023-10-09T13:16:21.993546+0000","last_clean":"2023-10-09T13:16:21.993546+0000","last_became_active":"2023-10-09T13:16:21.979165+0000","last_became_peered":"2023-10-09T13:16:21.979165+0000","last_unstale":"2023-10-09T13:16:21.993546+0000","last_undegraded":"2023-10-09T13:16:21.993546+0000","last_fullsized":"2023-10-09T13:16:21.993546+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:56.206671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983263+0000","last_change":"2023-10-09T13:16:21.977807+0000","last_active":"2023-10-09T13:16:21.983263+0000","last_peered":"2023-10-09T13:16:21.983263+0000","last_clean":"2023-10-09T13:16:21.983263+0000","last_became_active":"2023-10-09T13:16:21.977544+0000","last_became_peered":"2023-10-09T13:16:21.977544+0000","last_unstale":"2023-10-09T13:16:21.983263+0000","last_undegraded":"2023-10-09T13:16:21.983263+0000","last_fullsized":"2023-10-09T13:16:21.983263+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:49.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985798+0000","last_change":"2023-10-09T13:16:21.980966+0000","last_active":"2023-10-09T13:16:21.985798+0000","last_peered":"2023-10-09T13:16:21.985798+0000","last_clean":"2023-10-09T13:16:21.985798+0000","last_became_active":"2023-10-09T13:16:21.980427+0000","last_became_peered":"2023-10-09T13:16:21.980427+0000","last_unstale":"2023-10-09T13:16:21.985798+0000","last_undegraded":"2023-10-09T13:16:21.985798+0000","last_fullsized":"2023-10-09T13:16:21.985798+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:31.432708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985970+0000","last_change":"2023-10-09T13:16:21.983680+0000","last_active":"2023-10-09T13:16:21.985970+0000","last_peered":"2023-10-09T13:16:21.985970+0000","last_clean":"2023-10-09T13:16:21.985970+0000","last_became_active":"2023-10-09T13:16:21.983420+0000","last_became_peered":"2023-10-09T13:16:21.983420+0000","last_unstale":"2023-10-09T13:16:21.985970+0000","last_undegraded":"2023-10-09T13:16:21.985970+0000","last_fullsized":"2023-10-09T13:16:21.985970+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:11.242947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986956+0000","last_change":"2023-10-09T13:16:21.984801+0000","last_active":"2023-10-09T13:16:21.986956+0000","last_peered":"2023-10-09T13:16:21.986956+0000","last_clean":"2023-10-09T13:16:21.986956+0000","last_became_active":"2023-10-09T13:16:21.984132+0000","last_became_peered":"2023-10-09T13:16:21.984132+0000","last_unstale":"2023-10-09T13:16:21.986956+0000","last_undegraded":"2023-10-09T13:16:21.986956+0000","last_fullsized":"2023-10-09T13:16:21.986956+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:03.469750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986068+0000","last_change":"2023-10-09T13:16:21.981360+0000","last_active":"2023-10-09T13:16:21.986068+0000","last_peered":"2023-10-09T13:16:21.986068+0000","last_clean":"2023-10-09T13:16:21.986068+0000","last_became_active":"2023-10-09T13:16:21.980921+0000","last_became_peered":"2023-10-09T13:16:21.980921+0000","last_unstale":"2023-10-09T13:16:21.986068+0000","last_undegraded":"2023-10-09T13:16:21.986068+0000","last_fullsized":"2023-10-09T13:16:21.986068+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:49.426794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992437+0000","last_change":"2023-10-09T13:16:21.985857+0000","last_active":"2023-10-09T13:16:21.992437+0000","last_peered":"2023-10-09T13:16:21.992437+0000","last_clean":"2023-10-09T13:16:21.992437+0000","last_became_active":"2023-10-09T13:16:21.985625+0000","last_became_peered":"2023-10-09T13:16:21.985625+0000","last_unstale":"2023-10-09T13:16:21.992437+0000","last_undegraded":"2023-10-09T13:16:21.992437+0000","last_fullsized":"2023-10-09T13:16:21.992437+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:08.766173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984886+0000","last_change":"2023-10-09T13:16:21.983231+0000","last_active":"2023-10-09T13:16:21.984886+0000","last_peered":"2023-10-09T13:16:21.984886+0000","last_clean":"2023-10-09T13:16:21.984886+0000","last_became_active":"2023-10-09T13:16:21.982996+0000","last_became_peered":"2023-10-09T13:16:21.982996+0000","last_unstale":"2023-10-09T13:16:21.984886+0000","last_undegraded":"2023-10-09T13:16:21.984886+0000","last_fullsized":"2023-10-09T13:16:21.984886+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:03.704404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.989127+0000","last_change":"2023-10-09T13:16:21.987463+0000","last_active":"2023-10-09T13:16:21.989127+0000","last_peered":"2023-10-09T13:16:21.989127+0000","last_clean":"2023-10-09T13:16:21.989127+0000","last_became_active":"2023-10-09T13:16:21.987180+0000","last_became_peered":"2023-10-09T13:16:21.987180+0000","last_unstale":"2023-10-09T13:16:21.989127+0000","last_undegraded":"2023-10-09T13:16:21.989127+0000","last_fullsized":"2023-10-09T13:16:21.989127+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:36.131897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994035+0000","last_change":"2023-10-09T13:16:21.990192+0000","last_active":"2023-10-09T13:16:21.994035+0000","last_peered":"2023-10-09T13:16:21.994035+0000","last_clean":"2023-10-09T13:16:21.994035+0000","last_became_active":"2023-10-09T13:16:21.989953+0000","last_became_peered":"2023-10-09T13:16:21.989953+0000","last_unstale":"2023-10-09T13:16:21.994035+0000","last_undegraded":"2023-10-09T13:16:21.994035+0000","last_fullsized":"2023-10-09T13:16:21.994035+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:48.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984852+0000","last_change":"2023-10-09T13:16:21.982718+0000","last_active":"2023-10-09T13:16:21.984852+0000","last_peered":"2023-10-09T13:16:21.984852+0000","last_clean":"2023-10-09T13:16:21.984852+0000","last_became_active":"2023-10-09T13:16:21.982470+0000","last_became_peered":"2023-10-09T13:16:21.982470+0000","last_unstale":"2023-10-09T13:16:21.984852+0000","last_undegraded":"2023-10-09T13:16:21.984852+0000","last_fullsized":"2023-10-09T13:16:21.984852+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:46.162311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.988957+0000","last_change":"2023-10-09T13:16:21.985547+0000","last_active":"2023-10-09T13:16:21.988957+0000","last_peered":"2023-10-09T13:16:21.988957+0000","last_clean":"2023-10-09T13:16:21.988957+0000","last_became_active":"2023-10-09T13:16:21.985288+0000","last_became_peered":"2023-10-09T13:16:21.985288+0000","last_unstale":"2023-10-09T13:16:21.988957+0000","last_undegraded":"2023-10-09T13:16:21.988957+0000","last_fullsized":"2023-10-09T13:16:21.988957+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:48.417314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993459+0000","last_change":"2023-10-09T13:16:21.979574+0000","last_active":"2023-10-09T13:16:21.993459+0000","last_peered":"2023-10-09T13:16:21.993459+0000","last_clean":"2023-10-09T13:16:21.993459+0000","last_became_active":"2023-10-09T13:16:21.979327+0000","last_became_peered":"2023-10-09T13:16:21.979327+0000","last_unstale":"2023-10-09T13:16:21.993459+0000","last_undegraded":"2023-10-09T13:16:21.993459+0000","last_fullsized":"2023-10-09T13:16:21.993459+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:33.385074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.979730+0000","last_change":"2023-10-09T13:16:21.976558+0000","last_active":"2023-10-09T13:16:21.979730+0000","last_peered":"2023-10-09T13:16:21.979730+0000","last_clean":"2023-10-09T13:16:21.979730+0000","last_became_active":"2023-10-09T13:16:21.976297+0000","last_became_peered":"2023-10-09T13:16:21.976297+0000","last_unstale":"2023-10-09T13:16:21.979730+0000","last_undegraded":"2023-10-09T13:16:21.979730+0000","last_fullsized":"2023-10-09T13:16:21.979730+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:08.601463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.977534+0000","last_change":"2023-10-09T13:16:21.973622+0000","last_active":"2023-10-09T13:16:21.977534+0000","last_peered":"2023-10-09T13:16:21.977534+0000","last_clean":"2023-10-09T13:16:21.977534+0000","last_became_active":"2023-10-09T13:16:21.973356+0000","last_became_peered":"2023-10-09T13:16:21.973356+0000","last_unstale":"2023-10-09T13:16:21.977534+0000","last_undegraded":"2023-10-09T13:16:21.977534+0000","last_fullsized":"2023-10-09T13:16:21.977534+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:20.418439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984454+0000","last_change":"2023-10-09T13:16:21.978264+0000","last_active":"2023-10-09T13:16:21.984454+0000","last_peered":"2023-10-09T13:16:21.984454+0000","last_clean":"2023-10-09T13:16:21.984454+0000","last_became_active":"2023-10-09T13:16:21.978002+0000","last_became_peered":"2023-10-09T13:16:21.978002+0000","last_unstale":"2023-10-09T13:16:21.984454+0000","last_undegraded":"2023-10-09T13:16:21.984454+0000","last_fullsized":"2023-10-09T13:16:21.984454+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:50.194794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984851+0000","last_change":"2023-10-09T13:16:21.978220+0000","last_active":"2023-10-09T13:16:21.984851+0000","last_peered":"2023-10-09T13:16:21.984851+0000","last_clean":"2023-10-09T13:16:21.984851+0000","last_became_active":"2023-10-09T13:16:21.977971+0000","last_became_peered":"2023-10-09T13:16:21.977971+0000","last_unstale":"2023-10-09T13:16:21.984851+0000","last_undegraded":"2023-10-09T13:16:21.984851+0000","last_fullsized":"2023-10-09T13:16:21.984851+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:47.932132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.980704+0000","last_change":"2023-10-09T13:16:21.977854+0000","last_active":"2023-10-09T13:16:21.980704+0000","last_peered":"2023-10-09T13:16:21.980704+0000","last_clean":"2023-10-09T13:16:21.980704+0000","last_became_active":"2023-10-09T13:16:21.977593+0000","last_became_peered":"2023-10-09T13:16:21.977593+0000","last_unstale":"2023-10-09T13:16:21.980704+0000","last_undegraded":"2023-10-09T13:16:21.980704+0000","last_fullsized":"2023-10-09T13:16:21.980704+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:50.194794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.999971+0000","last_change":"2023-10-09T13:16:21.994661+0000","last_active":"2023-10-09T13:16:21.999971+0000","last_peered":"2023-10-09T13:16:21.999971+0000","last_clean":"2023-10-09T13:16:21.999971+0000","last_became_active":"2023-10-09T13:16:21.994332+0000","last_became_peered":"2023-10-09T13:16:21.994332+0000","last_unstale":"2023-10-09T13:16:21.999971+0000","last_undegraded":"2023-10-09T13:16:21.999971+0000","last_fullsized":"2023-10-09T13:16:21.999971+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:19.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985435+0000","last_change":"2023-10-09T13:16:21.978854+0000","last_active":"2023-10-09T13:16:21.985435+0000","last_peered":"2023-10-09T13:16:21.985435+0000","last_clean":"2023-10-09T13:16:21.985435+0000","last_became_active":"2023-10-09T13:16:21.978534+0000","last_became_peered":"2023-10-09T13:16:21.978534+0000","last_unstale":"2023-10-09T13:16:21.985435+0000","last_undegraded":"2023-10-09T13:16:21.985435+0000","last_fullsized":"2023-10-09T13:16:21.985435+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:49.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986992+0000","last_change":"2023-10-09T13:16:21.984987+0000","last_active":"2023-10-09T13:16:21.986992+0000","last_peered":"2023-10-09T13:16:21.986992+0000","last_clean":"2023-10-09T13:16:21.986992+0000","last_became_active":"2023-10-09T13:16:21.984518+0000","last_became_peered":"2023-10-09T13:16:21.984518+0000","last_unstale":"2023-10-09T13:16:21.986992+0000","last_undegraded":"2023-10-09T13:16:21.986992+0000","last_fullsized":"2023-10-09T13:16:21.986992+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:38.345943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983229+0000","last_change":"2023-10-09T13:16:21.982597+0000","last_active":"2023-10-09T13:16:21.983229+0000","last_peered":"2023-10-09T13:16:21.983229+0000","last_clean":"2023-10-09T13:16:21.983229+0000","last_became_active":"2023-10-09T13:16:21.982332+0000","last_became_peered":"2023-10-09T13:16:21.982332+0000","last_unstale":"2023-10-09T13:16:21.983229+0000","last_undegraded":"2023-10-09T13:16:21.983229+0000","last_fullsized":"2023-10-09T13:16:21.983229+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:24.881099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984225+0000","last_change":"2023-10-09T13:16:21.981003+0000","last_active":"2023-10-09T13:16:21.984225+0000","last_peered":"2023-10-09T13:16:21.984225+0000","last_clean":"2023-10-09T13:16:21.984225+0000","last_became_active":"2023-10-09T13:16:21.980759+0000","last_became_peered":"2023-10-09T13:16:21.980759+0000","last_unstale":"2023-10-09T13:16:21.984225+0000","last_undegraded":"2023-10-09T13:16:21.984225+0000","last_fullsized":"2023-10-09T13:16:21.984225+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:16.745289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992486+0000","last_change":"2023-10-09T13:16:21.986398+0000","last_active":"2023-10-09T13:16:21.992486+0000","last_peered":"2023-10-09T13:16:21.992486+0000","last_clean":"2023-10-09T13:16:21.992486+0000","last_became_active":"2023-10-09T13:16:21.986170+0000","last_became_peered":"2023-10-09T13:16:21.986170+0000","last_unstale":"2023-10-09T13:16:21.992486+0000","last_undegraded":"2023-10-09T13:16:21.992486+0000","last_fullsized":"2023-10-09T13:16:21.992486+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:22.532460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994043+0000","last_change":"2023-10-09T13:16:20.973380+0000","last_active":"2023-10-09T13:16:21.994043+0000","last_peered":"2023-10-09T13:16:21.994043+0000","last_clean":"2023-10-09T13:16:21.994043+0000","last_became_active":"2023-10-09T13:16:20.972958+0000","last_became_peered":"2023-10-09T13:16:20.972958+0000","last_unstale":"2023-10-09T13:16:21.994043+0000","last_undegraded":"2023-10-09T13:16:21.994043+0000","last_fullsized":"2023-10-09T13:16:21.994043+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:48.619196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.991734+0000","last_change":"2023-10-09T13:16:21.975315+0000","last_active":"2023-10-09T13:16:21.991734+0000","last_peered":"2023-10-09T13:16:21.991734+0000","last_clean":"2023-10-09T13:16:21.991734+0000","last_became_active":"2023-10-09T13:16:21.975039+0000","last_became_peered":"2023-10-09T13:16:21.975039+0000","last_unstale":"2023-10-09T13:16:21.991734+0000","last_undegraded":"2023-10-09T13:16:21.991734+0000","last_fullsized":"2023-10-09T13:16:21.991734+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:53.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996823+0000","last_change":"2023-10-09T13:16:20.973896+0000","last_active":"2023-10-09T13:16:21.996823+0000","last_peered":"2023-10-09T13:16:21.996823+0000","last_clean":"2023-10-09T13:16:21.996823+0000","last_became_active":"2023-10-09T13:16:20.973597+0000","last_became_peered":"2023-10-09T13:16:20.973597+0000","last_unstale":"2023-10-09T13:16:21.996823+0000","last_undegraded":"2023-10-09T13:16:21.996823+0000","last_fullsized":"2023-10-09T13:16:21.996823+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:23.056939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.979851+0000","last_change":"2023-10-09T13:16:21.975149+0000","last_active":"2023-10-09T13:16:21.979851+0000","last_peered":"2023-10-09T13:16:21.979851+0000","last_clean":"2023-10-09T13:16:21.979851+0000","last_became_active":"2023-10-09T13:16:21.974887+0000","last_became_peered":"2023-10-09T13:16:21.974887+0000","last_unstale":"2023-10-09T13:16:21.979851+0000","last_undegraded":"2023-10-09T13:16:21.979851+0000","last_fullsized":"2023-10-09T13:16:21.979851+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:31.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.997625+0000","last_change":"2023-10-09T13:16:20.973380+0000","last_active":"2023-10-09T13:16:21.997625+0000","last_peered":"2023-10-09T13:16:21.997625+0000","last_clean":"2023-10-09T13:16:21.997625+0000","last_became_active":"2023-10-09T13:16:20.973144+0000","last_became_peered":"2023-10-09T13:16:20.973144+0000","last_unstale":"2023-10-09T13:16:21.997625+0000","last_undegraded":"2023-10-09T13:16:21.997625+0000","last_fullsized":"2023-10-09T13:16:21.997625+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:06.088068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.988530+0000","last_change":"2023-10-09T13:16:21.985795+0000","last_active":"2023-10-09T13:16:21.988530+0000","last_peered":"2023-10-09T13:16:21.988530+0000","last_clean":"2023-10-09T13:16:21.988530+0000","last_became_active":"2023-10-09T13:16:21.985202+0000","last_became_peered":"2023-10-09T13:16:21.985202+0000","last_unstale":"2023-10-09T13:16:21.988530+0000","last_undegraded":"2023-10-09T13:16:21.988530+0000","last_fullsized":"2023-10-09T13:16:21.988530+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:36.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993099+0000","last_change":"2023-10-09T13:16:20.974215+0000","last_active":"2023-10-09T13:16:21.993099+0000","last_peered":"2023-10-09T13:16:21.993099+0000","last_clean":"2023-10-09T13:16:21.993099+0000","last_became_active":"2023-10-09T13:16:20.973955+0000","last_became_peered":"2023-10-09T13:16:20.973955+0000","last_unstale":"2023-10-09T13:16:21.993099+0000","last_undegraded":"2023-10-09T13:16:21.993099+0000","last_fullsized":"2023-10-09T13:16:21.993099+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:52.180936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993442+0000","last_change":"2023-10-09T13:16:21.979022+0000","last_active":"2023-10-09T13:16:21.993442+0000","last_peered":"2023-10-09T13:16:21.993442+0000","last_clean":"2023-10-09T13:16:21.993442+0000","last_became_active":"2023-10-09T13:16:21.978542+0000","last_became_peered":"2023-10-09T13:16:21.978542+0000","last_unstale":"2023-10-09T13:16:21.993442+0000","last_undegraded":"2023-10-09T13:16:21.993442+0000","last_fullsized":"2023-10-09T13:16:21.993442+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:06.317197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994893+0000","last_change":"2023-10-09T13:16:20.966935+0000","last_active":"2023-10-09T13:16:21.994893+0000","last_peered":"2023-10-09T13:16:21.994893+0000","last_clean":"2023-10-09T13:16:21.994893+0000","last_became_active":"2023-10-09T13:16:20.966655+0000","last_became_peered":"2023-10-09T13:16:20.966655+0000","last_unstale":"2023-10-09T13:16:21.994893+0000","last_undegraded":"2023-10-09T13:16:21.994893+0000","last_fullsized":"2023-10-09T13:16:21.994893+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:06.971294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992902+0000","last_change":"2023-10-09T13:16:21.987167+0000","last_active":"2023-10-09T13:16:21.992902+0000","last_peered":"2023-10-09T13:16:21.992902+0000","last_clean":"2023-10-09T13:16:21.992902+0000","last_became_active":"2023-10-09T13:16:21.986939+0000","last_became_peered":"2023-10-09T13:16:21.986939+0000","last_unstale":"2023-10-09T13:16:21.992902+0000","last_undegraded":"2023-10-09T13:16:21.992902+0000","last_fullsized":"2023-10-09T13:16:21.992902+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:11.619770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.999735+0000","last_change":"2023-10-09T13:16:20.973837+0000","last_active":"2023-10-09T13:16:21.999735+0000","last_peered":"2023-10-09T13:16:21.999735+0000","last_clean":"2023-10-09T13:16:21.999735+0000","last_became_active":"2023-10-09T13:16:20.973594+0000","last_became_peered":"2023-10-09T13:16:20.973594+0000","last_unstale":"2023-10-09T13:16:21.999735+0000","last_undegraded":"2023-10-09T13:16:21.999735+0000","last_fullsized":"2023-10-09T13:16:21.999735+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:00.502503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983162+0000","last_change":"2023-10-09T13:16:21.976033+0000","last_active":"2023-10-09T13:16:21.983162+0000","last_peered":"2023-10-09T13:16:21.983162+0000","last_clean":"2023-10-09T13:16:21.983162+0000","last_became_active":"2023-10-09T13:16:21.975689+0000","last_became_peered":"2023-10-09T13:16:21.975689+0000","last_unstale":"2023-10-09T13:16:21.983162+0000","last_undegraded":"2023-10-09T13:16:21.983162+0000","last_fullsized":"2023-10-09T13:16:21.983162+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:01.746648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970326+0000","last_change":"2023-10-09T13:16:20.970296+0000","last_active":"2023-10-09T13:16:21.970326+0000","last_peered":"2023-10-09T13:16:21.970326+0000","last_clean":"2023-10-09T13:16:21.970326+0000","last_became_active":"2023-10-09T13:16:20.970026+0000","last_became_peered":"2023-10-09T13:16:20.970026+0000","last_unstale":"2023-10-09T13:16:21.970326+0000","last_undegraded":"2023-10-09T13:16:21.970326+0000","last_fullsized":"2023-10-09T13:16:21.970326+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:20.174722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990189+0000","last_change":"2023-10-09T13:16:21.985661+0000","last_active":"2023-10-09T13:16:21.990189+0000","last_peered":"2023-10-09T13:16:21.990189+0000","last_clean":"2023-10-09T13:16:21.990189+0000","last_became_active":"2023-10-09T13:16:21.985406+0000","last_became_peered":"2023-10-09T13:16:21.985406+0000","last_unstale":"2023-10-09T13:16:21.990189+0000","last_undegraded":"2023-10-09T13:16:21.990189+0000","last_fullsized":"2023-10-09T13:16:21.990189+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:41.701099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.967097+0000","last_change":"2023-10-09T13:16:20.970308+0000","last_active":"2023-10-09T13:16:21.967097+0000","last_peered":"2023-10-09T13:16:21.967097+0000","last_clean":"2023-10-09T13:16:21.967097+0000","last_became_active":"2023-10-09T13:16:20.969986+0000","last_became_peered":"2023-10-09T13:16:20.969986+0000","last_unstale":"2023-10-09T13:16:21.967097+0000","last_undegraded":"2023-10-09T13:16:21.967097+0000","last_fullsized":"2023-10-09T13:16:21.967097+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:07:19.066955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.982332+0000","last_change":"2023-10-09T13:16:21.978649+0000","last_active":"2023-10-09T13:16:21.982332+0000","last_peered":"2023-10-09T13:16:21.982332+0000","last_clean":"2023-10-09T13:16:21.982332+0000","last_became_active":"2023-10-09T13:16:21.978362+0000","last_became_peered":"2023-10-09T13:16:21.978362+0000","last_unstale":"2023-10-09T13:16:21.982332+0000","last_undegraded":"2023-10-09T13:16:21.982332+0000","last_fullsized":"2023-10-09T13:16:21.982332+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:48.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970319+0000","last_change":"2023-10-09T13:16:20.973141+0000","last_active":"2023-10-09T13:16:21.970319+0000","last_peered":"2023-10-09T13:16:21.970319+0000","last_clean":"2023-10-09T13:16:21.970319+0000","last_became_active":"2023-10-09T13:16:20.972884+0000","last_became_peered":"2023-10-09T13:16:20.972884+0000","last_unstale":"2023-10-09T13:16:21.970319+0000","last_undegraded":"2023-10-09T13:16:21.970319+0000","last_fullsized":"2023-10-09T13:16:21.970319+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:37.768977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.987543+0000","last_change":"2023-10-09T13:16:21.985437+0000","last_active":"2023-10-09T13:16:21.987543+0000","last_peered":"2023-10-09T13:16:21.987543+0000","last_clean":"2023-10-09T13:16:21.987543+0000","last_became_active":"2023-10-09T13:16:21.985109+0000","last_became_peered":"2023-10-09T13:16:21.985109+0000","last_unstale":"2023-10-09T13:16:21.987543+0000","last_undegraded":"2023-10-09T13:16:21.987543+0000","last_fullsized":"2023-10-09T13:16:21.987543+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:34.272424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"211'3","reported_seq":13,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996308+0000","last_change":"2023-10-09T13:16:20.973559+0000","last_active":"2023-10-09T13:16:21.996308+0000","last_peered":"2023-10-09T13:16:21.996308+0000","last_clean":"2023-10-09T13:16:21.996308+0000","last_became_active":"2023-10-09T13:16:20.973310+0000","last_became_peered":"2023-10-09T13:16:20.973310+0000","last_unstale":"2023-10-09T13:16:21.996308+0000","last_undegraded":"2023-10-09T13:16:21.996308+0000","last_fullsized":"2023-10-09T13:16:21.996308+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:49.212218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993391+0000","last_change":"2023-10-09T13:16:21.980155+0000","last_active":"2023-10-09T13:16:21.993391+0000","last_peered":"2023-10-09T13:16:21.993391+0000","last_clean":"2023-10-09T13:16:21.993391+0000","last_became_active":"2023-10-09T13:16:21.979891+0000","last_became_peered":"2023-10-09T13:16:21.979891+0000","last_unstale":"2023-10-09T13:16:21.993391+0000","last_undegraded":"2023-10-09T13:16:21.993391+0000","last_fullsized":"2023-10-09T13:16:21.993391+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:45:01.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"211'6","reported_seq":16,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.997794+0000","last_change":"2023-10-09T13:16:20.971579+0000","last_active":"2023-10-09T13:16:21.997794+0000","last_peered":"2023-10-09T13:16:21.997794+0000","last_clean":"2023-10-09T13:16:21.997794+0000","last_became_active":"2023-10-09T13:16:20.970440+0000","last_became_peered":"2023-10-09T13:16:20.970440+0000","last_unstale":"2023-10-09T13:16:21.997794+0000","last_undegraded":"2023-10-09T13:16:21.997794+0000","last_fullsized":"2023-10-09T13:16:21.997794+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.980734+0000","last_change":"2023-10-09T13:16:21.977134+0000","last_active":"2023-10-09T13:16:21.980734+0000","last_peered":"2023-10-09T13:16:21.980734+0000","last_clean":"2023-10-09T13:16:21.980734+0000","last_became_active":"2023-10-09T13:16:21.976895+0000","last_became_peered":"2023-10-09T13:16:21.976895+0000","last_unstale":"2023-10-09T13:16:21.980734+0000","last_undegraded":"2023-10-09T13:16:21.980734+0000","last_fullsized":"2023-10-09T13:16:21.980734+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:25.652641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000193+0000","last_change":"2023-10-09T13:16:20.969778+0000","last_active":"2023-10-09T13:16:22.000193+0000","last_peered":"2023-10-09T13:16:22.000193+0000","last_clean":"2023-10-09T13:16:22.000193+0000","last_became_active":"2023-10-09T13:16:20.969469+0000","last_became_peered":"2023-10-09T13:16:20.969469+0000","last_unstale":"2023-10-09T13:16:22.000193+0000","last_undegraded":"2023-10-09T13:16:22.000193+0000","last_fullsized":"2023-10-09T13:16:22.000193+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:43.790547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986462+0000","last_change":"2023-10-09T13:16:21.981394+0000","last_active":"2023-10-09T13:16:21.986462+0000","last_peered":"2023-10-09T13:16:21.986462+0000","last_clean":"2023-10-09T13:16:21.986462+0000","last_became_active":"2023-10-09T13:16:21.980223+0000","last_became_peered":"2023-10-09T13:16:21.980223+0000","last_unstale":"2023-10-09T13:16:21.986462+0000","last_undegraded":"2023-10-09T13:16:21.986462+0000","last_fullsized":"2023-10-09T13:16:21.986462+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.590928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.965143+0000","last_change":"2023-10-09T13:16:20.963392+0000","last_active":"2023-10-09T13:16:21.965143+0000","last_peered":"2023-10-09T13:16:21.965143+0000","last_clean":"2023-10-09T13:16:21.965143+0000","last_became_active":"2023-10-09T13:16:20.963114+0000","last_became_peered":"2023-10-09T13:16:20.963114+0000","last_unstale":"2023-10-09T13:16:21.965143+0000","last_undegraded":"2023-10-09T13:16:21.965143+0000","last_fullsized":"2023-10-09T13:16:21.965143+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:43.589471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996022+0000","last_change":"2023-10-09T13:16:21.995169+0000","last_active":"2023-10-09T13:16:21.996022+0000","last_peered":"2023-10-09T13:16:21.996022+0000","last_clean":"2023-10-09T13:16:21.996022+0000","last_became_active":"2023-10-09T13:16:21.994858+0000","last_became_peered":"2023-10-09T13:16:21.994858+0000","last_unstale":"2023-10-09T13:16:21.996022+0000","last_undegraded":"2023-10-09T13:16:21.996022+0000","last_fullsized":"2023-10-09T13:16:21.996022+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:02.788953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.968201+0000","last_change":"2023-10-09T13:16:20.975765+0000","last_active":"2023-10-09T13:16:21.968201+0000","last_peered":"2023-10-09T13:16:21.968201+0000","last_clean":"2023-10-09T13:16:21.968201+0000","last_became_active":"2023-10-09T13:16:20.975477+0000","last_became_peered":"2023-10-09T13:16:20.975477+0000","last_unstale":"2023-10-09T13:16:21.968201+0000","last_undegraded":"2023-10-09T13:16:21.968201+0000","last_fullsized":"2023-10-09T13:16:21.968201+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:56.800026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.978223+0000","last_change":"2023-10-09T13:16:21.974400+0000","last_active":"2023-10-09T13:16:21.978223+0000","last_peered":"2023-10-09T13:16:21.978223+0000","last_clean":"2023-10-09T13:16:21.978223+0000","last_became_active":"2023-10-09T13:16:21.974125+0000","last_became_peered":"2023-10-09T13:16:21.974125+0000","last_unstale":"2023-10-09T13:16:21.978223+0000","last_undegraded":"2023-10-09T13:16:21.978223+0000","last_fullsized":"2023-10-09T13:16:21.978223+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:59:25.015202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"211'8","reported_seq":18,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000705+0000","last_change":"2023-10-09T13:16:20.970449+0000","last_active":"2023-10-09T13:16:22.000705+0000","last_peered":"2023-10-09T13:16:22.000705+0000","last_clean":"2023-10-09T13:16:22.000705+0000","last_became_active":"2023-10-09T13:16:20.970149+0000","last_became_peered":"2023-10-09T13:16:20.970149+0000","last_unstale":"2023-10-09T13:16:22.000705+0000","last_undegraded":"2023-10-09T13:16:22.000705+0000","last_fullsized":"2023-10-09T13:16:22.000705+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:38.924796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.975542+0000","last_change":"2023-10-09T13:16:21.974602+0000","last_active":"2023-10-09T13:16:21.975542+0000","last_peered":"2023-10-09T13:16:21.975542+0000","last_clean":"2023-10-09T13:16:21.975542+0000","last_became_active":"2023-10-09T13:16:21.974259+0000","last_became_peered":"2023-10-09T13:16:21.974259+0000","last_unstale":"2023-10-09T13:16:21.975542+0000","last_undegraded":"2023-10-09T13:16:21.975542+0000","last_fullsized":"2023-10-09T13:16:21.975542+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:07.910098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.995144+0000","last_change":"2023-10-09T13:16:20.973214+0000","last_active":"2023-10-09T13:16:21.995144+0000","last_peered":"2023-10-09T13:16:21.995144+0000","last_clean":"2023-10-09T13:16:21.995144+0000","last_became_active":"2023-10-09T13:16:20.972393+0000","last_became_peered":"2023-10-09T13:16:20.972393+0000","last_unstale":"2023-10-09T13:16:21.995144+0000","last_undegraded":"2023-10-09T13:16:21.995144+0000","last_fullsized":"2023-10-09T13:16:21.995144+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:27.318752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983819+0000","last_change":"2023-10-09T13:16:21.980984+0000","last_active":"2023-10-09T13:16:21.983819+0000","last_peered":"2023-10-09T13:16:21.983819+0000","last_clean":"2023-10-09T13:16:21.983819+0000","last_became_active":"2023-10-09T13:16:21.980719+0000","last_became_peered":"2023-10-09T13:16:21.980719+0000","last_unstale":"2023-10-09T13:16:21.983819+0000","last_undegraded":"2023-10-09T13:16:21.983819+0000","last_fullsized":"2023-10-09T13:16:21.983819+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:05.279600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.999719+0000","last_change":"2023-10-09T13:16:20.970687+0000","last_active":"2023-10-09T13:16:21.999719+0000","last_peered":"2023-10-09T13:16:21.999719+0000","last_clean":"2023-10-09T13:16:21.999719+0000","last_became_active":"2023-10-09T13:16:20.970421+0000","last_became_peered":"2023-10-09T13:16:20.970421+0000","last_unstale":"2023-10-09T13:16:21.999719+0000","last_undegraded":"2023-10-09T13:16:21.999719+0000","last_fullsized":"2023-10-09T13:16:21.999719+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:47.425358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.987184+0000","last_change":"2023-10-09T13:16:21.985233+0000","last_active":"2023-10-09T13:16:21.987184+0000","last_peered":"2023-10-09T13:16:21.987184+0000","last_clean":"2023-10-09T13:16:21.987184+0000","last_became_active":"2023-10-09T13:16:21.984925+0000","last_became_peered":"2023-10-09T13:16:21.984925+0000","last_unstale":"2023-10-09T13:16:21.987184+0000","last_undegraded":"2023-10-09T13:16:21.987184+0000","last_fullsized":"2023-10-09T13:16:21.987184+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:22.605969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000088+0000","last_change":"2023-10-09T13:16:20.969196+0000","last_active":"2023-10-09T13:16:22.000088+0000","last_peered":"2023-10-09T13:16:22.000088+0000","last_clean":"2023-10-09T13:16:22.000088+0000","last_became_active":"2023-10-09T13:16:20.968941+0000","last_became_peered":"2023-10-09T13:16:20.968941+0000","last_unstale":"2023-10-09T13:16:22.000088+0000","last_undegraded":"2023-10-09T13:16:22.000088+0000","last_fullsized":"2023-10-09T13:16:22.000088+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:19.260901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986024+0000","last_change":"2023-10-09T13:16:21.983996+0000","last_active":"2023-10-09T13:16:21.986024+0000","last_peered":"2023-10-09T13:16:21.986024+0000","last_clean":"2023-10-09T13:16:21.986024+0000","last_became_active":"2023-10-09T13:16:21.983630+0000","last_became_peered":"2023-10-09T13:16:21.983630+0000","last_unstale":"2023-10-09T13:16:21.986024+0000","last_undegraded":"2023-10-09T13:16:21.986024+0000","last_fullsized":"2023-10-09T13:16:21.986024+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:50.834079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.968132+0000","last_change":"2023-10-09T13:16:20.969022+0000","last_active":"2023-10-09T13:16:21.968132+0000","last_peered":"2023-10-09T13:16:21.968132+0000","last_clean":"2023-10-09T13:16:21.968132+0000","last_became_active":"2023-10-09T13:16:20.968696+0000","last_became_peered":"2023-10-09T13:16:20.968696+0000","last_unstale":"2023-10-09T13:16:21.968132+0000","last_undegraded":"2023-10-09T13:16:21.968132+0000","last_fullsized":"2023-10-09T13:16:21.968132+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:56.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993420+0000","last_change":"2023-10-09T13:16:21.978559+0000","last_active":"2023-10-09T13:16:21.993420+0000","last_peered":"2023-10-09T13:16:21.993420+0000","last_clean":"2023-10-09T13:16:21.993420+0000","last_became_active":"2023-10-09T13:16:21.975775+0000","last_became_peered":"2023-10-09T13:16:21.975775+0000","last_unstale":"2023-10-09T13:16:21.993420+0000","last_undegraded":"2023-10-09T13:16:21.993420+0000","last_fullsized":"2023-10-09T13:16:21.993420+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:11.619770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.997489+0000","last_change":"2023-10-09T13:16:20.978204+0000","last_active":"2023-10-09T13:16:21.997489+0000","last_peered":"2023-10-09T13:16:21.997489+0000","last_clean":"2023-10-09T13:16:21.997489+0000","last_became_active":"2023-10-09T13:16:20.977938+0000","last_became_peered":"2023-10-09T13:16:20.977938+0000","last_unstale":"2023-10-09T13:16:21.997489+0000","last_undegraded":"2023-10-09T13:16:21.997489+0000","last_fullsized":"2023-10-09T13:16:21.997489+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:59.530833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986482+0000","last_change":"2023-10-09T13:16:21.981471+0000","last_active":"2023-10-09T13:16:21.986482+0000","last_peered":"2023-10-09T13:16:21.986482+0000","last_clean":"2023-10-09T13:16:21.986482+0000","last_became_active":"2023-10-09T13:16:21.981182+0000","last_became_peered":"2023-10-09T13:16:21.981182+0000","last_unstale":"2023-10-09T13:16:21.986482+0000","last_undegraded":"2023-10-09T13:16:21.986482+0000","last_fullsized":"2023-10-09T13:16:21.986482+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:31.432708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970793+0000","last_change":"2023-10-09T13:16:20.973707+0000","last_active":"2023-10-09T13:16:21.970793+0000","last_peered":"2023-10-09T13:16:21.970793+0000","last_clean":"2023-10-09T13:16:21.970793+0000","last_became_active":"2023-10-09T13:16:20.973449+0000","last_became_peered":"2023-10-09T13:16:20.973449+0000","last_unstale":"2023-10-09T13:16:21.970793+0000","last_undegraded":"2023-10-09T13:16:21.970793+0000","last_fullsized":"2023-10-09T13:16:21.970793+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:34:02.949834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985474+0000","last_change":"2023-10-09T13:16:21.979250+0000","last_active":"2023-10-09T13:16:21.985474+0000","last_peered":"2023-10-09T13:16:21.985474+0000","last_clean":"2023-10-09T13:16:21.985474+0000","last_became_active":"2023-10-09T13:16:21.978993+0000","last_became_peered":"2023-10-09T13:16:21.978993+0000","last_unstale":"2023-10-09T13:16:21.985474+0000","last_undegraded":"2023-10-09T13:16:21.985474+0000","last_fullsized":"2023-10-09T13:16:21.985474+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:13.955305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970326+0000","last_change":"2023-10-09T13:16:20.975021+0000","last_active":"2023-10-09T13:16:21.970326+0000","last_peered":"2023-10-09T13:16:21.970326+0000","last_clean":"2023-10-09T13:16:21.970326+0000","last_became_active":"2023-10-09T13:16:20.974765+0000","last_became_peered":"2023-10-09T13:16:20.974765+0000","last_unstale":"2023-10-09T13:16:21.970326+0000","last_undegraded":"2023-10-09T13:16:21.970326+0000","last_fullsized":"2023-10-09T13:16:21.970326+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:25.214205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984201+0000","last_change":"2023-10-09T13:16:21.980810+0000","last_active":"2023-10-09T13:16:21.984201+0000","last_peered":"2023-10-09T13:16:21.984201+0000","last_clean":"2023-10-09T13:16:21.984201+0000","last_became_active":"2023-10-09T13:16:21.980534+0000","last_became_peered":"2023-10-09T13:16:21.980534+0000","last_unstale":"2023-10-09T13:16:21.984201+0000","last_undegraded":"2023-10-09T13:16:21.984201+0000","last_fullsized":"2023-10-09T13:16:21.984201+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:10.180560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.973501+0000","last_change":"2023-10-09T13:16:20.976018+0000","last_active":"2023-10-09T13:16:21.973501+0000","last_peered":"2023-10-09T13:16:21.973501+0000","last_clean":"2023-10-09T13:16:21.973501+0000","last_became_active":"2023-10-09T13:16:20.975728+0000","last_became_peered":"2023-10-09T13:16:20.975728+0000","last_unstale":"2023-10-09T13:16:21.973501+0000","last_undegraded":"2023-10-09T13:16:21.973501+0000","last_fullsized":"2023-10-09T13:16:21.973501+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:54.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.975151+0000","last_change":"2023-10-09T13:16:21.974328+0000","last_active":"2023-10-09T13:16:21.975151+0000","last_peered":"2023-10-09T13:16:21.975151+0000","last_clean":"2023-10-09T13:16:21.975151+0000","last_became_active":"2023-10-09T13:16:21.974079+0000","last_became_peered":"2023-10-09T13:16:21.974079+0000","last_unstale":"2023-10-09T13:16:21.975151+0000","last_undegraded":"2023-10-09T13:16:21.975151+0000","last_fullsized":"2023-10-09T13:16:21.975151+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:02.633413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000342+0000","last_change":"2023-10-09T13:16:20.973298+0000","last_active":"2023-10-09T13:16:22.000342+0000","last_peered":"2023-10-09T13:16:22.000342+0000","last_clean":"2023-10-09T13:16:22.000342+0000","last_became_active":"2023-10-09T13:16:20.973050+0000","last_became_peered":"2023-10-09T13:16:20.973050+0000","last_unstale":"2023-10-09T13:16:22.000342+0000","last_undegraded":"2023-10-09T13:16:22.000342+0000","last_fullsized":"2023-10-09T13:16:22.000342+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:12.396270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993432+0000","last_change":"2023-10-09T13:16:21.981283+0000","last_active":"2023-10-09T13:16:21.993432+0000","last_peered":"2023-10-09T13:16:21.993432+0000","last_clean":"2023-10-09T13:16:21.993432+0000","last_became_active":"2023-10-09T13:16:21.981047+0000","last_became_peered":"2023-10-09T13:16:21.981047+0000","last_unstale":"2023-10-09T13:16:21.993432+0000","last_undegraded":"2023-10-09T13:16:21.993432+0000","last_fullsized":"2023-10-09T13:16:21.993432+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:20.418439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.964863+0000","last_change":"2023-10-09T13:16:20.969793+0000","last_active":"2023-10-09T13:16:21.964863+0000","last_peered":"2023-10-09T13:16:21.964863+0000","last_clean":"2023-10-09T13:16:21.964863+0000","last_became_active":"2023-10-09T13:16:20.969481+0000","last_became_peered":"2023-10-09T13:16:20.969481+0000","last_unstale":"2023-10-09T13:16:21.964863+0000","last_undegraded":"2023-10-09T13:16:21.964863+0000","last_fullsized":"2023-10-09T13:16:21.964863+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:00.502503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983810+0000","last_change":"2023-10-09T13:16:21.977328+0000","last_active":"2023-10-09T13:16:21.983810+0000","last_peered":"2023-10-09T13:16:21.983810+0000","last_clean":"2023-10-09T13:16:21.983810+0000","last_became_active":"2023-10-09T13:16:21.977076+0000","last_became_peered":"2023-10-09T13:16:21.977076+0000","last_unstale":"2023-10-09T13:16:21.983810+0000","last_undegraded":"2023-10-09T13:16:21.983810+0000","last_fullsized":"2023-10-09T13:16:21.983810+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:36.430286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.965301+0000","last_change":"2023-10-09T13:16:20.971618+0000","last_active":"2023-10-09T13:16:21.965301+0000","last_peered":"2023-10-09T13:16:21.965301+0000","last_clean":"2023-10-09T13:16:21.965301+0000","last_became_active":"2023-10-09T13:16:20.971353+0000","last_became_peered":"2023-10-09T13:16:20.971353+0000","last_unstale":"2023-10-09T13:16:21.965301+0000","last_undegraded":"2023-10-09T13:16:21.965301+0000","last_fullsized":"2023-10-09T13:16:21.965301+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:47.425358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992308+0000","last_change":"2023-10-09T13:16:21.987936+0000","last_active":"2023-10-09T13:16:21.992308+0000","last_peered":"2023-10-09T13:16:21.992308+0000","last_clean":"2023-10-09T13:16:21.992308+0000","last_became_active":"2023-10-09T13:16:21.987706+0000","last_became_peered":"2023-10-09T13:16:21.987706+0000","last_unstale":"2023-10-09T13:16:21.992308+0000","last_undegraded":"2023-10-09T13:16:21.992308+0000","last_fullsized":"2023-10-09T13:16:21.992308+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:45:01.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.972474+0000","last_change":"2023-10-09T13:16:20.973204+0000","last_active":"2023-10-09T13:16:21.972474+0000","last_peered":"2023-10-09T13:16:21.972474+0000","last_clean":"2023-10-09T13:16:21.972474+0000","last_became_active":"2023-10-09T13:16:20.972944+0000","last_became_peered":"2023-10-09T13:16:20.972944+0000","last_unstale":"2023-10-09T13:16:21.972474+0000","last_undegraded":"2023-10-09T13:16:21.972474+0000","last_fullsized":"2023-10-09T13:16:21.972474+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:43.589471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990881+0000","last_change":"2023-10-09T13:16:21.988473+0000","last_active":"2023-10-09T13:16:21.990881+0000","last_peered":"2023-10-09T13:16:21.990881+0000","last_clean":"2023-10-09T13:16:21.990881+0000","last_became_active":"2023-10-09T13:16:21.988218+0000","last_became_peered":"2023-10-09T13:16:21.988218+0000","last_unstale":"2023-10-09T13:16:21.990881+0000","last_undegraded":"2023-10-09T13:16:21.990881+0000","last_fullsized":"2023-10-09T13:16:21.990881+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:58.379834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.972936+0000","last_change":"2023-10-09T13:16:20.972597+0000","last_active":"2023-10-09T13:16:21.972936+0000","last_peered":"2023-10-09T13:16:21.972936+0000","last_clean":"2023-10-09T13:16:21.972936+0000","last_became_active":"2023-10-09T13:16:20.972326+0000","last_became_peered":"2023-10-09T13:16:20.972326+0000","last_unstale":"2023-10-09T13:16:21.972936+0000","last_undegraded":"2023-10-09T13:16:21.972936+0000","last_fullsized":"2023-10-09T13:16:21.972936+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:28.433376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990991+0000","last_change":"2023-10-09T13:16:21.989333+0000","last_active":"2023-10-09T13:16:21.990991+0000","last_peered":"2023-10-09T13:16:21.990991+0000","last_clean":"2023-10-09T13:16:21.990991+0000","last_became_active":"2023-10-09T13:16:21.988401+0000","last_became_peered":"2023-10-09T13:16:21.988401+0000","last_unstale":"2023-10-09T13:16:21.990991+0000","last_undegraded":"2023-10-09T13:16:21.990991+0000","last_fullsized":"2023-10-09T13:16:21.990991+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:10.725524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.972413+0000","last_change":"2023-10-09T13:16:20.973775+0000","last_active":"2023-10-09T13:16:21.972413+0000","last_peered":"2023-10-09T13:16:21.972413+0000","last_clean":"2023-10-09T13:16:21.972413+0000","last_became_active":"2023-10-09T13:16:20.973438+0000","last_became_peered":"2023-10-09T13:16:20.973438+0000","last_unstale":"2023-10-09T13:16:21.972413+0000","last_undegraded":"2023-10-09T13:16:21.972413+0000","last_fullsized":"2023-10-09T13:16:21.972413+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:33.373452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984488+0000","last_change":"2023-10-09T13:16:21.976043+0000","last_active":"2023-10-09T13:16:21.984488+0000","last_peered":"2023-10-09T13:16:21.984488+0000","last_clean":"2023-10-09T13:16:21.984488+0000","last_became_active":"2023-10-09T13:16:21.975782+0000","last_became_peered":"2023-10-09T13:16:21.975782+0000","last_unstale":"2023-10-09T13:16:21.984488+0000","last_undegraded":"2023-10-09T13:16:21.984488+0000","last_fullsized":"2023-10-09T13:16:21.984488+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:49.470351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.969603+0000","last_change":"2023-10-09T13:16:20.973667+0000","last_active":"2023-10-09T13:16:21.969603+0000","last_peered":"2023-10-09T13:16:21.969603+0000","last_clean":"2023-10-09T13:16:21.969603+0000","last_became_active":"2023-10-09T13:16:20.973315+0000","last_became_peered":"2023-10-09T13:16:20.973315+0000","last_unstale":"2023-10-09T13:16:21.969603+0000","last_undegraded":"2023-10-09T13:16:21.969603+0000","last_fullsized":"2023-10-09T13:16:21.969603+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:40.693647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984847+0000","last_change":"2023-10-09T13:16:21.982719+0000","last_active":"2023-10-09T13:16:21.984847+0000","last_peered":"2023-10-09T13:16:21.984847+0000","last_clean":"2023-10-09T13:16:21.984847+0000","last_became_active":"2023-10-09T13:16:21.982494+0000","last_became_peered":"2023-10-09T13:16:21.982494+0000","last_unstale":"2023-10-09T13:16:21.984847+0000","last_undegraded":"2023-10-09T13:16:21.984847+0000","last_fullsized":"2023-10-09T13:16:21.984847+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:11.950642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970069+0000","last_change":"2023-10-09T13:16:20.975051+0000","last_active":"2023-10-09T13:16:21.970069+0000","last_peered":"2023-10-09T13:16:21.970069+0000","last_clean":"2023-10-09T13:16:21.970069+0000","last_became_active":"2023-10-09T13:16:20.974798+0000","last_became_peered":"2023-10-09T13:16:20.974798+0000","last_unstale":"2023-10-09T13:16:21.970069+0000","last_undegraded":"2023-10-09T13:16:21.970069+0000","last_fullsized":"2023-10-09T13:16:21.970069+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:41.755854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994123+0000","last_change":"2023-10-09T13:16:21.979465+0000","last_active":"2023-10-09T13:16:21.994123+0000","last_peered":"2023-10-09T13:16:21.994123+0000","last_clean":"2023-10-09T13:16:21.994123+0000","last_became_active":"2023-10-09T13:16:21.979182+0000","last_became_peered":"2023-10-09T13:16:21.979182+0000","last_unstale":"2023-10-09T13:16:21.994123+0000","last_undegraded":"2023-10-09T13:16:21.994123+0000","last_fullsized":"2023-10-09T13:16:21.994123+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:54.871710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.975204+0000","last_change":"2023-10-09T13:16:20.972455+0000","last_active":"2023-10-09T13:16:21.975204+0000","last_peered":"2023-10-09T13:16:21.975204+0000","last_clean":"2023-10-09T13:16:21.975204+0000","last_became_active":"2023-10-09T13:16:20.972193+0000","last_became_peered":"2023-10-09T13:16:20.972193+0000","last_unstale":"2023-10-09T13:16:21.975204+0000","last_undegraded":"2023-10-09T13:16:21.975204+0000","last_fullsized":"2023-10-09T13:16:21.975204+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:18.388136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"201'348","reported_seq":1141,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970523+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:21.970523+0000","last_peered":"2023-10-09T13:16:21.970523+0000","last_clean":"2023-10-09T13:16:21.970523+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:21.970523+0000","last_undegraded":"2023-10-09T13:16:21.970523+0000","last_fullsized":"2023-10-09T13:16:21.970523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312744,"kb_used_data":3168,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059096,"statfs":{"total":96636764160,"available":96316514304,"internally_reserved":0,"allocated":3244032,"data_stored":1921014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.62},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.68600000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.69899999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.67300000000000004}]}]},{"osd":6,"up_from":16,"seq":68719477866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1330542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70199999999999996,"15min":0.74099999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78600000000000003,"5min":1.0029999999999999,"15min":1.026},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.93600000000000005,"15min":1.014},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89400000000000002,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.1240000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.878,"5min":1.032,"15min":1.032},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.375}]},{"osd":5,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84199999999999997,"5min":1.028,"15min":1.028},"last":0.502}]},{"osd":7,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.433},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.44400000000000001}]}]},{"osd":1,"up_from":15,"seq":64424510570,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308072,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063768,"statfs":{"total":96636764160,"available":96321298432,"internally_reserved":0,"allocated":2654208,"data_stored":1332078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.41099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129543273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308644,"kb_used_data":3164,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063196,"statfs":{"total":96636764160,"available":96320712704,"internally_reserved":0,"allocated":3239936,"data_stored":1920932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.71999999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.73999999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543273,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316264,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055576,"statfs":{"total":96636764160,"available":96312909824,"internally_reserved":0,"allocated":2654208,"data_stored":1331208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.495},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.624}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":0.871},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":0.77700000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":0.89200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424510570,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312168,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059672,"statfs":{"total":96636764160,"available":96317104128,"internally_reserved":0,"allocated":2654208,"data_stored":1330736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61899999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68200000000000005,"5min":1.399,"15min":1.399},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.68000000000000005,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.502},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.84699999999999998},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.65000000000000002,"15min":0.61299999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.78800000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69699999999999995,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0269999999999999,"5min":1.169,"15min":1.1759999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58399999999999996},"max":{"1min":1.081,"5min":1.298,"15min":1.298},"last":0.75700000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82799999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.0549999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.204},"last":0.75}]},{"osd":6,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.038,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98899999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":1.155,"15min":1.4610000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.288,"15min":1.5349999999999999},"last":0.79400000000000004}]}]},{"osd":4,"up_from":16,"seq":68719477865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067860,"statfs":{"total":96636764160,"available":96325488640,"internally_reserved":0,"allocated":2658304,"data_stored":1332632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":1.016},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.874},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.89500000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":1.0640000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.94099999999999995}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.68999999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.83299999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.73299999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1330542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.73499999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.76500000000000001}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80700000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.88700000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":1.0189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:31.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.327+0000 7f82ecdff700 1 Processor -- start 2023-10-09T13:16:31.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.327+0000 7f82ecdff700 1 -- start start 2023-10-09T13:16:31.328 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.328+0000 7f82ecdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.328+0000 7f82ecdff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80cc300 con 0x7f82e80ccf90 2023-10-09T13:16:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.328+0000 7f82ecdff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80ad370 con 0x7f82e80cbf30 2023-10-09T13:16:31.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.328+0000 7f82ecdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8156bf0 con 0x7f82e80b1420 2023-10-09T13:16:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e6d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f82e80ccf90 0x7f82e80c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56954/0 (socket says 172.21.15.86:56954) 2023-10-09T13:16:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e6d9d700 1 -- 172.21.15.86:0/3385243458 learned_addr learned my addr 172.21.15.86:0/3385243458 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e5d9b700 1 --2- 172.21.15.86:0/3385243458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e559a700 1 -- 172.21.15.86:0/3385243458 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247582787 0 0) 0x7f82e80cc300 con 0x7f82e80ccf90 2023-10-09T13:16:31.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e559a700 1 -- 172.21.15.86:0/3385243458 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d0003570 con 0x7f82e80ccf90 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e559a700 1 -- 172.21.15.86:0/3385243458 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991977403 0 0) 0x7f82e80ad370 con 0x7f82e80cbf30 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e559a700 1 -- 172.21.15.86:0/3385243458 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e80cc300 con 0x7f82e80cbf30 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e5d9b700 1 -- 172.21.15.86:0/3385243458 >> v1:172.21.15.135:6789/0 conn(0x7f82e80cbf30 legacy=0x7f82e80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e5d9b700 1 -- 172.21.15.86:0/3385243458 >> v1:172.21.15.86:6789/0 conn(0x7f82e80ccf90 legacy=0x7f82e80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.329+0000 7f82e5d9b700 1 -- 172.21.15.86:0/3385243458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e80ad650 con 0x7f82e80b1420 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.330+0000 7f82e5d9b700 1 --2- 172.21.15.86:0/3385243458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80ae410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009910 tx=0x7f82dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52f67a729be9584b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.330+0000 7f82e559a700 1 -- 172.21.15.86:0/3385243458 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc011630 con 0x7f82e80b1420 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.330+0000 7f82e559a700 1 -- 172.21.15.86:0/3385243458 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc011790 con 0x7f82e80b1420 2023-10-09T13:16:31.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.330+0000 7f82e559a700 1 -- 172.21.15.86:0/3385243458 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc011b30 con 0x7f82e80b1420 2023-10-09T13:16:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.330+0000 7f82ecdff700 1 -- 172.21.15.86:0/3385243458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 msgr2=0x7f82e80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.330+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3385243458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80ae410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009910 tx=0x7f82dc0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.331+0000 7f82ecdff700 1 -- 172.21.15.86:0/3385243458 shutdown_connections 2023-10-09T13:16:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.331+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3385243458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80ae410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.331+0000 7f82ecdff700 1 -- 172.21.15.86:0/3385243458 >> 172.21.15.86:0/3385243458 conn(0x7f82e806a320 msgr2=0x7f82e80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.331+0000 7f82ecdff700 1 -- 172.21.15.86:0/3385243458 shutdown_connections 2023-10-09T13:16:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.331+0000 7f82ecdff700 1 -- 172.21.15.86:0/3385243458 wait complete. 2023-10-09T13:16:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.332+0000 7f82ecdff700 1 Processor -- start 2023-10-09T13:16:31.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.332+0000 7f82ecdff700 1 -- start start 2023-10-09T13:16:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82ecdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82ecdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82e80cbf30 0x7f82e816a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82ecdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e80ccf90 0x7f82e816a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82ecdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80c15d0 con 0x7f82e80cbf30 2023-10-09T13:16:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82ecdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8155130 con 0x7f82e80ccf90 2023-10-09T13:16:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82ecdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8155380 con 0x7f82e80b1420 2023-10-09T13:16:31.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82e5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82e80cbf30 0x7f82e816a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82e5d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82e80cbf30 0x7f82e816a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58928/0 (socket says 172.21.15.86:58928) 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82e5d9b700 1 -- 172.21.15.86:0/3224406277 learned_addr learned my addr 172.21.15.86:0/3224406277 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82e6d9d700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e80ccf90 0x7f82e816a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.333+0000 7f82e659c700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82e5d9b700 1 -- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 msgr2=0x7f82e80c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82e5d9b700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82e5d9b700 1 -- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e80ccf90 msgr2=0x7f82e816a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82e5d9b700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e80ccf90 0x7f82e816a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82e5d9b700 1 -- 172.21.15.86:0/3224406277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc009420 con 0x7f82e80cbf30 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82e5d9b700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82e80cbf30 0x7f82e816a130 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009f00 tx=0x7f82dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:31.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82d67fc700 1 -- 172.21.15.86:0/3224406277 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc01f070 con 0x7f82e80cbf30 2023-10-09T13:16:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82d67fc700 1 -- 172.21.15.86:0/3224406277 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc000bc0 con 0x7f82e80cbf30 2023-10-09T13:16:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e8155660 con 0x7f82e80cbf30 2023-10-09T13:16:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82d67fc700 1 -- 172.21.15.86:0/3224406277 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc025420 con 0x7f82e80cbf30 2023-10-09T13:16:31.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.334+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e8155c20 con 0x7f82e80cbf30 2023-10-09T13:16:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.335+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e804c3c0 con 0x7f82e80cbf30 2023-10-09T13:16:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.336+0000 7f82d67fc700 1 -- 172.21.15.86:0/3224406277 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82dc023070 con 0x7f82e80cbf30 2023-10-09T13:16:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.337+0000 7f82d67fc700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.337+0000 7f82d67fc700 1 -- 172.21.15.86:0/3224406277 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f82dc085ae0 con 0x7f82e80cbf30 2023-10-09T13:16:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.337+0000 7f82e659c700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.338+0000 7f82e659c700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f82c8066f30 0x7f82c80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82e81562f0 tx=0x7f82d8009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:31.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.342+0000 7f82d67fc700 1 -- 172.21.15.86:0/3224406277 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82dc052b50 con 0x7f82e80cbf30 2023-10-09T13:16:31.527 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.527+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82e80b08a0 con 0x7f82c8066f30 2023-10-09T13:16:31.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.536+0000 7f82d67fc700 1 -- 172.21.15.86:0/3224406277 <== mgr.9981 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289463 (secure 0 0 0) 0x7f82e80b08a0 con 0x7f82c8066f30 2023-10-09T13:16:31.539 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f82c8066f30 msgr2=0x7f82c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f82c8066f30 0x7f82c80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82e81562f0 tx=0x7f82d8009040 comp rx=0 tx=0).stop 2023-10-09T13:16:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82e80cbf30 msgr2=0x7f82e816a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82e80cbf30 0x7f82e816a130 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009f00 tx=0x7f82dc017000 comp rx=0 tx=0).stop 2023-10-09T13:16:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 shutdown_connections 2023-10-09T13:16:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.542 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82e80ccf90 0x7f82e816a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82e80b1420 0x7f82e80c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 --2- 172.21.15.86:0/3224406277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82e80cbf30 0x7f82e816a130 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 >> 172.21.15.86:0/3224406277 conn(0x7f82e806a320 msgr2=0x7f82e80ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:31.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 shutdown_connections 2023-10-09T13:16:31.543 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.540+0000 7f82ecdff700 1 -- 172.21.15.86:0/3224406277 wait complete. 2023-10-09T13:16:31.543 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:31.558 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-09T13:16:29.906453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2486184,"kb_used_data":21864,"kb_used_omap":0,"kb_used_meta":2464256,"kb_avail":752488536,"statfs":{"total":773094113280,"available":770548260864,"internally_reserved":0,"allocated":22388736,"data_stored":11829684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2523398144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001873"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996549+0000","last_change":"2023-10-09T13:16:21.994742+0000","last_active":"2023-10-09T13:16:21.996549+0000","last_peered":"2023-10-09T13:16:21.996549+0000","last_clean":"2023-10-09T13:16:21.996549+0000","last_became_active":"2023-10-09T13:16:21.994312+0000","last_became_peered":"2023-10-09T13:16:21.994312+0000","last_unstale":"2023-10-09T13:16:21.996549+0000","last_undegraded":"2023-10-09T13:16:21.996549+0000","last_fullsized":"2023-10-09T13:16:21.996549+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:02.715967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985880+0000","last_change":"2023-10-09T13:16:21.979770+0000","last_active":"2023-10-09T13:16:21.985880+0000","last_peered":"2023-10-09T13:16:21.985880+0000","last_clean":"2023-10-09T13:16:21.985880+0000","last_became_active":"2023-10-09T13:16:21.979525+0000","last_became_peered":"2023-10-09T13:16:21.979525+0000","last_unstale":"2023-10-09T13:16:21.985880+0000","last_undegraded":"2023-10-09T13:16:21.985880+0000","last_fullsized":"2023-10-09T13:16:21.985880+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:00.103652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990690+0000","last_change":"2023-10-09T13:16:21.986243+0000","last_active":"2023-10-09T13:16:21.990690+0000","last_peered":"2023-10-09T13:16:21.990690+0000","last_clean":"2023-10-09T13:16:21.990690+0000","last_became_active":"2023-10-09T13:16:21.985977+0000","last_became_peered":"2023-10-09T13:16:21.985977+0000","last_unstale":"2023-10-09T13:16:21.990690+0000","last_undegraded":"2023-10-09T13:16:21.990690+0000","last_fullsized":"2023-10-09T13:16:21.990690+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:28.092352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985776+0000","last_change":"2023-10-09T13:16:21.980718+0000","last_active":"2023-10-09T13:16:21.985776+0000","last_peered":"2023-10-09T13:16:21.985776+0000","last_clean":"2023-10-09T13:16:21.985776+0000","last_became_active":"2023-10-09T13:16:21.980110+0000","last_became_peered":"2023-10-09T13:16:21.980110+0000","last_unstale":"2023-10-09T13:16:21.985776+0000","last_undegraded":"2023-10-09T13:16:21.985776+0000","last_fullsized":"2023-10-09T13:16:21.985776+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:54.744855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.988975+0000","last_change":"2023-10-09T13:16:21.986185+0000","last_active":"2023-10-09T13:16:21.988975+0000","last_peered":"2023-10-09T13:16:21.988975+0000","last_clean":"2023-10-09T13:16:21.988975+0000","last_became_active":"2023-10-09T13:16:21.985954+0000","last_became_peered":"2023-10-09T13:16:21.985954+0000","last_unstale":"2023-10-09T13:16:21.988975+0000","last_undegraded":"2023-10-09T13:16:21.988975+0000","last_fullsized":"2023-10-09T13:16:21.988975+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:56.151834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.980751+0000","last_change":"2023-10-09T13:16:21.978534+0000","last_active":"2023-10-09T13:16:21.980751+0000","last_peered":"2023-10-09T13:16:21.980751+0000","last_clean":"2023-10-09T13:16:21.980751+0000","last_became_active":"2023-10-09T13:16:21.978290+0000","last_became_peered":"2023-10-09T13:16:21.978290+0000","last_unstale":"2023-10-09T13:16:21.980751+0000","last_undegraded":"2023-10-09T13:16:21.980751+0000","last_fullsized":"2023-10-09T13:16:21.980751+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:29.603158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983212+0000","last_change":"2023-10-09T13:16:21.977349+0000","last_active":"2023-10-09T13:16:21.983212+0000","last_peered":"2023-10-09T13:16:21.983212+0000","last_clean":"2023-10-09T13:16:21.983212+0000","last_became_active":"2023-10-09T13:16:21.977084+0000","last_became_peered":"2023-10-09T13:16:21.977084+0000","last_unstale":"2023-10-09T13:16:21.983212+0000","last_undegraded":"2023-10-09T13:16:21.983212+0000","last_fullsized":"2023-10-09T13:16:21.983212+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:32.028004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.982403+0000","last_change":"2023-10-09T13:16:21.978113+0000","last_active":"2023-10-09T13:16:21.982403+0000","last_peered":"2023-10-09T13:16:21.982403+0000","last_clean":"2023-10-09T13:16:21.982403+0000","last_became_active":"2023-10-09T13:16:21.977860+0000","last_became_peered":"2023-10-09T13:16:21.977860+0000","last_unstale":"2023-10-09T13:16:21.982403+0000","last_undegraded":"2023-10-09T13:16:21.982403+0000","last_fullsized":"2023-10-09T13:16:21.982403+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:31.743144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986820+0000","last_change":"2023-10-09T13:16:21.984537+0000","last_active":"2023-10-09T13:16:21.986820+0000","last_peered":"2023-10-09T13:16:21.986820+0000","last_clean":"2023-10-09T13:16:21.986820+0000","last_became_active":"2023-10-09T13:16:21.984246+0000","last_became_peered":"2023-10-09T13:16:21.984246+0000","last_unstale":"2023-10-09T13:16:21.986820+0000","last_undegraded":"2023-10-09T13:16:21.986820+0000","last_fullsized":"2023-10-09T13:16:21.986820+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:42.763306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993546+0000","last_change":"2023-10-09T13:16:21.980089+0000","last_active":"2023-10-09T13:16:21.993546+0000","last_peered":"2023-10-09T13:16:21.993546+0000","last_clean":"2023-10-09T13:16:21.993546+0000","last_became_active":"2023-10-09T13:16:21.979165+0000","last_became_peered":"2023-10-09T13:16:21.979165+0000","last_unstale":"2023-10-09T13:16:21.993546+0000","last_undegraded":"2023-10-09T13:16:21.993546+0000","last_fullsized":"2023-10-09T13:16:21.993546+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:43:56.206671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983263+0000","last_change":"2023-10-09T13:16:21.977807+0000","last_active":"2023-10-09T13:16:21.983263+0000","last_peered":"2023-10-09T13:16:21.983263+0000","last_clean":"2023-10-09T13:16:21.983263+0000","last_became_active":"2023-10-09T13:16:21.977544+0000","last_became_peered":"2023-10-09T13:16:21.977544+0000","last_unstale":"2023-10-09T13:16:21.983263+0000","last_undegraded":"2023-10-09T13:16:21.983263+0000","last_fullsized":"2023-10-09T13:16:21.983263+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:49.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985798+0000","last_change":"2023-10-09T13:16:21.980966+0000","last_active":"2023-10-09T13:16:21.985798+0000","last_peered":"2023-10-09T13:16:21.985798+0000","last_clean":"2023-10-09T13:16:21.985798+0000","last_became_active":"2023-10-09T13:16:21.980427+0000","last_became_peered":"2023-10-09T13:16:21.980427+0000","last_unstale":"2023-10-09T13:16:21.985798+0000","last_undegraded":"2023-10-09T13:16:21.985798+0000","last_fullsized":"2023-10-09T13:16:21.985798+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:31.432708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985970+0000","last_change":"2023-10-09T13:16:21.983680+0000","last_active":"2023-10-09T13:16:21.985970+0000","last_peered":"2023-10-09T13:16:21.985970+0000","last_clean":"2023-10-09T13:16:21.985970+0000","last_became_active":"2023-10-09T13:16:21.983420+0000","last_became_peered":"2023-10-09T13:16:21.983420+0000","last_unstale":"2023-10-09T13:16:21.985970+0000","last_undegraded":"2023-10-09T13:16:21.985970+0000","last_fullsized":"2023-10-09T13:16:21.985970+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:11.242947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986956+0000","last_change":"2023-10-09T13:16:21.984801+0000","last_active":"2023-10-09T13:16:21.986956+0000","last_peered":"2023-10-09T13:16:21.986956+0000","last_clean":"2023-10-09T13:16:21.986956+0000","last_became_active":"2023-10-09T13:16:21.984132+0000","last_became_peered":"2023-10-09T13:16:21.984132+0000","last_unstale":"2023-10-09T13:16:21.986956+0000","last_undegraded":"2023-10-09T13:16:21.986956+0000","last_fullsized":"2023-10-09T13:16:21.986956+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:03.469750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986068+0000","last_change":"2023-10-09T13:16:21.981360+0000","last_active":"2023-10-09T13:16:21.986068+0000","last_peered":"2023-10-09T13:16:21.986068+0000","last_clean":"2023-10-09T13:16:21.986068+0000","last_became_active":"2023-10-09T13:16:21.980921+0000","last_became_peered":"2023-10-09T13:16:21.980921+0000","last_unstale":"2023-10-09T13:16:21.986068+0000","last_undegraded":"2023-10-09T13:16:21.986068+0000","last_fullsized":"2023-10-09T13:16:21.986068+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:49.426794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992437+0000","last_change":"2023-10-09T13:16:21.985857+0000","last_active":"2023-10-09T13:16:21.992437+0000","last_peered":"2023-10-09T13:16:21.992437+0000","last_clean":"2023-10-09T13:16:21.992437+0000","last_became_active":"2023-10-09T13:16:21.985625+0000","last_became_peered":"2023-10-09T13:16:21.985625+0000","last_unstale":"2023-10-09T13:16:21.992437+0000","last_undegraded":"2023-10-09T13:16:21.992437+0000","last_fullsized":"2023-10-09T13:16:21.992437+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:08.766173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984886+0000","last_change":"2023-10-09T13:16:21.983231+0000","last_active":"2023-10-09T13:16:21.984886+0000","last_peered":"2023-10-09T13:16:21.984886+0000","last_clean":"2023-10-09T13:16:21.984886+0000","last_became_active":"2023-10-09T13:16:21.982996+0000","last_became_peered":"2023-10-09T13:16:21.982996+0000","last_unstale":"2023-10-09T13:16:21.984886+0000","last_undegraded":"2023-10-09T13:16:21.984886+0000","last_fullsized":"2023-10-09T13:16:21.984886+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:03.704404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.989127+0000","last_change":"2023-10-09T13:16:21.987463+0000","last_active":"2023-10-09T13:16:21.989127+0000","last_peered":"2023-10-09T13:16:21.989127+0000","last_clean":"2023-10-09T13:16:21.989127+0000","last_became_active":"2023-10-09T13:16:21.987180+0000","last_became_peered":"2023-10-09T13:16:21.987180+0000","last_unstale":"2023-10-09T13:16:21.989127+0000","last_undegraded":"2023-10-09T13:16:21.989127+0000","last_fullsized":"2023-10-09T13:16:21.989127+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:36.131897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994035+0000","last_change":"2023-10-09T13:16:21.990192+0000","last_active":"2023-10-09T13:16:21.994035+0000","last_peered":"2023-10-09T13:16:21.994035+0000","last_clean":"2023-10-09T13:16:21.994035+0000","last_became_active":"2023-10-09T13:16:21.989953+0000","last_became_peered":"2023-10-09T13:16:21.989953+0000","last_unstale":"2023-10-09T13:16:21.994035+0000","last_undegraded":"2023-10-09T13:16:21.994035+0000","last_fullsized":"2023-10-09T13:16:21.994035+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:48.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984852+0000","last_change":"2023-10-09T13:16:21.982718+0000","last_active":"2023-10-09T13:16:21.984852+0000","last_peered":"2023-10-09T13:16:21.984852+0000","last_clean":"2023-10-09T13:16:21.984852+0000","last_became_active":"2023-10-09T13:16:21.982470+0000","last_became_peered":"2023-10-09T13:16:21.982470+0000","last_unstale":"2023-10-09T13:16:21.984852+0000","last_undegraded":"2023-10-09T13:16:21.984852+0000","last_fullsized":"2023-10-09T13:16:21.984852+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:46.162311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.988957+0000","last_change":"2023-10-09T13:16:21.985547+0000","last_active":"2023-10-09T13:16:21.988957+0000","last_peered":"2023-10-09T13:16:21.988957+0000","last_clean":"2023-10-09T13:16:21.988957+0000","last_became_active":"2023-10-09T13:16:21.985288+0000","last_became_peered":"2023-10-09T13:16:21.985288+0000","last_unstale":"2023-10-09T13:16:21.988957+0000","last_undegraded":"2023-10-09T13:16:21.988957+0000","last_fullsized":"2023-10-09T13:16:21.988957+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:21:48.417314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993459+0000","last_change":"2023-10-09T13:16:21.979574+0000","last_active":"2023-10-09T13:16:21.993459+0000","last_peered":"2023-10-09T13:16:21.993459+0000","last_clean":"2023-10-09T13:16:21.993459+0000","last_became_active":"2023-10-09T13:16:21.979327+0000","last_became_peered":"2023-10-09T13:16:21.979327+0000","last_unstale":"2023-10-09T13:16:21.993459+0000","last_undegraded":"2023-10-09T13:16:21.993459+0000","last_fullsized":"2023-10-09T13:16:21.993459+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:33.385074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.979730+0000","last_change":"2023-10-09T13:16:21.976558+0000","last_active":"2023-10-09T13:16:21.979730+0000","last_peered":"2023-10-09T13:16:21.979730+0000","last_clean":"2023-10-09T13:16:21.979730+0000","last_became_active":"2023-10-09T13:16:21.976297+0000","last_became_peered":"2023-10-09T13:16:21.976297+0000","last_unstale":"2023-10-09T13:16:21.979730+0000","last_undegraded":"2023-10-09T13:16:21.979730+0000","last_fullsized":"2023-10-09T13:16:21.979730+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:49:08.601463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.977534+0000","last_change":"2023-10-09T13:16:21.973622+0000","last_active":"2023-10-09T13:16:21.977534+0000","last_peered":"2023-10-09T13:16:21.977534+0000","last_clean":"2023-10-09T13:16:21.977534+0000","last_became_active":"2023-10-09T13:16:21.973356+0000","last_became_peered":"2023-10-09T13:16:21.973356+0000","last_unstale":"2023-10-09T13:16:21.977534+0000","last_undegraded":"2023-10-09T13:16:21.977534+0000","last_fullsized":"2023-10-09T13:16:21.977534+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:20.418439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984454+0000","last_change":"2023-10-09T13:16:21.978264+0000","last_active":"2023-10-09T13:16:21.984454+0000","last_peered":"2023-10-09T13:16:21.984454+0000","last_clean":"2023-10-09T13:16:21.984454+0000","last_became_active":"2023-10-09T13:16:21.978002+0000","last_became_peered":"2023-10-09T13:16:21.978002+0000","last_unstale":"2023-10-09T13:16:21.984454+0000","last_undegraded":"2023-10-09T13:16:21.984454+0000","last_fullsized":"2023-10-09T13:16:21.984454+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:50.194794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984851+0000","last_change":"2023-10-09T13:16:21.978220+0000","last_active":"2023-10-09T13:16:21.984851+0000","last_peered":"2023-10-09T13:16:21.984851+0000","last_clean":"2023-10-09T13:16:21.984851+0000","last_became_active":"2023-10-09T13:16:21.977971+0000","last_became_peered":"2023-10-09T13:16:21.977971+0000","last_unstale":"2023-10-09T13:16:21.984851+0000","last_undegraded":"2023-10-09T13:16:21.984851+0000","last_fullsized":"2023-10-09T13:16:21.984851+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:47.932132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.980704+0000","last_change":"2023-10-09T13:16:21.977854+0000","last_active":"2023-10-09T13:16:21.980704+0000","last_peered":"2023-10-09T13:16:21.980704+0000","last_clean":"2023-10-09T13:16:21.980704+0000","last_became_active":"2023-10-09T13:16:21.977593+0000","last_became_peered":"2023-10-09T13:16:21.977593+0000","last_unstale":"2023-10-09T13:16:21.980704+0000","last_undegraded":"2023-10-09T13:16:21.980704+0000","last_fullsized":"2023-10-09T13:16:21.980704+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:50.194794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.999971+0000","last_change":"2023-10-09T13:16:21.994661+0000","last_active":"2023-10-09T13:16:21.999971+0000","last_peered":"2023-10-09T13:16:21.999971+0000","last_clean":"2023-10-09T13:16:21.999971+0000","last_became_active":"2023-10-09T13:16:21.994332+0000","last_became_peered":"2023-10-09T13:16:21.994332+0000","last_unstale":"2023-10-09T13:16:21.999971+0000","last_undegraded":"2023-10-09T13:16:21.999971+0000","last_fullsized":"2023-10-09T13:16:21.999971+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:19.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985435+0000","last_change":"2023-10-09T13:16:21.978854+0000","last_active":"2023-10-09T13:16:21.985435+0000","last_peered":"2023-10-09T13:16:21.985435+0000","last_clean":"2023-10-09T13:16:21.985435+0000","last_became_active":"2023-10-09T13:16:21.978534+0000","last_became_peered":"2023-10-09T13:16:21.978534+0000","last_unstale":"2023-10-09T13:16:21.985435+0000","last_undegraded":"2023-10-09T13:16:21.985435+0000","last_fullsized":"2023-10-09T13:16:21.985435+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:49.939998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986992+0000","last_change":"2023-10-09T13:16:21.984987+0000","last_active":"2023-10-09T13:16:21.986992+0000","last_peered":"2023-10-09T13:16:21.986992+0000","last_clean":"2023-10-09T13:16:21.986992+0000","last_became_active":"2023-10-09T13:16:21.984518+0000","last_became_peered":"2023-10-09T13:16:21.984518+0000","last_unstale":"2023-10-09T13:16:21.986992+0000","last_undegraded":"2023-10-09T13:16:21.986992+0000","last_fullsized":"2023-10-09T13:16:21.986992+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:38.345943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983229+0000","last_change":"2023-10-09T13:16:21.982597+0000","last_active":"2023-10-09T13:16:21.983229+0000","last_peered":"2023-10-09T13:16:21.983229+0000","last_clean":"2023-10-09T13:16:21.983229+0000","last_became_active":"2023-10-09T13:16:21.982332+0000","last_became_peered":"2023-10-09T13:16:21.982332+0000","last_unstale":"2023-10-09T13:16:21.983229+0000","last_undegraded":"2023-10-09T13:16:21.983229+0000","last_fullsized":"2023-10-09T13:16:21.983229+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:24.881099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984225+0000","last_change":"2023-10-09T13:16:21.981003+0000","last_active":"2023-10-09T13:16:21.984225+0000","last_peered":"2023-10-09T13:16:21.984225+0000","last_clean":"2023-10-09T13:16:21.984225+0000","last_became_active":"2023-10-09T13:16:21.980759+0000","last_became_peered":"2023-10-09T13:16:21.980759+0000","last_unstale":"2023-10-09T13:16:21.984225+0000","last_undegraded":"2023-10-09T13:16:21.984225+0000","last_fullsized":"2023-10-09T13:16:21.984225+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:16.745289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992486+0000","last_change":"2023-10-09T13:16:21.986398+0000","last_active":"2023-10-09T13:16:21.992486+0000","last_peered":"2023-10-09T13:16:21.992486+0000","last_clean":"2023-10-09T13:16:21.992486+0000","last_became_active":"2023-10-09T13:16:21.986170+0000","last_became_peered":"2023-10-09T13:16:21.986170+0000","last_unstale":"2023-10-09T13:16:21.992486+0000","last_undegraded":"2023-10-09T13:16:21.992486+0000","last_fullsized":"2023-10-09T13:16:21.992486+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:22.532460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"211'4","reported_seq":14,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994043+0000","last_change":"2023-10-09T13:16:20.973380+0000","last_active":"2023-10-09T13:16:21.994043+0000","last_peered":"2023-10-09T13:16:21.994043+0000","last_clean":"2023-10-09T13:16:21.994043+0000","last_became_active":"2023-10-09T13:16:20.972958+0000","last_became_peered":"2023-10-09T13:16:20.972958+0000","last_unstale":"2023-10-09T13:16:21.994043+0000","last_undegraded":"2023-10-09T13:16:21.994043+0000","last_fullsized":"2023-10-09T13:16:21.994043+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:48.619196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.991734+0000","last_change":"2023-10-09T13:16:21.975315+0000","last_active":"2023-10-09T13:16:21.991734+0000","last_peered":"2023-10-09T13:16:21.991734+0000","last_clean":"2023-10-09T13:16:21.991734+0000","last_became_active":"2023-10-09T13:16:21.975039+0000","last_became_peered":"2023-10-09T13:16:21.975039+0000","last_unstale":"2023-10-09T13:16:21.991734+0000","last_undegraded":"2023-10-09T13:16:21.991734+0000","last_fullsized":"2023-10-09T13:16:21.991734+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:53.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996823+0000","last_change":"2023-10-09T13:16:20.973896+0000","last_active":"2023-10-09T13:16:21.996823+0000","last_peered":"2023-10-09T13:16:21.996823+0000","last_clean":"2023-10-09T13:16:21.996823+0000","last_became_active":"2023-10-09T13:16:20.973597+0000","last_became_peered":"2023-10-09T13:16:20.973597+0000","last_unstale":"2023-10-09T13:16:21.996823+0000","last_undegraded":"2023-10-09T13:16:21.996823+0000","last_fullsized":"2023-10-09T13:16:21.996823+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:23.056939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.979851+0000","last_change":"2023-10-09T13:16:21.975149+0000","last_active":"2023-10-09T13:16:21.979851+0000","last_peered":"2023-10-09T13:16:21.979851+0000","last_clean":"2023-10-09T13:16:21.979851+0000","last_became_active":"2023-10-09T13:16:21.974887+0000","last_became_peered":"2023-10-09T13:16:21.974887+0000","last_unstale":"2023-10-09T13:16:21.979851+0000","last_undegraded":"2023-10-09T13:16:21.979851+0000","last_fullsized":"2023-10-09T13:16:21.979851+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:31.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.997625+0000","last_change":"2023-10-09T13:16:20.973380+0000","last_active":"2023-10-09T13:16:21.997625+0000","last_peered":"2023-10-09T13:16:21.997625+0000","last_clean":"2023-10-09T13:16:21.997625+0000","last_became_active":"2023-10-09T13:16:20.973144+0000","last_became_peered":"2023-10-09T13:16:20.973144+0000","last_unstale":"2023-10-09T13:16:21.997625+0000","last_undegraded":"2023-10-09T13:16:21.997625+0000","last_fullsized":"2023-10-09T13:16:21.997625+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:06.088068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.988530+0000","last_change":"2023-10-09T13:16:21.985795+0000","last_active":"2023-10-09T13:16:21.988530+0000","last_peered":"2023-10-09T13:16:21.988530+0000","last_clean":"2023-10-09T13:16:21.988530+0000","last_became_active":"2023-10-09T13:16:21.985202+0000","last_became_peered":"2023-10-09T13:16:21.985202+0000","last_unstale":"2023-10-09T13:16:21.988530+0000","last_undegraded":"2023-10-09T13:16:21.988530+0000","last_fullsized":"2023-10-09T13:16:21.988530+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:36.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993099+0000","last_change":"2023-10-09T13:16:20.974215+0000","last_active":"2023-10-09T13:16:21.993099+0000","last_peered":"2023-10-09T13:16:21.993099+0000","last_clean":"2023-10-09T13:16:21.993099+0000","last_became_active":"2023-10-09T13:16:20.973955+0000","last_became_peered":"2023-10-09T13:16:20.973955+0000","last_unstale":"2023-10-09T13:16:21.993099+0000","last_undegraded":"2023-10-09T13:16:21.993099+0000","last_fullsized":"2023-10-09T13:16:21.993099+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:52.180936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993442+0000","last_change":"2023-10-09T13:16:21.979022+0000","last_active":"2023-10-09T13:16:21.993442+0000","last_peered":"2023-10-09T13:16:21.993442+0000","last_clean":"2023-10-09T13:16:21.993442+0000","last_became_active":"2023-10-09T13:16:21.978542+0000","last_became_peered":"2023-10-09T13:16:21.978542+0000","last_unstale":"2023-10-09T13:16:21.993442+0000","last_undegraded":"2023-10-09T13:16:21.993442+0000","last_fullsized":"2023-10-09T13:16:21.993442+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:06.317197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994893+0000","last_change":"2023-10-09T13:16:20.966935+0000","last_active":"2023-10-09T13:16:21.994893+0000","last_peered":"2023-10-09T13:16:21.994893+0000","last_clean":"2023-10-09T13:16:21.994893+0000","last_became_active":"2023-10-09T13:16:20.966655+0000","last_became_peered":"2023-10-09T13:16:20.966655+0000","last_unstale":"2023-10-09T13:16:21.994893+0000","last_undegraded":"2023-10-09T13:16:21.994893+0000","last_fullsized":"2023-10-09T13:16:21.994893+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:06.971294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992902+0000","last_change":"2023-10-09T13:16:21.987167+0000","last_active":"2023-10-09T13:16:21.992902+0000","last_peered":"2023-10-09T13:16:21.992902+0000","last_clean":"2023-10-09T13:16:21.992902+0000","last_became_active":"2023-10-09T13:16:21.986939+0000","last_became_peered":"2023-10-09T13:16:21.986939+0000","last_unstale":"2023-10-09T13:16:21.992902+0000","last_undegraded":"2023-10-09T13:16:21.992902+0000","last_fullsized":"2023-10-09T13:16:21.992902+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:11.619770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.999735+0000","last_change":"2023-10-09T13:16:20.973837+0000","last_active":"2023-10-09T13:16:21.999735+0000","last_peered":"2023-10-09T13:16:21.999735+0000","last_clean":"2023-10-09T13:16:21.999735+0000","last_became_active":"2023-10-09T13:16:20.973594+0000","last_became_peered":"2023-10-09T13:16:20.973594+0000","last_unstale":"2023-10-09T13:16:21.999735+0000","last_undegraded":"2023-10-09T13:16:21.999735+0000","last_fullsized":"2023-10-09T13:16:21.999735+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:00.502503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983162+0000","last_change":"2023-10-09T13:16:21.976033+0000","last_active":"2023-10-09T13:16:21.983162+0000","last_peered":"2023-10-09T13:16:21.983162+0000","last_clean":"2023-10-09T13:16:21.983162+0000","last_became_active":"2023-10-09T13:16:21.975689+0000","last_became_peered":"2023-10-09T13:16:21.975689+0000","last_unstale":"2023-10-09T13:16:21.983162+0000","last_undegraded":"2023-10-09T13:16:21.983162+0000","last_fullsized":"2023-10-09T13:16:21.983162+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:42:01.746648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970326+0000","last_change":"2023-10-09T13:16:20.970296+0000","last_active":"2023-10-09T13:16:21.970326+0000","last_peered":"2023-10-09T13:16:21.970326+0000","last_clean":"2023-10-09T13:16:21.970326+0000","last_became_active":"2023-10-09T13:16:20.970026+0000","last_became_peered":"2023-10-09T13:16:20.970026+0000","last_unstale":"2023-10-09T13:16:21.970326+0000","last_undegraded":"2023-10-09T13:16:21.970326+0000","last_fullsized":"2023-10-09T13:16:21.970326+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:20.174722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990189+0000","last_change":"2023-10-09T13:16:21.985661+0000","last_active":"2023-10-09T13:16:21.990189+0000","last_peered":"2023-10-09T13:16:21.990189+0000","last_clean":"2023-10-09T13:16:21.990189+0000","last_became_active":"2023-10-09T13:16:21.985406+0000","last_became_peered":"2023-10-09T13:16:21.985406+0000","last_unstale":"2023-10-09T13:16:21.990189+0000","last_undegraded":"2023-10-09T13:16:21.990189+0000","last_fullsized":"2023-10-09T13:16:21.990189+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:41.701099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.967097+0000","last_change":"2023-10-09T13:16:20.970308+0000","last_active":"2023-10-09T13:16:21.967097+0000","last_peered":"2023-10-09T13:16:21.967097+0000","last_clean":"2023-10-09T13:16:21.967097+0000","last_became_active":"2023-10-09T13:16:20.969986+0000","last_became_peered":"2023-10-09T13:16:20.969986+0000","last_unstale":"2023-10-09T13:16:21.967097+0000","last_undegraded":"2023-10-09T13:16:21.967097+0000","last_fullsized":"2023-10-09T13:16:21.967097+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:07:19.066955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.982332+0000","last_change":"2023-10-09T13:16:21.978649+0000","last_active":"2023-10-09T13:16:21.982332+0000","last_peered":"2023-10-09T13:16:21.982332+0000","last_clean":"2023-10-09T13:16:21.982332+0000","last_became_active":"2023-10-09T13:16:21.978362+0000","last_became_peered":"2023-10-09T13:16:21.978362+0000","last_unstale":"2023-10-09T13:16:21.982332+0000","last_undegraded":"2023-10-09T13:16:21.982332+0000","last_fullsized":"2023-10-09T13:16:21.982332+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:48.526435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970319+0000","last_change":"2023-10-09T13:16:20.973141+0000","last_active":"2023-10-09T13:16:21.970319+0000","last_peered":"2023-10-09T13:16:21.970319+0000","last_clean":"2023-10-09T13:16:21.970319+0000","last_became_active":"2023-10-09T13:16:20.972884+0000","last_became_peered":"2023-10-09T13:16:20.972884+0000","last_unstale":"2023-10-09T13:16:21.970319+0000","last_undegraded":"2023-10-09T13:16:21.970319+0000","last_fullsized":"2023-10-09T13:16:21.970319+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:37.768977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.987543+0000","last_change":"2023-10-09T13:16:21.985437+0000","last_active":"2023-10-09T13:16:21.987543+0000","last_peered":"2023-10-09T13:16:21.987543+0000","last_clean":"2023-10-09T13:16:21.987543+0000","last_became_active":"2023-10-09T13:16:21.985109+0000","last_became_peered":"2023-10-09T13:16:21.985109+0000","last_unstale":"2023-10-09T13:16:21.987543+0000","last_undegraded":"2023-10-09T13:16:21.987543+0000","last_fullsized":"2023-10-09T13:16:21.987543+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:34.272424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"211'3","reported_seq":13,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996308+0000","last_change":"2023-10-09T13:16:20.973559+0000","last_active":"2023-10-09T13:16:21.996308+0000","last_peered":"2023-10-09T13:16:21.996308+0000","last_clean":"2023-10-09T13:16:21.996308+0000","last_became_active":"2023-10-09T13:16:20.973310+0000","last_became_peered":"2023-10-09T13:16:20.973310+0000","last_unstale":"2023-10-09T13:16:21.996308+0000","last_undegraded":"2023-10-09T13:16:21.996308+0000","last_fullsized":"2023-10-09T13:16:21.996308+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:49.212218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993391+0000","last_change":"2023-10-09T13:16:21.980155+0000","last_active":"2023-10-09T13:16:21.993391+0000","last_peered":"2023-10-09T13:16:21.993391+0000","last_clean":"2023-10-09T13:16:21.993391+0000","last_became_active":"2023-10-09T13:16:21.979891+0000","last_became_peered":"2023-10-09T13:16:21.979891+0000","last_unstale":"2023-10-09T13:16:21.993391+0000","last_undegraded":"2023-10-09T13:16:21.993391+0000","last_fullsized":"2023-10-09T13:16:21.993391+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:45:01.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"211'6","reported_seq":16,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.997794+0000","last_change":"2023-10-09T13:16:20.971579+0000","last_active":"2023-10-09T13:16:21.997794+0000","last_peered":"2023-10-09T13:16:21.997794+0000","last_clean":"2023-10-09T13:16:21.997794+0000","last_became_active":"2023-10-09T13:16:20.970440+0000","last_became_peered":"2023-10-09T13:16:20.970440+0000","last_unstale":"2023-10-09T13:16:21.997794+0000","last_undegraded":"2023-10-09T13:16:21.997794+0000","last_fullsized":"2023-10-09T13:16:21.997794+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.980734+0000","last_change":"2023-10-09T13:16:21.977134+0000","last_active":"2023-10-09T13:16:21.980734+0000","last_peered":"2023-10-09T13:16:21.980734+0000","last_clean":"2023-10-09T13:16:21.980734+0000","last_became_active":"2023-10-09T13:16:21.976895+0000","last_became_peered":"2023-10-09T13:16:21.976895+0000","last_unstale":"2023-10-09T13:16:21.980734+0000","last_undegraded":"2023-10-09T13:16:21.980734+0000","last_fullsized":"2023-10-09T13:16:21.980734+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:16:25.652641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000193+0000","last_change":"2023-10-09T13:16:20.969778+0000","last_active":"2023-10-09T13:16:22.000193+0000","last_peered":"2023-10-09T13:16:22.000193+0000","last_clean":"2023-10-09T13:16:22.000193+0000","last_became_active":"2023-10-09T13:16:20.969469+0000","last_became_peered":"2023-10-09T13:16:20.969469+0000","last_unstale":"2023-10-09T13:16:22.000193+0000","last_undegraded":"2023-10-09T13:16:22.000193+0000","last_fullsized":"2023-10-09T13:16:22.000193+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:07:43.790547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986462+0000","last_change":"2023-10-09T13:16:21.981394+0000","last_active":"2023-10-09T13:16:21.986462+0000","last_peered":"2023-10-09T13:16:21.986462+0000","last_clean":"2023-10-09T13:16:21.986462+0000","last_became_active":"2023-10-09T13:16:21.980223+0000","last_became_peered":"2023-10-09T13:16:21.980223+0000","last_unstale":"2023-10-09T13:16:21.986462+0000","last_undegraded":"2023-10-09T13:16:21.986462+0000","last_fullsized":"2023-10-09T13:16:21.986462+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.590928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.965143+0000","last_change":"2023-10-09T13:16:20.963392+0000","last_active":"2023-10-09T13:16:21.965143+0000","last_peered":"2023-10-09T13:16:21.965143+0000","last_clean":"2023-10-09T13:16:21.965143+0000","last_became_active":"2023-10-09T13:16:20.963114+0000","last_became_peered":"2023-10-09T13:16:20.963114+0000","last_unstale":"2023-10-09T13:16:21.965143+0000","last_undegraded":"2023-10-09T13:16:21.965143+0000","last_fullsized":"2023-10-09T13:16:21.965143+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:43.589471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.996022+0000","last_change":"2023-10-09T13:16:21.995169+0000","last_active":"2023-10-09T13:16:21.996022+0000","last_peered":"2023-10-09T13:16:21.996022+0000","last_clean":"2023-10-09T13:16:21.996022+0000","last_became_active":"2023-10-09T13:16:21.994858+0000","last_became_peered":"2023-10-09T13:16:21.994858+0000","last_unstale":"2023-10-09T13:16:21.996022+0000","last_undegraded":"2023-10-09T13:16:21.996022+0000","last_fullsized":"2023-10-09T13:16:21.996022+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:02.788953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.968201+0000","last_change":"2023-10-09T13:16:20.975765+0000","last_active":"2023-10-09T13:16:21.968201+0000","last_peered":"2023-10-09T13:16:21.968201+0000","last_clean":"2023-10-09T13:16:21.968201+0000","last_became_active":"2023-10-09T13:16:20.975477+0000","last_became_peered":"2023-10-09T13:16:20.975477+0000","last_unstale":"2023-10-09T13:16:21.968201+0000","last_undegraded":"2023-10-09T13:16:21.968201+0000","last_fullsized":"2023-10-09T13:16:21.968201+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:56.800026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.978223+0000","last_change":"2023-10-09T13:16:21.974400+0000","last_active":"2023-10-09T13:16:21.978223+0000","last_peered":"2023-10-09T13:16:21.978223+0000","last_clean":"2023-10-09T13:16:21.978223+0000","last_became_active":"2023-10-09T13:16:21.974125+0000","last_became_peered":"2023-10-09T13:16:21.974125+0000","last_unstale":"2023-10-09T13:16:21.978223+0000","last_undegraded":"2023-10-09T13:16:21.978223+0000","last_fullsized":"2023-10-09T13:16:21.978223+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:59:25.015202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"211'8","reported_seq":18,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000705+0000","last_change":"2023-10-09T13:16:20.970449+0000","last_active":"2023-10-09T13:16:22.000705+0000","last_peered":"2023-10-09T13:16:22.000705+0000","last_clean":"2023-10-09T13:16:22.000705+0000","last_became_active":"2023-10-09T13:16:20.970149+0000","last_became_peered":"2023-10-09T13:16:20.970149+0000","last_unstale":"2023-10-09T13:16:22.000705+0000","last_undegraded":"2023-10-09T13:16:22.000705+0000","last_fullsized":"2023-10-09T13:16:22.000705+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:38.924796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.975542+0000","last_change":"2023-10-09T13:16:21.974602+0000","last_active":"2023-10-09T13:16:21.975542+0000","last_peered":"2023-10-09T13:16:21.975542+0000","last_clean":"2023-10-09T13:16:21.975542+0000","last_became_active":"2023-10-09T13:16:21.974259+0000","last_became_peered":"2023-10-09T13:16:21.974259+0000","last_unstale":"2023-10-09T13:16:21.975542+0000","last_undegraded":"2023-10-09T13:16:21.975542+0000","last_fullsized":"2023-10-09T13:16:21.975542+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:07.910098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.995144+0000","last_change":"2023-10-09T13:16:20.973214+0000","last_active":"2023-10-09T13:16:21.995144+0000","last_peered":"2023-10-09T13:16:21.995144+0000","last_clean":"2023-10-09T13:16:21.995144+0000","last_became_active":"2023-10-09T13:16:20.972393+0000","last_became_peered":"2023-10-09T13:16:20.972393+0000","last_unstale":"2023-10-09T13:16:21.995144+0000","last_undegraded":"2023-10-09T13:16:21.995144+0000","last_fullsized":"2023-10-09T13:16:21.995144+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:02:27.318752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983819+0000","last_change":"2023-10-09T13:16:21.980984+0000","last_active":"2023-10-09T13:16:21.983819+0000","last_peered":"2023-10-09T13:16:21.983819+0000","last_clean":"2023-10-09T13:16:21.983819+0000","last_became_active":"2023-10-09T13:16:21.980719+0000","last_became_peered":"2023-10-09T13:16:21.980719+0000","last_unstale":"2023-10-09T13:16:21.983819+0000","last_undegraded":"2023-10-09T13:16:21.983819+0000","last_fullsized":"2023-10-09T13:16:21.983819+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:05.279600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.999719+0000","last_change":"2023-10-09T13:16:20.970687+0000","last_active":"2023-10-09T13:16:21.999719+0000","last_peered":"2023-10-09T13:16:21.999719+0000","last_clean":"2023-10-09T13:16:21.999719+0000","last_became_active":"2023-10-09T13:16:20.970421+0000","last_became_peered":"2023-10-09T13:16:20.970421+0000","last_unstale":"2023-10-09T13:16:21.999719+0000","last_undegraded":"2023-10-09T13:16:21.999719+0000","last_fullsized":"2023-10-09T13:16:21.999719+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:47.425358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.987184+0000","last_change":"2023-10-09T13:16:21.985233+0000","last_active":"2023-10-09T13:16:21.987184+0000","last_peered":"2023-10-09T13:16:21.987184+0000","last_clean":"2023-10-09T13:16:21.987184+0000","last_became_active":"2023-10-09T13:16:21.984925+0000","last_became_peered":"2023-10-09T13:16:21.984925+0000","last_unstale":"2023-10-09T13:16:21.987184+0000","last_undegraded":"2023-10-09T13:16:21.987184+0000","last_fullsized":"2023-10-09T13:16:21.987184+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:22.605969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"211'1","reported_seq":11,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000088+0000","last_change":"2023-10-09T13:16:20.969196+0000","last_active":"2023-10-09T13:16:22.000088+0000","last_peered":"2023-10-09T13:16:22.000088+0000","last_clean":"2023-10-09T13:16:22.000088+0000","last_became_active":"2023-10-09T13:16:20.968941+0000","last_became_peered":"2023-10-09T13:16:20.968941+0000","last_unstale":"2023-10-09T13:16:22.000088+0000","last_undegraded":"2023-10-09T13:16:22.000088+0000","last_fullsized":"2023-10-09T13:16:22.000088+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:19.260901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986024+0000","last_change":"2023-10-09T13:16:21.983996+0000","last_active":"2023-10-09T13:16:21.986024+0000","last_peered":"2023-10-09T13:16:21.986024+0000","last_clean":"2023-10-09T13:16:21.986024+0000","last_became_active":"2023-10-09T13:16:21.983630+0000","last_became_peered":"2023-10-09T13:16:21.983630+0000","last_unstale":"2023-10-09T13:16:21.986024+0000","last_undegraded":"2023-10-09T13:16:21.986024+0000","last_fullsized":"2023-10-09T13:16:21.986024+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:50.834079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.968132+0000","last_change":"2023-10-09T13:16:20.969022+0000","last_active":"2023-10-09T13:16:21.968132+0000","last_peered":"2023-10-09T13:16:21.968132+0000","last_clean":"2023-10-09T13:16:21.968132+0000","last_became_active":"2023-10-09T13:16:20.968696+0000","last_became_peered":"2023-10-09T13:16:20.968696+0000","last_unstale":"2023-10-09T13:16:21.968132+0000","last_undegraded":"2023-10-09T13:16:21.968132+0000","last_fullsized":"2023-10-09T13:16:21.968132+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:56.323875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993420+0000","last_change":"2023-10-09T13:16:21.978559+0000","last_active":"2023-10-09T13:16:21.993420+0000","last_peered":"2023-10-09T13:16:21.993420+0000","last_clean":"2023-10-09T13:16:21.993420+0000","last_became_active":"2023-10-09T13:16:21.975775+0000","last_became_peered":"2023-10-09T13:16:21.975775+0000","last_unstale":"2023-10-09T13:16:21.993420+0000","last_undegraded":"2023-10-09T13:16:21.993420+0000","last_fullsized":"2023-10-09T13:16:21.993420+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:11:11.619770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.997489+0000","last_change":"2023-10-09T13:16:20.978204+0000","last_active":"2023-10-09T13:16:21.997489+0000","last_peered":"2023-10-09T13:16:21.997489+0000","last_clean":"2023-10-09T13:16:21.997489+0000","last_became_active":"2023-10-09T13:16:20.977938+0000","last_became_peered":"2023-10-09T13:16:20.977938+0000","last_unstale":"2023-10-09T13:16:21.997489+0000","last_undegraded":"2023-10-09T13:16:21.997489+0000","last_fullsized":"2023-10-09T13:16:21.997489+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:59.530833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.986482+0000","last_change":"2023-10-09T13:16:21.981471+0000","last_active":"2023-10-09T13:16:21.986482+0000","last_peered":"2023-10-09T13:16:21.986482+0000","last_clean":"2023-10-09T13:16:21.986482+0000","last_became_active":"2023-10-09T13:16:21.981182+0000","last_became_peered":"2023-10-09T13:16:21.981182+0000","last_unstale":"2023-10-09T13:16:21.986482+0000","last_undegraded":"2023-10-09T13:16:21.986482+0000","last_fullsized":"2023-10-09T13:16:21.986482+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:22:31.432708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970793+0000","last_change":"2023-10-09T13:16:20.973707+0000","last_active":"2023-10-09T13:16:21.970793+0000","last_peered":"2023-10-09T13:16:21.970793+0000","last_clean":"2023-10-09T13:16:21.970793+0000","last_became_active":"2023-10-09T13:16:20.973449+0000","last_became_peered":"2023-10-09T13:16:20.973449+0000","last_unstale":"2023-10-09T13:16:21.970793+0000","last_undegraded":"2023-10-09T13:16:21.970793+0000","last_fullsized":"2023-10-09T13:16:21.970793+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:34:02.949834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.985474+0000","last_change":"2023-10-09T13:16:21.979250+0000","last_active":"2023-10-09T13:16:21.985474+0000","last_peered":"2023-10-09T13:16:21.985474+0000","last_clean":"2023-10-09T13:16:21.985474+0000","last_became_active":"2023-10-09T13:16:21.978993+0000","last_became_peered":"2023-10-09T13:16:21.978993+0000","last_unstale":"2023-10-09T13:16:21.985474+0000","last_undegraded":"2023-10-09T13:16:21.985474+0000","last_fullsized":"2023-10-09T13:16:21.985474+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:13.955305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970326+0000","last_change":"2023-10-09T13:16:20.975021+0000","last_active":"2023-10-09T13:16:21.970326+0000","last_peered":"2023-10-09T13:16:21.970326+0000","last_clean":"2023-10-09T13:16:21.970326+0000","last_became_active":"2023-10-09T13:16:20.974765+0000","last_became_peered":"2023-10-09T13:16:20.974765+0000","last_unstale":"2023-10-09T13:16:21.970326+0000","last_undegraded":"2023-10-09T13:16:21.970326+0000","last_fullsized":"2023-10-09T13:16:21.970326+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:49:25.214205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984201+0000","last_change":"2023-10-09T13:16:21.980810+0000","last_active":"2023-10-09T13:16:21.984201+0000","last_peered":"2023-10-09T13:16:21.984201+0000","last_clean":"2023-10-09T13:16:21.984201+0000","last_became_active":"2023-10-09T13:16:21.980534+0000","last_became_peered":"2023-10-09T13:16:21.980534+0000","last_unstale":"2023-10-09T13:16:21.984201+0000","last_undegraded":"2023-10-09T13:16:21.984201+0000","last_fullsized":"2023-10-09T13:16:21.984201+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:10.180560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.973501+0000","last_change":"2023-10-09T13:16:20.976018+0000","last_active":"2023-10-09T13:16:21.973501+0000","last_peered":"2023-10-09T13:16:21.973501+0000","last_clean":"2023-10-09T13:16:21.973501+0000","last_became_active":"2023-10-09T13:16:20.975728+0000","last_became_peered":"2023-10-09T13:16:20.975728+0000","last_unstale":"2023-10-09T13:16:21.973501+0000","last_undegraded":"2023-10-09T13:16:21.973501+0000","last_fullsized":"2023-10-09T13:16:21.973501+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:04:54.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.975151+0000","last_change":"2023-10-09T13:16:21.974328+0000","last_active":"2023-10-09T13:16:21.975151+0000","last_peered":"2023-10-09T13:16:21.975151+0000","last_clean":"2023-10-09T13:16:21.975151+0000","last_became_active":"2023-10-09T13:16:21.974079+0000","last_became_peered":"2023-10-09T13:16:21.974079+0000","last_unstale":"2023-10-09T13:16:21.975151+0000","last_undegraded":"2023-10-09T13:16:21.975151+0000","last_fullsized":"2023-10-09T13:16:21.975151+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:01:02.633413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"211'2","reported_seq":12,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:22.000342+0000","last_change":"2023-10-09T13:16:20.973298+0000","last_active":"2023-10-09T13:16:22.000342+0000","last_peered":"2023-10-09T13:16:22.000342+0000","last_clean":"2023-10-09T13:16:22.000342+0000","last_became_active":"2023-10-09T13:16:20.973050+0000","last_became_peered":"2023-10-09T13:16:20.973050+0000","last_unstale":"2023-10-09T13:16:22.000342+0000","last_undegraded":"2023-10-09T13:16:22.000342+0000","last_fullsized":"2023-10-09T13:16:22.000342+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:12.396270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.993432+0000","last_change":"2023-10-09T13:16:21.981283+0000","last_active":"2023-10-09T13:16:21.993432+0000","last_peered":"2023-10-09T13:16:21.993432+0000","last_clean":"2023-10-09T13:16:21.993432+0000","last_became_active":"2023-10-09T13:16:21.981047+0000","last_became_peered":"2023-10-09T13:16:21.981047+0000","last_unstale":"2023-10-09T13:16:21.993432+0000","last_undegraded":"2023-10-09T13:16:21.993432+0000","last_fullsized":"2023-10-09T13:16:21.993432+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:20.418439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.964863+0000","last_change":"2023-10-09T13:16:20.969793+0000","last_active":"2023-10-09T13:16:21.964863+0000","last_peered":"2023-10-09T13:16:21.964863+0000","last_clean":"2023-10-09T13:16:21.964863+0000","last_became_active":"2023-10-09T13:16:20.969481+0000","last_became_peered":"2023-10-09T13:16:20.969481+0000","last_unstale":"2023-10-09T13:16:21.964863+0000","last_undegraded":"2023-10-09T13:16:21.964863+0000","last_fullsized":"2023-10-09T13:16:21.964863+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:00.502503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.983810+0000","last_change":"2023-10-09T13:16:21.977328+0000","last_active":"2023-10-09T13:16:21.983810+0000","last_peered":"2023-10-09T13:16:21.983810+0000","last_clean":"2023-10-09T13:16:21.983810+0000","last_became_active":"2023-10-09T13:16:21.977076+0000","last_became_peered":"2023-10-09T13:16:21.977076+0000","last_unstale":"2023-10-09T13:16:21.983810+0000","last_undegraded":"2023-10-09T13:16:21.983810+0000","last_fullsized":"2023-10-09T13:16:21.983810+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:36.430286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.965301+0000","last_change":"2023-10-09T13:16:20.971618+0000","last_active":"2023-10-09T13:16:21.965301+0000","last_peered":"2023-10-09T13:16:21.965301+0000","last_clean":"2023-10-09T13:16:21.965301+0000","last_became_active":"2023-10-09T13:16:20.971353+0000","last_became_peered":"2023-10-09T13:16:20.971353+0000","last_unstale":"2023-10-09T13:16:21.965301+0000","last_undegraded":"2023-10-09T13:16:21.965301+0000","last_fullsized":"2023-10-09T13:16:21.965301+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:47.425358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.992308+0000","last_change":"2023-10-09T13:16:21.987936+0000","last_active":"2023-10-09T13:16:21.992308+0000","last_peered":"2023-10-09T13:16:21.992308+0000","last_clean":"2023-10-09T13:16:21.992308+0000","last_became_active":"2023-10-09T13:16:21.987706+0000","last_became_peered":"2023-10-09T13:16:21.987706+0000","last_unstale":"2023-10-09T13:16:21.992308+0000","last_undegraded":"2023-10-09T13:16:21.992308+0000","last_fullsized":"2023-10-09T13:16:21.992308+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:45:01.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.972474+0000","last_change":"2023-10-09T13:16:20.973204+0000","last_active":"2023-10-09T13:16:21.972474+0000","last_peered":"2023-10-09T13:16:21.972474+0000","last_clean":"2023-10-09T13:16:21.972474+0000","last_became_active":"2023-10-09T13:16:20.972944+0000","last_became_peered":"2023-10-09T13:16:20.972944+0000","last_unstale":"2023-10-09T13:16:21.972474+0000","last_undegraded":"2023-10-09T13:16:21.972474+0000","last_fullsized":"2023-10-09T13:16:21.972474+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:23:43.589471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990881+0000","last_change":"2023-10-09T13:16:21.988473+0000","last_active":"2023-10-09T13:16:21.990881+0000","last_peered":"2023-10-09T13:16:21.990881+0000","last_clean":"2023-10-09T13:16:21.990881+0000","last_became_active":"2023-10-09T13:16:21.988218+0000","last_became_peered":"2023-10-09T13:16:21.988218+0000","last_unstale":"2023-10-09T13:16:21.990881+0000","last_undegraded":"2023-10-09T13:16:21.990881+0000","last_fullsized":"2023-10-09T13:16:21.990881+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:58.379834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.972936+0000","last_change":"2023-10-09T13:16:20.972597+0000","last_active":"2023-10-09T13:16:21.972936+0000","last_peered":"2023-10-09T13:16:21.972936+0000","last_clean":"2023-10-09T13:16:21.972936+0000","last_became_active":"2023-10-09T13:16:20.972326+0000","last_became_peered":"2023-10-09T13:16:20.972326+0000","last_unstale":"2023-10-09T13:16:21.972936+0000","last_undegraded":"2023-10-09T13:16:21.972936+0000","last_fullsized":"2023-10-09T13:16:21.972936+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:00:28.433376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.990991+0000","last_change":"2023-10-09T13:16:21.989333+0000","last_active":"2023-10-09T13:16:21.990991+0000","last_peered":"2023-10-09T13:16:21.990991+0000","last_clean":"2023-10-09T13:16:21.990991+0000","last_became_active":"2023-10-09T13:16:21.988401+0000","last_became_peered":"2023-10-09T13:16:21.988401+0000","last_unstale":"2023-10-09T13:16:21.990991+0000","last_undegraded":"2023-10-09T13:16:21.990991+0000","last_fullsized":"2023-10-09T13:16:21.990991+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:52:10.725524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.972413+0000","last_change":"2023-10-09T13:16:20.973775+0000","last_active":"2023-10-09T13:16:21.972413+0000","last_peered":"2023-10-09T13:16:21.972413+0000","last_clean":"2023-10-09T13:16:21.972413+0000","last_became_active":"2023-10-09T13:16:20.973438+0000","last_became_peered":"2023-10-09T13:16:20.973438+0000","last_unstale":"2023-10-09T13:16:21.972413+0000","last_undegraded":"2023-10-09T13:16:21.972413+0000","last_fullsized":"2023-10-09T13:16:21.972413+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:33.373452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984488+0000","last_change":"2023-10-09T13:16:21.976043+0000","last_active":"2023-10-09T13:16:21.984488+0000","last_peered":"2023-10-09T13:16:21.984488+0000","last_clean":"2023-10-09T13:16:21.984488+0000","last_became_active":"2023-10-09T13:16:21.975782+0000","last_became_peered":"2023-10-09T13:16:21.975782+0000","last_unstale":"2023-10-09T13:16:21.984488+0000","last_undegraded":"2023-10-09T13:16:21.984488+0000","last_fullsized":"2023-10-09T13:16:21.984488+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:49.470351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.969603+0000","last_change":"2023-10-09T13:16:20.973667+0000","last_active":"2023-10-09T13:16:21.969603+0000","last_peered":"2023-10-09T13:16:21.969603+0000","last_clean":"2023-10-09T13:16:21.969603+0000","last_became_active":"2023-10-09T13:16:20.973315+0000","last_became_peered":"2023-10-09T13:16:20.973315+0000","last_unstale":"2023-10-09T13:16:21.969603+0000","last_undegraded":"2023-10-09T13:16:21.969603+0000","last_fullsized":"2023-10-09T13:16:21.969603+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:43:40.693647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.984847+0000","last_change":"2023-10-09T13:16:21.982719+0000","last_active":"2023-10-09T13:16:21.984847+0000","last_peered":"2023-10-09T13:16:21.984847+0000","last_clean":"2023-10-09T13:16:21.984847+0000","last_became_active":"2023-10-09T13:16:21.982494+0000","last_became_peered":"2023-10-09T13:16:21.982494+0000","last_unstale":"2023-10-09T13:16:21.984847+0000","last_undegraded":"2023-10-09T13:16:21.984847+0000","last_fullsized":"2023-10-09T13:16:21.984847+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:11.950642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970069+0000","last_change":"2023-10-09T13:16:20.975051+0000","last_active":"2023-10-09T13:16:21.970069+0000","last_peered":"2023-10-09T13:16:21.970069+0000","last_clean":"2023-10-09T13:16:21.970069+0000","last_became_active":"2023-10-09T13:16:20.974798+0000","last_became_peered":"2023-10-09T13:16:20.974798+0000","last_unstale":"2023-10-09T13:16:21.970069+0000","last_undegraded":"2023-10-09T13:16:21.970069+0000","last_fullsized":"2023-10-09T13:16:21.970069+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:41.755854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.994123+0000","last_change":"2023-10-09T13:16:21.979465+0000","last_active":"2023-10-09T13:16:21.994123+0000","last_peered":"2023-10-09T13:16:21.994123+0000","last_clean":"2023-10-09T13:16:21.994123+0000","last_became_active":"2023-10-09T13:16:21.979182+0000","last_became_peered":"2023-10-09T13:16:21.979182+0000","last_unstale":"2023-10-09T13:16:21.994123+0000","last_undegraded":"2023-10-09T13:16:21.994123+0000","last_fullsized":"2023-10-09T13:16:21.994123+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:20.947153+0000","last_clean_scrub_stamp":"2023-10-09T13:16:20.947153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:54.871710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.975204+0000","last_change":"2023-10-09T13:16:20.972455+0000","last_active":"2023-10-09T13:16:21.975204+0000","last_peered":"2023-10-09T13:16:21.975204+0000","last_clean":"2023-10-09T13:16:21.975204+0000","last_became_active":"2023-10-09T13:16:20.972193+0000","last_became_peered":"2023-10-09T13:16:20.972193+0000","last_unstale":"2023-10-09T13:16:21.975204+0000","last_undegraded":"2023-10-09T13:16:21.975204+0000","last_fullsized":"2023-10-09T13:16:21.975204+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T13:16:19.939701+0000","last_clean_scrub_stamp":"2023-10-09T13:16:19.939701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:18.388136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"201'348","reported_seq":1141,"reported_epoch":211,"state":"active+clean","last_fresh":"2023-10-09T13:16:21.970523+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:21.970523+0000","last_peered":"2023-10-09T13:16:21.970523+0000","last_clean":"2023-10-09T13:16:21.970523+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:21.970523+0000","last_undegraded":"2023-10-09T13:16:21.970523+0000","last_fullsized":"2023-10-09T13:16:21.970523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312744,"kb_used_data":3168,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059096,"statfs":{"total":96636764160,"available":96316514304,"internally_reserved":0,"allocated":3244032,"data_stored":1921014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.62},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.68600000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.69899999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.67300000000000004}]}]},{"osd":6,"up_from":16,"seq":68719477866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1330542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70199999999999996,"15min":0.74099999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78600000000000003,"5min":1.0029999999999999,"15min":1.026},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.93600000000000005,"15min":1.014},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89400000000000002,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.1240000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.878,"5min":1.032,"15min":1.032},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.375}]},{"osd":5,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84199999999999997,"5min":1.028,"15min":1.028},"last":0.502}]},{"osd":7,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.433},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.44400000000000001}]}]},{"osd":1,"up_from":15,"seq":64424510570,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308072,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063768,"statfs":{"total":96636764160,"available":96321298432,"internally_reserved":0,"allocated":2654208,"data_stored":1332078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.41099999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.48899999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.749}]}]},{"osd":0,"up_from":14,"seq":60129543273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308644,"kb_used_data":3164,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063196,"statfs":{"total":96636764160,"available":96320712704,"internally_reserved":0,"allocated":3239936,"data_stored":1920932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.71999999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.73999999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543273,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316264,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055576,"statfs":{"total":96636764160,"available":96312909824,"internally_reserved":0,"allocated":2654208,"data_stored":1331208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.495},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.624}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":0.871},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":0.77700000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":0.89200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424510570,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312168,"kb_used_data":2592,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059672,"statfs":{"total":96636764160,"available":96317104128,"internally_reserved":0,"allocated":2654208,"data_stored":1330736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.495,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61899999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68200000000000005,"5min":1.399,"15min":1.399},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.373,"15min":0.373},"max":{"1min":0.68000000000000005,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.502},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.84699999999999998},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.65000000000000002,"15min":0.61299999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.78800000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69699999999999995,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0269999999999999,"5min":1.169,"15min":1.1759999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89300000000000002,"15min":0.877},"min":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58399999999999996},"max":{"1min":1.081,"5min":1.298,"15min":1.298},"last":0.75700000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82599999999999996,"15min":0.82799999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.0549999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.204},"last":0.75}]},{"osd":6,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.038,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81699999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98899999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:15:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98199999999999998,"5min":1.155,"15min":1.4610000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0069999999999999,"5min":1.288,"15min":1.5349999999999999},"last":0.79400000000000004}]}]},{"osd":4,"up_from":16,"seq":68719477865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067860,"statfs":{"total":96636764160,"available":96325488640,"internally_reserved":0,"allocated":2658304,"data_stored":1332632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":1.016},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.874},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.89500000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":1.0640000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.94099999999999995}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.68999999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.83299999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.73299999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312156,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059684,"statfs":{"total":96636764160,"available":96317116416,"internally_reserved":0,"allocated":2641920,"data_stored":1330542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.73499999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.76500000000000001}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80700000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.88700000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":1.0189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:31.564 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T13:16:31.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T13:16:31.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.786+0000 7fc318b9d700 1 Processor -- start 2023-10-09T13:16:31.786 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.786+0000 7fc318b9d700 1 -- start start 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.787+0000 7fc318b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3140cf480 0x7fc31415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.787+0000 7fc318b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31415d760 0x7fc3140b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.787+0000 7fc318b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31415dbc0 con 0x7fc3141595d0 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.787+0000 7fc318b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3140b10f0 con 0x7fc3140cf480 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.787+0000 7fc318b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31415e000 con 0x7fc31415d760 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.787+0000 7fc312ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3140cf480 0x7fc31415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc312ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3140cf480 0x7fc31415d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58934/0 (socket says 172.21.15.86:58934) 2023-10-09T13:16:31.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc312ffd700 1 -- 172.21.15.86:0/1269974080 learned_addr learned my addr 172.21.15.86:0/1269974080 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:31.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc312ffd700 1 -- 172.21.15.86:0/1269974080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31415d760 msgr2=0x7fc3140b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:31.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc313fff700 1 --2- 172.21.15.86:0/1269974080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31415d760 0x7fc3140b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc312ffd700 1 --2- 172.21.15.86:0/1269974080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31415d760 0x7fc3140b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc312ffd700 1 -- 172.21.15.86:0/1269974080 >> v1:172.21.15.135:6789/0 conn(0x7fc3141595d0 legacy=0x7fc3140ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc312ffd700 1 -- 172.21.15.86:0/1269974080 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140cf990 con 0x7fc3140cf480 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc313fff700 1 --2- 172.21.15.86:0/1269974080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31415d760 0x7fc3140b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.788+0000 7fc312ffd700 1 --2- 172.21.15.86:0/1269974080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3140cf480 0x7fc31415d220 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fc3080099b0 tx=0x7fc308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c860e36b8075458 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc3127fc700 1 -- 172.21.15.86:0/1269974080 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800b860 con 0x7fc3140cf480 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc3127fc700 1 -- 172.21.15.86:0/1269974080 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30800b9c0 con 0x7fc3140cf480 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc3127fc700 1 -- 172.21.15.86:0/1269974080 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800bd60 con 0x7fc3140cf480 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 -- 172.21.15.86:0/1269974080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3140cf480 msgr2=0x7fc31415d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 --2- 172.21.15.86:0/1269974080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3140cf480 0x7fc31415d220 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fc3080099b0 tx=0x7fc308009250 comp rx=0 tx=0).stop 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 -- 172.21.15.86:0/1269974080 shutdown_connections 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 --2- 172.21.15.86:0/1269974080 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31415d760 0x7fc3140b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 --2- 172.21.15.86:0/1269974080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3140cf480 0x7fc31415d220 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 -- 172.21.15.86:0/1269974080 >> 172.21.15.86:0/1269974080 conn(0x7fc3140d05f0 msgr2=0x7fc3140d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:31.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 -- 172.21.15.86:0/1269974080 shutdown_connections 2023-10-09T13:16:31.792 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.789+0000 7fc318b9d700 1 -- 172.21.15.86:0/1269974080 wait complete. 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.791+0000 7fc318b9d700 1 Processor -- start 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.791+0000 7fc318b9d700 1 -- start start 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc318b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3140cf480 0x7fc314140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc318b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3141595d0 0x7fc314141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc318b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31415d760 0x7fc3140b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc318b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141526b0 con 0x7fc3141595d0 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc318b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140c6080 con 0x7fc31415d760 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc318b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc314157f10 con 0x7fc3140cf480 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3141595d0 0x7fc314141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3141595d0 0x7fc314141240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58938/0 (socket says 172.21.15.86:58938) 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 -- 172.21.15.86:0/2833103010 learned_addr learned my addr 172.21.15.86:0/2833103010 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 -- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3140cf480 msgr2=0x7fc314140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc3137fe700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3140cf480 0x7fc314140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc313fff700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31415d760 0x7fc3140b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3140cf480 0x7fc314140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 -- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31415d760 msgr2=0x7fc3140b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31415d760 0x7fc3140b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc312ffd700 1 -- 172.21.15.86:0/2833103010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080094f0 con 0x7fc3141595d0 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.792+0000 7fc3137fe700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3140cf480 0x7fc314140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.793+0000 7fc312ffd700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3141595d0 0x7fc314141240 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fc308009290 tx=0x7fc308017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.793+0000 7fc2fb7fe700 1 -- 172.21.15.86:0/2833103010 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308024440 con 0x7fc3141595d0 2023-10-09T13:16:31.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.793+0000 7fc2fb7fe700 1 -- 172.21.15.86:0/2833103010 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3080245a0 con 0x7fc3141595d0 2023-10-09T13:16:31.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.793+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc314157300 con 0x7fc3141595d0 2023-10-09T13:16:31.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.793+0000 7fc2fb7fe700 1 -- 172.21.15.86:0/2833103010 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308024940 con 0x7fc3141595d0 2023-10-09T13:16:31.796 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.793+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3141578c0 con 0x7fc3141595d0 2023-10-09T13:16:31.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.794+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31404c3c0 con 0x7fc3141595d0 2023-10-09T13:16:31.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.795+0000 7fc2fb7fe700 1 -- 172.21.15.86:0/2833103010 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc30801a420 con 0x7fc3141595d0 2023-10-09T13:16:31.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.796+0000 7fc2fb7fe700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:31.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.796+0000 7fc2fb7fe700 1 -- 172.21.15.86:0/2833103010 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7fc3080865f0 con 0x7fc3141595d0 2023-10-09T13:16:31.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.796+0000 7fc3137fe700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:31.797 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.796+0000 7fc3137fe700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc300066f30 0x7fc3000693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc304001870 tx=0x7fc304009040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:31.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:31.800+0000 7fc2fb7fe700 1 -- 172.21.15.86:0/2833103010 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc308053660 con 0x7fc3141595d0 2023-10-09T13:16:32.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.067+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc3140b3860 con 0x7fc3141595d0 2023-10-09T13:16:32.072 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.072+0000 7fc2fb7fe700 1 -- 172.21.15.86:0/2833103010 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v54) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc308056c80 con 0x7fc3141595d0 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc300066f30 msgr2=0x7fc3000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc300066f30 0x7fc3000693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc304001870 tx=0x7fc304009040 comp rx=0 tx=0).stop 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3141595d0 msgr2=0x7fc314141240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3141595d0 0x7fc314141240 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fc308009290 tx=0x7fc308017000 comp rx=0 tx=0).stop 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 shutdown_connections 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31415d760 0x7fc3140b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3140cf480 0x7fc314140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.075 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 --2- 172.21.15.86:0/2833103010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3141595d0 0x7fc314141240 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 >> 172.21.15.86:0/2833103010 conn(0x7fc3140d05f0 msgr2=0x7fc314069390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:32.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 shutdown_connections 2023-10-09T13:16:32.076 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.074+0000 7fc318b9d700 1 -- 172.21.15.86:0/2833103010 wait complete. 2023-10-09T13:16:32.076 INFO:teuthology.orchestra.run.smithi086.stderr:updated caps for client.0 2023-10-09T13:16:32.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:32.273 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.273+0000 7f6c3abff700 1 Processor -- start 2023-10-09T13:16:32.274 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.273+0000 7f6c3abff700 1 -- start start 2023-10-09T13:16:32.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c3abff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6c340ccf90 0x7f6c340ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:32.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c3abff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340cc300 con 0x7f6c340cbf30 2023-10-09T13:16:32.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c3abff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340ad370 con 0x7f6c340b1420 2023-10-09T13:16:32.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c3abff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c34156bf0 con 0x7f6c340ccf90 2023-10-09T13:16:32.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c3899b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6c340cbf30 0x7f6c340b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56958/0 (socket says 172.21.15.86:56958) 2023-10-09T13:16:32.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c3899b700 1 -- 172.21.15.86:0/90718414 learned_addr learned my addr 172.21.15.86:0/90718414 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:32.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c3919c700 1 --2- 172.21.15.86:0/90718414 >> v2:172.21.15.135:3300/0 conn(0x7f6c340ccf90 0x7f6c340ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:32.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c337fe700 1 -- 172.21.15.86:0/90718414 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121267659 0 0) 0x7f6c340cc300 con 0x7f6c340cbf30 2023-10-09T13:16:32.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.275+0000 7f6c337fe700 1 -- 172.21.15.86:0/90718414 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c24003570 con 0x7f6c340cbf30 2023-10-09T13:16:32.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c3919c700 1 -- 172.21.15.86:0/90718414 >> v1:172.21.15.135:6789/0 conn(0x7f6c340b1420 legacy=0x7f6c340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c337fe700 1 -- 172.21.15.86:0/90718414 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280755423 0 0) 0x7f6c24003570 con 0x7f6c340cbf30 2023-10-09T13:16:32.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c3919c700 1 -- 172.21.15.86:0/90718414 >> v1:172.21.15.86:6789/0 conn(0x7f6c340cbf30 legacy=0x7f6c340b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c3919c700 1 -- 172.21.15.86:0/90718414 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340ad650 con 0x7f6c340ccf90 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c3919c700 1 --2- 172.21.15.86:0/90718414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340ccf90 0x7f6c340ae410 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009e60 tx=0x7f6c2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac03c12fa5069c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c337fe700 1 -- 172.21.15.86:0/90718414 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28001470 con 0x7f6c340ccf90 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c337fe700 1 -- 172.21.15.86:0/90718414 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00b850 con 0x7f6c340ccf90 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.276+0000 7f6c337fe700 1 -- 172.21.15.86:0/90718414 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00bbf0 con 0x7f6c340ccf90 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.277+0000 7f6c3abff700 1 -- 172.21.15.86:0/90718414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340ccf90 msgr2=0x7f6c340ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.277+0000 7f6c3abff700 1 --2- 172.21.15.86:0/90718414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340ccf90 0x7f6c340ae410 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009e60 tx=0x7f6c2c009780 comp rx=0 tx=0).stop 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.277+0000 7f6c3abff700 1 -- 172.21.15.86:0/90718414 shutdown_connections 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.277+0000 7f6c3abff700 1 --2- 172.21.15.86:0/90718414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340ccf90 0x7f6c340ae410 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.277+0000 7f6c3abff700 1 -- 172.21.15.86:0/90718414 >> 172.21.15.86:0/90718414 conn(0x7f6c3406a320 msgr2=0x7f6c340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:32.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.277+0000 7f6c3abff700 1 -- 172.21.15.86:0/90718414 shutdown_connections 2023-10-09T13:16:32.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.277+0000 7f6c3abff700 1 -- 172.21.15.86:0/90718414 wait complete. 2023-10-09T13:16:32.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.278+0000 7f6c3abff700 1 Processor -- start 2023-10-09T13:16:32.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.278+0000 7f6c3abff700 1 -- start start 2023-10-09T13:16:32.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.279+0000 7f6c3abff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b1420 0x7f6c34155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:32.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.279+0000 7f6c3abff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c340cbf30 0x7f6c340c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:32.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.279+0000 7f6c3abff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340ccf90 0x7f6c340c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:32.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.279+0000 7f6c3abff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340a6be0 con 0x7f6c340ccf90 2023-10-09T13:16:32.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.279+0000 7f6c3abff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340a9b00 con 0x7f6c340b1420 2023-10-09T13:16:32.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.279+0000 7f6c3abff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34155fb0 con 0x7f6c340cbf30 2023-10-09T13:16:32.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340ccf90 0x7f6c340c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340ccf90 0x7f6c340c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58942/0 (socket says 172.21.15.86:58942) 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 -- 172.21.15.86:0/1945320581 learned_addr learned my addr 172.21.15.86:0/1945320581 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3899b700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b1420 0x7f6c34155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c33fff700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c340cbf30 0x7f6c340c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 -- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c340cbf30 msgr2=0x7f6c340c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c340cbf30 0x7f6c340c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 -- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b1420 msgr2=0x7f6c34155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b1420 0x7f6c34155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 -- 172.21.15.86:0/1945320581 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009a20 con 0x7f6c340ccf90 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.280+0000 7f6c3919c700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340ccf90 0x7f6c340c9c40 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f6c34064290 tx=0x7f6c2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:32.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.281+0000 7f6c30ff9700 1 -- 172.21.15.86:0/1945320581 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00e070 con 0x7f6c340ccf90 2023-10-09T13:16:32.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.281+0000 7f6c30ff9700 1 -- 172.21.15.86:0/1945320581 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00bb90 con 0x7f6c340ccf90 2023-10-09T13:16:32.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.281+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340a97d0 con 0x7f6c340ccf90 2023-10-09T13:16:32.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.281+0000 7f6c30ff9700 1 -- 172.21.15.86:0/1945320581 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c01f070 con 0x7f6c340ccf90 2023-10-09T13:16:32.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.281+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340a6620 con 0x7f6c340ccf90 2023-10-09T13:16:32.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.282+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340a9c70 con 0x7f6c340ccf90 2023-10-09T13:16:32.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.283+0000 7f6c30ff9700 1 -- 172.21.15.86:0/1945320581 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c2c019b30 con 0x7f6c340ccf90 2023-10-09T13:16:32.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.284+0000 7f6c30ff9700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c18066f30 0x7f6c180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:32.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.284+0000 7f6c30ff9700 1 -- 172.21.15.86:0/1945320581 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f6c2c086460 con 0x7f6c340ccf90 2023-10-09T13:16:32.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.284+0000 7f6c3899b700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c18066f30 0x7f6c180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:32.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.285+0000 7f6c3899b700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c18066f30 0x7f6c180693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c28001ed0 tx=0x7f6c280019d0 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:32.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.288+0000 7f6c30ff9700 1 -- 172.21.15.86:0/1945320581 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c2c053430 con 0x7f6c340ccf90 2023-10-09T13:16:32.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.525+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c3404c3c0 con 0x7f6c340ccf90 2023-10-09T13:16:32.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.525+0000 7f6c30ff9700 1 -- 172.21.15.86:0/1945320581 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f6c2c056a50 con 0x7f6c340ccf90 2023-10-09T13:16:32.526 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:32.526 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4046429451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4046429451},{"type":"v1","addr":"172.21.15.135:6834","nonce":4046429451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1310718495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1310718495},{"type":"v1","addr":"172.21.15.135:6835","nonce":1310718495}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3009333325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3009333325},{"type":"v1","addr":"172.21.15.86:6833","nonce":3009333325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:16:21.427143+0000","modified":"2023-10-09T13:16:24.986894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/903379396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":903379396},{"type":"v1","addr":"172.21.15.86:6835","nonce":903379396}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T13:16:32.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c18066f30 msgr2=0x7f6c180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c18066f30 0x7f6c180693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c28001ed0 tx=0x7f6c280019d0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340ccf90 msgr2=0x7f6c340c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340ccf90 0x7f6c340c9c40 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f6c34064290 tx=0x7f6c2c019000 comp rx=0 tx=0).stop 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 shutdown_connections 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6c18066f30 0x7f6c180693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c340ccf90 0x7f6c340c9c40 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c340b1420 0x7f6c34155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 --2- 172.21.15.86:0/1945320581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c340cbf30 0x7f6c340c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 >> 172.21.15.86:0/1945320581 conn(0x7f6c3406a320 msgr2=0x7f6c340ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 shutdown_connections 2023-10-09T13:16:32.529 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:32.528+0000 7f6c3abff700 1 -- 172.21.15.86:0/1945320581 wait complete. 2023-10-09T13:16:32.530 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 94 2023-10-09T13:16:32.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T13:16:21.427143+0000', 'modified': '2023-10-09T13:16:24.986894+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10167': {'gid': 10167, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/903379396', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 903379396}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 903379396}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T13:16:32.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T13:16:32.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T13:16:33.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.130+0000 7f299c9fe700 1 Processor -- start 2023-10-09T13:16:33.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.130+0000 7f299c9fe700 1 -- start start 2023-10-09T13:16:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f299c9fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f299806c0f0 0x7f29980ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f299c9fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f29981410a0 0x7f29980cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f299c9fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980b1500 con 0x7f2998140cd0 2023-10-09T13:16:33.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f299c9fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980cd790 con 0x7f299806c0f0 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f299c9fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980cda20 con 0x7f29981410a0 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f2996d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2998140cd0 0x7f299806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56964/0 (socket says 172.21.15.86:56964) 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f2996d9d700 1 -- 172.21.15.86:0/3368785172 learned_addr learned my addr 172.21.15.86:0/3368785172 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.131+0000 7f299659c700 1 --2- 172.21.15.86:0/3368785172 >> v2:172.21.15.86:3300/0 conn(0x7f299806c0f0 0x7f29980ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f299759e700 1 --2- 172.21.15.86:0/3368785172 >> v2:172.21.15.135:3300/0 conn(0x7f29981410a0 0x7f29980cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f2995d9b700 1 -- 172.21.15.86:0/3368785172 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183046721 0 0) 0x7f29980b1500 con 0x7f2998140cd0 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f299659c700 1 -- 172.21.15.86:0/3368785172 >> v2:172.21.15.135:3300/0 conn(0x7f29981410a0 msgr2=0x7f29980cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f299659c700 1 --2- 172.21.15.86:0/3368785172 >> v2:172.21.15.135:3300/0 conn(0x7f29981410a0 0x7f29980cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f299659c700 1 -- 172.21.15.86:0/3368785172 >> v1:172.21.15.86:6789/0 conn(0x7f2998140cd0 legacy=0x7f299806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f299659c700 1 -- 172.21.15.86:0/3368785172 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980cdd00 con 0x7f299806c0f0 2023-10-09T13:16:33.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f299659c700 1 --2- 172.21.15.86:0/3368785172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980ccd10 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f298c0098e0 tx=0x7f298c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca015f1d183ec37 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f2995d9b700 1 -- 172.21.15.86:0/3368785172 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c009e80 con 0x7f299806c0f0 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f2995d9b700 1 -- 172.21.15.86:0/3368785172 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00b820 con 0x7f299806c0f0 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.132+0000 7f2995d9b700 1 -- 172.21.15.86:0/3368785172 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00bba0 con 0x7f299806c0f0 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 -- 172.21.15.86:0/3368785172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 msgr2=0x7f29980ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 --2- 172.21.15.86:0/3368785172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980ccd10 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f298c0098e0 tx=0x7f298c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 -- 172.21.15.86:0/3368785172 shutdown_connections 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 --2- 172.21.15.86:0/3368785172 >> v2:172.21.15.135:3300/0 conn(0x7f29981410a0 0x7f29980cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 --2- 172.21.15.86:0/3368785172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980ccd10 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 -- 172.21.15.86:0/3368785172 >> 172.21.15.86:0/3368785172 conn(0x7f29980ce430 msgr2=0x7f29980ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 -- 172.21.15.86:0/3368785172 shutdown_connections 2023-10-09T13:16:33.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.133+0000 7f299c9fe700 1 -- 172.21.15.86:0/3368785172 wait complete. 2023-10-09T13:16:33.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.135+0000 7f299c9fe700 1 Processor -- start 2023-10-09T13:16:33.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.135+0000 7f299c9fe700 1 -- start start 2023-10-09T13:16:33.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299c9fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299c9fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998140cd0 0x7f29981500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299c9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29981410a0 0x7f2998168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299c9fe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998155ae0 con 0x7f299806c0f0 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299c9fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b0120 con 0x7f2998140cd0 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299c9fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b0400 con 0x7f29981410a0 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58960/0 (socket says 172.21.15.86:58960) 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 -- 172.21.15.86:0/2159666707 learned_addr learned my addr 172.21.15.86:0/2159666707 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299659c700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998140cd0 0x7f29981500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299759e700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29981410a0 0x7f2998168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 -- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29981410a0 msgr2=0x7f2998168010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29981410a0 0x7f2998168010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 -- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998140cd0 msgr2=0x7f29981500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998140cd0 0x7f29981500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 -- 172.21.15.86:0/2159666707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c009420 con 0x7f299806c0f0 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f299759e700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29981410a0 0x7f2998168010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.136+0000 7f2996d9d700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980add00 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f298800c7e0 tx=0x7f2988007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.137+0000 7f297effd700 1 -- 172.21.15.86:0/2159666707 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988005b30 con 0x7f299806c0f0 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.137+0000 7f297effd700 1 -- 172.21.15.86:0/2159666707 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2988005c90 con 0x7f299806c0f0 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.137+0000 7f297effd700 1 -- 172.21.15.86:0/2159666707 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988007300 con 0x7f299806c0f0 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.137+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29980b06e0 con 0x7f299806c0f0 2023-10-09T13:16:33.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.137+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29980af9b0 con 0x7f299806c0f0 2023-10-09T13:16:33.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.139+0000 7f297effd700 1 -- 172.21.15.86:0/2159666707 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f298801b400 con 0x7f299806c0f0 2023-10-09T13:16:33.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.140+0000 7f297effd700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2984066f30 0x7f29840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.140+0000 7f297effd700 1 -- 172.21.15.86:0/2159666707 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f29880842e0 con 0x7f299806c0f0 2023-10-09T13:16:33.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.140+0000 7f299659c700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2984066f30 0x7f29840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.141+0000 7f299659c700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2984066f30 0x7f29840693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f299806c4f0 tx=0x7f298c017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.142+0000 7f29aba10b80 1 Processor -- start 2023-10-09T13:16:33.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.142+0000 7f29aba10b80 1 -- start start 2023-10-09T13:16:33.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d805f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8080850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8035ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f29aba10b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d7f8ca70 con 0x5654d8035b80 2023-10-09T13:16:33.144 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d7f8a270 con 0x5654d8080480 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654d7f86060 con 0x5654d80335f0 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8035ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8035ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58962/0 (socket says 172.21.15.86:58962) 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 -- 172.21.15.86:0/791742164 learned_addr learned my addr 172.21.15.86:0/791742164 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f2996d9d700 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d805f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299659c700 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8080850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 -- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 msgr2=0x5654d8080850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8080850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 -- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 msgr2=0x5654d805f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d805f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.143+0000 7f299759e700 1 -- 172.21.15.86:0/791742164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654d7e20270 con 0x5654d8035b80 2023-10-09T13:16:33.145 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.144+0000 7f299759e700 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8035ff0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f29900073a0 tx=0x7f299000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455e1765332cbff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.144+0000 7f297cff9700 1 -- 172.21.15.86:0/791742164 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990015470 con 0x5654d8035b80 2023-10-09T13:16:33.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.144+0000 7f297cff9700 1 -- 172.21.15.86:0/791742164 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299000f050 con 0x5654d8035b80 2023-10-09T13:16:33.146 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.144+0000 7f297cff9700 1 -- 172.21.15.86:0/791742164 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900157e0 con 0x5654d8035b80 2023-10-09T13:16:33.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.144+0000 7f29aba10b80 1 -- 172.21.15.86:0/791742164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 msgr2=0x5654d8035ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.144+0000 7f29aba10b80 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8035ff0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f29900073a0 tx=0x7f299000b040 comp rx=0 tx=0).stop 2023-10-09T13:16:33.149 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 -- 172.21.15.86:0/791742164 shutdown_connections 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8035ff0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d805f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 --2- 172.21.15.86:0/791742164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8080850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 -- 172.21.15.86:0/791742164 >> 172.21.15.86:0/791742164 conn(0x5654d80370c0 msgr2=0x5654d80378f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 -- 172.21.15.86:0/791742164 shutdown_connections 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 -- 172.21.15.86:0/791742164 wait complete. 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.145+0000 7f29aba10b80 1 -- start start 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.146+0000 7f29aba10b80 1 Processor -- start 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.146+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d805c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8035b80 0x5654d804f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.150 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8080480 0x5654d804f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f29aba10b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d7f31890 con 0x5654d8080480 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d7f4cea0 con 0x5654d8035b80 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654d7e08e30 con 0x5654d80335f0 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f29aba10b80 10 client.0 _ll_register_callbacks cb 0x5654d7ff92c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8080480 0x5654d804f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8080480 0x5654d804f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58970/0 (socket says 172.21.15.86:58970) 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 -- 172.21.15.86:0/218492831 learned_addr learned my addr 172.21.15.86:0/218492831 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299659c700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8035b80 0x5654d804f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f2996d9d700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d805c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 -- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 msgr2=0x5654d805c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d805c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.151 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 -- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8035b80 msgr2=0x5654d804f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8035b80 0x5654d804f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 -- 172.21.15.86:0/218492831 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2990009ce0 con 0x5654d8080480 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f2996d9d700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d805c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f299759e700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8080480 0x5654d804f630 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f2990016f70 tx=0x7f299001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a682ea6f1ff5b33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.147+0000 7f29757fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29757fa700 1 -- 172.21.15.86:0/218492831 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990015800 con 0x5654d8080480 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29757fa700 1 -- 172.21.15.86:0/218492831 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f2990020420 con 0x5654d8080480 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654d802acd0 con 0x5654d8080480 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29757fa700 1 -- 172.21.15.86:0/218492831 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29900207f0 con 0x5654d8080480 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 10 client.10344 fetch_fsmap learned FSMap version 94 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x5654d7dc2fe0 con 0x5654d8080480 2023-10-09T13:16:33.152 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29757fa700 1 -- 172.21.15.86:0/218492831 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654d802acd0 con 0x5654d8080480 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29757fa700 1 -- 172.21.15.86:0/218492831 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 94) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2990020950 con 0x5654d8080480 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 10 client.10344 fetch_fsmap finished waiting for FSMap version 94 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 10 client.10344 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 20 client.10344 populate_metadata read hostname 'smithi086' 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8094050 0x5654d8094420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 4 client.10344 mds_command: new command op to 10167 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.148+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 --> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654d8007aa0 con 0x5654d8094050 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.149+0000 7f2996d9d700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8094050 0x5654d8094420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.149+0000 7f29757fa700 10 client.10344 ms_handle_connect on v2:172.21.15.86:6834/903379396 2023-10-09T13:16:33.153 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.149+0000 7f2996d9d700 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8094050 0x5654d8094420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612433341aac14eb server_cookie=8f95adaa19248ff7 in_seq=0 out_seq=0 2023-10-09T13:16:33.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29757fa700 1 -- 172.21.15.86:0/218492831 <== mds.0 v2:172.21.15.86:6834/903379396 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5654d8007aa0 con 0x5654d8094050 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29757fa700 10 client.10344 handle_command_reply: tid=0 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 client.10344 shutdown 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8080480 msgr2=0x5654d804f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8080480 0x5654d804f630 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f2990016f70 tx=0x7f299001a000 comp rx=0 tx=0).stop 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 shutdown_connections 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8094050 0x5654d8094420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8080480 0x5654d804f630 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d805c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 --2- 172.21.15.86:0/218492831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8035b80 0x5654d804f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29757fa700 0 client.10344 ms_handle_reset on v2:172.21.15.86:6834/903379396 2023-10-09T13:16:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 >> 172.21.15.86:0/218492831 conn(0x5654d80370c0 msgr2=0x5654d8031e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 shutdown_connections 2023-10-09T13:16:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 1 -- 172.21.15.86:0/218492831 wait complete. 2023-10-09T13:16:33.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.150+0000 7f29aba10b80 20 client.10344 trim_cache size 0 max 16384 2023-10-09T13:16:33.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.167+0000 7f29aba10b80 1 Processor -- start 2023-10-09T13:16:33.168 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.168+0000 7f29aba10b80 1 -- start start 2023-10-09T13:16:33.169 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.168+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8050290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.168+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d809a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.168+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d809a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.168+0000 7f29aba10b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d8081370 con 0x5654d8035b80 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.168+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d804eed0 con 0x5654d8080480 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.168+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654d8062620 con 0x5654d80335f0 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d809a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d809a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58974/0 (socket says 172.21.15.86:58974) 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 -- 172.21.15.86:0/2500985334 learned_addr learned my addr 172.21.15.86:0/2500985334 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f2996d9d700 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8050290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299759e700 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d809a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.170 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 -- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 msgr2=0x5654d8050290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8050290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 -- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 msgr2=0x5654d809a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d809a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 -- 172.21.15.86:0/2500985334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654d7f54780 con 0x5654d8035b80 2023-10-09T13:16:33.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299759e700 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d809a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:33.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f2996d9d700 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8050290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:33.171 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.169+0000 7f299659c700 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d809a450 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f298c013000 tx=0x7f298c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154e78d550858c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f297d7fa700 1 -- 172.21.15.86:0/2500985334 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c02f070 con 0x5654d8035b80 2023-10-09T13:16:33.174 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f297d7fa700 1 -- 172.21.15.86:0/2500985334 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c01ab10 con 0x5654d8035b80 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f297d7fa700 1 -- 172.21.15.86:0/2500985334 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c020070 con 0x5654d8035b80 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 -- 172.21.15.86:0/2500985334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 msgr2=0x5654d809a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d809a450 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f298c013000 tx=0x7f298c020000 comp rx=0 tx=0).stop 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 -- 172.21.15.86:0/2500985334 shutdown_connections 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d809a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d8050290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 --2- 172.21.15.86:0/2500985334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d809a450 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 -- 172.21.15.86:0/2500985334 >> 172.21.15.86:0/2500985334 conn(0x5654d80370c0 msgr2=0x5654d8062950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 -- 172.21.15.86:0/2500985334 shutdown_connections 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.170+0000 7f29aba10b80 1 -- 172.21.15.86:0/2500985334 wait complete. 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.171+0000 7f29aba10b80 1 -- start start 2023-10-09T13:16:33.175 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.171+0000 7f29aba10b80 1 Processor -- start 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d80e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8060260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f29aba10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d80607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f29aba10b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d809b1a0 con 0x5654d8035b80 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654d807ff10 con 0x5654d8080480 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f29aba10b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654d80e66f0 con 0x5654d80335f0 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f29aba10b80 10 client.0 _ll_register_callbacks cb 0x5654d7ff92c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f299659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8060260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f299659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8060260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58990/0 (socket says 172.21.15.86:58990) 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.172+0000 7f299659c700 1 -- 172.21.15.86:0/3272009768 learned_addr learned my addr 172.21.15.86:0/3272009768 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299759e700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d80607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.176 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f2996d9d700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d80e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299659c700 1 -- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 msgr2=0x5654d80e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299659c700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d80e60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299659c700 1 -- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 msgr2=0x5654d80607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299659c700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d80607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299659c700 1 -- 172.21.15.86:0/3272009768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29980cdd00 con 0x5654d8035b80 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299759e700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d80607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f299659c700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8060260 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f299806f0d0 tx=0x7f298c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1f0a72a152a24a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f29757fa700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f29757fa700 1 -- 172.21.15.86:0/3272009768 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c020070 con 0x5654d8035b80 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f29757fa700 1 -- 172.21.15.86:0/3272009768 <== mon.0 v2:172.21.15.86:3300/0 2 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f298c00bb10 con 0x5654d8035b80 2023-10-09T13:16:33.177 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2998156930 con 0x5654d8035b80 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f29757fa700 1 -- 172.21.15.86:0/3272009768 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f298c011420 con 0x5654d8035b80 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f29aba10b80 10 client.10350 fetch_fsmap learned FSMap version 94 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.173+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x5654d7f3b470 con 0x5654d8035b80 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29757fa700 1 -- 172.21.15.86:0/3272009768 <== mon.0 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c042030 con 0x5654d8035b80 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29757fa700 1 -- 172.21.15.86:0/3272009768 <== mon.0 v2:172.21.15.86:3300/0 5 ==== fsmap(e 94) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f298c03e3f0 con 0x5654d8035b80 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29aba10b80 10 client.10350 fetch_fsmap finished waiting for FSMap version 94 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29aba10b80 10 client.10350 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29aba10b80 20 client.10350 populate_metadata read hostname 'smithi086' 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29aba10b80 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8093730 0x5654d807ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29aba10b80 4 client.10350 mds_command: new command op to 10167 tid=0[{"prefix": "status"}] 2023-10-09T13:16:33.178 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 --> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f299000f050 con 0x5654d8093730 2023-10-09T13:16:33.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f2996d9d700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8093730 0x5654d807ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f29757fa700 10 client.10350 ms_handle_connect on v2:172.21.15.86:6834/903379396 2023-10-09T13:16:33.179 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.174+0000 7f2996d9d700 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8093730 0x5654d807ee90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff741282bd0a3b09 server_cookie=ea159630361bbc1f in_seq=0 out_seq=0 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29757fa700 1 -- 172.21.15.86:0/3272009768 <== mds.0 v2:172.21.15.86:6834/903379396 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x7f299000f050 con 0x5654d8093730 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29757fa700 10 client.10350 handle_command_reply: tid=0 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 client.10350 shutdown 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 msgr2=0x5654d8060260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8060260 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f299806f0d0 tx=0x7f298c02f000 comp rx=0 tx=0).stop 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 shutdown_connections 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:6834/903379396,v1:172.21.15.86:6835/903379396] conn(0x5654d8093730 0x5654d807ee90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654d8080480 0x5654d80607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.180 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5654d80335f0 0x5654d80e60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29757fa700 0 client.10350 ms_handle_reset on v2:172.21.15.86:6834/903379396 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 --2- 172.21.15.86:0/3272009768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654d8035b80 0x5654d8060260 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 >> 172.21.15.86:0/3272009768 conn(0x5654d80370c0 msgr2=0x5654d8031e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 shutdown_connections 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 1 -- 172.21.15.86:0/3272009768 wait complete. 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.175+0000 7f29aba10b80 20 client.10350 trim_cache size 0 max 16384 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "2b95c581-b8e1-4fc5-9efb-bba4b9f96168", 2023-10-09T13:16:33.181 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 10167, 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs", 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.200034303000001, 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 94, 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 212, 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 212, 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 16.984236630000002 2023-10-09T13:16:33.182 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:16:33.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2984066f30 msgr2=0x7f29840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2984066f30 0x7f29840693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f299806c4f0 tx=0x7f298c017000 comp rx=0 tx=0).stop 2023-10-09T13:16:33.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 msgr2=0x7f29980add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980add00 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f298800c7e0 tx=0x7f2988007df0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 shutdown_connections 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2984066f30 0x7f29840693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f299806c0f0 0x7f29980add00 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29981410a0 0x7f2998168010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 --2- 172.21.15.86:0/2159666707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2998140cd0 0x7f29981500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 >> 172.21.15.86:0/2159666707 conn(0x7f29980ce430 msgr2=0x7f299813cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 shutdown_connections 2023-10-09T13:16:33.184 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.176+0000 7f299c9fe700 1 -- 172.21.15.86:0/2159666707 wait complete. 2023-10-09T13:16:33.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T13:16:33.373 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.373+0000 7f8fa75ff700 1 Processor -- start 2023-10-09T13:16:33.374 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.373+0000 7f8fa75ff700 1 -- start start 2023-10-09T13:16:33.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa75ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fa01578b0 0x7f8fa0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa75ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8fa00af2f0 0x7f8fa00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.375 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa75ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa00ad930 con 0x7f8fa0155c10 2023-10-09T13:16:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa75ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa00b0c80 con 0x7f8fa01578b0 2023-10-09T13:16:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa75ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa00acd20 con 0x7f8fa00af2f0 2023-10-09T13:16:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa4b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fa01578b0 0x7f8fa0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa4b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8fa01578b0 0x7f8fa0155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59002/0 (socket says 172.21.15.86:59002) 2023-10-09T13:16:33.376 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa4b9a700 1 -- 172.21.15.86:0/1892787791 learned_addr learned my addr 172.21.15.86:0/1892787791 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:33.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa4b9a700 1 -- 172.21.15.86:0/1892787791 >> v2:172.21.15.135:3300/0 conn(0x7f8fa00af2f0 msgr2=0x7f8fa00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:33.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa4b9a700 1 --2- 172.21.15.86:0/1892787791 >> v2:172.21.15.135:3300/0 conn(0x7f8fa00af2f0 0x7f8fa00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa4b9a700 1 -- 172.21.15.86:0/1892787791 >> v1:172.21.15.86:6789/0 conn(0x7f8fa0155c10 legacy=0x7f8fa00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.377 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.375+0000 7f8fa4b9a700 1 -- 172.21.15.86:0/1892787791 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa00ad000 con 0x7f8fa01578b0 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.376+0000 7f8fa4b9a700 1 --2- 172.21.15.86:0/1892787791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa01578b0 0x7f8fa0155fe0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0065be0 tx=0x7f8f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ccbf291f04f8a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.376+0000 7f8f97fff700 1 -- 172.21.15.86:0/1892787791 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9000b860 con 0x7f8fa01578b0 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.376+0000 7f8f97fff700 1 -- 172.21.15.86:0/1892787791 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9000b9c0 con 0x7f8fa01578b0 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.376+0000 7f8f97fff700 1 -- 172.21.15.86:0/1892787791 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9000bd60 con 0x7f8fa01578b0 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.376+0000 7f8fa75ff700 1 -- 172.21.15.86:0/1892787791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa01578b0 msgr2=0x7f8fa0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.376+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/1892787791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa01578b0 0x7f8fa0155fe0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0065be0 tx=0x7f8f90009250 comp rx=0 tx=0).stop 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.377+0000 7f8fa75ff700 1 -- 172.21.15.86:0/1892787791 shutdown_connections 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.377+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/1892787791 >> v2:172.21.15.135:3300/0 conn(0x7f8fa00af2f0 0x7f8fa00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.377+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/1892787791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa01578b0 0x7f8fa0155fe0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.378 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.377+0000 7f8fa75ff700 1 -- 172.21.15.86:0/1892787791 >> 172.21.15.86:0/1892787791 conn(0x7f8fa006a320 msgr2=0x7f8fa00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.377+0000 7f8fa75ff700 1 -- 172.21.15.86:0/1892787791 shutdown_connections 2023-10-09T13:16:33.379 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.377+0000 7f8fa75ff700 1 -- 172.21.15.86:0/1892787791 wait complete. 2023-10-09T13:16:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.378+0000 7f8fa75ff700 1 Processor -- start 2023-10-09T13:16:33.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.378+0000 7f8fa75ff700 1 -- start start 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa75ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa00af2f0 0x7f8fa00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa75ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fa0155c10 0x7f8fa0148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa75ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fa01578b0 0x7f8fa0149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa75ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa0149cb0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa75ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa0147350 con 0x7f8fa01578b0 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa75ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa00cc600 con 0x7f8fa0155c10 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa539b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa00af2f0 0x7f8fa00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa539b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa00af2f0 0x7f8fa00cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59014/0 (socket says 172.21.15.86:59014) 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa539b700 1 -- 172.21.15.86:0/2334112233 learned_addr learned my addr 172.21.15.86:0/2334112233 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa4b9a700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fa0155c10 0x7f8fa0148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.379+0000 7f8fa5b9c700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fa01578b0 0x7f8fa0149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa539b700 1 -- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fa0155c10 msgr2=0x7f8fa0148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa539b700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fa0155c10 0x7f8fa0148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa539b700 1 -- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fa01578b0 msgr2=0x7f8fa0149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa539b700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fa01578b0 0x7f8fa0149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa539b700 1 -- 172.21.15.86:0/2334112233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900094f0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa539b700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa00af2f0 0x7f8fa00cca90 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c5c0 tx=0x7f8f9c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8f957fa700 1 -- 172.21.15.86:0/2334112233 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011590 con 0x7f8fa00af2f0 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8f957fa700 1 -- 172.21.15.86:0/2334112233 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c011710 con 0x7f8fa00af2f0 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa00cb9f0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8f957fa700 1 -- 172.21.15.86:0/2334112233 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011ad0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.380+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa00cbfb0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.381+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa00cc8e0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.382+0000 7f8f957fa700 1 -- 172.21.15.86:0/2334112233 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f9c012420 con 0x7f8fa00af2f0 2023-10-09T13:16:33.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.383+0000 7f8f957fa700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8f84066f30 0x7f8f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.383+0000 7f8f957fa700 1 -- 172.21.15.86:0/2334112233 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f8f9c083a40 con 0x7f8fa00af2f0 2023-10-09T13:16:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.383+0000 7f8fa4b9a700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8f84066f30 0x7f8f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:33.384 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.384+0000 7f8fa4b9a700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8f84066f30 0x7f8f840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0065be0 tx=0x7f8f90017000 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:33.387 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.387+0000 7f8f957fa700 1 -- 172.21.15.86:0/2334112233 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f9c04b5a0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.623+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fa004c3c0 con 0x7f8fa00af2f0 2023-10-09T13:16:33.623 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.623+0000 7f8f957fa700 1 -- 172.21.15.86:0/2334112233 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f9c017070 con 0x7f8fa00af2f0 2023-10-09T13:16:33.623 INFO:teuthology.orchestra.run.smithi086.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T13:16:33.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8f84066f30 msgr2=0x7f8f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.626 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8f84066f30 0x7f8f840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0065be0 tx=0x7f8f90017000 comp rx=0 tx=0).stop 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa00af2f0 msgr2=0x7f8fa00cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa00af2f0 0x7f8fa00cca90 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c5c0 tx=0x7f8f9c00c980 comp rx=0 tx=0).stop 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 shutdown_connections 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f8f84066f30 0x7f8f840693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fa00af2f0 0x7f8fa00cca90 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fa01578b0 0x7f8fa0149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 --2- 172.21.15.86:0/2334112233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fa0155c10 0x7f8fa0148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 >> 172.21.15.86:0/2334112233 conn(0x7f8fa006a320 msgr2=0x7f8fa006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 shutdown_connections 2023-10-09T13:16:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:33.626+0000 7f8fa75ff700 1 -- 172.21.15.86:0/2334112233 wait complete. 2023-10-09T13:16:33.643 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T13:16:33.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T13:16:33.643 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-10-09T13:16:33.643 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T13:16:33.643 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T13:16:33.643 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T13:16:33.644 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T13:16:33.644 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T13:16:33.644 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T13:16:33.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:33.644 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T13:16:33.681 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 36550sec preferred_lft 36550sec 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2023-10-09T13:16:33.682 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::4816:b1ff:fe84:29f9/64 scope link 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ee:81:4e:dd:be:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec81:4eff:fedd:be16/64 scope link 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T13:16:33.683 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether a2:fc:9d:b0:91:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T13:16:33.684 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::a0fc:9dff:feb0:91c0/64 scope link 2023-10-09T13:16:33.684 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-10-09T13:16:33.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:33.684 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T13:16:33.780 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-10-09T13:16:33.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:33.783 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-10-09T13:16:33.820 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-10-09T13:16:33.821 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T13:16:33.821 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T13:16:33.821 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T13:16:33.821 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T13:16:33.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:33.822 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-10-09T13:16:33.822 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-10-09T13:16:33.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T13:16:33.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T13:16:33.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T13:16:33.822 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-10-09T13:16:34.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:34.018 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T13:16:34.053 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T13:16:34.054 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T13:16:34.054 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T13:16:34.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:34.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-10-09T13:16:34.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T13:16:34.155 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T13:16:34.191 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T13:16:34.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T13:16:34.192 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T13:16:34.267 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T13:16:34.267 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T13:16:34.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T13:16:34.396 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T13:16:34.397 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T13:16:34.424 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T13:16:34.425 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T13:16:34.425 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.86:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-09T13:16:34.425 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 0@2b95c581-b8e1-4fc5-9efb-bba4b9f96168.cephfs=/ 2023-10-09T13:16:34.425 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.86:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-10-09T13:16:34.430 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T13:16:34.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:34.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T13:16:34.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T13:16:34.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.674+0000 7f0bff5ff700 1 Processor -- start 2023-10-09T13:16:34.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.674+0000 7f0bff5ff700 1 -- start start 2023-10-09T13:16:34.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 0x7f0bf8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bff5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0bf80af2f0 0x7f0bf80af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bff5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf80ad930 con 0x7f0bf8155c10 2023-10-09T13:16:34.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bff5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80b0c60 con 0x7f0bf80af2f0 2023-10-09T13:16:34.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80acd20 con 0x7f0bf81578b0 2023-10-09T13:16:34.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bfd39b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0bf8155c10 0x7f0bf80ac230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:56984/0 (socket says 172.21.15.86:56984) 2023-10-09T13:16:34.677 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1907586237 learned_addr learned my addr 172.21.15.86:0/1907586237 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:34.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773482560 0 0) 0x7f0bf80ad930 con 0x7f0bf8155c10 2023-10-09T13:16:34.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be4004680 con 0x7f0bf8155c10 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bfcb9a700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 0x7f0bf8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.676+0000 7f0bfdb9c700 1 --2- 172.21.15.86:0/1907586237 >> v2:172.21.15.135:3300/0 conn(0x7f0bf80af2f0 0x7f0bf80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205658240 0 0) 0x7f0be4004680 con 0x7f0bf8155c10 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 msgr2=0x7f0bf8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 0x7f0bf8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 >> v2:172.21.15.135:3300/0 conn(0x7f0bf80af2f0 msgr2=0x7f0bf80af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 --2- 172.21.15.86:0/1907586237 >> v2:172.21.15.135:3300/0 conn(0x7f0bf80af2f0 0x7f0bf80af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80ad000 con 0x7f0bf8155c10 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f0bf4001470 con 0x7f0bf8155c10 2023-10-09T13:16:34.680 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfdb9c700 1 --2- 172.21.15.86:0/1907586237 >> v2:172.21.15.135:3300/0 conn(0x7f0bf80af2f0 0x7f0bf80af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 >> v1:172.21.15.86:6789/0 conn(0x7f0bf8155c10 legacy=0x7f0bf80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0be4004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be4005920 0x7f0be4005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 0x7f0be40062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80b0c60 con 0x7f0be4004b70 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80acd20 con 0x7f0be4005920 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4003540 con 0x7f0bf81578b0 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfd39b700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0be4004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfdb9c700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 0x7f0be40062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfcb9a700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be4005920 0x7f0be4005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 msgr2=0x7f0be40062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:34.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfd39b700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 0x7f0be40062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be4005920 msgr2=0x7f0be4005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfd39b700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be4005920 0x7f0be4005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1907586237 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4004680 con 0x7f0be4004b70 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfdb9c700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf81578b0 0x7f0be40062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.677+0000 7f0bfcb9a700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be4005920 0x7f0be4005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0bfd39b700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0be4004f80 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c3c0 tx=0x7f0bf4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d104ca1f5ed3f27f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400cc90 con 0x7f0be4004b70 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf400ce30 con 0x7f0be4004b70 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0beffff700 1 -- 172.21.15.86:0/1907586237 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4005b70 con 0x7f0be4004b70 2023-10-09T13:16:34.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1907586237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 msgr2=0x7f0be4004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:34.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0bff5ff700 1 --2- 172.21.15.86:0/1907586237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0be4004f80 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c3c0 tx=0x7f0bf4001e90 comp rx=0 tx=0).stop 2023-10-09T13:16:34.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0bfdb9c700 1 -- 172.21.15.86:0/1907586237 reap_dead start 2023-10-09T13:16:34.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1907586237 shutdown_connections 2023-10-09T13:16:34.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1907586237 >> 172.21.15.86:0/1907586237 conn(0x7f0bf806a320 msgr2=0x7f0bf80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:34.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.678+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1907586237 shutdown_connections 2023-10-09T13:16:34.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.679+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1907586237 wait complete. 2023-10-09T13:16:34.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.680+0000 7f0bff5ff700 1 Processor -- start 2023-10-09T13:16:34.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.680+0000 7f0bff5ff700 1 -- start start 2023-10-09T13:16:34.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0bf81529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.685 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf814fc30 0x7f0bf816db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf815f570 0x7f0bf815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8152fd0 con 0x7f0be4004b70 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8169b10 con 0x7f0bf815f570 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80ab320 con 0x7f0bf814fc30 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bfd39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0bf81529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bfd39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0bf81529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:59032/0 (socket says 172.21.15.86:59032) 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1895357987 learned_addr learned my addr 172.21.15.86:0/1895357987 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bfcb9a700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf814fc30 0x7f0bf816db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.681+0000 7f0bfdb9c700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf815f570 0x7f0bf815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf814fc30 msgr2=0x7f0bf816db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:34.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bfd39b700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf814fc30 0x7f0bf816db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf815f570 msgr2=0x7f0bf815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bfd39b700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf815f570 0x7f0bf815f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bfd39b700 1 -- 172.21.15.86:0/1895357987 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf816a630 con 0x7f0be4004b70 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bfcb9a700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf814fc30 0x7f0bf816db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bfd39b700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0bf81529f0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4011000 tx=0x7f0bf4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bed7fa700 1 -- 172.21.15.86:0/1895357987 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400cc90 con 0x7f0be4004b70 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bed7fa700 1 -- 172.21.15.86:0/1895357987 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf40072e0 con 0x7f0be4004b70 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf816aac0 con 0x7f0be4004b70 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bed7fa700 1 -- 172.21.15.86:0/1895357987 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4007660 con 0x7f0be4004b70 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.682+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf8169d00 con 0x7f0be4004b70 2023-10-09T13:16:34.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.683+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf804c3c0 con 0x7f0be4004b70 2023-10-09T13:16:34.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.684+0000 7f0bed7fa700 1 -- 172.21.15.86:0/1895357987 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bf4019070 con 0x7f0be4004b70 2023-10-09T13:16:34.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.685+0000 7f0bed7fa700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0bdc066f30 0x7f0bdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:34.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.685+0000 7f0bed7fa700 1 -- 172.21.15.86:0/1895357987 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f0bf4085a90 con 0x7f0be4004b70 2023-10-09T13:16:34.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.685+0000 7f0bfcb9a700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0bdc066f30 0x7f0bdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:34.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.686+0000 7f0bfcb9a700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0bdc066f30 0x7f0bdc0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009de0 tx=0x7f0be8008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:34.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.690+0000 7f0bed7fa700 1 -- 172.21.15.86:0/1895357987 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bf4052a60 con 0x7f0be4004b70 2023-10-09T13:16:34.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.903+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bf815ff30 con 0x7f0bdc066f30 2023-10-09T13:16:34.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.905+0000 7f0bed7fa700 1 -- 172.21.15.86:0/1895357987 <== mgr.9981 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0be8009a20 con 0x7f0bdc066f30 2023-10-09T13:16:34.905 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2023-10-09T13:16:34.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-09T13:16:34.906 INFO:teuthology.orchestra.run.smithi086.stdout: "name": "cephfs" 2023-10-09T13:16:34.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-09T13:16:34.906 INFO:teuthology.orchestra.run.smithi086.stdout:] 2023-10-09T13:16:34.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0bdc066f30 msgr2=0x7f0bdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:34.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0bdc066f30 0x7f0bdc0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009de0 tx=0x7f0be8008040 comp rx=0 tx=0).stop 2023-10-09T13:16:34.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 msgr2=0x7f0bf81529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:34.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0bf81529f0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4011000 tx=0x7f0bf4015000 comp rx=0 tx=0).stop 2023-10-09T13:16:34.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 shutdown_connections 2023-10-09T13:16:34.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0bdc066f30 0x7f0bdc0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be4004b70 0x7f0bf81529f0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf815f570 0x7f0bf815f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 --2- 172.21.15.86:0/1895357987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bf814fc30 0x7f0bf816db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:34.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 >> 172.21.15.86:0/1895357987 conn(0x7f0bf806a320 msgr2=0x7f0bf806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:34.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 shutdown_connections 2023-10-09T13:16:34.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:34.907+0000 7f0bff5ff700 1 -- 172.21.15.86:0/1895357987 wait complete. 2023-10-09T13:16:34.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-09T13:16:35.107 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.107+0000 7f208dbff700 1 Processor -- start 2023-10-09T13:16:35.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.107+0000 7f208dbff700 1 -- start start 2023-10-09T13:16:35.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.108+0000 7f208dbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.108+0000 7f208dbff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f208815b050 0x7f2088069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.108+0000 7f208dbff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20880af2f0 con 0x7f20880afa60 2023-10-09T13:16:35.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.108+0000 7f208dbff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880af5d0 con 0x7f208815b050 2023-10-09T13:16:35.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f208dbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880c8660 con 0x7f208815ac80 2023-10-09T13:16:35.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f207ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f208815b050 0x7f2088069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f20877fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f20877fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:48340/0 (socket says 172.21.15.86:48340) 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f20877fe700 1 -- 172.21.15.86:0/4291765490 learned_addr learned my addr 172.21.15.86:0/4291765490 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f20877fe700 1 -- 172.21.15.86:0/4291765490 >> v2:172.21.15.135:3300/0 conn(0x7f208815b050 msgr2=0x7f2088069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f20877fe700 1 --2- 172.21.15.86:0/4291765490 >> v2:172.21.15.135:3300/0 conn(0x7f208815b050 0x7f2088069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.109+0000 7f20877fe700 1 -- 172.21.15.86:0/4291765490 >> v1:172.21.15.135:6789/0 conn(0x7f20880afa60 legacy=0x7f20880afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.110+0000 7f20877fe700 1 -- 172.21.15.86:0/4291765490 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880c8940 con 0x7f208815ac80 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.110+0000 7f207ffff700 1 --2- 172.21.15.86:0/4291765490 >> v2:172.21.15.135:3300/0 conn(0x7f208815b050 0x7f2088069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.110+0000 7f20877fe700 1 --2- 172.21.15.86:0/4291765490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088069770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20780099b0 tx=0x7f2078009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8fdef0bcabdbcf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.110+0000 7f2086ffd700 1 -- 172.21.15.86:0/4291765490 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078009ea0 con 0x7f208815ac80 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.110+0000 7f2086ffd700 1 -- 172.21.15.86:0/4291765490 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207800b860 con 0x7f208815ac80 2023-10-09T13:16:35.111 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.110+0000 7f2086ffd700 1 -- 172.21.15.86:0/4291765490 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800bc00 con 0x7f208815ac80 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 -- 172.21.15.86:0/4291765490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 msgr2=0x7f2088069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 --2- 172.21.15.86:0/4291765490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088069770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20780099b0 tx=0x7f2078009250 comp rx=0 tx=0).stop 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 -- 172.21.15.86:0/4291765490 shutdown_connections 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 --2- 172.21.15.86:0/4291765490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088069770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 --2- 172.21.15.86:0/4291765490 >> v2:172.21.15.135:3300/0 conn(0x7f208815b050 0x7f2088069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 -- 172.21.15.86:0/4291765490 >> 172.21.15.86:0/4291765490 conn(0x7f2088068e10 msgr2=0x7f20880cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 -- 172.21.15.86:0/4291765490 shutdown_connections 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.111+0000 7f208dbff700 1 -- 172.21.15.86:0/4291765490 wait complete. 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.112+0000 7f208dbff700 1 Processor -- start 2023-10-09T13:16:35.113 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.112+0000 7f208dbff700 1 -- start start 2023-10-09T13:16:35.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.113+0000 7f208dbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20880afa60 0x7f20880acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.113+0000 7f208dbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.115 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.113+0000 7f208dbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f208815b050 0x7f2088158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.113+0000 7f208dbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20880ad390 con 0x7f20880afa60 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.113+0000 7f208dbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881557a0 con 0x7f208815b050 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.113+0000 7f208dbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880abd40 con 0x7f208815ac80 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20880afa60 0x7f20880acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20880afa60 0x7f20880acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53926/0 (socket says 172.21.15.86:53926) 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 -- 172.21.15.86:0/3318541078 learned_addr learned my addr 172.21.15.86:0/3318541078 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f207ffff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f2087fff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f208815b050 0x7f2088158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 -- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 msgr2=0x7f2088145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.116 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 -- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f208815b050 msgr2=0x7f2088158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f208815b050 0x7f2088158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 -- 172.21.15.86:0/3318541078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070009420 con 0x7f20880afa60 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f2087fff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f208815b050 0x7f2088158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.114+0000 7f20877fe700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20880afa60 0x7f20880acc80 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f2088071290 tx=0x7f2078017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.115+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800bbe0 con 0x7f20880afa60 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.115+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078011420 con 0x7f20880afa60 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.115+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20780094f0 con 0x7f20880afa60 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.115+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780117c0 con 0x7f20880afa60 2023-10-09T13:16:35.117 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.115+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20880ac300 con 0x7f20880afa60 2023-10-09T13:16:35.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.116+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208806d6c0 con 0x7f20880afa60 2023-10-09T13:16:35.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.116+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 110) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2078011bb0 con 0x7f20880afa60 2023-10-09T13:16:35.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.118+0000 7f207f7fe700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2068066f30 0x7f20680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.118+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f2078086140 con 0x7f20880afa60 2023-10-09T13:16:35.118 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.118+0000 7f207ffff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2068066f30 0x7f20680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.119+0000 7f207ffff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2068066f30 0x7f20680693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20700093f0 tx=0x7f2070008040 comp rx=0 tx=0).ready entity=mgr.9981 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:35.122 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.122+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2078053110 con 0x7f20880afa60 2023-10-09T13:16:35.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.363+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f208804c3c0 con 0x7f20880afa60 2023-10-09T13:16:35.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.491+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f20780534e0 con 0x7f20880afa60 2023-10-09T13:16:35.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.493+0000 7f207f7fe700 1 -- 172.21.15.86:0/3318541078 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v111) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2078056ba0 con 0x7f20880afa60 2023-10-09T13:16:35.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2068066f30 msgr2=0x7f20680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2068066f30 0x7f20680693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20700093f0 tx=0x7f2070008040 comp rx=0 tx=0).stop 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20880afa60 msgr2=0x7f20880acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20880afa60 0x7f20880acc80 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f2088071290 tx=0x7f2078017000 comp rx=0 tx=0).stop 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 shutdown_connections 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2068066f30 0x7f20680693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20880afa60 0x7f20880acc80 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f208815b050 0x7f2088158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 --2- 172.21.15.86:0/3318541078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f208815ac80 0x7f2088145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 >> 172.21.15.86:0/3318541078 conn(0x7f2088068e10 msgr2=0x7f2088157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 shutdown_connections 2023-10-09T13:16:35.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.495+0000 7f208dbff700 1 -- 172.21.15.86:0/3318541078 wait complete. 2023-10-09T13:16:35.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-09T13:16:35.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.704+0000 7f56d759e700 1 Processor -- start 2023-10-09T13:16:35.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.704+0000 7f56d759e700 1 -- start start 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b4e70 0x7f56d80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f56d80b1b40 0x7f56d815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80cfb00 con 0x7f56d80b16d0 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80b5c40 con 0x7f56d80b1b40 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80b5f20 con 0x7f56d80b4e70 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f56d80b1b40 0x7f56d815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f56d80b1b40 0x7f56d815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53942/0 (socket says 172.21.15.86:53942) 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d6d9d700 1 -- 172.21.15.86:0/2775264553 learned_addr learned my addr 172.21.15.86:0/2775264553 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:35.707 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d659c700 1 --2- 172.21.15.86:0/2775264553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b4e70 0x7f56d80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d6d9d700 1 -- 172.21.15.86:0/2775264553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b4e70 msgr2=0x7f56d80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:35.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d6d9d700 1 --2- 172.21.15.86:0/2775264553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b4e70 0x7f56d80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d6d9d700 1 -- 172.21.15.86:0/2775264553 >> v1:172.21.15.135:6789/0 conn(0x7f56d80b16d0 legacy=0x7f56d815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.706+0000 7f56d6d9d700 1 -- 172.21.15.86:0/2775264553 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d80b6200 con 0x7f56d80b1b40 2023-10-09T13:16:35.708 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.707+0000 7f56d6d9d700 1 --2- 172.21.15.86:0/2775264553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b1b40 0x7f56d815d950 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009f20 tx=0x7f56d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d34d4d5fa306e10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.707+0000 7f56d559a700 1 -- 172.21.15.86:0/2775264553 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000e070 con 0x7f56d80b1b40 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.707+0000 7f56d559a700 1 -- 172.21.15.86:0/2775264553 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000b9d0 con 0x7f56d80b1b40 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.707+0000 7f56d559a700 1 -- 172.21.15.86:0/2775264553 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00092e0 con 0x7f56d80b1b40 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.707+0000 7f56d759e700 1 -- 172.21.15.86:0/2775264553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b1b40 msgr2=0x7f56d815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.707+0000 7f56d759e700 1 --2- 172.21.15.86:0/2775264553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b1b40 0x7f56d815d950 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009f20 tx=0x7f56d0009840 comp rx=0 tx=0).stop 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.708+0000 7f56d759e700 1 -- 172.21.15.86:0/2775264553 shutdown_connections 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.708+0000 7f56d759e700 1 --2- 172.21.15.86:0/2775264553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b1b40 0x7f56d815d950 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.708+0000 7f56d759e700 1 --2- 172.21.15.86:0/2775264553 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b4e70 0x7f56d80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.708+0000 7f56d759e700 1 -- 172.21.15.86:0/2775264553 >> 172.21.15.86:0/2775264553 conn(0x7f56d80d10c0 msgr2=0x7f56d80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:35.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.708+0000 7f56d759e700 1 -- 172.21.15.86:0/2775264553 shutdown_connections 2023-10-09T13:16:35.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.708+0000 7f56d759e700 1 -- 172.21.15.86:0/2775264553 wait complete. 2023-10-09T13:16:35.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.710+0000 7f56d759e700 1 Processor -- start 2023-10-09T13:16:35.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.710+0000 7f56d759e700 1 -- start start 2023-10-09T13:16:35.713 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d759e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b16d0 0x7f56d80c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b1b40 0x7f56d8156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d80b4e70 0x7f56d80cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d759e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8144be0 con 0x7f56d80b16d0 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c7060 con 0x7f56d80b4e70 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c6730 con 0x7f56d80b1b40 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b16d0 0x7f56d80c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b16d0 0x7f56d80c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53952/0 (socket says 172.21.15.86:53952) 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 -- 172.21.15.86:0/1029082557 learned_addr learned my addr 172.21.15.86:0/1029082557 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d6d9d700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d80b4e70 0x7f56d80cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d5d9b700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b1b40 0x7f56d8156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:35.714 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 -- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b1b40 msgr2=0x7f56d8156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b1b40 0x7f56d8156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 -- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d80b4e70 msgr2=0x7f56d80cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d80b4e70 0x7f56d80cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d659c700 1 -- 172.21.15.86:0/1029082557 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0009ae0 con 0x7f56d80b16d0 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.712+0000 7f56d5d9b700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b1b40 0x7f56d8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.713+0000 7f56d659c700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b16d0 0x7f56d80c9760 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f56c800e930 tx=0x7f56c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.713+0000 7f56c67fc700 1 -- 172.21.15.86:0/1029082557 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8013680 con 0x7f56d80b16d0 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.713+0000 7f56c67fc700 1 -- 172.21.15.86:0/1029082557 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80137e0 con 0x7f56d80b16d0 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.713+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d80c6a10 con 0x7f56d80b16d0 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.713+0000 7f56c67fc700 1 -- 172.21.15.86:0/1029082557 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8013b80 con 0x7f56d80b16d0 2023-10-09T13:16:35.715 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.713+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d80cbfb0 con 0x7f56d80b16d0 2023-10-09T13:16:35.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.714+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d80c7340 con 0x7f56d80b16d0 2023-10-09T13:16:35.716 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.715+0000 7f56c67fc700 1 -- 172.21.15.86:0/1029082557 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f56c800c460 con 0x7f56d80b16d0 2023-10-09T13:16:35.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.716+0000 7f56c67fc700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 0x7f56b80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:35.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.716+0000 7f56c67fc700 1 -- 172.21.15.86:0/1029082557 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f56c8084950 con 0x7f56d80b16d0 2023-10-09T13:16:35.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.716+0000 7f56d5d9b700 1 -- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 msgr2=0x7f56b80694b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:35.717 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.716+0000 7f56d5d9b700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 0x7f56b80694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:35.720 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.720+0000 7f56c67fc700 1 -- 172.21.15.86:0/1029082557 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56c8051920 con 0x7f56d80b16d0 2023-10-09T13:16:35.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.916+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f56d804bb80 con 0x7f56d80b16d0 2023-10-09T13:16:35.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.917+0000 7f56d5d9b700 1 -- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 msgr2=0x7f56b80694b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:35.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.917+0000 7f56d5d9b700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 0x7f56b80694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:35.920 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.920+0000 7f56c67fc700 1 -- 172.21.15.86:0/1029082557 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v71)=0 v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7f56c8054f40 con 0x7f56d80b16d0 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 msgr2=0x7f56b80694b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 0x7f56b80694b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b16d0 msgr2=0x7f56d80c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b16d0 0x7f56d80c9760 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f56c800e930 tx=0x7f56c80091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 shutdown_connections 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f56b8067000 0x7f56b80694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56d80b16d0 0x7f56d80c9760 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56d80b4e70 0x7f56d80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 --2- 172.21.15.86:0/1029082557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56d80b1b40 0x7f56d8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:35.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 >> 172.21.15.86:0/1029082557 conn(0x7f56d80d10c0 msgr2=0x7f56d8159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:35.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 shutdown_connections 2023-10-09T13:16:35.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:35.922+0000 7f56d759e700 1 -- 172.21.15.86:0/1029082557 wait complete. 2023-10-09T13:16:35.942 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-09T13:16:36.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.129+0000 7f4b61b9d700 1 Processor -- start 2023-10-09T13:16:36.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.129+0000 7f4b61b9d700 1 -- start start 2023-10-09T13:16:36.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b61b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4b5c0b4e70 0x7f4b5c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b61b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c0cfb00 con 0x7f4b5c0b1b40 2023-10-09T13:16:36.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b61b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c15e060 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b61b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c0b5c40 con 0x7f4b5c0b4e70 2023-10-09T13:16:36.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b6139c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4b5c0b1b40 0x7f4b5c15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58724/0 (socket says 172.21.15.86:58724) 2023-10-09T13:16:36.131 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b6139c700 1 -- 172.21.15.86:0/2869323955 learned_addr learned my addr 172.21.15.86:0/2869323955 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:36.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b60b9b700 1 --2- 172.21.15.86:0/2869323955 >> v2:172.21.15.135:3300/0 conn(0x7f4b5c0b4e70 0x7f4b5c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b5b7fe700 1 -- 172.21.15.86:0/2869323955 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926365590 0 0) 0x7f4b5c0cfb00 con 0x7f4b5c0b1b40 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.131+0000 7f4b5b7fe700 1 -- 172.21.15.86:0/2869323955 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b4c003570 con 0x7f4b5c0b1b40 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.132+0000 7f4b60b9b700 1 -- 172.21.15.86:0/2869323955 >> v1:172.21.15.135:6789/0 conn(0x7f4b5c0b16d0 legacy=0x7f4b5c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.132+0000 7f4b60b9b700 1 -- 172.21.15.86:0/2869323955 >> v1:172.21.15.86:6789/0 conn(0x7f4b5c0b1b40 legacy=0x7f4b5c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.132+0000 7f4b60b9b700 1 -- 172.21.15.86:0/2869323955 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0b5f20 con 0x7f4b5c0b4e70 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.132+0000 7f4b60b9b700 1 --2- 172.21.15.86:0/2869323955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 0x7f4b5c0ccff0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098e0 tx=0x7f4b500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25c39e9204eb2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.132+0000 7f4b5b7fe700 1 -- 172.21.15.86:0/2869323955 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000b640 con 0x7f4b5c0b4e70 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.132+0000 7f4b5b7fe700 1 -- 172.21.15.86:0/2869323955 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5000b7a0 con 0x7f4b5c0b4e70 2023-10-09T13:16:36.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.132+0000 7f4b5b7fe700 1 -- 172.21.15.86:0/2869323955 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000bb40 con 0x7f4b5c0b4e70 2023-10-09T13:16:36.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.133+0000 7f4b61b9d700 1 -- 172.21.15.86:0/2869323955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 msgr2=0x7f4b5c0ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.133+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/2869323955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 0x7f4b5c0ccff0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098e0 tx=0x7f4b500091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.133+0000 7f4b61b9d700 1 -- 172.21.15.86:0/2869323955 shutdown_connections 2023-10-09T13:16:36.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.133+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/2869323955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 0x7f4b5c0ccff0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.133+0000 7f4b61b9d700 1 -- 172.21.15.86:0/2869323955 >> 172.21.15.86:0/2869323955 conn(0x7f4b5c0d10c0 msgr2=0x7f4b5c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:36.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.133+0000 7f4b61b9d700 1 -- 172.21.15.86:0/2869323955 shutdown_connections 2023-10-09T13:16:36.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.133+0000 7f4b61b9d700 1 -- 172.21.15.86:0/2869323955 wait complete. 2023-10-09T13:16:36.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.134+0000 7f4b61b9d700 1 Processor -- start 2023-10-09T13:16:36.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.134+0000 7f4b61b9d700 1 -- start start 2023-10-09T13:16:36.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.135+0000 7f4b61b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b5c0b16d0 0x7f4b5c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.135+0000 7f4b61b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b5c0b1b40 0x7f4b5c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.135+0000 7f4b61b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 0x7f4b5c0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.135+0000 7f4b61b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c69b0 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.135+0000 7f4b61b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c63f0 con 0x7f4b5c0b4e70 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.135+0000 7f4b61b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c66d0 con 0x7f4b5c0b1b40 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b5c0b16d0 0x7f4b5c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b5c0b16d0 0x7f4b5c0c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53960/0 (socket says 172.21.15.86:53960) 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 -- 172.21.15.86:0/4173954019 learned_addr learned my addr 172.21.15.86:0/4173954019 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b6139c700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 0x7f4b5c0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b5bfff700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b5c0b1b40 0x7f4b5c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 -- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b5c0b1b40 msgr2=0x7f4b5c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b5c0b1b40 0x7f4b5c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 -- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 msgr2=0x7f4b5c0c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 0x7f4b5c0c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 -- 172.21.15.86:0/4173954019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50009420 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b5bfff700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b5c0b1b40 0x7f4b5c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:36.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b60b9b700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b5c0b16d0 0x7f4b5c0c5da0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c070dd0 tx=0x7f4b50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:36.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.136+0000 7f4b58ff9700 1 -- 172.21.15.86:0/4173954019 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50000d10 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.137+0000 7f4b58ff9700 1 -- 172.21.15.86:0/4173954019 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5000bb20 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.137+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c15bf10 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.137+0000 7f4b58ff9700 1 -- 172.21.15.86:0/4173954019 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011630 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.137+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c0cc340 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.138+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c088990 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.139+0000 7f4b58ff9700 1 -- 172.21.15.86:0/4173954019 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f4b500119a0 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.139+0000 7f4b58ff9700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 0x7f4b40069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.140+0000 7f4b5bfff700 1 -- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 msgr2=0x7f4b40069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:36.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.140+0000 7f4b58ff9700 1 -- 172.21.15.86:0/4173954019 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f4b50085ad0 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.140+0000 7f4b5bfff700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 0x7f4b40069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:36.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.148+0000 7f4b58ff9700 1 -- 172.21.15.86:0/4173954019 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b50052bc0 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:16:36.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.341+0000 7f4b5bfff700 1 -- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 msgr2=0x7f4b40069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:36.342 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.341+0000 7f4b5bfff700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 0x7f4b40069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:36.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:16:36.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.350+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f4b5c04bb80 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.354 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.354+0000 7f4b58ff9700 1 -- 172.21.15.86:0/4173954019 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v72)=0 v72) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4b500561e0 con 0x7f4b5c0b16d0 2023-10-09T13:16:36.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.356+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 msgr2=0x7f4b40069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:36.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.356+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 0x7f4b40069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b5c0b16d0 msgr2=0x7f4b5c0c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b5c0b16d0 0x7f4b5c0c5da0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c070dd0 tx=0x7f4b50017000 comp rx=0 tx=0).stop 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 shutdown_connections 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4b40066f80 0x7f4b40069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b5c0b16d0 0x7f4b5c0c5da0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b5c0b4e70 0x7f4b5c0c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 --2- 172.21.15.86:0/4173954019 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4b5c0b1b40 0x7f4b5c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 >> 172.21.15.86:0/4173954019 conn(0x7f4b5c0d10c0 msgr2=0x7f4b5c159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 shutdown_connections 2023-10-09T13:16:36.358 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.357+0000 7f4b61b9d700 1 -- 172.21.15.86:0/4173954019 wait complete. 2023-10-09T13:16:36.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:36.376 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-09T13:16:36.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-09T13:16:36.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.694+0000 7f004b39d700 1 Processor -- start 2023-10-09T13:16:36.695 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.694+0000 7f004b39d700 1 -- start start 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.695+0000 7f004b39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00440b03c0 0x7f00440cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.695+0000 7f004b39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.695+0000 7f004b39d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440cfa00 con 0x7f00441591e0 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.695+0000 7f004b39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00440cb580 con 0x7f00440b03c0 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.695+0000 7f004b39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440b2de0 con 0x7f00440b0790 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f004a39b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00440b03c0 0x7f00440cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f004ab9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f00441591e0 0x7f0044159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58734/0 (socket says 172.21.15.86:58734) 2023-10-09T13:16:36.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f004ab9c700 1 -- 172.21.15.86:0/2017104442 learned_addr learned my addr 172.21.15.86:0/2017104442 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:36.697 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f0049b9a700 1 --2- 172.21.15.86:0/2017104442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f0049399700 1 -- 172.21.15.86:0/2017104442 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497214146 0 0) 0x7f00440cfa00 con 0x7f00441591e0 2023-10-09T13:16:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f0049399700 1 -- 172.21.15.86:0/2017104442 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0030003570 con 0x7f00441591e0 2023-10-09T13:16:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f004a39b700 1 -- 172.21.15.86:0/2017104442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 msgr2=0x7f00440b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f004a39b700 1 --2- 172.21.15.86:0/2017104442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f004a39b700 1 -- 172.21.15.86:0/2017104442 >> v1:172.21.15.86:6789/0 conn(0x7f00441591e0 legacy=0x7f0044159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f004a39b700 1 -- 172.21.15.86:0/2017104442 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440cf160 con 0x7f00440b03c0 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.696+0000 7f0049b9a700 1 --2- 172.21.15.86:0/2017104442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.697+0000 7f004a39b700 1 --2- 172.21.15.86:0/2017104442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440cea70 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f00400098e0 tx=0x7f00400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de02fa3bb2fc63d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.697+0000 7f0049399700 1 -- 172.21.15.86:0/2017104442 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040011630 con 0x7f00440b03c0 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.697+0000 7f0049399700 1 -- 172.21.15.86:0/2017104442 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0040011790 con 0x7f00440b03c0 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.697+0000 7f0049399700 1 -- 172.21.15.86:0/2017104442 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040011b30 con 0x7f00440b03c0 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.697+0000 7f004b39d700 1 -- 172.21.15.86:0/2017104442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 msgr2=0x7f00440cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.697+0000 7f004b39d700 1 --2- 172.21.15.86:0/2017104442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440cea70 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f00400098e0 tx=0x7f00400091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.698+0000 7f004b39d700 1 -- 172.21.15.86:0/2017104442 shutdown_connections 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.698+0000 7f004b39d700 1 --2- 172.21.15.86:0/2017104442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440cea70 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.698+0000 7f004b39d700 1 --2- 172.21.15.86:0/2017104442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.698+0000 7f004b39d700 1 -- 172.21.15.86:0/2017104442 >> 172.21.15.86:0/2017104442 conn(0x7f0044063230 msgr2=0x7f0044063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.698+0000 7f004b39d700 1 -- 172.21.15.86:0/2017104442 shutdown_connections 2023-10-09T13:16:36.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.698+0000 7f004b39d700 1 -- 172.21.15.86:0/2017104442 wait complete. 2023-10-09T13:16:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.699+0000 7f004b39d700 1 Processor -- start 2023-10-09T13:16:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.699+0000 7f004b39d700 1 -- start start 2023-10-09T13:16:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004b39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004b39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004b39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00441591e0 0x7f00441526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004b39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00441571f0 con 0x7f00440b03c0 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004b39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044156620 con 0x7f00441591e0 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004b39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00441568c0 con 0x7f00440b0790 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004a39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004a39b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:53976/0 (socket says 172.21.15.86:53976) 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.700+0000 7f004a39b700 1 -- 172.21.15.86:0/3021046621 learned_addr learned my addr 172.21.15.86:0/3021046621 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004ab9c700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00441591e0 0x7f00441526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004a39b700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 msgr2=0x7f00440c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004a39b700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004a39b700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00441591e0 msgr2=0x7f00441526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004a39b700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00441591e0 0x7f00441526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004a39b700 1 -- 172.21.15.86:0/3021046621 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034009420 con 0x7f00440b03c0 2023-10-09T13:16:36.703 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004a39b700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440c7d20 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f00440cfe40 tx=0x7f0040017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040011900 con 0x7f00440b03c0 2023-10-09T13:16:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0040011a60 con 0x7f00440b03c0 2023-10-09T13:16:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.701+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040009420 con 0x7f00440b03c0 2023-10-09T13:16:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.702+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004001a680 con 0x7f00440b03c0 2023-10-09T13:16:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.702+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0044156e80 con 0x7f00440b03c0 2023-10-09T13:16:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.703+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004404c3c0 con 0x7f00440b03c0 2023-10-09T13:16:36.704 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.704+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 111) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f004001aa70 con 0x7f00440b03c0 2023-10-09T13:16:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.705+0000 7f003a7fc700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f0028069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.705+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6209+0+0 (secure 0 0 0) 0x7f0040086270 con 0x7f00440b03c0 2023-10-09T13:16:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.705+0000 7f0049b9a700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 msgr2=0x7f0028069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:36.705 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.705+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f0028069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:36.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.709+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00400532e0 con 0x7f00440b03c0 2023-10-09T13:16:36.777 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:36.777+0000 7f0de469d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:16:36.827 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:36.827+0000 7faa646c5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:16:36.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.906+0000 7f0049b9a700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 msgr2=0x7f0028069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:36.906 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.906+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f0028069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:36.934 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:36.934+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0044157330 con 0x7f0028066f80 2023-10-09T13:16:36.940 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:36.940+0000 7f0de469d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:36.996 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:36.996+0000 7faa646c5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:37.027 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:37.026+0000 7f0de469d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:16:37.082 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:37.082+0000 7faa646c5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:16:37.251 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:37.251+0000 7f0de469d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:37.305 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:37.305+0000 7faa646c5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:37.307+0000 7f0049b9a700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 msgr2=0x7f0028069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:37.307 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:37.307+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f0028069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T13:16:37.428 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:37.427+0000 7f0de469d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:16:37.482 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:37.482+0000 7faa646c5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:16:37.521 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:37.519+0000 7f0de469d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:16:37.574 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:37.574+0000 7faa646c5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:16:37.683 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:37.683+0000 7f0de469d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:16:37.735 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:37.735+0000 7faa646c5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:16:37.783 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:37.783+0000 7f0de469d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:37.836 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:37.836+0000 7faa646c5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:38.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:38.108+0000 7f0049b9a700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 msgr2=0x7f0028069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:38.108 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:38.108+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f0028069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-09T13:16:38.270 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:38.270+0000 7f0de469d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:16:38.324 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:38.324+0000 7faa646c5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:16:38.364 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:38.363+0000 7f0de469d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:16:38.418 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:38.417+0000 7faa646c5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:16:38.454 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:38.454+0000 7f0de469d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:16:38.510 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:38.508+0000 7faa646c5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:16:39.081 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:39.079+0000 7f0de469d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:16:39.135 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:39.135+0000 7faa646c5180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:16:39.253 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:39.252+0000 7f0de469d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:39.309 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:39.308+0000 7faa646c5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:39.349 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:39.348+0000 7f0de469d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:16:39.404 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:39.404+0000 7faa646c5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:16:39.644 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:39.643+0000 7f0de469d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:16:39.695 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:39.695+0000 7faa646c5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:16:39.709 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:39.709+0000 7f0049b9a700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 msgr2=0x7f0028069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:39.710 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:39.709+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f0028069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-09T13:16:39.740 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:39.739+0000 7f0de469d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:16:39.790 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:39.790+0000 7faa646c5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:16:40.442 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:40.442+0000 7f0de469d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:16:40.491 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:40.491+0000 7faa646c5180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:16:40.729 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:40.729+0000 7f0de469d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:16:40.776 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:40.776+0000 7faa646c5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:16:40.822 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:40.822+0000 7f0de469d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:16:40.870 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:40.870+0000 7faa646c5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:16:40.975 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:40.975+0000 7f0de469d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:16:41.025 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.025+0000 7faa646c5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:16:41.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:41.079+0000 7f0de469d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:16:41.129 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.129+0000 7faa646c5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:16:41.270 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:41.269+0000 7f0de469d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:16:41.321 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.320+0000 7faa646c5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:16:41.362 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:41.362+0000 7f0de469d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:16:41.414 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.414+0000 7faa646c5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:16:41.454 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:41.454+0000 7f0de469d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:16:41.507 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.507+0000 7faa646c5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:16:41.548 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:41.547+0000 7f0de469d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:16:41.602 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.602+0000 7faa646c5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:16:41.607 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:41.607+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 112) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f004001ad20 con 0x7f00440b03c0 2023-10-09T13:16:41.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:41.619+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mgrmap(e 113) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f00400697f0 con 0x7f00440b03c0 2023-10-09T13:16:41.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:41.619+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 msgr2=0x7f0028069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:41.620 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:41.619+0000 7f003a7fc700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f0028069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:41.738 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d61f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.738 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d61f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.738 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d61f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.738 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d61f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.738 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d61f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.739 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d91f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.739 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d91f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.739 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d91f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.739 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d91f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:41.739 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:41.738+0000 7fa9d91f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T13:16:42.628 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.628+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mon.0 v2:172.21.15.86:3300/0 9 ==== mgrmap(e 114) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0040053f80 con 0x7f00440b03c0 2023-10-09T13:16:42.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.628+0000 7f003a7fc700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f00280693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:42.629 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.628+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0028032aa0 con 0x7f0028066f80 2023-10-09T13:16:42.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.631+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f00280693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:42.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.634+0000 7f0049b9a700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f00280693b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f004415e030 tx=0x7f00340091a0 comp rx=0 tx=0).ready entity=mgr.10377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:42.698 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.698+0000 7f003a7fc700 1 -- 172.21.15.86:0/3021046621 <== mgr.10377 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0028032aa0 con 0x7f0028066f80 2023-10-09T13:16:42.698 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule set for path snap_test_dir1 2023-10-09T13:16:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 msgr2=0x7f00280693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f00280693b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f004415e030 tx=0x7f00340091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 msgr2=0x7f00440c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:42.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440c7d20 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f00440cfe40 tx=0x7f0040017000 comp rx=0 tx=0).stop 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 shutdown_connections 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0028066f80 0x7f00280693b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00440b03c0 0x7f00440c7d20 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00441591e0 0x7f00441526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 --2- 172.21.15.86:0/3021046621 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b0790 0x7f00440c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 >> 172.21.15.86:0/3021046621 conn(0x7f0044063230 msgr2=0x7f00440b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 shutdown_connections 2023-10-09T13:16:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.701+0000 7f004b39d700 1 -- 172.21.15.86:0/3021046621 wait complete. 2023-10-09T13:16:42.720 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-09T13:16:42.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-09T13:16:42.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.907+0000 7f3c13dff700 1 Processor -- start 2023-10-09T13:16:42.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.907+0000 7f3c13dff700 1 -- start start 2023-10-09T13:16:42.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.908+0000 7f3c13dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157630 0x7f3c0c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:42.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.908+0000 7f3c13dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c0c157a00 0x7f3c0c0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:42.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.908+0000 7f3c13dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c158590 con 0x7f3c0c0ac290 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.908+0000 7f3c13dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c157f80 con 0x7f3c0c157a00 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.908+0000 7f3c13dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0ac7a0 con 0x7f3c0c157630 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.908+0000 7f3c1139a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c0c157a00 0x7f3c0c0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c1139a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c0c157a00 0x7f3c0c0abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54094/0 (socket says 172.21.15.86:54094) 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c1139a700 1 -- 172.21.15.86:0/38476745 learned_addr learned my addr 172.21.15.86:0/38476745 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c11b9b700 1 --2- 172.21.15.86:0/38476745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157630 0x7f3c0c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c1139a700 1 -- 172.21.15.86:0/38476745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157630 msgr2=0x7f3c0c158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c1139a700 1 --2- 172.21.15.86:0/38476745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157630 0x7f3c0c158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c1139a700 1 -- 172.21.15.86:0/38476745 >> v1:172.21.15.135:6789/0 conn(0x7f3c0c0ac290 legacy=0x7f3c0c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:42.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c1139a700 1 -- 172.21.15.86:0/38476745 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c158220 con 0x7f3c0c157a00 2023-10-09T13:16:42.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c1139a700 1 --2- 172.21.15.86:0/38476745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157a00 0x7f3c0c0abd50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0099b0 tx=0x7f3bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f8be083728b5fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:42.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.909+0000 7f3c10b99700 1 -- 172.21.15.86:0/38476745 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc009ea0 con 0x7f3c0c157a00 2023-10-09T13:16:42.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c10b99700 1 -- 172.21.15.86:0/38476745 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc00b860 con 0x7f3c0c157a00 2023-10-09T13:16:42.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c10b99700 1 -- 172.21.15.86:0/38476745 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00bc00 con 0x7f3c0c157a00 2023-10-09T13:16:42.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 -- 172.21.15.86:0/38476745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157a00 msgr2=0x7f3c0c0abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:42.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 --2- 172.21.15.86:0/38476745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157a00 0x7f3c0c0abd50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0099b0 tx=0x7f3bfc009250 comp rx=0 tx=0).stop 2023-10-09T13:16:42.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 -- 172.21.15.86:0/38476745 shutdown_connections 2023-10-09T13:16:42.912 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 --2- 172.21.15.86:0/38476745 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157630 0x7f3c0c158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 --2- 172.21.15.86:0/38476745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157a00 0x7f3c0c0abd50 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 -- 172.21.15.86:0/38476745 >> 172.21.15.86:0/38476745 conn(0x7f3c0c0cc540 msgr2=0x7f3c0c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:42.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 -- 172.21.15.86:0/38476745 shutdown_connections 2023-10-09T13:16:42.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.910+0000 7f3c13dff700 1 -- 172.21.15.86:0/38476745 wait complete. 2023-10-09T13:16:42.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.912+0000 7f3c13dff700 1 Processor -- start 2023-10-09T13:16:42.913 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.912+0000 7f3c13dff700 1 -- start start 2023-10-09T13:16:42.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c13dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0c0ac290 0x7f3c0c0b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:42.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c13dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157630 0x7f3c0c1452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:42.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c13dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157a00 0x7f3c0c0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:42.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c13dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c7f40 con 0x7f3c0c157630 2023-10-09T13:16:42.915 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c13dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c7330 con 0x7f3c0c0ac290 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c13dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c7610 con 0x7f3c0c157a00 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157630 0x7f3c0c1452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157630 0x7f3c0c1452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54106/0 (socket says 172.21.15.86:54106) 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 -- 172.21.15.86:0/1555350743 learned_addr learned my addr 172.21.15.86:0/1555350743 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c11b9b700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0c0ac290 0x7f3c0c0b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1239c700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157a00 0x7f3c0c0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 -- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157a00 msgr2=0x7f3c0c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157a00 0x7f3c0c0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 -- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0c0ac290 msgr2=0x7f3c0c0b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0c0ac290 0x7f3c0c0b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:42.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.913+0000 7f3c1139a700 1 -- 172.21.15.86:0/1555350743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0094f0 con 0x7f3c0c157630 2023-10-09T13:16:42.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.914+0000 7f3c1139a700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157630 0x7f3c0c1452e0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c06a9e0 tx=0x7f3bfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:42.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.914+0000 7f3c01ffb700 1 -- 172.21.15.86:0/1555350743 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc000d10 con 0x7f3c0c157630 2023-10-09T13:16:42.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.914+0000 7f3c01ffb700 1 -- 172.21.15.86:0/1555350743 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc00bbe0 con 0x7f3c0c157630 2023-10-09T13:16:42.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.914+0000 7f3c01ffb700 1 -- 172.21.15.86:0/1555350743 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc011670 con 0x7f3c0c157630 2023-10-09T13:16:42.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.914+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c0c78f0 con 0x7f3c0c157630 2023-10-09T13:16:42.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.914+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c0c7020 con 0x7f3c0c157630 2023-10-09T13:16:42.917 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.915+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c0c80b0 con 0x7f3c0c157630 2023-10-09T13:16:42.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.916+0000 7f3c01ffb700 1 -- 172.21.15.86:0/1555350743 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 114) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f3bfc011aa0 con 0x7f3c0c157630 2023-10-09T13:16:42.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.917+0000 7f3c01ffb700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3bf0066dd0 0x7f3bf0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:42.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.917+0000 7f3c01ffb700 1 -- 172.21.15.86:0/1555350743 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f3bfc085d00 con 0x7f3c0c157630 2023-10-09T13:16:42.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.917+0000 7f3c11b9b700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3bf0066dd0 0x7f3bf0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:42.918 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.917+0000 7f3c11b9b700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3bf0066dd0 0x7f3bf0069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009db0 tx=0x7f3c080091a0 comp rx=0 tx=0).ready entity=mgr.10377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:42.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:42.921+0000 7f3c01ffb700 1 -- 172.21.15.86:0/1555350743 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bfc052f20 con 0x7f3c0c157630 2023-10-09T13:16:43.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.134+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c0c0718b0 con 0x7f3bf0066dd0 2023-10-09T13:16:43.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.188+0000 7f3c01ffb700 1 -- 172.21.15.86:0/1555350743 <== mgr.10377 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f3c0c0718b0 con 0x7f3bf0066dd0 2023-10-09T13:16:43.189 INFO:teuthology.orchestra.run.smithi086.stdout:Retention added to path snap_test_dir1 2023-10-09T13:16:43.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3bf0066dd0 msgr2=0x7f3bf0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3bf0066dd0 0x7f3bf0069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009db0 tx=0x7f3c080091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157630 msgr2=0x7f3c0c1452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157630 0x7f3c0c1452e0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c06a9e0 tx=0x7f3bfc017000 comp rx=0 tx=0).stop 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 shutdown_connections 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f3bf0066dd0 0x7f3bf0069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3c0c157a00 0x7f3c0c0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0c0ac290 0x7f3c0c0b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 --2- 172.21.15.86:0/1555350743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c0c157630 0x7f3c0c1452e0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 >> 172.21.15.86:0/1555350743 conn(0x7f3c0c0cc540 msgr2=0x7f3c0c0cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 shutdown_connections 2023-10-09T13:16:43.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.191+0000 7f3c13dff700 1 -- 172.21.15.86:0/1555350743 wait complete. 2023-10-09T13:16:43.208 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-09T13:16:43.213 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-09-13_17_00 in ~17s... 2023-10-09T13:16:43.213 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-09T13:16:43.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-09T13:16:43.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.399+0000 7f168f1ff700 1 Processor -- start 2023-10-09T13:16:43.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.399+0000 7f168f1ff700 1 -- start start 2023-10-09T13:16:43.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.400+0000 7f168f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1688159ec0 0x7f16880b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.400+0000 7f168f1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880b5b00 con 0x7f16880b53d0 2023-10-09T13:16:43.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.400+0000 7f168f1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880b5da0 con 0x7f16880cf350 2023-10-09T13:16:43.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.400+0000 7f168f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16880b6080 con 0x7f1688159ec0 2023-10-09T13:16:43.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f1687fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f16880b53d0 0x7f16880cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58746/0 (socket says 172.21.15.86:58746) 2023-10-09T13:16:43.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f1687fff700 1 -- 172.21.15.86:0/3413645196 learned_addr learned my addr 172.21.15.86:0/3413645196 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:43.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f168cf9b700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1688159ec0 0x7f16880b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.410 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403603844 0 0) 0x7f16880b5b00 con 0x7f16880b53d0 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1678003570 con 0x7f16880b53d0 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355401035 0 0) 0x7f16880b5da0 con 0x7f16880cf350 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16880b5b00 con 0x7f16880cf350 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2975111862 0 0) 0x7f1678003570 con 0x7f16880b53d0 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1688159ec0 msgr2=0x7f16880b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1688159ec0 0x7f16880b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 >> v1:172.21.15.135:6789/0 conn(0x7f16880cf350 legacy=0x7f16880cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880cc100 con 0x7f16880b53d0 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.401+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f1674001470 con 0x7f16880b53d0 2023-10-09T13:16:43.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 >> v1:172.21.15.86:6789/0 conn(0x7f16880b53d0 legacy=0x7f16880cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f16877fe700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1678003c20 0x7f1678004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f16877fe700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1678004810 0x7f1678004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f16877fe700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16780051c0 0x7f167800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16880b6080 con 0x7f1678003c20 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167800c020 con 0x7f1678004810 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167800c1e0 con 0x7f16780051c0 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168cf9b700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1688159ec0 0x7f16880b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168cf9b700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1678003c20 0x7f1678004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f1687fff700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1678004810 0x7f1678004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168d79c700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16780051c0 0x7f167800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.412 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168cf9b700 1 -- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16780051c0 msgr2=0x7f167800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168cf9b700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16780051c0 0x7f167800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168cf9b700 1 -- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1678004810 msgr2=0x7f1678004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168cf9b700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1678004810 0x7f1678004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.402+0000 7f168cf9b700 1 -- 172.21.15.86:0/3413645196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678003570 con 0x7f1678003c20 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168cf9b700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1678003c20 0x7f1678004010 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f16880ce2f0 tx=0x7f167c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c02481743a2c63 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c00e710 con 0x7f1678003c20 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c00e870 con 0x7f1678003c20 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f16877fe700 1 -- 172.21.15.86:0/3413645196 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c00ec10 con 0x7f1678003c20 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168f1ff700 1 -- 172.21.15.86:0/3413645196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1678003c20 msgr2=0x7f1678004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168f1ff700 1 --2- 172.21.15.86:0/3413645196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1678003c20 0x7f1678004010 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f16880ce2f0 tx=0x7f167c009120 comp rx=0 tx=0).stop 2023-10-09T13:16:43.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168d79c700 1 -- 172.21.15.86:0/3413645196 reap_dead start 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168f1ff700 1 -- 172.21.15.86:0/3413645196 shutdown_connections 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168f1ff700 1 -- 172.21.15.86:0/3413645196 >> 172.21.15.86:0/3413645196 conn(0x7f16880999f0 msgr2=0x7f16880b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168f1ff700 1 -- 172.21.15.86:0/3413645196 shutdown_connections 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.403+0000 7f168f1ff700 1 -- 172.21.15.86:0/3413645196 wait complete. 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.405+0000 7f168f1ff700 1 Processor -- start 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.405+0000 7f168f1ff700 1 -- start start 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1678003c20 0x7f168809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168809ac80 0x7f16881571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168f1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1688157710 0x7f168806a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168f1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1688069f70 con 0x7f1688157710 2023-10-09T13:16:43.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1688069360 con 0x7f168809ac80 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1688069640 con 0x7f1678003c20 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1688157710 0x7f168806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1688157710 0x7f168806a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54132/0 (socket says 172.21.15.86:54132) 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 -- 172.21.15.86:0/2685579832 learned_addr learned my addr 172.21.15.86:0/2685579832 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168cf9b700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1678003c20 0x7f168809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f1687fff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168809ac80 0x7f16881571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 -- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1678003c20 msgr2=0x7f168809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1678003c20 0x7f168809ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 -- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168809ac80 msgr2=0x7f16881571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168809ac80 0x7f16881571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168d79c700 1 -- 172.21.15.86:0/2685579832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688069920 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f1687fff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168809ac80 0x7f16881571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.406+0000 7f168cf9b700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1678003c20 0x7f168809ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.407+0000 7f168d79c700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1688157710 0x7f168806a400 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f16880b31f0 tx=0x7f16800017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.407+0000 7f1684ff9700 1 -- 172.21.15.86:0/2685579832 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168000c820 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.407+0000 7f1684ff9700 1 -- 172.21.15.86:0/2685579832 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168000c980 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.407+0000 7f1684ff9700 1 -- 172.21.15.86:0/2685579832 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168000cd40 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.407+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1688069c00 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.407+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168806a940 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.408+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16880c9fd0 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.409+0000 7f1684ff9700 1 -- 172.21.15.86:0/2685579832 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 114) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f1680014690 con 0x7f1688157710 2023-10-09T13:16:43.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.410+0000 7f1684ff9700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f166c066dd0 0x7f166c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.410+0000 7f1684ff9700 1 -- 172.21.15.86:0/2685579832 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f16800848f0 con 0x7f1688157710 2023-10-09T13:16:43.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.410+0000 7f168cf9b700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f166c066dd0 0x7f166c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.410+0000 7f168cf9b700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f166c066dd0 0x7f166c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f167c009570 tx=0x7f167c019000 comp rx=0 tx=0).ready entity=mgr.10377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:43.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.414+0000 7f1684ff9700 1 -- 172.21.15.86:0/2685579832 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1680051b10 con 0x7f1688157710 2023-10-09T13:16:43.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.631+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f168809c1e0 con 0x7f166c066dd0 2023-10-09T13:16:43.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.639+0000 7f1684ff9700 1 -- 172.21.15.86:0/2685579832 <== mgr.10377 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f167c024040 con 0x7f166c066dd0 2023-10-09T13:16:43.640 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:43.640 INFO:teuthology.orchestra.run.smithi086.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T13:16:43.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f166c066dd0 msgr2=0x7f166c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f166c066dd0 0x7f166c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f167c009570 tx=0x7f167c019000 comp rx=0 tx=0).stop 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1688157710 msgr2=0x7f168806a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1688157710 0x7f168806a400 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f16880b31f0 tx=0x7f16800017a0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 shutdown_connections 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f166c066dd0 0x7f166c069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1688157710 0x7f168806a400 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1678003c20 0x7f168809ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 --2- 172.21.15.86:0/2685579832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f168809ac80 0x7f16881571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 >> 172.21.15.86:0/2685579832 conn(0x7f16880999f0 msgr2=0x7f16880c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 shutdown_connections 2023-10-09T13:16:43.643 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.642+0000 7f168f1ff700 1 -- 172.21.15.86:0/2685579832 wait complete. 2023-10-09T13:16:43.660 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-09T13:16:43.660 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-09T13:16:43.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-09T13:16:43.845 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.845+0000 7f0d8c7ff700 1 Processor -- start 2023-10-09T13:16:43.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.845+0000 7f0d8c7ff700 1 -- start start 2023-10-09T13:16:43.846 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.846+0000 7f0d8c7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0d840c8490 0x7f0d840c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.846+0000 7f0d8c7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d841569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.846+0000 7f0d8c7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840ac030 con 0x7f0d84069a50 2023-10-09T13:16:43.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.846+0000 7f0d8c7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840ab820 con 0x7f0d840c8490 2023-10-09T13:16:43.847 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.846+0000 7f0d8c7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8406dbb0 con 0x7f0d84069e20 2023-10-09T13:16:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d8ad9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d841569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d8ad9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d841569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:48630/0 (socket says 172.21.15.86:48630) 2023-10-09T13:16:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d8ad9c700 1 -- 172.21.15.86:0/2337438542 learned_addr learned my addr 172.21.15.86:0/2337438542 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d89d9a700 1 --2- 172.21.15.86:0/2337438542 >> v2:172.21.15.135:3300/0 conn(0x7f0d840c8490 0x7f0d840c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d89d9a700 1 -- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 msgr2=0x7f0d841569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d89d9a700 1 --2- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d841569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.849 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d89d9a700 1 -- 172.21.15.86:0/2337438542 >> v1:172.21.15.135:6789/0 conn(0x7f0d84069a50 legacy=0x7f0d8415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d89d9a700 1 -- 172.21.15.86:0/2337438542 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d840aba70 con 0x7f0d840c8490 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.847+0000 7f0d8ad9c700 1 --2- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d841569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d89d9a700 1 --2- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d840c8490 0x7f0d840c6ac0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0d740098e0 tx=0x7f0d740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfbb6bcd945b0988 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d89599700 1 -- 172.21.15.86:0/2337438542 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400b640 con 0x7f0d840c8490 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d89599700 1 -- 172.21.15.86:0/2337438542 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7400b7a0 con 0x7f0d840c8490 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d89599700 1 -- 172.21.15.86:0/2337438542 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400bb40 con 0x7f0d840c8490 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d840c8490 msgr2=0x7f0d840c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d840c8490 0x7f0d840c6ac0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0d740098e0 tx=0x7f0d740091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2337438542 shutdown_connections 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d841569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.850 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2337438542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d840c8490 0x7f0d840c6ac0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.848+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2337438542 >> 172.21.15.86:0/2337438542 conn(0x7f0d840c8f90 msgr2=0x7f0d840c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.849+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2337438542 shutdown_connections 2023-10-09T13:16:43.851 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.849+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2337438542 wait complete. 2023-10-09T13:16:43.852 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.850+0000 7f0d8c7ff700 1 Processor -- start 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.850+0000 7f0d8c7ff700 1 -- start start 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8c7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d84069a50 0x7f0d84169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8c7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d840af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8c7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d840c8490 0x7f0d840af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8c7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84154dd0 con 0x7f0d840c8490 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8c7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84158d50 con 0x7f0d84069a50 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8c7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840c0b00 con 0x7f0d84069e20 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8ad9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d840c8490 0x7f0d840af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8ad9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d840c8490 0x7f0d840af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54134/0 (socket says 172.21.15.86:54134) 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8ad9c700 1 -- 172.21.15.86:0/2373757076 learned_addr learned my addr 172.21.15.86:0/2373757076 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:43.853 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d89d9a700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d840af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.851+0000 7f0d8a59b700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d84069a50 0x7f0d84169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8ad9c700 1 -- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 msgr2=0x7f0d840af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8ad9c700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d840af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8ad9c700 1 -- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d84069a50 msgr2=0x7f0d84169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8ad9c700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d84069a50 0x7f0d84169ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8ad9c700 1 -- 172.21.15.86:0/2373757076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c009ae0 con 0x7f0d840c8490 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8ad9c700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d840c8490 0x7f0d840af810 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009fd0 tx=0x7f0d7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d7a7fc700 1 -- 172.21.15.86:0/2373757076 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c018070 con 0x7f0d840c8490 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d7a7fc700 1 -- 172.21.15.86:0/2373757076 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00f040 con 0x7f0d840c8490 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d74009420 con 0x7f0d840c8490 2023-10-09T13:16:43.854 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d7a7fc700 1 -- 172.21.15.86:0/2373757076 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00cbf0 con 0x7f0d840c8490 2023-10-09T13:16:43.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.852+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d840c10c0 con 0x7f0d840c8490 2023-10-09T13:16:43.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.853+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d840c0960 con 0x7f0d840c8490 2023-10-09T13:16:43.855 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.854+0000 7f0d7a7fc700 1 -- 172.21.15.86:0/2373757076 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 114) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0d7c003020 con 0x7f0d840c8490 2023-10-09T13:16:43.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.855+0000 7f0d7a7fc700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0d68066dd0 0x7f0d68069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:43.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.855+0000 7f0d7a7fc700 1 -- 172.21.15.86:0/2373757076 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f0d7c084440 con 0x7f0d840c8490 2023-10-09T13:16:43.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.855+0000 7f0d8a59b700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0d68066dd0 0x7f0d68069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:43.856 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.856+0000 7f0d8a59b700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0d68066dd0 0x7f0d68069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d800039e0 tx=0x7f0d80007ec0 comp rx=0 tx=0).ready entity=mgr.10377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:43.859 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:43.859+0000 7f0d7a7fc700 1 -- 172.21.15.86:0/2373757076 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d7c04d5a0 con 0x7f0d840c8490 2023-10-09T13:16:44.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.073+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d840ae6e0 con 0x7f0d68066dd0 2023-10-09T13:16:44.136 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.136+0000 7f0d7a7fc700 1 -- 172.21.15.86:0/2373757076 <== mgr.10377 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0d840ae6e0 con 0x7f0d68066dd0 2023-10-09T13:16:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:Schedule removed for path snap_test_dir1 2023-10-09T13:16:44.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0d68066dd0 msgr2=0x7f0d68069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0d68066dd0 0x7f0d68069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d800039e0 tx=0x7f0d80007ec0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d840c8490 msgr2=0x7f0d840af810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d840c8490 0x7f0d840af810 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009fd0 tx=0x7f0d7c00b040 comp rx=0 tx=0).stop 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 shutdown_connections 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0d68066dd0 0x7f0d68069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d840c8490 0x7f0d840af810 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d84069a50 0x7f0d84169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 --2- 172.21.15.86:0/2373757076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d84069e20 0x7f0d840af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 >> 172.21.15.86:0/2373757076 conn(0x7f0d840c8f90 msgr2=0x7f0d840a9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 shutdown_connections 2023-10-09T13:16:44.140 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.139+0000 7f0d8c7ff700 1 -- 172.21.15.86:0/2373757076 wait complete. 2023-10-09T13:16:44.157 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-09T13:16:44.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:44.157 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-09T13:16:44.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:44.195 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-09T13:16:44.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-09T13:16:44.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.501+0000 7f9b8b1ff700 1 Processor -- start 2023-10-09T13:16:44.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.501+0000 7f9b8b1ff700 1 -- start start 2023-10-09T13:16:44.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.502+0000 7f9b8b1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b84155eb0 0x7f9b8406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:44.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.502+0000 7f9b8b1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b840c70b0 0x7f9b84069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:44.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.502+0000 7f9b8b1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9b84069cb0 0x7f9b84159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:44.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.502+0000 7f9b8b1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8406a130 con 0x7f9b840c70b0 2023-10-09T13:16:44.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.502+0000 7f9b8b1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8406eb90 con 0x7f9b84069cb0 2023-10-09T13:16:44.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.502+0000 7f9b8b1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8406ee70 con 0x7f9b84155eb0 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b840c70b0 0x7f9b84069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b840c70b0 0x7f9b84069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54150/0 (socket says 172.21.15.86:54150) 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 -- 172.21.15.86:0/16487906 learned_addr learned my addr 172.21.15.86:0/16487906 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b88f9b700 1 --2- 172.21.15.86:0/16487906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b84155eb0 0x7f9b8406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b8979c700 1 --2- 172.21.15.86:0/16487906 >> v2:172.21.15.135:3300/0 conn(0x7f9b84069cb0 0x7f9b84159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 -- 172.21.15.86:0/16487906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b84155eb0 msgr2=0x7f9b8406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 --2- 172.21.15.86:0/16487906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b84155eb0 0x7f9b8406e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 -- 172.21.15.86:0/16487906 >> v2:172.21.15.135:3300/0 conn(0x7f9b84069cb0 msgr2=0x7f9b84159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 --2- 172.21.15.86:0/16487906 >> v2:172.21.15.135:3300/0 conn(0x7f9b84069cb0 0x7f9b84159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 -- 172.21.15.86:0/16487906 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8406f150 con 0x7f9b840c70b0 2023-10-09T13:16:44.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b8979c700 1 --2- 172.21.15.86:0/16487906 >> v2:172.21.15.135:3300/0 conn(0x7f9b84069cb0 0x7f9b84159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:44.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b88f9b700 1 --2- 172.21.15.86:0/16487906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b84155eb0 0x7f9b8406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:44.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.503+0000 7f9b7bfff700 1 --2- 172.21.15.86:0/16487906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b840c70b0 0x7f9b84069770 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f9b840c7740 tx=0x7f9b74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9520c1a45e918b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:44.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b7b7fe700 1 -- 172.21.15.86:0/16487906 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400b860 con 0x7f9b840c70b0 2023-10-09T13:16:44.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b7b7fe700 1 -- 172.21.15.86:0/16487906 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400b9c0 con 0x7f9b840c70b0 2023-10-09T13:16:44.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b7b7fe700 1 -- 172.21.15.86:0/16487906 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400bd60 con 0x7f9b840c70b0 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/16487906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b840c70b0 msgr2=0x7f9b84069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/16487906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b840c70b0 0x7f9b84069770 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f9b840c7740 tx=0x7f9b74009250 comp rx=0 tx=0).stop 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/16487906 shutdown_connections 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/16487906 >> v2:172.21.15.135:3300/0 conn(0x7f9b84069cb0 0x7f9b84159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/16487906 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b84155eb0 0x7f9b8406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/16487906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b840c70b0 0x7f9b84069770 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/16487906 >> 172.21.15.86:0/16487906 conn(0x7f9b84068e10 msgr2=0x7f9b840cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:44.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/16487906 shutdown_connections 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.504+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/16487906 wait complete. 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.506+0000 7f9b8b1ff700 1 Processor -- start 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.506+0000 7f9b8b1ff700 1 -- start start 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84069cb0 0x7f9b8416b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8b1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840c70b0 0x7f9b840c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8b1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155eb0 0x7f9b84151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8b1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8416d480 con 0x7f9b84155eb0 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840af2d0 con 0x7f9b84069cb0 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8b1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840b1cb0 con 0x7f9b840c70b0 2023-10-09T13:16:44.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155eb0 0x7f9b84151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8979c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155eb0 0x7f9b84151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:54166/0 (socket says 172.21.15.86:54166) 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.507+0000 7f9b8979c700 1 -- 172.21.15.86:0/3800715568 learned_addr learned my addr 172.21.15.86:0/3800715568 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b88f9b700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84069cb0 0x7f9b8416b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b7bfff700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840c70b0 0x7f9b840c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8979c700 1 -- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840c70b0 msgr2=0x7f9b840c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8979c700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840c70b0 0x7f9b840c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8979c700 1 -- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84069cb0 msgr2=0x7f9b8416b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8979c700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84069cb0 0x7f9b8416b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8979c700 1 -- 172.21.15.86:0/3800715568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740094f0 con 0x7f9b84155eb0 2023-10-09T13:16:44.511 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8979c700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155eb0 0x7f9b84151a20 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00cf60 tx=0x7f9b7c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:44.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c015440 con 0x7f9b84155eb0 2023-10-09T13:16:44.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c0155a0 con 0x7f9b84155eb0 2023-10-09T13:16:44.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c015960 con 0x7f9b84155eb0 2023-10-09T13:16:44.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b840af4e0 con 0x7f9b84155eb0 2023-10-09T13:16:44.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.508+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840afaa0 con 0x7f9b84155eb0 2023-10-09T13:16:44.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.509+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8404c3c0 con 0x7f9b84155eb0 2023-10-09T13:16:44.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.510+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 115) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f9b7c015d50 con 0x7f9b84155eb0 2023-10-09T13:16:44.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.511+0000 7f9b78ff9700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b70067130 0x7f9b700695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:44.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.511+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f9b7c0855b0 con 0x7f9b84155eb0 2023-10-09T13:16:44.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.511+0000 7f9b88f9b700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b70067130 0x7f9b700695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:44.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.512+0000 7f9b88f9b700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b70067130 0x7f9b700695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006fd0 tx=0x7f9b80008040 comp rx=0 tx=0).ready entity=mgr.10377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:44.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.515+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b7c0522a0 con 0x7f9b84155eb0 2023-10-09T13:16:44.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:44.763+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f9b8406f430 con 0x7f9b84155eb0 2023-10-09T13:16:45.636 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.636+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9b7c052670 con 0x7f9b84155eb0 2023-10-09T13:16:45.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.637+0000 7f9b78ff9700 1 -- 172.21.15.86:0/3800715568 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v116) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9b7c0522a0 con 0x7f9b84155eb0 2023-10-09T13:16:45.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b70067130 msgr2=0x7f9b700695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:45.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b70067130 0x7f9b700695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006fd0 tx=0x7f9b80008040 comp rx=0 tx=0).stop 2023-10-09T13:16:45.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155eb0 msgr2=0x7f9b84151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:45.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155eb0 0x7f9b84151a20 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00cf60 tx=0x7f9b7c007870 comp rx=0 tx=0).stop 2023-10-09T13:16:45.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 shutdown_connections 2023-10-09T13:16:45.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9b70067130 0x7f9b700695e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:45.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b84155eb0 0x7f9b84151a20 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:45.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84069cb0 0x7f9b8416b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:45.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 --2- 172.21.15.86:0/3800715568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b840c70b0 0x7f9b840c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:45.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 >> 172.21.15.86:0/3800715568 conn(0x7f9b84068e10 msgr2=0x7f9b840c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:45.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 shutdown_connections 2023-10-09T13:16:45.642 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:45.640+0000 7f9b8b1ff700 1 -- 172.21.15.86:0/3800715568 wait complete. 2023-10-09T13:16:45.663 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T13:16:45.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:16:45.745 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T13:16:45.829 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T13:16:45.829 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T13:16:45.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T13:16:45.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T13:16:45.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:16:45.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:45.916 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T13:16:45.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:46.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.186+0000 7f44c8d9d700 1 Processor -- start 2023-10-09T13:16:46.188 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.187+0000 7f44c8d9d700 1 -- start start 2023-10-09T13:16:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c8d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44c4159420 0x7f44c40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c8d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f44c41597f0 0x7f44c40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.191 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c8d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c40b11d0 con 0x7f44c415d230 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c8d9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c40b14b0 con 0x7f44c4159420 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c8d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c40b1790 con 0x7f44c41597f0 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44c4159420 0x7f44c40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c3fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f44c415d230 0x7f44c415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33580/0 (socket says 172.21.15.86:33580) 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c3fff700 1 -- 172.21.15.86:0/2650168671 learned_addr learned my addr 172.21.15.86:0/2650168671 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.189+0000 7f44c2ffd700 1 --2- 172.21.15.86:0/2650168671 >> v2:172.21.15.135:3300/0 conn(0x7f44c41597f0 0x7f44c40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c37fe700 1 -- 172.21.15.86:0/2650168671 >> v2:172.21.15.135:3300/0 conn(0x7f44c41597f0 msgr2=0x7f44c40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c37fe700 1 --2- 172.21.15.86:0/2650168671 >> v2:172.21.15.135:3300/0 conn(0x7f44c41597f0 0x7f44c40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.192 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c37fe700 1 -- 172.21.15.86:0/2650168671 >> v1:172.21.15.86:6789/0 conn(0x7f44c415d230 legacy=0x7f44c415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c37fe700 1 -- 172.21.15.86:0/2650168671 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40b1a70 con 0x7f44c4159420 2023-10-09T13:16:46.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c27fc700 1 -- 172.21.15.86:0/2650168671 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803816344 0 0) 0x7f44c40b11d0 con 0x7f44c415d230 2023-10-09T13:16:46.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c37fe700 1 --2- 172.21.15.86:0/2650168671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c4159420 0x7f44c40b5f40 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f44c4089750 tx=0x7f44b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb037fcaf96b3269 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:46.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c27fc700 1 -- 172.21.15.86:0/2650168671 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011630 con 0x7f44c4159420 2023-10-09T13:16:46.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c27fc700 1 -- 172.21.15.86:0/2650168671 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4011790 con 0x7f44c4159420 2023-10-09T13:16:46.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.190+0000 7f44c27fc700 1 -- 172.21.15.86:0/2650168671 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011b30 con 0x7f44c4159420 2023-10-09T13:16:46.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2650168671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c4159420 msgr2=0x7f44c40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2650168671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c4159420 0x7f44c40b5f40 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f44c4089750 tx=0x7f44b40091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2650168671 shutdown_connections 2023-10-09T13:16:46.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2650168671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c4159420 0x7f44c40b5f40 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2650168671 >> v2:172.21.15.135:3300/0 conn(0x7f44c41597f0 0x7f44c40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2650168671 >> 172.21.15.86:0/2650168671 conn(0x7f44c40d0660 msgr2=0x7f44c40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:46.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2650168671 shutdown_connections 2023-10-09T13:16:46.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.191+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2650168671 wait complete. 2023-10-09T13:16:46.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.193+0000 7f44c8d9d700 1 Processor -- start 2023-10-09T13:16:46.195 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.193+0000 7f44c8d9d700 1 -- start start 2023-10-09T13:16:46.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.194+0000 7f44c8d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4159420 0x7f44c416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.194+0000 7f44c8d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c41597f0 0x7f44c4155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.194+0000 7f44c8d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c415d230 0x7f44c40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.194+0000 7f44c8d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4169c10 con 0x7f44c41597f0 2023-10-09T13:16:46.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.194+0000 7f44c8d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c415b8b0 con 0x7f44c415d230 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.194+0000 7f44c8d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4169620 con 0x7f44c4159420 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.194+0000 7f44c2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c41597f0 0x7f44c4155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c41597f0 0x7f44c4155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39312/0 (socket says 172.21.15.86:39312) 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 -- 172.21.15.86:0/2011677894 learned_addr learned my addr 172.21.15.86:0/2011677894 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c37fe700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4159420 0x7f44c416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c3fff700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c415d230 0x7f44c40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 -- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4159420 msgr2=0x7f44c416a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4159420 0x7f44c416a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.198 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 -- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c415d230 msgr2=0x7f44c40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c415d230 0x7f44c40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 -- 172.21.15.86:0/2011677894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4009420 con 0x7f44c41597f0 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44c2ffd700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c41597f0 0x7f44c4155eb0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f44b800ec50 tx=0x7f44b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44ab7fe700 1 -- 172.21.15.86:0/2011677894 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8009690 con 0x7f44c41597f0 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44ab7fe700 1 -- 172.21.15.86:0/2011677894 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b800c850 con 0x7f44c41597f0 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.195+0000 7f44ab7fe700 1 -- 172.21.15.86:0/2011677894 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800cc10 con 0x7f44c41597f0 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.196+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c40cc010 con 0x7f44c41597f0 2023-10-09T13:16:46.199 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.196+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c415b2f0 con 0x7f44c41597f0 2023-10-09T13:16:46.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.197+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c4169d50 con 0x7f44c41597f0 2023-10-09T13:16:46.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.198+0000 7f44ab7fe700 1 -- 172.21.15.86:0/2011677894 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f44b8013470 con 0x7f44c41597f0 2023-10-09T13:16:46.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.198+0000 7f44ab7fe700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 0x7f44b0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.200 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.199+0000 7f44ab7fe700 1 -- 172.21.15.86:0/2011677894 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f44b8084ca0 con 0x7f44c41597f0 2023-10-09T13:16:46.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.199+0000 7f44c37fe700 1 -- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 msgr2=0x7f44b0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:46.201 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.199+0000 7f44c37fe700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 0x7f44b0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:46.203 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.202+0000 7f44ab7fe700 1 -- 172.21.15.86:0/2011677894 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44c4169d50 con 0x7f44c41597f0 2023-10-09T13:16:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.400+0000 7f44c37fe700 1 -- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 msgr2=0x7f44b0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:46.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.400+0000 7f44c37fe700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 0x7f44b0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:46.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.446+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44c4169d50 con 0x7f44c41597f0 2023-10-09T13:16:46.448 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.447+0000 7f44ab7fe700 1 -- 172.21.15.86:0/2011677894 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f44c4169d50 con 0x7f44c41597f0 2023-10-09T13:16:46.448 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4046429451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4046429451},{"type":"v1","addr":"172.21.15.135:6834","nonce":4046429451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1310718495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1310718495},{"type":"v1","addr":"172.21.15.135:6835","nonce":1310718495}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3009333325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3009333325},{"type":"v1","addr":"172.21.15.86:6833","nonce":3009333325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:16:21.427143+0000","modified":"2023-10-09T13:16:24.986894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/903379396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":903379396},{"type":"v1","addr":"172.21.15.86:6835","nonce":903379396}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T13:16:46.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 msgr2=0x7f44b0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:46.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 0x7f44b0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c41597f0 msgr2=0x7f44c4155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c41597f0 0x7f44c4155eb0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f44b800ec50 tx=0x7f44b80091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 shutdown_connections 2023-10-09T13:16:46.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f44b00670e0 0x7f44b0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c415d230 0x7f44c40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4159420 0x7f44c416a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 --2- 172.21.15.86:0/2011677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c41597f0 0x7f44c4155eb0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 >> 172.21.15.86:0/2011677894 conn(0x7f44c40d0660 msgr2=0x7f44c4068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:46.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.449+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 shutdown_connections 2023-10-09T13:16:46.452 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.450+0000 7f44c8d9d700 1 -- 172.21.15.86:0/2011677894 wait complete. 2023-10-09T13:16:46.452 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 94 2023-10-09T13:16:46.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:46.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.656+0000 7f055ffff700 1 Processor -- start 2023-10-09T13:16:46.657 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.656+0000 7f055ffff700 1 -- start start 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.657+0000 7f055ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05601597f0 0x7f05600b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f056015d230 0x7f056015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056015dbd0 con 0x7f0560159420 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055ffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05600b11d0 con 0x7f056015d230 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05600b14b0 con 0x7f05601597f0 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f056015d230 0x7f056015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f056015d230 0x7f056015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39318/0 (socket says 172.21.15.86:39318) 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055f7fe700 1 -- 172.21.15.86:0/1203162131 learned_addr learned my addr 172.21.15.86:0/1203162131 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:46.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055e7fc700 1 --2- 172.21.15.86:0/1203162131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05601597f0 0x7f05600b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055f7fe700 1 -- 172.21.15.86:0/1203162131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05601597f0 msgr2=0x7f05600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:46.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055f7fe700 1 --2- 172.21.15.86:0/1203162131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05601597f0 0x7f05600b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055f7fe700 1 -- 172.21.15.86:0/1203162131 >> v1:172.21.15.135:6789/0 conn(0x7f0560159420 legacy=0x7f05600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055f7fe700 1 -- 172.21.15.86:0/1203162131 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600b1790 con 0x7f056015d230 2023-10-09T13:16:46.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.658+0000 7f055dffb700 1 -- 172.21.15.86:0/1203162131 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212293474 0 0) 0x7f0550001110 con 0x7f0560159420 2023-10-09T13:16:46.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.659+0000 7f055f7fe700 1 --2- 172.21.15.86:0/1203162131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056015d230 0x7f056015d690 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f0558009f20 tx=0x7f0558009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ce0f7ead7f7f23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:46.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.659+0000 7f055dffb700 1 -- 172.21.15.86:0/1203162131 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800e070 con 0x7f056015d230 2023-10-09T13:16:46.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.659+0000 7f055dffb700 1 -- 172.21.15.86:0/1203162131 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800b9d0 con 0x7f056015d230 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.659+0000 7f055dffb700 1 -- 172.21.15.86:0/1203162131 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580092e0 con 0x7f056015d230 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.659+0000 7f055ffff700 1 -- 172.21.15.86:0/1203162131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056015d230 msgr2=0x7f056015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.659+0000 7f055ffff700 1 --2- 172.21.15.86:0/1203162131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056015d230 0x7f056015d690 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f0558009f20 tx=0x7f0558009840 comp rx=0 tx=0).stop 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.660+0000 7f055ffff700 1 -- 172.21.15.86:0/1203162131 shutdown_connections 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.660+0000 7f055ffff700 1 --2- 172.21.15.86:0/1203162131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056015d230 0x7f056015d690 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.660+0000 7f055ffff700 1 --2- 172.21.15.86:0/1203162131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05601597f0 0x7f05600b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.660+0000 7f055ffff700 1 -- 172.21.15.86:0/1203162131 >> 172.21.15.86:0/1203162131 conn(0x7f05600d0660 msgr2=0x7f05600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.660+0000 7f055ffff700 1 -- 172.21.15.86:0/1203162131 shutdown_connections 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.660+0000 7f055ffff700 1 -- 172.21.15.86:0/1203162131 wait complete. 2023-10-09T13:16:46.663 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.661+0000 7f055ffff700 1 Processor -- start 2023-10-09T13:16:46.664 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.661+0000 7f055ffff700 1 -- start start 2023-10-09T13:16:46.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0560159420 0x7f05600c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05601597f0 0x7f056015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f056015d230 0x7f0560154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0560169cc0 con 0x7f05601597f0 2023-10-09T13:16:46.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056015c040 con 0x7f056015d230 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056015c320 con 0x7f0560159420 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05601597f0 0x7f056015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05601597f0 0x7f056015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39328/0 (socket says 172.21.15.86:39328) 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055e7fc700 1 -- 172.21.15.86:0/2929459910 learned_addr learned my addr 172.21.15.86:0/2929459910 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055effd700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0560159420 0x7f05600c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.662+0000 7f055f7fe700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f056015d230 0x7f0560154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055e7fc700 1 -- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0560159420 msgr2=0x7f05600c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055e7fc700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0560159420 0x7f05600c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055e7fc700 1 -- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f056015d230 msgr2=0x7f0560154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.666 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055e7fc700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f056015d230 0x7f0560154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055e7fc700 1 -- 172.21.15.86:0/2929459910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558009ae0 con 0x7f05601597f0 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055effd700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0560159420 0x7f05600c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055e7fc700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05601597f0 0x7f056015b620 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f055400ec80 tx=0x7f05540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f0546ffd700 1 -- 172.21.15.86:0/2929459910 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400c850 con 0x7f05601597f0 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f0546ffd700 1 -- 172.21.15.86:0/2929459910 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400c9b0 con 0x7f05601597f0 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f0546ffd700 1 -- 172.21.15.86:0/2929459910 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400cd50 con 0x7f05601597f0 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056015c600 con 0x7f05601597f0 2023-10-09T13:16:46.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.663+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05600c65a0 con 0x7f05601597f0 2023-10-09T13:16:46.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.664+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056004c3c0 con 0x7f05601597f0 2023-10-09T13:16:46.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.666+0000 7f0546ffd700 1 -- 172.21.15.86:0/2929459910 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0554013680 con 0x7f05601597f0 2023-10-09T13:16:46.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.667+0000 7f0546ffd700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 0x7f054c0695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:46.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.667+0000 7f0546ffd700 1 -- 172.21.15.86:0/2929459910 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f0554084df0 con 0x7f05601597f0 2023-10-09T13:16:46.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.667+0000 7f055effd700 1 -- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 msgr2=0x7f054c0695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:46.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.668+0000 7f055effd700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 0x7f054c0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:46.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.671+0000 7f0546ffd700 1 -- 172.21.15.86:0/2929459910 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0554051ae0 con 0x7f05601597f0 2023-10-09T13:16:46.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.869+0000 7f055effd700 1 -- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 msgr2=0x7f054c0695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:46.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.869+0000 7f055effd700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 0x7f054c0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:46.874 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.873+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05600b1a70 con 0x7f05601597f0 2023-10-09T13:16:46.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.874+0000 7f0546ffd700 1 -- 172.21.15.86:0/2929459910 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f0554055100 con 0x7f05601597f0 2023-10-09T13:16:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:46.876 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":213,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:41.609464+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:16:19.520774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T13:16:20.411921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:6836/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/4258990999":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/976545406":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/1033762369":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/2579375919":"2023-10-10T13:16:41.609435+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:46.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 msgr2=0x7f054c0695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:46.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 0x7f054c0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.878 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05601597f0 msgr2=0x7f056015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05601597f0 0x7f056015b620 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f055400ec80 tx=0x7f05540091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 shutdown_connections 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f054c067110 0x7f054c0695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f056015d230 0x7f0560154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0560159420 0x7f05600c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 --2- 172.21.15.86:0/2929459910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05601597f0 0x7f056015b620 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 >> 172.21.15.86:0/2929459910 conn(0x7f05600d0660 msgr2=0x7f0560068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 shutdown_connections 2023-10-09T13:16:46.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:46.877+0000 7f055ffff700 1 -- 172.21.15.86:0/2929459910 wait complete. 2023-10-09T13:16:46.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:41:00.002429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T13:16:19.520774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '211', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T13:16:20.411921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '212', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T13:16:46.897 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T13:16:46.918 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:46.916+0000 7fb1aa654180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:16:46.992 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:46.991+0000 7f1eab7a0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T13:16:47.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:47.078+0000 7fb1aa654180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:47.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.085+0000 7f0562b9d700 1 Processor -- start 2023-10-09T13:16:47.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.085+0000 7f0562b9d700 1 -- start start 2023-10-09T13:16:47.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.086+0000 7f0562b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f055c159a60 0x7f055c0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.086+0000 7f0562b9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0c9cb0 con 0x7f055c0ccc00 2023-10-09T13:16:47.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.086+0000 7f0562b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0c9f30 con 0x7f055c0cb230 2023-10-09T13:16:47.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.086+0000 7f0562b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c06dfc0 con 0x7f055c159a60 2023-10-09T13:16:47.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.087+0000 7f0561b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f055c159a60 0x7f055c0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.087+0000 7f0561b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f055c159a60 0x7f055c0c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39340/0 (socket says 172.21.15.86:39340) 2023-10-09T13:16:47.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.087+0000 7f0561b9b700 1 -- 172.21.15.86:0/3552358519 learned_addr learned my addr 172.21.15.86:0/3552358519 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:47.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.087+0000 7f0561b9b700 1 -- 172.21.15.86:0/3552358519 >> v1:172.21.15.135:6789/0 conn(0x7f055c0cb230 legacy=0x7f055c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.087+0000 7f0561b9b700 1 -- 172.21.15.86:0/3552358519 >> v1:172.21.15.86:6789/0 conn(0x7f055c0ccc00 legacy=0x7f055c069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.087+0000 7f0561b9b700 1 -- 172.21.15.86:0/3552358519 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0ca470 con 0x7f055c159a60 2023-10-09T13:16:47.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.087+0000 7f0561b9b700 1 --2- 172.21.15.86:0/3552358519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c159a60 0x7f055c0c9770 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f05580099b0 tx=0x7f0558009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3615cac749116ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:47.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0560b99700 1 -- 172.21.15.86:0/3552358519 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800b8f0 con 0x7f055c159a60 2023-10-09T13:16:47.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0560b99700 1 -- 172.21.15.86:0/3552358519 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800ba50 con 0x7f055c159a60 2023-10-09T13:16:47.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0560b99700 1 -- 172.21.15.86:0/3552358519 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800bdf0 con 0x7f055c159a60 2023-10-09T13:16:47.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0562b9d700 1 -- 172.21.15.86:0/3552358519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c159a60 msgr2=0x7f055c0c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0562b9d700 1 --2- 172.21.15.86:0/3552358519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c159a60 0x7f055c0c9770 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f05580099b0 tx=0x7f0558009250 comp rx=0 tx=0).stop 2023-10-09T13:16:47.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0562b9d700 1 -- 172.21.15.86:0/3552358519 shutdown_connections 2023-10-09T13:16:47.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0562b9d700 1 --2- 172.21.15.86:0/3552358519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c159a60 0x7f055c0c9770 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0562b9d700 1 -- 172.21.15.86:0/3552358519 >> 172.21.15.86:0/3552358519 conn(0x7f055c06baa0 msgr2=0x7f055c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:47.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0562b9d700 1 -- 172.21.15.86:0/3552358519 shutdown_connections 2023-10-09T13:16:47.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.088+0000 7f0562b9d700 1 -- 172.21.15.86:0/3552358519 wait complete. 2023-10-09T13:16:47.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.090+0000 7f0562b9d700 1 Processor -- start 2023-10-09T13:16:47.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.090+0000 7f0562b9d700 1 -- start start 2023-10-09T13:16:47.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f0562b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0cb230 0x7f055c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f0562b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0ccc00 0x7f055c06a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f0562b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c159a60 0x7f055c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f0562b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c167c00 con 0x7f055c0ccc00 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f0562b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c15b3b0 con 0x7f055c159a60 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f0562b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c15b690 con 0x7f055c0cb230 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f056139a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0ccc00 0x7f055c06a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f056139a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0ccc00 0x7f055c06a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39356/0 (socket says 172.21.15.86:39356) 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f056139a700 1 -- 172.21.15.86:0/22171690 learned_addr learned my addr 172.21.15.86:0/22171690 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f0561b9b700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0cb230 0x7f055c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.091+0000 7f056239c700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c159a60 0x7f055c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.094 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f056139a700 1 -- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0cb230 msgr2=0x7f055c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f056139a700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0cb230 0x7f055c069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f056139a700 1 -- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c159a60 msgr2=0x7f055c15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f056139a700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c159a60 0x7f055c15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f056139a700 1 -- 172.21.15.86:0/22171690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580094f0 con 0x7f055c0ccc00 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f056139a700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0ccc00 0x7f055c06a470 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c590 tx=0x7f054c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f0551ffb700 1 -- 172.21.15.86:0/22171690 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c011590 con 0x7f055c0ccc00 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f0551ffb700 1 -- 172.21.15.86:0/22171690 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c011710 con 0x7f055c0ccc00 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c15b970 con 0x7f055c0ccc00 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f0551ffb700 1 -- 172.21.15.86:0/22171690 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c011ad0 con 0x7f055c0ccc00 2023-10-09T13:16:47.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.092+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c15c920 con 0x7f055c0ccc00 2023-10-09T13:16:47.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.093+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c15bf80 con 0x7f055c0ccc00 2023-10-09T13:16:47.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.094+0000 7f0551ffb700 1 -- 172.21.15.86:0/22171690 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f054c01b3b0 con 0x7f055c0ccc00 2023-10-09T13:16:47.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.095+0000 7f0551ffb700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 0x7f0540069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.095+0000 7f0551ffb700 1 -- 172.21.15.86:0/22171690 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f054c083f80 con 0x7f055c0ccc00 2023-10-09T13:16:47.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.095+0000 7f0561b9b700 1 -- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 msgr2=0x7f0540069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:47.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.095+0000 7f0561b9b700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 0x7f0540069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:47.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.099+0000 7f0551ffb700 1 -- 172.21.15.86:0/22171690 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f054c050c70 con 0x7f055c0ccc00 2023-10-09T13:16:47.164 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:47.163+0000 7f1eab7a0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:47.166 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:47.165+0000 7fb1aa654180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:16:47.252 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:47.251+0000 7f1eab7a0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T13:16:47.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.296+0000 7f0561b9b700 1 -- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 msgr2=0x7f0540069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:47.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.296+0000 7f0561b9b700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 0x7f0540069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:47.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.296+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f055c0ca750 con 0x7f055c0ccc00 2023-10-09T13:16:47.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.296+0000 7f0551ffb700 1 -- 172.21.15.86:0/22171690 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v213) v1 ==== 93+0+10 (secure 0 0 0) 0x7f054c017070 con 0x7f055c0ccc00 2023-10-09T13:16:47.298 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 1 2023-10-09T13:16:47.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 msgr2=0x7f0540069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:47.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 0x7f0540069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0ccc00 msgr2=0x7f055c06a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0ccc00 0x7f055c06a470 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c590 tx=0x7f054c00c8a0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 shutdown_connections 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f05400670e0 0x7f0540069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c159a60 0x7f055c15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f055c0cb230 0x7f055c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 --2- 172.21.15.86:0/22171690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f055c0ccc00 0x7f055c06a470 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 >> 172.21.15.86:0/22171690 conn(0x7f055c06baa0 msgr2=0x7f055c157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 shutdown_connections 2023-10-09T13:16:47.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.299+0000 7f0562b9d700 1 -- 172.21.15.86:0/22171690 wait complete. 2023-10-09T13:16:47.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T13:16:47.391 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:47.390+0000 7fb1aa654180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:47.490 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:47.489+0000 7f1eab7a0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:47.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.510+0000 7fe51eb9d700 1 Processor -- start 2023-10-09T13:16:47.512 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.511+0000 7fe51eb9d700 1 -- start start 2023-10-09T13:16:47.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.512+0000 7fe51eb9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5180b1b40 0x7fe5180b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.513 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.512+0000 7fe51eb9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5180cfb00 con 0x7fe5180b16d0 2023-10-09T13:16:47.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.512+0000 7fe51eb9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5180b5c40 con 0x7fe5180b4e70 2023-10-09T13:16:47.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.512+0000 7fe51eb9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5180b5f20 con 0x7fe5180b1b40 2023-10-09T13:16:47.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.512+0000 7fe51d39a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe5180b16d0 0x7fe5180b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33594/0 (socket says 172.21.15.86:33594) 2023-10-09T13:16:47.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.512+0000 7fe51d39a700 1 -- 172.21.15.86:0/1175534888 learned_addr learned my addr 172.21.15.86:0/1175534888 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:47.514 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.512+0000 7fe51e39c700 1 --2- 172.21.15.86:0/1175534888 >> v2:172.21.15.86:3300/0 conn(0x7fe5180b1b40 0x7fe5180b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51e39c700 1 -- 172.21.15.86:0/1175534888 >> v1:172.21.15.135:6789/0 conn(0x7fe5180b4e70 legacy=0x7fe5180ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51e39c700 1 -- 172.21.15.86:0/1175534888 >> v1:172.21.15.86:6789/0 conn(0x7fe5180b16d0 legacy=0x7fe5180b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51cb99700 1 -- 172.21.15.86:0/1175534888 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044678021 0 0) 0x7fe5180cfb00 con 0x7fe5180b16d0 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51e39c700 1 -- 172.21.15.86:0/1175534888 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5180b6200 con 0x7fe5180b1b40 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51e39c700 1 --2- 172.21.15.86:0/1175534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b1b40 0x7fe5180b3ac0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fe510009de0 tx=0x7fe510009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27397260bc231ced server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51cb99700 1 -- 172.21.15.86:0/1175534888 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51000e070 con 0x7fe5180b1b40 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51cb99700 1 -- 172.21.15.86:0/1175534888 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51000bbb0 con 0x7fe5180b1b40 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.513+0000 7fe51cb99700 1 -- 172.21.15.86:0/1175534888 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510012430 con 0x7fe5180b1b40 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.514+0000 7fe51eb9d700 1 -- 172.21.15.86:0/1175534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b1b40 msgr2=0x7fe5180b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.514+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/1175534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b1b40 0x7fe5180b3ac0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fe510009de0 tx=0x7fe510009780 comp rx=0 tx=0).stop 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.514+0000 7fe51eb9d700 1 -- 172.21.15.86:0/1175534888 shutdown_connections 2023-10-09T13:16:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.514+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/1175534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b1b40 0x7fe5180b3ac0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.514+0000 7fe51eb9d700 1 -- 172.21.15.86:0/1175534888 >> 172.21.15.86:0/1175534888 conn(0x7fe5180d10c0 msgr2=0x7fe5180affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:47.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.514+0000 7fe51eb9d700 1 -- 172.21.15.86:0/1175534888 shutdown_connections 2023-10-09T13:16:47.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.514+0000 7fe51eb9d700 1 -- 172.21.15.86:0/1175534888 wait complete. 2023-10-09T13:16:47.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.516+0000 7fe51eb9d700 1 Processor -- start 2023-10-09T13:16:47.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.516+0000 7fe51eb9d700 1 -- start start 2023-10-09T13:16:47.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51eb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5180b16d0 0x7fe5181490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51eb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5180b1b40 0x7fe5180caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51eb9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b4e70 0x7fe518068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51eb9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5180a6f70 con 0x7fe5180b4e70 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51eb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51816bd60 con 0x7fe5180b16d0 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51eb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5181495e0 con 0x7fe5180b1b40 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b4e70 0x7fe518068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b4e70 0x7fe518068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39370/0 (socket says 172.21.15.86:39370) 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 -- 172.21.15.86:0/3289786759 learned_addr learned my addr 172.21.15.86:0/3289786759 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51db9b700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5180b16d0 0x7fe5181490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51d39a700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5180b1b40 0x7fe5180caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 -- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5180b1b40 msgr2=0x7fe5180caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5180b1b40 0x7fe5180caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 -- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5180b16d0 msgr2=0x7fe5181490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5180b16d0 0x7fe5181490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.517+0000 7fe51e39c700 1 -- 172.21.15.86:0/3289786759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe510009a20 con 0x7fe5180b4e70 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.518+0000 7fe51e39c700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b4e70 0x7fe518068390 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fe51000b6c0 tx=0x7fe510018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.518+0000 7fe50dffb700 1 -- 172.21.15.86:0/3289786759 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100124b0 con 0x7fe5180b4e70 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.518+0000 7fe50dffb700 1 -- 172.21.15.86:0/3289786759 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe510021070 con 0x7fe5180b4e70 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.518+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51816ae70 con 0x7fe5180b4e70 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.518+0000 7fe50dffb700 1 -- 172.21.15.86:0/3289786759 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510026430 con 0x7fe5180b4e70 2023-10-09T13:16:47.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.518+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51816b4b0 con 0x7fe5180b4e70 2023-10-09T13:16:47.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.519+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe518088990 con 0x7fe5180b4e70 2023-10-09T13:16:47.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.520+0000 7fe50dffb700 1 -- 172.21.15.86:0/3289786759 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe510023030 con 0x7fe5180b4e70 2023-10-09T13:16:47.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.521+0000 7fe50dffb700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 0x7fe4fc0695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.521+0000 7fe50dffb700 1 -- 172.21.15.86:0/3289786759 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7fe510086d70 con 0x7fe5180b4e70 2023-10-09T13:16:47.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.521+0000 7fe51db9b700 1 -- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 msgr2=0x7fe4fc0695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:47.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.521+0000 7fe51db9b700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 0x7fe4fc0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:47.530 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.529+0000 7fe50dffb700 1 -- 172.21.15.86:0/3289786759 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5100574f0 con 0x7fe5180b4e70 2023-10-09T13:16:47.571 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:47.569+0000 7fb1aa654180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:16:47.665 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:47.663+0000 7fb1aa654180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:16:47.678 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:47.677+0000 7f1eab7a0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T13:16:47.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.722+0000 7fe51db9b700 1 -- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 msgr2=0x7fe4fc0695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:47.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.722+0000 7fe51db9b700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 0x7fe4fc0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:47.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.729+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe51804bb80 con 0x7fe5180b4e70 2023-10-09T13:16:47.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.729+0000 7fe50dffb700 1 -- 172.21.15.86:0/3289786759 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v213) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe510057080 con 0x7fe5180b4e70 2023-10-09T13:16:47.731 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 32 2023-10-09T13:16:47.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 msgr2=0x7fe4fc0695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:47.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 0x7fe4fc0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.733 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b4e70 msgr2=0x7fe518068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b4e70 0x7fe518068390 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fe51000b6c0 tx=0x7fe510018000 comp rx=0 tx=0).stop 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 shutdown_connections 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe4fc067110 0x7fe4fc0695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5180b4e70 0x7fe518068390 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5180b16d0 0x7fe5181490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 --2- 172.21.15.86:0/3289786759 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5180b1b40 0x7fe5180caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 >> 172.21.15.86:0/3289786759 conn(0x7fe5180d10c0 msgr2=0x7fe518069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 shutdown_connections 2023-10-09T13:16:47.734 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.732+0000 7fe51eb9d700 1 -- 172.21.15.86:0/3289786759 wait complete. 2023-10-09T13:16:47.752 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T13:16:47.775 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:47.774+0000 7f1eab7a0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T13:16:47.827 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:47.826+0000 7fb1aa654180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:16:47.927 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:47.926+0000 7fb1aa654180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:47.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.942+0000 7f5a91d9d700 1 Processor -- start 2023-10-09T13:16:47.943 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.942+0000 7f5a91d9d700 1 -- start start 2023-10-09T13:16:47.944 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:47.943+0000 7f1eab7a0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T13:16:47.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.943+0000 7f5a91d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b16d0 0x7f5a8c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.943+0000 7f5a91d9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0b2080 con 0x7f5a8c0b33b0 2023-10-09T13:16:47.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a91d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0cfb00 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a91d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0b5c40 con 0x7f5a8c0b16d0 2023-10-09T13:16:47.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a9159c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5a8c0b33b0 0x7f5a8c0b3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33600/0 (socket says 172.21.15.86:33600) 2023-10-09T13:16:47.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a9159c700 1 -- 172.21.15.86:0/4094761861 learned_addr learned my addr 172.21.15.86:0/4094761861 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:47.945 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/4094761861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b16d0 0x7f5a8c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/4094761861 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160282965 0 0) 0x7f5a8c0b2080 con 0x7f5a8c0b33b0 2023-10-09T13:16:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/4094761861 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a7c003570 con 0x7f5a8c0b33b0 2023-10-09T13:16:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/4094761861 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724737108 0 0) 0x7f5a8c0cfb00 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.947 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/4094761861 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a8c0b2080 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8bfff700 1 -- 172.21.15.86:0/4094761861 >> v1:172.21.15.135:6789/0 conn(0x7f5a8c0b4e70 legacy=0x7f5a8c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8bfff700 1 -- 172.21.15.86:0/4094761861 >> v1:172.21.15.86:6789/0 conn(0x7f5a8c0b33b0 legacy=0x7f5a8c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.944+0000 7f5a8bfff700 1 -- 172.21.15.86:0/4094761861 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0b5f20 con 0x7f5a8c0b16d0 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.945+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/4094761861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b16d0 0x7f5a8c0b1b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009910 tx=0x7f5a780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c3c378359d1ab4f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.945+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/4094761861 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78011630 con 0x7f5a8c0b16d0 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.945+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/4094761861 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a78011790 con 0x7f5a8c0b16d0 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.945+0000 7f5a8b7fe700 1 -- 172.21.15.86:0/4094761861 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78011b30 con 0x7f5a8c0b16d0 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.946+0000 7f5a91d9d700 1 -- 172.21.15.86:0/4094761861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b16d0 msgr2=0x7f5a8c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.946+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/4094761861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b16d0 0x7f5a8c0b1b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009910 tx=0x7f5a780091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.946+0000 7f5a91d9d700 1 -- 172.21.15.86:0/4094761861 shutdown_connections 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.946+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/4094761861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b16d0 0x7f5a8c0b1b40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.948 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.946+0000 7f5a91d9d700 1 -- 172.21.15.86:0/4094761861 >> 172.21.15.86:0/4094761861 conn(0x7f5a8c0d10c0 msgr2=0x7f5a8c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.946+0000 7f5a91d9d700 1 -- 172.21.15.86:0/4094761861 shutdown_connections 2023-10-09T13:16:47.949 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.946+0000 7f5a91d9d700 1 -- 172.21.15.86:0/4094761861 wait complete. 2023-10-09T13:16:47.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.947+0000 7f5a91d9d700 1 Processor -- start 2023-10-09T13:16:47.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.947+0000 7f5a91d9d700 1 -- start start 2023-10-09T13:16:47.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a91d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b16d0 0x7f5a8c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a91d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b33b0 0x7f5a8c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.950 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a91d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0b4e70 0x7f5a8c15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a91d9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c15cf90 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a91d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c169a00 con 0x7f5a8c0b16d0 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a91d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c15ba10 con 0x7f5a8c0b33b0 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a9159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0b4e70 0x7f5a8c15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a9159c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0b4e70 0x7f5a8c15ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39374/0 (socket says 172.21.15.86:39374) 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a9159c700 1 -- 172.21.15.86:0/3194910489 learned_addr learned my addr 172.21.15.86:0/3194910489 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a8bfff700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b33b0 0x7f5a8c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.948+0000 7f5a90d9b700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b16d0 0x7f5a8c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a9159c700 1 -- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b33b0 msgr2=0x7f5a8c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a9159c700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b33b0 0x7f5a8c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a9159c700 1 -- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b16d0 msgr2=0x7f5a8c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:47.951 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a9159c700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b16d0 0x7f5a8c156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:47.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a9159c700 1 -- 172.21.15.86:0/3194910489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a78009420 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a9159c700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0b4e70 0x7f5a8c15ca50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400cd00 tx=0x7f5a84001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:47.952 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a88ff9700 1 -- 172.21.15.86:0/3194910489 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400ce00 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a88ff9700 1 -- 172.21.15.86:0/3194910489 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8400aac0 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c15bcf0 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.949+0000 7f5a88ff9700 1 -- 172.21.15.86:0/3194910489 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400ae80 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.950+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c15c2b0 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.951+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c088990 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.951+0000 7f5a88ff9700 1 -- 172.21.15.86:0/3194910489 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5a84007300 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.953 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.952+0000 7f5a88ff9700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 0x7f5a70069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:47.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.952+0000 7f5a88ff9700 1 -- 172.21.15.86:0/3194910489 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f5a84084f40 con 0x7f5a8c0b4e70 2023-10-09T13:16:47.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.952+0000 7f5a90d9b700 1 -- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 msgr2=0x7f5a70069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:47.954 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.952+0000 7f5a90d9b700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 0x7f5a70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:47.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:47.956+0000 7f5a88ff9700 1 -- 172.21.15.86:0/3194910489 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a84051c30 con 0x7f5a8c0b4e70 2023-10-09T13:16:48.050 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:48.049+0000 7f1eab7a0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T13:16:48.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.153+0000 7f5a90d9b700 1 -- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 msgr2=0x7f5a70069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:48.154 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.153+0000 7f5a90d9b700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 0x7f5a70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:48.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.157+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a8c169b40 con 0x7f5a8c0b4e70 2023-10-09T13:16:48.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.158+0000 7f5a88ff9700 1 -- 172.21.15.86:0/3194910489 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v213) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a84055250 con 0x7f5a8c0b4e70 2023-10-09T13:16:48.159 INFO:teuthology.orchestra.run.smithi086.stdout:pg_num: 64 2023-10-09T13:16:48.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 msgr2=0x7f5a70069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:48.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 0x7f5a70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0b4e70 msgr2=0x7f5a8c15ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0b4e70 0x7f5a8c15ca50 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400cd00 tx=0x7f5a84001ac0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 shutdown_connections 2023-10-09T13:16:48.162 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5a700670e0 0x7f5a70069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a8c0b4e70 0x7f5a8c15ca50 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b16d0 0x7f5a8c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 --2- 172.21.15.86:0/3194910489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b33b0 0x7f5a8c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.160+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 >> 172.21.15.86:0/3194910489 conn(0x7f5a8c0d10c0 msgr2=0x7f5a8c1590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:48.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.161+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 shutdown_connections 2023-10-09T13:16:48.163 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.161+0000 7f5a91d9d700 1 -- 172.21.15.86:0/3194910489 wait complete. 2023-10-09T13:16:48.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:48.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.410+0000 7f1553fff700 1 Processor -- start 2023-10-09T13:16:48.411 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.410+0000 7f1553fff700 1 -- start start 2023-10-09T13:16:48.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.411+0000 7f1553fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f15540c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.411+0000 7f1553fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f155406e8c0 0x7f15540c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.411+0000 7f1553fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15540b1410 con 0x7f15541595a0 2023-10-09T13:16:48.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.411+0000 7f1553fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15540b2b90 con 0x7f155406e8c0 2023-10-09T13:16:48.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.411+0000 7f1553fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1554063230 con 0x7f15540c6c60 2023-10-09T13:16:48.413 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f1552ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f15541595a0 0x7f15540b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33614/0 (socket says 172.21.15.86:33614) 2023-10-09T13:16:48.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f1552ffd700 1 -- 172.21.15.86:0/3372620189 learned_addr learned my addr 172.21.15.86:0/3372620189 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:48.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f15527fc700 1 --2- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f15540c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.414 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f15537fe700 1 --2- 172.21.15.86:0/3372620189 >> v2:172.21.15.135:3300/0 conn(0x7f155406e8c0 0x7f15540c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f1551ffb700 1 -- 172.21.15.86:0/3372620189 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140309895 0 0) 0x7f15540b1410 con 0x7f15541595a0 2023-10-09T13:16:48.415 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f1551ffb700 1 -- 172.21.15.86:0/3372620189 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c003570 con 0x7f15541595a0 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f15537fe700 1 -- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 msgr2=0x7f15540c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f15537fe700 1 --2- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f15540c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f15537fe700 1 -- 172.21.15.86:0/3372620189 >> v1:172.21.15.86:6789/0 conn(0x7f15541595a0 legacy=0x7f15540b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.412+0000 7f15537fe700 1 -- 172.21.15.86:0/3372620189 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540634f0 con 0x7f155406e8c0 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.413+0000 7f15537fe700 1 --2- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f155406e8c0 0x7f15540c8660 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f154c009e60 tx=0x7f154c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e5559c711d4df7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.413+0000 7f1551ffb700 1 -- 172.21.15.86:0/3372620189 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00e070 con 0x7f155406e8c0 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.413+0000 7f1551ffb700 1 -- 172.21.15.86:0/3372620189 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00bab0 con 0x7f155406e8c0 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.413+0000 7f1551ffb700 1 -- 172.21.15.86:0/3372620189 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00be70 con 0x7f155406e8c0 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 -- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f155406e8c0 msgr2=0x7f15540c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 --2- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f155406e8c0 0x7f15540c8660 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f154c009e60 tx=0x7f154c009780 comp rx=0 tx=0).stop 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 -- 172.21.15.86:0/3372620189 shutdown_connections 2023-10-09T13:16:48.416 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 --2- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f155406e8c0 0x7f15540c8660 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 --2- 172.21.15.86:0/3372620189 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f15540c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 -- 172.21.15.86:0/3372620189 >> 172.21.15.86:0/3372620189 conn(0x7f155406ddb0 msgr2=0x7f155406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:48.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 -- 172.21.15.86:0/3372620189 shutdown_connections 2023-10-09T13:16:48.417 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.414+0000 7f1553fff700 1 -- 172.21.15.86:0/3372620189 wait complete. 2023-10-09T13:16:48.417 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:48.415+0000 7fb1aa654180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:16:48.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.416+0000 7f1553fff700 1 Processor -- start 2023-10-09T13:16:48.418 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.417+0000 7f1553fff700 1 -- start start 2023-10-09T13:16:48.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1553fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155406e8c0 0x7f1554151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1553fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f155415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.420 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1553fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15541595a0 0x7f1554152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1553fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155415c840 con 0x7f155406e8c0 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1553fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1554169c10 con 0x7f15541595a0 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1553fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155416a4b0 con 0x7f15540c6c60 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1552ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155406e8c0 0x7f1554151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1552ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155406e8c0 0x7f1554151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39382/0 (socket says 172.21.15.86:39382) 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f1552ffd700 1 -- 172.21.15.86:0/1302160334 learned_addr learned my addr 172.21.15.86:0/1302160334 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f15527fc700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f155415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.418+0000 7f15537fe700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15541595a0 0x7f1554152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f1552ffd700 1 -- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 msgr2=0x7f155415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f1552ffd700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f155415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f1552ffd700 1 -- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15541595a0 msgr2=0x7f1554152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.421 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f1552ffd700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15541595a0 0x7f1554152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f1552ffd700 1 -- 172.21.15.86:0/1302160334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c009a20 con 0x7f155406e8c0 2023-10-09T13:16:48.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f1552ffd700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155406e8c0 0x7f1554151a00 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f154400c590 tx=0x7f1544007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:48.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f153affd700 1 -- 172.21.15.86:0/1302160334 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544005b30 con 0x7f155406e8c0 2023-10-09T13:16:48.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f153affd700 1 -- 172.21.15.86:0/1302160334 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1544005cb0 con 0x7f155406e8c0 2023-10-09T13:16:48.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f153affd700 1 -- 172.21.15.86:0/1302160334 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544007320 con 0x7f155406e8c0 2023-10-09T13:16:48.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.419+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1554151f40 con 0x7f155406e8c0 2023-10-09T13:16:48.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.420+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155416a140 con 0x7f155406e8c0 2023-10-09T13:16:48.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.421+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155404c3c0 con 0x7f155406e8c0 2023-10-09T13:16:48.423 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.422+0000 7f153affd700 1 -- 172.21.15.86:0/1302160334 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f154401b3b0 con 0x7f155406e8c0 2023-10-09T13:16:48.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.423+0000 7f153affd700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 0x7f1540069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.423+0000 7f153affd700 1 -- 172.21.15.86:0/1302160334 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f1544084000 con 0x7f155406e8c0 2023-10-09T13:16:48.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.423+0000 7f15527fc700 1 -- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 msgr2=0x7f1540069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:48.424 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.423+0000 7f15527fc700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 0x7f1540069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:48.428 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.427+0000 7f153affd700 1 -- 172.21.15.86:0/1302160334 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1544050cf0 con 0x7f155406e8c0 2023-10-09T13:16:48.512 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:48.510+0000 7fb1aa654180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:16:48.561 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:48.560+0000 7f1eab7a0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T13:16:48.602 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:48.600+0000 7fb1aa654180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:16:48.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.624+0000 7f15527fc700 1 -- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 msgr2=0x7f1540069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:48.625 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.624+0000 7f15527fc700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 0x7f1540069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:48.659 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:48.658+0000 7f1eab7a0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T13:16:48.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.670+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15540637d0 con 0x7f155406e8c0 2023-10-09T13:16:48.671 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.670+0000 7f153affd700 1 -- 172.21.15.86:0/1302160334 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f1544017090 con 0x7f155406e8c0 2023-10-09T13:16:48.671 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:48.672 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4046429451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4046429451},{"type":"v1","addr":"172.21.15.135:6834","nonce":4046429451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1310718495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1310718495},{"type":"v1","addr":"172.21.15.135:6835","nonce":1310718495}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3009333325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3009333325},{"type":"v1","addr":"172.21.15.86:6833","nonce":3009333325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:16:21.427143+0000","modified":"2023-10-09T13:16:24.986894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/903379396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":903379396},{"type":"v1","addr":"172.21.15.86:6835","nonce":903379396}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T13:16:48.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 msgr2=0x7f1540069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:48.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 0x7f1540069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155406e8c0 msgr2=0x7f1554151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155406e8c0 0x7f1554151a00 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f154400c590 tx=0x7f1544007e00 comp rx=0 tx=0).stop 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 shutdown_connections 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f15400670e0 0x7f1540069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155406e8c0 0x7f1554151a00 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15541595a0 0x7f1554152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 --2- 172.21.15.86:0/1302160334 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15540c6c60 0x7f155415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 >> 172.21.15.86:0/1302160334 conn(0x7f155406ddb0 msgr2=0x7f155415cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 shutdown_connections 2023-10-09T13:16:48.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.673+0000 7f1553fff700 1 -- 172.21.15.86:0/1302160334 wait complete. 2023-10-09T13:16:48.676 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 94 2023-10-09T13:16:48.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:48.757 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:48.755+0000 7f1eab7a0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T13:16:48.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.877+0000 7fc42ffff700 1 Processor -- start 2023-10-09T13:16:48.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.877+0000 7fc42ffff700 1 -- start start 2023-10-09T13:16:48.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc430142ea0 0x7fc4300b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4300ad870 0x7fc43006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4300b3b70 0x7fc43006bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42ffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4300b40f0 con 0x7fc4300b3b70 2023-10-09T13:16:48.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42ffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc430069640 con 0x7fc4300ad870 2023-10-09T13:16:48.881 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc430069920 con 0x7fc430142ea0 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4300b3b70 0x7fc43006bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc4300b3b70 0x7fc43006bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39398/0 (socket says 172.21.15.86:39398) 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 -- 172.21.15.86:0/1880570714 learned_addr learned my addr 172.21.15.86:0/1880570714 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42e7fc700 1 --2- 172.21.15.86:0/1880570714 >> v2:172.21.15.135:3300/0 conn(0x7fc4300ad870 0x7fc43006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42effd700 1 --2- 172.21.15.86:0/1880570714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc430142ea0 0x7fc4300b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 -- 172.21.15.86:0/1880570714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc430142ea0 msgr2=0x7fc4300b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 --2- 172.21.15.86:0/1880570714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc430142ea0 0x7fc4300b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 -- 172.21.15.86:0/1880570714 >> v2:172.21.15.135:3300/0 conn(0x7fc4300ad870 msgr2=0x7fc43006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 --2- 172.21.15.86:0/1880570714 >> v2:172.21.15.135:3300/0 conn(0x7fc4300ad870 0x7fc43006b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.879+0000 7fc42f7fe700 1 -- 172.21.15.86:0/1880570714 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430069c00 con 0x7fc4300b3b70 2023-10-09T13:16:48.882 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.880+0000 7fc42f7fe700 1 --2- 172.21.15.86:0/1880570714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43006bf20 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc43006f1a0 tx=0x7fc428009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ba679396e4ce36 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.880+0000 7fc42dffb700 1 -- 172.21.15.86:0/1880570714 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800e070 con 0x7fc4300b3b70 2023-10-09T13:16:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.880+0000 7fc42dffb700 1 -- 172.21.15.86:0/1880570714 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800b970 con 0x7fc4300b3b70 2023-10-09T13:16:48.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.880+0000 7fc42dffb700 1 -- 172.21.15.86:0/1880570714 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280092e0 con 0x7fc4300b3b70 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.880+0000 7fc42ffff700 1 -- 172.21.15.86:0/1880570714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 msgr2=0x7fc43006bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.880+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1880570714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43006bf20 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc43006f1a0 tx=0x7fc428009840 comp rx=0 tx=0).stop 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.881+0000 7fc42ffff700 1 -- 172.21.15.86:0/1880570714 shutdown_connections 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.881+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1880570714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43006bf20 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.881+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1880570714 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc430142ea0 0x7fc4300b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.881+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1880570714 >> v2:172.21.15.135:3300/0 conn(0x7fc4300ad870 0x7fc43006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.881+0000 7fc42ffff700 1 -- 172.21.15.86:0/1880570714 >> 172.21.15.86:0/1880570714 conn(0x7fc4300ce430 msgr2=0x7fc4300ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.881+0000 7fc42ffff700 1 -- 172.21.15.86:0/1880570714 shutdown_connections 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.881+0000 7fc42ffff700 1 -- 172.21.15.86:0/1880570714 wait complete. 2023-10-09T13:16:48.884 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.882+0000 7fc42ffff700 1 Processor -- start 2023-10-09T13:16:48.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.882+0000 7fc42ffff700 1 -- start start 2023-10-09T13:16:48.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43015b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc430142ea0 0x7fc43015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43015c5f0 0x7fc43016a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015a0f0 con 0x7fc4300b3b70 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015a3d0 con 0x7fc430142ea0 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015a6b0 con 0x7fc43015c5f0 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43015b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42effd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43015b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39408/0 (socket says 172.21.15.86:39408) 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.883+0000 7fc42effd700 1 -- 172.21.15.86:0/1565261649 learned_addr learned my addr 172.21.15.86:0/1565261649 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42e7fc700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc430142ea0 0x7fc43015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42f7fe700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43015c5f0 0x7fc43016a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42effd700 1 -- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43015c5f0 msgr2=0x7fc43016a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42effd700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43015c5f0 0x7fc43016a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42effd700 1 -- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc430142ea0 msgr2=0x7fc43015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42effd700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc430142ea0 0x7fc43015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42effd700 1 -- 172.21.15.86:0/1565261649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428009ae0 con 0x7fc4300b3b70 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42effd700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43015b470 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fc42000e950 tx=0x7fc4200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc416ffd700 1 -- 172.21.15.86:0/1565261649 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420013680 con 0x7fc4300b3b70 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc416ffd700 1 -- 172.21.15.86:0/1565261649 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4200137e0 con 0x7fc4300b3b70 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43015a990 con 0x7fc4300b3b70 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.884+0000 7fc416ffd700 1 -- 172.21.15.86:0/1565261649 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420013ba0 con 0x7fc4300b3b70 2023-10-09T13:16:48.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.885+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43015af50 con 0x7fc4300b3b70 2023-10-09T13:16:48.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.886+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43015b140 con 0x7fc4300b3b70 2023-10-09T13:16:48.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.886+0000 7fc416ffd700 1 -- 172.21.15.86:0/1565261649 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc4200123d0 con 0x7fc4300b3b70 2023-10-09T13:16:48.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.887+0000 7fc416ffd700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 0x7fc41c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:48.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.887+0000 7fc42e7fc700 1 -- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 msgr2=0x7fc41c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:48.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.887+0000 7fc416ffd700 1 -- 172.21.15.86:0/1565261649 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7fc420084cd0 con 0x7fc4300b3b70 2023-10-09T13:16:48.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.887+0000 7fc42e7fc700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 0x7fc41c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:48.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:48.896+0000 7fc416ffd700 1 -- 172.21.15.86:0/1565261649 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4200519c0 con 0x7fc4300b3b70 2023-10-09T13:16:49.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.088+0000 7fc42e7fc700 1 -- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 msgr2=0x7fc41c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:49.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.088+0000 7fc42e7fc700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 0x7fc41c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:49.099 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.098+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc43004c3c0 con 0x7fc4300b3b70 2023-10-09T13:16:49.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.099+0000 7fc416ffd700 1 -- 172.21.15.86:0/1565261649 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+16558 (secure 0 0 0) 0x7fc420017090 con 0x7fc4300b3b70 2023-10-09T13:16:49.100 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:49.100 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":213,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:41.609464+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:16:19.520774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T13:16:20.411921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:6836/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/4258990999":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/976545406":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/1033762369":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/2579375919":"2023-10-10T13:16:41.609435+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 msgr2=0x7fc41c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 0x7fc41c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 msgr2=0x7fc43015b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43015b470 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fc42000e950 tx=0x7fc4200091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 shutdown_connections 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc41c0670e0 0x7fc41c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4300b3b70 0x7fc43015b470 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc43015c5f0 0x7fc43016a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 --2- 172.21.15.86:0/1565261649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc430142ea0 0x7fc43015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 >> 172.21.15.86:0/1565261649 conn(0x7fc4300ce430 msgr2=0x7fc430141d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:49.103 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 shutdown_connections 2023-10-09T13:16:49.104 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.101+0000 7fc42ffff700 1 -- 172.21.15.86:0/1565261649 wait complete. 2023-10-09T13:16:49.121 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T13:16:49.122 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:49.230 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:49.228+0000 7fb1aa654180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:16:49.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.329+0000 7f1f8359e700 1 Processor -- start 2023-10-09T13:16:49.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.329+0000 7f1f8359e700 1 -- start start 2023-10-09T13:16:49.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f8359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1f8406e000 0x7f1f8406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f8359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8406e8c0 con 0x7f1f8415de70 2023-10-09T13:16:49.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f8359e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f840ca740 con 0x7f1f8415daa0 2023-10-09T13:16:49.335 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f8359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8406e400 con 0x7f1f8406e000 2023-10-09T13:16:49.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f81d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1f8415de70 0x7f1f840696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33618/0 (socket says 172.21.15.86:33618) 2023-10-09T13:16:49.336 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f81d9b700 1 -- 172.21.15.86:0/259426653 learned_addr learned my addr 172.21.15.86:0/259426653 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f8259c700 1 --1- 172.21.15.86:0/259426653 >> v1:172.21.15.135:6789/0 conn(0x7f1f8415daa0 0x7f1f840c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:37670/0 (socket says 172.21.15.86:37670) 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.332+0000 7f1f82d9d700 1 --2- 172.21.15.86:0/259426653 >> v2:172.21.15.135:3300/0 conn(0x7f1f8406e000 0x7f1f8406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.333+0000 7f1f8159a700 1 -- 172.21.15.86:0/259426653 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033057750 0 0) 0x7f1f8406e8c0 con 0x7f1f8415de70 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.333+0000 7f1f8159a700 1 -- 172.21.15.86:0/259426653 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f70003570 con 0x7f1f8415de70 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.333+0000 7f1f82d9d700 1 -- 172.21.15.86:0/259426653 >> v1:172.21.15.135:6789/0 conn(0x7f1f8415daa0 legacy=0x7f1f840c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.333+0000 7f1f82d9d700 1 -- 172.21.15.86:0/259426653 >> v1:172.21.15.86:6789/0 conn(0x7f1f8415de70 legacy=0x7f1f840696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.333+0000 7f1f82d9d700 1 -- 172.21.15.86:0/259426653 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8406e5e0 con 0x7f1f8406e000 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.333+0000 7f1f82d9d700 1 --2- 172.21.15.86:0/259426653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8406e000 0x7f1f8406ecd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1f740098e0 tx=0x7f1f740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=265bbb178741c5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.334+0000 7f1f8159a700 1 -- 172.21.15.86:0/259426653 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400b640 con 0x7f1f8406e000 2023-10-09T13:16:49.337 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.334+0000 7f1f8159a700 1 -- 172.21.15.86:0/259426653 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7400b7c0 con 0x7f1f8406e000 2023-10-09T13:16:49.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.334+0000 7f1f8159a700 1 -- 172.21.15.86:0/259426653 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400bb60 con 0x7f1f8406e000 2023-10-09T13:16:49.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.334+0000 7f1f8359e700 1 -- 172.21.15.86:0/259426653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8406e000 msgr2=0x7f1f8406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.334+0000 7f1f8359e700 1 --2- 172.21.15.86:0/259426653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8406e000 0x7f1f8406ecd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1f740098e0 tx=0x7f1f740091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.335+0000 7f1f8359e700 1 -- 172.21.15.86:0/259426653 shutdown_connections 2023-10-09T13:16:49.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.335+0000 7f1f8359e700 1 --2- 172.21.15.86:0/259426653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8406e000 0x7f1f8406ecd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.338 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.335+0000 7f1f8359e700 1 -- 172.21.15.86:0/259426653 >> 172.21.15.86:0/259426653 conn(0x7f1f840cc1f0 msgr2=0x7f1f840cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:49.339 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.338+0000 7f1f8359e700 1 -- 172.21.15.86:0/259426653 shutdown_connections 2023-10-09T13:16:49.343 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.342+0000 7f1f8359e700 1 -- 172.21.15.86:0/259426653 wait complete. 2023-10-09T13:16:49.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.344+0000 7f1f8359e700 1 Processor -- start 2023-10-09T13:16:49.346 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.345+0000 7f1f8359e700 1 -- start start 2023-10-09T13:16:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.346+0000 7f1f8359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f8406e000 0x7f1f840b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.346+0000 7f1f8359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8415daa0 0x7f1f84160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.346+0000 7f1f8359e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f8415de70 0x7f1f84161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.346+0000 7f1f8359e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c1e00 con 0x7f1f8415de70 2023-10-09T13:16:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.346+0000 7f1f8359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8415ea10 con 0x7f1f8415daa0 2023-10-09T13:16:49.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.346+0000 7f1f8359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84161a90 con 0x7f1f8406e000 2023-10-09T13:16:49.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f81d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8415daa0 0x7f1f84160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f81d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8415daa0 0x7f1f84160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:51714/0 (socket says 172.21.15.86:51714) 2023-10-09T13:16:49.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f8259c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f8406e000 0x7f1f840b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f8259c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f8406e000 0x7f1f840b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:33770/0 (socket says 172.21.15.86:33770) 2023-10-09T13:16:49.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f8259c700 1 -- 172.21.15.86:0/1656040861 learned_addr learned my addr 172.21.15.86:0/1656040861 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:49.349 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f82d9d700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f8415de70 0x7f1f84161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f8259c700 1 -- 172.21.15.86:0/1656040861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8415daa0 msgr2=0x7f1f84160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f8259c700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8415daa0 0x7f1f84160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.347+0000 7f1f8259c700 1 -- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f8415de70 msgr2=0x7f1f84161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f8259c700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f8415de70 0x7f1f84161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f8259c700 1 -- 172.21.15.86:0/1656040861 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74009420 con 0x7f1f8406e000 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f82d9d700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f8415de70 0x7f1f84161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f8259c700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f8406e000 0x7f1f840b12a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c510 tx=0x7f1f7c007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f7a7fc700 1 -- 172.21.15.86:0/1656040861 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c005a70 con 0x7f1f8406e000 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f7a7fc700 1 -- 172.21.15.86:0/1656040861 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c005bd0 con 0x7f1f8406e000 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f7a7fc700 1 -- 172.21.15.86:0/1656040861 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0070d0 con 0x7f1f8406e000 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8415e3c0 con 0x7f1f8406e000 2023-10-09T13:16:49.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.348+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f84161d70 con 0x7f1f8406e000 2023-10-09T13:16:49.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.349+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8404c3c0 con 0x7f1f8406e000 2023-10-09T13:16:49.352 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.350+0000 7f1f7a7fc700 1 -- 172.21.15.86:0/1656040861 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1f7c0074c0 con 0x7f1f8406e000 2023-10-09T13:16:49.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.351+0000 7f1f7a7fc700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 0x7f1f64069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.351+0000 7f1f7a7fc700 1 -- 172.21.15.86:0/1656040861 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f1f7c083f00 con 0x7f1f8406e000 2023-10-09T13:16:49.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.351+0000 7f1f81d9b700 1 -- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 msgr2=0x7f1f64069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:49.353 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.351+0000 7f1f81d9b700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 0x7f1f64069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:49.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.356+0000 7f1f7a7fc700 1 -- 172.21.15.86:0/1656040861 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f7c050b50 con 0x7f1f8406e000 2023-10-09T13:16:49.405 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:49.404+0000 7fb1aa654180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:49.408 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:49.407+0000 7f1eab7a0180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T13:16:49.501 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:49.499+0000 7fb1aa654180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:16:49.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.552+0000 7f1f81d9b700 1 -- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 msgr2=0x7f1f64069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:49.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.552+0000 7f1f81d9b700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 0x7f1f64069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:49.586 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:49.585+0000 7f1eab7a0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T13:16:49.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.598+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f8406cdb0 con 0x7f1f8406e000 2023-10-09T13:16:49.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.599+0000 7f1f7a7fc700 1 -- 172.21.15.86:0/1656040861 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f1f7c017070 con 0x7f1f8406e000 2023-10-09T13:16:49.600 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:49.600 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4046429451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4046429451},{"type":"v1","addr":"172.21.15.135:6834","nonce":4046429451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1310718495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1310718495},{"type":"v1","addr":"172.21.15.135:6835","nonce":1310718495}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3009333325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3009333325},{"type":"v1","addr":"172.21.15.86:6833","nonce":3009333325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:16:21.427143+0000","modified":"2023-10-09T13:16:24.986894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/903379396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":903379396},{"type":"v1","addr":"172.21.15.86:6835","nonce":903379396}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T13:16:49.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 msgr2=0x7f1f64069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:49.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 0x7f1f64069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f8406e000 msgr2=0x7f1f840b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f8406e000 0x7f1f840b12a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c510 tx=0x7f1f7c007f70 comp rx=0 tx=0).stop 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 shutdown_connections 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f1f640670e0 0x7f1f64069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f8415de70 0x7f1f84161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f8406e000 0x7f1f840b12a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 --2- 172.21.15.86:0/1656040861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f8415daa0 0x7f1f84160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 >> 172.21.15.86:0/1656040861 conn(0x7f1f840cc1f0 msgr2=0x7f1f84069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 shutdown_connections 2023-10-09T13:16:49.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.601+0000 7f1f8359e700 1 -- 172.21.15.86:0/1656040861 wait complete. 2023-10-09T13:16:49.604 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 94 2023-10-09T13:16:49.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:16:49.695 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:49.694+0000 7f1eab7a0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T13:16:49.796 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:49.794+0000 7fb1aa654180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:16:49.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.813+0000 7f285159d700 1 Processor -- start 2023-10-09T13:16:49.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.813+0000 7f285159d700 1 -- start start 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f285159d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c142ea0 0x7f284c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f285159d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f284c0ad870 0x7f284c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f285159d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c0b40f0 con 0x7f284c0b3b70 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f285159d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c069640 con 0x7f284c0ad870 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f285159d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c069920 con 0x7f284c142ea0 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f2850d9c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f284c0b3b70 0x7f284c06cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33622/0 (socket says 172.21.15.86:33622) 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f2850d9c700 1 -- 172.21.15.86:0/422458729 learned_addr learned my addr 172.21.15.86:0/422458729 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284bfff700 1 --2- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c142ea0 0x7f284c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.814+0000 7f284b7fe700 1 --2- 172.21.15.86:0/422458729 >> v2:172.21.15.135:3300/0 conn(0x7f284c0ad870 0x7f284c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284affd700 1 -- 172.21.15.86:0/422458729 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265615073 0 0) 0x7f284c0b40f0 con 0x7f284c0b3b70 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284affd700 1 -- 172.21.15.86:0/422458729 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2834003570 con 0x7f284c0b3b70 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284b7fe700 1 -- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c142ea0 msgr2=0x7f284c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284b7fe700 1 --2- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c142ea0 0x7f284c0b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284b7fe700 1 -- 172.21.15.86:0/422458729 >> v1:172.21.15.86:6789/0 conn(0x7f284c0b3b70 legacy=0x7f284c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284b7fe700 1 -- 172.21.15.86:0/422458729 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c069c00 con 0x7f284c0ad870 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284bfff700 1 --2- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c142ea0 0x7f284c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:49.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.815+0000 7f284b7fe700 1 --2- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c0ad870 0x7f284c06b9e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f28400098e0 tx=0x7f28400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98278427b40f132e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f284affd700 1 -- 172.21.15.86:0/422458729 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011630 con 0x7f284c0ad870 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f284affd700 1 -- 172.21.15.86:0/422458729 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2840011790 con 0x7f284c0ad870 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f284affd700 1 -- 172.21.15.86:0/422458729 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011b30 con 0x7f284c0ad870 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f285159d700 1 -- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c0ad870 msgr2=0x7f284c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f285159d700 1 --2- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c0ad870 0x7f284c06b9e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f28400098e0 tx=0x7f28400091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f285159d700 1 -- 172.21.15.86:0/422458729 shutdown_connections 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f285159d700 1 --2- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c142ea0 0x7f284c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f285159d700 1 --2- 172.21.15.86:0/422458729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c0ad870 0x7f284c06b9e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.816+0000 7f285159d700 1 -- 172.21.15.86:0/422458729 >> 172.21.15.86:0/422458729 conn(0x7f284c0ce430 msgr2=0x7f284c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.817+0000 7f285159d700 1 -- 172.21.15.86:0/422458729 shutdown_connections 2023-10-09T13:16:49.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.817+0000 7f285159d700 1 -- 172.21.15.86:0/422458729 wait complete. 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.818+0000 7f285159d700 1 Processor -- start 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.818+0000 7f285159d700 1 -- start start 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f285159d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b3b70 0x7f284c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f285159d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c142ea0 0x7f284c159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f285159d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c15a580 0x7f284c15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f285159d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c15a250 con 0x7f284c0b3b70 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f285159d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c15c610 con 0x7f284c142ea0 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f285159d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c15d100 con 0x7f284c15a580 2023-10-09T13:16:49.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f284bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b3b70 0x7f284c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f284bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b3b70 0x7f284c159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39420/0 (socket says 172.21.15.86:39420) 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f284bfff700 1 -- 172.21.15.86:0/562904038 learned_addr learned my addr 172.21.15.86:0/562904038 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.819+0000 7f2850d9c700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c15a580 0x7f284c15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f284b7fe700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c142ea0 0x7f284c159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f284bfff700 1 -- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c15a580 msgr2=0x7f284c15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f284bfff700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c15a580 0x7f284c15a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f284bfff700 1 -- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c142ea0 msgr2=0x7f284c159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f284bfff700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c142ea0 0x7f284c159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:49.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f284bfff700 1 -- 172.21.15.86:0/562904038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c009420 con 0x7f284c0b3b70 2023-10-09T13:16:49.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f284bfff700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b3b70 0x7f284c159d10 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f283c00ec80 tx=0x7f283c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:49.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f2833fff700 1 -- 172.21.15.86:0/562904038 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00c850 con 0x7f284c0b3b70 2023-10-09T13:16:49.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f2833fff700 1 -- 172.21.15.86:0/562904038 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c00c9b0 con 0x7f284c0b3b70 2023-10-09T13:16:49.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2840009420 con 0x7f284c0b3b70 2023-10-09T13:16:49.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.820+0000 7f2833fff700 1 -- 172.21.15.86:0/562904038 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00cd30 con 0x7f284c0b3b70 2023-10-09T13:16:49.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.821+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c15cb40 con 0x7f284c0b3b70 2023-10-09T13:16:49.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.822+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c04c3c0 con 0x7f284c0b3b70 2023-10-09T13:16:49.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.823+0000 7f2833fff700 1 -- 172.21.15.86:0/562904038 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f283c013680 con 0x7f284c0b3b70 2023-10-09T13:16:49.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.824+0000 7f2833fff700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 0x7f2838069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:49.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.824+0000 7f2833fff700 1 -- 172.21.15.86:0/562904038 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f283c084e30 con 0x7f284c0b3b70 2023-10-09T13:16:49.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.824+0000 7f284b7fe700 1 -- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 msgr2=0x7f2838069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:49.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.824+0000 7f284b7fe700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 0x7f2838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:49.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:49.828+0000 7f2833fff700 1 -- 172.21.15.86:0/562904038 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f283c055510 con 0x7f284c0b3b70 2023-10-09T13:16:49.893 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:49.892+0000 7fb1aa654180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:16:50.001 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:50.000+0000 7f1eab7a0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T13:16:50.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.025+0000 7f284b7fe700 1 -- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 msgr2=0x7f2838069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:50.026 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.025+0000 7f284b7fe700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 0x7f2838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:50.073 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.072+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f284c143270 con 0x7f284c0b3b70 2023-10-09T13:16:50.074 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.073+0000 7f2833fff700 1 -- 172.21.15.86:0/562904038 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f283c0550a0 con 0x7f284c0b3b70 2023-10-09T13:16:50.074 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:50.074 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":94,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4046429451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4046429451},{"type":"v1","addr":"172.21.15.135:6834","nonce":4046429451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1310718495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1310718495},{"type":"v1","addr":"172.21.15.135:6835","nonce":1310718495}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3009333325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3009333325},{"type":"v1","addr":"172.21.15.86:6833","nonce":3009333325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T13:16:21.427143+0000","modified":"2023-10-09T13:16:24.986894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/903379396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":903379396},{"type":"v1","addr":"172.21.15.86:6835","nonce":903379396}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T13:16:50.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 msgr2=0x7f2838069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:50.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 0x7f2838069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b3b70 msgr2=0x7f284c159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b3b70 0x7f284c159d10 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f283c00ec80 tx=0x7f283c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 shutdown_connections 2023-10-09T13:16:50.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f28380670e0 0x7f2838069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b3b70 0x7f284c159d10 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f284c15a580 0x7f284c15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 --2- 172.21.15.86:0/562904038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f284c142ea0 0x7f284c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 >> 172.21.15.86:0/562904038 conn(0x7f284c0ce430 msgr2=0x7f284c142010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:50.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 shutdown_connections 2023-10-09T13:16:50.078 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.075+0000 7f285159d700 1 -- 172.21.15.86:0/562904038 wait complete. 2023-10-09T13:16:50.078 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 94 2023-10-09T13:16:50.094 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:50.101 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:50.100+0000 7f1eab7a0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T13:16:50.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.279+0000 7f9879b9d700 1 Processor -- start 2023-10-09T13:16:50.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.279+0000 7f9879b9d700 1 -- start start 2023-10-09T13:16:50.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9879b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98741566e0 0x7f98740ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9879b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98740cb900 0x7f98740ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9879b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98740ca860 con 0x7f9874156310 2023-10-09T13:16:50.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9879b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98740cab40 con 0x7f98741566e0 2023-10-09T13:16:50.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9879b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98740cae20 con 0x7f98740cb900 2023-10-09T13:16:50.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9873fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98741566e0 0x7f98740ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9873fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f98741566e0 0x7f98740ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39424/0 (socket says 172.21.15.86:39424) 2023-10-09T13:16:50.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f9873fff700 1 -- 172.21.15.86:0/786463746 learned_addr learned my addr 172.21.15.86:0/786463746 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:50.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.280+0000 7f987939c700 1 --2- 172.21.15.86:0/786463746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98740cb900 0x7f98740ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f98737fe700 1 -- 172.21.15.86:0/786463746 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398858615 0 0) 0x7f98740ca860 con 0x7f9874156310 2023-10-09T13:16:50.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f98737fe700 1 -- 172.21.15.86:0/786463746 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9864003570 con 0x7f9874156310 2023-10-09T13:16:50.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f9873fff700 1 -- 172.21.15.86:0/786463746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98740cb900 msgr2=0x7f98740ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:50.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f9873fff700 1 --2- 172.21.15.86:0/786463746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98740cb900 0x7f98740ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f9873fff700 1 -- 172.21.15.86:0/786463746 >> v1:172.21.15.135:6789/0 conn(0x7f9874156310 legacy=0x7f98740c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f9873fff700 1 -- 172.21.15.86:0/786463746 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740cb100 con 0x7f98741566e0 2023-10-09T13:16:50.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f987939c700 1 --2- 172.21.15.86:0/786463746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98740cb900 0x7f98740ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:50.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f9873fff700 1 --2- 172.21.15.86:0/786463746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98741566e0 0x7f98740ae000 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f986000bc50 tx=0x7f986000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7ef99d8a72d244 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:50.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.281+0000 7f98737fe700 1 -- 172.21.15.86:0/786463746 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000db40 con 0x7f98741566e0 2023-10-09T13:16:50.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f98737fe700 1 -- 172.21.15.86:0/786463746 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986000dca0 con 0x7f98741566e0 2023-10-09T13:16:50.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f98737fe700 1 -- 172.21.15.86:0/786463746 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600196b0 con 0x7f98741566e0 2023-10-09T13:16:50.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 -- 172.21.15.86:0/786463746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98741566e0 msgr2=0x7f98740ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 --2- 172.21.15.86:0/786463746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98741566e0 0x7f98740ae000 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f986000bc50 tx=0x7f986000b4f0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 -- 172.21.15.86:0/786463746 shutdown_connections 2023-10-09T13:16:50.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 --2- 172.21.15.86:0/786463746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98740cb900 0x7f98740ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 --2- 172.21.15.86:0/786463746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98741566e0 0x7f98740ae000 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 -- 172.21.15.86:0/786463746 >> 172.21.15.86:0/786463746 conn(0x7f98740cc1f0 msgr2=0x7f98740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:50.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 -- 172.21.15.86:0/786463746 shutdown_connections 2023-10-09T13:16:50.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.282+0000 7f9879b9d700 1 -- 172.21.15.86:0/786463746 wait complete. 2023-10-09T13:16:50.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.284+0000 7f9879b9d700 1 Processor -- start 2023-10-09T13:16:50.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.284+0000 7f9879b9d700 1 -- start start 2023-10-09T13:16:50.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9879b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98740cb900 0x7f9874154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9879b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9874156310 0x7f9874149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9879b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98741566e0 0x7f987414b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9879b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987414ab40 con 0x7f9874156310 2023-10-09T13:16:50.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9879b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98740b0130 con 0x7f98740cb900 2023-10-09T13:16:50.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9879b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987414d2c0 con 0x7f98741566e0 2023-10-09T13:16:50.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9874156310 0x7f9874149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9874156310 0x7f9874149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39434/0 (socket says 172.21.15.86:39434) 2023-10-09T13:16:50.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 -- 172.21.15.86:0/3034429106 learned_addr learned my addr 172.21.15.86:0/3034429106 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:50.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9878b9b700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98740cb900 0x7f9874154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f987939c700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98741566e0 0x7f987414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 -- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98741566e0 msgr2=0x7f987414b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98741566e0 0x7f987414b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 -- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98740cb900 msgr2=0x7f9874154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98740cb900 0x7f9874154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f9873fff700 1 -- 172.21.15.86:0/3034429106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c009a20 con 0x7f9874156310 2023-10-09T13:16:50.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.285+0000 7f987939c700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98741566e0 0x7f987414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:50.296 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.286+0000 7f9873fff700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9874156310 0x7f9874149fc0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f986000b760 tx=0x7f986001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:50.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.286+0000 7f9870ff9700 1 -- 172.21.15.86:0/3034429106 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860010680 con 0x7f9874156310 2023-10-09T13:16:50.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.286+0000 7f9870ff9700 1 -- 172.21.15.86:0/3034429106 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860010800 con 0x7f9874156310 2023-10-09T13:16:50.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.286+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986000b790 con 0x7f9874156310 2023-10-09T13:16:50.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.286+0000 7f9870ff9700 1 -- 172.21.15.86:0/3034429106 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860010bc0 con 0x7f9874156310 2023-10-09T13:16:50.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.286+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987414d5a0 con 0x7f9874156310 2023-10-09T13:16:50.297 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.287+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987415add0 con 0x7f9874156310 2023-10-09T13:16:50.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.288+0000 7f9870ff9700 1 -- 172.21.15.86:0/3034429106 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f986002c430 con 0x7f9874156310 2023-10-09T13:16:50.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.289+0000 7f9870ff9700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 0x7f9858069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.289+0000 7f9870ff9700 1 -- 172.21.15.86:0/3034429106 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f9860014070 con 0x7f9874156310 2023-10-09T13:16:50.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.289+0000 7f9878b9b700 1 -- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 msgr2=0x7f9858069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:50.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.289+0000 7f9878b9b700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 0x7f9858069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:50.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.297+0000 7f9870ff9700 1 -- 172.21.15.86:0/3034429106 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9860053530 con 0x7f9874156310 2023-10-09T13:16:50.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.490+0000 7f9878b9b700 1 -- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 msgr2=0x7f9858069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:50.491 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.490+0000 7f9878b9b700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 0x7f9858069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:50.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.495+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98740cd0b0 con 0x7f9874156310 2023-10-09T13:16:50.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.497+0000 7f9870ff9700 1 -- 172.21.15.86:0/3034429106 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f9860056b50 con 0x7f9874156310 2023-10-09T13:16:50.499 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:50.499 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":213,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:41.609464+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T13:16:19.520774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T13:16:20.411921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6837/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:6836/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/4258990999":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/976545406":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/1033762369":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/2579375919":"2023-10-10T13:16:41.609435+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:50.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 msgr2=0x7f9858069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:50.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 0x7f9858069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9874156310 msgr2=0x7f9874149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9874156310 0x7f9874149fc0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f986000b760 tx=0x7f986001b000 comp rx=0 tx=0).stop 2023-10-09T13:16:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 shutdown_connections 2023-10-09T13:16:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f98580670e0 0x7f9858069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98741566e0 0x7f987414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98740cb900 0x7f9874154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 --2- 172.21.15.86:0/3034429106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9874156310 0x7f9874149fc0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 >> 172.21.15.86:0/3034429106 conn(0x7f98740cc1f0 msgr2=0x7f98740c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:50.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 shutdown_connections 2023-10-09T13:16:50.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.499+0000 7f9879b9d700 1 -- 172.21.15.86:0/3034429106 wait complete. 2023-10-09T13:16:50.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T13:16:50.594 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:50.593+0000 7fb1aa654180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:16:50.746 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.745+0000 7f645a19d700 1 Processor -- start 2023-10-09T13:16:50.747 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.745+0000 7f645a19d700 1 -- start start 2023-10-09T13:16:50.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.746+0000 7f645a19d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64541595a0 0x7f64540b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.746+0000 7f645a19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f64540c6c60 0x7f64540c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.746+0000 7f645a19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540b1de0 0x7f64540c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.746+0000 7f645a19d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540b2b90 con 0x7f64541595a0 2023-10-09T13:16:50.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.746+0000 7f645a19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540b1410 con 0x7f64540c6c60 2023-10-09T13:16:50.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.746+0000 7f645a19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6454063230 con 0x7f64540b1de0 2023-10-09T13:16:50.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64541595a0 0x7f64540b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64541595a0 0x7f64540b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39444/0 (socket says 172.21.15.86:39444) 2023-10-09T13:16:50.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 -- 172.21.15.86:0/78654609 learned_addr learned my addr 172.21.15.86:0/78654609 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:50.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645999c700 1 --2- 172.21.15.86:0/78654609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540b1de0 0x7f64540c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645899a700 1 --2- 172.21.15.86:0/78654609 >> v2:172.21.15.135:3300/0 conn(0x7f64540c6c60 0x7f64540c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.754 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 -- 172.21.15.86:0/78654609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540b1de0 msgr2=0x7f64540c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:50.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 --2- 172.21.15.86:0/78654609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540b1de0 0x7f64540c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 -- 172.21.15.86:0/78654609 >> v2:172.21.15.135:3300/0 conn(0x7f64540c6c60 msgr2=0x7f64540c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:50.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 --2- 172.21.15.86:0/78654609 >> v2:172.21.15.135:3300/0 conn(0x7f64540c6c60 0x7f64540c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 -- 172.21.15.86:0/78654609 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540634f0 con 0x7f64541595a0 2023-10-09T13:16:50.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.747+0000 7f645919b700 1 --2- 172.21.15.86:0/78654609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64541595a0 0x7f64540b18a0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f64540b07d0 tx=0x7f6450009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38becd150a19c493 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:50.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f644bfff700 1 -- 172.21.15.86:0/78654609 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000b860 con 0x7f64541595a0 2023-10-09T13:16:50.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f644bfff700 1 -- 172.21.15.86:0/78654609 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645000b9c0 con 0x7f64541595a0 2023-10-09T13:16:50.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f644bfff700 1 -- 172.21.15.86:0/78654609 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000bd60 con 0x7f64541595a0 2023-10-09T13:16:50.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 -- 172.21.15.86:0/78654609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64541595a0 msgr2=0x7f64540b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 --2- 172.21.15.86:0/78654609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64541595a0 0x7f64540b18a0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f64540b07d0 tx=0x7f6450009250 comp rx=0 tx=0).stop 2023-10-09T13:16:50.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 -- 172.21.15.86:0/78654609 shutdown_connections 2023-10-09T13:16:50.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 --2- 172.21.15.86:0/78654609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540b1de0 0x7f64540c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 --2- 172.21.15.86:0/78654609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64541595a0 0x7f64540b18a0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 --2- 172.21.15.86:0/78654609 >> v2:172.21.15.135:3300/0 conn(0x7f64540c6c60 0x7f64540c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 -- 172.21.15.86:0/78654609 >> 172.21.15.86:0/78654609 conn(0x7f645406ddb0 msgr2=0x7f645406e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:50.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 -- 172.21.15.86:0/78654609 shutdown_connections 2023-10-09T13:16:50.757 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.748+0000 7f645a19d700 1 -- 172.21.15.86:0/78654609 wait complete. 2023-10-09T13:16:50.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.750+0000 7f645a19d700 1 Processor -- start 2023-10-09T13:16:50.758 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.750+0000 7f645a19d700 1 -- start start 2023-10-09T13:16:50.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645a19d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64540b1de0 0x7f645415be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645a19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540c6c60 0x7f645416d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645a19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64541595a0 0x7f64541542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645a19d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645416dd90 con 0x7f64540b1de0 2023-10-09T13:16:50.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645a19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645415ed40 con 0x7f64541595a0 2023-10-09T13:16:50.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645a19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645415f020 con 0x7f64540c6c60 2023-10-09T13:16:50.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64540b1de0 0x7f645415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64540b1de0 0x7f645415be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39456/0 (socket says 172.21.15.86:39456) 2023-10-09T13:16:50.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645919b700 1 -- 172.21.15.86:0/901865911 learned_addr learned my addr 172.21.15.86:0/901865911 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:50.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645999c700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64541595a0 0x7f64541542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.751+0000 7f645899a700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540c6c60 0x7f645416d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:50.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645919b700 1 -- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540c6c60 msgr2=0x7f645416d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645919b700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540c6c60 0x7f645416d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645919b700 1 -- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64541595a0 msgr2=0x7f64541542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:50.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645919b700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64541595a0 0x7f64541542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:50.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645919b700 1 -- 172.21.15.86:0/901865911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500094f0 con 0x7f64540b1de0 2023-10-09T13:16:50.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645919b700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64540b1de0 0x7f645415be60 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f6454064340 tx=0x7f6450017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:50.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f64497fa700 1 -- 172.21.15.86:0/901865911 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450011dc0 con 0x7f64540b1de0 2023-10-09T13:16:50.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f64497fa700 1 -- 172.21.15.86:0/901865911 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450024440 con 0x7f64540b1de0 2023-10-09T13:16:50.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6454159af0 con 0x7f64540b1de0 2023-10-09T13:16:50.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f64497fa700 1 -- 172.21.15.86:0/901865911 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450024800 con 0x7f64540b1de0 2023-10-09T13:16:50.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.752+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645415c3a0 con 0x7f64540b1de0 2023-10-09T13:16:50.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.753+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645404c3c0 con 0x7f64540b1de0 2023-10-09T13:16:50.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.754+0000 7f64497fa700 1 -- 172.21.15.86:0/901865911 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f645001a420 con 0x7f64540b1de0 2023-10-09T13:16:50.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.755+0000 7f64497fa700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 0x7f6438069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:50.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.755+0000 7f64497fa700 1 -- 172.21.15.86:0/901865911 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6467+0+0 (secure 0 0 0) 0x7f6450086a30 con 0x7f64540b1de0 2023-10-09T13:16:50.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.755+0000 7f645899a700 1 -- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 msgr2=0x7f6438069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:50.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.755+0000 7f645899a700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 0x7f6438069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:50.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.759+0000 7f64497fa700 1 -- 172.21.15.86:0/901865911 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6450053700 con 0x7f64540b1de0 2023-10-09T13:16:50.836 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:50.835+0000 7f1eab7a0180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T13:16:50.883 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:50.882+0000 7fb1aa654180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:16:50.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.956+0000 7f645899a700 1 -- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 msgr2=0x7f6438069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:50.957 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:50.956+0000 7f645899a700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 0x7f6438069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:50.975 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:50.974+0000 7fb1aa654180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:16:51.006 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.005+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64540637d0 con 0x7f64540b1de0 2023-10-09T13:16:51.007 INFO:tasks.ceph.mon.a.smithi086.stderr:2023-10-09T13:16:51.006+0000 7f646f9f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T13:16:51.011 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.010+0000 7f64497fa700 1 -- 172.21.15.86:0/901865911 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6450056d20 con 0x7f64540b1de0 2023-10-09T13:16:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 msgr2=0x7f6438069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 0x7f6438069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64540b1de0 msgr2=0x7f645415be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:51.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64540b1de0 0x7f645415be60 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f6454064340 tx=0x7f6450017000 comp rx=0 tx=0).stop 2023-10-09T13:16:51.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 shutdown_connections 2023-10-09T13:16:51.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f64380670e0 0x7f6438069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64540b1de0 0x7f645415be60 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64541595a0 0x7f64541542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 --2- 172.21.15.86:0/901865911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64540c6c60 0x7f645416d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 >> 172.21.15.86:0/901865911 conn(0x7f645406ddb0 msgr2=0x7f64540c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:51.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 shutdown_connections 2023-10-09T13:16:51.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.013+0000 7f645a19d700 1 -- 172.21.15.86:0/901865911 wait complete. 2023-10-09T13:16:51.018 INFO:teuthology.orchestra.run.smithi086.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T13:16:51.018 INFO:tasks.ceph.mds.c.smithi086.stderr: -2434> 2023-10-09T13:16:26.942+0000 7ff5eddf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T13:16:51.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T13:16:51.083 INFO:tasks.ceph.mds.c.smithi086.stdout:starting mds.c at 2023-10-09T13:16:51.133 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:51.132+0000 7fb1aa654180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:16:51.140 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.139+0000 7f1eab7a0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T13:16:51.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.229+0000 7f5ade99d700 1 Processor -- start 2023-10-09T13:16:51.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.229+0000 7f5ade99d700 1 -- start start 2023-10-09T13:16:51.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5ade99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 0x7f5ad80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5ade99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5ad80ccc00 0x7f5ad8069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5ade99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80c9cb0 con 0x7f5ad806a020 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5ade99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad806dfc0 con 0x7f5ad80ccc00 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5ade99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c9f30 con 0x7f5ad8159a60 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5ade19c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5ad806a020 0x7f5ad80cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33640/0 (socket says 172.21.15.86:33640) 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5ade19c700 1 -- 172.21.15.86:0/2774839977 learned_addr learned my addr 172.21.15.86:0/2774839977 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5add19a700 1 --2- 172.21.15.86:0/2774839977 >> v2:172.21.15.135:3300/0 conn(0x7f5ad80ccc00 0x7f5ad8069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5add99b700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 0x7f5ad80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565725432 0 0) 0x7f5ad80c9cb0 con 0x7f5ad806a020 2023-10-09T13:16:51.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.231+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac4003570 con 0x7f5ad806a020 2023-10-09T13:16:51.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007983690 0 0) 0x7f5ac4003570 con 0x7f5ad806a020 2023-10-09T13:16:51.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 msgr2=0x7f5ad80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 0x7f5ad80c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 >> v2:172.21.15.135:3300/0 conn(0x7f5ad80ccc00 msgr2=0x7f5ad8069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 --2- 172.21.15.86:0/2774839977 >> v2:172.21.15.135:3300/0 conn(0x7f5ad80ccc00 0x7f5ad8069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80ca470 con 0x7f5ad806a020 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f5ad00017f0 con 0x7f5ad806a020 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add99b700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 0x7f5ad80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 >> v1:172.21.15.86:6789/0 conn(0x7f5ad806a020 legacy=0x7f5ad80cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac4003a60 0x7f5ac4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 0x7f5ac4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac4004d50 0x7f5ac40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad806dfc0 con 0x7f5ac4003a60 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c9f30 con 0x7f5ac4004d50 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac400ba60 con 0x7f5ad8159a60 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add99b700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac4003a60 0x7f5ac4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5ade19c700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac4004d50 0x7f5ac40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add19a700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 0x7f5ac4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add99b700 1 -- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 msgr2=0x7f5ac4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add99b700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ad8159a60 0x7f5ac4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add99b700 1 -- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac4004d50 msgr2=0x7f5ac40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:51.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add99b700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac4004d50 0x7f5ac40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.232+0000 7f5add99b700 1 -- 172.21.15.86:0/2774839977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009420 con 0x7f5ac4003a60 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5ade19c700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ac4004d50 0x7f5ac40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5add99b700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac4003a60 0x7f5ac4003e70 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009df0 tx=0x7f5ad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55a01e9db02c763 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4009740 con 0x7f5ac4003a60 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad400e8c0 con 0x7f5ac4003a60 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5adc999700 1 -- 172.21.15.86:0/2774839977 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400ec80 con 0x7f5ac4003a60 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5ade99d700 1 -- 172.21.15.86:0/2774839977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac4003a60 msgr2=0x7f5ac4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5ade99d700 1 --2- 172.21.15.86:0/2774839977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ac4003a60 0x7f5ac4003e70 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009df0 tx=0x7f5ad40091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.233+0000 7f5ade19c700 1 -- 172.21.15.86:0/2774839977 reap_dead start 2023-10-09T13:16:51.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.234+0000 7f5ade99d700 1 -- 172.21.15.86:0/2774839977 shutdown_connections 2023-10-09T13:16:51.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.234+0000 7f5ade99d700 1 -- 172.21.15.86:0/2774839977 >> 172.21.15.86:0/2774839977 conn(0x7f5ad806baa0 msgr2=0x7f5ad806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:51.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.234+0000 7f5ade99d700 1 -- 172.21.15.86:0/2774839977 shutdown_connections 2023-10-09T13:16:51.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.234+0000 7f5ade99d700 1 -- 172.21.15.86:0/2774839977 wait complete. 2023-10-09T13:16:51.239 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:51.238+0000 7fb1aa654180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:16:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.235+0000 7f5ade99d700 1 Processor -- start 2023-10-09T13:16:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.235+0000 7f5ade99d700 1 -- start start 2023-10-09T13:16:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5ade99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ac4003a60 0x7f5ad8141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5ade99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad8142240 0x7f5ad80b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5ade99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad80cb130 0x7f5ad80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5ade99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80b4310 con 0x7f5ad8142240 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5ade99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80cbaf0 con 0x7f5ad80cb130 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5ade99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80b22d0 con 0x7f5ac4003a60 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5add19a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad8142240 0x7f5ad80b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5add19a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad8142240 0x7f5ad80b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39486/0 (socket says 172.21.15.86:39486) 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5add19a700 1 -- 172.21.15.86:0/3326634806 learned_addr learned my addr 172.21.15.86:0/3326634806 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5add99b700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ac4003a60 0x7f5ad8141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.236+0000 7f5ade19c700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad80cb130 0x7f5ad80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5add19a700 1 -- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ac4003a60 msgr2=0x7f5ad8141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5add19a700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ac4003a60 0x7f5ad8141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5add19a700 1 -- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad80cb130 msgr2=0x7f5ad80cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:51.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5add19a700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad80cb130 0x7f5ad80cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5add19a700 1 -- 172.21.15.86:0/3326634806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8141fa0 con 0x7f5ad8142240 2023-10-09T13:16:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5add19a700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad8142240 0x7f5ad80b1430 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8011d70 tx=0x7f5ac80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800fa10 con 0x7f5ad8142240 2023-10-09T13:16:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac800fb70 con 0x7f5ad8142240 2023-10-09T13:16:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad80b1d10 con 0x7f5ad8142240 2023-10-09T13:16:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8014440 con 0x7f5ad8142240 2023-10-09T13:16:51.243 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.237+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad816d600 con 0x7f5ad8142240 2023-10-09T13:16:51.243 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.238+0000 7f1eab7a0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T13:16:51.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.238+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad806eba0 con 0x7f5ad8142240 2023-10-09T13:16:51.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.239+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 116) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5ac8014870 con 0x7f5ad8142240 2023-10-09T13:16:51.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.240+0000 7f5acdffb700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 0x7f5abc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:51.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.240+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6553+0+0 (secure 0 0 0) 0x7f5ac8018030 con 0x7f5ad8142240 2023-10-09T13:16:51.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.240+0000 7f5add99b700 1 -- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 msgr2=0x7f5abc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:51.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.240+0000 7f5add99b700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 0x7f5abc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T13:16:51.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.244+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ac8052190 con 0x7f5ad8142240 2023-10-09T13:16:51.400 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.398+0000 7f1eab7a0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T13:16:51.429 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:51.427+0000 7fb1aa654180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:16:51.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.441+0000 7f5add99b700 1 -- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 msgr2=0x7f5abc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:51.442 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.441+0000 7f5add99b700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 0x7f5abc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-09T13:16:51.489 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.487+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5ad80ca750 con 0x7f5ad8142240 2023-10-09T13:16:51.508 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.507+0000 7f1eab7a0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T13:16:51.523 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:51.522+0000 7fb1aa654180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:16:51.618 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:51.616+0000 7fb1aa654180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:16:51.701 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.700+0000 7f1eab7a0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T13:16:51.713 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-09T13:16:51.712+0000 7fb1aa654180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:16:51.795 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.794+0000 7f1eab7a0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T13:16:51.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.842+0000 7f5add99b700 1 -- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 msgr2=0x7f5abc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.86:6836/133360 2023-10-09T13:16:51.843 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.842+0000 7f5add99b700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 0x7f5abc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-09T13:16:51.889 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.888+0000 7f1eab7a0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T13:16:51.985 INFO:tasks.ceph.mgr.y.smithi086.stderr:2023-10-09T13:16:51.984+0000 7f1eab7a0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T13:16:51.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.994+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 117) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f5ac8052560 con 0x7f5ad8142240 2023-10-09T13:16:51.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.994+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 msgr2=0x7f5abc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T13:16:51.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:51.994+0000 7f5acdffb700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 0x7f5abc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.012 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.011+0000 7f5acdffb700 1 -- 172.21.15.86:0/3326634806 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v96) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ac8081d70 con 0x7f5ad8142240 2023-10-09T13:16:52.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad8142240 msgr2=0x7f5ad80b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:52.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad8142240 0x7f5ad80b1430 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8011d70 tx=0x7f5ac80091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 shutdown_connections 2023-10-09T13:16:52.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5abc0670e0 0x7f5abc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ad80cb130 0x7f5ad80cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ac4003a60 0x7f5ad8141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 --2- 172.21.15.86:0/3326634806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ad8142240 0x7f5ad80b1430 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 >> 172.21.15.86:0/3326634806 conn(0x7f5ad806baa0 msgr2=0x7f5ad80c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:52.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 shutdown_connections 2023-10-09T13:16:52.017 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.014+0000 7f5ade99d700 1 -- 172.21.15.86:0/3326634806 wait complete. 2023-10-09T13:16:52.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T13:16:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.261+0000 7f5fcb5ff700 1 Processor -- start 2023-10-09T13:16:52.262 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.261+0000 7f5fcb5ff700 1 -- start start 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.262+0000 7f5fcb5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5fc40b2100 0x7f5fc4068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.262+0000 7f5fcb5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5fc40688d0 0x7f5fc406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.262+0000 7f5fcb5ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40ae6d0 con 0x7f5fc4157740 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.262+0000 7f5fcb5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc40acc00 con 0x7f5fc40b2100 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.262+0000 7f5fcb5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc406d6a0 con 0x7f5fc40688d0 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc8b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5fc40b2100 0x7f5fc4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc939b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5fc4157740 0x7f5fc40adfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33642/0 (socket says 172.21.15.86:33642) 2023-10-09T13:16:52.264 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc939b700 1 -- 172.21.15.86:0/1839638305 learned_addr learned my addr 172.21.15.86:0/1839638305 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc9b9c700 1 --2- 172.21.15.86:0/1839638305 >> v2:172.21.15.135:3300/0 conn(0x7f5fc40688d0 0x7f5fc406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc8b9a700 1 -- 172.21.15.86:0/1839638305 >> v2:172.21.15.135:3300/0 conn(0x7f5fc40688d0 msgr2=0x7f5fc406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc8b9a700 1 --2- 172.21.15.86:0/1839638305 >> v2:172.21.15.135:3300/0 conn(0x7f5fc40688d0 0x7f5fc406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc8b9a700 1 -- 172.21.15.86:0/1839638305 >> v1:172.21.15.86:6789/0 conn(0x7f5fc4157740 legacy=0x7f5fc40adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc8b9a700 1 -- 172.21.15.86:0/1839638305 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4068d30 con 0x7f5fc40b2100 2023-10-09T13:16:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fbbfff700 1 -- 172.21.15.86:0/1839638305 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201675797 0 0) 0x7f5fc0001110 con 0x7f5fc4157740 2023-10-09T13:16:52.266 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.263+0000 7f5fc8b9a700 1 --2- 172.21.15.86:0/1839638305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40b2100 0x7f5fc4068390 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f5fc406d7e0 tx=0x7f5fb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7591fe57315c0ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fbbfff700 1 -- 172.21.15.86:0/1839638305 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400b680 con 0x7f5fc40b2100 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fbbfff700 1 -- 172.21.15.86:0/1839638305 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb400b7e0 con 0x7f5fc40b2100 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fbbfff700 1 -- 172.21.15.86:0/1839638305 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400bba0 con 0x7f5fc40b2100 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1839638305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40b2100 msgr2=0x7f5fc4068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 --2- 172.21.15.86:0/1839638305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40b2100 0x7f5fc4068390 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f5fc406d7e0 tx=0x7f5fb40091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1839638305 shutdown_connections 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 --2- 172.21.15.86:0/1839638305 >> v2:172.21.15.135:3300/0 conn(0x7f5fc40688d0 0x7f5fc406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 --2- 172.21.15.86:0/1839638305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40b2100 0x7f5fc4068390 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1839638305 >> 172.21.15.86:0/1839638305 conn(0x7f5fc40c8f90 msgr2=0x7f5fc40c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1839638305 shutdown_connections 2023-10-09T13:16:52.267 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.264+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1839638305 wait complete. 2023-10-09T13:16:52.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.266+0000 7f5fcb5ff700 1 Processor -- start 2023-10-09T13:16:52.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.266+0000 7f5fcb5ff700 1 -- start start 2023-10-09T13:16:52.269 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fcb5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40688d0 0x7f5fc40c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fcb5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fc40b2100 0x7f5fc4156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fcb5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc4157740 0x7f5fc40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fcb5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40b3a30 con 0x7f5fc40688d0 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fcb5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40b2e20 con 0x7f5fc4157740 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fcb5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40b3100 con 0x7f5fc40b2100 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40688d0 0x7f5fc40c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40688d0 0x7f5fc40c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39602/0 (socket says 172.21.15.86:39602) 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 -- 172.21.15.86:0/1274263756 learned_addr learned my addr 172.21.15.86:0/1274263756 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc9b9c700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc4157740 0x7f5fc40b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc8b9a700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fc40b2100 0x7f5fc4156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:52.270 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 -- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fc40b2100 msgr2=0x7f5fc4156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fc40b2100 0x7f5fc4156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 -- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc4157740 msgr2=0x7f5fc40b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc4157740 0x7f5fc40b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.267+0000 7f5fc939b700 1 -- 172.21.15.86:0/1274263756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb4009420 con 0x7f5fc40688d0 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.268+0000 7f5fc939b700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40688d0 0x7f5fc40c5fe0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c810 tx=0x7f5fc0007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.268+0000 7f5fb97fa700 1 -- 172.21.15.86:0/1274263756 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0005b30 con 0x7f5fc40688d0 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.268+0000 7f5fb97fa700 1 -- 172.21.15.86:0/1274263756 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc0005c90 con 0x7f5fc40688d0 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.268+0000 7f5fb97fa700 1 -- 172.21.15.86:0/1274263756 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0007300 con 0x7f5fc40688d0 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.268+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc40b33e0 con 0x7f5fc40688d0 2023-10-09T13:16:52.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.268+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc40c6520 con 0x7f5fc40688d0 2023-10-09T13:16:52.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.269+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc40b3d10 con 0x7f5fc40688d0 2023-10-09T13:16:52.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.270+0000 7f5fb97fa700 1 -- 172.21.15.86:0/1274263756 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 117) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f5fc001b3b0 con 0x7f5fc40688d0 2023-10-09T13:16:52.272 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.271+0000 7f5fb97fa700 1 -- 172.21.15.86:0/1274263756 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6854+0+0 (secure 0 0 0) 0x7f5fc00837b0 con 0x7f5fc40688d0 2023-10-09T13:16:52.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.275+0000 7f5fb97fa700 1 -- 172.21.15.86:0/1274263756 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fc0050960 con 0x7f5fc40688d0 2023-10-09T13:16:52.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:52.465+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5fc40ae6d0 con 0x7f5fc40688d0 2023-10-09T13:16:53.015 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.014+0000 7f5fb97fa700 1 -- 172.21.15.86:0/1274263756 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v216) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5fc40ae6d0 con 0x7f5fc40688d0 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.019+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40688d0 msgr2=0x7f5fc40c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.019+0000 7f5fcb5ff700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40688d0 0x7f5fc40c5fe0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c810 tx=0x7f5fc0007c50 comp rx=0 tx=0).stop 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.019+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 shutdown_connections 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.019+0000 7f5fcb5ff700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc40688d0 0x7f5fc40c5fe0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.019+0000 7f5fcb5ff700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc4157740 0x7f5fc40b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.019+0000 7f5fcb5ff700 1 --2- 172.21.15.86:0/1274263756 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fc40b2100 0x7f5fc4156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.019+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 >> 172.21.15.86:0/1274263756 conn(0x7f5fc40c8f90 msgr2=0x7f5fc40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.020+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 shutdown_connections 2023-10-09T13:16:53.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.020+0000 7f5fcb5ff700 1 -- 172.21.15.86:0/1274263756 wait complete. 2023-10-09T13:16:53.023 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_metadata' removed 2023-10-09T13:16:53.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T13:16:53.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.230+0000 7f281e7ff700 1 Processor -- start 2023-10-09T13:16:53.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.230+0000 7f281e7ff700 1 -- start start 2023-10-09T13:16:53.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.231+0000 7f281e7ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2818153f50 0x7f28180b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:53.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.231+0000 7f281e7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2818154320 0x7f281806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.231+0000 7f281e7ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180b4570 con 0x7f281815a190 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.231+0000 7f281e7ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281815a730 con 0x7f2818153f50 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.231+0000 7f281e7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281815aa10 con 0x7f2818154320 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2818153f50 0x7f28180b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2818153f50 0x7f28180b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39610/0 (socket says 172.21.15.86:39610) 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 -- 172.21.15.86:0/1482974058 learned_addr learned my addr 172.21.15.86:0/1482974058 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f28177fe700 1 --2- 172.21.15.86:0/1482974058 >> v2:172.21.15.135:3300/0 conn(0x7f2818154320 0x7f281806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 -- 172.21.15.86:0/1482974058 >> v2:172.21.15.135:3300/0 conn(0x7f2818154320 msgr2=0x7f281806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 --2- 172.21.15.86:0/1482974058 >> v2:172.21.15.135:3300/0 conn(0x7f2818154320 0x7f281806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 -- 172.21.15.86:0/1482974058 >> v1:172.21.15.86:6789/0 conn(0x7f281815a190 legacy=0x7f281815d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:53.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 -- 172.21.15.86:0/1482974058 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281815acf0 con 0x7f2818153f50 2023-10-09T13:16:53.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2816ffd700 1 -- 172.21.15.86:0/1482974058 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232021198 0 0) 0x7f28180b4570 con 0x7f281815a190 2023-10-09T13:16:53.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.232+0000 7f2817fff700 1 --2- 172.21.15.86:0/1482974058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818153f50 0x7f28180b2000 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f28180b36a0 tx=0x7f2808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98926cfd0857a39 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f2816ffd700 1 -- 172.21.15.86:0/1482974058 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280800b860 con 0x7f2818153f50 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f2816ffd700 1 -- 172.21.15.86:0/1482974058 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280800b9c0 con 0x7f2818153f50 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f2816ffd700 1 -- 172.21.15.86:0/1482974058 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280800bd60 con 0x7f2818153f50 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 -- 172.21.15.86:0/1482974058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818153f50 msgr2=0x7f28180b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 --2- 172.21.15.86:0/1482974058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818153f50 0x7f28180b2000 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f28180b36a0 tx=0x7f2808009250 comp rx=0 tx=0).stop 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 -- 172.21.15.86:0/1482974058 shutdown_connections 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 --2- 172.21.15.86:0/1482974058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2818153f50 0x7f28180b2000 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.236 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 --2- 172.21.15.86:0/1482974058 >> v2:172.21.15.135:3300/0 conn(0x7f2818154320 0x7f281806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 -- 172.21.15.86:0/1482974058 >> 172.21.15.86:0/1482974058 conn(0x7f281806baf0 msgr2=0x7f281806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:53.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 -- 172.21.15.86:0/1482974058 shutdown_connections 2023-10-09T13:16:53.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.233+0000 7f281e7ff700 1 -- 172.21.15.86:0/1482974058 wait complete. 2023-10-09T13:16:53.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.235+0000 7f281e7ff700 1 Processor -- start 2023-10-09T13:16:53.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.235+0000 7f281e7ff700 1 -- start start 2023-10-09T13:16:53.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281e7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818153f50 0x7f28180cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:53.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281e7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2818154320 0x7f28180cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:53.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281e7ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f281815a190 0x7f28180afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:53.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281e7ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180caa10 con 0x7f281815a190 2023-10-09T13:16:53.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281e7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180b0680 con 0x7f2818154320 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281e7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180cac60 con 0x7f2818153f50 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f281815a190 0x7f28180afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f2817fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818153f50 0x7f28180cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f281815a190 0x7f28180afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39626/0 (socket says 172.21.15.86:39626) 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 -- 172.21.15.86:0/2330742982 learned_addr learned my addr 172.21.15.86:0/2330742982 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f28177fe700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2818154320 0x7f28180cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 -- 172.21.15.86:0/2330742982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818153f50 msgr2=0x7f28180cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818153f50 0x7f28180cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 -- 172.21.15.86:0/2330742982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2818154320 msgr2=0x7f28180cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2818154320 0x7f28180cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.236+0000 7f281cd9c700 1 -- 172.21.15.86:0/2330742982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080094f0 con 0x7f281815a190 2023-10-09T13:16:53.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.237+0000 7f281cd9c700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f281815a190 0x7f28180afbc0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f2810001560 tx=0x7f2810001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:53.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.237+0000 7f27fffff700 1 -- 172.21.15.86:0/2330742982 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100040d0 con 0x7f281815a190 2023-10-09T13:16:53.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.237+0000 7f27fffff700 1 -- 172.21.15.86:0/2330742982 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000a7e0 con 0x7f281815a190 2023-10-09T13:16:53.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.237+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28180caf40 con 0x7f281815a190 2023-10-09T13:16:53.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.237+0000 7f27fffff700 1 -- 172.21.15.86:0/2330742982 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000aba0 con 0x7f281815a190 2023-10-09T13:16:53.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.237+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28180ce460 con 0x7f281815a190 2023-10-09T13:16:53.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.238+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28180cb460 con 0x7f281815a190 2023-10-09T13:16:53.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.239+0000 7f27fffff700 1 -- 172.21.15.86:0/2330742982 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 118) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f2810012420 con 0x7f281815a190 2023-10-09T13:16:53.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.240+0000 7f27fffff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2804066d80 0x7f2804069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:53.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.240+0000 7f27fffff700 1 -- 172.21.15.86:0/2330742982 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2810084140 con 0x7f281815a190 2023-10-09T13:16:53.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.240+0000 7f2817fff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2804066d80 0x7f2804069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:53.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.241+0000 7f2817fff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2804066d80 0x7f2804069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28180b36a0 tx=0x7f2808017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:53.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.244+0000 7f27fffff700 1 -- 172.21.15.86:0/2330742982 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28180cb460 con 0x7f281815a190 2023-10-09T13:16:53.435 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:53.434+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f28180cb460 con 0x7f281815a190 2023-10-09T13:16:54.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.025+0000 7f27fffff700 1 -- 172.21.15.86:0/2330742982 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v217) v1 ==== 169+0+0 (secure 0 0 0) 0x7f28180cb460 con 0x7f281815a190 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2804066d80 msgr2=0x7f2804069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2804066d80 0x7f2804069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28180b36a0 tx=0x7f2808017000 comp rx=0 tx=0).stop 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f281815a190 msgr2=0x7f28180afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f281815a190 0x7f28180afbc0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f2810001560 tx=0x7f2810001770 comp rx=0 tx=0).stop 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 shutdown_connections 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f2804066d80 0x7f2804069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f281815a190 0x7f28180afbc0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2818153f50 0x7f28180cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 --2- 172.21.15.86:0/2330742982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2818154320 0x7f28180cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 >> 172.21.15.86:0/2330742982 conn(0x7f281806baf0 msgr2=0x7f28180c9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:54.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 shutdown_connections 2023-10-09T13:16:54.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.029+0000 7f281e7ff700 1 -- 172.21.15.86:0/2330742982 wait complete. 2023-10-09T13:16:54.032 INFO:teuthology.orchestra.run.smithi086.stderr:pool 'cephfs_data' removed 2023-10-09T13:16:54.053 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-09T13:16:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.241+0000 7f6b1219d700 1 Processor -- start 2023-10-09T13:16:54.242 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.241+0000 7f6b1219d700 1 -- start start 2023-10-09T13:16:54.244 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.242+0000 7f6b1219d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b0c159a70 0x7f6b0c0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.242+0000 7f6b1219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c06bfa0 0x7f6b0c0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.242+0000 7f6b1219d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6b0c068390 0x7f6b0c068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.242+0000 7f6b1219d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c068d50 con 0x7f6b0c159a70 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.242+0000 7f6b1219d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c0ca920 con 0x7f6b0c068390 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.242+0000 7f6b1219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c06af00 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.242+0000 7f6b1119b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b0c159a70 0x7f6b0c0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b0c159a70 0x7f6b0c0c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39638/0 (socket says 172.21.15.86:39638) 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 -- 172.21.15.86:0/176220439 learned_addr learned my addr 172.21.15.86:0/176220439 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1099a700 1 --2- 172.21.15.86:0/176220439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c06bfa0 0x7f6b0c0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1199c700 1 --2- 172.21.15.86:0/176220439 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c068390 0x7f6b0c068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.245 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 -- 172.21.15.86:0/176220439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c06bfa0 msgr2=0x7f6b0c0c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 --2- 172.21.15.86:0/176220439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c06bfa0 0x7f6b0c0c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 -- 172.21.15.86:0/176220439 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c068390 msgr2=0x7f6b0c068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 --2- 172.21.15.86:0/176220439 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c068390 0x7f6b0c068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 -- 172.21.15.86:0/176220439 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c06b1e0 con 0x7f6b0c159a70 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b1119b700 1 --2- 172.21.15.86:0/176220439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c159a70 0x7f6b0c0c82f0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0cd2a0 tx=0x7f6b08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b155038bc6bce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b03fff700 1 -- 172.21.15.86:0/176220439 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800b860 con 0x7f6b0c159a70 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b03fff700 1 -- 172.21.15.86:0/176220439 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0800b9c0 con 0x7f6b0c159a70 2023-10-09T13:16:54.246 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.243+0000 7f6b03fff700 1 -- 172.21.15.86:0/176220439 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800bd60 con 0x7f6b0c159a70 2023-10-09T13:16:54.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 -- 172.21.15.86:0/176220439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c159a70 msgr2=0x7f6b0c0c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 --2- 172.21.15.86:0/176220439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c159a70 0x7f6b0c0c82f0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0cd2a0 tx=0x7f6b08009250 comp rx=0 tx=0).stop 2023-10-09T13:16:54.247 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 -- 172.21.15.86:0/176220439 shutdown_connections 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 --2- 172.21.15.86:0/176220439 >> v2:172.21.15.135:3300/0 conn(0x7f6b0c068390 0x7f6b0c068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 --2- 172.21.15.86:0/176220439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c159a70 0x7f6b0c0c82f0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 --2- 172.21.15.86:0/176220439 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c06bfa0 0x7f6b0c0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 -- 172.21.15.86:0/176220439 >> 172.21.15.86:0/176220439 conn(0x7f6b0c0cddc0 msgr2=0x7f6b0c0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 -- 172.21.15.86:0/176220439 shutdown_connections 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.244+0000 7f6b1219d700 1 -- 172.21.15.86:0/176220439 wait complete. 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.246+0000 7f6b1219d700 1 Processor -- start 2023-10-09T13:16:54.248 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.246+0000 7f6b1219d700 1 -- start start 2023-10-09T13:16:54.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c068390 0x7f6b0c1426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1219d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c06bfa0 0x7f6b0c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1219d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c159a70 0x7f6b0c0b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1219d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c15a740 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.250 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1219d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c16afd0 con 0x7f6b0c159a70 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c16b2b0 con 0x7f6b0c068390 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c06bfa0 0x7f6b0c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c06bfa0 0x7f6b0c159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39650/0 (socket says 172.21.15.86:39650) 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 -- 172.21.15.86:0/2740804723 learned_addr learned my addr 172.21.15.86:0/2740804723 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1199c700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c159a70 0x7f6b0c0b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1119b700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c068390 0x7f6b0c1426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 -- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c068390 msgr2=0x7f6b0c1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c068390 0x7f6b0c1426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 -- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c159a70 msgr2=0x7f6b0c0b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c159a70 0x7f6b0c0b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.251 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1099a700 1 -- 172.21.15.86:0/2740804723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080094f0 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.247+0000 7f6b1119b700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c068390 0x7f6b0c1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.248+0000 7f6b1099a700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c06bfa0 0x7f6b0c159e40 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00d890 tx=0x7f6afc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.248+0000 7f6b017fa700 1 -- 172.21.15.86:0/2740804723 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc018070 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.248+0000 7f6b017fa700 1 -- 172.21.15.86:0/2740804723 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc005a00 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.248+0000 7f6b017fa700 1 -- 172.21.15.86:0/2740804723 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc005da0 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.248+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0c16b590 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.248+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c142be0 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.252 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.249+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0c16ba90 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.250+0000 7f6b017fa700 1 -- 172.21.15.86:0/2740804723 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 118) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f6afc012800 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.251+0000 7f6b017fa700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6af0066d80 0x7f6af0069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.251+0000 7f6b017fa700 1 -- 172.21.15.86:0/2740804723 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f6afc0843e0 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.251+0000 7f6b1119b700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6af0066d80 0x7f6af0069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.253 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.252+0000 7f6b1119b700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6af0066d80 0x7f6af0069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0cd2a0 tx=0x7f6b08017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:54.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.255+0000 7f6b017fa700 1 -- 172.21.15.86:0/2740804723 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6afc055260 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.447 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.446+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f6b0c06b4c0 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.450+0000 7f6b017fa700 1 -- 172.21.15.86:0/2740804723 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v73) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6afc054df0 con 0x7f6b0c06bfa0 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6af0066d80 msgr2=0x7f6af0069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6af0066d80 0x7f6af0069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0cd2a0 tx=0x7f6b08017000 comp rx=0 tx=0).stop 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c06bfa0 msgr2=0x7f6b0c159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c06bfa0 0x7f6b0c159e40 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00d890 tx=0x7f6afc008040 comp rx=0 tx=0).stop 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 shutdown_connections 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f6af0066d80 0x7f6af0069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b0c159a70 0x7f6b0c0b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6b0c068390 0x7f6b0c1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 --2- 172.21.15.86:0/2740804723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c06bfa0 0x7f6b0c159e40 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 >> 172.21.15.86:0/2740804723 conn(0x7f6b0c0cddc0 msgr2=0x7f6b0c1550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 shutdown_connections 2023-10-09T13:16:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.453+0000 7f6b1219d700 1 -- 172.21.15.86:0/2740804723 wait complete. 2023-10-09T13:16:54.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-09T13:16:54.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.664+0000 7eff67dff700 1 Processor -- start 2023-10-09T13:16:54.665 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.664+0000 7eff67dff700 1 -- start start 2023-10-09T13:16:54.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.665+0000 7eff67dff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff600c70b0 0x7eff60069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.667 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.665+0000 7eff67dff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6006e950 con 0x7eff60069cb0 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.665+0000 7eff67dff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6006eb90 con 0x7eff60155eb0 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.665+0000 7eff67dff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6006a130 con 0x7eff600c70b0 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff6539a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff600c70b0 0x7eff60069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff6639c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7eff60069cb0 0x7eff600ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:33672/0 (socket says 172.21.15.86:33672) 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff6639c700 1 -- 172.21.15.86:0/407754594 learned_addr learned my addr 172.21.15.86:0/407754594 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff6539a700 1 -- 172.21.15.86:0/407754594 >> v1:172.21.15.135:6789/0 conn(0x7eff60155eb0 legacy=0x7eff6006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff6539a700 1 -- 172.21.15.86:0/407754594 >> v1:172.21.15.86:6789/0 conn(0x7eff60069cb0 legacy=0x7eff600ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff6539a700 1 -- 172.21.15.86:0/407754594 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6006ee70 con 0x7eff600c70b0 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff64b99700 1 -- 172.21.15.86:0/407754594 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017593769 0 0) 0x7eff58001490 con 0x7eff60069cb0 2023-10-09T13:16:54.668 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.666+0000 7eff6539a700 1 --2- 172.21.15.86:0/407754594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff600c70b0 0x7eff60069770 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7eff5000bb90 tx=0x7eff5000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20d07cb22c4ec19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:54.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff64b99700 1 -- 172.21.15.86:0/407754594 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000da90 con 0x7eff600c70b0 2023-10-09T13:16:54.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff64b99700 1 -- 172.21.15.86:0/407754594 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5000dbf0 con 0x7eff600c70b0 2023-10-09T13:16:54.669 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff64b99700 1 -- 172.21.15.86:0/407754594 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50017410 con 0x7eff600c70b0 2023-10-09T13:16:54.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff67dff700 1 -- 172.21.15.86:0/407754594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff600c70b0 msgr2=0x7eff60069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff67dff700 1 --2- 172.21.15.86:0/407754594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff600c70b0 0x7eff60069770 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7eff5000bb90 tx=0x7eff5000b430 comp rx=0 tx=0).stop 2023-10-09T13:16:54.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff67dff700 1 -- 172.21.15.86:0/407754594 shutdown_connections 2023-10-09T13:16:54.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff67dff700 1 --2- 172.21.15.86:0/407754594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff600c70b0 0x7eff60069770 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff67dff700 1 -- 172.21.15.86:0/407754594 >> 172.21.15.86:0/407754594 conn(0x7eff60068e10 msgr2=0x7eff600cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:54.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff67dff700 1 -- 172.21.15.86:0/407754594 shutdown_connections 2023-10-09T13:16:54.670 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.667+0000 7eff67dff700 1 -- 172.21.15.86:0/407754594 wait complete. 2023-10-09T13:16:54.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.669+0000 7eff67dff700 1 Processor -- start 2023-10-09T13:16:54.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.669+0000 7eff67dff700 1 -- start start 2023-10-09T13:16:54.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff67dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff60069cb0 0x7eff600aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff67dff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff600c70b0 0x7eff600aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.672 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff67dff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff60155eb0 0x7eff600ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff67dff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600ac970 con 0x7eff60155eb0 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff67dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600abd60 con 0x7eff60069cb0 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff67dff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff600ac040 con 0x7eff600c70b0 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff60155eb0 0x7eff600ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff60155eb0 0x7eff600ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39662/0 (socket says 172.21.15.86:39662) 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 -- 172.21.15.86:0/3479502571 learned_addr learned my addr 172.21.15.86:0/3479502571 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff65b9b700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff60069cb0 0x7eff600aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6539a700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff600c70b0 0x7eff600aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 -- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff600c70b0 msgr2=0x7eff600aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff600c70b0 0x7eff600aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.673 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 -- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff60069cb0 msgr2=0x7eff600aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff60069cb0 0x7eff600aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.670+0000 7eff6639c700 1 -- 172.21.15.86:0/3479502571 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5000b6d0 con 0x7eff60155eb0 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.671+0000 7eff6639c700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff60155eb0 0x7eff600ace50 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7eff5800cc90 tx=0x7eff58001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.671+0000 7eff55ffb700 1 -- 172.21.15.86:0/3479502571 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58004bb0 con 0x7eff60155eb0 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.671+0000 7eff55ffb700 1 -- 172.21.15.86:0/3479502571 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58004d10 con 0x7eff60155eb0 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.671+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff600ac320 con 0x7eff60155eb0 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.671+0000 7eff55ffb700 1 -- 172.21.15.86:0/3479502571 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800ab00 con 0x7eff60155eb0 2023-10-09T13:16:54.674 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.671+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff601476c0 con 0x7eff60155eb0 2023-10-09T13:16:54.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.672+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff600aa4c0 con 0x7eff60155eb0 2023-10-09T13:16:54.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.673+0000 7eff55ffb700 1 -- 172.21.15.86:0/3479502571 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff580070f0 con 0x7eff60155eb0 2023-10-09T13:16:54.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.674+0000 7eff55ffb700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:54.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.674+0000 7eff55ffb700 1 -- 172.21.15.86:0/3479502571 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7eff58084270 con 0x7eff60155eb0 2023-10-09T13:16:54.675 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.674+0000 7eff65b9b700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:54.676 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.674+0000 7eff65b9b700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7eff44066f30 0x7eff440693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0039e0 tx=0x7eff5c007ec0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:54.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.678+0000 7eff55ffb700 1 -- 172.21.15.86:0/3479502571 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff58051430 con 0x7eff60155eb0 2023-10-09T13:16:54.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.866+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7eff6006e950 con 0x7eff60155eb0 2023-10-09T13:16:54.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.871+0000 7eff55ffb700 1 -- 172.21.15.86:0/3479502571 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v74) v1 ==== 120+0+0 (secure 0 0 0) 0x7eff6006e950 con 0x7eff60155eb0 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7eff44066f30 msgr2=0x7eff440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7eff44066f30 0x7eff440693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0039e0 tx=0x7eff5c007ec0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff60155eb0 msgr2=0x7eff600ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff60155eb0 0x7eff600ace50 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7eff5800cc90 tx=0x7eff58001a50 comp rx=0 tx=0).stop 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 shutdown_connections 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7eff44066f30 0x7eff440693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff60155eb0 0x7eff600ace50 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.875 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff60069cb0 0x7eff600aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 --2- 172.21.15.86:0/3479502571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff600c70b0 0x7eff600aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:54.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 >> 172.21.15.86:0/3479502571 conn(0x7eff60068e10 msgr2=0x7eff600c21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:54.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.873+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 shutdown_connections 2023-10-09T13:16:54.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:54.874+0000 7eff67dff700 1 -- 172.21.15.86:0/3479502571 wait complete. 2023-10-09T13:16:54.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T13:16:55.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.076+0000 7fd34c3ff700 1 Processor -- start 2023-10-09T13:16:55.077 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.076+0000 7fd34c3ff700 1 -- start start 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.077+0000 7fd34c3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd34406c0a0 0x7fd3440caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.077+0000 7fd34c3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd34415df50 0x7fd34415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.077+0000 7fd34c3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34415d7e0 con 0x7fd34406bcd0 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.077+0000 7fd34c3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34415dac0 con 0x7fd34406c0a0 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.077+0000 7fd34c3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34415aa30 con 0x7fd34415df50 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34a19b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd34406bcd0 0x7fd34415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58832/0 (socket says 172.21.15.86:58832) 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34a19b700 1 -- 172.21.15.86:0/1963548555 learned_addr learned my addr 172.21.15.86:0/1963548555 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:55.079 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34999a700 1 --2- 172.21.15.86:0/1963548555 >> v2:172.21.15.86:3300/0 conn(0x7fd34406c0a0 0x7fd3440caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd349199700 1 -- 172.21.15.86:0/1963548555 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872856171 0 0) 0x7fd34415d7e0 con 0x7fd34406bcd0 2023-10-09T13:16:55.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34999a700 1 -- 172.21.15.86:0/1963548555 >> v2:172.21.15.135:3300/0 conn(0x7fd34415df50 msgr2=0x7fd34415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:55.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34a99c700 1 --2- 172.21.15.86:0/1963548555 >> v2:172.21.15.135:3300/0 conn(0x7fd34415df50 0x7fd34415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34999a700 1 --2- 172.21.15.86:0/1963548555 >> v2:172.21.15.135:3300/0 conn(0x7fd34415df50 0x7fd34415e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34999a700 1 -- 172.21.15.86:0/1963548555 >> v1:172.21.15.86:6789/0 conn(0x7fd34406bcd0 legacy=0x7fd34415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34999a700 1 -- 172.21.15.86:0/1963548555 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34415ad10 con 0x7fd34406c0a0 2023-10-09T13:16:55.081 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34a99c700 1 --2- 172.21.15.86:0/1963548555 >> v2:172.21.15.135:3300/0 conn(0x7fd34415df50 0x7fd34415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.078+0000 7fd34999a700 1 --2- 172.21.15.86:0/1963548555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406c0a0 0x7fd3440caa90 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fd34415d720 tx=0x7fd3340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833a50cdc636d60d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd349199700 1 -- 172.21.15.86:0/1963548555 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400b6b0 con 0x7fd34406c0a0 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd349199700 1 -- 172.21.15.86:0/1963548555 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400b810 con 0x7fd34406c0a0 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd349199700 1 -- 172.21.15.86:0/1963548555 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400bbb0 con 0x7fd34406c0a0 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 -- 172.21.15.86:0/1963548555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406c0a0 msgr2=0x7fd3440caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/1963548555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406c0a0 0x7fd3440caa90 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fd34415d720 tx=0x7fd3340091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 -- 172.21.15.86:0/1963548555 shutdown_connections 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/1963548555 >> v2:172.21.15.135:3300/0 conn(0x7fd34415df50 0x7fd34415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/1963548555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406c0a0 0x7fd3440caa90 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 -- 172.21.15.86:0/1963548555 >> 172.21.15.86:0/1963548555 conn(0x7fd3440ce600 msgr2=0x7fd3440cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:55.082 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 -- 172.21.15.86:0/1963548555 shutdown_connections 2023-10-09T13:16:55.083 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.079+0000 7fd34c3ff700 1 -- 172.21.15.86:0/1963548555 wait complete. 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.081+0000 7fd34c3ff700 1 Processor -- start 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.081+0000 7fd34c3ff700 1 -- start start 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34c3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406bcd0 0x7fd3440c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34c3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34406c0a0 0x7fd34416b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34c3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34415df50 0x7fd3440c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34c3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34416b680 con 0x7fd34406bcd0 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34c3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440c5c90 con 0x7fd34406c0a0 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34c3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440c5f70 con 0x7fd34415df50 2023-10-09T13:16:55.085 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406bcd0 0x7fd3440c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406bcd0 0x7fd3440c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46574/0 (socket says 172.21.15.86:46574) 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 -- 172.21.15.86:0/600331118 learned_addr learned my addr 172.21.15.86:0/600331118 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34999a700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34406c0a0 0x7fd34416b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a99c700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34415df50 0x7fd3440c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 -- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34415df50 msgr2=0x7fd3440c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34415df50 0x7fd3440c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 -- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34406c0a0 msgr2=0x7fd34416b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34406c0a0 0x7fd34416b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 -- 172.21.15.86:0/600331118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334009420 con 0x7fd34406bcd0 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34999a700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34406c0a0 0x7fd34416b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:16:55.086 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.082+0000 7fd34a19b700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406bcd0 0x7fd3440c56b0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c5b0 tx=0x7fd340001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:55.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.083+0000 7fd33a7fc700 1 -- 172.21.15.86:0/600331118 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340005b30 con 0x7fd34406bcd0 2023-10-09T13:16:55.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.083+0000 7fd33a7fc700 1 -- 172.21.15.86:0/600331118 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340005c90 con 0x7fd34406bcd0 2023-10-09T13:16:55.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.083+0000 7fd33a7fc700 1 -- 172.21.15.86:0/600331118 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340007300 con 0x7fd34406bcd0 2023-10-09T13:16:55.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.083+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3440c6250 con 0x7fd34406bcd0 2023-10-09T13:16:55.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.083+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3440c6810 con 0x7fd34406bcd0 2023-10-09T13:16:55.087 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.084+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3440c6b80 con 0x7fd34406bcd0 2023-10-09T13:16:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.085+0000 7fd33a7fc700 1 -- 172.21.15.86:0/600331118 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd34001b3b0 con 0x7fd34406bcd0 2023-10-09T13:16:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.086+0000 7fd33a7fc700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd328066f60 0x7fd328069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.086+0000 7fd33a7fc700 1 -- 172.21.15.86:0/600331118 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fd340083b70 con 0x7fd34406bcd0 2023-10-09T13:16:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.086+0000 7fd34999a700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd328066f60 0x7fd328069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.087+0000 7fd34999a700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd328066f60 0x7fd328069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3340093f0 tx=0x7fd334017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:55.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.090+0000 7fd33a7fc700 1 -- 172.21.15.86:0/600331118 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd340050cb0 con 0x7fd34406bcd0 2023-10-09T13:16:55.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.281+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd34404c3c0 con 0x7fd34406bcd0 2023-10-09T13:16:55.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.287+0000 7fd33a7fc700 1 -- 172.21.15.86:0/600331118 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd3400542d0 con 0x7fd34406bcd0 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd328066f60 msgr2=0x7fd328069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd328066f60 0x7fd328069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3340093f0 tx=0x7fd334017000 comp rx=0 tx=0).stop 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406bcd0 msgr2=0x7fd3440c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406bcd0 0x7fd3440c56b0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c5b0 tx=0x7fd340001070 comp rx=0 tx=0).stop 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 shutdown_connections 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd328066f60 0x7fd328069410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd34406bcd0 0x7fd3440c56b0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd34415df50 0x7fd3440c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 --2- 172.21.15.86:0/600331118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd34406c0a0 0x7fd34416b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 >> 172.21.15.86:0/600331118 conn(0x7fd3440ce600 msgr2=0x7fd34415b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:55.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 shutdown_connections 2023-10-09T13:16:55.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.290+0000 7fd34c3ff700 1 -- 172.21.15.86:0/600331118 wait complete. 2023-10-09T13:16:55.309 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-09T13:16:55.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.488+0000 7fc19dd9d700 1 Processor -- start 2023-10-09T13:16:55.490 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.489+0000 7fc19dd9d700 1 -- start start 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc19dd9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc198150180 0x7fc198157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc19dd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 0x7fc198069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc19dd9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19806e2a0 con 0x7fc198150550 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc19dd9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19806b2e0 con 0x7fc198150180 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc19dd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980c78e0 con 0x7fc1980c7410 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc197fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc198150550 0x7fc1980c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58842/0 (socket says 172.21.15.86:58842) 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc197fff700 1 -- 172.21.15.86:0/2530847774 learned_addr learned my addr 172.21.15.86:0/2530847774 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc19cd9b700 1 --2- 172.21.15.86:0/2530847774 >> v2:172.21.15.135:3300/0 conn(0x7fc198150180 0x7fc198157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.490+0000 7fc19d59c700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 0x7fc198069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.492 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681356456 0 0) 0x7fc19806e2a0 con 0x7fc198150550 2023-10-09T13:16:55.493 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc188003570 con 0x7fc198150550 2023-10-09T13:16:55.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914308289 0 0) 0x7fc188003570 con 0x7fc198150550 2023-10-09T13:16:55.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 msgr2=0x7fc198069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:55.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 0x7fc198069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 >> v2:172.21.15.135:3300/0 conn(0x7fc198150180 msgr2=0x7fc198157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:55.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 --2- 172.21.15.86:0/2530847774 >> v2:172.21.15.135:3300/0 conn(0x7fc198150180 0x7fc198157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1980c7bc0 con 0x7fc198150550 2023-10-09T13:16:55.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fc184001470 con 0x7fc198150550 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 >> v1:172.21.15.86:6789/0 conn(0x7fc198150550 legacy=0x7fc1980c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc188003ae0 0x7fc188003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc188004810 0x7fc188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 0x7fc1880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19806b2e0 con 0x7fc188004810 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1980c78e0 con 0x7fc188003ae0 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18800bb10 con 0x7fc1980c7410 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc197fff700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc188004810 0x7fc188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc19cd9b700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc188003ae0 0x7fc188003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.491+0000 7fc19d59c700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 0x7fc1880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc197fff700 1 -- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 msgr2=0x7fc1880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc197fff700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1980c7410 0x7fc1880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc197fff700 1 -- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc188003ae0 msgr2=0x7fc188003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc197fff700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc188003ae0 0x7fc188003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc197fff700 1 -- 172.21.15.86:0/2530847774 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188003570 con 0x7fc188004810 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc197fff700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc188004810 0x7fc188004c80 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c2d0 tx=0x7fc184001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b770bfe9b8cf00ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18400cba0 con 0x7fc188004810 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18400cd20 con 0x7fc188004810 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.492+0000 7fc1977fe700 1 -- 172.21.15.86:0/2530847774 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184005b70 con 0x7fc188004810 2023-10-09T13:16:55.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.493+0000 7fc19dd9d700 1 -- 172.21.15.86:0/2530847774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc188004810 msgr2=0x7fc188004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.493+0000 7fc19dd9d700 1 --2- 172.21.15.86:0/2530847774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc188004810 0x7fc188004c80 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c2d0 tx=0x7fc184001dc0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.493+0000 7fc19d59c700 1 -- 172.21.15.86:0/2530847774 reap_dead start 2023-10-09T13:16:55.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.493+0000 7fc19dd9d700 1 -- 172.21.15.86:0/2530847774 shutdown_connections 2023-10-09T13:16:55.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.493+0000 7fc19dd9d700 1 -- 172.21.15.86:0/2530847774 >> 172.21.15.86:0/2530847774 conn(0x7fc1980cc1f0 msgr2=0x7fc1980cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:55.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.493+0000 7fc19dd9d700 1 -- 172.21.15.86:0/2530847774 shutdown_connections 2023-10-09T13:16:55.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.493+0000 7fc19dd9d700 1 -- 172.21.15.86:0/2530847774 wait complete. 2023-10-09T13:16:55.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.494+0000 7fc19dd9d700 1 Processor -- start 2023-10-09T13:16:55.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.494+0000 7fc19dd9d700 1 -- start start 2023-10-09T13:16:55.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.495+0000 7fc19dd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc188004810 0x7fc19815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.495+0000 7fc19dd9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1981581f0 0x7fc198169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.495+0000 7fc19dd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc198154d30 0x7fc1981551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.495+0000 7fc19dd9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1981556f0 con 0x7fc1981581f0 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.495+0000 7fc19dd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19816b0f0 con 0x7fc198154d30 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.495+0000 7fc19dd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19816b3d0 con 0x7fc188004810 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1981581f0 0x7fc198169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1981581f0 0x7fc198169ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46592/0 (socket says 172.21.15.86:46592) 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 -- 172.21.15.86:0/881789832 learned_addr learned my addr 172.21.15.86:0/881789832 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc19cd9b700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc188004810 0x7fc19815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc19d59c700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc198154d30 0x7fc1981551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 -- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc188004810 msgr2=0x7fc19815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc188004810 0x7fc19815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 -- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc198154d30 msgr2=0x7fc1981551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc198154d30 0x7fc1981551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 -- 172.21.15.86:0/881789832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19816a770 con 0x7fc1981581f0 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.496+0000 7fc197fff700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1981581f0 0x7fc198169ee0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c8c0 tx=0x7fc184012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.497+0000 7fc194ff9700 1 -- 172.21.15.86:0/881789832 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18400c8f0 con 0x7fc1981581f0 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.497+0000 7fc194ff9700 1 -- 172.21.15.86:0/881789832 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18400ce90 con 0x7fc1981581f0 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.497+0000 7fc194ff9700 1 -- 172.21.15.86:0/881789832 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840072e0 con 0x7fc1981581f0 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.497+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19816aa50 con 0x7fc1981581f0 2023-10-09T13:16:55.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.497+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19816a420 con 0x7fc1981581f0 2023-10-09T13:16:55.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.498+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19816b560 con 0x7fc1981581f0 2023-10-09T13:16:55.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.499+0000 7fc194ff9700 1 -- 172.21.15.86:0/881789832 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc184019030 con 0x7fc1981581f0 2023-10-09T13:16:55.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.500+0000 7fc194ff9700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc17c066f20 0x7fc17c0693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:55.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.500+0000 7fc194ff9700 1 -- 172.21.15.86:0/881789832 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fc184085940 con 0x7fc1981581f0 2023-10-09T13:16:55.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.500+0000 7fc19cd9b700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc17c066f20 0x7fc17c0693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:55.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.500+0000 7fc19cd9b700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc17c066f20 0x7fc17c0693d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc18c006f00 tx=0x7fc18c0091a0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:55.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.504+0000 7fc194ff9700 1 -- 172.21.15.86:0/881789832 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1840529e0 con 0x7fc1981581f0 2023-10-09T13:16:55.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:55.772+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fc19804c3c0 con 0x7fc1981581f0 2023-10-09T13:16:56.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.031+0000 7fc194ff9700 1 -- 172.21.15.86:0/881789832 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3100) v1 ==== 155+0+0 (secure 0 0 0) 0x7fc1840170e0 con 0x7fc1981581f0 2023-10-09T13:16:56.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc17c066f20 msgr2=0x7fc17c0693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:56.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc17c066f20 0x7fc17c0693d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc18c006f00 tx=0x7fc18c0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:56.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1981581f0 msgr2=0x7fc198169ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:56.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1981581f0 0x7fc198169ee0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fc18400c8c0 tx=0x7fc184012000 comp rx=0 tx=0).stop 2023-10-09T13:16:56.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 shutdown_connections 2023-10-09T13:16:56.035 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fc17c066f20 0x7fc17c0693d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:56.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc198154d30 0x7fc1981551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:56.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc188004810 0x7fc19815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:56.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 --2- 172.21.15.86:0/881789832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1981581f0 0x7fc198169ee0 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:56.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 >> 172.21.15.86:0/881789832 conn(0x7fc1980cc1f0 msgr2=0x7fc1980abc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:56.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 shutdown_connections 2023-10-09T13:16:56.036 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:56.033+0000 7fc19dd9d700 1 -- 172.21.15.86:0/881789832 wait complete. 2023-10-09T13:16:56.053 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-10-09T13:16:56.053 INFO:tasks.cephfs_test_runner: 2023-10-09T13:16:56.053 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T13:16:56.053 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5706.933s 2023-10-09T13:16:56.054 INFO:tasks.cephfs_test_runner: 2023-10-09T13:16:56.054 INFO:tasks.cephfs_test_runner:OK 2023-10-09T13:16:56.054 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-09T13:16:56.066 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-09T13:16:56.110 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-09T13:16:56.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.110 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T13:16:56.147 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T13:16:56.147 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T13:16:56.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T13:16:56.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.248 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T13:16:56.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2023-10-09T13:16:56.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.431 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-10-09T13:16:56.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2023-10-09T13:16:56.576 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2023-10-09T13:16:56.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T13:16:56.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.579 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-09T13:16:56.619 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T13:16:56.619 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T13:16:56.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.620 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T13:16:56.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.725 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T13:16:56.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.795 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-09T13:16:56.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.932 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-09T13:16:56.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T13:16:56.968 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-09T13:16:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-10-09T13:16:57.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T13:16:57.077 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-09T13:16:57.086 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-09T13:16:57.087 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:57.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.270+0000 7f556a39d700 1 Processor -- start 2023-10-09T13:16:57.271 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.270+0000 7f556a39d700 1 -- start start 2023-10-09T13:16:57.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.271+0000 7f556a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5564150180 0x7f5564157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.271+0000 7f556a39d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f55640c7410 0x7f5564069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.271+0000 7f556a39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556406e2a0 con 0x7f5564150550 2023-10-09T13:16:57.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.271+0000 7f556a39d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556406b2e0 con 0x7f55640c7410 2023-10-09T13:16:57.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.271+0000 7f556a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55640c78e0 con 0x7f5564150180 2023-10-09T13:16:57.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.271+0000 7f5569b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f55640c7410 0x7f5564069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f5569b9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f55640c7410 0x7f5564069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46594/0 (socket says 172.21.15.86:46594) 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f5569b9c700 1 -- 172.21.15.86:0/3125452228 learned_addr learned my addr 172.21.15.86:0/3125452228 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f556939b700 1 --2- 172.21.15.86:0/3125452228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5564150180 0x7f5564157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f5569b9c700 1 -- 172.21.15.86:0/3125452228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5564150180 msgr2=0x7f5564157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f5569b9c700 1 --2- 172.21.15.86:0/3125452228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5564150180 0x7f5564157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f5569b9c700 1 -- 172.21.15.86:0/3125452228 >> v1:172.21.15.135:6789/0 conn(0x7f5564150550 legacy=0x7f55640c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f5569b9c700 1 -- 172.21.15.86:0/3125452228 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640c7bc0 con 0x7f55640c7410 2023-10-09T13:16:57.276 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f5569b9c700 1 --2- 172.21.15.86:0/3125452228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55640c7410 0x7f5564069f50 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f555c00d1a0 tx=0x7f555c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88934ea0dbfd41e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:57.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f555bfff700 1 -- 172.21.15.86:0/3125452228 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c010070 con 0x7f55640c7410 2023-10-09T13:16:57.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f555bfff700 1 -- 172.21.15.86:0/3125452228 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c00b0d0 con 0x7f55640c7410 2023-10-09T13:16:57.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.272+0000 7f555bfff700 1 -- 172.21.15.86:0/3125452228 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00b490 con 0x7f55640c7410 2023-10-09T13:16:57.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 -- 172.21.15.86:0/3125452228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55640c7410 msgr2=0x7f5564069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 --2- 172.21.15.86:0/3125452228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55640c7410 0x7f5564069f50 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f555c00d1a0 tx=0x7f555c00ba50 comp rx=0 tx=0).stop 2023-10-09T13:16:57.277 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 -- 172.21.15.86:0/3125452228 shutdown_connections 2023-10-09T13:16:57.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 --2- 172.21.15.86:0/3125452228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55640c7410 0x7f5564069f50 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 --2- 172.21.15.86:0/3125452228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5564150180 0x7f5564157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 -- 172.21.15.86:0/3125452228 >> 172.21.15.86:0/3125452228 conn(0x7f55640cc1f0 msgr2=0x7f55640cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:57.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 -- 172.21.15.86:0/3125452228 shutdown_connections 2023-10-09T13:16:57.278 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.273+0000 7f556a39d700 1 -- 172.21.15.86:0/3125452228 wait complete. 2023-10-09T13:16:57.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.275+0000 7f556a39d700 1 Processor -- start 2023-10-09T13:16:57.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.275+0000 7f556a39d700 1 -- start start 2023-10-09T13:16:57.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f556a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55640c7410 0x7f55640b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f556a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564150180 0x7f55640ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f556a39d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5564150550 0x7f5564154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f556a39d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564149600 con 0x7f5564150550 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f556a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55640b1e50 con 0x7f5564150180 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f556a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55640adb90 con 0x7f55640c7410 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5564150550 0x7f5564154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5564150550 0x7f5564154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46606/0 (socket says 172.21.15.86:46606) 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 -- 172.21.15.86:0/1841040622 learned_addr learned my addr 172.21.15.86:0/1841040622 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f556939b700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55640c7410 0x7f55640b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5568b9a700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564150180 0x7f55640ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 -- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55640c7410 msgr2=0x7f55640b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55640c7410 0x7f55640b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 -- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564150180 msgr2=0x7f55640ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564150180 0x7f55640ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 -- 172.21.15.86:0/1841040622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c00bcf0 con 0x7f5564150550 2023-10-09T13:16:57.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.276+0000 7f5569b9c700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5564150550 0x7f5564154d30 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f556406fe40 tx=0x7f555c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:57.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.277+0000 7f55597fa700 1 -- 172.21.15.86:0/1841040622 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00acb0 con 0x7f5564150550 2023-10-09T13:16:57.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.277+0000 7f55597fa700 1 -- 172.21.15.86:0/1841040622 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c00ae50 con 0x7f5564150550 2023-10-09T13:16:57.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.277+0000 7f55597fa700 1 -- 172.21.15.86:0/1841040622 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c01d680 con 0x7f5564150550 2023-10-09T13:16:57.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.277+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55640ca440 con 0x7f5564150550 2023-10-09T13:16:57.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.277+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55640caa00 con 0x7f5564150550 2023-10-09T13:16:57.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.278+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556404c3c0 con 0x7f5564150550 2023-10-09T13:16:57.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.279+0000 7f55597fa700 1 -- 172.21.15.86:0/1841040622 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f555c003040 con 0x7f5564150550 2023-10-09T13:16:57.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.279+0000 7f55597fa700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5548066f00 0x7f55480693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.280+0000 7f55597fa700 1 -- 172.21.15.86:0/1841040622 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f555c085ea0 con 0x7f5564150550 2023-10-09T13:16:57.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.280+0000 7f556939b700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5548066f00 0x7f55480693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.280+0000 7f556939b700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5548066f00 0x7f55480693b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5560006fd0 tx=0x7f5560008040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:57.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.284+0000 7f55597fa700 1 -- 172.21.15.86:0/1841040622 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f555c052fe0 con 0x7f5564150550 2023-10-09T13:16:57.476 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.474+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f556406ada0 con 0x7f5564150550 2023-10-09T13:16:57.477 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.475+0000 7f55597fa700 1 -- 172.21.15.86:0/1841040622 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) v1 ==== 74+0+13898 (secure 0 0 0) 0x7f555c056600 con 0x7f5564150550 2023-10-09T13:16:57.477 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:57.478 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":217,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:54.021274+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:0/1984974562":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/1895544307":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/613401282":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/2242263466":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/2288569450":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/3881135967":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/285548301":"2023-10-10T13:16:51.987598+0000","172.21.15.86:6835/903379396":"2023-10-10T13:16:51.007444+0000","172.21.15.86:6837/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:6836/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/4258990999":"2023-10-10T13:16:41.609435+0000","172.21.15.86:6834/903379396":"2023-10-10T13:16:51.007444+0000","172.21.15.86:0/976545406":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/1033762369":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/2579375919":"2023-10-10T13:16:41.609435+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:57.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5548066f00 msgr2=0x7f55480693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5548066f00 0x7f55480693b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5560006fd0 tx=0x7f5560008040 comp rx=0 tx=0).stop 2023-10-09T13:16:57.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5564150550 msgr2=0x7f5564154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.480 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5564150550 0x7f5564154d30 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f556406fe40 tx=0x7f555c01a000 comp rx=0 tx=0).stop 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 shutdown_connections 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5548066f00 0x7f55480693b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5564150550 0x7f5564154d30 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55640c7410 0x7f55640b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 --2- 172.21.15.86:0/1841040622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564150180 0x7f55640ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 >> 172.21.15.86:0/1841040622 conn(0x7f55640cc1f0 msgr2=0x7f5564159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 shutdown_connections 2023-10-09T13:16:57.481 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.478+0000 7f556a39d700 1 -- 172.21.15.86:0/1841040622 wait complete. 2023-10-09T13:16:57.496 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T13:16:57.497 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:57.678 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.677+0000 7fbbff1ff700 1 Processor -- start 2023-10-09T13:16:57.679 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.677+0000 7fbbff1ff700 1 -- start start 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.678+0000 7fbbff1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbbf806bcd0 0x7fbbf80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.678+0000 7fbbff1ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbbf806c0a0 0x7fbbf815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.678+0000 7fbbff1ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf815d7e0 con 0x7fbbf815df50 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbff1ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf815dac0 con 0x7fbbf806c0a0 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbff1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf815aa30 con 0x7fbbf806bcd0 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbf7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbbf806c0a0 0x7fbbf815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbfd79c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbbf815df50 0x7fbbf80c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58852/0 (socket says 172.21.15.86:58852) 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbf7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbbf806c0a0 0x7fbbf815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46608/0 (socket says 172.21.15.86:46608) 2023-10-09T13:16:57.681 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbfd79c700 1 -- 172.21.15.86:0/421431020 learned_addr learned my addr 172.21.15.86:0/421431020 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbfcf9b700 1 --2- 172.21.15.86:0/421431020 >> v2:172.21.15.135:3300/0 conn(0x7fbbf806bcd0 0x7fbbf80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbf7fff700 1 -- 172.21.15.86:0/421431020 >> v2:172.21.15.135:3300/0 conn(0x7fbbf806bcd0 msgr2=0x7fbbf80caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbf7fff700 1 --2- 172.21.15.86:0/421431020 >> v2:172.21.15.135:3300/0 conn(0x7fbbf806bcd0 0x7fbbf80caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbf7fff700 1 -- 172.21.15.86:0/421431020 >> v1:172.21.15.86:6789/0 conn(0x7fbbf815df50 legacy=0x7fbbf80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbf7fff700 1 -- 172.21.15.86:0/421431020 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf815ad10 con 0x7fbbf806c0a0 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.679+0000 7fbbf77fe700 1 -- 172.21.15.86:0/421431020 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228795761 0 0) 0x7fbbf815d7e0 con 0x7fbbf815df50 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbf7fff700 1 --2- 172.21.15.86:0/421431020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806c0a0 0x7fbbf815a1e0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80691a0 tx=0x7fbbe40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce977b51bbe7be75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbf77fe700 1 -- 172.21.15.86:0/421431020 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011630 con 0x7fbbf806c0a0 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbf77fe700 1 -- 172.21.15.86:0/421431020 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4011790 con 0x7fbbf806c0a0 2023-10-09T13:16:57.682 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbf77fe700 1 -- 172.21.15.86:0/421431020 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011b30 con 0x7fbbf806c0a0 2023-10-09T13:16:57.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 -- 172.21.15.86:0/421431020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806c0a0 msgr2=0x7fbbf815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.683 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/421431020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806c0a0 0x7fbbf815a1e0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80691a0 tx=0x7fbbe40091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 -- 172.21.15.86:0/421431020 shutdown_connections 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/421431020 >> v2:172.21.15.135:3300/0 conn(0x7fbbf806bcd0 0x7fbbf80caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/421431020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806c0a0 0x7fbbf815a1e0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 -- 172.21.15.86:0/421431020 >> 172.21.15.86:0/421431020 conn(0x7fbbf80ce600 msgr2=0x7fbbf80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 -- 172.21.15.86:0/421431020 shutdown_connections 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.680+0000 7fbbff1ff700 1 -- 172.21.15.86:0/421431020 wait complete. 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.682+0000 7fbbff1ff700 1 Processor -- start 2023-10-09T13:16:57.684 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.682+0000 7fbbff1ff700 1 -- start start 2023-10-09T13:16:57.686 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbff1ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806bcd0 0x7fbbf814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbff1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbf806c0a0 0x7fbbf80c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbff1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbf815df50 0x7fbbf80b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbff1ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf81533b0 con 0x7fbbf806bcd0 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbff1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8153c50 con 0x7fbbf815df50 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbff1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf814bf70 con 0x7fbbf806c0a0 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbfcf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806bcd0 0x7fbbf814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbfcf9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806bcd0 0x7fbbf814ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46616/0 (socket says 172.21.15.86:46616) 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.683+0000 7fbbfcf9b700 1 -- 172.21.15.86:0/2397557173 learned_addr learned my addr 172.21.15.86:0/2397557173 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbf7fff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbf806c0a0 0x7fbbf80c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfd79c700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbf815df50 0x7fbbf80b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.687 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfcf9b700 1 -- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbf806c0a0 msgr2=0x7fbbf80c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfcf9b700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbf806c0a0 0x7fbbf80c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfcf9b700 1 -- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbf815df50 msgr2=0x7fbbf80b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfcf9b700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbf815df50 0x7fbbf80b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfcf9b700 1 -- 172.21.15.86:0/2397557173 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4009420 con 0x7fbbf806bcd0 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfd79c700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbf815df50 0x7fbbf80b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbfcf9b700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806bcd0 0x7fbbf814ba30 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e960 tx=0x7fbbec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbf4ff9700 1 -- 172.21.15.86:0/2397557173 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00c850 con 0x7fbbf806bcd0 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbf4ff9700 1 -- 172.21.15.86:0/2397557173 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec00c9b0 con 0x7fbbf806bcd0 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbf4ff9700 1 -- 172.21.15.86:0/2397557173 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00cd50 con 0x7fbbf806bcd0 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf80c4b50 con 0x7fbbf806bcd0 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.684+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf81538e0 con 0x7fbbf806bcd0 2023-10-09T13:16:57.688 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.685+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf8153f30 con 0x7fbbf806bcd0 2023-10-09T13:16:57.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.686+0000 7fbbf4ff9700 1 -- 172.21.15.86:0/2397557173 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbec013680 con 0x7fbbf806bcd0 2023-10-09T13:16:57.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.687+0000 7fbbf4ff9700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbbdc066f30 0x7fbbdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:57.689 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.687+0000 7fbbf4ff9700 1 -- 172.21.15.86:0/2397557173 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fbbec0848e0 con 0x7fbbf806bcd0 2023-10-09T13:16:57.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.687+0000 7fbbf7fff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbbdc066f30 0x7fbbdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:57.690 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.688+0000 7fbbf7fff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbbdc066f30 0x7fbbdc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40093f0 tx=0x7fbbe4017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:57.693 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.691+0000 7fbbf4ff9700 1 -- 172.21.15.86:0/2397557173 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbec051a20 con 0x7fbbf806bcd0 2023-10-09T13:16:57.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.878+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbf8153d90 con 0x7fbbdc066f30 2023-10-09T13:16:57.883 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.881+0000 7fbbf4ff9700 1 -- 172.21.15.86:0/2397557173 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50471 (secure 0 0 0) 0x7fbbe4011900 con 0x7fbbdc066f30 2023-10-09T13:16:57.883 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:57.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.883+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbbdc066f30 msgr2=0x7fbbdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.883+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbbdc066f30 0x7fbbdc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40093f0 tx=0x7fbbe4017000 comp rx=0 tx=0).stop 2023-10-09T13:16:57.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.883+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806bcd0 msgr2=0x7fbbf814ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:57.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.883+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806bcd0 0x7fbbf814ba30 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e960 tx=0x7fbbec0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 shutdown_connections 2023-10-09T13:16:57.885 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fbbdc066f30 0x7fbbdc0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf806bcd0 0x7fbbf814ba30 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbf815df50 0x7fbbf80b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 --2- 172.21.15.86:0/2397557173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbf806c0a0 0x7fbbf80c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:57.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 >> 172.21.15.86:0/2397557173 conn(0x7fbbf80ce600 msgr2=0x7fbbf80cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:57.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 shutdown_connections 2023-10-09T13:16:57.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:57.884+0000 7fbbff1ff700 1 -- 172.21.15.86:0/2397557173 wait complete. 2023-10-09T13:16:57.886 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:57.902 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2023-10-09T13:16:56.005869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2491860,"kb_used_data":23444,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752482860,"statfs":{"total":773094113280,"available":770542448640,"internally_reserved":0,"allocated":24006656,"data_stored":13313563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.968811"},"pg_stats":[{"pgid":"1.0","version":"215'370","reported_seq":1222,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-09T13:16:52.072290+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:52.072290+0000","last_peered":"2023-10-09T13:16:52.072290+0000","last_clean":"2023-10-09T13:16:52.072290+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:52.072290+0000","last_undegraded":"2023-10-09T13:16:52.072290+0000","last_fullsized":"2023-10-09T13:16:52.072290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313104,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058736,"statfs":{"total":96636764160,"available":96316145664,"internally_reserved":0,"allocated":3612672,"data_stored":2270427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.748},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.629}]}]},{"osd":6,"up_from":16,"seq":68719477869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312184,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059656,"statfs":{"total":96636764160,"available":96317087744,"internally_reserved":0,"allocated":2670592,"data_stored":1344391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70199999999999996,"15min":0.74099999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78600000000000003,"5min":1.0029999999999999,"15min":1.026},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.752}]},{"osd":1,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.93600000000000005,"15min":1.014},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89400000000000002,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.1240000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.878,"5min":1.032,"15min":1.032},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84199999999999997,"5min":1.028,"15min":1.028},"last":0.70299999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.71499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424510573,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1696818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.501},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.81200000000000006}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.76400000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309000,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062840,"statfs":{"total":96636764160,"available":96320348160,"internally_reserved":0,"allocated":3604480,"data_stored":2269793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.628},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.58399999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316288,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055552,"statfs":{"total":96636764160,"available":96312885248,"internally_reserved":0,"allocated":2678784,"data_stored":1344956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.85499999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":1.099},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":1.1930000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":1.119}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":1.1379999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312528,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059312,"statfs":{"total":96636764160,"available":96316735488,"internally_reserved":0,"allocated":3022848,"data_stored":1680149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59899999999999998,"5min":0.88700000000000001,"15min":1.0820000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.498,"15min":0.53100000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":1.399},"last":0.39300000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":1.0720000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.84699999999999998},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.66400000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.84499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.204,"5min":1.298,"15min":1.298},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1930000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.56200000000000006,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.204},"last":0.83799999999999997}]},{"osd":6,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94399999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1040000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.626}]},{"osd":7,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.83599999999999997},"min":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.117,"5min":1.155,"15min":1.4610000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1319999999999999,"5min":1.2130000000000001,"15min":1.5349999999999999},"last":0.74199999999999999}]}]},{"osd":4,"up_from":16,"seq":68719477868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304024,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067816,"statfs":{"total":96636764160,"available":96325443584,"internally_reserved":0,"allocated":2703360,"data_stored":1362638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.62}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":0.63600000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.375}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.58099999999999996}]}]},{"osd":5,"up_from":16,"seq":68719477868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312184,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059656,"statfs":{"total":96636764160,"available":96317087744,"internally_reserved":0,"allocated":2670592,"data_stored":1344391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.504},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.75},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:57.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:58.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.086+0000 7f449f59d700 1 Processor -- start 2023-10-09T13:16:58.088 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.087+0000 7f449f59d700 1 -- start start 2023-10-09T13:16:58.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449f59d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4498156310 0x7f44980c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449f59d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44980ca860 con 0x7f44980ae710 2023-10-09T13:16:58.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449f59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44980cab40 con 0x7f44981566e0 2023-10-09T13:16:58.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449f59d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44980cae20 con 0x7f4498156310 2023-10-09T13:16:58.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449e59b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4498156310 0x7f44980c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449e59b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4498156310 0x7f44980c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46628/0 (socket says 172.21.15.86:46628) 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449e59b700 1 -- 172.21.15.86:0/3350194018 learned_addr learned my addr 172.21.15.86:0/3350194018 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.088+0000 7f449ed9c700 1 --1- 172.21.15.86:0/3350194018 >> v1:172.21.15.86:6789/0 conn(0x7f44980ae710 0x7f44980c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58860/0 (socket says 172.21.15.86:58860) 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449e59b700 1 -- 172.21.15.86:0/3350194018 >> v1:172.21.15.135:6789/0 conn(0x7f44981566e0 legacy=0x7f44980ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449e59b700 1 -- 172.21.15.86:0/3350194018 >> v1:172.21.15.86:6789/0 conn(0x7f44980ae710 legacy=0x7f44980c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449e59b700 1 -- 172.21.15.86:0/3350194018 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980cb100 con 0x7f4498156310 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449d599700 1 -- 172.21.15.86:0/3350194018 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460911635 0 0) 0x7f44980ca860 con 0x7f44980ae710 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449e59b700 1 --2- 172.21.15.86:0/3350194018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4498156310 0x7f44980c9dc0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f44940099b0 tx=0x7f4494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e262189b22f62827 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449d599700 1 -- 172.21.15.86:0/3350194018 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400b860 con 0x7f4498156310 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449d599700 1 -- 172.21.15.86:0/3350194018 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400b9c0 con 0x7f4498156310 2023-10-09T13:16:58.091 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.089+0000 7f449d599700 1 -- 172.21.15.86:0/3350194018 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400bd60 con 0x7f4498156310 2023-10-09T13:16:58.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.090+0000 7f449f59d700 1 -- 172.21.15.86:0/3350194018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4498156310 msgr2=0x7f44980c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.090+0000 7f449f59d700 1 --2- 172.21.15.86:0/3350194018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4498156310 0x7f44980c9dc0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f44940099b0 tx=0x7f4494009250 comp rx=0 tx=0).stop 2023-10-09T13:16:58.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.090+0000 7f449f59d700 1 -- 172.21.15.86:0/3350194018 shutdown_connections 2023-10-09T13:16:58.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.090+0000 7f449f59d700 1 --2- 172.21.15.86:0/3350194018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4498156310 0x7f44980c9dc0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.090+0000 7f449f59d700 1 -- 172.21.15.86:0/3350194018 >> 172.21.15.86:0/3350194018 conn(0x7f44980cc1f0 msgr2=0x7f44980cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:58.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.090+0000 7f449f59d700 1 -- 172.21.15.86:0/3350194018 shutdown_connections 2023-10-09T13:16:58.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.090+0000 7f449f59d700 1 -- 172.21.15.86:0/3350194018 wait complete. 2023-10-09T13:16:58.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.091+0000 7f449f59d700 1 Processor -- start 2023-10-09T13:16:58.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.091+0000 7f449f59d700 1 -- start start 2023-10-09T13:16:58.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.092+0000 7f449f59d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44980ae710 0x7f44980c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.092+0000 7f449f59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4498156310 0x7f4498157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.092+0000 7f449f59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44981566e0 0x7f449815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.092+0000 7f449f59d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4498158fe0 con 0x7f44980ae710 2023-10-09T13:16:58.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.092+0000 7f449f59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44981586b0 con 0x7f44981566e0 2023-10-09T13:16:58.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.092+0000 7f449f59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4498158990 con 0x7f4498156310 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.092+0000 7f449e59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44980ae710 0x7f44980c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44980ae710 0x7f44980c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46636/0 (socket says 172.21.15.86:46636) 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 -- 172.21.15.86:0/2929901411 learned_addr learned my addr 172.21.15.86:0/2929901411 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 -- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4498156310 msgr2=0x7f4498157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4498156310 0x7f4498157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 -- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44981566e0 msgr2=0x7f449815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449ed9c700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44981566e0 0x7f449815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44981566e0 0x7f449815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 -- 172.21.15.86:0/2929901411 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940094f0 con 0x7f44980ae710 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449ed9c700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44981566e0 0x7f449815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449e59b700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44980ae710 0x7f44980c32a0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f4494006f50 tx=0x7f4494017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f448e7fc700 1 -- 172.21.15.86:0/2929901411 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449401f070 con 0x7f44980ae710 2023-10-09T13:16:58.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f448e7fc700 1 -- 172.21.15.86:0/2929901411 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449401a420 con 0x7f44980ae710 2023-10-09T13:16:58.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f448e7fc700 1 -- 172.21.15.86:0/2929901411 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449401a7e0 con 0x7f44980ae710 2023-10-09T13:16:58.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.093+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4498158c70 con 0x7f44980ae710 2023-10-09T13:16:58.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.094+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4498159470 con 0x7f44980ae710 2023-10-09T13:16:58.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.094+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44981592c0 con 0x7f44980ae710 2023-10-09T13:16:58.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.095+0000 7f448e7fc700 1 -- 172.21.15.86:0/2929901411 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f449401ab50 con 0x7f44980ae710 2023-10-09T13:16:58.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.096+0000 7f448e7fc700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f447c066f30 0x7f447c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.096+0000 7f448e7fc700 1 -- 172.21.15.86:0/2929901411 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f4494085830 con 0x7f44980ae710 2023-10-09T13:16:58.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.096+0000 7f449dd9a700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f447c066f30 0x7f447c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.097+0000 7f449dd9a700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f447c066f30 0x7f447c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f44980ada80 tx=0x7f4488007b40 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.101 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.100+0000 7f448e7fc700 1 -- 172.21.15.86:0/2929901411 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4494052970 con 0x7f44980ae710 2023-10-09T13:16:58.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.286+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4498158820 con 0x7f447c066f30 2023-10-09T13:16:58.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.289+0000 7f448e7fc700 1 -- 172.21.15.86:0/2929901411 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50471 (secure 0 0 0) 0x7f4498158820 con 0x7f447c066f30 2023-10-09T13:16:58.291 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f447c066f30 msgr2=0x7f447c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f447c066f30 0x7f447c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f44980ada80 tx=0x7f4488007b40 comp rx=0 tx=0).stop 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44980ae710 msgr2=0x7f44980c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44980ae710 0x7f44980c32a0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f4494006f50 tx=0x7f4494017000 comp rx=0 tx=0).stop 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 shutdown_connections 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f447c066f30 0x7f447c0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44980ae710 0x7f44980c32a0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44981566e0 0x7f449815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 --2- 172.21.15.86:0/2929901411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4498156310 0x7f4498157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 >> 172.21.15.86:0/2929901411 conn(0x7f44980cc1f0 msgr2=0x7f4498155220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:58.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 shutdown_connections 2023-10-09T13:16:58.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.291+0000 7f449f59d700 1 -- 172.21.15.86:0/2929901411 wait complete. 2023-10-09T13:16:58.294 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:58.310 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-09T13:16:58.006297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2491860,"kb_used_data":23444,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752482860,"statfs":{"total":773094113280,"available":770542448640,"internally_reserved":0,"allocated":24006656,"data_stored":13313563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.969239"},"pg_stats":[{"pgid":"1.0","version":"215'370","reported_seq":1222,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-09T13:16:52.072290+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:52.072290+0000","last_peered":"2023-10-09T13:16:52.072290+0000","last_clean":"2023-10-09T13:16:52.072290+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:52.072290+0000","last_undegraded":"2023-10-09T13:16:52.072290+0000","last_fullsized":"2023-10-09T13:16:52.072290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313104,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058736,"statfs":{"total":96636764160,"available":96316145664,"internally_reserved":0,"allocated":3612672,"data_stored":2270427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.748},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.629}]}]},{"osd":6,"up_from":16,"seq":68719477869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312184,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059656,"statfs":{"total":96636764160,"available":96317087744,"internally_reserved":0,"allocated":2670592,"data_stored":1344391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70199999999999996,"15min":0.74099999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78600000000000003,"5min":1.0029999999999999,"15min":1.026},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.752}]},{"osd":1,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.93600000000000005,"15min":1.014},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89400000000000002,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.1240000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.878,"5min":1.032,"15min":1.032},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84199999999999997,"5min":1.028,"15min":1.028},"last":0.70299999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.71499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424510573,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1696818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.501},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.81200000000000006}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.76400000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309000,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062840,"statfs":{"total":96636764160,"available":96320348160,"internally_reserved":0,"allocated":3604480,"data_stored":2269793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.628},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.58399999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316288,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055552,"statfs":{"total":96636764160,"available":96312885248,"internally_reserved":0,"allocated":2678784,"data_stored":1344956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.85499999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":1.099},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":1.1930000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":1.119}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":1.1379999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312528,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059312,"statfs":{"total":96636764160,"available":96316735488,"internally_reserved":0,"allocated":3022848,"data_stored":1680149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59899999999999998,"5min":0.88700000000000001,"15min":1.0820000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.498,"15min":0.53100000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":1.399},"last":0.39300000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":1.0720000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.84699999999999998},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.66400000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.84499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.204,"5min":1.298,"15min":1.298},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1930000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.56200000000000006,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.204},"last":0.83799999999999997}]},{"osd":6,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94399999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1040000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.626}]},{"osd":7,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.83599999999999997},"min":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.117,"5min":1.155,"15min":1.4610000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1319999999999999,"5min":1.2130000000000001,"15min":1.5349999999999999},"last":0.74199999999999999}]}]},{"osd":4,"up_from":16,"seq":68719477868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304024,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067816,"statfs":{"total":96636764160,"available":96325443584,"internally_reserved":0,"allocated":2703360,"data_stored":1362638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.62}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":0.63600000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.375}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.58099999999999996}]}]},{"osd":5,"up_from":16,"seq":68719477868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312184,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059656,"statfs":{"total":96636764160,"available":96317087744,"internally_reserved":0,"allocated":2670592,"data_stored":1344391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.504},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.75},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:58.312 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T13:16:58.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:16:58.494 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.493+0000 7fe02b3ff700 1 Processor -- start 2023-10-09T13:16:58.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.493+0000 7fe02b3ff700 1 -- start start 2023-10-09T13:16:58.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.494+0000 7fe02b3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe0240cbf30 0x7fe0240ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02b3ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0240b1420 0x7fe0240c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02b3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0240cc300 con 0x7fe0240ccf90 2023-10-09T13:16:58.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02b3ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe024156bf0 con 0x7fe0240b1420 2023-10-09T13:16:58.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02b3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0240ae950 con 0x7fe0240cbf30 2023-10-09T13:16:58.496 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02999c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0240b1420 0x7fe0240c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02899a700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe0240ccf90 0x7fe0240b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58874/0 (socket says 172.21.15.86:58874) 2023-10-09T13:16:58.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02899a700 1 -- 172.21.15.86:0/1790136615 learned_addr learned my addr 172.21.15.86:0/1790136615 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:16:58.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02999c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0240b1420 0x7fe0240c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46646/0 (socket says 172.21.15.86:46646) 2023-10-09T13:16:58.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02919b700 1 --2- 172.21.15.86:0/1790136615 >> v2:172.21.15.135:3300/0 conn(0x7fe0240cbf30 0x7fe0240ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.498 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02999c700 1 -- 172.21.15.86:0/1790136615 >> v2:172.21.15.135:3300/0 conn(0x7fe0240cbf30 msgr2=0x7fe0240ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02999c700 1 --2- 172.21.15.86:0/1790136615 >> v2:172.21.15.135:3300/0 conn(0x7fe0240cbf30 0x7fe0240ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02999c700 1 -- 172.21.15.86:0/1790136615 >> v1:172.21.15.86:6789/0 conn(0x7fe0240ccf90 legacy=0x7fe0240b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02999c700 1 -- 172.21.15.86:0/1790136615 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240ad370 con 0x7fe0240b1420 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe02919b700 1 --2- 172.21.15.86:0/1790136615 >> v2:172.21.15.135:3300/0 conn(0x7fe0240cbf30 0x7fe0240ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.495+0000 7fe01bfff700 1 -- 172.21.15.86:0/1790136615 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872199134 0 0) 0x7fe0240cc300 con 0x7fe0240ccf90 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe02999c700 1 --2- 172.21.15.86:0/1790136615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe0240c9740 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fe024063d40 tx=0x7fe01c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70cbb72ed9cd132 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe01bfff700 1 -- 172.21.15.86:0/1790136615 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c00e070 con 0x7fe0240b1420 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe01bfff700 1 -- 172.21.15.86:0/1790136615 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c00bbf0 con 0x7fe0240b1420 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe01bfff700 1 -- 172.21.15.86:0/1790136615 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c012430 con 0x7fe0240b1420 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe02b3ff700 1 -- 172.21.15.86:0/1790136615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 msgr2=0x7fe0240c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/1790136615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe0240c9740 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fe024063d40 tx=0x7fe01c009780 comp rx=0 tx=0).stop 2023-10-09T13:16:58.499 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe02b3ff700 1 -- 172.21.15.86:0/1790136615 shutdown_connections 2023-10-09T13:16:58.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/1790136615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe0240c9740 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/1790136615 >> v2:172.21.15.135:3300/0 conn(0x7fe0240cbf30 0x7fe0240ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.496+0000 7fe02b3ff700 1 -- 172.21.15.86:0/1790136615 >> 172.21.15.86:0/1790136615 conn(0x7fe02406a320 msgr2=0x7fe0240cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:58.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.497+0000 7fe02b3ff700 1 -- 172.21.15.86:0/1790136615 shutdown_connections 2023-10-09T13:16:58.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.497+0000 7fe02b3ff700 1 -- 172.21.15.86:0/1790136615 wait complete. 2023-10-09T13:16:58.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.498+0000 7fe02b3ff700 1 Processor -- start 2023-10-09T13:16:58.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.498+0000 7fe02b3ff700 1 -- start start 2023-10-09T13:16:58.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02b3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe024169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02b3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0240cbf30 0x7fe02416ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0240ccf90 0x7fe0240aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02b3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240ab290 con 0x7fe0240b1420 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02416a1e0 con 0x7fe0240ccf90 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02b3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02416a4c0 con 0x7fe0240cbf30 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe024169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02919b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe024169b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46656/0 (socket says 172.21.15.86:46656) 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.499+0000 7fe02919b700 1 -- 172.21.15.86:0/416929508 learned_addr learned my addr 172.21.15.86:0/416929508 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02999c700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0240ccf90 0x7fe0240aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02899a700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0240cbf30 0x7fe02416ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02919b700 1 -- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0240cbf30 msgr2=0x7fe02416ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02919b700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0240cbf30 0x7fe02416ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02919b700 1 -- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0240ccf90 msgr2=0x7fe0240aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02919b700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0240ccf90 0x7fe0240aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02919b700 1 -- 172.21.15.86:0/416929508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c009a20 con 0x7fe0240b1420 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02999c700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0240ccf90 0x7fe0240aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02899a700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0240cbf30 0x7fe02416ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02919b700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe024169b50 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c830 tx=0x7fe020008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe0197fa700 1 -- 172.21.15.86:0/416929508 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020011600 con 0x7fe0240b1420 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe0197fa700 1 -- 172.21.15.86:0/416929508 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe020011760 con 0x7fe0240b1420 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02416a7a0 con 0x7fe0240b1420 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe0197fa700 1 -- 172.21.15.86:0/416929508 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020011b20 con 0x7fe0240b1420 2023-10-09T13:16:58.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.500+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0240ab590 con 0x7fe0240b1420 2023-10-09T13:16:58.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.501+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02404c3c0 con 0x7fe0240b1420 2023-10-09T13:16:58.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.502+0000 7fe0197fa700 1 -- 172.21.15.86:0/416929508 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe02000a3e0 con 0x7fe0240b1420 2023-10-09T13:16:58.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.503+0000 7fe0197fa700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe008066f30 0x7fe0080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.503+0000 7fe0197fa700 1 -- 172.21.15.86:0/416929508 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fe020084b70 con 0x7fe0240b1420 2023-10-09T13:16:58.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.503+0000 7fe02899a700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe008066f30 0x7fe0080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.505 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.504+0000 7fe02899a700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe008066f30 0x7fe0080693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe0240b1020 tx=0x7fe014009040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.507+0000 7fe0197fa700 1 -- 172.21.15.86:0/416929508 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe020051cb0 con 0x7fe0240b1420 2023-10-09T13:16:58.694 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.693+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0240ad650 con 0x7fe008066f30 2023-10-09T13:16:58.696 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.695+0000 7fe0197fa700 1 -- 172.21.15.86:0/416929508 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50471 (secure 0 0 0) 0x7fe0240ad650 con 0x7fe008066f30 2023-10-09T13:16:58.698 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:58.699 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe008066f30 msgr2=0x7fe0080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe008066f30 0x7fe0080693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe0240b1020 tx=0x7fe014009040 comp rx=0 tx=0).stop 2023-10-09T13:16:58.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 msgr2=0x7fe024169b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe024169b50 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c830 tx=0x7fe020008040 comp rx=0 tx=0).stop 2023-10-09T13:16:58.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 shutdown_connections 2023-10-09T13:16:58.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fe008066f30 0x7fe0080693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.700 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0240b1420 0x7fe024169b50 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0240ccf90 0x7fe0240aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 --2- 172.21.15.86:0/416929508 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0240cbf30 0x7fe02416ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 >> 172.21.15.86:0/416929508 conn(0x7fe02406a320 msgr2=0x7fe024156150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:58.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 shutdown_connections 2023-10-09T13:16:58.701 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.698+0000 7fe02b3ff700 1 -- 172.21.15.86:0/416929508 wait complete. 2023-10-09T13:16:58.702 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:16:58.716 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-09T13:16:58.006297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2491860,"kb_used_data":23444,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752482860,"statfs":{"total":773094113280,"available":770542448640,"internally_reserved":0,"allocated":24006656,"data_stored":13313563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.969239"},"pg_stats":[{"pgid":"1.0","version":"215'370","reported_seq":1222,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-09T13:16:52.072290+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:52.072290+0000","last_peered":"2023-10-09T13:16:52.072290+0000","last_clean":"2023-10-09T13:16:52.072290+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:52.072290+0000","last_undegraded":"2023-10-09T13:16:52.072290+0000","last_fullsized":"2023-10-09T13:16:52.072290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313104,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94058736,"statfs":{"total":96636764160,"available":96316145664,"internally_reserved":0,"allocated":3612672,"data_stored":2270427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.69199999999999995,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.93600000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.66000000000000003,"5min":0.53700000000000003,"15min":0.443},"max":{"1min":0.90400000000000003,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.42099999999999999},"max":{"1min":0.83899999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":1.212,"15min":1.212},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.47899999999999998},"max":{"1min":0.85499999999999998,"5min":1.115,"15min":1.208},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.747,"15min":0.75},"min":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.83699999999999997,"5min":1.077,"15min":1.2410000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.93999999999999995,"15min":1.089},"last":0.748},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.92600000000000005,"15min":1.0780000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.629},"min":{"1min":0.44800000000000001,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":0.91800000000000004,"15min":0.95899999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 9 13:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.2070000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.73699999999999999},"min":{"1min":0.55700000000000005,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.038,"15min":1.3200000000000001},"last":0.629}]}]},{"osd":6,"up_from":16,"seq":68719477869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312184,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059656,"statfs":{"total":96636764160,"available":96317087744,"internally_reserved":0,"allocated":2670592,"data_stored":1344391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70199999999999996,"15min":0.74099999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78600000000000003,"5min":1.0029999999999999,"15min":1.026},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.752}]},{"osd":1,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.93600000000000005,"15min":1.014},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89400000000000002,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.1240000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.878,"5min":1.032,"15min":1.032},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84199999999999997,"5min":1.028,"15min":1.028},"last":0.70299999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.71499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424510573,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312548,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059292,"statfs":{"total":96636764160,"available":96316715008,"internally_reserved":0,"allocated":3043328,"data_stored":1696818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.501},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.443}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.81200000000000006}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.76400000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309000,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062840,"statfs":{"total":96636764160,"available":96320348160,"internally_reserved":0,"allocated":3604480,"data_stored":2269793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.75600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.83599999999999997},"last":0.628},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.32400000000000001},"max":{"1min":0.68000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.135,"15min":1.135},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.83899999999999997},"min":{"1min":0.622,"5min":0.56100000000000005,"15min":0.55400000000000005},"max":{"1min":1.1140000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81499999999999995,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.56899999999999995,"15min":0.501},"max":{"1min":1.1659999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.64400000000000002,"5min":0.61099999999999999,"15min":0.54800000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.212},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83699999999999997,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.66700000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.71499999999999997,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.165,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.58399999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316288,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055552,"statfs":{"total":96636764160,"available":96312885248,"internally_reserved":0,"allocated":2678784,"data_stored":1344956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.85499999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":1.099},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":1.1930000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":1.119}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":1.1379999999999999}]}]},{"osd":3,"up_from":15,"seq":64424510573,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312528,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059312,"statfs":{"total":96636764160,"available":96316735488,"internally_reserved":0,"allocated":3022848,"data_stored":1680149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59899999999999998,"5min":0.88700000000000001,"15min":1.0820000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.498,"15min":0.53100000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":1.399},"last":0.39300000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":1.0720000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.84699999999999998},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.66400000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.84499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.204,"5min":1.298,"15min":1.298},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1930000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.56200000000000006,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.204},"last":0.83799999999999997}]},{"osd":6,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94399999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1040000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.626}]},{"osd":7,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.83599999999999997},"min":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.117,"5min":1.155,"15min":1.4610000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1319999999999999,"5min":1.2130000000000001,"15min":1.5349999999999999},"last":0.74199999999999999}]}]},{"osd":4,"up_from":16,"seq":68719477868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304024,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067816,"statfs":{"total":96636764160,"available":96325443584,"internally_reserved":0,"allocated":2703360,"data_stored":1362638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.62}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":0.63600000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.375}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.58099999999999996}]}]},{"osd":5,"up_from":16,"seq":68719477868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312184,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059656,"statfs":{"total":96636764160,"available":96317087744,"internally_reserved":0,"allocated":2670592,"data_stored":1344391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.623}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.504},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.76300000000000001}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68100000000000005}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.75},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:16:58.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T13:16:58.900 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.898+0000 7f29fb59e700 1 Processor -- start 2023-10-09T13:16:58.901 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.899+0000 7f29fb59e700 1 -- start start 2023-10-09T13:16:58.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29fb59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f29fc156310 0x7f29fc0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29fb59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29fc1566e0 0x7f29fc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29fb59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc0ca860 con 0x7f29fc0ca300 2023-10-09T13:16:58.902 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29fb59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc0cab40 con 0x7f29fc1566e0 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29fb59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29fc0cae20 con 0x7f29fc156310 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29f3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29fc1566e0 0x7f29fc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29f3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29fc1566e0 0x7f29fc0ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46662/0 (socket says 172.21.15.86:46662) 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29fa59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f29fc156310 0x7f29fc0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.900+0000 7f29f3fff700 1 -- 172.21.15.86:0/404341040 learned_addr learned my addr 172.21.15.86:0/404341040 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f3fff700 1 -- 172.21.15.86:0/404341040 >> v2:172.21.15.135:3300/0 conn(0x7f29fc156310 msgr2=0x7f29fc0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f3fff700 1 --2- 172.21.15.86:0/404341040 >> v2:172.21.15.135:3300/0 conn(0x7f29fc156310 0x7f29fc0c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f3fff700 1 -- 172.21.15.86:0/404341040 >> v1:172.21.15.135:6789/0 conn(0x7f29fc0ca300 legacy=0x7f29fc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f3fff700 1 -- 172.21.15.86:0/404341040 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0cb100 con 0x7f29fc1566e0 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f3fff700 1 --2- 172.21.15.86:0/404341040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc0ae000 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0cce20 tx=0x7f29e400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b3d0df97de7af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.903 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f9d9b700 1 -- 172.21.15.86:0/404341040 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400dba0 con 0x7f29fc1566e0 2023-10-09T13:16:58.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f9d9b700 1 -- 172.21.15.86:0/404341040 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400dd00 con 0x7f29fc1566e0 2023-10-09T13:16:58.904 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.901+0000 7f29f9d9b700 1 -- 172.21.15.86:0/404341040 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40196d0 con 0x7f29fc1566e0 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 -- 172.21.15.86:0/404341040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 msgr2=0x7f29fc0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 --2- 172.21.15.86:0/404341040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc0ae000 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0cce20 tx=0x7f29e400b4f0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 -- 172.21.15.86:0/404341040 shutdown_connections 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 --2- 172.21.15.86:0/404341040 >> v2:172.21.15.135:3300/0 conn(0x7f29fc156310 0x7f29fc0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 --2- 172.21.15.86:0/404341040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc0ae000 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 -- 172.21.15.86:0/404341040 >> 172.21.15.86:0/404341040 conn(0x7f29fc0cc1f0 msgr2=0x7f29fc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 -- 172.21.15.86:0/404341040 shutdown_connections 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.902+0000 7f29fb59e700 1 -- 172.21.15.86:0/404341040 wait complete. 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.903+0000 7f29fb59e700 1 Processor -- start 2023-10-09T13:16:58.905 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.903+0000 7f29fb59e700 1 -- start start 2023-10-09T13:16:58.907 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.904+0000 7f29fb59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29fc0ca300 0x7f29fc15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.904+0000 7f29fb59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29fc156310 0x7f29fc1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.904+0000 7f29fb59e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.904+0000 7f29fb59e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc155630 con 0x7f29fc1566e0 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.904+0000 7f29fb59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc152760 con 0x7f29fc0ca300 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.904+0000 7f29fb59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc153000 con 0x7f29fc156310 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc169970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46668/0 (socket says 172.21.15.86:46668) 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 -- 172.21.15.86:0/2110988524 learned_addr learned my addr 172.21.15.86:0/2110988524 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29f3fff700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29fc156310 0x7f29fc1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fa59c700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29fc0ca300 0x7f29fc15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.908 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 -- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29fc156310 msgr2=0x7f29fc1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29fc156310 0x7f29fc1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 -- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29fc0ca300 msgr2=0x7f29fc15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29fc0ca300 0x7f29fc15cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 -- 172.21.15.86:0/2110988524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e400b790 con 0x7f29fc1566e0 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.905+0000 7f29fad9d700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc169970 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c910 tx=0x7f29f4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.906+0000 7f29f27fc700 1 -- 172.21.15.86:0/2110988524 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4012630 con 0x7f29fc1566e0 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.906+0000 7f29f27fc700 1 -- 172.21.15.86:0/2110988524 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4012790 con 0x7f29fc1566e0 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.906+0000 7f29f27fc700 1 -- 172.21.15.86:0/2110988524 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4012b50 con 0x7f29fc1566e0 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.906+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc15d210 con 0x7f29fc1566e0 2023-10-09T13:16:58.909 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.906+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc152c90 con 0x7f29fc1566e0 2023-10-09T13:16:58.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.907+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc04c3c0 con 0x7f29fc1566e0 2023-10-09T13:16:58.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.908+0000 7f29f27fc700 1 -- 172.21.15.86:0/2110988524 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29f401a3a0 con 0x7f29fc1566e0 2023-10-09T13:16:58.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.908+0000 7f29f27fc700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f29dc066f30 0x7f29dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:16:58.910 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.909+0000 7f29f27fc700 1 -- 172.21.15.86:0/2110988524 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f29f4084850 con 0x7f29fc1566e0 2023-10-09T13:16:58.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.909+0000 7f29fa59c700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f29dc066f30 0x7f29dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:16:58.911 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.909+0000 7f29fa59c700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f29dc066f30 0x7f29dc0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009db0 tx=0x7f29ec0091a0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:16:58.914 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:58.913+0000 7f29f27fc700 1 -- 172.21.15.86:0/2110988524 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29f4055420 con 0x7f29fc1566e0 2023-10-09T13:16:59.105 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.104+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29fc153140 con 0x7f29fc1566e0 2023-10-09T13:16:59.106 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.105+0000 7f29f27fc700 1 -- 172.21.15.86:0/2110988524 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) v1 ==== 74+0+13898 (secure 0 0 0) 0x7f29f4054fb0 con 0x7f29fc1566e0 2023-10-09T13:16:59.106 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:16:59.107 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":217,"fsid":"2b95c581-b8e1-4fc5-9efb-bba4b9f96168","created":"2023-10-09T11:40:47.239617+0000","modified":"2023-10-09T13:16:54.021274+0000","last_up_change":"2023-10-09T11:41:00.251155+0000","last_in_change":"2023-10-09T11:40:50.669698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:41:00.002429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23697720-b70b-4a46-9e6b-f08bf831ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":85765},{"type":"v1","addr":"172.21.15.86:6801","nonce":85765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":85765},{"type":"v1","addr":"172.21.15.86:6803","nonce":85765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":85765},{"type":"v1","addr":"172.21.15.86:6807","nonce":85765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":85765},{"type":"v1","addr":"172.21.15.86:6805","nonce":85765}]},"public_addr":"172.21.15.86:6801/85765","cluster_addr":"172.21.15.86:6803/85765","heartbeat_back_addr":"172.21.15.86:6807/85765","heartbeat_front_addr":"172.21.15.86:6805/85765","state":["exists","up"]},{"osd":1,"uuid":"56782c33-979b-40d2-8bbc-4369d1d5c34d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":85768},{"type":"v1","addr":"172.21.15.86:6820","nonce":85768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":85768},{"type":"v1","addr":"172.21.15.86:6825","nonce":85768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":85768},{"type":"v1","addr":"172.21.15.86:6831","nonce":85768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":85768},{"type":"v1","addr":"172.21.15.86:6829","nonce":85768}]},"public_addr":"172.21.15.86:6820/85768","cluster_addr":"172.21.15.86:6825/85768","heartbeat_back_addr":"172.21.15.86:6831/85768","heartbeat_front_addr":"172.21.15.86:6829/85768","state":["exists","up"]},{"osd":2,"uuid":"8f880a5f-971b-4352-86ec-366bd3e44eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":85766},{"type":"v1","addr":"172.21.15.86:6809","nonce":85766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":85766},{"type":"v1","addr":"172.21.15.86:6811","nonce":85766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":85766},{"type":"v1","addr":"172.21.15.86:6815","nonce":85766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":85766},{"type":"v1","addr":"172.21.15.86:6813","nonce":85766}]},"public_addr":"172.21.15.86:6809/85766","cluster_addr":"172.21.15.86:6811/85766","heartbeat_back_addr":"172.21.15.86:6815/85766","heartbeat_front_addr":"172.21.15.86:6813/85766","state":["exists","up"]},{"osd":3,"uuid":"5cdc5a9b-da9a-412d-afa1-71f67fd314db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":85767},{"type":"v1","addr":"172.21.15.86:6818","nonce":85767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6819","nonce":85767},{"type":"v1","addr":"172.21.15.86:6821","nonce":85767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":85767},{"type":"v1","addr":"172.21.15.86:6827","nonce":85767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":85767},{"type":"v1","addr":"172.21.15.86:6824","nonce":85767}]},"public_addr":"172.21.15.86:6818/85767","cluster_addr":"172.21.15.86:6821/85767","heartbeat_back_addr":"172.21.15.86:6827/85767","heartbeat_front_addr":"172.21.15.86:6824/85767","state":["exists","up"]},{"osd":4,"uuid":"a7ccad54-7e58-44a5-a52f-80bf5dc2a888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":114751},{"type":"v1","addr":"172.21.15.135:6801","nonce":114751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":114751},{"type":"v1","addr":"172.21.15.135:6803","nonce":114751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":114751},{"type":"v1","addr":"172.21.15.135:6807","nonce":114751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":114751},{"type":"v1","addr":"172.21.15.135:6805","nonce":114751}]},"public_addr":"172.21.15.135:6801/114751","cluster_addr":"172.21.15.135:6803/114751","heartbeat_back_addr":"172.21.15.135:6807/114751","heartbeat_front_addr":"172.21.15.135:6805/114751","state":["exists","up"]},{"osd":5,"uuid":"ad45688c-6a40-4e89-aff3-c4c55420fa6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":114759},{"type":"v1","addr":"172.21.15.135:6810","nonce":114759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":114759},{"type":"v1","addr":"172.21.15.135:6814","nonce":114759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":114759},{"type":"v1","addr":"172.21.15.135:6822","nonce":114759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":114759},{"type":"v1","addr":"172.21.15.135:6818","nonce":114759}]},"public_addr":"172.21.15.135:6810/114759","cluster_addr":"172.21.15.135:6814/114759","heartbeat_back_addr":"172.21.15.135:6822/114759","heartbeat_front_addr":"172.21.15.135:6818/114759","state":["exists","up"]},{"osd":6,"uuid":"dd24db72-6eb2-48dc-a23c-ba81858526ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":114774},{"type":"v1","addr":"172.21.15.135:6825","nonce":114774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":114774},{"type":"v1","addr":"172.21.15.135:6827","nonce":114774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":114774},{"type":"v1","addr":"172.21.15.135:6831","nonce":114774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":114774},{"type":"v1","addr":"172.21.15.135:6829","nonce":114774}]},"public_addr":"172.21.15.135:6825/114774","cluster_addr":"172.21.15.135:6827/114774","heartbeat_back_addr":"172.21.15.135:6831/114774","heartbeat_front_addr":"172.21.15.135:6829/114774","state":["exists","up"]},{"osd":7,"uuid":"0d290858-b41d-4cc6-b758-62c0ab3b1447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":114757},{"type":"v1","addr":"172.21.15.135:6811","nonce":114757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":114757},{"type":"v1","addr":"172.21.15.135:6815","nonce":114757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":114757},{"type":"v1","addr":"172.21.15.135:6823","nonce":114757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":114757},{"type":"v1","addr":"172.21.15.135:6819","nonce":114757}]},"public_addr":"172.21.15.135:6811/114757","cluster_addr":"172.21.15.135:6815/114757","heartbeat_back_addr":"172.21.15.135:6823/114757","heartbeat_front_addr":"172.21.15.135:6819/114757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.910582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.976173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.936236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:55.967206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.228156+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.236887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.332177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:40:56.059661+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:0/1984974562":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/1895544307":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/613401282":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/2242263466":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/2288569450":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/3881135967":"2023-10-10T13:16:51.987598+0000","172.21.15.86:0/285548301":"2023-10-10T13:16:51.987598+0000","172.21.15.86:6835/903379396":"2023-10-10T13:16:51.007444+0000","172.21.15.86:6837/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:6836/133360":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/4258990999":"2023-10-10T13:16:41.609435+0000","172.21.15.86:6834/903379396":"2023-10-10T13:16:51.007444+0000","172.21.15.86:0/976545406":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/1033762369":"2023-10-10T13:16:41.609435+0000","172.21.15.86:0/2579375919":"2023-10-10T13:16:41.609435+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":16,"length":1},{"begin":21,"length":2},{"begin":27,"length":1},{"begin":32,"length":1},{"begin":37,"length":1},{"begin":43,"length":2},{"begin":48,"length":1},{"begin":54,"length":2},{"begin":59,"length":1},{"begin":64,"length":2},{"begin":69,"length":1},{"begin":75,"length":2},{"begin":80,"length":1},{"begin":86,"length":2},{"begin":91,"length":2},{"begin":97,"length":2},{"begin":102,"length":1},{"begin":107,"length":2},{"begin":193,"length":29}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":20,"length":38},{"begin":76,"length":38}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f29dc066f30 msgr2=0x7f29dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f29dc066f30 0x7f29dc0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009db0 tx=0x7f29ec0091a0 comp rx=0 tx=0).stop 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 msgr2=0x7f29fc169970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc169970 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c910 tx=0x7f29f4001710 comp rx=0 tx=0).stop 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 shutdown_connections 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f29dc066f30 0x7f29dc0693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29fc1566e0 0x7f29fc169970 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29fc0ca300 0x7f29fc15cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:59.109 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 --2- 172.21.15.86:0/2110988524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29fc156310 0x7f29fc1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:16:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 >> 172.21.15.86:0/2110988524 conn(0x7f29fc0cc1f0 msgr2=0x7f29fc0c2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:16:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 shutdown_connections 2023-10-09T13:16:59.110 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:16:59.107+0000 7f29fb59e700 1 -- 172.21.15.86:0/2110988524 wait complete. 2023-10-09T13:17:00.127 INFO:tasks.ceph:Scrubbing osd.0 2023-10-09T13:17:00.127 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:00.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.320+0000 7fadd5b9d700 1 Processor -- start 2023-10-09T13:17:00.322 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.321+0000 7fadd5b9d700 1 -- start start 2023-10-09T13:17:00.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd5b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fadd015b050 0x7fadd00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd5b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd015b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd5b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd0157a50 con 0x7fadd015b960 2023-10-09T13:17:00.323 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd5b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd01591b0 con 0x7fadd015b050 2023-10-09T13:17:00.324 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd5b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00ca9e0 con 0x7fadd00cc8d0 2023-10-09T13:17:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd4b9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fadd015b050 0x7fadd00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadcffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.325 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd4b9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fadd015b050 0x7fadd00ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:43920/0 (socket says 172.21.15.86:43920) 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadcffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd015b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.86:38178/0 (socket says 172.21.15.86:38178) 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.322+0000 7fadd539c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fadd015b960 0x7fadd0157f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:33094/0 (socket says 172.21.15.86:33094) 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadd4b9b700 1 -- 172.21.15.86:0/876294630 learned_addr learned my addr 172.21.15.86:0/876294630 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadd4b9b700 1 -- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 msgr2=0x7fadd015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadd4b9b700 1 --2- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadd4b9b700 1 -- 172.21.15.86:0/876294630 >> v1:172.21.15.135:6789/0 conn(0x7fadd015b960 legacy=0x7fadd0157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadd4b9b700 1 -- 172.21.15.86:0/876294630 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00cacc0 con 0x7fadd015b050 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadcffff700 1 --2- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.323+0000 7fadd4b9b700 1 --2- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 0x7fadd00ca100 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fadc40099b0 tx=0x7fadc4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4653f4124a2b11f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadcf7fe700 1 -- 172.21.15.86:0/876294630 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4009ea0 con 0x7fadd015b050 2023-10-09T13:17:00.326 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadcf7fe700 1 -- 172.21.15.86:0/876294630 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc400b860 con 0x7fadd015b050 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadcf7fe700 1 -- 172.21.15.86:0/876294630 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc400bc00 con 0x7fadd015b050 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 -- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 msgr2=0x7fadd00ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 --2- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 0x7fadd00ca100 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fadc40099b0 tx=0x7fadc4009250 comp rx=0 tx=0).stop 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 -- 172.21.15.86:0/876294630 shutdown_connections 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 --2- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 0x7fadd00ca100 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 --2- 172.21.15.86:0/876294630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 -- 172.21.15.86:0/876294630 >> 172.21.15.86:0/876294630 conn(0x7fadd0068e20 msgr2=0x7fadd00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 -- 172.21.15.86:0/876294630 shutdown_connections 2023-10-09T13:17:00.327 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.324+0000 7fadd5b9d700 1 -- 172.21.15.86:0/876294630 wait complete. 2023-10-09T13:17:00.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.326+0000 7fadd5b9d700 1 Processor -- start 2023-10-09T13:17:00.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.326+0000 7fadd5b9d700 1 -- start start 2023-10-09T13:17:00.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd5b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd0144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.329 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd5b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 0x7fadd00c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd5b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd015b960 0x7fadd00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd5b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00c4440 con 0x7fadd015b960 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd5b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00c30f0 con 0x7fadd015b050 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd5b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00c33a0 con 0x7fadd00cc8d0 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd015b960 0x7fadd00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd015b960 0x7fadd00c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46680/0 (socket says 172.21.15.86:46680) 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd4b9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd0144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 -- 172.21.15.86:0/1398981988 learned_addr learned my addr 172.21.15.86:0/1398981988 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadcffff700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 0x7fadd00c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 -- 172.21.15.86:0/1398981988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 msgr2=0x7fadd0144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd0144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 -- 172.21.15.86:0/1398981988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 msgr2=0x7fadd00c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd015b050 0x7fadd00c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd539c700 1 -- 172.21.15.86:0/1398981988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc009420 con 0x7fadd015b960 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.327+0000 7fadd4b9b700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fadd00cc8d0 0x7fadd0144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.328+0000 7fadd539c700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd015b960 0x7fadd00c2bb0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fadc800cd00 tx=0x7fadc8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.328+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800ce60 con 0x7fadd015b960 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.328+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc8005df0 con 0x7fadd015b960 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.328+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc40094f0 con 0x7fadd015b960 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.328+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800ab00 con 0x7fadd015b960 2023-10-09T13:17:00.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.328+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd00c3730 con 0x7fadd015b960 2023-10-09T13:17:00.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.329+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fadd004c3c0 con 0x7fadd015b960 2023-10-09T13:17:00.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.330+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadc80070f0 con 0x7fadd015b960 2023-10-09T13:17:00.332 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.331+0000 7fadccff9700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.331+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fadc8085060 con 0x7fadd015b960 2023-10-09T13:17:00.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.331+0000 7fadd4b9b700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.331+0000 7fadccff9700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7fadb406d6d0 0x7fadb406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.331+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 --> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadb4070170 con 0x7fadb406d6d0 2023-10-09T13:17:00.333 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.331+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadc8085430 con 0x7fadd015b960 2023-10-09T13:17:00.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.331+0000 7fadcffff700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7fadb406d6d0 0x7fadb406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.332+0000 7fadd4b9b700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fadb4066f30 0x7fadb40693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc40099b0 tx=0x7fadc4017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.332+0000 7fadcffff700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7fadb406d6d0 0x7fadb406fb40 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.334 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.333+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== osd.0 v2:172.21.15.86:6800/85765 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fadb4070170 con 0x7fadb406d6d0 2023-10-09T13:17:00.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.347+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 --> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fadd00c1730 con 0x7fadb406d6d0 2023-10-09T13:17:00.348 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.347+0000 7fadccff9700 1 -- 172.21.15.86:0/1398981988 <== osd.0 v2:172.21.15.86:6800/85765 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fadd00c1730 con 0x7fadb406d6d0 2023-10-09T13:17:00.349 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:00.349 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:00.349 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7fadb406d6d0 msgr2=0x7fadb406fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6800/85765,v1:172.21.15.86:6801/85765] conn(0x7fadb406d6d0 0x7fadb406fb40 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fadb4066f30 msgr2=0x7fadb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fadb4066f30 0x7fadb40693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc40099b0 tx=0x7fadc4017000 comp rx=0 tx=0).stop 2023-10-09T13:17:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd015b960 msgr2=0x7fadd00c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 --2- 172.21.15.86:0/1398981988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd015b960 0x7fadd00c2bb0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fadc800cd00 tx=0x7fadc8001b10 comp rx=0 tx=0).stop 2023-10-09T13:17:00.350 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd539c700 1 -- 172.21.15.86:0/1398981988 reap_dead start 2023-10-09T13:17:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 shutdown_connections 2023-10-09T13:17:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 >> 172.21.15.86:0/1398981988 conn(0x7fadd0068e20 msgr2=0x7fadd00704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 shutdown_connections 2023-10-09T13:17:00.351 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.348+0000 7fadd5b9d700 1 -- 172.21.15.86:0/1398981988 wait complete. 2023-10-09T13:17:00.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-09T13:17:00.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.547+0000 7f7e7e9ff700 1 Processor -- start 2023-10-09T13:17:00.549 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.548+0000 7f7e7e9ff700 1 -- start start 2023-10-09T13:17:00.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e7e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e78155c10 0x7f7e78155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e7e9ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e780ac230 0x7f7e780ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.551 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e7e9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780ad930 con 0x7f7e781568a0 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e7e9ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780acd20 con 0x7f7e780ac230 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e7e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780ad000 con 0x7f7e78155c10 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e777fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e780ac230 0x7f7e780ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e777fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e780ac230 0x7f7e780ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46688/0 (socket says 172.21.15.86:46688) 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e777fe700 1 -- 172.21.15.86:0/1008950861 learned_addr learned my addr 172.21.15.86:0/1008950861 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e7cf9c700 1 --1- 172.21.15.86:0/1008950861 >> v1:172.21.15.135:6789/0 conn(0x7f7e781568a0 0x7f7e78156cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.86:33108/0 (socket says 172.21.15.86:33108) 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.549+0000 7f7e77fff700 1 --2- 172.21.15.86:0/1008950861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e78155c10 0x7f7e78155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e777fe700 1 -- 172.21.15.86:0/1008950861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e78155c10 msgr2=0x7f7e78155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e777fe700 1 --2- 172.21.15.86:0/1008950861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e78155c10 0x7f7e78155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e76ffd700 1 -- 172.21.15.86:0/1008950861 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312550769 0 0) 0x7f7e780ad930 con 0x7f7e781568a0 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e777fe700 1 -- 172.21.15.86:0/1008950861 >> v1:172.21.15.135:6789/0 conn(0x7f7e781568a0 legacy=0x7f7e78156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.552 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e777fe700 1 -- 172.21.15.86:0/1008950861 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780ad2e0 con 0x7f7e780ac230 2023-10-09T13:17:00.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e777fe700 1 --2- 172.21.15.86:0/1008950861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e780ac230 0x7f7e780ac6a0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0099b0 tx=0x7f7e6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9a35d3e4227d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e76ffd700 1 -- 172.21.15.86:0/1008950861 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c009ea0 con 0x7f7e780ac230 2023-10-09T13:17:00.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e76ffd700 1 -- 172.21.15.86:0/1008950861 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c00b860 con 0x7f7e780ac230 2023-10-09T13:17:00.553 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.550+0000 7f7e76ffd700 1 -- 172.21.15.86:0/1008950861 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00bc00 con 0x7f7e780ac230 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/1008950861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e780ac230 msgr2=0x7f7e780ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/1008950861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e780ac230 0x7f7e780ac6a0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0099b0 tx=0x7f7e6c009250 comp rx=0 tx=0).stop 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/1008950861 shutdown_connections 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/1008950861 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e78155c10 0x7f7e78155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/1008950861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e780ac230 0x7f7e780ac6a0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/1008950861 >> 172.21.15.86:0/1008950861 conn(0x7f7e7806a320 msgr2=0x7f7e780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/1008950861 shutdown_connections 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.551+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/1008950861 wait complete. 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.552+0000 7f7e7e9ff700 1 Processor -- start 2023-10-09T13:17:00.554 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.552+0000 7f7e7e9ff700 1 -- start start 2023-10-09T13:17:00.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e7e9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e780ac230 0x7f7e78167330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e7e9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e78155c10 0x7f7e780aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e7e9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e781568a0 0x7f7e781485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.556 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e7e9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7814cd80 con 0x7f7e78155c10 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e7e9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78148ae0 con 0x7f7e781568a0 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e7e9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78167960 con 0x7f7e780ac230 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e777fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e78155c10 0x7f7e780aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e777fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e78155c10 0x7f7e780aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46698/0 (socket says 172.21.15.86:46698) 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e777fe700 1 -- 172.21.15.86:0/647032182 learned_addr learned my addr 172.21.15.86:0/647032182 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e7cf9c700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e781568a0 0x7f7e781485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.553+0000 7f7e77fff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e780ac230 0x7f7e78167330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e777fe700 1 -- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e780ac230 msgr2=0x7f7e78167330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e777fe700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e780ac230 0x7f7e78167330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e777fe700 1 -- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e781568a0 msgr2=0x7f7e781485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e777fe700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e781568a0 0x7f7e781485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.557 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e777fe700 1 -- 172.21.15.86:0/647032182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0094f0 con 0x7f7e78155c10 2023-10-09T13:17:00.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e777fe700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e78155c10 0x7f7e780aadc0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c006fd0 tx=0x7f7e6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e5ffff700 1 -- 172.21.15.86:0/647032182 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c000d10 con 0x7f7e78155c10 2023-10-09T13:17:00.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e5ffff700 1 -- 172.21.15.86:0/647032182 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c00bbe0 con 0x7f7e78155c10 2023-10-09T13:17:00.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e5ffff700 1 -- 172.21.15.86:0/647032182 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011690 con 0x7f7e78155c10 2023-10-09T13:17:00.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e78167c40 con 0x7f7e78155c10 2023-10-09T13:17:00.558 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.554+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e78168200 con 0x7f7e78155c10 2023-10-09T13:17:00.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.555+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7804c3c0 con 0x7f7e78155c10 2023-10-09T13:17:00.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.556+0000 7f7e5ffff700 1 -- 172.21.15.86:0/647032182 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e6c011a40 con 0x7f7e78155c10 2023-10-09T13:17:00.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.557+0000 7f7e5ffff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7e64066f30 0x7f7e640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.558+0000 7f7e5ffff700 1 -- 172.21.15.86:0/647032182 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f7e6c085e40 con 0x7f7e78155c10 2023-10-09T13:17:00.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.558+0000 7f7e77fff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7e64066f30 0x7f7e640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.559 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.558+0000 7f7e77fff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7e64066f30 0x7f7e640693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7e7814c9a0 tx=0x7f7e680091a0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.562+0000 7f7e5ffff700 1 -- 172.21.15.86:0/647032182 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e6c052f80 con 0x7f7e78155c10 2023-10-09T13:17:00.752 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.751+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e780ad5c0 con 0x7f7e64066f30 2023-10-09T13:17:00.753 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.752+0000 7f7e5ffff700 1 -- 172.21.15.86:0/647032182 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e780ad5c0 con 0x7f7e64066f30 2023-10-09T13:17:00.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7e64066f30 msgr2=0x7f7e640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.755 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7e64066f30 0x7f7e640693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7e7814c9a0 tx=0x7f7e680091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e78155c10 msgr2=0x7f7e780aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e78155c10 0x7f7e780aadc0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c006fd0 tx=0x7f7e6c017000 comp rx=0 tx=0).stop 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 shutdown_connections 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7e64066f30 0x7f7e640693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e781568a0 0x7f7e781485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e780ac230 0x7f7e78167330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 --2- 172.21.15.86:0/647032182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e78155c10 0x7f7e780aadc0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 >> 172.21.15.86:0/647032182 conn(0x7f7e7806a320 msgr2=0x7f7e7806f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 shutdown_connections 2023-10-09T13:17:00.756 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.754+0000 7f7e7e9ff700 1 -- 172.21.15.86:0/647032182 wait complete. 2023-10-09T13:17:00.757 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 0 to deep-scrub 2023-10-09T13:17:00.773 INFO:tasks.ceph:Scrubbing osd.1 2023-10-09T13:17:00.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:00.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.956+0000 7fb98dbff700 1 Processor -- start 2023-10-09T13:17:00.958 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.957+0000 7fb98dbff700 1 -- start start 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb98dbff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9881563b0 0x7fb988156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb98dbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb98dbff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb988068890 0x7fb9880c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb98dbff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98815a9b0 con 0x7fb9881563b0 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb98dbff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98815ac90 con 0x7fb988068890 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb98dbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98815af70 con 0x7fb98815a440 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9881563b0 0x7fb988156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9881563b0 0x7fb988156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46704/0 (socket says 172.21.15.86:46704) 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 -- 172.21.15.86:0/3562911990 learned_addr learned my addr 172.21.15.86:0/3562911990 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:00.961 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb97ffff700 1 --2- 172.21.15.86:0/3562911990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb987fff700 1 --2- 172.21.15.86:0/3562911990 >> v2:172.21.15.135:3300/0 conn(0x7fb988068890 0x7fb9880c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 -- 172.21.15.86:0/3562911990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 msgr2=0x7fb9880acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 --2- 172.21.15.86:0/3562911990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 -- 172.21.15.86:0/3562911990 >> v2:172.21.15.135:3300/0 conn(0x7fb988068890 msgr2=0x7fb9880c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 --2- 172.21.15.86:0/3562911990 >> v2:172.21.15.135:3300/0 conn(0x7fb988068890 0x7fb9880c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb9877fe700 1 -- 172.21.15.86:0/3562911990 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98815b250 con 0x7fb9881563b0 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb97ffff700 1 --2- 172.21.15.86:0/3562911990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.958+0000 7fb987fff700 1 --2- 172.21.15.86:0/3562911990 >> v2:172.21.15.135:3300/0 conn(0x7fb988068890 0x7fb9880c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb9877fe700 1 --2- 172.21.15.86:0/3562911990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb988156780 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fb98806fb10 tx=0x7fb97800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9a9d7db74aca88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb986ffd700 1 -- 172.21.15.86:0/3562911990 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800dc50 con 0x7fb9881563b0 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb986ffd700 1 -- 172.21.15.86:0/3562911990 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97800ddb0 con 0x7fb9881563b0 2023-10-09T13:17:00.962 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb986ffd700 1 -- 172.21.15.86:0/3562911990 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9780196d0 con 0x7fb9881563b0 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb98dbff700 1 -- 172.21.15.86:0/3562911990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 msgr2=0x7fb988156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb98dbff700 1 --2- 172.21.15.86:0/3562911990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb988156780 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fb98806fb10 tx=0x7fb97800b4f0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb98dbff700 1 -- 172.21.15.86:0/3562911990 shutdown_connections 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb98dbff700 1 --2- 172.21.15.86:0/3562911990 >> v2:172.21.15.135:3300/0 conn(0x7fb988068890 0x7fb9880c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb98dbff700 1 --2- 172.21.15.86:0/3562911990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb988156780 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb98dbff700 1 --2- 172.21.15.86:0/3562911990 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.959+0000 7fb98dbff700 1 -- 172.21.15.86:0/3562911990 >> 172.21.15.86:0/3562911990 conn(0x7fb9880c8f90 msgr2=0x7fb9880c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.960+0000 7fb98dbff700 1 -- 172.21.15.86:0/3562911990 shutdown_connections 2023-10-09T13:17:00.963 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.960+0000 7fb98dbff700 1 -- 172.21.15.86:0/3562911990 wait complete. 2023-10-09T13:17:00.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.961+0000 7fb98dbff700 1 Processor -- start 2023-10-09T13:17:00.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.961+0000 7fb98dbff700 1 -- start start 2023-10-09T13:17:00.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb98dbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988068890 0x7fb9880bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb98dbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb9880ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.965 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb98dbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb98dbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880c1450 con 0x7fb9881563b0 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb98dbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880c0840 con 0x7fb988068890 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb98dbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880c0b20 con 0x7fb98815a440 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb9880ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb9880ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46712/0 (socket says 172.21.15.86:46712) 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb97ffff700 1 -- 172.21.15.86:0/1862426138 learned_addr learned my addr 172.21.15.86:0/1862426138 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb9877fe700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988068890 0x7fb9880bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.962+0000 7fb987fff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97ffff700 1 -- 172.21.15.86:0/1862426138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 msgr2=0x7fb9880ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97ffff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98815a440 0x7fb9880ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.966 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97ffff700 1 -- 172.21.15.86:0/1862426138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988068890 msgr2=0x7fb9880bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97ffff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb988068890 0x7fb9880bff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97ffff700 1 -- 172.21.15.86:0/1862426138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97800b790 con 0x7fb9881563b0 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97ffff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb9880ade60 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fb97000d860 tx=0x7fb970008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700125f0 con 0x7fb9881563b0 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970012750 con 0x7fb9881563b0 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970012af0 con 0x7fb9881563b0 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9880c0e00 con 0x7fb9881563b0 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.963+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb988155340 con 0x7fb9881563b0 2023-10-09T13:17:00.967 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.964+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb98815c610 con 0x7fb9881563b0 2023-10-09T13:17:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.965+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb970014430 con 0x7fb9881563b0 2023-10-09T13:17:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.966+0000 7fb97f7fe700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb968066f30 0x7fb9680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.966+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fb970084940 con 0x7fb9881563b0 2023-10-09T13:17:00.968 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.966+0000 7fb97f7fe700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fb96806d6d0 0x7fb96806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.966+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 --> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb968070170 con 0x7fb96806d6d0 2023-10-09T13:17:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.966+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb970089220 con 0x7fb9881563b0 2023-10-09T13:17:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.966+0000 7fb9877fe700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb968066f30 0x7fb9680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.966+0000 7fb987fff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fb96806d6d0 0x7fb96806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.967+0000 7fb9877fe700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb968066f30 0x7fb9680693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb98806fb10 tx=0x7fb97801b000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.967+0000 7fb987fff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fb96806d6d0 0x7fb96806fb40 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:00.969 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.968+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== osd.1 v2:172.21.15.86:6817/85768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb968070170 con 0x7fb96806d6d0 2023-10-09T13:17:00.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.982+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 --> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb9880718b0 con 0x7fb96806d6d0 2023-10-09T13:17:00.983 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.982+0000 7fb97f7fe700 1 -- 172.21.15.86:0/1862426138 <== osd.1 v2:172.21.15.86:6817/85768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb9880718b0 con 0x7fb96806d6d0 2023-10-09T13:17:00.983 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:00.984 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:00.984 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:00.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.982+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fb96806d6d0 msgr2=0x7fb96806fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.984 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.982+0000 7fb98dbff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6817/85768,v1:172.21.15.86:6820/85768] conn(0x7fb96806d6d0 0x7fb96806fb40 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb968066f30 msgr2=0x7fb9680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fb968066f30 0x7fb9680693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb98806fb10 tx=0x7fb97801b000 comp rx=0 tx=0).stop 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 msgr2=0x7fb9880ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 --2- 172.21.15.86:0/1862426138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9881563b0 0x7fb9880ade60 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fb97000d860 tx=0x7fb970008040 comp rx=0 tx=0).stop 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb987fff700 1 -- 172.21.15.86:0/1862426138 reap_dead start 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 shutdown_connections 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 >> 172.21.15.86:0/1862426138 conn(0x7fb9880c8f90 msgr2=0x7fb9880b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 shutdown_connections 2023-10-09T13:17:00.985 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:00.983+0000 7fb98dbff700 1 -- 172.21.15.86:0/1862426138 wait complete. 2023-10-09T13:17:01.001 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-09T13:17:01.183 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.182+0000 7f527c5ff700 1 Processor -- start 2023-10-09T13:17:01.275 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.182+0000 7f527c5ff700 1 -- start start 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.183+0000 7f527c5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f527406bcd0 0x7f5274140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.183+0000 7f527c5ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f527406c0a0 0x7f5274141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.183+0000 7f527c5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52740c8e00 0x7f52740c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.183+0000 7f527c5ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527415c2a0 con 0x7f527406c0a0 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.183+0000 7f527c5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527415b690 con 0x7f527406bcd0 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.183+0000 7f527c5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527415b970 con 0x7f52740c8e00 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f527406c0a0 0x7f5274141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f527406c0a0 0x7f5274141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46714/0 (socket says 172.21.15.86:46714) 2023-10-09T13:17:01.279 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 -- 172.21.15.86:0/3997661737 learned_addr learned my addr 172.21.15.86:0/3997661737 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f527a39b700 1 --2- 172.21.15.86:0/3997661737 >> v2:172.21.15.135:3300/0 conn(0x7f527406bcd0 0x7f5274140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f527ab9c700 1 --2- 172.21.15.86:0/3997661737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52740c8e00 0x7f52740c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 -- 172.21.15.86:0/3997661737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52740c8e00 msgr2=0x7f52740c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 --2- 172.21.15.86:0/3997661737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52740c8e00 0x7f52740c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 -- 172.21.15.86:0/3997661737 >> v2:172.21.15.135:3300/0 conn(0x7f527406bcd0 msgr2=0x7f5274140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 --2- 172.21.15.86:0/3997661737 >> v2:172.21.15.135:3300/0 conn(0x7f527406bcd0 0x7f5274140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 -- 172.21.15.86:0/3997661737 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527415bc50 con 0x7f527406c0a0 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.184+0000 7f5279b9a700 1 --2- 172.21.15.86:0/3997661737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f527406c0a0 0x7f5274141330 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f52740cafd0 tx=0x7f5264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c9d349e179ba84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f5279399700 1 -- 172.21.15.86:0/3997661737 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400b640 con 0x7f527406c0a0 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f5279399700 1 -- 172.21.15.86:0/3997661737 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400b7a0 con 0x7f527406c0a0 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f5279399700 1 -- 172.21.15.86:0/3997661737 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400bb60 con 0x7f527406c0a0 2023-10-09T13:17:01.280 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 -- 172.21.15.86:0/3997661737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f527406c0a0 msgr2=0x7f5274141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 --2- 172.21.15.86:0/3997661737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f527406c0a0 0x7f5274141330 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f52740cafd0 tx=0x7f5264009250 comp rx=0 tx=0).stop 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 -- 172.21.15.86:0/3997661737 shutdown_connections 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 --2- 172.21.15.86:0/3997661737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52740c8e00 0x7f52740c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 --2- 172.21.15.86:0/3997661737 >> v2:172.21.15.135:3300/0 conn(0x7f527406bcd0 0x7f5274140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 --2- 172.21.15.86:0/3997661737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f527406c0a0 0x7f5274141330 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 -- 172.21.15.86:0/3997661737 >> 172.21.15.86:0/3997661737 conn(0x7f52740ce600 msgr2=0x7f52740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 -- 172.21.15.86:0/3997661737 shutdown_connections 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.185+0000 7f527c5ff700 1 -- 172.21.15.86:0/3997661737 wait complete. 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.187+0000 7f527c5ff700 1 Processor -- start 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.187+0000 7f527c5ff700 1 -- start start 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f527406bcd0 0x7f527406ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527c5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f527406c0a0 0x7f527413ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527c5ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52740c8e00 0x7f52740c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527c5ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52740c4390 con 0x7f52740c8e00 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52740c3780 con 0x7f527406bcd0 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527c5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52740c3a60 con 0x7f527406c0a0 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527ab9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52740c8e00 0x7f52740c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527a39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f527406bcd0 0x7f527406ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527a39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f527406bcd0 0x7f527406ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:43968/0 (socket says 172.21.15.86:43968) 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527a39b700 1 -- 172.21.15.86:0/2729628827 learned_addr learned my addr 172.21.15.86:0/2729628827 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527ab9c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52740c8e00 0x7f52740c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46724/0 (socket says 172.21.15.86:46724) 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f5279b9a700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f527406c0a0 0x7f527413ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.282 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527ab9c700 1 -- 172.21.15.86:0/2729628827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f527406c0a0 msgr2=0x7f527413ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527ab9c700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f527406c0a0 0x7f527413ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527ab9c700 1 -- 172.21.15.86:0/2729628827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f527406bcd0 msgr2=0x7f527406ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527ab9c700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f527406bcd0 0x7f527406ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.188+0000 7f527ab9c700 1 -- 172.21.15.86:0/2729628827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640094f0 con 0x7f52740c8e00 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.189+0000 7f527ab9c700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52740c8e00 0x7f52740c4820 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f526c00ecc0 tx=0x7f526c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.189+0000 7f526a7fc700 1 -- 172.21.15.86:0/2729628827 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c00c8c0 con 0x7f52740c8e00 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.189+0000 7f526a7fc700 1 -- 172.21.15.86:0/2729628827 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c00f040 con 0x7f52740c8e00 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.189+0000 7f526a7fc700 1 -- 172.21.15.86:0/2729628827 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c00cc90 con 0x7f52740c8e00 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.189+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52740c3d40 con 0x7f52740c8e00 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.189+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527406b340 con 0x7f52740c8e00 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.190+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527404c3c0 con 0x7f52740c8e00 2023-10-09T13:17:01.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.191+0000 7f526a7fc700 1 -- 172.21.15.86:0/2729628827 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f526c014690 con 0x7f52740c8e00 2023-10-09T13:17:01.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.192+0000 7f526a7fc700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5258066f30 0x7f52580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.192+0000 7f526a7fc700 1 -- 172.21.15.86:0/2729628827 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f526c085130 con 0x7f52740c8e00 2023-10-09T13:17:01.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.192+0000 7f527a39b700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5258066f30 0x7f52580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.193+0000 7f527a39b700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5258066f30 0x7f52580693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5270009e70 tx=0x7f52700091a0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.196+0000 7f526a7fc700 1 -- 172.21.15.86:0/2729628827 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f526c0521d0 con 0x7f52740c8e00 2023-10-09T13:17:01.385 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.384+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f527406c9d0 con 0x7f5258066f30 2023-10-09T13:17:01.386 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.385+0000 7f526a7fc700 1 -- 172.21.15.86:0/2729628827 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f527406c9d0 con 0x7f5258066f30 2023-10-09T13:17:01.388 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5258066f30 msgr2=0x7f52580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5258066f30 0x7f52580693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5270009e70 tx=0x7f52700091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52740c8e00 msgr2=0x7f52740c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52740c8e00 0x7f52740c4820 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f526c00ecc0 tx=0x7f526c00b040 comp rx=0 tx=0).stop 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 shutdown_connections 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5258066f30 0x7f52580693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52740c8e00 0x7f52740c4820 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f527406bcd0 0x7f527406ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 --2- 172.21.15.86:0/2729628827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f527406c0a0 0x7f527413ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 >> 172.21.15.86:0/2729628827 conn(0x7f52740ce600 msgr2=0x7f5274140bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 shutdown_connections 2023-10-09T13:17:01.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.387+0000 7f527c5ff700 1 -- 172.21.15.86:0/2729628827 wait complete. 2023-10-09T13:17:01.390 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 1 to deep-scrub 2023-10-09T13:17:01.405 INFO:tasks.ceph:Scrubbing osd.2 2023-10-09T13:17:01.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:01.591 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.590+0000 7f564bbff700 1 Processor -- start 2023-10-09T13:17:01.592 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.590+0000 7f564bbff700 1 -- start start 2023-10-09T13:17:01.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.591+0000 7f564bbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f5644068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.591+0000 7f564bbff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5644069a50 0x7f5644156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.591+0000 7f564bbff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440ac030 con 0x7f56440c8490 2023-10-09T13:17:01.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.591+0000 7f564bbff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440ab820 con 0x7f5644069a50 2023-10-09T13:17:01.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.591+0000 7f564bbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564406dbb0 con 0x7f56440c6ac0 2023-10-09T13:17:01.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564999b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f56440c8490 0x7f564415a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58884/0 (socket says 172.21.15.86:58884) 2023-10-09T13:17:01.593 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564999b700 1 -- 172.21.15.86:0/3292342317 learned_addr learned my addr 172.21.15.86:0/3292342317 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:17:01.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564919a700 1 --2- 172.21.15.86:0/3292342317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f5644068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.594 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564a19c700 1 --2- 172.21.15.86:0/3292342317 >> v2:172.21.15.135:3300/0 conn(0x7f5644069a50 0x7f5644156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f5648999700 1 -- 172.21.15.86:0/3292342317 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491019794 0 0) 0x7f5640001110 con 0x7f56440c8490 2023-10-09T13:17:01.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f5648999700 1 -- 172.21.15.86:0/3292342317 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5630003570 con 0x7f56440c8490 2023-10-09T13:17:01.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564919a700 1 -- 172.21.15.86:0/3292342317 >> v2:172.21.15.135:3300/0 conn(0x7f5644069a50 msgr2=0x7f5644156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564919a700 1 --2- 172.21.15.86:0/3292342317 >> v2:172.21.15.135:3300/0 conn(0x7f5644069a50 0x7f5644156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564919a700 1 -- 172.21.15.86:0/3292342317 >> v1:172.21.15.86:6789/0 conn(0x7f56440c8490 legacy=0x7f564415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564919a700 1 -- 172.21.15.86:0/3292342317 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440c6f10 con 0x7f56440c6ac0 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.592+0000 7f564a19c700 1 --2- 172.21.15.86:0/3292342317 >> v2:172.21.15.135:3300/0 conn(0x7f5644069a50 0x7f5644156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f564919a700 1 --2- 172.21.15.86:0/3292342317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f5644068390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f56340098e0 tx=0x7f56340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d831ae09ea6edb24 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f5648999700 1 -- 172.21.15.86:0/3292342317 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634011630 con 0x7f56440c6ac0 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f5648999700 1 -- 172.21.15.86:0/3292342317 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634011790 con 0x7f56440c6ac0 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f5648999700 1 -- 172.21.15.86:0/3292342317 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634011b30 con 0x7f56440c6ac0 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f564bbff700 1 -- 172.21.15.86:0/3292342317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 msgr2=0x7f5644068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f564bbff700 1 --2- 172.21.15.86:0/3292342317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f5644068390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f56340098e0 tx=0x7f56340091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.596 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f564bbff700 1 -- 172.21.15.86:0/3292342317 shutdown_connections 2023-10-09T13:17:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f564bbff700 1 --2- 172.21.15.86:0/3292342317 >> v2:172.21.15.135:3300/0 conn(0x7f5644069a50 0x7f5644156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f564bbff700 1 --2- 172.21.15.86:0/3292342317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f5644068390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.593+0000 7f564bbff700 1 -- 172.21.15.86:0/3292342317 >> 172.21.15.86:0/3292342317 conn(0x7f56440c8f90 msgr2=0x7f56440c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.594+0000 7f564bbff700 1 -- 172.21.15.86:0/3292342317 shutdown_connections 2023-10-09T13:17:01.597 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.594+0000 7f564bbff700 1 -- 172.21.15.86:0/3292342317 wait complete. 2023-10-09T13:17:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.595+0000 7f564bbff700 1 Processor -- start 2023-10-09T13:17:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.595+0000 7f564bbff700 1 -- start start 2023-10-09T13:17:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564bbff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5644069a50 0x7f56441539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.599 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564bbff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f56440c0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564bbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56440c8490 0x7f56440a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564bbff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644157b20 con 0x7f5644069a50 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564bbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440aa3a0 con 0x7f56440c8490 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564bbff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440aa680 con 0x7f56440c6ac0 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564999b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5644069a50 0x7f56441539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564999b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5644069a50 0x7f56441539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46732/0 (socket says 172.21.15.86:46732) 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564999b700 1 -- 172.21.15.86:0/2392081262 learned_addr learned my addr 172.21.15.86:0/2392081262 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564919a700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f56440c0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.596+0000 7f564a19c700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56440c8490 0x7f56440a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564999b700 1 -- 172.21.15.86:0/2392081262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 msgr2=0x7f56440c0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564999b700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56440c6ac0 0x7f56440c0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564999b700 1 -- 172.21.15.86:0/2392081262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56440c8490 msgr2=0x7f56440a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564999b700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56440c8490 0x7f56440a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564999b700 1 -- 172.21.15.86:0/2392081262 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c009a20 con 0x7f5644069a50 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564999b700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5644069a50 0x7f56441539b0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f564000c590 tx=0x7f5640007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640005b30 con 0x7f5644069a50 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5640005c90 con 0x7f5644069a50 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5634009420 con 0x7f5644069a50 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640007320 con 0x7f5644069a50 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.597+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56440aaed0 con 0x7f5644069a50 2023-10-09T13:17:01.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.598+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5644157610 con 0x7f5644069a50 2023-10-09T13:17:01.602 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.599+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f564001b3b0 con 0x7f5644069a50 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.600+0000 7f5639ffb700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5628066f30 0x7f56280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.600+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f56400839f0 con 0x7f5644069a50 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.600+0000 7f564919a700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5628066f30 0x7f56280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.600+0000 7f5639ffb700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f562806d6d0 0x7f562806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.600+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 --> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5628070170 con 0x7f562806d6d0 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.600+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5640088220 con 0x7f5644069a50 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.600+0000 7f564a19c700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f562806d6d0 0x7f562806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.601+0000 7f564919a700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5628066f30 0x7f56280693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56340091e0 tx=0x7f5634017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.601+0000 7f564a19c700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f562806d6d0 0x7f562806fb40 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.603 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.602+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== osd.2 v2:172.21.15.86:6808/85766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5628070170 con 0x7f562806d6d0 2023-10-09T13:17:01.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.616+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 --> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56440ac030 con 0x7f562806d6d0 2023-10-09T13:17:01.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.616+0000 7f5639ffb700 1 -- 172.21.15.86:0/2392081262 <== osd.2 v2:172.21.15.86:6808/85766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f56440ac030 con 0x7f562806d6d0 2023-10-09T13:17:01.617 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:01.618 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.616+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f562806d6d0 msgr2=0x7f562806fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.616+0000 7f564bbff700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6808/85766,v1:172.21.15.86:6809/85766] conn(0x7f562806d6d0 0x7f562806fb40 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5628066f30 msgr2=0x7f56280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f5628066f30 0x7f56280693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56340091e0 tx=0x7f5634017000 comp rx=0 tx=0).stop 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5644069a50 msgr2=0x7f56441539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 --2- 172.21.15.86:0/2392081262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5644069a50 0x7f56441539b0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f564000c590 tx=0x7f5640007c70 comp rx=0 tx=0).stop 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564a19c700 1 -- 172.21.15.86:0/2392081262 reap_dead start 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 shutdown_connections 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 >> 172.21.15.86:0/2392081262 conn(0x7f56440c8f90 msgr2=0x7f56440cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 shutdown_connections 2023-10-09T13:17:01.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.617+0000 7f564bbff700 1 -- 172.21.15.86:0/2392081262 wait complete. 2023-10-09T13:17:01.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-09T13:17:01.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.815+0000 7f937bfff700 1 Processor -- start 2023-10-09T13:17:01.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.815+0000 7f937bfff700 1 -- start start 2023-10-09T13:17:01.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f937bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f9374155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f937bfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740ad930 con 0x7f93740af2f0 2023-10-09T13:17:01.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f937bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740acd20 con 0x7f9374155c10 2023-10-09T13:17:01.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f937bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93740ad000 con 0x7f93741578b0 2023-10-09T13:17:01.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f937a59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f93740af2f0 0x7f93740af710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58888/0 (socket says 172.21.15.86:58888) 2023-10-09T13:17:01.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f937a59c700 1 -- 172.21.15.86:0/2181599376 learned_addr learned my addr 172.21.15.86:0/2181599376 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:17:01.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f937959a700 1 --2- 172.21.15.86:0/2181599376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f9374155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.817+0000 7f9378d99700 1 -- 172.21.15.86:0/2181599376 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570250811 0 0) 0x7f93740ad930 con 0x7f93740af2f0 2023-10-09T13:17:01.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f9378d99700 1 -- 172.21.15.86:0/2181599376 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9360004680 con 0x7f93740af2f0 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f9378d99700 1 -- 172.21.15.86:0/2181599376 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079931441 0 0) 0x7f93740acd20 con 0x7f9374155c10 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f9378d99700 1 -- 172.21.15.86:0/2181599376 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93740ad930 con 0x7f9374155c10 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f937959a700 1 -- 172.21.15.86:0/2181599376 >> v1:172.21.15.135:6789/0 conn(0x7f9374155c10 legacy=0x7f93740ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f937959a700 1 -- 172.21.15.86:0/2181599376 >> v1:172.21.15.86:6789/0 conn(0x7f93740af2f0 legacy=0x7f93740af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f937959a700 1 -- 172.21.15.86:0/2181599376 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93740ad2e0 con 0x7f93741578b0 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f937959a700 1 --2- 172.21.15.86:0/2181599376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f9374155fe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9364009910 tx=0x7f93640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0408765f8079b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f9378d99700 1 -- 172.21.15.86:0/2181599376 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364011630 con 0x7f93741578b0 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f9378d99700 1 -- 172.21.15.86:0/2181599376 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9364011790 con 0x7f93741578b0 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.818+0000 7f9378d99700 1 -- 172.21.15.86:0/2181599376 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364011b30 con 0x7f93741578b0 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.819+0000 7f937bfff700 1 -- 172.21.15.86:0/2181599376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 msgr2=0x7f9374155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.819+0000 7f937bfff700 1 --2- 172.21.15.86:0/2181599376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f9374155fe0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9364009910 tx=0x7f93640091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.819+0000 7f937bfff700 1 -- 172.21.15.86:0/2181599376 shutdown_connections 2023-10-09T13:17:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.819+0000 7f937bfff700 1 --2- 172.21.15.86:0/2181599376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f9374155fe0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.819+0000 7f937bfff700 1 -- 172.21.15.86:0/2181599376 >> 172.21.15.86:0/2181599376 conn(0x7f937406a320 msgr2=0x7f93740cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.819+0000 7f937bfff700 1 -- 172.21.15.86:0/2181599376 shutdown_connections 2023-10-09T13:17:01.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.819+0000 7f937bfff700 1 -- 172.21.15.86:0/2181599376 wait complete. 2023-10-09T13:17:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.820+0000 7f937bfff700 1 Processor -- start 2023-10-09T13:17:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.821+0000 7f937bfff700 1 -- start start 2023-10-09T13:17:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.821+0000 7f937bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740af2f0 0x7f937416a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.821+0000 7f937bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9374155c10 0x7f937415d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.821+0000 7f937bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f937415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.821+0000 7f937bfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937414de00 con 0x7f93740af2f0 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.821+0000 7f937bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93740aa330 con 0x7f9374155c10 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.821+0000 7f937bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93740a9a00 con 0x7f93741578b0 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740af2f0 0x7f937416a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740af2f0 0x7f937416a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46734/0 (socket says 172.21.15.86:46734) 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 -- 172.21.15.86:0/1818725855 learned_addr learned my addr 172.21.15.86:0/1818725855 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f937959a700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9374155c10 0x7f937415d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f937a59c700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f937415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 -- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 msgr2=0x7f937415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f937415d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 -- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9374155c10 msgr2=0x7f937415d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9374155c10 0x7f937415d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 -- 172.21.15.86:0/1818725855 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364009420 con 0x7f93740af2f0 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f937a59c700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f937415d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9379d9b700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740af2f0 0x7f937416a5e0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f937000c7c0 tx=0x7f9370007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.822+0000 7f9369ffb700 1 -- 172.21.15.86:0/1818725855 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370010510 con 0x7f93740af2f0 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.823+0000 7f9369ffb700 1 -- 172.21.15.86:0/1818725855 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370010670 con 0x7f93740af2f0 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.823+0000 7f9369ffb700 1 -- 172.21.15.86:0/1818725855 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370010a10 con 0x7f93740af2f0 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.823+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93740a9ce0 con 0x7f93740af2f0 2023-10-09T13:17:01.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.823+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93740aa7c0 con 0x7f93740af2f0 2023-10-09T13:17:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.824+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93740b0f90 con 0x7f93740af2f0 2023-10-09T13:17:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.825+0000 7f9369ffb700 1 -- 172.21.15.86:0/1818725855 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f937001b3b0 con 0x7f93740af2f0 2023-10-09T13:17:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.826+0000 7f9369ffb700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.826+0000 7f9369ffb700 1 -- 172.21.15.86:0/1818725855 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f9370083ee0 con 0x7f93740af2f0 2023-10-09T13:17:01.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.826+0000 7f937959a700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:01.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.827+0000 7f937959a700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9358066f30 0x7f93580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93640091e0 tx=0x7f9364017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:01.830 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:01.829+0000 7f9369ffb700 1 -- 172.21.15.86:0/1818725855 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9370051020 con 0x7f93740af2f0 2023-10-09T13:17:02.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.022+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f937404c3c0 con 0x7f9358066f30 2023-10-09T13:17:02.024 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.023+0000 7f9369ffb700 1 -- 172.21.15.86:0/1818725855 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f937404c3c0 con 0x7f9358066f30 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9358066f30 msgr2=0x7f93580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9358066f30 0x7f93580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93640091e0 tx=0x7f9364017000 comp rx=0 tx=0).stop 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740af2f0 msgr2=0x7f937416a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740af2f0 0x7f937416a5e0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f937000c7c0 tx=0x7f9370007e10 comp rx=0 tx=0).stop 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 shutdown_connections 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9358066f30 0x7f93580693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740af2f0 0x7f937416a5e0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93741578b0 0x7f937415d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.027 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 --2- 172.21.15.86:0/1818725855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9374155c10 0x7f937415d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 >> 172.21.15.86:0/1818725855 conn(0x7f937406a320 msgr2=0x7f93740b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:02.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 shutdown_connections 2023-10-09T13:17:02.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.025+0000 7f937bfff700 1 -- 172.21.15.86:0/1818725855 wait complete. 2023-10-09T13:17:02.028 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 2 to deep-scrub 2023-10-09T13:17:02.044 INFO:tasks.ceph:Scrubbing osd.3 2023-10-09T13:17:02.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:02.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.228+0000 7f7cedd9d700 1 Processor -- start 2023-10-09T13:17:02.229 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.228+0000 7f7cedd9d700 1 -- start start 2023-10-09T13:17:02.231 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7cedd9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7ce80cb560 0x7f7ce80cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7cedd9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ce80cc970 0x7f7ce80697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7cedd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce8069cf0 0x7f7ce806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7cedd9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce806aa30 con 0x7f7ce80cc970 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7cedd9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce80cce10 con 0x7f7ce80cb560 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7cedd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce8159db0 con 0x7f7ce8069cf0 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7ce7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ce80cc970 0x7f7ce80697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.229+0000 7f7ce7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ce80cc970 0x7f7ce80697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46740/0 (socket says 172.21.15.86:46740) 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce7fff700 1 -- 172.21.15.86:0/540497437 learned_addr learned my addr 172.21.15.86:0/540497437 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7cecd9b700 1 --2- 172.21.15.86:0/540497437 >> v2:172.21.15.135:3300/0 conn(0x7f7ce80cb560 0x7f7ce80cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.232 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ced59c700 1 --2- 172.21.15.86:0/540497437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce8069cf0 0x7f7ce806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce7fff700 1 -- 172.21.15.86:0/540497437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce8069cf0 msgr2=0x7f7ce806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce7fff700 1 --2- 172.21.15.86:0/540497437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce8069cf0 0x7f7ce806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce7fff700 1 -- 172.21.15.86:0/540497437 >> v2:172.21.15.135:3300/0 conn(0x7f7ce80cb560 msgr2=0x7f7ce80cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce7fff700 1 --2- 172.21.15.86:0/540497437 >> v2:172.21.15.135:3300/0 conn(0x7f7ce80cb560 0x7f7ce80cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce7fff700 1 -- 172.21.15.86:0/540497437 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce806a470 con 0x7f7ce80cc970 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce7fff700 1 --2- 172.21.15.86:0/540497437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 0x7f7ce80697b0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40099b0 tx=0x7f7cd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708a357cc15428d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce77fe700 1 -- 172.21.15.86:0/540497437 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400b640 con 0x7f7ce80cc970 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce77fe700 1 -- 172.21.15.86:0/540497437 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd400b7a0 con 0x7f7ce80cc970 2023-10-09T13:17:02.233 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.230+0000 7f7ce77fe700 1 -- 172.21.15.86:0/540497437 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400bb40 con 0x7f7ce80cc970 2023-10-09T13:17:02.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 -- 172.21.15.86:0/540497437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 msgr2=0x7f7ce80697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.234 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 --2- 172.21.15.86:0/540497437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 0x7f7ce80697b0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40099b0 tx=0x7f7cd4009250 comp rx=0 tx=0).stop 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 -- 172.21.15.86:0/540497437 shutdown_connections 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 --2- 172.21.15.86:0/540497437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce8069cf0 0x7f7ce806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 --2- 172.21.15.86:0/540497437 >> v2:172.21.15.135:3300/0 conn(0x7f7ce80cb560 0x7f7ce80cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 --2- 172.21.15.86:0/540497437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 0x7f7ce80697b0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 -- 172.21.15.86:0/540497437 >> 172.21.15.86:0/540497437 conn(0x7f7ce806baf0 msgr2=0x7f7ce806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 -- 172.21.15.86:0/540497437 shutdown_connections 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.231+0000 7f7cedd9d700 1 -- 172.21.15.86:0/540497437 wait complete. 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.233+0000 7f7cedd9d700 1 Processor -- start 2023-10-09T13:17:02.235 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.233+0000 7f7cedd9d700 1 -- start start 2023-10-09T13:17:02.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cedd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce8069cf0 0x7f7ce8169f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cedd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80cb560 0x7f7ce80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cedd9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 0x7f7ce80c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cedd9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80ade90 con 0x7f7ce80cc970 2023-10-09T13:17:02.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cedd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80aecf0 con 0x7f7ce8069cf0 2023-10-09T13:17:02.237 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cedd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80ae0e0 con 0x7f7ce80cb560 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7ced59c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 0x7f7ce80c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cecd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce8069cf0 0x7f7ce8169f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cecd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce8069cf0 0x7f7ce8169f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:44008/0 (socket says 172.21.15.86:44008) 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cecd9b700 1 -- 172.21.15.86:0/3261520927 learned_addr learned my addr 172.21.15.86:0/3261520927 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7ce7fff700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80cb560 0x7f7ce80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7ced59c700 1 -- 172.21.15.86:0/3261520927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80cb560 msgr2=0x7f7ce80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7ced59c700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80cb560 0x7f7ce80c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7ced59c700 1 -- 172.21.15.86:0/3261520927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce8069cf0 msgr2=0x7f7ce8169f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7ced59c700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce8069cf0 0x7f7ce8169f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.238 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7ced59c700 1 -- 172.21.15.86:0/3261520927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40094f0 con 0x7f7ce80cc970 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.234+0000 7f7cecd9b700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce8069cf0 0x7f7ce8169f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.235+0000 7f7ced59c700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 0x7f7ce80c7c70 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009e80 tx=0x7f7ce000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.235+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000caa0 con 0x7f7ce80cc970 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.235+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce000f040 con 0x7f7ce80cc970 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.235+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce80ae3c0 con 0x7f7ce80cc970 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.235+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000ce70 con 0x7f7ce80cc970 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.235+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce80ae980 con 0x7f7ce80cc970 2023-10-09T13:17:02.239 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.236+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ce804c3c0 con 0x7f7ce80cc970 2023-10-09T13:17:02.240 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.237+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ce0014690 con 0x7f7ce80cc970 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.238+0000 7f7ce4ff9700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7ccc066f30 0x7f7ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.238+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f7ce0085230 con 0x7f7ce80cc970 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.238+0000 7f7cecd9b700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7ccc066f30 0x7f7ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.238+0000 7f7ce4ff9700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f7ccc06d6d0 0x7f7ccc06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.238+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 --> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ccc070170 con 0x7f7ccc06d6d0 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.238+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ce0087870 con 0x7f7ce80cc970 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.238+0000 7f7ce7fff700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f7ccc06d6d0 0x7f7ccc06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.239+0000 7f7cecd9b700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7ccc066f30 0x7f7ccc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009fd0 tx=0x7f7cdc0091a0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.239+0000 7f7ce7fff700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f7ccc06d6d0 0x7f7ccc06fb40 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.241 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.239+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== osd.3 v2:172.21.15.86:6816/85767 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7ccc070170 con 0x7f7ccc06d6d0 2023-10-09T13:17:02.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 --> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7ce806a750 con 0x7f7ccc06d6d0 2023-10-09T13:17:02.255 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7ce4ff9700 1 -- 172.21.15.86:0/3261520927 <== osd.3 v2:172.21.15.86:6816/85767 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7ce806a750 con 0x7f7ccc06d6d0 2023-10-09T13:17:02.255 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:02.255 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:02.255 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:02.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f7ccc06d6d0 msgr2=0x7f7ccc06fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6816/85767,v1:172.21.15.86:6818/85767] conn(0x7f7ccc06d6d0 0x7f7ccc06fb40 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.256 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7ccc066f30 msgr2=0x7f7ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7ccc066f30 0x7f7ccc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009fd0 tx=0x7f7cdc0091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 msgr2=0x7f7ce80c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 --2- 172.21.15.86:0/3261520927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce80cc970 0x7f7ce80c7c70 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009e80 tx=0x7f7ce000b040 comp rx=0 tx=0).stop 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7ced59c700 1 -- 172.21.15.86:0/3261520927 reap_dead start 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 shutdown_connections 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.254+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 >> 172.21.15.86:0/3261520927 conn(0x7f7ce806baf0 msgr2=0x7f7ce806d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.255+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 shutdown_connections 2023-10-09T13:17:02.257 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.255+0000 7f7cedd9d700 1 -- 172.21.15.86:0/3261520927 wait complete. 2023-10-09T13:17:02.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-09T13:17:02.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.452+0000 7fa99d3ff700 1 Processor -- start 2023-10-09T13:17:02.454 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.453+0000 7fa99d3ff700 1 -- start start 2023-10-09T13:17:02.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa99d3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa9980ccf90 0x7fa9980ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa99d3ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980cc300 con 0x7fa9980cbf30 2023-10-09T13:17:02.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa99d3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980ad370 con 0x7fa9980b1420 2023-10-09T13:17:02.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa99d3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa998156bf0 con 0x7fa9980ccf90 2023-10-09T13:17:02.455 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa996ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa9980cbf30 0x7fa9980b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58896/0 (socket says 172.21.15.86:58896) 2023-10-09T13:17:02.456 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa996ffd700 1 -- 172.21.15.86:0/64733241 learned_addr learned my addr 172.21.15.86:0/64733241 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:17:02.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa9977fe700 1 --2- 172.21.15.86:0/64733241 >> v2:172.21.15.135:3300/0 conn(0x7fa9980ccf90 0x7fa9980ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421680171 0 0) 0x7fa9980cc300 con 0x7fa9980cbf30 2023-10-09T13:17:02.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.454+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa984003570 con 0x7fa9980cbf30 2023-10-09T13:17:02.458 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 756013938 0 0) 0x7fa984003570 con 0x7fa9980cbf30 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 >> v2:172.21.15.135:3300/0 conn(0x7fa9980ccf90 msgr2=0x7fa9980ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 --2- 172.21.15.86:0/64733241 >> v2:172.21.15.135:3300/0 conn(0x7fa9980ccf90 0x7fa9980ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 >> v1:172.21.15.135:6789/0 conn(0x7fa9980b1420 legacy=0x7fa9980c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980ad650 con 0x7fa9980cbf30 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7fa988001470 con 0x7fa9980cbf30 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 >> v1:172.21.15.86:6789/0 conn(0x7fa9980cbf30 legacy=0x7fa9980b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa984003a60 0x7fa984003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa984004810 0x7fa984004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa98400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998156bf0 con 0x7fa9840051c0 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98400c0d0 con 0x7fa984004810 2023-10-09T13:17:02.459 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98400c290 con 0x7fa984003a60 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa9977fe700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa98400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa98ffff700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa984004810 0x7fa984004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.455+0000 7fa996ffd700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa984003a60 0x7fa984003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9977fe700 1 -- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa984003a60 msgr2=0x7fa984003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9977fe700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa984003a60 0x7fa984003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9977fe700 1 -- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa984004810 msgr2=0x7fa984004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9977fe700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa984004810 0x7fa984004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9977fe700 1 -- 172.21.15.86:0/64733241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984003570 con 0x7fa9840051c0 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9977fe700 1 -- 172.21.15.86:0/64733241 reap_dead start 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9977fe700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa98400ba60 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e210 tx=0x7fa99000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27de5a204ea11b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.460 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000eac0 con 0x7fa9840051c0 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99000f040 con 0x7fa9840051c0 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.456+0000 7fa9967fc700 1 -- 172.21.15.86:0/64733241 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000ee70 con 0x7fa9840051c0 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.457+0000 7fa99d3ff700 1 -- 172.21.15.86:0/64733241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 msgr2=0x7fa98400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.457+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa98400ba60 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e210 tx=0x7fa99000b040 comp rx=0 tx=0).stop 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.457+0000 7fa99d3ff700 1 -- 172.21.15.86:0/64733241 shutdown_connections 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.457+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/64733241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa98400ba60 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.457+0000 7fa99d3ff700 1 -- 172.21.15.86:0/64733241 >> 172.21.15.86:0/64733241 conn(0x7fa99806a320 msgr2=0x7fa9980cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.457+0000 7fa99d3ff700 1 -- 172.21.15.86:0/64733241 shutdown_connections 2023-10-09T13:17:02.461 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.457+0000 7fa99d3ff700 1 -- 172.21.15.86:0/64733241 wait complete. 2023-10-09T13:17:02.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.458+0000 7fa99d3ff700 1 Processor -- start 2023-10-09T13:17:02.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.458+0000 7fa99d3ff700 1 -- start start 2023-10-09T13:17:02.463 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa99d3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa998158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa99d3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa998157590 0x7fa998159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa99d3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa998157a00 0x7fa998159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa99d3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998155ba0 con 0x7fa9840051c0 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa99d3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998154f90 con 0x7fa998157a00 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa99d3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa998155270 con 0x7fa998157590 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa996ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa998158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa996ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa998158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46766/0 (socket says 172.21.15.86:46766) 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.459+0000 7fa996ffd700 1 -- 172.21.15.86:0/1432217867 learned_addr learned my addr 172.21.15.86:0/1432217867 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa996ffd700 1 -- 172.21.15.86:0/1432217867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa998157590 msgr2=0x7fa998159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa996ffd700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa998157590 0x7fa998159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.464 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa996ffd700 1 -- 172.21.15.86:0/1432217867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa998157a00 msgr2=0x7fa998159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa996ffd700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa998157a00 0x7fa998159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa996ffd700 1 -- 172.21.15.86:0/1432217867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998155550 con 0x7fa9840051c0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa996ffd700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa998158130 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fa988007390 tx=0x7fa988001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa98effd700 1 -- 172.21.15.86:0/1432217867 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988018030 con 0x7fa9840051c0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa98effd700 1 -- 172.21.15.86:0/1432217867 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98800f8d0 con 0x7fa9840051c0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa998155830 con 0x7fa9840051c0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa98effd700 1 -- 172.21.15.86:0/1432217867 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800fcb0 con 0x7fa9840051c0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.460+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa998158670 con 0x7fa9840051c0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.461+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa998158890 con 0x7fa9840051c0 2023-10-09T13:17:02.465 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.462+0000 7fa98effd700 1 -- 172.21.15.86:0/1432217867 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa98801b070 con 0x7fa9840051c0 2023-10-09T13:17:02.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.463+0000 7fa98effd700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.463+0000 7fa98effd700 1 -- 172.21.15.86:0/1432217867 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fa988019070 con 0x7fa9840051c0 2023-10-09T13:17:02.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.463+0000 7fa98ffff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.466 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.464+0000 7fa98ffff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa978066f30 0x7fa9780693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa980000c00 tx=0x7fa980007d30 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.468 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.467+0000 7fa98effd700 1 -- 172.21.15.86:0/1432217867 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9880516c0 con 0x7fa9840051c0 2023-10-09T13:17:02.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.656+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9981553e0 con 0x7fa978066f30 2023-10-09T13:17:02.658 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.656+0000 7fa98effd700 1 -- 172.21.15.86:0/1432217867 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9981553e0 con 0x7fa978066f30 2023-10-09T13:17:02.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa978066f30 msgr2=0x7fa9780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa978066f30 0x7fa9780693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa980000c00 tx=0x7fa980007d30 comp rx=0 tx=0).stop 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 msgr2=0x7fa998158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa998158130 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fa988007390 tx=0x7fa988001e50 comp rx=0 tx=0).stop 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 shutdown_connections 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fa978066f30 0x7fa9780693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9840051c0 0x7fa998158130 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa998157a00 0x7fa998159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 --2- 172.21.15.86:0/1432217867 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa998157590 0x7fa998159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 >> 172.21.15.86:0/1432217867 conn(0x7fa99806a320 msgr2=0x7fa998068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 shutdown_connections 2023-10-09T13:17:02.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.659+0000 7fa99d3ff700 1 -- 172.21.15.86:0/1432217867 wait complete. 2023-10-09T13:17:02.662 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 3 to deep-scrub 2023-10-09T13:17:02.677 INFO:tasks.ceph:Scrubbing osd.4 2023-10-09T13:17:02.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:02.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.859+0000 7f936c9ff700 1 Processor -- start 2023-10-09T13:17:02.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.859+0000 7f936c9ff700 1 -- start start 2023-10-09T13:17:02.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.860+0000 7f936c9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.860+0000 7f936c9ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680b4570 con 0x7f9368154320 2023-10-09T13:17:02.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.860+0000 7f936c9ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936815a730 con 0x7f936806d840 2023-10-09T13:17:02.863 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.860+0000 7f936c9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936815aa10 con 0x7f9368153f50 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.860+0000 7f935ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9368154320 0x7f936806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58898/0 (socket says 172.21.15.86:58898) 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f935ffff700 1 -- 172.21.15.86:0/1530340856 learned_addr learned my addr 172.21.15.86:0/1530340856 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f936659c700 1 --2- 172.21.15.86:0/1530340856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f9365d9b700 1 -- 172.21.15.86:0/1530340856 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371546879 0 0) 0x7f93680b4570 con 0x7f9368154320 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f9365d9b700 1 -- 172.21.15.86:0/1530340856 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9354003570 con 0x7f9368154320 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f9365d9b700 1 -- 172.21.15.86:0/1530340856 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216909034 0 0) 0x7f936815a730 con 0x7f936806d840 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f936659c700 1 -- 172.21.15.86:0/1530340856 >> v1:172.21.15.135:6789/0 conn(0x7f936806d840 legacy=0x7f9368069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f936659c700 1 -- 172.21.15.86:0/1530340856 >> v1:172.21.15.86:6789/0 conn(0x7f9368154320 legacy=0x7f936806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f936659c700 1 -- 172.21.15.86:0/1530340856 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936815acf0 con 0x7f9368153f50 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.861+0000 7f936659c700 1 --2- 172.21.15.86:0/1530340856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680b2000 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9358009910 tx=0x7f93580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cbeee0ec3033ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.864 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f9365d9b700 1 -- 172.21.15.86:0/1530340856 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800b680 con 0x7f9368153f50 2023-10-09T13:17:02.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f9365d9b700 1 -- 172.21.15.86:0/1530340856 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935800b7e0 con 0x7f9368153f50 2023-10-09T13:17:02.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f9365d9b700 1 -- 172.21.15.86:0/1530340856 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800bba0 con 0x7f9368153f50 2023-10-09T13:17:02.865 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f936c9ff700 1 -- 172.21.15.86:0/1530340856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 msgr2=0x7f93680b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f936c9ff700 1 --2- 172.21.15.86:0/1530340856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680b2000 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9358009910 tx=0x7f93580091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f936c9ff700 1 -- 172.21.15.86:0/1530340856 shutdown_connections 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f936c9ff700 1 --2- 172.21.15.86:0/1530340856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680b2000 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f936c9ff700 1 -- 172.21.15.86:0/1530340856 >> 172.21.15.86:0/1530340856 conn(0x7f936806baf0 msgr2=0x7f936806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f936c9ff700 1 -- 172.21.15.86:0/1530340856 shutdown_connections 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.862+0000 7f936c9ff700 1 -- 172.21.15.86:0/1530340856 wait complete. 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.864+0000 7f936c9ff700 1 Processor -- start 2023-10-09T13:17:02.866 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.864+0000 7f936c9ff700 1 -- start start 2023-10-09T13:17:02.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936c9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f936806d840 0x7f936816b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936c9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936c9ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9368154320 0x7f93681420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936c9ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680caa10 con 0x7f9368154320 2023-10-09T13:17:02.868 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936c9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680cb830 con 0x7f936806d840 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936c9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93680cac20 con 0x7f9368153f50 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9368154320 0x7f93681420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9368154320 0x7f93681420f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46774/0 (socket says 172.21.15.86:46774) 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 -- 172.21.15.86:0/498265851 learned_addr learned my addr 172.21.15.86:0/498265851 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f935ffff700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936659c700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f936806d840 0x7f936816b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 -- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 msgr2=0x7f93680cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9368153f50 0x7f93680cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 -- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f936806d840 msgr2=0x7f936816b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f936806d840 0x7f936816b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.869 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f9366d9d700 1 -- 172.21.15.86:0/498265851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358009420 con 0x7f9368154320 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.865+0000 7f936659c700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f936806d840 0x7f936816b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.866+0000 7f9366d9d700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9368154320 0x7f93681420f0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f936000c910 tx=0x7f9360001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.866+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360012630 con 0x7f9368154320 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.866+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360012790 con 0x7f9368154320 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.866+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360012b50 con 0x7f9368154320 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.866+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93680caf00 con 0x7f9368154320 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.866+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93680cb4c0 con 0x7f9368154320 2023-10-09T13:17:02.870 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.867+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93680718b0 con 0x7f9368154320 2023-10-09T13:17:02.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.868+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9360024430 con 0x7f9368154320 2023-10-09T13:17:02.871 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.869+0000 7f935e7fc700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9348066f30 0x7f93480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.869+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f9360085090 con 0x7f9368154320 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.869+0000 7f936659c700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9348066f30 0x7f93480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.869+0000 7f935e7fc700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f934806d6d0 0x7f934806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.869+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 --> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9348070170 con 0x7f934806d6d0 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.869+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9360085380 con 0x7f9368154320 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.870+0000 7f935ffff700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f934806d6d0 0x7f934806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.870+0000 7f936659c700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9348066f30 0x7f93480693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93580093f0 tx=0x7f9358017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.870+0000 7f935ffff700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f934806d6d0 0x7f934806fb40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:02.872 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.871+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== osd.4 v2:172.21.15.135:6800/114751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9348070170 con 0x7f934806d6d0 2023-10-09T13:17:02.886 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.885+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 --> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f936815afd0 con 0x7f934806d6d0 2023-10-09T13:17:02.887 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f935e7fc700 1 -- 172.21.15.86:0/498265851 <== osd.4 v2:172.21.15.135:6800/114751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f936815afd0 con 0x7f934806d6d0 2023-10-09T13:17:02.887 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:02.887 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:02.887 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:02.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f934806d6d0 msgr2=0x7f934806fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.135:6800/114751,v1:172.21.15.135:6801/114751] conn(0x7f934806d6d0 0x7f934806fb40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9348066f30 msgr2=0x7f93480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9348066f30 0x7f93480693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93580093f0 tx=0x7f9358017000 comp rx=0 tx=0).stop 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9368154320 msgr2=0x7f93681420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 --2- 172.21.15.86:0/498265851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9368154320 0x7f93681420f0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f936000c910 tx=0x7f9360001700 comp rx=0 tx=0).stop 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f9366d9d700 1 -- 172.21.15.86:0/498265851 reap_dead start 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 shutdown_connections 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.886+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 >> 172.21.15.86:0/498265851 conn(0x7f936806baf0 msgr2=0x7f93680afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.887+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 shutdown_connections 2023-10-09T13:17:02.889 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:02.887+0000 7f936c9ff700 1 -- 172.21.15.86:0/498265851 wait complete. 2023-10-09T13:17:02.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.085+0000 7f638ffff700 1 Processor -- start 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.086+0000 7f638ffff700 1 -- start start 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f639006d950 0x7f63900c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638ffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639006ae70 con 0x7f639006dd20 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63900c7a30 con 0x7f639006a0a0 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638ffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639006a540 con 0x7f639006d950 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638effd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f639006d950 0x7f63900c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.089 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638effd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f639006d950 0x7f63900c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46782/0 (socket says 172.21.15.86:46782) 2023-10-09T13:17:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638effd700 1 -- 172.21.15.86:0/1617868862 learned_addr learned my addr 172.21.15.86:0/1617868862 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638effd700 1 -- 172.21.15.86:0/1617868862 >> v1:172.21.15.135:6789/0 conn(0x7f639006a0a0 legacy=0x7f63900c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638effd700 1 -- 172.21.15.86:0/1617868862 >> v1:172.21.15.86:6789/0 conn(0x7f639006dd20 legacy=0x7f63900c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638effd700 1 -- 172.21.15.86:0/1617868862 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639006a820 con 0x7f639006d950 2023-10-09T13:17:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.087+0000 7f638dffb700 1 -- 172.21.15.86:0/1617868862 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765283533 0 0) 0x7f639006ae70 con 0x7f639006dd20 2023-10-09T13:17:03.090 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.088+0000 7f638effd700 1 --2- 172.21.15.86:0/1617868862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8350 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f63800099b0 tx=0x7f6380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ffdb28b31ed24a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.088+0000 7f638dffb700 1 -- 172.21.15.86:0/1617868862 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000b860 con 0x7f639006d950 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.088+0000 7f638dffb700 1 -- 172.21.15.86:0/1617868862 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638000b9c0 con 0x7f639006d950 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.088+0000 7f638dffb700 1 -- 172.21.15.86:0/1617868862 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000bd60 con 0x7f639006d950 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.089+0000 7f638ffff700 1 -- 172.21.15.86:0/1617868862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 msgr2=0x7f63900c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.089+0000 7f638ffff700 1 --2- 172.21.15.86:0/1617868862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8350 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f63800099b0 tx=0x7f6380009250 comp rx=0 tx=0).stop 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.089+0000 7f638ffff700 1 -- 172.21.15.86:0/1617868862 shutdown_connections 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.089+0000 7f638ffff700 1 --2- 172.21.15.86:0/1617868862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8350 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.092 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.089+0000 7f638ffff700 1 -- 172.21.15.86:0/1617868862 >> 172.21.15.86:0/1617868862 conn(0x7f63900cc1f0 msgr2=0x7f63900cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:03.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.089+0000 7f638ffff700 1 -- 172.21.15.86:0/1617868862 shutdown_connections 2023-10-09T13:17:03.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.089+0000 7f638ffff700 1 -- 172.21.15.86:0/1617868862 wait complete. 2023-10-09T13:17:03.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.090+0000 7f638ffff700 1 Processor -- start 2023-10-09T13:17:03.093 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.090+0000 7f638ffff700 1 -- start start 2023-10-09T13:17:03.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.091+0000 7f638ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f639006a0a0 0x7f63900cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.091+0000 7f638ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.091+0000 7f638ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f639006dd20 0x7f6390169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.091+0000 7f638ffff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639015b140 con 0x7f639006d950 2023-10-09T13:17:03.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.091+0000 7f638ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639016acc0 con 0x7f639006a0a0 2023-10-09T13:17:03.095 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.091+0000 7f638ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63900c41b0 con 0x7f639006dd20 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46794/0 (socket says 172.21.15.86:46794) 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 -- 172.21.15.86:0/2527450725 learned_addr learned my addr 172.21.15.86:0/2527450725 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638effd700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f639006a0a0 0x7f63900cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638f7fe700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f639006dd20 0x7f6390169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 -- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f639006dd20 msgr2=0x7f6390169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f639006dd20 0x7f6390169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 -- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f639006a0a0 msgr2=0x7f63900cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f639006a0a0 0x7f63900cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 -- 172.21.15.86:0/2527450725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63800094f0 con 0x7f639006d950 2023-10-09T13:17:03.096 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638effd700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f639006a0a0 0x7f63900cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638f7fe700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f639006dd20 0x7f6390169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f638e7fc700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8be0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f638400c4e0 tx=0x7f638400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.092+0000 7f6376ffd700 1 -- 172.21.15.86:0/2527450725 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384011590 con 0x7f639006d950 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.093+0000 7f6376ffd700 1 -- 172.21.15.86:0/2527450725 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384011710 con 0x7f639006d950 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.093+0000 7f6376ffd700 1 -- 172.21.15.86:0/2527450725 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384011ad0 con 0x7f639006d950 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.093+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63900cb580 con 0x7f639006d950 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.093+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63900cbab0 con 0x7f639006d950 2023-10-09T13:17:03.097 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.094+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639004c3c0 con 0x7f639006d950 2023-10-09T13:17:03.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.094+0000 7f6376ffd700 1 -- 172.21.15.86:0/2527450725 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f638401b3b0 con 0x7f639006d950 2023-10-09T13:17:03.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.095+0000 7f6376ffd700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f637c066f30 0x7f637c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.096+0000 7f6376ffd700 1 -- 172.21.15.86:0/2527450725 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f6384083b20 con 0x7f639006d950 2023-10-09T13:17:03.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.096+0000 7f638effd700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f637c066f30 0x7f637c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.098 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.096+0000 7f638effd700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f637c066f30 0x7f637c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63800099b0 tx=0x7f6380017000 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.100 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.099+0000 7f6376ffd700 1 -- 172.21.15.86:0/2527450725 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6384050c60 con 0x7f639006d950 2023-10-09T13:17:03.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.288+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f63900c42f0 con 0x7f637c066f30 2023-10-09T13:17:03.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.289+0000 7f6376ffd700 1 -- 172.21.15.86:0/2527450725 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f63900c42f0 con 0x7f637c066f30 2023-10-09T13:17:03.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f637c066f30 msgr2=0x7f637c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f637c066f30 0x7f637c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63800099b0 tx=0x7f6380017000 comp rx=0 tx=0).stop 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 msgr2=0x7f63900c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8be0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f638400c4e0 tx=0x7f638400c8a0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 shutdown_connections 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f637c066f30 0x7f637c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f639006dd20 0x7f6390169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f639006a0a0 0x7f63900cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 --2- 172.21.15.86:0/2527450725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f639006d950 0x7f63900c8be0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 >> 172.21.15.86:0/2527450725 conn(0x7f63900cc1f0 msgr2=0x7f6390153bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 shutdown_connections 2023-10-09T13:17:03.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.291+0000 7f638ffff700 1 -- 172.21.15.86:0/2527450725 wait complete. 2023-10-09T13:17:03.294 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 4 to deep-scrub 2023-10-09T13:17:03.309 INFO:tasks.ceph:Scrubbing osd.5 2023-10-09T13:17:03.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:03.495 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.494+0000 7f48d3fff700 1 Processor -- start 2023-10-09T13:17:03.497 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.494+0000 7f48d3fff700 1 -- start start 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.495+0000 7f48d3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f48d4156350 0x7f48d4157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.495+0000 7f48d3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 0x7f48d415a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.495+0000 7f48d3fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d40b0570 con 0x7f48d40b0760 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.495+0000 7f48d3fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d41578b0 con 0x7f48d4156350 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.495+0000 7f48d3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40af4d0 con 0x7f48d40b0c00 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.495+0000 7f48d27fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f48d40b0760 0x7f48d4159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58908/0 (socket says 172.21.15.86:58908) 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.495+0000 7f48d27fc700 1 -- 172.21.15.86:0/1618116959 learned_addr learned my addr 172.21.15.86:0/1618116959 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:17:03.500 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/1618116959 >> v2:172.21.15.135:3300/0 conn(0x7f48d4156350 0x7f48d4157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421080394 0 0) 0x7f48d40b0570 con 0x7f48d40b0760 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 0x7f48d415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48bc003570 con 0x7f48d40b0760 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2194601511 0 0) 0x7f48bc003570 con 0x7f48d40b0760 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 msgr2=0x7f48d415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 0x7f48d415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 >> v2:172.21.15.135:3300/0 conn(0x7f48d4156350 msgr2=0x7f48d4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 --2- 172.21.15.86:0/1618116959 >> v2:172.21.15.135:3300/0 conn(0x7f48d4156350 0x7f48d4157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40af7b0 con 0x7f48d40b0760 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1456297833 0 0) 0x7f48c8001470 con 0x7f48d40b0760 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 >> v1:172.21.15.86:6789/0 conn(0x7f48d40b0760 legacy=0x7f48d4159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.501 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 0x7f48bc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc003fe0 0x7f48bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48bc004d50 0x7f48bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d41578b0 con 0x7f48bc004d50 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40af4d0 con 0x7f48bc003fe0 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc00ba90 con 0x7f48d40b0c00 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.496+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48bc004d50 0x7f48bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 0x7f48bc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d27fc700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc003fe0 0x7f48bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d37fe700 1 -- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 msgr2=0x7f48bc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48d40b0c00 0x7f48bc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.502 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d37fe700 1 -- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc003fe0 msgr2=0x7f48bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc003fe0 0x7f48bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d37fe700 1 -- 172.21.15.86:0/1618116959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc003570 con 0x7f48bc004d50 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48bc004d50 0x7f48bc0051c0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0113e0 tx=0x7f48cc009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ce34309c504090 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00f040 con 0x7f48bc004d50 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc011c30 con 0x7f48bc004d50 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.497+0000 7f48d1ffb700 1 -- 172.21.15.86:0/1618116959 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc015420 con 0x7f48bc004d50 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.498+0000 7f48d3fff700 1 -- 172.21.15.86:0/1618116959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48bc004d50 msgr2=0x7f48bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.498+0000 7f48d3fff700 1 --2- 172.21.15.86:0/1618116959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48bc004d50 0x7f48bc0051c0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0113e0 tx=0x7f48cc009740 comp rx=0 tx=0).stop 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.498+0000 7f48d37fe700 1 -- 172.21.15.86:0/1618116959 reap_dead start 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.498+0000 7f48d3fff700 1 -- 172.21.15.86:0/1618116959 shutdown_connections 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.498+0000 7f48d3fff700 1 -- 172.21.15.86:0/1618116959 >> 172.21.15.86:0/1618116959 conn(0x7f48d4068e20 msgr2=0x7f48d40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:03.503 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.498+0000 7f48d3fff700 1 -- 172.21.15.86:0/1618116959 shutdown_connections 2023-10-09T13:17:03.504 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.498+0000 7f48d3fff700 1 -- 172.21.15.86:0/1618116959 wait complete. 2023-10-09T13:17:03.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.499+0000 7f48d3fff700 1 Processor -- start 2023-10-09T13:17:03.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.500+0000 7f48d3fff700 1 -- start start 2023-10-09T13:17:03.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.500+0000 7f48d3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48bc004d50 0x7f48d414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.500+0000 7f48d3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d41540c0 0x7f48d4154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.506 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.500+0000 7f48d3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40aafe0 0x7f48d40ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.500+0000 7f48d3fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4154a70 con 0x7f48d40aafe0 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.500+0000 7f48d3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40ac960 con 0x7f48d41540c0 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.500+0000 7f48d3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40abd50 con 0x7f48bc004d50 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40aafe0 0x7f48d40ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40aafe0 0x7f48d40ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46814/0 (socket says 172.21.15.86:46814) 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 -- 172.21.15.86:0/1285030921 learned_addr learned my addr 172.21.15.86:0/1285030921 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 -- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48bc004d50 msgr2=0x7f48d414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d27fc700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d41540c0 0x7f48d4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48bc004d50 0x7f48d414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48bc004d50 0x7f48d414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 -- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d41540c0 msgr2=0x7f48d4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.507 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d41540c0 0x7f48d4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 -- 172.21.15.86:0/1285030921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40ac030 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d27fc700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48d41540c0 0x7f48d4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48bc004d50 0x7f48d414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d37fe700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40aafe0 0x7f48d40ab480 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f48bc004730 tx=0x7f48cc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc01f7c0 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc01f920 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.501+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d40ac310 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.502+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc01fca0 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.502+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d414fe00 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.502+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48d404c3c0 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.503+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48cc01d5c0 con 0x7f48d40aafe0 2023-10-09T13:17:03.508 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.504+0000 7f48baffd700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f48c0066f30 0x7f48c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.504+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f48cc00f040 con 0x7f48d40aafe0 2023-10-09T13:17:03.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.504+0000 7f48baffd700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f48c006d6d0 0x7f48c006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.505+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f48c0066f30 0x7f48c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.505+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 --> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48c0070170 con 0x7f48c006d6d0 2023-10-09T13:17:03.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.505+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48cc088af0 con 0x7f48d40aafe0 2023-10-09T13:17:03.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.505+0000 7f48d2ffd700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f48c0066f30 0x7f48c00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48d4154fe0 tx=0x7f48c4008040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.509 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.505+0000 7f48d27fc700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f48c006d6d0 0x7f48c006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.506+0000 7f48d27fc700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f48c006d6d0 0x7f48c006fb40 crc :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.510 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.507+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== osd.5 v2:172.21.15.135:6808/114759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f48c0070170 con 0x7f48c006d6d0 2023-10-09T13:17:03.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.521+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 --> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f48d4154a70 con 0x7f48c006d6d0 2023-10-09T13:17:03.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.521+0000 7f48baffd700 1 -- 172.21.15.86:0/1285030921 <== osd.5 v2:172.21.15.135:6808/114759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f48d4154a70 con 0x7f48c006d6d0 2023-10-09T13:17:03.523 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:03.523 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:03.523 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:03.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f48c006d6d0 msgr2=0x7f48c006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.135:6808/114759,v1:172.21.15.135:6810/114759] conn(0x7f48c006d6d0 0x7f48c006fb40 crc :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f48c0066f30 msgr2=0x7f48c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f48c0066f30 0x7f48c00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48d4154fe0 tx=0x7f48c4008040 comp rx=0 tx=0).stop 2023-10-09T13:17:03.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40aafe0 msgr2=0x7f48d40ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 --2- 172.21.15.86:0/1285030921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48d40aafe0 0x7f48d40ab480 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f48bc004730 tx=0x7f48cc01e000 comp rx=0 tx=0).stop 2023-10-09T13:17:03.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d37fe700 1 -- 172.21.15.86:0/1285030921 reap_dead start 2023-10-09T13:17:03.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 shutdown_connections 2023-10-09T13:17:03.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 >> 172.21.15.86:0/1285030921 conn(0x7f48d4068e20 msgr2=0x7f48d4157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:03.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 shutdown_connections 2023-10-09T13:17:03.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.522+0000 7f48d3fff700 1 -- 172.21.15.86:0/1285030921 wait complete. 2023-10-09T13:17:03.540 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-09T13:17:03.722 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.720+0000 7f4471fff700 1 Processor -- start 2023-10-09T13:17:03.723 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.720+0000 7f4471fff700 1 -- start start 2023-10-09T13:17:03.724 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.721+0000 7f4471fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f446c159c60 0x7f446c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.721+0000 7f4471fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c15db10 0x7f446c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f4471fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c15a160 con 0x7f446c159890 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f4471fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c15df50 con 0x7f446c159c60 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f4471fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0d13a0 con 0x7f446c15db10 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f446c159c60 0x7f446c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f446c159c60 0x7f446c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46826/0 (socket says 172.21.15.86:46826) 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 -- 172.21.15.86:0/3162728656 learned_addr learned my addr 172.21.15.86:0/3162728656 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446bfff700 1 --2- 172.21.15.86:0/3162728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c15db10 0x7f446c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 -- 172.21.15.86:0/3162728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c15db10 msgr2=0x7f446c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:03.725 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 --2- 172.21.15.86:0/3162728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c15db10 0x7f446c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 -- 172.21.15.86:0/3162728656 >> v1:172.21.15.135:6789/0 conn(0x7f446c159890 legacy=0x7f446c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 -- 172.21.15.86:0/3162728656 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c15e140 con 0x7f446c159c60 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.722+0000 7f446affd700 1 --2- 172.21.15.86:0/3162728656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c159c60 0x7f446c15d5d0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f44600099b0 tx=0x7f4460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e1b9318d0775e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f446a7fc700 1 -- 172.21.15.86:0/3162728656 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446000b860 con 0x7f446c159c60 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f446a7fc700 1 -- 172.21.15.86:0/3162728656 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446000b9c0 con 0x7f446c159c60 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f446a7fc700 1 -- 172.21.15.86:0/3162728656 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446000bd60 con 0x7f446c159c60 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 -- 172.21.15.86:0/3162728656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c159c60 msgr2=0x7f446c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 --2- 172.21.15.86:0/3162728656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c159c60 0x7f446c15d5d0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f44600099b0 tx=0x7f4460009250 comp rx=0 tx=0).stop 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 -- 172.21.15.86:0/3162728656 shutdown_connections 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 --2- 172.21.15.86:0/3162728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c15db10 0x7f446c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.726 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 --2- 172.21.15.86:0/3162728656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c159c60 0x7f446c15d5d0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 -- 172.21.15.86:0/3162728656 >> 172.21.15.86:0/3162728656 conn(0x7f446c068e20 msgr2=0x7f446c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:03.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 -- 172.21.15.86:0/3162728656 shutdown_connections 2023-10-09T13:17:03.727 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.723+0000 7f4471fff700 1 -- 172.21.15.86:0/3162728656 wait complete. 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.725+0000 7f4471fff700 1 Processor -- start 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.725+0000 7f4471fff700 1 -- start start 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f4471fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c159890 0x7f446c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f4471fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f446c159c60 0x7f446c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f4471fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c15db10 0x7f446c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f4471fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c158e40 con 0x7f446c15db10 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f4471fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0c8dd0 con 0x7f446c159c60 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f4471fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b5b60 con 0x7f446c159890 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f446bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c15db10 0x7f446c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f446bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c15db10 0x7f446c0b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46842/0 (socket says 172.21.15.86:46842) 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f446bfff700 1 -- 172.21.15.86:0/1714260123 learned_addr learned my addr 172.21.15.86:0/1714260123 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.726+0000 7f446b7fe700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c159890 0x7f446c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446affd700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f446c159c60 0x7f446c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446bfff700 1 -- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c159890 msgr2=0x7f446c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446bfff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c159890 0x7f446c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446bfff700 1 -- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f446c159c60 msgr2=0x7f446c158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446bfff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f446c159c60 0x7f446c158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446bfff700 1 -- 172.21.15.86:0/1714260123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44600094f0 con 0x7f446c15db10 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446affd700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f446c159c60 0x7f446c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f446bfff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c15db10 0x7f446c0b5210 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f4464007f20 tx=0x7f4464009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f44537fe700 1 -- 172.21.15.86:0/1714260123 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400ebf0 con 0x7f446c15db10 2023-10-09T13:17:03.730 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f44537fe700 1 -- 172.21.15.86:0/1714260123 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446400ed70 con 0x7f446c15db10 2023-10-09T13:17:03.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0b5e40 con 0x7f446c15db10 2023-10-09T13:17:03.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f44537fe700 1 -- 172.21.15.86:0/1714260123 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464014670 con 0x7f446c15db10 2023-10-09T13:17:03.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.727+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0c86c0 con 0x7f446c15db10 2023-10-09T13:17:03.731 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.728+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c04c3c0 con 0x7f446c15db10 2023-10-09T13:17:03.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.729+0000 7f44537fe700 1 -- 172.21.15.86:0/1714260123 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44640149e0 con 0x7f446c15db10 2023-10-09T13:17:03.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.730+0000 7f44537fe700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:03.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.730+0000 7f44537fe700 1 -- 172.21.15.86:0/1714260123 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f4464084d40 con 0x7f446c15db10 2023-10-09T13:17:03.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.730+0000 7f446b7fe700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:03.732 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.731+0000 7f446b7fe700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4458066f30 0x7f44580693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f445c003a80 tx=0x7f445c007ec0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:03.736 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.735+0000 7f44537fe700 1 -- 172.21.15.86:0/1714260123 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4464051de0 con 0x7f446c15db10 2023-10-09T13:17:03.925 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.924+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f446c0b6080 con 0x7f4458066f30 2023-10-09T13:17:03.926 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.924+0000 7f44537fe700 1 -- 172.21.15.86:0/1714260123 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f445c002480 con 0x7f4458066f30 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4458066f30 msgr2=0x7f44580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4458066f30 0x7f44580693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f445c003a80 tx=0x7f445c007ec0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c15db10 msgr2=0x7f446c0b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c15db10 0x7f446c0b5210 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f4464007f20 tx=0x7f4464009860 comp rx=0 tx=0).stop 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 shutdown_connections 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f446c15db10 0x7f446c0b5210 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f446c159890 0x7f446c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.928 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 --2- 172.21.15.86:0/1714260123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f446c159c60 0x7f446c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 >> 172.21.15.86:0/1714260123 conn(0x7f446c068e20 msgr2=0x7f446c0c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 shutdown_connections 2023-10-09T13:17:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:03.926+0000 7f4471fff700 1 -- 172.21.15.86:0/1714260123 wait complete. 2023-10-09T13:17:03.929 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 5 to deep-scrub 2023-10-09T13:17:03.945 INFO:tasks.ceph:Scrubbing osd.6 2023-10-09T13:17:03.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:04.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.128+0000 7efe35b9d700 1 Processor -- start 2023-10-09T13:17:04.130 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.128+0000 7efe35b9d700 1 -- start start 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.129+0000 7efe35b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe30156350 0x7efe30157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.129+0000 7efe35b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe300b0760 0x7efe300b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.129+0000 7efe35b9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efe30159f20 0x7efe3015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.129+0000 7efe35b9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe300b1110 con 0x7efe30159f20 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.129+0000 7efe35b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe300b0570 con 0x7efe30156350 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.129+0000 7efe35b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe301578b0 con 0x7efe300b0760 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efe30159f20 0x7efe3015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.132 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efe30159f20 0x7efe3015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46846/0 (socket says 172.21.15.86:46846) 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 -- 172.21.15.86:0/2054149361 learned_addr learned my addr 172.21.15.86:0/2054149361 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe34b9b700 1 --2- 172.21.15.86:0/2054149361 >> v2:172.21.15.135:3300/0 conn(0x7efe30156350 0x7efe30157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe2ffff700 1 --2- 172.21.15.86:0/2054149361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe300b0760 0x7efe300b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 -- 172.21.15.86:0/2054149361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe300b0760 msgr2=0x7efe300b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 --2- 172.21.15.86:0/2054149361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe300b0760 0x7efe300b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 -- 172.21.15.86:0/2054149361 >> v2:172.21.15.135:3300/0 conn(0x7efe30156350 msgr2=0x7efe30157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 --2- 172.21.15.86:0/2054149361 >> v2:172.21.15.135:3300/0 conn(0x7efe30156350 0x7efe30157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 -- 172.21.15.86:0/2054149361 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe300af4d0 con 0x7efe30159f20 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe34b9b700 1 --2- 172.21.15.86:0/2054149361 >> v2:172.21.15.135:3300/0 conn(0x7efe30156350 0x7efe30157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.130+0000 7efe3539c700 1 --2- 172.21.15.86:0/2054149361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe30159f20 0x7efe3015a360 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7efe30065950 tx=0x7efe28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2536bb58c3b11a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe2f7fe700 1 -- 172.21.15.86:0/2054149361 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2800e070 con 0x7efe30159f20 2023-10-09T13:17:04.133 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe2f7fe700 1 -- 172.21.15.86:0/2054149361 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2800ba50 con 0x7efe30159f20 2023-10-09T13:17:04.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe2f7fe700 1 -- 172.21.15.86:0/2054149361 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280092e0 con 0x7efe30159f20 2023-10-09T13:17:04.134 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 -- 172.21.15.86:0/2054149361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe30159f20 msgr2=0x7efe3015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 --2- 172.21.15.86:0/2054149361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe30159f20 0x7efe3015a360 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7efe30065950 tx=0x7efe28009840 comp rx=0 tx=0).stop 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 -- 172.21.15.86:0/2054149361 shutdown_connections 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 --2- 172.21.15.86:0/2054149361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe30159f20 0x7efe3015a360 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 --2- 172.21.15.86:0/2054149361 >> v2:172.21.15.135:3300/0 conn(0x7efe30156350 0x7efe30157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 --2- 172.21.15.86:0/2054149361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe300b0760 0x7efe300b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 -- 172.21.15.86:0/2054149361 >> 172.21.15.86:0/2054149361 conn(0x7efe30068e20 msgr2=0x7efe300cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 -- 172.21.15.86:0/2054149361 shutdown_connections 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.131+0000 7efe35b9d700 1 -- 172.21.15.86:0/2054149361 wait complete. 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.133+0000 7efe35b9d700 1 Processor -- start 2023-10-09T13:17:04.135 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.133+0000 7efe35b9d700 1 -- start start 2023-10-09T13:17:04.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe35b9d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe300b0760 0x7efe30151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.137 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe35b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe30156350 0x7efe300ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe35b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe30159f20 0x7efe300ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe35b9d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe30169cb0 con 0x7efe300b0760 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe35b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe300ca740 con 0x7efe30156350 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe35b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe300c9ea0 con 0x7efe30159f20 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe300b0760 0x7efe30151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe300b0760 0x7efe30151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46860/0 (socket says 172.21.15.86:46860) 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 -- 172.21.15.86:0/3147973452 learned_addr learned my addr 172.21.15.86:0/3147973452 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe3539c700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe30159f20 0x7efe300ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe2ffff700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe30156350 0x7efe300ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 -- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe30159f20 msgr2=0x7efe300ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.138 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe30159f20 0x7efe300ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 -- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe30156350 msgr2=0x7efe300ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe30156350 0x7efe300ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe34b9b700 1 -- 172.21.15.86:0/3147973452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009ae0 con 0x7efe300b0760 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe3539c700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe30159f20 0x7efe300ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.134+0000 7efe2ffff700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe30156350 0x7efe300ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.135+0000 7efe34b9b700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe300b0760 0x7efe30151b20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d860 tx=0x7efe24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.135+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe240125f0 con 0x7efe300b0760 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.135+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe24012750 con 0x7efe300b0760 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.135+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24012ad0 con 0x7efe300b0760 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.135+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe300ca180 con 0x7efe300b0760 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.135+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe30152060 con 0x7efe300b0760 2023-10-09T13:17:04.139 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.136+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe30169aa0 con 0x7efe300b0760 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.137+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe24027430 con 0x7efe300b0760 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.138+0000 7efe2cff9700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe14066f30 0x7efe140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.138+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7efe24085640 con 0x7efe300b0760 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.138+0000 7efe2ffff700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe14066f30 0x7efe140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.138+0000 7efe2cff9700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7efe1406d6d0 0x7efe1406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.138+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 --> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe14070170 con 0x7efe1406d6d0 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.138+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe24085930 con 0x7efe300b0760 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.139+0000 7efe2ffff700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe14066f30 0x7efe140693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efe300cad90 tx=0x7efe1c008040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.139+0000 7efe3539c700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7efe1406d6d0 0x7efe1406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.141 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.139+0000 7efe3539c700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7efe1406d6d0 0x7efe1406fb40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.142 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.140+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== osd.6 v2:172.21.15.135:6824/114774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7efe14070170 con 0x7efe1406d6d0 2023-10-09T13:17:04.155 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.154+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 --> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efe3004c3c0 con 0x7efe1406d6d0 2023-10-09T13:17:04.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.155+0000 7efe2cff9700 1 -- 172.21.15.86:0/3147973452 <== osd.6 v2:172.21.15.135:6824/114774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efe3004c3c0 con 0x7efe1406d6d0 2023-10-09T13:17:04.157 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:04.157 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:04.157 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7efe1406d6d0 msgr2=0x7efe1406fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.135:6824/114774,v1:172.21.15.135:6825/114774] conn(0x7efe1406d6d0 0x7efe1406fb40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe14066f30 msgr2=0x7efe140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe14066f30 0x7efe140693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efe300cad90 tx=0x7efe1c008040 comp rx=0 tx=0).stop 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe300b0760 msgr2=0x7efe30151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 --2- 172.21.15.86:0/3147973452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe300b0760 0x7efe30151b20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d860 tx=0x7efe24008040 comp rx=0 tx=0).stop 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe3539c700 1 -- 172.21.15.86:0/3147973452 reap_dead start 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 shutdown_connections 2023-10-09T13:17:04.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 >> 172.21.15.86:0/3147973452 conn(0x7efe30068e20 msgr2=0x7efe300704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:04.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 shutdown_connections 2023-10-09T13:17:04.159 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.156+0000 7efe35b9d700 1 -- 172.21.15.86:0/3147973452 wait complete. 2023-10-09T13:17:04.174 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-09T13:17:04.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.354+0000 7fd0931ff700 1 Processor -- start 2023-10-09T13:17:04.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.354+0000 7fd0931ff700 1 -- start start 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd0931ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd08c155c10 0x7fd08c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd0931ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd08c0ac6d0 0x7fd08c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd0931ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0acac0 con 0x7fd08c0ac230 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd0931ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0ad930 con 0x7fd08c0ac6d0 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd0931ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0acd20 con 0x7fd08c155c10 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd09179c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd08c0ac6d0 0x7fd08c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd09179c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd08c0ac6d0 0x7fd08c0b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46862/0 (socket says 172.21.15.86:46862) 2023-10-09T13:17:04.359 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd09179c700 1 -- 172.21.15.86:0/1780890828 learned_addr learned my addr 172.21.15.86:0/1780890828 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd090f9b700 1 --2- 172.21.15.86:0/1780890828 >> v2:172.21.15.135:3300/0 conn(0x7fd08c155c10 0x7fd08c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd09179c700 1 -- 172.21.15.86:0/1780890828 >> v2:172.21.15.135:3300/0 conn(0x7fd08c155c10 msgr2=0x7fd08c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd09179c700 1 --2- 172.21.15.86:0/1780890828 >> v2:172.21.15.135:3300/0 conn(0x7fd08c155c10 0x7fd08c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd09179c700 1 -- 172.21.15.86:0/1780890828 >> v1:172.21.15.135:6789/0 conn(0x7fd08c0ac230 legacy=0x7fd08c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd09179c700 1 -- 172.21.15.86:0/1780890828 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0ad000 con 0x7fd08c0ac6d0 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.356+0000 7fd090f9b700 1 --2- 172.21.15.86:0/1780890828 >> v2:172.21.15.135:3300/0 conn(0x7fd08c155c10 0x7fd08c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.357+0000 7fd09179c700 1 --2- 172.21.15.86:0/1780890828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac6d0 0x7fd08c0b0300 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fd08c063d40 tx=0x7fd084009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7f683683286430 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.357+0000 7fd08b7fe700 1 -- 172.21.15.86:0/1780890828 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08400e070 con 0x7fd08c0ac6d0 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.357+0000 7fd08b7fe700 1 -- 172.21.15.86:0/1780890828 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08400ba50 con 0x7fd08c0ac6d0 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.357+0000 7fd08b7fe700 1 -- 172.21.15.86:0/1780890828 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840092e0 con 0x7fd08c0ac6d0 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.357+0000 7fd0931ff700 1 -- 172.21.15.86:0/1780890828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac6d0 msgr2=0x7fd08c0b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.360 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.357+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1780890828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac6d0 0x7fd08c0b0300 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fd08c063d40 tx=0x7fd084009840 comp rx=0 tx=0).stop 2023-10-09T13:17:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.358+0000 7fd0931ff700 1 -- 172.21.15.86:0/1780890828 shutdown_connections 2023-10-09T13:17:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.358+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1780890828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac6d0 0x7fd08c0b0300 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.358+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1780890828 >> v2:172.21.15.135:3300/0 conn(0x7fd08c155c10 0x7fd08c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.358+0000 7fd0931ff700 1 -- 172.21.15.86:0/1780890828 >> 172.21.15.86:0/1780890828 conn(0x7fd08c06a320 msgr2=0x7fd08c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.358+0000 7fd0931ff700 1 -- 172.21.15.86:0/1780890828 shutdown_connections 2023-10-09T13:17:04.361 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.358+0000 7fd0931ff700 1 -- 172.21.15.86:0/1780890828 wait complete. 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.359+0000 7fd0931ff700 1 Processor -- start 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.359+0000 7fd0931ff700 1 -- start start 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd0931ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac230 0x7fd08c1527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd0931ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd08c0ac6d0 0x7fd08c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd0931ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd08c155c10 0x7fd08c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd0931ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0aa4e0 con 0x7fd08c0ac230 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd0931ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0a98d0 con 0x7fd08c0ac6d0 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd0931ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0a9bb0 con 0x7fd08c155c10 2023-10-09T13:17:04.363 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd090f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac230 0x7fd08c1527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd090f9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac230 0x7fd08c1527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46872/0 (socket says 172.21.15.86:46872) 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.360+0000 7fd090f9b700 1 -- 172.21.15.86:0/1183348680 learned_addr learned my addr 172.21.15.86:0/1183348680 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd090f9b700 1 -- 172.21.15.86:0/1183348680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd08c155c10 msgr2=0x7fd08c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd090f9b700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd08c155c10 0x7fd08c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd090f9b700 1 -- 172.21.15.86:0/1183348680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd08c0ac6d0 msgr2=0x7fd08c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd090f9b700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd08c0ac6d0 0x7fd08c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd090f9b700 1 -- 172.21.15.86:0/1183348680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084009ae0 con 0x7fd08c0ac230 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd090f9b700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac230 0x7fd08c1527e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fd08000d860 tx=0x7fd080008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd088ff9700 1 -- 172.21.15.86:0/1183348680 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800125f0 con 0x7fd08c0ac230 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd088ff9700 1 -- 172.21.15.86:0/1183348680 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080012750 con 0x7fd08c0ac230 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c0a9e90 con 0x7fd08c0ac230 2023-10-09T13:17:04.364 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd088ff9700 1 -- 172.21.15.86:0/1183348680 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080012ad0 con 0x7fd08c0ac230 2023-10-09T13:17:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.361+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c0aa970 con 0x7fd08c0ac230 2023-10-09T13:17:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.362+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c04c3c0 con 0x7fd08c0ac230 2023-10-09T13:17:04.365 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.363+0000 7fd088ff9700 1 -- 172.21.15.86:0/1183348680 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd080014430 con 0x7fd08c0ac230 2023-10-09T13:17:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.364+0000 7fd088ff9700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.364+0000 7fd088ff9700 1 -- 172.21.15.86:0/1183348680 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fd080084b50 con 0x7fd08c0ac230 2023-10-09T13:17:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.364+0000 7fd08bfff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.366 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.365+0000 7fd08bfff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd070066f30 0x7fd0700693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd078001730 tx=0x7fd078007b40 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.369 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.368+0000 7fd088ff9700 1 -- 172.21.15.86:0/1183348680 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd080051bf0 con 0x7fd08c0ac230 2023-10-09T13:17:04.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.558+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd08c0aa620 con 0x7fd070066f30 2023-10-09T13:17:04.560 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.558+0000 7fd088ff9700 1 -- 172.21.15.86:0/1183348680 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd078014410 con 0x7fd070066f30 2023-10-09T13:17:04.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd070066f30 msgr2=0x7fd0700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd070066f30 0x7fd0700693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd078001730 tx=0x7fd078007b40 comp rx=0 tx=0).stop 2023-10-09T13:17:04.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac230 msgr2=0x7fd08c1527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac230 0x7fd08c1527e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fd08000d860 tx=0x7fd080008040 comp rx=0 tx=0).stop 2023-10-09T13:17:04.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 shutdown_connections 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd08c0ac230 0x7fd08c1527e0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd08c155c10 0x7fd08c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 --2- 172.21.15.86:0/1183348680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd08c0ac6d0 0x7fd08c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.560+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 >> 172.21.15.86:0/1183348680 conn(0x7fd08c06a320 msgr2=0x7fd08c0c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.561+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 shutdown_connections 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.561+0000 7fd0931ff700 1 -- 172.21.15.86:0/1183348680 wait complete. 2023-10-09T13:17:04.563 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 6 to deep-scrub 2023-10-09T13:17:04.579 INFO:tasks.ceph:Scrubbing osd.7 2023-10-09T13:17:04.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-09T13:17:04.762 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.761+0000 7fd77c99d700 1 Processor -- start 2023-10-09T13:17:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.761+0000 7fd77c99d700 1 -- start start 2023-10-09T13:17:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd77c99d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7781597d0 0x7fd7780afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd77c99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd7780ac0e0 0x7fd77806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd77c99d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77806e510 con 0x7fd77806eee0 2023-10-09T13:17:04.763 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd77c99d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77815e450 con 0x7fd7781597d0 2023-10-09T13:17:04.764 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd77c99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd778069180 con 0x7fd7780ac0e0 2023-10-09T13:17:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd7777fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7781597d0 0x7fd7780afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd777fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd77806eee0 0x7fd7780a98d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:58922/0 (socket says 172.21.15.86:58922) 2023-10-09T13:17:04.765 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd777fff700 1 -- 172.21.15.86:0/2772034442 learned_addr learned my addr 172.21.15.86:0/2772034442 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.762+0000 7fd7777fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7781597d0 0x7fd7780afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46888/0 (socket says 172.21.15.86:46888) 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd776ffd700 1 --2- 172.21.15.86:0/2772034442 >> v2:172.21.15.135:3300/0 conn(0x7fd7780ac0e0 0x7fd77806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7777fe700 1 -- 172.21.15.86:0/2772034442 >> v2:172.21.15.135:3300/0 conn(0x7fd7780ac0e0 msgr2=0x7fd77806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7777fe700 1 --2- 172.21.15.86:0/2772034442 >> v2:172.21.15.135:3300/0 conn(0x7fd7780ac0e0 0x7fd77806e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7777fe700 1 -- 172.21.15.86:0/2772034442 >> v1:172.21.15.86:6789/0 conn(0x7fd77806eee0 legacy=0x7fd7780a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7777fe700 1 -- 172.21.15.86:0/2772034442 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77806dec0 con 0x7fd7781597d0 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd776ffd700 1 --2- 172.21.15.86:0/2772034442 >> v2:172.21.15.135:3300/0 conn(0x7fd7780ac0e0 0x7fd77806e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7767fc700 1 -- 172.21.15.86:0/2772034442 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099887439 0 0) 0x7fd77806e510 con 0x7fd77806eee0 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7777fe700 1 --2- 172.21.15.86:0/2772034442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7781597d0 0x7fd7780afa40 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fd77806dbf0 tx=0x7fd7680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4aefdcf269d6b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7767fc700 1 -- 172.21.15.86:0/2772034442 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800b6b0 con 0x7fd7781597d0 2023-10-09T13:17:04.766 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7767fc700 1 -- 172.21.15.86:0/2772034442 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76800b810 con 0x7fd7781597d0 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.763+0000 7fd7767fc700 1 -- 172.21.15.86:0/2772034442 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800bbb0 con 0x7fd7781597d0 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 -- 172.21.15.86:0/2772034442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7781597d0 msgr2=0x7fd7780afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 --2- 172.21.15.86:0/2772034442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7781597d0 0x7fd7780afa40 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fd77806dbf0 tx=0x7fd7680091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 -- 172.21.15.86:0/2772034442 shutdown_connections 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 --2- 172.21.15.86:0/2772034442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7781597d0 0x7fd7780afa40 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 --2- 172.21.15.86:0/2772034442 >> v2:172.21.15.135:3300/0 conn(0x7fd7780ac0e0 0x7fd77806e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 -- 172.21.15.86:0/2772034442 >> 172.21.15.86:0/2772034442 conn(0x7fd77806adf0 msgr2=0x7fd7780ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 -- 172.21.15.86:0/2772034442 shutdown_connections 2023-10-09T13:17:04.767 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.764+0000 7fd77c99d700 1 -- 172.21.15.86:0/2772034442 wait complete. 2023-10-09T13:17:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.765+0000 7fd77c99d700 1 Processor -- start 2023-10-09T13:17:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.766+0000 7fd77c99d700 1 -- start start 2023-10-09T13:17:04.769 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.766+0000 7fd77c99d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd77806eee0 0x7fd77816ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd77c99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7781597d0 0x7fd7780ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd77c99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd77815d800 0x7fd778155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd77c99d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780ad740 con 0x7fd77806eee0 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd77c99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd778151260 con 0x7fd7781597d0 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd77c99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780acea0 con 0x7fd77815d800 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd77806eee0 0x7fd77816ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd77806eee0 0x7fd77816ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:46904/0 (socket says 172.21.15.86:46904) 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 -- 172.21.15.86:0/894047232 learned_addr learned my addr 172.21.15.86:0/894047232 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd776ffd700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7781597d0 0x7fd7780ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd777fff700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd77815d800 0x7fd778155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.770 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 -- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd77815d800 msgr2=0x7fd778155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd77815d800 0x7fd778155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 -- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7781597d0 msgr2=0x7fd7780ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7781597d0 0x7fd7780ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 -- 172.21.15.86:0/894047232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd768009420 con 0x7fd77806eee0 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd776ffd700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7781597d0 0x7fd7780ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.767+0000 7fd7777fe700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd77806eee0 0x7fd77816ad80 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fd7680097b0 tx=0x7fd768017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.768+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800bb90 con 0x7fd77806eee0 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.768+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd768011420 con 0x7fd77806eee0 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.768+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7680117a0 con 0x7fd77806eee0 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.768+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7780ad180 con 0x7fd77806eee0 2023-10-09T13:17:04.771 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.768+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7780acb90 con 0x7fd77806eee0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.768+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd77804c3c0 con 0x7fd77806eee0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.770+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd768011b90 con 0x7fd77806eee0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.770+0000 7fd75f7fe700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd764066f30 0x7fd7640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.771+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7fd768086c50 con 0x7fd77806eee0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.771+0000 7fd776ffd700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd764066f30 0x7fd7640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.771+0000 7fd75f7fe700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fd76406d6d0 0x7fd76406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.771+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 --> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd764070170 con 0x7fd76406d6d0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.771+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=217) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd768086f40 con 0x7fd77806eee0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.771+0000 7fd777fff700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fd76406d6d0 0x7fd76406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.771+0000 7fd776ffd700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd764066f30 0x7fd7640693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd76c006f00 tx=0x7fd76c008040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.773 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.772+0000 7fd777fff700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fd76406d6d0 0x7fd76406fb40 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.774 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.773+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== osd.7 v2:172.21.15.135:6809/114757 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd764070170 con 0x7fd76406d6d0 2023-10-09T13:17:04.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.787+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 --> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7780cd4a0 con 0x7fd76406d6d0 2023-10-09T13:17:04.788 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.787+0000 7fd75f7fe700 1 -- 172.21.15.86:0/894047232 <== osd.7 v2:172.21.15.135:6809/114757 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd7780cd4a0 con 0x7fd76406d6d0 2023-10-09T13:17:04.789 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-09T13:17:04.789 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T13:17:04.789 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fd76406d6d0 msgr2=0x7fd76406fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.135:6809/114757,v1:172.21.15.135:6811/114757] conn(0x7fd76406d6d0 0x7fd76406fb40 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd764066f30 msgr2=0x7fd7640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7fd764066f30 0x7fd7640693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd76c006f00 tx=0x7fd76c008040 comp rx=0 tx=0).stop 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd77806eee0 msgr2=0x7fd77816ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 --2- 172.21.15.86:0/894047232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd77806eee0 0x7fd77816ad80 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fd7680097b0 tx=0x7fd768017000 comp rx=0 tx=0).stop 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd777fff700 1 -- 172.21.15.86:0/894047232 reap_dead start 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 shutdown_connections 2023-10-09T13:17:04.790 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 >> 172.21.15.86:0/894047232 conn(0x7fd77806adf0 msgr2=0x7fd7780afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 shutdown_connections 2023-10-09T13:17:04.791 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.788+0000 7fd77c99d700 1 -- 172.21.15.86:0/894047232 wait complete. 2023-10-09T13:17:04.805 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-09T13:17:04.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.985+0000 7feedbfff700 1 Processor -- start 2023-10-09T13:17:04.987 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.986+0000 7feedbfff700 1 -- start start 2023-10-09T13:17:04.988 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feedbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed4155c10 0x7feed4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feedbfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feed40ac6a0 0x7feed40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feedbfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed40acac0 con 0x7feed40ac230 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feedbfff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed40ad930 con 0x7feed40ac6a0 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feedbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed40acd20 con 0x7feed4155c10 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feeda59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feed40ac6a0 0x7feed40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feeda59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feed40ac6a0 0x7feed40b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35496/0 (socket says 172.21.15.86:35496) 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feeda59c700 1 -- 172.21.15.86:0/1017910659 learned_addr learned my addr 172.21.15.86:0/1017910659 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.987+0000 7feed9d9b700 1 --2- 172.21.15.86:0/1017910659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed4155c10 0x7feed4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feeda59c700 1 -- 172.21.15.86:0/1017910659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed4155c10 msgr2=0x7feed4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feeda59c700 1 --2- 172.21.15.86:0/1017910659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed4155c10 0x7feed4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.989 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feeda59c700 1 -- 172.21.15.86:0/1017910659 >> v1:172.21.15.135:6789/0 conn(0x7feed40ac230 legacy=0x7feed41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feeda59c700 1 -- 172.21.15.86:0/1017910659 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed40ad000 con 0x7feed40ac6a0 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feed8d99700 1 -- 172.21.15.86:0/1017910659 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707990683 0 0) 0x7feed40acac0 con 0x7feed40ac230 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feeda59c700 1 --2- 172.21.15.86:0/1017910659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac6a0 0x7feed40b0300 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7feecc00afb0 tx=0x7feecc00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9330492a41956a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feed8d99700 1 -- 172.21.15.86:0/1017910659 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00a2e0 con 0x7feed40ac6a0 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feed8d99700 1 -- 172.21.15.86:0/1017910659 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc00ba70 con 0x7feed40ac6a0 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.988+0000 7feed8d99700 1 -- 172.21.15.86:0/1017910659 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00be10 con 0x7feed40ac6a0 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 -- 172.21.15.86:0/1017910659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac6a0 msgr2=0x7feed40b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 --2- 172.21.15.86:0/1017910659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac6a0 0x7feed40b0300 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7feecc00afb0 tx=0x7feecc00c040 comp rx=0 tx=0).stop 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 -- 172.21.15.86:0/1017910659 shutdown_connections 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 --2- 172.21.15.86:0/1017910659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac6a0 0x7feed40b0300 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.991 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 --2- 172.21.15.86:0/1017910659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed4155c10 0x7feed4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 -- 172.21.15.86:0/1017910659 >> 172.21.15.86:0/1017910659 conn(0x7feed406a320 msgr2=0x7feed40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:04.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 -- 172.21.15.86:0/1017910659 shutdown_connections 2023-10-09T13:17:04.992 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.989+0000 7feedbfff700 1 -- 172.21.15.86:0/1017910659 wait complete. 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.990+0000 7feedbfff700 1 Processor -- start 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.990+0000 7feedbfff700 1 -- start start 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feedbfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac230 0x7feed40aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feedbfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed40ac6a0 0x7feed40cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feedbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed4155c10 0x7feed40cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feedbfff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed40c9d20 con 0x7feed40ac230 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feedbfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed40ca000 con 0x7feed4155c10 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feedbfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed40ca2e0 con 0x7feed40ac6a0 2023-10-09T13:17:04.994 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feed9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac230 0x7feed40aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feed9d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac230 0x7feed40aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35498/0 (socket says 172.21.15.86:35498) 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.991+0000 7feed9d9b700 1 -- 172.21.15.86:0/1511502666 learned_addr learned my addr 172.21.15.86:0/1511502666 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed959a700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed40ac6a0 0x7feed40cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feeda59c700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed4155c10 0x7feed40cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed9d9b700 1 -- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed40ac6a0 msgr2=0x7feed40cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed9d9b700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed40ac6a0 0x7feed40cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed9d9b700 1 -- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed4155c10 msgr2=0x7feed40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed9d9b700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed4155c10 0x7feed40cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed9d9b700 1 -- 172.21.15.86:0/1511502666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc00aaf0 con 0x7feed40ac230 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed959a700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed40ac6a0 0x7feed40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feeda59c700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed4155c10 0x7feed40cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T13:17:04.995 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feed9d9b700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac230 0x7feed40aab00 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7feed000be50 tx=0x7feed000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:04.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feec9ffb700 1 -- 172.21.15.86:0/1511502666 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000ec20 con 0x7feed40ac230 2023-10-09T13:17:04.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feec9ffb700 1 -- 172.21.15.86:0/1511502666 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0011040 con 0x7feed40ac230 2023-10-09T13:17:04.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed40ca5c0 con 0x7feed40ac230 2023-10-09T13:17:04.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feec9ffb700 1 -- 172.21.15.86:0/1511502666 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0016480 con 0x7feed40ac230 2023-10-09T13:17:04.996 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.992+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed40ab040 con 0x7feed40ac230 2023-10-09T13:17:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.993+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed404c3c0 con 0x7feed40ac230 2023-10-09T13:17:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.994+0000 7feec9ffb700 1 -- 172.21.15.86:0/1511502666 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feed00167f0 con 0x7feed40ac230 2023-10-09T13:17:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.995+0000 7feec9ffb700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feeb8066f30 0x7feeb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.995+0000 7feec9ffb700 1 -- 172.21.15.86:0/1511502666 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7feed0087210 con 0x7feed40ac230 2023-10-09T13:17:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.995+0000 7feed959a700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feeb8066f30 0x7feeb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:04.997 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.996+0000 7feed959a700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feeb8066f30 0x7feeb80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feec40011e0 tx=0x7feec4009040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:05.000 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:04.999+0000 7feec9ffb700 1 -- 172.21.15.86:0/1511502666 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feed00542b0 con 0x7feed40ac230 2023-10-09T13:17:05.193 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.192+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7feed40ca170 con 0x7feeb8066f30 2023-10-09T13:17:05.194 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.193+0000 7feec9ffb700 1 -- 172.21.15.86:0/1511502666 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feed40ca170 con 0x7feeb8066f30 2023-10-09T13:17:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feeb8066f30 msgr2=0x7feeb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feeb8066f30 0x7feeb80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feec40011e0 tx=0x7feec4009040 comp rx=0 tx=0).stop 2023-10-09T13:17:05.196 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac230 msgr2=0x7feed40aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac230 0x7feed40aab00 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7feed000be50 tx=0x7feed000d040 comp rx=0 tx=0).stop 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 shutdown_connections 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7feeb8066f30 0x7feeb80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed40ac230 0x7feed40aab00 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed4155c10 0x7feed40cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 --2- 172.21.15.86:0/1511502666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feed40ac6a0 0x7feed40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 >> 172.21.15.86:0/1511502666 conn(0x7feed406a320 msgr2=0x7feed4153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 shutdown_connections 2023-10-09T13:17:05.197 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.195+0000 7feedbfff700 1 -- 172.21.15.86:0/1511502666 wait complete. 2023-10-09T13:17:05.198 INFO:teuthology.orchestra.run.smithi086.stderr:instructed osd(s) 7 to deep-scrub 2023-10-09T13:17:05.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:17:05.394 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.393+0000 7efebfdff700 1 Processor -- start 2023-10-09T13:17:05.395 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.393+0000 7efebfdff700 1 -- start start 2023-10-09T13:17:05.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebfdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 0x7efeb8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:05.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebfdff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efeb80ac230 0x7efeb80ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:05.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebfdff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efeb81568a0 0x7efeb8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:05.397 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebfdff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80ad930 con 0x7efeb80ac230 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebfdff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80acd20 con 0x7efeb81568a0 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebfdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80ad000 con 0x7efeb8155c10 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efeb80ac230 0x7efeb80ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efeb80ac230 0x7efeb80ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35504/0 (socket says 172.21.15.86:35504) 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 -- 172.21.15.86:0/2243200859 learned_addr learned my addr 172.21.15.86:0/2243200859 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebdb9b700 1 --2- 172.21.15.86:0/2243200859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 0x7efeb8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebe39c700 1 --2- 172.21.15.86:0/2243200859 >> v2:172.21.15.135:3300/0 conn(0x7efeb81568a0 0x7efeb8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 -- 172.21.15.86:0/2243200859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 msgr2=0x7efeb8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 --2- 172.21.15.86:0/2243200859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 0x7efeb8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 -- 172.21.15.86:0/2243200859 >> v2:172.21.15.135:3300/0 conn(0x7efeb81568a0 msgr2=0x7efeb8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:05.398 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 --2- 172.21.15.86:0/2243200859 >> v2:172.21.15.135:3300/0 conn(0x7efeb81568a0 0x7efeb8156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebd39a700 1 -- 172.21.15.86:0/2243200859 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80ad2e0 con 0x7efeb80ac230 2023-10-09T13:17:05.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.395+0000 7efebe39c700 1 --2- 172.21.15.86:0/2243200859 >> v2:172.21.15.135:3300/0 conn(0x7efeb81568a0 0x7efeb8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:05.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.396+0000 7efebd39a700 1 --2- 172.21.15.86:0/2243200859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb80ac230 0x7efeb80ac6a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7efeb80c8c60 tx=0x7efea800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf2112172c08a48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:05.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.396+0000 7efebcb99700 1 -- 172.21.15.86:0/2243200859 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800dba0 con 0x7efeb80ac230 2023-10-09T13:17:05.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.396+0000 7efebcb99700 1 -- 172.21.15.86:0/2243200859 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800dd00 con 0x7efeb80ac230 2023-10-09T13:17:05.399 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.396+0000 7efebcb99700 1 -- 172.21.15.86:0/2243200859 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea80196d0 con 0x7efeb80ac230 2023-10-09T13:17:05.400 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.396+0000 7efebfdff700 1 -- 172.21.15.86:0/2243200859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb80ac230 msgr2=0x7efeb80ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.396+0000 7efebfdff700 1 --2- 172.21.15.86:0/2243200859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb80ac230 0x7efeb80ac6a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7efeb80c8c60 tx=0x7efea800b4f0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.397+0000 7efebfdff700 1 -- 172.21.15.86:0/2243200859 shutdown_connections 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.397+0000 7efebfdff700 1 --2- 172.21.15.86:0/2243200859 >> v2:172.21.15.135:3300/0 conn(0x7efeb81568a0 0x7efeb8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.397+0000 7efebfdff700 1 --2- 172.21.15.86:0/2243200859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 0x7efeb8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.397+0000 7efebfdff700 1 --2- 172.21.15.86:0/2243200859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb80ac230 0x7efeb80ac6a0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.397+0000 7efebfdff700 1 -- 172.21.15.86:0/2243200859 >> 172.21.15.86:0/2243200859 conn(0x7efeb806a320 msgr2=0x7efeb80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.397+0000 7efebfdff700 1 -- 172.21.15.86:0/2243200859 shutdown_connections 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.397+0000 7efebfdff700 1 -- 172.21.15.86:0/2243200859 wait complete. 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.398+0000 7efebfdff700 1 Processor -- start 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.398+0000 7efebfdff700 1 -- start start 2023-10-09T13:17:05.401 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebfdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efeb80ac230 0x7efeb8146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebfdff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 0x7efeb815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebfdff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb81568a0 0x7efeb815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebfdff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c9eb0 con 0x7efeb81568a0 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebfdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c92a0 con 0x7efeb80ac230 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebfdff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c9580 con 0x7efeb8155c10 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebe39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb81568a0 0x7efeb815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebe39c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb81568a0 0x7efeb815b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35510/0 (socket says 172.21.15.86:35510) 2023-10-09T13:17:05.402 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.399+0000 7efebe39c700 1 -- 172.21.15.86:0/2650844787 learned_addr learned my addr 172.21.15.86:0/2650844787 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:05.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebe39c700 1 -- 172.21.15.86:0/2650844787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 msgr2=0x7efeb815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:05.403 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebe39c700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 0x7efeb815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebe39c700 1 -- 172.21.15.86:0/2650844787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efeb80ac230 msgr2=0x7efeb8146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebe39c700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efeb80ac230 0x7efeb8146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebe39c700 1 -- 172.21.15.86:0/2650844787 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea800b790 con 0x7efeb81568a0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebe39c700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb81568a0 0x7efeb815b5c0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009fc0 tx=0x7efeb00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efeadffb700 1 -- 172.21.15.86:0/2650844787 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000dd40 con 0x7efeb81568a0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efeadffb700 1 -- 172.21.15.86:0/2650844787 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb000f040 con 0x7efeb81568a0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb80c9860 con 0x7efeb81568a0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efeadffb700 1 -- 172.21.15.86:0/2650844787 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0015690 con 0x7efeb81568a0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.400+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb80ca340 con 0x7efeb81568a0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.401+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb804c3c0 con 0x7efeb81568a0 2023-10-09T13:17:05.404 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.402+0000 7efeadffb700 1 -- 172.21.15.86:0/2650844787 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efeb001e3b0 con 0x7efeb81568a0 2023-10-09T13:17:05.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.403+0000 7efeadffb700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:05.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.403+0000 7efeadffb700 1 -- 172.21.15.86:0/2650844787 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7efeb0084c50 con 0x7efeb81568a0 2023-10-09T13:17:05.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.403+0000 7efebdb9b700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:05.405 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.404+0000 7efebdb9b700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe9c066f30 0x7efe9c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009b20 tx=0x7efeb40091a0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:05.408 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.407+0000 7efeadffb700 1 -- 172.21.15.86:0/2650844787 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeb0051cf0 con 0x7efeb81568a0 2023-10-09T13:17:05.595 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.594+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efeb80c9ff0 con 0x7efe9c066f30 2023-10-09T13:17:05.598 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.597+0000 7efeadffb700 1 -- 172.21.15.86:0/2650844787 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50592 (secure 0 0 0) 0x7efeb80c9ff0 con 0x7efe9c066f30 2023-10-09T13:17:05.599 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:17:05.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe9c066f30 msgr2=0x7efe9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:05.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe9c066f30 0x7efe9c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009b20 tx=0x7efeb40091a0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb81568a0 msgr2=0x7efeb815b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:05.600 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb81568a0 0x7efeb815b5c0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009fc0 tx=0x7efeb00099b0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 shutdown_connections 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7efe9c066f30 0x7efe9c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeb81568a0 0x7efeb815b5c0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efeb80ac230 0x7efeb8146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 --2- 172.21.15.86:0/2650844787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efeb8155c10 0x7efeb815b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 >> 172.21.15.86:0/2650844787 conn(0x7efeb806a320 msgr2=0x7efeb806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 shutdown_connections 2023-10-09T13:17:05.601 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:05.599+0000 7efebfdff700 1 -- 172.21.15.86:0/2650844787 wait complete. 2023-10-09T13:17:05.602 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:17:05.617 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-10-09T13:17:04.007220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2490760,"kb_used_data":22344,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752483960,"statfs":{"total":773094113280,"available":770543575040,"internally_reserved":0,"allocated":22880256,"data_stored":12103880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001744"},"pg_stats":[{"pgid":"1.0","version":"215'370","reported_seq":1224,"reported_epoch":216,"state":"active+clean","last_fresh":"2023-10-09T13:16:54.125834+0000","last_change":"2023-10-09T11:41:01.498903+0000","last_active":"2023-10-09T13:16:54.125834+0000","last_peered":"2023-10-09T13:16:54.125834+0000","last_clean":"2023-10-09T13:16:54.125834+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:16:54.125834+0000","last_undegraded":"2023-10-09T13:16:54.125834+0000","last_fullsized":"2023-10-09T13:16:54.125834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:00.251155+0000","last_clean_scrub_stamp":"2023-10-09T11:41:00.251155+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:22.007938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312804,"kb_used_data":3228,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059036,"statfs":{"total":96636764160,"available":96316452864,"internally_reserved":0,"allocated":3305472,"data_stored":1955761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.78700000000000003,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.67500000000000004,"15min":0.70499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86499999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.501}]},{"osd":1,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.499,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.83099999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.748,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.82399999999999995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78700000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.73499999999999999,"15min":0.747},"min":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.878,"5min":1.212,"15min":1.212},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81599999999999995,"5min":1.115,"15min":1.115},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.84599999999999997,"5min":1.077,"15min":1.077},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76600000000000001,"5min":0.90000000000000002,"15min":1.089},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.39500000000000002},"max":{"1min":0.79900000000000004,"5min":0.92600000000000005,"15min":0.96099999999999997},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":0.95899999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.65800000000000003,"15min":0.65500000000000003},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.85699999999999998,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.61599999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.747,"15min":0.748},"min":{"1min":0.59599999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80000000000000004,"5min":0.97699999999999998,"15min":1.028},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.0429999999999999},"last":0.59199999999999997}]}]},{"osd":6,"up_from":16,"seq":68719477871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70199999999999996,"15min":0.74099999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78600000000000003,"5min":1.0029999999999999,"15min":1.026},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.65000000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.93600000000000005,"15min":1.014},"last":0.435},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89400000000000002,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.1240000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.878,"5min":1.032,"15min":1.032},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84199999999999997,"5min":1.028,"15min":1.028},"last":0.69999999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.53000000000000003}]}]},{"osd":1,"up_from":15,"seq":64424510575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.84899999999999998},"last":0.43099999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.72199999999999998,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.872},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.373,"15min":0.32000000000000001},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":1.052},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.38700000000000001},"max":{"1min":1.1160000000000001,"5min":1.153,"15min":1.153},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0369999999999999,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.2070000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.628,"5min":0.55800000000000005,"15min":0.54300000000000004},"max":{"1min":1.0900000000000001,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.024,"5min":1.212,"15min":1.24},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.177,"15min":1.3220000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.879},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.53600000000000003},"max":{"1min":1.095,"5min":1.244,"15min":1.266},"last":0.61699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129543278,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308708,"kb_used_data":3228,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063132,"statfs":{"total":96636764160,"available":96320647168,"internally_reserved":0,"allocated":3305472,"data_stored":1955761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56599999999999995,"5min":0.71499999999999997,"15min":0.75600000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.31900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60999999999999999,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32400000000000001},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.89900000000000002},"last":0.372}]},{"osd":3,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.61099999999999999,"5min":0.75,"15min":1.1439999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":0.79900000000000004,"15min":1.135},"last":0.52300000000000002}]},{"osd":4,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.82999999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.014,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47499999999999998},"max":{"1min":1.0129999999999999,"5min":1.274,"15min":1.274},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0609999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":1.181,"15min":1.212},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51200000000000001},"max":{"1min":0.98299999999999998,"5min":1.208,"15min":1.208},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":0.95299999999999996,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.83299999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.55900000000000005,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.68500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316320,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055520,"statfs":{"total":96636764160,"available":96312852480,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.71399999999999997,"15min":0.56499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.497},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70599999999999996,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.42399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71899999999999997,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.79100000000000004,"15min":0.64700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":24.497,"15min":24.497},"last":0.627}]},{"osd":3,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.76600000000000001,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.67300000000000004,"5min":23.401,"15min":23.401},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76400000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.002,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.52800000000000002,"15min":0.45400000000000001},"max":{"1min":1.0009999999999999,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0860000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.0580000000000001,"15min":0.91400000000000003},"min":{"1min":0.60599999999999998,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.073,"5min":24.948,"15min":24.948},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.032,"15min":0.89700000000000002},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1870000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":0.751}]},{"osd":6,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.872,"15min":0.86699999999999999},"min":{"1min":0.64800000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.127,"5min":1.351,"15min":1.351},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.1000000000000001,"15min":0.93899999999999995},"min":{"1min":0.68700000000000006,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":25.491,"15min":25.491},"last":0.79700000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86399999999999999},"min":{"1min":0.60099999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":0.88},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.109,"15min":0.96299999999999997},"min":{"1min":0.64200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":24.875,"15min":24.875},"last":0.82599999999999996}]}]},{"osd":3,"up_from":15,"seq":64424510575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59899999999999998,"5min":0.88700000000000001,"15min":1.0820000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.498,"15min":0.53100000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":1.399},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":1.0720000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.84699999999999998},"last":0.40600000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.66400000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.84499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.625},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.204,"5min":1.298,"15min":1.298},"last":0.65900000000000003}]},{"osd":5,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1930000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.56200000000000006,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.204},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94399999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1040000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.83599999999999997},"min":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.117,"5min":1.155,"15min":1.4610000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1319999999999999,"5min":1.2130000000000001,"15min":1.5349999999999999},"last":0.57599999999999996}]}]},{"osd":4,"up_from":16,"seq":68719477870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304032,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067808,"statfs":{"total":96636764160,"available":96325435392,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":1.0309999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":1.036},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":0.99299999999999999,"15min":1.018},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48099999999999998,"15min":0.47999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93899999999999995,"5min":1.0569999999999999,"15min":1.079},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.753},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.879,"5min":0.95999999999999996,"15min":1.3089999999999999},"last":0.496},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.51800000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":1.173},"last":0.59799999999999998}]},{"osd":5,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":1.026,"15min":1.026},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.38200000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.434},"max":{"1min":0.82799999999999996,"5min":1.056,"15min":1.056},"last":0.52300000000000002}]},{"osd":7,"last update":"Mon Oct 9 13:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.1759999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.012,"15min":1.1020000000000001},"last":0.62}]}]},{"osd":5,"up_from":16,"seq":68719477870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70999999999999996,"15min":0.73799999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.371},"max":{"1min":0.97699999999999998,"5min":1.0289999999999999,"15min":1.075},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.026},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69199999999999995,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96799999999999997,"15min":1.008},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94799999999999995,"5min":0.997,"15min":1.008},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96999999999999997,"5min":0.97999999999999998,"15min":1.0429999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.79700000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97199999999999998,"5min":1.0029999999999999,"15min":1.115},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"min":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.622}]},{"osd":4,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":1.038,"15min":1.038},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.0209999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.497},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.069,"5min":1.0820000000000001,"15min":1.0920000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Mon Oct 9 13:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.016,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:17:05.622 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-09T11:41:00.251155+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=11, tm_min=41, tm_sec=0, tm_wday=0, tm_yday=282, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=13, tm_min=16, tm_sec=59, tm_wday=0, tm_yday=282, tm_isdst=0) 2023-10-09T13:17:05.622 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-09T13:17:06.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:17:06.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:17:25.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T13:17:25.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.814+0000 7f7c369ff700 1 Processor -- start 2023-10-09T13:17:25.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.814+0000 7f7c369ff700 1 -- start start 2023-10-09T13:17:25.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.815+0000 7f7c369ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c300cbf30 0x7f7c300ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:25.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.815+0000 7f7c369ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:25.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.815+0000 7f7c369ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c300cc300 con 0x7f7c300ccf90 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.815+0000 7f7c369ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c30156bf0 con 0x7f7c300cbf30 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.815+0000 7f7c369ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300ae950 con 0x7f7c300b1420 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.815+0000 7f7c2ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c300cbf30 0x7f7c300ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c2ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c300cbf30 0x7f7c300ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51044/0 (socket says 172.21.15.86:51044) 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c2ffff700 1 -- 172.21.15.86:0/4215547056 learned_addr learned my addr 172.21.15.86:0/4215547056 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c34f9c700 1 --2- 172.21.15.86:0/4215547056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c2ffff700 1 -- 172.21.15.86:0/4215547056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 msgr2=0x7f7c300c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:25.817 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c2ffff700 1 --2- 172.21.15.86:0/4215547056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:25.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c2ffff700 1 -- 172.21.15.86:0/4215547056 >> v1:172.21.15.135:6789/0 conn(0x7f7c300ccf90 legacy=0x7f7c300b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:25.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c2ffff700 1 -- 172.21.15.86:0/4215547056 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300ad370 con 0x7f7c300cbf30 2023-10-09T13:17:25.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.816+0000 7f7c2ffff700 1 --2- 172.21.15.86:0/4215547056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300cbf30 0x7f7c300ae410 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f7c200099e0 tx=0x7f7c20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624bf8a2ca32b38b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:25.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c2effd700 1 -- 172.21.15.86:0/4215547056 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000b820 con 0x7f7c300cbf30 2023-10-09T13:17:25.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c2effd700 1 -- 172.21.15.86:0/4215547056 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000b980 con 0x7f7c300cbf30 2023-10-09T13:17:25.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c2effd700 1 -- 172.21.15.86:0/4215547056 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000bd20 con 0x7f7c300cbf30 2023-10-09T13:17:25.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 -- 172.21.15.86:0/4215547056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300cbf30 msgr2=0x7f7c300ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:25.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 --2- 172.21.15.86:0/4215547056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300cbf30 0x7f7c300ae410 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f7c200099e0 tx=0x7f7c20009250 comp rx=0 tx=0).stop 2023-10-09T13:17:25.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 -- 172.21.15.86:0/4215547056 shutdown_connections 2023-10-09T13:17:25.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 --2- 172.21.15.86:0/4215547056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300b1420 0x7f7c300c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:25.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 --2- 172.21.15.86:0/4215547056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300cbf30 0x7f7c300ae410 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:25.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 -- 172.21.15.86:0/4215547056 >> 172.21.15.86:0/4215547056 conn(0x7f7c3006a320 msgr2=0x7f7c300cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:25.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 -- 172.21.15.86:0/4215547056 shutdown_connections 2023-10-09T13:17:25.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.817+0000 7f7c369ff700 1 -- 172.21.15.86:0/4215547056 wait complete. 2023-10-09T13:17:25.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.819+0000 7f7c369ff700 1 Processor -- start 2023-10-09T13:17:25.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.819+0000 7f7c369ff700 1 -- start start 2023-10-09T13:17:25.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c369ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300b1420 0x7f7c300abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:25.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c369ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300cbf30 0x7f7c300a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:25.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c369ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300ccf90 0x7f7c300a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:25.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c369ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30140a90 con 0x7f7c300b1420 2023-10-09T13:17:25.822 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c369ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300ab980 con 0x7f7c300ccf90 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c369ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300a5f40 con 0x7f7c300cbf30 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300b1420 0x7f7c300abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300b1420 0x7f7c300abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51046/0 (socket says 172.21.15.86:51046) 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 -- 172.21.15.86:0/880339264 learned_addr learned my addr 172.21.15.86:0/880339264 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2f7fe700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300cbf30 0x7f7c300a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c34f9c700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300ccf90 0x7f7c300a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 -- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300cbf30 msgr2=0x7f7c300a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300cbf30 0x7f7c300a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:25.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 -- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300ccf90 msgr2=0x7f7c300a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300ccf90 0x7f7c300a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.820+0000 7f7c2ffff700 1 -- 172.21.15.86:0/880339264 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200094f0 con 0x7f7c300b1420 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.821+0000 7f7c2ffff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300b1420 0x7f7c300abe10 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009290 tx=0x7f7c20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.821+0000 7f7c17fff700 1 -- 172.21.15.86:0/880339264 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20011e20 con 0x7f7c300b1420 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.821+0000 7f7c17fff700 1 -- 172.21.15.86:0/880339264 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20024440 con 0x7f7c300b1420 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.821+0000 7f7c17fff700 1 -- 172.21.15.86:0/880339264 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20024800 con 0x7f7c300b1420 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.821+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c300aad70 con 0x7f7c300b1420 2023-10-09T13:17:25.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.821+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c300ab330 con 0x7f7c300b1420 2023-10-09T13:17:25.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.822+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3004c3c0 con 0x7f7c300b1420 2023-10-09T13:17:25.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.823+0000 7f7c17fff700 1 -- 172.21.15.86:0/880339264 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c2002d440 con 0x7f7c300b1420 2023-10-09T13:17:25.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.824+0000 7f7c17fff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c1c066f60 0x7f7c1c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:25.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.824+0000 7f7c17fff700 1 -- 172.21.15.86:0/880339264 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f7c20085ff0 con 0x7f7c300b1420 2023-10-09T13:17:25.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.824+0000 7f7c2f7fe700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c1c066f60 0x7f7c1c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:25.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.825+0000 7f7c2f7fe700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c1c066f60 0x7f7c1c069410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c300a9bb0 tx=0x7f7c24007ec0 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:25.829 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:25.829+0000 7f7c17fff700 1 -- 172.21.15.86:0/880339264 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c20053090 con 0x7f7c300b1420 2023-10-09T13:17:26.016 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.016+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 --> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c300abac0 con 0x7f7c1c066f60 2023-10-09T13:17:26.019 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.019+0000 7f7c17fff700 1 -- 172.21.15.86:0/880339264 <== mgr.10476 v2:172.21.15.86:6836/133360 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50442 (secure 0 0 0) 0x7f7c24003670 con 0x7f7c1c066f60 2023-10-09T13:17:26.020 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:17:26.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c1c066f60 msgr2=0x7f7c1c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c1c066f60 0x7f7c1c069410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c300a9bb0 tx=0x7f7c24007ec0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.021 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300b1420 msgr2=0x7f7c300abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300b1420 0x7f7c300abe10 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009290 tx=0x7f7c20017000 comp rx=0 tx=0).stop 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 shutdown_connections 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f7c1c066f60 0x7f7c1c069410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c300b1420 0x7f7c300abe10 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c300ccf90 0x7f7c300a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 --2- 172.21.15.86:0/880339264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c300cbf30 0x7f7c300a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 >> 172.21.15.86:0/880339264 conn(0x7f7c3006a320 msgr2=0x7f7c300ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 shutdown_connections 2023-10-09T13:17:26.022 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.021+0000 7f7c369ff700 1 -- 172.21.15.86:0/880339264 wait complete. 2023-10-09T13:17:26.023 INFO:teuthology.orchestra.run.smithi086.stderr:dumped all 2023-10-09T13:17:26.038 INFO:teuthology.orchestra.run.smithi086.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T13:17:26.011673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2490760,"kb_used_data":22344,"kb_used_omap":0,"kb_used_meta":2468352,"kb_avail":752483960,"statfs":{"total":773094113280,"available":770543575040,"internally_reserved":0,"allocated":22880256,"data_stored":12103880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2527592448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002598"},"pg_stats":[{"pgid":"1.0","version":"217'371","reported_seq":1236,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-09T13:17:07.770994+0000","last_change":"2023-10-09T13:17:07.770959+0000","last_active":"2023-10-09T13:17:07.770994+0000","last_peered":"2023-10-09T13:17:07.770994+0000","last_clean":"2023-10-09T13:17:07.770994+0000","last_became_active":"2023-10-09T11:41:01.497891+0000","last_became_peered":"2023-10-09T11:41:01.497891+0000","last_unstale":"2023-10-09T13:17:07.770994+0000","last_undegraded":"2023-10-09T13:17:07.770994+0000","last_fullsized":"2023-10-09T13:17:07.770994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'371","last_scrub_stamp":"2023-10-09T13:17:07.770853+0000","last_deep_scrub":"217'371","last_deep_scrub_stamp":"2023-10-09T13:17:07.770853+0000","last_clean_scrub_stamp":"2023-10-09T13:17:07.770853+0000","objects_scrubbed":2,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:51:39.261829+0000","scrub_duration":0.0061779290000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312804,"kb_used_data":3228,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059036,"statfs":{"total":96636764160,"available":96316452864,"internally_reserved":0,"allocated":3305472,"data_stored":1955761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.39700000000000002},"max":{"1min":0.78700000000000003,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.67500000000000004,"15min":0.70499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86499999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67800000000000005}]},{"osd":1,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.499,"5min":0.46000000000000002,"15min":0.38800000000000001},"max":{"1min":0.83099999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.748,"15min":0.76300000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.82399999999999995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.75}]},{"osd":2,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78700000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.73499999999999999,"15min":0.747},"min":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.41899999999999998},"max":{"1min":0.878,"5min":1.212,"15min":1.212},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81599999999999995,"5min":1.115,"15min":1.115},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.51500000000000001},"max":{"1min":0.84599999999999997,"5min":1.077,"15min":1.077},"last":0.71399999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76600000000000001,"5min":0.90000000000000002,"15min":1.089},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.39500000000000002},"max":{"1min":0.79900000000000004,"5min":0.92600000000000005,"15min":0.96099999999999997},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64500000000000002,"15min":0.624},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.35699999999999998},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":0.95899999999999996},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.65800000000000003,"15min":0.65500000000000003},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.39800000000000002},"max":{"1min":0.85699999999999998,"5min":0.90100000000000002,"15min":0.91900000000000004},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Oct 9 13:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.747,"15min":0.748},"min":{"1min":0.59599999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80000000000000004,"5min":0.97699999999999998,"15min":1.028},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.42899999999999999},"max":{"1min":0.84199999999999997,"5min":1.038,"15min":1.0429999999999999},"last":0.84299999999999997}]}]},{"osd":6,"up_from":16,"seq":68719477875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70199999999999996,"15min":0.74099999999999999},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78600000000000003,"5min":1.0029999999999999,"15min":1.026},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":0.97299999999999998,"15min":1.069},"last":0.626}]},{"osd":1,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":0.93600000000000005,"15min":1.014},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89400000000000002,"5min":1.0589999999999999,"15min":1.0620000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.46000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.1240000000000001},"last":0.83999999999999997}]},{"osd":3,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.48299999999999998},"max":{"1min":0.878,"5min":1.032,"15min":1.032},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.63800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.91300000000000003,"15min":1.0449999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.98699999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84199999999999997,"5min":1.028,"15min":1.028},"last":0.751}]},{"osd":7,"last update":"Mon Oct 9 13:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":1.008},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.0469999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":15,"seq":64424510579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46700000000000003,"15min":0.48299999999999998},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.74299999999999999,"15min":0.79100000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50900000000000001,"15min":0.52600000000000002},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.495,"15min":0.52000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64200000000000002,"5min":0.85099999999999998,"15min":0.92700000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53900000000000003,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.81499999999999995},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32000000000000001},"max":{"1min":0.745,"5min":0.76700000000000002,"15min":1.052},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72699999999999998,"5min":0.78100000000000003,"15min":0.80600000000000005},"last":0.55000000000000004}]},{"osd":4,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80100000000000005,"15min":0.81899999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.38700000000000001},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.81100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":1.0840000000000001,"15min":1.2849999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.53700000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.2070000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.81100000000000005,"15min":0.84199999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1299999999999999,"5min":1.2070000000000001,"15min":1.2250000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80400000000000005,"15min":0.83399999999999996},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1439999999999999,"5min":1.212,"15min":1.24},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.093,"5min":1.177,"15min":1.3220000000000001},"last":0.97399999999999998}]},{"osd":7,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81699999999999995,"15min":0.84799999999999998},"min":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.503},"max":{"1min":1.095,"5min":1.1719999999999999,"15min":1.1899999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.86899999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.53600000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.90600000000000003}]}]},{"osd":0,"up_from":14,"seq":60129543282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308708,"kb_used_data":3228,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063132,"statfs":{"total":96636764160,"available":96320647168,"internally_reserved":0,"allocated":3305472,"data_stored":1955761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56599999999999995,"5min":0.71499999999999997,"15min":0.75600000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.31900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60999999999999999,"5min":0.83699999999999997,"15min":1.0149999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32400000000000001},"max":{"1min":0.67000000000000004,"5min":0.76300000000000001,"15min":0.89900000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.61099999999999999,"5min":0.75,"15min":1.1439999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":0.79900000000000004,"15min":1.135},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.82999999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"max":{"1min":1.014,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.874},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47499999999999998},"max":{"1min":1.0129999999999999,"5min":1.274,"15min":1.274},"last":0.83599999999999997}]},{"osd":5,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0609999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95699999999999996,"5min":1.181,"15min":1.212},"last":0.75}]},{"osd":6,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51200000000000001},"max":{"1min":0.98299999999999998,"5min":1.208,"15min":1.208},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"max":{"1min":0.95299999999999996,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Oct 9 13:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.83299999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.55900000000000005,"5min":0.54100000000000004,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.89900000000000002}]}]},{"osd":2,"up_from":14,"seq":60129543282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":316320,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055520,"statfs":{"total":96636764160,"available":96312852480,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.71599999999999997,"15min":0.56699999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1020000000000001,"5min":24.452999999999999,"15min":24.452999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.70999999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88800000000000001,"5min":20.568000000000001,"15min":20.568000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Oct 9 13:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.35199999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.167,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.78900000000000003,"15min":0.64500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96799999999999997,"5min":24.497,"15min":24.497},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Oct 9 13:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.76600000000000001,"15min":0.626},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.36599999999999999},"max":{"1min":0.83799999999999997,"5min":23.401,"15min":23.401},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2030000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.627}]},{"osd":4,"last update":"Mon Oct 9 13:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.97599999999999998,"15min":0.86599999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":20.658000000000001,"15min":20.658000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.81599999999999995,"15min":0.82399999999999995},"min":{"1min":0.57299999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0660000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.90200000000000002}]},{"osd":5,"last update":"Mon Oct 9 13:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.044,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":1.099,"5min":24.948,"15min":24.948},"last":0.87},{"interface":"front","average":{"1min":0.74099999999999999,"5min":1.016,"15min":0.89300000000000002},"min":{"1min":0.56299999999999994,"5min":0.54800000000000004,"15min":0.501},"max":{"1min":1.1930000000000001,"5min":20.701000000000001,"15min":20.701000000000001},"last":1.1020000000000001}]},{"osd":6,"last update":"Mon Oct 9 13:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.86199999999999999},"min":{"1min":0.65000000000000002,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.2569999999999999,"5min":1.351,"15min":1.351},"last":1.046},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.089,"15min":0.93899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.54200000000000004},"max":{"1min":1.135,"5min":25.491,"15min":25.491},"last":0.96999999999999997}]},{"osd":7,"last update":"Mon Oct 9 13:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2150000000000001,"5min":1.2490000000000001,"15min":1.4490000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":1.0940000000000001,"15min":0.95799999999999996},"min":{"1min":0.64600000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1379999999999999,"5min":24.875,"15min":24.875},"last":1.0740000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.33400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59899999999999998,"5min":0.88700000000000001,"15min":1.0820000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.498,"15min":0.53100000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":1.399},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":1.0720000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.84699999999999998},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.373},"max":{"1min":0.66400000000000003,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.372,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.63400000000000001}]},{"osd":4,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.84499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.204,"5min":1.298,"15min":1.298},"last":1.077}]},{"osd":5,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1930000000000001},"last":0.995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.56200000000000006,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.204},"last":1.0209999999999999}]},{"osd":6,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94399999999999995,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1040000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0549999999999999}]},{"osd":7,"last update":"Mon Oct 9 13:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.83599999999999997},"min":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.117,"5min":1.155,"15min":1.4610000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83199999999999996,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1319999999999999,"5min":1.2130000000000001,"15min":1.5349999999999999},"last":1.042}]}]},{"osd":4,"up_from":16,"seq":68719477874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304032,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067808,"statfs":{"total":96636764160,"available":96325435392,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73799999999999999,"15min":0.755},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.40000000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.46000000000000002,"5min":0.436,"15min":0.39500000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Oct 9 13:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.874,"5min":0.99299999999999999,"15min":1.036},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.755},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":0.89500000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.74399999999999999}]},{"osd":2,"last update":"Mon Oct 9 13:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":0.99199999999999999,"15min":1.0429999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.752,"15min":0.77300000000000002},"min":{"1min":0.54600000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.079},"last":0.79700000000000004}]},{"osd":3,"last update":"Mon Oct 9 13:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73399999999999999,"15min":0.749},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":1.3089999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94099999999999995,"5min":0.97899999999999998,"15min":1.173},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon Oct 9 13:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.624,"15min":0.622},"min":{"1min":0.47199999999999998,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":1.026},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Mon Oct 9 13:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97599999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.434},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.57499999999999996}]},{"osd":7,"last update":"Mon Oct 9 13:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97999999999999998,"5min":1.026,"15min":1.1759999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.505,"5min":0.49099999999999999,"15min":0.48799999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1020000000000001},"last":0.63200000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312224,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059616,"statfs":{"total":96636764160,"available":96317046784,"internally_reserved":0,"allocated":2711552,"data_stored":1365393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69699999999999995,"15min":0.73099999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.371},"max":{"1min":1.032,"5min":1.032,"15min":1.075},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69999999999999996,"15min":0.72699999999999998},"min":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95999999999999996,"5min":1.022,"15min":1.026},"last":0.90700000000000003}]},{"osd":1,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.441,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.876},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.751},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.008},"last":0.76100000000000001}]},{"osd":2,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70799999999999996,"15min":0.73999999999999999},"min":{"1min":0.504,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70999999999999996,"15min":0.72899999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94999999999999996,"5min":0.96999999999999997,"15min":1.008},"last":0.81499999999999995}]},{"osd":3,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.0620000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78500000000000003,"15min":0.81100000000000005},"min":{"1min":0.622,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.014,"5min":1.052,"15min":1.052},"last":0.94699999999999995}]},{"osd":4,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.38600000000000001,"15min":0.35799999999999998},"max":{"1min":0.83899999999999997,"5min":0.90600000000000003,"15min":1.038},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.622,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0209999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.38400000000000001},"max":{"1min":1.024,"5min":1.085,"15min":1.085},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.89300000000000002,"5min":1.069,"15min":1.0820000000000001},"last":0.91900000000000004}]},{"osd":7,"last update":"Mon Oct 9 13:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.0509999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0189999999999999,"5min":1.0469999999999999,"15min":1.1100000000000001},"last":1.0029999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T13:17:26.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-09T13:17:26.215 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.215+0000 7f0efd3ff700 1 Processor -- start 2023-10-09T13:17:26.216 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.215+0000 7f0efd3ff700 1 -- start start 2023-10-09T13:17:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.216+0000 7f0efd3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.216+0000 7f0efd3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ef80637d0 0x7f0ef8068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.216+0000 7f0efd3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef80ac450 con 0x7f0ef806a2b0 2023-10-09T13:17:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.216+0000 7f0efd3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef8069d00 con 0x7f0ef80637d0 2023-10-09T13:17:26.217 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0efd3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8068830 con 0x7f0ef806b160 2023-10-09T13:17:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef67fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ef80637d0 0x7f0ef8068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.218 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef67fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ef80637d0 0x7f0ef8068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.86:37138/0 (socket says 172.21.15.86:37138) 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3538896617 learned_addr learned my addr 172.21.15.86:0/3538896617 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3538896617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 msgr2=0x7f0ef806b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef67fc700 1 --2- 172.21.15.86:0/3538896617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef806b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3538896617 >> v1:172.21.15.135:6789/0 conn(0x7f0ef806a2b0 legacy=0x7f0ef806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3538896617 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8069740 con 0x7f0ef80637d0 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.217+0000 7f0ef5ffb700 1 -- 172.21.15.86:0/3538896617 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320543876 0 0) 0x7f0ef80ac450 con 0x7f0ef806a2b0 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.218+0000 7f0ef67fc700 1 --2- 172.21.15.86:0/3538896617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8068cc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0099b0 tx=0x7f0eec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ec38c117533d2c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:26.219 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.218+0000 7f0ef5ffb700 1 -- 172.21.15.86:0/3538896617 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec009ea0 con 0x7f0ef80637d0 2023-10-09T13:17:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.218+0000 7f0ef5ffb700 1 -- 172.21.15.86:0/3538896617 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec00b860 con 0x7f0ef80637d0 2023-10-09T13:17:26.220 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.218+0000 7f0ef5ffb700 1 -- 172.21.15.86:0/3538896617 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00bc20 con 0x7f0ef80637d0 2023-10-09T13:17:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3538896617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 msgr2=0x7f0ef8068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3538896617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8068cc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0099b0 tx=0x7f0eec009250 comp rx=0 tx=0).stop 2023-10-09T13:17:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3538896617 shutdown_connections 2023-10-09T13:17:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3538896617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef806b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3538896617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8068cc0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3538896617 >> 172.21.15.86:0/3538896617 conn(0x7f0ef806ded0 msgr2=0x7f0ef806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:26.221 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3538896617 shutdown_connections 2023-10-09T13:17:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.219+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3538896617 wait complete. 2023-10-09T13:17:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.220+0000 7f0efd3ff700 1 Processor -- start 2023-10-09T13:17:26.222 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.220+0000 7f0efd3ff700 1 -- start start 2023-10-09T13:17:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0efd3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0efd3ff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef806a2b0 0x7f0ef816add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0efd3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0efd3ff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8153230 con 0x7f0ef806a2b0 2023-10-09T13:17:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0efd3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef816bfd0 con 0x7f0ef80637d0 2023-10-09T13:17:26.224 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0efd3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80c1fc0 con 0x7f0ef806b160 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0ef67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef806a2b0 0x7f0ef816add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0ef67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef806a2b0 0x7f0ef816add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51062/0 (socket says 172.21.15.86:51062) 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.221+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3083645303 learned_addr learned my addr 172.21.15.86:0/3083645303 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef77fe700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef6ffd700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 msgr2=0x7f0ef815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef67fc700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 msgr2=0x7f0ef8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.225 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef67fc700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef67fc700 1 -- 172.21.15.86:0/3083645303 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0094f0 con 0x7f0ef806a2b0 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef77fe700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef6ffd700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0ef67fc700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef806a2b0 0x7f0ef816add0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006fd0 tx=0x7f0eec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec01f070 con 0x7f0ef806a2b0 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec000bc0 con 0x7f0ef806a2b0 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef816b6a0 con 0x7f0ef806a2b0 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.222+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00bc20 con 0x7f0ef806a2b0 2023-10-09T13:17:26.226 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.223+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef816bc60 con 0x7f0ef806a2b0 2023-10-09T13:17:26.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.224+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef816c160 con 0x7f0ef806a2b0 2023-10-09T13:17:26.227 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.224+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0eec023070 con 0x7f0ef806a2b0 2023-10-09T13:17:26.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.225+0000 7f0edeffd700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0ee4066f30 0x7f0ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.225+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f0eec085890 con 0x7f0ef806a2b0 2023-10-09T13:17:26.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.226+0000 7f0ef6ffd700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0ee4066f30 0x7f0ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.228 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.226+0000 7f0ef6ffd700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0ee4066f30 0x7f0ee40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8157a90 tx=0x7f0ee8008040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:26.230 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.229+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0eec0529e0 con 0x7f0ef806a2b0 2023-10-09T13:17:26.422 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.421+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0ef804c3c0 con 0x7f0ef806a2b0 2023-10-09T13:17:26.426 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.426+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0eec009320 con 0x7f0ef806a2b0 2023-10-09T13:17:26.427 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.426+0000 7f0edeffd700 1 -- 172.21.15.86:0/3083645303 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v76)=0 v76) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0eec056000 con 0x7f0ef806a2b0 2023-10-09T13:17:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0ee4066f30 msgr2=0x7f0ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0ee4066f30 0x7f0ee40693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8157a90 tx=0x7f0ee8008040 comp rx=0 tx=0).stop 2023-10-09T13:17:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef806a2b0 msgr2=0x7f0ef816add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef806a2b0 0x7f0ef816add0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006fd0 tx=0x7f0eec017000 comp rx=0 tx=0).stop 2023-10-09T13:17:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 shutdown_connections 2023-10-09T13:17:26.430 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f0ee4066f30 0x7f0ee40693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ef806b160 0x7f0ef815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ef80637d0 0x7f0ef8152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 --2- 172.21.15.86:0/3083645303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef806a2b0 0x7f0ef816add0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.429+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 >> 172.21.15.86:0/3083645303 conn(0x7f0ef806ded0 msgr2=0x7f0ef806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.430+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 shutdown_connections 2023-10-09T13:17:26.431 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.430+0000 7f0efd3ff700 1 -- 172.21.15.86:0/3083645303 wait complete. 2023-10-09T13:17:26.448 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T13:17:26.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T13:17:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.630+0000 7f953759d700 1 Processor -- start 2023-10-09T13:17:26.630 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.630+0000 7f953759d700 1 -- start start 2023-10-09T13:17:26.631 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f953759d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f953006d950 0x7f95300c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f953759d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f953006dd20 0x7f95300c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f953759d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953006ae70 con 0x7f953006a0a0 2023-10-09T13:17:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f953759d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953006a540 con 0x7f953006dd20 2023-10-09T13:17:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f953759d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953006a820 con 0x7f953006d950 2023-10-09T13:17:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f9536d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f953006dd20 0x7f95300c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f9536d9c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f953006dd20 0x7f95300c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51068/0 (socket says 172.21.15.86:51068) 2023-10-09T13:17:26.632 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.631+0000 7f9536d9c700 1 -- 172.21.15.86:0/4197873982 learned_addr learned my addr 172.21.15.86:0/4197873982 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f953659b700 1 --2- 172.21.15.86:0/4197873982 >> v2:172.21.15.135:3300/0 conn(0x7f953006d950 0x7f95300c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9536d9c700 1 -- 172.21.15.86:0/4197873982 >> v2:172.21.15.135:3300/0 conn(0x7f953006d950 msgr2=0x7f95300c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9536d9c700 1 --2- 172.21.15.86:0/4197873982 >> v2:172.21.15.135:3300/0 conn(0x7f953006d950 0x7f95300c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9536d9c700 1 -- 172.21.15.86:0/4197873982 >> v1:172.21.15.135:6789/0 conn(0x7f953006a0a0 legacy=0x7f95300c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9536d9c700 1 -- 172.21.15.86:0/4197873982 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953006ab00 con 0x7f953006dd20 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9536d9c700 1 --2- 172.21.15.86:0/4197873982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006dd20 0x7f95300c7320 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f95300c9c70 tx=0x7f9528009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260b96a5ed71284f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9535599700 1 -- 172.21.15.86:0/4197873982 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800e070 con 0x7f953006dd20 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9535599700 1 -- 172.21.15.86:0/4197873982 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f952800ba10 con 0x7f953006dd20 2023-10-09T13:17:26.634 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.632+0000 7f9535599700 1 -- 172.21.15.86:0/4197873982 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280092e0 con 0x7f953006dd20 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 -- 172.21.15.86:0/4197873982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006dd20 msgr2=0x7f95300c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 --2- 172.21.15.86:0/4197873982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006dd20 0x7f95300c7320 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f95300c9c70 tx=0x7f9528009840 comp rx=0 tx=0).stop 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 -- 172.21.15.86:0/4197873982 shutdown_connections 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 --2- 172.21.15.86:0/4197873982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006dd20 0x7f95300c7320 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 --2- 172.21.15.86:0/4197873982 >> v2:172.21.15.135:3300/0 conn(0x7f953006d950 0x7f95300c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 -- 172.21.15.86:0/4197873982 >> 172.21.15.86:0/4197873982 conn(0x7f95300cc1f0 msgr2=0x7f95300cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 -- 172.21.15.86:0/4197873982 shutdown_connections 2023-10-09T13:17:26.635 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.633+0000 7f953759d700 1 -- 172.21.15.86:0/4197873982 wait complete. 2023-10-09T13:17:26.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.634+0000 7f953759d700 1 Processor -- start 2023-10-09T13:17:26.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.634+0000 7f953759d700 1 -- start start 2023-10-09T13:17:26.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.635+0000 7f953759d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006a0a0 0x7f95300c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.635+0000 7f953759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f953006d950 0x7f9530168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.637 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.635+0000 7f953759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953006dd20 0x7f9530167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.635+0000 7f953759d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9530168d00 con 0x7f953006a0a0 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.635+0000 7f953759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9530168270 con 0x7f953006dd20 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.635+0000 7f953759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95300c3460 con 0x7f953006d950 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006a0a0 0x7f95300c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006a0a0 0x7f95300c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51082/0 (socket says 172.21.15.86:51082) 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 -- 172.21.15.86:0/50701479 learned_addr learned my addr 172.21.15.86:0/50701479 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f9536d9c700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953006dd20 0x7f9530167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f9535d9a700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f953006d950 0x7f9530168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 -- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f953006d950 msgr2=0x7f9530168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f953006d950 0x7f9530168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.638 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 -- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953006dd20 msgr2=0x7f9530167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953006dd20 0x7f9530167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 -- 172.21.15.86:0/50701479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009ae0 con 0x7f953006a0a0 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.636+0000 7f953659b700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006a0a0 0x7f95300c54d0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f952c00d890 tx=0x7f952c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.637+0000 7f95267fc700 1 -- 172.21.15.86:0/50701479 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c0125f0 con 0x7f953006a0a0 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.637+0000 7f95267fc700 1 -- 172.21.15.86:0/50701479 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f952c012770 con 0x7f953006a0a0 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.637+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9530168460 con 0x7f953006a0a0 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.637+0000 7f95267fc700 1 -- 172.21.15.86:0/50701479 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c012b50 con 0x7f953006a0a0 2023-10-09T13:17:26.639 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.637+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9530168a20 con 0x7f953006a0a0 2023-10-09T13:17:26.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.638+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953004c3c0 con 0x7f953006a0a0 2023-10-09T13:17:26.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.639+0000 7f95267fc700 1 -- 172.21.15.86:0/50701479 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 119) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f952c01e460 con 0x7f953006a0a0 2023-10-09T13:17:26.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.640+0000 7f95267fc700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T13:17:26.640 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.640+0000 7f95267fc700 1 -- 172.21.15.86:0/50701479 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6002+0+0 (secure 0 0 0) 0x7f952c084da0 con 0x7f953006a0a0 2023-10-09T13:17:26.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.640+0000 7f9535d9a700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T13:17:26.641 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.641+0000 7f9535d9a700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9514066f30 0x7f95140693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9520006fd0 tx=0x7f9520008040 comp rx=0 tx=0).ready entity=mgr.10476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T13:17:26.644 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.644+0000 7f95267fc700 1 -- 172.21.15.86:0/50701479 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f952c051f60 con 0x7f953006a0a0 2023-10-09T13:17:26.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.875+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95300c6360 con 0x7f953006a0a0 2023-10-09T13:17:26.876 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.876+0000 7f95267fc700 1 -- 172.21.15.86:0/50701479 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+3533 (secure 0 0 0) 0x7f952c055580 con 0x7f953006a0a0 2023-10-09T13:17:26.876 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-09T13:17:26.876 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":96,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/4046429451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4046429451},{"type":"v1","addr":"172.21.15.135:6834","nonce":4046429451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1310718495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1310718495},{"type":"v1","addr":"172.21.15.135:6835","nonce":1310718495}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":8369,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/825536240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":825536240},{"type":"v1","addr":"172.21.15.86:6835","nonce":825536240}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3009333325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3009333325},{"type":"v1","addr":"172.21.15.86:6833","nonce":3009333325}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[]} 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9514066f30 msgr2=0x7f95140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9514066f30 0x7f95140693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9520006fd0 tx=0x7f9520008040 comp rx=0 tx=0).stop 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006a0a0 msgr2=0x7f95300c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006a0a0 0x7f95300c54d0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f952c00d890 tx=0x7f952c008040 comp rx=0 tx=0).stop 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 shutdown_connections 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:6836/133360,v1:172.21.15.86:6837/133360] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f953006a0a0 0x7f95300c54d0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.879 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953006dd20 0x7f9530167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 --2- 172.21.15.86:0/50701479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f953006d950 0x7f9530168ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T13:17:26.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 >> 172.21.15.86:0/50701479 conn(0x7f95300cc1f0 msgr2=0x7f95300b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T13:17:26.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.878+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 shutdown_connections 2023-10-09T13:17:26.880 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-09T13:17:26.879+0000 7f953759d700 1 -- 172.21.15.86:0/50701479 wait complete. 2023-10-09T13:17:26.880 INFO:teuthology.orchestra.run.smithi086.stderr:dumped fsmap epoch 96 2023-10-09T13:17:26.897 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-09T13:17:26.897 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-09T13:17:26.897 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T13:17:26.897 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:26.910 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T13:17:26.910 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T13:17:26.910 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:26.963 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T13:17:26.963 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T13:17:26.963 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:26.979 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T13:17:26.979 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T13:17:26.979 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.037 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T13:17:27.038 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-09T13:17:27.038 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-09T13:17:27.038 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.079 INFO:tasks.ceph.osd.0:Stopped 2023-10-09T13:17:27.079 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-09T13:17:27.079 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.160 INFO:tasks.ceph.osd.1:Stopped 2023-10-09T13:17:27.161 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-09T13:17:27.161 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.208 INFO:tasks.ceph.osd.2:Stopped 2023-10-09T13:17:27.208 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-09T13:17:27.209 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.261 INFO:tasks.ceph.osd.3:Stopped 2023-10-09T13:17:27.261 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-09T13:17:27.261 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.319 INFO:tasks.ceph.osd.4:Stopped 2023-10-09T13:17:27.319 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-09T13:17:27.319 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.375 INFO:tasks.ceph.osd.5:Stopped 2023-10-09T13:17:27.375 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-09T13:17:27.375 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.424 INFO:tasks.ceph.osd.6:Stopped 2023-10-09T13:17:27.425 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-09T13:17:27.425 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.468 INFO:tasks.ceph.osd.7:Stopped 2023-10-09T13:17:27.468 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-09T13:17:27.469 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-09T13:17:27.469 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.534 INFO:tasks.ceph.mgr.y:Stopped 2023-10-09T13:17:27.534 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-09T13:17:27.534 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.597 INFO:tasks.ceph.mgr.x:Stopped 2023-10-09T13:17:27.597 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-09T13:17:27.598 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-09T13:17:27.598 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.629 INFO:tasks.ceph.mon.a:Stopped 2023-10-09T13:17:27.629 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-09T13:17:27.629 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.653 INFO:tasks.ceph.mon.b:Stopped 2023-10-09T13:17:27.653 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-09T13:17:27.653 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T13:17:27.718 INFO:tasks.ceph.mon.c:Stopped 2023-10-09T13:17:27.718 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-09T13:17:27.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T13:17:27.789 INFO:teuthology.orchestra.run.smithi086.stdout:1696856325.3261294 mon.a (mon.0) 1797 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-09T13:17:27.790 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-09T13:17:27.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T13:17:27.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T13:17:27.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-09T13:17:28.005 INFO:teuthology.orchestra.run.smithi086.stdout:1696856325.3261294 mon.a (mon.0) 1797 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-09T13:17:28.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:17:28.005 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-09T13:17:28.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:17:28.350 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-09T13:17:28.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:17:28.563 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-09T13:17:28.785 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:17:28.785 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-09T13:17:28.966 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T13:17:28.966 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-09T13:17:29.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T13:17:29.365 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-09T13:17:29.553 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T13:17:29.553 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-09T13:17:29.766 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T13:17:29.767 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-09T13:17:29.939 INFO:tasks.ceph:Archiving mon data... 2023-10-09T13:17:29.941 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/data/mon.a.tgz 2023-10-09T13:17:29.941 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2023-10-09T13:17:29.980 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.ksrmc7Ciay 2023-10-09T13:17:29.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ksrmc7Ciay 2023-10-09T13:17:30.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.ksrmc7Ciay 2023-10-09T13:17:30.886 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.ksrmc7Ciay is 3MB 2023-10-09T13:17:31.006 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.ksrmc7Ciay 2023-10-09T13:17:31.043 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/data/mon.b.tgz 2023-10-09T13:17:31.043 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-10-09T13:17:31.082 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.7XQx9xmkDY 2023-10-09T13:17:31.083 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7XQx9xmkDY 2023-10-09T13:17:31.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.7XQx9xmkDY 2023-10-09T13:17:31.871 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.7XQx9xmkDY is 3MB 2023-10-09T13:17:31.984 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.7XQx9xmkDY 2023-10-09T13:17:32.020 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/data/mon.c.tgz 2023-10-09T13:17:32.021 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-10-09T13:17:32.095 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.pxFRJbdYoK 2023-10-09T13:17:32.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pxFRJbdYoK 2023-10-09T13:17:32.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.pxFRJbdYoK 2023-10-09T13:17:32.691 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.pxFRJbdYoK is 3MB 2023-10-09T13:17:32.807 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.pxFRJbdYoK 2023-10-09T13:17:32.843 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-09T13:17:32.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T13:17:32.848 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T13:17:32.943 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-09T13:17:32.943 DEBUG:teuthology.orchestra.run.smithi086:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T13:17:32.948 DEBUG:teuthology.orchestra.run.smithi135:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T13:17:33.023 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T13:17:33.032 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T13:17:33.047 INFO:tasks.ceph:Archiving crash dumps... 2023-10-09T13:17:33.049 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/remote/smithi086/crash 2023-10-09T13:17:33.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T13:17:33.110 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/remote/smithi135/crash 2023-10-09T13:17:33.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T13:17:33.170 INFO:tasks.ceph:Shutting down logrotate 2023-10-09T13:17:33.170 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:17:33.174 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T13:17:33.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T13:17:33.320 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T13:17:33.380 INFO:tasks.ceph:Compressing logs... 2023-10-09T13:17:33.380 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T13:17:33.385 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T13:17:33.441 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143634.log 2023-10-09T13:17:33.442 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97502.log 2023-10-09T13:17:33.443 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119387.log 2023-10-09T13:17:33.443 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143634.log.gz 2023-10-09T13:17:33.444 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.97502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97502.log.gz 2023-10-09T13:17:33.444 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92758.log 2023-10-09T13:17:33.445 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119387.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119387.log.gz 2023-10-09T13:17:33.445 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112769.log 2023-10-09T13:17:33.446 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92758.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92758.log.gz 2023-10-09T13:17:33.446 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118707.log 2023-10-09T13:17:33.447 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112769.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112769.log.gz 2023-10-09T13:17:33.447 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143970.log 2023-10-09T13:17:33.448 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118707.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118707.log.gzgzip 2023-10-09T13:17:33.448 INFO:teuthology.orchestra.run.smithi086.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.99622.log 2023-10-09T13:17:33.449 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143970.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143970.log.gzgzip 2023-10-09T13:17:33.449 INFO:teuthology.orchestra.run.smithi086.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.97699.log 2023-10-09T13:17:33.450 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113254.log 2023-10-09T13:17:33.450 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113717.log 2023-10-09T13:17:33.451 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99622.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99622.log.gz 2023-10-09T13:17:33.451 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117840.log 2023-10-09T13:17:33.451 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97699.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97699.log.gz 2023-10-09T13:17:33.451 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122666.log 2023-10-09T13:17:33.452 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117840.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117840.log.gz 2023-10-09T13:17:33.453 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114374.log 2023-10-09T13:17:33.453 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.113254.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T13:17:33.453 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113254.log.gz 2023-10-09T13:17:33.453 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.113717.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113717.log.gz 2023-10-09T13:17:33.453 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113931.log 2023-10-09T13:17:33.453 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-09T13:17:33.455 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.113931.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113931.log.gz 2023-10-09T13:17:33.455 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T13:17:33.455 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113431.log 2023-10-09T13:17:33.456 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122666.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122666.log.gz 2023-10-09T13:17:33.456 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129754.log 2023-10-09T13:17:33.456 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94133.log 2023-10-09T13:17:33.456 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114374.log.gz 2023-10-09T13:17:33.457 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128100.log 2023-10-09T13:17:33.457 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129754.log.gz 2023-10-09T13:17:33.457 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.94133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94133.log.gz 2023-10-09T13:17:33.457 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104807.log 2023-10-09T13:17:33.459 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.121788.log 2023-10-09T13:17:33.459 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.113431.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113431.log.gz 2023-10-09T13:17:33.459 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-09T13:17:33.459 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.121788.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-09T13:17:33.459 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.121788.log.gz 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128100.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128100.log.gz 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139342.log 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104765.log 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104807.log.gz 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139342.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139342.log.gz 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113297.log 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104765.log.gz 2023-10-09T13:17:33.460 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116777.log 2023-10-09T13:17:33.462 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-09T13:17:33.462 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-09T13:17:33.463 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139804.log 2023-10-09T13:17:33.463 INFO:teuthology.orchestra.run.smithi086.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113297.log.gz 2023-10-09T13:17:33.463 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116777.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116777.log.gz 2023-10-09T13:17:33.463 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121629.log 2023-10-09T13:17:33.463 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139804.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139804.log.gz 2023-10-09T13:17:33.463 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132227.log 2023-10-09T13:17:33.464 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.4.log: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T13:17:33.464 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-09T13:17:33.464 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.c.log: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T13:17:33.465 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121629.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121629.log.gz 2023-10-09T13:17:33.465 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95624.log 2023-10-09T13:17:33.465 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.132227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.132227.log.gz 2023-10-09T13:17:33.465 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93179.log 2023-10-09T13:17:33.468 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95624.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95624.log.gz 2023-10-09T13:17:33.468 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103508.log 2023-10-09T13:17:33.468 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93179.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93179.log.gz 2023-10-09T13:17:33.468 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91709.log 2023-10-09T13:17:33.468 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103508.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103508.log.gz 2023-10-09T13:17:33.468 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108031.log 2023-10-09T13:17:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114340.log 2023-10-09T13:17:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-09T13:17:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.114340.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114340.log.gz 2023-10-09T13:17:33.469 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113595.log 2023-10-09T13:17:33.471 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-09T13:17:33.471 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.113595.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113595.log.gz 2023-10-09T13:17:33.472 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91709.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91709.log.gz 2023-10-09T13:17:33.472 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140651.log 2023-10-09T13:17:33.472 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108031.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108031.log.gz 2023-10-09T13:17:33.472 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131573.log 2023-10-09T13:17:33.472 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140651.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140651.log.gz 2023-10-09T13:17:33.473 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111168.log 2023-10-09T13:17:33.473 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131573.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131573.log.gz 2023-10-09T13:17:33.473 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126646.log 2023-10-09T13:17:33.473 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114514.log 2023-10-09T13:17:33.474 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111168.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111168.log.gz 2023-10-09T13:17:33.474 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117405.log 2023-10-09T13:17:33.474 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.126646.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126646.log.gz 2023-10-09T13:17:33.474 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91135.log 2023-10-09T13:17:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117405.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117405.log.gz 2023-10-09T13:17:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94695.log 2023-10-09T13:17:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91135.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91135.log.gz 2023-10-09T13:17:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141127.log 2023-10-09T13:17:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94695.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94695.log.gz 2023-10-09T13:17:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144432.log 2023-10-09T13:17:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141127.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141127.log.gz 2023-10-09T13:17:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120614.log 2023-10-09T13:17:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144432.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144432.log.gz 2023-10-09T13:17:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119151.log 2023-10-09T13:17:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120614.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120614.log.gz 2023-10-09T13:17:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115575.log 2023-10-09T13:17:33.481 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119151.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119151.log.gz 2023-10-09T13:17:33.481 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91453.log 2023-10-09T13:17:33.482 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115575.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115575.log.gz 2023-10-09T13:17:33.482 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130064.log 2023-10-09T13:17:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91453.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91453.log.gz 2023-10-09T13:17:33.483 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118833.log 2023-10-09T13:17:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130064.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130064.log.gz 2023-10-09T13:17:33.484 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131233.log 2023-10-09T13:17:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118833.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118833.log.gz 2023-10-09T13:17:33.485 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128058.log 2023-10-09T13:17:33.486 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131233.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.131233.log.gz 2023-10-09T13:17:33.486 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114558.log 2023-10-09T13:17:33.487 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128058.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.128058.log.gz 2023-10-09T13:17:33.487 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102088.log 2023-10-09T13:17:33.487 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.122157.log 2023-10-09T13:17:33.488 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99874.log 2023-10-09T13:17:33.488 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114558.log.gz 2023-10-09T13:17:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.102088.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102088.log.gz 2023-10-09T13:17:33.489 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100074.log 2023-10-09T13:17:33.490 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99874.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99874.log.gz 2023-10-09T13:17:33.490 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108665.log 2023-10-09T13:17:33.491 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100074.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100074.log.gz 2023-10-09T13:17:33.491 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96905.log 2023-10-09T13:17:33.492 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108665.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108665.log.gz 2023-10-09T13:17:33.492 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92423.log 2023-10-09T13:17:33.493 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96905.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96905.log.gz 2023-10-09T13:17:33.493 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136021.log 2023-10-09T13:17:33.494 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92423.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92423.log.gz 2023-10-09T13:17:33.494 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98920.log 2023-10-09T13:17:33.495 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136021.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.136021.log.gz 2023-10-09T13:17:33.495 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131107.log 2023-10-09T13:17:33.496 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98920.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98920.log.gz 2023-10-09T13:17:33.496 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98533.log 2023-10-09T13:17:33.497 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131107.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131107.log.gz 2023-10-09T13:17:33.497 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135615.log 2023-10-09T13:17:33.498 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98533.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98533.log.gz 2023-10-09T13:17:33.498 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113845.log 2023-10-09T13:17:33.499 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98136.log 2023-10-09T13:17:33.499 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135615.log.gz 2023-10-09T13:17:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113845.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113845.log.gz 2023-10-09T13:17:33.500 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96624.log 2023-10-09T13:17:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98136.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98136.log.gz 2023-10-09T13:17:33.501 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114076.log 2023-10-09T13:17:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.114514.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114514.log.gz 2023-10-09T13:17:33.503 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96624.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96624.log.gz 2023-10-09T13:17:33.503 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135308.log 2023-10-09T13:17:33.503 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114076.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114076.log.gz 2023-10-09T13:17:33.503 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140693.log 2023-10-09T13:17:33.504 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-09T13:17:33.504 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.3.122157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.122157.log.gz 2023-10-09T13:17:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135308.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135308.log.gz 2023-10-09T13:17:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115363.log 2023-10-09T13:17:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140693.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140693.log.gz 2023-10-09T13:17:33.505 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122574.log 2023-10-09T13:17:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115363.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115363.log.gz 2023-10-09T13:17:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126862.log 2023-10-09T13:17:33.506 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.122574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122574.log.gz 2023-10-09T13:17:33.507 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92764.log 2023-10-09T13:17:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.126862.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126862.log.gz 2023-10-09T13:17:33.508 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103368.log 2023-10-09T13:17:33.509 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92764.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92764.log.gz 2023-10-09T13:17:33.509 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115617.log 2023-10-09T13:17:33.510 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103368.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103368.log.gz 2023-10-09T13:17:33.510 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139252.log 2023-10-09T13:17:33.511 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115617.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115617.log.gz 2023-10-09T13:17:33.511 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122779.log 2023-10-09T13:17:33.512 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139252.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139252.log.gz 2023-10-09T13:17:33.512 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128016.log 2023-10-09T13:17:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114112.log 2023-10-09T13:17:33.513 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85488.log 2023-10-09T13:17:33.513 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122779.log.gz 2023-10-09T13:17:33.514 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128016.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128016.log.gz 2023-10-09T13:17:33.514 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103759.log 2023-10-09T13:17:33.515 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.85488.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85488.log.gz 2023-10-09T13:17:33.515 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-09T13:17:33.516 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103759.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103759.log.gz 2023-10-09T13:17:33.516 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96821.log 2023-10-09T13:17:33.516 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128416.log 2023-10-09T13:17:33.517 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96821.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96821.log.gz 2023-10-09T13:17:33.518 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139558.log 2023-10-09T13:17:33.518 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128416.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.113497.log 2023-10-09T13:17:33.518 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128416.log.gz 2023-10-09T13:17:33.519 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139558.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139558.log.gz 2023-10-09T13:17:33.519 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98254.log 2023-10-09T13:17:33.520 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113497.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.113497.log.gz-5 2023-10-09T13:17:33.520 INFO:teuthology.orchestra.run.smithi086.stderr:--verbose -- /var/log/ceph/ceph-client.admin.121281.log 2023-10-09T13:17:33.521 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98254.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98254.log.gz 2023-10-09T13:17:33.521 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129297.log 2023-10-09T13:17:33.522 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121281.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.121281.log.gz-5 2023-10-09T13:17:33.522 INFO:teuthology.orchestra.run.smithi086.stderr:--verbose -- /var/log/ceph/ceph-client.admin.96044.log 2023-10-09T13:17:33.523 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129297.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129297.log.gz 2023-10-09T13:17:33.523 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134472.log 2023-10-09T13:17:33.524 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96044.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96044.log.gz 2023-10-09T13:17:33.525 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98018.log 2023-10-09T13:17:33.525 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134472.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134472.log.gz 2023-10-09T13:17:33.525 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107940.log 2023-10-09T13:17:33.526 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98018.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98018.log.gz 2023-10-09T13:17:33.526 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105589.log 2023-10-09T13:17:33.527 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.107940.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107940.log.gz 2023-10-09T13:17:33.527 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135266.log 2023-10-09T13:17:33.528 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.105589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105589.log.gz 2023-10-09T13:17:33.528 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113255.log 2023-10-09T13:17:33.529 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135266.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135266.log.gz 2023-10-09T13:17:33.529 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111027.log 2023-10-09T13:17:33.530 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.113255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113255.log.gz 2023-10-09T13:17:33.530 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97201.log 2023-10-09T13:17:33.531 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111027.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111027.log.gz 2023-10-09T13:17:33.531 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92087.log 2023-10-09T13:17:33.532 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97201.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97201.log.gz 2023-10-09T13:17:33.532 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118445.log 2023-10-09T13:17:33.533 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92087.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92087.log.gz 2023-10-09T13:17:33.533 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143760.log 2023-10-09T13:17:33.534 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118445.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118445.log.gz 2023-10-09T13:17:33.534 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118579.log 2023-10-09T13:17:33.535 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143760.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143760.log.gz 2023-10-09T13:17:33.535 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108707.log 2023-10-09T13:17:33.536 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118579.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118579.log.gz 2023-10-09T13:17:33.536 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135224.log 2023-10-09T13:17:33.537 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.114112.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114112.log.gz 2023-10-09T13:17:33.538 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108707.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108707.log.gz 2023-10-09T13:17:33.538 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140303.log 2023-10-09T13:17:33.538 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135224.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135224.log.gz 2023-10-09T13:17:33.538 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108422.log 2023-10-09T13:17:33.539 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140303.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140303.log.gz 2023-10-09T13:17:33.539 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91919.log 2023-10-09T13:17:33.540 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108422.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108422.log.gz 2023-10-09T13:17:33.541 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103461.log 2023-10-09T13:17:33.541 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91919.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91919.log.gz 2023-10-09T13:17:33.541 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98431.log 2023-10-09T13:17:33.543 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103461.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103461.log.gz 2023-10-09T13:17:33.543 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115208.log 2023-10-09T13:17:33.544 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98431.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98431.log.gz 2023-10-09T13:17:33.544 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135845.log 2023-10-09T13:17:33.544 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115208.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115208.log.gz 2023-10-09T13:17:33.545 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105288.log 2023-10-09T13:17:33.545 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135845.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135845.log.gz 2023-10-09T13:17:33.545 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114726.log 2023-10-09T13:17:33.546 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105288.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105288.log.gz 2023-10-09T13:17:33.546 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114166.log 2023-10-09T13:17:33.547 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114726.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114726.log.gz 2023-10-09T13:17:33.548 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139714.log 2023-10-09T13:17:33.548 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114166.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114166.log.gz 2023-10-09T13:17:33.549 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127091.log 2023-10-09T13:17:33.549 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139714.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139714.log.gz 2023-10-09T13:17:33.550 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109521.log 2023-10-09T13:17:33.551 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127091.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127091.log.gz 2023-10-09T13:17:33.551 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121843.log 2023-10-09T13:17:33.552 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140957.log 2023-10-09T13:17:33.552 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109521.log.gz 2023-10-09T13:17:33.553 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93599.log 2023-10-09T13:17:33.553 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121843.log.gz 2023-10-09T13:17:33.553 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140957.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140957.log.gz 2023-10-09T13:17:33.553 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130298.log 2023-10-09T13:17:33.555 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116819.log 2023-10-09T13:17:33.555 INFO:teuthology.orchestra.run.smithi086.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.93599.log.gz 2023-10-09T13:17:33.556 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130298.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130298.log.gz 2023-10-09T13:17:33.556 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93137.log 2023-10-09T13:17:33.557 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116819.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116819.log.gz 2023-10-09T13:17:33.557 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98619.log 2023-10-09T13:17:33.558 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93137.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93137.log.gz 2023-10-09T13:17:33.558 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115252.log 2023-10-09T13:17:33.559 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98619.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98619.log.gz 2023-10-09T13:17:33.559 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116346.log 2023-10-09T13:17:33.560 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104459.log 2023-10-09T13:17:33.560 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115252.log.gz 2023-10-09T13:17:33.561 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116346.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116346.log.gz 2023-10-09T13:17:33.561 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118623.log 2023-10-09T13:17:33.562 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104459.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104459.log.gz 2023-10-09T13:17:33.562 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98877.log 2023-10-09T13:17:33.562 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118623.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118623.log.gz 2023-10-09T13:17:33.563 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104629.log 2023-10-09T13:17:33.563 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98877.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.98877.log.gz-- 2023-10-09T13:17:33.564 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95242.log 2023-10-09T13:17:33.564 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104629.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104629.log.gz 2023-10-09T13:17:33.565 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98791.log 2023-10-09T13:17:33.566 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95242.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95242.log.gz 2023-10-09T13:17:33.566 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141337.log 2023-10-09T13:17:33.566 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98791.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98791.log.gz 2023-10-09T13:17:33.567 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117262.log 2023-10-09T13:17:33.567 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141337.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.141337.log.gz 2023-10-09T13:17:33.568 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111219.log 2023-10-09T13:17:33.569 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117262.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117262.log.gz 2023-10-09T13:17:33.569 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141041.log 2023-10-09T13:17:33.570 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131447.log 2023-10-09T13:17:33.570 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111219.log.gz 2023-10-09T13:17:33.570 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141041.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141041.log.gz 2023-10-09T13:17:33.570 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104935.log 2023-10-09T13:17:33.571 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131447.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131447.log.gz 2023-10-09T13:17:33.572 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114768.log 2023-10-09T13:17:33.572 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104935.log.gz 2023-10-09T13:17:33.573 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100190.log 2023-10-09T13:17:33.573 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114768.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114768.log.gz 2023-10-09T13:17:33.574 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132269.log 2023-10-09T13:17:33.574 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100190.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100190.log.gz 2023-10-09T13:17:33.575 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112209.log 2023-10-09T13:17:33.575 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.132269.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132269.log.gz 2023-10-09T13:17:33.576 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108359.log 2023-10-09T13:17:33.576 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112209.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112209.log.gz 2023-10-09T13:17:33.577 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94780.log 2023-10-09T13:17:33.577 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108359.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108359.log.gz 2023-10-09T13:17:33.578 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139949.log 2023-10-09T13:17:33.578 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94780.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94780.log.gz 2023-10-09T13:17:33.578 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98372.log 2023-10-09T13:17:33.579 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139949.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139949.log.gz 2023-10-09T13:17:33.580 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121587.log 2023-10-09T13:17:33.581 INFO:teuthology.orchestra.run.smithi135.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-09T13:17:33.581 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98372.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98372.log.gz 2023-10-09T13:17:33.581 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114950.log 2023-10-09T13:17:33.582 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121587.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.121587.log.gz-5 2023-10-09T13:17:33.582 INFO:teuthology.orchestra.run.smithi086.stderr:--verbose -- /var/log/ceph/ceph-client.admin.121197.log 2023-10-09T13:17:33.582 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114950.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114950.log.gz 2023-10-09T13:17:33.582 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109689.log 2023-10-09T13:17:33.583 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121197.log.gz 2023-10-09T13:17:33.584 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102855.log 2023-10-09T13:17:33.584 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109689.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109689.log.gz 2023-10-09T13:17:33.585 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139513.log 2023-10-09T13:17:33.585 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.102855.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.102855.log.gz 2023-10-09T13:17:33.586 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117714.log 2023-10-09T13:17:33.586 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139513.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139513.log.gz 2023-10-09T13:17:33.586 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121155.log 2023-10-09T13:17:33.588 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117714.log.gz 2023-10-09T13:17:33.588 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140387.log 2023-10-09T13:17:33.589 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121155.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121155.log.gz 2023-10-09T13:17:33.589 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115124.log 2023-10-09T13:17:33.589 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140387.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140387.log.gz 2023-10-09T13:17:33.589 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95074.log 2023-10-09T13:17:33.590 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115124.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115124.log.gz 2023-10-09T13:17:33.590 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140999.log 2023-10-09T13:17:33.591 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95074.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95074.log.gz 2023-10-09T13:17:33.591 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98313.log 2023-10-09T13:17:33.592 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140999.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140999.log.gz 2023-10-09T13:17:33.592 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134380.log 2023-10-09T13:17:33.593 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98313.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98313.log.gz 2023-10-09T13:17:33.593 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104153.log 2023-10-09T13:17:33.594 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134380.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.134380.log.gz 2023-10-09T13:17:33.594 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142974.log 2023-10-09T13:17:33.595 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104153.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104153.log.gz 2023-10-09T13:17:33.595 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141085.log 2023-10-09T13:17:33.596 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142974.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142974.log.gz 2023-10-09T13:17:33.597 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116212.log 2023-10-09T13:17:33.597 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141085.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141085.log.gz 2023-10-09T13:17:33.598 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99748.log 2023-10-09T13:17:33.598 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.116212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116212.log.gz 2023-10-09T13:17:33.598 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95368.log 2023-10-09T13:17:33.599 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99748.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.99748.log.gz 2023-10-09T13:17:33.600 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109097.log 2023-10-09T13:17:33.600 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95368.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95368.log.gz 2023-10-09T13:17:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110765.log 2023-10-09T13:17:33.601 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109097.log: gzip 88.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.109097.log.gz--verbose 2023-10-09T13:17:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:-- /var/log/ceph/ceph-client.admin.120569.log 2023-10-09T13:17:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110765.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110765.log.gz 2023-10-09T13:17:33.602 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121365.log 2023-10-09T13:17:33.603 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120569.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120569.log.gz 2023-10-09T13:17:33.604 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121323.log 2023-10-09T13:17:33.604 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121365.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121365.log.gz 2023-10-09T13:17:33.605 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131657.log 2023-10-09T13:17:33.605 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121323.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121323.log.gz 2023-10-09T13:17:33.606 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103606.log 2023-10-09T13:17:33.606 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131657.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131657.log.gz 2023-10-09T13:17:33.607 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141505.log 2023-10-09T13:17:33.607 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103606.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103606.log.gz 2023-10-09T13:17:33.607 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141547.log 2023-10-09T13:17:33.608 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141505.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141505.log.gz 2023-10-09T13:17:33.609 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114311.log 2023-10-09T13:17:33.609 INFO:teuthology.orchestra.run.smithi135.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-09T13:17:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93733.log 2023-10-09T13:17:33.610 INFO:teuthology.orchestra.run.smithi086.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.141547.log.gz 2023-10-09T13:17:33.610 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114311.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114311.log.gz 2023-10-09T13:17:33.611 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121713.log 2023-10-09T13:17:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93733.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93733.log.gz 2023-10-09T13:17:33.612 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108833.log 2023-10-09T13:17:33.613 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121713.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121713.log.gz 2023-10-09T13:17:33.613 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136827.log 2023-10-09T13:17:33.614 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108833.log: gzip -5 --verbose 88.4%-- /var/log/ceph/ceph-client.admin.141463.log -- replaced with /var/log/ceph/ceph-client.admin.108833.log.gz 2023-10-09T13:17:33.614 INFO:teuthology.orchestra.run.smithi086.stderr: 2023-10-09T13:17:33.615 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136827.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136827.log.gz 2023-10-09T13:17:33.615 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100132.log 2023-10-09T13:17:33.616 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141463.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141463.log.gz 2023-10-09T13:17:33.616 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129925.log 2023-10-09T13:17:33.616 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100132.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100132.log.gz 2023-10-09T13:17:33.617 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125649.log 2023-10-09T13:17:33.617 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112251.log 2023-10-09T13:17:33.618 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129925.log.gz 2023-10-09T13:17:33.618 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.125649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114221.log 2023-10-09T13:17:33.619 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125649.log.gz 2023-10-09T13:17:33.619 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112251.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112251.log.gz 2023-10-09T13:17:33.619 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142645.log 2023-10-09T13:17:33.620 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114221.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114221.log.gz 2023-10-09T13:17:33.620 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111693.log 2023-10-09T13:17:33.621 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142645.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142645.log.gz 2023-10-09T13:17:33.622 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118272.log 2023-10-09T13:17:33.622 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111693.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111693.log.gz 2023-10-09T13:17:33.622 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103551.log 2023-10-09T13:17:33.623 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118272.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118272.log.gz 2023-10-09T13:17:33.623 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105632.log 2023-10-09T13:17:33.624 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103551.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103551.log.gz 2023-10-09T13:17:33.625 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131405.log 2023-10-09T13:17:33.625 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105632.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105632.log.gz 2023-10-09T13:17:33.625 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93095.log 2023-10-09T13:17:33.626 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131405.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131405.log.gz 2023-10-09T13:17:33.626 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121799.log 2023-10-09T13:17:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93095.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93095.log.gz 2023-10-09T13:17:33.627 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136483.log 2023-10-09T13:17:33.628 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121799.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121799.log.gz 2023-10-09T13:17:33.628 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92213.log 2023-10-09T13:17:33.629 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111265.log 2023-10-09T13:17:33.630 INFO:teuthology.orchestra.run.smithi086.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.136483.log.gz 2023-10-09T13:17:33.630 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92213.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92213.log.gz 2023-10-09T13:17:33.631 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100364.log 2023-10-09T13:17:33.632 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111265.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111265.log.gz 2023-10-09T13:17:33.632 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134892.log 2023-10-09T13:17:33.633 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100364.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100364.log.gz 2023-10-09T13:17:33.633 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122621.log 2023-10-09T13:17:33.634 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134892.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.134892.log.gz 2023-10-09T13:17:33.634 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121054.log 2023-10-09T13:17:33.635 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122621.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122621.log.gzgzip 2023-10-09T13:17:33.635 INFO:teuthology.orchestra.run.smithi086.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.135937.log 2023-10-09T13:17:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121054.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121054.log.gz 2023-10-09T13:17:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128500.log 2023-10-09T13:17:33.636 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135937.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135937.log.gz 2023-10-09T13:17:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117924.log 2023-10-09T13:17:33.637 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128500.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128500.log.gz 2023-10-09T13:17:33.638 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128794.log 2023-10-09T13:17:33.638 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117924.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117924.log.gz 2023-10-09T13:17:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92255.log 2023-10-09T13:17:33.639 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128794.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128794.log.gz 2023-10-09T13:17:33.640 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108623.log 2023-10-09T13:17:33.640 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92255.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92255.log.gz 2023-10-09T13:17:33.640 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T13:17:33.641 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108623.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108623.log.gz 2023-10-09T13:17:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128542.log 2023-10-09T13:17:33.642 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121239.log 2023-10-09T13:17:33.644 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128542.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128542.log.gz 2023-10-09T13:17:33.644 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91667.log 2023-10-09T13:17:33.645 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121239.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121239.log.gz 2023-10-09T13:17:33.645 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111567.log 2023-10-09T13:17:33.646 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91667.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91667.log.gz 2023-10-09T13:17:33.646 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132034.log 2023-10-09T13:17:33.647 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111567.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111567.log.gz 2023-10-09T13:17:33.647 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96086.log 2023-10-09T13:17:33.648 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.132034.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132034.log.gz 2023-10-09T13:17:33.648 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96540.log 2023-10-09T13:17:33.648 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T13:17:33.649 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96086.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96086.log.gz 2023-10-09T13:17:33.650 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109857.log 2023-10-09T13:17:33.651 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96540.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96540.log.gz 2023-10-09T13:17:33.651 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143479.log 2023-10-09T13:17:33.652 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109857.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109857.log.gz 2023-10-09T13:17:33.652 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141421.log 2023-10-09T13:17:33.653 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143479.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143479.log.gz 2023-10-09T13:17:33.653 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142829.log 2023-10-09T13:17:33.654 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141421.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141421.log.gz 2023-10-09T13:17:33.654 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128288.log 2023-10-09T13:17:33.655 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142829.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142829.log.gz 2023-10-09T13:17:33.655 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123126.log 2023-10-09T13:17:33.656 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128288.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128288.log.gz 2023-10-09T13:17:33.656 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117966.log 2023-10-09T13:17:33.657 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.123126.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123126.log.gz 2023-10-09T13:17:33.657 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97243.log 2023-10-09T13:17:33.658 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117966.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117966.log.gz 2023-10-09T13:17:33.658 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108791.log 2023-10-09T13:17:33.659 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118875.log 2023-10-09T13:17:33.659 INFO:teuthology.orchestra.run.smithi086.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.97243.log.gz 2023-10-09T13:17:33.660 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108791.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108791.log.gz 2023-10-09T13:17:33.660 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109265.log 2023-10-09T13:17:33.661 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118875.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118875.log.gz 2023-10-09T13:17:33.661 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118791.log 2023-10-09T13:17:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109265.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109265.log.gz 2023-10-09T13:17:33.662 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105787.log 2023-10-09T13:17:33.663 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118791.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118791.log.gz 2023-10-09T13:17:33.663 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127710.log 2023-10-09T13:17:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105787.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105787.log.gz 2023-10-09T13:17:33.664 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142400.log 2023-10-09T13:17:33.665 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127710.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127710.log.gz 2023-10-09T13:17:33.665 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91835.log 2023-10-09T13:17:33.666 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142400.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142400.log.gz 2023-10-09T13:17:33.666 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144659.log 2023-10-09T13:17:33.667 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91835.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91835.log.gz 2023-10-09T13:17:33.667 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109815.log 2023-10-09T13:17:33.668 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144659.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144659.log.gz 2023-10-09T13:17:33.668 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95410.log 2023-10-09T13:17:33.669 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109815.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109815.log.gz 2023-10-09T13:17:33.669 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127500.log 2023-10-09T13:17:33.670 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95410.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95410.log.gz 2023-10-09T13:17:33.670 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115659.log 2023-10-09T13:17:33.671 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127500.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127500.log.gz 2023-10-09T13:17:33.671 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105246.log 2023-10-09T13:17:33.672 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115659.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115659.log.gz 2023-10-09T13:17:33.672 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141379.log 2023-10-09T13:17:33.673 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105246.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105246.log.gz 2023-10-09T13:17:33.673 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103230.log 2023-10-09T13:17:33.674 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141379.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141379.log.gz 2023-10-09T13:17:33.674 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136878.log 2023-10-09T13:17:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103230.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103230.log.gz 2023-10-09T13:17:33.675 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136742.log 2023-10-09T13:17:33.676 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136878.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136878.log.gz 2023-10-09T13:17:33.676 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103277.log 2023-10-09T13:17:33.677 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.136742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.136742.log.gz 2023-10-09T13:17:33.677 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95540.log 2023-10-09T13:17:33.678 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103277.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103277.log.gz 2023-10-09T13:17:33.682 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107893.log 2023-10-09T13:17:33.682 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95540.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95540.log.gz 2023-10-09T13:17:33.682 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118028.log 2023-10-09T13:17:33.682 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.107893.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107893.log.gz 2023-10-09T13:17:33.682 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136399.log 2023-10-09T13:17:33.682 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118028.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118028.log.gz 2023-10-09T13:17:33.682 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143928.log 2023-10-09T13:17:33.683 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136399.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136399.log.gz 2023-10-09T13:17:33.683 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136273.log 2023-10-09T13:17:33.684 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117031.log 2023-10-09T13:17:33.684 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143928.log.gz 2023-10-09T13:17:33.685 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136273.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136273.log.gz 2023-10-09T13:17:33.685 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143676.log 2023-10-09T13:17:33.686 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111355.log 2023-10-09T13:17:33.686 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117031.log.gz 2023-10-09T13:17:33.687 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143676.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.143676.log.gz-5 2023-10-09T13:17:33.687 INFO:teuthology.orchestra.run.smithi086.stderr:--verbose -- /var/log/ceph/ceph-client.admin.143437.log 2023-10-09T13:17:33.688 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111355.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111355.log.gz 2023-10-09T13:17:33.688 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129878.log 2023-10-09T13:17:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143437.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143437.log.gz 2023-10-09T13:17:33.689 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108124.log 2023-10-09T13:17:33.690 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129878.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129878.log.gz 2023-10-09T13:17:33.690 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131149.log 2023-10-09T13:17:33.691 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108124.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108124.log.gz 2023-10-09T13:17:33.691 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122315.log 2023-10-09T13:17:33.692 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131149.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131149.log.gz 2023-10-09T13:17:33.692 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109899.log 2023-10-09T13:17:33.693 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93347.log 2023-10-09T13:17:33.693 INFO:teuthology.orchestra.run.smithi086.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.122315.log.gz 2023-10-09T13:17:33.694 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109899.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109899.log.gz 2023-10-09T13:17:33.694 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123083.log 2023-10-09T13:17:33.695 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93347.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93347.log.gz 2023-10-09T13:17:33.695 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118188.log 2023-10-09T13:17:33.696 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.123083.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123083.log.gz 2023-10-09T13:17:33.696 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111401.log 2023-10-09T13:17:33.697 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118188.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118188.log.gz 2023-10-09T13:17:33.697 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103651.log 2023-10-09T13:17:33.698 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111401.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.111401.log.gz 2023-10-09T13:17:33.698 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105162.log 2023-10-09T13:17:33.699 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103651.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103651.log.gz 2023-10-09T13:17:33.699 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92425.log 2023-10-09T13:17:33.700 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105162.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105162.log.gz 2023-10-09T13:17:33.700 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131884.log 2023-10-09T13:17:33.701 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92425.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92425.log.gz 2023-10-09T13:17:33.701 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110981.log 2023-10-09T13:17:33.702 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131884.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.131884.log.gz 2023-10-09T13:17:33.702 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108937.log 2023-10-09T13:17:33.703 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110981.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110981.log.gz 2023-10-09T13:17:33.703 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128836.log 2023-10-09T13:17:33.704 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108937.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108937.log.gz 2023-10-09T13:17:33.704 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94906.log 2023-10-09T13:17:33.705 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128836.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128836.log.gz 2023-10-09T13:17:33.705 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132502.log 2023-10-09T13:17:33.706 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94906.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94906.log.gz 2023-10-09T13:17:33.706 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135350.log 2023-10-09T13:17:33.707 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.132502.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132502.log.gz 2023-10-09T13:17:33.707 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144096.log 2023-10-09T13:17:33.708 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135350.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135350.log.gz 2023-10-09T13:17:33.708 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79500.log 2023-10-09T13:17:33.709 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144096.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144096.log.gz 2023-10-09T13:17:33.709 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115449.log 2023-10-09T13:17:33.710 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.tmp-client.admin.79500.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79500.log.gz 2023-10-09T13:17:33.710 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91625.log 2023-10-09T13:17:33.711 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115449.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115449.log.gz 2023-10-09T13:17:33.711 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116296.log 2023-10-09T13:17:33.712 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91625.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91625.log.gz 2023-10-09T13:17:33.712 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93473.log 2023-10-09T13:17:33.713 INFO:teuthology.orchestra.run.smithi135.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-09T13:17:33.714 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116296.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116296.log.gz 2023-10-09T13:17:33.714 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127048.log 2023-10-09T13:17:33.714 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93473.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93473.log.gz 2023-10-09T13:17:33.714 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96456.log 2023-10-09T13:17:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127048.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127048.log.gz 2023-10-09T13:17:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109731.log 2023-10-09T13:17:33.716 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96456.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96456.log.gz 2023-10-09T13:17:33.716 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136441.log 2023-10-09T13:17:33.717 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109731.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109731.log.gz 2023-10-09T13:17:33.717 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103901.log 2023-10-09T13:17:33.718 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136441.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136441.log.gz 2023-10-09T13:17:33.718 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92430.log 2023-10-09T13:17:33.719 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103901.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103901.log.gz 2023-10-09T13:17:33.719 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113892.log 2023-10-09T13:17:33.720 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92430.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92430.log.gz 2023-10-09T13:17:33.720 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96666.log 2023-10-09T13:17:33.721 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113892.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113892.log.gz 2023-10-09T13:17:33.721 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111310.log 2023-10-09T13:17:33.722 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96666.log: gzip 89.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.96666.log.gz-- 2023-10-09T13:17:33.723 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112685.log 2023-10-09T13:17:33.723 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111310.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.111310.log.gz 2023-10-09T13:17:33.723 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135056.log 2023-10-09T13:17:33.724 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112685.log: 89.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.112685.log.gz--verbose 2023-10-09T13:17:33.724 INFO:teuthology.orchestra.run.smithi086.stderr:-- /var/log/ceph/ceph-client.admin.140777.log 2023-10-09T13:17:33.725 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135056.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135056.log.gz 2023-10-09T13:17:33.725 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104893.log 2023-10-09T13:17:33.727 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140777.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140777.log.gz 2023-10-09T13:17:33.727 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95200.log 2023-10-09T13:17:33.727 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104893.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104893.log.gz 2023-10-09T13:17:33.727 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131531.log 2023-10-09T13:17:33.728 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95200.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95200.log.gz 2023-10-09T13:17:33.728 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134801.log 2023-10-09T13:17:33.729 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131531.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131531.log.gz 2023-10-09T13:17:33.729 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112167.log 2023-10-09T13:17:33.730 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134801.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134801.log.gz 2023-10-09T13:17:33.730 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144617.log 2023-10-09T13:17:33.731 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112167.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.112167.log.gz 2023-10-09T13:17:33.731 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130016.log 2023-10-09T13:17:33.732 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144617.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144617.log.gz 2023-10-09T13:17:33.732 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127668.log 2023-10-09T13:17:33.733 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130016.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130016.log.gz 2023-10-09T13:17:33.733 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143353.log 2023-10-09T13:17:33.734 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127668.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127668.log.gz 2023-10-09T13:17:33.734 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126817.log 2023-10-09T13:17:33.735 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143353.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143353.log.gz 2023-10-09T13:17:33.735 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91793.log 2023-10-09T13:17:33.736 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.126817.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126817.log.gz 2023-10-09T13:17:33.736 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135673.log 2023-10-09T13:17:33.737 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91793.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91793.log.gz 2023-10-09T13:17:33.737 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85898.log 2023-10-09T13:17:33.738 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135673.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135673.log.gz 2023-10-09T13:17:33.738 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130675.log 2023-10-09T13:17:33.739 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.85898.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85898.log.gz 2023-10-09T13:17:33.739 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115911.log 2023-10-09T13:17:33.740 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130675.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130675.log.gz 2023-10-09T13:17:33.740 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98705.log 2023-10-09T13:17:33.741 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115911.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115911.log.gz 2023-10-09T13:17:33.741 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118230.log 2023-10-09T13:17:33.742 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98705.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98705.log.gz 2023-10-09T13:17:33.742 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101080.log 2023-10-09T13:17:33.743 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118230.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118230.log.gz 2023-10-09T13:17:33.743 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129970.log 2023-10-09T13:17:33.744 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.101080.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101080.log.gz 2023-10-09T13:17:33.744 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115305.log 2023-10-09T13:17:33.745 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129970.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129970.log.gz 2023-10-09T13:17:33.745 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140907.log 2023-10-09T13:17:33.746 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115305.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115305.log.gz 2023-10-09T13:17:33.746 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118356.log 2023-10-09T13:17:33.747 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140907.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140907.log.gz 2023-10-09T13:17:33.747 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T13:17:33.748 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118356.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118356.log.gz 2023-10-09T13:17:33.748 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93389.log 2023-10-09T13:17:33.749 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92045.log 2023-10-09T13:17:33.750 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93389.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93389.log.gz 2023-10-09T13:17:33.750 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127584.log 2023-10-09T13:17:33.752 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92045.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92045.log.gz 2023-10-09T13:17:33.752 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92765.log 2023-10-09T13:17:33.753 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127584.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127584.log.gz 2023-10-09T13:17:33.753 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99958.log 2023-10-09T13:17:33.753 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T13:17:33.754 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92765.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92765.log.gz 2023-10-09T13:17:33.754 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131321.log 2023-10-09T13:17:33.755 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99958.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99958.log.gz 2023-10-09T13:17:33.755 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115491.log 2023-10-09T13:17:33.756 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109647.log 2023-10-09T13:17:33.756 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131321.log.gz 2023-10-09T13:17:33.757 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144264.log 88.3% 2023-10-09T13:17:33.757 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115491.log.gz 2023-10-09T13:17:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109647.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109647.log.gz 2023-10-09T13:17:33.758 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109437.log 2023-10-09T13:17:33.759 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104417.log 2023-10-09T13:17:33.759 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144264.log.gz 2023-10-09T13:17:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109437.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109437.log.gz 2023-10-09T13:17:33.760 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130156.log 2023-10-09T13:17:33.761 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140491.log 2023-10-09T13:17:33.761 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104417.log.gz 2023-10-09T13:17:33.762 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130156.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130156.log.gz 2023-10-09T13:17:33.762 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95582.log 2023-10-09T13:17:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140491.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140491.log.gz 2023-10-09T13:17:33.763 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112727.log 2023-10-09T13:17:33.764 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106074.log 2023-10-09T13:17:33.764 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95582.log.gz 2023-10-09T13:17:33.765 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109605.log 2023-10-09T13:17:33.765 INFO:teuthology.orchestra.run.smithi086.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112727.log.gz 2023-10-09T13:17:33.766 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.106074.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106074.log.gz 2023-10-09T13:17:33.766 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104585.log 2023-10-09T13:17:33.767 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109605.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109605.log.gz 2023-10-09T13:17:33.767 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144474.log 2023-10-09T13:17:33.768 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104585.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104585.log.gz 2023-10-09T13:17:33.768 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93557.log 2023-10-09T13:17:33.769 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144474.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144474.log.gz 2023-10-09T13:17:33.769 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113339.log 2023-10-09T13:17:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93557.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93557.log.gz 2023-10-09T13:17:33.770 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100306.log 2023-10-09T13:17:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113339.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113339.log.gz 2023-10-09T13:17:33.771 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99664.log 2023-10-09T13:17:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112083.log 2023-10-09T13:17:33.772 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100306.log.gz 2023-10-09T13:17:33.772 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99664.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99664.log.gz 2023-10-09T13:17:33.773 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141890.log 2023-10-09T13:17:33.773 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112083.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112083.log.gz 2023-10-09T13:17:33.774 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143018.log 2023-10-09T13:17:33.774 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141890.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141890.log.gz 2023-10-09T13:17:33.774 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97159.log 2023-10-09T13:17:33.775 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143018.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143018.log.gz 2023-10-09T13:17:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96330.log 2023-10-09T13:17:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97159.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97159.log.gz 2023-10-09T13:17:33.776 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96372.log 2023-10-09T13:17:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96330.log.gz 2023-10-09T13:17:33.777 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95284.log 2023-10-09T13:17:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96372.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96372.log.gz 2023-10-09T13:17:33.778 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95666.log 2023-10-09T13:17:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95284.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95284.log.gz 2023-10-09T13:17:33.779 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95032.log 2023-10-09T13:17:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95666.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95666.log.gz 2023-10-09T13:17:33.780 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103416.log 2023-10-09T13:17:33.781 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95032.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95032.log.gz 2023-10-09T13:17:33.781 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139903.log 2023-10-09T13:17:33.782 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103416.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103416.log.gz 2023-10-09T13:17:33.782 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103322.log 2023-10-09T13:17:33.783 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139903.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139903.log.gz 2023-10-09T13:17:33.783 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130717.log 2023-10-09T13:17:33.784 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103322.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103322.log.gz 2023-10-09T13:17:33.784 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95792.log 2023-10-09T13:17:33.785 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130717.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130717.log.gz 2023-10-09T13:17:33.785 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113452.log 2023-10-09T13:17:33.786 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95792.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95792.log.gz 2023-10-09T13:17:33.786 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128238.log 2023-10-09T13:17:33.787 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113452.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113452.log.gz 2023-10-09T13:17:33.787 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117122.log 2023-10-09T13:17:33.788 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128238.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128238.log.gz 2023-10-09T13:17:33.788 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98490.log 2023-10-09T13:17:33.789 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117122.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117122.log.gz 2023-10-09T13:17:33.789 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-09T13:17:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98490.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98490.log.gz 2023-10-09T13:17:33.790 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140219.log 2023-10-09T13:17:33.791 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104501.log 2023-10-09T13:17:33.792 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140219.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140219.log.gz 2023-10-09T13:17:33.793 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92171.log 2023-10-09T13:17:33.794 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104501.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104501.log.gz 2023-10-09T13:17:33.794 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128584.log 2023-10-09T13:17:33.794 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92171.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92171.log.gz 2023-10-09T13:17:33.795 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129697.log 2023-10-09T13:17:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128584.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.128584.log.gz 2023-10-09T13:17:33.796 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122841.log 2023-10-09T13:17:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129697.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.129697.log.gz 2023-10-09T13:17:33.797 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92766.log 2023-10-09T13:17:33.798 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112389.log 2023-10-09T13:17:33.799 INFO:teuthology.orchestra.run.smithi086.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.122841.log.gz 2023-10-09T13:17:33.799 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92766.log.gz 2023-10-09T13:17:33.799 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112601.log 2023-10-09T13:17:33.800 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112389.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112389.log.gz 2023-10-09T13:17:33.801 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95876.log 2023-10-09T13:17:33.801 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112601.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112601.log.gz 2023-10-09T13:17:33.802 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104723.log 2023-10-09T13:17:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95876.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95876.log.gz 2023-10-09T13:17:33.803 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91537.log 2023-10-09T13:17:33.804 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112125.log 2023-10-09T13:17:33.804 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104723.log.gz 2023-10-09T13:17:33.805 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105204.log 2023-10-09T13:17:33.805 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91537.log.gz 2023-10-09T13:17:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112125.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112125.log.gz 2023-10-09T13:17:33.806 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144180.log 2023-10-09T13:17:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105204.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105204.log.gz 2023-10-09T13:17:33.807 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127542.log 2023-10-09T13:17:33.808 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144180.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.144180.log.gz 2023-10-09T13:17:33.808 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136315.log 2023-10-09T13:17:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127542.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127542.log.gz 2023-10-09T13:17:33.810 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.94552.log 2023-10-09T13:17:33.811 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136315.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.136315.log.gz 2023-10-09T13:17:33.811 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103985.log 2023-10-09T13:17:33.811 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.2.94552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.94552.log.gz 2023-10-09T13:17:33.812 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142474.log 2023-10-09T13:17:33.813 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103985.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103985.log.gz 2023-10-09T13:17:33.813 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96582.log 2023-10-09T13:17:33.814 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142474.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.142474.log.gz-5 2023-10-09T13:17:33.814 INFO:teuthology.orchestra.run.smithi086.stderr:--verbose -- /var/log/ceph/ceph-client.admin.141253.log 2023-10-09T13:17:33.815 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96582.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96582.log.gz 2023-10-09T13:17:33.815 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144012.log 2023-10-09T13:17:33.816 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141253.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141253.log.gz 2023-10-09T13:17:33.816 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109139.log 2023-10-09T13:17:33.817 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144012.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144012.log.gz 2023-10-09T13:17:33.817 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112912.log 2023-10-09T13:17:33.819 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109139.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109139.log.gz 2023-10-09T13:17:33.819 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142736.log 2023-10-09T13:17:33.819 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112912.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112912.log.gz 2023-10-09T13:17:33.820 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112475.log 2023-10-09T13:17:33.821 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142736.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142736.log.gz 2023-10-09T13:17:33.821 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93431.log 2023-10-09T13:17:33.822 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112475.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112475.log.gz 2023-10-09T13:17:33.822 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97586.log 2023-10-09T13:17:33.823 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93431.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93431.log.gz 2023-10-09T13:17:33.823 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140261.log 2023-10-09T13:17:33.824 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97586.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97586.log.gz 2023-10-09T13:17:33.824 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129655.log 2023-10-09T13:17:33.825 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140261.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140261.log.gz 2023-10-09T13:17:33.825 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140863.log 2023-10-09T13:17:33.826 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129655.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129655.log.gz 2023-10-09T13:17:33.826 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96414.log 2023-10-09T13:17:33.827 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140863.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140863.log.gz 2023-10-09T13:17:33.828 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98576.log 2023-10-09T13:17:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96414.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96414.log.gz 2023-10-09T13:17:33.829 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144516.log 2023-10-09T13:17:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98576.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98576.log.gz 2023-10-09T13:17:33.830 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134611.log 2023-10-09T13:17:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144516.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144516.log.gz 2023-10-09T13:17:33.831 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135182.log 2023-10-09T13:17:33.832 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134611.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134611.log.gz 2023-10-09T13:17:33.832 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105731.log 2023-10-09T13:17:33.833 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135182.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135182.log.gz 2023-10-09T13:17:33.833 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127974.log 2023-10-09T13:17:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105731.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105731.log.gz 2023-10-09T13:17:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141848.log 2023-10-09T13:17:33.835 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127974.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127974.log.gz 2023-10-09T13:17:33.836 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121096.log 2023-10-09T13:17:33.837 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141848.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141848.log.gz 2023-10-09T13:17:33.837 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116019.log 2023-10-09T13:17:33.838 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121096.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121096.log.gz 2023-10-09T13:17:33.838 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104257.log 2023-10-09T13:17:33.839 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116019.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116019.log.gz 2023-10-09T13:17:33.839 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99706.log 2023-10-09T13:17:33.840 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104257.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104257.log.gz 2023-10-09T13:17:33.840 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98195.log 2023-10-09T13:17:33.841 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99706.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99706.log.gz 2023-10-09T13:17:33.841 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127892.log 2023-10-09T13:17:33.842 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98195.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98195.log.gz 2023-10-09T13:17:33.842 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121977.log 2023-10-09T13:17:33.844 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127892.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127892.log.gz 2023-10-09T13:17:33.844 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131968.log 2023-10-09T13:17:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121977.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121977.log.gz 2023-10-09T13:17:33.845 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135098.log 2023-10-09T13:17:33.846 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100538.log 2023-10-09T13:17:33.846 INFO:teuthology.orchestra.run.smithi086.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.131968.log.gz 2023-10-09T13:17:33.847 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135098.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135098.log.gz 2023-10-09T13:17:33.847 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100580.log 2023-10-09T13:17:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100538.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100538.log.gz 2023-10-09T13:17:33.849 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108171.log 2023-10-09T13:17:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100580.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100580.log.gz 2023-10-09T13:17:33.850 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125692.log 2023-10-09T13:17:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108171.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.108171.log.gz 2023-10-09T13:17:33.851 INFO:teuthology.orchestra.run.smithi086.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.105036.log 2023-10-09T13:17:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.125692.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125692.log.gz 2023-10-09T13:17:33.852 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102605.log 2023-10-09T13:17:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105036.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105036.log.gz 2023-10-09T13:17:33.853 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135801.log 2023-10-09T13:17:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.102605.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102605.log.gz 2023-10-09T13:17:33.854 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135140.log 2023-10-09T13:17:33.856 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135801.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135801.log.gz 2023-10-09T13:17:33.856 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144348.log 2023-10-09T13:17:33.857 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135140.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135140.log.gz 2023-10-09T13:17:33.857 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114265.log 2023-10-09T13:17:33.858 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144348.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144348.log.gz 2023-10-09T13:17:33.858 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122189.log 2023-10-09T13:17:33.859 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114265.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114265.log.gz 2023-10-09T13:17:33.859 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127190.log 2023-10-09T13:17:33.860 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122189.log: gzip -5 --verbose 88.3%-- -- replaced with /var/log/ceph/ceph-client.admin.122189.log.gz/var/log/ceph/ceph-client.admin.128458.log 2023-10-09T13:17:33.860 INFO:teuthology.orchestra.run.smithi086.stderr: 2023-10-09T13:17:33.861 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127190.log.gz 2023-10-09T13:17:33.861 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121755.log 2023-10-09T13:17:33.862 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128458.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128458.log.gz 2023-10-09T13:17:33.863 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94864.log 2023-10-09T13:17:33.863 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121755.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121755.log.gz 2023-10-09T13:17:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117798.log 2023-10-09T13:17:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94864.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94864.log.gz 2023-10-09T13:17:33.865 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110284.log 2023-10-09T13:17:33.866 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117798.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117798.log.gz 2023-10-09T13:17:33.866 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129412.log 2023-10-09T13:17:33.867 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140177.log 2023-10-09T13:17:33.867 INFO:teuthology.orchestra.run.smithi086.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110284.log.gz 2023-10-09T13:17:33.868 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129412.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129412.log.gz 2023-10-09T13:17:33.868 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96991.log 2023-10-09T13:17:33.869 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140177.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140177.log.gz 2023-10-09T13:17:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136189.log 2023-10-09T13:17:33.870 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96991.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96991.log.gz 2023-10-09T13:17:33.871 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115533.log 2023-10-09T13:17:33.872 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136189.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136189.log.gz 2023-10-09T13:17:33.872 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118665.log 2023-10-09T13:17:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115533.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115533.log.gz 2023-10-09T13:17:33.873 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97075.log 2023-10-09T13:17:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118665.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118665.log.gz 2023-10-09T13:17:33.874 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101330.log 2023-10-09T13:17:33.875 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97075.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97075.log.gz 2023-10-09T13:17:33.875 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92762.log 2023-10-09T13:17:33.876 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.101330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134703.log 2023-10-09T13:17:33.876 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101330.log.gz 2023-10-09T13:17:33.877 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92762.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92762.log.gz 2023-10-09T13:17:33.877 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115743.log 2023-10-09T13:17:33.878 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134703.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134703.log.gz 2023-10-09T13:17:33.878 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131926.log 2023-10-09T13:17:33.879 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115743.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115743.log.gz 2023-10-09T13:17:33.880 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96771.log 2023-10-09T13:17:33.881 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131926.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131926.log.gz 2023-10-09T13:17:33.881 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128194.log 2023-10-09T13:17:33.882 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96771.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96771.log.gz 2023-10-09T13:17:33.882 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108214.log 2023-10-09T13:17:33.886 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128194.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128194.log.gz 2023-10-09T13:17:33.886 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113388.log 2023-10-09T13:17:33.886 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108214.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108214.log.gz 2023-10-09T13:17:33.886 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134566.log 2023-10-09T13:17:33.886 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113388.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113388.log.gz 2023-10-09T13:17:33.886 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112433.log 2023-10-09T13:17:33.887 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134566.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134566.log.gz 2023-10-09T13:17:33.887 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130633.log 2023-10-09T13:17:33.888 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130199.log 2023-10-09T13:17:33.888 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112433.log.gz 2023-10-09T13:17:33.889 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130633.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130633.log.gz 2023-10-09T13:17:33.889 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96287.log 2023-10-09T13:17:33.890 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130199.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130199.log.gz 2023-10-09T13:17:33.890 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113721.log 2023-10-09T13:17:33.891 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96287.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96287.log.gz 2023-10-09T13:17:33.891 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95750.log 2023-10-09T13:17:33.892 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113721.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113721.log.gz 2023-10-09T13:17:33.892 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131489.log 2023-10-09T13:17:33.893 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95750.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95750.log.gz 2023-10-09T13:17:33.893 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105674.log 2023-10-09T13:17:33.894 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131489.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131489.log.gz 2023-10-09T13:17:33.895 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110509.log 2023-10-09T13:17:33.895 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105674.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105674.log.gz 2023-10-09T13:17:33.896 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116861.log 2023-10-09T13:17:33.897 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110509.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110509.log.gz 2023-10-09T13:17:33.897 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102355.log 2023-10-09T13:17:33.898 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116861.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116861.log.gz 2023-10-09T13:17:33.898 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114031.log 2023-10-09T13:17:33.899 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.102355.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102355.log.gz 2023-10-09T13:17:33.899 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91581.log 2023-10-09T13:17:33.900 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114031.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114031.log.gz 2023-10-09T13:17:33.900 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94190.log 2023-10-09T13:17:33.901 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91581.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91581.log.gz 2023-10-09T13:17:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127001.log 2023-10-09T13:17:33.902 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94190.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94190.log.gz 2023-10-09T13:17:33.903 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93053.log 2023-10-09T13:17:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127001.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127001.log.gz 2023-10-09T13:17:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134846.log 2023-10-09T13:17:33.904 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93053.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93053.log.gz 2023-10-09T13:17:33.905 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98077.log 2023-10-09T13:17:33.906 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134846.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134846.log.gz 2023-10-09T13:17:33.906 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114810.log 2023-10-09T13:17:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98077.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98077.log.gz 2023-10-09T13:17:33.907 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118106.log 2023-10-09T13:17:33.908 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114810.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114810.log.gz 2023-10-09T13:17:33.908 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105330.log 2023-10-09T13:17:33.909 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118106.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118106.log.gz 2023-10-09T13:17:33.910 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105120.log 2023-10-09T13:17:33.911 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136105.log 2023-10-09T13:17:33.911 INFO:teuthology.orchestra.run.smithi086.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.105330.log.gz 2023-10-09T13:17:33.912 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105120.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105120.log.gz 2023-10-09T13:17:33.912 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112954.log 2023-10-09T13:17:33.914 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136105.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.136105.log.gz 2023-10-09T13:17:33.914 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142358.log 2023-10-09T13:17:33.914 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112954.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112954.log.gz 2023-10-09T13:17:33.915 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111075.log 2023-10-09T13:17:33.916 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142358.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142358.log.gz 2023-10-09T13:17:33.916 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130905.log 2023-10-09T13:17:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111075.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111075.log.gz 2023-10-09T13:17:33.917 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127441.log 2023-10-09T13:17:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130905.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130905.log.gz 2023-10-09T13:17:33.918 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118314.log 2023-10-09T13:17:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127441.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.127441.log.gz 2023-10-09T13:17:33.919 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129350.log 2023-10-09T13:17:33.920 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118314.log.gz 2023-10-09T13:17:33.921 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143395.log 2023-10-09T13:17:33.921 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129350.log.gz 2023-10-09T13:17:33.922 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94990.log 2023-10-09T13:17:33.923 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143395.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143395.log.gz 2023-10-09T13:17:33.923 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111735.log 2023-10-09T13:17:33.924 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94990.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94990.log.gz 2023-10-09T13:17:33.924 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93305.log 2023-10-09T13:17:33.925 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111735.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111735.log.gz 2023-10-09T13:17:33.925 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117076.log 2023-10-09T13:17:33.926 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93305.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.93305.log.gz 2023-10-09T13:17:33.926 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94603.log 2023-10-09T13:17:33.927 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117076.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117076.log.gz 2023-10-09T13:17:33.927 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117756.log 2023-10-09T13:17:33.928 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94603.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94603.log.gz 2023-10-09T13:17:33.929 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106117.log 2023-10-09T13:17:33.929 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117756.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117756.log.gz 2023-10-09T13:17:33.930 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129179.log 2023-10-09T13:17:33.931 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.106117.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106117.log.gz 2023-10-09T13:17:33.931 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137002.log 2023-10-09T13:17:33.932 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129179.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129179.log.gz 2023-10-09T13:17:33.932 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139466.log 2023-10-09T13:17:33.933 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.137002.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137002.log.gz 2023-10-09T13:17:33.933 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92429.log 2023-10-09T13:17:33.934 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139466.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139466.log.gz 2023-10-09T13:17:33.934 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104111.log 2023-10-09T13:17:33.935 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92429.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92429.log.gz 2023-10-09T13:17:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105396.log 2023-10-09T13:17:33.936 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104111.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104111.log.gz 2023-10-09T13:17:33.937 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115166.log 2023-10-09T13:17:33.938 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105396.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105396.log.gz 2023-10-09T13:17:33.938 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109395.log 2023-10-09T13:17:33.939 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115166.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115166.log.gz 2023-10-09T13:17:33.939 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96245.log 2023-10-09T13:17:33.940 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109395.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109395.log.gz 2023-10-09T13:17:33.940 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128878.log 2023-10-09T13:17:33.941 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96245.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96245.log.gz 2023-10-09T13:17:33.942 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107985.log 2023-10-09T13:17:33.943 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128878.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.128878.log.gz 2023-10-09T13:17:33.943 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111609.log 2023-10-09T13:17:33.944 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.107985.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107985.log.gz 2023-10-09T13:17:33.944 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119437.log 2023-10-09T13:17:33.945 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111609.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111609.log.gz 2023-10-09T13:17:33.945 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136231.log 2023-10-09T13:17:33.946 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119437.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119437.log.gz 2023-10-09T13:17:33.946 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91368.log 2023-10-09T13:17:33.947 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136231.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136231.log.gz 2023-10-09T13:17:33.948 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105849.log 2023-10-09T13:17:33.948 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91368.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91368.log.gz 2023-10-09T13:17:33.949 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95116.log 2023-10-09T13:17:33.949 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105849.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105849.log.gz 2023-10-09T13:17:33.950 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92418.log 2023-10-09T13:17:33.951 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95116.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95116.log.gz 2023-10-09T13:17:33.951 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-09T13:17:33.952 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92418.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.92418.log.gz 2023-10-09T13:17:33.952 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143802.log 2023-10-09T13:17:33.953 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121671.log 2023-10-09T13:17:33.954 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143802.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143802.log.gz 2023-10-09T13:17:33.955 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121935.log 2023-10-09T13:17:33.956 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121671.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121671.log.gz 2023-10-09T13:17:33.956 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112295.log 2023-10-09T13:17:33.957 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121935.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121935.log.gz 2023-10-09T13:17:33.958 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132735.log 2023-10-09T13:17:33.959 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112295.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112295.log.gz 2023-10-09T13:17:33.959 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96498.log 2023-10-09T13:17:33.960 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.132735.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132735.log.gz 2023-10-09T13:17:33.961 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92969.log 2023-10-09T13:17:33.962 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96498.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96498.log.gz 2023-10-09T13:17:33.962 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137227.log 2023-10-09T13:17:33.963 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92969.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92969.log.gz 2023-10-09T13:17:33.964 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142598.log 2023-10-09T13:17:33.965 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.137227.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137227.log.gz 2023-10-09T13:17:33.965 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100422.log 2023-10-09T13:17:33.967 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110439.log 2023-10-09T13:17:33.967 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142598.log.gz 2023-10-09T13:17:33.967 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100422.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100422.log.gz 2023-10-09T13:17:33.968 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128944.log 2023-10-09T13:17:33.969 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110439.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110439.log.gz 2023-10-09T13:17:33.969 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121525.log 2023-10-09T13:17:33.970 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128944.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128944.log.gz 2023-10-09T13:17:33.971 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-09T13:17:33.972 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121525.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121525.log.gz 2023-10-09T13:17:33.973 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133927.log 2023-10-09T13:17:33.974 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109563.log 2023-10-09T13:17:33.975 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.133927.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133927.log.gz 2023-10-09T13:17:33.975 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109983.log 2023-10-09T13:17:33.976 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109563.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109563.log.gz 2023-10-09T13:17:33.977 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140569.log 2023-10-09T13:17:33.979 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136357.log 2023-10-09T13:17:33.979 INFO:teuthology.orchestra.run.smithi086.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.109983.log.gz 2023-10-09T13:17:33.980 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140569.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140569.log.gz 2023-10-09T13:17:33.980 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95960.log 2023-10-09T13:17:33.981 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136357.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136357.log.gz 2023-10-09T13:17:33.982 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128668.log 2023-10-09T13:17:33.983 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95960.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95960.log.gz 2023-10-09T13:17:33.983 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113062.log 2023-10-09T13:17:33.984 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128668.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128668.log.gz 2023-10-09T13:17:33.985 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127752.log 2023-10-09T13:17:33.986 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113062.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113062.log.gz 2023-10-09T13:17:33.986 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117513.log 2023-10-09T13:17:33.987 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127752.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127752.log.gz 2023-10-09T13:17:33.988 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135412.log 2023-10-09T13:17:33.989 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117513.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117513.log.gz 2023-10-09T13:17:33.989 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142315.log 2023-10-09T13:17:33.990 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135412.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135412.log.gz 2023-10-09T13:17:33.991 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120521.log 2023-10-09T13:17:33.992 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117215.log 2023-10-09T13:17:33.992 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142315.log.gz 2023-10-09T13:17:33.993 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120521.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120521.log.gz 2023-10-09T13:17:33.993 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134427.log 2023-10-09T13:17:33.994 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101838.log 2023-10-09T13:17:33.995 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117215.log.gz 2023-10-09T13:17:33.995 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134427.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134427.log.gz 2023-10-09T13:17:33.996 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99916.log 2023-10-09T13:17:33.997 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.101838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115827.log 2023-10-09T13:17:33.997 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101838.log.gz 2023-10-09T13:17:33.998 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99916.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99916.log.gz 2023-10-09T13:17:33.998 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92003.log 2023-10-09T13:17:33.999 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139761.log 2023-10-09T13:17:34.000 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115827.log.gz 2023-10-09T13:17:34.000 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92003.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92003.log.gz 2023-10-09T13:17:34.001 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143718.log 2023-10-09T13:17:34.002 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130759.log 2023-10-09T13:17:34.002 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139761.log.gz 2023-10-09T13:17:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143718.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143718.log.gz 2023-10-09T13:17:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128752.log 2023-10-09T13:17:34.004 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140735.log 2023-10-09T13:17:34.005 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130759.log.gz 2023-10-09T13:17:34.005 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128752.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128752.log.gz 2023-10-09T13:17:34.006 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122021.log 2023-10-09T13:17:34.007 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95158.log 2023-10-09T13:17:34.007 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140735.log.gz 2023-10-09T13:17:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122021.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122021.log.gz 2023-10-09T13:17:34.008 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96164.log 2023-10-09T13:17:34.009 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115040.log 2023-10-09T13:17:34.010 INFO:teuthology.orchestra.run.smithi086.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95158.log.gz 2023-10-09T13:17:34.010 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96164.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96164.log.gz 2023-10-09T13:17:34.011 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127299.log 2023-10-09T13:17:34.012 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141169.log 2023-10-09T13:17:34.012 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115040.log.gz 2023-10-09T13:17:34.013 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127299.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127299.log.gz 2023-10-09T13:17:34.014 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127626.log 2023-10-09T13:17:34.014 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97544.log 2023-10-09T13:17:34.015 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141169.log.gz 2023-10-09T13:17:34.016 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127626.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.127626.log.gz 2023-10-09T13:17:34.016 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113937.log 2023-10-09T13:17:34.018 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97544.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97544.log.gz 2023-10-09T13:17:34.018 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134756.log 2023-10-09T13:17:34.019 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.113937.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113937.log.gz 2023-10-09T13:17:34.019 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126770.log 2023-10-09T13:17:34.020 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96863.log 2023-10-09T13:17:34.020 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134756.log.gz 2023-10-09T13:17:34.021 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.126770.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126770.log.gz 2023-10-09T13:17:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134257.log 2023-10-09T13:17:34.022 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108875.log 2023-10-09T13:17:34.023 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96863.log.gz 2023-10-09T13:17:34.024 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134257.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.134257.log.gz 2023-10-09T13:17:34.024 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114642.log 2023-10-09T13:17:34.025 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107664.log 2023-10-09T13:17:34.025 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108875.log.gz 2023-10-09T13:17:34.026 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114642.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114642.log.gz 2023-10-09T13:17:34.026 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137270.log 2023-10-09T13:17:34.028 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.107664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119001.log 2023-10-09T13:17:34.028 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107664.log.gz 2023-10-09T13:17:34.029 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.137270.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137270.log.gz 2023-10-09T13:17:34.029 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-09T13:17:34.030 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142784.log 2023-10-09T13:17:34.030 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119001.log.gz 2023-10-09T13:17:34.032 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143844.log 2023-10-09T13:17:34.033 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142784.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142784.log.gz 2023-10-09T13:17:34.034 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109223.log 2023-10-09T13:17:34.035 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143844.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143844.log.gz 2023-10-09T13:17:34.036 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119854.log 2023-10-09T13:17:34.037 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109223.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109223.log.gz 2023-10-09T13:17:34.037 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91961.log 2023-10-09T13:17:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119854.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119854.log.gz 2023-10-09T13:17:34.039 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92751.log 2023-10-09T13:17:34.040 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91961.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91961.log.gz 2023-10-09T13:17:34.040 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116681.log 2023-10-09T13:17:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92751.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92751.log.gz 2023-10-09T13:17:34.042 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127146.log 2023-10-09T13:17:34.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116681.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116681.log.gz 2023-10-09T13:17:34.044 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130983.log 2023-10-09T13:17:34.045 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127146.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127146.log.gz 2023-10-09T13:17:34.046 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119550.log 2023-10-09T13:17:34.047 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130983.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130983.log.gz 2023-10-09T13:17:34.047 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112517.log 2023-10-09T13:17:34.049 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119550.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119550.log.gz 2023-10-09T13:17:34.050 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128372.log 2023-10-09T13:17:34.051 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112517.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112517.log.gz 2023-10-09T13:17:34.051 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108079.log 2023-10-09T13:17:34.053 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128372.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128372.log.gz 2023-10-09T13:17:34.053 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97033.log 2023-10-09T13:17:34.054 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108079.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108079.log.gz 2023-10-09T13:17:34.054 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119612.log 2023-10-09T13:17:34.056 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97033.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97033.log.gz 2023-10-09T13:17:34.056 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139859.log 2023-10-09T13:17:34.057 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119612.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119612.log.gz 2023-10-09T13:17:34.058 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131783.log 2023-10-09T13:17:34.060 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139859.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139859.log.gz 2023-10-09T13:17:34.060 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117305.log 2023-10-09T13:17:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131783.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.131783.log.gz 2023-10-09T13:17:34.061 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95326.log 2023-10-09T13:17:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117305.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117305.log.gz 2023-10-09T13:17:34.063 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130801.log 2023-10-09T13:17:34.064 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95326.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95326.log.gz 2023-10-09T13:17:34.065 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140429.log 2023-10-09T13:17:34.067 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130801.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130801.log.gz 2023-10-09T13:17:34.067 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120259.log 2023-10-09T13:17:34.068 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140429.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140429.log.gz 2023-10-09T13:17:34.068 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122381.log 2023-10-09T13:17:34.070 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120259.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120259.log.gz 2023-10-09T13:17:34.070 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120383.log 2023-10-09T13:17:34.071 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122381.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122381.log.gz 2023-10-09T13:17:34.072 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114516.log 2023-10-09T13:17:34.073 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120383.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120383.log.gz 2023-10-09T13:17:34.074 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122105.log 2023-10-09T13:17:34.075 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114516.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.114516.log.gz 2023-10-09T13:17:34.075 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91317.log 2023-10-09T13:17:34.077 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122105.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122105.log.gz 2023-10-09T13:17:34.077 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139994.log 2023-10-09T13:17:34.078 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91317.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91317.log.gz 2023-10-09T13:17:34.079 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85764.log 2023-10-09T13:17:34.080 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139994.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139994.log.gz 2023-10-09T13:17:34.081 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118917.log 2023-10-09T13:17:34.082 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.85764.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85764.log.gz 2023-10-09T13:17:34.083 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94738.log 2023-10-09T13:17:34.083 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118917.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118917.log.gz 2023-10-09T13:17:34.084 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104195.log 2023-10-09T13:17:34.085 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94738.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94738.log.gz 2023-10-09T13:17:34.086 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130254.log 2023-10-09T13:17:34.090 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104195.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104195.log.gz 2023-10-09T13:17:34.090 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121427.log 2023-10-09T13:17:34.091 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130254.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130254.log.gz 2023-10-09T13:17:34.091 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120759.log 2023-10-09T13:17:34.091 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121427.log.gz 2023-10-09T13:17:34.092 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122273.log 2023-10-09T13:17:34.093 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120759.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120759.log.gz 2023-10-09T13:17:34.093 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103696.log 2023-10-09T13:17:34.094 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122273.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122273.log.gz 2023-10-09T13:17:34.095 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130109.log 2023-10-09T13:17:34.096 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103696.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103696.log.gz 2023-10-09T13:17:34.096 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120661.log 2023-10-09T13:17:34.098 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130109.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130109.log.gz 2023-10-09T13:17:34.099 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97777.log 2023-10-09T13:17:34.099 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120661.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120661.log.gz 2023-10-09T13:17:34.100 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111777.log 2023-10-09T13:17:34.102 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97777.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97777.log.gz 2023-10-09T13:17:34.102 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142919.log 2023-10-09T13:17:34.103 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111777.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111777.log.gz 2023-10-09T13:17:34.103 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112811.log 2023-10-09T13:17:34.105 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142919.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142919.log.gz 2023-10-09T13:17:34.105 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115082.log 2023-10-09T13:17:34.106 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112811.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112811.log.gz 2023-10-09T13:17:34.107 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128142.log 2023-10-09T13:17:34.108 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115082.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115082.log.gz 2023-10-09T13:17:34.109 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133276.log 2023-10-09T13:17:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128142.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128142.log.gz 2023-10-09T13:17:34.110 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110378.log 2023-10-09T13:17:34.112 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.133276.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.133276.log.gz 2023-10-09T13:17:34.112 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109479.log 2023-10-09T13:17:34.113 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110378.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110378.log.gz 2023-10-09T13:17:34.114 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132361.log 2023-10-09T13:17:34.115 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109479.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109479.log.gz 2023-10-09T13:17:34.116 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143127.log 2023-10-09T13:17:34.117 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.132361.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132361.log.gz 2023-10-09T13:17:34.117 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143886.log 2023-10-09T13:17:34.119 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143127.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143127.log.gz 2023-10-09T13:17:34.119 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141295.log 2023-10-09T13:17:34.120 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143886.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143886.log.gz 2023-10-09T13:17:34.121 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135757.log 2023-10-09T13:17:34.123 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141295.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141295.log.gz 2023-10-09T13:17:34.123 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133318.log 2023-10-09T13:17:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135757.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135757.log.gz 2023-10-09T13:17:34.124 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110889.log 2023-10-09T13:17:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.133318.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133318.log.gz 2023-10-09T13:17:34.126 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93263.log 2023-10-09T13:17:34.127 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110889.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110889.log.gz 2023-10-09T13:17:34.128 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136147.log 2023-10-09T13:17:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93263.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93263.log.gz 2023-10-09T13:17:34.130 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120912.log 2023-10-09T13:17:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136147.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136147.log.gz 2023-10-09T13:17:34.131 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120475.log 2023-10-09T13:17:34.133 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120912.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120912.log.gz 2023-10-09T13:17:34.133 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97117.log 2023-10-09T13:17:34.134 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120475.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120475.log.gz 2023-10-09T13:17:34.135 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107770.log 2023-10-09T13:17:34.137 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97117.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97117.log.gz 2023-10-09T13:17:34.137 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130843.log 2023-10-09T13:17:34.138 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.107770.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107770.log.gz 2023-10-09T13:17:34.138 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135895.log 2023-10-09T13:17:34.140 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130843.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130843.log.gz 2023-10-09T13:17:34.140 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136549.log 2023-10-09T13:17:34.141 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135895.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135895.log.gz 2023-10-09T13:17:34.142 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103943.log 2023-10-09T13:17:34.144 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136549.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136549.log.gz 2023-10-09T13:17:34.144 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91228.log 2023-10-09T13:17:34.145 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103943.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103943.log.gz 2023-10-09T13:17:34.145 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114684.log 2023-10-09T13:17:34.147 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91228.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91228.log.gz 2023-10-09T13:17:34.147 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100480.log 2023-10-09T13:17:34.148 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114684.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114684.log.gz 2023-10-09T13:17:34.149 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120168.log 2023-10-09T13:17:34.151 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100480.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100480.log.gz 2023-10-09T13:17:34.151 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95918.log 2023-10-09T13:17:34.152 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120168.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120168.log.gz 2023-10-09T13:17:34.153 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114600.log 2023-10-09T13:17:34.154 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95918.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95918.log.gz 2023-10-09T13:17:34.155 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116409.log 2023-10-09T13:17:34.156 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114600.log.gz 2023-10-09T13:17:34.156 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103105.log 2023-10-09T13:17:34.158 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116409.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116409.log.gz 2023-10-09T13:17:34.158 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111923.log 2023-10-09T13:17:34.159 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.103105.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103105.log.gz 2023-10-09T13:17:34.160 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142003.log 2023-10-09T13:17:34.161 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111923.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111923.log.gz 2023-10-09T13:17:34.161 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94653.log 2023-10-09T13:17:34.163 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142003.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142003.log.gz 2023-10-09T13:17:34.163 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117360.log 2023-10-09T13:17:34.164 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94653.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94653.log.gz 2023-10-09T13:17:34.165 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120704.log 2023-10-09T13:17:34.166 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117360.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117360.log.gz 2023-10-09T13:17:34.166 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101588.log 2023-10-09T13:17:34.168 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120704.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120704.log.gz 2023-10-09T13:17:34.169 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111819.log 2023-10-09T13:17:34.169 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.101588.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101588.log.gz 2023-10-09T13:17:34.170 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117655.log 2023-10-09T13:17:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111819.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111819.log.gz 2023-10-09T13:17:34.172 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141940.log 2023-10-09T13:17:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117655.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117655.log.gz 2023-10-09T13:17:34.173 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126907.log 2023-10-09T13:17:34.175 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141940.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141940.log.gz 2023-10-09T13:17:34.176 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127814.log 2023-10-09T13:17:34.177 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.126907.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126907.log.gz 2023-10-09T13:17:34.177 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134658.log 2023-10-09T13:17:34.179 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127814.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127814.log.gz 2023-10-09T13:17:34.179 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97652.log 2023-10-09T13:17:34.180 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134658.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134658.log.gz 2023-10-09T13:17:34.181 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130344.log 2023-10-09T13:17:34.182 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97652.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97652.log.gz 2023-10-09T13:17:34.183 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118959.log 2023-10-09T13:17:34.184 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130344.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130344.log.gz 2023-10-09T13:17:34.184 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109773.log 2023-10-09T13:17:34.186 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118959.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118959.log.gz 2023-10-09T13:17:34.187 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100016.log 2023-10-09T13:17:34.187 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109773.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109773.log.gz 2023-10-09T13:17:34.188 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110326.log 2023-10-09T13:17:34.189 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100016.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100016.log.gz 2023-10-09T13:17:34.190 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96949.log 2023-10-09T13:17:34.191 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110326.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110326.log.gz 2023-10-09T13:17:34.192 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111861.log 2023-10-09T13:17:34.194 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96949.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96949.log.gz 2023-10-09T13:17:34.194 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136063.log 2023-10-09T13:17:34.195 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111861.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111861.log.gz 2023-10-09T13:17:34.195 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120803.log 2023-10-09T13:17:34.197 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136063.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136063.log.gz 2023-10-09T13:17:34.197 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.119344.log 2023-10-09T13:17:34.198 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120803.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120803.log.gz 2023-10-09T13:17:34.199 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142082.log 2023-10-09T13:17:34.200 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.119344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119344.log.gz 2023-10-09T13:17:34.201 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140135.log 2023-10-09T13:17:34.202 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142082.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142082.log.gz 2023-10-09T13:17:34.202 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117450.log 2023-10-09T13:17:34.204 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140135.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.140135.log.gz 2023-10-09T13:17:34.204 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94948.log 2023-10-09T13:17:34.205 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117450.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117450.log.gz 2023-10-09T13:17:34.206 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122231.log 2023-10-09T13:17:34.208 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94948.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94948.log.gz 2023-10-09T13:17:34.208 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131277.log 2023-10-09T13:17:34.209 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122231.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122231.log.gz 2023-10-09T13:17:34.209 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133885.log 2023-10-09T13:17:34.211 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131277.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.131277.log.gz 2023-10-09T13:17:34.211 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110049.log 2023-10-09T13:17:34.212 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.133885.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.133885.log.gz 2023-10-09T13:17:34.213 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144222.log 2023-10-09T13:17:34.215 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110049.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110049.log.gz 2023-10-09T13:17:34.215 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-09T13:17:34.215 INFO:teuthology.orchestra.run.smithi086.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-09T13:17:34.215 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144222.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144222.log.gz 2023-10-09T13:17:34.216 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131615.log 2023-10-09T13:17:34.217 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136940.log 2023-10-09T13:17:34.218 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131615.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131615.log.gz 2023-10-09T13:17:34.219 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116254.log 2023-10-09T13:17:34.220 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135715.log 2023-10-09T13:17:34.220 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136940.log.gz 2023-10-09T13:17:34.221 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116254.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116254.log.gz 2023-10-09T13:17:34.222 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135490.log 2023-10-09T13:17:34.224 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135715.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135715.log.gz 2023-10-09T13:17:34.224 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93011.log 2023-10-09T13:17:34.226 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91043.log 2023-10-09T13:17:34.226 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135490.log.gz 2023-10-09T13:17:34.226 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93011.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93011.log.gz 2023-10-09T13:17:34.227 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110242.log 2023-10-09T13:17:34.229 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99580.log 2023-10-09T13:17:34.229 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91043.log.gz 2023-10-09T13:17:34.229 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.110242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110242.log.gz 2023-10-09T13:17:34.230 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109941.log 2023-10-09T13:17:34.232 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128710.log 2023-10-09T13:17:34.232 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99580.log.gz 2023-10-09T13:17:34.232 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109941.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109941.log.gz 2023-10-09T13:17:34.233 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114123.log 2023-10-09T13:17:34.234 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108269.log 2023-10-09T13:17:34.235 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128710.log.gz 2023-10-09T13:17:34.235 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114123.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114123.log.gz 2023-10-09T13:17:34.236 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104069.log 2023-10-09T13:17:34.237 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104027.log 2023-10-09T13:17:34.237 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108269.log.gz 2023-10-09T13:17:34.238 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104069.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104069.log.gz 2023-10-09T13:17:34.239 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93515.log 2023-10-09T13:17:34.240 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100830.log 2023-10-09T13:17:34.241 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104027.log.gz 2023-10-09T13:17:34.241 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93515.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93515.log.gz 2023-10-09T13:17:34.242 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104673.log 2023-10-09T13:17:34.243 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97309.log 2023-10-09T13:17:34.243 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100830.log.gz 2023-10-09T13:17:34.244 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104673.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104673.log.gz 2023-10-09T13:17:34.244 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135572.log 2023-10-09T13:17:34.246 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.97309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109353.log 2023-10-09T13:17:34.246 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97309.log.gz 2023-10-09T13:17:34.247 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135572.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135572.log.gz 2023-10-09T13:17:34.247 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112870.log 2023-10-09T13:17:34.249 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109353.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109353.log.gz 2023-10-09T13:17:34.249 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104994.log 2023-10-09T13:17:34.251 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112643.log 2023-10-09T13:17:34.251 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112870.log.gz 2023-10-09T13:17:34.252 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104994.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104994.log.gz 2023-10-09T13:17:34.252 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131363.log 2023-10-09T13:17:34.253 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112643.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112643.log.gz 2023-10-09T13:17:34.254 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94822.log 2023-10-09T13:17:34.255 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92744.log 2023-10-09T13:17:34.255 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131363.log.gz 2023-10-09T13:17:34.256 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.94822.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94822.log.gz 2023-10-09T13:17:34.257 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109015.log 2023-10-09T13:17:34.258 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92744.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92744.log.gz 2023-10-09T13:17:34.258 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133827.log 2023-10-09T13:17:34.260 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116984.log 2023-10-09T13:17:34.260 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109015.log.gz 2023-10-09T13:17:34.261 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.133827.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133827.log.gz 2023-10-09T13:17:34.261 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115953.log 2023-10-09T13:17:34.263 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141211.log 2023-10-09T13:17:34.263 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116984.log.gz 2023-10-09T13:17:34.264 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115953.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.115953.log.gz 2023-10-09T13:17:34.264 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92129.log 2023-10-09T13:17:34.266 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121893.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141211.log.gz 2023-10-09T13:17:34.266 INFO:teuthology.orchestra.run.smithi086.stderr: 2023-10-09T13:17:34.266 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92129.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92129.log.gz 2023-10-09T13:17:34.267 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104851.log 2023-10-09T13:17:34.269 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.121893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122726.log 2023-10-09T13:17:34.269 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121893.log.gz 2023-10-09T13:17:34.269 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104851.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104851.log.gz 2023-10-09T13:17:34.270 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115785.log 2023-10-09T13:17:34.272 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143311.log 2023-10-09T13:17:34.272 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122726.log.gz 2023-10-09T13:17:34.273 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115785.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115785.log.gz 2023-10-09T13:17:34.273 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92419.log 2023-10-09T13:17:34.275 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144306.log 2023-10-09T13:17:34.276 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92419.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143311.log.gz 2023-10-09T13:17:34.277 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92419.log.gz 2023-10-09T13:17:34.277 INFO:teuthology.orchestra.run.smithi086.stderr:-- /var/log/ceph/ceph-mgr.y.log 2023-10-09T13:17:34.278 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144306.log: gzip -5 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144306.log.gz 2023-10-09T13:17:34.278 INFO:teuthology.orchestra.run.smithi086.stderr:--verbose -- /var/log/ceph/ceph-client.admin.108749.log 2023-10-09T13:17:34.280 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131741.log 2023-10-09T13:17:34.281 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108749.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108749.log.gz 2023-10-09T13:17:34.281 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96710.log 2023-10-09T13:17:34.283 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142690.log 2023-10-09T13:17:34.283 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131741.log.gz 2023-10-09T13:17:34.285 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96710.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96710.log.gz 2023-10-09T13:17:34.285 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92428.log 2023-10-09T13:17:34.287 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109309.log 2023-10-09T13:17:34.288 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92428.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142690.log.gz 2023-10-09T13:17:34.288 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92428.log.gz 2023-10-09T13:17:34.289 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116454.log 2023-10-09T13:17:34.294 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117882.log 2023-10-09T13:17:34.294 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.116454.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109309.log.gz 2023-10-09T13:17:34.294 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116454.log.gz 2023-10-09T13:17:34.294 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119043.log 2023-10-09T13:17:34.295 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134518.log 2023-10-09T13:17:34.297 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119043.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117882.log.gz 2023-10-09T13:17:34.297 INFO:teuthology.orchestra.run.smithi086.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119043.log.gz 2023-10-09T13:17:34.298 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140819.log 2023-10-09T13:17:34.299 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98834.log 2023-10-09T13:17:34.300 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.134518.log: /var/log/ceph/ceph-client.admin.140819.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134518.log.gz 2023-10-09T13:17:34.301 INFO:teuthology.orchestra.run.smithi086.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140819.log.gz 2023-10-09T13:17:34.302 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120430.log 2023-10-09T13:17:34.304 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130407.log 2023-10-09T13:17:34.305 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120430.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98834.log.gz 2023-10-09T13:17:34.305 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120430.log.gz 2023-10-09T13:17:34.306 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118495.log 2023-10-09T13:17:34.308 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93221.log 2023-10-09T13:17:34.309 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118495.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130407.log.gz 2023-10-09T13:17:34.310 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118495.log.gz 2023-10-09T13:17:34.310 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115869.log 2023-10-09T13:17:34.312 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.93221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131191.log 2023-10-09T13:17:34.314 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115869.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115869.log.gz 2023-10-09T13:17:34.314 INFO:teuthology.orchestra.run.smithi086.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93221.log.gz 2023-10-09T13:17:34.315 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122147.log 2023-10-09T13:17:34.317 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143269.log 2023-10-09T13:17:34.318 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122147.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131191.log.gz 2023-10-09T13:17:34.318 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122147.log.gz 2023-10-09T13:17:34.319 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113983.log 2023-10-09T13:17:34.321 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144577.log 2023-10-09T13:17:34.322 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143269.log: /var/log/ceph/ceph-client.admin.113983.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.143269.log.gz 2023-10-09T13:17:34.322 INFO:teuthology.orchestra.run.smithi086.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113983.log.gz 2023-10-09T13:17:34.323 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112339.log 2023-10-09T13:17:34.325 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131065.log 2023-10-09T13:17:34.326 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112339.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144577.log.gz 2023-10-09T13:17:34.326 INFO:teuthology.orchestra.run.smithi086.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112339.log.gz 2023-10-09T13:17:34.327 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132311.log 2023-10-09T13:17:34.329 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140345.log 2023-10-09T13:17:34.330 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.132311.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131065.log.gz 2023-10-09T13:17:34.331 INFO:teuthology.orchestra.run.smithi086.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.132311.log.gz 2023-10-09T13:17:34.332 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131842.log 2023-10-09T13:17:34.333 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.140345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111120.log 2023-10-09T13:17:34.334 INFO:teuthology.orchestra.run.smithi086.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140345.log.gz 2023-10-09T13:17:34.336 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131842.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131842.log.gz 2023-10-09T13:17:34.336 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108314.log 2023-10-09T13:17:34.337 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111120.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111120.log.gz 2023-10-09T13:17:34.339 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91411.log 2023-10-09T13:17:34.340 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108314.log.gz 2023-10-09T13:17:34.340 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.129137.log 2023-10-09T13:17:34.342 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142876.log 2023-10-09T13:17:34.343 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.0.129137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.129137.log.gz 89.6% -- replaced with /var/log/ceph/ceph-client.admin.91411.log.gz 2023-10-09T13:17:34.343 INFO:teuthology.orchestra.run.smithi086.stderr: 2023-10-09T13:17:34.345 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118749.log 2023-10-09T13:17:34.346 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.142876.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.142876.log.gz 2023-10-09T13:17:34.346 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126956.log 2023-10-09T13:17:34.348 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100248.log 2023-10-09T13:17:34.349 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.126956.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118749.log.gz 2023-10-09T13:17:34.350 INFO:teuthology.orchestra.run.smithi086.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126956.log.gz 2023-10-09T13:17:34.351 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99832.log 2023-10-09T13:17:34.353 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.100248.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100248.log.gz 2023-10-09T13:17:34.353 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130549.log 2023-10-09T13:17:34.354 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144138.log 2023-10-09T13:17:34.356 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130549.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99832.log.gz 2023-10-09T13:17:34.356 INFO:teuthology.orchestra.run.smithi086.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130549.log.gz 2023-10-09T13:17:34.358 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104543.log 2023-10-09T13:17:34.359 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144138.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144138.log.gz 2023-10-09T13:17:34.359 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118401.log 2023-10-09T13:17:34.361 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99790.log 2023-10-09T13:17:34.362 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118401.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104543.log.gz 2023-10-09T13:17:34.362 INFO:teuthology.orchestra.run.smithi086.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118401.log.gz 2023-10-09T13:17:34.364 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98662.log 2023-10-09T13:17:34.365 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.99790.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99790.log.gz 2023-10-09T13:17:34.365 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91495.log 2023-10-09T13:17:34.367 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112559.log 2023-10-09T13:17:34.368 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91495.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98662.log.gz 2023-10-09T13:17:34.368 INFO:teuthology.orchestra.run.smithi086.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91495.log.gz 2023-10-09T13:17:34.370 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132424.log 2023-10-09T13:17:34.371 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112559.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112559.log.gz 2023-10-09T13:17:34.372 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92756.log 2023-10-09T13:17:34.373 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.132424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108564.log 2023-10-09T13:17:34.374 INFO:teuthology.orchestra.run.smithi086.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.132424.log.gz 2023-10-09T13:17:34.375 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128330.log 2023-10-09T13:17:34.376 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.108564.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92756.log.gz 2023-10-09T13:17:34.377 INFO:teuthology.orchestra.run.smithi086.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.108564.log.gz 2023-10-09T13:17:34.378 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130591.log 2023-10-09T13:17:34.379 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91751.log 2023-10-09T13:17:34.381 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.130591.log: 88.8% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130591.log.gz 2023-10-09T13:17:34.381 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128330.log.gz 2023-10-09T13:17:34.382 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141613.log 2023-10-09T13:17:34.383 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91751.log.gz 2023-10-09T13:17:34.384 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144054.log 2023-10-09T13:17:34.386 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.141613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95834.log 2023-10-09T13:17:34.387 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144054.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.144054.log.gz 2023-10-09T13:17:34.387 INFO:teuthology.orchestra.run.smithi086.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141613.log.gz 2023-10-09T13:17:34.388 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119487.log 2023-10-09T13:17:34.390 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95834.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95834.log.gz 2023-10-09T13:17:34.390 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96002.log 2023-10-09T13:17:34.392 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136785.log 2023-10-09T13:17:34.393 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.96002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96002.log.gz 2023-10-09T13:17:34.393 INFO:teuthology.orchestra.run.smithi086.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119487.log.gz 2023-10-09T13:17:34.395 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135979.log 2023-10-09T13:17:34.396 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.136785.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136785.log.gz 2023-10-09T13:17:34.396 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131699.log 2023-10-09T13:17:34.398 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.135979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122063.log 2023-10-09T13:17:34.399 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.131699.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135979.log.gz 2023-10-09T13:17:34.399 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131699.log.gz 2023-10-09T13:17:34.401 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105078.log 2023-10-09T13:17:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.122063.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122063.log.gz 2023-10-09T13:17:34.402 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91877.log 2023-10-09T13:17:34.404 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.105078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115407.log 2023-10-09T13:17:34.406 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.91877.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91877.log.gz 2023-10-09T13:17:34.406 INFO:teuthology.orchestra.run.smithi086.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105078.log.gz 2023-10-09T13:17:34.407 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117170.log 2023-10-09T13:17:34.408 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115407.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115407.log.gz 2023-10-09T13:17:34.408 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104335.log 2023-10-09T13:17:34.410 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.117170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98748.log 2023-10-09T13:17:34.412 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.104335.log: 88.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117170.log.gz 2023-10-09T13:17:34.412 INFO:teuthology.orchestra.run.smithi086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104335.log.gz 2023-10-09T13:17:34.413 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128626.log 2023-10-09T13:17:34.415 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.98748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119085.log 2023-10-09T13:17:34.416 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.128626.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.128626.log.gz 2023-10-09T13:17:34.416 INFO:teuthology.orchestra.run.smithi086.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98748.log.gz 2023-10-09T13:17:34.417 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127236.log 2023-10-09T13:17:34.419 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.119085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139652.log 2023-10-09T13:17:34.420 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.127236.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127236.log.gz 2023-10-09T13:17:34.421 INFO:teuthology.orchestra.run.smithi086.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.119085.log.gz 2023-10-09T13:17:34.422 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115701.log 2023-10-09T13:17:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139652.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139652.log.gz 2023-10-09T13:17:34.423 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111651.log 2023-10-09T13:17:34.425 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.115701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129223.log 2023-10-09T13:17:34.426 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.111651.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115701.log.gz 2023-10-09T13:17:34.426 INFO:teuthology.orchestra.run.smithi086.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111651.log.gz 2023-10-09T13:17:34.428 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112996.log 2023-10-09T13:17:34.429 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.129223.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129223.log.gz 2023-10-09T13:17:34.429 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141806.log 2023-10-09T13:17:34.431 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-09T13:17:34.432 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112996.log: /var/log/ceph/ceph-client.0.141806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.141806.log.gz 2023-10-09T13:17:34.432 INFO:teuthology.orchestra.run.smithi086.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.112996.log.gz 2023-10-09T13:17:34.434 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110936.log 2023-10-09T13:17:34.436 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114872.log 2023-10-09T13:17:34.438 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.110936.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110936.log.gz 2023-10-09T13:17:34.440 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143064.log 2023-10-09T13:17:34.442 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.114872.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114872.log.gz 2023-10-09T13:17:34.443 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118537.log 2023-10-09T13:17:34.445 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.143064.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143064.log.gz 2023-10-09T13:17:34.447 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144390.log 2023-10-09T13:17:34.449 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.118537.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118537.log.gz 2023-10-09T13:17:34.451 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109181.log 2023-10-09T13:17:34.453 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.144390.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144390.log.gz 2023-10-09T13:17:34.455 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92415.log 2023-10-09T13:17:34.457 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.109181.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109181.log.gz 2023-10-09T13:17:34.459 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120849.log 2023-10-09T13:17:34.461 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.92415.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92415.log.gz 2023-10-09T13:17:34.462 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139604.log 2023-10-09T13:17:34.464 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.120849.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120849.log.gz 2023-10-09T13:17:34.466 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95708.log 2023-10-09T13:17:34.468 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.139604.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.139604.log.gz 2023-10-09T13:17:34.470 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112001.log 2023-10-09T13:17:34.472 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.95708.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95708.log.gz 2023-10-09T13:17:34.475 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.112001.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112001.log.gz 2023-10-09T13:17:34.515 INFO:teuthology.orchestra.run.smithi086.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-09T13:17:35.107 INFO:teuthology.orchestra.run.smithi135.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-09T13:17:35.263 INFO:teuthology.orchestra.run.smithi135.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-09T13:17:36.042 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-09T13:17:36.071 INFO:teuthology.orchestra.run.smithi086.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-09T13:17:36.083 INFO:teuthology.orchestra.run.smithi135.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-09T13:17:36.253 INFO:teuthology.orchestra.run.smithi135.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-09T13:17:36.497 INFO:teuthology.orchestra.run.smithi086.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-09T13:17:36.627 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-09T13:17:36.630 INFO:teuthology.orchestra.run.smithi135.stderr: 2023-10-09T13:17:36.631 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m3.212s 2023-10-09T13:17:36.631 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m13.787s 2023-10-09T13:17:36.631 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m1.318s 2023-10-09T13:17:36.757 INFO:teuthology.orchestra.run.smithi086.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-09T13:17:37.226 INFO:teuthology.orchestra.run.smithi086.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-09T13:17:37.756 INFO:teuthology.orchestra.run.smithi086.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-09T13:17:38.275 INFO:teuthology.orchestra.run.smithi086.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-09T13:17:38.278 INFO:teuthology.orchestra.run.smithi086.stderr: 2023-10-09T13:17:38.278 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m4.864s 2023-10-09T13:17:38.278 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m17.847s 2023-10-09T13:17:38.278 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m3.318s 2023-10-09T13:17:38.279 INFO:tasks.ceph:Archiving logs... 2023-10-09T13:17:38.279 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/remote/smithi086/log 2023-10-09T13:17:38.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T13:17:41.144 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/remote/smithi135/log 2023-10-09T13:17:41.145 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T13:17:42.868 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-09T13:17:42.877 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-09T13:17:42.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T13:17:42.882 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T13:17:43.009 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-09T13:17:43.018 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-09T13:17:43.018 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T13:17:43.023 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T13:17:43.053 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2023-10-09T13:17:43.057 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-10-09T13:17:43.059 INFO:teuthology.orchestra.run.smithi086.stdout:210 Number of sources = 4 2023-10-09T13:17:43.059 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T13:17:43.059 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2023-10-09T13:17:43.059 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv01.front.sepia.ceph.com 2 9 377 467 -295us[ -317us] +/- 93ms 2023-10-09T13:17:43.059 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv02.front.sepia.ceph.com 3 8 377 12 -504us[ -505us] +/- 74ms 2023-10-09T13:17:43.060 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +1024us[+1023us] +/- 86ms 2023-10-09T13:17:43.060 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T13:17:43.062 INFO:teuthology.orchestra.run.smithi135.stdout:210 Number of sources = 4 2023-10-09T13:17:43.062 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T13:17:43.062 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-10-09T13:17:43.062 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 82 -286us[ -280us] +/- 74ms 2023-10-09T13:17:43.062 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 8 377 78 -483us[ -476us] +/- 73ms 2023-10-09T13:17:43.062 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +1029us[+1029us] +/- 86ms 2023-10-09T13:17:43.062 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T13:17:43.063 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-09T13:17:43.071 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-09T13:17:43.072 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-09T13:17:43.095 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T13:17:43.204 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T13:17:43.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T13:17:43.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T13:17:43.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T13:17:43.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T13:17:43.496 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-09T13:17:43.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-09T13:17:43.546 INFO:teuthology.task.internal:Duration was 6715.138838 seconds 2023-10-09T13:17:43.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-09T13:17:43.580 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-09T13:17:43.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T13:17:43.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T13:17:43.689 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T13:17:43.694 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T13:17:43.989 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-09T13:17:43.989 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2023-10-09T13:17:43.989 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T13:17:44.039 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2023-10-09T13:17:44.040 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T13:17:44.090 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-09T13:17:44.090 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T13:17:44.094 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T13:17:44.184 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-09T13:17:44.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T13:17:44.188 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T13:17:44.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-09T13:17:44.339 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-09T13:17:44.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T13:17:44.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T13:17:44.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-09T13:17:44.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T13:17:44.474 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T13:17:44.529 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2023-10-09T13:17:44.534 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2023-10-09T13:17:44.569 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T13:17:44.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T13:17:44.603 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T13:17:44.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T13:17:44.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-09T13:17:44.648 INFO:teuthology.task.internal:Transferring archived files... 2023-10-09T13:17:44.648 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/remote/smithi086 2023-10-09T13:17:44.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T13:17:44.718 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426/remote/smithi135 2023-10-09T13:17:44.718 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T13:17:44.788 INFO:teuthology.task.internal:Removing archive directory... 2023-10-09T13:17:44.788 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T13:17:44.793 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T13:17:44.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-09T13:17:44.840 INFO:teuthology.task.internal:Not uploading archives. 2023-10-09T13:17:44.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-09T13:17:44.863 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-09T13:17:44.863 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T13:17:44.868 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T13:17:44.900 INFO:teuthology.orchestra.run.smithi086.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 13:17 /home/ubuntu/cephtest 2023-10-09T13:17:44.905 INFO:teuthology.orchestra.run.smithi135.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 13:17 /home/ubuntu/cephtest 2023-10-09T13:17:44.908 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-09T13:17:44.918 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-09T13:17:44.981 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T13:17:45.008 DEBUG:teuthology.nuke:shortname: smithi086 2023-10-09T13:17:45.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T13:17:45.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:38.345237', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD34nbgYcUZvZJZ8f8skn4RhTM6NnE0qu8eFT+hbrug4a313XXlpfaJ8kcTE3m/zuZoHcr/nfate0hq76Hm8RdE='} 2023-10-09T13:17:45.035 DEBUG:teuthology.nuke:shortname: smithi135 2023-10-09T13:17:45.035 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T13:17:45.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:38.346388', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHxfDg/flbxzoCjGrPvdOZI+jnTNUsQmqFyt+51j2EbHwt1F45TcH7E17DzWehwRL0z3XoUBzGLI2yaQGcjDqkY='} 2023-10-09T13:17:45.084 INFO:teuthology.orchestra.console.smithi086:Power off 2023-10-09T13:17:45.084 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T13:17:45.107 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-10-09T13:17:45.108 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T13:17:45.121 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-09T13:17:45.121 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T13:17:45.129 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-09T13:17:45.143 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-09T13:17:45.143 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T13:17:45.163 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-09T13:17:49.130 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T13:17:49.164 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T13:17:49.239 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-09T13:17:49.272 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-09T13:17:53.241 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T13:17:53.273 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T13:17:53.352 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-09T13:17:53.382 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-09T13:17:53.453 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-10-09T13:17:53.483 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-09T13:17:53.588 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6715.138838291168 failure_reason: '"1696856325.3261294 mon.a (mon.0) 1797 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-10-09T13:17:53.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T13:17:53.669 INFO:teuthology.run:FAIL